2024-09-10T08:18:08.723 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T08:18:08.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T08:18:08.853 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898918 branch: wip-rishabh-testing-20240909.165402-squid description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} email: null first_in_suite: false job_id: '7898918' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240909.165402-squid ceph: cephfs: fs: - name: a - name: b session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 filestore flush min: 0 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - overall HEALTH_ - \(MON_DOWN\) - SLOW_OPS - slow request sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: cephfs_name: a client.1: cephfs_name: b install: ceph: flavor: default sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b kclient: client.0: cephfs_name: a client.1: cephfs_name: b selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240909.165402-squid sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 9893 sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b sleep_before_teardown: 0 subset: 197/1024 suite: fs suite_branch: wip-rishabh-testing-20240909.165402-squid suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi103.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNCaTmmASN5j8ztCf8LQsXuH44qV3dDJmJcoSH3w6ZmP0fP7ihsqaIRgfPHtZdkwuiWvDHxN/u4fU5zE2XACtpg= smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEce2LQq3a0orgSdEjpoQqmr2miW/ehX6m9yaDx/8kb+Tsi6LXWsfEMAK94wzKeN3bAscjFJWihHPSnZpSkTmgA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - mon_thrash: check_mds_failover: true revive_delay: 20 thrash_delay: 10 - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_06:58:10 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T08:18:08.853 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa; will attempt to use it 2024-09-10T08:18:08.854 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks 2024-09-10T08:18:08.854 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T08:18:08.856 INFO:teuthology.task.internal:Checking packages... 2024-09-10T08:18:08.879 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1cf819b7212a6048e92fc78c4eff963344f6d56b' 2024-09-10T08:18:08.879 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T08:18:08.879 INFO:teuthology.packaging:ref: None 2024-09-10T08:18:08.879 INFO:teuthology.packaging:tag: None 2024-09-10T08:18:08.879 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240909.165402-squid 2024-09-10T08:18:08.879 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T08:18:08.879 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240909.165402-squid 2024-09-10T08:18:09.026 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-305.g1cf819b7 2024-09-10T08:18:09.027 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T08:18:09.034 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T08:18:09.034 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T08:18:09.076 INFO:teuthology.task.internal:Saving configuration 2024-09-10T08:18:09.095 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T08:18:09.109 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T08:18:09.135 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898918', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 08:12:40.649449', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNCaTmmASN5j8ztCf8LQsXuH44qV3dDJmJcoSH3w6ZmP0fP7ihsqaIRgfPHtZdkwuiWvDHxN/u4fU5zE2XACtpg='} 2024-09-10T08:18:09.156 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898918', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 08:12:40.650638', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEce2LQq3a0orgSdEjpoQqmr2miW/ehX6m9yaDx/8kb+Tsi6LXWsfEMAK94wzKeN3bAscjFJWihHPSnZpSkTmgA='} 2024-09-10T08:18:09.156 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T08:18:09.164 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-09-10T08:18:09.164 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-09-10T08:18:09.164 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T08:18:09.245 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5ee0ba3be0>, signals=[15]) 2024-09-10T08:18:09.245 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T08:18:09.251 INFO:teuthology.task.internal:Opening connections... 2024-09-10T08:18:09.252 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T08:18:09.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:18:09.332 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T08:18:09.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:18:09.407 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T08:18:09.422 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-09-10T08:18:09.440 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-09-10T08:18:09.440 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-09-10T08:18:09.498 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-09-10T08:18:09.498 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2024-09-10T08:18:09.498 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-09-10T08:18:09.499 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-09-10T08:18:09.499 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2024-09-10T08:18:09.499 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2024-09-10T08:18:09.499 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T08:18:09.499 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-09-10T08:18:09.499 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2024-09-10T08:18:09.499 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T08:18:09.499 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-09-10T08:18:09.499 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T08:18:09.499 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T08:18:09.499 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T08:18:09.500 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-09-10T08:18:09.522 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-09-10T08:18:09.541 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-09-10T08:18:09.541 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-09-10T08:18:09.599 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2024-09-10T08:18:09.599 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2024-09-10T08:18:09.599 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2024-09-10T08:18:09.599 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2024-09-10T08:18:09.599 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2024-09-10T08:18:09.599 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2024-09-10T08:18:09.599 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T08:18:09.599 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2024-09-10T08:18:09.599 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2024-09-10T08:18:09.599 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T08:18:09.600 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2024-09-10T08:18:09.600 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T08:18:09.600 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T08:18:09.600 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T08:18:09.600 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-09-10T08:18:09.622 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T08:18:09.636 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T08:18:09.672 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T08:18:09.673 DEBUG:teuthology.orchestra.run.smithi103:> test '!' -e /home/ubuntu/cephtest 2024-09-10T08:18:09.675 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2024-09-10T08:18:09.692 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T08:18:09.712 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T08:18:09.712 DEBUG:teuthology.orchestra.run.smithi103:> test -z $(ls -A /var/lib/ceph) 2024-09-10T08:18:09.732 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2024-09-10T08:18:09.828 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T08:18:09.878 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T08:18:09.900 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-10T08:18:09.901 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-10T08:18:09.901 DEBUG:teuthology.orchestra.run.smithi103:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T08:18:09.902 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T08:18:09.918 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:18:09.919 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-09-10T08:18:09.920 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:18:09.920 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-09-10T08:18:09.976 INFO:teuthology.orchestra.run.smithi103.stdout:5.14.0-503.el9.x86_64 2024-09-10T08:18:09.977 INFO:teuthology.task.kernel:Running kernel on smithi103: 5.14.0-503.el9.x86_64 2024-09-10T08:18:09.977 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum install -y kernel 2024-09-10T08:18:09.978 INFO:teuthology.orchestra.run.smithi154.stdout:5.14.0-503.el9.x86_64 2024-09-10T08:18:09.978 INFO:teuthology.task.kernel:Running kernel on smithi154: 5.14.0-503.el9.x86_64 2024-09-10T08:18:09.978 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum install -y kernel 2024-09-10T08:18:13.030 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - BaseOS 6.8 MB/s | 8.2 MB 00:01 2024-09-10T08:18:13.074 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 6.1 MB/s | 8.2 MB 00:01 2024-09-10T08:18:14.942 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-10T08:18:17.464 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 20 MB 00:03 2024-09-10T08:18:19.160 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-10T08:18:20.633 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 19 kB 00:00 2024-09-10T08:18:21.565 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-10T08:18:22.814 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-10T08:18:24.332 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-10T08:18:25.311 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-10T08:18:27.187 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-10T08:18:29.185 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T08:18:29.186 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T08:18:29.269 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-10T08:18:29.280 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-10T08:18:29.280 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-09-10T08:18:29.280 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-10T08:18:29.281 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-10T08:18:29.281 INFO:teuthology.orchestra.run.smithi103.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T08:18:29.281 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-10T08:18:29.281 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T08:18:29.281 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T08:18:29.281 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T08:18:29.281 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:18:29.281 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-10T08:18:29.281 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-10T08:18:29.281 INFO:teuthology.orchestra.run.smithi103.stdout:Install 4 Packages 2024-09-10T08:18:29.281 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:18:29.282 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 79 M 2024-09-10T08:18:29.282 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 126 M 2024-09-10T08:18:29.282 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-10T08:18:29.664 INFO:teuthology.orchestra.run.smithi103.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 178 kB/s | 23 kB 00:00 2024-09-10T08:18:30.759 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-10T08:18:32.832 INFO:teuthology.orchestra.run.smithi154.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T08:18:32.832 INFO:teuthology.orchestra.run.smithi154.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T08:18:32.930 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-09-10T08:18:32.939 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-09-10T08:18:32.939 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2024-09-10T08:18:32.939 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-09-10T08:18:32.939 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-09-10T08:18:32.939 INFO:teuthology.orchestra.run.smithi154.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T08:18:32.940 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-09-10T08:18:32.940 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T08:18:32.940 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T08:18:32.940 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T08:18:32.940 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:18:32.940 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-09-10T08:18:32.940 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-09-10T08:18:32.940 INFO:teuthology.orchestra.run.smithi154.stdout:Install 4 Packages 2024-09-10T08:18:32.940 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:18:32.941 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 79 M 2024-09-10T08:18:32.941 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 126 M 2024-09-10T08:18:32.941 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-09-10T08:18:33.293 INFO:teuthology.orchestra.run.smithi154.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 241 kB/s | 23 kB 00:00 2024-09-10T08:18:33.693 INFO:teuthology.orchestra.run.smithi154.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-10T08:18:34.160 INFO:teuthology.orchestra.run.smithi154.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 36 MB/s | 35 MB 00:00 2024-09-10T08:18:34.427 INFO:teuthology.orchestra.run.smithi154.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-10T08:18:34.427 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-09-10T08:18:34.428 INFO:teuthology.orchestra.run.smithi154.stdout:Total 53 MB/s | 79 MB 00:01 2024-09-10T08:18:35.110 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-09-10T08:18:35.451 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-09-10T08:18:35.451 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-09-10T08:18:36.416 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-09-10T08:18:36.416 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-09-10T08:18:36.738 INFO:teuthology.orchestra.run.smithi103.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 2.2 MB/s | 16 MB 00:07 2024-09-10T08:18:38.844 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-09-10T08:18:39.551 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T08:18:39.645 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T08:18:42.455 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T08:18:42.592 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T08:18:42.671 INFO:teuthology.orchestra.run.smithi103.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 2.2 MB/s | 29 MB 00:13 2024-09-10T08:18:43.513 INFO:teuthology.orchestra.run.smithi103.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 2.5 MB/s | 35 MB 00:13 2024-09-10T08:18:43.513 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-10T08:18:43.513 INFO:teuthology.orchestra.run.smithi103.stdout:Total 5.5 MB/s | 79 MB 00:14 2024-09-10T08:18:44.198 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-10T08:18:44.551 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-10T08:18:44.551 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-10T08:18:45.515 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-10T08:18:45.516 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-10T08:18:47.392 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T08:18:47.592 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T08:18:47.991 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-10T08:18:48.676 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T08:18:48.758 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T08:18:51.557 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T08:18:51.693 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T08:18:52.601 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T08:18:56.501 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T08:18:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T08:19:01.574 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T08:19:30.832 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T08:19:30.871 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T08:19:31.211 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T08:19:31.211 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T08:19:31.211 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T08:19:31.211 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T08:19:32.088 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T08:19:32.088 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:19:32.088 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-09-10T08:19:32.088 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T08:19:32.088 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T08:19:32.088 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T08:19:32.088 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T08:19:32.088 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:19:32.088 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-09-10T08:19:32.419 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T08:19:32.552 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T08:19:32.552 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T08:19:32.552 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T08:19:32.552 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T08:19:32.552 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T08:19:32.553 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-10T08:19:32.553 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi154.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T08:19:32.553 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T08:19:32.611 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T08:19:32.612 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T08:19:32.612 DEBUG:teuthology.orchestra.run.smithi154:> sudo rpm -qi grub2-tools 2024-09-10T08:19:32.651 INFO:teuthology.orchestra.run.smithi154.stdout:Name : grub2-tools 2024-09-10T08:19:32.651 INFO:teuthology.orchestra.run.smithi154.stdout:Epoch : 1 2024-09-10T08:19:32.651 INFO:teuthology.orchestra.run.smithi154.stdout:Version : 2.06 2024-09-10T08:19:32.651 INFO:teuthology.orchestra.run.smithi154.stdout:Release : 82.el9 2024-09-10T08:19:32.651 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: x86_64 2024-09-10T08:19:32.651 INFO:teuthology.orchestra.run.smithi154.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T08:19:32.651 INFO:teuthology.orchestra.run.smithi154.stdout:Group : Unspecified 2024-09-10T08:19:32.651 INFO:teuthology.orchestra.run.smithi154.stdout:Size : 8274670 2024-09-10T08:19:32.651 INFO:teuthology.orchestra.run.smithi154.stdout:License : GPLv3+ 2024-09-10T08:19:32.651 INFO:teuthology.orchestra.run.smithi154.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T08:19:32.651 INFO:teuthology.orchestra.run.smithi154.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T08:19:32.652 INFO:teuthology.orchestra.run.smithi154.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T08:19:32.652 INFO:teuthology.orchestra.run.smithi154.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T08:19:32.652 INFO:teuthology.orchestra.run.smithi154.stdout:Packager : builder@centos.org 2024-09-10T08:19:32.652 INFO:teuthology.orchestra.run.smithi154.stdout:Vendor : CentOS 2024-09-10T08:19:32.652 INFO:teuthology.orchestra.run.smithi154.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T08:19:32.652 INFO:teuthology.orchestra.run.smithi154.stdout:Summary : Support tools for GRUB. 2024-09-10T08:19:32.652 INFO:teuthology.orchestra.run.smithi154.stdout:Description : 2024-09-10T08:19:32.652 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:19:32.652 INFO:teuthology.orchestra.run.smithi154.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T08:19:32.652 INFO:teuthology.orchestra.run.smithi154.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T08:19:32.652 INFO:teuthology.orchestra.run.smithi154.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T08:19:32.652 INFO:teuthology.orchestra.run.smithi154.stdout:hardware devices. 2024-09-10T08:19:32.652 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:19:32.652 INFO:teuthology.orchestra.run.smithi154.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T08:19:32.653 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T08:19:32.653 INFO:teuthology.task.kernel:Updating grub on smithi154 to boot 5.14.0-505.el9.x86_64 2024-09-10T08:19:32.654 DEBUG:teuthology.orchestra.run.smithi154:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T08:19:33.258 INFO:teuthology.orchestra.run.smithi154.stderr:Generating grub configuration file ... 2024-09-10T08:19:34.593 INFO:teuthology.orchestra.run.smithi154.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T08:19:34.634 INFO:teuthology.orchestra.run.smithi154.stderr:done 2024-09-10T08:19:34.636 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-09-10T08:19:34.652 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.OPKc0a3i4V 2024-09-10T08:19:34.652 DEBUG:teuthology.orchestra.run.smithi154:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.OPKc0a3i4V 2024-09-10T08:19:34.732 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.OPKc0a3i4V 2024-09-10T08:19:34.877 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.OPKc0a3i4V is 6KB 2024-09-10T08:19:34.926 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.OPKc0a3i4V 2024-09-10T08:19:34.941 DEBUG:teuthology.orchestra.run.smithi154:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T08:19:35.003 INFO:teuthology.orchestra.run.smithi154.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T08:19:35.004 INFO:teuthology.orchestra.run.smithi154.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T08:19:35.004 INFO:teuthology.orchestra.run.smithi154.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T08:19:35.004 INFO:teuthology.orchestra.run.smithi154.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T08:19:35.005 DEBUG:teuthology.orchestra.run.smithi154:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T08:19:35.160 DEBUG:teuthology.orchestra.run.smithi154:> sudo shutdown -r now 2024-09-10T08:19:39.803 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T08:19:39.843 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T08:19:40.246 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T08:19:40.246 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T08:19:40.246 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T08:19:40.246 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T08:19:41.141 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T08:19:41.141 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:19:41.142 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-10T08:19:41.142 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T08:19:41.142 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T08:19:41.142 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T08:19:41.142 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T08:19:41.142 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:19:41.142 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-10T08:19:41.468 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T08:19:41.554 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T08:19:41.555 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T08:19:41.555 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T08:19:41.555 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T08:19:41.555 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T08:19:41.555 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-10T08:19:41.555 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi103.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T08:19:41.555 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T08:19:41.614 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T08:19:41.614 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T08:19:41.614 DEBUG:teuthology.orchestra.run.smithi103:> sudo rpm -qi grub2-tools 2024-09-10T08:19:41.646 INFO:teuthology.orchestra.run.smithi103.stdout:Name : grub2-tools 2024-09-10T08:19:41.646 INFO:teuthology.orchestra.run.smithi103.stdout:Epoch : 1 2024-09-10T08:19:41.646 INFO:teuthology.orchestra.run.smithi103.stdout:Version : 2.06 2024-09-10T08:19:41.646 INFO:teuthology.orchestra.run.smithi103.stdout:Release : 82.el9 2024-09-10T08:19:41.646 INFO:teuthology.orchestra.run.smithi103.stdout:Architecture: x86_64 2024-09-10T08:19:41.646 INFO:teuthology.orchestra.run.smithi103.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T08:19:41.646 INFO:teuthology.orchestra.run.smithi103.stdout:Group : Unspecified 2024-09-10T08:19:41.646 INFO:teuthology.orchestra.run.smithi103.stdout:Size : 8274670 2024-09-10T08:19:41.646 INFO:teuthology.orchestra.run.smithi103.stdout:License : GPLv3+ 2024-09-10T08:19:41.646 INFO:teuthology.orchestra.run.smithi103.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T08:19:41.647 INFO:teuthology.orchestra.run.smithi103.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T08:19:41.647 INFO:teuthology.orchestra.run.smithi103.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T08:19:41.647 INFO:teuthology.orchestra.run.smithi103.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T08:19:41.647 INFO:teuthology.orchestra.run.smithi103.stdout:Packager : builder@centos.org 2024-09-10T08:19:41.647 INFO:teuthology.orchestra.run.smithi103.stdout:Vendor : CentOS 2024-09-10T08:19:41.647 INFO:teuthology.orchestra.run.smithi103.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T08:19:41.647 INFO:teuthology.orchestra.run.smithi103.stdout:Summary : Support tools for GRUB. 2024-09-10T08:19:41.647 INFO:teuthology.orchestra.run.smithi103.stdout:Description : 2024-09-10T08:19:41.647 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:19:41.647 INFO:teuthology.orchestra.run.smithi103.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T08:19:41.647 INFO:teuthology.orchestra.run.smithi103.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T08:19:41.647 INFO:teuthology.orchestra.run.smithi103.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T08:19:41.647 INFO:teuthology.orchestra.run.smithi103.stdout:hardware devices. 2024-09-10T08:19:41.648 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:19:41.648 INFO:teuthology.orchestra.run.smithi103.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T08:19:41.649 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T08:19:41.649 INFO:teuthology.task.kernel:Updating grub on smithi103 to boot 5.14.0-505.el9.x86_64 2024-09-10T08:19:41.649 DEBUG:teuthology.orchestra.run.smithi103:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T08:19:42.337 INFO:teuthology.orchestra.run.smithi103.stderr:Generating grub configuration file ... 2024-09-10T08:19:43.659 INFO:teuthology.orchestra.run.smithi103.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T08:19:43.695 INFO:teuthology.orchestra.run.smithi103.stderr:done 2024-09-10T08:19:43.697 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-09-10T08:19:43.713 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.BrZwc1Wewn 2024-09-10T08:19:43.713 DEBUG:teuthology.orchestra.run.smithi103:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.BrZwc1Wewn 2024-09-10T08:19:43.781 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.BrZwc1Wewn 2024-09-10T08:19:43.916 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.BrZwc1Wewn is 6KB 2024-09-10T08:19:43.965 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.BrZwc1Wewn 2024-09-10T08:19:43.980 DEBUG:teuthology.orchestra.run.smithi103:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T08:19:44.042 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T08:19:44.042 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T08:19:44.043 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T08:19:44.043 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T08:19:44.044 DEBUG:teuthology.orchestra.run.smithi103:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T08:19:44.188 DEBUG:teuthology.orchestra.run.smithi103:> sudo shutdown -r now 2024-09-10T08:20:05.183 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-10T08:20:05.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-10T08:20:05.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:20:14.198 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-10T08:20:14.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-10T08:20:14.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:20:23.741 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-09-10T08:20:32.701 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-10T08:20:32.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-10T08:20:32.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:20:35.805 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-09-10T08:20:41.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-10T08:20:41.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:20:44.765 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-10T08:20:47.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-10T08:20:47.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:20:56.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-10T08:20:56.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:20:59.837 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-10T08:21:06.241 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-09-10T08:21:14.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-10T08:21:14.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:21:21.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-10T08:21:21.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:21:21.647 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-09-10T08:21:22.080 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-10T08:21:22.080 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-10T08:21:22.080 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-09-10T08:21:22.095 INFO:teuthology.orchestra.run.smithi154.stdout:5.14.0-505.el9.x86_64 2024-09-10T08:21:22.095 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T08:21:22.095 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T08:21:22.095 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T08:21:23.096 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-10T08:21:23.096 DEBUG:teuthology.orchestra.run.smithi154:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T08:21:23.170 INFO:teuthology.orchestra.run.smithi154.stdout:ttyS1 2024-09-10T08:21:23.193 DEBUG:teuthology.parallel:result is None 2024-09-10T08:21:33.377 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-10T08:21:51.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-10T08:21:51.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:21:51.713 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-10T08:21:52.037 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-10T08:21:52.037 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-10T08:21:52.038 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-09-10T08:21:52.053 INFO:teuthology.orchestra.run.smithi103.stdout:5.14.0-505.el9.x86_64 2024-09-10T08:21:52.053 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T08:21:52.053 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T08:21:52.053 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T08:21:53.054 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-10T08:21:53.054 DEBUG:teuthology.orchestra.run.smithi103:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T08:21:53.128 INFO:teuthology.orchestra.run.smithi103.stdout:ttyS1 2024-09-10T08:21:53.146 DEBUG:teuthology.parallel:result is None 2024-09-10T08:21:53.146 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T08:21:53.155 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T08:21:53.155 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T08:21:53.158 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T08:21:53.178 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T08:21:53.196 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T08:21:53.229 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T08:21:53.230 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T08:21:53.233 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T08:21:53.268 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T08:21:53.274 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T08:21:53.274 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T08:21:53.305 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T08:21:53.336 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T08:21:53.347 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T08:21:53.349 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T08:21:53.361 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T08:21:53.363 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T08:21:53.370 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T08:21:53.370 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T08:21:53.373 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T08:21:53.417 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T08:21:53.427 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T08:21:53.427 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T08:21:53.441 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T08:21:53.473 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T08:21:53.540 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T08:21:53.593 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T08:21:53.674 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T08:21:53.717 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:21:53.717 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T08:21:53.783 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T08:21:53.825 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T08:21:53.901 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T08:21:53.943 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T08:21:53.984 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:21:53.984 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T08:21:54.050 DEBUG:teuthology.orchestra.run.smithi103:> sudo service rsyslog restart 2024-09-10T08:21:54.053 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2024-09-10T08:21:54.091 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T08:21:54.147 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T08:21:54.675 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T08:21:54.683 INFO:teuthology.task.internal:Starting timer... 2024-09-10T08:21:54.683 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T08:21:54.725 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T08:21:54.757 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-10T08:21:54.757 DEBUG:teuthology.orchestra.run.smithi103:> sudo service auditd rotate 2024-09-10T08:21:54.833 INFO:teuthology.orchestra.run.smithi103.stdout:Rotating logs: 2024-09-10T08:21:54.835 DEBUG:teuthology.orchestra.run.smithi154:> sudo service auditd rotate 2024-09-10T08:21:54.901 INFO:teuthology.orchestra.run.smithi154.stdout:Rotating logs: 2024-09-10T08:21:54.902 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T08:21:54.903 DEBUG:teuthology.orchestra.run.smithi103:> /usr/sbin/getenforce 2024-09-10T08:21:54.933 INFO:teuthology.orchestra.run.smithi103.stdout:Permissive 2024-09-10T08:21:54.933 DEBUG:teuthology.orchestra.run.smithi154:> /usr/sbin/getenforce 2024-09-10T08:21:54.960 INFO:teuthology.orchestra.run.smithi154.stdout:Permissive 2024-09-10T08:21:54.961 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi103.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi154.front.sepia.ceph.com': 'permissive'} 2024-09-10T08:21:54.961 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T08:21:54.999 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:21:55.000 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T08:21:55.027 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:21:55.027 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T08:21:55.027 DEBUG:teuthology.orchestra.run.smithi103:> sudo /usr/sbin/setenforce permissive 2024-09-10T08:21:55.075 DEBUG:teuthology.orchestra.run.smithi154:> sudo /usr/sbin/setenforce permissive 2024-09-10T08:21:55.107 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T08:21:55.116 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-10T08:21:55.120 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-10T08:21:55.241 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T08:21:55.252 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T08:21:55.253 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi103.front.sepia.ceph.com,smithi154.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T08:25:38.039 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi103.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com')] 2024-09-10T08:25:38.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-10T08:25:38.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:25:38.118 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-10T08:25:38.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-10T08:25:38.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-10T08:25:38.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:25:38.275 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-09-10T08:25:38.353 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-10T08:25:38.353 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T08:25:38.364 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T08:25:38.365 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T08:25:38.365 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T08:25:38.368 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T08:25:38.368 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T08:25:38.394 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T08:25:38.408 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T08:25:38.424 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T08:25:38.432 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: ntpd: command not found 2024-09-10T08:25:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T08:25:38.443 INFO:teuthology.orchestra.run.smithi103.stdout:506 Cannot talk to daemon 2024-09-10T08:25:38.457 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T08:25:38.464 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: ntpd: command not found 2024-09-10T08:25:38.471 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T08:25:38.475 INFO:teuthology.orchestra.run.smithi154.stdout:506 Cannot talk to daemon 2024-09-10T08:25:38.490 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T08:25:38.504 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T08:25:38.529 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-09-10T08:25:38.532 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T08:25:38.532 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-09-10T08:25:38.532 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:25:38.532 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:25:38.532 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:25:38.532 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:25:38.562 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-09-10T08:25:38.565 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T08:25:38.565 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-09-10T08:25:38.565 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:25:38.565 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:25:38.565 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:25:38.565 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:25:38.566 INFO:teuthology.run_tasks:Running task install... 2024-09-10T08:25:38.574 DEBUG:teuthology.task.install:project ceph 2024-09-10T08:25:38.574 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}} 2024-09-10T08:25:38.574 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'} 2024-09-10T08:25:38.575 INFO:teuthology.task.install:Using flavor: default 2024-09-10T08:25:38.580 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T08:25:38.580 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T08:25:38.581 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T08:25:38.581 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T08:25:38.583 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T08:25:38.583 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T08:25:38.730 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T08:25:38.730 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T08:25:38.733 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T08:25:38.733 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T08:25:38.839 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T08:25:38.839 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:25:38.839 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T08:25:38.846 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T08:25:38.846 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:25:38.847 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T08:25:38.866 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T08:25:38.866 DEBUG:teuthology.orchestra.run.smithi103:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T08:25:38.873 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T08:25:38.873 DEBUG:teuthology.orchestra.run.smithi154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T08:25:38.932 DEBUG:teuthology.orchestra.run.smithi103:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T08:25:38.939 DEBUG:teuthology.orchestra.run.smithi154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T08:25:39.008 DEBUG:teuthology.orchestra.run.smithi103:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T08:25:39.015 DEBUG:teuthology.orchestra.run.smithi154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T08:25:39.072 INFO:teuthology.orchestra.run.smithi103.stdout:check_obsoletes = 1 2024-09-10T08:25:39.073 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum clean all 2024-09-10T08:25:39.079 INFO:teuthology.orchestra.run.smithi154.stdout:check_obsoletes = 1 2024-09-10T08:25:39.081 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum clean all 2024-09-10T08:25:39.316 INFO:teuthology.orchestra.run.smithi103.stdout:45 files removed 2024-09-10T08:25:39.318 INFO:teuthology.orchestra.run.smithi154.stdout:45 files removed 2024-09-10T08:25:39.343 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T08:25:39.346 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T08:25:39.891 INFO:teuthology.orchestra.run.smithi103.stdout:ceph packages for x86_64 315 kB/s | 84 kB 00:00 2024-09-10T08:25:39.912 INFO:teuthology.orchestra.run.smithi154.stdout:ceph packages for x86_64 297 kB/s | 84 kB 00:00 2024-09-10T08:25:40.175 INFO:teuthology.orchestra.run.smithi103.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-10T08:25:40.196 INFO:teuthology.orchestra.run.smithi154.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-10T08:25:40.459 INFO:teuthology.orchestra.run.smithi103.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-10T08:25:40.472 INFO:teuthology.orchestra.run.smithi154.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-10T08:25:42.213 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.2 MB 00:01 2024-09-10T08:25:42.409 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.2 MB 00:01 2024-09-10T08:25:44.303 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-10T08:25:47.872 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 20 MB 00:04 2024-09-10T08:25:48.537 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-10T08:25:50.355 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-10T08:25:51.143 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-10T08:25:53.423 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-10T08:25:55.632 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:00 2024-09-10T08:25:56.507 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2024-09-10T08:25:56.711 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-10T08:25:58.867 INFO:teuthology.orchestra.run.smithi103.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T08:25:58.867 INFO:teuthology.orchestra.run.smithi103.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T08:25:58.878 INFO:teuthology.orchestra.run.smithi103.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T08:25:58.879 INFO:teuthology.orchestra.run.smithi103.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T08:25:58.880 INFO:teuthology.orchestra.run.smithi103.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T08:25:58.881 INFO:teuthology.orchestra.run.smithi103.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T08:25:58.882 INFO:teuthology.orchestra.run.smithi103.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T08:25:58.885 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T08:25:58.885 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T08:25:58.947 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-10T08:25:58.975 INFO:teuthology.orchestra.run.smithi103.stdout:====================================================================================== 2024-09-10T08:25:58.975 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-10T08:25:58.975 INFO:teuthology.orchestra.run.smithi103.stdout:====================================================================================== 2024-09-10T08:25:58.975 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-10T08:25:58.975 INFO:teuthology.orchestra.run.smithi103.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T08:25:58.975 INFO:teuthology.orchestra.run.smithi103.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T08:25:58.975 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T08:25:58.976 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T08:25:58.976 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T08:25:58.976 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T08:25:58.976 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T08:25:58.976 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T08:25:58.976 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T08:25:58.976 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T08:25:58.976 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T08:25:58.976 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T08:25:58.976 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T08:25:58.976 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T08:25:58.977 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T08:25:58.977 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T08:25:58.977 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T08:25:58.977 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T08:25:58.977 INFO:teuthology.orchestra.run.smithi103.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T08:25:58.977 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T08:25:58.977 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T08:25:58.977 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T08:25:58.977 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T08:25:58.977 INFO:teuthology.orchestra.run.smithi103.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T08:25:58.977 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T08:25:58.977 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T08:25:58.978 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T08:25:58.978 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T08:25:58.978 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T08:25:58.978 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T08:25:58.978 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T08:25:58.978 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T08:25:58.978 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T08:25:58.978 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T08:25:58.978 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T08:25:58.978 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T08:25:58.978 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T08:25:58.978 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrading: 2024-09-10T08:25:58.978 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T08:25:58.979 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T08:25:58.979 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T08:25:58.979 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T08:25:58.979 INFO:teuthology.orchestra.run.smithi103.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T08:25:58.979 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T08:25:58.979 INFO:teuthology.orchestra.run.smithi103.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T08:25:58.979 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T08:25:58.979 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-10T08:25:58.979 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T08:25:58.979 INFO:teuthology.orchestra.run.smithi103.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T08:25:58.979 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T08:25:58.979 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T08:25:58.979 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T08:25:58.980 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T08:25:58.980 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T08:25:58.980 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T08:25:58.980 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T08:25:58.980 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T08:25:58.980 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T08:25:58.980 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T08:25:58.980 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T08:25:58.980 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T08:25:58.980 INFO:teuthology.orchestra.run.smithi103.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T08:25:58.980 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T08:25:58.980 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T08:25:58.981 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T08:25:58.981 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T08:25:58.981 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T08:25:58.981 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T08:25:58.981 INFO:teuthology.orchestra.run.smithi103.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T08:25:58.981 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T08:25:58.981 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T08:25:58.981 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T08:25:58.981 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T08:25:58.981 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T08:25:58.981 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T08:25:58.981 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T08:25:58.982 INFO:teuthology.orchestra.run.smithi103.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T08:25:58.982 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T08:25:58.982 INFO:teuthology.orchestra.run.smithi103.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T08:25:58.982 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T08:25:58.982 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T08:25:58.982 INFO:teuthology.orchestra.run.smithi103.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T08:25:58.982 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T08:25:58.982 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T08:25:58.982 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T08:25:58.982 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T08:25:58.982 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T08:25:58.982 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T08:25:58.983 INFO:teuthology.orchestra.run.smithi103.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T08:25:58.983 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T08:25:58.983 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T08:25:58.983 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T08:25:58.983 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T08:25:58.983 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T08:25:58.983 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T08:25:58.983 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T08:25:58.983 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T08:25:58.983 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T08:25:58.983 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T08:25:58.983 INFO:teuthology.orchestra.run.smithi103.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T08:25:58.983 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T08:25:58.984 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T08:25:58.984 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T08:25:58.984 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T08:25:58.984 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T08:25:58.984 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T08:25:58.984 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T08:25:58.984 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T08:25:58.984 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T08:25:58.984 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T08:25:58.984 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T08:25:58.984 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T08:25:58.984 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T08:25:58.985 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T08:25:58.985 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T08:25:58.985 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T08:25:58.985 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T08:25:58.985 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T08:25:58.985 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T08:25:58.985 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T08:25:58.985 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T08:25:58.985 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T08:25:58.985 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T08:25:58.985 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T08:25:58.985 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T08:25:58.985 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T08:25:58.986 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T08:25:58.986 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T08:25:58.986 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T08:25:58.986 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T08:25:58.986 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T08:25:58.986 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T08:25:58.986 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T08:25:58.986 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T08:25:58.986 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T08:25:58.986 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T08:25:58.986 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T08:25:58.986 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T08:25:58.987 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T08:25:58.987 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T08:25:58.987 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T08:25:58.987 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T08:25:58.987 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T08:25:58.987 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T08:25:58.987 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T08:25:58.987 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T08:25:58.987 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T08:25:58.987 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T08:25:58.987 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T08:25:58.987 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T08:25:58.988 INFO:teuthology.orchestra.run.smithi103.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T08:25:58.988 INFO:teuthology.orchestra.run.smithi103.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T08:25:58.988 INFO:teuthology.orchestra.run.smithi103.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T08:25:58.988 INFO:teuthology.orchestra.run.smithi103.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T08:25:58.988 INFO:teuthology.orchestra.run.smithi103.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T08:25:58.988 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T08:25:58.988 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T08:25:58.988 INFO:teuthology.orchestra.run.smithi103.stdout:Installing weak dependencies: 2024-09-10T08:25:58.988 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T08:25:58.988 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:25:58.988 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-10T08:25:58.988 INFO:teuthology.orchestra.run.smithi103.stdout:====================================================================================== 2024-09-10T08:25:58.988 INFO:teuthology.orchestra.run.smithi103.stdout:Install 148 Packages 2024-09-10T08:25:58.989 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrade 8 Packages 2024-09-10T08:25:58.989 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:25:58.989 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 226 M 2024-09-10T08:25:58.989 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-10T08:25:59.384 INFO:teuthology.orchestra.run.smithi103.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 41 kB/s | 6.5 kB 00:00 2024-09-10T08:25:59.900 INFO:teuthology.orchestra.run.smithi103.stdout:(2/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 8.0 MB/s | 5.4 MB 00:00 2024-09-10T08:25:59.934 INFO:teuthology.orchestra.run.smithi103.stdout:(3/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 1.6 MB/s | 897 kB 00:00 2024-09-10T08:25:59.959 INFO:teuthology.orchestra.run.smithi103.stdout:(4/156): ceph-immutable-object-cache-19.1.1-305 2.4 MB/s | 145 kB 00:00 2024-09-10T08:26:00.077 INFO:teuthology.orchestra.run.smithi103.stdout:(5/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 13 MB/s | 1.5 MB 00:00 2024-09-10T08:26:00.285 INFO:teuthology.orchestra.run.smithi103.stdout:(6/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 23 MB/s | 4.7 MB 00:00 2024-09-10T08:26:00.344 INFO:teuthology.orchestra.run.smithi103.stdout:(7/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 5.8 MB/s | 2.4 MB 00:00 2024-09-10T08:26:01.103 INFO:teuthology.orchestra.run.smithi103.stdout:(8/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86_ 21 MB/s | 17 MB 00:00 2024-09-10T08:26:01.219 INFO:teuthology.orchestra.run.smithi103.stdout:(9/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9. 12 MB/s | 11 MB 00:00 2024-09-10T08:26:01.244 INFO:teuthology.orchestra.run.smithi103.stdout:(10/156): ceph-selinux-19.1.1-305.g1cf819b7.el9 177 kB/s | 25 kB 00:00 2024-09-10T08:26:01.303 INFO:teuthology.orchestra.run.smithi103.stdout:(11/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 3.8 MB/s | 228 kB 00:00 2024-09-10T08:26:01.362 INFO:teuthology.orchestra.run.smithi103.stdout:(12/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 462 kB/s | 27 kB 00:00 2024-09-10T08:26:01.421 INFO:teuthology.orchestra.run.smithi103.stdout:(13/156): libcephfs-devel-19.1.1-305.g1cf819b7. 544 kB/s | 32 kB 00:00 2024-09-10T08:26:01.496 INFO:teuthology.orchestra.run.smithi103.stdout:(14/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 9.8 MB/s | 751 kB 00:00 2024-09-10T08:26:01.563 INFO:teuthology.orchestra.run.smithi103.stdout:(15/156): libcephsqlite-19.1.1-305.g1cf819b7.el 2.4 MB/s | 164 kB 00:00 2024-09-10T08:26:01.630 INFO:teuthology.orchestra.run.smithi103.stdout:(16/156): librados-devel-19.1.1-305.g1cf819b7.e 1.9 MB/s | 127 kB 00:00 2024-09-10T08:26:01.708 INFO:teuthology.orchestra.run.smithi103.stdout:(17/156): libradosstriper1-19.1.1-305.g1cf819b7 6.6 MB/s | 506 kB 00:00 2024-09-10T08:26:02.148 INFO:teuthology.orchestra.run.smithi103.stdout:(18/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 12 MB/s | 5.3 MB 00:00 2024-09-10T08:26:02.189 INFO:teuthology.orchestra.run.smithi103.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 1.1 MB/s | 45 kB 00:00 2024-09-10T08:26:02.199 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-10T08:26:02.281 INFO:teuthology.orchestra.run.smithi103.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 1.4 MB/s | 136 kB 00:00 2024-09-10T08:26:02.382 INFO:teuthology.orchestra.run.smithi103.stdout:(21/156): python3-cephfs-19.1.1-305.g1cf819b7.e 1.6 MB/s | 161 kB 00:00 2024-09-10T08:26:02.490 INFO:teuthology.orchestra.run.smithi103.stdout:(22/156): python3-rados-19.1.1-305.g1cf819b7.el 2.9 MB/s | 320 kB 00:00 2024-09-10T08:26:02.958 INFO:teuthology.orchestra.run.smithi103.stdout:(23/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 28 MB/s | 49 MB 00:01 2024-09-10T08:26:03.166 INFO:teuthology.orchestra.run.smithi103.stdout:(24/156): ceph-common-19.1.1-305.g1cf819b7.el9. 5.4 MB/s | 21 MB 00:03 2024-09-10T08:26:03.191 INFO:teuthology.orchestra.run.smithi103.stdout:(25/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 426 kB/s | 99 kB 00:00 2024-09-10T08:26:03.217 INFO:teuthology.orchestra.run.smithi103.stdout:(26/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 414 kB/s | 301 kB 00:00 2024-09-10T08:26:03.309 INFO:teuthology.orchestra.run.smithi103.stdout:(27/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 600 kB/s | 85 kB 00:00 2024-09-10T08:26:03.334 INFO:teuthology.orchestra.run.smithi103.stdout:(28/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 1.4 MB/s | 170 kB 00:00 2024-09-10T08:26:03.351 INFO:teuthology.orchestra.run.smithi103.stdout:(29/156): ceph-grafana-dashboards-19.1.1-305.g1 761 kB/s | 32 kB 00:00 2024-09-10T08:26:03.385 INFO:teuthology.orchestra.run.smithi103.stdout:(30/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 2.8 MB/s | 146 kB 00:00 2024-09-10T08:26:03.452 INFO:teuthology.orchestra.run.smithi103.stdout:(31/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 12 MB/s | 3.1 MB 00:00 2024-09-10T08:26:03.510 INFO:teuthology.orchestra.run.smithi103.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 4.2 MB/s | 249 kB 00:00 2024-09-10T08:26:03.577 INFO:teuthology.orchestra.run.smithi103.stdout:(33/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 741 kB/s | 49 kB 00:00 2024-09-10T08:26:03.653 INFO:teuthology.orchestra.run.smithi103.stdout:(34/156): ceph-prometheus-alerts-19.1.1-305.g1c 220 kB/s | 16 kB 00:00 2024-09-10T08:26:03.753 INFO:teuthology.orchestra.run.smithi103.stdout:(35/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 2.8 MB/s | 285 kB 00:00 2024-09-10T08:26:04.012 INFO:teuthology.orchestra.run.smithi103.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 12 MB/s | 7.4 MB 00:00 2024-09-10T08:26:04.070 INFO:teuthology.orchestra.run.smithi103.stdout:(37/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 5.0 MB/s | 3.6 MB 00:00 2024-09-10T08:26:04.096 INFO:teuthology.orchestra.run.smithi103.stdout:(38/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 219 kB/s | 18 kB 00:00 2024-09-10T08:26:04.246 INFO:teuthology.orchestra.run.smithi103.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 456 kB/s | 80 kB 00:00 2024-09-10T08:26:04.338 INFO:teuthology.orchestra.run.smithi103.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-10T08:26:04.372 INFO:teuthology.orchestra.run.smithi103.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-10T08:26:04.430 INFO:teuthology.orchestra.run.smithi103.stdout:(42/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 1.1 MB/s | 766 kB 00:00 2024-09-10T08:26:04.464 INFO:teuthology.orchestra.run.smithi103.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-10T08:26:04.531 INFO:teuthology.orchestra.run.smithi103.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-10T08:26:04.535 INFO:teuthology.orchestra.run.smithi154.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T08:26:04.536 INFO:teuthology.orchestra.run.smithi154.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T08:26:04.547 INFO:teuthology.orchestra.run.smithi154.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T08:26:04.548 INFO:teuthology.orchestra.run.smithi154.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T08:26:04.549 INFO:teuthology.orchestra.run.smithi154.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T08:26:04.550 INFO:teuthology.orchestra.run.smithi154.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T08:26:04.551 INFO:teuthology.orchestra.run.smithi154.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T08:26:04.554 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T08:26:04.554 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T08:26:04.590 INFO:teuthology.orchestra.run.smithi103.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-10T08:26:04.617 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-09-10T08:26:04.632 INFO:teuthology.orchestra.run.smithi103.stdout:(46/156): python3-ply-3.11-14.el9.noarch.rpm 530 kB/s | 106 kB 00:00 2024-09-10T08:26:04.639 INFO:teuthology.orchestra.run.smithi154.stdout:====================================================================================== 2024-09-10T08:26:04.639 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2024-09-10T08:26:04.639 INFO:teuthology.orchestra.run.smithi154.stdout:====================================================================================== 2024-09-10T08:26:04.639 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-09-10T08:26:04.640 INFO:teuthology.orchestra.run.smithi154.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T08:26:04.640 INFO:teuthology.orchestra.run.smithi154.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T08:26:04.640 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T08:26:04.640 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T08:26:04.640 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T08:26:04.640 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T08:26:04.640 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T08:26:04.640 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T08:26:04.640 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T08:26:04.640 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T08:26:04.640 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T08:26:04.640 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T08:26:04.641 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T08:26:04.641 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T08:26:04.641 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T08:26:04.641 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T08:26:04.641 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T08:26:04.641 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T08:26:04.641 INFO:teuthology.orchestra.run.smithi154.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T08:26:04.641 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T08:26:04.641 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T08:26:04.641 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T08:26:04.641 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T08:26:04.641 INFO:teuthology.orchestra.run.smithi154.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T08:26:04.642 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T08:26:04.642 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T08:26:04.642 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T08:26:04.642 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T08:26:04.642 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T08:26:04.642 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T08:26:04.642 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T08:26:04.642 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T08:26:04.642 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T08:26:04.642 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T08:26:04.642 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T08:26:04.642 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T08:26:04.642 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T08:26:04.643 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2024-09-10T08:26:04.643 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T08:26:04.643 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T08:26:04.643 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T08:26:04.643 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T08:26:04.643 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T08:26:04.643 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T08:26:04.643 INFO:teuthology.orchestra.run.smithi154.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T08:26:04.643 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T08:26:04.643 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-09-10T08:26:04.643 INFO:teuthology.orchestra.run.smithi154.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T08:26:04.644 INFO:teuthology.orchestra.run.smithi154.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T08:26:04.644 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T08:26:04.644 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T08:26:04.644 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T08:26:04.644 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T08:26:04.644 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T08:26:04.644 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T08:26:04.644 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T08:26:04.644 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T08:26:04.644 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T08:26:04.644 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T08:26:04.644 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T08:26:04.645 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T08:26:04.645 INFO:teuthology.orchestra.run.smithi154.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T08:26:04.645 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T08:26:04.645 INFO:teuthology.orchestra.run.smithi154.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T08:26:04.645 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T08:26:04.645 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T08:26:04.645 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T08:26:04.645 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T08:26:04.645 INFO:teuthology.orchestra.run.smithi154.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T08:26:04.645 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T08:26:04.645 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T08:26:04.645 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T08:26:04.646 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T08:26:04.646 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T08:26:04.646 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T08:26:04.646 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T08:26:04.646 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T08:26:04.646 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T08:26:04.646 INFO:teuthology.orchestra.run.smithi154.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T08:26:04.646 INFO:teuthology.orchestra.run.smithi154.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T08:26:04.646 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T08:26:04.646 INFO:teuthology.orchestra.run.smithi154.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T08:26:04.646 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T08:26:04.646 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T08:26:04.646 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T08:26:04.647 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T08:26:04.647 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T08:26:04.647 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T08:26:04.647 INFO:teuthology.orchestra.run.smithi154.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T08:26:04.647 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T08:26:04.647 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T08:26:04.647 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T08:26:04.647 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T08:26:04.647 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T08:26:04.647 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T08:26:04.647 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T08:26:04.647 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T08:26:04.647 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T08:26:04.647 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T08:26:04.648 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T08:26:04.648 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T08:26:04.648 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T08:26:04.648 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T08:26:04.648 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T08:26:04.648 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T08:26:04.648 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T08:26:04.648 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T08:26:04.648 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T08:26:04.648 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T08:26:04.648 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T08:26:04.648 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T08:26:04.648 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T08:26:04.649 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T08:26:04.649 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T08:26:04.649 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T08:26:04.649 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T08:26:04.649 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T08:26:04.649 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T08:26:04.649 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T08:26:04.649 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T08:26:04.649 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T08:26:04.649 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T08:26:04.649 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T08:26:04.649 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T08:26:04.650 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T08:26:04.650 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T08:26:04.650 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T08:26:04.650 INFO:teuthology.orchestra.run.smithi154.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T08:26:04.650 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T08:26:04.650 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T08:26:04.650 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T08:26:04.650 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T08:26:04.650 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T08:26:04.650 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T08:26:04.650 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T08:26:04.650 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T08:26:04.651 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T08:26:04.651 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T08:26:04.651 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T08:26:04.651 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T08:26:04.651 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T08:26:04.651 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T08:26:04.651 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T08:26:04.651 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T08:26:04.651 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T08:26:04.651 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T08:26:04.651 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T08:26:04.651 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T08:26:04.651 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T08:26:04.652 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T08:26:04.652 INFO:teuthology.orchestra.run.smithi154.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T08:26:04.652 INFO:teuthology.orchestra.run.smithi154.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T08:26:04.652 INFO:teuthology.orchestra.run.smithi154.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T08:26:04.652 INFO:teuthology.orchestra.run.smithi154.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T08:26:04.652 INFO:teuthology.orchestra.run.smithi154.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T08:26:04.652 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T08:26:04.652 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T08:26:04.652 INFO:teuthology.orchestra.run.smithi154.stdout:Installing weak dependencies: 2024-09-10T08:26:04.652 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T08:26:04.652 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:26:04.652 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-09-10T08:26:04.652 INFO:teuthology.orchestra.run.smithi154.stdout:====================================================================================== 2024-09-10T08:26:04.653 INFO:teuthology.orchestra.run.smithi154.stdout:Install 148 Packages 2024-09-10T08:26:04.653 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 8 Packages 2024-09-10T08:26:04.653 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:26:04.653 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 226 M 2024-09-10T08:26:04.653 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-09-10T08:26:04.657 INFO:teuthology.orchestra.run.smithi103.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-10T08:26:04.732 INFO:teuthology.orchestra.run.smithi103.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 3.4 MB/s | 1.2 MB 00:00 2024-09-10T08:26:04.866 INFO:teuthology.orchestra.run.smithi103.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 802 kB/s | 107 kB 00:00 2024-09-10T08:26:04.916 INFO:teuthology.orchestra.run.smithi103.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-10T08:26:04.942 INFO:teuthology.orchestra.run.smithi103.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-10T08:26:04.992 INFO:teuthology.orchestra.run.smithi103.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-09-10T08:26:05.017 INFO:teuthology.orchestra.run.smithi103.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 434 kB/s | 33 kB 00:00 2024-09-10T08:26:05.042 INFO:teuthology.orchestra.run.smithi103.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-10T08:26:05.067 INFO:teuthology.orchestra.run.smithi103.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-10T08:26:05.068 INFO:teuthology.orchestra.run.smithi154.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 43 kB/s | 6.5 kB 00:00 2024-09-10T08:26:05.093 INFO:teuthology.orchestra.run.smithi103.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-10T08:26:05.143 INFO:teuthology.orchestra.run.smithi103.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 909 kB/s | 45 kB 00:00 2024-09-10T08:26:05.169 INFO:teuthology.orchestra.run.smithi103.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-09-10T08:26:05.335 INFO:teuthology.orchestra.run.smithi103.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-09-10T08:26:05.401 INFO:teuthology.orchestra.run.smithi154.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 2.6 MB/s | 897 kB 00:00 2024-09-10T08:26:05.402 INFO:teuthology.orchestra.run.smithi103.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 2.4 MB/s | 581 kB 00:00 2024-09-10T08:26:05.444 INFO:teuthology.orchestra.run.smithi103.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-10T08:26:05.461 INFO:teuthology.orchestra.run.smithi103.stdout:(62/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 195 kB/s | 24 kB 00:00 2024-09-10T08:26:05.476 INFO:teuthology.orchestra.run.smithi154.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 1.9 MB/s | 145 kB 00:00 2024-09-10T08:26:05.586 INFO:teuthology.orchestra.run.smithi103.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-10T08:26:05.612 INFO:teuthology.orchestra.run.smithi103.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-10T08:26:05.662 INFO:teuthology.orchestra.run.smithi103.stdout:(65/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.5 MB/s | 3.0 MB 00:00 2024-09-10T08:26:05.687 INFO:teuthology.orchestra.run.smithi103.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 382 kB/s | 38 kB 00:00 2024-09-10T08:26:06.043 INFO:teuthology.orchestra.run.smithi154.stdout:(4/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 4.8 MB/s | 5.4 MB 00:01 2024-09-10T08:26:06.093 INFO:teuthology.orchestra.run.smithi154.stdout:(5/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 3.9 MB/s | 2.4 MB 00:00 2024-09-10T08:26:06.171 INFO:teuthology.orchestra.run.smithi103.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 3.3 MB/s | 1.6 MB 00:00 2024-09-10T08:26:06.194 INFO:teuthology.orchestra.run.smithi154.stdout:(6/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 10 MB/s | 1.5 MB 00:00 2024-09-10T08:26:06.438 INFO:teuthology.orchestra.run.smithi103.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 5.7 MB/s | 4.4 MB 00:00 2024-09-10T08:26:06.472 INFO:teuthology.orchestra.run.smithi103.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 3.0 MB/s | 910 kB 00:00 2024-09-10T08:26:06.497 INFO:teuthology.orchestra.run.smithi103.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-10T08:26:06.544 INFO:teuthology.orchestra.run.smithi154.stdout:(7/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 10 MB/s | 4.7 MB 00:00 2024-09-10T08:26:06.673 INFO:teuthology.orchestra.run.smithi103.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 5.8 MB/s | 1.0 MB 00:00 2024-09-10T08:26:06.773 INFO:teuthology.orchestra.run.smithi103.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 876 kB/s | 87 kB 00:00 2024-09-10T08:26:06.990 INFO:teuthology.orchestra.run.smithi103.stdout:(73/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.6 MB/s | 4.9 MB 00:01 2024-09-10T08:26:07.048 INFO:teuthology.orchestra.run.smithi103.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-10T08:26:07.119 INFO:teuthology.orchestra.run.smithi154.stdout:(8/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 9.6 MB/s | 21 MB 00:02 2024-09-10T08:26:07.140 INFO:teuthology.orchestra.run.smithi103.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-10T08:26:07.233 INFO:teuthology.orchestra.run.smithi103.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.7 MB/s | 248 kB 00:00 2024-09-10T08:26:07.291 INFO:teuthology.orchestra.run.smithi103.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 440 kB/s | 26 kB 00:00 2024-09-10T08:26:07.294 INFO:teuthology.orchestra.run.smithi154.stdout:(9/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86_ 15 MB/s | 17 MB 00:01 2024-09-10T08:26:07.320 INFO:teuthology.orchestra.run.smithi154.stdout:(10/156): ceph-selinux-19.1.1-305.g1cf819b7.el9 126 kB/s | 25 kB 00:00 2024-09-10T08:26:07.350 INFO:teuthology.orchestra.run.smithi103.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 329 kB/s | 19 kB 00:00 2024-09-10T08:26:07.433 INFO:teuthology.orchestra.run.smithi103.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-10T08:26:07.453 INFO:teuthology.orchestra.run.smithi154.stdout:(11/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 12 MB/s | 11 MB 00:00 2024-09-10T08:26:07.479 INFO:teuthology.orchestra.run.smithi154.stdout:(12/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 1.4 MB/s | 228 kB 00:00 2024-09-10T08:26:07.484 INFO:teuthology.orchestra.run.smithi103.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-09-10T08:26:07.504 INFO:teuthology.orchestra.run.smithi154.stdout:(13/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 540 kB/s | 27 kB 00:00 2024-09-10T08:26:07.529 INFO:teuthology.orchestra.run.smithi154.stdout:(14/156): libcephfs-devel-19.1.1-305.g1cf819b7. 634 kB/s | 32 kB 00:00 2024-09-10T08:26:07.563 INFO:teuthology.orchestra.run.smithi154.stdout:(15/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 13 MB/s | 751 kB 00:00 2024-09-10T08:26:07.588 INFO:teuthology.orchestra.run.smithi154.stdout:(16/156): libcephsqlite-19.1.1-305.g1cf819b7.el 2.7 MB/s | 164 kB 00:00 2024-09-10T08:26:07.613 INFO:teuthology.orchestra.run.smithi154.stdout:(17/156): librados-devel-19.1.1-305.g1cf819b7.e 2.5 MB/s | 127 kB 00:00 2024-09-10T08:26:07.617 INFO:teuthology.orchestra.run.smithi103.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 5.0 MB/s | 5.8 MB 00:01 2024-09-10T08:26:07.647 INFO:teuthology.orchestra.run.smithi154.stdout:(18/156): libradosstriper1-19.1.1-305.g1cf819b7 8.5 MB/s | 506 kB 00:00 2024-09-10T08:26:07.693 INFO:teuthology.orchestra.run.smithi103.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 6.5 MB/s | 6.0 MB 00:00 2024-09-10T08:26:07.705 INFO:teuthology.orchestra.run.smithi154.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 771 kB/s | 45 kB 00:00 2024-09-10T08:26:07.743 INFO:teuthology.orchestra.run.smithi103.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 250 kB 00:00 2024-09-10T08:26:07.768 INFO:teuthology.orchestra.run.smithi103.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-09-10T08:26:07.773 INFO:teuthology.orchestra.run.smithi154.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 2.0 MB/s | 136 kB 00:00 2024-09-10T08:26:07.793 INFO:teuthology.orchestra.run.smithi103.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-10T08:26:07.819 INFO:teuthology.orchestra.run.smithi103.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 839 kB/s | 42 kB 00:00 2024-09-10T08:26:07.848 INFO:teuthology.orchestra.run.smithi154.stdout:(21/156): python3-cephfs-19.1.1-305.g1cf819b7.e 2.1 MB/s | 161 kB 00:00 2024-09-10T08:26:07.869 INFO:teuthology.orchestra.run.smithi103.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-10T08:26:07.894 INFO:teuthology.orchestra.run.smithi103.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-09-10T08:26:07.932 INFO:teuthology.orchestra.run.smithi154.stdout:(22/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 17 MB/s | 5.3 MB 00:00 2024-09-10T08:26:07.945 INFO:teuthology.orchestra.run.smithi103.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-10T08:26:07.957 INFO:teuthology.orchestra.run.smithi154.stdout:(23/156): python3-rados-19.1.1-305.g1cf819b7.el 2.9 MB/s | 320 kB 00:00 2024-09-10T08:26:07.970 INFO:teuthology.orchestra.run.smithi103.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-09-10T08:26:07.982 INFO:teuthology.orchestra.run.smithi154.stdout:(24/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 5.9 MB/s | 301 kB 00:00 2024-09-10T08:26:07.995 INFO:teuthology.orchestra.run.smithi103.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-10T08:26:08.007 INFO:teuthology.orchestra.run.smithi154.stdout:(25/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.9 MB/s | 99 kB 00:00 2024-09-10T08:26:08.033 INFO:teuthology.orchestra.run.smithi154.stdout:(26/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-10T08:26:08.046 INFO:teuthology.orchestra.run.smithi103.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 835 kB/s | 42 kB 00:00 2024-09-10T08:26:08.083 INFO:teuthology.orchestra.run.smithi154.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 3.3 MB/s | 170 kB 00:00 2024-09-10T08:26:08.105 INFO:teuthology.orchestra.run.smithi103.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 753 kB/s | 44 kB 00:00 2024-09-10T08:26:08.158 INFO:teuthology.orchestra.run.smithi154.stdout:(28/156): ceph-grafana-dashboards-19.1.1-305.g1 424 kB/s | 32 kB 00:00 2024-09-10T08:26:08.163 INFO:teuthology.orchestra.run.smithi103.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-10T08:26:08.214 INFO:teuthology.orchestra.run.smithi103.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-10T08:26:08.216 INFO:teuthology.orchestra.run.smithi154.stdout:(29/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 15 MB/s | 3.1 MB 00:00 2024-09-10T08:26:08.234 INFO:teuthology.orchestra.run.smithi154.stdout:(30/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 1.9 MB/s | 146 kB 00:00 2024-09-10T08:26:08.272 INFO:teuthology.orchestra.run.smithi103.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 812 kB/s | 47 kB 00:00 2024-09-10T08:26:08.398 INFO:teuthology.orchestra.run.smithi103.stdout:(97/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.6 MB/s | 5.1 MB 00:00 2024-09-10T08:26:08.423 INFO:teuthology.orchestra.run.smithi103.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.0 MB/s | 304 kB 00:00 2024-09-10T08:26:08.448 INFO:teuthology.orchestra.run.smithi103.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-10T08:26:08.474 INFO:teuthology.orchestra.run.smithi103.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-10T08:26:08.499 INFO:teuthology.orchestra.run.smithi103.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-10T08:26:08.501 INFO:teuthology.orchestra.run.smithi154.stdout:(31/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 13 MB/s | 3.6 MB 00:00 2024-09-10T08:26:08.525 INFO:teuthology.orchestra.run.smithi103.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-10T08:26:08.584 INFO:teuthology.orchestra.run.smithi154.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 2.9 MB/s | 249 kB 00:00 2024-09-10T08:26:08.693 INFO:teuthology.orchestra.run.smithi154.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 16 MB/s | 7.4 MB 00:00 2024-09-10T08:26:08.718 INFO:teuthology.orchestra.run.smithi154.stdout:(34/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 369 kB/s | 49 kB 00:00 2024-09-10T08:26:08.743 INFO:teuthology.orchestra.run.smithi154.stdout:(35/156): ceph-prometheus-alerts-19.1.1-305.g1c 328 kB/s | 16 kB 00:00 2024-09-10T08:26:08.769 INFO:teuthology.orchestra.run.smithi154.stdout:(36/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 5.5 MB/s | 285 kB 00:00 2024-09-10T08:26:08.802 INFO:teuthology.orchestra.run.smithi154.stdout:(37/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 13 MB/s | 766 kB 00:00 2024-09-10T08:26:08.827 INFO:teuthology.orchestra.run.smithi154.stdout:(38/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 313 kB/s | 18 kB 00:00 2024-09-10T08:26:08.961 INFO:teuthology.orchestra.run.smithi154.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 504 kB/s | 80 kB 00:00 2024-09-10T08:26:09.075 INFO:teuthology.orchestra.run.smithi103.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 39 kB/s | 22 kB 00:00 2024-09-10T08:26:09.125 INFO:teuthology.orchestra.run.smithi103.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-10T08:26:09.159 INFO:teuthology.orchestra.run.smithi103.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-10T08:26:09.184 INFO:teuthology.orchestra.run.smithi103.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-10T08:26:09.301 INFO:teuthology.orchestra.run.smithi103.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-10T08:26:09.326 INFO:teuthology.orchestra.run.smithi103.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T08:26:09.352 INFO:teuthology.orchestra.run.smithi103.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T08:26:09.377 INFO:teuthology.orchestra.run.smithi103.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T08:26:09.402 INFO:teuthology.orchestra.run.smithi103.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-10T08:26:09.420 INFO:teuthology.orchestra.run.smithi154.stdout:(40/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 23 MB/s | 49 MB 00:02 2024-09-10T08:26:09.444 INFO:teuthology.orchestra.run.smithi103.stdout:(112/156): protobuf-compiler-3.14.0-13.el9.x86_ 939 kB/s | 863 kB 00:00 2024-09-10T08:26:09.445 INFO:teuthology.orchestra.run.smithi154.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 395 kB/s | 191 kB 00:00 2024-09-10T08:26:09.479 INFO:teuthology.orchestra.run.smithi154.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 801 kB 00:00 2024-09-10T08:26:09.495 INFO:teuthology.orchestra.run.smithi103.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.0 MB/s | 839 kB 00:00 2024-09-10T08:26:09.520 INFO:teuthology.orchestra.run.smithi103.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T08:26:09.545 INFO:teuthology.orchestra.run.smithi103.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-10T08:26:09.562 INFO:teuthology.orchestra.run.smithi154.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-10T08:26:09.571 INFO:teuthology.orchestra.run.smithi103.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 564 kB/s | 14 kB 00:00 2024-09-10T08:26:09.596 INFO:teuthology.orchestra.run.smithi103.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-10T08:26:09.640 INFO:teuthology.orchestra.run.smithi103.stdout:(118/156): python3-asyncssh-2.13.2-5.el9.noarch 2.7 MB/s | 548 kB 00:00 2024-09-10T08:26:09.646 INFO:teuthology.orchestra.run.smithi154.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-10T08:26:09.671 INFO:teuthology.orchestra.run.smithi154.stdout:(45/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-09-10T08:26:09.672 INFO:teuthology.orchestra.run.smithi103.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 9.4 MB/s | 303 kB 00:00 2024-09-10T08:26:09.697 INFO:teuthology.orchestra.run.smithi103.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-09-10T08:26:09.731 INFO:teuthology.orchestra.run.smithi103.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-10T08:26:09.756 INFO:teuthology.orchestra.run.smithi103.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-10T08:26:09.763 INFO:teuthology.orchestra.run.smithi154.stdout:(46/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-10T08:26:09.782 INFO:teuthology.orchestra.run.smithi103.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-10T08:26:09.807 INFO:teuthology.orchestra.run.smithi103.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 712 kB/s | 18 kB 00:00 2024-09-10T08:26:09.832 INFO:teuthology.orchestra.run.smithi103.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 928 kB/s | 23 kB 00:00 2024-09-10T08:26:09.838 INFO:teuthology.orchestra.run.smithi154.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 650 kB/s | 125 kB 00:00 2024-09-10T08:26:09.857 INFO:teuthology.orchestra.run.smithi103.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 782 kB/s | 19 kB 00:00 2024-09-10T08:26:09.871 INFO:teuthology.orchestra.run.smithi154.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 2.9 MB/s | 1.2 MB 00:00 2024-09-10T08:26:09.883 INFO:teuthology.orchestra.run.smithi103.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 786 kB/s | 20 kB 00:00 2024-09-10T08:26:09.933 INFO:teuthology.orchestra.run.smithi103.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 20 MB/s | 1.0 MB 00:00 2024-09-10T08:26:09.959 INFO:teuthology.orchestra.run.smithi103.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T08:26:09.984 INFO:teuthology.orchestra.run.smithi103.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T08:26:10.009 INFO:teuthology.orchestra.run.smithi103.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T08:26:10.060 INFO:teuthology.orchestra.run.smithi103.stdout:(132/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.6 MB/s | 2.0 MB 00:00 2024-09-10T08:26:10.085 INFO:teuthology.orchestra.run.smithi103.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-10T08:26:10.110 INFO:teuthology.orchestra.run.smithi103.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-10T08:26:10.136 INFO:teuthology.orchestra.run.smithi103.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-09-10T08:26:10.161 INFO:teuthology.orchestra.run.smithi103.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-10T08:26:10.186 INFO:teuthology.orchestra.run.smithi103.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-10T08:26:10.212 INFO:teuthology.orchestra.run.smithi103.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T08:26:10.237 INFO:teuthology.orchestra.run.smithi103.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-10T08:26:10.262 INFO:teuthology.orchestra.run.smithi103.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-10T08:26:10.429 INFO:teuthology.orchestra.run.smithi103.stdout:(141/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.6 MB/s | 16 MB 00:02 2024-09-10T08:26:10.455 INFO:teuthology.orchestra.run.smithi103.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 387 kB/s | 74 kB 00:00 2024-09-10T08:26:10.489 INFO:teuthology.orchestra.run.smithi103.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.0 MB/s | 230 kB 00:00 2024-09-10T08:26:10.530 INFO:teuthology.orchestra.run.smithi103.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 504 kB/s | 20 kB 00:00 2024-09-10T08:26:10.547 INFO:teuthology.orchestra.run.smithi154.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 158 kB/s | 107 kB 00:00 2024-09-10T08:26:10.555 INFO:teuthology.orchestra.run.smithi103.stdout:(145/156): python3-websocket-client-1.2.3-2.el9 712 kB/s | 90 kB 00:00 2024-09-10T08:26:10.581 INFO:teuthology.orchestra.run.smithi103.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T08:26:10.615 INFO:teuthology.orchestra.run.smithi103.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.7 MB/s | 427 kB 00:00 2024-09-10T08:26:10.665 INFO:teuthology.orchestra.run.smithi103.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-10T08:26:10.714 INFO:teuthology.orchestra.run.smithi154.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 725 kB/s | 689 kB 00:00 2024-09-10T08:26:10.815 INFO:teuthology.orchestra.run.smithi154.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 966 kB/s | 943 kB 00:00 2024-09-10T08:26:11.140 INFO:teuthology.orchestra.run.smithi154.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 37 kB/s | 22 kB 00:00 2024-09-10T08:26:11.232 INFO:teuthology.orchestra.run.smithi103.stdout:(149/156): librados2-19.1.1-305.g1cf819b7.el9.x 5.3 MB/s | 3.4 MB 00:00 2024-09-10T08:26:11.316 INFO:teuthology.orchestra.run.smithi103.stdout:(150/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 4.5 MB/s | 3.2 MB 00:00 2024-09-10T08:26:11.408 INFO:teuthology.orchestra.run.smithi103.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 3.1 MB/s | 2.3 MB 00:00 2024-09-10T08:26:11.433 INFO:teuthology.orchestra.run.smithi103.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 349 kB/s | 41 kB 00:00 2024-09-10T08:26:11.440 INFO:teuthology.orchestra.run.smithi154.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 53 kB/s | 33 kB 00:00 2024-09-10T08:26:11.523 INFO:teuthology.orchestra.run.smithi154.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 388 kB/s | 313 kB 00:00 2024-09-10T08:26:11.550 INFO:teuthology.orchestra.run.smithi103.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 1.7 MB/s | 249 kB 00:00 2024-09-10T08:26:11.717 INFO:teuthology.orchestra.run.smithi103.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 4.8 MB/s | 1.4 MB 00:00 2024-09-10T08:26:11.967 INFO:teuthology.orchestra.run.smithi103.stdout:(155/156): NetworkManager-libnm-1.49.90-1.el9.x 2.5 MB/s | 1.8 MB 00:00 2024-09-10T08:26:11.990 INFO:teuthology.orchestra.run.smithi154.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 24 kB/s | 11 kB 00:00 2024-09-10T08:26:12.007 INFO:teuthology.orchestra.run.smithi154.stdout:(56/156): flexiblas-openblas-openmp-3.0.4-8.el9 32 kB/s | 18 kB 00:00 2024-09-10T08:26:12.191 INFO:teuthology.orchestra.run.smithi154.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-09-10T08:26:12.616 INFO:teuthology.orchestra.run.smithi154.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 74 kB/s | 45 kB 00:00 2024-09-10T08:26:12.766 INFO:teuthology.orchestra.run.smithi154.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 207 kB/s | 160 kB 00:00 2024-09-10T08:26:12.775 INFO:teuthology.orchestra.run.smithi103.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 2.4 MB 00:01 2024-09-10T08:26:12.783 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-10T08:26:12.783 INFO:teuthology.orchestra.run.smithi103.stdout:Total 16 MB/s | 226 MB 00:13 2024-09-10T08:26:13.058 INFO:teuthology.orchestra.run.smithi154.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 764 kB/s | 662 kB 00:00 2024-09-10T08:26:13.342 INFO:teuthology.orchestra.run.smithi154.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 43 kB/s | 24 kB 00:00 2024-09-10T08:26:13.475 INFO:teuthology.orchestra.run.smithi154.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 677 kB/s | 581 kB 00:00 2024-09-10T08:26:13.634 INFO:teuthology.orchestra.run.smithi154.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-09-10T08:26:14.008 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-10T08:26:14.117 INFO:teuthology.orchestra.run.smithi154.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 377 kB/s | 292 kB 00:00 2024-09-10T08:26:14.160 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-10T08:26:14.160 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-10T08:26:14.201 INFO:teuthology.orchestra.run.smithi154.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 68 kB/s | 38 kB 00:00 2024-09-10T08:26:14.226 INFO:teuthology.orchestra.run.smithi154.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 251 kB/s | 188 kB 00:00 2024-09-10T08:26:15.185 INFO:teuthology.orchestra.run.smithi154.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 1.7 MB/s | 1.6 MB 00:00 2024-09-10T08:26:15.403 INFO:teuthology.orchestra.run.smithi154.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.8 MB/s | 4.9 MB 00:01 2024-09-10T08:26:15.469 INFO:teuthology.orchestra.run.smithi154.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 4.4 MB 00:01 2024-09-10T08:26:16.102 INFO:teuthology.orchestra.run.smithi154.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 196 kB/s | 137 kB 00:00 2024-09-10T08:26:16.385 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-10T08:26:16.386 INFO:teuthology.orchestra.run.smithi154.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 758 kB/s | 910 kB 00:01 2024-09-10T08:26:16.386 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-10T08:26:16.594 INFO:teuthology.orchestra.run.smithi154.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 5.1 MB/s | 5.8 MB 00:01 2024-09-10T08:26:17.053 INFO:teuthology.orchestra.run.smithi154.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-09-10T08:26:17.103 INFO:teuthology.orchestra.run.smithi154.stdout:(74/156): python3-attrs-20.3.0-7.el9.noarch.rpm 122 kB/s | 87 kB 00:00 2024-09-10T08:26:17.670 INFO:teuthology.orchestra.run.smithi154.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 99 kB/s | 61 kB 00:00 2024-09-10T08:26:17.745 INFO:teuthology.orchestra.run.smithi154.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.2 MB/s | 6.0 MB 00:01 2024-09-10T08:26:17.879 INFO:teuthology.orchestra.run.smithi154.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 316 kB/s | 245 kB 00:00 2024-09-10T08:26:18.320 INFO:teuthology.orchestra.run.smithi154.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 45 kB/s | 26 kB 00:00 2024-09-10T08:26:18.371 INFO:teuthology.orchestra.run.smithi154.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 39 kB/s | 19 kB 00:00 2024-09-10T08:26:18.437 INFO:teuthology.orchestra.run.smithi154.stdout:(80/156): python3-jinja2-2.11.3-6.el9.noarch.rp 324 kB/s | 248 kB 00:00 2024-09-10T08:26:18.930 INFO:teuthology.orchestra.run.smithi154.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 62 kB/s | 35 kB 00:00 2024-09-10T08:26:19.030 INFO:teuthology.orchestra.run.smithi154.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 243 kB/s | 172 kB 00:00 2024-09-10T08:26:19.547 INFO:teuthology.orchestra.run.smithi154.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.6 MB/s | 5.1 MB 00:01 2024-09-10T08:26:19.747 INFO:teuthology.orchestra.run.smithi154.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 307 kB/s | 250 kB 00:00 2024-09-10T08:26:19.872 INFO:teuthology.orchestra.run.smithi154.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 264 kB/s | 222 kB 00:00 2024-09-10T08:26:20.214 INFO:teuthology.orchestra.run.smithi154.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 116 kB/s | 77 kB 00:00 2024-09-10T08:26:20.324 INFO:teuthology.orchestra.run.smithi154.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 73 kB/s | 42 kB 00:00 2024-09-10T08:26:20.648 INFO:teuthology.orchestra.run.smithi154.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 348 kB/s | 269 kB 00:00 2024-09-10T08:26:20.923 INFO:teuthology.orchestra.run.smithi154.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 224 kB/s | 159 kB 00:00 2024-09-10T08:26:21.173 INFO:teuthology.orchestra.run.smithi154.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 328 kB/s | 279 kB 00:00 2024-09-10T08:26:21.241 INFO:teuthology.orchestra.run.smithi154.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 86 kB/s | 51 kB 00:00 2024-09-10T08:26:21.590 INFO:teuthology.orchestra.run.smithi154.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 80 kB/s | 54 kB 00:00 2024-09-10T08:26:21.791 INFO:teuthology.orchestra.run.smithi154.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 76 kB/s | 42 kB 00:00 2024-09-10T08:26:22.191 INFO:teuthology.orchestra.run.smithi154.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 74 kB/s | 44 kB 00:00 2024-09-10T08:26:22.600 INFO:teuthology.orchestra.run.smithi154.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-10T08:26:22.624 INFO:teuthology.orchestra.run.smithi154.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 265 kB/s | 221 kB 00:00 2024-09-10T08:26:22.829 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-10T08:26:22.858 INFO:teuthology.orchestra.run.smithi154.stdout:(97/156): qatlib-service-24.02.0-1.el9.x86_64.r 54 kB/s | 36 kB 00:00 2024-09-10T08:26:22.936 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T08:26:22.982 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T08:26:23.036 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T08:26:23.078 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T08:26:23.103 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T08:26:23.153 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T08:26:23.167 INFO:teuthology.orchestra.run.smithi154.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 84 kB/s | 47 kB 00:00 2024-09-10T08:26:23.484 INFO:teuthology.orchestra.run.smithi154.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 354 kB/s | 304 kB 00:00 2024-09-10T08:26:23.500 INFO:teuthology.orchestra.run.smithi154.stdout:(100/156): uuid-1.6.2-55.el9.x86_64.rpm 91 kB/s | 58 kB 00:00 2024-09-10T08:26:23.629 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T08:26:23.688 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T08:26:23.810 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T08:26:23.851 INFO:teuthology.orchestra.run.smithi154.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 140 kB/s | 96 kB 00:00 2024-09-10T08:26:23.864 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T08:26:23.910 INFO:teuthology.orchestra.run.smithi154.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 384 kB/s | 22 kB 00:00 2024-09-10T08:26:23.956 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T08:26:23.987 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T08:26:24.026 INFO:teuthology.orchestra.run.smithi154.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 7.2 MB/s | 863 kB 00:00 2024-09-10T08:26:24.085 INFO:teuthology.orchestra.run.smithi154.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-10T08:26:24.102 INFO:teuthology.orchestra.run.smithi154.stdout:(105/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 103 kB/s | 64 kB 00:00 2024-09-10T08:26:24.118 INFO:teuthology.orchestra.run.smithi154.stdout:(106/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 72 kB/s | 45 kB 00:00 2024-09-10T08:26:24.160 INFO:teuthology.orchestra.run.smithi154.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 4.0 MB/s | 309 kB 00:00 2024-09-10T08:26:24.163 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T08:26:24.177 INFO:teuthology.orchestra.run.smithi154.stdout:(108/156): grpc-data-1.46.7-10.el9.noarch.rpm 262 kB/s | 19 kB 00:00 2024-09-10T08:26:24.194 INFO:teuthology.orchestra.run.smithi154.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 814 kB/s | 26 kB 00:00 2024-09-10T08:26:24.211 INFO:teuthology.orchestra.run.smithi154.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-10T08:26:24.223 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T08:26:24.236 INFO:teuthology.orchestra.run.smithi154.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-10T08:26:24.252 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T08:26:24.262 INFO:teuthology.orchestra.run.smithi154.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-10T08:26:24.304 INFO:teuthology.orchestra.run.smithi154.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-10T08:26:24.337 INFO:teuthology.orchestra.run.smithi154.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-10T08:26:24.346 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T08:26:24.370 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T08:26:24.371 INFO:teuthology.orchestra.run.smithi154.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 648 kB/s | 43 kB 00:00 2024-09-10T08:26:24.396 INFO:teuthology.orchestra.run.smithi154.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 550 kB/s | 32 kB 00:00 2024-09-10T08:26:24.422 INFO:teuthology.orchestra.run.smithi154.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-10T08:26:24.433 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T08:26:24.447 INFO:teuthology.orchestra.run.smithi154.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-10T08:26:24.462 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T08:26:24.472 INFO:teuthology.orchestra.run.smithi154.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-10T08:26:24.487 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T08:26:24.497 INFO:teuthology.orchestra.run.smithi154.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-10T08:26:24.523 INFO:teuthology.orchestra.run.smithi154.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-10T08:26:24.556 INFO:teuthology.orchestra.run.smithi154.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-10T08:26:24.582 INFO:teuthology.orchestra.run.smithi154.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-10T08:26:24.607 INFO:teuthology.orchestra.run.smithi154.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 712 kB/s | 18 kB 00:00 2024-09-10T08:26:24.632 INFO:teuthology.orchestra.run.smithi154.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 933 kB/s | 23 kB 00:00 2024-09-10T08:26:24.658 INFO:teuthology.orchestra.run.smithi154.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 775 kB/s | 19 kB 00:00 2024-09-10T08:26:24.683 INFO:teuthology.orchestra.run.smithi154.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 793 kB/s | 20 kB 00:00 2024-09-10T08:26:24.706 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T08:26:24.725 INFO:teuthology.orchestra.run.smithi154.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-09-10T08:26:24.750 INFO:teuthology.orchestra.run.smithi154.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T08:26:24.775 INFO:teuthology.orchestra.run.smithi154.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T08:26:24.800 INFO:teuthology.orchestra.run.smithi154.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T08:26:24.868 INFO:teuthology.orchestra.run.smithi154.stdout:(132/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.0 MB/s | 4.4 MB 00:00 2024-09-10T08:26:24.878 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T08:26:24.884 INFO:teuthology.orchestra.run.smithi154.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 992 kB/s | 16 kB 00:00 2024-09-10T08:26:24.910 INFO:teuthology.orchestra.run.smithi154.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-10T08:26:25.020 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T08:26:25.023 INFO:teuthology.orchestra.run.smithi154.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-09-10T08:26:25.126 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T08:26:25.177 INFO:teuthology.orchestra.run.smithi154.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 106 kB/s | 28 kB 00:00 2024-09-10T08:26:25.205 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T08:26:25.211 INFO:teuthology.orchestra.run.smithi154.stdout:(137/156): python3-kubernetes-26.1.0-2.el9.noar 1.9 MB/s | 1.0 MB 00:00 2024-09-10T08:26:25.227 INFO:teuthology.orchestra.run.smithi154.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 151 kB/s | 31 kB 00:00 2024-09-10T08:26:25.245 INFO:teuthology.orchestra.run.smithi154.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-10T08:26:25.262 INFO:teuthology.orchestra.run.smithi154.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-10T08:26:25.287 INFO:teuthology.orchestra.run.smithi154.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-10T08:26:25.312 INFO:teuthology.orchestra.run.smithi154.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-10T08:26:25.338 INFO:teuthology.orchestra.run.smithi154.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T08:26:25.363 INFO:teuthology.orchestra.run.smithi154.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-10T08:26:25.380 INFO:teuthology.orchestra.run.smithi154.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 479 kB/s | 20 kB 00:00 2024-09-10T08:26:25.405 INFO:teuthology.orchestra.run.smithi154.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-10T08:26:25.430 INFO:teuthology.orchestra.run.smithi154.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-10T08:26:25.440 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T08:26:25.497 INFO:teuthology.orchestra.run.smithi154.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-10T08:26:25.557 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T08:26:25.656 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T08:26:25.673 INFO:teuthology.orchestra.run.smithi154.stdout:(149/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 13 MB/s | 3.2 MB 00:00 2024-09-10T08:26:25.686 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T08:26:25.720 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T08:26:25.739 INFO:teuthology.orchestra.run.smithi154.stdout:(150/156): librados2-19.1.1-305.g1cf819b7.el9.x 10 MB/s | 3.4 MB 00:00 2024-09-10T08:26:25.786 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T08:26:25.798 INFO:teuthology.orchestra.run.smithi154.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 702 kB/s | 41 kB 00:00 2024-09-10T08:26:25.829 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T08:26:25.862 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T08:26:25.890 INFO:teuthology.orchestra.run.smithi154.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 5.9 MB/s | 2.3 MB 00:00 2024-09-10T08:26:25.905 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T08:26:25.915 INFO:teuthology.orchestra.run.smithi154.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 2.1 MB/s | 249 kB 00:00 2024-09-10T08:26:25.947 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T08:26:25.983 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T08:26:26.032 INFO:teuthology.orchestra.run.smithi154.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 5.0 MB/s | 1.8 MB 00:00 2024-09-10T08:26:26.051 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T08:26:26.105 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T08:26:26.137 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T08:26:26.180 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T08:26:26.232 INFO:teuthology.orchestra.run.smithi154.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 4.0 MB/s | 1.4 MB 00:00 2024-09-10T08:26:26.255 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T08:26:26.291 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T08:26:26.334 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T08:26:26.363 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T08:26:26.434 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T08:26:26.465 INFO:teuthology.orchestra.run.smithi154.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 4.3 MB/s | 2.4 MB 00:00 2024-09-10T08:26:26.472 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-09-10T08:26:26.472 INFO:teuthology.orchestra.run.smithi154.stdout:Total 10 MB/s | 226 MB 00:21 2024-09-10T08:26:26.486 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T08:26:26.561 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T08:26:26.693 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T08:26:26.746 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T08:26:27.271 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T08:26:27.350 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T08:26:27.380 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T08:26:27.423 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T08:26:27.461 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T08:26:27.503 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T08:26:27.663 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T08:26:27.706 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T08:26:27.712 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-09-10T08:26:27.761 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T08:26:27.841 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T08:26:27.866 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-09-10T08:26:27.866 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-09-10T08:26:27.874 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T08:26:27.911 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T08:26:27.958 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T08:26:27.993 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T08:26:28.036 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T08:26:28.078 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T08:26:28.215 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T08:26:28.264 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T08:26:28.306 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T08:26:28.407 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T08:26:28.448 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T08:26:28.487 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T08:26:28.513 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T08:26:28.538 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T08:26:28.851 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T08:26:28.996 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T08:26:29.033 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T08:26:29.069 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T08:26:29.107 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T08:26:29.151 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T08:26:29.191 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T08:26:29.221 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T08:26:29.255 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T08:26:29.289 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T08:26:29.340 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T08:26:29.382 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T08:26:29.468 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T08:26:29.512 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T08:26:29.544 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T08:26:29.646 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T08:26:29.703 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T08:26:30.160 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-09-10T08:26:30.161 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-09-10T08:26:30.427 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T08:26:30.476 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T08:26:30.526 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T08:26:30.624 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T08:26:30.690 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T08:26:30.742 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T08:26:30.837 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T08:26:30.870 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T08:26:31.054 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T08:26:31.093 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T08:26:31.187 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T08:26:31.843 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T08:26:31.967 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T08:26:33.225 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T08:26:33.315 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T08:26:33.343 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T08:26:33.376 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T08:26:33.687 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T08:26:33.732 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T08:26:33.822 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T08:26:33.853 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T08:26:33.889 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T08:26:34.379 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T08:26:34.409 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T08:26:34.463 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T08:26:34.495 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T08:26:36.629 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-09-10T08:26:36.744 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T08:26:36.830 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T08:26:36.875 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T08:26:36.913 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T08:26:36.979 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T08:26:37.012 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T08:26:37.037 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T08:26:37.093 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T08:26:37.424 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T08:26:37.428 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T08:26:37.462 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T08:26:37.545 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T08:26:37.545 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T08:26:37.545 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T08:26:37.545 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:26:37.546 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T08:26:37.580 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T08:26:37.668 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T08:26:37.706 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T08:26:37.798 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T08:26:37.827 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T08:26:37.997 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T08:26:38.057 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T08:26:38.084 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T08:26:38.173 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T08:26:38.211 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T08:26:38.258 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T08:26:38.287 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T08:26:38.308 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T08:26:38.515 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T08:26:38.689 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T08:26:38.846 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T08:26:38.967 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T08:26:39.070 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T08:26:39.292 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T08:26:39.400 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T08:26:39.488 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T08:26:39.525 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T08:26:39.560 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T08:26:39.625 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T08:26:39.669 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T08:26:39.701 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T08:26:39.744 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T08:26:39.777 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T08:26:39.813 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T08:26:39.882 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T08:26:39.935 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T08:26:39.967 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T08:26:40.010 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T08:26:40.086 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T08:26:40.120 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T08:26:40.164 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T08:26:40.192 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T08:26:40.263 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T08:26:40.315 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T08:26:40.391 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T08:26:40.526 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T08:26:40.576 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T08:26:41.104 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T08:26:41.189 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T08:26:41.217 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T08:26:41.260 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T08:26:41.298 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T08:26:41.340 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T08:26:41.509 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T08:26:41.584 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T08:26:41.640 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T08:26:41.714 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T08:26:41.752 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T08:26:41.788 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T08:26:41.835 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T08:26:41.879 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T08:26:41.923 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T08:26:41.965 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T08:26:42.103 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T08:26:42.149 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T08:26:42.191 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T08:26:42.294 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T08:26:42.333 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T08:26:42.373 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T08:26:42.398 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T08:26:42.422 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T08:26:42.525 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T08:26:42.649 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T08:26:42.680 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T08:26:42.708 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T08:26:42.751 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T08:26:42.789 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T08:26:42.821 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T08:26:42.851 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T08:26:42.885 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T08:26:42.927 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T08:26:42.969 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T08:26:43.003 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T08:26:43.090 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T08:26:43.133 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T08:26:43.173 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T08:26:43.278 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T08:26:43.332 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T08:26:44.065 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T08:26:44.112 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T08:26:44.147 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T08:26:44.258 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T08:26:44.310 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T08:26:44.359 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T08:26:44.445 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T08:26:44.482 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T08:26:44.666 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T08:26:44.696 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T08:26:44.777 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T08:26:45.438 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T08:26:45.556 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T08:26:46.810 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T08:26:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T08:26:46.930 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T08:26:46.972 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T08:26:47.282 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T08:26:47.318 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T08:26:47.393 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T08:26:47.423 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T08:26:47.459 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T08:26:47.937 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T08:26:47.963 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T08:26:48.034 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T08:26:48.064 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T08:26:49.390 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T08:26:49.390 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /sys 2024-09-10T08:26:49.390 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /proc 2024-09-10T08:26:49.390 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /mnt 2024-09-10T08:26:49.390 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /var/tmp 2024-09-10T08:26:49.390 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /home 2024-09-10T08:26:49.390 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /root 2024-09-10T08:26:49.390 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /tmp 2024-09-10T08:26:49.390 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:26:49.571 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T08:26:49.586 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T08:26:49.587 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:26:49.587 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T08:26:49.587 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:26:50.313 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T08:26:50.435 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T08:26:50.985 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T08:26:51.022 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T08:26:51.091 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T08:26:51.114 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T08:26:51.114 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T08:26:51.115 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T08:26:51.115 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:26:51.117 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T08:26:51.117 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:26:51.118 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T08:26:51.118 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T08:26:51.118 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T08:26:51.118 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:26:51.148 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T08:26:51.341 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T08:26:51.365 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T08:26:51.365 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:26:51.365 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T08:26:51.365 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T08:26:51.365 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T08:26:51.365 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:26:51.809 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T08:26:51.832 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T08:26:51.832 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:26:51.832 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T08:26:51.832 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T08:26:51.833 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T08:26:51.833 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:26:51.947 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T08:26:51.996 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T08:26:52.051 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T08:26:52.236 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T08:26:52.293 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T08:26:52.362 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T08:26:52.451 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T08:26:52.599 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T08:26:52.647 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T08:26:52.684 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T08:26:52.712 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T08:26:53.134 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T08:26:53.161 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T08:26:53.193 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T08:26:53.255 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T08:26:53.284 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T08:26:54.324 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T08:26:54.362 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T08:26:55.322 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T08:26:55.354 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T08:26:55.454 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T08:26:55.623 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T08:26:55.656 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T08:26:55.680 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T08:26:55.680 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:26:55.680 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T08:26:55.680 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T08:26:55.680 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T08:26:55.680 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:26:55.732 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T08:26:55.743 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T08:26:55.841 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T08:26:55.899 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T08:26:56.828 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T08:26:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T08:26:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T08:26:56.883 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:26:56.883 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T08:26:56.883 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T08:26:56.883 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T08:26:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:26:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T08:26:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T08:26:56.950 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:26:56.950 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T08:26:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:26:56.994 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T08:26:57.018 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T08:26:57.018 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:26:57.018 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T08:26:57.018 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T08:26:57.018 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T08:26:57.018 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:26:57.329 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T08:26:57.352 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T08:26:57.352 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:26:57.352 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T08:26:57.352 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T08:26:57.353 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T08:26:57.353 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:01.950 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T08:27:01.991 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T08:27:02.031 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T08:27:02.064 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T08:27:02.091 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T08:27:02.275 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T08:27:02.330 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T08:27:02.360 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T08:27:02.390 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T08:27:02.437 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T08:27:02.818 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T08:27:02.818 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /sys 2024-09-10T08:27:02.818 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /proc 2024-09-10T08:27:02.818 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /mnt 2024-09-10T08:27:02.818 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /var/tmp 2024-09-10T08:27:02.818 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /home 2024-09-10T08:27:02.819 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /root 2024-09-10T08:27:02.819 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /tmp 2024-09-10T08:27:02.819 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:02.994 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T08:27:03.010 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T08:27:03.010 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:27:03.010 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T08:27:03.010 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:03.057 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T08:27:03.094 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T08:27:03.114 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T08:27:03.958 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T08:27:04.050 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T08:27:04.098 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T08:27:04.191 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T08:27:04.219 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T08:27:04.245 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T08:27:04.280 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T08:27:04.280 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T08:27:04.364 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T08:27:04.364 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T08:27:04.448 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T08:27:04.473 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T08:27:04.478 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T08:27:04.479 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T08:27:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T08:27:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T08:27:04.524 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:27:04.524 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T08:27:04.524 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T08:27:04.524 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T08:27:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:04.658 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T08:27:04.658 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T08:27:04.743 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T08:27:04.748 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T08:27:04.770 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T08:27:04.771 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:27:04.771 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T08:27:04.771 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T08:27:04.771 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T08:27:04.771 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:04.817 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T08:27:05.215 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T08:27:05.238 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T08:27:05.239 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:27:05.239 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T08:27:05.239 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T08:27:05.239 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T08:27:05.239 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:05.346 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T08:27:05.403 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T08:27:05.467 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T08:27:05.655 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T08:27:05.699 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T08:27:05.778 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T08:27:05.875 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T08:27:06.015 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T08:27:06.075 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T08:27:06.106 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T08:27:06.134 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T08:27:06.547 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T08:27:06.574 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T08:27:06.605 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T08:27:06.669 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T08:27:06.705 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T08:27:07.754 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T08:27:07.791 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T08:27:08.756 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T08:27:08.791 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T08:27:08.894 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T08:27:09.053 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T08:27:09.085 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T08:27:09.108 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T08:27:09.108 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:27:09.109 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T08:27:09.109 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T08:27:09.109 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T08:27:09.109 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:09.160 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T08:27:09.172 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T08:27:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T08:27:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T08:27:10.255 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T08:27:10.287 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T08:27:10.311 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T08:27:10.311 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:27:10.312 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T08:27:10.312 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T08:27:10.312 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T08:27:10.312 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:10.355 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T08:27:10.378 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T08:27:10.378 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:27:10.378 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T08:27:10.378 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:10.430 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T08:27:10.454 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T08:27:10.454 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:27:10.454 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T08:27:10.454 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T08:27:10.454 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T08:27:10.454 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:10.756 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T08:27:10.759 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T08:27:10.760 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T08:27:10.760 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T08:27:10.760 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T08:27:10.760 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T08:27:10.760 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T08:27:10.760 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T08:27:10.760 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T08:27:10.760 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T08:27:10.760 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T08:27:10.760 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T08:27:10.760 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T08:27:10.760 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T08:27:10.761 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T08:27:10.761 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T08:27:10.761 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T08:27:10.761 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T08:27:10.761 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T08:27:10.761 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T08:27:10.761 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T08:27:10.761 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T08:27:10.761 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T08:27:10.761 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T08:27:10.761 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T08:27:10.761 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T08:27:10.762 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T08:27:10.762 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T08:27:10.762 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T08:27:10.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T08:27:10.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T08:27:10.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T08:27:10.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T08:27:10.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T08:27:10.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T08:27:10.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T08:27:10.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T08:27:10.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T08:27:10.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T08:27:10.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T08:27:10.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T08:27:10.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T08:27:10.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T08:27:10.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T08:27:10.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T08:27:10.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T08:27:10.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T08:27:10.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T08:27:10.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T08:27:10.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T08:27:10.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T08:27:10.776 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T08:27:10.776 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T08:27:10.776 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T08:27:10.776 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T08:27:10.776 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T08:27:10.776 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T08:27:10.776 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T08:27:10.776 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T08:27:10.776 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T08:27:10.776 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T08:27:10.776 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T08:27:10.777 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T08:27:10.777 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T08:27:10.777 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T08:27:10.777 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T08:27:10.777 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T08:27:10.777 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T08:27:10.777 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T08:27:10.777 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T08:27:10.777 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T08:27:10.777 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T08:27:10.777 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T08:27:10.777 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T08:27:10.777 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T08:27:10.778 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T08:27:10.778 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T08:27:10.778 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T08:27:10.778 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T08:27:10.778 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T08:27:10.778 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T08:27:10.778 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T08:27:10.778 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T08:27:10.778 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T08:27:10.778 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T08:27:10.778 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T08:27:10.778 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T08:27:10.779 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T08:27:10.779 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T08:27:10.779 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T08:27:10.779 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T08:27:10.779 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T08:27:10.779 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T08:27:10.779 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T08:27:10.779 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T08:27:10.779 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T08:27:10.779 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T08:27:10.779 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T08:27:10.779 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T08:27:10.780 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T08:27:10.780 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T08:27:10.780 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T08:27:10.780 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T08:27:10.780 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T08:27:10.780 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T08:27:10.780 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T08:27:10.780 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T08:27:10.780 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T08:27:10.780 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T08:27:10.780 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T08:27:10.780 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T08:27:10.781 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T08:27:10.781 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T08:27:10.781 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T08:27:10.781 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T08:27:10.781 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T08:27:10.781 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T08:27:10.781 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T08:27:10.781 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T08:27:10.781 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T08:27:10.781 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T08:27:10.781 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T08:27:10.781 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T08:27:10.781 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T08:27:10.782 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T08:27:10.782 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T08:27:10.782 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T08:27:10.782 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T08:27:10.782 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T08:27:10.782 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T08:27:10.782 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T08:27:10.782 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T08:27:10.782 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T08:27:10.782 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T08:27:10.782 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T08:27:10.782 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T08:27:10.782 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T08:27:10.783 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T08:27:10.783 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T08:27:10.783 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T08:27:10.783 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T08:27:10.783 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T08:27:10.783 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T08:27:10.783 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T08:27:10.783 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T08:27:10.783 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T08:27:10.783 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T08:27:10.783 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T08:27:10.783 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T08:27:10.783 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T08:27:10.784 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T08:27:10.784 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T08:27:10.784 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T08:27:10.784 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T08:27:10.784 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T08:27:10.784 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T08:27:10.784 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T08:27:10.784 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T08:27:10.784 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T08:27:10.784 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T08:27:10.784 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T08:27:10.784 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T08:27:10.784 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T08:27:10.785 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T08:27:10.785 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T08:27:10.785 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T08:27:10.785 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:27:10.785 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T08:27:10.785 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T08:27:10.785 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T08:27:10.785 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:13.508 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T08:27:13.508 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:13.508 INFO:teuthology.orchestra.run.smithi103.stdout:Upgraded: 2024-09-10T08:27:13.508 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T08:27:13.508 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T08:27:13.508 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T08:27:13.508 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T08:27:13.509 INFO:teuthology.orchestra.run.smithi103.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.509 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.509 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T08:27:13.509 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T08:27:13.509 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-10T08:27:13.509 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T08:27:13.509 INFO:teuthology.orchestra.run.smithi103.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T08:27:13.509 INFO:teuthology.orchestra.run.smithi103.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T08:27:13.509 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T08:27:13.509 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.509 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.509 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.510 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.510 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:13.510 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.510 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.510 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.510 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:13.510 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:13.510 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:13.510 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:13.510 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:13.510 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.510 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.510 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:13.511 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.511 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.511 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.511 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:13.511 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:13.511 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.511 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.511 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:13.511 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T08:27:13.511 INFO:teuthology.orchestra.run.smithi103.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T08:27:13.511 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T08:27:13.511 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T08:27:13.511 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T08:27:13.512 INFO:teuthology.orchestra.run.smithi103.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T08:27:13.512 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T08:27:13.512 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T08:27:13.512 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T08:27:13.512 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T08:27:13.512 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T08:27:13.512 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.512 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.512 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.512 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T08:27:13.512 INFO:teuthology.orchestra.run.smithi103.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T08:27:13.512 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T08:27:13.513 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T08:27:13.513 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T08:27:13.513 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.513 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.513 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T08:27:13.513 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.513 INFO:teuthology.orchestra.run.smithi103.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T08:27:13.513 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T08:27:13.513 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T08:27:13.513 INFO:teuthology.orchestra.run.smithi103.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T08:27:13.513 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T08:27:13.513 INFO:teuthology.orchestra.run.smithi103.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T08:27:13.513 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T08:27:13.514 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T08:27:13.514 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T08:27:13.514 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T08:27:13.514 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T08:27:13.514 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T08:27:13.514 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T08:27:13.514 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T08:27:13.514 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T08:27:13.514 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T08:27:13.514 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T08:27:13.514 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T08:27:13.514 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T08:27:13.514 INFO:teuthology.orchestra.run.smithi103.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T08:27:13.515 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T08:27:13.515 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T08:27:13.515 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T08:27:13.515 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.515 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.515 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.515 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T08:27:13.515 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T08:27:13.515 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T08:27:13.515 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T08:27:13.515 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T08:27:13.515 INFO:teuthology.orchestra.run.smithi103.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T08:27:13.515 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T08:27:13.516 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T08:27:13.516 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T08:27:13.516 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T08:27:13.516 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T08:27:13.516 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T08:27:13.516 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T08:27:13.516 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T08:27:13.516 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T08:27:13.516 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T08:27:13.516 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T08:27:13.516 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T08:27:13.516 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T08:27:13.517 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T08:27:13.517 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T08:27:13.517 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T08:27:13.517 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T08:27:13.517 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T08:27:13.517 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T08:27:13.517 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T08:27:13.517 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T08:27:13.517 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T08:27:13.517 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T08:27:13.517 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T08:27:13.517 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T08:27:13.517 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T08:27:13.518 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T08:27:13.518 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T08:27:13.518 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T08:27:13.518 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T08:27:13.518 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T08:27:13.518 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T08:27:13.518 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T08:27:13.518 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T08:27:13.518 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.518 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.518 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T08:27:13.518 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T08:27:13.518 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T08:27:13.518 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.519 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T08:27:13.519 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T08:27:13.519 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T08:27:13.519 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T08:27:13.519 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T08:27:13.519 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T08:27:13.519 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T08:27:13.519 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T08:27:13.519 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T08:27:13.519 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T08:27:13.519 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T08:27:13.519 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T08:27:13.519 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T08:27:13.520 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T08:27:13.520 INFO:teuthology.orchestra.run.smithi103.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T08:27:13.520 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.520 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.520 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:13.520 INFO:teuthology.orchestra.run.smithi103.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T08:27:13.520 INFO:teuthology.orchestra.run.smithi103.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T08:27:13.520 INFO:teuthology.orchestra.run.smithi103.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T08:27:13.520 INFO:teuthology.orchestra.run.smithi103.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T08:27:13.520 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T08:27:13.520 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T08:27:13.521 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T08:27:13.521 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:13.521 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-10T08:27:13.967 DEBUG:teuthology.parallel:result is None 2024-09-10T08:27:15.377 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T08:27:15.426 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T08:27:15.467 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T08:27:15.499 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T08:27:15.526 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T08:27:15.717 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T08:27:15.756 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T08:27:15.786 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T08:27:15.817 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T08:27:15.862 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T08:27:16.430 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T08:27:16.469 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T08:27:16.489 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T08:27:17.355 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T08:27:17.448 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T08:27:17.496 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T08:27:17.588 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T08:27:17.618 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T08:27:17.643 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T08:27:17.677 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T08:27:17.677 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T08:27:17.762 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T08:27:17.762 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T08:27:17.845 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T08:27:17.870 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T08:27:17.876 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T08:27:17.876 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T08:27:18.059 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T08:27:18.059 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T08:27:18.140 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T08:27:18.204 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T08:27:23.907 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T08:27:23.908 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T08:27:23.908 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T08:27:23.908 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T08:27:23.908 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T08:27:23.908 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T08:27:23.908 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T08:27:23.908 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T08:27:23.908 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T08:27:23.908 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T08:27:23.908 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T08:27:23.908 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T08:27:23.908 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T08:27:23.909 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T08:27:23.909 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T08:27:23.909 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T08:27:23.909 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T08:27:23.909 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T08:27:23.909 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T08:27:23.909 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T08:27:23.909 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T08:27:23.909 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T08:27:23.909 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T08:27:23.909 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T08:27:23.909 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T08:27:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T08:27:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T08:27:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T08:27:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T08:27:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T08:27:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T08:27:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T08:27:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T08:27:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T08:27:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T08:27:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T08:27:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T08:27:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T08:27:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T08:27:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T08:27:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T08:27:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T08:27:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T08:27:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T08:27:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T08:27:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T08:27:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T08:27:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T08:27:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T08:27:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T08:27:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T08:27:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T08:27:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T08:27:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T08:27:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T08:27:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T08:27:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T08:27:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T08:27:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T08:27:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T08:27:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T08:27:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T08:27:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T08:27:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T08:27:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T08:27:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T08:27:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T08:27:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T08:27:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T08:27:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T08:27:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T08:27:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T08:27:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T08:27:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T08:27:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T08:27:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T08:27:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T08:27:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T08:27:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T08:27:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T08:27:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T08:27:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T08:27:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T08:27:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T08:27:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T08:27:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T08:27:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T08:27:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T08:27:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T08:27:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T08:27:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T08:27:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T08:27:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T08:27:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T08:27:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T08:27:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T08:27:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T08:27:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T08:27:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T08:27:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T08:27:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T08:27:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T08:27:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T08:27:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T08:27:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T08:27:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T08:27:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T08:27:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T08:27:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T08:27:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T08:27:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T08:27:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T08:27:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T08:27:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T08:27:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T08:27:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T08:27:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T08:27:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T08:27:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T08:27:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T08:27:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T08:27:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T08:27:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T08:27:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T08:27:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T08:27:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T08:27:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T08:27:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T08:27:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T08:27:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T08:27:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T08:27:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T08:27:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T08:27:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T08:27:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T08:27:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T08:27:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T08:27:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T08:27:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T08:27:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T08:27:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T08:27:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T08:27:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T08:27:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T08:27:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T08:27:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T08:27:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T08:27:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T08:27:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T08:27:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T08:27:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T08:27:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T08:27:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T08:27:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T08:27:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T08:27:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T08:27:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T08:27:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T08:27:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T08:27:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T08:27:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T08:27:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T08:27:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T08:27:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T08:27:26.414 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T08:27:26.414 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:26.414 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2024-09-10T08:27:26.414 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T08:27:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T08:27:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T08:27:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T08:27:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T08:27:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T08:27:26.415 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-09-10T08:27:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T08:27:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T08:27:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T08:27:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T08:27:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T08:27:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T08:27:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T08:27:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T08:27:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T08:27:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T08:27:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T08:27:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T08:27:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T08:27:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T08:27:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T08:27:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T08:27:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T08:27:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T08:27:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T08:27:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T08:27:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T08:27:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T08:27:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T08:27:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T08:27:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T08:27:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T08:27:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T08:27:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T08:27:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T08:27:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T08:27:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T08:27:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T08:27:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T08:27:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T08:27:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T08:27:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T08:27:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T08:27:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T08:27:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T08:27:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T08:27:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T08:27:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T08:27:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T08:27:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T08:27:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T08:27:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T08:27:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T08:27:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T08:27:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T08:27:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T08:27:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T08:27:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T08:27:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T08:27:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T08:27:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T08:27:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T08:27:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T08:27:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T08:27:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T08:27:26.423 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T08:27:26.424 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T08:27:26.424 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T08:27:26.424 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T08:27:26.424 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T08:27:26.424 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T08:27:26.424 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T08:27:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T08:27:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T08:27:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T08:27:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T08:27:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T08:27:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T08:27:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T08:27:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T08:27:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T08:27:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T08:27:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T08:27:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T08:27:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T08:27:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T08:27:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T08:27:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T08:27:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T08:27:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T08:27:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T08:27:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T08:27:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T08:27:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T08:27:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T08:27:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T08:27:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T08:27:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T08:27:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T08:27:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T08:27:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T08:27:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T08:27:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T08:27:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T08:27:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T08:27:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T08:27:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T08:27:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T08:27:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T08:27:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T08:27:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T08:27:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T08:27:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T08:27:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T08:27:26.429 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T08:27:26.429 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:26.429 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-09-10T08:27:26.820 DEBUG:teuthology.parallel:result is None 2024-09-10T08:27:26.821 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T08:27:26.969 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T08:27:26.995 INFO:teuthology.orchestra.run.smithi103.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T08:27:26.996 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T08:27:26.996 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T08:27:26.998 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T08:27:27.148 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T08:27:27.170 INFO:teuthology.orchestra.run.smithi154.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T08:27:27.171 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T08:27:27.171 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T08:27:27.173 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T08:27:27.173 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:27:27.173 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T08:27:27.207 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:27:27.207 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T08:27:27.238 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T08:27:27.238 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:27:27.238 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T08:27:27.277 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T08:27:27.345 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:27:27.345 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T08:27:27.370 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T08:27:27.434 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T08:27:27.435 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:27:27.435 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T08:27:27.462 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T08:27:27.530 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:27:27.530 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T08:27:27.555 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T08:27:27.619 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T08:27:27.619 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:27:27.619 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T08:27:27.646 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T08:27:27.713 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:27:27.713 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T08:27:27.738 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T08:27:27.802 INFO:teuthology.run_tasks:Running task ceph... 2024-09-10T08:27:27.886 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-10T08:27:27.886 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 777 /var/log/ceph 2024-09-10T08:27:27.888 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /var/log/ceph 2024-09-10T08:27:27.912 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-10T08:27:27.913 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T08:27:27.955 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T08:27:27.979 INFO:tasks.ceph:Creating extra log directories... 2024-09-10T08:27:27.979 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T08:27:28.021 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T08:27:28.050 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-10T08:27:28.051 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-10T08:27:28.051 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-10T08:27:28.051 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:27:28.051 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T08:27:28.100 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T08:27:28.204 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-10T08:27:28.229 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:27:28.229 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T08:27:28.245 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T08:27:28.348 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-10T08:27:28.377 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-10T08:27:28.377 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-10T08:27:28.378 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898918', 'branch': 'wip-rishabh-testing-20240909.165402-squid', 'description': 'fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}}', 'email': None, 'first_in_suite': False, 'job_id': '7898918', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240909.165402-squid'}, 'ceph': {'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}}, 'kclient': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240909.165402-squid', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 9893, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'sleep_before_teardown': 0, 'subset': '197/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240909.165402-squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi103.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNCaTmmASN5j8ztCf8LQsXuH44qV3dDJmJcoSH3w6ZmP0fP7ihsqaIRgfPHtZdkwuiWvDHxN/u4fU5zE2XACtpg=', 'smithi154.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEce2LQq3a0orgSdEjpoQqmr2miW/ehX6m9yaDx/8kb+Tsi6LXWsfEMAK94wzKeN3bAscjFJWihHPSnZpSkTmgA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'mon_thrash': {'check_mds_failover': True, 'revive_delay': 20, 'thrash_delay': 10}}, {'workunit': {'clients': {'all': ['suites/ffsb.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_06:58:10', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-10T08:27:28.378 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T08:27:28.381 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T08:27:28.428 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T08:27:28.435 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T08:27:28.492 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:27:28.492 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T08:27:28.513 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T08:27:28.513 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_1 2024-09-10T08:27:28.568 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T08:27:28.568 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:27:28.568 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 670 Links: 1 2024-09-10T08:27:28.568 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:27:28.568 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:27:28.568 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-10 08:27:05.179734123 +0000 2024-09-10T08:27:28.569 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-10 08:25:17.979940169 +0000 2024-09-10T08:27:28.569 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-10 08:25:17.979940169 +0000 2024-09-10T08:27:28.569 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-10 08:25:17.979940169 +0000 2024-09-10T08:27:28.569 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T08:27:28.630 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-10T08:27:28.630 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-10T08:27:28.630 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000202192 s, 2.5 MB/s 2024-09-10T08:27:28.632 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T08:27:28.688 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_2 2024-09-10T08:27:28.743 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T08:27:28.743 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:27:28.743 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-09-10T08:27:28.744 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:27:28.744 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:27:28.744 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-10 08:27:05.179734123 +0000 2024-09-10T08:27:28.744 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-10 08:25:18.297934034 +0000 2024-09-10T08:27:28.744 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-10 08:25:18.297934034 +0000 2024-09-10T08:27:28.744 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-10 08:25:18.297934034 +0000 2024-09-10T08:27:28.744 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T08:27:28.806 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-10T08:27:28.806 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-10T08:27:28.806 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000188886 s, 2.7 MB/s 2024-09-10T08:27:28.807 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T08:27:28.864 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_3 2024-09-10T08:27:28.919 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T08:27:28.919 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:27:28.920 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-10T08:27:28.920 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:27:28.920 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:27:28.920 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-10 08:27:05.180734104 +0000 2024-09-10T08:27:28.920 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-10 08:25:18.629927630 +0000 2024-09-10T08:27:28.920 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-10 08:25:18.629927630 +0000 2024-09-10T08:27:28.920 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-10 08:25:18.629927630 +0000 2024-09-10T08:27:28.920 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T08:27:28.982 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-10T08:27:28.982 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-10T08:27:28.983 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000180383 s, 2.8 MB/s 2024-09-10T08:27:28.984 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T08:27:29.040 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_4 2024-09-10T08:27:29.095 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T08:27:29.095 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:27:29.096 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-10T08:27:29.096 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:27:29.096 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:27:29.096 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-10 08:27:05.180734104 +0000 2024-09-10T08:27:29.096 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-10 08:25:18.963921186 +0000 2024-09-10T08:27:29.096 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-10 08:25:18.963921186 +0000 2024-09-10T08:27:29.096 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-10 08:25:18.963921186 +0000 2024-09-10T08:27:29.096 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T08:27:29.159 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-10T08:27:29.159 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-10T08:27:29.159 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000224962 s, 2.3 MB/s 2024-09-10T08:27:29.160 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T08:27:29.217 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T08:27:29.218 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:27:29.218 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T08:27:29.234 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T08:27:29.234 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2024-09-10T08:27:29.291 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T08:27:29.291 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:27:29.291 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-10T08:27:29.292 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:27:29.292 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:27:29.292 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-10 08:27:18.557999842 +0000 2024-09-10T08:27:29.292 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-10 08:25:17.969634583 +0000 2024-09-10T08:27:29.292 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-10 08:25:17.969634583 +0000 2024-09-10T08:27:29.292 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-10 08:25:17.969634583 +0000 2024-09-10T08:27:29.292 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T08:27:29.356 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-10T08:27:29.356 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-10T08:27:29.356 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000212943 s, 2.4 MB/s 2024-09-10T08:27:29.357 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T08:27:29.415 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2024-09-10T08:27:29.471 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T08:27:29.471 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:27:29.471 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-10T08:27:29.471 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:27:29.471 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:27:29.471 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-10 08:27:18.558999815 +0000 2024-09-10T08:27:29.471 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-10 08:25:18.298625670 +0000 2024-09-10T08:27:29.471 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-10 08:25:18.298625670 +0000 2024-09-10T08:27:29.471 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-10 08:25:18.298625670 +0000 2024-09-10T08:27:29.472 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T08:27:29.535 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-10T08:27:29.535 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-10T08:27:29.535 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000215275 s, 2.4 MB/s 2024-09-10T08:27:29.536 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T08:27:29.594 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2024-09-10T08:27:29.650 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T08:27:29.650 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:27:29.650 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-10T08:27:29.651 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:27:29.651 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:27:29.651 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-10 08:27:18.558999815 +0000 2024-09-10T08:27:29.651 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-10 08:25:18.624616839 +0000 2024-09-10T08:27:29.651 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-10 08:25:18.624616839 +0000 2024-09-10T08:27:29.651 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-10 08:25:18.624616839 +0000 2024-09-10T08:27:29.651 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T08:27:29.714 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-10T08:27:29.715 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-10T08:27:29.715 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000235163 s, 2.2 MB/s 2024-09-10T08:27:29.716 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T08:27:29.772 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2024-09-10T08:27:29.827 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T08:27:29.827 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:27:29.827 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-10T08:27:29.827 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:27:29.827 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:27:29.827 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-10 08:27:18.558999815 +0000 2024-09-10T08:27:29.827 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-10 08:25:18.938608332 +0000 2024-09-10T08:27:29.827 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-10 08:25:18.938608332 +0000 2024-09-10T08:27:29.828 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-10 08:25:18.938608332 +0000 2024-09-10T08:27:29.828 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T08:27:29.891 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-10T08:27:29.891 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-10T08:27:29.891 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000195926 s, 2.6 MB/s 2024-09-10T08:27:29.892 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T08:27:29.948 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T08:27:29.949 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T08:27:29.949 INFO:tasks.ceph:Generating config... 2024-09-10T08:27:29.950 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-10T08:27:29.950 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-09-10T08:27:29.950 INFO:tasks.ceph:[client] debug client = 20 2024-09-10T08:27:29.950 INFO:tasks.ceph:[client] debug ms = 1 2024-09-10T08:27:29.950 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-10T08:27:29.950 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-10T08:27:29.950 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-10T08:27:29.951 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-10T08:27:29.951 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-10T08:27:29.951 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-09-10T08:27:29.951 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-09-10T08:27:29.951 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-09-10T08:27:29.951 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-09-10T08:27:29.951 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-10T08:27:29.951 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-10T08:27:29.951 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-10T08:27:29.951 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-10T08:27:29.951 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-09-10T08:27:29.951 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-09-10T08:27:29.951 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-09-10T08:27:29.952 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-09-10T08:27:29.952 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-09-10T08:27:29.952 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-10T08:27:29.952 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-10T08:27:29.952 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-10T08:27:29.952 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-10T08:27:29.952 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-10T08:27:29.952 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-10T08:27:29.952 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-10T08:27:29.952 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-10T08:27:29.952 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-10T08:27:29.953 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-10T08:27:29.953 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-10T08:27:29.953 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-10T08:27:29.953 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-10T08:27:29.953 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-10T08:27:29.953 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-10T08:27:29.953 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-10T08:27:29.953 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-10T08:27:29.953 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-10T08:27:29.953 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-10T08:27:29.953 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-10T08:27:29.953 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-10T08:27:29.954 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-10T08:27:29.954 INFO:tasks.ceph:[osd] filestore flush min = 0 2024-09-10T08:27:29.954 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-09-10T08:27:29.954 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-10T08:27:29.954 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-10T08:27:29.954 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-10T08:27:29.954 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-09-10T08:27:29.954 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-09-10T08:27:29.954 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-09-10T08:27:29.954 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-09-10T08:27:29.954 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-10T08:27:29.954 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-10T08:27:29.954 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-10T08:27:29.955 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-10T08:27:29.955 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-10T08:27:29.955 INFO:tasks.ceph:Setting up mon.a... 2024-09-10T08:27:29.955 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-10T08:27:30.012 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.keyring 2024-09-10T08:27:30.015 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-10T08:27:30.060 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T08:27:30.084 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.103'), ('mon.b', '172.21.15.154'), ('mon.c', '[v2:172.21.15.154:3301,v1:172.21.15.154:6790]')] 2024-09-10T08:27:30.085 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.103,172.21.15.154,[v2:172.21.15.154:3301,v1:172.21.15.154:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-10T08:27:30.086 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:27:30.086 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T08:27:30.140 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.103 --add b 172.21.15.154 --addv c '[v2:172.21.15.154:3301,v1:172.21.15.154:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:27:30.228 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:27:30.228 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: generated fsid 4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5 2024-09-10T08:27:30.228 INFO:teuthology.orchestra.run.smithi103.stdout:setting min_mon_release = quincy 2024-09-10T08:27:30.228 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 0 2024-09-10T08:27:30.228 INFO:teuthology.orchestra.run.smithi103.stdout:fsid 4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5 2024-09-10T08:27:30.228 INFO:teuthology.orchestra.run.smithi103.stdout:last_changed 2024-09-10T08:27:30.229267+0000 2024-09-10T08:27:30.228 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-10T08:27:30.229267+0000 2024-09-10T08:27:30.228 INFO:teuthology.orchestra.run.smithi103.stdout:min_mon_release 17 (quincy) 2024-09-10T08:27:30.229 INFO:teuthology.orchestra.run.smithi103.stdout:election_strategy: 1 2024-09-10T08:27:30.229 INFO:teuthology.orchestra.run.smithi103.stdout:0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-09-10T08:27:30.229 INFO:teuthology.orchestra.run.smithi103.stdout:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-10T08:27:30.229 INFO:teuthology.orchestra.run.smithi103.stdout:2: [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] mon.c 2024-09-10T08:27:30.229 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-10T08:27:30.230 DEBUG:teuthology.orchestra.run.smithi103:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T08:27:30.245 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5... 2024-09-10T08:27:30.246 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T08:27:30.287 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T08:27:30.328 INFO:teuthology.orchestra.run.smithi103.stdout:[global] 2024-09-10T08:27:30.328 INFO:teuthology.orchestra.run.smithi103.stdout: chdir = "" 2024-09-10T08:27:30.328 INFO:teuthology.orchestra.run.smithi103.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T08:27:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: auth supported = cephx 2024-09-10T08:27:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: filestore xattr use omap = true 2024-09-10T08:27:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: mon clock drift allowed = 1.000 2024-09-10T08:27:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: osd crush chooseleaf type = 0 2024-09-10T08:27:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: auth debug = true 2024-09-10T08:27:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on old message = true 2024-09-10T08:27:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on bug = true 2024-09-10T08:27:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.329 INFO:teuthology.orchestra.run.smithi103.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T08:27:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: mon pg warn max object skew = 0 2024-09-10T08:27:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T08:27:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T08:27:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default size = 2 2024-09-10T08:27:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow primary affinity = true 2024-09-10T08:27:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow pg remap = true 2024-09-10T08:27:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on legacy crush tunables = false 2024-09-10T08:27:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on crush straw calc version zero = false 2024-09-10T08:27:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on no sortbitwise = false 2024-09-10T08:27:30.330 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on osd down out interval zero = false 2024-09-10T08:27:30.331 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on too few osds = false 2024-09-10T08:27:30.331 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T08:27:30.331 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T08:27:30.331 INFO:teuthology.orchestra.run.smithi103.stdout: mon_allow_pool_size_one = true 2024-09-10T08:27:30.331 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.331 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T08:27:30.331 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.331 INFO:teuthology.orchestra.run.smithi103.stdout: osd default data pool replay window = 5 2024-09-10T08:27:30.331 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.331 INFO:teuthology.orchestra.run.smithi103.stdout: mon allow pool delete = true 2024-09-10T08:27:30.331 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.331 INFO:teuthology.orchestra.run.smithi103.stdout: mon cluster log file level = debug 2024-09-10T08:27:30.331 INFO:teuthology.orchestra.run.smithi103.stdout: debug asserts on shutdown = true 2024-09-10T08:27:30.332 INFO:teuthology.orchestra.run.smithi103.stdout: mon health detail to clog = false 2024-09-10T08:27:30.332 INFO:teuthology.orchestra.run.smithi103.stdout: mon host = "172.21.15.103,172.21.15.154,[v2:172.21.15.154:3301,v1:172.21.15.154:6790]" 2024-09-10T08:27:30.332 INFO:teuthology.orchestra.run.smithi103.stdout: fsid = 4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5 2024-09-10T08:27:30.332 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.332 INFO:teuthology.orchestra.run.smithi103.stdout:[osd] 2024-09-10T08:27:30.332 INFO:teuthology.orchestra.run.smithi103.stdout: osd journal size = 100 2024-09-10T08:27:30.332 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.332 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub load threshold = 5.0 2024-09-10T08:27:30.332 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub max interval = 600 2024-09-10T08:27:30.332 INFO:teuthology.orchestra.run.smithi103.stdout: osd mclock profile = high_recovery_ops 2024-09-10T08:27:30.332 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.332 INFO:teuthology.orchestra.run.smithi103.stdout: osd recover clone overlap = true 2024-09-10T08:27:30.333 INFO:teuthology.orchestra.run.smithi103.stdout: osd recovery max chunk = 1048576 2024-09-10T08:27:30.333 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.333 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug shutdown = true 2024-09-10T08:27:30.333 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug op order = true 2024-09-10T08:27:30.333 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug verify stray on activate = true 2024-09-10T08:27:30.333 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug trim objects = true 2024-09-10T08:27:30.333 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.333 INFO:teuthology.orchestra.run.smithi103.stdout: osd open classes on start = true 2024-09-10T08:27:30.333 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug pg log writeout = true 2024-09-10T08:27:30.333 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.333 INFO:teuthology.orchestra.run.smithi103.stdout: osd deep scrub update digest min age = 30 2024-09-10T08:27:30.333 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.333 INFO:teuthology.orchestra.run.smithi103.stdout: osd map max advance = 10 2024-09-10T08:27:30.334 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.334 INFO:teuthology.orchestra.run.smithi103.stdout: journal zero on create = true 2024-09-10T08:27:30.334 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.334 INFO:teuthology.orchestra.run.smithi103.stdout: filestore ondisk finisher threads = 3 2024-09-10T08:27:30.334 INFO:teuthology.orchestra.run.smithi103.stdout: filestore apply finisher threads = 3 2024-09-10T08:27:30.334 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.334 INFO:teuthology.orchestra.run.smithi103.stdout: bdev debug aio = true 2024-09-10T08:27:30.334 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug misdirected ops = true 2024-09-10T08:27:30.334 INFO:teuthology.orchestra.run.smithi103.stdout: bdev async discard = True 2024-09-10T08:27:30.334 INFO:teuthology.orchestra.run.smithi103.stdout: bdev enable discard = True 2024-09-10T08:27:30.334 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore allocator = bitmap 2024-09-10T08:27:30.334 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore block size = 96636764160 2024-09-10T08:27:30.334 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore fsck on mount = True 2024-09-10T08:27:30.334 INFO:teuthology.orchestra.run.smithi103.stdout: debug bluefs = 1/20 2024-09-10T08:27:30.335 INFO:teuthology.orchestra.run.smithi103.stdout: debug bluestore = 1/20 2024-09-10T08:27:30.335 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-10T08:27:30.335 INFO:teuthology.orchestra.run.smithi103.stdout: debug osd = 20 2024-09-10T08:27:30.335 INFO:teuthology.orchestra.run.smithi103.stdout: debug rocksdb = 4/10 2024-09-10T08:27:30.335 INFO:teuthology.orchestra.run.smithi103.stdout: filestore flush min = 0 2024-09-10T08:27:30.335 INFO:teuthology.orchestra.run.smithi103.stdout: mon client directed command retry = 5 2024-09-10T08:27:30.335 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T08:27:30.335 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd full ratio = 0.9 2024-09-10T08:27:30.335 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd nearfull ratio = 0.8 2024-09-10T08:27:30.335 INFO:teuthology.orchestra.run.smithi103.stdout: ms inject delay max = 1 2024-09-10T08:27:30.335 INFO:teuthology.orchestra.run.smithi103.stdout: ms inject delay probability = 0.005 2024-09-10T08:27:30.335 INFO:teuthology.orchestra.run.smithi103.stdout: ms inject delay type = client mds 2024-09-10T08:27:30.335 INFO:teuthology.orchestra.run.smithi103.stdout: ms inject socket failures = 2500 2024-09-10T08:27:30.336 INFO:teuthology.orchestra.run.smithi103.stdout: osd blocked scrub grace period = 3600 2024-09-10T08:27:30.336 INFO:teuthology.orchestra.run.smithi103.stdout: osd failsafe full ratio = 0.95 2024-09-10T08:27:30.336 INFO:teuthology.orchestra.run.smithi103.stdout: osd max markdown count = 1000 2024-09-10T08:27:30.336 INFO:teuthology.orchestra.run.smithi103.stdout: osd objectstore = bluestore 2024-09-10T08:27:30.336 INFO:teuthology.orchestra.run.smithi103.stdout: osd op complaint time = 180 2024-09-10T08:27:30.336 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.336 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr] 2024-09-10T08:27:30.336 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-10T08:27:30.336 INFO:teuthology.orchestra.run.smithi103.stdout: debug mgr = 20 2024-09-10T08:27:30.336 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2024-09-10T08:27:30.336 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2024-09-10T08:27:30.336 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2024-09-10T08:27:30.336 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2024-09-10T08:27:30.336 INFO:teuthology.orchestra.run.smithi103.stdout: mgr/telemetry/nag = false 2024-09-10T08:27:30.337 INFO:teuthology.orchestra.run.smithi103.stdout: debug client = 20 2024-09-10T08:27:30.337 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.337 INFO:teuthology.orchestra.run.smithi103.stdout:[mon] 2024-09-10T08:27:30.337 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-10T08:27:30.337 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2024-09-10T08:27:30.337 INFO:teuthology.orchestra.run.smithi103.stdout: debug paxos = 20 2024-09-10T08:27:30.337 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2024-09-10T08:27:30.337 INFO:teuthology.orchestra.run.smithi103.stdout: mon data avail warn = 5 2024-09-10T08:27:30.337 INFO:teuthology.orchestra.run.smithi103.stdout: mon mgr mkfs grace = 240 2024-09-10T08:27:30.337 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2024-09-10T08:27:30.337 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd reporter subtree level = osd 2024-09-10T08:27:30.337 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd prime pg temp = true 2024-09-10T08:27:30.337 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2024-09-10T08:27:30.338 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.338 INFO:teuthology.orchestra.run.smithi103.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T08:27:30.338 INFO:teuthology.orchestra.run.smithi103.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T08:27:30.338 INFO:teuthology.orchestra.run.smithi103.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T08:27:30.338 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.338 INFO:teuthology.orchestra.run.smithi103.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T08:27:30.338 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T08:27:30.338 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T08:27:30.338 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.338 INFO:teuthology.orchestra.run.smithi103.stdout: # 1m isn't quite enough 2024-09-10T08:27:30.338 INFO:teuthology.orchestra.run.smithi103.stdout: mon_down_mkfs_grace = 2m 2024-09-10T08:27:30.338 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.338 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_filestore_osds = false 2024-09-10T08:27:30.339 INFO:teuthology.orchestra.run.smithi103.stdout: mon down mkfs grace = 300 2024-09-10T08:27:30.339 INFO:teuthology.orchestra.run.smithi103.stdout: mon op complaint time = 120 2024-09-10T08:27:30.339 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on pool no app = False 2024-09-10T08:27:30.339 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:27:30.339 INFO:teuthology.orchestra.run.smithi103.stdout:[client] 2024-09-10T08:27:30.339 INFO:teuthology.orchestra.run.smithi103.stdout: rgw cache enabled = true 2024-09-10T08:27:30.339 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable ops log = true 2024-09-10T08:27:30.339 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable usage log = true 2024-09-10T08:27:30.339 INFO:teuthology.orchestra.run.smithi103.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T08:27:30.339 INFO:teuthology.orchestra.run.smithi103.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T08:27:30.339 INFO:teuthology.orchestra.run.smithi103.stdout: client mount timeout = 600 2024-09-10T08:27:30.339 INFO:teuthology.orchestra.run.smithi103.stdout: client_shutdown_timeout = 120 2024-09-10T08:27:30.339 INFO:teuthology.orchestra.run.smithi103.stdout: debug client = 20 2024-09-10T08:27:30.339 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-10T08:27:30.340 INFO:teuthology.orchestra.run.smithi103.stdout: rados mon op timeout = 900 2024-09-10T08:27:30.340 INFO:teuthology.orchestra.run.smithi103.stdout: rados osd op timeout = 900 2024-09-10T08:27:30.340 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.a] 2024-09-10T08:27:30.340 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.b] 2024-09-10T08:27:30.340 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.c] 2024-09-10T08:27:30.340 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.a] 2024-09-10T08:27:30.340 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.c] 2024-09-10T08:27:30.340 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.b] 2024-09-10T08:27:30.340 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.d] 2024-09-10T08:27:30.340 INFO:teuthology.orchestra.run.smithi103.stdout:[mds] 2024-09-10T08:27:30.340 INFO:teuthology.orchestra.run.smithi103.stdout: debug mds = 20 2024-09-10T08:27:30.340 INFO:teuthology.orchestra.run.smithi103.stdout: debug mds balancer = 20 2024-09-10T08:27:30.340 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-10T08:27:30.341 INFO:teuthology.orchestra.run.smithi103.stdout: mds bal fragment size max = 10000 2024-09-10T08:27:30.341 INFO:teuthology.orchestra.run.smithi103.stdout: mds bal merge size = 5 2024-09-10T08:27:30.341 INFO:teuthology.orchestra.run.smithi103.stdout: mds bal split bits = 3 2024-09-10T08:27:30.341 INFO:teuthology.orchestra.run.smithi103.stdout: mds bal split size = 100 2024-09-10T08:27:30.341 INFO:teuthology.orchestra.run.smithi103.stdout: mds debug frag = True 2024-09-10T08:27:30.341 INFO:teuthology.orchestra.run.smithi103.stdout: mds debug scatterstat = True 2024-09-10T08:27:30.341 INFO:teuthology.orchestra.run.smithi103.stdout: mds op complaint time = 180 2024-09-10T08:27:30.341 INFO:teuthology.orchestra.run.smithi103.stdout: mds verify scatter = True 2024-09-10T08:27:30.341 INFO:teuthology.orchestra.run.smithi103.stdout: mon client directed command retry = 5 2024-09-10T08:27:30.341 INFO:teuthology.orchestra.run.smithi103.stdout: ms inject delay max = 1 2024-09-10T08:27:30.341 INFO:teuthology.orchestra.run.smithi103.stdout: ms inject delay probability = 0.005 2024-09-10T08:27:30.341 INFO:teuthology.orchestra.run.smithi103.stdout: ms inject delay type = client mds osd 2024-09-10T08:27:30.341 INFO:teuthology.orchestra.run.smithi103.stdout: ms inject socket failures = 2500 2024-09-10T08:27:30.342 INFO:teuthology.orchestra.run.smithi103.stdout: osd op complaint time = 180 2024-09-10T08:27:30.342 INFO:teuthology.orchestra.run.smithi103.stdout: rados mon op timeout = 900 2024-09-10T08:27:30.342 INFO:teuthology.orchestra.run.smithi103.stdout: rados osd op timeout = 900 2024-09-10T08:27:30.342 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2024-09-10T08:27:30.342 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2024-09-10T08:27:30.342 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T08:27:30.343 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2024-09-10T08:27:30.343 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.343 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2024-09-10T08:27:30.343 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.343 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2024-09-10T08:27:30.343 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.343 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2024-09-10T08:27:30.343 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2024-09-10T08:27:30.343 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.343 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2024-09-10T08:27:30.343 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2024-09-10T08:27:30.343 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.344 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T08:27:30.344 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2024-09-10T08:27:30.344 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.344 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T08:27:30.344 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T08:27:30.344 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.344 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2024-09-10T08:27:30.344 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.344 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2024-09-10T08:27:30.344 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2024-09-10T08:27:30.344 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2024-09-10T08:27:30.344 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2024-09-10T08:27:30.344 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2024-09-10T08:27:30.345 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2024-09-10T08:27:30.345 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2024-09-10T08:27:30.345 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T08:27:30.345 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T08:27:30.345 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2024-09-10T08:27:30.345 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.345 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T08:27:30.345 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.345 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2024-09-10T08:27:30.345 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.345 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2024-09-10T08:27:30.345 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.345 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2024-09-10T08:27:30.346 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2024-09-10T08:27:30.346 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2024-09-10T08:27:30.346 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.103,172.21.15.154,[v2:172.21.15.154:3301,v1:172.21.15.154:6790]" 2024-09-10T08:27:30.346 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = 4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5 2024-09-10T08:27:30.346 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.346 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2024-09-10T08:27:30.346 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2024-09-10T08:27:30.346 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.346 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2024-09-10T08:27:30.346 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 600 2024-09-10T08:27:30.346 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock profile = high_recovery_ops 2024-09-10T08:27:30.346 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.346 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2024-09-10T08:27:30.346 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2024-09-10T08:27:30.347 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.347 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2024-09-10T08:27:30.347 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2024-09-10T08:27:30.347 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2024-09-10T08:27:30.347 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug trim objects = true 2024-09-10T08:27:30.347 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.347 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2024-09-10T08:27:30.347 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2024-09-10T08:27:30.347 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.347 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2024-09-10T08:27:30.347 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.347 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2024-09-10T08:27:30.347 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.347 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2024-09-10T08:27:30.348 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.348 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2024-09-10T08:27:30.348 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2024-09-10T08:27:30.348 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.348 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2024-09-10T08:27:30.348 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2024-09-10T08:27:30.348 INFO:teuthology.orchestra.run.smithi154.stdout: bdev async discard = True 2024-09-10T08:27:30.348 INFO:teuthology.orchestra.run.smithi154.stdout: bdev enable discard = True 2024-09-10T08:27:30.348 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore allocator = bitmap 2024-09-10T08:27:30.348 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2024-09-10T08:27:30.348 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2024-09-10T08:27:30.348 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 1/20 2024-09-10T08:27:30.348 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 1/20 2024-09-10T08:27:30.348 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-10T08:27:30.349 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2024-09-10T08:27:30.349 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 4/10 2024-09-10T08:27:30.349 INFO:teuthology.orchestra.run.smithi154.stdout: filestore flush min = 0 2024-09-10T08:27:30.349 INFO:teuthology.orchestra.run.smithi154.stdout: mon client directed command retry = 5 2024-09-10T08:27:30.349 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T08:27:30.349 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2024-09-10T08:27:30.349 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2024-09-10T08:27:30.349 INFO:teuthology.orchestra.run.smithi154.stdout: ms inject delay max = 1 2024-09-10T08:27:30.349 INFO:teuthology.orchestra.run.smithi154.stdout: ms inject delay probability = 0.005 2024-09-10T08:27:30.349 INFO:teuthology.orchestra.run.smithi154.stdout: ms inject delay type = client mds 2024-09-10T08:27:30.349 INFO:teuthology.orchestra.run.smithi154.stdout: ms inject socket failures = 2500 2024-09-10T08:27:30.349 INFO:teuthology.orchestra.run.smithi154.stdout: osd blocked scrub grace period = 3600 2024-09-10T08:27:30.349 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2024-09-10T08:27:30.350 INFO:teuthology.orchestra.run.smithi154.stdout: osd max markdown count = 1000 2024-09-10T08:27:30.350 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2024-09-10T08:27:30.350 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2024-09-10T08:27:30.350 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.350 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2024-09-10T08:27:30.350 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-10T08:27:30.350 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2024-09-10T08:27:30.350 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-09-10T08:27:30.350 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-09-10T08:27:30.350 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-09-10T08:27:30.350 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-09-10T08:27:30.350 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2024-09-10T08:27:30.350 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2024-09-10T08:27:30.350 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.351 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2024-09-10T08:27:30.351 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-10T08:27:30.351 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-09-10T08:27:30.351 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2024-09-10T08:27:30.351 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-09-10T08:27:30.351 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2024-09-10T08:27:30.351 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2024-09-10T08:27:30.351 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-09-10T08:27:30.351 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2024-09-10T08:27:30.351 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2024-09-10T08:27:30.351 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-09-10T08:27:30.351 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.351 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T08:27:30.351 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T08:27:30.352 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T08:27:30.352 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.352 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T08:27:30.352 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T08:27:30.352 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T08:27:30.352 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.352 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2024-09-10T08:27:30.352 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2024-09-10T08:27:30.352 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.352 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2024-09-10T08:27:30.352 INFO:teuthology.orchestra.run.smithi154.stdout: mon down mkfs grace = 300 2024-09-10T08:27:30.352 INFO:teuthology.orchestra.run.smithi154.stdout: mon op complaint time = 120 2024-09-10T08:27:30.352 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on pool no app = False 2024-09-10T08:27:30.353 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T08:27:30.353 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2024-09-10T08:27:30.353 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2024-09-10T08:27:30.353 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2024-09-10T08:27:30.353 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2024-09-10T08:27:30.353 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T08:27:30.353 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T08:27:30.353 INFO:teuthology.orchestra.run.smithi154.stdout: client mount timeout = 600 2024-09-10T08:27:30.353 INFO:teuthology.orchestra.run.smithi154.stdout: client_shutdown_timeout = 120 2024-09-10T08:27:30.353 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2024-09-10T08:27:30.353 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-10T08:27:30.353 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2024-09-10T08:27:30.353 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2024-09-10T08:27:30.353 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2024-09-10T08:27:30.354 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2024-09-10T08:27:30.354 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2024-09-10T08:27:30.354 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2024-09-10T08:27:30.354 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2024-09-10T08:27:30.354 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2024-09-10T08:27:30.354 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2024-09-10T08:27:30.354 INFO:teuthology.orchestra.run.smithi154.stdout:[mds] 2024-09-10T08:27:30.354 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds = 20 2024-09-10T08:27:30.354 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds balancer = 20 2024-09-10T08:27:30.354 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-10T08:27:30.354 INFO:teuthology.orchestra.run.smithi154.stdout: mds bal fragment size max = 10000 2024-09-10T08:27:30.354 INFO:teuthology.orchestra.run.smithi154.stdout: mds bal merge size = 5 2024-09-10T08:27:30.354 INFO:teuthology.orchestra.run.smithi154.stdout: mds bal split bits = 3 2024-09-10T08:27:30.354 INFO:teuthology.orchestra.run.smithi154.stdout: mds bal split size = 100 2024-09-10T08:27:30.354 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug frag = True 2024-09-10T08:27:30.355 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug scatterstat = True 2024-09-10T08:27:30.355 INFO:teuthology.orchestra.run.smithi154.stdout: mds op complaint time = 180 2024-09-10T08:27:30.355 INFO:teuthology.orchestra.run.smithi154.stdout: mds verify scatter = True 2024-09-10T08:27:30.355 INFO:teuthology.orchestra.run.smithi154.stdout: mon client directed command retry = 5 2024-09-10T08:27:30.355 INFO:teuthology.orchestra.run.smithi154.stdout: ms inject delay max = 1 2024-09-10T08:27:30.355 INFO:teuthology.orchestra.run.smithi154.stdout: ms inject delay probability = 0.005 2024-09-10T08:27:30.355 INFO:teuthology.orchestra.run.smithi154.stdout: ms inject delay type = client mds osd 2024-09-10T08:27:30.355 INFO:teuthology.orchestra.run.smithi154.stdout: ms inject socket failures = 2500 2024-09-10T08:27:30.355 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2024-09-10T08:27:30.355 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2024-09-10T08:27:30.355 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2024-09-10T08:27:30.357 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-10T08:27:30.357 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-10T08:27:30.450 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-10T08:27:30.451 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:27:30.451 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-10T08:27:30.466 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:27:30.466 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-10T08:27:30.521 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T08:27:30.522 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:27:30.522 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T08:27:30.522 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T08:27:30.599 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:27:30.599 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:27:30.657 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T08:27:30.658 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:27:30.658 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T08:27:30.658 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T08:27:30.694 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:27:30.694 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:27:30.752 INFO:tasks.ceph:Setting up mon nodes... 2024-09-10T08:27:30.752 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-10T08:27:30.752 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T08:27:30.803 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T08:27:30.805 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T08:27:30.868 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T08:27:30.870 INFO:tasks.ceph:Setting up mds nodes... 2024-09-10T08:27:30.871 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T08:27:30.921 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T08:27:30.924 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-10T08:27:30.948 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T08:27:31.039 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T08:27:31.041 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-10T08:27:31.066 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T08:27:31.117 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T08:27:31.120 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-10T08:27:31.145 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T08:27:31.235 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T08:27:31.238 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-10T08:27:31.262 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-10T08:27:31.263 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T08:27:31.305 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-10T08:27:31.317 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-10T08:27:31.358 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-10T08:27:31.371 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-10T08:27:31.371 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T08:27:31.371 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-10T08:27:31.396 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T08:27:31.396 INFO:tasks.ceph:role: osd.0 2024-09-10T08:27:31.397 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T08:27:31.397 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T08:27:31.467 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:27:31.468 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:27:31.468 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:27:31.468 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:27:31.468 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:27:31.468 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:27:31.468 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:27:31.468 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:27:31.468 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:27:31.468 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:27:31.960 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-10T08:27:31.963 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-10T08:27:31.963 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-10T08:27:32.081 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-10T08:27:32.113 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-10T08:27:32.178 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T08:27:32.179 INFO:tasks.ceph:role: osd.1 2024-09-10T08:27:32.179 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T08:27:32.179 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T08:27:32.251 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:27:32.251 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:27:32.251 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:27:32.251 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:27:32.252 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:27:32.252 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:27:32.252 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:27:32.252 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:27:32.252 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:27:32.252 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:27:32.721 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-10T08:27:32.723 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-10T08:27:32.723 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-10T08:27:32.818 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-10T08:27:32.848 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-10T08:27:32.913 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T08:27:32.913 INFO:tasks.ceph:role: osd.2 2024-09-10T08:27:32.913 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T08:27:32.913 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T08:27:32.985 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:27:32.986 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:27:32.986 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:27:32.986 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:27:32.986 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:27:32.986 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:27:32.986 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:27:32.986 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:27:32.987 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:27:32.987 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:27:33.469 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-10T08:27:33.471 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-10T08:27:33.472 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-10T08:27:33.619 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-10T08:27:33.650 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-10T08:27:33.715 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T08:27:33.715 INFO:tasks.ceph:role: osd.3 2024-09-10T08:27:33.715 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T08:27:33.716 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T08:27:33.788 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:27:33.788 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:27:33.788 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:27:33.788 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:27:33.788 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:27:33.788 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:27:33.788 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:27:33.788 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:27:33.788 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:27:33.788 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:27:34.305 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-10T08:27:34.307 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-10T08:27:34.307 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-10T08:27:34.437 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-10T08:27:34.471 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:27:34.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:27:34.578+0000 7f5f80d89640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-10T08:27:34.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:27:34.578+0000 7f5f80d89640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-10T08:27:34.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:27:34.578+0000 7f5f80d89640 -1 bdev(0x55cdb5ce3800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-10T08:27:34.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:27:34.578+0000 7f5f80d89640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-10T08:27:38.501 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T08:27:38.530 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:27:38.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:27:38.623+0000 7f3923c40640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-10T08:27:38.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:27:38.624+0000 7f3923c40640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-10T08:27:38.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:27:38.624+0000 7f3923c40640 -1 bdev(0x555d91e37800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-10T08:27:38.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:27:38.624+0000 7f3923c40640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-10T08:27:42.522 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T08:27:42.551 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:27:42.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:27:42.643+0000 7f9a393b2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-10T08:27:42.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:27:42.643+0000 7f9a393b2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-10T08:27:42.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:27:42.643+0000 7f9a393b2640 -1 bdev(0x564150aab800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-10T08:27:42.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:27:42.643+0000 7f9a393b2640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-10T08:27:46.543 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T08:27:46.573 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:27:46.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:27:46.663+0000 7fa47e42c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-10T08:27:46.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:27:46.664+0000 7fa47e42c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-10T08:27:46.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:27:46.664+0000 7fa47e42c640 -1 bdev(0x5593b03b3800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-10T08:27:46.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:27:46.664+0000 7fa47e42c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-10T08:27:50.570 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T08:27:50.600 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-10T08:27:50.631 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T08:27:50.631 INFO:tasks.ceph:role: osd.4 2024-09-10T08:27:50.631 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T08:27:50.631 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T08:27:50.707 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:27:50.707 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:27:50.707 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:27:50.707 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:27:50.707 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:27:50.707 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:27:50.707 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:27:50.707 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:27:50.707 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:27:50.707 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:27:51.224 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-10T08:27:51.226 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-10T08:27:51.226 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-10T08:27:51.346 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-10T08:27:51.379 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-10T08:27:51.443 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T08:27:51.444 INFO:tasks.ceph:role: osd.5 2024-09-10T08:27:51.444 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T08:27:51.444 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T08:27:51.516 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:27:51.517 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:27:51.517 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:27:51.517 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:27:51.517 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:27:51.517 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:27:51.517 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:27:51.517 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:27:51.517 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:27:51.517 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:27:51.977 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-10T08:27:51.979 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-10T08:27:51.979 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-10T08:27:52.071 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-10T08:27:52.099 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-10T08:27:52.165 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T08:27:52.165 INFO:tasks.ceph:role: osd.6 2024-09-10T08:27:52.165 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T08:27:52.165 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T08:27:52.237 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:27:52.238 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:27:52.238 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:27:52.238 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:27:52.238 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:27:52.238 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:27:52.238 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:27:52.238 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:27:52.238 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:27:52.238 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:27:52.722 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-10T08:27:52.724 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-10T08:27:52.724 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-10T08:27:52.866 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-10T08:27:52.897 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-10T08:27:52.963 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T08:27:52.963 INFO:tasks.ceph:role: osd.7 2024-09-10T08:27:52.963 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T08:27:52.963 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T08:27:53.037 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:27:53.037 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:27:53.037 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:27:53.037 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:27:53.037 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:27:53.037 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:27:53.038 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:27:53.038 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:27:53.038 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:27:53.038 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:27:53.555 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-10T08:27:53.557 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-10T08:27:53.557 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-10T08:27:53.687 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-10T08:27:53.717 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:27:53.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:27:53.815+0000 7f337020d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-10T08:27:53.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:27:53.815+0000 7f337020d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-10T08:27:53.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:27:53.815+0000 7f337020d640 -1 bdev(0x561c9252d800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-10T08:27:53.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:27:53.815+0000 7f337020d640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-10T08:27:57.725 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T08:27:57.755 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:27:57.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:27:57.844+0000 7f03cd812640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-10T08:27:57.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:27:57.845+0000 7f03cd812640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-10T08:27:57.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:27:57.845+0000 7f03cd812640 -1 bdev(0x560eca0eb800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-10T08:27:57.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:27:57.845+0000 7f03cd812640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-10T08:27:58.380 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:27:58.383 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:28:01.754 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T08:28:01.786 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:28:01.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:01.877+0000 7f37c8a24640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-10T08:28:01.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:01.877+0000 7f37c8a24640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-10T08:28:01.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:01.877+0000 7f37c8a24640 -1 bdev(0x5616c254f800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-10T08:28:01.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:01.877+0000 7f37c8a24640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-10T08:28:05.775 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-10T08:28:05.805 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:28:05.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:05.897+0000 7f2eca2b0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-10T08:28:05.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:05.897+0000 7f2eca2b0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-10T08:28:05.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:05.897+0000 7f2eca2b0640 -1 bdev(0x55f124a63800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-10T08:28:05.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:05.898+0000 7f2eca2b0640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-10T08:28:09.559 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-10T08:28:09.589 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-10T08:28:09.589 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:28:09.590 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-10T08:28:09.620 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:28:09.620 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-10T08:28:09.689 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:28:09.689 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-10T08:28:09.757 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:28:09.757 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-10T08:28:09.824 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:28:09.825 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-10T08:28:09.890 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:28:09.891 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-10T08:28:09.955 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:28:09.955 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-10T08:28:10.020 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:28:10.020 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-10T08:28:10.051 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:28:10.051 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-10T08:28:10.119 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:28:10.119 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-10T08:28:10.186 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:28:10.186 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-10T08:28:10.253 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:28:10.254 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-10T08:28:10.319 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:28:10.320 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-10T08:28:10.385 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:28:10.385 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-10T08:28:10.451 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:28:10.451 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-10T08:28:10.467 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:28:10.467 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-10T08:28:10.506 INFO:tasks.ceph:Adding keys to all mons... 2024-09-10T08:28:10.507 DEBUG:teuthology.orchestra.run.smithi103:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T08:28:10.509 DEBUG:teuthology.orchestra.run.smithi154:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T08:28:10.550 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr.y] 2024-09-10T08:28:10.550 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDyAuBm6ZzvLxAAif472U23pm0OCJtmhZt1hg== 2024-09-10T08:28:10.550 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.a] 2024-09-10T08:28:10.550 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDyAuBmyJYANxAApG8Bmr9GGQ4os8fpPlrarw== 2024-09-10T08:28:10.550 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.c] 2024-09-10T08:28:10.550 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDzAuBmaPRsAhAAV3Z+/61Zdp+uyuFCe0hb9w== 2024-09-10T08:28:10.550 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.0] 2024-09-10T08:28:10.551 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQD2AuBm2geAIhAAJ9CxzAXrsDGr6qKYlB6+5g== 2024-09-10T08:28:10.551 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.1] 2024-09-10T08:28:10.551 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQD6AuBmTY81JRAAQD7AxWg9WLlHt9J6Ezj8Gg== 2024-09-10T08:28:10.551 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.2] 2024-09-10T08:28:10.551 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQD+AuBmIntgJhAADHLP9dPRioWuiTsG+ApdWA== 2024-09-10T08:28:10.551 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.3] 2024-09-10T08:28:10.551 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQACA+BmHPmpJxAAzPm5YQ1Sb0b4F9lTaUg9vw== 2024-09-10T08:28:10.551 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr.x] 2024-09-10T08:28:10.551 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDyAuBm9tPRMxAAbsP2AYa+QsDpODamyaljGg== 2024-09-10T08:28:10.551 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.b] 2024-09-10T08:28:10.551 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDzAuBm3oYWBxAAHy27Wg81ERw7k7soaunOdA== 2024-09-10T08:28:10.551 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.d] 2024-09-10T08:28:10.551 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDzAuBmEs8eDhAAZSl75rDcS2aqIRcP/MaL1w== 2024-09-10T08:28:10.552 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.4] 2024-09-10T08:28:10.552 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAJA+BmEtqpMBAA1IY9kjSAPN04+DzPZ7VyUg== 2024-09-10T08:28:10.552 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.5] 2024-09-10T08:28:10.552 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQANA+Bmxox4MhAAWhp9l5NFQwi+XMm5VXkyLw== 2024-09-10T08:28:10.552 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.6] 2024-09-10T08:28:10.552 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQARA+BmfntaNBAAbNOMMyLG3Ng5rLgKxZjcfg== 2024-09-10T08:28:10.552 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.7] 2024-09-10T08:28:10.552 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAVA+Bm+NCNNRAAAK7saICGeUNCbK311FfG5Q== 2024-09-10T08:28:10.552 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-09-10T08:28:10.552 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDzAuBmbaRDEhAACofe6h8tMWXpzd6KytAguA== 2024-09-10T08:28:10.552 INFO:teuthology.orchestra.run.smithi103.stdout:[client.1] 2024-09-10T08:28:10.552 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDzAuBmpQptFRAAT+zw/WJ56kKTKsx5OFbVvA== 2024-09-10T08:28:10.571 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.y] 2024-09-10T08:28:10.571 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDyAuBm6ZzvLxAAif472U23pm0OCJtmhZt1hg== 2024-09-10T08:28:10.571 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2024-09-10T08:28:10.571 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDyAuBmyJYANxAApG8Bmr9GGQ4os8fpPlrarw== 2024-09-10T08:28:10.571 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2024-09-10T08:28:10.571 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDzAuBmaPRsAhAAV3Z+/61Zdp+uyuFCe0hb9w== 2024-09-10T08:28:10.572 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.0] 2024-09-10T08:28:10.572 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQD2AuBm2geAIhAAJ9CxzAXrsDGr6qKYlB6+5g== 2024-09-10T08:28:10.572 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.1] 2024-09-10T08:28:10.572 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQD6AuBmTY81JRAAQD7AxWg9WLlHt9J6Ezj8Gg== 2024-09-10T08:28:10.572 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.2] 2024-09-10T08:28:10.572 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQD+AuBmIntgJhAADHLP9dPRioWuiTsG+ApdWA== 2024-09-10T08:28:10.572 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.3] 2024-09-10T08:28:10.572 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQACA+BmHPmpJxAAzPm5YQ1Sb0b4F9lTaUg9vw== 2024-09-10T08:28:10.572 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.x] 2024-09-10T08:28:10.572 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDyAuBm9tPRMxAAbsP2AYa+QsDpODamyaljGg== 2024-09-10T08:28:10.572 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2024-09-10T08:28:10.572 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDzAuBm3oYWBxAAHy27Wg81ERw7k7soaunOdA== 2024-09-10T08:28:10.572 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2024-09-10T08:28:10.572 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDzAuBmEs8eDhAAZSl75rDcS2aqIRcP/MaL1w== 2024-09-10T08:28:10.573 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.4] 2024-09-10T08:28:10.573 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAJA+BmEtqpMBAA1IY9kjSAPN04+DzPZ7VyUg== 2024-09-10T08:28:10.573 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.5] 2024-09-10T08:28:10.573 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQANA+Bmxox4MhAAWhp9l5NFQwi+XMm5VXkyLw== 2024-09-10T08:28:10.573 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.6] 2024-09-10T08:28:10.573 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQARA+BmfntaNBAAbNOMMyLG3Ng5rLgKxZjcfg== 2024-09-10T08:28:10.573 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.7] 2024-09-10T08:28:10.573 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAVA+Bm+NCNNRAAAK7saICGeUNCbK311FfG5Q== 2024-09-10T08:28:10.573 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2024-09-10T08:28:10.573 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDzAuBmbaRDEhAACofe6h8tMWXpzd6KytAguA== 2024-09-10T08:28:10.573 INFO:teuthology.orchestra.run.smithi154.stdout:[client.1] 2024-09-10T08:28:10.573 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDzAuBmpQptFRAAT+zw/WJ56kKTKsx5OFbVvA== 2024-09-10T08:28:10.574 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T08:28:10.596 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T08:28:10.666 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:28:10.669 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:28:10.722 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:28:10.724 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:28:10.777 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:10.780 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:10.831 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:10.833 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:10.883 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:10.886 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:10.936 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:10.939 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:10.989 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T08:28:10.992 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T08:28:11.042 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:28:11.045 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:28:11.099 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:28:11.101 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:28:11.155 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:11.157 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:11.208 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:11.211 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:11.263 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:11.265 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:11.316 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:11.318 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:11.369 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T08:28:11.371 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T08:28:11.429 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T08:28:11.432 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T08:28:11.485 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-10T08:28:11.485 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-10T08:28:11.511 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T08:28:11.607 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-10T08:28:11.632 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-10T08:28:11.657 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T08:28:11.753 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-10T08:28:11.778 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-10T08:28:11.844 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T08:28:11.940 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-10T08:28:11.965 DEBUG:teuthology.orchestra.run.smithi103:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:28:11.968 DEBUG:teuthology.orchestra.run.smithi154:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:28:12.026 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-10T08:28:12.353 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T08:28:12.353 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T08:28:12.356 INFO:tasks.ceph.mon.a:Started 2024-09-10T08:28:12.356 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T08:28:12.356 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T08:28:12.359 INFO:tasks.ceph.mon.b:Started 2024-09-10T08:28:12.359 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T08:28:12.359 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T08:28:12.361 INFO:tasks.ceph.mon.c:Started 2024-09-10T08:28:12.361 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-10T08:28:12.362 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-10T08:28:12.362 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-10T08:28:12.364 INFO:tasks.ceph.mgr.y:Started 2024-09-10T08:28:12.364 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-10T08:28:12.364 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-10T08:28:12.366 INFO:tasks.ceph.mgr.x:Started 2024-09-10T08:28:12.367 INFO:tasks.ceph:Setting crush tunables to default 2024-09-10T08:28:12.367 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd crush tunables default 2024-09-10T08:28:12.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.469+0000 7f39abb4b640 1 Processor -- start 2024-09-10T08:28:12.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.469+0000 7f39abb4b640 1 -- start start 2024-09-10T08:28:12.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.470+0000 7f39abb4b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39a40c8080 0x7f39a406f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:12.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.470+0000 7f39abb4b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39a40c8890 con 0x7f39a40c48c0 2024-09-10T08:28:12.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.470+0000 7f39abb4b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39a4073770 con 0x7f39a40a9460 2024-09-10T08:28:12.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.470+0000 7f39abb4b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f39a4073d30 con 0x7f39a40c8080 2024-09-10T08:28:12.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.470+0000 7f39aa0e8640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f39a40c48c0 0x7f39a40c4d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:35818/0 (socket says 172.21.15.103:35818) 2024-09-10T08:28:12.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.470+0000 7f39aa0e8640 1 -- 172.21.15.103:0/1339860768 learned_addr learned my addr 172.21.15.103:0/1339860768 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:12.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.470+0000 7f39a98e7640 1 --2- 172.21.15.103:0/1339860768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39a40c8080 0x7f39a406f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:12.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.470+0000 7f39a98e7640 1 -- 172.21.15.103:0/1339860768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39a40c8080 msgr2=0x7f39a406f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:28:12.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.470+0000 7f39a98e7640 1 -- 172.21.15.103:0/1339860768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39a40c8080 msgr2=0x7f39a406f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:28:12.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.470+0000 7f39a98e7640 1 --2- 172.21.15.103:0/1339860768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39a40c8080 0x7f39a406f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:28:12.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.470+0000 7f39a98e7640 1 --2- 172.21.15.103:0/1339860768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39a40c8080 0x7f39a406f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:28:12.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.669+0000 7f39a88e5640 1 -- 172.21.15.103:0/1339860768 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3804722294 0 0) 0x7f39a40c8890 con 0x7f39a40c48c0 2024-09-10T08:28:12.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.669+0000 7f39a88e5640 1 -- 172.21.15.103:0/1339860768 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3990003520 con 0x7f39a40c48c0 2024-09-10T08:28:12.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.669+0000 7f39a88e5640 1 -- 172.21.15.103:0/1339860768 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 67874384 0 0) 0x7f3990003520 con 0x7f39a40c48c0 2024-09-10T08:28:12.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.669+0000 7f39a88e5640 1 -- 172.21.15.103:0/1339860768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39a40c8080 msgr2=0x7f39a406f4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:28:12.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.669+0000 7f39a88e5640 1 --2- 172.21.15.103:0/1339860768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39a40c8080 0x7f39a406f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:12.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.669+0000 7f39a88e5640 1 -- 172.21.15.103:0/1339860768 >> v1:172.21.15.154:6789/0 conn(0x7f39a40a9460 legacy=0x7f39a406fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:12.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.669+0000 7f39a88e5640 1 -- 172.21.15.103:0/1339860768 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a4073a50 con 0x7f39a40c48c0 2024-09-10T08:28:12.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.669+0000 7f39a88e5640 1 -- 172.21.15.103:0/1339860768 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f399c0019f0 con 0x7f39a40c48c0 2024-09-10T08:28:12.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.669+0000 7f39a88e5640 1 -- 172.21.15.103:0/1339860768 >> v1:172.21.15.103:6789/0 conn(0x7f39a40c48c0 legacy=0x7f39a40c4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:12.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.669+0000 7f39a88e5640 1 --2- 172.21.15.103:0/1339860768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39a40c8080 0x7f39900039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:12.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.669+0000 7f39a88e5640 1 --2- 172.21.15.103:0/1339860768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3990004010 0x7f3990004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:12.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.669+0000 7f39a88e5640 1 --2- 172.21.15.103:0/1339860768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3990004d40 0x7f39900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:12.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.670+0000 7f39a88e5640 1 -- 172.21.15.103:0/1339860768 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f39a4073d30 con 0x7f3990004010 2024-09-10T08:28:12.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.670+0000 7f39a88e5640 1 -- 172.21.15.103:0/1339860768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f399000bb80 con 0x7f3990004d40 2024-09-10T08:28:12.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.670+0000 7f39a88e5640 1 -- 172.21.15.103:0/1339860768 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f399000bd80 con 0x7f39a40c8080 2024-09-10T08:28:12.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.670+0000 7f39aa0e8640 1 --2- 172.21.15.103:0/1339860768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3990004d40 0x7f39900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:12.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.670+0000 7f39a98e7640 1 --2- 172.21.15.103:0/1339860768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39a40c8080 0x7f39900039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:12.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.670+0000 7f39a90e6640 1 --2- 172.21.15.103:0/1339860768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3990004010 0x7f3990004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:12.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.670+0000 7f39a98e7640 1 -- 172.21.15.103:0/1339860768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3990004d40 msgr2=0x7f39900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:12.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.670+0000 7f39a98e7640 1 --2- 172.21.15.103:0/1339860768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3990004d40 0x7f39900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:12.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.670+0000 7f39a98e7640 1 -- 172.21.15.103:0/1339860768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3990004010 msgr2=0x7f3990004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:12.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.670+0000 7f39a98e7640 1 --2- 172.21.15.103:0/1339860768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3990004010 0x7f3990004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:12.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.670+0000 7f39a98e7640 1 -- 172.21.15.103:0/1339860768 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3990003520 con 0x7f39a40c8080 2024-09-10T08:28:12.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.670+0000 7f39a90e6640 1 --2- 172.21.15.103:0/1339860768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3990004010 0x7f3990004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:12.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.671+0000 7f39a98e7640 1 --2- 172.21.15.103:0/1339860768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39a40c8080 0x7f39900039e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f39a000fd70 tx=0x7f3990005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4faa3b1723ae2d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:12.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.673+0000 7f39a88e5640 1 -- 172.21.15.103:0/1339860768 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a003c070 con 0x7f39a40c8080 2024-09-10T08:28:12.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.673+0000 7f39a88e5640 1 -- 172.21.15.103:0/1339860768 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a0037410 con 0x7f39a40c8080 2024-09-10T08:28:12.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.673+0000 7f39a88e5640 1 -- 172.21.15.103:0/1339860768 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a000f9f0 con 0x7f39a40c8080 2024-09-10T08:28:12.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.674+0000 7f39abb4b640 1 -- 172.21.15.103:0/1339860768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39a40c8080 msgr2=0x7f39900039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:12.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.674+0000 7f39abb4b640 1 --2- 172.21.15.103:0/1339860768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39a40c8080 0x7f39900039e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f39a000fd70 tx=0x7f3990005830 comp rx=0 tx=0).stop 2024-09-10T08:28:12.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.674+0000 7f39aa0e8640 1 -- 172.21.15.103:0/1339860768 reap_dead start 2024-09-10T08:28:12.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.674+0000 7f39abb4b640 1 -- 172.21.15.103:0/1339860768 shutdown_connections 2024-09-10T08:28:12.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.674+0000 7f39abb4b640 1 -- 172.21.15.103:0/1339860768 >> 172.21.15.103:0/1339860768 conn(0x7f39a40aba20 msgr2=0x7f39a40abe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:12.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.674+0000 7f39abb4b640 1 -- 172.21.15.103:0/1339860768 shutdown_connections 2024-09-10T08:28:12.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.674+0000 7f39abb4b640 1 -- 172.21.15.103:0/1339860768 wait complete. 2024-09-10T08:28:12.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.675+0000 7f39abb4b640 1 Processor -- start 2024-09-10T08:28:12.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.675+0000 7f39abb4b640 1 -- start start 2024-09-10T08:28:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.676+0000 7f39abb4b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39a40c8080 0x7f39a4151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.676+0000 7f39abb4b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39a40a8e80 0x7f39a4150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.676+0000 7f39abb4b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4152980 0x7f39a4151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.676+0000 7f39abb4b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f39a40ac7a0 con 0x7f39a4152980 2024-09-10T08:28:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.676+0000 7f39abb4b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f39a4070110 con 0x7f39a40c8080 2024-09-10T08:28:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.676+0000 7f39abb4b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f39a4074420 con 0x7f39a40a8e80 2024-09-10T08:28:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.676+0000 7f39aa0e8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4152980 0x7f39a4151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.676+0000 7f39a98e7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39a40c8080 0x7f39a4151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:12.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.676+0000 7f39aa0e8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4152980 0x7f39a4151440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52894/0 (socket says 172.21.15.103:52894) 2024-09-10T08:28:12.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.676+0000 7f39aa0e8640 1 -- 172.21.15.103:0/3747512392 learned_addr learned my addr 172.21.15.103:0/3747512392 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:12.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.676+0000 7f39a90e6640 1 --2- 172.21.15.103:0/3747512392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39a40a8e80 0x7f39a4150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:12.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.677+0000 7f39aa0e8640 1 -- 172.21.15.103:0/3747512392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39a40a8e80 msgr2=0x7f39a4150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:12.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.677+0000 7f39aa0e8640 1 --2- 172.21.15.103:0/3747512392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39a40a8e80 0x7f39a4150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:12.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.677+0000 7f39aa0e8640 1 -- 172.21.15.103:0/3747512392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39a40c8080 msgr2=0x7f39a4151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:12.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.677+0000 7f39aa0e8640 1 --2- 172.21.15.103:0/3747512392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39a40c8080 0x7f39a4151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:12.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.677+0000 7f39aa0e8640 1 -- 172.21.15.103:0/3747512392 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a4151980 con 0x7f39a4152980 2024-09-10T08:28:12.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.677+0000 7f39aa0e8640 1 --2- 172.21.15.103:0/3747512392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4152980 0x7f39a4151440 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f39a40caca0 tx=0x7f399c00a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:12.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.677+0000 7f399a7fc640 1 -- 172.21.15.103:0/3747512392 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3994001370 con 0x7f39a4152980 2024-09-10T08:28:12.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.677+0000 7f399a7fc640 1 -- 172.21.15.103:0/3747512392 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f399c018070 con 0x7f39a4152980 2024-09-10T08:28:12.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.677+0000 7f39abb4b640 1 -- 172.21.15.103:0/3747512392 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a41e8100 con 0x7f39a4152980 2024-09-10T08:28:12.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.677+0000 7f399a7fc640 1 -- 172.21.15.103:0/3747512392 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c0133f0 con 0x7f39a4152980 2024-09-10T08:28:12.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.677+0000 7f39abb4b640 1 -- 172.21.15.103:0/3747512392 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a40bf180 con 0x7f39a4152980 2024-09-10T08:28:12.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.677+0000 7f399a7fc640 1 -- 172.21.15.103:0/3747512392 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f399c013590 con 0x7f39a4152980 2024-09-10T08:28:12.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.677+0000 7f399a7fc640 1 -- 172.21.15.103:0/3747512392 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f399c01da80 con 0x7f39a4152980 2024-09-10T08:28:12.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.678+0000 7f39abb4b640 1 -- 172.21.15.103:0/3747512392 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39a40bec90 con 0x7f39a4152980 2024-09-10T08:28:12.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.680+0000 7f399a7fc640 1 -- 172.21.15.103:0/3747512392 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f399c01d460 con 0x7f39a4152980 2024-09-10T08:28:12.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.744+0000 7f39abb4b640 1 -- 172.21.15.103:0/3747512392 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f39a40c8460 con 0x7f39a4152980 2024-09-10T08:28:12.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.745+0000 7f399a7fc640 1 -- 172.21.15.103:0/3747512392 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f399c01dcd0 con 0x7f39a4152980 2024-09-10T08:28:12.745 INFO:teuthology.orchestra.run.smithi103.stderr:adjusted tunables profile to default 2024-09-10T08:28:12.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.746+0000 7f39abb4b640 1 -- 172.21.15.103:0/3747512392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4152980 msgr2=0x7f39a4151440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:12.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.746+0000 7f39abb4b640 1 --2- 172.21.15.103:0/3747512392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4152980 0x7f39a4151440 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f39a40caca0 tx=0x7f399c00a730 comp rx=0 tx=0).stop 2024-09-10T08:28:12.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.746+0000 7f39abb4b640 1 -- 172.21.15.103:0/3747512392 shutdown_connections 2024-09-10T08:28:12.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.746+0000 7f39abb4b640 1 --2- 172.21.15.103:0/3747512392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39a4152980 0x7f39a4151440 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:12.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.746+0000 7f39abb4b640 1 --2- 172.21.15.103:0/3747512392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39a40a8e80 0x7f39a4150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:12.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.746+0000 7f39abb4b640 1 --2- 172.21.15.103:0/3747512392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39a40c8080 0x7f39a4151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:12.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.746+0000 7f39abb4b640 1 -- 172.21.15.103:0/3747512392 >> 172.21.15.103:0/3747512392 conn(0x7f39a40aba20 msgr2=0x7f39a4158410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:12.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.746+0000 7f39abb4b640 1 -- 172.21.15.103:0/3747512392 shutdown_connections 2024-09-10T08:28:12.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:12.746+0000 7f39abb4b640 1 -- 172.21.15.103:0/3747512392 wait complete. 2024-09-10T08:28:12.756 INFO:tasks.ceph:check_enable_crimson: False 2024-09-10T08:28:12.756 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-10T08:28:12.757 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:28:12.757 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-10T08:28:12.772 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:12.773+0000 7ff5a785c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T08:28:12.775 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:12.776+0000 7f800df27040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T08:28:12.781 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:28:12.781 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-10T08:28:12.816 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:12.816+0000 7ff5a785c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T08:28:12.816 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:12.816+0000 7f800df27040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T08:28:12.840 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:28:12.840 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-10T08:28:12.905 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:28:12.905 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-10T08:28:12.952 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:12.952+0000 7f800df27040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T08:28:12.961 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:12.962+0000 7ff5a785c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T08:28:12.970 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:28:12.970 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-10T08:28:12.996 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:28:12.996 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-10T08:28:13.004 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:13.004+0000 7f800df27040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T08:28:13.014 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:13.015+0000 7ff5a785c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T08:28:13.028 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:28:13.029 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-10T08:28:13.093 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:28:13.093 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-10T08:28:13.159 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 1abe08f4-0348-435e-9f97-cec00e96992c 0 2024-09-10T08:28:13.166 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:13.166+0000 7f800df27040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:28:13.173 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:13.174+0000 7ff5a785c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:28:13.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.264+0000 7f98ff853640 1 Processor -- start 2024-09-10T08:28:13.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.265+0000 7f98ff853640 1 -- start start 2024-09-10T08:28:13.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.265+0000 7f98ff853640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98f8153b70 0x7f98f8157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:13.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.265+0000 7f98ff853640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f98f8153f50 0x7f98f8158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:13.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.265+0000 7f98ff853640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98f8157540 con 0x7f98f80bf900 2024-09-10T08:28:13.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.265+0000 7f98ff853640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f98f8157c30 con 0x7f98f8153f50 2024-09-10T08:28:13.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.265+0000 7f98ff853640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f98f8157f10 con 0x7f98f8153b70 2024-09-10T08:28:13.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.265+0000 7f98fcdee640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f98f80bf900 0x7f98f80ae740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:48726/0 (socket says 172.21.15.154:48726) 2024-09-10T08:28:13.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.265+0000 7f98fd5ef640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98f8153b70 0x7f98f8157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:13.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.265+0000 7f98fcdee640 1 -- 172.21.15.154:0/1720098134 learned_addr learned my addr 172.21.15.154:0/1720098134 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-09-10T08:28:13.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.266+0000 7f98fddf0640 1 --2- 172.21.15.154:0/1720098134 >> v2:172.21.15.103:3300/0 conn(0x7f98f8153f50 0x7f98f8158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:13.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.266+0000 7f98ebfff640 1 -- 172.21.15.154:0/1720098134 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4203222263 0 0) 0x7f98f8157540 con 0x7f98f80bf900 2024-09-10T08:28:13.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.266+0000 7f98ebfff640 1 -- 172.21.15.154:0/1720098134 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98e4003520 con 0x7f98f80bf900 2024-09-10T08:28:13.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.266+0000 7f98fd5ef640 1 -- 172.21.15.154:0/1720098134 >> v2:172.21.15.103:3300/0 conn(0x7f98f8153f50 msgr2=0x7f98f8158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:13.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.266+0000 7f98fd5ef640 1 --2- 172.21.15.154:0/1720098134 >> v2:172.21.15.103:3300/0 conn(0x7f98f8153f50 0x7f98f8158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.266+0000 7f98fd5ef640 1 -- 172.21.15.154:0/1720098134 >> v1:172.21.15.154:6789/0 conn(0x7f98f80bf900 legacy=0x7f98f80ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:13.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.266+0000 7f98fd5ef640 1 -- 172.21.15.154:0/1720098134 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f81581f0 con 0x7f98f8153b70 2024-09-10T08:28:13.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.267+0000 7f98fd5ef640 1 --2- 172.21.15.154:0/1720098134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98f8153b70 0x7f98f8157000 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f98f40097a0 tx=0x7f98f402a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=601c44b83f57b004 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:13.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.267+0000 7f98ebfff640 1 -- 172.21.15.154:0/1720098134 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f4037070 con 0x7f98f8153b70 2024-09-10T08:28:13.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.267+0000 7f98ebfff640 1 -- 172.21.15.154:0/1720098134 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f402adb0 con 0x7f98f8153b70 2024-09-10T08:28:13.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.267+0000 7f98ebfff640 1 -- 172.21.15.154:0/1720098134 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f4032660 con 0x7f98f8153b70 2024-09-10T08:28:13.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.268+0000 7f98ff853640 1 -- 172.21.15.154:0/1720098134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98f8153b70 msgr2=0x7f98f8157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:13.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.268+0000 7f98ff853640 1 --2- 172.21.15.154:0/1720098134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98f8153b70 0x7f98f8157000 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f98f40097a0 tx=0x7f98f402a060 comp rx=0 tx=0).stop 2024-09-10T08:28:13.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.268+0000 7f98ff853640 1 -- 172.21.15.154:0/1720098134 shutdown_connections 2024-09-10T08:28:13.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.268+0000 7f98ff853640 1 --2- 172.21.15.154:0/1720098134 >> v2:172.21.15.103:3300/0 conn(0x7f98f8153f50 0x7f98f8158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.268+0000 7f98ff853640 1 --2- 172.21.15.154:0/1720098134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98f8153b70 0x7f98f8157000 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.268+0000 7f98ff853640 1 -- 172.21.15.154:0/1720098134 >> 172.21.15.154:0/1720098134 conn(0x7f98f80c6a30 msgr2=0x7f98f80c6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:13.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.268+0000 7f98ff853640 1 -- 172.21.15.154:0/1720098134 shutdown_connections 2024-09-10T08:28:13.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.268+0000 7f98ff853640 1 -- 172.21.15.154:0/1720098134 wait complete. 2024-09-10T08:28:13.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.269+0000 7f98ff853640 1 Processor -- start 2024-09-10T08:28:13.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.269+0000 7f98ff853640 1 -- start start 2024-09-10T08:28:13.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.270+0000 7f98ff853640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98f80bf900 0x7f98f81e1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:13.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.270+0000 7f98ff853640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98f8153b70 0x7f98f81dfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:13.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.270+0000 7f98ff853640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98f8153f50 0x7f98f81e2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:13.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.270+0000 7f98ff853640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f98f80aefd0 con 0x7f98f80bf900 2024-09-10T08:28:13.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.270+0000 7f98ff853640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f98f80aee50 con 0x7f98f8153b70 2024-09-10T08:28:13.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.270+0000 7f98ff853640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f98f8159210 con 0x7f98f8153f50 2024-09-10T08:28:13.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.270+0000 7f98fcdee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98f8153b70 0x7f98f81dfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:13.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.270+0000 7f98fddf0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98f8153f50 0x7f98f81e2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:13.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.270+0000 7f98fcdee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98f8153b70 0x7f98f81dfbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58526/0 (socket says 172.21.15.154:58526) 2024-09-10T08:28:13.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.270+0000 7f98fcdee640 1 -- 172.21.15.154:0/3132981473 learned_addr learned my addr 172.21.15.154:0/3132981473 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T08:28:13.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.270+0000 7f98fd5ef640 1 --2- 172.21.15.154:0/3132981473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98f80bf900 0x7f98f81e1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:13.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.270+0000 7f98fcdee640 1 -- 172.21.15.154:0/3132981473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98f8153f50 msgr2=0x7f98f81e2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.270+0000 7f98fcdee640 1 --2- 172.21.15.154:0/3132981473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98f8153f50 0x7f98f81e2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.270+0000 7f98fcdee640 1 -- 172.21.15.154:0/3132981473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98f80bf900 msgr2=0x7f98f81e1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.270+0000 7f98fcdee640 1 --2- 172.21.15.154:0/3132981473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98f80bf900 0x7f98f81e1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.270+0000 7f98fcdee640 1 -- 172.21.15.154:0/3132981473 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f81e2300 con 0x7f98f8153b70 2024-09-10T08:28:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.270+0000 7f98fddf0640 1 --2- 172.21.15.154:0/3132981473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98f8153f50 0x7f98f81e2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.270+0000 7f98fcdee640 1 --2- 172.21.15.154:0/3132981473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98f8153b70 0x7f98f81dfbe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f98ec001eb0 tx=0x7f98ec00c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.270+0000 7f98e9ffb640 1 -- 172.21.15.154:0/3132981473 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ec017070 con 0x7f98f8153b70 2024-09-10T08:28:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.270+0000 7f98e9ffb640 1 -- 172.21.15.154:0/3132981473 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98ec005d00 con 0x7f98f8153b70 2024-09-10T08:28:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.270+0000 7f98ff853640 1 -- 172.21.15.154:0/3132981473 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98f81e3810 con 0x7f98f8153b70 2024-09-10T08:28:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.271+0000 7f98e9ffb640 1 -- 172.21.15.154:0/3132981473 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ec007310 con 0x7f98f8153b70 2024-09-10T08:28:13.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.271+0000 7f98ff853640 1 -- 172.21.15.154:0/3132981473 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98f81e0120 con 0x7f98f8153b70 2024-09-10T08:28:13.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.271+0000 7f98e9ffb640 1 -- 172.21.15.154:0/3132981473 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f98ec01a070 con 0x7f98f8153b70 2024-09-10T08:28:13.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.271+0000 7f98e9ffb640 1 -- 172.21.15.154:0/3132981473 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f98ec012740 con 0x7f98f8153b70 2024-09-10T08:28:13.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.272+0000 7f98ff853640 1 -- 172.21.15.154:0/3132981473 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98f8159620 con 0x7f98f8153b70 2024-09-10T08:28:13.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.274+0000 7f98e9ffb640 1 -- 172.21.15.154:0/3132981473 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f98ec021020 con 0x7f98f8153b70 2024-09-10T08:28:13.283 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:13.284+0000 7ff5a785c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T08:28:13.289 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:13.289+0000 7f800df27040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T08:28:13.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.357+0000 7f98ff853640 1 -- 172.21.15.154:0/3132981473 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1abe08f4-0348-435e-9f97-cec00e96992c", "id": 0} v 0) -- 0x7f98f81e3000 con 0x7f98f8153b70 2024-09-10T08:28:13.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.364+0000 7f98e9ffb640 1 -- 172.21.15.154:0/3132981473 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1abe08f4-0348-435e-9f97-cec00e96992c", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f98ec0075e0 con 0x7f98f8153b70 2024-09-10T08:28:13.364 INFO:teuthology.orchestra.run.smithi154.stdout:0 2024-09-10T08:28:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.365+0000 7f98ff853640 1 -- 172.21.15.154:0/3132981473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98f8153b70 msgr2=0x7f98f81dfbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.365+0000 7f98ff853640 1 --2- 172.21.15.154:0/3132981473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98f8153b70 0x7f98f81dfbe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f98ec001eb0 tx=0x7f98ec00c820 comp rx=0 tx=0).stop 2024-09-10T08:28:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.365+0000 7f98ff853640 1 -- 172.21.15.154:0/3132981473 shutdown_connections 2024-09-10T08:28:13.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.365+0000 7f98ff853640 1 --2- 172.21.15.154:0/3132981473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98f8153f50 0x7f98f81e2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.365+0000 7f98ff853640 1 --2- 172.21.15.154:0/3132981473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98f8153b70 0x7f98f81dfbe0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.365+0000 7f98ff853640 1 --2- 172.21.15.154:0/3132981473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98f80bf900 0x7f98f81e1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.365+0000 7f98ff853640 1 -- 172.21.15.154:0/3132981473 >> 172.21.15.154:0/3132981473 conn(0x7f98f80c6a30 msgr2=0x7f98f80c6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.365+0000 7f98ff853640 1 -- 172.21.15.154:0/3132981473 shutdown_connections 2024-09-10T08:28:13.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.365+0000 7f98ff853640 1 -- 172.21.15.154:0/3132981473 wait complete. 2024-09-10T08:28:13.378 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new df342e58-1026-4739-82f6-7a216707444c 1 2024-09-10T08:28:13.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.477+0000 7f185845e640 1 Processor -- start 2024-09-10T08:28:13.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.477+0000 7f185845e640 1 -- start start 2024-09-10T08:28:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.478+0000 7f185845e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18501539e0 0x7f18500c6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.478+0000 7f185845e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f18500cb280 0x7f18500cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.478+0000 7f185845e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1850157320 con 0x7f1850156760 2024-09-10T08:28:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.478+0000 7f185845e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f18500c6e50 con 0x7f18500cb280 2024-09-10T08:28:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.478+0000 7f185845e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f185006d430 con 0x7f18501539e0 2024-09-10T08:28:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.478+0000 7f18559f9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f18500cb280 0x7f18500cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.478+0000 7f18561fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18501539e0 0x7f18500c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.479+0000 7f18559f9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f18500cb280 0x7f18500cb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58532/0 (socket says 172.21.15.154:58532) 2024-09-10T08:28:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.479+0000 7f18559f9640 1 -- 172.21.15.154:0/3216753335 learned_addr learned my addr 172.21.15.154:0/3216753335 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T08:28:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.479+0000 7f18561fa640 1 -- 172.21.15.154:0/3216753335 >> v2:172.21.15.154:3300/0 conn(0x7f18500cb280 msgr2=0x7f18500cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.479+0000 7f18561fa640 1 --2- 172.21.15.154:0/3216753335 >> v2:172.21.15.154:3300/0 conn(0x7f18500cb280 0x7f18500cb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.479+0000 7f18561fa640 1 -- 172.21.15.154:0/3216753335 >> v1:172.21.15.103:6789/0 conn(0x7f1850156760 legacy=0x7f1850156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:13.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.479+0000 7f18561fa640 1 -- 172.21.15.154:0/3216753335 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1850153dc0 con 0x7f18501539e0 2024-09-10T08:28:13.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.479+0000 7f18559f9640 1 --2- 172.21.15.154:0/3216753335 >> v2:172.21.15.154:3300/0 conn(0x7f18500cb280 0x7f18500cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:13.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.479+0000 7f18561fa640 1 --2- 172.21.15.154:0/3216753335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18501539e0 0x7f18500c6910 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f184c0097a0 tx=0x7f184c02a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dac86bd74d21e3b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:13.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.480+0000 7f18551f8640 1 -- 172.21.15.154:0/3216753335 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c037070 con 0x7f18501539e0 2024-09-10T08:28:13.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.480+0000 7f18551f8640 1 -- 172.21.15.154:0/3216753335 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f184c02ae40 con 0x7f18501539e0 2024-09-10T08:28:13.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.480+0000 7f18551f8640 1 -- 172.21.15.154:0/3216753335 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c032660 con 0x7f18501539e0 2024-09-10T08:28:13.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.480+0000 7f185845e640 1 -- 172.21.15.154:0/3216753335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18501539e0 msgr2=0x7f18500c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:13.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.480+0000 7f185845e640 1 --2- 172.21.15.154:0/3216753335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18501539e0 0x7f18500c6910 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f184c0097a0 tx=0x7f184c02a130 comp rx=0 tx=0).stop 2024-09-10T08:28:13.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.480+0000 7f185845e640 1 -- 172.21.15.154:0/3216753335 shutdown_connections 2024-09-10T08:28:13.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.480+0000 7f185845e640 1 --2- 172.21.15.154:0/3216753335 >> v2:172.21.15.154:3300/0 conn(0x7f18500cb280 0x7f18500cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.480+0000 7f185845e640 1 --2- 172.21.15.154:0/3216753335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18501539e0 0x7f18500c6910 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.480+0000 7f185845e640 1 -- 172.21.15.154:0/3216753335 >> 172.21.15.154:0/3216753335 conn(0x7f18500c8800 msgr2=0x7f18500c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:13.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.480+0000 7f185845e640 1 -- 172.21.15.154:0/3216753335 shutdown_connections 2024-09-10T08:28:13.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.480+0000 7f185845e640 1 -- 172.21.15.154:0/3216753335 wait complete. 2024-09-10T08:28:13.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.481+0000 7f185845e640 1 Processor -- start 2024-09-10T08:28:13.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.482+0000 7f185845e640 1 -- start start 2024-09-10T08:28:13.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.482+0000 7f185845e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18500cb280 0x7f18501491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.482+0000 7f185845e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18501539e0 0x7f1850154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.482+0000 7f185845e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1850156760 0x7f18501ed980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.482+0000 7f185845e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f185006cd70 con 0x7f1850156760 2024-09-10T08:28:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.482+0000 7f185845e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f185006ca90 con 0x7f18500cb280 2024-09-10T08:28:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.482+0000 7f185845e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f185006d050 con 0x7f18501539e0 2024-09-10T08:28:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.482+0000 7f18561fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18500cb280 0x7f18501491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.482+0000 7f18559f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18501539e0 0x7f1850154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.482+0000 7f18561fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18500cb280 0x7f18501491a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58548/0 (socket says 172.21.15.154:58548) 2024-09-10T08:28:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.482+0000 7f18561fa640 1 -- 172.21.15.154:0/1676202958 learned_addr learned my addr 172.21.15.154:0/1676202958 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T08:28:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.482+0000 7f18569fb640 1 --2- 172.21.15.154:0/1676202958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1850156760 0x7f18501ed980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.483+0000 7f18561fa640 1 -- 172.21.15.154:0/1676202958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18501539e0 msgr2=0x7f1850154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.483+0000 7f18561fa640 1 --2- 172.21.15.154:0/1676202958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18501539e0 0x7f1850154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.483+0000 7f18561fa640 1 -- 172.21.15.154:0/1676202958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1850156760 msgr2=0x7f18501ed980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.483+0000 7f18561fa640 1 --2- 172.21.15.154:0/1676202958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1850156760 0x7f18501ed980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.483+0000 7f18561fa640 1 -- 172.21.15.154:0/1676202958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18501e2710 con 0x7f18500cb280 2024-09-10T08:28:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.483+0000 7f18559f9640 1 --2- 172.21.15.154:0/1676202958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18501539e0 0x7f1850154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.483+0000 7f18561fa640 1 --2- 172.21.15.154:0/1676202958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18500cb280 0x7f18501491a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f184c035040 tx=0x7f184c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.483+0000 7f1846ffd640 1 -- 172.21.15.154:0/1676202958 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c041070 con 0x7f18500cb280 2024-09-10T08:28:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.483+0000 7f1846ffd640 1 -- 172.21.15.154:0/1676202958 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f184c03c460 con 0x7f18500cb280 2024-09-10T08:28:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.483+0000 7f185845e640 1 -- 172.21.15.154:0/1676202958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18501f0090 con 0x7f18500cb280 2024-09-10T08:28:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.483+0000 7f1846ffd640 1 -- 172.21.15.154:0/1676202958 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c037040 con 0x7f18500cb280 2024-09-10T08:28:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.483+0000 7f185845e640 1 -- 172.21.15.154:0/1676202958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f185014dc80 con 0x7f18500cb280 2024-09-10T08:28:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.483+0000 7f1846ffd640 1 -- 172.21.15.154:0/1676202958 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f184c03a070 con 0x7f18500cb280 2024-09-10T08:28:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.483+0000 7f1846ffd640 1 -- 172.21.15.154:0/1676202958 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f184c045ad0 con 0x7f18500cb280 2024-09-10T08:28:13.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.484+0000 7f185845e640 1 -- 172.21.15.154:0/1676202958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18500c93a0 con 0x7f18500cb280 2024-09-10T08:28:13.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.488+0000 7f1846ffd640 1 -- 172.21.15.154:0/1676202958 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1850153dc0 con 0x7f18500cb280 2024-09-10T08:28:13.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.557+0000 7f185845e640 1 -- 172.21.15.154:0/1676202958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "df342e58-1026-4739-82f6-7a216707444c", "id": 1} v 0) -- 0x7f18500b2010 con 0x7f18500cb280 2024-09-10T08:28:13.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.565+0000 7f1846ffd640 1 -- 172.21.15.154:0/1676202958 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "df342e58-1026-4739-82f6-7a216707444c", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f184c03c870 con 0x7f18500cb280 2024-09-10T08:28:13.566 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-09-10T08:28:13.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.566+0000 7f185845e640 1 -- 172.21.15.154:0/1676202958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18500cb280 msgr2=0x7f18501491a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:13.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.566+0000 7f185845e640 1 --2- 172.21.15.154:0/1676202958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18500cb280 0x7f18501491a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f184c035040 tx=0x7f184c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.566+0000 7f185845e640 1 -- 172.21.15.154:0/1676202958 shutdown_connections 2024-09-10T08:28:13.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.566+0000 7f185845e640 1 --2- 172.21.15.154:0/1676202958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1850156760 0x7f18501ed980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.566+0000 7f185845e640 1 --2- 172.21.15.154:0/1676202958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18501539e0 0x7f1850154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.566+0000 7f185845e640 1 --2- 172.21.15.154:0/1676202958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18500cb280 0x7f18501491a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.566+0000 7f185845e640 1 -- 172.21.15.154:0/1676202958 >> 172.21.15.154:0/1676202958 conn(0x7f18500c8800 msgr2=0x7f18500ca2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:13.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.566+0000 7f185845e640 1 -- 172.21.15.154:0/1676202958 shutdown_connections 2024-09-10T08:28:13.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.566+0000 7f185845e640 1 -- 172.21.15.154:0/1676202958 wait complete. 2024-09-10T08:28:13.576 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new f7aea2cf-208c-41ed-a0f6-8948d70b9a0a 2 2024-09-10T08:28:13.633 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:13.633+0000 7f800df27040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T08:28:13.634 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:13.634+0000 7ff5a785c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T08:28:13.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.676+0000 7fc1f2c6e640 1 Processor -- start 2024-09-10T08:28:13.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.676+0000 7fc1f2c6e640 1 -- start start 2024-09-10T08:28:13.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.677+0000 7fc1f2c6e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1ec1551d0 0x7fc1ec1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:13.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.677+0000 7fc1f2c6e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1ec1557d0 con 0x7fc1ec150910 2024-09-10T08:28:13.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.677+0000 7fc1f2c6e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1ec155ab0 con 0x7fc1ec150cf0 2024-09-10T08:28:13.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.677+0000 7fc1f2c6e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc1ec1563e0 con 0x7fc1ec1551d0 2024-09-10T08:28:13.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.677+0000 7fc1ebfff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc1ec150cf0 0x7fc1ec151950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:48736/0 (socket says 172.21.15.154:48736) 2024-09-10T08:28:13.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.677+0000 7fc1f120b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1ec1551d0 0x7fc1ec1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:13.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.677+0000 7fc1ebfff640 1 -- 172.21.15.154:0/2968205801 learned_addr learned my addr 172.21.15.154:0/2968205801 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-09-10T08:28:13.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.677+0000 7fc1eb7fe640 1 -- 172.21.15.154:0/2968205801 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1249808136 0 0) 0x7fc1ec155ab0 con 0x7fc1ec150cf0 2024-09-10T08:28:13.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.677+0000 7fc1f120b640 1 -- 172.21.15.154:0/2968205801 >> v1:172.21.15.154:6789/0 conn(0x7fc1ec150cf0 legacy=0x7fc1ec151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:13.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.677+0000 7fc1f120b640 1 -- 172.21.15.154:0/2968205801 >> v1:172.21.15.103:6789/0 conn(0x7fc1ec150910 legacy=0x7fc1ec151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:13.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.677+0000 7fc1f120b640 1 -- 172.21.15.154:0/2968205801 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ec155d90 con 0x7fc1ec1551d0 2024-09-10T08:28:13.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.678+0000 7fc1f120b640 1 --2- 172.21.15.154:0/2968205801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1ec1551d0 0x7fc1ec1568c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4009dc0 tx=0x7fc1e402a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceee003c9aee6bbc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:13.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.678+0000 7fc1eb7fe640 1 -- 172.21.15.154:0/2968205801 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4007740 con 0x7fc1ec1551d0 2024-09-10T08:28:13.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.678+0000 7fc1eb7fe640 1 -- 172.21.15.154:0/2968205801 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e40078e0 con 0x7fc1ec1551d0 2024-09-10T08:28:13.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.678+0000 7fc1eb7fe640 1 -- 172.21.15.154:0/2968205801 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4007cb0 con 0x7fc1ec1551d0 2024-09-10T08:28:13.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.679+0000 7fc1f2c6e640 1 -- 172.21.15.154:0/2968205801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1ec1551d0 msgr2=0x7fc1ec1568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:13.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.679+0000 7fc1f2c6e640 1 --2- 172.21.15.154:0/2968205801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1ec1551d0 0x7fc1ec1568c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4009dc0 tx=0x7fc1e402a5b0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.679+0000 7fc1f2c6e640 1 -- 172.21.15.154:0/2968205801 shutdown_connections 2024-09-10T08:28:13.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.679+0000 7fc1f2c6e640 1 --2- 172.21.15.154:0/2968205801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1ec1551d0 0x7fc1ec1568c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.679+0000 7fc1f2c6e640 1 -- 172.21.15.154:0/2968205801 >> 172.21.15.154:0/2968205801 conn(0x7fc1ec0c6a30 msgr2=0x7fc1ec0c6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:13.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.679+0000 7fc1f2c6e640 1 -- 172.21.15.154:0/2968205801 shutdown_connections 2024-09-10T08:28:13.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.679+0000 7fc1f2c6e640 1 -- 172.21.15.154:0/2968205801 wait complete. 2024-09-10T08:28:13.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.680+0000 7fc1f2c6e640 1 Processor -- start 2024-09-10T08:28:13.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.680+0000 7fc1f2c6e640 1 -- start start 2024-09-10T08:28:13.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.681+0000 7fc1f2c6e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1ec150910 0x7fc1ec162270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:13.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.681+0000 7fc1f2c6e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1ec150cf0 0x7fc1ec0adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:13.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.681+0000 7fc1f2c6e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1ec1551d0 0x7fc1ec0ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:13.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.681+0000 7fc1f2c6e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec156e00 con 0x7fc1ec150cf0 2024-09-10T08:28:13.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.681+0000 7fc1f2c6e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc1ec0c87f0 con 0x7fc1ec1551d0 2024-09-10T08:28:13.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.681+0000 7fc1f2c6e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc1ec156f80 con 0x7fc1ec150910 2024-09-10T08:28:13.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.681+0000 7fc1f120b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1ec1551d0 0x7fc1ec0ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:13.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.681+0000 7fc1f0a0a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1ec150910 0x7fc1ec162270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:13.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.681+0000 7fc1f120b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1ec1551d0 0x7fc1ec0ae010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58554/0 (socket says 172.21.15.154:58554) 2024-09-10T08:28:13.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.681+0000 7fc1f120b640 1 -- 172.21.15.154:0/154918929 learned_addr learned my addr 172.21.15.154:0/154918929 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T08:28:13.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.681+0000 7fc1f0a0a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1ec150910 0x7fc1ec162270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52136/0 (socket says 172.21.15.154:52136) 2024-09-10T08:28:13.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.681+0000 7fc1ebfff640 1 --2- 172.21.15.154:0/154918929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1ec150cf0 0x7fc1ec0adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:13.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.681+0000 7fc1f0a0a640 1 -- 172.21.15.154:0/154918929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1ec1551d0 msgr2=0x7fc1ec0ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:13.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.681+0000 7fc1f0a0a640 1 --2- 172.21.15.154:0/154918929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1ec1551d0 0x7fc1ec0ae010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.681+0000 7fc1f0a0a640 1 -- 172.21.15.154:0/154918929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1ec150cf0 msgr2=0x7fc1ec0adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:13.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.681+0000 7fc1f0a0a640 1 --2- 172.21.15.154:0/154918929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1ec150cf0 0x7fc1ec0adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.681+0000 7fc1f0a0a640 1 -- 172.21.15.154:0/154918929 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1ec0bfcb0 con 0x7fc1ec150910 2024-09-10T08:28:13.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.682+0000 7fc1f0a0a640 1 --2- 172.21.15.154:0/154918929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1ec150910 0x7fc1ec162270 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000c390 tx=0x7fc1e000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:13.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.682+0000 7fc1e97fa640 1 -- 172.21.15.154:0/154918929 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0017070 con 0x7fc1ec150910 2024-09-10T08:28:13.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.682+0000 7fc1e97fa640 1 -- 172.21.15.154:0/154918929 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e00052d0 con 0x7fc1ec150910 2024-09-10T08:28:13.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.682+0000 7fc1f2c6e640 1 -- 172.21.15.154:0/154918929 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1ec0c0cf0 con 0x7fc1ec150910 2024-09-10T08:28:13.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.682+0000 7fc1e97fa640 1 -- 172.21.15.154:0/154918929 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0003830 con 0x7fc1ec150910 2024-09-10T08:28:13.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.682+0000 7fc1f2c6e640 1 -- 172.21.15.154:0/154918929 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1ec0c15d0 con 0x7fc1ec150910 2024-09-10T08:28:13.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.682+0000 7fc1e97fa640 1 -- 172.21.15.154:0/154918929 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc1e001a070 con 0x7fc1ec150910 2024-09-10T08:28:13.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.682+0000 7fc1e97fa640 1 -- 172.21.15.154:0/154918929 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fc1e0012420 con 0x7fc1ec150910 2024-09-10T08:28:13.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.683+0000 7fc1f2c6e640 1 -- 172.21.15.154:0/154918929 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1ec157360 con 0x7fc1ec150910 2024-09-10T08:28:13.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.685+0000 7fc1e97fa640 1 -- 172.21.15.154:0/154918929 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc1e0021020 con 0x7fc1ec150910 2024-09-10T08:28:13.691 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:13.692+0000 7ff5a785c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T08:28:13.694 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:13.695+0000 7f800df27040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T08:28:13.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.753+0000 7fc1f2c6e640 1 -- 172.21.15.154:0/154918929 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f7aea2cf-208c-41ed-a0f6-8948d70b9a0a", "id": 2} v 0) -- 0x7fc1ec154060 con 0x7fc1ec150910 2024-09-10T08:28:13.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.758+0000 7fc1e97fa640 1 -- 172.21.15.154:0/154918929 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f7aea2cf-208c-41ed-a0f6-8948d70b9a0a", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fc1e0011590 con 0x7fc1ec150910 2024-09-10T08:28:13.758 INFO:teuthology.orchestra.run.smithi154.stdout:2 2024-09-10T08:28:13.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.759+0000 7fc1f2c6e640 1 -- 172.21.15.154:0/154918929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1ec150910 msgr2=0x7fc1ec162270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:13.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.759+0000 7fc1f2c6e640 1 --2- 172.21.15.154:0/154918929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1ec150910 0x7fc1ec162270 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000c390 tx=0x7fc1e000c850 comp rx=0 tx=0).stop 2024-09-10T08:28:13.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.759+0000 7fc1f2c6e640 1 -- 172.21.15.154:0/154918929 shutdown_connections 2024-09-10T08:28:13.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.759+0000 7fc1f2c6e640 1 --2- 172.21.15.154:0/154918929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1ec1551d0 0x7fc1ec0ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.759+0000 7fc1f2c6e640 1 --2- 172.21.15.154:0/154918929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1ec150cf0 0x7fc1ec0adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.759+0000 7fc1f2c6e640 1 --2- 172.21.15.154:0/154918929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1ec150910 0x7fc1ec162270 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.759+0000 7fc1f2c6e640 1 -- 172.21.15.154:0/154918929 >> 172.21.15.154:0/154918929 conn(0x7fc1ec0c6a30 msgr2=0x7fc1ec153190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:13.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.759+0000 7fc1f2c6e640 1 -- 172.21.15.154:0/154918929 shutdown_connections 2024-09-10T08:28:13.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.759+0000 7fc1f2c6e640 1 -- 172.21.15.154:0/154918929 wait complete. 2024-09-10T08:28:13.769 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 615ef8b0-12a5-4503-96d0-f7ec17dbc792 3 2024-09-10T08:28:13.842 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:13.842+0000 7ff5a785c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T08:28:13.851 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:13.852+0000 7f800df27040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T08:28:13.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.868+0000 7f3f83cd0640 1 Processor -- start 2024-09-10T08:28:13.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.868+0000 7f3f83cd0640 1 -- start start 2024-09-10T08:28:13.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.869+0000 7f3f83cd0640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3f7c0701e0 0x7f3f7c152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:13.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.869+0000 7f3f83cd0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7c0c3b20 0x7f3f7c0c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:13.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.869+0000 7f3f83cd0640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f7c1535d0 con 0x7f3f7c0a8200 2024-09-10T08:28:13.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.869+0000 7f3f83cd0640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f3f7c0c5450 con 0x7f3f7c0701e0 2024-09-10T08:28:13.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.869+0000 7f3f83cd0640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3f7c0c3690 con 0x7f3f7c0c3b20 2024-09-10T08:28:13.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.869+0000 7f3f8226d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7c0c3b20 0x7f3f7c0c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:13.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.869+0000 7f3f8226d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7c0c3b20 0x7f3f7c0c3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52138/0 (socket says 172.21.15.154:52138) 2024-09-10T08:28:13.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.869+0000 7f3f8226d640 1 -- 172.21.15.154:0/284981136 learned_addr learned my addr 172.21.15.154:0/284981136 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T08:28:13.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.869+0000 7f3f8126b640 1 --2- 172.21.15.154:0/284981136 >> v2:172.21.15.103:3300/0 conn(0x7f3f7c0701e0 0x7f3f7c152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:13.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.869+0000 7f3f8226d640 1 -- 172.21.15.154:0/284981136 >> v2:172.21.15.103:3300/0 conn(0x7f3f7c0701e0 msgr2=0x7f3f7c152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:13.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.869+0000 7f3f8226d640 1 --2- 172.21.15.154:0/284981136 >> v2:172.21.15.103:3300/0 conn(0x7f3f7c0701e0 0x7f3f7c152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.869+0000 7f3f8226d640 1 -- 172.21.15.154:0/284981136 >> v1:172.21.15.103:6789/0 conn(0x7f3f7c0a8200 legacy=0x7f3f7c0c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:13.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.869+0000 7f3f8226d640 1 -- 172.21.15.154:0/284981136 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7c1538b0 con 0x7f3f7c0c3b20 2024-09-10T08:28:13.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.869+0000 7f3f8126b640 1 --2- 172.21.15.154:0/284981136 >> v2:172.21.15.103:3300/0 conn(0x7f3f7c0701e0 0x7f3f7c152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:13.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.870+0000 7f3f8226d640 1 --2- 172.21.15.154:0/284981136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7c0c3b20 0x7f3f7c0c3fb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3f74009e50 tx=0x7f3f7402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3517644b51165a15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:13.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.870+0000 7f3f80a6a640 1 -- 172.21.15.154:0/284981136 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f74036070 con 0x7f3f7c0c3b20 2024-09-10T08:28:13.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.870+0000 7f3f80a6a640 1 -- 172.21.15.154:0/284981136 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f74031600 con 0x7f3f7c0c3b20 2024-09-10T08:28:13.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.870+0000 7f3f80a6a640 1 -- 172.21.15.154:0/284981136 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f740319d0 con 0x7f3f7c0c3b20 2024-09-10T08:28:13.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.871+0000 7f3f83cd0640 1 -- 172.21.15.154:0/284981136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7c0c3b20 msgr2=0x7f3f7c0c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:13.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.871+0000 7f3f83cd0640 1 --2- 172.21.15.154:0/284981136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7c0c3b20 0x7f3f7c0c3fb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3f74009e50 tx=0x7f3f7402a710 comp rx=0 tx=0).stop 2024-09-10T08:28:13.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.871+0000 7f3f83cd0640 1 -- 172.21.15.154:0/284981136 shutdown_connections 2024-09-10T08:28:13.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.871+0000 7f3f83cd0640 1 --2- 172.21.15.154:0/284981136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7c0c3b20 0x7f3f7c0c3fb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.871+0000 7f3f83cd0640 1 --2- 172.21.15.154:0/284981136 >> v2:172.21.15.103:3300/0 conn(0x7f3f7c0701e0 0x7f3f7c152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.871+0000 7f3f83cd0640 1 -- 172.21.15.154:0/284981136 >> 172.21.15.154:0/284981136 conn(0x7f3f7c0c5660 msgr2=0x7f3f7c0c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:13.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.871+0000 7f3f83cd0640 1 -- 172.21.15.154:0/284981136 shutdown_connections 2024-09-10T08:28:13.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.871+0000 7f3f83cd0640 1 -- 172.21.15.154:0/284981136 wait complete. 2024-09-10T08:28:13.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.872+0000 7f3f83cd0640 1 Processor -- start 2024-09-10T08:28:13.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.872+0000 7f3f83cd0640 1 -- start start 2024-09-10T08:28:13.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.873+0000 7f3f83cd0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7c0701e0 0x7f3f7c154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:13.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.873+0000 7f3f83cd0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f7c0a8200 0x7f3f7c14ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:13.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.873+0000 7f3f83cd0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f7c0c3b20 0x7f3f7c1efac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:13.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.873+0000 7f3f83cd0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c0c44f0 con 0x7f3f7c0c3b20 2024-09-10T08:28:13.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.873+0000 7f3f83cd0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c153e70 con 0x7f3f7c0a8200 2024-09-10T08:28:13.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.873+0000 7f3f83cd0640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3f7c0a85e0 con 0x7f3f7c0701e0 2024-09-10T08:28:13.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.873+0000 7f3f81a6c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7c0701e0 0x7f3f7c154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:13.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.873+0000 7f3f81a6c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7c0701e0 0x7f3f7c154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52142/0 (socket says 172.21.15.154:52142) 2024-09-10T08:28:13.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.873+0000 7f3f81a6c640 1 -- 172.21.15.154:0/3383523577 learned_addr learned my addr 172.21.15.154:0/3383523577 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T08:28:13.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.873+0000 7f3f8126b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f7c0a8200 0x7f3f7c14ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:13.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.873+0000 7f3f8226d640 1 --2- 172.21.15.154:0/3383523577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f7c0c3b20 0x7f3f7c1efac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:13.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.873+0000 7f3f81a6c640 1 -- 172.21.15.154:0/3383523577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f7c0a8200 msgr2=0x7f3f7c14ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:13.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.873+0000 7f3f81a6c640 1 --2- 172.21.15.154:0/3383523577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f7c0a8200 0x7f3f7c14ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.873+0000 7f3f81a6c640 1 -- 172.21.15.154:0/3383523577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f7c0c3b20 msgr2=0x7f3f7c1efac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:13.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.873+0000 7f3f81a6c640 1 --2- 172.21.15.154:0/3383523577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f7c0c3b20 0x7f3f7c1efac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.873+0000 7f3f81a6c640 1 -- 172.21.15.154:0/3383523577 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7c155260 con 0x7f3f7c0701e0 2024-09-10T08:28:13.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.873+0000 7f3f8126b640 1 --2- 172.21.15.154:0/3383523577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f7c0a8200 0x7f3f7c14ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:13.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.874+0000 7f3f81a6c640 1 --2- 172.21.15.154:0/3383523577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7c0701e0 0x7f3f7c154d20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3f7000c400 tx=0x7f3f7000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:13.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.874+0000 7f3f6e7fc640 1 -- 172.21.15.154:0/3383523577 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f700052d0 con 0x7f3f7c0701e0 2024-09-10T08:28:13.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.874+0000 7f3f6e7fc640 1 -- 172.21.15.154:0/3383523577 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f70005490 con 0x7f3f7c0701e0 2024-09-10T08:28:13.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.874+0000 7f3f83cd0640 1 -- 172.21.15.154:0/3383523577 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f7c157350 con 0x7f3f7c0701e0 2024-09-10T08:28:13.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.874+0000 7f3f6e7fc640 1 -- 172.21.15.154:0/3383523577 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f70007260 con 0x7f3f7c0701e0 2024-09-10T08:28:13.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.874+0000 7f3f83cd0640 1 -- 172.21.15.154:0/3383523577 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f7c156d90 con 0x7f3f7c0701e0 2024-09-10T08:28:13.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.874+0000 7f3f6e7fc640 1 -- 172.21.15.154:0/3383523577 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3f70007400 con 0x7f3f7c0701e0 2024-09-10T08:28:13.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.874+0000 7f3f6e7fc640 1 -- 172.21.15.154:0/3383523577 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f3f70011590 con 0x7f3f7c0701e0 2024-09-10T08:28:13.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.875+0000 7f3f83cd0640 1 -- 172.21.15.154:0/3383523577 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f7c067d70 con 0x7f3f7c0701e0 2024-09-10T08:28:13.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.877+0000 7f3f6e7fc640 1 -- 172.21.15.154:0/3383523577 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3f7c067d70 con 0x7f3f7c0701e0 2024-09-10T08:28:13.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.945+0000 7f3f83cd0640 1 -- 172.21.15.154:0/3383523577 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd new", "uuid": "615ef8b0-12a5-4503-96d0-f7ec17dbc792", "id": 3} v 0) -- 0x7f3f7c0ac5e0 con 0x7f3f7c0701e0 2024-09-10T08:28:13.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.950+0000 7f3f6e7fc640 1 -- 172.21.15.154:0/3383523577 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "615ef8b0-12a5-4503-96d0-f7ec17dbc792", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f3f70020070 con 0x7f3f7c0701e0 2024-09-10T08:28:13.950 INFO:teuthology.orchestra.run.smithi154.stdout:3 2024-09-10T08:28:13.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.951+0000 7f3f83cd0640 1 -- 172.21.15.154:0/3383523577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7c0701e0 msgr2=0x7f3f7c154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:13.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.951+0000 7f3f83cd0640 1 --2- 172.21.15.154:0/3383523577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7c0701e0 0x7f3f7c154d20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3f7000c400 tx=0x7f3f7000c8c0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.951+0000 7f3f83cd0640 1 -- 172.21.15.154:0/3383523577 shutdown_connections 2024-09-10T08:28:13.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.951+0000 7f3f83cd0640 1 --2- 172.21.15.154:0/3383523577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f7c0c3b20 0x7f3f7c1efac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.951+0000 7f3f83cd0640 1 --2- 172.21.15.154:0/3383523577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f7c0a8200 0x7f3f7c14ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.951+0000 7f3f83cd0640 1 --2- 172.21.15.154:0/3383523577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f7c0701e0 0x7f3f7c154d20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:13.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.951+0000 7f3f83cd0640 1 -- 172.21.15.154:0/3383523577 >> 172.21.15.154:0/3383523577 conn(0x7f3f7c0c5660 msgr2=0x7f3f7c0c77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:13.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.951+0000 7f3f83cd0640 1 -- 172.21.15.154:0/3383523577 shutdown_connections 2024-09-10T08:28:13.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:13.951+0000 7f3f83cd0640 1 -- 172.21.15.154:0/3383523577 wait complete. 2024-09-10T08:28:13.962 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 644c5e94-db18-4b83-b5cd-3762ae2647a6 4 2024-09-10T08:28:14.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.060+0000 7f9d1bb11640 1 Processor -- start 2024-09-10T08:28:14.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.060+0000 7f9d1bb11640 1 -- start start 2024-09-10T08:28:14.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.061+0000 7f9d1bb11640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d14072ec0 0x7f9d14153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.061+0000 7f9d1bb11640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9d140c4ac0 0x7f9d14070040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.061+0000 7f9d1bb11640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d1406efa0 con 0x7f9d140afc60 2024-09-10T08:28:14.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.061+0000 7f9d1bb11640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f9d1406f280 con 0x7f9d140c4ac0 2024-09-10T08:28:14.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.061+0000 7f9d1bb11640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9d1406f560 con 0x7f9d14072ec0 2024-09-10T08:28:14.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.061+0000 7f9d198ad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d14072ec0 0x7f9d14153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.061+0000 7f9d1a0ae640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9d140afc60 0x7f9d14151380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:48742/0 (socket says 172.21.15.154:48742) 2024-09-10T08:28:14.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.061+0000 7f9d1a0ae640 1 -- 172.21.15.154:0/2467490406 learned_addr learned my addr 172.21.15.154:0/2467490406 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-09-10T08:28:14.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.061+0000 7f9d190ac640 1 --2- 172.21.15.154:0/2467490406 >> v2:172.21.15.103:3300/0 conn(0x7f9d140c4ac0 0x7f9d14070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.061+0000 7f9d198ad640 1 -- 172.21.15.154:0/2467490406 >> v2:172.21.15.103:3300/0 conn(0x7f9d140c4ac0 msgr2=0x7f9d14070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:14.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.061+0000 7f9d198ad640 1 --2- 172.21.15.154:0/2467490406 >> v2:172.21.15.103:3300/0 conn(0x7f9d140c4ac0 0x7f9d14070040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.061+0000 7f9d198ad640 1 -- 172.21.15.154:0/2467490406 >> v1:172.21.15.154:6789/0 conn(0x7f9d140afc60 legacy=0x7f9d14151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.061+0000 7f9d188ab640 1 -- 172.21.15.154:0/2467490406 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 368278345 0 0) 0x7f9d1406efa0 con 0x7f9d140afc60 2024-09-10T08:28:14.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.061+0000 7f9d198ad640 1 -- 172.21.15.154:0/2467490406 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1406f840 con 0x7f9d14072ec0 2024-09-10T08:28:14.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.062+0000 7f9d198ad640 1 --2- 172.21.15.154:0/2467490406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d14072ec0 0x7f9d14153ff0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9d100097a0 tx=0x7f9d1002a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=879bacf5dc83f61b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:14.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.062+0000 7f9d188ab640 1 -- 172.21.15.154:0/2467490406 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d10037070 con 0x7f9d14072ec0 2024-09-10T08:28:14.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.062+0000 7f9d188ab640 1 -- 172.21.15.154:0/2467490406 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d1002adb0 con 0x7f9d14072ec0 2024-09-10T08:28:14.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.062+0000 7f9d188ab640 1 -- 172.21.15.154:0/2467490406 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d10032660 con 0x7f9d14072ec0 2024-09-10T08:28:14.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.063+0000 7f9d1bb11640 1 -- 172.21.15.154:0/2467490406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d14072ec0 msgr2=0x7f9d14153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.063+0000 7f9d1bb11640 1 --2- 172.21.15.154:0/2467490406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d14072ec0 0x7f9d14153ff0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9d100097a0 tx=0x7f9d1002a060 comp rx=0 tx=0).stop 2024-09-10T08:28:14.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.063+0000 7f9d1bb11640 1 -- 172.21.15.154:0/2467490406 shutdown_connections 2024-09-10T08:28:14.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.063+0000 7f9d1bb11640 1 --2- 172.21.15.154:0/2467490406 >> v2:172.21.15.103:3300/0 conn(0x7f9d140c4ac0 0x7f9d14070040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.063+0000 7f9d1bb11640 1 --2- 172.21.15.154:0/2467490406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d14072ec0 0x7f9d14153ff0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.063+0000 7f9d1bb11640 1 -- 172.21.15.154:0/2467490406 >> 172.21.15.154:0/2467490406 conn(0x7f9d140c9d80 msgr2=0x7f9d140ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:14.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.063+0000 7f9d1bb11640 1 -- 172.21.15.154:0/2467490406 shutdown_connections 2024-09-10T08:28:14.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.063+0000 7f9d1bb11640 1 -- 172.21.15.154:0/2467490406 wait complete. 2024-09-10T08:28:14.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.064+0000 7f9d1bb11640 1 Processor -- start 2024-09-10T08:28:14.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.064+0000 7f9d1bb11640 1 -- start start 2024-09-10T08:28:14.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d1bb11640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d14072ec0 0x7f9d1414a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d1bb11640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d140afc60 0x7f9d14144660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d1bb11640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d140c4ac0 0x7f9d14144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d1bb11640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9d140732a0 con 0x7f9d140afc60 2024-09-10T08:28:14.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d1bb11640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9d140c47f0 con 0x7f9d140c4ac0 2024-09-10T08:28:14.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d1bb11640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9d14073420 con 0x7f9d14072ec0 2024-09-10T08:28:14.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d198ad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d14072ec0 0x7f9d1414a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d1a0ae640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d140c4ac0 0x7f9d14144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d1a0ae640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d140c4ac0 0x7f9d14144ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58580/0 (socket says 172.21.15.154:58580) 2024-09-10T08:28:14.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d198ad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d14072ec0 0x7f9d1414a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52162/0 (socket says 172.21.15.154:52162) 2024-09-10T08:28:14.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d1a0ae640 1 -- 172.21.15.154:0/464633996 learned_addr learned my addr 172.21.15.154:0/464633996 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T08:28:14.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d190ac640 1 --2- 172.21.15.154:0/464633996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d140afc60 0x7f9d14144660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d1a0ae640 1 -- 172.21.15.154:0/464633996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d14072ec0 msgr2=0x7f9d1414a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d1a0ae640 1 --2- 172.21.15.154:0/464633996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d14072ec0 0x7f9d1414a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d1a0ae640 1 -- 172.21.15.154:0/464633996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d140afc60 msgr2=0x7f9d14144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d1a0ae640 1 --2- 172.21.15.154:0/464633996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d140afc60 0x7f9d14144660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d1a0ae640 1 -- 172.21.15.154:0/464633996 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1414fd20 con 0x7f9d140c4ac0 2024-09-10T08:28:14.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d198ad640 1 --2- 172.21.15.154:0/464633996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d14072ec0 0x7f9d1414a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:14.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d1a0ae640 1 --2- 172.21.15.154:0/464633996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d140c4ac0 0x7f9d14144ba0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00c7a0 tx=0x7f9d0c00cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:14.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d0a7fc640 1 -- 172.21.15.154:0/464633996 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c018070 con 0x7f9d140c4ac0 2024-09-10T08:28:14.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d0a7fc640 1 -- 172.21.15.154:0/464633996 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d0c00a640 con 0x7f9d140c4ac0 2024-09-10T08:28:14.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d1bb11640 1 -- 172.21.15.154:0/464633996 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d141e9ca0 con 0x7f9d140c4ac0 2024-09-10T08:28:14.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.065+0000 7f9d0a7fc640 1 -- 172.21.15.154:0/464633996 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c00aab0 con 0x7f9d140c4ac0 2024-09-10T08:28:14.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.066+0000 7f9d1bb11640 1 -- 172.21.15.154:0/464633996 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d141ea260 con 0x7f9d140c4ac0 2024-09-10T08:28:14.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.066+0000 7f9d0a7fc640 1 -- 172.21.15.154:0/464633996 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9d0c01b070 con 0x7f9d140c4ac0 2024-09-10T08:28:14.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.066+0000 7f9d0a7fc640 1 -- 172.21.15.154:0/464633996 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f9d0c007990 con 0x7f9d140c4ac0 2024-09-10T08:28:14.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.067+0000 7f9d1bb11640 1 -- 172.21.15.154:0/464633996 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d14153ff0 con 0x7f9d140c4ac0 2024-09-10T08:28:14.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.069+0000 7f9d0a7fc640 1 -- 172.21.15.154:0/464633996 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9d1414fd20 con 0x7f9d140c4ac0 2024-09-10T08:28:14.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.139+0000 7f9d1bb11640 1 -- 172.21.15.154:0/464633996 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "644c5e94-db18-4b83-b5cd-3762ae2647a6", "id": 4} v 0) -- 0x7f9d14151f60 con 0x7f9d140c4ac0 2024-09-10T08:28:14.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.145+0000 7f9d0a7fc640 1 -- 172.21.15.154:0/464633996 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "644c5e94-db18-4b83-b5cd-3762ae2647a6", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f9d0c0070d0 con 0x7f9d140c4ac0 2024-09-10T08:28:14.145 INFO:teuthology.orchestra.run.smithi154.stdout:4 2024-09-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.145+0000 7f9d1bb11640 1 -- 172.21.15.154:0/464633996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d140c4ac0 msgr2=0x7f9d14144ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.145+0000 7f9d1bb11640 1 --2- 172.21.15.154:0/464633996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d140c4ac0 0x7f9d14144ba0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00c7a0 tx=0x7f9d0c00cc60 comp rx=0 tx=0).stop 2024-09-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.146+0000 7f9d1bb11640 1 -- 172.21.15.154:0/464633996 shutdown_connections 2024-09-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.146+0000 7f9d1bb11640 1 --2- 172.21.15.154:0/464633996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d140c4ac0 0x7f9d14144ba0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.146+0000 7f9d1bb11640 1 --2- 172.21.15.154:0/464633996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d140afc60 0x7f9d14144660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.146+0000 7f9d1bb11640 1 --2- 172.21.15.154:0/464633996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d14072ec0 0x7f9d1414a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.146+0000 7f9d1bb11640 1 -- 172.21.15.154:0/464633996 >> 172.21.15.154:0/464633996 conn(0x7f9d140c9d80 msgr2=0x7f9d140c6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.146+0000 7f9d1bb11640 1 -- 172.21.15.154:0/464633996 shutdown_connections 2024-09-10T08:28:14.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.146+0000 7f9d1bb11640 1 -- 172.21.15.154:0/464633996 wait complete. 2024-09-10T08:28:14.156 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new f40210bd-f4ca-442e-baac-729ced5a9f21 5 2024-09-10T08:28:14.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.269+0000 7f2de4c47640 1 Processor -- start 2024-09-10T08:28:14.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.269+0000 7f2de4c47640 1 -- start start 2024-09-10T08:28:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.270+0000 7f2de4c47640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de0153a40 0x7f2de006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.270+0000 7f2de4c47640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2de006cbe0 0x7f2de00c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.270+0000 7f2de4c47640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2de0159900 con 0x7f2de00c80f0 2024-09-10T08:28:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.270+0000 7f2de4c47640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f2de0159be0 con 0x7f2de006cbe0 2024-09-10T08:28:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.270+0000 7f2de4c47640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2de0159ec0 con 0x7f2de0153a40 2024-09-10T08:28:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.270+0000 7f2dd7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2de006cbe0 0x7f2de00c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.270+0000 7f2dde59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de0153a40 0x7f2de006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.270+0000 7f2dd7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2de006cbe0 0x7f2de00c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58586/0 (socket says 172.21.15.154:58586) 2024-09-10T08:28:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.270+0000 7f2dde59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de0153a40 0x7f2de006c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52166/0 (socket says 172.21.15.154:52166) 2024-09-10T08:28:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.270+0000 7f2dd7fff640 1 -- 172.21.15.154:0/3771940684 learned_addr learned my addr 172.21.15.154:0/3771940684 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T08:28:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.270+0000 7f2dde59c640 1 -- 172.21.15.154:0/3771940684 >> v2:172.21.15.154:3300/0 conn(0x7f2de006cbe0 msgr2=0x7f2de00c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.270+0000 7f2dde59c640 1 --2- 172.21.15.154:0/3771940684 >> v2:172.21.15.154:3300/0 conn(0x7f2de006cbe0 0x7f2de00c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.270+0000 7f2dde59c640 1 -- 172.21.15.154:0/3771940684 >> v1:172.21.15.103:6789/0 conn(0x7f2de00c80f0 legacy=0x7f2de0156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.270+0000 7f2dde59c640 1 -- 172.21.15.154:0/3771940684 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de015a1a0 con 0x7f2de0153a40 2024-09-10T08:28:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.270+0000 7f2dd7fff640 1 --2- 172.21.15.154:0/3771940684 >> v2:172.21.15.154:3300/0 conn(0x7f2de006cbe0 0x7f2de00c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.271+0000 7f2dde59c640 1 --2- 172.21.15.154:0/3771940684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de0153a40 0x7f2de006c6a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2dd00097a0 tx=0x7f2dd002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9636c32cf1b6d7a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.271+0000 7f2dddd9b640 1 -- 172.21.15.154:0/3771940684 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0037070 con 0x7f2de0153a40 2024-09-10T08:28:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.271+0000 7f2dddd9b640 1 -- 172.21.15.154:0/3771940684 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd0032440 con 0x7f2de0153a40 2024-09-10T08:28:14.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.271+0000 7f2dddd9b640 1 -- 172.21.15.154:0/3771940684 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0032810 con 0x7f2de0153a40 2024-09-10T08:28:14.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.272+0000 7f2de4c47640 1 -- 172.21.15.154:0/3771940684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de0153a40 msgr2=0x7f2de006c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.272+0000 7f2de4c47640 1 --2- 172.21.15.154:0/3771940684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de0153a40 0x7f2de006c6a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2dd00097a0 tx=0x7f2dd002a180 comp rx=0 tx=0).stop 2024-09-10T08:28:14.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.272+0000 7f2de4c47640 1 -- 172.21.15.154:0/3771940684 shutdown_connections 2024-09-10T08:28:14.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.272+0000 7f2de4c47640 1 --2- 172.21.15.154:0/3771940684 >> v2:172.21.15.154:3300/0 conn(0x7f2de006cbe0 0x7f2de00c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.272+0000 7f2de4c47640 1 --2- 172.21.15.154:0/3771940684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de0153a40 0x7f2de006c6a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.272+0000 7f2de4c47640 1 -- 172.21.15.154:0/3771940684 >> 172.21.15.154:0/3771940684 conn(0x7f2de0073310 msgr2=0x7f2de00736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:14.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.272+0000 7f2de4c47640 1 -- 172.21.15.154:0/3771940684 shutdown_connections 2024-09-10T08:28:14.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.272+0000 7f2de4c47640 1 -- 172.21.15.154:0/3771940684 wait complete. 2024-09-10T08:28:14.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.273+0000 7f2de4c47640 1 Processor -- start 2024-09-10T08:28:14.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.273+0000 7f2de4c47640 1 -- start start 2024-09-10T08:28:14.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.274+0000 7f2de4c47640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2de006cbe0 0x7f2de00aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.274+0000 7f2de4c47640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de00c80f0 0x7f2de01ebd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.274+0000 7f2de4c47640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de0153a40 0x7f2de01ec2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.274+0000 7f2de4c47640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2de0153e20 con 0x7f2de006cbe0 2024-09-10T08:28:14.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.274+0000 7f2de4c47640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2de00c9270 con 0x7f2de00c80f0 2024-09-10T08:28:14.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.274+0000 7f2de4c47640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2de0153fa0 con 0x7f2de0153a40 2024-09-10T08:28:14.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.274+0000 7f2dd7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de00c80f0 0x7f2de01ebd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.274+0000 7f2dded9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de0153a40 0x7f2de01ec2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.274+0000 7f2dd7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de00c80f0 0x7f2de01ebd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58592/0 (socket says 172.21.15.154:58592) 2024-09-10T08:28:14.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.274+0000 7f2dd7fff640 1 -- 172.21.15.154:0/2226528983 learned_addr learned my addr 172.21.15.154:0/2226528983 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T08:28:14.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.274+0000 7f2dded9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de0153a40 0x7f2de01ec2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52178/0 (socket says 172.21.15.154:52178) 2024-09-10T08:28:14.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.274+0000 7f2dde59c640 1 --2- 172.21.15.154:0/2226528983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2de006cbe0 0x7f2de00aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.274+0000 7f2dd7fff640 1 -- 172.21.15.154:0/2226528983 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de0153a40 msgr2=0x7f2de01ec2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.274+0000 7f2dd7fff640 1 --2- 172.21.15.154:0/2226528983 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de0153a40 0x7f2de01ec2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.274+0000 7f2dd7fff640 1 -- 172.21.15.154:0/2226528983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2de006cbe0 msgr2=0x7f2de00aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.274+0000 7f2dd7fff640 1 --2- 172.21.15.154:0/2226528983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2de006cbe0 0x7f2de00aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.274+0000 7f2dd7fff640 1 -- 172.21.15.154:0/2226528983 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de00cab40 con 0x7f2de00c80f0 2024-09-10T08:28:14.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.274+0000 7f2dd7fff640 1 --2- 172.21.15.154:0/2226528983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de00c80f0 0x7f2de01ebd90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800e930 tx=0x7f2dc800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:14.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.274+0000 7f2dd6ffd640 1 -- 172.21.15.154:0/2226528983 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8017070 con 0x7f2de00c80f0 2024-09-10T08:28:14.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.275+0000 7f2dd6ffd640 1 -- 172.21.15.154:0/2226528983 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc800ca00 con 0x7f2de00c80f0 2024-09-10T08:28:14.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.275+0000 7f2dd6ffd640 1 -- 172.21.15.154:0/2226528983 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc800cdf0 con 0x7f2de00c80f0 2024-09-10T08:28:14.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.275+0000 7f2de4c47640 1 -- 172.21.15.154:0/2226528983 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de01542b0 con 0x7f2de00c80f0 2024-09-10T08:28:14.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.275+0000 7f2de4c47640 1 -- 172.21.15.154:0/2226528983 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de00b0450 con 0x7f2de00c80f0 2024-09-10T08:28:14.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.275+0000 7f2dd6ffd640 1 -- 172.21.15.154:0/2226528983 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2dc801a070 con 0x7f2de00c80f0 2024-09-10T08:28:14.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.275+0000 7f2dd6ffd640 1 -- 172.21.15.154:0/2226528983 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f2dc801c9d0 con 0x7f2de00c80f0 2024-09-10T08:28:14.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.276+0000 7f2de4c47640 1 -- 172.21.15.154:0/2226528983 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de00cae20 con 0x7f2de00c80f0 2024-09-10T08:28:14.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.278+0000 7f2dd6ffd640 1 -- 172.21.15.154:0/2226528983 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2dc801c450 con 0x7f2de00c80f0 2024-09-10T08:28:14.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.347+0000 7f2de4c47640 1 -- 172.21.15.154:0/2226528983 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f40210bd-f4ca-442e-baac-729ced5a9f21", "id": 5} v 0) -- 0x7f2de00c7b90 con 0x7f2de00c80f0 2024-09-10T08:28:14.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.353+0000 7f2dd6ffd640 1 -- 172.21.15.154:0/2226528983 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f40210bd-f4ca-442e-baac-729ced5a9f21", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f2dc801c630 con 0x7f2de00c80f0 2024-09-10T08:28:14.353 INFO:teuthology.orchestra.run.smithi154.stdout:5 2024-09-10T08:28:14.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.354+0000 7f2de4c47640 1 -- 172.21.15.154:0/2226528983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de00c80f0 msgr2=0x7f2de01ebd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.354+0000 7f2de4c47640 1 --2- 172.21.15.154:0/2226528983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de00c80f0 0x7f2de01ebd90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2dc800e930 tx=0x7f2dc800edf0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.354+0000 7f2de4c47640 1 -- 172.21.15.154:0/2226528983 shutdown_connections 2024-09-10T08:28:14.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.354+0000 7f2de4c47640 1 --2- 172.21.15.154:0/2226528983 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de0153a40 0x7f2de01ec2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.354+0000 7f2de4c47640 1 --2- 172.21.15.154:0/2226528983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de00c80f0 0x7f2de01ebd90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.354+0000 7f2de4c47640 1 --2- 172.21.15.154:0/2226528983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2de006cbe0 0x7f2de00aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.354+0000 7f2de4c47640 1 -- 172.21.15.154:0/2226528983 >> 172.21.15.154:0/2226528983 conn(0x7f2de0073310 msgr2=0x7f2de00c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:14.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.354+0000 7f2de4c47640 1 -- 172.21.15.154:0/2226528983 shutdown_connections 2024-09-10T08:28:14.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.354+0000 7f2de4c47640 1 -- 172.21.15.154:0/2226528983 wait complete. 2024-09-10T08:28:14.364 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new eebac31e-aaef-47b0-90d7-4af08f36d7c4 6 2024-09-10T08:28:14.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.464+0000 7f362d7d8640 1 Processor -- start 2024-09-10T08:28:14.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.464+0000 7f362d7d8640 1 -- start start 2024-09-10T08:28:14.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.465+0000 7f362d7d8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3628151950 0x7f36280c4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.465+0000 7f362d7d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36280c2720 0x7f36281576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.465+0000 7f362d7d8640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36281550d0 con 0x7f36280c2ea0 2024-09-10T08:28:14.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.465+0000 7f362d7d8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3628154ba0 con 0x7f3628151950 2024-09-10T08:28:14.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.465+0000 7f362d7d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3628158320 con 0x7f36280c2720 2024-09-10T08:28:14.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.465+0000 7f36267fc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36280c2720 0x7f36281576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.465+0000 7f3626ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3628151950 0x7f36280c4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.465+0000 7f3626ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3628151950 0x7f36280c4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58598/0 (socket says 172.21.15.154:58598) 2024-09-10T08:28:14.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.465+0000 7f36267fc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36280c2720 0x7f36281576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52192/0 (socket says 172.21.15.154:52192) 2024-09-10T08:28:14.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.465+0000 7f3626ffd640 1 -- 172.21.15.154:0/2225233762 learned_addr learned my addr 172.21.15.154:0/2225233762 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T08:28:14.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.465+0000 7f3626ffd640 1 -- 172.21.15.154:0/2225233762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36280c2720 msgr2=0x7f36281576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:14.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.465+0000 7f3626ffd640 1 --2- 172.21.15.154:0/2225233762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36280c2720 0x7f36281576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.465+0000 7f3626ffd640 1 -- 172.21.15.154:0/2225233762 >> v1:172.21.15.103:6789/0 conn(0x7f36280c2ea0 legacy=0x7f3628157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.465+0000 7f3626ffd640 1 -- 172.21.15.154:0/2225233762 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3628154df0 con 0x7f3628151950 2024-09-10T08:28:14.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.465+0000 7f36267fc640 1 --2- 172.21.15.154:0/2225233762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36280c2720 0x7f36281576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:14.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.466+0000 7f3626ffd640 1 --2- 172.21.15.154:0/2225233762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3628151950 0x7f36280c4f30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3618009870 tx=0x7f361802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb2d06e2258cb229 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:14.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.466+0000 7f3625ffb640 1 -- 172.21.15.154:0/2225233762 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3618037070 con 0x7f3628151950 2024-09-10T08:28:14.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.466+0000 7f3625ffb640 1 -- 172.21.15.154:0/2225233762 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3618032440 con 0x7f3628151950 2024-09-10T08:28:14.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.466+0000 7f3625ffb640 1 -- 172.21.15.154:0/2225233762 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3618032810 con 0x7f3628151950 2024-09-10T08:28:14.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.467+0000 7f362d7d8640 1 -- 172.21.15.154:0/2225233762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3628151950 msgr2=0x7f36280c4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.467+0000 7f362d7d8640 1 --2- 172.21.15.154:0/2225233762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3628151950 0x7f36280c4f30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3618009870 tx=0x7f361802a1c0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.467+0000 7f362d7d8640 1 -- 172.21.15.154:0/2225233762 shutdown_connections 2024-09-10T08:28:14.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.467+0000 7f362d7d8640 1 --2- 172.21.15.154:0/2225233762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36280c2720 0x7f36281576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.467+0000 7f362d7d8640 1 --2- 172.21.15.154:0/2225233762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3628151950 0x7f36280c4f30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.467+0000 7f362d7d8640 1 -- 172.21.15.154:0/2225233762 >> 172.21.15.154:0/2225233762 conn(0x7f36280681e0 msgr2=0x7f36280c84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:14.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.467+0000 7f362d7d8640 1 -- 172.21.15.154:0/2225233762 shutdown_connections 2024-09-10T08:28:14.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.467+0000 7f362d7d8640 1 -- 172.21.15.154:0/2225233762 wait complete. 2024-09-10T08:28:14.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.468+0000 7f362d7d8640 1 Processor -- start 2024-09-10T08:28:14.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.468+0000 7f362d7d8640 1 -- start start 2024-09-10T08:28:14.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.469+0000 7f362d7d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36280c2720 0x7f36281557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.469+0000 7f362d7d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36280c2ea0 0x7f36280c1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.469+0000 7f362d7d8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3628151950 0x7f36281ebb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.469+0000 7f362d7d8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3628151d30 con 0x7f3628151950 2024-09-10T08:28:14.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.469+0000 7f362d7d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f36280c8fa0 con 0x7f36280c2ea0 2024-09-10T08:28:14.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.469+0000 7f362d7d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f36280a7f00 con 0x7f36280c2720 2024-09-10T08:28:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.469+0000 7f36267fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36280c2ea0 0x7f36280c1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.469+0000 7f3626ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36280c2720 0x7f36281557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.469+0000 7f36267fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36280c2ea0 0x7f36280c1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58606/0 (socket says 172.21.15.154:58606) 2024-09-10T08:28:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.469+0000 7f36267fc640 1 -- 172.21.15.154:0/871961329 learned_addr learned my addr 172.21.15.154:0/871961329 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T08:28:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.469+0000 7f36277fe640 1 --2- 172.21.15.154:0/871961329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3628151950 0x7f36281ebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.469+0000 7f3626ffd640 1 -- 172.21.15.154:0/871961329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36280c2ea0 msgr2=0x7f36280c1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.469+0000 7f3626ffd640 1 --2- 172.21.15.154:0/871961329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36280c2ea0 0x7f36280c1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.469+0000 7f3626ffd640 1 -- 172.21.15.154:0/871961329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3628151950 msgr2=0x7f36281ebb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.469+0000 7f3626ffd640 1 --2- 172.21.15.154:0/871961329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3628151950 0x7f36281ebb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.469+0000 7f3626ffd640 1 -- 172.21.15.154:0/871961329 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3628155cf0 con 0x7f36280c2720 2024-09-10T08:28:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.469+0000 7f36267fc640 1 --2- 172.21.15.154:0/871961329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36280c2ea0 0x7f36280c1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.470+0000 7f3626ffd640 1 --2- 172.21.15.154:0/871961329 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36280c2720 0x7f36281557b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3618031000 tx=0x7f36180046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.470+0000 7f361f7fe640 1 -- 172.21.15.154:0/871961329 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3618041020 con 0x7f36280c2720 2024-09-10T08:28:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.470+0000 7f361f7fe640 1 -- 172.21.15.154:0/871961329 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3618030660 con 0x7f36280c2720 2024-09-10T08:28:14.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.470+0000 7f361f7fe640 1 -- 172.21.15.154:0/871961329 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3618037040 con 0x7f36280c2720 2024-09-10T08:28:14.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.470+0000 7f362d7d8640 1 -- 172.21.15.154:0/871961329 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36281577b0 con 0x7f36280c2720 2024-09-10T08:28:14.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.470+0000 7f362d7d8640 1 -- 172.21.15.154:0/871961329 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f36280ad2c0 con 0x7f36280c2720 2024-09-10T08:28:14.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.470+0000 7f361f7fe640 1 -- 172.21.15.154:0/871961329 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3618044020 con 0x7f36280c2720 2024-09-10T08:28:14.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.470+0000 7f361f7fe640 1 -- 172.21.15.154:0/871961329 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f361803db50 con 0x7f36280c2720 2024-09-10T08:28:14.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.471+0000 7f362d7d8640 1 -- 172.21.15.154:0/871961329 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36280c4f30 con 0x7f36280c2720 2024-09-10T08:28:14.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.473+0000 7f361f7fe640 1 -- 172.21.15.154:0/871961329 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f361804b030 con 0x7f36280c2720 2024-09-10T08:28:14.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.541+0000 7f362d7d8640 1 -- 172.21.15.154:0/871961329 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd new", "uuid": "eebac31e-aaef-47b0-90d7-4af08f36d7c4", "id": 6} v 0) -- 0x7f36280aad40 con 0x7f36280c2720 2024-09-10T08:28:14.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.547+0000 7f361f7fe640 1 -- 172.21.15.154:0/871961329 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eebac31e-aaef-47b0-90d7-4af08f36d7c4", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f361803ddf0 con 0x7f36280c2720 2024-09-10T08:28:14.547 INFO:teuthology.orchestra.run.smithi154.stdout:6 2024-09-10T08:28:14.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.548+0000 7f362d7d8640 1 -- 172.21.15.154:0/871961329 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36280c2720 msgr2=0x7f36281557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.548+0000 7f362d7d8640 1 --2- 172.21.15.154:0/871961329 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36280c2720 0x7f36281557b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3618031000 tx=0x7f36180046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.548+0000 7f362d7d8640 1 -- 172.21.15.154:0/871961329 shutdown_connections 2024-09-10T08:28:14.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.548+0000 7f362d7d8640 1 --2- 172.21.15.154:0/871961329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3628151950 0x7f36281ebb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.548+0000 7f362d7d8640 1 --2- 172.21.15.154:0/871961329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36280c2ea0 0x7f36280c1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.548+0000 7f362d7d8640 1 --2- 172.21.15.154:0/871961329 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36280c2720 0x7f36281557b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.548+0000 7f362d7d8640 1 -- 172.21.15.154:0/871961329 >> 172.21.15.154:0/871961329 conn(0x7f36280681e0 msgr2=0x7f36280c80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:14.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.548+0000 7f362d7d8640 1 -- 172.21.15.154:0/871961329 shutdown_connections 2024-09-10T08:28:14.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.548+0000 7f362d7d8640 1 -- 172.21.15.154:0/871961329 wait complete. 2024-09-10T08:28:14.558 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 58406c9a-036f-4618-bfb6-0beddbd71605 7 2024-09-10T08:28:14.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.659+0000 7f3c72ee6640 1 Processor -- start 2024-09-10T08:28:14.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.659+0000 7f3c72ee6640 1 -- start start 2024-09-10T08:28:14.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.659+0000 7f3c72ee6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3c6c0a7cc0 0x7f3c6c0a80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.659+0000 7f3c72ee6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c6c0c4790 0x7f3c6c159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.659+0000 7f3c72ee6640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c6c156300 con 0x7f3c6c070230 2024-09-10T08:28:14.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.659+0000 7f3c72ee6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3c6c1565e0 con 0x7f3c6c0a7cc0 2024-09-10T08:28:14.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.659+0000 7f3c72ee6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3c6c1568c0 con 0x7f3c6c0c4790 2024-09-10T08:28:14.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.660+0000 7f3c70c82640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3c6c0a7cc0 0x7f3c6c0a80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.660+0000 7f3c70c82640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3c6c0a7cc0 0x7f3c6c0a80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58608/0 (socket says 172.21.15.154:58608) 2024-09-10T08:28:14.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.660+0000 7f3c70c82640 1 -- 172.21.15.154:0/1916731979 learned_addr learned my addr 172.21.15.154:0/1916731979 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T08:28:14.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.660+0000 7f3c71483640 1 --2- 172.21.15.154:0/1916731979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c6c0c4790 0x7f3c6c159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.660+0000 7f3c70c82640 1 -- 172.21.15.154:0/1916731979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c6c0c4790 msgr2=0x7f3c6c159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:14.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.660+0000 7f3c70c82640 1 --2- 172.21.15.154:0/1916731979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c6c0c4790 0x7f3c6c159ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.660+0000 7f3c70c82640 1 -- 172.21.15.154:0/1916731979 >> v1:172.21.15.103:6789/0 conn(0x7f3c6c070230 legacy=0x7f3c6c1597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.660+0000 7f3c70c82640 1 -- 172.21.15.154:0/1916731979 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c6c156ba0 con 0x7f3c6c0a7cc0 2024-09-10T08:28:14.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.661+0000 7f3c70c82640 1 --2- 172.21.15.154:0/1916731979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c6c0a7cc0 0x7f3c6c0a80a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3c60009870 tx=0x7f3c6002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3592ebef2b347bfc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:14.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.661+0000 7f3c6b7fe640 1 -- 172.21.15.154:0/1916731979 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c60037070 con 0x7f3c6c0a7cc0 2024-09-10T08:28:14.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.661+0000 7f3c6b7fe640 1 -- 172.21.15.154:0/1916731979 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c60032440 con 0x7f3c6c0a7cc0 2024-09-10T08:28:14.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.661+0000 7f3c6b7fe640 1 -- 172.21.15.154:0/1916731979 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c60032810 con 0x7f3c6c0a7cc0 2024-09-10T08:28:14.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.661+0000 7f3c72ee6640 1 -- 172.21.15.154:0/1916731979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c6c0a7cc0 msgr2=0x7f3c6c0a80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.661+0000 7f3c72ee6640 1 --2- 172.21.15.154:0/1916731979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c6c0a7cc0 0x7f3c6c0a80a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3c60009870 tx=0x7f3c6002a1c0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.661+0000 7f3c72ee6640 1 -- 172.21.15.154:0/1916731979 shutdown_connections 2024-09-10T08:28:14.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.661+0000 7f3c72ee6640 1 --2- 172.21.15.154:0/1916731979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c6c0c4790 0x7f3c6c159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.661+0000 7f3c72ee6640 1 --2- 172.21.15.154:0/1916731979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c6c0a7cc0 0x7f3c6c0a80a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.661+0000 7f3c72ee6640 1 -- 172.21.15.154:0/1916731979 >> 172.21.15.154:0/1916731979 conn(0x7f3c6c0c5660 msgr2=0x7f3c6c0c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:14.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.661+0000 7f3c72ee6640 1 -- 172.21.15.154:0/1916731979 shutdown_connections 2024-09-10T08:28:14.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.661+0000 7f3c72ee6640 1 -- 172.21.15.154:0/1916731979 wait complete. 2024-09-10T08:28:14.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.663+0000 7f3c72ee6640 1 Processor -- start 2024-09-10T08:28:14.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.663+0000 7f3c72ee6640 1 -- start start 2024-09-10T08:28:14.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.663+0000 7f3c72ee6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c6c070230 0x7f3c6c0a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.663+0000 7f3c72ee6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c6c0a7cc0 0x7f3c6c0c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.663+0000 7f3c72ee6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6c0c4790 0x7f3c6c0c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.663+0000 7f3c72ee6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c0c52f0 con 0x7f3c6c0c4790 2024-09-10T08:28:14.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.663+0000 7f3c72ee6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c0c5170 con 0x7f3c6c0a7cc0 2024-09-10T08:28:14.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.663+0000 7f3c72ee6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3c6c150540 con 0x7f3c6c070230 2024-09-10T08:28:14.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.664+0000 7f3c70c82640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c6c070230 0x7f3c6c0a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.664+0000 7f3c6bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c6c0a7cc0 0x7f3c6c0c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.664+0000 7f3c70c82640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c6c070230 0x7f3c6c0a9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52232/0 (socket says 172.21.15.154:52232) 2024-09-10T08:28:14.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.664+0000 7f3c6bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c6c0a7cc0 0x7f3c6c0c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58616/0 (socket says 172.21.15.154:58616) 2024-09-10T08:28:14.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.664+0000 7f3c70c82640 1 -- 172.21.15.154:0/91500033 learned_addr learned my addr 172.21.15.154:0/91500033 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T08:28:14.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.664+0000 7f3c71483640 1 --2- 172.21.15.154:0/91500033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6c0c4790 0x7f3c6c0c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.664+0000 7f3c70c82640 1 -- 172.21.15.154:0/91500033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c6c0a7cc0 msgr2=0x7f3c6c0c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.664+0000 7f3c70c82640 1 --2- 172.21.15.154:0/91500033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c6c0a7cc0 0x7f3c6c0c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.664+0000 7f3c70c82640 1 -- 172.21.15.154:0/91500033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6c0c4790 msgr2=0x7f3c6c0c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.664+0000 7f3c70c82640 1 --2- 172.21.15.154:0/91500033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6c0c4790 0x7f3c6c0c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.664+0000 7f3c70c82640 1 -- 172.21.15.154:0/91500033 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c6c14b890 con 0x7f3c6c070230 2024-09-10T08:28:14.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.664+0000 7f3c6bfff640 1 --2- 172.21.15.154:0/91500033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c6c0a7cc0 0x7f3c6c0c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:14.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.664+0000 7f3c70c82640 1 --2- 172.21.15.154:0/91500033 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c6c070230 0x7f3c6c0a9480 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3c6002a200 tx=0x7f3c600046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:14.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.664+0000 7f3c697fa640 1 -- 172.21.15.154:0/91500033 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c60037040 con 0x7f3c6c070230 2024-09-10T08:28:14.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.664+0000 7f3c697fa640 1 -- 172.21.15.154:0/91500033 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c60042070 con 0x7f3c6c070230 2024-09-10T08:28:14.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.664+0000 7f3c72ee6640 1 -- 172.21.15.154:0/91500033 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c6c14aeb0 con 0x7f3c6c070230 2024-09-10T08:28:14.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.664+0000 7f3c697fa640 1 -- 172.21.15.154:0/91500033 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c60030880 con 0x7f3c6c070230 2024-09-10T08:28:14.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.664+0000 7f3c72ee6640 1 -- 172.21.15.154:0/91500033 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c6c0a99c0 con 0x7f3c6c070230 2024-09-10T08:28:14.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.665+0000 7f3c697fa640 1 -- 172.21.15.154:0/91500033 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3c6002ad10 con 0x7f3c6c070230 2024-09-10T08:28:14.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.665+0000 7f3c697fa640 1 -- 172.21.15.154:0/91500033 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f3c6003b430 con 0x7f3c6c070230 2024-09-10T08:28:14.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.665+0000 7f3c72ee6640 1 -- 172.21.15.154:0/91500033 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c6c0a8980 con 0x7f3c6c070230 2024-09-10T08:28:14.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.667+0000 7f3c697fa640 1 -- 172.21.15.154:0/91500033 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3c6c0a8980 con 0x7f3c6c070230 2024-09-10T08:28:14.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.739+0000 7f3c72ee6640 1 -- 172.21.15.154:0/91500033 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd new", "uuid": "58406c9a-036f-4618-bfb6-0beddbd71605", "id": 7} v 0) -- 0x7f3c6c14bf00 con 0x7f3c6c070230 2024-09-10T08:28:14.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.747+0000 7f3c697fa640 1 -- 172.21.15.154:0/91500033 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "58406c9a-036f-4618-bfb6-0beddbd71605", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f3c60047460 con 0x7f3c6c070230 2024-09-10T08:28:14.747 INFO:teuthology.orchestra.run.smithi154.stdout:7 2024-09-10T08:28:14.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.748+0000 7f3c72ee6640 1 -- 172.21.15.154:0/91500033 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c6c070230 msgr2=0x7f3c6c0a9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.748+0000 7f3c72ee6640 1 --2- 172.21.15.154:0/91500033 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c6c070230 0x7f3c6c0a9480 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3c6002a200 tx=0x7f3c600046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.748+0000 7f3c72ee6640 1 -- 172.21.15.154:0/91500033 shutdown_connections 2024-09-10T08:28:14.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.748+0000 7f3c72ee6640 1 --2- 172.21.15.154:0/91500033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c6c0c4790 0x7f3c6c0c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.748+0000 7f3c72ee6640 1 --2- 172.21.15.154:0/91500033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c6c0a7cc0 0x7f3c6c0c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.748+0000 7f3c72ee6640 1 --2- 172.21.15.154:0/91500033 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c6c070230 0x7f3c6c0a9480 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.748+0000 7f3c72ee6640 1 -- 172.21.15.154:0/91500033 >> 172.21.15.154:0/91500033 conn(0x7f3c6c0c5660 msgr2=0x7f3c6c14c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:14.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.748+0000 7f3c72ee6640 1 -- 172.21.15.154:0/91500033 shutdown_connections 2024-09-10T08:28:14.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:28:14.748+0000 7f3c72ee6640 1 -- 172.21.15.154:0/91500033 wait complete. 2024-09-10T08:28:14.758 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-10T08:28:14.758 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-10T08:28:14.761 INFO:tasks.ceph.osd.0:Started 2024-09-10T08:28:14.761 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-10T08:28:14.761 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-10T08:28:14.763 INFO:tasks.ceph.osd.1:Started 2024-09-10T08:28:14.763 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-10T08:28:14.764 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-10T08:28:14.765 INFO:tasks.ceph.osd.2:Started 2024-09-10T08:28:14.766 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-10T08:28:14.766 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-10T08:28:14.768 INFO:tasks.ceph.osd.3:Started 2024-09-10T08:28:14.768 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-10T08:28:14.768 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-10T08:28:14.770 INFO:tasks.ceph.osd.4:Started 2024-09-10T08:28:14.770 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-10T08:28:14.770 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-10T08:28:14.772 INFO:tasks.ceph.osd.5:Started 2024-09-10T08:28:14.772 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-10T08:28:14.773 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-10T08:28:14.775 INFO:tasks.ceph.osd.6:Started 2024-09-10T08:28:14.775 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-10T08:28:14.775 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-10T08:28:14.777 INFO:tasks.ceph.osd.7:Started 2024-09-10T08:28:14.777 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:28:14.823 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:14.824+0000 7ff5a785c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T08:28:14.880 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:14.880+0000 7f800df27040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T08:28:14.905 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:14.905+0000 7ff5a785c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T08:28:14.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.919+0000 7f55ea827640 1 Processor -- start 2024-09-10T08:28:14.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.919+0000 7f55ea827640 1 -- start start 2024-09-10T08:28:14.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.920+0000 7f55ea827640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f55e40c55f0 0x7f55e40ac470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.920+0000 7f55ea827640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55e40c3e60 con 0x7f55e40addf0 2024-09-10T08:28:14.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.920+0000 7f55ea827640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55e40c8580 con 0x7f55e40c59d0 2024-09-10T08:28:14.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.920+0000 7f55ea827640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f55e40c4120 con 0x7f55e40c55f0 2024-09-10T08:28:14.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.920+0000 7f55dbfff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f55e40addf0 0x7f55e40ac9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:35852/0 (socket says 172.21.15.103:35852) 2024-09-10T08:28:14.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.920+0000 7f55dbfff640 1 -- 172.21.15.103:0/991129482 learned_addr learned my addr 172.21.15.103:0/991129482 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:14.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.920+0000 7f55e3fff640 1 --2- 172.21.15.103:0/991129482 >> v2:172.21.15.103:3300/0 conn(0x7f55e40c55f0 0x7f55e40ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.920+0000 7f55e37fe640 1 -- 172.21.15.103:0/991129482 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2243405912 0 0) 0x7f55e40c3e60 con 0x7f55e40addf0 2024-09-10T08:28:14.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.920+0000 7f55e37fe640 1 -- 172.21.15.103:0/991129482 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55d0003520 con 0x7f55e40addf0 2024-09-10T08:28:14.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.920+0000 7f55e3fff640 1 -- 172.21.15.103:0/991129482 >> v1:172.21.15.154:6789/0 conn(0x7f55e40c59d0 legacy=0x7f55e4157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.920+0000 7f55e3fff640 1 -- 172.21.15.103:0/991129482 >> v1:172.21.15.103:6789/0 conn(0x7f55e40addf0 legacy=0x7f55e40ac9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.920+0000 7f55e3fff640 1 -- 172.21.15.103:0/991129482 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e40c4400 con 0x7f55e40c55f0 2024-09-10T08:28:14.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.921+0000 7f55e3fff640 1 --2- 172.21.15.103:0/991129482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e40c55f0 0x7f55e40ac470 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f55d40097a0 tx=0x7f55d402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81559b14311ca1b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:14.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.921+0000 7f55e37fe640 1 -- 172.21.15.103:0/991129482 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d4037070 con 0x7f55e40c55f0 2024-09-10T08:28:14.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.921+0000 7f55e37fe640 1 -- 172.21.15.103:0/991129482 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d402adc0 con 0x7f55e40c55f0 2024-09-10T08:28:14.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.921+0000 7f55e37fe640 1 -- 172.21.15.103:0/991129482 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d4032660 con 0x7f55e40c55f0 2024-09-10T08:28:14.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.922+0000 7f55ea827640 1 -- 172.21.15.103:0/991129482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e40c55f0 msgr2=0x7f55e40ac470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.922+0000 7f55ea827640 1 --2- 172.21.15.103:0/991129482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e40c55f0 0x7f55e40ac470 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f55d40097a0 tx=0x7f55d402a0b0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.922+0000 7f55ea827640 1 -- 172.21.15.103:0/991129482 shutdown_connections 2024-09-10T08:28:14.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.922+0000 7f55ea827640 1 --2- 172.21.15.103:0/991129482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e40c55f0 0x7f55e40ac470 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.922+0000 7f55ea827640 1 -- 172.21.15.103:0/991129482 >> 172.21.15.103:0/991129482 conn(0x7f55e40c8a50 msgr2=0x7f55e40c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:14.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.922+0000 7f55ea827640 1 -- 172.21.15.103:0/991129482 shutdown_connections 2024-09-10T08:28:14.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.922+0000 7f55ea827640 1 -- 172.21.15.103:0/991129482 wait complete. 2024-09-10T08:28:14.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.923+0000 7f55ea827640 1 Processor -- start 2024-09-10T08:28:14.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.923+0000 7f55ea827640 1 -- start start 2024-09-10T08:28:14.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.924+0000 7f55ea827640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e40addf0 0x7f55e40c0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.924+0000 7f55ea827640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e40c55f0 0x7f55e40a7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.924+0000 7f55ea827640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e40c59d0 0x7f55e41ecf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:14.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.924+0000 7f55ea827640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f55e40c35d0 con 0x7f55e40c55f0 2024-09-10T08:28:14.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.924+0000 7f55ea827640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55e40c3450 con 0x7f55e40c59d0 2024-09-10T08:28:14.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.924+0000 7f55ea827640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f55e40abb00 con 0x7f55e40addf0 2024-09-10T08:28:14.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.924+0000 7f55dbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e40c55f0 0x7f55e40a7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.924+0000 7f55dbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e40c55f0 0x7f55e40a7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52918/0 (socket says 172.21.15.103:52918) 2024-09-10T08:28:14.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.924+0000 7f55dbfff640 1 -- 172.21.15.103:0/680302249 learned_addr learned my addr 172.21.15.103:0/680302249 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:14.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.924+0000 7f55e8dc4640 1 --2- 172.21.15.103:0/680302249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e40c59d0 0x7f55e41ecf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.924+0000 7f55e3fff640 1 --2- 172.21.15.103:0/680302249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e40addf0 0x7f55e40c0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:14.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.924+0000 7f55dbfff640 1 -- 172.21.15.103:0/680302249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e40addf0 msgr2=0x7f55e40c0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.924+0000 7f55dbfff640 1 --2- 172.21.15.103:0/680302249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e40addf0 0x7f55e40c0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.924+0000 7f55dbfff640 1 -- 172.21.15.103:0/680302249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e40c59d0 msgr2=0x7f55e41ecf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.924+0000 7f55dbfff640 1 --2- 172.21.15.103:0/680302249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e40c59d0 0x7f55e41ecf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.924+0000 7f55dbfff640 1 -- 172.21.15.103:0/680302249 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e40c0d60 con 0x7f55e40c55f0 2024-09-10T08:28:14.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.925+0000 7f55dbfff640 1 --2- 172.21.15.103:0/680302249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e40c55f0 0x7f55e40a7cd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00c4a0 tx=0x7f55cc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:14.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.925+0000 7f55e17fa640 1 -- 172.21.15.103:0/680302249 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc018070 con 0x7f55e40c55f0 2024-09-10T08:28:14.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.925+0000 7f55e17fa640 1 -- 172.21.15.103:0/680302249 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55cc0074e0 con 0x7f55e40c55f0 2024-09-10T08:28:14.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.925+0000 7f55ea827640 1 -- 172.21.15.103:0/680302249 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e40c21a0 con 0x7f55e40c55f0 2024-09-10T08:28:14.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.925+0000 7f55e17fa640 1 -- 172.21.15.103:0/680302249 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc0049e0 con 0x7f55e40c55f0 2024-09-10T08:28:14.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.925+0000 7f55ea827640 1 -- 172.21.15.103:0/680302249 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e40c1ec0 con 0x7f55e40c55f0 2024-09-10T08:28:14.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.925+0000 7f55e17fa640 1 -- 172.21.15.103:0/680302249 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f55cc01b070 con 0x7f55e40c55f0 2024-09-10T08:28:14.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.925+0000 7f55e17fa640 1 -- 172.21.15.103:0/680302249 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f55cc012ad0 con 0x7f55e40c55f0 2024-09-10T08:28:14.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.926+0000 7f55ea827640 1 -- 172.21.15.103:0/680302249 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e40ac470 con 0x7f55e40c55f0 2024-09-10T08:28:14.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.928+0000 7f55e17fa640 1 -- 172.21.15.103:0/680302249 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f55cc022020 con 0x7f55e40c55f0 2024-09-10T08:28:14.933 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:14.934+0000 7f800df27040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T08:28:14.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.985+0000 7f55ea827640 1 -- 172.21.15.103:0/680302249 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55e40ad680 con 0x7f55e40c55f0 2024-09-10T08:28:14.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.986+0000 7f55e17fa640 1 -- 172.21.15.103:0/680302249 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f55cc004c90 con 0x7f55e40c55f0 2024-09-10T08:28:14.985 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:14.986 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":10,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","created":"2024-09-10T08:28:12.654957+0000","modified":"2024-09-10T08:28:14.741133+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T08:28:14.741133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1abe08f4-0348-435e-9f97-cec00e96992c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"df342e58-1026-4739-82f6-7a216707444c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f7aea2cf-208c-41ed-a0f6-8948d70b9a0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"615ef8b0-12a5-4503-96d0-f7ec17dbc792","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"644c5e94-db18-4b83-b5cd-3762ae2647a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f40210bd-f4ca-442e-baac-729ced5a9f21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"eebac31e-aaef-47b0-90d7-4af08f36d7c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"58406c9a-036f-4618-bfb6-0beddbd71605","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:28:14.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.987+0000 7f55ea827640 1 -- 172.21.15.103:0/680302249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e40c55f0 msgr2=0x7f55e40a7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.987+0000 7f55ea827640 1 --2- 172.21.15.103:0/680302249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e40c55f0 0x7f55e40a7cd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00c4a0 tx=0x7f55cc00c960 comp rx=0 tx=0).stop 2024-09-10T08:28:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.987+0000 7f55ea827640 1 -- 172.21.15.103:0/680302249 shutdown_connections 2024-09-10T08:28:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.987+0000 7f55ea827640 1 --2- 172.21.15.103:0/680302249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e40c59d0 0x7f55e41ecf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.987+0000 7f55ea827640 1 --2- 172.21.15.103:0/680302249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e40c55f0 0x7f55e40a7cd0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.987+0000 7f55ea827640 1 --2- 172.21.15.103:0/680302249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e40addf0 0x7f55e40c0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.987+0000 7f55ea827640 1 -- 172.21.15.103:0/680302249 >> 172.21.15.103:0/680302249 conn(0x7f55e40c8a50 msgr2=0x7f55e40c6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.987+0000 7f55ea827640 1 -- 172.21.15.103:0/680302249 shutdown_connections 2024-09-10T08:28:14.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:14.987+0000 7f55ea827640 1 -- 172.21.15.103:0/680302249 wait complete. 2024-09-10T08:28:14.997 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-10T08:28:14.998 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-10T08:28:15.282 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:15.283+0000 7ff5a785c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T08:28:15.301 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:15.300+0000 7f800df27040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T08:28:15.367 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:15.367+0000 7ff5a785c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T08:28:15.385 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:15.385+0000 7f800df27040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T08:28:15.477 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:15.478+0000 7ff5a785c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:28:15.494 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:15.494+0000 7f800df27040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:28:15.524 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:15.524+0000 7ff5a785c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T08:28:15.540 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:15.540+0000 7f800df27040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T08:28:15.637 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:15.638+0000 7ff5a785c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T08:28:15.651 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:15.651+0000 7f800df27040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T08:28:15.693 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:15.693+0000 7ff5a785c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T08:28:15.707 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:15.707+0000 7f800df27040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T08:28:15.739 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:15.739+0000 7ff5a785c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T08:28:15.753 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:15.753+0000 7f800df27040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T08:28:15.802 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T08:28:15.854 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:15.855+0000 7ff5a785c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T08:28:15.863 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:15.863+0000 7f800df27040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T08:28:15.894 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.894+0000 7f4a3cbc4640 1 Processor -- start 2024-09-10T08:28:15.894 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.894+0000 7f4a3cbc4640 1 -- start start 2024-09-10T08:28:15.896 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.895+0000 7f4a3cbc4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a38159df0 0x7f4a380aef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:15.896 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.895+0000 7f4a3cbc4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4a3815a690 0x7f4a38156950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:15.896 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.895+0000 7f4a3cbc4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a380aec30 con 0x7f4a380ab450 2024-09-10T08:28:15.896 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.895+0000 7f4a3cbc4640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f4a380c60f0 con 0x7f4a3815a690 2024-09-10T08:28:15.897 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.895+0000 7f4a3cbc4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4a380abe60 con 0x7f4a38159df0 2024-09-10T08:28:15.897 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.896+0000 7f4a35d9b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4a380ab450 0x7f4a380ae2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:37584/0 (socket says 172.21.15.103:37584) 2024-09-10T08:28:15.897 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.896+0000 7f4a35d9b640 1 -- 172.21.15.103:0/1691306219 learned_addr learned my addr 172.21.15.103:0/1691306219 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:15.897 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.896+0000 7f4a36d9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4a3815a690 0x7f4a38156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:15.897 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.896+0000 7f4a3659c640 1 --2- 172.21.15.103:0/1691306219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a38159df0 0x7f4a380aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:15.897 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.896+0000 7f4a3559a640 1 -- 172.21.15.103:0/1691306219 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512414091 0 0) 0x7f4a380aec30 con 0x7f4a380ab450 2024-09-10T08:28:15.897 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.896+0000 7f4a3559a640 1 -- 172.21.15.103:0/1691306219 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a20003520 con 0x7f4a380ab450 2024-09-10T08:28:15.897 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.896+0000 7f4a36d9d640 1 -- 172.21.15.103:0/1691306219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a38159df0 msgr2=0x7f4a380aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:15.897 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.896+0000 7f4a36d9d640 1 --2- 172.21.15.103:0/1691306219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a38159df0 0x7f4a380aef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:15.897 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.896+0000 7f4a36d9d640 1 -- 172.21.15.103:0/1691306219 >> v1:172.21.15.103:6789/0 conn(0x7f4a380ab450 legacy=0x7f4a380ae2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:15.897 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.896+0000 7f4a36d9d640 1 -- 172.21.15.103:0/1691306219 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a380c7780 con 0x7f4a3815a690 2024-09-10T08:28:15.897 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.897+0000 7f4a36d9d640 1 --2- 172.21.15.103:0/1691306219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a3815a690 0x7f4a38156950 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009d90 tx=0x7f4a3002a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0a4a09cadde7d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:15.897 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.897+0000 7f4a3559a640 1 -- 172.21.15.103:0/1691306219 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30007740 con 0x7f4a3815a690 2024-09-10T08:28:15.898 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.897+0000 7f4a3559a640 1 -- 172.21.15.103:0/1691306219 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a300078e0 con 0x7f4a3815a690 2024-09-10T08:28:15.898 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.897+0000 7f4a3559a640 1 -- 172.21.15.103:0/1691306219 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30007c90 con 0x7f4a3815a690 2024-09-10T08:28:15.901 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.897+0000 7f4a3cbc4640 1 -- 172.21.15.103:0/1691306219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a3815a690 msgr2=0x7f4a38156950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:15.901 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.897+0000 7f4a3cbc4640 1 --2- 172.21.15.103:0/1691306219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a3815a690 0x7f4a38156950 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009d90 tx=0x7f4a3002a530 comp rx=0 tx=0).stop 2024-09-10T08:28:15.901 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.897+0000 7f4a3cbc4640 1 -- 172.21.15.103:0/1691306219 shutdown_connections 2024-09-10T08:28:15.901 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.897+0000 7f4a3cbc4640 1 --2- 172.21.15.103:0/1691306219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a3815a690 0x7f4a38156950 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:15.901 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.897+0000 7f4a3cbc4640 1 --2- 172.21.15.103:0/1691306219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a38159df0 0x7f4a380aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:15.901 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.897+0000 7f4a3cbc4640 1 -- 172.21.15.103:0/1691306219 >> 172.21.15.103:0/1691306219 conn(0x7f4a380c6a50 msgr2=0x7f4a380c6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:15.901 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.897+0000 7f4a3cbc4640 1 -- 172.21.15.103:0/1691306219 shutdown_connections 2024-09-10T08:28:15.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.897+0000 7f4a3cbc4640 1 -- 172.21.15.103:0/1691306219 wait complete. 2024-09-10T08:28:15.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.899+0000 7f4a3cbc4640 1 Processor -- start 2024-09-10T08:28:15.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.899+0000 7f4a3cbc4640 1 -- start start 2024-09-10T08:28:15.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.899+0000 7f4a3cbc4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a380ab450 0x7f4a381544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:15.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.899+0000 7f4a3cbc4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a38159df0 0x7f4a381e9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:15.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.899+0000 7f4a3cbc4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a3815a690 0x7f4a381e95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:15.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.899+0000 7f4a3cbc4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3815a350 con 0x7f4a3815a690 2024-09-10T08:28:15.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.899+0000 7f4a3cbc4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3815a1d0 con 0x7f4a38159df0 2024-09-10T08:28:15.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.899+0000 7f4a3cbc4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4a38156e90 con 0x7f4a380ab450 2024-09-10T08:28:15.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.900+0000 7f4a36d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a3815a690 0x7f4a381e95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:15.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.900+0000 7f4a35d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a38159df0 0x7f4a381e9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:15.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.900+0000 7f4a36d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a3815a690 0x7f4a381e95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41002/0 (socket says 172.21.15.103:41002) 2024-09-10T08:28:15.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.900+0000 7f4a36d9d640 1 -- 172.21.15.103:0/4256109027 learned_addr learned my addr 172.21.15.103:0/4256109027 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:15.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.900+0000 7f4a3659c640 1 --2- 172.21.15.103:0/4256109027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a380ab450 0x7f4a381544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:15.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.900+0000 7f4a36d9d640 1 -- 172.21.15.103:0/4256109027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a380ab450 msgr2=0x7f4a381544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:15.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.900+0000 7f4a36d9d640 1 --2- 172.21.15.103:0/4256109027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a380ab450 0x7f4a381544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:15.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.900+0000 7f4a36d9d640 1 -- 172.21.15.103:0/4256109027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a38159df0 msgr2=0x7f4a381e9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:15.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.900+0000 7f4a36d9d640 1 --2- 172.21.15.103:0/4256109027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a38159df0 0x7f4a381e9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:15.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.900+0000 7f4a36d9d640 1 -- 172.21.15.103:0/4256109027 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a38158980 con 0x7f4a3815a690 2024-09-10T08:28:15.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.900+0000 7f4a35d9b640 1 --2- 172.21.15.103:0/4256109027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a38159df0 0x7f4a381e9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:15.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.900+0000 7f4a36d9d640 1 --2- 172.21.15.103:0/4256109027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a3815a690 0x7f4a381e95b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4a3002ab20 tx=0x7f4a30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:15.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.900+0000 7f4a26ffd640 1 -- 172.21.15.103:0/4256109027 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3003f070 con 0x7f4a3815a690 2024-09-10T08:28:15.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.900+0000 7f4a26ffd640 1 -- 172.21.15.103:0/4256109027 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a30031c60 con 0x7f4a3815a690 2024-09-10T08:28:15.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.900+0000 7f4a3cbc4640 1 -- 172.21.15.103:0/4256109027 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a381ec7b0 con 0x7f4a3815a690 2024-09-10T08:28:15.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.900+0000 7f4a26ffd640 1 -- 172.21.15.103:0/4256109027 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30009450 con 0x7f4a3815a690 2024-09-10T08:28:15.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.901+0000 7f4a3cbc4640 1 -- 172.21.15.103:0/4256109027 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a38158c20 con 0x7f4a3815a690 2024-09-10T08:28:15.904 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.901+0000 7f4a26ffd640 1 -- 172.21.15.103:0/4256109027 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4a300439e0 con 0x7f4a3815a690 2024-09-10T08:28:15.904 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.901+0000 7f4a26ffd640 1 -- 172.21.15.103:0/4256109027 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f4a3003a3a0 con 0x7f4a3815a690 2024-09-10T08:28:15.904 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.901+0000 7f4a3cbc4640 1 -- 172.21.15.103:0/4256109027 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a380b02b0 con 0x7f4a3815a690 2024-09-10T08:28:15.904 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.903+0000 7f4a26ffd640 1 -- 172.21.15.103:0/4256109027 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4a3003b7d0 con 0x7f4a3815a690 2024-09-10T08:28:15.908 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:15.909+0000 7ff5a785c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T08:28:15.913 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:15.913+0000 7f800df27040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T08:28:15.961 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.962+0000 7f4a3cbc4640 1 -- 172.21.15.103:0/4256109027 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a38071270 con 0x7f4a3815a690 2024-09-10T08:28:15.962 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.963+0000 7f4a26ffd640 1 -- 172.21.15.103:0/4256109027 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f4a3003b9b0 con 0x7f4a3815a690 2024-09-10T08:28:15.962 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:15.963+0000 7ff5a785c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T08:28:15.963 INFO:teuthology.misc.health.smithi103.stdout: 2024-09-10T08:28:15.963 INFO:teuthology.misc.health.smithi103.stdout:{"epoch":10,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","created":"2024-09-10T08:28:12.654957+0000","modified":"2024-09-10T08:28:14.741133+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T08:28:14.741133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1abe08f4-0348-435e-9f97-cec00e96992c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"df342e58-1026-4739-82f6-7a216707444c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f7aea2cf-208c-41ed-a0f6-8948d70b9a0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"615ef8b0-12a5-4503-96d0-f7ec17dbc792","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"644c5e94-db18-4b83-b5cd-3762ae2647a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f40210bd-f4ca-442e-baac-729ced5a9f21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"eebac31e-aaef-47b0-90d7-4af08f36d7c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"58406c9a-036f-4618-bfb6-0beddbd71605","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:28:15.964 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.964+0000 7f4a3cbc4640 1 -- 172.21.15.103:0/4256109027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a3815a690 msgr2=0x7f4a381e95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:15.964 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.964+0000 7f4a3cbc4640 1 --2- 172.21.15.103:0/4256109027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a3815a690 0x7f4a381e95b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4a3002ab20 tx=0x7f4a30004a40 comp rx=0 tx=0).stop 2024-09-10T08:28:15.964 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.964+0000 7f4a3cbc4640 1 -- 172.21.15.103:0/4256109027 shutdown_connections 2024-09-10T08:28:15.964 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.964+0000 7f4a3cbc4640 1 --2- 172.21.15.103:0/4256109027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a3815a690 0x7f4a381e95b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:15.964 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.964+0000 7f4a3cbc4640 1 --2- 172.21.15.103:0/4256109027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a38159df0 0x7f4a381e9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:15.964 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.964+0000 7f4a3cbc4640 1 --2- 172.21.15.103:0/4256109027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a380ab450 0x7f4a381544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:15.964 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.964+0000 7f4a3cbc4640 1 -- 172.21.15.103:0/4256109027 >> 172.21.15.103:0/4256109027 conn(0x7f4a380c6a50 msgr2=0x7f4a380c5570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:15.964 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.964+0000 7f4a3cbc4640 1 -- 172.21.15.103:0/4256109027 shutdown_connections 2024-09-10T08:28:15.964 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:15.964+0000 7f4a3cbc4640 1 -- 172.21.15.103:0/4256109027 wait complete. 2024-09-10T08:28:15.965 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:15.966+0000 7f800df27040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T08:28:15.972 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T08:28:16.033 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:16.033+0000 7ff5a785c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T08:28:16.035 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:16.035+0000 7f800df27040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T08:28:16.078 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:16.078+0000 7ff5a785c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T08:28:16.079 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:16.079+0000 7f800df27040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T08:28:16.121 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:16.122+0000 7ff5a785c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T08:28:16.122 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:16.123+0000 7f800df27040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T08:28:16.237 INFO:tasks.ceph.osd.3.smithi103.stderr:2024-09-10T08:28:16.237+0000 7f53c0320640 -1 Falling back to public interface 2024-09-10T08:28:16.261 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-10T08:28:16.261+0000 7fb4a2358640 -1 Falling back to public interface 2024-09-10T08:28:16.474 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-10T08:28:16.474+0000 7f0165dc3640 -1 Falling back to public interface 2024-09-10T08:28:16.500 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-10T08:28:16.500+0000 7f37fb3b0640 -1 Falling back to public interface 2024-09-10T08:28:16.759 INFO:tasks.ceph.osd.0.smithi103.stderr:2024-09-10T08:28:16.741+0000 7f29ffbcc640 -1 Falling back to public interface 2024-09-10T08:28:16.760 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-10T08:28:16.738+0000 7fad0b026640 -1 Falling back to public interface 2024-09-10T08:28:16.760 INFO:tasks.ceph.osd.1.smithi103.stderr:2024-09-10T08:28:16.753+0000 7fb61fc33640 -1 Falling back to public interface 2024-09-10T08:28:16.761 INFO:tasks.ceph.osd.2.smithi103.stderr:2024-09-10T08:28:16.753+0000 7f1b5cc11640 -1 Falling back to public interface 2024-09-10T08:28:16.761 INFO:tasks.ceph.osd.2.smithi103.stderr:2024-09-10T08:28:16.754+0000 7f1b5b5ab640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2024-09-10T08:28:16.785 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:16.783+0000 7ff5a785c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T08:28:16.786 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-10T08:28:16.783+0000 7f800df27040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T08:28:17.797 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:17.798+0000 7ff548128640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-10T08:28:17.798 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-09-10T08:28:17.798+0000 7ff548128640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-10T08:28:20.577 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-10T08:28:20.577+0000 7fb4a2358640 -1 osd.6 0 log_to_monitors true 2024-09-10T08:28:20.792 INFO:tasks.ceph.osd.2.smithi103.stderr:2024-09-10T08:28:20.793+0000 7f1b5cc11640 -1 osd.2 0 log_to_monitors true 2024-09-10T08:28:20.848 INFO:tasks.ceph.osd.3.smithi103.stderr:2024-09-10T08:28:20.849+0000 7f53c0320640 -1 osd.3 0 log_to_monitors true 2024-09-10T08:28:20.998 INFO:tasks.ceph.osd.0.smithi103.stderr:2024-09-10T08:28:20.998+0000 7f29ffbcc640 -1 osd.0 0 log_to_monitors true 2024-09-10T08:28:21.012 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-10T08:28:21.012+0000 7f0165dc3640 -1 osd.4 0 log_to_monitors true 2024-09-10T08:28:21.064 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-10T08:28:21.064+0000 7f37fb3b0640 -1 osd.5 0 log_to_monitors true 2024-09-10T08:28:21.116 INFO:tasks.ceph.osd.1.smithi103.stderr:2024-09-10T08:28:21.116+0000 7fb61fc33640 -1 osd.1 0 log_to_monitors true 2024-09-10T08:28:21.246 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-10T08:28:21.246+0000 7fad0b026640 -1 osd.7 0 log_to_monitors true 2024-09-10T08:28:22.637 INFO:tasks.ceph.osd.2.smithi103.stderr:2024-09-10T08:28:22.638+0000 7f1b57d6f640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T08:28:22.648 INFO:tasks.ceph.osd.2.smithi103.stderr:2024-09-10T08:28:22.649+0000 7f1b503a1640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:28:22.664 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-10T08:28:22.664+0000 7fb49dac4640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T08:28:22.678 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-10T08:28:22.678+0000 7fb4960f6640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:28:22.784 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T08:28:22.894 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.895+0000 7ff8cd59f640 1 Processor -- start 2024-09-10T08:28:22.894 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.895+0000 7ff8cd59f640 1 -- start start 2024-09-10T08:28:22.899 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.896+0000 7ff8cd59f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff8c8155840 0x7ff8c8155c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.899 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.896+0000 7ff8cd59f640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8c806efd0 con 0x7ff8c8151c80 2024-09-10T08:28:22.899 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.896+0000 7ff8cd59f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8c806f240 con 0x7ff8c8073fa0 2024-09-10T08:28:22.899 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.896+0000 7ff8c6ffd640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff8c8151c80 0x7ff8c8154dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:37586/0 (socket says 172.21.15.103:37586) 2024-09-10T08:28:22.899 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.896+0000 7ff8c6ffd640 1 -- 172.21.15.103:0/256237353 learned_addr learned my addr 172.21.15.103:0/256237353 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:22.899 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.896+0000 7ff8cd59f640 1 -- 172.21.15.103:0/256237353 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff8c81561b0 con 0x7ff8c8155840 2024-09-10T08:28:22.899 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.896+0000 7ff8c5ffb640 1 -- 172.21.15.103:0/256237353 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1589511479 0 0) 0x7ff8c806efd0 con 0x7ff8c8151c80 2024-09-10T08:28:22.899 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.896+0000 7ff8c5ffb640 1 -- 172.21.15.103:0/256237353 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8b4003520 con 0x7ff8c8151c80 2024-09-10T08:28:22.900 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.896+0000 7ff8c77fe640 1 --2- 172.21.15.103:0/256237353 >> v2:172.21.15.154:3300/0 conn(0x7ff8c8155840 0x7ff8c8155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.900 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.896+0000 7ff8c5ffb640 1 -- 172.21.15.103:0/256237353 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1512797506 0 0) 0x7ff8b4003520 con 0x7ff8c8151c80 2024-09-10T08:28:22.900 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.896+0000 7ff8c5ffb640 1 -- 172.21.15.103:0/256237353 >> v2:172.21.15.154:3300/0 conn(0x7ff8c8155840 msgr2=0x7ff8c8155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:22.900 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.896+0000 7ff8c5ffb640 1 --2- 172.21.15.103:0/256237353 >> v2:172.21.15.154:3300/0 conn(0x7ff8c8155840 0x7ff8c8155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.900 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.896+0000 7ff8c5ffb640 1 -- 172.21.15.103:0/256237353 >> v1:172.21.15.154:6789/0 conn(0x7ff8c8073fa0 legacy=0x7ff8c8070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.900 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.896+0000 7ff8c5ffb640 1 -- 172.21.15.103:0/256237353 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c806f520 con 0x7ff8c8151c80 2024-09-10T08:28:22.900 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.896+0000 7ff8c5ffb640 1 -- 172.21.15.103:0/256237353 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7ff8c00019f0 con 0x7ff8c8151c80 2024-09-10T08:28:22.900 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.896+0000 7ff8c5ffb640 1 -- 172.21.15.103:0/256237353 >> v1:172.21.15.103:6789/0 conn(0x7ff8c8151c80 legacy=0x7ff8c8154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.901 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.896+0000 7ff8c5ffb640 1 --2- 172.21.15.103:0/256237353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8b40039b0 0x7ff8b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.901 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.896+0000 7ff8c5ffb640 1 --2- 172.21.15.103:0/256237353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b4004800 0x7ff8b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.901 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.896+0000 7ff8c5ffb640 1 --2- 172.21.15.103:0/256237353 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8b40051c0 0x7ff8b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.901 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.896+0000 7ff8c5ffb640 1 -- 172.21.15.103:0/256237353 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b400c130 con 0x7ff8b4004800 2024-09-10T08:28:22.901 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.896+0000 7ff8c5ffb640 1 -- 172.21.15.103:0/256237353 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b40106f0 con 0x7ff8b40039b0 2024-09-10T08:28:22.901 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.896+0000 7ff8c5ffb640 1 -- 172.21.15.103:0/256237353 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff8b40108f0 con 0x7ff8b40051c0 2024-09-10T08:28:22.901 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.897+0000 7ff8c6ffd640 1 --2- 172.21.15.103:0/256237353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8b40039b0 0x7ff8b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.897+0000 7ff8c67fc640 1 --2- 172.21.15.103:0/256237353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b4004800 0x7ff8b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.897+0000 7ff8c77fe640 1 --2- 172.21.15.103:0/256237353 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8b40051c0 0x7ff8b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.897+0000 7ff8c6ffd640 1 -- 172.21.15.103:0/256237353 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8b40051c0 msgr2=0x7ff8b400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:22.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.897+0000 7ff8c6ffd640 1 --2- 172.21.15.103:0/256237353 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8b40051c0 0x7ff8b400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.897+0000 7ff8c6ffd640 1 -- 172.21.15.103:0/256237353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b4004800 msgr2=0x7ff8b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:22.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.897+0000 7ff8c6ffd640 1 --2- 172.21.15.103:0/256237353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b4004800 0x7ff8b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.897+0000 7ff8c6ffd640 1 -- 172.21.15.103:0/256237353 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b4003520 con 0x7ff8b40039b0 2024-09-10T08:28:22.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.897+0000 7ff8c77fe640 1 --2- 172.21.15.103:0/256237353 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8b40051c0 0x7ff8b400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:22.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.897+0000 7ff8c77fe640 1 -- 172.21.15.103:0/256237353 reap_dead start 2024-09-10T08:28:22.902 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.898+0000 7ff8c6ffd640 1 --2- 172.21.15.103:0/256237353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8b40039b0 0x7ff8b4003dd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff8c000a850 tx=0x7ff8b4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77ec25a0818855b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:22.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.898+0000 7ff8c5ffb640 1 -- 172.21.15.103:0/256237353 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c000a4a0 con 0x7ff8b40039b0 2024-09-10T08:28:22.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.898+0000 7ff8c5ffb640 1 -- 172.21.15.103:0/256237353 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c002f070 con 0x7ff8b40039b0 2024-09-10T08:28:22.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.898+0000 7ff8c5ffb640 1 -- 172.21.15.103:0/256237353 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c002bcb0 con 0x7ff8b40039b0 2024-09-10T08:28:22.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.899+0000 7ff8cd59f640 1 -- 172.21.15.103:0/256237353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8b40039b0 msgr2=0x7ff8b4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.899+0000 7ff8cd59f640 1 --2- 172.21.15.103:0/256237353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8b40039b0 0x7ff8b4003dd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff8c000a850 tx=0x7ff8b4005830 comp rx=0 tx=0).stop 2024-09-10T08:28:22.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.899+0000 7ff8cd59f640 1 -- 172.21.15.103:0/256237353 shutdown_connections 2024-09-10T08:28:22.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.899+0000 7ff8cd59f640 1 --2- 172.21.15.103:0/256237353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8b40039b0 0x7ff8b4003dd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.899+0000 7ff8cd59f640 1 -- 172.21.15.103:0/256237353 >> 172.21.15.103:0/256237353 conn(0x7ff8c80c6a50 msgr2=0x7ff8c80c6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:22.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.899+0000 7ff8cd59f640 1 -- 172.21.15.103:0/256237353 shutdown_connections 2024-09-10T08:28:22.903 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.899+0000 7ff8cd59f640 1 -- 172.21.15.103:0/256237353 wait complete. 2024-09-10T08:28:22.906 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.900+0000 7ff8cd59f640 1 Processor -- start 2024-09-10T08:28:22.906 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.900+0000 7ff8cd59f640 1 -- start start 2024-09-10T08:28:22.906 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.901+0000 7ff8cd59f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8b40039b0 0x7ff8c80c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.907 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.901+0000 7ff8cd59f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8c806de30 0x7ff8c80c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.907 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.901+0000 7ff8cd59f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8c8144330 0x7ff8c80c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.907 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.901+0000 7ff8cd59f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c8070000 con 0x7ff8c8144330 2024-09-10T08:28:22.907 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.901+0000 7ff8cd59f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c806fae0 con 0x7ff8c806de30 2024-09-10T08:28:22.907 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.901+0000 7ff8cd59f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff8c8070180 con 0x7ff8b40039b0 2024-09-10T08:28:22.907 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.901+0000 7ff8c77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8c8144330 0x7ff8c80c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.907 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.901+0000 7ff8c67fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8c806de30 0x7ff8c80c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.907 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.901+0000 7ff8c77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8c8144330 0x7ff8c80c5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41128/0 (socket says 172.21.15.103:41128) 2024-09-10T08:28:22.907 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.901+0000 7ff8c77fe640 1 -- 172.21.15.103:0/1919723365 learned_addr learned my addr 172.21.15.103:0/1919723365 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:22.907 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.901+0000 7ff8c6ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8b40039b0 0x7ff8c80c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.907 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.901+0000 7ff8c77fe640 1 -- 172.21.15.103:0/1919723365 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8b40039b0 msgr2=0x7ff8c80c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.907 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.901+0000 7ff8c77fe640 1 --2- 172.21.15.103:0/1919723365 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8b40039b0 0x7ff8c80c9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.908 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.901+0000 7ff8c77fe640 1 -- 172.21.15.103:0/1919723365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8c806de30 msgr2=0x7ff8c80c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.908 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.901+0000 7ff8c77fe640 1 --2- 172.21.15.103:0/1919723365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8c806de30 0x7ff8c80c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.908 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.901+0000 7ff8c77fe640 1 -- 172.21.15.103:0/1919723365 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c81eae70 con 0x7ff8c8144330 2024-09-10T08:28:22.908 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.901+0000 7ff8c67fc640 1 --2- 172.21.15.103:0/1919723365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8c806de30 0x7ff8c80c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:22.908 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.902+0000 7ff8c77fe640 1 --2- 172.21.15.103:0/1919723365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8c8144330 0x7ff8c80c5a30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80c45f0 tx=0x7ff8b8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:22.908 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.902+0000 7ff8bf7fe640 1 -- 172.21.15.103:0/1919723365 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8003610 con 0x7ff8c8144330 2024-09-10T08:28:22.908 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.902+0000 7ff8bf7fe640 1 -- 172.21.15.103:0/1919723365 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8b801b070 con 0x7ff8c8144330 2024-09-10T08:28:22.908 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.902+0000 7ff8cd59f640 1 -- 172.21.15.103:0/1919723365 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8c806e590 con 0x7ff8c8144330 2024-09-10T08:28:22.908 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.902+0000 7ff8bf7fe640 1 -- 172.21.15.103:0/1919723365 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b80039f0 con 0x7ff8c8144330 2024-09-10T08:28:22.908 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.902+0000 7ff8cd59f640 1 -- 172.21.15.103:0/1919723365 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c81eb130 con 0x7ff8c8144330 2024-09-10T08:28:22.908 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.903+0000 7ff8cd59f640 1 -- 172.21.15.103:0/1919723365 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8c80765b0 con 0x7ff8c8144330 2024-09-10T08:28:22.909 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.903+0000 7ff8bf7fe640 1 -- 172.21.15.103:0/1919723365 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7ff8b8003b90 con 0x7ff8c8144330 2024-09-10T08:28:22.909 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.904+0000 7ff8bf7fe640 1 --2- 172.21.15.103:0/1919723365 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff8a806bdd0 0x7ff8a806e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.909 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.904+0000 7ff8bf7fe640 1 -- 172.21.15.103:0/1919723365 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2791+0+0 (secure 0 0 0) 0x7ff8b808a2a0 con 0x7ff8c8144330 2024-09-10T08:28:22.909 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.904+0000 7ff8c6ffd640 1 --2- 172.21.15.103:0/1919723365 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff8a806bdd0 0x7ff8a806e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.909 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.904+0000 7ff8c6ffd640 1 --2- 172.21.15.103:0/1919723365 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff8a806bdd0 0x7ff8a806e290 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0033000 tx=0x7ff8c0009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:22.909 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:22.909+0000 7ff8bf7fe640 1 -- 172.21.15.103:0/1919723365 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff8c80765b0 con 0x7ff8c8144330 2024-09-10T08:28:23.106 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:23.106+0000 7ff8cd59f640 1 -- 172.21.15.103:0/1919723365 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8c8073d80 con 0x7ff8c8144330 2024-09-10T08:28:23.107 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:23.107+0000 7ff8bf7fe640 1 -- 172.21.15.103:0/1919723365 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+8029 (secure 0 0 0) 0x7ff8b80592d0 con 0x7ff8c8144330 2024-09-10T08:28:23.107 INFO:teuthology.misc.health.smithi103.stdout: 2024-09-10T08:28:23.108 INFO:teuthology.misc.health.smithi103.stdout:{"epoch":13,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","created":"2024-09-10T08:28:12.654957+0000","modified":"2024-09-10T08:28:22.806730+0000","last_up_change":"2024-09-10T08:28:22.806730+0000","last_in_change":"2024-09-10T08:28:14.741133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1abe08f4-0348-435e-9f97-cec00e96992c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"df342e58-1026-4739-82f6-7a216707444c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f7aea2cf-208c-41ed-a0f6-8948d70b9a0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6819","nonce":428484432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6821","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6823","nonce":428484432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6829","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6831","nonce":428484432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6825","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6827","nonce":428484432}]},"public_addr":"172.21.15.103:6819/428484432","cluster_addr":"172.21.15.103:6823/428484432","heartbeat_back_addr":"172.21.15.103:6831/428484432","heartbeat_front_addr":"172.21.15.103:6827/428484432","state":["exists","up"]},{"osd":3,"uuid":"615ef8b0-12a5-4503-96d0-f7ec17dbc792","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"644c5e94-db18-4b83-b5cd-3762ae2647a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f40210bd-f4ca-442e-baac-729ced5a9f21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"eebac31e-aaef-47b0-90d7-4af08f36d7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6801","nonce":345273812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6803","nonce":345273812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6807","nonce":345273812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6805","nonce":345273812}]},"public_addr":"172.21.15.154:6801/345273812","cluster_addr":"172.21.15.154:6803/345273812","heartbeat_back_addr":"172.21.15.154:6807/345273812","heartbeat_front_addr":"172.21.15.154:6805/345273812","state":["exists","up"]},{"osd":7,"uuid":"58406c9a-036f-4618-bfb6-0beddbd71605","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:28:23.109 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:23.109+0000 7ff8cd59f640 1 -- 172.21.15.103:0/1919723365 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff8a806bdd0 msgr2=0x7ff8a806e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:23.109 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:23.109+0000 7ff8cd59f640 1 --2- 172.21.15.103:0/1919723365 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff8a806bdd0 0x7ff8a806e290 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0033000 tx=0x7ff8c0009030 comp rx=0 tx=0).stop 2024-09-10T08:28:23.110 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:23.109+0000 7ff8cd59f640 1 -- 172.21.15.103:0/1919723365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8c8144330 msgr2=0x7ff8c80c5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:23.110 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:23.109+0000 7ff8cd59f640 1 --2- 172.21.15.103:0/1919723365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8c8144330 0x7ff8c80c5a30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80c45f0 tx=0x7ff8b8009f90 comp rx=0 tx=0).stop 2024-09-10T08:28:23.110 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:23.109+0000 7ff8cd59f640 1 -- 172.21.15.103:0/1919723365 shutdown_connections 2024-09-10T08:28:23.110 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:23.109+0000 7ff8cd59f640 1 --2- 172.21.15.103:0/1919723365 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff8a806bdd0 0x7ff8a806e290 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.110 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:23.109+0000 7ff8cd59f640 1 --2- 172.21.15.103:0/1919723365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8c8144330 0x7ff8c80c5a30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.111 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:23.109+0000 7ff8cd59f640 1 --2- 172.21.15.103:0/1919723365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8c806de30 0x7ff8c80c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.111 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:23.109+0000 7ff8cd59f640 1 --2- 172.21.15.103:0/1919723365 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8b40039b0 0x7ff8c80c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.111 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:23.109+0000 7ff8cd59f640 1 -- 172.21.15.103:0/1919723365 >> 172.21.15.103:0/1919723365 conn(0x7ff8c80c6a50 msgr2=0x7ff8c81452d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:23.111 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:23.109+0000 7ff8cd59f640 1 -- 172.21.15.103:0/1919723365 shutdown_connections 2024-09-10T08:28:23.111 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:23.109+0000 7ff8cd59f640 1 -- 172.21.15.103:0/1919723365 wait complete. 2024-09-10T08:28:23.120 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-09-10T08:28:24.433 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-10T08:28:24.433+0000 7fad06792640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T08:28:24.442 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-10T08:28:24.442+0000 7f37f6b1c640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T08:28:24.447 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-10T08:28:24.448+0000 7facfedc4640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:28:24.465 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-10T08:28:24.465+0000 7f37ef14e640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:28:24.472 INFO:tasks.ceph.osd.0.smithi103.stderr:2024-09-10T08:28:24.473+0000 7f29fb338640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T08:28:24.481 INFO:tasks.ceph.osd.3.smithi103.stderr:2024-09-10T08:28:24.482+0000 7f53bba8c640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T08:28:24.486 INFO:tasks.ceph.osd.0.smithi103.stderr:2024-09-10T08:28:24.487+0000 7f29f396a640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:28:24.497 INFO:tasks.ceph.osd.3.smithi103.stderr:2024-09-10T08:28:24.498+0000 7f53b40be640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:28:24.512 INFO:tasks.ceph.osd.1.smithi103.stderr:2024-09-10T08:28:24.513+0000 7fb61b39f640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T08:28:24.526 INFO:tasks.ceph.osd.1.smithi103.stderr:2024-09-10T08:28:24.527+0000 7fb6139d1640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:28:24.564 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-10T08:28:24.564+0000 7f016152f640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T08:28:24.573 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-10T08:28:24.574+0000 7f0159b61640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:28:28.562 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:28:28.565 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:28:29.926 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T08:28:30.029 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.029+0000 7fcb97615640 1 Processor -- start 2024-09-10T08:28:30.029 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.029+0000 7fcb97615640 1 -- start start 2024-09-10T08:28:30.030 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.030+0000 7fcb97615640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb900c8a50 0x7fcb90156e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:30.030 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.030+0000 7fcb97615640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb900c82d0 0x7fcb90159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:30.030 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.030+0000 7fcb97615640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcb90159d80 0x7fcb900cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:30.030 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.030+0000 7fcb97615640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fcb9006c920 con 0x7fcb90159d80 2024-09-10T08:28:30.031 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.030+0000 7fcb97615640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fcb9006c640 con 0x7fcb900c8a50 2024-09-10T08:28:30.031 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.030+0000 7fcb97615640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcb90156360 con 0x7fcb900c82d0 2024-09-10T08:28:30.031 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.031+0000 7fcb95bb2640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcb90159d80 0x7fcb900cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:30.031 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.031+0000 7fcb95bb2640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcb90159d80 0x7fcb900cb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41946/0 (socket says 172.21.15.103:41946) 2024-09-10T08:28:30.031 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.031+0000 7fcb95bb2640 1 -- 172.21.15.103:0/1699038562 learned_addr learned my addr 172.21.15.103:0/1699038562 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:30.031 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.031+0000 7fcb953b1640 1 --2- 172.21.15.103:0/1699038562 >> v2:172.21.15.154:3300/0 conn(0x7fcb900c8a50 0x7fcb90156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:30.031 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.031+0000 7fcb94bb0640 1 --2- 172.21.15.103:0/1699038562 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb900c82d0 0x7fcb90159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:30.031 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.031+0000 7fcb95bb2640 1 -- 172.21.15.103:0/1699038562 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb900c82d0 msgr2=0x7fcb90159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:30.031 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.031+0000 7fcb95bb2640 1 --2- 172.21.15.103:0/1699038562 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb900c82d0 0x7fcb90159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:30.031 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.031+0000 7fcb95bb2640 1 -- 172.21.15.103:0/1699038562 >> v2:172.21.15.154:3300/0 conn(0x7fcb900c8a50 msgr2=0x7fcb90156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:30.031 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.031+0000 7fcb95bb2640 1 --2- 172.21.15.103:0/1699038562 >> v2:172.21.15.154:3300/0 conn(0x7fcb900c8a50 0x7fcb90156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:30.031 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.031+0000 7fcb95bb2640 1 -- 172.21.15.103:0/1699038562 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb90156640 con 0x7fcb90159d80 2024-09-10T08:28:30.033 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.032+0000 7fcb95bb2640 1 --2- 172.21.15.103:0/1699038562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb90159d80 0x7fcb900cb0c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcb900743e0 tx=0x7fcb8802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5a05f4e115efe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:30.033 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.032+0000 7fcb87fff640 1 -- 172.21.15.103:0/1699038562 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb88037070 con 0x7fcb90159d80 2024-09-10T08:28:30.033 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.032+0000 7fcb87fff640 1 -- 172.21.15.103:0/1699038562 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb88032440 con 0x7fcb90159d80 2024-09-10T08:28:30.033 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.032+0000 7fcb87fff640 1 -- 172.21.15.103:0/1699038562 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb88032810 con 0x7fcb90159d80 2024-09-10T08:28:30.033 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.032+0000 7fcb97615640 1 -- 172.21.15.103:0/1699038562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb90159d80 msgr2=0x7fcb900cb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:30.033 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.032+0000 7fcb97615640 1 --2- 172.21.15.103:0/1699038562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb90159d80 0x7fcb900cb0c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcb900743e0 tx=0x7fcb8802a140 comp rx=0 tx=0).stop 2024-09-10T08:28:30.033 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.032+0000 7fcb97615640 1 -- 172.21.15.103:0/1699038562 shutdown_connections 2024-09-10T08:28:30.033 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.032+0000 7fcb97615640 1 --2- 172.21.15.103:0/1699038562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb90159d80 0x7fcb900cb0c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:30.033 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.032+0000 7fcb97615640 1 --2- 172.21.15.103:0/1699038562 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb900c82d0 0x7fcb90159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:30.034 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.032+0000 7fcb97615640 1 --2- 172.21.15.103:0/1699038562 >> v2:172.21.15.154:3300/0 conn(0x7fcb900c8a50 0x7fcb90156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:30.034 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.032+0000 7fcb97615640 1 -- 172.21.15.103:0/1699038562 >> 172.21.15.103:0/1699038562 conn(0x7fcb90067c80 msgr2=0x7fcb900adb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:30.034 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.032+0000 7fcb97615640 1 -- 172.21.15.103:0/1699038562 shutdown_connections 2024-09-10T08:28:30.034 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.032+0000 7fcb97615640 1 -- 172.21.15.103:0/1699038562 wait complete. 2024-09-10T08:28:30.034 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.034+0000 7fcb97615640 1 Processor -- start 2024-09-10T08:28:30.034 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.034+0000 7fcb97615640 1 -- start start 2024-09-10T08:28:30.036 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.034+0000 7fcb97615640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb900c82d0 0x7fcb901484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:30.036 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.034+0000 7fcb97615640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb900c8a50 0x7fcb900c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:30.036 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.034+0000 7fcb97615640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb90159d80 0x7fcb901ecdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:30.036 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.034+0000 7fcb97615640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9006c400 con 0x7fcb900c8a50 2024-09-10T08:28:30.036 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.034+0000 7fcb97615640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9006c280 con 0x7fcb900c82d0 2024-09-10T08:28:30.036 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.034+0000 7fcb97615640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcb900c8e30 con 0x7fcb90159d80 2024-09-10T08:28:30.037 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.034+0000 7fcb94bb0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb900c8a50 0x7fcb900c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:30.037 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.034+0000 7fcb94bb0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb900c8a50 0x7fcb900c4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41950/0 (socket says 172.21.15.103:41950) 2024-09-10T08:28:30.037 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.034+0000 7fcb94bb0640 1 -- 172.21.15.103:0/3448455494 learned_addr learned my addr 172.21.15.103:0/3448455494 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:30.037 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.034+0000 7fcb953b1640 1 --2- 172.21.15.103:0/3448455494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb900c82d0 0x7fcb901484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:30.037 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.035+0000 7fcb95bb2640 1 --2- 172.21.15.103:0/3448455494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb90159d80 0x7fcb901ecdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:30.037 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.035+0000 7fcb94bb0640 1 -- 172.21.15.103:0/3448455494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb90159d80 msgr2=0x7fcb901ecdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:30.037 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.035+0000 7fcb94bb0640 1 --2- 172.21.15.103:0/3448455494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb90159d80 0x7fcb901ecdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:30.037 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.035+0000 7fcb94bb0640 1 -- 172.21.15.103:0/3448455494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb900c82d0 msgr2=0x7fcb901484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:30.037 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.035+0000 7fcb94bb0640 1 --2- 172.21.15.103:0/3448455494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb900c82d0 0x7fcb901484a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:30.037 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.035+0000 7fcb94bb0640 1 -- 172.21.15.103:0/3448455494 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb900b0df0 con 0x7fcb900c8a50 2024-09-10T08:28:30.037 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.035+0000 7fcb94bb0640 1 --2- 172.21.15.103:0/3448455494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb900c8a50 0x7fcb900c4b20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcb8000e840 tx=0x7fcb8000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:30.037 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.035+0000 7fcb85ffb640 1 -- 172.21.15.103:0/3448455494 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb80017070 con 0x7fcb900c8a50 2024-09-10T08:28:30.037 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.035+0000 7fcb85ffb640 1 -- 172.21.15.103:0/3448455494 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb8000c730 con 0x7fcb900c8a50 2024-09-10T08:28:30.038 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.035+0000 7fcb97615640 1 -- 172.21.15.103:0/3448455494 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb900c3860 con 0x7fcb900c8a50 2024-09-10T08:28:30.038 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.035+0000 7fcb85ffb640 1 -- 172.21.15.103:0/3448455494 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8000cb00 con 0x7fcb900c8a50 2024-09-10T08:28:30.038 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.035+0000 7fcb97615640 1 -- 172.21.15.103:0/3448455494 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb900c3e20 con 0x7fcb900c8a50 2024-09-10T08:28:30.038 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.036+0000 7fcb97615640 1 -- 172.21.15.103:0/3448455494 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb9006d240 con 0x7fcb900c8a50 2024-09-10T08:28:30.038 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.037+0000 7fcb85ffb640 1 -- 172.21.15.103:0/3448455494 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb8001a070 con 0x7fcb900c8a50 2024-09-10T08:28:30.040 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.037+0000 7fcb85ffb640 1 --2- 172.21.15.103:0/3448455494 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb7406be30 0x7fcb7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:30.040 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.037+0000 7fcb85ffb640 1 -- 172.21.15.103:0/3448455494 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fcb8008a7d0 con 0x7fcb900c8a50 2024-09-10T08:28:30.040 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.037+0000 7fcb953b1640 1 --2- 172.21.15.103:0/3448455494 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb7406be30 0x7fcb7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:30.040 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.038+0000 7fcb953b1640 1 --2- 172.21.15.103:0/3448455494 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb7406be30 0x7fcb7406e2f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcb90153040 tx=0x7fcb8c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:30.041 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.042+0000 7fcb85ffb640 1 -- 172.21.15.103:0/3448455494 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb900b0df0 con 0x7fcb900c8a50 2024-09-10T08:28:30.208 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.209+0000 7fcb97615640 1 -- 172.21.15.103:0/3448455494 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb90153070 con 0x7fcb900c8a50 2024-09-10T08:28:30.209 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.209+0000 7fcb85ffb640 1 -- 172.21.15.103:0/3448455494 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12944 (secure 0 0 0) 0x7fcb80058f10 con 0x7fcb900c8a50 2024-09-10T08:28:30.209 INFO:teuthology.misc.health.smithi103.stdout: 2024-09-10T08:28:30.209 INFO:teuthology.misc.health.smithi103.stdout:{"epoch":17,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","created":"2024-09-10T08:28:12.654957+0000","modified":"2024-09-10T08:28:27.456960+0000","last_up_change":"2024-09-10T08:28:25.445753+0000","last_in_change":"2024-09-10T08:28:14.741133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:24.821696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1abe08f4-0348-435e-9f97-cec00e96992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6809","nonce":2707863099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6811","nonce":2707863099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6815","nonce":2707863099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6813","nonce":2707863099}]},"public_addr":"172.21.15.103:6809/2707863099","cluster_addr":"172.21.15.103:6811/2707863099","heartbeat_back_addr":"172.21.15.103:6815/2707863099","heartbeat_front_addr":"172.21.15.103:6813/2707863099","state":["exists","up"]},{"osd":1,"uuid":"df342e58-1026-4739-82f6-7a216707444c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6818","nonce":4029892782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6822","nonce":4029892782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6830","nonce":4029892782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6826","nonce":4029892782}]},"public_addr":"172.21.15.103:6818/4029892782","cluster_addr":"172.21.15.103:6822/4029892782","heartbeat_back_addr":"172.21.15.103:6830/4029892782","heartbeat_front_addr":"172.21.15.103:6826/4029892782","state":["exists","up"]},{"osd":2,"uuid":"f7aea2cf-208c-41ed-a0f6-8948d70b9a0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6819","nonce":428484432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6821","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6823","nonce":428484432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6829","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6831","nonce":428484432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6825","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6827","nonce":428484432}]},"public_addr":"172.21.15.103:6819/428484432","cluster_addr":"172.21.15.103:6823/428484432","heartbeat_back_addr":"172.21.15.103:6831/428484432","heartbeat_front_addr":"172.21.15.103:6827/428484432","state":["exists","up"]},{"osd":3,"uuid":"615ef8b0-12a5-4503-96d0-f7ec17dbc792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6801","nonce":3453676282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6803","nonce":3453676282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6807","nonce":3453676282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6805","nonce":3453676282}]},"public_addr":"172.21.15.103:6801/3453676282","cluster_addr":"172.21.15.103:6803/3453676282","heartbeat_back_addr":"172.21.15.103:6807/3453676282","heartbeat_front_addr":"172.21.15.103:6805/3453676282","state":["exists","up"]},{"osd":4,"uuid":"644c5e94-db18-4b83-b5cd-3762ae2647a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6809","nonce":1808157069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6811","nonce":1808157069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6815","nonce":1808157069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6813","nonce":1808157069}]},"public_addr":"172.21.15.154:6809/1808157069","cluster_addr":"172.21.15.154:6811/1808157069","heartbeat_back_addr":"172.21.15.154:6815/1808157069","heartbeat_front_addr":"172.21.15.154:6813/1808157069","state":["exists","up"]},{"osd":5,"uuid":"f40210bd-f4ca-442e-baac-729ced5a9f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6817","nonce":1048015779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6819","nonce":1048015779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6823","nonce":1048015779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6821","nonce":1048015779}]},"public_addr":"172.21.15.154:6817/1048015779","cluster_addr":"172.21.15.154:6819/1048015779","heartbeat_back_addr":"172.21.15.154:6823/1048015779","heartbeat_front_addr":"172.21.15.154:6821/1048015779","state":["exists","up"]},{"osd":6,"uuid":"eebac31e-aaef-47b0-90d7-4af08f36d7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6801","nonce":345273812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6803","nonce":345273812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6807","nonce":345273812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6805","nonce":345273812}]},"public_addr":"172.21.15.154:6801/345273812","cluster_addr":"172.21.15.154:6803/345273812","heartbeat_back_addr":"172.21.15.154:6807/345273812","heartbeat_front_addr":"172.21.15.154:6805/345273812","state":["exists","up"]},{"osd":7,"uuid":"58406c9a-036f-4618-bfb6-0beddbd71605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6825","nonce":3439481239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6827","nonce":3439481239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6831","nonce":3439481239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6829","nonce":3439481239}]},"public_addr":"172.21.15.154:6825/3439481239","cluster_addr":"172.21.15.154:6827/3439481239","heartbeat_back_addr":"172.21.15.154:6831/3439481239","heartbeat_front_addr":"172.21.15.154:6829/3439481239","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.032718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.126448+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.781158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.808718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.050591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.038245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.586989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.223326+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:28:30.211 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.211+0000 7fcb97615640 1 -- 172.21.15.103:0/3448455494 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb7406be30 msgr2=0x7fcb7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:30.211 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.211+0000 7fcb97615640 1 --2- 172.21.15.103:0/3448455494 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb7406be30 0x7fcb7406e2f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcb90153040 tx=0x7fcb8c00b040 comp rx=0 tx=0).stop 2024-09-10T08:28:30.211 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.211+0000 7fcb97615640 1 -- 172.21.15.103:0/3448455494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb900c8a50 msgr2=0x7fcb900c4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:30.211 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.211+0000 7fcb97615640 1 --2- 172.21.15.103:0/3448455494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb900c8a50 0x7fcb900c4b20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcb8000e840 tx=0x7fcb8000ed00 comp rx=0 tx=0).stop 2024-09-10T08:28:30.212 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.212+0000 7fcb97615640 1 -- 172.21.15.103:0/3448455494 shutdown_connections 2024-09-10T08:28:30.212 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.212+0000 7fcb97615640 1 --2- 172.21.15.103:0/3448455494 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb7406be30 0x7fcb7406e2f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:30.212 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.212+0000 7fcb97615640 1 --2- 172.21.15.103:0/3448455494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb90159d80 0x7fcb901ecdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:30.212 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.212+0000 7fcb97615640 1 --2- 172.21.15.103:0/3448455494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb900c8a50 0x7fcb900c4b20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:30.212 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.212+0000 7fcb97615640 1 --2- 172.21.15.103:0/3448455494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb900c82d0 0x7fcb901484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:30.212 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.212+0000 7fcb97615640 1 -- 172.21.15.103:0/3448455494 >> 172.21.15.103:0/3448455494 conn(0x7fcb90067c80 msgr2=0x7fcb90157640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:30.212 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.212+0000 7fcb97615640 1 -- 172.21.15.103:0/3448455494 shutdown_connections 2024-09-10T08:28:30.212 INFO:teuthology.misc.health.smithi103.stderr:2024-09-10T08:28:30.212+0000 7fcb97615640 1 -- 172.21.15.103:0/3448455494 wait complete. 2024-09-10T08:28:30.221 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-10T08:28:30.221 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-10T08:28:30.221 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T08:28:30.221 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T08:28:30.224 INFO:tasks.ceph.mds.a:Started 2024-09-10T08:28:30.224 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T08:28:30.224 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T08:28:30.226 INFO:tasks.ceph.mds.c:Started 2024-09-10T08:28:30.226 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T08:28:30.226 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T08:28:30.229 INFO:tasks.ceph.mds.b:Started 2024-09-10T08:28:30.229 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T08:28:30.229 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T08:28:30.231 INFO:tasks.ceph.mds.d:Started 2024-09-10T08:28:30.232 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-10T08:28:30.232 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:28:30.298 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2024-09-10T08:28:30.298 INFO:tasks.ceph.mds.c.smithi103.stdout:starting mds.c at 2024-09-10T08:28:30.298 INFO:tasks.ceph.mds.c.smithi103.stderr:2024-09-10T08:28:30.299+0000 7fb9ffe96640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-10T08:28:30.315 INFO:tasks.ceph.mds.d.smithi154.stdout:starting mds.d at 2024-09-10T08:28:30.316 INFO:tasks.ceph.mds.b.smithi154.stdout:starting mds.b at 2024-09-10T08:28:30.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.336+0000 7f74df01e640 1 Processor -- start 2024-09-10T08:28:30.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.336+0000 7f74df01e640 1 -- start start 2024-09-10T08:28:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.337+0000 7f74df01e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74d8150480 0x7f74d80c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.337+0000 7f74df01e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f74d806c650 0x7f74d80c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.337+0000 7f74df01e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74d815a7c0 con 0x7f74d80c9c80 2024-09-10T08:28:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.337+0000 7f74df01e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f74d806c240 con 0x7f74d806c650 2024-09-10T08:28:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.337+0000 7f74df01e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f74d815a330 con 0x7f74d8150480 2024-09-10T08:28:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.337+0000 7f74d7fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f74d806c650 0x7f74d80c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.337+0000 7f74d7fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f74d806c650 0x7f74d80c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41988/0 (socket says 172.21.15.103:41988) 2024-09-10T08:28:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.337+0000 7f74d7fff640 1 -- 172.21.15.103:0/997232530 learned_addr learned my addr 172.21.15.103:0/997232530 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.337+0000 7f74dcdba640 1 --2- 172.21.15.103:0/997232530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74d8150480 0x7f74d80c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.337+0000 7f74d7fff640 1 -- 172.21.15.103:0/997232530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74d8150480 msgr2=0x7f74d80c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.337+0000 7f74d7fff640 1 --2- 172.21.15.103:0/997232530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74d8150480 0x7f74d80c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.337+0000 7f74d7fff640 1 -- 172.21.15.103:0/997232530 >> v1:172.21.15.154:6789/0 conn(0x7f74d80c9c80 legacy=0x7f74d80ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:30.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.337+0000 7f74d7fff640 1 -- 172.21.15.103:0/997232530 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d8159a00 con 0x7f74d806c650 2024-09-10T08:28:30.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.338+0000 7f74d7fff640 1 --2- 172.21.15.103:0/997232530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d806c650 0x7f74d80c7fd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009870 tx=0x7f74c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49a5a6570e37c68 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:30.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.338+0000 7f74d77fe640 1 -- 172.21.15.103:0/997232530 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c4037070 con 0x7f74d806c650 2024-09-10T08:28:30.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.338+0000 7f74d77fe640 1 -- 172.21.15.103:0/997232530 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74c4032440 con 0x7f74d806c650 2024-09-10T08:28:30.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.338+0000 7f74d77fe640 1 -- 172.21.15.103:0/997232530 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c4032810 con 0x7f74d806c650 2024-09-10T08:28:30.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.339+0000 7f74df01e640 1 -- 172.21.15.103:0/997232530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d806c650 msgr2=0x7f74d80c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:30.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.339+0000 7f74df01e640 1 --2- 172.21.15.103:0/997232530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d806c650 0x7f74d80c7fd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009870 tx=0x7f74c402a270 comp rx=0 tx=0).stop 2024-09-10T08:28:30.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.339+0000 7f74df01e640 1 -- 172.21.15.103:0/997232530 shutdown_connections 2024-09-10T08:28:30.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.339+0000 7f74df01e640 1 --2- 172.21.15.103:0/997232530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d806c650 0x7f74d80c7fd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:30.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.339+0000 7f74df01e640 1 --2- 172.21.15.103:0/997232530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74d8150480 0x7f74d80c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:30.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.339+0000 7f74df01e640 1 -- 172.21.15.103:0/997232530 >> 172.21.15.103:0/997232530 conn(0x7f74d8068030 msgr2=0x7f74d8073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:30.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.339+0000 7f74df01e640 1 -- 172.21.15.103:0/997232530 shutdown_connections 2024-09-10T08:28:30.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.339+0000 7f74df01e640 1 -- 172.21.15.103:0/997232530 wait complete. 2024-09-10T08:28:30.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.340+0000 7f74df01e640 1 Processor -- start 2024-09-10T08:28:30.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.340+0000 7f74df01e640 1 -- start start 2024-09-10T08:28:30.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.341+0000 7f74df01e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74d806c650 0x7f74d81594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:30.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.341+0000 7f74df01e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74d80c9c80 0x7f74d8152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:30.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.341+0000 7f74df01e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d8150480 0x7f74d8150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:30.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.341+0000 7f74df01e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f74d806d270 con 0x7f74d8150480 2024-09-10T08:28:30.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.341+0000 7f74df01e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f74d8159fc0 con 0x7f74d80c9c80 2024-09-10T08:28:30.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.341+0000 7f74df01e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f74d8156270 con 0x7f74d806c650 2024-09-10T08:28:30.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.341+0000 7f74dd5bb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d8150480 0x7f74d8150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:30.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.341+0000 7f74dd5bb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d8150480 0x7f74d8150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41992/0 (socket says 172.21.15.103:41992) 2024-09-10T08:28:30.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.341+0000 7f74dd5bb640 1 -- 172.21.15.103:0/3436803213 learned_addr learned my addr 172.21.15.103:0/3436803213 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:30.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.341+0000 7f74d7fff640 1 --2- 172.21.15.103:0/3436803213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74d80c9c80 0x7f74d8152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:30.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.341+0000 7f74dcdba640 1 --2- 172.21.15.103:0/3436803213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74d806c650 0x7f74d81594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:30.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.341+0000 7f74dd5bb640 1 -- 172.21.15.103:0/3436803213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74d806c650 msgr2=0x7f74d81594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:30.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.341+0000 7f74dd5bb640 1 --2- 172.21.15.103:0/3436803213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74d806c650 0x7f74d81594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:30.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.341+0000 7f74dd5bb640 1 -- 172.21.15.103:0/3436803213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74d80c9c80 msgr2=0x7f74d8152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:30.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.341+0000 7f74dd5bb640 1 --2- 172.21.15.103:0/3436803213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74d80c9c80 0x7f74d8152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:30.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.341+0000 7f74dd5bb640 1 -- 172.21.15.103:0/3436803213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d8153570 con 0x7f74d8150480 2024-09-10T08:28:30.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.341+0000 7f74dd5bb640 1 --2- 172.21.15.103:0/3436803213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d8150480 0x7f74d8150860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f74d000c730 tx=0x7f74d000cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.341+0000 7f74d57fa640 1 -- 172.21.15.103:0/3436803213 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d0016020 con 0x7f74d8150480 2024-09-10T08:28:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.341+0000 7f74d57fa640 1 -- 172.21.15.103:0/3436803213 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74d0006d50 con 0x7f74d8150480 2024-09-10T08:28:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.341+0000 7f74df01e640 1 -- 172.21.15.103:0/3436803213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74d81ecb90 con 0x7f74d8150480 2024-09-10T08:28:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.341+0000 7f74d57fa640 1 -- 172.21.15.103:0/3436803213 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d0003bb0 con 0x7f74d8150480 2024-09-10T08:28:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.341+0000 7f74df01e640 1 -- 172.21.15.103:0/3436803213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74d80cc3a0 con 0x7f74d8150480 2024-09-10T08:28:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.342+0000 7f74df01e640 1 -- 172.21.15.103:0/3436803213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74d80ca130 con 0x7f74d8150480 2024-09-10T08:28:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.343+0000 7f74d57fa640 1 -- 172.21.15.103:0/3436803213 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f74d00050d0 con 0x7f74d8150480 2024-09-10T08:28:30.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.343+0000 7f74d57fa640 1 --2- 172.21.15.103:0/3436803213 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f74bc06be30 0x7f74bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.343+0000 7f74d57fa640 1 -- 172.21.15.103:0/3436803213 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f74d008a520 con 0x7f74d8150480 2024-09-10T08:28:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.343+0000 7f74dcdba640 1 --2- 172.21.15.103:0/3436803213 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f74bc06be30 0x7f74bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:30.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.346+0000 7f74dcdba640 1 --2- 172.21.15.103:0/3436803213 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f74bc06be30 0x7f74bc06e2f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f74d8155470 tx=0x7f74cc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:30.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.348+0000 7f74d57fa640 1 -- 172.21.15.103:0/3436803213 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f74d0020020 con 0x7f74d8150480 2024-09-10T08:28:30.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.548+0000 7f74df01e640 1 -- 172.21.15.103:0/3436803213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74d8159210 con 0x7f74d8150480 2024-09-10T08:28:30.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.548+0000 7f74d57fa640 1 -- 172.21.15.103:0/3436803213 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7f74d0058c60 con 0x7f74d8150480 2024-09-10T08:28:30.548 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:30.548 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":2,"btime":"2024-09-10T08:28:30:303712+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2250136134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2250136134},{"type":"v1","addr":"172.21.15.103:6836","nonce":2250136134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T08:28:30.548 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 2 2024-09-10T08:28:30.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.550+0000 7f74df01e640 1 -- 172.21.15.103:0/3436803213 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f74bc06be30 msgr2=0x7f74bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:30.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.550+0000 7f74df01e640 1 --2- 172.21.15.103:0/3436803213 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f74bc06be30 0x7f74bc06e2f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f74d8155470 tx=0x7f74cc009190 comp rx=0 tx=0).stop 2024-09-10T08:28:30.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.550+0000 7f74df01e640 1 -- 172.21.15.103:0/3436803213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d8150480 msgr2=0x7f74d8150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:30.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.550+0000 7f74df01e640 1 --2- 172.21.15.103:0/3436803213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d8150480 0x7f74d8150860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f74d000c730 tx=0x7f74d000cb30 comp rx=0 tx=0).stop 2024-09-10T08:28:30.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.550+0000 7f74df01e640 1 -- 172.21.15.103:0/3436803213 shutdown_connections 2024-09-10T08:28:30.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.550+0000 7f74df01e640 1 --2- 172.21.15.103:0/3436803213 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f74bc06be30 0x7f74bc06e2f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:30.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.550+0000 7f74df01e640 1 --2- 172.21.15.103:0/3436803213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74d8150480 0x7f74d8150860 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:30.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.550+0000 7f74df01e640 1 --2- 172.21.15.103:0/3436803213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74d80c9c80 0x7f74d8152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:30.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.550+0000 7f74df01e640 1 --2- 172.21.15.103:0/3436803213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74d806c650 0x7f74d81594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:30.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.550+0000 7f74df01e640 1 -- 172.21.15.103:0/3436803213 >> 172.21.15.103:0/3436803213 conn(0x7f74d8068030 msgr2=0x7f74d8154850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:30.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.550+0000 7f74df01e640 1 -- 172.21.15.103:0/3436803213 shutdown_connections 2024-09-10T08:28:30.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:30.550+0000 7f74df01e640 1 -- 172.21.15.103:0/3436803213 wait complete. 2024-09-10T08:28:32.561 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:28:32.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.673+0000 7fb7f4a37640 1 Processor -- start 2024-09-10T08:28:32.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.673+0000 7fb7f4a37640 1 -- start start 2024-09-10T08:28:32.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.674+0000 7fb7f4a37640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7f00ca390 0x7fb7f0161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:32.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.674+0000 7fb7f4a37640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7f015a7c0 con 0x7fb7f0150480 2024-09-10T08:28:32.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.674+0000 7fb7f4a37640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7f0159a00 con 0x7fb7f006c650 2024-09-10T08:28:32.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.674+0000 7fb7f4a37640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb7f006c240 con 0x7fb7f00ca390 2024-09-10T08:28:32.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.674+0000 7fb7ee59c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb7f0150480 0x7fb7f00c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:55106/0 (socket says 172.21.15.103:55106) 2024-09-10T08:28:32.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.674+0000 7fb7ee59c640 1 -- 172.21.15.103:0/1705927928 learned_addr learned my addr 172.21.15.103:0/1705927928 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:32.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.674+0000 7fb7eed9d640 1 --2- 172.21.15.103:0/1705927928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7f00ca390 0x7fb7f0161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:32.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.674+0000 7fb7edd9b640 1 -- 172.21.15.103:0/1705927928 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3875467056 0 0) 0x7fb7f015a7c0 con 0x7fb7f0150480 2024-09-10T08:28:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.674+0000 7fb7edd9b640 1 -- 172.21.15.103:0/1705927928 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7dc003520 con 0x7fb7f0150480 2024-09-10T08:28:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.674+0000 7fb7edd9b640 1 -- 172.21.15.103:0/1705927928 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4220672386 0 0) 0x7fb7dc003520 con 0x7fb7f0150480 2024-09-10T08:28:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.674+0000 7fb7edd9b640 1 -- 172.21.15.103:0/1705927928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7f00ca390 msgr2=0x7fb7f0161c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.674+0000 7fb7edd9b640 1 --2- 172.21.15.103:0/1705927928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7f00ca390 0x7fb7f0161c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.674+0000 7fb7edd9b640 1 -- 172.21.15.103:0/1705927928 >> v1:172.21.15.154:6789/0 conn(0x7fb7f006c650 legacy=0x7fb7f00c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.674+0000 7fb7edd9b640 1 -- 172.21.15.103:0/1705927928 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f0159ce0 con 0x7fb7f0150480 2024-09-10T08:28:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.674+0000 7fb7edd9b640 1 -- 172.21.15.103:0/1705927928 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7fb7e0001670 con 0x7fb7f0150480 2024-09-10T08:28:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.675+0000 7fb7edd9b640 1 -- 172.21.15.103:0/1705927928 >> v1:172.21.15.103:6789/0 conn(0x7fb7f0150480 legacy=0x7fb7f00c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.675+0000 7fb7edd9b640 1 --2- 172.21.15.103:0/1705927928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7dc0039e0 0x7fb7dc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.675+0000 7fb7edd9b640 1 --2- 172.21.15.103:0/1705927928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7dc004390 0x7fb7dc004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.675+0000 7fb7edd9b640 1 --2- 172.21.15.103:0/1705927928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7f00ca390 0x7fb7dc0050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.675+0000 7fb7edd9b640 1 -- 172.21.15.103:0/1705927928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc00b9c0 con 0x7fb7dc0039e0 2024-09-10T08:28:32.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.675+0000 7fb7edd9b640 1 -- 172.21.15.103:0/1705927928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc00bb40 con 0x7fb7dc004390 2024-09-10T08:28:32.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.675+0000 7fb7edd9b640 1 -- 172.21.15.103:0/1705927928 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb7dc00bd40 con 0x7fb7f00ca390 2024-09-10T08:28:32.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.675+0000 7fb7ee59c640 1 --2- 172.21.15.103:0/1705927928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7dc0039e0 0x7fb7dc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:32.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.675+0000 7fb7e7fff640 1 --2- 172.21.15.103:0/1705927928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7dc004390 0x7fb7dc004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:32.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.675+0000 7fb7eed9d640 1 --2- 172.21.15.103:0/1705927928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7f00ca390 0x7fb7dc0050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:32.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.675+0000 7fb7ee59c640 1 -- 172.21.15.103:0/1705927928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7f00ca390 msgr2=0x7fb7dc0050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:32.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.675+0000 7fb7ee59c640 1 --2- 172.21.15.103:0/1705927928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7f00ca390 0x7fb7dc0050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:32.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.675+0000 7fb7ee59c640 1 -- 172.21.15.103:0/1705927928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7dc004390 msgr2=0x7fb7dc004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:32.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.675+0000 7fb7ee59c640 1 --2- 172.21.15.103:0/1705927928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7dc004390 0x7fb7dc004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:32.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.675+0000 7fb7ee59c640 1 -- 172.21.15.103:0/1705927928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7dc003520 con 0x7fb7dc0039e0 2024-09-10T08:28:32.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.676+0000 7fb7ee59c640 1 --2- 172.21.15.103:0/1705927928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7dc0039e0 0x7fb7dc003dc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000c190 tx=0x7fb7dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41ac2c7816bce39 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:32.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.676+0000 7fb7edd9b640 1 -- 172.21.15.103:0/1705927928 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0007cc0 con 0x7fb7dc0039e0 2024-09-10T08:28:32.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.676+0000 7fb7edd9b640 1 -- 172.21.15.103:0/1705927928 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e0005ad0 con 0x7fb7dc0039e0 2024-09-10T08:28:32.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.676+0000 7fb7edd9b640 1 -- 172.21.15.103:0/1705927928 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0007070 con 0x7fb7dc0039e0 2024-09-10T08:28:32.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.676+0000 7fb7f4a37640 1 -- 172.21.15.103:0/1705927928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7dc0039e0 msgr2=0x7fb7dc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:32.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.676+0000 7fb7f4a37640 1 --2- 172.21.15.103:0/1705927928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7dc0039e0 0x7fb7dc003dc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000c190 tx=0x7fb7dc005830 comp rx=0 tx=0).stop 2024-09-10T08:28:32.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.676+0000 7fb7eed9d640 1 -- 172.21.15.103:0/1705927928 reap_dead start 2024-09-10T08:28:32.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.676+0000 7fb7f4a37640 1 -- 172.21.15.103:0/1705927928 shutdown_connections 2024-09-10T08:28:32.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.676+0000 7fb7f4a37640 1 -- 172.21.15.103:0/1705927928 >> 172.21.15.103:0/1705927928 conn(0x7fb7f0068030 msgr2=0x7fb7f0073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:32.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.676+0000 7fb7f4a37640 1 -- 172.21.15.103:0/1705927928 shutdown_connections 2024-09-10T08:28:32.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.677+0000 7fb7f4a37640 1 -- 172.21.15.103:0/1705927928 wait complete. 2024-09-10T08:28:32.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.678+0000 7fb7f4a37640 1 Processor -- start 2024-09-10T08:28:32.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.678+0000 7fb7f4a37640 1 -- start start 2024-09-10T08:28:32.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.678+0000 7fb7f4a37640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7dc0039e0 0x7fb7f00c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:32.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.678+0000 7fb7f4a37640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f014fdc0 0x7fb7f0152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:32.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.678+0000 7fb7f4a37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7f0152eb0 0x7fb7f00c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:32.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.678+0000 7fb7f4a37640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f006d270 con 0x7fb7f014fdc0 2024-09-10T08:28:32.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.679+0000 7fb7f4a37640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f015a330 con 0x7fb7f0152eb0 2024-09-10T08:28:32.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.679+0000 7fb7f4a37640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb7f00c81a0 con 0x7fb7dc0039e0 2024-09-10T08:28:32.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.679+0000 7fb7e7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f014fdc0 0x7fb7f0152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:32.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.679+0000 7fb7e7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f014fdc0 0x7fb7f0152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42004/0 (socket says 172.21.15.103:42004) 2024-09-10T08:28:32.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.679+0000 7fb7e7fff640 1 -- 172.21.15.103:0/261761557 learned_addr learned my addr 172.21.15.103:0/261761557 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:32.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.679+0000 7fb7ee59c640 1 --2- 172.21.15.103:0/261761557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7dc0039e0 0x7fb7f00c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:32.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.679+0000 7fb7eed9d640 1 --2- 172.21.15.103:0/261761557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7f0152eb0 0x7fb7f00c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:32.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.679+0000 7fb7e7fff640 1 -- 172.21.15.103:0/261761557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7dc0039e0 msgr2=0x7fb7f00c2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:32.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.679+0000 7fb7e7fff640 1 --2- 172.21.15.103:0/261761557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7dc0039e0 0x7fb7f00c2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:32.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.679+0000 7fb7e7fff640 1 -- 172.21.15.103:0/261761557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7f0152eb0 msgr2=0x7fb7f00c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:32.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.679+0000 7fb7e7fff640 1 --2- 172.21.15.103:0/261761557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7f0152eb0 0x7fb7f00c0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:32.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.679+0000 7fb7e7fff640 1 -- 172.21.15.103:0/261761557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f01539a0 con 0x7fb7f014fdc0 2024-09-10T08:28:32.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.679+0000 7fb7eed9d640 1 --2- 172.21.15.103:0/261761557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7f0152eb0 0x7fb7f00c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:32.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.679+0000 7fb7e7fff640 1 --2- 172.21.15.103:0/261761557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f014fdc0 0x7fb7f0152970 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800f870 tx=0x7fb7d800fd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:32.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.679+0000 7fb7e6ffd640 1 -- 172.21.15.103:0/261761557 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d801a070 con 0x7fb7f014fdc0 2024-09-10T08:28:32.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.679+0000 7fb7e6ffd640 1 -- 172.21.15.103:0/261761557 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7d8005320 con 0x7fb7f014fdc0 2024-09-10T08:28:32.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.679+0000 7fb7f4a37640 1 -- 172.21.15.103:0/261761557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7f0153c80 con 0x7fb7f014fdc0 2024-09-10T08:28:32.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.679+0000 7fb7e6ffd640 1 -- 172.21.15.103:0/261761557 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8007270 con 0x7fb7f014fdc0 2024-09-10T08:28:32.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.679+0000 7fb7f4a37640 1 -- 172.21.15.103:0/261761557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7f00c33f0 con 0x7fb7f014fdc0 2024-09-10T08:28:32.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.680+0000 7fb7f4a37640 1 -- 172.21.15.103:0/261761557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7f0159a00 con 0x7fb7f014fdc0 2024-09-10T08:28:32.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.681+0000 7fb7e6ffd640 1 -- 172.21.15.103:0/261761557 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7d801d070 con 0x7fb7f014fdc0 2024-09-10T08:28:32.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.681+0000 7fb7e6ffd640 1 --2- 172.21.15.103:0/261761557 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb7d006be60 0x7fb7d006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:32.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.681+0000 7fb7e6ffd640 1 -- 172.21.15.103:0/261761557 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fb7d808a280 con 0x7fb7f014fdc0 2024-09-10T08:28:32.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.681+0000 7fb7ee59c640 1 --2- 172.21.15.103:0/261761557 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb7d006be60 0x7fb7d006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:32.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.682+0000 7fb7ee59c640 1 --2- 172.21.15.103:0/261761557 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb7d006be60 0x7fb7d006e320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000c190 tx=0x7fb7e002d000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:32.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.686+0000 7fb7e6ffd640 1 -- 172.21.15.103:0/261761557 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb7d8059010 con 0x7fb7f014fdc0 2024-09-10T08:28:32.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.888+0000 7fb7f4a37640 1 -- 172.21.15.103:0/261761557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7f0153e50 con 0x7fb7f014fdc0 2024-09-10T08:28:32.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.888+0000 7fb7e6ffd640 1 -- 172.21.15.103:0/261761557 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3918 (secure 0 0 0) 0x7fb7d8058910 con 0x7fb7f014fdc0 2024-09-10T08:28:32.888 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:32.888 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":3,"btime":"2024-09-10T08:28:31:305090+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3378269214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3378269214},{"type":"v1","addr":"172.21.15.154:6833","nonce":3378269214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2141115327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2141115327},{"type":"v1","addr":"172.21.15.154:6835","nonce":2141115327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2250136134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2250136134},{"type":"v1","addr":"172.21.15.103:6836","nonce":2250136134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3032037784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":3032037784},{"type":"v1","addr":"172.21.15.103:6837","nonce":3032037784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T08:28:32.888 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 3 2024-09-10T08:28:32.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.891+0000 7fb7f4a37640 1 -- 172.21.15.103:0/261761557 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb7d006be60 msgr2=0x7fb7d006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:32.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.891+0000 7fb7f4a37640 1 --2- 172.21.15.103:0/261761557 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb7d006be60 0x7fb7d006e320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000c190 tx=0x7fb7e002d000 comp rx=0 tx=0).stop 2024-09-10T08:28:32.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.891+0000 7fb7f4a37640 1 -- 172.21.15.103:0/261761557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f014fdc0 msgr2=0x7fb7f0152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:32.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.891+0000 7fb7f4a37640 1 --2- 172.21.15.103:0/261761557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f014fdc0 0x7fb7f0152970 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800f870 tx=0x7fb7d800fd30 comp rx=0 tx=0).stop 2024-09-10T08:28:32.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.891+0000 7fb7f4a37640 1 -- 172.21.15.103:0/261761557 shutdown_connections 2024-09-10T08:28:32.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.891+0000 7fb7f4a37640 1 --2- 172.21.15.103:0/261761557 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb7d006be60 0x7fb7d006e320 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:32.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.891+0000 7fb7f4a37640 1 --2- 172.21.15.103:0/261761557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7f0152eb0 0x7fb7f00c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:32.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.891+0000 7fb7f4a37640 1 --2- 172.21.15.103:0/261761557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f014fdc0 0x7fb7f0152970 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:32.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.891+0000 7fb7f4a37640 1 --2- 172.21.15.103:0/261761557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7dc0039e0 0x7fb7f00c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:32.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.891+0000 7fb7f4a37640 1 -- 172.21.15.103:0/261761557 >> 172.21.15.103:0/261761557 conn(0x7fb7f0068030 msgr2=0x7fb7f00ca7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:32.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.891+0000 7fb7f4a37640 1 -- 172.21.15.103:0/261761557 shutdown_connections 2024-09-10T08:28:32.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:32.891+0000 7fb7f4a37640 1 -- 172.21.15.103:0/261761557 wait complete. 2024-09-10T08:28:32.901 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T08:28:32.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.000+0000 7fbd97f3b640 1 Processor -- start 2024-09-10T08:28:32.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.000+0000 7fbd97f3b640 1 -- start start 2024-09-10T08:28:33.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.001+0000 7fbd97f3b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd90150aa0 0x7fbd90153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:33.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.001+0000 7fbd97f3b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbd900bda70 0x7fbd900bf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:33.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.001+0000 7fbd97f3b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd900c8290 con 0x7fbd900bf8f0 2024-09-10T08:28:33.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.001+0000 7fbd97f3b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fbd90074100 con 0x7fbd900bda70 2024-09-10T08:28:33.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.001+0000 7fbd97f3b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fbd900c8570 con 0x7fbd90150aa0 2024-09-10T08:28:33.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.001+0000 7fbd964d8640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbd900bf8f0 0x7fbd900c5090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:55116/0 (socket says 172.21.15.103:55116) 2024-09-10T08:28:33.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.001+0000 7fbd964d8640 1 -- 172.21.15.103:0/3105759384 learned_addr learned my addr 172.21.15.103:0/3105759384 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:33.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.001+0000 7fbd95cd7640 1 --2- 172.21.15.103:0/3105759384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd90150aa0 0x7fbd90153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:33.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.001+0000 7fbd954d6640 1 --2- 172.21.15.103:0/3105759384 >> v2:172.21.15.154:3300/0 conn(0x7fbd900bda70 0x7fbd900bf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:33.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.001+0000 7fbd94cd5640 1 -- 172.21.15.103:0/3105759384 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1783578944 0 0) 0x7fbd900c8290 con 0x7fbd900bf8f0 2024-09-10T08:28:33.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.001+0000 7fbd94cd5640 1 -- 172.21.15.103:0/3105759384 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd7c003520 con 0x7fbd900bf8f0 2024-09-10T08:28:33.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.001+0000 7fbd954d6640 1 -- 172.21.15.103:0/3105759384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd90150aa0 msgr2=0x7fbd90153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:33.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.001+0000 7fbd954d6640 1 --2- 172.21.15.103:0/3105759384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd90150aa0 0x7fbd90153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.001+0000 7fbd954d6640 1 -- 172.21.15.103:0/3105759384 >> v1:172.21.15.103:6789/0 conn(0x7fbd900bf8f0 legacy=0x7fbd900c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:33.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.001+0000 7fbd954d6640 1 -- 172.21.15.103:0/3105759384 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd90074350 con 0x7fbd900bda70 2024-09-10T08:28:33.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.001+0000 7fbd95cd7640 1 --2- 172.21.15.103:0/3105759384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd90150aa0 0x7fbd90153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:33.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.002+0000 7fbd954d6640 1 --2- 172.21.15.103:0/3105759384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd900bda70 0x7fbd900bf3b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbd800097a0 tx=0x7fbd8002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71ecf7f9b16617b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:33.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.002+0000 7fbd94cd5640 1 -- 172.21.15.103:0/3105759384 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd80037070 con 0x7fbd900bda70 2024-09-10T08:28:33.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.002+0000 7fbd94cd5640 1 -- 172.21.15.103:0/3105759384 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8002ae50 con 0x7fbd900bda70 2024-09-10T08:28:33.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.002+0000 7fbd94cd5640 1 -- 172.21.15.103:0/3105759384 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd80032640 con 0x7fbd900bda70 2024-09-10T08:28:33.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.003+0000 7fbd97f3b640 1 -- 172.21.15.103:0/3105759384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd900bda70 msgr2=0x7fbd900bf3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:33.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.003+0000 7fbd97f3b640 1 --2- 172.21.15.103:0/3105759384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd900bda70 0x7fbd900bf3b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbd800097a0 tx=0x7fbd8002a100 comp rx=0 tx=0).stop 2024-09-10T08:28:33.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.003+0000 7fbd97f3b640 1 -- 172.21.15.103:0/3105759384 shutdown_connections 2024-09-10T08:28:33.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.003+0000 7fbd97f3b640 1 --2- 172.21.15.103:0/3105759384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd900bda70 0x7fbd900bf3b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.003+0000 7fbd97f3b640 1 --2- 172.21.15.103:0/3105759384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd90150aa0 0x7fbd90153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.003+0000 7fbd97f3b640 1 -- 172.21.15.103:0/3105759384 >> 172.21.15.103:0/3105759384 conn(0x7fbd900c8a50 msgr2=0x7fbd900c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.003+0000 7fbd97f3b640 1 -- 172.21.15.103:0/3105759384 shutdown_connections 2024-09-10T08:28:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.003+0000 7fbd97f3b640 1 -- 172.21.15.103:0/3105759384 wait complete. 2024-09-10T08:28:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.004+0000 7fbd97f3b640 1 Processor -- start 2024-09-10T08:28:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.004+0000 7fbd97f3b640 1 -- start start 2024-09-10T08:28:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.004+0000 7fbd97f3b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd900bda70 0x7fbd900aae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.004+0000 7fbd97f3b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd900bf8f0 0x7fbd900c2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.004+0000 7fbd97f3b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd90150aa0 0x7fbd900c2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.004+0000 7fbd97f3b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbd900c57a0 con 0x7fbd90150aa0 2024-09-10T08:28:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.004+0000 7fbd97f3b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbd90150e80 con 0x7fbd900bda70 2024-09-10T08:28:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.004+0000 7fbd97f3b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fbd900c5920 con 0x7fbd900bf8f0 2024-09-10T08:28:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.005+0000 7fbd964d8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd90150aa0 0x7fbd900c2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.005+0000 7fbd964d8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd90150aa0 0x7fbd900c2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42018/0 (socket says 172.21.15.103:42018) 2024-09-10T08:28:33.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.005+0000 7fbd964d8640 1 -- 172.21.15.103:0/3738236372 learned_addr learned my addr 172.21.15.103:0/3738236372 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:33.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.005+0000 7fbd954d6640 1 --2- 172.21.15.103:0/3738236372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd900bf8f0 0x7fbd900c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:33.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.005+0000 7fbd95cd7640 1 --2- 172.21.15.103:0/3738236372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd900bda70 0x7fbd900aae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:33.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.005+0000 7fbd964d8640 1 -- 172.21.15.103:0/3738236372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd900bf8f0 msgr2=0x7fbd900c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:33.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.005+0000 7fbd964d8640 1 --2- 172.21.15.103:0/3738236372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd900bf8f0 0x7fbd900c2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.005+0000 7fbd964d8640 1 -- 172.21.15.103:0/3738236372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd900bda70 msgr2=0x7fbd900aae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:33.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.005+0000 7fbd964d8640 1 --2- 172.21.15.103:0/3738236372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd900bda70 0x7fbd900aae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.005+0000 7fbd964d8640 1 -- 172.21.15.103:0/3738236372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd900a8670 con 0x7fbd90150aa0 2024-09-10T08:28:33.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.005+0000 7fbd954d6640 1 --2- 172.21.15.103:0/3738236372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd900bf8f0 0x7fbd900c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:33.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.005+0000 7fbd95cd7640 1 --2- 172.21.15.103:0/3738236372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd900bda70 0x7fbd900aae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:33.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.005+0000 7fbd964d8640 1 --2- 172.21.15.103:0/3738236372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd90150aa0 0x7fbd900c2b80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800cb70 tx=0x7fbd8800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:33.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.005+0000 7fbd867fc640 1 -- 172.21.15.103:0/3738236372 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88017070 con 0x7fbd90150aa0 2024-09-10T08:28:33.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.005+0000 7fbd867fc640 1 -- 172.21.15.103:0/3738236372 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8800ad40 con 0x7fbd90150aa0 2024-09-10T08:28:33.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.005+0000 7fbd97f3b640 1 -- 172.21.15.103:0/3738236372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd900aa590 con 0x7fbd90150aa0 2024-09-10T08:28:33.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.005+0000 7fbd867fc640 1 -- 172.21.15.103:0/3738236372 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88012620 con 0x7fbd90150aa0 2024-09-10T08:28:33.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.005+0000 7fbd97f3b640 1 -- 172.21.15.103:0/3738236372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd900a8a50 con 0x7fbd90150aa0 2024-09-10T08:28:33.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.006+0000 7fbd97f3b640 1 -- 172.21.15.103:0/3738236372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd900aaab0 con 0x7fbd90150aa0 2024-09-10T08:28:33.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.007+0000 7fbd867fc640 1 -- 172.21.15.103:0/3738236372 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbd8801a070 con 0x7fbd90150aa0 2024-09-10T08:28:33.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.007+0000 7fbd867fc640 1 --2- 172.21.15.103:0/3738236372 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbd7406be30 0x7fbd7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:33.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.007+0000 7fbd867fc640 1 -- 172.21.15.103:0/3738236372 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fbd8808a8f0 con 0x7fbd90150aa0 2024-09-10T08:28:33.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.007+0000 7fbd95cd7640 1 --2- 172.21.15.103:0/3738236372 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbd7406be30 0x7fbd7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:33.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.008+0000 7fbd95cd7640 1 --2- 172.21.15.103:0/3738236372 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbd7406be30 0x7fbd7406e2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbd900a7db0 tx=0x7fbd8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:33.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.012+0000 7fbd867fc640 1 -- 172.21.15.103:0/3738236372 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbd900aaab0 con 0x7fbd90150aa0 2024-09-10T08:28:33.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.178+0000 7fbd97f3b640 1 -- 172.21.15.103:0/3738236372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fbd900c7f40 con 0x7fbd90150aa0 2024-09-10T08:28:33.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.178+0000 7fbd867fc640 1 -- 172.21.15.103:0/3738236372 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7fbd88059680 con 0x7fbd90150aa0 2024-09-10T08:28:33.178 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:33.178 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-09-10T08:28:33.178 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:28:33.178 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2024-09-10T08:28:33.178 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": ".mgr" 2024-09-10T08:28:33.179 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:28:33.179 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-09-10T08:28:33.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.180+0000 7fbd97f3b640 1 -- 172.21.15.103:0/3738236372 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbd7406be30 msgr2=0x7fbd7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:33.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.180+0000 7fbd97f3b640 1 --2- 172.21.15.103:0/3738236372 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbd7406be30 0x7fbd7406e2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbd900a7db0 tx=0x7fbd8c008040 comp rx=0 tx=0).stop 2024-09-10T08:28:33.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.180+0000 7fbd97f3b640 1 -- 172.21.15.103:0/3738236372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd90150aa0 msgr2=0x7fbd900c2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:33.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.180+0000 7fbd97f3b640 1 --2- 172.21.15.103:0/3738236372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd90150aa0 0x7fbd900c2b80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800cb70 tx=0x7fbd8800a430 comp rx=0 tx=0).stop 2024-09-10T08:28:33.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.181+0000 7fbd97f3b640 1 -- 172.21.15.103:0/3738236372 shutdown_connections 2024-09-10T08:28:33.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.181+0000 7fbd97f3b640 1 --2- 172.21.15.103:0/3738236372 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbd7406be30 0x7fbd7406e2f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.181+0000 7fbd97f3b640 1 --2- 172.21.15.103:0/3738236372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd90150aa0 0x7fbd900c2b80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.181+0000 7fbd97f3b640 1 --2- 172.21.15.103:0/3738236372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd900bf8f0 0x7fbd900c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.181+0000 7fbd97f3b640 1 --2- 172.21.15.103:0/3738236372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd900bda70 0x7fbd900aae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.181+0000 7fbd97f3b640 1 -- 172.21.15.103:0/3738236372 >> 172.21.15.103:0/3738236372 conn(0x7fbd900c8a50 msgr2=0x7fbd90152770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:33.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.181+0000 7fbd97f3b640 1 -- 172.21.15.103:0/3738236372 shutdown_connections 2024-09-10T08:28:33.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.181+0000 7fbd97f3b640 1 -- 172.21.15.103:0/3738236372 wait complete. 2024-09-10T08:28:33.190 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'a' 2024-09-10T08:28:33.190 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_metadata --pg_num_min 64 2024-09-10T08:28:33.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.293+0000 7fd805d8d640 1 Processor -- start 2024-09-10T08:28:33.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.293+0000 7fd805d8d640 1 -- start start 2024-09-10T08:28:33.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.294+0000 7fd805d8d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8000731e0 0x7fd8000c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:33.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.294+0000 7fd805d8d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd8000c5280 0x7fd8000c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:33.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.294+0000 7fd805d8d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8000c80d0 con 0x7fd800073be0 2024-09-10T08:28:33.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.294+0000 7fd805d8d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fd8000c8430 con 0x7fd8000c5280 2024-09-10T08:28:33.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.294+0000 7fd805d8d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd8000c8680 con 0x7fd8000731e0 2024-09-10T08:28:33.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.294+0000 7fd7fffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd8000c5280 0x7fd8000c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:33.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.294+0000 7fd7fffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd8000c5280 0x7fd8000c56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42034/0 (socket says 172.21.15.103:42034) 2024-09-10T08:28:33.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.294+0000 7fd7fffff640 1 -- 172.21.15.103:0/2006350586 learned_addr learned my addr 172.21.15.103:0/2006350586 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:33.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.294+0000 7fd7fffff640 1 -- 172.21.15.103:0/2006350586 >> v2:172.21.15.154:3300/0 conn(0x7fd8000731e0 msgr2=0x7fd8000c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:33.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.294+0000 7fd7ff7fe640 1 --2- 172.21.15.103:0/2006350586 >> v2:172.21.15.154:3300/0 conn(0x7fd8000731e0 0x7fd8000c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:33.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.294+0000 7fd7fffff640 1 --2- 172.21.15.103:0/2006350586 >> v2:172.21.15.154:3300/0 conn(0x7fd8000731e0 0x7fd8000c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.294+0000 7fd7fffff640 1 -- 172.21.15.103:0/2006350586 >> v1:172.21.15.154:6789/0 conn(0x7fd800073be0 legacy=0x7fd80015a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:33.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.294+0000 7fd7fffff640 1 -- 172.21.15.103:0/2006350586 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8000c8960 con 0x7fd8000c5280 2024-09-10T08:28:33.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.295+0000 7fd7fffff640 1 --2- 172.21.15.103:0/2006350586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8000c5280 0x7fd8000c56d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd8000725a0 tx=0x7fd7f802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55fbff32ce703c8a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:33.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.295+0000 7fd7fe7fc640 1 -- 172.21.15.103:0/2006350586 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8036070 con 0x7fd8000c5280 2024-09-10T08:28:33.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.295+0000 7fd7fe7fc640 1 -- 172.21.15.103:0/2006350586 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7f8031600 con 0x7fd8000c5280 2024-09-10T08:28:33.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.295+0000 7fd7fe7fc640 1 -- 172.21.15.103:0/2006350586 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80319d0 con 0x7fd8000c5280 2024-09-10T08:28:33.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.296+0000 7fd805d8d640 1 -- 172.21.15.103:0/2006350586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8000c5280 msgr2=0x7fd8000c56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:33.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.296+0000 7fd805d8d640 1 --2- 172.21.15.103:0/2006350586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8000c5280 0x7fd8000c56d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd8000725a0 tx=0x7fd7f802a660 comp rx=0 tx=0).stop 2024-09-10T08:28:33.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.296+0000 7fd805d8d640 1 -- 172.21.15.103:0/2006350586 shutdown_connections 2024-09-10T08:28:33.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.296+0000 7fd805d8d640 1 --2- 172.21.15.103:0/2006350586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8000c5280 0x7fd8000c56d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.296+0000 7fd805d8d640 1 --2- 172.21.15.103:0/2006350586 >> v2:172.21.15.154:3300/0 conn(0x7fd8000731e0 0x7fd8000c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.296+0000 7fd805d8d640 1 -- 172.21.15.103:0/2006350586 >> 172.21.15.103:0/2006350586 conn(0x7fd8000c9c00 msgr2=0x7fd8000ca010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:33.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.296+0000 7fd805d8d640 1 -- 172.21.15.103:0/2006350586 shutdown_connections 2024-09-10T08:28:33.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.296+0000 7fd805d8d640 1 -- 172.21.15.103:0/2006350586 wait complete. 2024-09-10T08:28:33.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.297+0000 7fd805d8d640 1 Processor -- start 2024-09-10T08:28:33.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.297+0000 7fd805d8d640 1 -- start start 2024-09-10T08:28:33.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.298+0000 7fd805d8d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8000731e0 0x7fd800153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:33.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.298+0000 7fd805d8d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd800073be0 0x7fd8001eca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:33.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.298+0000 7fd805d8d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8000c5280 0x7fd800151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:33.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.298+0000 7fd805d8d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd80015a740 con 0x7fd8000731e0 2024-09-10T08:28:33.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.298+0000 7fd805d8d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd8000c8f20 con 0x7fd8000c5280 2024-09-10T08:28:33.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.298+0000 7fd805d8d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd80015a8c0 con 0x7fd800073be0 2024-09-10T08:28:33.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.298+0000 7fd7ff7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8000731e0 0x7fd800153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:33.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.298+0000 7fd7ff7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8000731e0 0x7fd800153490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42036/0 (socket says 172.21.15.103:42036) 2024-09-10T08:28:33.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.298+0000 7fd7ff7fe640 1 -- 172.21.15.103:0/1415331700 learned_addr learned my addr 172.21.15.103:0/1415331700 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:33.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.298+0000 7fd7feffd640 1 --2- 172.21.15.103:0/1415331700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd800073be0 0x7fd8001eca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:33.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.298+0000 7fd7fffff640 1 --2- 172.21.15.103:0/1415331700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8000c5280 0x7fd800151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:33.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.298+0000 7fd7ff7fe640 1 -- 172.21.15.103:0/1415331700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd800073be0 msgr2=0x7fd8001eca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:33.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.298+0000 7fd7ff7fe640 1 --2- 172.21.15.103:0/1415331700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd800073be0 0x7fd8001eca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.298+0000 7fd7ff7fe640 1 -- 172.21.15.103:0/1415331700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8000c5280 msgr2=0x7fd800151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:33.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.298+0000 7fd7ff7fe640 1 --2- 172.21.15.103:0/1415331700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8000c5280 0x7fd800151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.298+0000 7fd7ff7fe640 1 -- 172.21.15.103:0/1415331700 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8001eb940 con 0x7fd8000731e0 2024-09-10T08:28:33.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.298+0000 7fd7ff7fe640 1 --2- 172.21.15.103:0/1415331700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8000731e0 0x7fd800153490 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000c820 tx=0x7fd7f000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:33.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.298+0000 7fd7e7fff640 1 -- 172.21.15.103:0/1415331700 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0015070 con 0x7fd8000731e0 2024-09-10T08:28:33.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.298+0000 7fd7e7fff640 1 -- 172.21.15.103:0/1415331700 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7f0004240 con 0x7fd8000731e0 2024-09-10T08:28:33.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.298+0000 7fd805d8d640 1 -- 172.21.15.103:0/1415331700 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8001526d0 con 0x7fd8000731e0 2024-09-10T08:28:33.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.298+0000 7fd7e7fff640 1 -- 172.21.15.103:0/1415331700 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f000ce10 con 0x7fd8000731e0 2024-09-10T08:28:33.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.298+0000 7fd805d8d640 1 -- 172.21.15.103:0/1415331700 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd800152c90 con 0x7fd8000731e0 2024-09-10T08:28:33.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.299+0000 7fd805d8d640 1 -- 172.21.15.103:0/1415331700 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8000735c0 con 0x7fd8000731e0 2024-09-10T08:28:33.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.300+0000 7fd7e7fff640 1 -- 172.21.15.103:0/1415331700 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd7f0007830 con 0x7fd8000731e0 2024-09-10T08:28:33.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.300+0000 7fd7e7fff640 1 --2- 172.21.15.103:0/1415331700 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd7ec06be60 0x7fd7ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:33.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.300+0000 7fd7feffd640 1 --2- 172.21.15.103:0/1415331700 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd7ec06be60 0x7fd7ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:33.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.300+0000 7fd7e7fff640 1 -- 172.21.15.103:0/1415331700 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fd7f008a860 con 0x7fd8000731e0 2024-09-10T08:28:33.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.301+0000 7fd7feffd640 1 --2- 172.21.15.103:0/1415331700 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd7ec06be60 0x7fd7ec06e320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd80006d6f0 tx=0x7fd7f4007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:33.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.305+0000 7fd7e7fff640 1 -- 172.21.15.103:0/1415331700 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd7f0058fa0 con 0x7fd8000731e0 2024-09-10T08:28:33.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.470+0000 7fd805d8d640 1 -- 172.21.15.103:0/1415331700 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64} v 0) -- 0x7fd8000a8c70 con 0x7fd8000731e0 2024-09-10T08:28:33.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.539+0000 7fd7e7fff640 1 -- 172.21.15.103:0/1415331700 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64}]=0 pool 'a_metadata' created v18) ==== 128+0+0 (secure 0 0 0) 0x7fd7f005d2a0 con 0x7fd8000731e0 2024-09-10T08:28:33.539 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'a_metadata' created 2024-09-10T08:28:33.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.541+0000 7fd805d8d640 1 -- 172.21.15.103:0/1415331700 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd7ec06be60 msgr2=0x7fd7ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:33.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.541+0000 7fd805d8d640 1 --2- 172.21.15.103:0/1415331700 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd7ec06be60 0x7fd7ec06e320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd80006d6f0 tx=0x7fd7f4007e30 comp rx=0 tx=0).stop 2024-09-10T08:28:33.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.541+0000 7fd805d8d640 1 -- 172.21.15.103:0/1415331700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8000731e0 msgr2=0x7fd800153490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:33.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.541+0000 7fd805d8d640 1 --2- 172.21.15.103:0/1415331700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8000731e0 0x7fd800153490 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000c820 tx=0x7fd7f000cce0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.541+0000 7fd805d8d640 1 -- 172.21.15.103:0/1415331700 shutdown_connections 2024-09-10T08:28:33.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.541+0000 7fd805d8d640 1 --2- 172.21.15.103:0/1415331700 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd7ec06be60 0x7fd7ec06e320 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.541+0000 7fd805d8d640 1 --2- 172.21.15.103:0/1415331700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8000c5280 0x7fd800151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.541+0000 7fd805d8d640 1 --2- 172.21.15.103:0/1415331700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd800073be0 0x7fd8001eca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.541+0000 7fd805d8d640 1 --2- 172.21.15.103:0/1415331700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8000731e0 0x7fd800153490 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.541+0000 7fd805d8d640 1 -- 172.21.15.103:0/1415331700 >> 172.21.15.103:0/1415331700 conn(0x7fd8000c9c00 msgr2=0x7fd8000c3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:33.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.541+0000 7fd805d8d640 1 -- 172.21.15.103:0/1415331700 shutdown_connections 2024-09-10T08:28:33.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.541+0000 7fd805d8d640 1 -- 172.21.15.103:0/1415331700 wait complete. 2024-09-10T08:28:33.555 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T08:28:33.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.661+0000 7f8ee135b640 1 Processor -- start 2024-09-10T08:28:33.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.661+0000 7f8ee135b640 1 -- start start 2024-09-10T08:28:33.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.662+0000 7f8ee135b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8edc1581b0 0x7f8edc0c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:33.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.662+0000 7f8ee135b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8edc0ae830 con 0x7f8edc0a8370 2024-09-10T08:28:33.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.662+0000 7f8ee135b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8edc0aead0 con 0x7f8edc0c4020 2024-09-10T08:28:33.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.662+0000 7f8ee135b640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f8edc154b10 con 0x7f8edc1581b0 2024-09-10T08:28:33.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.662+0000 7f8edb7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8edc1581b0 0x7f8edc0c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:33.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.662+0000 7f8edb7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8edc1581b0 0x7f8edc0c4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42048/0 (socket says 172.21.15.103:42048) 2024-09-10T08:28:33.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.662+0000 7f8edb7fe640 1 -- 172.21.15.103:0/292048574 learned_addr learned my addr 172.21.15.103:0/292048574 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:33.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.662+0000 7f8edaffd640 1 --1- 172.21.15.103:0/292048574 >> v1:172.21.15.103:6789/0 conn(0x7f8edc0a8370 0x7f8edc073d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:55128/0 (socket says 172.21.15.103:55128) 2024-09-10T08:28:33.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.663+0000 7f8edb7fe640 1 -- 172.21.15.103:0/292048574 >> v1:172.21.15.154:6789/0 conn(0x7f8edc0c4020 legacy=0x7f8edc157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:33.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.663+0000 7f8edb7fe640 1 -- 172.21.15.103:0/292048574 >> v1:172.21.15.103:6789/0 conn(0x7f8edc0a8370 legacy=0x7f8edc073d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:33.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.663+0000 7f8edb7fe640 1 -- 172.21.15.103:0/292048574 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8edc157580 con 0x7f8edc1581b0 2024-09-10T08:28:33.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.663+0000 7f8ed9ffb640 1 -- 172.21.15.103:0/292048574 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2772216756 0 0) 0x7f8edc0ae830 con 0x7f8edc0a8370 2024-09-10T08:28:33.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.663+0000 7f8edb7fe640 1 --2- 172.21.15.103:0/292048574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8edc1581b0 0x7f8edc0c4c40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009870 tx=0x7f8ed402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e116b9d7b32dd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:33.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.663+0000 7f8ed9ffb640 1 -- 172.21.15.103:0/292048574 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4037070 con 0x7f8edc1581b0 2024-09-10T08:28:33.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.664+0000 7f8ed9ffb640 1 -- 172.21.15.103:0/292048574 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ed4032440 con 0x7f8edc1581b0 2024-09-10T08:28:33.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.664+0000 7f8ed9ffb640 1 -- 172.21.15.103:0/292048574 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4032810 con 0x7f8edc1581b0 2024-09-10T08:28:33.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.664+0000 7f8ee135b640 1 -- 172.21.15.103:0/292048574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8edc1581b0 msgr2=0x7f8edc0c4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:33.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.664+0000 7f8ee135b640 1 --2- 172.21.15.103:0/292048574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8edc1581b0 0x7f8edc0c4c40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009870 tx=0x7f8ed402a2a0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.664+0000 7f8ee135b640 1 -- 172.21.15.103:0/292048574 shutdown_connections 2024-09-10T08:28:33.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.664+0000 7f8ee135b640 1 --2- 172.21.15.103:0/292048574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8edc1581b0 0x7f8edc0c4c40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.664+0000 7f8ee135b640 1 -- 172.21.15.103:0/292048574 >> 172.21.15.103:0/292048574 conn(0x7f8edc0c5660 msgr2=0x7f8edc0c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:33.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.664+0000 7f8ee135b640 1 -- 172.21.15.103:0/292048574 shutdown_connections 2024-09-10T08:28:33.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.664+0000 7f8ee135b640 1 -- 172.21.15.103:0/292048574 wait complete. 2024-09-10T08:28:33.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.665+0000 7f8ee135b640 1 Processor -- start 2024-09-10T08:28:33.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.665+0000 7f8ee135b640 1 -- start start 2024-09-10T08:28:33.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.666+0000 7f8ee135b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8edc0a8370 0x7f8edc1efb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:33.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.666+0000 7f8ee135b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8edc0c4020 0x7f8edc0c2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:33.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.666+0000 7f8ee135b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8edc1581b0 0x7f8edc14ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:33.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.666+0000 7f8ee135b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc074610 con 0x7f8edc1581b0 2024-09-10T08:28:33.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.666+0000 7f8ee135b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc074490 con 0x7f8edc0c4020 2024-09-10T08:28:33.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.666+0000 7f8ee135b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8edc0abc10 con 0x7f8edc0a8370 2024-09-10T08:28:33.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.666+0000 7f8edb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8edc1581b0 0x7f8edc14ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:33.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.666+0000 7f8edb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8edc1581b0 0x7f8edc14ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42064/0 (socket says 172.21.15.103:42064) 2024-09-10T08:28:33.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.666+0000 7f8edb7fe640 1 -- 172.21.15.103:0/2883339021 learned_addr learned my addr 172.21.15.103:0/2883339021 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:33.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.666+0000 7f8edaffd640 1 --2- 172.21.15.103:0/2883339021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8edc0a8370 0x7f8edc1efb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:33.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.666+0000 7f8eda7fc640 1 --2- 172.21.15.103:0/2883339021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8edc0c4020 0x7f8edc0c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:33.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.666+0000 7f8edb7fe640 1 -- 172.21.15.103:0/2883339021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8edc0a8370 msgr2=0x7f8edc1efb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:33.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.667+0000 7f8edb7fe640 1 --2- 172.21.15.103:0/2883339021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8edc0a8370 0x7f8edc1efb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.667+0000 7f8edb7fe640 1 -- 172.21.15.103:0/2883339021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8edc0c4020 msgr2=0x7f8edc0c2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:33.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.667+0000 7f8edb7fe640 1 --2- 172.21.15.103:0/2883339021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8edc0c4020 0x7f8edc0c2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:33.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.667+0000 7f8edb7fe640 1 -- 172.21.15.103:0/2883339021 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8edc1ebc60 con 0x7f8edc1581b0 2024-09-10T08:28:33.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.667+0000 7f8edb7fe640 1 --2- 172.21.15.103:0/2883339021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8edc1581b0 0x7f8edc14ad30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8ed40090b0 tx=0x7f8ed40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:33.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.667+0000 7f8ec37fe640 1 -- 172.21.15.103:0/2883339021 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4037040 con 0x7f8edc1581b0 2024-09-10T08:28:33.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.667+0000 7f8ec37fe640 1 -- 172.21.15.103:0/2883339021 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ed4004250 con 0x7f8edc1581b0 2024-09-10T08:28:33.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.667+0000 7f8ec37fe640 1 -- 172.21.15.103:0/2883339021 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed403c670 con 0x7f8edc1581b0 2024-09-10T08:28:33.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.667+0000 7f8ee135b640 1 -- 172.21.15.103:0/2883339021 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8edc1ebf20 con 0x7f8edc1581b0 2024-09-10T08:28:33.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.667+0000 7f8ee135b640 1 -- 172.21.15.103:0/2883339021 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8edc1ec4e0 con 0x7f8edc1581b0 2024-09-10T08:28:33.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.668+0000 7f8ee135b640 1 -- 172.21.15.103:0/2883339021 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8edc0c3c70 con 0x7f8edc1581b0 2024-09-10T08:28:33.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.669+0000 7f8ec37fe640 1 -- 172.21.15.103:0/2883339021 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ed403a070 con 0x7f8edc1581b0 2024-09-10T08:28:33.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.669+0000 7f8ec37fe640 1 --2- 172.21.15.103:0/2883339021 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8ec806be30 0x7f8ec806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:33.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.669+0000 7f8edaffd640 1 --2- 172.21.15.103:0/2883339021 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8ec806be30 0x7f8ec806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:33.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.669+0000 7f8ec37fe640 1 -- 172.21.15.103:0/2883339021 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5222+0+0 (secure 0 0 0) 0x7f8ed40ab460 con 0x7f8edc1581b0 2024-09-10T08:28:33.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.670+0000 7f8edaffd640 1 --2- 172.21.15.103:0/2883339021 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8ec806be30 0x7f8ec806e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc0012e0 tx=0x7f8ecc001630 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:33.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.674+0000 7f8ec37fe640 1 -- 172.21.15.103:0/2883339021 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ed4041020 con 0x7f8edc1581b0 2024-09-10T08:28:33.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:33.840+0000 7f8ee135b640 1 -- 172.21.15.103:0/2883339021 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f8edc0c3110 con 0x7f8edc1581b0 2024-09-10T08:28:34.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.541+0000 7f8ec37fe640 1 -- 172.21.15.103:0/2883339021 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'a_data' created v19) ==== 160+0+0 (secure 0 0 0) 0x7f8ed4079a30 con 0x7f8edc1581b0 2024-09-10T08:28:34.541 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'a_data' created 2024-09-10T08:28:34.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.544+0000 7f8ee135b640 1 -- 172.21.15.103:0/2883339021 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8ec806be30 msgr2=0x7f8ec806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:34.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.544+0000 7f8ee135b640 1 --2- 172.21.15.103:0/2883339021 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8ec806be30 0x7f8ec806e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc0012e0 tx=0x7f8ecc001630 comp rx=0 tx=0).stop 2024-09-10T08:28:34.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.544+0000 7f8ee135b640 1 -- 172.21.15.103:0/2883339021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8edc1581b0 msgr2=0x7f8edc14ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:34.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.544+0000 7f8ee135b640 1 --2- 172.21.15.103:0/2883339021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8edc1581b0 0x7f8edc14ad30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8ed40090b0 tx=0x7f8ed40046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:34.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.544+0000 7f8ee135b640 1 -- 172.21.15.103:0/2883339021 shutdown_connections 2024-09-10T08:28:34.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.544+0000 7f8ee135b640 1 --2- 172.21.15.103:0/2883339021 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8ec806be30 0x7f8ec806e2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:34.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.544+0000 7f8ee135b640 1 --2- 172.21.15.103:0/2883339021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8edc1581b0 0x7f8edc14ad30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:34.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.544+0000 7f8ee135b640 1 --2- 172.21.15.103:0/2883339021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8edc0c4020 0x7f8edc0c2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:34.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.544+0000 7f8ee135b640 1 --2- 172.21.15.103:0/2883339021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8edc0a8370 0x7f8edc1efb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:34.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.544+0000 7f8ee135b640 1 -- 172.21.15.103:0/2883339021 >> 172.21.15.103:0/2883339021 conn(0x7f8edc0c5660 msgr2=0x7f8edc073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:34.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.544+0000 7f8ee135b640 1 -- 172.21.15.103:0/2883339021 shutdown_connections 2024-09-10T08:28:34.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.544+0000 7f8ee135b640 1 -- 172.21.15.103:0/2883339021 wait complete. 2024-09-10T08:28:34.566 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new a a_metadata a_data 2024-09-10T08:28:34.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.670+0000 7fec1ebaf640 1 Processor -- start 2024-09-10T08:28:34.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.671+0000 7fec1ebaf640 1 -- start start 2024-09-10T08:28:34.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.671+0000 7fec1ebaf640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec18072ec0 0x7fec18153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:34.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.671+0000 7fec1ebaf640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fec180afc60 0x7fec18151380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:34.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.671+0000 7fec1ebaf640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec1806efa0 con 0x7fec180c4ac0 2024-09-10T08:28:34.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.671+0000 7fec1ebaf640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fec1806f280 con 0x7fec180afc60 2024-09-10T08:28:34.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.671+0000 7fec1ebaf640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fec1806f560 con 0x7fec18072ec0 2024-09-10T08:28:34.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.671+0000 7fec1d14c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fec180afc60 0x7fec18151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:34.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.671+0000 7fec1d14c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fec180afc60 0x7fec18151380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42074/0 (socket says 172.21.15.103:42074) 2024-09-10T08:28:34.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.671+0000 7fec1d14c640 1 -- 172.21.15.103:0/3102735968 learned_addr learned my addr 172.21.15.103:0/3102735968 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:34.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.672+0000 7fec1c94b640 1 --2- 172.21.15.103:0/3102735968 >> v2:172.21.15.154:3300/0 conn(0x7fec18072ec0 0x7fec18153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:34.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.672+0000 7fec1d14c640 1 -- 172.21.15.103:0/3102735968 >> v2:172.21.15.154:3300/0 conn(0x7fec18072ec0 msgr2=0x7fec18153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:34.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.672+0000 7fec1d14c640 1 --2- 172.21.15.103:0/3102735968 >> v2:172.21.15.154:3300/0 conn(0x7fec18072ec0 0x7fec18153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:34.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.672+0000 7fec1d14c640 1 -- 172.21.15.103:0/3102735968 >> v1:172.21.15.154:6789/0 conn(0x7fec180c4ac0 legacy=0x7fec18070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:34.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.672+0000 7fec1d14c640 1 -- 172.21.15.103:0/3102735968 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1806f840 con 0x7fec180afc60 2024-09-10T08:28:34.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.672+0000 7fec1c94b640 1 --2- 172.21.15.103:0/3102735968 >> v2:172.21.15.154:3300/0 conn(0x7fec18072ec0 0x7fec18153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:34.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.672+0000 7fec1d14c640 1 --2- 172.21.15.103:0/3102735968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec180afc60 0x7fec18151380 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fec180766f0 tx=0x7fec1002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865700355a4383a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:34.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.673+0000 7fec177fe640 1 -- 172.21.15.103:0/3102735968 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec10036070 con 0x7fec180afc60 2024-09-10T08:28:34.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.673+0000 7fec177fe640 1 -- 172.21.15.103:0/3102735968 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec10031600 con 0x7fec180afc60 2024-09-10T08:28:34.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.673+0000 7fec177fe640 1 -- 172.21.15.103:0/3102735968 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec100319d0 con 0x7fec180afc60 2024-09-10T08:28:34.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.673+0000 7fec1ebaf640 1 -- 172.21.15.103:0/3102735968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec180afc60 msgr2=0x7fec18151380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:34.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.673+0000 7fec1ebaf640 1 --2- 172.21.15.103:0/3102735968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec180afc60 0x7fec18151380 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fec180766f0 tx=0x7fec1002a610 comp rx=0 tx=0).stop 2024-09-10T08:28:34.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.673+0000 7fec1ebaf640 1 -- 172.21.15.103:0/3102735968 shutdown_connections 2024-09-10T08:28:34.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.673+0000 7fec1ebaf640 1 --2- 172.21.15.103:0/3102735968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec180afc60 0x7fec18151380 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:34.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.673+0000 7fec1ebaf640 1 --2- 172.21.15.103:0/3102735968 >> v2:172.21.15.154:3300/0 conn(0x7fec18072ec0 0x7fec18153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:34.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.673+0000 7fec1ebaf640 1 -- 172.21.15.103:0/3102735968 >> 172.21.15.103:0/3102735968 conn(0x7fec180c9d80 msgr2=0x7fec180ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:34.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.673+0000 7fec1ebaf640 1 -- 172.21.15.103:0/3102735968 shutdown_connections 2024-09-10T08:28:34.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.673+0000 7fec1ebaf640 1 -- 172.21.15.103:0/3102735968 wait complete. 2024-09-10T08:28:34.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.674+0000 7fec1ebaf640 1 Processor -- start 2024-09-10T08:28:34.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.674+0000 7fec1ebaf640 1 -- start start 2024-09-10T08:28:34.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.675+0000 7fec1ebaf640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec18072ec0 0x7fec18148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:34.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.675+0000 7fec1ebaf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec180afc60 0x7fec18157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:34.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.675+0000 7fec1ebaf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec180c4ac0 0x7fec18157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:34.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.675+0000 7fec1ebaf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fec18070750 con 0x7fec180afc60 2024-09-10T08:28:34.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.675+0000 7fec1ebaf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec180c47f0 con 0x7fec180c4ac0 2024-09-10T08:28:34.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.675+0000 7fec1ebaf640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fec180708d0 con 0x7fec18072ec0 2024-09-10T08:28:34.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.675+0000 7fec17fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec180afc60 0x7fec18157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:34.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.675+0000 7fec17fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec180afc60 0x7fec18157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42078/0 (socket says 172.21.15.103:42078) 2024-09-10T08:28:34.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.675+0000 7fec17fff640 1 -- 172.21.15.103:0/2360565838 learned_addr learned my addr 172.21.15.103:0/2360565838 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:34.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.675+0000 7fec1d14c640 1 --2- 172.21.15.103:0/2360565838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec180c4ac0 0x7fec18157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:34.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.675+0000 7fec1c94b640 1 --2- 172.21.15.103:0/2360565838 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec18072ec0 0x7fec18148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:34.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.675+0000 7fec17fff640 1 -- 172.21.15.103:0/2360565838 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec18072ec0 msgr2=0x7fec18148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:34.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.675+0000 7fec17fff640 1 --2- 172.21.15.103:0/2360565838 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec18072ec0 0x7fec18148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:34.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.675+0000 7fec17fff640 1 -- 172.21.15.103:0/2360565838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec180c4ac0 msgr2=0x7fec18157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:34.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.675+0000 7fec17fff640 1 --2- 172.21.15.103:0/2360565838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec180c4ac0 0x7fec18157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:34.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.675+0000 7fec17fff640 1 -- 172.21.15.103:0/2360565838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1814bae0 con 0x7fec180afc60 2024-09-10T08:28:34.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.676+0000 7fec17fff640 1 --2- 172.21.15.103:0/2360565838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec180afc60 0x7fec18157630 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00c3f0 tx=0x7fec0c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:34.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.676+0000 7fec157fa640 1 -- 172.21.15.103:0/2360565838 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c0052d0 con 0x7fec180afc60 2024-09-10T08:28:34.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.676+0000 7fec157fa640 1 -- 172.21.15.103:0/2360565838 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec0c005490 con 0x7fec180afc60 2024-09-10T08:28:34.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.676+0000 7fec1ebaf640 1 -- 172.21.15.103:0/2360565838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec1814bdc0 con 0x7fec180afc60 2024-09-10T08:28:34.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.676+0000 7fec157fa640 1 -- 172.21.15.103:0/2360565838 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c007260 con 0x7fec180afc60 2024-09-10T08:28:34.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.676+0000 7fec1ebaf640 1 -- 172.21.15.103:0/2360565838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec181493e0 con 0x7fec180afc60 2024-09-10T08:28:34.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.677+0000 7fec1ebaf640 1 -- 172.21.15.103:0/2360565838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec180732a0 con 0x7fec180afc60 2024-09-10T08:28:34.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.677+0000 7fec157fa640 1 -- 172.21.15.103:0/2360565838 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec0c007400 con 0x7fec180afc60 2024-09-10T08:28:34.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.678+0000 7fec157fa640 1 --2- 172.21.15.103:0/2360565838 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fec0406be30 0x7fec0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:34.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.678+0000 7fec157fa640 1 -- 172.21.15.103:0/2360565838 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5599+0+0 (secure 0 0 0) 0x7fec0c08a180 con 0x7fec180afc60 2024-09-10T08:28:34.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.678+0000 7fec1c94b640 1 --2- 172.21.15.103:0/2360565838 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fec0406be30 0x7fec0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:34.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.678+0000 7fec1c94b640 1 --2- 172.21.15.103:0/2360565838 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fec0406be30 0x7fec0406e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fec180c5a20 tx=0x7fec08008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:34.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.682+0000 7fec157fa640 1 -- 172.21.15.103:0/2360565838 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec0c0585e0 con 0x7fec180afc60 2024-09-10T08:28:34.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:34.884+0000 7fec1ebaf640 1 -- 172.21.15.103:0/2360565838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"} v 0) -- 0x7fec180c5770 con 0x7fec180afc60 2024-09-10T08:28:35.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.563+0000 7fec157fa640 1 -- 172.21.15.103:0/2360565838 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 157+0+0 (secure 0 0 0) 0x7fec0c05c8e0 con 0x7fec180afc60 2024-09-10T08:28:35.564 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T08:28:35.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.568+0000 7fec1ebaf640 1 -- 172.21.15.103:0/2360565838 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fec0406be30 msgr2=0x7fec0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:35.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.569+0000 7fec1ebaf640 1 --2- 172.21.15.103:0/2360565838 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fec0406be30 0x7fec0406e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fec180c5a20 tx=0x7fec08008040 comp rx=0 tx=0).stop 2024-09-10T08:28:35.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.569+0000 7fec1ebaf640 1 -- 172.21.15.103:0/2360565838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec180afc60 msgr2=0x7fec18157630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:35.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.569+0000 7fec1ebaf640 1 --2- 172.21.15.103:0/2360565838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec180afc60 0x7fec18157630 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00c3f0 tx=0x7fec0c00c8b0 comp rx=0 tx=0).stop 2024-09-10T08:28:35.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.569+0000 7fec1ebaf640 1 -- 172.21.15.103:0/2360565838 shutdown_connections 2024-09-10T08:28:35.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.569+0000 7fec1ebaf640 1 --2- 172.21.15.103:0/2360565838 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fec0406be30 0x7fec0406e2f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:35.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.569+0000 7fec1ebaf640 1 --2- 172.21.15.103:0/2360565838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec180c4ac0 0x7fec18157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:35.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.569+0000 7fec1ebaf640 1 --2- 172.21.15.103:0/2360565838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec180afc60 0x7fec18157630 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:35.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.569+0000 7fec1ebaf640 1 --2- 172.21.15.103:0/2360565838 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec18072ec0 0x7fec18148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:35.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.569+0000 7fec1ebaf640 1 -- 172.21.15.103:0/2360565838 >> 172.21.15.103:0/2360565838 conn(0x7fec180c9d80 msgr2=0x7fec180c5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:35.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.578+0000 7fec1ebaf640 1 -- 172.21.15.103:0/2360565838 shutdown_connections 2024-09-10T08:28:35.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.578+0000 7fec1ebaf640 1 -- 172.21.15.103:0/2360565838 wait complete. 2024-09-10T08:28:35.594 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:28:35.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.693+0000 7fc8c5bfd640 1 Processor -- start 2024-09-10T08:28:35.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.693+0000 7fc8c5bfd640 1 -- start start 2024-09-10T08:28:35.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.693+0000 7fc8c5bfd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc8c006bbe0 0x7fc8c006c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:35.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.693+0000 7fc8c5bfd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8c01598c0 0x7fc8c0159d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:35.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.694+0000 7fc8c5bfd640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8c00c6b20 con 0x7fc8c0153de0 2024-09-10T08:28:35.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.694+0000 7fc8c5bfd640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc8c00c9480 con 0x7fc8c006bbe0 2024-09-10T08:28:35.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.694+0000 7fc8c5bfd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc8c00cb620 con 0x7fc8c01598c0 2024-09-10T08:28:35.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.694+0000 7fc8bffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8c01598c0 0x7fc8c0159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:35.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.694+0000 7fc8beffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc8c006bbe0 0x7fc8c006c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:35.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.694+0000 7fc8beffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc8c006bbe0 0x7fc8c006c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:51220/0 (socket says 172.21.15.103:51220) 2024-09-10T08:28:35.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.694+0000 7fc8beffd640 1 -- 172.21.15.103:0/2210300572 learned_addr learned my addr 172.21.15.103:0/2210300572 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:35.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.694+0000 7fc8bf7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc8c0153de0 0x7fc8c00ca640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:37602/0 (socket says 172.21.15.103:37602) 2024-09-10T08:28:35.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.694+0000 7fc8bffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8c01598c0 0x7fc8c0159d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:60728/0 (socket says 172.21.15.103:60728) 2024-09-10T08:28:35.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.694+0000 7fc8bffff640 1 -- 172.21.15.103:0/2210300572 >> v2:172.21.15.154:3300/0 conn(0x7fc8c006bbe0 msgr2=0x7fc8c006c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:35.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.694+0000 7fc8bffff640 1 --2- 172.21.15.103:0/2210300572 >> v2:172.21.15.154:3300/0 conn(0x7fc8c006bbe0 0x7fc8c006c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:35.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.694+0000 7fc8bffff640 1 -- 172.21.15.103:0/2210300572 >> v1:172.21.15.154:6789/0 conn(0x7fc8c0153de0 legacy=0x7fc8c00ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:35.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.694+0000 7fc8bffff640 1 -- 172.21.15.103:0/2210300572 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c00c6e00 con 0x7fc8c01598c0 2024-09-10T08:28:35.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.695+0000 7fc8bffff640 1 --2- 172.21.15.103:0/2210300572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8c01598c0 0x7fc8c0159d50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009d90 tx=0x7fc8b802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e107fc8b228dda24 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:35.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.695+0000 7fc8be7fc640 1 -- 172.21.15.103:0/2210300572 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8007740 con 0x7fc8c01598c0 2024-09-10T08:28:35.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.695+0000 7fc8be7fc640 1 -- 172.21.15.103:0/2210300572 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b80078e0 con 0x7fc8c01598c0 2024-09-10T08:28:35.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.695+0000 7fc8be7fc640 1 -- 172.21.15.103:0/2210300572 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8007cb0 con 0x7fc8c01598c0 2024-09-10T08:28:35.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.696+0000 7fc8c5bfd640 1 -- 172.21.15.103:0/2210300572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8c01598c0 msgr2=0x7fc8c0159d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:35.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.696+0000 7fc8c5bfd640 1 --2- 172.21.15.103:0/2210300572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8c01598c0 0x7fc8c0159d50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009d90 tx=0x7fc8b802a660 comp rx=0 tx=0).stop 2024-09-10T08:28:35.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.696+0000 7fc8c5bfd640 1 -- 172.21.15.103:0/2210300572 shutdown_connections 2024-09-10T08:28:35.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.696+0000 7fc8c5bfd640 1 --2- 172.21.15.103:0/2210300572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8c01598c0 0x7fc8c0159d50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:35.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.696+0000 7fc8c5bfd640 1 --2- 172.21.15.103:0/2210300572 >> v2:172.21.15.154:3300/0 conn(0x7fc8c006bbe0 0x7fc8c006c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:35.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.696+0000 7fc8c5bfd640 1 -- 172.21.15.103:0/2210300572 >> 172.21.15.103:0/2210300572 conn(0x7fc8c00c8800 msgr2=0x7fc8c00c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:35.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.696+0000 7fc8c5bfd640 1 -- 172.21.15.103:0/2210300572 shutdown_connections 2024-09-10T08:28:35.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.696+0000 7fc8c5bfd640 1 -- 172.21.15.103:0/2210300572 wait complete. 2024-09-10T08:28:35.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.697+0000 7fc8c5bfd640 1 Processor -- start 2024-09-10T08:28:35.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.697+0000 7fc8c5bfd640 1 -- start start 2024-09-10T08:28:35.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.698+0000 7fc8c5bfd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8c006bbe0 0x7fc8c00b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:35.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.698+0000 7fc8c5bfd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8c0153de0 0x7fc8c014ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:35.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.698+0000 7fc8c5bfd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8c01598c0 0x7fc8c00b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:35.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.698+0000 7fc8c5bfd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c00cbab0 con 0x7fc8c0153de0 2024-09-10T08:28:35.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.698+0000 7fc8c5bfd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c006c560 con 0x7fc8c006bbe0 2024-09-10T08:28:35.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.698+0000 7fc8c5bfd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc8c015a290 con 0x7fc8c01598c0 2024-09-10T08:28:35.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.698+0000 7fc8beffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8c0153de0 0x7fc8c014ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:35.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.698+0000 7fc8beffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8c0153de0 0x7fc8c014ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57436/0 (socket says 172.21.15.103:57436) 2024-09-10T08:28:35.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.698+0000 7fc8beffd640 1 -- 172.21.15.103:0/3284453743 learned_addr learned my addr 172.21.15.103:0/3284453743 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:35.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.698+0000 7fc8bf7fe640 1 --2- 172.21.15.103:0/3284453743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8c006bbe0 0x7fc8c00b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:35.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.698+0000 7fc8bffff640 1 --2- 172.21.15.103:0/3284453743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8c01598c0 0x7fc8c00b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:35.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.698+0000 7fc8beffd640 1 -- 172.21.15.103:0/3284453743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8c01598c0 msgr2=0x7fc8c00b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:35.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.698+0000 7fc8beffd640 1 --2- 172.21.15.103:0/3284453743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8c01598c0 0x7fc8c00b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:35.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.698+0000 7fc8beffd640 1 -- 172.21.15.103:0/3284453743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8c006bbe0 msgr2=0x7fc8c00b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:35.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.698+0000 7fc8beffd640 1 --2- 172.21.15.103:0/3284453743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8c006bbe0 0x7fc8c00b06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:35.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.698+0000 7fc8beffd640 1 -- 172.21.15.103:0/3284453743 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c00af8a0 con 0x7fc8c0153de0 2024-09-10T08:28:35.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.698+0000 7fc8beffd640 1 --2- 172.21.15.103:0/3284453743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8c0153de0 0x7fc8c014ebb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4009fd0 tx=0x7fc8b400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:35.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.698+0000 7fc8a7fff640 1 -- 172.21.15.103:0/3284453743 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4017070 con 0x7fc8c0153de0 2024-09-10T08:28:35.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.698+0000 7fc8a7fff640 1 -- 172.21.15.103:0/3284453743 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b400c940 con 0x7fc8c0153de0 2024-09-10T08:28:35.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.698+0000 7fc8c5bfd640 1 -- 172.21.15.103:0/3284453743 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c00afe30 con 0x7fc8c0153de0 2024-09-10T08:28:35.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.698+0000 7fc8a7fff640 1 -- 172.21.15.103:0/3284453743 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b400cd10 con 0x7fc8c0153de0 2024-09-10T08:28:35.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.698+0000 7fc8c5bfd640 1 -- 172.21.15.103:0/3284453743 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c014f0f0 con 0x7fc8c0153de0 2024-09-10T08:28:35.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.699+0000 7fc8c5bfd640 1 -- 172.21.15.103:0/3284453743 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8c00ca060 con 0x7fc8c0153de0 2024-09-10T08:28:35.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.700+0000 7fc8a7fff640 1 -- 172.21.15.103:0/3284453743 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc8b401a070 con 0x7fc8c0153de0 2024-09-10T08:28:35.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.700+0000 7fc8a7fff640 1 --2- 172.21.15.103:0/3284453743 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc8ac06be30 0x7fc8ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:35.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.700+0000 7fc8a7fff640 1 -- 172.21.15.103:0/3284453743 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7fc8b408ad00 con 0x7fc8c0153de0 2024-09-10T08:28:35.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.700+0000 7fc8bf7fe640 1 --2- 172.21.15.103:0/3284453743 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc8ac06be30 0x7fc8ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:35.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.701+0000 7fc8bf7fe640 1 --2- 172.21.15.103:0/3284453743 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc8ac06be30 0x7fc8ac06e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0000f60 tx=0x7fc8b0000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:35.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.705+0000 7fc8a7fff640 1 -- 172.21.15.103:0/3284453743 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc8c00ca060 con 0x7fc8c0153de0 2024-09-10T08:28:35.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.871+0000 7fc8c5bfd640 1 -- 172.21.15.103:0/3284453743 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8c00cb3b0 con 0x7fc8c0153de0 2024-09-10T08:28:35.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.873+0000 7fc8a7fff640 1 -- 172.21.15.103:0/3284453743 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16706 (secure 0 0 0) 0x7fc8c00cb3b0 con 0x7fc8c0153de0 2024-09-10T08:28:35.873 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:35.873 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":20,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","created":"2024-09-10T08:28:12.654957+0000","modified":"2024-09-10T08:28:34.885079+0000","last_up_change":"2024-09-10T08:28:25.445753+0000","last_in_change":"2024-09-10T08:28:14.741133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:24.821696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-10T08:28:33.488154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-10T08:28:33.857868+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1abe08f4-0348-435e-9f97-cec00e96992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6809","nonce":2707863099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6811","nonce":2707863099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6815","nonce":2707863099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6813","nonce":2707863099}]},"public_addr":"172.21.15.103:6809/2707863099","cluster_addr":"172.21.15.103:6811/2707863099","heartbeat_back_addr":"172.21.15.103:6815/2707863099","heartbeat_front_addr":"172.21.15.103:6813/2707863099","state":["exists","up"]},{"osd":1,"uuid":"df342e58-1026-4739-82f6-7a216707444c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6818","nonce":4029892782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6822","nonce":4029892782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6830","nonce":4029892782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6826","nonce":4029892782}]},"public_addr":"172.21.15.103:6818/4029892782","cluster_addr":"172.21.15.103:6822/4029892782","heartbeat_back_addr":"172.21.15.103:6830/4029892782","heartbeat_front_addr":"172.21.15.103:6826/4029892782","state":["exists","up"]},{"osd":2,"uuid":"f7aea2cf-208c-41ed-a0f6-8948d70b9a0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6819","nonce":428484432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6821","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6823","nonce":428484432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6829","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6831","nonce":428484432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6825","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6827","nonce":428484432}]},"public_addr":"172.21.15.103:6819/428484432","cluster_addr":"172.21.15.103:6823/428484432","heartbeat_back_addr":"172.21.15.103:6831/428484432","heartbeat_front_addr":"172.21.15.103:6827/428484432","state":["exists","up"]},{"osd":3,"uuid":"615ef8b0-12a5-4503-96d0-f7ec17dbc792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6801","nonce":3453676282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6803","nonce":3453676282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6807","nonce":3453676282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6805","nonce":3453676282}]},"public_addr":"172.21.15.103:6801/3453676282","cluster_addr":"172.21.15.103:6803/3453676282","heartbeat_back_addr":"172.21.15.103:6807/3453676282","heartbeat_front_addr":"172.21.15.103:6805/3453676282","state":["exists","up"]},{"osd":4,"uuid":"644c5e94-db18-4b83-b5cd-3762ae2647a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6809","nonce":1808157069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6811","nonce":1808157069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6815","nonce":1808157069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6813","nonce":1808157069}]},"public_addr":"172.21.15.154:6809/1808157069","cluster_addr":"172.21.15.154:6811/1808157069","heartbeat_back_addr":"172.21.15.154:6815/1808157069","heartbeat_front_addr":"172.21.15.154:6813/1808157069","state":["exists","up"]},{"osd":5,"uuid":"f40210bd-f4ca-442e-baac-729ced5a9f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6817","nonce":1048015779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6819","nonce":1048015779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6823","nonce":1048015779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6821","nonce":1048015779}]},"public_addr":"172.21.15.154:6817/1048015779","cluster_addr":"172.21.15.154:6819/1048015779","heartbeat_back_addr":"172.21.15.154:6823/1048015779","heartbeat_front_addr":"172.21.15.154:6821/1048015779","state":["exists","up"]},{"osd":6,"uuid":"eebac31e-aaef-47b0-90d7-4af08f36d7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6801","nonce":345273812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6803","nonce":345273812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6807","nonce":345273812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6805","nonce":345273812}]},"public_addr":"172.21.15.154:6801/345273812","cluster_addr":"172.21.15.154:6803/345273812","heartbeat_back_addr":"172.21.15.154:6807/345273812","heartbeat_front_addr":"172.21.15.154:6805/345273812","state":["exists","up"]},{"osd":7,"uuid":"58406c9a-036f-4618-bfb6-0beddbd71605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6825","nonce":3439481239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6827","nonce":3439481239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6831","nonce":3439481239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6829","nonce":3439481239}]},"public_addr":"172.21.15.154:6825/3439481239","cluster_addr":"172.21.15.154:6827/3439481239","heartbeat_back_addr":"172.21.15.154:6831/3439481239","heartbeat_front_addr":"172.21.15.154:6829/3439481239","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.032718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.126448+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.781158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.808718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.050591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.038245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.586989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.223326+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:28:35.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.875+0000 7fc8c5bfd640 1 -- 172.21.15.103:0/3284453743 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc8ac06be30 msgr2=0x7fc8ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:35.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.875+0000 7fc8c5bfd640 1 --2- 172.21.15.103:0/3284453743 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc8ac06be30 0x7fc8ac06e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0000f60 tx=0x7fc8b0000ed0 comp rx=0 tx=0).stop 2024-09-10T08:28:35.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.875+0000 7fc8c5bfd640 1 -- 172.21.15.103:0/3284453743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8c0153de0 msgr2=0x7fc8c014ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:35.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.875+0000 7fc8c5bfd640 1 --2- 172.21.15.103:0/3284453743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8c0153de0 0x7fc8c014ebb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4009fd0 tx=0x7fc8b400ed40 comp rx=0 tx=0).stop 2024-09-10T08:28:35.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.875+0000 7fc8c5bfd640 1 -- 172.21.15.103:0/3284453743 shutdown_connections 2024-09-10T08:28:35.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.875+0000 7fc8c5bfd640 1 --2- 172.21.15.103:0/3284453743 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc8ac06be30 0x7fc8ac06e2f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:35.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.875+0000 7fc8c5bfd640 1 --2- 172.21.15.103:0/3284453743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8c01598c0 0x7fc8c00b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:35.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.875+0000 7fc8c5bfd640 1 --2- 172.21.15.103:0/3284453743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8c0153de0 0x7fc8c014ebb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:35.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.875+0000 7fc8c5bfd640 1 --2- 172.21.15.103:0/3284453743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8c006bbe0 0x7fc8c00b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:35.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.875+0000 7fc8c5bfd640 1 -- 172.21.15.103:0/3284453743 >> 172.21.15.103:0/3284453743 conn(0x7fc8c00c8800 msgr2=0x7fc8c00c9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:35.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.875+0000 7fc8c5bfd640 1 -- 172.21.15.103:0/3284453743 shutdown_connections 2024-09-10T08:28:35.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.875+0000 7fc8c5bfd640 1 -- 172.21.15.103:0/3284453743 wait complete. 2024-09-10T08:28:35.886 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:28:35.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.984+0000 7fa9c1877640 1 Processor -- start 2024-09-10T08:28:35.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.984+0000 7fa9c1877640 1 -- start start 2024-09-10T08:28:35.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.985+0000 7fa9c1877640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc150480 0x7fa9bc0c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:35.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.985+0000 7fa9c1877640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9bc15a7c0 con 0x7fa9bc0ca390 2024-09-10T08:28:35.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.985+0000 7fa9c1877640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9bc159a00 con 0x7fa9bc06c650 2024-09-10T08:28:35.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.985+0000 7fa9c1877640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa9bc06c240 con 0x7fa9bc150480 2024-09-10T08:28:35.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.985+0000 7fa9bb7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa9bc0ca390 0x7fa9bc160bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51146/0 (socket says 172.21.15.103:51146) 2024-09-10T08:28:35.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.985+0000 7fa9bb7fe640 1 -- 172.21.15.103:0/1346821813 learned_addr learned my addr 172.21.15.103:0/1346821813 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:35.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.985+0000 7fa9baffd640 1 --2- 172.21.15.103:0/1346821813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc150480 0x7fa9bc0c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:35.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.985+0000 7fa9b9ffb640 1 -- 172.21.15.103:0/1346821813 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 626894844 0 0) 0x7fa9bc15a7c0 con 0x7fa9bc0ca390 2024-09-10T08:28:35.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.985+0000 7fa9b9ffb640 1 -- 172.21.15.103:0/1346821813 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9a4003520 con 0x7fa9bc0ca390 2024-09-10T08:28:35.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.986+0000 7fa9b9ffb640 1 -- 172.21.15.103:0/1346821813 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4125272112 0 0) 0x7fa9a4003520 con 0x7fa9bc0ca390 2024-09-10T08:28:35.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.986+0000 7fa9b9ffb640 1 -- 172.21.15.103:0/1346821813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc150480 msgr2=0x7fa9bc0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:35.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.986+0000 7fa9b9ffb640 1 --2- 172.21.15.103:0/1346821813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc150480 0x7fa9bc0c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:35.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.986+0000 7fa9b9ffb640 1 -- 172.21.15.103:0/1346821813 >> v1:172.21.15.154:6789/0 conn(0x7fa9bc06c650 legacy=0x7fa9bc0c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:35.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.986+0000 7fa9b9ffb640 1 -- 172.21.15.103:0/1346821813 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9bc159ce0 con 0x7fa9bc0ca390 2024-09-10T08:28:35.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.986+0000 7fa9b9ffb640 1 -- 172.21.15.103:0/1346821813 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7fa9b4001670 con 0x7fa9bc0ca390 2024-09-10T08:28:35.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.986+0000 7fa9b9ffb640 1 -- 172.21.15.103:0/1346821813 >> v1:172.21.15.103:6789/0 conn(0x7fa9bc0ca390 legacy=0x7fa9bc160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:35.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.986+0000 7fa9b9ffb640 1 --2- 172.21.15.103:0/1346821813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc150480 0x7fa9a40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:35.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.986+0000 7fa9b9ffb640 1 --2- 172.21.15.103:0/1346821813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9a4003f20 0x7fa9a4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:35.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.986+0000 7fa9b9ffb640 1 --2- 172.21.15.103:0/1346821813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9a4004d40 0x7fa9a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:35.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.986+0000 7fa9b9ffb640 1 -- 172.21.15.103:0/1346821813 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a400b9f0 con 0x7fa9a4004d40 2024-09-10T08:28:35.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.986+0000 7fa9b9ffb640 1 -- 172.21.15.103:0/1346821813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a400bba0 con 0x7fa9a4003f20 2024-09-10T08:28:35.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.986+0000 7fa9b9ffb640 1 -- 172.21.15.103:0/1346821813 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa9a400bda0 con 0x7fa9bc150480 2024-09-10T08:28:35.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.986+0000 7fa9bb7fe640 1 --2- 172.21.15.103:0/1346821813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9a4004d40 0x7fa9a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:35.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.986+0000 7fa9baffd640 1 --2- 172.21.15.103:0/1346821813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc150480 0x7fa9a40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:35.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.986+0000 7fa9ba7fc640 1 --2- 172.21.15.103:0/1346821813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9a4003f20 0x7fa9a4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:35.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.986+0000 7fa9bb7fe640 1 -- 172.21.15.103:0/1346821813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc150480 msgr2=0x7fa9a40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:35.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.986+0000 7fa9bb7fe640 1 --2- 172.21.15.103:0/1346821813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc150480 0x7fa9a40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:35.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.986+0000 7fa9bb7fe640 1 -- 172.21.15.103:0/1346821813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9a4003f20 msgr2=0x7fa9a4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:35.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.986+0000 7fa9bb7fe640 1 --2- 172.21.15.103:0/1346821813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9a4003f20 0x7fa9a4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:35.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.986+0000 7fa9bb7fe640 1 -- 172.21.15.103:0/1346821813 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a4003520 con 0x7fa9a4004d40 2024-09-10T08:28:35.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.987+0000 7fa9bb7fe640 1 --2- 172.21.15.103:0/1346821813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9a4004d40 0x7fa9a40051c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400c290 tx=0x7fa9a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517b380f1b4f3b83 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:35.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.987+0000 7fa9b9ffb640 1 -- 172.21.15.103:0/1346821813 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4007d50 con 0x7fa9a4004d40 2024-09-10T08:28:35.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.987+0000 7fa9b9ffb640 1 -- 172.21.15.103:0/1346821813 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b4005af0 con 0x7fa9a4004d40 2024-09-10T08:28:35.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.987+0000 7fa9b9ffb640 1 -- 172.21.15.103:0/1346821813 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4007070 con 0x7fa9a4004d40 2024-09-10T08:28:35.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.987+0000 7fa9c1877640 1 -- 172.21.15.103:0/1346821813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9a4004d40 msgr2=0x7fa9a40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:35.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.987+0000 7fa9c1877640 1 --2- 172.21.15.103:0/1346821813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9a4004d40 0x7fa9a40051c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400c290 tx=0x7fa9a4005830 comp rx=0 tx=0).stop 2024-09-10T08:28:35.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.987+0000 7fa9bb7fe640 1 -- 172.21.15.103:0/1346821813 reap_dead start 2024-09-10T08:28:35.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.988+0000 7fa9c1877640 1 -- 172.21.15.103:0/1346821813 shutdown_connections 2024-09-10T08:28:35.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.988+0000 7fa9c1877640 1 -- 172.21.15.103:0/1346821813 >> 172.21.15.103:0/1346821813 conn(0x7fa9bc068030 msgr2=0x7fa9bc073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:35.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.988+0000 7fa9c1877640 1 -- 172.21.15.103:0/1346821813 shutdown_connections 2024-09-10T08:28:35.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.988+0000 7fa9c1877640 1 -- 172.21.15.103:0/1346821813 wait complete. 2024-09-10T08:28:35.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.989+0000 7fa9c1877640 1 Processor -- start 2024-09-10T08:28:35.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.989+0000 7fa9c1877640 1 -- start start 2024-09-10T08:28:35.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.989+0000 7fa9c1877640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9a4004d40 0x7fa9bc14bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:35.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.989+0000 7fa9c1877640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9bc0c7a20 0x7fa9bc0c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:35.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.989+0000 7fa9c1877640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc1eecf0 0x7fa9bc1ef170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:35.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.989+0000 7fa9c1877640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc06d270 con 0x7fa9bc1eecf0 2024-09-10T08:28:35.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.989+0000 7fa9c1877640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc15a330 con 0x7fa9bc0c7a20 2024-09-10T08:28:35.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.989+0000 7fa9c1877640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa9bc156270 con 0x7fa9a4004d40 2024-09-10T08:28:35.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.990+0000 7fa9bb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc1eecf0 0x7fa9bc1ef170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:35.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.990+0000 7fa9bb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc1eecf0 0x7fa9bc1ef170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57452/0 (socket says 172.21.15.103:57452) 2024-09-10T08:28:35.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.990+0000 7fa9bb7fe640 1 -- 172.21.15.103:0/848493487 learned_addr learned my addr 172.21.15.103:0/848493487 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:35.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.990+0000 7fa9baffd640 1 --2- 172.21.15.103:0/848493487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9a4004d40 0x7fa9bc14bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:35.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.990+0000 7fa9ba7fc640 1 --2- 172.21.15.103:0/848493487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9bc0c7a20 0x7fa9bc0c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:35.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.990+0000 7fa9bb7fe640 1 -- 172.21.15.103:0/848493487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9a4004d40 msgr2=0x7fa9bc14bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:35.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.990+0000 7fa9bb7fe640 1 --2- 172.21.15.103:0/848493487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9a4004d40 0x7fa9bc14bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:35.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.990+0000 7fa9bb7fe640 1 -- 172.21.15.103:0/848493487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9bc0c7a20 msgr2=0x7fa9bc0c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:35.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.990+0000 7fa9bb7fe640 1 --2- 172.21.15.103:0/848493487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9bc0c7a20 0x7fa9bc0c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:35.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.990+0000 7fa9bb7fe640 1 -- 172.21.15.103:0/848493487 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9bc14c060 con 0x7fa9bc1eecf0 2024-09-10T08:28:35.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.990+0000 7fa9bb7fe640 1 --2- 172.21.15.103:0/848493487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc1eecf0 0x7fa9bc1ef170 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400c380 tx=0x7fa9b4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:35.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.990+0000 7fa9a3fff640 1 -- 172.21.15.103:0/848493487 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4007d50 con 0x7fa9bc1eecf0 2024-09-10T08:28:35.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.990+0000 7fa9a3fff640 1 -- 172.21.15.103:0/848493487 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b4007070 con 0x7fa9bc1eecf0 2024-09-10T08:28:35.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.990+0000 7fa9c1877640 1 -- 172.21.15.103:0/848493487 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9bc1ec500 con 0x7fa9bc1eecf0 2024-09-10T08:28:35.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.990+0000 7fa9a3fff640 1 -- 172.21.15.103:0/848493487 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4007220 con 0x7fa9bc1eecf0 2024-09-10T08:28:35.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.990+0000 7fa9c1877640 1 -- 172.21.15.103:0/848493487 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9bc1ec220 con 0x7fa9bc1eecf0 2024-09-10T08:28:35.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.991+0000 7fa9c1877640 1 -- 172.21.15.103:0/848493487 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9bc06c430 con 0x7fa9bc1eecf0 2024-09-10T08:28:35.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.992+0000 7fa9a3fff640 1 -- 172.21.15.103:0/848493487 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa9b4046020 con 0x7fa9bc1eecf0 2024-09-10T08:28:35.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.992+0000 7fa9a3fff640 1 --2- 172.21.15.103:0/848493487 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa9a806be30 0x7fa9a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:35.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.992+0000 7fa9a3fff640 1 -- 172.21.15.103:0/848493487 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7fa9b40aac30 con 0x7fa9bc1eecf0 2024-09-10T08:28:35.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.992+0000 7fa9baffd640 1 --2- 172.21.15.103:0/848493487 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa9a806be30 0x7fa9a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:35.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.993+0000 7fa9baffd640 1 --2- 172.21.15.103:0/848493487 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa9a806be30 0x7fa9a806e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac014510 tx=0x7fa9ac00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:35.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:35.996+0000 7fa9a3fff640 1 -- 172.21.15.103:0/848493487 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa9bc14c060 con 0x7fa9bc1eecf0 2024-09-10T08:28:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.162+0000 7fa9c1877640 1 -- 172.21.15.103:0/848493487 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa9bc0acab0 con 0x7fa9bc1eecf0 2024-09-10T08:28:36.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.163+0000 7fa9a3fff640 1 -- 172.21.15.103:0/848493487 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16706 (secure 0 0 0) 0x7fa9b4079230 con 0x7fa9bc1eecf0 2024-09-10T08:28:36.164 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:36.164 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":20,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","created":"2024-09-10T08:28:12.654957+0000","modified":"2024-09-10T08:28:34.885079+0000","last_up_change":"2024-09-10T08:28:25.445753+0000","last_in_change":"2024-09-10T08:28:14.741133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:24.821696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-10T08:28:33.488154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-10T08:28:33.857868+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1abe08f4-0348-435e-9f97-cec00e96992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6809","nonce":2707863099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6811","nonce":2707863099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6815","nonce":2707863099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6813","nonce":2707863099}]},"public_addr":"172.21.15.103:6809/2707863099","cluster_addr":"172.21.15.103:6811/2707863099","heartbeat_back_addr":"172.21.15.103:6815/2707863099","heartbeat_front_addr":"172.21.15.103:6813/2707863099","state":["exists","up"]},{"osd":1,"uuid":"df342e58-1026-4739-82f6-7a216707444c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6818","nonce":4029892782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6822","nonce":4029892782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6830","nonce":4029892782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6826","nonce":4029892782}]},"public_addr":"172.21.15.103:6818/4029892782","cluster_addr":"172.21.15.103:6822/4029892782","heartbeat_back_addr":"172.21.15.103:6830/4029892782","heartbeat_front_addr":"172.21.15.103:6826/4029892782","state":["exists","up"]},{"osd":2,"uuid":"f7aea2cf-208c-41ed-a0f6-8948d70b9a0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6819","nonce":428484432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6821","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6823","nonce":428484432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6829","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6831","nonce":428484432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6825","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6827","nonce":428484432}]},"public_addr":"172.21.15.103:6819/428484432","cluster_addr":"172.21.15.103:6823/428484432","heartbeat_back_addr":"172.21.15.103:6831/428484432","heartbeat_front_addr":"172.21.15.103:6827/428484432","state":["exists","up"]},{"osd":3,"uuid":"615ef8b0-12a5-4503-96d0-f7ec17dbc792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6801","nonce":3453676282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6803","nonce":3453676282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6807","nonce":3453676282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6805","nonce":3453676282}]},"public_addr":"172.21.15.103:6801/3453676282","cluster_addr":"172.21.15.103:6803/3453676282","heartbeat_back_addr":"172.21.15.103:6807/3453676282","heartbeat_front_addr":"172.21.15.103:6805/3453676282","state":["exists","up"]},{"osd":4,"uuid":"644c5e94-db18-4b83-b5cd-3762ae2647a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6809","nonce":1808157069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6811","nonce":1808157069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6815","nonce":1808157069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6813","nonce":1808157069}]},"public_addr":"172.21.15.154:6809/1808157069","cluster_addr":"172.21.15.154:6811/1808157069","heartbeat_back_addr":"172.21.15.154:6815/1808157069","heartbeat_front_addr":"172.21.15.154:6813/1808157069","state":["exists","up"]},{"osd":5,"uuid":"f40210bd-f4ca-442e-baac-729ced5a9f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6817","nonce":1048015779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6819","nonce":1048015779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6823","nonce":1048015779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6821","nonce":1048015779}]},"public_addr":"172.21.15.154:6817/1048015779","cluster_addr":"172.21.15.154:6819/1048015779","heartbeat_back_addr":"172.21.15.154:6823/1048015779","heartbeat_front_addr":"172.21.15.154:6821/1048015779","state":["exists","up"]},{"osd":6,"uuid":"eebac31e-aaef-47b0-90d7-4af08f36d7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6801","nonce":345273812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6803","nonce":345273812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6807","nonce":345273812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6805","nonce":345273812}]},"public_addr":"172.21.15.154:6801/345273812","cluster_addr":"172.21.15.154:6803/345273812","heartbeat_back_addr":"172.21.15.154:6807/345273812","heartbeat_front_addr":"172.21.15.154:6805/345273812","state":["exists","up"]},{"osd":7,"uuid":"58406c9a-036f-4618-bfb6-0beddbd71605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6825","nonce":3439481239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6827","nonce":3439481239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6831","nonce":3439481239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6829","nonce":3439481239}]},"public_addr":"172.21.15.154:6825/3439481239","cluster_addr":"172.21.15.154:6827/3439481239","heartbeat_back_addr":"172.21.15.154:6831/3439481239","heartbeat_front_addr":"172.21.15.154:6829/3439481239","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.032718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.126448+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.781158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.808718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.050591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.038245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.586989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.223326+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:28:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.165+0000 7fa9c1877640 1 -- 172.21.15.103:0/848493487 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa9a806be30 msgr2=0x7fa9a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.165+0000 7fa9c1877640 1 --2- 172.21.15.103:0/848493487 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa9a806be30 0x7fa9a806e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac014510 tx=0x7fa9ac00b040 comp rx=0 tx=0).stop 2024-09-10T08:28:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.165+0000 7fa9c1877640 1 -- 172.21.15.103:0/848493487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc1eecf0 msgr2=0x7fa9bc1ef170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.165+0000 7fa9c1877640 1 --2- 172.21.15.103:0/848493487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc1eecf0 0x7fa9bc1ef170 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400c380 tx=0x7fa9b4001a40 comp rx=0 tx=0).stop 2024-09-10T08:28:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.165+0000 7fa9c1877640 1 -- 172.21.15.103:0/848493487 shutdown_connections 2024-09-10T08:28:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.165+0000 7fa9c1877640 1 --2- 172.21.15.103:0/848493487 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa9a806be30 0x7fa9a806e2f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.165+0000 7fa9c1877640 1 --2- 172.21.15.103:0/848493487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc1eecf0 0x7fa9bc1ef170 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.165+0000 7fa9c1877640 1 --2- 172.21.15.103:0/848493487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9bc0c7a20 0x7fa9bc0c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.165+0000 7fa9c1877640 1 --2- 172.21.15.103:0/848493487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9a4004d40 0x7fa9bc14bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.165+0000 7fa9c1877640 1 -- 172.21.15.103:0/848493487 >> 172.21.15.103:0/848493487 conn(0x7fa9bc068030 msgr2=0x7fa9bc1540e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.165+0000 7fa9c1877640 1 -- 172.21.15.103:0/848493487 shutdown_connections 2024-09-10T08:28:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.165+0000 7fa9c1877640 1 -- 172.21.15.103:0/848493487 wait complete. 2024-09-10T08:28:36.176 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a standby_count_wanted 0 2024-09-10T08:28:36.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.277+0000 7f17ecdd6640 1 Processor -- start 2024-09-10T08:28:36.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.277+0000 7f17ecdd6640 1 -- start start 2024-09-10T08:28:36.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.278+0000 7f17ecdd6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17e8153b70 0x7f17e8157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:36.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.278+0000 7f17ecdd6640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17e8157540 con 0x7f17e80bf900 2024-09-10T08:28:36.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.278+0000 7f17ecdd6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17e8157c30 con 0x7f17e8153f50 2024-09-10T08:28:36.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.278+0000 7f17ecdd6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f17e8157f10 con 0x7f17e8153b70 2024-09-10T08:28:36.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.278+0000 7f17e5d9b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f17e80bf900 0x7f17e80ae740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51148/0 (socket says 172.21.15.103:51148) 2024-09-10T08:28:36.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.278+0000 7f17e5d9b640 1 -- 172.21.15.103:0/1319691266 learned_addr learned my addr 172.21.15.103:0/1319691266 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:36.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e659c640 1 --2- 172.21.15.103:0/1319691266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17e8153b70 0x7f17e8157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:36.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e559a640 1 -- 172.21.15.103:0/1319691266 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3344484207 0 0) 0x7f17e8157540 con 0x7f17e80bf900 2024-09-10T08:28:36.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e559a640 1 -- 172.21.15.103:0/1319691266 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17d0003520 con 0x7f17e80bf900 2024-09-10T08:28:36.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e559a640 1 -- 172.21.15.103:0/1319691266 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2873933465 0 0) 0x7f17d0003520 con 0x7f17e80bf900 2024-09-10T08:28:36.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e559a640 1 -- 172.21.15.103:0/1319691266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17e8153b70 msgr2=0x7f17e8157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:36.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e559a640 1 --2- 172.21.15.103:0/1319691266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17e8153b70 0x7f17e8157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:36.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e559a640 1 -- 172.21.15.103:0/1319691266 >> v1:172.21.15.154:6789/0 conn(0x7f17e8153f50 legacy=0x7f17e8158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:36.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e559a640 1 -- 172.21.15.103:0/1319691266 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e81581f0 con 0x7f17e80bf900 2024-09-10T08:28:36.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e559a640 1 -- 172.21.15.103:0/1319691266 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f17dc001670 con 0x7f17e80bf900 2024-09-10T08:28:36.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e559a640 1 -- 172.21.15.103:0/1319691266 >> v1:172.21.15.103:6789/0 conn(0x7f17e80bf900 legacy=0x7f17e80ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:36.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e559a640 1 --2- 172.21.15.103:0/1319691266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17d00039e0 0x7f17d0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:36.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e559a640 1 --2- 172.21.15.103:0/1319691266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17e8153b70 0x7f17d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:36.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e559a640 1 --2- 172.21.15.103:0/1319691266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17d0004d40 0x7f17d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:36.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e559a640 1 -- 172.21.15.103:0/1319691266 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f17e8157f10 con 0x7f17d00039e0 2024-09-10T08:28:36.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e559a640 1 -- 172.21.15.103:0/1319691266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f17d000bb50 con 0x7f17d0004d40 2024-09-10T08:28:36.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e559a640 1 -- 172.21.15.103:0/1319691266 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f17d000bd20 con 0x7f17e8153b70 2024-09-10T08:28:36.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e659c640 1 --2- 172.21.15.103:0/1319691266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17d00039e0 0x7f17d0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:36.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e5d9b640 1 --2- 172.21.15.103:0/1319691266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17e8153b70 0x7f17d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:36.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e6d9d640 1 --2- 172.21.15.103:0/1319691266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17d0004d40 0x7f17d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:36.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e659c640 1 -- 172.21.15.103:0/1319691266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17e8153b70 msgr2=0x7f17d0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:36.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e659c640 1 --2- 172.21.15.103:0/1319691266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17e8153b70 0x7f17d0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:36.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e659c640 1 -- 172.21.15.103:0/1319691266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17d0004d40 msgr2=0x7f17d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:36.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e659c640 1 --2- 172.21.15.103:0/1319691266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17d0004d40 0x7f17d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:36.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e659c640 1 -- 172.21.15.103:0/1319691266 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17d0003520 con 0x7f17d00039e0 2024-09-10T08:28:36.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.279+0000 7f17e6d9d640 1 --2- 172.21.15.103:0/1319691266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17d0004d40 0x7f17d00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:36.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.280+0000 7f17e659c640 1 --2- 172.21.15.103:0/1319691266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17d00039e0 0x7f17d0003dc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f17d800e170 tx=0x7f17d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e38064f4772346 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:36.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.280+0000 7f17e559a640 1 -- 172.21.15.103:0/1319691266 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d8034020 con 0x7f17d00039e0 2024-09-10T08:28:36.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.280+0000 7f17e559a640 1 -- 172.21.15.103:0/1319691266 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d80305f0 con 0x7f17d00039e0 2024-09-10T08:28:36.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.280+0000 7f17e559a640 1 -- 172.21.15.103:0/1319691266 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d8009c10 con 0x7f17d00039e0 2024-09-10T08:28:36.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.281+0000 7f17ecdd6640 1 -- 172.21.15.103:0/1319691266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17d00039e0 msgr2=0x7f17d0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:36.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.281+0000 7f17ecdd6640 1 --2- 172.21.15.103:0/1319691266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17d00039e0 0x7f17d0003dc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f17d800e170 tx=0x7f17d0005830 comp rx=0 tx=0).stop 2024-09-10T08:28:36.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.281+0000 7f17e6d9d640 1 -- 172.21.15.103:0/1319691266 reap_dead start 2024-09-10T08:28:36.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.281+0000 7f17ecdd6640 1 -- 172.21.15.103:0/1319691266 shutdown_connections 2024-09-10T08:28:36.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.281+0000 7f17ecdd6640 1 -- 172.21.15.103:0/1319691266 >> 172.21.15.103:0/1319691266 conn(0x7f17e80c6a30 msgr2=0x7f17e80c6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:36.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.281+0000 7f17ecdd6640 1 -- 172.21.15.103:0/1319691266 shutdown_connections 2024-09-10T08:28:36.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.281+0000 7f17ecdd6640 1 -- 172.21.15.103:0/1319691266 wait complete. 2024-09-10T08:28:36.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.282+0000 7f17ecdd6640 1 Processor -- start 2024-09-10T08:28:36.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.282+0000 7f17ecdd6640 1 -- start start 2024-09-10T08:28:36.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.283+0000 7f17ecdd6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17d00039e0 0x7f17e80c1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:36.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.283+0000 7f17ecdd6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17e806eed0 0x7f17e806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:36.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.283+0000 7f17ecdd6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17e81eba90 0x7f17e81ebf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:36.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.283+0000 7f17ecdd6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f17e80aefd0 con 0x7f17e806eed0 2024-09-10T08:28:36.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.283+0000 7f17ecdd6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f17e80aee50 con 0x7f17d00039e0 2024-09-10T08:28:36.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.283+0000 7f17ecdd6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f17e8157000 con 0x7f17e81eba90 2024-09-10T08:28:36.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.283+0000 7f17e5d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17e806eed0 0x7f17e806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:36.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.283+0000 7f17e5d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17e806eed0 0x7f17e806f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57466/0 (socket says 172.21.15.103:57466) 2024-09-10T08:28:36.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.283+0000 7f17e5d9b640 1 -- 172.21.15.103:0/632256778 learned_addr learned my addr 172.21.15.103:0/632256778 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:36.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.283+0000 7f17e659c640 1 --2- 172.21.15.103:0/632256778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17d00039e0 0x7f17e80c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:36.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.283+0000 7f17e6d9d640 1 --2- 172.21.15.103:0/632256778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17e81eba90 0x7f17e81ebf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:36.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.283+0000 7f17e5d9b640 1 -- 172.21.15.103:0/632256778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17e81eba90 msgr2=0x7f17e81ebf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:36.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.283+0000 7f17e5d9b640 1 --2- 172.21.15.103:0/632256778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17e81eba90 0x7f17e81ebf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:36.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.283+0000 7f17e5d9b640 1 -- 172.21.15.103:0/632256778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17d00039e0 msgr2=0x7f17e80c1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:36.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.283+0000 7f17e5d9b640 1 --2- 172.21.15.103:0/632256778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17d00039e0 0x7f17e80c1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:36.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.283+0000 7f17e5d9b640 1 -- 172.21.15.103:0/632256778 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e80bf1a0 con 0x7f17e806eed0 2024-09-10T08:28:36.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.283+0000 7f17e5d9b640 1 --2- 172.21.15.103:0/632256778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17e806eed0 0x7f17e806f350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f17dc004e80 tx=0x7f17dc007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:36.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.283+0000 7f17d6ffd640 1 -- 172.21.15.103:0/632256778 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc00f750 con 0x7f17e806eed0 2024-09-10T08:28:36.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.284+0000 7f17d6ffd640 1 -- 172.21.15.103:0/632256778 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17dc018070 con 0x7f17e806eed0 2024-09-10T08:28:36.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.284+0000 7f17d6ffd640 1 -- 172.21.15.103:0/632256778 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc00fb70 con 0x7f17e806eed0 2024-09-10T08:28:36.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.284+0000 7f17ecdd6640 1 -- 172.21.15.103:0/632256778 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17e806f890 con 0x7f17e806eed0 2024-09-10T08:28:36.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.284+0000 7f17ecdd6640 1 -- 172.21.15.103:0/632256778 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17e80bf440 con 0x7f17e806eed0 2024-09-10T08:28:36.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.285+0000 7f17ecdd6640 1 -- 172.21.15.103:0/632256778 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17e80bf640 con 0x7f17e806eed0 2024-09-10T08:28:36.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.285+0000 7f17d6ffd640 1 -- 172.21.15.103:0/632256778 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f17dc00fd10 con 0x7f17e806eed0 2024-09-10T08:28:36.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.285+0000 7f17d6ffd640 1 --2- 172.21.15.103:0/632256778 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f17c806be30 0x7f17c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:36.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.285+0000 7f17d6ffd640 1 -- 172.21.15.103:0/632256778 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f17dc08ac40 con 0x7f17e806eed0 2024-09-10T08:28:36.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.286+0000 7f17e659c640 1 --2- 172.21.15.103:0/632256778 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f17c806be30 0x7f17c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:36.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.286+0000 7f17e659c640 1 --2- 172.21.15.103:0/632256778 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f17c806be30 0x7f17c806e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f17d8035000 tx=0x7f17d803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:36.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.290+0000 7f17d6ffd640 1 -- 172.21.15.103:0/632256778 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f17e80bf640 con 0x7f17e806eed0 2024-09-10T08:28:36.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.489+0000 7f17ecdd6640 1 -- 172.21.15.103:0/632256778 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f17e81573e0 con 0x7f17e806eed0 2024-09-10T08:28:36.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.567+0000 7f17d6ffd640 1 -- 172.21.15.103:0/632256778 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 113+0+0 (secure 0 0 0) 0x7f17dc059690 con 0x7f17e806eed0 2024-09-10T08:28:36.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.570+0000 7f17ecdd6640 1 -- 172.21.15.103:0/632256778 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f17c806be30 msgr2=0x7f17c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:36.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.570+0000 7f17ecdd6640 1 --2- 172.21.15.103:0/632256778 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f17c806be30 0x7f17c806e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f17d8035000 tx=0x7f17d803c040 comp rx=0 tx=0).stop 2024-09-10T08:28:36.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.570+0000 7f17ecdd6640 1 -- 172.21.15.103:0/632256778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17e806eed0 msgr2=0x7f17e806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:36.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.570+0000 7f17ecdd6640 1 --2- 172.21.15.103:0/632256778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17e806eed0 0x7f17e806f350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f17dc004e80 tx=0x7f17dc007430 comp rx=0 tx=0).stop 2024-09-10T08:28:36.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.570+0000 7f17ecdd6640 1 -- 172.21.15.103:0/632256778 shutdown_connections 2024-09-10T08:28:36.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.570+0000 7f17ecdd6640 1 --2- 172.21.15.103:0/632256778 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f17c806be30 0x7f17c806e2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:36.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.570+0000 7f17ecdd6640 1 --2- 172.21.15.103:0/632256778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17e81eba90 0x7f17e81ebf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:36.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.570+0000 7f17ecdd6640 1 --2- 172.21.15.103:0/632256778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17e806eed0 0x7f17e806f350 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:36.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.570+0000 7f17ecdd6640 1 --2- 172.21.15.103:0/632256778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17d00039e0 0x7f17e80c1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:36.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.570+0000 7f17ecdd6640 1 -- 172.21.15.103:0/632256778 >> 172.21.15.103:0/632256778 conn(0x7f17e80c6a30 msgr2=0x7f17e81593f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:36.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.570+0000 7f17ecdd6640 1 -- 172.21.15.103:0/632256778 shutdown_connections 2024-09-10T08:28:36.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.570+0000 7f17ecdd6640 1 -- 172.21.15.103:0/632256778 wait complete. 2024-09-10T08:28:36.581 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-09-10T08:28:36.581 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a allow_standby_replay false 2024-09-10T08:28:36.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.684+0000 7f1028053640 1 Processor -- start 2024-09-10T08:28:36.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.684+0000 7f1028053640 1 -- start start 2024-09-10T08:28:36.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.685+0000 7f1028053640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f10200c4bb0 0x7f1020158090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:36.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.685+0000 7f1028053640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10200ace70 con 0x7f10200c3170 2024-09-10T08:28:36.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.685+0000 7f1028053640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10200c2690 con 0x7f10200c47d0 2024-09-10T08:28:36.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.685+0000 7f1028053640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f10200c2440 con 0x7f10200c4bb0 2024-09-10T08:28:36.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.685+0000 7f10255ee640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f10200c4bb0 0x7f1020158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:36.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.685+0000 7f10255ee640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f10200c4bb0 0x7f1020158090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57470/0 (socket says 172.21.15.103:57470) 2024-09-10T08:28:36.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.685+0000 7f10265f0640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f10200c3170 0x7f10201575c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51154/0 (socket says 172.21.15.103:51154) 2024-09-10T08:28:36.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.685+0000 7f10255ee640 1 -- 172.21.15.103:0/1615288171 learned_addr learned my addr 172.21.15.103:0/1615288171 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:36.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.685+0000 7f10255ee640 1 -- 172.21.15.103:0/1615288171 >> v1:172.21.15.154:6789/0 conn(0x7f10200c47d0 legacy=0x7f10200c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:36.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.685+0000 7f10255ee640 1 -- 172.21.15.103:0/1615288171 >> v1:172.21.15.103:6789/0 conn(0x7f10200c3170 legacy=0x7f10201575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:36.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.685+0000 7f10255ee640 1 -- 172.21.15.103:0/1615288171 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10200c2970 con 0x7f10200c4bb0 2024-09-10T08:28:36.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.686+0000 7f10255ee640 1 --2- 172.21.15.103:0/1615288171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10200c4bb0 0x7f1020158090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f10200c25c0 tx=0x7f101002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d192252f5d4975b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:36.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.686+0000 7f1024ded640 1 -- 172.21.15.103:0/1615288171 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1010037070 con 0x7f10200c4bb0 2024-09-10T08:28:36.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.686+0000 7f1024ded640 1 -- 172.21.15.103:0/1615288171 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1010032440 con 0x7f10200c4bb0 2024-09-10T08:28:36.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.686+0000 7f1024ded640 1 -- 172.21.15.103:0/1615288171 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1010032810 con 0x7f10200c4bb0 2024-09-10T08:28:36.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.686+0000 7f1028053640 1 -- 172.21.15.103:0/1615288171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10200c4bb0 msgr2=0x7f1020158090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:36.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.686+0000 7f1028053640 1 --2- 172.21.15.103:0/1615288171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10200c4bb0 0x7f1020158090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f10200c25c0 tx=0x7f101002a210 comp rx=0 tx=0).stop 2024-09-10T08:28:36.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.686+0000 7f1028053640 1 -- 172.21.15.103:0/1615288171 shutdown_connections 2024-09-10T08:28:36.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.686+0000 7f1028053640 1 --2- 172.21.15.103:0/1615288171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10200c4bb0 0x7f1020158090 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:36.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.686+0000 7f1028053640 1 -- 172.21.15.103:0/1615288171 >> 172.21.15.103:0/1615288171 conn(0x7f102006c210 msgr2=0x7f10200c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:36.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.687+0000 7f1028053640 1 -- 172.21.15.103:0/1615288171 shutdown_connections 2024-09-10T08:28:36.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.687+0000 7f1028053640 1 -- 172.21.15.103:0/1615288171 wait complete. 2024-09-10T08:28:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.688+0000 7f1028053640 1 Processor -- start 2024-09-10T08:28:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.688+0000 7f1028053640 1 -- start start 2024-09-10T08:28:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.688+0000 7f1028053640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10200c3170 0x7f10200726d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.688+0000 7f1028053640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10200c47d0 0x7f1020153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.688+0000 7f1028053640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10200c4bb0 0x7f10201df300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.688+0000 7f1028053640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f10200a74c0 con 0x7f10200c3170 2024-09-10T08:28:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.688+0000 7f1028053640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f10200a7340 con 0x7f10200c4bb0 2024-09-10T08:28:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.688+0000 7f1028053640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f10200aca90 con 0x7f10200c47d0 2024-09-10T08:28:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.688+0000 7f1025def640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10200c3170 0x7f10200726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.688+0000 7f1025def640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10200c3170 0x7f10200726d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57482/0 (socket says 172.21.15.103:57482) 2024-09-10T08:28:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.688+0000 7f1025def640 1 -- 172.21.15.103:0/2428107385 learned_addr learned my addr 172.21.15.103:0/2428107385 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.689+0000 7f10255ee640 1 --2- 172.21.15.103:0/2428107385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10200c47d0 0x7f1020153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.689+0000 7f1025def640 1 -- 172.21.15.103:0/2428107385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10200c47d0 msgr2=0x7f1020153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.689+0000 7f1025def640 1 --2- 172.21.15.103:0/2428107385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10200c47d0 0x7f1020153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.689+0000 7f1025def640 1 -- 172.21.15.103:0/2428107385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10200c4bb0 msgr2=0x7f10201df300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.689+0000 7f10265f0640 1 --2- 172.21.15.103:0/2428107385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10200c4bb0 0x7f10201df300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.689+0000 7f1025def640 1 --2- 172.21.15.103:0/2428107385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10200c4bb0 0x7f10201df300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.689+0000 7f1025def640 1 -- 172.21.15.103:0/2428107385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10200745e0 con 0x7f10200c3170 2024-09-10T08:28:36.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.689+0000 7f10255ee640 1 --2- 172.21.15.103:0/2428107385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10200c47d0 0x7f1020153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:36.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.689+0000 7f1025def640 1 --2- 172.21.15.103:0/2428107385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10200c3170 0x7f10200726d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f101c00c410 tx=0x7f101c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:36.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.689+0000 7f10167fc640 1 -- 172.21.15.103:0/2428107385 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c017070 con 0x7f10200c3170 2024-09-10T08:28:36.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.689+0000 7f10167fc640 1 -- 172.21.15.103:0/2428107385 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f101c0035f0 con 0x7f10200c3170 2024-09-10T08:28:36.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.689+0000 7f1028053640 1 -- 172.21.15.103:0/2428107385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1020071780 con 0x7f10200c3170 2024-09-10T08:28:36.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.689+0000 7f10167fc640 1 -- 172.21.15.103:0/2428107385 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c003a20 con 0x7f10200c3170 2024-09-10T08:28:36.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.689+0000 7f1028053640 1 -- 172.21.15.103:0/2428107385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1020074880 con 0x7f10200c3170 2024-09-10T08:28:36.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.690+0000 7f1028053640 1 -- 172.21.15.103:0/2428107385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10200c35a0 con 0x7f10200c3170 2024-09-10T08:28:36.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.691+0000 7f10167fc640 1 -- 172.21.15.103:0/2428107385 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f101c01a070 con 0x7f10200c3170 2024-09-10T08:28:36.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.691+0000 7f10167fc640 1 --2- 172.21.15.103:0/2428107385 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f100406be30 0x7f100406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:36.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.691+0000 7f10167fc640 1 -- 172.21.15.103:0/2428107385 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f101c08a270 con 0x7f10200c3170 2024-09-10T08:28:36.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.691+0000 7f10255ee640 1 --2- 172.21.15.103:0/2428107385 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f100406be30 0x7f100406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:36.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.692+0000 7f10255ee640 1 --2- 172.21.15.103:0/2428107385 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f100406be30 0x7f100406e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1010034000 tx=0x7f101002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.695+0000 7f10167fc640 1 -- 172.21.15.103:0/2428107385 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f101c058cc0 con 0x7f10200c3170 2024-09-10T08:28:36.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:36.897+0000 7f1028053640 1 -- 172.21.15.103:0/2428107385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f1020155bc0 con 0x7f10200c3170 2024-09-10T08:28:37.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.572+0000 7f10167fc640 1 -- 172.21.15.103:0/2428107385 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 117+0+0 (secure 0 0 0) 0x7f101c0010c0 con 0x7f10200c3170 2024-09-10T08:28:37.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.574+0000 7f1028053640 1 -- 172.21.15.103:0/2428107385 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f100406be30 msgr2=0x7f100406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:37.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.574+0000 7f1028053640 1 --2- 172.21.15.103:0/2428107385 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f100406be30 0x7f100406e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1010034000 tx=0x7f101002e000 comp rx=0 tx=0).stop 2024-09-10T08:28:37.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.574+0000 7f1028053640 1 -- 172.21.15.103:0/2428107385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10200c3170 msgr2=0x7f10200726d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:37.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.574+0000 7f1028053640 1 --2- 172.21.15.103:0/2428107385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10200c3170 0x7f10200726d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f101c00c410 tx=0x7f101c00c8d0 comp rx=0 tx=0).stop 2024-09-10T08:28:37.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.574+0000 7f1028053640 1 -- 172.21.15.103:0/2428107385 shutdown_connections 2024-09-10T08:28:37.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.574+0000 7f1028053640 1 --2- 172.21.15.103:0/2428107385 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f100406be30 0x7f100406e2f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:37.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.574+0000 7f1028053640 1 --2- 172.21.15.103:0/2428107385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10200c4bb0 0x7f10201df300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:37.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.574+0000 7f1028053640 1 --2- 172.21.15.103:0/2428107385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10200c47d0 0x7f1020153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:37.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.574+0000 7f1028053640 1 --2- 172.21.15.103:0/2428107385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10200c3170 0x7f10200726d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:37.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.575+0000 7f1028053640 1 -- 172.21.15.103:0/2428107385 >> 172.21.15.103:0/2428107385 conn(0x7f102006c210 msgr2=0x7f1020157370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:37.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.575+0000 7f1028053640 1 -- 172.21.15.103:0/2428107385 shutdown_connections 2024-09-10T08:28:37.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.575+0000 7f1028053640 1 -- 172.21.15.103:0/2428107385 wait complete. 2024-09-10T08:28:37.587 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a session_timeout 300 2024-09-10T08:28:37.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.691+0000 7ff8d8126640 1 Processor -- start 2024-09-10T08:28:37.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.691+0000 7ff8d8126640 1 -- start start 2024-09-10T08:28:37.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.692+0000 7ff8d8126640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8d0153a80 0x7ff8d00c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:37.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.692+0000 7ff8d8126640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff8d0073730 0x7ff8d00c5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:37.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.692+0000 7ff8d8126640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8d00c5c70 con 0x7ff8d00c9fd0 2024-09-10T08:28:37.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.692+0000 7ff8d8126640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7ff8d0073fc0 con 0x7ff8d0073730 2024-09-10T08:28:37.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.692+0000 7ff8d8126640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff8d00c4950 con 0x7ff8d0153a80 2024-09-10T08:28:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.692+0000 7ff8d56c1640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff8d0073730 0x7ff8d00c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.692+0000 7ff8d66c3640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff8d00c9fd0 0x7ff8d00c5560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51164/0 (socket says 172.21.15.103:51164) 2024-09-10T08:28:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.692+0000 7ff8d56c1640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff8d0073730 0x7ff8d00c5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57488/0 (socket says 172.21.15.103:57488) 2024-09-10T08:28:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.692+0000 7ff8d66c3640 1 -- 172.21.15.103:0/299855595 learned_addr learned my addr 172.21.15.103:0/299855595 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.692+0000 7ff8d5ec2640 1 --2- 172.21.15.103:0/299855595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8d0153a80 0x7ff8d00c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.692+0000 7ff8d56c1640 1 -- 172.21.15.103:0/299855595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8d0153a80 msgr2=0x7ff8d00c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.692+0000 7ff8d56c1640 1 --2- 172.21.15.103:0/299855595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8d0153a80 0x7ff8d00c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.692+0000 7ff8d56c1640 1 -- 172.21.15.103:0/299855595 >> v1:172.21.15.103:6789/0 conn(0x7ff8d00c9fd0 legacy=0x7ff8d00c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.692+0000 7ff8d4ec0640 1 -- 172.21.15.103:0/299855595 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1335877266 0 0) 0x7ff8d00c5c70 con 0x7ff8d00c9fd0 2024-09-10T08:28:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.692+0000 7ff8d56c1640 1 -- 172.21.15.103:0/299855595 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d00c4670 con 0x7ff8d0073730 2024-09-10T08:28:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.693+0000 7ff8d56c1640 1 --2- 172.21.15.103:0/299855595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d0073730 0x7ff8d00c5020 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff8c00097a0 tx=0x7ff8c002a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2944a2c28d21415a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.693+0000 7ff8d4ec0640 1 -- 172.21.15.103:0/299855595 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0037070 con 0x7ff8d0073730 2024-09-10T08:28:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.693+0000 7ff8d4ec0640 1 -- 172.21.15.103:0/299855595 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c002adb0 con 0x7ff8d0073730 2024-09-10T08:28:37.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.693+0000 7ff8d4ec0640 1 -- 172.21.15.103:0/299855595 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0032660 con 0x7ff8d0073730 2024-09-10T08:28:37.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.694+0000 7ff8d8126640 1 -- 172.21.15.103:0/299855595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d0073730 msgr2=0x7ff8d00c5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:37.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.694+0000 7ff8d8126640 1 --2- 172.21.15.103:0/299855595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d0073730 0x7ff8d00c5020 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff8c00097a0 tx=0x7ff8c002a060 comp rx=0 tx=0).stop 2024-09-10T08:28:37.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.694+0000 7ff8d8126640 1 -- 172.21.15.103:0/299855595 shutdown_connections 2024-09-10T08:28:37.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.694+0000 7ff8d8126640 1 --2- 172.21.15.103:0/299855595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d0073730 0x7ff8d00c5020 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:37.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.694+0000 7ff8d8126640 1 --2- 172.21.15.103:0/299855595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8d0153a80 0x7ff8d00c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:37.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.694+0000 7ff8d8126640 1 -- 172.21.15.103:0/299855595 >> 172.21.15.103:0/299855595 conn(0x7ff8d0067950 msgr2=0x7ff8d0067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:37.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.694+0000 7ff8d8126640 1 -- 172.21.15.103:0/299855595 shutdown_connections 2024-09-10T08:28:37.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.694+0000 7ff8d8126640 1 -- 172.21.15.103:0/299855595 wait complete. 2024-09-10T08:28:37.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.695+0000 7ff8d8126640 1 Processor -- start 2024-09-10T08:28:37.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.695+0000 7ff8d8126640 1 -- start start 2024-09-10T08:28:37.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8d8126640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8d0073730 0x7ff8d01494b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:37.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8d8126640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8d00c9fd0 0x7ff8d01e1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:37.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8d8126640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d0153a80 0x7ff8d01ecfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:37.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8d8126640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d0073be0 con 0x7ff8d0153a80 2024-09-10T08:28:37.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8d8126640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d006e870 con 0x7ff8d00c9fd0 2024-09-10T08:28:37.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8d8126640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff8d0073d60 con 0x7ff8d0073730 2024-09-10T08:28:37.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8d66c3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d0153a80 0x7ff8d01ecfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:37.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8d66c3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d0153a80 0x7ff8d01ecfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57498/0 (socket says 172.21.15.103:57498) 2024-09-10T08:28:37.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8d66c3640 1 -- 172.21.15.103:0/4210673733 learned_addr learned my addr 172.21.15.103:0/4210673733 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:37.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8d56c1640 1 --2- 172.21.15.103:0/4210673733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8d00c9fd0 0x7ff8d01e1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:37.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8d5ec2640 1 --2- 172.21.15.103:0/4210673733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8d0073730 0x7ff8d01494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:37.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8d66c3640 1 -- 172.21.15.103:0/4210673733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8d0073730 msgr2=0x7ff8d01494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:37.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8d66c3640 1 --2- 172.21.15.103:0/4210673733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8d0073730 0x7ff8d01494b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:37.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8d66c3640 1 -- 172.21.15.103:0/4210673733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8d00c9fd0 msgr2=0x7ff8d01e1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:37.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8d66c3640 1 --2- 172.21.15.103:0/4210673733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8d00c9fd0 0x7ff8d01e1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:37.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8d66c3640 1 -- 172.21.15.103:0/4210673733 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d01530c0 con 0x7ff8d0153a80 2024-09-10T08:28:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8d56c1640 1 --2- 172.21.15.103:0/4210673733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8d00c9fd0 0x7ff8d01e1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8d66c3640 1 --2- 172.21.15.103:0/4210673733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d0153a80 0x7ff8d01ecfb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00c480 tx=0x7ff8cc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8c67fc640 1 -- 172.21.15.103:0/4210673733 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc018070 con 0x7ff8d0153a80 2024-09-10T08:28:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8c67fc640 1 -- 172.21.15.103:0/4210673733 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8cc007500 con 0x7ff8d0153a80 2024-09-10T08:28:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8d8126640 1 -- 172.21.15.103:0/4210673733 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8d0148cb0 con 0x7ff8d0153a80 2024-09-10T08:28:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8c67fc640 1 -- 172.21.15.103:0/4210673733 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc004a20 con 0x7ff8d0153a80 2024-09-10T08:28:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.696+0000 7ff8d8126640 1 -- 172.21.15.103:0/4210673733 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8d01e22d0 con 0x7ff8d0153a80 2024-09-10T08:28:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.697+0000 7ff8d8126640 1 -- 172.21.15.103:0/4210673733 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8d0072cf0 con 0x7ff8d0153a80 2024-09-10T08:28:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.698+0000 7ff8c67fc640 1 -- 172.21.15.103:0/4210673733 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff8cc01b070 con 0x7ff8d0153a80 2024-09-10T08:28:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.698+0000 7ff8c67fc640 1 --2- 172.21.15.103:0/4210673733 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff8b406be60 0x7ff8b406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.698+0000 7ff8c67fc640 1 -- 172.21.15.103:0/4210673733 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7ff8cc08a140 con 0x7ff8d0153a80 2024-09-10T08:28:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.698+0000 7ff8d5ec2640 1 --2- 172.21.15.103:0/4210673733 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff8b406be60 0x7ff8b406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.699+0000 7ff8d5ec2640 1 --2- 172.21.15.103:0/4210673733 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff8b406be60 0x7ff8b406e320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80099c0 tx=0x7ff8c8003990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:37.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.703+0000 7ff8c67fc640 1 -- 172.21.15.103:0/4210673733 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff8cc058c50 con 0x7ff8d0153a80 2024-09-10T08:28:37.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:37.903+0000 7ff8d8126640 1 -- 172.21.15.103:0/4210673733 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"} v 0) -- 0x7ff8d00afe30 con 0x7ff8d0153a80 2024-09-10T08:28:38.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.573+0000 7ff8c67fc640 1 -- 172.21.15.103:0/4210673733 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"}]=0 v7) ==== 110+0+0 (secure 0 0 0) 0x7ff8cc058550 con 0x7ff8d0153a80 2024-09-10T08:28:38.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.576+0000 7ff8d8126640 1 -- 172.21.15.103:0/4210673733 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff8b406be60 msgr2=0x7ff8b406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:38.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.576+0000 7ff8d8126640 1 --2- 172.21.15.103:0/4210673733 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff8b406be60 0x7ff8b406e320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80099c0 tx=0x7ff8c8003990 comp rx=0 tx=0).stop 2024-09-10T08:28:38.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.576+0000 7ff8d8126640 1 -- 172.21.15.103:0/4210673733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d0153a80 msgr2=0x7ff8d01ecfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:38.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.576+0000 7ff8d8126640 1 --2- 172.21.15.103:0/4210673733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d0153a80 0x7ff8d01ecfb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00c480 tx=0x7ff8cc00c940 comp rx=0 tx=0).stop 2024-09-10T08:28:38.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.576+0000 7ff8d8126640 1 -- 172.21.15.103:0/4210673733 shutdown_connections 2024-09-10T08:28:38.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.576+0000 7ff8d8126640 1 --2- 172.21.15.103:0/4210673733 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff8b406be60 0x7ff8b406e320 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:38.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.576+0000 7ff8d8126640 1 --2- 172.21.15.103:0/4210673733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8d0153a80 0x7ff8d01ecfb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:38.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.576+0000 7ff8d8126640 1 --2- 172.21.15.103:0/4210673733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8d00c9fd0 0x7ff8d01e1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:38.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.576+0000 7ff8d8126640 1 --2- 172.21.15.103:0/4210673733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8d0073730 0x7ff8d01494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:38.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.576+0000 7ff8d8126640 1 -- 172.21.15.103:0/4210673733 >> 172.21.15.103:0/4210673733 conn(0x7ff8d0067950 msgr2=0x7ff8d0152840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:38.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.576+0000 7ff8d8126640 1 -- 172.21.15.103:0/4210673733 shutdown_connections 2024-09-10T08:28:38.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.576+0000 7ff8d8126640 1 -- 172.21.15.103:0/4210673733 wait complete. 2024-09-10T08:28:38.590 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'a' 2024-09-10T08:28:38.590 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:28:38.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.693+0000 7f962cb31640 1 Processor -- start 2024-09-10T08:28:38.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.693+0000 7f962cb31640 1 -- start start 2024-09-10T08:28:38.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f962cb31640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9628153af0 0x7f96281563a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:38.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f962cb31640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f96280afdd0 0x7f96280c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:38.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f962cb31640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96280c54e0 con 0x7f96280af870 2024-09-10T08:28:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f962cb31640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f96280c74a0 con 0x7f96280afdd0 2024-09-10T08:28:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f962cb31640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f96280c7740 con 0x7f9628153af0 2024-09-10T08:28:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f9626d9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f96280af870 0x7f96280c4780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51176/0 (socket says 172.21.15.103:51176) 2024-09-10T08:28:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f9626d9d640 1 -- 172.21.15.103:0/1166561632 learned_addr learned my addr 172.21.15.103:0/1166561632 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f961dd9b640 1 --2- 172.21.15.103:0/1166561632 >> v2:172.21.15.154:3300/0 conn(0x7f96280afdd0 0x7f96280c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f9625d9b640 1 -- 172.21.15.103:0/1166561632 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 586396646 0 0) 0x7f96280c54e0 con 0x7f96280af870 2024-09-10T08:28:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f962659c640 1 --2- 172.21.15.103:0/1166561632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9628153af0 0x7f96281563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f9625d9b640 1 -- 172.21.15.103:0/1166561632 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9614003520 con 0x7f96280af870 2024-09-10T08:28:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f9625d9b640 1 -- 172.21.15.103:0/1166561632 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1401836297 0 0) 0x7f9614003520 con 0x7f96280af870 2024-09-10T08:28:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f9625d9b640 1 -- 172.21.15.103:0/1166561632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9628153af0 msgr2=0x7f96281563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:38.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f9625d9b640 1 --2- 172.21.15.103:0/1166561632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9628153af0 0x7f96281563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f9625d9b640 1 -- 172.21.15.103:0/1166561632 >> v2:172.21.15.154:3300/0 conn(0x7f96280afdd0 msgr2=0x7f96280c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f9625d9b640 1 --2- 172.21.15.103:0/1166561632 >> v2:172.21.15.154:3300/0 conn(0x7f96280afdd0 0x7f96280c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f9625d9b640 1 -- 172.21.15.103:0/1166561632 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f962815a3c0 con 0x7f96280af870 2024-09-10T08:28:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f9625d9b640 1 -- 172.21.15.103:0/1166561632 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f96200019f0 con 0x7f96280af870 2024-09-10T08:28:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f9625d9b640 1 -- 172.21.15.103:0/1166561632 >> v1:172.21.15.103:6789/0 conn(0x7f96280af870 legacy=0x7f96280c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f9625d9b640 1 --2- 172.21.15.103:0/1166561632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96140039b0 0x7f9614003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f9625d9b640 1 --2- 172.21.15.103:0/1166561632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9628153af0 0x7f9614004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f9625d9b640 1 --2- 172.21.15.103:0/1166561632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9614004d40 0x7f96140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f9625d9b640 1 -- 172.21.15.103:0/1166561632 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f96280c74a0 con 0x7f9614004d40 2024-09-10T08:28:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f9625d9b640 1 -- 172.21.15.103:0/1166561632 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f96280c7740 con 0x7f96140039b0 2024-09-10T08:28:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f9625d9b640 1 -- 172.21.15.103:0/1166561632 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f961400ba40 con 0x7f9628153af0 2024-09-10T08:28:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f9626d9d640 1 --2- 172.21.15.103:0/1166561632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9614004d40 0x7f96140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.694+0000 7f961dd9b640 1 --2- 172.21.15.103:0/1166561632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9628153af0 0x7f9614004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.695+0000 7f962659c640 1 --2- 172.21.15.103:0/1166561632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96140039b0 0x7f9614003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.695+0000 7f9626d9d640 1 -- 172.21.15.103:0/1166561632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9628153af0 msgr2=0x7f9614004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.695+0000 7f9626d9d640 1 --2- 172.21.15.103:0/1166561632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9628153af0 0x7f9614004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.695+0000 7f9626d9d640 1 -- 172.21.15.103:0/1166561632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96140039b0 msgr2=0x7f9614003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.695+0000 7f9626d9d640 1 --2- 172.21.15.103:0/1166561632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96140039b0 0x7f9614003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.695+0000 7f9626d9d640 1 -- 172.21.15.103:0/1166561632 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9614003520 con 0x7f9614004d40 2024-09-10T08:28:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.695+0000 7f9626d9d640 1 --2- 172.21.15.103:0/1166561632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9614004d40 0x7f96140051c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f96200013d0 tx=0x7f9614005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766334c4fcafd1a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.696+0000 7f9625d9b640 1 -- 172.21.15.103:0/1166561632 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962000a4e0 con 0x7f9614004d40 2024-09-10T08:28:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.696+0000 7f9625d9b640 1 -- 172.21.15.103:0/1166561632 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f962002f070 con 0x7f9614004d40 2024-09-10T08:28:38.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.696+0000 7f9625d9b640 1 -- 172.21.15.103:0/1166561632 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962002bce0 con 0x7f9614004d40 2024-09-10T08:28:38.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.696+0000 7f962cb31640 1 -- 172.21.15.103:0/1166561632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9614004d40 msgr2=0x7f96140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:38.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.696+0000 7f962cb31640 1 --2- 172.21.15.103:0/1166561632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9614004d40 0x7f96140051c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f96200013d0 tx=0x7f9614005830 comp rx=0 tx=0).stop 2024-09-10T08:28:38.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.696+0000 7f9626d9d640 1 -- 172.21.15.103:0/1166561632 reap_dead start 2024-09-10T08:28:38.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.696+0000 7f962cb31640 1 -- 172.21.15.103:0/1166561632 shutdown_connections 2024-09-10T08:28:38.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.696+0000 7f962cb31640 1 -- 172.21.15.103:0/1166561632 >> 172.21.15.103:0/1166561632 conn(0x7f96280c6880 msgr2=0x7f96280c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:38.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.696+0000 7f962cb31640 1 -- 172.21.15.103:0/1166561632 shutdown_connections 2024-09-10T08:28:38.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.696+0000 7f962cb31640 1 -- 172.21.15.103:0/1166561632 wait complete. 2024-09-10T08:28:38.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.698+0000 7f962cb31640 1 Processor -- start 2024-09-10T08:28:38.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.698+0000 7f962cb31640 1 -- start start 2024-09-10T08:28:38.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.698+0000 7f962cb31640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9614004d40 0x7f96281ec020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:38.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.698+0000 7f962cb31640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96280c2000 0x7f962814e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:38.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.698+0000 7f962cb31640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96281541d0 0x7f9628156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:38.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.698+0000 7f962cb31640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9628154050 con 0x7f9614004d40 2024-09-10T08:28:38.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.698+0000 7f962cb31640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9628153ed0 con 0x7f96280c2000 2024-09-10T08:28:38.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.698+0000 7f962cb31640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f96280c4e90 con 0x7f96281541d0 2024-09-10T08:28:38.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.698+0000 7f962659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9614004d40 0x7f96281ec020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:38.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.698+0000 7f962659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9614004d40 0x7f96281ec020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57512/0 (socket says 172.21.15.103:57512) 2024-09-10T08:28:38.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.698+0000 7f962659c640 1 -- 172.21.15.103:0/2687942069 learned_addr learned my addr 172.21.15.103:0/2687942069 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:38.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.698+0000 7f9626d9d640 1 --2- 172.21.15.103:0/2687942069 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96281541d0 0x7f9628156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:38.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.698+0000 7f961dd9b640 1 --2- 172.21.15.103:0/2687942069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96280c2000 0x7f962814e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:38.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.699+0000 7f962659c640 1 -- 172.21.15.103:0/2687942069 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96281541d0 msgr2=0x7f9628156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:38.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.699+0000 7f962659c640 1 --2- 172.21.15.103:0/2687942069 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96281541d0 0x7f9628156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:38.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.699+0000 7f962659c640 1 -- 172.21.15.103:0/2687942069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96280c2000 msgr2=0x7f962814e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:38.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.699+0000 7f962659c640 1 --2- 172.21.15.103:0/2687942069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96280c2000 0x7f962814e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:38.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.699+0000 7f962659c640 1 -- 172.21.15.103:0/2687942069 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f962814ef70 con 0x7f9614004d40 2024-09-10T08:28:38.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.699+0000 7f962659c640 1 --2- 172.21.15.103:0/2687942069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9614004d40 0x7f96281ec020 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f96180118e0 tx=0x7f9618011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:38.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.699+0000 7f961f7fe640 1 -- 172.21.15.103:0/2687942069 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961800f9d0 con 0x7f9614004d40 2024-09-10T08:28:38.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.699+0000 7f961f7fe640 1 -- 172.21.15.103:0/2687942069 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f961800fb70 con 0x7f9614004d40 2024-09-10T08:28:38.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.699+0000 7f962cb31640 1 -- 172.21.15.103:0/2687942069 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96281eb560 con 0x7f9614004d40 2024-09-10T08:28:38.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.699+0000 7f961f7fe640 1 -- 172.21.15.103:0/2687942069 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9618014440 con 0x7f9614004d40 2024-09-10T08:28:38.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.699+0000 7f962cb31640 1 -- 172.21.15.103:0/2687942069 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96281eb820 con 0x7f9614004d40 2024-09-10T08:28:38.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.700+0000 7f962cb31640 1 -- 172.21.15.103:0/2687942069 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96280c5900 con 0x7f9614004d40 2024-09-10T08:28:38.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.701+0000 7f961f7fe640 1 -- 172.21.15.103:0/2687942069 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9618012040 con 0x7f9614004d40 2024-09-10T08:28:38.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.701+0000 7f961f7fe640 1 --2- 172.21.15.103:0/2687942069 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f960806be30 0x7f960806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:38.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.701+0000 7f961f7fe640 1 -- 172.21.15.103:0/2687942069 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f961808b2c0 con 0x7f9614004d40 2024-09-10T08:28:38.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.701+0000 7f961dd9b640 1 --2- 172.21.15.103:0/2687942069 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f960806be30 0x7f960806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:38.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.701+0000 7f961dd9b640 1 --2- 172.21.15.103:0/2687942069 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f960806be30 0x7f960806e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f96280706d0 tx=0x7f9610009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:38.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.705+0000 7f961f7fe640 1 -- 172.21.15.103:0/2687942069 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9618019030 con 0x7f9614004d40 2024-09-10T08:28:38.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.906+0000 7f962cb31640 1 -- 172.21.15.103:0/2687942069 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96280c3d60 con 0x7f9614004d40 2024-09-10T08:28:38.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.907+0000 7f961f7fe640 1 -- 172.21.15.103:0/2687942069 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5225 (secure 0 0 0) 0x7f9618059d10 con 0x7f9614004d40 2024-09-10T08:28:38.908 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:38.908 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":7,"btime":"2024-09-10T08:28:38:573857+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3378269214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3378269214},{"type":"v1","addr":"172.21.15.154:6833","nonce":3378269214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2141115327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2141115327},{"type":"v1","addr":"172.21.15.154:6835","nonce":2141115327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/2250136134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2250136134},{"type":"v1","addr":"172.21.15.103:6836","nonce":2250136134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:34.885455+0000","modified":"2024-09-10T08:28:37.905202+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/3032037784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":3032037784},{"type":"v1","addr":"172.21.15.103:6837","nonce":3032037784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-09-10T08:28:38.908 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 7 2024-09-10T08:28:38.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.909+0000 7f962cb31640 1 -- 172.21.15.103:0/2687942069 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f960806be30 msgr2=0x7f960806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:38.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.909+0000 7f962cb31640 1 --2- 172.21.15.103:0/2687942069 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f960806be30 0x7f960806e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f96280706d0 tx=0x7f9610009190 comp rx=0 tx=0).stop 2024-09-10T08:28:38.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.909+0000 7f962cb31640 1 -- 172.21.15.103:0/2687942069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9614004d40 msgr2=0x7f96281ec020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:38.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.909+0000 7f962cb31640 1 --2- 172.21.15.103:0/2687942069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9614004d40 0x7f96281ec020 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f96180118e0 tx=0x7f9618011ce0 comp rx=0 tx=0).stop 2024-09-10T08:28:38.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.909+0000 7f962cb31640 1 -- 172.21.15.103:0/2687942069 shutdown_connections 2024-09-10T08:28:38.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.909+0000 7f962cb31640 1 --2- 172.21.15.103:0/2687942069 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f960806be30 0x7f960806e2f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:38.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.909+0000 7f962cb31640 1 --2- 172.21.15.103:0/2687942069 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96281541d0 0x7f9628156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:38.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.909+0000 7f962cb31640 1 --2- 172.21.15.103:0/2687942069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96280c2000 0x7f962814e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:38.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.909+0000 7f962cb31640 1 --2- 172.21.15.103:0/2687942069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9614004d40 0x7f96281ec020 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:38.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.909+0000 7f962cb31640 1 -- 172.21.15.103:0/2687942069 >> 172.21.15.103:0/2687942069 conn(0x7f96280c6880 msgr2=0x7f9628151b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:38.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.909+0000 7f962cb31640 1 -- 172.21.15.103:0/2687942069 shutdown_connections 2024-09-10T08:28:38.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:38.909+0000 7f962cb31640 1 -- 172.21.15.103:0/2687942069 wait complete. 2024-09-10T08:28:38.921 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:28:39.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.019+0000 7f39d8b6d640 1 Processor -- start 2024-09-10T08:28:39.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.019+0000 7f39d8b6d640 1 -- start start 2024-09-10T08:28:39.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.020+0000 7f39d8b6d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f39d4073ae0 0x7f39d4153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.020+0000 7f39d8b6d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f39d40733d0 0x7f39d41538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.020+0000 7f39d8b6d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39d406dd50 con 0x7f39d406d850 2024-09-10T08:28:39.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.020+0000 7f39d8b6d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f39d406e030 con 0x7f39d40733d0 2024-09-10T08:28:39.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.020+0000 7f39d8b6d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f39d406e310 con 0x7f39d4073ae0 2024-09-10T08:28:39.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.020+0000 7f39d1d9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f39d40733d0 0x7f39d41538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.020+0000 7f39d2d9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f39d406d850 0x7f39d4156840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51190/0 (socket says 172.21.15.103:51190) 2024-09-10T08:28:39.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.020+0000 7f39d1d9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f39d40733d0 0x7f39d41538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57520/0 (socket says 172.21.15.103:57520) 2024-09-10T08:28:39.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.020+0000 7f39d2d9d640 1 -- 172.21.15.103:0/4145016026 learned_addr learned my addr 172.21.15.103:0/4145016026 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:39.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.020+0000 7f39d259c640 1 --2- 172.21.15.103:0/4145016026 >> v2:172.21.15.154:3300/0 conn(0x7f39d4073ae0 0x7f39d4153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.020+0000 7f39d1d9b640 1 -- 172.21.15.103:0/4145016026 >> v2:172.21.15.154:3300/0 conn(0x7f39d4073ae0 msgr2=0x7f39d4153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:39.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.020+0000 7f39d1d9b640 1 --2- 172.21.15.103:0/4145016026 >> v2:172.21.15.154:3300/0 conn(0x7f39d4073ae0 0x7f39d4153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.020+0000 7f39d1d9b640 1 -- 172.21.15.103:0/4145016026 >> v1:172.21.15.103:6789/0 conn(0x7f39d406d850 legacy=0x7f39d4156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.020+0000 7f39d159a640 1 -- 172.21.15.103:0/4145016026 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 774326902 0 0) 0x7f39d406dd50 con 0x7f39d406d850 2024-09-10T08:28:39.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.020+0000 7f39d1d9b640 1 -- 172.21.15.103:0/4145016026 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d406e5f0 con 0x7f39d40733d0 2024-09-10T08:28:39.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.021+0000 7f39d1d9b640 1 --2- 172.21.15.103:0/4145016026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d40733d0 0x7f39d41538c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f39d4076720 tx=0x7f39c802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd296f10220babf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:39.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.021+0000 7f39d159a640 1 -- 172.21.15.103:0/4145016026 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c8037070 con 0x7f39d40733d0 2024-09-10T08:28:39.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.021+0000 7f39d159a640 1 -- 172.21.15.103:0/4145016026 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c8032440 con 0x7f39d40733d0 2024-09-10T08:28:39.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.021+0000 7f39d159a640 1 -- 172.21.15.103:0/4145016026 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c8032810 con 0x7f39d40733d0 2024-09-10T08:28:39.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.022+0000 7f39d8b6d640 1 -- 172.21.15.103:0/4145016026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d40733d0 msgr2=0x7f39d41538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.022+0000 7f39d8b6d640 1 --2- 172.21.15.103:0/4145016026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d40733d0 0x7f39d41538c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f39d4076720 tx=0x7f39c802a1a0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.022+0000 7f39d8b6d640 1 -- 172.21.15.103:0/4145016026 shutdown_connections 2024-09-10T08:28:39.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.022+0000 7f39d8b6d640 1 --2- 172.21.15.103:0/4145016026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d40733d0 0x7f39d41538c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.022+0000 7f39d8b6d640 1 --2- 172.21.15.103:0/4145016026 >> v2:172.21.15.154:3300/0 conn(0x7f39d4073ae0 0x7f39d4153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.022+0000 7f39d8b6d640 1 -- 172.21.15.103:0/4145016026 >> 172.21.15.103:0/4145016026 conn(0x7f39d40c9d80 msgr2=0x7f39d40ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:39.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.022+0000 7f39d8b6d640 1 -- 172.21.15.103:0/4145016026 shutdown_connections 2024-09-10T08:28:39.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.022+0000 7f39d8b6d640 1 -- 172.21.15.103:0/4145016026 wait complete. 2024-09-10T08:28:39.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.023+0000 7f39d8b6d640 1 Processor -- start 2024-09-10T08:28:39.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.023+0000 7f39d8b6d640 1 -- start start 2024-09-10T08:28:39.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39d8b6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39d406d850 0x7f39d41463e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39d8b6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39d40733d0 0x7f39d40c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39d8b6d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d4073ae0 0x7f39d41414c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39d8b6d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f39d406edd0 con 0x7f39d4073ae0 2024-09-10T08:28:39.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39d8b6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f39d406ec50 con 0x7f39d40733d0 2024-09-10T08:28:39.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39d8b6d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f39d4073ec0 con 0x7f39d406d850 2024-09-10T08:28:39.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39d2d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d4073ae0 0x7f39d41414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39d2d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d4073ae0 0x7f39d41414c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57524/0 (socket says 172.21.15.103:57524) 2024-09-10T08:28:39.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39d2d9d640 1 -- 172.21.15.103:0/3901445501 learned_addr learned my addr 172.21.15.103:0/3901445501 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:39.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39d1d9b640 1 --2- 172.21.15.103:0/3901445501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39d40733d0 0x7f39d40c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39d259c640 1 --2- 172.21.15.103:0/3901445501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39d406d850 0x7f39d41463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39d2d9d640 1 -- 172.21.15.103:0/3901445501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39d406d850 msgr2=0x7f39d41463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39d2d9d640 1 --2- 172.21.15.103:0/3901445501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39d406d850 0x7f39d41463e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39d2d9d640 1 -- 172.21.15.103:0/3901445501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39d40733d0 msgr2=0x7f39d40c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39d2d9d640 1 --2- 172.21.15.103:0/3901445501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39d40733d0 0x7f39d40c8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39d2d9d640 1 -- 172.21.15.103:0/3901445501 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d41ef820 con 0x7f39d4073ae0 2024-09-10T08:28:39.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39d1d9b640 1 --2- 172.21.15.103:0/3901445501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39d40733d0 0x7f39d40c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:39.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39d259c640 1 --2- 172.21.15.103:0/3901445501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39d406d850 0x7f39d41463e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:39.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39d2d9d640 1 --2- 172.21.15.103:0/3901445501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d4073ae0 0x7f39d41414c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00c780 tx=0x7f39cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:39.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39c2ffd640 1 -- 172.21.15.103:0/3901445501 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc018070 con 0x7f39d4073ae0 2024-09-10T08:28:39.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39c2ffd640 1 -- 172.21.15.103:0/3901445501 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39cc00a640 con 0x7f39d4073ae0 2024-09-10T08:28:39.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39d8b6d640 1 -- 172.21.15.103:0/3901445501 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d41efb00 con 0x7f39d4073ae0 2024-09-10T08:28:39.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.024+0000 7f39c2ffd640 1 -- 172.21.15.103:0/3901445501 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc00aa70 con 0x7f39d4073ae0 2024-09-10T08:28:39.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.025+0000 7f39d8b6d640 1 -- 172.21.15.103:0/3901445501 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d414fd30 con 0x7f39d4073ae0 2024-09-10T08:28:39.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.026+0000 7f39d8b6d640 1 -- 172.21.15.103:0/3901445501 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d4072c50 con 0x7f39d4073ae0 2024-09-10T08:28:39.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.026+0000 7f39c2ffd640 1 -- 172.21.15.103:0/3901445501 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39cc01b070 con 0x7f39d4073ae0 2024-09-10T08:28:39.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.026+0000 7f39c2ffd640 1 --2- 172.21.15.103:0/3901445501 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f39b406be30 0x7f39b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.027+0000 7f39c2ffd640 1 -- 172.21.15.103:0/3901445501 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f39cc08a530 con 0x7f39d4073ae0 2024-09-10T08:28:39.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.027+0000 7f39d259c640 1 --2- 172.21.15.103:0/3901445501 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f39b406be30 0x7f39b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.027+0000 7f39d259c640 1 --2- 172.21.15.103:0/3901445501 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f39b406be30 0x7f39b406e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f39c4006fd0 tx=0x7f39c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:39.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.031+0000 7f39c2ffd640 1 -- 172.21.15.103:0/3901445501 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f39cc058e60 con 0x7f39d4073ae0 2024-09-10T08:28:39.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.197+0000 7f39d8b6d640 1 -- 172.21.15.103:0/3901445501 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39d414c0b0 con 0x7f39d4073ae0 2024-09-10T08:28:39.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.198+0000 7f39c2ffd640 1 -- 172.21.15.103:0/3901445501 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16693 (secure 0 0 0) 0x7f39cc058760 con 0x7f39d4073ae0 2024-09-10T08:28:39.199 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:39.199 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":21,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","created":"2024-09-10T08:28:12.654957+0000","modified":"2024-09-10T08:28:36.552549+0000","last_up_change":"2024-09-10T08:28:25.445753+0000","last_in_change":"2024-09-10T08:28:14.741133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:24.821696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-10T08:28:33.488154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-10T08:28:33.857868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1abe08f4-0348-435e-9f97-cec00e96992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6809","nonce":2707863099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6811","nonce":2707863099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6815","nonce":2707863099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6813","nonce":2707863099}]},"public_addr":"172.21.15.103:6809/2707863099","cluster_addr":"172.21.15.103:6811/2707863099","heartbeat_back_addr":"172.21.15.103:6815/2707863099","heartbeat_front_addr":"172.21.15.103:6813/2707863099","state":["exists","up"]},{"osd":1,"uuid":"df342e58-1026-4739-82f6-7a216707444c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6818","nonce":4029892782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6822","nonce":4029892782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6830","nonce":4029892782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6826","nonce":4029892782}]},"public_addr":"172.21.15.103:6818/4029892782","cluster_addr":"172.21.15.103:6822/4029892782","heartbeat_back_addr":"172.21.15.103:6830/4029892782","heartbeat_front_addr":"172.21.15.103:6826/4029892782","state":["exists","up"]},{"osd":2,"uuid":"f7aea2cf-208c-41ed-a0f6-8948d70b9a0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6819","nonce":428484432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6821","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6823","nonce":428484432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6829","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6831","nonce":428484432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6825","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6827","nonce":428484432}]},"public_addr":"172.21.15.103:6819/428484432","cluster_addr":"172.21.15.103:6823/428484432","heartbeat_back_addr":"172.21.15.103:6831/428484432","heartbeat_front_addr":"172.21.15.103:6827/428484432","state":["exists","up"]},{"osd":3,"uuid":"615ef8b0-12a5-4503-96d0-f7ec17dbc792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6801","nonce":3453676282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6803","nonce":3453676282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6807","nonce":3453676282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6805","nonce":3453676282}]},"public_addr":"172.21.15.103:6801/3453676282","cluster_addr":"172.21.15.103:6803/3453676282","heartbeat_back_addr":"172.21.15.103:6807/3453676282","heartbeat_front_addr":"172.21.15.103:6805/3453676282","state":["exists","up"]},{"osd":4,"uuid":"644c5e94-db18-4b83-b5cd-3762ae2647a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6809","nonce":1808157069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6811","nonce":1808157069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6815","nonce":1808157069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6813","nonce":1808157069}]},"public_addr":"172.21.15.154:6809/1808157069","cluster_addr":"172.21.15.154:6811/1808157069","heartbeat_back_addr":"172.21.15.154:6815/1808157069","heartbeat_front_addr":"172.21.15.154:6813/1808157069","state":["exists","up"]},{"osd":5,"uuid":"f40210bd-f4ca-442e-baac-729ced5a9f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6817","nonce":1048015779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6819","nonce":1048015779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6823","nonce":1048015779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6821","nonce":1048015779}]},"public_addr":"172.21.15.154:6817/1048015779","cluster_addr":"172.21.15.154:6819/1048015779","heartbeat_back_addr":"172.21.15.154:6823/1048015779","heartbeat_front_addr":"172.21.15.154:6821/1048015779","state":["exists","up"]},{"osd":6,"uuid":"eebac31e-aaef-47b0-90d7-4af08f36d7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6801","nonce":345273812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6803","nonce":345273812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6807","nonce":345273812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6805","nonce":345273812}]},"public_addr":"172.21.15.154:6801/345273812","cluster_addr":"172.21.15.154:6803/345273812","heartbeat_back_addr":"172.21.15.154:6807/345273812","heartbeat_front_addr":"172.21.15.154:6805/345273812","state":["exists","up"]},{"osd":7,"uuid":"58406c9a-036f-4618-bfb6-0beddbd71605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6825","nonce":3439481239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6827","nonce":3439481239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6831","nonce":3439481239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6829","nonce":3439481239}]},"public_addr":"172.21.15.154:6825/3439481239","cluster_addr":"172.21.15.154:6827/3439481239","heartbeat_back_addr":"172.21.15.154:6831/3439481239","heartbeat_front_addr":"172.21.15.154:6829/3439481239","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.032718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.126448+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.781158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.808718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.050591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.038245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.586989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.223326+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:28:39.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.201+0000 7f39d8b6d640 1 -- 172.21.15.103:0/3901445501 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f39b406be30 msgr2=0x7f39b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.201+0000 7f39d8b6d640 1 --2- 172.21.15.103:0/3901445501 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f39b406be30 0x7f39b406e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f39c4006fd0 tx=0x7f39c4008040 comp rx=0 tx=0).stop 2024-09-10T08:28:39.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.201+0000 7f39d8b6d640 1 -- 172.21.15.103:0/3901445501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d4073ae0 msgr2=0x7f39d41414c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.201+0000 7f39d8b6d640 1 --2- 172.21.15.103:0/3901445501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d4073ae0 0x7f39d41414c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00c780 tx=0x7f39cc00cc40 comp rx=0 tx=0).stop 2024-09-10T08:28:39.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.201+0000 7f39d8b6d640 1 -- 172.21.15.103:0/3901445501 shutdown_connections 2024-09-10T08:28:39.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.201+0000 7f39d8b6d640 1 --2- 172.21.15.103:0/3901445501 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f39b406be30 0x7f39b406e2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.201+0000 7f39d8b6d640 1 --2- 172.21.15.103:0/3901445501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d4073ae0 0x7f39d41414c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.201+0000 7f39d8b6d640 1 --2- 172.21.15.103:0/3901445501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39d40733d0 0x7f39d40c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.201+0000 7f39d8b6d640 1 --2- 172.21.15.103:0/3901445501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39d406d850 0x7f39d41463e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.201+0000 7f39d8b6d640 1 -- 172.21.15.103:0/3901445501 >> 172.21.15.103:0/3901445501 conn(0x7f39d40c9d80 msgr2=0x7f39d40c4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:39.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.201+0000 7f39d8b6d640 1 -- 172.21.15.103:0/3901445501 shutdown_connections 2024-09-10T08:28:39.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.201+0000 7f39d8b6d640 1 -- 172.21.15.103:0/3901445501 wait complete. 2024-09-10T08:28:39.212 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:28:39.213 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:28:39.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.310+0000 7fc2e8217640 1 Processor -- start 2024-09-10T08:28:39.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.311+0000 7fc2e8217640 1 -- start start 2024-09-10T08:28:39.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.311+0000 7fc2e8217640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc2e00c4680 0x7fc2e0156a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.311+0000 7fc2e8217640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2e0156fc0 0x7fc2e01573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.311+0000 7fc2e8217640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2e0070590 con 0x7fc2e00acc30 2024-09-10T08:28:39.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.311+0000 7fc2e8217640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc2e00c4ea0 con 0x7fc2e00c4680 2024-09-10T08:28:39.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.311+0000 7fc2e8217640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc2e00a8220 con 0x7fc2e0156fc0 2024-09-10T08:28:39.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.311+0000 7fc2e5fb3640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc2e00acc30 0x7fc2e00c3f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51200/0 (socket says 172.21.15.103:51200) 2024-09-10T08:28:39.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.311+0000 7fc2e5fb3640 1 -- 172.21.15.103:0/3574372177 learned_addr learned my addr 172.21.15.103:0/3574372177 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:39.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e57b2640 1 --2- 172.21.15.103:0/3574372177 >> v2:172.21.15.154:3300/0 conn(0x7fc2e00c4680 0x7fc2e0156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e4fb1640 1 -- 172.21.15.103:0/3574372177 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 586850829 0 0) 0x7fc2e0070590 con 0x7fc2e00acc30 2024-09-10T08:28:39.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e67b4640 1 --2- 172.21.15.103:0/3574372177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2e0156fc0 0x7fc2e01573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e4fb1640 1 -- 172.21.15.103:0/3574372177 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2cc003520 con 0x7fc2e00acc30 2024-09-10T08:28:39.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e4fb1640 1 -- 172.21.15.103:0/3574372177 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1457526239 0 0) 0x7fc2cc003520 con 0x7fc2e00acc30 2024-09-10T08:28:39.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e4fb1640 1 -- 172.21.15.103:0/3574372177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2e0156fc0 msgr2=0x7fc2e01573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:39.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e4fb1640 1 --2- 172.21.15.103:0/3574372177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2e0156fc0 0x7fc2e01573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e4fb1640 1 -- 172.21.15.103:0/3574372177 >> v2:172.21.15.154:3300/0 conn(0x7fc2e00c4680 msgr2=0x7fc2e0156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:39.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e4fb1640 1 --2- 172.21.15.103:0/3574372177 >> v2:172.21.15.154:3300/0 conn(0x7fc2e00c4680 0x7fc2e0156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e4fb1640 1 -- 172.21.15.103:0/3574372177 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e00a84f0 con 0x7fc2e00acc30 2024-09-10T08:28:39.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e4fb1640 1 -- 172.21.15.103:0/3574372177 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7fc2dc001670 con 0x7fc2e00acc30 2024-09-10T08:28:39.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e4fb1640 1 -- 172.21.15.103:0/3574372177 >> v1:172.21.15.103:6789/0 conn(0x7fc2e00acc30 legacy=0x7fc2e00c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e4fb1640 1 --2- 172.21.15.103:0/3574372177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2e0156fc0 0x7fc2cc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e4fb1640 1 --2- 172.21.15.103:0/3574372177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2cc003f30 0x7fc2cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e4fb1640 1 --2- 172.21.15.103:0/3574372177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2cc004d40 0x7fc2cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e4fb1640 1 -- 172.21.15.103:0/3574372177 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e00a8220 con 0x7fc2cc004d40 2024-09-10T08:28:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e4fb1640 1 -- 172.21.15.103:0/3574372177 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc00ba20 con 0x7fc2cc003f30 2024-09-10T08:28:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e4fb1640 1 -- 172.21.15.103:0/3574372177 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc2cc00bc20 con 0x7fc2e0156fc0 2024-09-10T08:28:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e67b4640 1 --2- 172.21.15.103:0/3574372177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2cc004d40 0x7fc2cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e5fb3640 1 --2- 172.21.15.103:0/3574372177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2e0156fc0 0x7fc2cc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e57b2640 1 --2- 172.21.15.103:0/3574372177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2cc003f30 0x7fc2cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e67b4640 1 -- 172.21.15.103:0/3574372177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2e0156fc0 msgr2=0x7fc2cc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e67b4640 1 --2- 172.21.15.103:0/3574372177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2e0156fc0 0x7fc2cc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e67b4640 1 -- 172.21.15.103:0/3574372177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2cc003f30 msgr2=0x7fc2cc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e67b4640 1 --2- 172.21.15.103:0/3574372177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2cc003f30 0x7fc2cc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.312+0000 7fc2e67b4640 1 -- 172.21.15.103:0/3574372177 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2cc003520 con 0x7fc2cc004d40 2024-09-10T08:28:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.313+0000 7fc2e67b4640 1 --2- 172.21.15.103:0/3574372177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2cc004d40 0x7fc2cc0051c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009fc0 tx=0x7fc2cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916cb986ac5fd517 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.313+0000 7fc2e4fb1640 1 -- 172.21.15.103:0/3574372177 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8009c10 con 0x7fc2cc004d40 2024-09-10T08:28:39.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.313+0000 7fc2e4fb1640 1 -- 172.21.15.103:0/3574372177 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d8036070 con 0x7fc2cc004d40 2024-09-10T08:28:39.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.313+0000 7fc2e4fb1640 1 -- 172.21.15.103:0/3574372177 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8031880 con 0x7fc2cc004d40 2024-09-10T08:28:39.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.314+0000 7fc2e8217640 1 -- 172.21.15.103:0/3574372177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2cc004d40 msgr2=0x7fc2cc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.314+0000 7fc2e8217640 1 --2- 172.21.15.103:0/3574372177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2cc004d40 0x7fc2cc0051c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009fc0 tx=0x7fc2cc005830 comp rx=0 tx=0).stop 2024-09-10T08:28:39.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.314+0000 7fc2e67b4640 1 -- 172.21.15.103:0/3574372177 reap_dead start 2024-09-10T08:28:39.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.314+0000 7fc2e8217640 1 -- 172.21.15.103:0/3574372177 shutdown_connections 2024-09-10T08:28:39.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.314+0000 7fc2e8217640 1 -- 172.21.15.103:0/3574372177 >> 172.21.15.103:0/3574372177 conn(0x7fc2e00c5660 msgr2=0x7fc2e00c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:39.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.314+0000 7fc2e8217640 1 -- 172.21.15.103:0/3574372177 shutdown_connections 2024-09-10T08:28:39.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.314+0000 7fc2e8217640 1 -- 172.21.15.103:0/3574372177 wait complete. 2024-09-10T08:28:39.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.315+0000 7fc2e8217640 1 Processor -- start 2024-09-10T08:28:39.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.315+0000 7fc2e8217640 1 -- start start 2024-09-10T08:28:39.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2e8217640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2cc004d40 0x7fc2e01ef8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2e8217640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2e009ca00 0x7fc2e006f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2e8217640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2e01ecc60 0x7fc2e0152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2e8217640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e00c5330 con 0x7fc2cc004d40 2024-09-10T08:28:39.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2e8217640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e00702b0 con 0x7fc2e01ecc60 2024-09-10T08:28:39.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2e8217640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc2e00c63f0 con 0x7fc2e009ca00 2024-09-10T08:28:39.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2e5fb3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2cc004d40 0x7fc2e01ef8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2e5fb3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2cc004d40 0x7fc2e01ef8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57532/0 (socket says 172.21.15.103:57532) 2024-09-10T08:28:39.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2e5fb3640 1 -- 172.21.15.103:0/2438228872 learned_addr learned my addr 172.21.15.103:0/2438228872 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:39.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2e57b2640 1 --2- 172.21.15.103:0/2438228872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2e009ca00 0x7fc2e006f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2e67b4640 1 --2- 172.21.15.103:0/2438228872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2e01ecc60 0x7fc2e0152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2e5fb3640 1 -- 172.21.15.103:0/2438228872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2e009ca00 msgr2=0x7fc2e006f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2e5fb3640 1 --2- 172.21.15.103:0/2438228872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2e009ca00 0x7fc2e006f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2e5fb3640 1 -- 172.21.15.103:0/2438228872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2e01ecc60 msgr2=0x7fc2e0152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2e5fb3640 1 --2- 172.21.15.103:0/2438228872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2e01ecc60 0x7fc2e0152e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2e5fb3640 1 -- 172.21.15.103:0/2438228872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e006fcc0 con 0x7fc2cc004d40 2024-09-10T08:28:39.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2e67b4640 1 --2- 172.21.15.103:0/2438228872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2e01ecc60 0x7fc2e0152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:39.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2e57b2640 1 --2- 172.21.15.103:0/2438228872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2e009ca00 0x7fc2e006f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:39.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2e5fb3640 1 --2- 172.21.15.103:0/2438228872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2cc004d40 0x7fc2e01ef8e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc007310 tx=0x7fc2dc0077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:39.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2d67fc640 1 -- 172.21.15.103:0/2438228872 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc01a070 con 0x7fc2cc004d40 2024-09-10T08:28:39.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2d67fc640 1 -- 172.21.15.103:0/2438228872 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2dc00f8e0 con 0x7fc2cc004d40 2024-09-10T08:28:39.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2e8217640 1 -- 172.21.15.103:0/2438228872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e01ec360 con 0x7fc2cc004d40 2024-09-10T08:28:39.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.316+0000 7fc2d67fc640 1 -- 172.21.15.103:0/2438228872 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc00fcd0 con 0x7fc2cc004d40 2024-09-10T08:28:39.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.317+0000 7fc2e8217640 1 -- 172.21.15.103:0/2438228872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e01ef0e0 con 0x7fc2cc004d40 2024-09-10T08:28:39.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.317+0000 7fc2e8217640 1 -- 172.21.15.103:0/2438228872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2e00abc10 con 0x7fc2cc004d40 2024-09-10T08:28:39.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.318+0000 7fc2d67fc640 1 -- 172.21.15.103:0/2438228872 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc2dc01d070 con 0x7fc2cc004d40 2024-09-10T08:28:39.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.318+0000 7fc2d67fc640 1 --2- 172.21.15.103:0/2438228872 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc2c406bdd0 0x7fc2c406e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.318+0000 7fc2d67fc640 1 -- 172.21.15.103:0/2438228872 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7fc2dc08a6b0 con 0x7fc2cc004d40 2024-09-10T08:28:39.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.318+0000 7fc2e57b2640 1 --2- 172.21.15.103:0/2438228872 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc2c406bdd0 0x7fc2c406e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.319+0000 7fc2e57b2640 1 --2- 172.21.15.103:0/2438228872 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc2c406bdd0 0x7fc2c406e290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00a7e40 tx=0x7fc2d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:39.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.323+0000 7fc2d67fc640 1 -- 172.21.15.103:0/2438228872 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc2dc059100 con 0x7fc2cc004d40 2024-09-10T08:28:39.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.485+0000 7fc2e8217640 1 -- 172.21.15.103:0/2438228872 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc2e0074660 con 0x7fc2c406bdd0 2024-09-10T08:28:39.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.491+0000 7fc2d67fc640 1 -- 172.21.15.103:0/2438228872 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250435 (secure 0 0 0) 0x7fc2e0074660 con 0x7fc2c406bdd0 2024-09-10T08:28:39.495 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:39.496 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T08:28:39.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.494+0000 7fc2e8217640 1 -- 172.21.15.103:0/2438228872 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc2c406bdd0 msgr2=0x7fc2c406e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.494+0000 7fc2e8217640 1 --2- 172.21.15.103:0/2438228872 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc2c406bdd0 0x7fc2c406e290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00a7e40 tx=0x7fc2d0008040 comp rx=0 tx=0).stop 2024-09-10T08:28:39.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.494+0000 7fc2e8217640 1 -- 172.21.15.103:0/2438228872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2cc004d40 msgr2=0x7fc2e01ef8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.494+0000 7fc2e8217640 1 --2- 172.21.15.103:0/2438228872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2cc004d40 0x7fc2e01ef8e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc007310 tx=0x7fc2dc0077d0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.494+0000 7fc2e8217640 1 -- 172.21.15.103:0/2438228872 shutdown_connections 2024-09-10T08:28:39.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.494+0000 7fc2e8217640 1 --2- 172.21.15.103:0/2438228872 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc2c406bdd0 0x7fc2c406e290 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.494+0000 7fc2e8217640 1 --2- 172.21.15.103:0/2438228872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2e01ecc60 0x7fc2e0152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.494+0000 7fc2e8217640 1 --2- 172.21.15.103:0/2438228872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2e009ca00 0x7fc2e006f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.494+0000 7fc2e8217640 1 --2- 172.21.15.103:0/2438228872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2cc004d40 0x7fc2e01ef8e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.494+0000 7fc2e8217640 1 -- 172.21.15.103:0/2438228872 >> 172.21.15.103:0/2438228872 conn(0x7fc2e00c5660 msgr2=0x7fc2e01541f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:39.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.494+0000 7fc2e8217640 1 -- 172.21.15.103:0/2438228872 shutdown_connections 2024-09-10T08:28:39.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.494+0000 7fc2e8217640 1 -- 172.21.15.103:0/2438228872 wait complete. 2024-09-10T08:28:39.506 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-10T08:28:38.794305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":194,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218884,"kb_used_data":2636,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755836,"statfs":{"total":773094113280,"available":772869976064,"internally_reserved":0,"allocated":2699264,"data_stored":1673029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.254075"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.572264+0000","last_change":"2024-09-10T08:28:35.571065+0000","last_active":"2024-09-10T08:28:35.572264+0000","last_peered":"2024-09-10T08:28:35.572264+0000","last_clean":"2024-09-10T08:28:35.572264+0000","last_became_active":"2024-09-10T08:28:35.570749+0000","last_became_peered":"2024-09-10T08:28:35.570749+0000","last_unstale":"2024-09-10T08:28:35.572264+0000","last_undegraded":"2024-09-10T08:28:35.572264+0000","last_fullsized":"2024-09-10T08:28:35.572264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:45:43.769092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582300+0000","last_change":"2024-09-10T08:28:35.578197+0000","last_active":"2024-09-10T08:28:35.582300+0000","last_peered":"2024-09-10T08:28:35.582300+0000","last_clean":"2024-09-10T08:28:35.582300+0000","last_became_active":"2024-09-10T08:28:35.577852+0000","last_became_peered":"2024-09-10T08:28:35.577852+0000","last_unstale":"2024-09-10T08:28:35.582300+0000","last_undegraded":"2024-09-10T08:28:35.582300+0000","last_fullsized":"2024-09-10T08:28:35.582300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:42.678700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579443+0000","last_change":"2024-09-10T08:28:35.573918+0000","last_active":"2024-09-10T08:28:35.579443+0000","last_peered":"2024-09-10T08:28:35.579443+0000","last_clean":"2024-09-10T08:28:35.579443+0000","last_became_active":"2024-09-10T08:28:35.573646+0000","last_became_peered":"2024-09-10T08:28:35.573646+0000","last_unstale":"2024-09-10T08:28:35.579443+0000","last_undegraded":"2024-09-10T08:28:35.579443+0000","last_fullsized":"2024-09-10T08:28:35.579443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:33.686562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582117+0000","last_change":"2024-09-10T08:28:35.578961+0000","last_active":"2024-09-10T08:28:35.582117+0000","last_peered":"2024-09-10T08:28:35.582117+0000","last_clean":"2024-09-10T08:28:35.582117+0000","last_became_active":"2024-09-10T08:28:35.578680+0000","last_became_peered":"2024-09-10T08:28:35.578680+0000","last_unstale":"2024-09-10T08:28:35.582117+0000","last_undegraded":"2024-09-10T08:28:35.582117+0000","last_fullsized":"2024-09-10T08:28:35.582117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:59.172004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.574504+0000","last_change":"2024-09-10T08:28:35.572112+0000","last_active":"2024-09-10T08:28:35.574504+0000","last_peered":"2024-09-10T08:28:35.574504+0000","last_clean":"2024-09-10T08:28:35.574504+0000","last_became_active":"2024-09-10T08:28:35.571803+0000","last_became_peered":"2024-09-10T08:28:35.571803+0000","last_unstale":"2024-09-10T08:28:35.574504+0000","last_undegraded":"2024-09-10T08:28:35.574504+0000","last_fullsized":"2024-09-10T08:28:35.574504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:10.044940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582149+0000","last_change":"2024-09-10T08:28:35.578978+0000","last_active":"2024-09-10T08:28:35.582149+0000","last_peered":"2024-09-10T08:28:35.582149+0000","last_clean":"2024-09-10T08:28:35.582149+0000","last_became_active":"2024-09-10T08:28:35.578475+0000","last_became_peered":"2024-09-10T08:28:35.578475+0000","last_unstale":"2024-09-10T08:28:35.582149+0000","last_undegraded":"2024-09-10T08:28:35.582149+0000","last_fullsized":"2024-09-10T08:28:35.582149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:42.164241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.585683+0000","last_change":"2024-09-10T08:28:35.578664+0000","last_active":"2024-09-10T08:28:35.585683+0000","last_peered":"2024-09-10T08:28:35.585683+0000","last_clean":"2024-09-10T08:28:35.585683+0000","last_became_active":"2024-09-10T08:28:35.578384+0000","last_became_peered":"2024-09-10T08:28:35.578384+0000","last_unstale":"2024-09-10T08:28:35.585683+0000","last_undegraded":"2024-09-10T08:28:35.585683+0000","last_fullsized":"2024-09-10T08:28:35.585683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:34.146373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582054+0000","last_change":"2024-09-10T08:28:35.575275+0000","last_active":"2024-09-10T08:28:35.582054+0000","last_peered":"2024-09-10T08:28:35.582054+0000","last_clean":"2024-09-10T08:28:35.582054+0000","last_became_active":"2024-09-10T08:28:35.575052+0000","last_became_peered":"2024-09-10T08:28:35.575052+0000","last_unstale":"2024-09-10T08:28:35.582054+0000","last_undegraded":"2024-09-10T08:28:35.582054+0000","last_fullsized":"2024-09-10T08:28:35.582054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:06.466029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.585429+0000","last_change":"2024-09-10T08:28:35.577345+0000","last_active":"2024-09-10T08:28:35.585429+0000","last_peered":"2024-09-10T08:28:35.585429+0000","last_clean":"2024-09-10T08:28:35.585429+0000","last_became_active":"2024-09-10T08:28:35.576191+0000","last_became_peered":"2024-09-10T08:28:35.576191+0000","last_unstale":"2024-09-10T08:28:35.585429+0000","last_undegraded":"2024-09-10T08:28:35.585429+0000","last_fullsized":"2024-09-10T08:28:35.585429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:24.323783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:34.539900+0000","last_change":"2024-09-10T08:28:34.539900+0000","last_active":"2024-09-10T08:28:34.539900+0000","last_peered":"2024-09-10T08:28:34.539900+0000","last_clean":"2024-09-10T08:28:34.539900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:34.539900+0000","last_undegraded":"2024-09-10T08:28:34.539900+0000","last_fullsized":"2024-09-10T08:28:34.539900+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:34.539900+0000","last_change":"2024-09-10T08:28:34.539900+0000","last_active":"2024-09-10T08:28:34.539900+0000","last_peered":"2024-09-10T08:28:34.539900+0000","last_clean":"2024-09-10T08:28:34.539900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:34.539900+0000","last_undegraded":"2024-09-10T08:28:34.539900+0000","last_fullsized":"2024-09-10T08:28:34.539900+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.573460+0000","last_change":"2024-09-10T08:28:35.566574+0000","last_active":"2024-09-10T08:28:35.573460+0000","last_peered":"2024-09-10T08:28:35.573460+0000","last_clean":"2024-09-10T08:28:35.573460+0000","last_became_active":"2024-09-10T08:28:35.566205+0000","last_became_peered":"2024-09-10T08:28:35.566205+0000","last_unstale":"2024-09-10T08:28:35.573460+0000","last_undegraded":"2024-09-10T08:28:35.573460+0000","last_fullsized":"2024-09-10T08:28:35.573460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:44.800134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582120+0000","last_change":"2024-09-10T08:28:35.573330+0000","last_active":"2024-09-10T08:28:35.582120+0000","last_peered":"2024-09-10T08:28:35.582120+0000","last_clean":"2024-09-10T08:28:35.582120+0000","last_became_active":"2024-09-10T08:28:35.572992+0000","last_became_peered":"2024-09-10T08:28:35.572992+0000","last_unstale":"2024-09-10T08:28:35.582120+0000","last_undegraded":"2024-09-10T08:28:35.582120+0000","last_fullsized":"2024-09-10T08:28:35.582120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:17.660618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579134+0000","last_change":"2024-09-10T08:28:35.574551+0000","last_active":"2024-09-10T08:28:35.579134+0000","last_peered":"2024-09-10T08:28:35.579134+0000","last_clean":"2024-09-10T08:28:35.579134+0000","last_became_active":"2024-09-10T08:28:35.574256+0000","last_became_peered":"2024-09-10T08:28:35.574256+0000","last_unstale":"2024-09-10T08:28:35.579134+0000","last_undegraded":"2024-09-10T08:28:35.579134+0000","last_fullsized":"2024-09-10T08:28:35.579134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:46.296836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.566154+0000","last_change":"2024-09-10T08:28:35.560693+0000","last_active":"2024-09-10T08:28:35.566154+0000","last_peered":"2024-09-10T08:28:35.566154+0000","last_clean":"2024-09-10T08:28:35.566154+0000","last_became_active":"2024-09-10T08:28:35.560409+0000","last_became_peered":"2024-09-10T08:28:35.560409+0000","last_unstale":"2024-09-10T08:28:35.566154+0000","last_undegraded":"2024-09-10T08:28:35.566154+0000","last_fullsized":"2024-09-10T08:28:35.566154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:17:35.028101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.573680+0000","last_change":"2024-09-10T08:28:35.570249+0000","last_active":"2024-09-10T08:28:35.573680+0000","last_peered":"2024-09-10T08:28:35.573680+0000","last_clean":"2024-09-10T08:28:35.573680+0000","last_became_active":"2024-09-10T08:28:35.569960+0000","last_became_peered":"2024-09-10T08:28:35.569960+0000","last_unstale":"2024-09-10T08:28:35.573680+0000","last_undegraded":"2024-09-10T08:28:35.573680+0000","last_fullsized":"2024-09-10T08:28:35.573680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:38.524087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.571052+0000","last_change":"2024-09-10T08:28:35.567296+0000","last_active":"2024-09-10T08:28:35.571052+0000","last_peered":"2024-09-10T08:28:35.571052+0000","last_clean":"2024-09-10T08:28:35.571052+0000","last_became_active":"2024-09-10T08:28:35.567074+0000","last_became_peered":"2024-09-10T08:28:35.567074+0000","last_unstale":"2024-09-10T08:28:35.571052+0000","last_undegraded":"2024-09-10T08:28:35.571052+0000","last_fullsized":"2024-09-10T08:28:35.571052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:05.005278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619264+0000","last_change":"2024-09-10T08:28:35.574438+0000","last_active":"2024-09-10T08:28:36.619264+0000","last_peered":"2024-09-10T08:28:36.619264+0000","last_clean":"2024-09-10T08:28:36.619264+0000","last_became_active":"2024-09-10T08:28:35.574175+0000","last_became_peered":"2024-09-10T08:28:35.574175+0000","last_unstale":"2024-09-10T08:28:36.619264+0000","last_undegraded":"2024-09-10T08:28:36.619264+0000","last_fullsized":"2024-09-10T08:28:36.619264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:55.808543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.574680+0000","last_change":"2024-09-10T08:28:35.572709+0000","last_active":"2024-09-10T08:28:35.574680+0000","last_peered":"2024-09-10T08:28:35.574680+0000","last_clean":"2024-09-10T08:28:35.574680+0000","last_became_active":"2024-09-10T08:28:35.572392+0000","last_became_peered":"2024-09-10T08:28:35.572392+0000","last_unstale":"2024-09-10T08:28:35.574680+0000","last_undegraded":"2024-09-10T08:28:35.574680+0000","last_fullsized":"2024-09-10T08:28:35.574680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:58.255939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:34.539900+0000","last_change":"2024-09-10T08:28:34.539900+0000","last_active":"2024-09-10T08:28:34.539900+0000","last_peered":"2024-09-10T08:28:34.539900+0000","last_clean":"2024-09-10T08:28:34.539900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:34.539900+0000","last_undegraded":"2024-09-10T08:28:34.539900+0000","last_fullsized":"2024-09-10T08:28:34.539900+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579258+0000","last_change":"2024-09-10T08:28:35.575802+0000","last_active":"2024-09-10T08:28:35.579258+0000","last_peered":"2024-09-10T08:28:35.579258+0000","last_clean":"2024-09-10T08:28:35.579258+0000","last_became_active":"2024-09-10T08:28:35.575388+0000","last_became_peered":"2024-09-10T08:28:35.575388+0000","last_unstale":"2024-09-10T08:28:35.579258+0000","last_undegraded":"2024-09-10T08:28:35.579258+0000","last_fullsized":"2024-09-10T08:28:35.579258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:59.338559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.571167+0000","last_change":"2024-09-10T08:28:35.568044+0000","last_active":"2024-09-10T08:28:35.571167+0000","last_peered":"2024-09-10T08:28:35.571167+0000","last_clean":"2024-09-10T08:28:35.571167+0000","last_became_active":"2024-09-10T08:28:35.567744+0000","last_became_peered":"2024-09-10T08:28:35.567744+0000","last_unstale":"2024-09-10T08:28:35.571167+0000","last_undegraded":"2024-09-10T08:28:35.571167+0000","last_fullsized":"2024-09-10T08:28:35.571167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:09:31.071067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581919+0000","last_change":"2024-09-10T08:28:35.571566+0000","last_active":"2024-09-10T08:28:35.581919+0000","last_peered":"2024-09-10T08:28:35.581919+0000","last_clean":"2024-09-10T08:28:35.581919+0000","last_became_active":"2024-09-10T08:28:35.571285+0000","last_became_peered":"2024-09-10T08:28:35.571285+0000","last_unstale":"2024-09-10T08:28:35.581919+0000","last_undegraded":"2024-09-10T08:28:35.581919+0000","last_fullsized":"2024-09-10T08:28:35.581919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:32.338136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582042+0000","last_change":"2024-09-10T08:28:35.578285+0000","last_active":"2024-09-10T08:28:35.582042+0000","last_peered":"2024-09-10T08:28:35.582042+0000","last_clean":"2024-09-10T08:28:35.582042+0000","last_became_active":"2024-09-10T08:28:35.576805+0000","last_became_peered":"2024-09-10T08:28:35.576805+0000","last_unstale":"2024-09-10T08:28:35.582042+0000","last_undegraded":"2024-09-10T08:28:35.582042+0000","last_fullsized":"2024-09-10T08:28:35.582042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:36.953572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582073+0000","last_change":"2024-09-10T08:28:35.575902+0000","last_active":"2024-09-10T08:28:35.582073+0000","last_peered":"2024-09-10T08:28:35.582073+0000","last_clean":"2024-09-10T08:28:35.582073+0000","last_became_active":"2024-09-10T08:28:35.575614+0000","last_became_peered":"2024-09-10T08:28:35.575614+0000","last_unstale":"2024-09-10T08:28:35.582073+0000","last_undegraded":"2024-09-10T08:28:35.582073+0000","last_fullsized":"2024-09-10T08:28:35.582073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:47.654980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:34.539900+0000","last_change":"2024-09-10T08:28:34.539900+0000","last_active":"2024-09-10T08:28:34.539900+0000","last_peered":"2024-09-10T08:28:34.539900+0000","last_clean":"2024-09-10T08:28:34.539900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:34.539900+0000","last_undegraded":"2024-09-10T08:28:34.539900+0000","last_fullsized":"2024-09-10T08:28:34.539900+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.575566+0000","last_change":"2024-09-10T08:28:35.572550+0000","last_active":"2024-09-10T08:28:35.575566+0000","last_peered":"2024-09-10T08:28:35.575566+0000","last_clean":"2024-09-10T08:28:35.575566+0000","last_became_active":"2024-09-10T08:28:35.572184+0000","last_became_peered":"2024-09-10T08:28:35.572184+0000","last_unstale":"2024-09-10T08:28:35.575566+0000","last_undegraded":"2024-09-10T08:28:35.575566+0000","last_fullsized":"2024-09-10T08:28:35.575566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:29.422204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582039+0000","last_change":"2024-09-10T08:28:35.574676+0000","last_active":"2024-09-10T08:28:35.582039+0000","last_peered":"2024-09-10T08:28:35.582039+0000","last_clean":"2024-09-10T08:28:35.582039+0000","last_became_active":"2024-09-10T08:28:35.574437+0000","last_became_peered":"2024-09-10T08:28:35.574437+0000","last_unstale":"2024-09-10T08:28:35.582039+0000","last_undegraded":"2024-09-10T08:28:35.582039+0000","last_fullsized":"2024-09-10T08:28:35.582039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:31.398284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582245+0000","last_change":"2024-09-10T08:28:35.577852+0000","last_active":"2024-09-10T08:28:35.582245+0000","last_peered":"2024-09-10T08:28:35.582245+0000","last_clean":"2024-09-10T08:28:35.582245+0000","last_became_active":"2024-09-10T08:28:35.577571+0000","last_became_peered":"2024-09-10T08:28:35.577571+0000","last_unstale":"2024-09-10T08:28:35.582245+0000","last_undegraded":"2024-09-10T08:28:35.582245+0000","last_fullsized":"2024-09-10T08:28:35.582245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:07:32.121601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582131+0000","last_change":"2024-09-10T08:28:35.578735+0000","last_active":"2024-09-10T08:28:35.582131+0000","last_peered":"2024-09-10T08:28:35.582131+0000","last_clean":"2024-09-10T08:28:35.582131+0000","last_became_active":"2024-09-10T08:28:35.577995+0000","last_became_peered":"2024-09-10T08:28:35.577995+0000","last_unstale":"2024-09-10T08:28:35.582131+0000","last_undegraded":"2024-09-10T08:28:35.582131+0000","last_fullsized":"2024-09-10T08:28:35.582131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:32.178282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620517+0000","last_change":"2024-09-10T08:28:35.566780+0000","last_active":"2024-09-10T08:28:36.620517+0000","last_peered":"2024-09-10T08:28:36.620517+0000","last_clean":"2024-09-10T08:28:36.620517+0000","last_became_active":"2024-09-10T08:28:35.566529+0000","last_became_peered":"2024-09-10T08:28:35.566529+0000","last_unstale":"2024-09-10T08:28:36.620517+0000","last_undegraded":"2024-09-10T08:28:36.620517+0000","last_fullsized":"2024-09-10T08:28:36.620517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:09.481166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:34.539900+0000","last_change":"2024-09-10T08:28:34.539900+0000","last_active":"2024-09-10T08:28:34.539900+0000","last_peered":"2024-09-10T08:28:34.539900+0000","last_clean":"2024-09-10T08:28:34.539900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:34.539900+0000","last_undegraded":"2024-09-10T08:28:34.539900+0000","last_fullsized":"2024-09-10T08:28:34.539900+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.560246+0000","last_change":"2024-09-10T08:28:35.559371+0000","last_active":"2024-09-10T08:28:35.560246+0000","last_peered":"2024-09-10T08:28:35.560246+0000","last_clean":"2024-09-10T08:28:35.560246+0000","last_became_active":"2024-09-10T08:28:35.559145+0000","last_became_peered":"2024-09-10T08:28:35.559145+0000","last_unstale":"2024-09-10T08:28:35.560246+0000","last_undegraded":"2024-09-10T08:28:35.560246+0000","last_fullsized":"2024-09-10T08:28:35.560246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:34:56.302624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582149+0000","last_change":"2024-09-10T08:28:34.566606+0000","last_active":"2024-09-10T08:28:35.582149+0000","last_peered":"2024-09-10T08:28:35.582149+0000","last_clean":"2024-09-10T08:28:35.582149+0000","last_became_active":"2024-09-10T08:28:34.566388+0000","last_became_peered":"2024-09-10T08:28:34.566388+0000","last_unstale":"2024-09-10T08:28:35.582149+0000","last_undegraded":"2024-09-10T08:28:35.582149+0000","last_fullsized":"2024-09-10T08:28:35.582149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:33.528801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582227+0000","last_change":"2024-09-10T08:28:35.576406+0000","last_active":"2024-09-10T08:28:35.582227+0000","last_peered":"2024-09-10T08:28:35.582227+0000","last_clean":"2024-09-10T08:28:35.582227+0000","last_became_active":"2024-09-10T08:28:35.576145+0000","last_became_peered":"2024-09-10T08:28:35.576145+0000","last_unstale":"2024-09-10T08:28:35.582227+0000","last_undegraded":"2024-09-10T08:28:35.582227+0000","last_fullsized":"2024-09-10T08:28:35.582227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:55.026157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T08:28:33.545183+0000","last_change":"2024-09-10T08:28:33.545183+0000","last_active":"2024-09-10T08:28:33.538281+0000","last_peered":"2024-09-10T08:28:33.538281+0000","last_clean":"2024-09-10T08:28:33.538281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:33.545183+0000","last_undegraded":"2024-09-10T08:28:33.545183+0000","last_fullsized":"2024-09-10T08:28:33.545183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.568578+0000","last_change":"2024-09-10T08:28:34.564751+0000","last_active":"2024-09-10T08:28:35.568578+0000","last_peered":"2024-09-10T08:28:35.568578+0000","last_clean":"2024-09-10T08:28:35.568578+0000","last_became_active":"2024-09-10T08:28:34.564479+0000","last_became_peered":"2024-09-10T08:28:34.564479+0000","last_unstale":"2024-09-10T08:28:35.568578+0000","last_undegraded":"2024-09-10T08:28:35.568578+0000","last_fullsized":"2024-09-10T08:28:35.568578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:29.618224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.584085+0000","last_change":"2024-09-10T08:28:35.580244+0000","last_active":"2024-09-10T08:28:35.584085+0000","last_peered":"2024-09-10T08:28:35.584085+0000","last_clean":"2024-09-10T08:28:35.584085+0000","last_became_active":"2024-09-10T08:28:35.579975+0000","last_became_peered":"2024-09-10T08:28:35.579975+0000","last_unstale":"2024-09-10T08:28:35.584085+0000","last_undegraded":"2024-09-10T08:28:35.584085+0000","last_fullsized":"2024-09-10T08:28:35.584085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:07.055709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556929+0000","last_change":"2024-09-10T08:28:34.554346+0000","last_active":"2024-09-10T08:28:35.556929+0000","last_peered":"2024-09-10T08:28:35.556929+0000","last_clean":"2024-09-10T08:28:35.556929+0000","last_became_active":"2024-09-10T08:28:34.553933+0000","last_became_peered":"2024-09-10T08:28:34.553933+0000","last_unstale":"2024-09-10T08:28:35.556929+0000","last_undegraded":"2024-09-10T08:28:35.556929+0000","last_fullsized":"2024-09-10T08:28:35.556929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:07.639671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.576475+0000","last_change":"2024-09-10T08:28:35.572803+0000","last_active":"2024-09-10T08:28:35.576475+0000","last_peered":"2024-09-10T08:28:35.576475+0000","last_clean":"2024-09-10T08:28:35.576475+0000","last_became_active":"2024-09-10T08:28:35.572219+0000","last_became_peered":"2024-09-10T08:28:35.572219+0000","last_unstale":"2024-09-10T08:28:35.576475+0000","last_undegraded":"2024-09-10T08:28:35.576475+0000","last_fullsized":"2024-09-10T08:28:35.576475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:01:26.046238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T08:28:33.545852+0000","last_change":"2024-09-10T08:28:33.545852+0000","last_active":"2024-09-10T08:28:33.538281+0000","last_peered":"2024-09-10T08:28:33.538281+0000","last_clean":"2024-09-10T08:28:33.538281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:33.545852+0000","last_undegraded":"2024-09-10T08:28:33.545852+0000","last_fullsized":"2024-09-10T08:28:33.545852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.576172+0000","last_change":"2024-09-10T08:28:35.572944+0000","last_active":"2024-09-10T08:28:35.576172+0000","last_peered":"2024-09-10T08:28:35.576172+0000","last_clean":"2024-09-10T08:28:35.576172+0000","last_became_active":"2024-09-10T08:28:35.572620+0000","last_became_peered":"2024-09-10T08:28:35.572620+0000","last_unstale":"2024-09-10T08:28:35.576172+0000","last_undegraded":"2024-09-10T08:28:35.576172+0000","last_fullsized":"2024-09-10T08:28:35.576172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:59.209973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556683+0000","last_change":"2024-09-10T08:28:34.564571+0000","last_active":"2024-09-10T08:28:35.556683+0000","last_peered":"2024-09-10T08:28:35.556683+0000","last_clean":"2024-09-10T08:28:35.556683+0000","last_became_active":"2024-09-10T08:28:34.564189+0000","last_became_peered":"2024-09-10T08:28:34.564189+0000","last_unstale":"2024-09-10T08:28:35.556683+0000","last_undegraded":"2024-09-10T08:28:35.556683+0000","last_fullsized":"2024-09-10T08:28:35.556683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:46.055510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582203+0000","last_change":"2024-09-10T08:28:35.577913+0000","last_active":"2024-09-10T08:28:35.582203+0000","last_peered":"2024-09-10T08:28:35.582203+0000","last_clean":"2024-09-10T08:28:35.582203+0000","last_became_active":"2024-09-10T08:28:35.577255+0000","last_became_peered":"2024-09-10T08:28:35.577255+0000","last_unstale":"2024-09-10T08:28:35.582203+0000","last_undegraded":"2024-09-10T08:28:35.582203+0000","last_fullsized":"2024-09-10T08:28:35.582203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:17.573799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581974+0000","last_change":"2024-09-10T08:28:34.557352+0000","last_active":"2024-09-10T08:28:35.581974+0000","last_peered":"2024-09-10T08:28:35.581974+0000","last_clean":"2024-09-10T08:28:35.581974+0000","last_became_active":"2024-09-10T08:28:34.557076+0000","last_became_peered":"2024-09-10T08:28:34.557076+0000","last_unstale":"2024-09-10T08:28:35.581974+0000","last_undegraded":"2024-09-10T08:28:35.581974+0000","last_fullsized":"2024-09-10T08:28:35.581974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:04.957739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.575391+0000","last_change":"2024-09-10T08:28:35.571262+0000","last_active":"2024-09-10T08:28:35.575391+0000","last_peered":"2024-09-10T08:28:35.575391+0000","last_clean":"2024-09-10T08:28:35.575391+0000","last_became_active":"2024-09-10T08:28:35.570711+0000","last_became_peered":"2024-09-10T08:28:35.570711+0000","last_unstale":"2024-09-10T08:28:35.575391+0000","last_undegraded":"2024-09-10T08:28:35.575391+0000","last_fullsized":"2024-09-10T08:28:35.575391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:26.384552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T08:28:33.545269+0000","last_change":"2024-09-10T08:28:33.545269+0000","last_active":"2024-09-10T08:28:33.538281+0000","last_peered":"2024-09-10T08:28:33.538281+0000","last_clean":"2024-09-10T08:28:33.538281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:33.545269+0000","last_undegraded":"2024-09-10T08:28:33.545269+0000","last_fullsized":"2024-09-10T08:28:33.545269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.586558+0000","last_change":"2024-09-10T08:28:35.582473+0000","last_active":"2024-09-10T08:28:35.586558+0000","last_peered":"2024-09-10T08:28:35.586558+0000","last_clean":"2024-09-10T08:28:35.586558+0000","last_became_active":"2024-09-10T08:28:35.582205+0000","last_became_peered":"2024-09-10T08:28:35.582205+0000","last_unstale":"2024-09-10T08:28:35.586558+0000","last_undegraded":"2024-09-10T08:28:35.586558+0000","last_fullsized":"2024-09-10T08:28:35.586558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:51.531897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.583031+0000","last_change":"2024-09-10T08:28:34.553556+0000","last_active":"2024-09-10T08:28:35.583031+0000","last_peered":"2024-09-10T08:28:35.583031+0000","last_clean":"2024-09-10T08:28:35.583031+0000","last_became_active":"2024-09-10T08:28:34.553275+0000","last_became_peered":"2024-09-10T08:28:34.553275+0000","last_unstale":"2024-09-10T08:28:35.583031+0000","last_undegraded":"2024-09-10T08:28:35.583031+0000","last_fullsized":"2024-09-10T08:28:35.583031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:45.957635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579158+0000","last_change":"2024-09-10T08:28:35.574810+0000","last_active":"2024-09-10T08:28:35.579158+0000","last_peered":"2024-09-10T08:28:35.579158+0000","last_clean":"2024-09-10T08:28:35.579158+0000","last_became_active":"2024-09-10T08:28:35.574567+0000","last_became_peered":"2024-09-10T08:28:35.574567+0000","last_unstale":"2024-09-10T08:28:35.579158+0000","last_undegraded":"2024-09-10T08:28:35.579158+0000","last_fullsized":"2024-09-10T08:28:35.579158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:28.056169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556821+0000","last_change":"2024-09-10T08:28:34.560699+0000","last_active":"2024-09-10T08:28:35.556821+0000","last_peered":"2024-09-10T08:28:35.556821+0000","last_clean":"2024-09-10T08:28:35.556821+0000","last_became_active":"2024-09-10T08:28:34.560376+0000","last_became_peered":"2024-09-10T08:28:34.560376+0000","last_unstale":"2024-09-10T08:28:35.556821+0000","last_undegraded":"2024-09-10T08:28:35.556821+0000","last_fullsized":"2024-09-10T08:28:35.556821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:09.981216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.580029+0000","last_change":"2024-09-10T08:28:35.575788+0000","last_active":"2024-09-10T08:28:35.580029+0000","last_peered":"2024-09-10T08:28:35.580029+0000","last_clean":"2024-09-10T08:28:35.580029+0000","last_became_active":"2024-09-10T08:28:35.575333+0000","last_became_peered":"2024-09-10T08:28:35.575333+0000","last_unstale":"2024-09-10T08:28:35.580029+0000","last_undegraded":"2024-09-10T08:28:35.580029+0000","last_fullsized":"2024-09-10T08:28:35.580029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:17.994128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T08:28:33.545130+0000","last_change":"2024-09-10T08:28:33.545130+0000","last_active":"2024-09-10T08:28:33.538281+0000","last_peered":"2024-09-10T08:28:33.538281+0000","last_clean":"2024-09-10T08:28:33.538281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:33.545130+0000","last_undegraded":"2024-09-10T08:28:33.545130+0000","last_fullsized":"2024-09-10T08:28:33.545130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:34.539900+0000","last_change":"2024-09-10T08:28:34.539900+0000","last_active":"2024-09-10T08:28:34.539900+0000","last_peered":"2024-09-10T08:28:34.539900+0000","last_clean":"2024-09-10T08:28:34.539900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:34.539900+0000","last_undegraded":"2024-09-10T08:28:34.539900+0000","last_fullsized":"2024-09-10T08:28:34.539900+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619641+0000","last_change":"2024-09-10T08:28:34.555542+0000","last_active":"2024-09-10T08:28:36.619641+0000","last_peered":"2024-09-10T08:28:36.619641+0000","last_clean":"2024-09-10T08:28:36.619641+0000","last_became_active":"2024-09-10T08:28:34.555179+0000","last_became_peered":"2024-09-10T08:28:34.555179+0000","last_unstale":"2024-09-10T08:28:36.619641+0000","last_undegraded":"2024-09-10T08:28:36.619641+0000","last_fullsized":"2024-09-10T08:28:36.619641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:53.313161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.577350+0000","last_change":"2024-09-10T08:28:35.575307+0000","last_active":"2024-09-10T08:28:35.577350+0000","last_peered":"2024-09-10T08:28:35.577350+0000","last_clean":"2024-09-10T08:28:35.577350+0000","last_became_active":"2024-09-10T08:28:35.575038+0000","last_became_peered":"2024-09-10T08:28:35.575038+0000","last_unstale":"2024-09-10T08:28:35.577350+0000","last_undegraded":"2024-09-10T08:28:35.577350+0000","last_fullsized":"2024-09-10T08:28:35.577350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:12.751231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.584686+0000","last_change":"2024-09-10T08:28:34.551102+0000","last_active":"2024-09-10T08:28:35.584686+0000","last_peered":"2024-09-10T08:28:35.584686+0000","last_clean":"2024-09-10T08:28:35.584686+0000","last_became_active":"2024-09-10T08:28:34.550773+0000","last_became_peered":"2024-09-10T08:28:34.550773+0000","last_unstale":"2024-09-10T08:28:35.584686+0000","last_undegraded":"2024-09-10T08:28:35.584686+0000","last_fullsized":"2024-09-10T08:28:35.584686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:35.393695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.585491+0000","last_change":"2024-09-10T08:28:35.577476+0000","last_active":"2024-09-10T08:28:35.585491+0000","last_peered":"2024-09-10T08:28:35.585491+0000","last_clean":"2024-09-10T08:28:35.585491+0000","last_became_active":"2024-09-10T08:28:35.576786+0000","last_became_peered":"2024-09-10T08:28:35.576786+0000","last_unstale":"2024-09-10T08:28:35.585491+0000","last_undegraded":"2024-09-10T08:28:35.585491+0000","last_fullsized":"2024-09-10T08:28:35.585491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:17.606334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619362+0000","last_change":"2024-09-10T08:28:34.560313+0000","last_active":"2024-09-10T08:28:36.619362+0000","last_peered":"2024-09-10T08:28:36.619362+0000","last_clean":"2024-09-10T08:28:36.619362+0000","last_became_active":"2024-09-10T08:28:34.560035+0000","last_became_peered":"2024-09-10T08:28:34.560035+0000","last_unstale":"2024-09-10T08:28:36.619362+0000","last_undegraded":"2024-09-10T08:28:36.619362+0000","last_fullsized":"2024-09-10T08:28:36.619362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:56.945537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.585563+0000","last_change":"2024-09-10T08:28:35.577577+0000","last_active":"2024-09-10T08:28:35.585563+0000","last_peered":"2024-09-10T08:28:35.585563+0000","last_clean":"2024-09-10T08:28:35.585563+0000","last_became_active":"2024-09-10T08:28:35.576686+0000","last_became_peered":"2024-09-10T08:28:35.576686+0000","last_unstale":"2024-09-10T08:28:35.585563+0000","last_undegraded":"2024-09-10T08:28:35.585563+0000","last_fullsized":"2024-09-10T08:28:35.585563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:51.251652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582053+0000","last_change":"2024-09-10T08:28:34.560694+0000","last_active":"2024-09-10T08:28:35.582053+0000","last_peered":"2024-09-10T08:28:35.582053+0000","last_clean":"2024-09-10T08:28:35.582053+0000","last_became_active":"2024-09-10T08:28:34.560429+0000","last_became_peered":"2024-09-10T08:28:34.560429+0000","last_unstale":"2024-09-10T08:28:35.582053+0000","last_undegraded":"2024-09-10T08:28:35.582053+0000","last_fullsized":"2024-09-10T08:28:35.582053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:54.514467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581989+0000","last_change":"2024-09-10T08:28:35.577124+0000","last_active":"2024-09-10T08:28:35.581989+0000","last_peered":"2024-09-10T08:28:35.581989+0000","last_clean":"2024-09-10T08:28:35.581989+0000","last_became_active":"2024-09-10T08:28:35.576655+0000","last_became_peered":"2024-09-10T08:28:35.576655+0000","last_unstale":"2024-09-10T08:28:35.581989+0000","last_undegraded":"2024-09-10T08:28:35.581989+0000","last_fullsized":"2024-09-10T08:28:35.581989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:57.339318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619122+0000","last_change":"2024-09-10T08:28:34.559911+0000","last_active":"2024-09-10T08:28:36.619122+0000","last_peered":"2024-09-10T08:28:36.619122+0000","last_clean":"2024-09-10T08:28:36.619122+0000","last_became_active":"2024-09-10T08:28:34.559635+0000","last_became_peered":"2024-09-10T08:28:34.559635+0000","last_unstale":"2024-09-10T08:28:36.619122+0000","last_undegraded":"2024-09-10T08:28:36.619122+0000","last_fullsized":"2024-09-10T08:28:36.619122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:40.892609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.577384+0000","last_change":"2024-09-10T08:28:35.574532+0000","last_active":"2024-09-10T08:28:35.577384+0000","last_peered":"2024-09-10T08:28:35.577384+0000","last_clean":"2024-09-10T08:28:35.577384+0000","last_became_active":"2024-09-10T08:28:35.574215+0000","last_became_peered":"2024-09-10T08:28:35.574215+0000","last_unstale":"2024-09-10T08:28:35.577384+0000","last_undegraded":"2024-09-10T08:28:35.577384+0000","last_fullsized":"2024-09-10T08:28:35.577384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:54.299622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.565625+0000","last_change":"2024-09-10T08:28:26.724394+0000","last_active":"2024-09-10T08:28:35.565625+0000","last_peered":"2024-09-10T08:28:35.565625+0000","last_clean":"2024-09-10T08:28:35.565625+0000","last_became_active":"2024-09-10T08:28:26.723452+0000","last_became_peered":"2024-09-10T08:28:26.723452+0000","last_unstale":"2024-09-10T08:28:35.565625+0000","last_undegraded":"2024-09-10T08:28:35.565625+0000","last_fullsized":"2024-09-10T08:28:35.565625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_clean_scrub_stamp":"2024-09-10T08:28:25.445753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:00.811505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556142+0000","last_change":"2024-09-10T08:28:34.555587+0000","last_active":"2024-09-10T08:28:35.556142+0000","last_peered":"2024-09-10T08:28:35.556142+0000","last_clean":"2024-09-10T08:28:35.556142+0000","last_became_active":"2024-09-10T08:28:34.555269+0000","last_became_peered":"2024-09-10T08:28:34.555269+0000","last_unstale":"2024-09-10T08:28:35.556142+0000","last_undegraded":"2024-09-10T08:28:35.556142+0000","last_fullsized":"2024-09-10T08:28:35.556142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:19.499870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582012+0000","last_change":"2024-09-10T08:28:35.572658+0000","last_active":"2024-09-10T08:28:35.582012+0000","last_peered":"2024-09-10T08:28:35.582012+0000","last_clean":"2024-09-10T08:28:35.582012+0000","last_became_active":"2024-09-10T08:28:35.571611+0000","last_became_peered":"2024-09-10T08:28:35.571611+0000","last_unstale":"2024-09-10T08:28:35.582012+0000","last_undegraded":"2024-09-10T08:28:35.582012+0000","last_fullsized":"2024-09-10T08:28:35.582012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:44.555736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.565556+0000","last_change":"2024-09-10T08:28:34.568477+0000","last_active":"2024-09-10T08:28:35.565556+0000","last_peered":"2024-09-10T08:28:35.565556+0000","last_clean":"2024-09-10T08:28:35.565556+0000","last_became_active":"2024-09-10T08:28:34.568249+0000","last_became_peered":"2024-09-10T08:28:34.568249+0000","last_unstale":"2024-09-10T08:28:35.565556+0000","last_undegraded":"2024-09-10T08:28:35.565556+0000","last_fullsized":"2024-09-10T08:28:35.565556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:08.640043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579232+0000","last_change":"2024-09-10T08:28:35.576360+0000","last_active":"2024-09-10T08:28:35.579232+0000","last_peered":"2024-09-10T08:28:35.579232+0000","last_clean":"2024-09-10T08:28:35.579232+0000","last_became_active":"2024-09-10T08:28:35.576096+0000","last_became_peered":"2024-09-10T08:28:35.576096+0000","last_unstale":"2024-09-10T08:28:35.579232+0000","last_undegraded":"2024-09-10T08:28:35.579232+0000","last_fullsized":"2024-09-10T08:28:35.579232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:51.274979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620584+0000","last_change":"2024-09-10T08:28:34.560745+0000","last_active":"2024-09-10T08:28:36.620584+0000","last_peered":"2024-09-10T08:28:36.620584+0000","last_clean":"2024-09-10T08:28:36.620584+0000","last_became_active":"2024-09-10T08:28:34.559911+0000","last_became_peered":"2024-09-10T08:28:34.559911+0000","last_unstale":"2024-09-10T08:28:36.620584+0000","last_undegraded":"2024-09-10T08:28:36.620584+0000","last_fullsized":"2024-09-10T08:28:36.620584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:00.234067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.572722+0000","last_change":"2024-09-10T08:28:35.566745+0000","last_active":"2024-09-10T08:28:35.572722+0000","last_peered":"2024-09-10T08:28:35.572722+0000","last_clean":"2024-09-10T08:28:35.572722+0000","last_became_active":"2024-09-10T08:28:35.566444+0000","last_became_peered":"2024-09-10T08:28:35.566444+0000","last_unstale":"2024-09-10T08:28:35.572722+0000","last_undegraded":"2024-09-10T08:28:35.572722+0000","last_fullsized":"2024-09-10T08:28:35.572722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:37.924675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.557028+0000","last_change":"2024-09-10T08:28:34.553983+0000","last_active":"2024-09-10T08:28:35.557028+0000","last_peered":"2024-09-10T08:28:35.557028+0000","last_clean":"2024-09-10T08:28:35.557028+0000","last_became_active":"2024-09-10T08:28:34.553693+0000","last_became_peered":"2024-09-10T08:28:34.553693+0000","last_unstale":"2024-09-10T08:28:35.557028+0000","last_undegraded":"2024-09-10T08:28:35.557028+0000","last_fullsized":"2024-09-10T08:28:35.557028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:40.001685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.580684+0000","last_change":"2024-09-10T08:28:35.577978+0000","last_active":"2024-09-10T08:28:35.580684+0000","last_peered":"2024-09-10T08:28:35.580684+0000","last_clean":"2024-09-10T08:28:35.580684+0000","last_became_active":"2024-09-10T08:28:35.577718+0000","last_became_peered":"2024-09-10T08:28:35.577718+0000","last_unstale":"2024-09-10T08:28:35.580684+0000","last_undegraded":"2024-09-10T08:28:35.580684+0000","last_fullsized":"2024-09-10T08:28:35.580684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:46.194153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.557039+0000","last_change":"2024-09-10T08:28:34.555212+0000","last_active":"2024-09-10T08:28:35.557039+0000","last_peered":"2024-09-10T08:28:35.557039+0000","last_clean":"2024-09-10T08:28:35.557039+0000","last_became_active":"2024-09-10T08:28:34.554922+0000","last_became_peered":"2024-09-10T08:28:34.554922+0000","last_unstale":"2024-09-10T08:28:35.557039+0000","last_undegraded":"2024-09-10T08:28:35.557039+0000","last_fullsized":"2024-09-10T08:28:35.557039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581944+0000","last_change":"2024-09-10T08:28:35.576280+0000","last_active":"2024-09-10T08:28:35.581944+0000","last_peered":"2024-09-10T08:28:35.581944+0000","last_clean":"2024-09-10T08:28:35.581944+0000","last_became_active":"2024-09-10T08:28:35.576002+0000","last_became_peered":"2024-09-10T08:28:35.576002+0000","last_unstale":"2024-09-10T08:28:35.581944+0000","last_undegraded":"2024-09-10T08:28:35.581944+0000","last_fullsized":"2024-09-10T08:28:35.581944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:47.191902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.565441+0000","last_change":"2024-09-10T08:28:34.571283+0000","last_active":"2024-09-10T08:28:35.565441+0000","last_peered":"2024-09-10T08:28:35.565441+0000","last_clean":"2024-09-10T08:28:35.565441+0000","last_became_active":"2024-09-10T08:28:34.570791+0000","last_became_peered":"2024-09-10T08:28:34.570791+0000","last_unstale":"2024-09-10T08:28:35.565441+0000","last_undegraded":"2024-09-10T08:28:35.565441+0000","last_fullsized":"2024-09-10T08:28:35.565441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:17.427597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.572702+0000","last_change":"2024-09-10T08:28:35.567481+0000","last_active":"2024-09-10T08:28:35.572702+0000","last_peered":"2024-09-10T08:28:35.572702+0000","last_clean":"2024-09-10T08:28:35.572702+0000","last_became_active":"2024-09-10T08:28:35.567167+0000","last_became_peered":"2024-09-10T08:28:35.567167+0000","last_unstale":"2024-09-10T08:28:35.572702+0000","last_undegraded":"2024-09-10T08:28:35.572702+0000","last_fullsized":"2024-09-10T08:28:35.572702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:45.440275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556778+0000","last_change":"2024-09-10T08:28:34.563451+0000","last_active":"2024-09-10T08:28:35.556778+0000","last_peered":"2024-09-10T08:28:35.556778+0000","last_clean":"2024-09-10T08:28:35.556778+0000","last_became_active":"2024-09-10T08:28:34.563259+0000","last_became_peered":"2024-09-10T08:28:34.563259+0000","last_unstale":"2024-09-10T08:28:35.556778+0000","last_undegraded":"2024-09-10T08:28:35.556778+0000","last_fullsized":"2024-09-10T08:28:35.556778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:44.899351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581971+0000","last_change":"2024-09-10T08:28:35.574107+0000","last_active":"2024-09-10T08:28:35.581971+0000","last_peered":"2024-09-10T08:28:35.581971+0000","last_clean":"2024-09-10T08:28:35.581971+0000","last_became_active":"2024-09-10T08:28:35.573851+0000","last_became_peered":"2024-09-10T08:28:35.573851+0000","last_unstale":"2024-09-10T08:28:35.581971+0000","last_undegraded":"2024-09-10T08:28:35.581971+0000","last_fullsized":"2024-09-10T08:28:35.581971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:24.848264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T08:28:33.545282+0000","last_change":"2024-09-10T08:28:33.545282+0000","last_active":"2024-09-10T08:28:33.538281+0000","last_peered":"2024-09-10T08:28:33.538281+0000","last_clean":"2024-09-10T08:28:33.538281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:33.545282+0000","last_undegraded":"2024-09-10T08:28:33.545282+0000","last_fullsized":"2024-09-10T08:28:33.545282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579227+0000","last_change":"2024-09-10T08:28:35.575106+0000","last_active":"2024-09-10T08:28:35.579227+0000","last_peered":"2024-09-10T08:28:35.579227+0000","last_clean":"2024-09-10T08:28:35.579227+0000","last_became_active":"2024-09-10T08:28:35.574815+0000","last_became_peered":"2024-09-10T08:28:35.574815+0000","last_unstale":"2024-09-10T08:28:35.579227+0000","last_undegraded":"2024-09-10T08:28:35.579227+0000","last_fullsized":"2024-09-10T08:28:35.579227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:39.473943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.565374+0000","last_change":"2024-09-10T08:28:34.571069+0000","last_active":"2024-09-10T08:28:35.565374+0000","last_peered":"2024-09-10T08:28:35.565374+0000","last_clean":"2024-09-10T08:28:35.565374+0000","last_became_active":"2024-09-10T08:28:34.570766+0000","last_became_peered":"2024-09-10T08:28:34.570766+0000","last_unstale":"2024-09-10T08:28:35.565374+0000","last_undegraded":"2024-09-10T08:28:35.565374+0000","last_fullsized":"2024-09-10T08:28:35.565374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:47.458195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.574702+0000","last_change":"2024-09-10T08:28:35.569938+0000","last_active":"2024-09-10T08:28:35.574702+0000","last_peered":"2024-09-10T08:28:35.574702+0000","last_clean":"2024-09-10T08:28:35.574702+0000","last_became_active":"2024-09-10T08:28:35.569109+0000","last_became_peered":"2024-09-10T08:28:35.569109+0000","last_unstale":"2024-09-10T08:28:35.574702+0000","last_undegraded":"2024-09-10T08:28:35.574702+0000","last_fullsized":"2024-09-10T08:28:35.574702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:40.936585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.557127+0000","last_change":"2024-09-10T08:28:34.564813+0000","last_active":"2024-09-10T08:28:35.557127+0000","last_peered":"2024-09-10T08:28:35.557127+0000","last_clean":"2024-09-10T08:28:35.557127+0000","last_became_active":"2024-09-10T08:28:34.564557+0000","last_became_peered":"2024-09-10T08:28:34.564557+0000","last_unstale":"2024-09-10T08:28:35.557127+0000","last_undegraded":"2024-09-10T08:28:35.557127+0000","last_fullsized":"2024-09-10T08:28:35.557127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:48.356069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581850+0000","last_change":"2024-09-10T08:28:35.572363+0000","last_active":"2024-09-10T08:28:35.581850+0000","last_peered":"2024-09-10T08:28:35.581850+0000","last_clean":"2024-09-10T08:28:35.581850+0000","last_became_active":"2024-09-10T08:28:35.572108+0000","last_became_peered":"2024-09-10T08:28:35.572108+0000","last_unstale":"2024-09-10T08:28:35.581850+0000","last_undegraded":"2024-09-10T08:28:35.581850+0000","last_fullsized":"2024-09-10T08:28:35.581850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:47.800442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556782+0000","last_change":"2024-09-10T08:28:34.561324+0000","last_active":"2024-09-10T08:28:35.556782+0000","last_peered":"2024-09-10T08:28:35.556782+0000","last_clean":"2024-09-10T08:28:35.556782+0000","last_became_active":"2024-09-10T08:28:34.560974+0000","last_became_peered":"2024-09-10T08:28:34.560974+0000","last_unstale":"2024-09-10T08:28:35.556782+0000","last_undegraded":"2024-09-10T08:28:35.556782+0000","last_fullsized":"2024-09-10T08:28:35.556782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:18.790965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.584262+0000","last_change":"2024-09-10T08:28:35.577024+0000","last_active":"2024-09-10T08:28:35.584262+0000","last_peered":"2024-09-10T08:28:35.584262+0000","last_clean":"2024-09-10T08:28:35.584262+0000","last_became_active":"2024-09-10T08:28:35.576771+0000","last_became_peered":"2024-09-10T08:28:35.576771+0000","last_unstale":"2024-09-10T08:28:35.584262+0000","last_undegraded":"2024-09-10T08:28:35.584262+0000","last_fullsized":"2024-09-10T08:28:35.584262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:42.944227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.586398+0000","last_change":"2024-09-10T08:28:34.569235+0000","last_active":"2024-09-10T08:28:35.586398+0000","last_peered":"2024-09-10T08:28:35.586398+0000","last_clean":"2024-09-10T08:28:35.586398+0000","last_became_active":"2024-09-10T08:28:34.568899+0000","last_became_peered":"2024-09-10T08:28:34.568899+0000","last_unstale":"2024-09-10T08:28:35.586398+0000","last_undegraded":"2024-09-10T08:28:35.586398+0000","last_fullsized":"2024-09-10T08:28:35.586398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:21.927656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:34.539900+0000","last_change":"2024-09-10T08:28:34.539900+0000","last_active":"2024-09-10T08:28:34.539900+0000","last_peered":"2024-09-10T08:28:34.539900+0000","last_clean":"2024-09-10T08:28:34.539900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:34.539900+0000","last_undegraded":"2024-09-10T08:28:34.539900+0000","last_fullsized":"2024-09-10T08:28:34.539900+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.561221+0000","last_change":"2024-09-10T08:28:35.560380+0000","last_active":"2024-09-10T08:28:35.561221+0000","last_peered":"2024-09-10T08:28:35.561221+0000","last_clean":"2024-09-10T08:28:35.561221+0000","last_became_active":"2024-09-10T08:28:35.560095+0000","last_became_peered":"2024-09-10T08:28:35.560095+0000","last_unstale":"2024-09-10T08:28:35.561221+0000","last_undegraded":"2024-09-10T08:28:35.561221+0000","last_fullsized":"2024-09-10T08:28:35.561221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:10.493163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.586370+0000","last_change":"2024-09-10T08:28:34.566560+0000","last_active":"2024-09-10T08:28:35.586370+0000","last_peered":"2024-09-10T08:28:35.586370+0000","last_clean":"2024-09-10T08:28:35.586370+0000","last_became_active":"2024-09-10T08:28:34.566275+0000","last_became_peered":"2024-09-10T08:28:34.566275+0000","last_unstale":"2024-09-10T08:28:35.586370+0000","last_undegraded":"2024-09-10T08:28:35.586370+0000","last_fullsized":"2024-09-10T08:28:35.586370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:03.507683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.564414+0000","last_change":"2024-09-10T08:28:35.562132+0000","last_active":"2024-09-10T08:28:35.564414+0000","last_peered":"2024-09-10T08:28:35.564414+0000","last_clean":"2024-09-10T08:28:35.564414+0000","last_became_active":"2024-09-10T08:28:35.561842+0000","last_became_peered":"2024-09-10T08:28:35.561842+0000","last_unstale":"2024-09-10T08:28:35.564414+0000","last_undegraded":"2024-09-10T08:28:35.564414+0000","last_fullsized":"2024-09-10T08:28:35.564414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:55.020192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.586634+0000","last_change":"2024-09-10T08:28:34.571965+0000","last_active":"2024-09-10T08:28:35.586634+0000","last_peered":"2024-09-10T08:28:35.586634+0000","last_clean":"2024-09-10T08:28:35.586634+0000","last_became_active":"2024-09-10T08:28:34.571640+0000","last_became_peered":"2024-09-10T08:28:34.571640+0000","last_unstale":"2024-09-10T08:28:35.586634+0000","last_undegraded":"2024-09-10T08:28:35.586634+0000","last_fullsized":"2024-09-10T08:28:35.586634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:53.047030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.584568+0000","last_change":"2024-09-10T08:28:35.579033+0000","last_active":"2024-09-10T08:28:35.584568+0000","last_peered":"2024-09-10T08:28:35.584568+0000","last_clean":"2024-09-10T08:28:35.584568+0000","last_became_active":"2024-09-10T08:28:35.578333+0000","last_became_peered":"2024-09-10T08:28:35.578333+0000","last_unstale":"2024-09-10T08:28:35.584568+0000","last_undegraded":"2024-09-10T08:28:35.584568+0000","last_fullsized":"2024-09-10T08:28:35.584568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:33.115063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582973+0000","last_change":"2024-09-10T08:28:34.561691+0000","last_active":"2024-09-10T08:28:35.582973+0000","last_peered":"2024-09-10T08:28:35.582973+0000","last_clean":"2024-09-10T08:28:35.582973+0000","last_became_active":"2024-09-10T08:28:34.561410+0000","last_became_peered":"2024-09-10T08:28:34.561410+0000","last_unstale":"2024-09-10T08:28:35.582973+0000","last_undegraded":"2024-09-10T08:28:35.582973+0000","last_fullsized":"2024-09-10T08:28:35.582973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.629982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582221+0000","last_change":"2024-09-10T08:28:35.575267+0000","last_active":"2024-09-10T08:28:35.582221+0000","last_peered":"2024-09-10T08:28:35.582221+0000","last_clean":"2024-09-10T08:28:35.582221+0000","last_became_active":"2024-09-10T08:28:35.575019+0000","last_became_peered":"2024-09-10T08:28:35.575019+0000","last_unstale":"2024-09-10T08:28:35.582221+0000","last_undegraded":"2024-09-10T08:28:35.582221+0000","last_fullsized":"2024-09-10T08:28:35.582221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:56.550243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581879+0000","last_change":"2024-09-10T08:28:34.564816+0000","last_active":"2024-09-10T08:28:35.581879+0000","last_peered":"2024-09-10T08:28:35.581879+0000","last_clean":"2024-09-10T08:28:35.581879+0000","last_became_active":"2024-09-10T08:28:34.564545+0000","last_became_peered":"2024-09-10T08:28:34.564545+0000","last_unstale":"2024-09-10T08:28:35.581879+0000","last_undegraded":"2024-09-10T08:28:35.581879+0000","last_fullsized":"2024-09-10T08:28:35.581879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:34.365104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":650015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":59647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":59647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":68004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":59647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":650015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":72667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:28:39.510 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:28:39.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.644+0000 7fae39842640 1 Processor -- start 2024-09-10T08:28:39.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.644+0000 7fae39842640 1 -- start start 2024-09-10T08:28:39.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.645+0000 7fae39842640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fae34150480 0x7fae340c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.645+0000 7fae39842640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae3406c650 0x7fae340c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.645+0000 7fae39842640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae340c9c80 0x7fae340ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.645+0000 7fae39842640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fae3406c240 con 0x7fae34150480 2024-09-10T08:28:39.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.645+0000 7fae39842640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fae3415a330 con 0x7fae3406c650 2024-09-10T08:28:39.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.645+0000 7fae39842640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fae3415a7c0 con 0x7fae340c9c80 2024-09-10T08:28:39.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.645+0000 7fae32ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fae34150480 0x7fae340c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.645+0000 7fae32ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fae34150480 0x7fae340c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57538/0 (socket says 172.21.15.103:57538) 2024-09-10T08:28:39.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.645+0000 7fae32ffd640 1 -- 172.21.15.103:0/3924416561 learned_addr learned my addr 172.21.15.103:0/3924416561 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:39.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.645+0000 7fae337fe640 1 --2- 172.21.15.103:0/3924416561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae340c9c80 0x7fae340ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.645+0000 7fae2a7fc640 1 --2- 172.21.15.103:0/3924416561 >> v2:172.21.15.154:3300/0 conn(0x7fae3406c650 0x7fae340c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.645+0000 7fae32ffd640 1 -- 172.21.15.103:0/3924416561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae340c9c80 msgr2=0x7fae340ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:39.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.645+0000 7fae32ffd640 1 --2- 172.21.15.103:0/3924416561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae340c9c80 0x7fae340ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.645+0000 7fae32ffd640 1 -- 172.21.15.103:0/3924416561 >> v2:172.21.15.154:3300/0 conn(0x7fae3406c650 msgr2=0x7fae340c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:39.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.645+0000 7fae32ffd640 1 --2- 172.21.15.103:0/3924416561 >> v2:172.21.15.154:3300/0 conn(0x7fae3406c650 0x7fae340c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.645+0000 7fae32ffd640 1 -- 172.21.15.103:0/3924416561 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae34159a00 con 0x7fae34150480 2024-09-10T08:28:39.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.646+0000 7fae32ffd640 1 --2- 172.21.15.103:0/3924416561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae34150480 0x7fae340c7a90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fae340c6110 tx=0x7fae2402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1918021b8a0509d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:39.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.646+0000 7fae327fc640 1 -- 172.21.15.103:0/3924416561 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae24037070 con 0x7fae34150480 2024-09-10T08:28:39.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.646+0000 7fae327fc640 1 -- 172.21.15.103:0/3924416561 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae24032440 con 0x7fae34150480 2024-09-10T08:28:39.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.646+0000 7fae327fc640 1 -- 172.21.15.103:0/3924416561 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae24032810 con 0x7fae34150480 2024-09-10T08:28:39.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.647+0000 7fae39842640 1 -- 172.21.15.103:0/3924416561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae34150480 msgr2=0x7fae340c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.647+0000 7fae39842640 1 --2- 172.21.15.103:0/3924416561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae34150480 0x7fae340c7a90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fae340c6110 tx=0x7fae2402a1e0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.647+0000 7fae39842640 1 -- 172.21.15.103:0/3924416561 shutdown_connections 2024-09-10T08:28:39.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.647+0000 7fae39842640 1 --2- 172.21.15.103:0/3924416561 >> v2:172.21.15.154:3300/0 conn(0x7fae3406c650 0x7fae340c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.647+0000 7fae39842640 1 --2- 172.21.15.103:0/3924416561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae340c9c80 0x7fae340ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.647+0000 7fae39842640 1 --2- 172.21.15.103:0/3924416561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae34150480 0x7fae340c7a90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.647+0000 7fae39842640 1 -- 172.21.15.103:0/3924416561 >> 172.21.15.103:0/3924416561 conn(0x7fae34068030 msgr2=0x7fae34073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:39.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.647+0000 7fae39842640 1 -- 172.21.15.103:0/3924416561 shutdown_connections 2024-09-10T08:28:39.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.647+0000 7fae39842640 1 -- 172.21.15.103:0/3924416561 wait complete. 2024-09-10T08:28:39.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.648+0000 7fae39842640 1 Processor -- start 2024-09-10T08:28:39.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.648+0000 7fae39842640 1 -- start start 2024-09-10T08:28:39.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.649+0000 7fae39842640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae3406c650 0x7fae3414a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.649+0000 7fae39842640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae340c9c80 0x7fae341ef630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.649+0000 7fae39842640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae34150480 0x7fae340b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.649+0000 7fae39842640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fae340ca670 con 0x7fae34150480 2024-09-10T08:28:39.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.649+0000 7fae39842640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fae34159fc0 con 0x7fae340c9c80 2024-09-10T08:28:39.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.649+0000 7fae39842640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fae3406d270 con 0x7fae3406c650 2024-09-10T08:28:39.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.649+0000 7fae337fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae34150480 0x7fae340b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.649+0000 7fae337fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae34150480 0x7fae340b00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57546/0 (socket says 172.21.15.103:57546) 2024-09-10T08:28:39.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.649+0000 7fae337fe640 1 -- 172.21.15.103:0/1578643798 learned_addr learned my addr 172.21.15.103:0/1578643798 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:39.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.649+0000 7fae2a7fc640 1 --2- 172.21.15.103:0/1578643798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae340c9c80 0x7fae341ef630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.649+0000 7fae32ffd640 1 --2- 172.21.15.103:0/1578643798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae3406c650 0x7fae3414a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.649+0000 7fae337fe640 1 -- 172.21.15.103:0/1578643798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae3406c650 msgr2=0x7fae3414a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.649+0000 7fae337fe640 1 --2- 172.21.15.103:0/1578643798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae3406c650 0x7fae3414a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.649+0000 7fae337fe640 1 -- 172.21.15.103:0/1578643798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae340c9c80 msgr2=0x7fae341ef630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.649+0000 7fae337fe640 1 --2- 172.21.15.103:0/1578643798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae340c9c80 0x7fae341ef630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.649+0000 7fae337fe640 1 -- 172.21.15.103:0/1578643798 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae3414be50 con 0x7fae34150480 2024-09-10T08:28:39.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.649+0000 7fae337fe640 1 --2- 172.21.15.103:0/1578643798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae34150480 0x7fae340b00f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00efc0 tx=0x7fae2c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:39.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.649+0000 7fae30ff9640 1 -- 172.21.15.103:0/1578643798 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2c018020 con 0x7fae34150480 2024-09-10T08:28:39.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.649+0000 7fae30ff9640 1 -- 172.21.15.103:0/1578643798 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae2c014480 con 0x7fae34150480 2024-09-10T08:28:39.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.650+0000 7fae39842640 1 -- 172.21.15.103:0/1578643798 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae3414c130 con 0x7fae34150480 2024-09-10T08:28:39.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.650+0000 7fae30ff9640 1 -- 172.21.15.103:0/1578643798 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2c014870 con 0x7fae34150480 2024-09-10T08:28:39.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.650+0000 7fae39842640 1 -- 172.21.15.103:0/1578643798 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae3414a6f0 con 0x7fae34150480 2024-09-10T08:28:39.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.651+0000 7fae39842640 1 -- 172.21.15.103:0/1578643798 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae341eef00 con 0x7fae34150480 2024-09-10T08:28:39.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.651+0000 7fae30ff9640 1 -- 172.21.15.103:0/1578643798 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae2c01b020 con 0x7fae34150480 2024-09-10T08:28:39.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.651+0000 7fae30ff9640 1 --2- 172.21.15.103:0/1578643798 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae1406be30 0x7fae1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.651+0000 7fae30ff9640 1 -- 172.21.15.103:0/1578643798 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7fae2c08b800 con 0x7fae34150480 2024-09-10T08:28:39.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.651+0000 7fae32ffd640 1 --2- 172.21.15.103:0/1578643798 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae1406be30 0x7fae1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.652+0000 7fae32ffd640 1 --2- 172.21.15.103:0/1578643798 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae1406be30 0x7fae1406e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fae24034000 tx=0x7fae2402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:39.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.656+0000 7fae30ff9640 1 -- 172.21.15.103:0/1578643798 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae2c022030 con 0x7fae34150480 2024-09-10T08:28:39.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.818+0000 7fae39842640 1 -- 172.21.15.103:0/1578643798 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fae34156270 con 0x7fae1406be30 2024-09-10T08:28:39.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.823+0000 7fae30ff9640 1 -- 172.21.15.103:0/1578643798 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250435 (secure 0 0 0) 0x7fae34156270 con 0x7fae1406be30 2024-09-10T08:28:39.826 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:39.828 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T08:28:39.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.826+0000 7fae39842640 1 -- 172.21.15.103:0/1578643798 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae1406be30 msgr2=0x7fae1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.826+0000 7fae39842640 1 --2- 172.21.15.103:0/1578643798 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae1406be30 0x7fae1406e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fae24034000 tx=0x7fae2402e000 comp rx=0 tx=0).stop 2024-09-10T08:28:39.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.826+0000 7fae39842640 1 -- 172.21.15.103:0/1578643798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae34150480 msgr2=0x7fae340b00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.826+0000 7fae39842640 1 --2- 172.21.15.103:0/1578643798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae34150480 0x7fae340b00f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00efc0 tx=0x7fae2c00c490 comp rx=0 tx=0).stop 2024-09-10T08:28:39.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.826+0000 7fae39842640 1 -- 172.21.15.103:0/1578643798 shutdown_connections 2024-09-10T08:28:39.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.826+0000 7fae39842640 1 --2- 172.21.15.103:0/1578643798 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae1406be30 0x7fae1406e2f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.826+0000 7fae39842640 1 --2- 172.21.15.103:0/1578643798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae34150480 0x7fae340b00f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.826+0000 7fae39842640 1 --2- 172.21.15.103:0/1578643798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae340c9c80 0x7fae341ef630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.826+0000 7fae39842640 1 --2- 172.21.15.103:0/1578643798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae3406c650 0x7fae3414a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.826+0000 7fae39842640 1 -- 172.21.15.103:0/1578643798 >> 172.21.15.103:0/1578643798 conn(0x7fae34068030 msgr2=0x7fae341551d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:39.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.826+0000 7fae39842640 1 -- 172.21.15.103:0/1578643798 shutdown_connections 2024-09-10T08:28:39.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.826+0000 7fae39842640 1 -- 172.21.15.103:0/1578643798 wait complete. 2024-09-10T08:28:39.837 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-10T08:28:38.794305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":194,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218884,"kb_used_data":2636,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755836,"statfs":{"total":773094113280,"available":772869976064,"internally_reserved":0,"allocated":2699264,"data_stored":1673029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.254075"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.572264+0000","last_change":"2024-09-10T08:28:35.571065+0000","last_active":"2024-09-10T08:28:35.572264+0000","last_peered":"2024-09-10T08:28:35.572264+0000","last_clean":"2024-09-10T08:28:35.572264+0000","last_became_active":"2024-09-10T08:28:35.570749+0000","last_became_peered":"2024-09-10T08:28:35.570749+0000","last_unstale":"2024-09-10T08:28:35.572264+0000","last_undegraded":"2024-09-10T08:28:35.572264+0000","last_fullsized":"2024-09-10T08:28:35.572264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:45:43.769092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582300+0000","last_change":"2024-09-10T08:28:35.578197+0000","last_active":"2024-09-10T08:28:35.582300+0000","last_peered":"2024-09-10T08:28:35.582300+0000","last_clean":"2024-09-10T08:28:35.582300+0000","last_became_active":"2024-09-10T08:28:35.577852+0000","last_became_peered":"2024-09-10T08:28:35.577852+0000","last_unstale":"2024-09-10T08:28:35.582300+0000","last_undegraded":"2024-09-10T08:28:35.582300+0000","last_fullsized":"2024-09-10T08:28:35.582300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:42.678700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579443+0000","last_change":"2024-09-10T08:28:35.573918+0000","last_active":"2024-09-10T08:28:35.579443+0000","last_peered":"2024-09-10T08:28:35.579443+0000","last_clean":"2024-09-10T08:28:35.579443+0000","last_became_active":"2024-09-10T08:28:35.573646+0000","last_became_peered":"2024-09-10T08:28:35.573646+0000","last_unstale":"2024-09-10T08:28:35.579443+0000","last_undegraded":"2024-09-10T08:28:35.579443+0000","last_fullsized":"2024-09-10T08:28:35.579443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:33.686562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582117+0000","last_change":"2024-09-10T08:28:35.578961+0000","last_active":"2024-09-10T08:28:35.582117+0000","last_peered":"2024-09-10T08:28:35.582117+0000","last_clean":"2024-09-10T08:28:35.582117+0000","last_became_active":"2024-09-10T08:28:35.578680+0000","last_became_peered":"2024-09-10T08:28:35.578680+0000","last_unstale":"2024-09-10T08:28:35.582117+0000","last_undegraded":"2024-09-10T08:28:35.582117+0000","last_fullsized":"2024-09-10T08:28:35.582117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:59.172004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.574504+0000","last_change":"2024-09-10T08:28:35.572112+0000","last_active":"2024-09-10T08:28:35.574504+0000","last_peered":"2024-09-10T08:28:35.574504+0000","last_clean":"2024-09-10T08:28:35.574504+0000","last_became_active":"2024-09-10T08:28:35.571803+0000","last_became_peered":"2024-09-10T08:28:35.571803+0000","last_unstale":"2024-09-10T08:28:35.574504+0000","last_undegraded":"2024-09-10T08:28:35.574504+0000","last_fullsized":"2024-09-10T08:28:35.574504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:10.044940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582149+0000","last_change":"2024-09-10T08:28:35.578978+0000","last_active":"2024-09-10T08:28:35.582149+0000","last_peered":"2024-09-10T08:28:35.582149+0000","last_clean":"2024-09-10T08:28:35.582149+0000","last_became_active":"2024-09-10T08:28:35.578475+0000","last_became_peered":"2024-09-10T08:28:35.578475+0000","last_unstale":"2024-09-10T08:28:35.582149+0000","last_undegraded":"2024-09-10T08:28:35.582149+0000","last_fullsized":"2024-09-10T08:28:35.582149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:42.164241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.585683+0000","last_change":"2024-09-10T08:28:35.578664+0000","last_active":"2024-09-10T08:28:35.585683+0000","last_peered":"2024-09-10T08:28:35.585683+0000","last_clean":"2024-09-10T08:28:35.585683+0000","last_became_active":"2024-09-10T08:28:35.578384+0000","last_became_peered":"2024-09-10T08:28:35.578384+0000","last_unstale":"2024-09-10T08:28:35.585683+0000","last_undegraded":"2024-09-10T08:28:35.585683+0000","last_fullsized":"2024-09-10T08:28:35.585683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:34.146373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582054+0000","last_change":"2024-09-10T08:28:35.575275+0000","last_active":"2024-09-10T08:28:35.582054+0000","last_peered":"2024-09-10T08:28:35.582054+0000","last_clean":"2024-09-10T08:28:35.582054+0000","last_became_active":"2024-09-10T08:28:35.575052+0000","last_became_peered":"2024-09-10T08:28:35.575052+0000","last_unstale":"2024-09-10T08:28:35.582054+0000","last_undegraded":"2024-09-10T08:28:35.582054+0000","last_fullsized":"2024-09-10T08:28:35.582054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:06.466029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.585429+0000","last_change":"2024-09-10T08:28:35.577345+0000","last_active":"2024-09-10T08:28:35.585429+0000","last_peered":"2024-09-10T08:28:35.585429+0000","last_clean":"2024-09-10T08:28:35.585429+0000","last_became_active":"2024-09-10T08:28:35.576191+0000","last_became_peered":"2024-09-10T08:28:35.576191+0000","last_unstale":"2024-09-10T08:28:35.585429+0000","last_undegraded":"2024-09-10T08:28:35.585429+0000","last_fullsized":"2024-09-10T08:28:35.585429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:24.323783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:34.539900+0000","last_change":"2024-09-10T08:28:34.539900+0000","last_active":"2024-09-10T08:28:34.539900+0000","last_peered":"2024-09-10T08:28:34.539900+0000","last_clean":"2024-09-10T08:28:34.539900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:34.539900+0000","last_undegraded":"2024-09-10T08:28:34.539900+0000","last_fullsized":"2024-09-10T08:28:34.539900+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:34.539900+0000","last_change":"2024-09-10T08:28:34.539900+0000","last_active":"2024-09-10T08:28:34.539900+0000","last_peered":"2024-09-10T08:28:34.539900+0000","last_clean":"2024-09-10T08:28:34.539900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:34.539900+0000","last_undegraded":"2024-09-10T08:28:34.539900+0000","last_fullsized":"2024-09-10T08:28:34.539900+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.573460+0000","last_change":"2024-09-10T08:28:35.566574+0000","last_active":"2024-09-10T08:28:35.573460+0000","last_peered":"2024-09-10T08:28:35.573460+0000","last_clean":"2024-09-10T08:28:35.573460+0000","last_became_active":"2024-09-10T08:28:35.566205+0000","last_became_peered":"2024-09-10T08:28:35.566205+0000","last_unstale":"2024-09-10T08:28:35.573460+0000","last_undegraded":"2024-09-10T08:28:35.573460+0000","last_fullsized":"2024-09-10T08:28:35.573460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:44.800134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582120+0000","last_change":"2024-09-10T08:28:35.573330+0000","last_active":"2024-09-10T08:28:35.582120+0000","last_peered":"2024-09-10T08:28:35.582120+0000","last_clean":"2024-09-10T08:28:35.582120+0000","last_became_active":"2024-09-10T08:28:35.572992+0000","last_became_peered":"2024-09-10T08:28:35.572992+0000","last_unstale":"2024-09-10T08:28:35.582120+0000","last_undegraded":"2024-09-10T08:28:35.582120+0000","last_fullsized":"2024-09-10T08:28:35.582120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:17.660618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579134+0000","last_change":"2024-09-10T08:28:35.574551+0000","last_active":"2024-09-10T08:28:35.579134+0000","last_peered":"2024-09-10T08:28:35.579134+0000","last_clean":"2024-09-10T08:28:35.579134+0000","last_became_active":"2024-09-10T08:28:35.574256+0000","last_became_peered":"2024-09-10T08:28:35.574256+0000","last_unstale":"2024-09-10T08:28:35.579134+0000","last_undegraded":"2024-09-10T08:28:35.579134+0000","last_fullsized":"2024-09-10T08:28:35.579134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:46.296836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.566154+0000","last_change":"2024-09-10T08:28:35.560693+0000","last_active":"2024-09-10T08:28:35.566154+0000","last_peered":"2024-09-10T08:28:35.566154+0000","last_clean":"2024-09-10T08:28:35.566154+0000","last_became_active":"2024-09-10T08:28:35.560409+0000","last_became_peered":"2024-09-10T08:28:35.560409+0000","last_unstale":"2024-09-10T08:28:35.566154+0000","last_undegraded":"2024-09-10T08:28:35.566154+0000","last_fullsized":"2024-09-10T08:28:35.566154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:17:35.028101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.573680+0000","last_change":"2024-09-10T08:28:35.570249+0000","last_active":"2024-09-10T08:28:35.573680+0000","last_peered":"2024-09-10T08:28:35.573680+0000","last_clean":"2024-09-10T08:28:35.573680+0000","last_became_active":"2024-09-10T08:28:35.569960+0000","last_became_peered":"2024-09-10T08:28:35.569960+0000","last_unstale":"2024-09-10T08:28:35.573680+0000","last_undegraded":"2024-09-10T08:28:35.573680+0000","last_fullsized":"2024-09-10T08:28:35.573680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:38.524087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.571052+0000","last_change":"2024-09-10T08:28:35.567296+0000","last_active":"2024-09-10T08:28:35.571052+0000","last_peered":"2024-09-10T08:28:35.571052+0000","last_clean":"2024-09-10T08:28:35.571052+0000","last_became_active":"2024-09-10T08:28:35.567074+0000","last_became_peered":"2024-09-10T08:28:35.567074+0000","last_unstale":"2024-09-10T08:28:35.571052+0000","last_undegraded":"2024-09-10T08:28:35.571052+0000","last_fullsized":"2024-09-10T08:28:35.571052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:05.005278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619264+0000","last_change":"2024-09-10T08:28:35.574438+0000","last_active":"2024-09-10T08:28:36.619264+0000","last_peered":"2024-09-10T08:28:36.619264+0000","last_clean":"2024-09-10T08:28:36.619264+0000","last_became_active":"2024-09-10T08:28:35.574175+0000","last_became_peered":"2024-09-10T08:28:35.574175+0000","last_unstale":"2024-09-10T08:28:36.619264+0000","last_undegraded":"2024-09-10T08:28:36.619264+0000","last_fullsized":"2024-09-10T08:28:36.619264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:55.808543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.574680+0000","last_change":"2024-09-10T08:28:35.572709+0000","last_active":"2024-09-10T08:28:35.574680+0000","last_peered":"2024-09-10T08:28:35.574680+0000","last_clean":"2024-09-10T08:28:35.574680+0000","last_became_active":"2024-09-10T08:28:35.572392+0000","last_became_peered":"2024-09-10T08:28:35.572392+0000","last_unstale":"2024-09-10T08:28:35.574680+0000","last_undegraded":"2024-09-10T08:28:35.574680+0000","last_fullsized":"2024-09-10T08:28:35.574680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:58.255939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:34.539900+0000","last_change":"2024-09-10T08:28:34.539900+0000","last_active":"2024-09-10T08:28:34.539900+0000","last_peered":"2024-09-10T08:28:34.539900+0000","last_clean":"2024-09-10T08:28:34.539900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:34.539900+0000","last_undegraded":"2024-09-10T08:28:34.539900+0000","last_fullsized":"2024-09-10T08:28:34.539900+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579258+0000","last_change":"2024-09-10T08:28:35.575802+0000","last_active":"2024-09-10T08:28:35.579258+0000","last_peered":"2024-09-10T08:28:35.579258+0000","last_clean":"2024-09-10T08:28:35.579258+0000","last_became_active":"2024-09-10T08:28:35.575388+0000","last_became_peered":"2024-09-10T08:28:35.575388+0000","last_unstale":"2024-09-10T08:28:35.579258+0000","last_undegraded":"2024-09-10T08:28:35.579258+0000","last_fullsized":"2024-09-10T08:28:35.579258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:59.338559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.571167+0000","last_change":"2024-09-10T08:28:35.568044+0000","last_active":"2024-09-10T08:28:35.571167+0000","last_peered":"2024-09-10T08:28:35.571167+0000","last_clean":"2024-09-10T08:28:35.571167+0000","last_became_active":"2024-09-10T08:28:35.567744+0000","last_became_peered":"2024-09-10T08:28:35.567744+0000","last_unstale":"2024-09-10T08:28:35.571167+0000","last_undegraded":"2024-09-10T08:28:35.571167+0000","last_fullsized":"2024-09-10T08:28:35.571167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:09:31.071067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581919+0000","last_change":"2024-09-10T08:28:35.571566+0000","last_active":"2024-09-10T08:28:35.581919+0000","last_peered":"2024-09-10T08:28:35.581919+0000","last_clean":"2024-09-10T08:28:35.581919+0000","last_became_active":"2024-09-10T08:28:35.571285+0000","last_became_peered":"2024-09-10T08:28:35.571285+0000","last_unstale":"2024-09-10T08:28:35.581919+0000","last_undegraded":"2024-09-10T08:28:35.581919+0000","last_fullsized":"2024-09-10T08:28:35.581919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:32.338136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582042+0000","last_change":"2024-09-10T08:28:35.578285+0000","last_active":"2024-09-10T08:28:35.582042+0000","last_peered":"2024-09-10T08:28:35.582042+0000","last_clean":"2024-09-10T08:28:35.582042+0000","last_became_active":"2024-09-10T08:28:35.576805+0000","last_became_peered":"2024-09-10T08:28:35.576805+0000","last_unstale":"2024-09-10T08:28:35.582042+0000","last_undegraded":"2024-09-10T08:28:35.582042+0000","last_fullsized":"2024-09-10T08:28:35.582042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:36.953572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582073+0000","last_change":"2024-09-10T08:28:35.575902+0000","last_active":"2024-09-10T08:28:35.582073+0000","last_peered":"2024-09-10T08:28:35.582073+0000","last_clean":"2024-09-10T08:28:35.582073+0000","last_became_active":"2024-09-10T08:28:35.575614+0000","last_became_peered":"2024-09-10T08:28:35.575614+0000","last_unstale":"2024-09-10T08:28:35.582073+0000","last_undegraded":"2024-09-10T08:28:35.582073+0000","last_fullsized":"2024-09-10T08:28:35.582073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:47.654980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:34.539900+0000","last_change":"2024-09-10T08:28:34.539900+0000","last_active":"2024-09-10T08:28:34.539900+0000","last_peered":"2024-09-10T08:28:34.539900+0000","last_clean":"2024-09-10T08:28:34.539900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:34.539900+0000","last_undegraded":"2024-09-10T08:28:34.539900+0000","last_fullsized":"2024-09-10T08:28:34.539900+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.575566+0000","last_change":"2024-09-10T08:28:35.572550+0000","last_active":"2024-09-10T08:28:35.575566+0000","last_peered":"2024-09-10T08:28:35.575566+0000","last_clean":"2024-09-10T08:28:35.575566+0000","last_became_active":"2024-09-10T08:28:35.572184+0000","last_became_peered":"2024-09-10T08:28:35.572184+0000","last_unstale":"2024-09-10T08:28:35.575566+0000","last_undegraded":"2024-09-10T08:28:35.575566+0000","last_fullsized":"2024-09-10T08:28:35.575566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:29.422204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582039+0000","last_change":"2024-09-10T08:28:35.574676+0000","last_active":"2024-09-10T08:28:35.582039+0000","last_peered":"2024-09-10T08:28:35.582039+0000","last_clean":"2024-09-10T08:28:35.582039+0000","last_became_active":"2024-09-10T08:28:35.574437+0000","last_became_peered":"2024-09-10T08:28:35.574437+0000","last_unstale":"2024-09-10T08:28:35.582039+0000","last_undegraded":"2024-09-10T08:28:35.582039+0000","last_fullsized":"2024-09-10T08:28:35.582039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:31.398284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582245+0000","last_change":"2024-09-10T08:28:35.577852+0000","last_active":"2024-09-10T08:28:35.582245+0000","last_peered":"2024-09-10T08:28:35.582245+0000","last_clean":"2024-09-10T08:28:35.582245+0000","last_became_active":"2024-09-10T08:28:35.577571+0000","last_became_peered":"2024-09-10T08:28:35.577571+0000","last_unstale":"2024-09-10T08:28:35.582245+0000","last_undegraded":"2024-09-10T08:28:35.582245+0000","last_fullsized":"2024-09-10T08:28:35.582245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:07:32.121601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582131+0000","last_change":"2024-09-10T08:28:35.578735+0000","last_active":"2024-09-10T08:28:35.582131+0000","last_peered":"2024-09-10T08:28:35.582131+0000","last_clean":"2024-09-10T08:28:35.582131+0000","last_became_active":"2024-09-10T08:28:35.577995+0000","last_became_peered":"2024-09-10T08:28:35.577995+0000","last_unstale":"2024-09-10T08:28:35.582131+0000","last_undegraded":"2024-09-10T08:28:35.582131+0000","last_fullsized":"2024-09-10T08:28:35.582131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:32.178282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620517+0000","last_change":"2024-09-10T08:28:35.566780+0000","last_active":"2024-09-10T08:28:36.620517+0000","last_peered":"2024-09-10T08:28:36.620517+0000","last_clean":"2024-09-10T08:28:36.620517+0000","last_became_active":"2024-09-10T08:28:35.566529+0000","last_became_peered":"2024-09-10T08:28:35.566529+0000","last_unstale":"2024-09-10T08:28:36.620517+0000","last_undegraded":"2024-09-10T08:28:36.620517+0000","last_fullsized":"2024-09-10T08:28:36.620517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:09.481166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:34.539900+0000","last_change":"2024-09-10T08:28:34.539900+0000","last_active":"2024-09-10T08:28:34.539900+0000","last_peered":"2024-09-10T08:28:34.539900+0000","last_clean":"2024-09-10T08:28:34.539900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:34.539900+0000","last_undegraded":"2024-09-10T08:28:34.539900+0000","last_fullsized":"2024-09-10T08:28:34.539900+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.560246+0000","last_change":"2024-09-10T08:28:35.559371+0000","last_active":"2024-09-10T08:28:35.560246+0000","last_peered":"2024-09-10T08:28:35.560246+0000","last_clean":"2024-09-10T08:28:35.560246+0000","last_became_active":"2024-09-10T08:28:35.559145+0000","last_became_peered":"2024-09-10T08:28:35.559145+0000","last_unstale":"2024-09-10T08:28:35.560246+0000","last_undegraded":"2024-09-10T08:28:35.560246+0000","last_fullsized":"2024-09-10T08:28:35.560246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:34:56.302624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582149+0000","last_change":"2024-09-10T08:28:34.566606+0000","last_active":"2024-09-10T08:28:35.582149+0000","last_peered":"2024-09-10T08:28:35.582149+0000","last_clean":"2024-09-10T08:28:35.582149+0000","last_became_active":"2024-09-10T08:28:34.566388+0000","last_became_peered":"2024-09-10T08:28:34.566388+0000","last_unstale":"2024-09-10T08:28:35.582149+0000","last_undegraded":"2024-09-10T08:28:35.582149+0000","last_fullsized":"2024-09-10T08:28:35.582149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:33.528801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582227+0000","last_change":"2024-09-10T08:28:35.576406+0000","last_active":"2024-09-10T08:28:35.582227+0000","last_peered":"2024-09-10T08:28:35.582227+0000","last_clean":"2024-09-10T08:28:35.582227+0000","last_became_active":"2024-09-10T08:28:35.576145+0000","last_became_peered":"2024-09-10T08:28:35.576145+0000","last_unstale":"2024-09-10T08:28:35.582227+0000","last_undegraded":"2024-09-10T08:28:35.582227+0000","last_fullsized":"2024-09-10T08:28:35.582227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:55.026157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T08:28:33.545183+0000","last_change":"2024-09-10T08:28:33.545183+0000","last_active":"2024-09-10T08:28:33.538281+0000","last_peered":"2024-09-10T08:28:33.538281+0000","last_clean":"2024-09-10T08:28:33.538281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:33.545183+0000","last_undegraded":"2024-09-10T08:28:33.545183+0000","last_fullsized":"2024-09-10T08:28:33.545183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.568578+0000","last_change":"2024-09-10T08:28:34.564751+0000","last_active":"2024-09-10T08:28:35.568578+0000","last_peered":"2024-09-10T08:28:35.568578+0000","last_clean":"2024-09-10T08:28:35.568578+0000","last_became_active":"2024-09-10T08:28:34.564479+0000","last_became_peered":"2024-09-10T08:28:34.564479+0000","last_unstale":"2024-09-10T08:28:35.568578+0000","last_undegraded":"2024-09-10T08:28:35.568578+0000","last_fullsized":"2024-09-10T08:28:35.568578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:29.618224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.584085+0000","last_change":"2024-09-10T08:28:35.580244+0000","last_active":"2024-09-10T08:28:35.584085+0000","last_peered":"2024-09-10T08:28:35.584085+0000","last_clean":"2024-09-10T08:28:35.584085+0000","last_became_active":"2024-09-10T08:28:35.579975+0000","last_became_peered":"2024-09-10T08:28:35.579975+0000","last_unstale":"2024-09-10T08:28:35.584085+0000","last_undegraded":"2024-09-10T08:28:35.584085+0000","last_fullsized":"2024-09-10T08:28:35.584085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:07.055709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556929+0000","last_change":"2024-09-10T08:28:34.554346+0000","last_active":"2024-09-10T08:28:35.556929+0000","last_peered":"2024-09-10T08:28:35.556929+0000","last_clean":"2024-09-10T08:28:35.556929+0000","last_became_active":"2024-09-10T08:28:34.553933+0000","last_became_peered":"2024-09-10T08:28:34.553933+0000","last_unstale":"2024-09-10T08:28:35.556929+0000","last_undegraded":"2024-09-10T08:28:35.556929+0000","last_fullsized":"2024-09-10T08:28:35.556929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:07.639671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.576475+0000","last_change":"2024-09-10T08:28:35.572803+0000","last_active":"2024-09-10T08:28:35.576475+0000","last_peered":"2024-09-10T08:28:35.576475+0000","last_clean":"2024-09-10T08:28:35.576475+0000","last_became_active":"2024-09-10T08:28:35.572219+0000","last_became_peered":"2024-09-10T08:28:35.572219+0000","last_unstale":"2024-09-10T08:28:35.576475+0000","last_undegraded":"2024-09-10T08:28:35.576475+0000","last_fullsized":"2024-09-10T08:28:35.576475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:01:26.046238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T08:28:33.545852+0000","last_change":"2024-09-10T08:28:33.545852+0000","last_active":"2024-09-10T08:28:33.538281+0000","last_peered":"2024-09-10T08:28:33.538281+0000","last_clean":"2024-09-10T08:28:33.538281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:33.545852+0000","last_undegraded":"2024-09-10T08:28:33.545852+0000","last_fullsized":"2024-09-10T08:28:33.545852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.576172+0000","last_change":"2024-09-10T08:28:35.572944+0000","last_active":"2024-09-10T08:28:35.576172+0000","last_peered":"2024-09-10T08:28:35.576172+0000","last_clean":"2024-09-10T08:28:35.576172+0000","last_became_active":"2024-09-10T08:28:35.572620+0000","last_became_peered":"2024-09-10T08:28:35.572620+0000","last_unstale":"2024-09-10T08:28:35.576172+0000","last_undegraded":"2024-09-10T08:28:35.576172+0000","last_fullsized":"2024-09-10T08:28:35.576172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:59.209973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556683+0000","last_change":"2024-09-10T08:28:34.564571+0000","last_active":"2024-09-10T08:28:35.556683+0000","last_peered":"2024-09-10T08:28:35.556683+0000","last_clean":"2024-09-10T08:28:35.556683+0000","last_became_active":"2024-09-10T08:28:34.564189+0000","last_became_peered":"2024-09-10T08:28:34.564189+0000","last_unstale":"2024-09-10T08:28:35.556683+0000","last_undegraded":"2024-09-10T08:28:35.556683+0000","last_fullsized":"2024-09-10T08:28:35.556683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:46.055510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582203+0000","last_change":"2024-09-10T08:28:35.577913+0000","last_active":"2024-09-10T08:28:35.582203+0000","last_peered":"2024-09-10T08:28:35.582203+0000","last_clean":"2024-09-10T08:28:35.582203+0000","last_became_active":"2024-09-10T08:28:35.577255+0000","last_became_peered":"2024-09-10T08:28:35.577255+0000","last_unstale":"2024-09-10T08:28:35.582203+0000","last_undegraded":"2024-09-10T08:28:35.582203+0000","last_fullsized":"2024-09-10T08:28:35.582203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:17.573799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581974+0000","last_change":"2024-09-10T08:28:34.557352+0000","last_active":"2024-09-10T08:28:35.581974+0000","last_peered":"2024-09-10T08:28:35.581974+0000","last_clean":"2024-09-10T08:28:35.581974+0000","last_became_active":"2024-09-10T08:28:34.557076+0000","last_became_peered":"2024-09-10T08:28:34.557076+0000","last_unstale":"2024-09-10T08:28:35.581974+0000","last_undegraded":"2024-09-10T08:28:35.581974+0000","last_fullsized":"2024-09-10T08:28:35.581974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:04.957739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.575391+0000","last_change":"2024-09-10T08:28:35.571262+0000","last_active":"2024-09-10T08:28:35.575391+0000","last_peered":"2024-09-10T08:28:35.575391+0000","last_clean":"2024-09-10T08:28:35.575391+0000","last_became_active":"2024-09-10T08:28:35.570711+0000","last_became_peered":"2024-09-10T08:28:35.570711+0000","last_unstale":"2024-09-10T08:28:35.575391+0000","last_undegraded":"2024-09-10T08:28:35.575391+0000","last_fullsized":"2024-09-10T08:28:35.575391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:26.384552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T08:28:33.545269+0000","last_change":"2024-09-10T08:28:33.545269+0000","last_active":"2024-09-10T08:28:33.538281+0000","last_peered":"2024-09-10T08:28:33.538281+0000","last_clean":"2024-09-10T08:28:33.538281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:33.545269+0000","last_undegraded":"2024-09-10T08:28:33.545269+0000","last_fullsized":"2024-09-10T08:28:33.545269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.586558+0000","last_change":"2024-09-10T08:28:35.582473+0000","last_active":"2024-09-10T08:28:35.586558+0000","last_peered":"2024-09-10T08:28:35.586558+0000","last_clean":"2024-09-10T08:28:35.586558+0000","last_became_active":"2024-09-10T08:28:35.582205+0000","last_became_peered":"2024-09-10T08:28:35.582205+0000","last_unstale":"2024-09-10T08:28:35.586558+0000","last_undegraded":"2024-09-10T08:28:35.586558+0000","last_fullsized":"2024-09-10T08:28:35.586558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:51.531897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.583031+0000","last_change":"2024-09-10T08:28:34.553556+0000","last_active":"2024-09-10T08:28:35.583031+0000","last_peered":"2024-09-10T08:28:35.583031+0000","last_clean":"2024-09-10T08:28:35.583031+0000","last_became_active":"2024-09-10T08:28:34.553275+0000","last_became_peered":"2024-09-10T08:28:34.553275+0000","last_unstale":"2024-09-10T08:28:35.583031+0000","last_undegraded":"2024-09-10T08:28:35.583031+0000","last_fullsized":"2024-09-10T08:28:35.583031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:45.957635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579158+0000","last_change":"2024-09-10T08:28:35.574810+0000","last_active":"2024-09-10T08:28:35.579158+0000","last_peered":"2024-09-10T08:28:35.579158+0000","last_clean":"2024-09-10T08:28:35.579158+0000","last_became_active":"2024-09-10T08:28:35.574567+0000","last_became_peered":"2024-09-10T08:28:35.574567+0000","last_unstale":"2024-09-10T08:28:35.579158+0000","last_undegraded":"2024-09-10T08:28:35.579158+0000","last_fullsized":"2024-09-10T08:28:35.579158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:28.056169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556821+0000","last_change":"2024-09-10T08:28:34.560699+0000","last_active":"2024-09-10T08:28:35.556821+0000","last_peered":"2024-09-10T08:28:35.556821+0000","last_clean":"2024-09-10T08:28:35.556821+0000","last_became_active":"2024-09-10T08:28:34.560376+0000","last_became_peered":"2024-09-10T08:28:34.560376+0000","last_unstale":"2024-09-10T08:28:35.556821+0000","last_undegraded":"2024-09-10T08:28:35.556821+0000","last_fullsized":"2024-09-10T08:28:35.556821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:09.981216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.580029+0000","last_change":"2024-09-10T08:28:35.575788+0000","last_active":"2024-09-10T08:28:35.580029+0000","last_peered":"2024-09-10T08:28:35.580029+0000","last_clean":"2024-09-10T08:28:35.580029+0000","last_became_active":"2024-09-10T08:28:35.575333+0000","last_became_peered":"2024-09-10T08:28:35.575333+0000","last_unstale":"2024-09-10T08:28:35.580029+0000","last_undegraded":"2024-09-10T08:28:35.580029+0000","last_fullsized":"2024-09-10T08:28:35.580029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:17.994128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T08:28:33.545130+0000","last_change":"2024-09-10T08:28:33.545130+0000","last_active":"2024-09-10T08:28:33.538281+0000","last_peered":"2024-09-10T08:28:33.538281+0000","last_clean":"2024-09-10T08:28:33.538281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:33.545130+0000","last_undegraded":"2024-09-10T08:28:33.545130+0000","last_fullsized":"2024-09-10T08:28:33.545130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:34.539900+0000","last_change":"2024-09-10T08:28:34.539900+0000","last_active":"2024-09-10T08:28:34.539900+0000","last_peered":"2024-09-10T08:28:34.539900+0000","last_clean":"2024-09-10T08:28:34.539900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:34.539900+0000","last_undegraded":"2024-09-10T08:28:34.539900+0000","last_fullsized":"2024-09-10T08:28:34.539900+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619641+0000","last_change":"2024-09-10T08:28:34.555542+0000","last_active":"2024-09-10T08:28:36.619641+0000","last_peered":"2024-09-10T08:28:36.619641+0000","last_clean":"2024-09-10T08:28:36.619641+0000","last_became_active":"2024-09-10T08:28:34.555179+0000","last_became_peered":"2024-09-10T08:28:34.555179+0000","last_unstale":"2024-09-10T08:28:36.619641+0000","last_undegraded":"2024-09-10T08:28:36.619641+0000","last_fullsized":"2024-09-10T08:28:36.619641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:53.313161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.577350+0000","last_change":"2024-09-10T08:28:35.575307+0000","last_active":"2024-09-10T08:28:35.577350+0000","last_peered":"2024-09-10T08:28:35.577350+0000","last_clean":"2024-09-10T08:28:35.577350+0000","last_became_active":"2024-09-10T08:28:35.575038+0000","last_became_peered":"2024-09-10T08:28:35.575038+0000","last_unstale":"2024-09-10T08:28:35.577350+0000","last_undegraded":"2024-09-10T08:28:35.577350+0000","last_fullsized":"2024-09-10T08:28:35.577350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:12.751231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.584686+0000","last_change":"2024-09-10T08:28:34.551102+0000","last_active":"2024-09-10T08:28:35.584686+0000","last_peered":"2024-09-10T08:28:35.584686+0000","last_clean":"2024-09-10T08:28:35.584686+0000","last_became_active":"2024-09-10T08:28:34.550773+0000","last_became_peered":"2024-09-10T08:28:34.550773+0000","last_unstale":"2024-09-10T08:28:35.584686+0000","last_undegraded":"2024-09-10T08:28:35.584686+0000","last_fullsized":"2024-09-10T08:28:35.584686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:35.393695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.585491+0000","last_change":"2024-09-10T08:28:35.577476+0000","last_active":"2024-09-10T08:28:35.585491+0000","last_peered":"2024-09-10T08:28:35.585491+0000","last_clean":"2024-09-10T08:28:35.585491+0000","last_became_active":"2024-09-10T08:28:35.576786+0000","last_became_peered":"2024-09-10T08:28:35.576786+0000","last_unstale":"2024-09-10T08:28:35.585491+0000","last_undegraded":"2024-09-10T08:28:35.585491+0000","last_fullsized":"2024-09-10T08:28:35.585491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:17.606334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619362+0000","last_change":"2024-09-10T08:28:34.560313+0000","last_active":"2024-09-10T08:28:36.619362+0000","last_peered":"2024-09-10T08:28:36.619362+0000","last_clean":"2024-09-10T08:28:36.619362+0000","last_became_active":"2024-09-10T08:28:34.560035+0000","last_became_peered":"2024-09-10T08:28:34.560035+0000","last_unstale":"2024-09-10T08:28:36.619362+0000","last_undegraded":"2024-09-10T08:28:36.619362+0000","last_fullsized":"2024-09-10T08:28:36.619362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:56.945537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.585563+0000","last_change":"2024-09-10T08:28:35.577577+0000","last_active":"2024-09-10T08:28:35.585563+0000","last_peered":"2024-09-10T08:28:35.585563+0000","last_clean":"2024-09-10T08:28:35.585563+0000","last_became_active":"2024-09-10T08:28:35.576686+0000","last_became_peered":"2024-09-10T08:28:35.576686+0000","last_unstale":"2024-09-10T08:28:35.585563+0000","last_undegraded":"2024-09-10T08:28:35.585563+0000","last_fullsized":"2024-09-10T08:28:35.585563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:51.251652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582053+0000","last_change":"2024-09-10T08:28:34.560694+0000","last_active":"2024-09-10T08:28:35.582053+0000","last_peered":"2024-09-10T08:28:35.582053+0000","last_clean":"2024-09-10T08:28:35.582053+0000","last_became_active":"2024-09-10T08:28:34.560429+0000","last_became_peered":"2024-09-10T08:28:34.560429+0000","last_unstale":"2024-09-10T08:28:35.582053+0000","last_undegraded":"2024-09-10T08:28:35.582053+0000","last_fullsized":"2024-09-10T08:28:35.582053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:54.514467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581989+0000","last_change":"2024-09-10T08:28:35.577124+0000","last_active":"2024-09-10T08:28:35.581989+0000","last_peered":"2024-09-10T08:28:35.581989+0000","last_clean":"2024-09-10T08:28:35.581989+0000","last_became_active":"2024-09-10T08:28:35.576655+0000","last_became_peered":"2024-09-10T08:28:35.576655+0000","last_unstale":"2024-09-10T08:28:35.581989+0000","last_undegraded":"2024-09-10T08:28:35.581989+0000","last_fullsized":"2024-09-10T08:28:35.581989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:57.339318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619122+0000","last_change":"2024-09-10T08:28:34.559911+0000","last_active":"2024-09-10T08:28:36.619122+0000","last_peered":"2024-09-10T08:28:36.619122+0000","last_clean":"2024-09-10T08:28:36.619122+0000","last_became_active":"2024-09-10T08:28:34.559635+0000","last_became_peered":"2024-09-10T08:28:34.559635+0000","last_unstale":"2024-09-10T08:28:36.619122+0000","last_undegraded":"2024-09-10T08:28:36.619122+0000","last_fullsized":"2024-09-10T08:28:36.619122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:40.892609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.577384+0000","last_change":"2024-09-10T08:28:35.574532+0000","last_active":"2024-09-10T08:28:35.577384+0000","last_peered":"2024-09-10T08:28:35.577384+0000","last_clean":"2024-09-10T08:28:35.577384+0000","last_became_active":"2024-09-10T08:28:35.574215+0000","last_became_peered":"2024-09-10T08:28:35.574215+0000","last_unstale":"2024-09-10T08:28:35.577384+0000","last_undegraded":"2024-09-10T08:28:35.577384+0000","last_fullsized":"2024-09-10T08:28:35.577384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:54.299622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.565625+0000","last_change":"2024-09-10T08:28:26.724394+0000","last_active":"2024-09-10T08:28:35.565625+0000","last_peered":"2024-09-10T08:28:35.565625+0000","last_clean":"2024-09-10T08:28:35.565625+0000","last_became_active":"2024-09-10T08:28:26.723452+0000","last_became_peered":"2024-09-10T08:28:26.723452+0000","last_unstale":"2024-09-10T08:28:35.565625+0000","last_undegraded":"2024-09-10T08:28:35.565625+0000","last_fullsized":"2024-09-10T08:28:35.565625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_clean_scrub_stamp":"2024-09-10T08:28:25.445753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:00.811505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556142+0000","last_change":"2024-09-10T08:28:34.555587+0000","last_active":"2024-09-10T08:28:35.556142+0000","last_peered":"2024-09-10T08:28:35.556142+0000","last_clean":"2024-09-10T08:28:35.556142+0000","last_became_active":"2024-09-10T08:28:34.555269+0000","last_became_peered":"2024-09-10T08:28:34.555269+0000","last_unstale":"2024-09-10T08:28:35.556142+0000","last_undegraded":"2024-09-10T08:28:35.556142+0000","last_fullsized":"2024-09-10T08:28:35.556142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:19.499870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582012+0000","last_change":"2024-09-10T08:28:35.572658+0000","last_active":"2024-09-10T08:28:35.582012+0000","last_peered":"2024-09-10T08:28:35.582012+0000","last_clean":"2024-09-10T08:28:35.582012+0000","last_became_active":"2024-09-10T08:28:35.571611+0000","last_became_peered":"2024-09-10T08:28:35.571611+0000","last_unstale":"2024-09-10T08:28:35.582012+0000","last_undegraded":"2024-09-10T08:28:35.582012+0000","last_fullsized":"2024-09-10T08:28:35.582012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:44.555736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.565556+0000","last_change":"2024-09-10T08:28:34.568477+0000","last_active":"2024-09-10T08:28:35.565556+0000","last_peered":"2024-09-10T08:28:35.565556+0000","last_clean":"2024-09-10T08:28:35.565556+0000","last_became_active":"2024-09-10T08:28:34.568249+0000","last_became_peered":"2024-09-10T08:28:34.568249+0000","last_unstale":"2024-09-10T08:28:35.565556+0000","last_undegraded":"2024-09-10T08:28:35.565556+0000","last_fullsized":"2024-09-10T08:28:35.565556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:08.640043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579232+0000","last_change":"2024-09-10T08:28:35.576360+0000","last_active":"2024-09-10T08:28:35.579232+0000","last_peered":"2024-09-10T08:28:35.579232+0000","last_clean":"2024-09-10T08:28:35.579232+0000","last_became_active":"2024-09-10T08:28:35.576096+0000","last_became_peered":"2024-09-10T08:28:35.576096+0000","last_unstale":"2024-09-10T08:28:35.579232+0000","last_undegraded":"2024-09-10T08:28:35.579232+0000","last_fullsized":"2024-09-10T08:28:35.579232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:51.274979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620584+0000","last_change":"2024-09-10T08:28:34.560745+0000","last_active":"2024-09-10T08:28:36.620584+0000","last_peered":"2024-09-10T08:28:36.620584+0000","last_clean":"2024-09-10T08:28:36.620584+0000","last_became_active":"2024-09-10T08:28:34.559911+0000","last_became_peered":"2024-09-10T08:28:34.559911+0000","last_unstale":"2024-09-10T08:28:36.620584+0000","last_undegraded":"2024-09-10T08:28:36.620584+0000","last_fullsized":"2024-09-10T08:28:36.620584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:00.234067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.572722+0000","last_change":"2024-09-10T08:28:35.566745+0000","last_active":"2024-09-10T08:28:35.572722+0000","last_peered":"2024-09-10T08:28:35.572722+0000","last_clean":"2024-09-10T08:28:35.572722+0000","last_became_active":"2024-09-10T08:28:35.566444+0000","last_became_peered":"2024-09-10T08:28:35.566444+0000","last_unstale":"2024-09-10T08:28:35.572722+0000","last_undegraded":"2024-09-10T08:28:35.572722+0000","last_fullsized":"2024-09-10T08:28:35.572722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:37.924675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.557028+0000","last_change":"2024-09-10T08:28:34.553983+0000","last_active":"2024-09-10T08:28:35.557028+0000","last_peered":"2024-09-10T08:28:35.557028+0000","last_clean":"2024-09-10T08:28:35.557028+0000","last_became_active":"2024-09-10T08:28:34.553693+0000","last_became_peered":"2024-09-10T08:28:34.553693+0000","last_unstale":"2024-09-10T08:28:35.557028+0000","last_undegraded":"2024-09-10T08:28:35.557028+0000","last_fullsized":"2024-09-10T08:28:35.557028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:40.001685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.580684+0000","last_change":"2024-09-10T08:28:35.577978+0000","last_active":"2024-09-10T08:28:35.580684+0000","last_peered":"2024-09-10T08:28:35.580684+0000","last_clean":"2024-09-10T08:28:35.580684+0000","last_became_active":"2024-09-10T08:28:35.577718+0000","last_became_peered":"2024-09-10T08:28:35.577718+0000","last_unstale":"2024-09-10T08:28:35.580684+0000","last_undegraded":"2024-09-10T08:28:35.580684+0000","last_fullsized":"2024-09-10T08:28:35.580684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:46.194153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.557039+0000","last_change":"2024-09-10T08:28:34.555212+0000","last_active":"2024-09-10T08:28:35.557039+0000","last_peered":"2024-09-10T08:28:35.557039+0000","last_clean":"2024-09-10T08:28:35.557039+0000","last_became_active":"2024-09-10T08:28:34.554922+0000","last_became_peered":"2024-09-10T08:28:34.554922+0000","last_unstale":"2024-09-10T08:28:35.557039+0000","last_undegraded":"2024-09-10T08:28:35.557039+0000","last_fullsized":"2024-09-10T08:28:35.557039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581944+0000","last_change":"2024-09-10T08:28:35.576280+0000","last_active":"2024-09-10T08:28:35.581944+0000","last_peered":"2024-09-10T08:28:35.581944+0000","last_clean":"2024-09-10T08:28:35.581944+0000","last_became_active":"2024-09-10T08:28:35.576002+0000","last_became_peered":"2024-09-10T08:28:35.576002+0000","last_unstale":"2024-09-10T08:28:35.581944+0000","last_undegraded":"2024-09-10T08:28:35.581944+0000","last_fullsized":"2024-09-10T08:28:35.581944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:47.191902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.565441+0000","last_change":"2024-09-10T08:28:34.571283+0000","last_active":"2024-09-10T08:28:35.565441+0000","last_peered":"2024-09-10T08:28:35.565441+0000","last_clean":"2024-09-10T08:28:35.565441+0000","last_became_active":"2024-09-10T08:28:34.570791+0000","last_became_peered":"2024-09-10T08:28:34.570791+0000","last_unstale":"2024-09-10T08:28:35.565441+0000","last_undegraded":"2024-09-10T08:28:35.565441+0000","last_fullsized":"2024-09-10T08:28:35.565441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:17.427597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.572702+0000","last_change":"2024-09-10T08:28:35.567481+0000","last_active":"2024-09-10T08:28:35.572702+0000","last_peered":"2024-09-10T08:28:35.572702+0000","last_clean":"2024-09-10T08:28:35.572702+0000","last_became_active":"2024-09-10T08:28:35.567167+0000","last_became_peered":"2024-09-10T08:28:35.567167+0000","last_unstale":"2024-09-10T08:28:35.572702+0000","last_undegraded":"2024-09-10T08:28:35.572702+0000","last_fullsized":"2024-09-10T08:28:35.572702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:45.440275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556778+0000","last_change":"2024-09-10T08:28:34.563451+0000","last_active":"2024-09-10T08:28:35.556778+0000","last_peered":"2024-09-10T08:28:35.556778+0000","last_clean":"2024-09-10T08:28:35.556778+0000","last_became_active":"2024-09-10T08:28:34.563259+0000","last_became_peered":"2024-09-10T08:28:34.563259+0000","last_unstale":"2024-09-10T08:28:35.556778+0000","last_undegraded":"2024-09-10T08:28:35.556778+0000","last_fullsized":"2024-09-10T08:28:35.556778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:44.899351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581971+0000","last_change":"2024-09-10T08:28:35.574107+0000","last_active":"2024-09-10T08:28:35.581971+0000","last_peered":"2024-09-10T08:28:35.581971+0000","last_clean":"2024-09-10T08:28:35.581971+0000","last_became_active":"2024-09-10T08:28:35.573851+0000","last_became_peered":"2024-09-10T08:28:35.573851+0000","last_unstale":"2024-09-10T08:28:35.581971+0000","last_undegraded":"2024-09-10T08:28:35.581971+0000","last_fullsized":"2024-09-10T08:28:35.581971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:24.848264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T08:28:33.545282+0000","last_change":"2024-09-10T08:28:33.545282+0000","last_active":"2024-09-10T08:28:33.538281+0000","last_peered":"2024-09-10T08:28:33.538281+0000","last_clean":"2024-09-10T08:28:33.538281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:33.545282+0000","last_undegraded":"2024-09-10T08:28:33.545282+0000","last_fullsized":"2024-09-10T08:28:33.545282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579227+0000","last_change":"2024-09-10T08:28:35.575106+0000","last_active":"2024-09-10T08:28:35.579227+0000","last_peered":"2024-09-10T08:28:35.579227+0000","last_clean":"2024-09-10T08:28:35.579227+0000","last_became_active":"2024-09-10T08:28:35.574815+0000","last_became_peered":"2024-09-10T08:28:35.574815+0000","last_unstale":"2024-09-10T08:28:35.579227+0000","last_undegraded":"2024-09-10T08:28:35.579227+0000","last_fullsized":"2024-09-10T08:28:35.579227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:39.473943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.565374+0000","last_change":"2024-09-10T08:28:34.571069+0000","last_active":"2024-09-10T08:28:35.565374+0000","last_peered":"2024-09-10T08:28:35.565374+0000","last_clean":"2024-09-10T08:28:35.565374+0000","last_became_active":"2024-09-10T08:28:34.570766+0000","last_became_peered":"2024-09-10T08:28:34.570766+0000","last_unstale":"2024-09-10T08:28:35.565374+0000","last_undegraded":"2024-09-10T08:28:35.565374+0000","last_fullsized":"2024-09-10T08:28:35.565374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:47.458195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.574702+0000","last_change":"2024-09-10T08:28:35.569938+0000","last_active":"2024-09-10T08:28:35.574702+0000","last_peered":"2024-09-10T08:28:35.574702+0000","last_clean":"2024-09-10T08:28:35.574702+0000","last_became_active":"2024-09-10T08:28:35.569109+0000","last_became_peered":"2024-09-10T08:28:35.569109+0000","last_unstale":"2024-09-10T08:28:35.574702+0000","last_undegraded":"2024-09-10T08:28:35.574702+0000","last_fullsized":"2024-09-10T08:28:35.574702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:40.936585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.557127+0000","last_change":"2024-09-10T08:28:34.564813+0000","last_active":"2024-09-10T08:28:35.557127+0000","last_peered":"2024-09-10T08:28:35.557127+0000","last_clean":"2024-09-10T08:28:35.557127+0000","last_became_active":"2024-09-10T08:28:34.564557+0000","last_became_peered":"2024-09-10T08:28:34.564557+0000","last_unstale":"2024-09-10T08:28:35.557127+0000","last_undegraded":"2024-09-10T08:28:35.557127+0000","last_fullsized":"2024-09-10T08:28:35.557127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:48.356069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581850+0000","last_change":"2024-09-10T08:28:35.572363+0000","last_active":"2024-09-10T08:28:35.581850+0000","last_peered":"2024-09-10T08:28:35.581850+0000","last_clean":"2024-09-10T08:28:35.581850+0000","last_became_active":"2024-09-10T08:28:35.572108+0000","last_became_peered":"2024-09-10T08:28:35.572108+0000","last_unstale":"2024-09-10T08:28:35.581850+0000","last_undegraded":"2024-09-10T08:28:35.581850+0000","last_fullsized":"2024-09-10T08:28:35.581850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:47.800442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556782+0000","last_change":"2024-09-10T08:28:34.561324+0000","last_active":"2024-09-10T08:28:35.556782+0000","last_peered":"2024-09-10T08:28:35.556782+0000","last_clean":"2024-09-10T08:28:35.556782+0000","last_became_active":"2024-09-10T08:28:34.560974+0000","last_became_peered":"2024-09-10T08:28:34.560974+0000","last_unstale":"2024-09-10T08:28:35.556782+0000","last_undegraded":"2024-09-10T08:28:35.556782+0000","last_fullsized":"2024-09-10T08:28:35.556782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:18.790965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.584262+0000","last_change":"2024-09-10T08:28:35.577024+0000","last_active":"2024-09-10T08:28:35.584262+0000","last_peered":"2024-09-10T08:28:35.584262+0000","last_clean":"2024-09-10T08:28:35.584262+0000","last_became_active":"2024-09-10T08:28:35.576771+0000","last_became_peered":"2024-09-10T08:28:35.576771+0000","last_unstale":"2024-09-10T08:28:35.584262+0000","last_undegraded":"2024-09-10T08:28:35.584262+0000","last_fullsized":"2024-09-10T08:28:35.584262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:42.944227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.586398+0000","last_change":"2024-09-10T08:28:34.569235+0000","last_active":"2024-09-10T08:28:35.586398+0000","last_peered":"2024-09-10T08:28:35.586398+0000","last_clean":"2024-09-10T08:28:35.586398+0000","last_became_active":"2024-09-10T08:28:34.568899+0000","last_became_peered":"2024-09-10T08:28:34.568899+0000","last_unstale":"2024-09-10T08:28:35.586398+0000","last_undegraded":"2024-09-10T08:28:35.586398+0000","last_fullsized":"2024-09-10T08:28:35.586398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:21.927656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:34.539900+0000","last_change":"2024-09-10T08:28:34.539900+0000","last_active":"2024-09-10T08:28:34.539900+0000","last_peered":"2024-09-10T08:28:34.539900+0000","last_clean":"2024-09-10T08:28:34.539900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:34.539900+0000","last_undegraded":"2024-09-10T08:28:34.539900+0000","last_fullsized":"2024-09-10T08:28:34.539900+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.561221+0000","last_change":"2024-09-10T08:28:35.560380+0000","last_active":"2024-09-10T08:28:35.561221+0000","last_peered":"2024-09-10T08:28:35.561221+0000","last_clean":"2024-09-10T08:28:35.561221+0000","last_became_active":"2024-09-10T08:28:35.560095+0000","last_became_peered":"2024-09-10T08:28:35.560095+0000","last_unstale":"2024-09-10T08:28:35.561221+0000","last_undegraded":"2024-09-10T08:28:35.561221+0000","last_fullsized":"2024-09-10T08:28:35.561221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:10.493163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.586370+0000","last_change":"2024-09-10T08:28:34.566560+0000","last_active":"2024-09-10T08:28:35.586370+0000","last_peered":"2024-09-10T08:28:35.586370+0000","last_clean":"2024-09-10T08:28:35.586370+0000","last_became_active":"2024-09-10T08:28:34.566275+0000","last_became_peered":"2024-09-10T08:28:34.566275+0000","last_unstale":"2024-09-10T08:28:35.586370+0000","last_undegraded":"2024-09-10T08:28:35.586370+0000","last_fullsized":"2024-09-10T08:28:35.586370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:03.507683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.564414+0000","last_change":"2024-09-10T08:28:35.562132+0000","last_active":"2024-09-10T08:28:35.564414+0000","last_peered":"2024-09-10T08:28:35.564414+0000","last_clean":"2024-09-10T08:28:35.564414+0000","last_became_active":"2024-09-10T08:28:35.561842+0000","last_became_peered":"2024-09-10T08:28:35.561842+0000","last_unstale":"2024-09-10T08:28:35.564414+0000","last_undegraded":"2024-09-10T08:28:35.564414+0000","last_fullsized":"2024-09-10T08:28:35.564414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:55.020192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.586634+0000","last_change":"2024-09-10T08:28:34.571965+0000","last_active":"2024-09-10T08:28:35.586634+0000","last_peered":"2024-09-10T08:28:35.586634+0000","last_clean":"2024-09-10T08:28:35.586634+0000","last_became_active":"2024-09-10T08:28:34.571640+0000","last_became_peered":"2024-09-10T08:28:34.571640+0000","last_unstale":"2024-09-10T08:28:35.586634+0000","last_undegraded":"2024-09-10T08:28:35.586634+0000","last_fullsized":"2024-09-10T08:28:35.586634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:53.047030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.584568+0000","last_change":"2024-09-10T08:28:35.579033+0000","last_active":"2024-09-10T08:28:35.584568+0000","last_peered":"2024-09-10T08:28:35.584568+0000","last_clean":"2024-09-10T08:28:35.584568+0000","last_became_active":"2024-09-10T08:28:35.578333+0000","last_became_peered":"2024-09-10T08:28:35.578333+0000","last_unstale":"2024-09-10T08:28:35.584568+0000","last_undegraded":"2024-09-10T08:28:35.584568+0000","last_fullsized":"2024-09-10T08:28:35.584568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:33.115063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582973+0000","last_change":"2024-09-10T08:28:34.561691+0000","last_active":"2024-09-10T08:28:35.582973+0000","last_peered":"2024-09-10T08:28:35.582973+0000","last_clean":"2024-09-10T08:28:35.582973+0000","last_became_active":"2024-09-10T08:28:34.561410+0000","last_became_peered":"2024-09-10T08:28:34.561410+0000","last_unstale":"2024-09-10T08:28:35.582973+0000","last_undegraded":"2024-09-10T08:28:35.582973+0000","last_fullsized":"2024-09-10T08:28:35.582973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.629982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582221+0000","last_change":"2024-09-10T08:28:35.575267+0000","last_active":"2024-09-10T08:28:35.582221+0000","last_peered":"2024-09-10T08:28:35.582221+0000","last_clean":"2024-09-10T08:28:35.582221+0000","last_became_active":"2024-09-10T08:28:35.575019+0000","last_became_peered":"2024-09-10T08:28:35.575019+0000","last_unstale":"2024-09-10T08:28:35.582221+0000","last_undegraded":"2024-09-10T08:28:35.582221+0000","last_fullsized":"2024-09-10T08:28:35.582221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:56.550243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581879+0000","last_change":"2024-09-10T08:28:34.564816+0000","last_active":"2024-09-10T08:28:35.581879+0000","last_peered":"2024-09-10T08:28:35.581879+0000","last_clean":"2024-09-10T08:28:35.581879+0000","last_became_active":"2024-09-10T08:28:34.564545+0000","last_became_peered":"2024-09-10T08:28:34.564545+0000","last_unstale":"2024-09-10T08:28:35.581879+0000","last_undegraded":"2024-09-10T08:28:35.581879+0000","last_fullsized":"2024-09-10T08:28:35.581879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:34.365104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":650015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":59647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":59647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":68004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":59647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":650015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":72667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:28:39.841 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:28:39.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.974+0000 7f70ef52a640 1 Processor -- start 2024-09-10T08:28:39.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.975+0000 7f70ef52a640 1 -- start start 2024-09-10T08:28:39.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.975+0000 7f70ef52a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e8158300 0x7f70e815f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.975+0000 7f70ef52a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70e8154e00 con 0x7f70e80744a0 2024-09-10T08:28:39.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.975+0000 7f70ef52a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70e80c50e0 con 0x7f70e80c7a70 2024-09-10T08:28:39.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.975+0000 7f70ef52a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f70e80c4ba0 con 0x7f70e8158300 2024-09-10T08:28:39.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.975+0000 7f70ecac5640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f70e80744a0 0x7f70e8157bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51210/0 (socket says 172.21.15.103:51210) 2024-09-10T08:28:39.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.975+0000 7f70ecac5640 1 -- 172.21.15.103:0/3305978568 learned_addr learned my addr 172.21.15.103:0/3305978568 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:39.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.976+0000 7f70edac7640 1 --2- 172.21.15.103:0/3305978568 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e8158300 0x7f70e815f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.976+0000 7f70dffff640 1 -- 172.21.15.103:0/3305978568 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1102164588 0 0) 0x7f70e8154e00 con 0x7f70e80744a0 2024-09-10T08:28:39.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.976+0000 7f70dffff640 1 -- 172.21.15.103:0/3305978568 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70d4003520 con 0x7f70e80744a0 2024-09-10T08:28:39.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.976+0000 7f70edac7640 1 -- 172.21.15.103:0/3305978568 >> v1:172.21.15.154:6789/0 conn(0x7f70e80c7a70 legacy=0x7f70e80c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.976+0000 7f70edac7640 1 -- 172.21.15.103:0/3305978568 >> v1:172.21.15.103:6789/0 conn(0x7f70e80744a0 legacy=0x7f70e8157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.976+0000 7f70edac7640 1 -- 172.21.15.103:0/3305978568 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e81576d0 con 0x7f70e8158300 2024-09-10T08:28:39.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.977+0000 7f70edac7640 1 --2- 172.21.15.103:0/3305978568 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e8158300 0x7f70e815f9d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009dc0 tx=0x7f70e002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7777bfb2cfb7c588 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:39.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.977+0000 7f70dffff640 1 -- 172.21.15.103:0/3305978568 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0007740 con 0x7f70e8158300 2024-09-10T08:28:39.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.977+0000 7f70dffff640 1 -- 172.21.15.103:0/3305978568 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e00078e0 con 0x7f70e8158300 2024-09-10T08:28:39.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.977+0000 7f70dffff640 1 -- 172.21.15.103:0/3305978568 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0007cb0 con 0x7f70e8158300 2024-09-10T08:28:39.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.977+0000 7f70ef52a640 1 -- 172.21.15.103:0/3305978568 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e8158300 msgr2=0x7f70e815f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.977+0000 7f70ef52a640 1 --2- 172.21.15.103:0/3305978568 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e8158300 0x7f70e815f9d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009dc0 tx=0x7f70e002a6d0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.977+0000 7f70ef52a640 1 -- 172.21.15.103:0/3305978568 shutdown_connections 2024-09-10T08:28:39.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.977+0000 7f70ef52a640 1 --2- 172.21.15.103:0/3305978568 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e8158300 0x7f70e815f9d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.977+0000 7f70ef52a640 1 -- 172.21.15.103:0/3305978568 >> 172.21.15.103:0/3305978568 conn(0x7f70e80c5660 msgr2=0x7f70e80c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:39.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.977+0000 7f70ef52a640 1 -- 172.21.15.103:0/3305978568 shutdown_connections 2024-09-10T08:28:39.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.977+0000 7f70ef52a640 1 -- 172.21.15.103:0/3305978568 wait complete. 2024-09-10T08:28:39.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.979+0000 7f70ef52a640 1 Processor -- start 2024-09-10T08:28:39.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.979+0000 7f70ef52a640 1 -- start start 2024-09-10T08:28:39.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.979+0000 7f70ef52a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70e80744a0 0x7f70e81de250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.979+0000 7f70ef52a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70e80c7a70 0x7f70e81de790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.979+0000 7f70ef52a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e8158300 0x7f70e80a88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.979+0000 7f70ef52a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f70e8071bb0 con 0x7f70e80744a0 2024-09-10T08:28:39.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.979+0000 7f70ef52a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70e80c53c0 con 0x7f70e80c7a70 2024-09-10T08:28:39.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.979+0000 7f70ef52a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f70e8071d30 con 0x7f70e8158300 2024-09-10T08:28:39.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.979+0000 7f70ed2c6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70e80744a0 0x7f70e81de250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.979+0000 7f70ed2c6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70e80744a0 0x7f70e81de250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57560/0 (socket says 172.21.15.103:57560) 2024-09-10T08:28:39.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.979+0000 7f70ed2c6640 1 -- 172.21.15.103:0/3767281839 learned_addr learned my addr 172.21.15.103:0/3767281839 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:39.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.979+0000 7f70ecac5640 1 --2- 172.21.15.103:0/3767281839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70e80c7a70 0x7f70e81de790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.979+0000 7f70edac7640 1 --2- 172.21.15.103:0/3767281839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e8158300 0x7f70e80a88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.980+0000 7f70ed2c6640 1 -- 172.21.15.103:0/3767281839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e8158300 msgr2=0x7f70e80a88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.980+0000 7f70ed2c6640 1 --2- 172.21.15.103:0/3767281839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e8158300 0x7f70e80a88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.980+0000 7f70ed2c6640 1 -- 172.21.15.103:0/3767281839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70e80c7a70 msgr2=0x7f70e81de790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.980+0000 7f70ed2c6640 1 --2- 172.21.15.103:0/3767281839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70e80c7a70 0x7f70e81de790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.980+0000 7f70ed2c6640 1 -- 172.21.15.103:0/3767281839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e8152910 con 0x7f70e80744a0 2024-09-10T08:28:39.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.980+0000 7f70ed2c6640 1 --2- 172.21.15.103:0/3767281839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70e80744a0 0x7f70e81de250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f70e400c450 tx=0x7f70e400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:39.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.980+0000 7f70ddffb640 1 -- 172.21.15.103:0/3767281839 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e40052d0 con 0x7f70e80744a0 2024-09-10T08:28:39.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.980+0000 7f70ddffb640 1 -- 172.21.15.103:0/3767281839 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e4005470 con 0x7f70e80744a0 2024-09-10T08:28:39.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.980+0000 7f70ef52a640 1 -- 172.21.15.103:0/3767281839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e81ddc10 con 0x7f70e80744a0 2024-09-10T08:28:39.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.980+0000 7f70ddffb640 1 -- 172.21.15.103:0/3767281839 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e4012870 con 0x7f70e80744a0 2024-09-10T08:28:39.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.980+0000 7f70ef52a640 1 -- 172.21.15.103:0/3767281839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e8152e70 con 0x7f70e80744a0 2024-09-10T08:28:39.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.981+0000 7f70ef52a640 1 -- 172.21.15.103:0/3767281839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e8153070 con 0x7f70e80744a0 2024-09-10T08:28:39.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.981+0000 7f70ddffb640 1 -- 172.21.15.103:0/3767281839 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f70e4012a10 con 0x7f70e80744a0 2024-09-10T08:28:39.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.982+0000 7f70ddffb640 1 --2- 172.21.15.103:0/3767281839 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f70cc06be60 0x7f70cc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.982+0000 7f70ddffb640 1 -- 172.21.15.103:0/3767281839 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f70e408a870 con 0x7f70e80744a0 2024-09-10T08:28:39.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.982+0000 7f70ecac5640 1 --2- 172.21.15.103:0/3767281839 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f70cc06be60 0x7f70cc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.982+0000 7f70ecac5640 1 --2- 172.21.15.103:0/3767281839 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f70cc06be60 0x7f70cc06e320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f70e80aa3a0 tx=0x7f70d8007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:39.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:39.986+0000 7f70ddffb640 1 -- 172.21.15.103:0/3767281839 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f70e8152910 con 0x7f70e80744a0 2024-09-10T08:28:40.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.149+0000 7f70ef52a640 1 -- 172.21.15.103:0/3767281839 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f70e80731b0 con 0x7f70cc06be60 2024-09-10T08:28:40.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.155+0000 7f70ddffb640 1 -- 172.21.15.103:0/3767281839 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250435 (secure 0 0 0) 0x7f70e80731b0 con 0x7f70cc06be60 2024-09-10T08:28:40.158 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:40.160 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T08:28:40.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.158+0000 7f70ef52a640 1 -- 172.21.15.103:0/3767281839 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f70cc06be60 msgr2=0x7f70cc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:40.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.158+0000 7f70ef52a640 1 --2- 172.21.15.103:0/3767281839 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f70cc06be60 0x7f70cc06e320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f70e80aa3a0 tx=0x7f70d8007d30 comp rx=0 tx=0).stop 2024-09-10T08:28:40.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.158+0000 7f70ef52a640 1 -- 172.21.15.103:0/3767281839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70e80744a0 msgr2=0x7f70e81de250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:40.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.158+0000 7f70ef52a640 1 --2- 172.21.15.103:0/3767281839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70e80744a0 0x7f70e81de250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f70e400c450 tx=0x7f70e400c910 comp rx=0 tx=0).stop 2024-09-10T08:28:40.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.158+0000 7f70ef52a640 1 -- 172.21.15.103:0/3767281839 shutdown_connections 2024-09-10T08:28:40.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.158+0000 7f70ef52a640 1 --2- 172.21.15.103:0/3767281839 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f70cc06be60 0x7f70cc06e320 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.158+0000 7f70ef52a640 1 --2- 172.21.15.103:0/3767281839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e8158300 0x7f70e80a88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.158+0000 7f70ef52a640 1 --2- 172.21.15.103:0/3767281839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70e80c7a70 0x7f70e81de790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.158+0000 7f70ef52a640 1 --2- 172.21.15.103:0/3767281839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70e80744a0 0x7f70e81de250 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.158+0000 7f70ef52a640 1 -- 172.21.15.103:0/3767281839 >> 172.21.15.103:0/3767281839 conn(0x7f70e80c5660 msgr2=0x7f70e81504b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:40.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.158+0000 7f70ef52a640 1 -- 172.21.15.103:0/3767281839 shutdown_connections 2024-09-10T08:28:40.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.158+0000 7f70ef52a640 1 -- 172.21.15.103:0/3767281839 wait complete. 2024-09-10T08:28:40.169 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-10T08:28:38.794305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":194,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218884,"kb_used_data":2636,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755836,"statfs":{"total":773094113280,"available":772869976064,"internally_reserved":0,"allocated":2699264,"data_stored":1673029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.254075"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.572264+0000","last_change":"2024-09-10T08:28:35.571065+0000","last_active":"2024-09-10T08:28:35.572264+0000","last_peered":"2024-09-10T08:28:35.572264+0000","last_clean":"2024-09-10T08:28:35.572264+0000","last_became_active":"2024-09-10T08:28:35.570749+0000","last_became_peered":"2024-09-10T08:28:35.570749+0000","last_unstale":"2024-09-10T08:28:35.572264+0000","last_undegraded":"2024-09-10T08:28:35.572264+0000","last_fullsized":"2024-09-10T08:28:35.572264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:45:43.769092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582300+0000","last_change":"2024-09-10T08:28:35.578197+0000","last_active":"2024-09-10T08:28:35.582300+0000","last_peered":"2024-09-10T08:28:35.582300+0000","last_clean":"2024-09-10T08:28:35.582300+0000","last_became_active":"2024-09-10T08:28:35.577852+0000","last_became_peered":"2024-09-10T08:28:35.577852+0000","last_unstale":"2024-09-10T08:28:35.582300+0000","last_undegraded":"2024-09-10T08:28:35.582300+0000","last_fullsized":"2024-09-10T08:28:35.582300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:42.678700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579443+0000","last_change":"2024-09-10T08:28:35.573918+0000","last_active":"2024-09-10T08:28:35.579443+0000","last_peered":"2024-09-10T08:28:35.579443+0000","last_clean":"2024-09-10T08:28:35.579443+0000","last_became_active":"2024-09-10T08:28:35.573646+0000","last_became_peered":"2024-09-10T08:28:35.573646+0000","last_unstale":"2024-09-10T08:28:35.579443+0000","last_undegraded":"2024-09-10T08:28:35.579443+0000","last_fullsized":"2024-09-10T08:28:35.579443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:33.686562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582117+0000","last_change":"2024-09-10T08:28:35.578961+0000","last_active":"2024-09-10T08:28:35.582117+0000","last_peered":"2024-09-10T08:28:35.582117+0000","last_clean":"2024-09-10T08:28:35.582117+0000","last_became_active":"2024-09-10T08:28:35.578680+0000","last_became_peered":"2024-09-10T08:28:35.578680+0000","last_unstale":"2024-09-10T08:28:35.582117+0000","last_undegraded":"2024-09-10T08:28:35.582117+0000","last_fullsized":"2024-09-10T08:28:35.582117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:59.172004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.574504+0000","last_change":"2024-09-10T08:28:35.572112+0000","last_active":"2024-09-10T08:28:35.574504+0000","last_peered":"2024-09-10T08:28:35.574504+0000","last_clean":"2024-09-10T08:28:35.574504+0000","last_became_active":"2024-09-10T08:28:35.571803+0000","last_became_peered":"2024-09-10T08:28:35.571803+0000","last_unstale":"2024-09-10T08:28:35.574504+0000","last_undegraded":"2024-09-10T08:28:35.574504+0000","last_fullsized":"2024-09-10T08:28:35.574504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:10.044940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582149+0000","last_change":"2024-09-10T08:28:35.578978+0000","last_active":"2024-09-10T08:28:35.582149+0000","last_peered":"2024-09-10T08:28:35.582149+0000","last_clean":"2024-09-10T08:28:35.582149+0000","last_became_active":"2024-09-10T08:28:35.578475+0000","last_became_peered":"2024-09-10T08:28:35.578475+0000","last_unstale":"2024-09-10T08:28:35.582149+0000","last_undegraded":"2024-09-10T08:28:35.582149+0000","last_fullsized":"2024-09-10T08:28:35.582149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:42.164241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.585683+0000","last_change":"2024-09-10T08:28:35.578664+0000","last_active":"2024-09-10T08:28:35.585683+0000","last_peered":"2024-09-10T08:28:35.585683+0000","last_clean":"2024-09-10T08:28:35.585683+0000","last_became_active":"2024-09-10T08:28:35.578384+0000","last_became_peered":"2024-09-10T08:28:35.578384+0000","last_unstale":"2024-09-10T08:28:35.585683+0000","last_undegraded":"2024-09-10T08:28:35.585683+0000","last_fullsized":"2024-09-10T08:28:35.585683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:34.146373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582054+0000","last_change":"2024-09-10T08:28:35.575275+0000","last_active":"2024-09-10T08:28:35.582054+0000","last_peered":"2024-09-10T08:28:35.582054+0000","last_clean":"2024-09-10T08:28:35.582054+0000","last_became_active":"2024-09-10T08:28:35.575052+0000","last_became_peered":"2024-09-10T08:28:35.575052+0000","last_unstale":"2024-09-10T08:28:35.582054+0000","last_undegraded":"2024-09-10T08:28:35.582054+0000","last_fullsized":"2024-09-10T08:28:35.582054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:06.466029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.585429+0000","last_change":"2024-09-10T08:28:35.577345+0000","last_active":"2024-09-10T08:28:35.585429+0000","last_peered":"2024-09-10T08:28:35.585429+0000","last_clean":"2024-09-10T08:28:35.585429+0000","last_became_active":"2024-09-10T08:28:35.576191+0000","last_became_peered":"2024-09-10T08:28:35.576191+0000","last_unstale":"2024-09-10T08:28:35.585429+0000","last_undegraded":"2024-09-10T08:28:35.585429+0000","last_fullsized":"2024-09-10T08:28:35.585429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:24.323783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:34.539900+0000","last_change":"2024-09-10T08:28:34.539900+0000","last_active":"2024-09-10T08:28:34.539900+0000","last_peered":"2024-09-10T08:28:34.539900+0000","last_clean":"2024-09-10T08:28:34.539900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:34.539900+0000","last_undegraded":"2024-09-10T08:28:34.539900+0000","last_fullsized":"2024-09-10T08:28:34.539900+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:34.539900+0000","last_change":"2024-09-10T08:28:34.539900+0000","last_active":"2024-09-10T08:28:34.539900+0000","last_peered":"2024-09-10T08:28:34.539900+0000","last_clean":"2024-09-10T08:28:34.539900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:34.539900+0000","last_undegraded":"2024-09-10T08:28:34.539900+0000","last_fullsized":"2024-09-10T08:28:34.539900+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.573460+0000","last_change":"2024-09-10T08:28:35.566574+0000","last_active":"2024-09-10T08:28:35.573460+0000","last_peered":"2024-09-10T08:28:35.573460+0000","last_clean":"2024-09-10T08:28:35.573460+0000","last_became_active":"2024-09-10T08:28:35.566205+0000","last_became_peered":"2024-09-10T08:28:35.566205+0000","last_unstale":"2024-09-10T08:28:35.573460+0000","last_undegraded":"2024-09-10T08:28:35.573460+0000","last_fullsized":"2024-09-10T08:28:35.573460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:44.800134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582120+0000","last_change":"2024-09-10T08:28:35.573330+0000","last_active":"2024-09-10T08:28:35.582120+0000","last_peered":"2024-09-10T08:28:35.582120+0000","last_clean":"2024-09-10T08:28:35.582120+0000","last_became_active":"2024-09-10T08:28:35.572992+0000","last_became_peered":"2024-09-10T08:28:35.572992+0000","last_unstale":"2024-09-10T08:28:35.582120+0000","last_undegraded":"2024-09-10T08:28:35.582120+0000","last_fullsized":"2024-09-10T08:28:35.582120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:17.660618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579134+0000","last_change":"2024-09-10T08:28:35.574551+0000","last_active":"2024-09-10T08:28:35.579134+0000","last_peered":"2024-09-10T08:28:35.579134+0000","last_clean":"2024-09-10T08:28:35.579134+0000","last_became_active":"2024-09-10T08:28:35.574256+0000","last_became_peered":"2024-09-10T08:28:35.574256+0000","last_unstale":"2024-09-10T08:28:35.579134+0000","last_undegraded":"2024-09-10T08:28:35.579134+0000","last_fullsized":"2024-09-10T08:28:35.579134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:46.296836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.566154+0000","last_change":"2024-09-10T08:28:35.560693+0000","last_active":"2024-09-10T08:28:35.566154+0000","last_peered":"2024-09-10T08:28:35.566154+0000","last_clean":"2024-09-10T08:28:35.566154+0000","last_became_active":"2024-09-10T08:28:35.560409+0000","last_became_peered":"2024-09-10T08:28:35.560409+0000","last_unstale":"2024-09-10T08:28:35.566154+0000","last_undegraded":"2024-09-10T08:28:35.566154+0000","last_fullsized":"2024-09-10T08:28:35.566154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:17:35.028101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.573680+0000","last_change":"2024-09-10T08:28:35.570249+0000","last_active":"2024-09-10T08:28:35.573680+0000","last_peered":"2024-09-10T08:28:35.573680+0000","last_clean":"2024-09-10T08:28:35.573680+0000","last_became_active":"2024-09-10T08:28:35.569960+0000","last_became_peered":"2024-09-10T08:28:35.569960+0000","last_unstale":"2024-09-10T08:28:35.573680+0000","last_undegraded":"2024-09-10T08:28:35.573680+0000","last_fullsized":"2024-09-10T08:28:35.573680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:38.524087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.571052+0000","last_change":"2024-09-10T08:28:35.567296+0000","last_active":"2024-09-10T08:28:35.571052+0000","last_peered":"2024-09-10T08:28:35.571052+0000","last_clean":"2024-09-10T08:28:35.571052+0000","last_became_active":"2024-09-10T08:28:35.567074+0000","last_became_peered":"2024-09-10T08:28:35.567074+0000","last_unstale":"2024-09-10T08:28:35.571052+0000","last_undegraded":"2024-09-10T08:28:35.571052+0000","last_fullsized":"2024-09-10T08:28:35.571052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:05.005278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619264+0000","last_change":"2024-09-10T08:28:35.574438+0000","last_active":"2024-09-10T08:28:36.619264+0000","last_peered":"2024-09-10T08:28:36.619264+0000","last_clean":"2024-09-10T08:28:36.619264+0000","last_became_active":"2024-09-10T08:28:35.574175+0000","last_became_peered":"2024-09-10T08:28:35.574175+0000","last_unstale":"2024-09-10T08:28:36.619264+0000","last_undegraded":"2024-09-10T08:28:36.619264+0000","last_fullsized":"2024-09-10T08:28:36.619264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:55.808543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.574680+0000","last_change":"2024-09-10T08:28:35.572709+0000","last_active":"2024-09-10T08:28:35.574680+0000","last_peered":"2024-09-10T08:28:35.574680+0000","last_clean":"2024-09-10T08:28:35.574680+0000","last_became_active":"2024-09-10T08:28:35.572392+0000","last_became_peered":"2024-09-10T08:28:35.572392+0000","last_unstale":"2024-09-10T08:28:35.574680+0000","last_undegraded":"2024-09-10T08:28:35.574680+0000","last_fullsized":"2024-09-10T08:28:35.574680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:58.255939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:34.539900+0000","last_change":"2024-09-10T08:28:34.539900+0000","last_active":"2024-09-10T08:28:34.539900+0000","last_peered":"2024-09-10T08:28:34.539900+0000","last_clean":"2024-09-10T08:28:34.539900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:34.539900+0000","last_undegraded":"2024-09-10T08:28:34.539900+0000","last_fullsized":"2024-09-10T08:28:34.539900+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579258+0000","last_change":"2024-09-10T08:28:35.575802+0000","last_active":"2024-09-10T08:28:35.579258+0000","last_peered":"2024-09-10T08:28:35.579258+0000","last_clean":"2024-09-10T08:28:35.579258+0000","last_became_active":"2024-09-10T08:28:35.575388+0000","last_became_peered":"2024-09-10T08:28:35.575388+0000","last_unstale":"2024-09-10T08:28:35.579258+0000","last_undegraded":"2024-09-10T08:28:35.579258+0000","last_fullsized":"2024-09-10T08:28:35.579258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:59.338559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.571167+0000","last_change":"2024-09-10T08:28:35.568044+0000","last_active":"2024-09-10T08:28:35.571167+0000","last_peered":"2024-09-10T08:28:35.571167+0000","last_clean":"2024-09-10T08:28:35.571167+0000","last_became_active":"2024-09-10T08:28:35.567744+0000","last_became_peered":"2024-09-10T08:28:35.567744+0000","last_unstale":"2024-09-10T08:28:35.571167+0000","last_undegraded":"2024-09-10T08:28:35.571167+0000","last_fullsized":"2024-09-10T08:28:35.571167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:09:31.071067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581919+0000","last_change":"2024-09-10T08:28:35.571566+0000","last_active":"2024-09-10T08:28:35.581919+0000","last_peered":"2024-09-10T08:28:35.581919+0000","last_clean":"2024-09-10T08:28:35.581919+0000","last_became_active":"2024-09-10T08:28:35.571285+0000","last_became_peered":"2024-09-10T08:28:35.571285+0000","last_unstale":"2024-09-10T08:28:35.581919+0000","last_undegraded":"2024-09-10T08:28:35.581919+0000","last_fullsized":"2024-09-10T08:28:35.581919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:32.338136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582042+0000","last_change":"2024-09-10T08:28:35.578285+0000","last_active":"2024-09-10T08:28:35.582042+0000","last_peered":"2024-09-10T08:28:35.582042+0000","last_clean":"2024-09-10T08:28:35.582042+0000","last_became_active":"2024-09-10T08:28:35.576805+0000","last_became_peered":"2024-09-10T08:28:35.576805+0000","last_unstale":"2024-09-10T08:28:35.582042+0000","last_undegraded":"2024-09-10T08:28:35.582042+0000","last_fullsized":"2024-09-10T08:28:35.582042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:36.953572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582073+0000","last_change":"2024-09-10T08:28:35.575902+0000","last_active":"2024-09-10T08:28:35.582073+0000","last_peered":"2024-09-10T08:28:35.582073+0000","last_clean":"2024-09-10T08:28:35.582073+0000","last_became_active":"2024-09-10T08:28:35.575614+0000","last_became_peered":"2024-09-10T08:28:35.575614+0000","last_unstale":"2024-09-10T08:28:35.582073+0000","last_undegraded":"2024-09-10T08:28:35.582073+0000","last_fullsized":"2024-09-10T08:28:35.582073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:47.654980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:34.539900+0000","last_change":"2024-09-10T08:28:34.539900+0000","last_active":"2024-09-10T08:28:34.539900+0000","last_peered":"2024-09-10T08:28:34.539900+0000","last_clean":"2024-09-10T08:28:34.539900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:34.539900+0000","last_undegraded":"2024-09-10T08:28:34.539900+0000","last_fullsized":"2024-09-10T08:28:34.539900+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.575566+0000","last_change":"2024-09-10T08:28:35.572550+0000","last_active":"2024-09-10T08:28:35.575566+0000","last_peered":"2024-09-10T08:28:35.575566+0000","last_clean":"2024-09-10T08:28:35.575566+0000","last_became_active":"2024-09-10T08:28:35.572184+0000","last_became_peered":"2024-09-10T08:28:35.572184+0000","last_unstale":"2024-09-10T08:28:35.575566+0000","last_undegraded":"2024-09-10T08:28:35.575566+0000","last_fullsized":"2024-09-10T08:28:35.575566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:29.422204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582039+0000","last_change":"2024-09-10T08:28:35.574676+0000","last_active":"2024-09-10T08:28:35.582039+0000","last_peered":"2024-09-10T08:28:35.582039+0000","last_clean":"2024-09-10T08:28:35.582039+0000","last_became_active":"2024-09-10T08:28:35.574437+0000","last_became_peered":"2024-09-10T08:28:35.574437+0000","last_unstale":"2024-09-10T08:28:35.582039+0000","last_undegraded":"2024-09-10T08:28:35.582039+0000","last_fullsized":"2024-09-10T08:28:35.582039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:31.398284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582245+0000","last_change":"2024-09-10T08:28:35.577852+0000","last_active":"2024-09-10T08:28:35.582245+0000","last_peered":"2024-09-10T08:28:35.582245+0000","last_clean":"2024-09-10T08:28:35.582245+0000","last_became_active":"2024-09-10T08:28:35.577571+0000","last_became_peered":"2024-09-10T08:28:35.577571+0000","last_unstale":"2024-09-10T08:28:35.582245+0000","last_undegraded":"2024-09-10T08:28:35.582245+0000","last_fullsized":"2024-09-10T08:28:35.582245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:07:32.121601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582131+0000","last_change":"2024-09-10T08:28:35.578735+0000","last_active":"2024-09-10T08:28:35.582131+0000","last_peered":"2024-09-10T08:28:35.582131+0000","last_clean":"2024-09-10T08:28:35.582131+0000","last_became_active":"2024-09-10T08:28:35.577995+0000","last_became_peered":"2024-09-10T08:28:35.577995+0000","last_unstale":"2024-09-10T08:28:35.582131+0000","last_undegraded":"2024-09-10T08:28:35.582131+0000","last_fullsized":"2024-09-10T08:28:35.582131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:32.178282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620517+0000","last_change":"2024-09-10T08:28:35.566780+0000","last_active":"2024-09-10T08:28:36.620517+0000","last_peered":"2024-09-10T08:28:36.620517+0000","last_clean":"2024-09-10T08:28:36.620517+0000","last_became_active":"2024-09-10T08:28:35.566529+0000","last_became_peered":"2024-09-10T08:28:35.566529+0000","last_unstale":"2024-09-10T08:28:36.620517+0000","last_undegraded":"2024-09-10T08:28:36.620517+0000","last_fullsized":"2024-09-10T08:28:36.620517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:09.481166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:34.539900+0000","last_change":"2024-09-10T08:28:34.539900+0000","last_active":"2024-09-10T08:28:34.539900+0000","last_peered":"2024-09-10T08:28:34.539900+0000","last_clean":"2024-09-10T08:28:34.539900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:34.539900+0000","last_undegraded":"2024-09-10T08:28:34.539900+0000","last_fullsized":"2024-09-10T08:28:34.539900+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.560246+0000","last_change":"2024-09-10T08:28:35.559371+0000","last_active":"2024-09-10T08:28:35.560246+0000","last_peered":"2024-09-10T08:28:35.560246+0000","last_clean":"2024-09-10T08:28:35.560246+0000","last_became_active":"2024-09-10T08:28:35.559145+0000","last_became_peered":"2024-09-10T08:28:35.559145+0000","last_unstale":"2024-09-10T08:28:35.560246+0000","last_undegraded":"2024-09-10T08:28:35.560246+0000","last_fullsized":"2024-09-10T08:28:35.560246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:34:56.302624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582149+0000","last_change":"2024-09-10T08:28:34.566606+0000","last_active":"2024-09-10T08:28:35.582149+0000","last_peered":"2024-09-10T08:28:35.582149+0000","last_clean":"2024-09-10T08:28:35.582149+0000","last_became_active":"2024-09-10T08:28:34.566388+0000","last_became_peered":"2024-09-10T08:28:34.566388+0000","last_unstale":"2024-09-10T08:28:35.582149+0000","last_undegraded":"2024-09-10T08:28:35.582149+0000","last_fullsized":"2024-09-10T08:28:35.582149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:33.528801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582227+0000","last_change":"2024-09-10T08:28:35.576406+0000","last_active":"2024-09-10T08:28:35.582227+0000","last_peered":"2024-09-10T08:28:35.582227+0000","last_clean":"2024-09-10T08:28:35.582227+0000","last_became_active":"2024-09-10T08:28:35.576145+0000","last_became_peered":"2024-09-10T08:28:35.576145+0000","last_unstale":"2024-09-10T08:28:35.582227+0000","last_undegraded":"2024-09-10T08:28:35.582227+0000","last_fullsized":"2024-09-10T08:28:35.582227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:55.026157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T08:28:33.545183+0000","last_change":"2024-09-10T08:28:33.545183+0000","last_active":"2024-09-10T08:28:33.538281+0000","last_peered":"2024-09-10T08:28:33.538281+0000","last_clean":"2024-09-10T08:28:33.538281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:33.545183+0000","last_undegraded":"2024-09-10T08:28:33.545183+0000","last_fullsized":"2024-09-10T08:28:33.545183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.568578+0000","last_change":"2024-09-10T08:28:34.564751+0000","last_active":"2024-09-10T08:28:35.568578+0000","last_peered":"2024-09-10T08:28:35.568578+0000","last_clean":"2024-09-10T08:28:35.568578+0000","last_became_active":"2024-09-10T08:28:34.564479+0000","last_became_peered":"2024-09-10T08:28:34.564479+0000","last_unstale":"2024-09-10T08:28:35.568578+0000","last_undegraded":"2024-09-10T08:28:35.568578+0000","last_fullsized":"2024-09-10T08:28:35.568578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:29.618224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.584085+0000","last_change":"2024-09-10T08:28:35.580244+0000","last_active":"2024-09-10T08:28:35.584085+0000","last_peered":"2024-09-10T08:28:35.584085+0000","last_clean":"2024-09-10T08:28:35.584085+0000","last_became_active":"2024-09-10T08:28:35.579975+0000","last_became_peered":"2024-09-10T08:28:35.579975+0000","last_unstale":"2024-09-10T08:28:35.584085+0000","last_undegraded":"2024-09-10T08:28:35.584085+0000","last_fullsized":"2024-09-10T08:28:35.584085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:07.055709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556929+0000","last_change":"2024-09-10T08:28:34.554346+0000","last_active":"2024-09-10T08:28:35.556929+0000","last_peered":"2024-09-10T08:28:35.556929+0000","last_clean":"2024-09-10T08:28:35.556929+0000","last_became_active":"2024-09-10T08:28:34.553933+0000","last_became_peered":"2024-09-10T08:28:34.553933+0000","last_unstale":"2024-09-10T08:28:35.556929+0000","last_undegraded":"2024-09-10T08:28:35.556929+0000","last_fullsized":"2024-09-10T08:28:35.556929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:07.639671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.576475+0000","last_change":"2024-09-10T08:28:35.572803+0000","last_active":"2024-09-10T08:28:35.576475+0000","last_peered":"2024-09-10T08:28:35.576475+0000","last_clean":"2024-09-10T08:28:35.576475+0000","last_became_active":"2024-09-10T08:28:35.572219+0000","last_became_peered":"2024-09-10T08:28:35.572219+0000","last_unstale":"2024-09-10T08:28:35.576475+0000","last_undegraded":"2024-09-10T08:28:35.576475+0000","last_fullsized":"2024-09-10T08:28:35.576475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:01:26.046238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T08:28:33.545852+0000","last_change":"2024-09-10T08:28:33.545852+0000","last_active":"2024-09-10T08:28:33.538281+0000","last_peered":"2024-09-10T08:28:33.538281+0000","last_clean":"2024-09-10T08:28:33.538281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:33.545852+0000","last_undegraded":"2024-09-10T08:28:33.545852+0000","last_fullsized":"2024-09-10T08:28:33.545852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.576172+0000","last_change":"2024-09-10T08:28:35.572944+0000","last_active":"2024-09-10T08:28:35.576172+0000","last_peered":"2024-09-10T08:28:35.576172+0000","last_clean":"2024-09-10T08:28:35.576172+0000","last_became_active":"2024-09-10T08:28:35.572620+0000","last_became_peered":"2024-09-10T08:28:35.572620+0000","last_unstale":"2024-09-10T08:28:35.576172+0000","last_undegraded":"2024-09-10T08:28:35.576172+0000","last_fullsized":"2024-09-10T08:28:35.576172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:59.209973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556683+0000","last_change":"2024-09-10T08:28:34.564571+0000","last_active":"2024-09-10T08:28:35.556683+0000","last_peered":"2024-09-10T08:28:35.556683+0000","last_clean":"2024-09-10T08:28:35.556683+0000","last_became_active":"2024-09-10T08:28:34.564189+0000","last_became_peered":"2024-09-10T08:28:34.564189+0000","last_unstale":"2024-09-10T08:28:35.556683+0000","last_undegraded":"2024-09-10T08:28:35.556683+0000","last_fullsized":"2024-09-10T08:28:35.556683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:46.055510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582203+0000","last_change":"2024-09-10T08:28:35.577913+0000","last_active":"2024-09-10T08:28:35.582203+0000","last_peered":"2024-09-10T08:28:35.582203+0000","last_clean":"2024-09-10T08:28:35.582203+0000","last_became_active":"2024-09-10T08:28:35.577255+0000","last_became_peered":"2024-09-10T08:28:35.577255+0000","last_unstale":"2024-09-10T08:28:35.582203+0000","last_undegraded":"2024-09-10T08:28:35.582203+0000","last_fullsized":"2024-09-10T08:28:35.582203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:17.573799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581974+0000","last_change":"2024-09-10T08:28:34.557352+0000","last_active":"2024-09-10T08:28:35.581974+0000","last_peered":"2024-09-10T08:28:35.581974+0000","last_clean":"2024-09-10T08:28:35.581974+0000","last_became_active":"2024-09-10T08:28:34.557076+0000","last_became_peered":"2024-09-10T08:28:34.557076+0000","last_unstale":"2024-09-10T08:28:35.581974+0000","last_undegraded":"2024-09-10T08:28:35.581974+0000","last_fullsized":"2024-09-10T08:28:35.581974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:04.957739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.575391+0000","last_change":"2024-09-10T08:28:35.571262+0000","last_active":"2024-09-10T08:28:35.575391+0000","last_peered":"2024-09-10T08:28:35.575391+0000","last_clean":"2024-09-10T08:28:35.575391+0000","last_became_active":"2024-09-10T08:28:35.570711+0000","last_became_peered":"2024-09-10T08:28:35.570711+0000","last_unstale":"2024-09-10T08:28:35.575391+0000","last_undegraded":"2024-09-10T08:28:35.575391+0000","last_fullsized":"2024-09-10T08:28:35.575391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:26.384552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T08:28:33.545269+0000","last_change":"2024-09-10T08:28:33.545269+0000","last_active":"2024-09-10T08:28:33.538281+0000","last_peered":"2024-09-10T08:28:33.538281+0000","last_clean":"2024-09-10T08:28:33.538281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:33.545269+0000","last_undegraded":"2024-09-10T08:28:33.545269+0000","last_fullsized":"2024-09-10T08:28:33.545269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.586558+0000","last_change":"2024-09-10T08:28:35.582473+0000","last_active":"2024-09-10T08:28:35.586558+0000","last_peered":"2024-09-10T08:28:35.586558+0000","last_clean":"2024-09-10T08:28:35.586558+0000","last_became_active":"2024-09-10T08:28:35.582205+0000","last_became_peered":"2024-09-10T08:28:35.582205+0000","last_unstale":"2024-09-10T08:28:35.586558+0000","last_undegraded":"2024-09-10T08:28:35.586558+0000","last_fullsized":"2024-09-10T08:28:35.586558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:51.531897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.583031+0000","last_change":"2024-09-10T08:28:34.553556+0000","last_active":"2024-09-10T08:28:35.583031+0000","last_peered":"2024-09-10T08:28:35.583031+0000","last_clean":"2024-09-10T08:28:35.583031+0000","last_became_active":"2024-09-10T08:28:34.553275+0000","last_became_peered":"2024-09-10T08:28:34.553275+0000","last_unstale":"2024-09-10T08:28:35.583031+0000","last_undegraded":"2024-09-10T08:28:35.583031+0000","last_fullsized":"2024-09-10T08:28:35.583031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:45.957635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579158+0000","last_change":"2024-09-10T08:28:35.574810+0000","last_active":"2024-09-10T08:28:35.579158+0000","last_peered":"2024-09-10T08:28:35.579158+0000","last_clean":"2024-09-10T08:28:35.579158+0000","last_became_active":"2024-09-10T08:28:35.574567+0000","last_became_peered":"2024-09-10T08:28:35.574567+0000","last_unstale":"2024-09-10T08:28:35.579158+0000","last_undegraded":"2024-09-10T08:28:35.579158+0000","last_fullsized":"2024-09-10T08:28:35.579158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:28.056169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556821+0000","last_change":"2024-09-10T08:28:34.560699+0000","last_active":"2024-09-10T08:28:35.556821+0000","last_peered":"2024-09-10T08:28:35.556821+0000","last_clean":"2024-09-10T08:28:35.556821+0000","last_became_active":"2024-09-10T08:28:34.560376+0000","last_became_peered":"2024-09-10T08:28:34.560376+0000","last_unstale":"2024-09-10T08:28:35.556821+0000","last_undegraded":"2024-09-10T08:28:35.556821+0000","last_fullsized":"2024-09-10T08:28:35.556821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:09.981216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.580029+0000","last_change":"2024-09-10T08:28:35.575788+0000","last_active":"2024-09-10T08:28:35.580029+0000","last_peered":"2024-09-10T08:28:35.580029+0000","last_clean":"2024-09-10T08:28:35.580029+0000","last_became_active":"2024-09-10T08:28:35.575333+0000","last_became_peered":"2024-09-10T08:28:35.575333+0000","last_unstale":"2024-09-10T08:28:35.580029+0000","last_undegraded":"2024-09-10T08:28:35.580029+0000","last_fullsized":"2024-09-10T08:28:35.580029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:17.994128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T08:28:33.545130+0000","last_change":"2024-09-10T08:28:33.545130+0000","last_active":"2024-09-10T08:28:33.538281+0000","last_peered":"2024-09-10T08:28:33.538281+0000","last_clean":"2024-09-10T08:28:33.538281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:33.545130+0000","last_undegraded":"2024-09-10T08:28:33.545130+0000","last_fullsized":"2024-09-10T08:28:33.545130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:34.539900+0000","last_change":"2024-09-10T08:28:34.539900+0000","last_active":"2024-09-10T08:28:34.539900+0000","last_peered":"2024-09-10T08:28:34.539900+0000","last_clean":"2024-09-10T08:28:34.539900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:34.539900+0000","last_undegraded":"2024-09-10T08:28:34.539900+0000","last_fullsized":"2024-09-10T08:28:34.539900+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619641+0000","last_change":"2024-09-10T08:28:34.555542+0000","last_active":"2024-09-10T08:28:36.619641+0000","last_peered":"2024-09-10T08:28:36.619641+0000","last_clean":"2024-09-10T08:28:36.619641+0000","last_became_active":"2024-09-10T08:28:34.555179+0000","last_became_peered":"2024-09-10T08:28:34.555179+0000","last_unstale":"2024-09-10T08:28:36.619641+0000","last_undegraded":"2024-09-10T08:28:36.619641+0000","last_fullsized":"2024-09-10T08:28:36.619641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:53.313161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.577350+0000","last_change":"2024-09-10T08:28:35.575307+0000","last_active":"2024-09-10T08:28:35.577350+0000","last_peered":"2024-09-10T08:28:35.577350+0000","last_clean":"2024-09-10T08:28:35.577350+0000","last_became_active":"2024-09-10T08:28:35.575038+0000","last_became_peered":"2024-09-10T08:28:35.575038+0000","last_unstale":"2024-09-10T08:28:35.577350+0000","last_undegraded":"2024-09-10T08:28:35.577350+0000","last_fullsized":"2024-09-10T08:28:35.577350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:12.751231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.584686+0000","last_change":"2024-09-10T08:28:34.551102+0000","last_active":"2024-09-10T08:28:35.584686+0000","last_peered":"2024-09-10T08:28:35.584686+0000","last_clean":"2024-09-10T08:28:35.584686+0000","last_became_active":"2024-09-10T08:28:34.550773+0000","last_became_peered":"2024-09-10T08:28:34.550773+0000","last_unstale":"2024-09-10T08:28:35.584686+0000","last_undegraded":"2024-09-10T08:28:35.584686+0000","last_fullsized":"2024-09-10T08:28:35.584686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:35.393695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.585491+0000","last_change":"2024-09-10T08:28:35.577476+0000","last_active":"2024-09-10T08:28:35.585491+0000","last_peered":"2024-09-10T08:28:35.585491+0000","last_clean":"2024-09-10T08:28:35.585491+0000","last_became_active":"2024-09-10T08:28:35.576786+0000","last_became_peered":"2024-09-10T08:28:35.576786+0000","last_unstale":"2024-09-10T08:28:35.585491+0000","last_undegraded":"2024-09-10T08:28:35.585491+0000","last_fullsized":"2024-09-10T08:28:35.585491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:17.606334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619362+0000","last_change":"2024-09-10T08:28:34.560313+0000","last_active":"2024-09-10T08:28:36.619362+0000","last_peered":"2024-09-10T08:28:36.619362+0000","last_clean":"2024-09-10T08:28:36.619362+0000","last_became_active":"2024-09-10T08:28:34.560035+0000","last_became_peered":"2024-09-10T08:28:34.560035+0000","last_unstale":"2024-09-10T08:28:36.619362+0000","last_undegraded":"2024-09-10T08:28:36.619362+0000","last_fullsized":"2024-09-10T08:28:36.619362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:56.945537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.585563+0000","last_change":"2024-09-10T08:28:35.577577+0000","last_active":"2024-09-10T08:28:35.585563+0000","last_peered":"2024-09-10T08:28:35.585563+0000","last_clean":"2024-09-10T08:28:35.585563+0000","last_became_active":"2024-09-10T08:28:35.576686+0000","last_became_peered":"2024-09-10T08:28:35.576686+0000","last_unstale":"2024-09-10T08:28:35.585563+0000","last_undegraded":"2024-09-10T08:28:35.585563+0000","last_fullsized":"2024-09-10T08:28:35.585563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:51.251652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582053+0000","last_change":"2024-09-10T08:28:34.560694+0000","last_active":"2024-09-10T08:28:35.582053+0000","last_peered":"2024-09-10T08:28:35.582053+0000","last_clean":"2024-09-10T08:28:35.582053+0000","last_became_active":"2024-09-10T08:28:34.560429+0000","last_became_peered":"2024-09-10T08:28:34.560429+0000","last_unstale":"2024-09-10T08:28:35.582053+0000","last_undegraded":"2024-09-10T08:28:35.582053+0000","last_fullsized":"2024-09-10T08:28:35.582053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:54.514467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581989+0000","last_change":"2024-09-10T08:28:35.577124+0000","last_active":"2024-09-10T08:28:35.581989+0000","last_peered":"2024-09-10T08:28:35.581989+0000","last_clean":"2024-09-10T08:28:35.581989+0000","last_became_active":"2024-09-10T08:28:35.576655+0000","last_became_peered":"2024-09-10T08:28:35.576655+0000","last_unstale":"2024-09-10T08:28:35.581989+0000","last_undegraded":"2024-09-10T08:28:35.581989+0000","last_fullsized":"2024-09-10T08:28:35.581989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:57.339318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619122+0000","last_change":"2024-09-10T08:28:34.559911+0000","last_active":"2024-09-10T08:28:36.619122+0000","last_peered":"2024-09-10T08:28:36.619122+0000","last_clean":"2024-09-10T08:28:36.619122+0000","last_became_active":"2024-09-10T08:28:34.559635+0000","last_became_peered":"2024-09-10T08:28:34.559635+0000","last_unstale":"2024-09-10T08:28:36.619122+0000","last_undegraded":"2024-09-10T08:28:36.619122+0000","last_fullsized":"2024-09-10T08:28:36.619122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:40.892609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.577384+0000","last_change":"2024-09-10T08:28:35.574532+0000","last_active":"2024-09-10T08:28:35.577384+0000","last_peered":"2024-09-10T08:28:35.577384+0000","last_clean":"2024-09-10T08:28:35.577384+0000","last_became_active":"2024-09-10T08:28:35.574215+0000","last_became_peered":"2024-09-10T08:28:35.574215+0000","last_unstale":"2024-09-10T08:28:35.577384+0000","last_undegraded":"2024-09-10T08:28:35.577384+0000","last_fullsized":"2024-09-10T08:28:35.577384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:54.299622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.565625+0000","last_change":"2024-09-10T08:28:26.724394+0000","last_active":"2024-09-10T08:28:35.565625+0000","last_peered":"2024-09-10T08:28:35.565625+0000","last_clean":"2024-09-10T08:28:35.565625+0000","last_became_active":"2024-09-10T08:28:26.723452+0000","last_became_peered":"2024-09-10T08:28:26.723452+0000","last_unstale":"2024-09-10T08:28:35.565625+0000","last_undegraded":"2024-09-10T08:28:35.565625+0000","last_fullsized":"2024-09-10T08:28:35.565625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_clean_scrub_stamp":"2024-09-10T08:28:25.445753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:00.811505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556142+0000","last_change":"2024-09-10T08:28:34.555587+0000","last_active":"2024-09-10T08:28:35.556142+0000","last_peered":"2024-09-10T08:28:35.556142+0000","last_clean":"2024-09-10T08:28:35.556142+0000","last_became_active":"2024-09-10T08:28:34.555269+0000","last_became_peered":"2024-09-10T08:28:34.555269+0000","last_unstale":"2024-09-10T08:28:35.556142+0000","last_undegraded":"2024-09-10T08:28:35.556142+0000","last_fullsized":"2024-09-10T08:28:35.556142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:19.499870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582012+0000","last_change":"2024-09-10T08:28:35.572658+0000","last_active":"2024-09-10T08:28:35.582012+0000","last_peered":"2024-09-10T08:28:35.582012+0000","last_clean":"2024-09-10T08:28:35.582012+0000","last_became_active":"2024-09-10T08:28:35.571611+0000","last_became_peered":"2024-09-10T08:28:35.571611+0000","last_unstale":"2024-09-10T08:28:35.582012+0000","last_undegraded":"2024-09-10T08:28:35.582012+0000","last_fullsized":"2024-09-10T08:28:35.582012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:44.555736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.565556+0000","last_change":"2024-09-10T08:28:34.568477+0000","last_active":"2024-09-10T08:28:35.565556+0000","last_peered":"2024-09-10T08:28:35.565556+0000","last_clean":"2024-09-10T08:28:35.565556+0000","last_became_active":"2024-09-10T08:28:34.568249+0000","last_became_peered":"2024-09-10T08:28:34.568249+0000","last_unstale":"2024-09-10T08:28:35.565556+0000","last_undegraded":"2024-09-10T08:28:35.565556+0000","last_fullsized":"2024-09-10T08:28:35.565556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:08.640043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579232+0000","last_change":"2024-09-10T08:28:35.576360+0000","last_active":"2024-09-10T08:28:35.579232+0000","last_peered":"2024-09-10T08:28:35.579232+0000","last_clean":"2024-09-10T08:28:35.579232+0000","last_became_active":"2024-09-10T08:28:35.576096+0000","last_became_peered":"2024-09-10T08:28:35.576096+0000","last_unstale":"2024-09-10T08:28:35.579232+0000","last_undegraded":"2024-09-10T08:28:35.579232+0000","last_fullsized":"2024-09-10T08:28:35.579232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:51.274979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620584+0000","last_change":"2024-09-10T08:28:34.560745+0000","last_active":"2024-09-10T08:28:36.620584+0000","last_peered":"2024-09-10T08:28:36.620584+0000","last_clean":"2024-09-10T08:28:36.620584+0000","last_became_active":"2024-09-10T08:28:34.559911+0000","last_became_peered":"2024-09-10T08:28:34.559911+0000","last_unstale":"2024-09-10T08:28:36.620584+0000","last_undegraded":"2024-09-10T08:28:36.620584+0000","last_fullsized":"2024-09-10T08:28:36.620584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:00.234067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.572722+0000","last_change":"2024-09-10T08:28:35.566745+0000","last_active":"2024-09-10T08:28:35.572722+0000","last_peered":"2024-09-10T08:28:35.572722+0000","last_clean":"2024-09-10T08:28:35.572722+0000","last_became_active":"2024-09-10T08:28:35.566444+0000","last_became_peered":"2024-09-10T08:28:35.566444+0000","last_unstale":"2024-09-10T08:28:35.572722+0000","last_undegraded":"2024-09-10T08:28:35.572722+0000","last_fullsized":"2024-09-10T08:28:35.572722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:37.924675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.557028+0000","last_change":"2024-09-10T08:28:34.553983+0000","last_active":"2024-09-10T08:28:35.557028+0000","last_peered":"2024-09-10T08:28:35.557028+0000","last_clean":"2024-09-10T08:28:35.557028+0000","last_became_active":"2024-09-10T08:28:34.553693+0000","last_became_peered":"2024-09-10T08:28:34.553693+0000","last_unstale":"2024-09-10T08:28:35.557028+0000","last_undegraded":"2024-09-10T08:28:35.557028+0000","last_fullsized":"2024-09-10T08:28:35.557028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:40.001685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.580684+0000","last_change":"2024-09-10T08:28:35.577978+0000","last_active":"2024-09-10T08:28:35.580684+0000","last_peered":"2024-09-10T08:28:35.580684+0000","last_clean":"2024-09-10T08:28:35.580684+0000","last_became_active":"2024-09-10T08:28:35.577718+0000","last_became_peered":"2024-09-10T08:28:35.577718+0000","last_unstale":"2024-09-10T08:28:35.580684+0000","last_undegraded":"2024-09-10T08:28:35.580684+0000","last_fullsized":"2024-09-10T08:28:35.580684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:46.194153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.557039+0000","last_change":"2024-09-10T08:28:34.555212+0000","last_active":"2024-09-10T08:28:35.557039+0000","last_peered":"2024-09-10T08:28:35.557039+0000","last_clean":"2024-09-10T08:28:35.557039+0000","last_became_active":"2024-09-10T08:28:34.554922+0000","last_became_peered":"2024-09-10T08:28:34.554922+0000","last_unstale":"2024-09-10T08:28:35.557039+0000","last_undegraded":"2024-09-10T08:28:35.557039+0000","last_fullsized":"2024-09-10T08:28:35.557039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581944+0000","last_change":"2024-09-10T08:28:35.576280+0000","last_active":"2024-09-10T08:28:35.581944+0000","last_peered":"2024-09-10T08:28:35.581944+0000","last_clean":"2024-09-10T08:28:35.581944+0000","last_became_active":"2024-09-10T08:28:35.576002+0000","last_became_peered":"2024-09-10T08:28:35.576002+0000","last_unstale":"2024-09-10T08:28:35.581944+0000","last_undegraded":"2024-09-10T08:28:35.581944+0000","last_fullsized":"2024-09-10T08:28:35.581944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:47.191902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.565441+0000","last_change":"2024-09-10T08:28:34.571283+0000","last_active":"2024-09-10T08:28:35.565441+0000","last_peered":"2024-09-10T08:28:35.565441+0000","last_clean":"2024-09-10T08:28:35.565441+0000","last_became_active":"2024-09-10T08:28:34.570791+0000","last_became_peered":"2024-09-10T08:28:34.570791+0000","last_unstale":"2024-09-10T08:28:35.565441+0000","last_undegraded":"2024-09-10T08:28:35.565441+0000","last_fullsized":"2024-09-10T08:28:35.565441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:17.427597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.572702+0000","last_change":"2024-09-10T08:28:35.567481+0000","last_active":"2024-09-10T08:28:35.572702+0000","last_peered":"2024-09-10T08:28:35.572702+0000","last_clean":"2024-09-10T08:28:35.572702+0000","last_became_active":"2024-09-10T08:28:35.567167+0000","last_became_peered":"2024-09-10T08:28:35.567167+0000","last_unstale":"2024-09-10T08:28:35.572702+0000","last_undegraded":"2024-09-10T08:28:35.572702+0000","last_fullsized":"2024-09-10T08:28:35.572702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:45.440275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556778+0000","last_change":"2024-09-10T08:28:34.563451+0000","last_active":"2024-09-10T08:28:35.556778+0000","last_peered":"2024-09-10T08:28:35.556778+0000","last_clean":"2024-09-10T08:28:35.556778+0000","last_became_active":"2024-09-10T08:28:34.563259+0000","last_became_peered":"2024-09-10T08:28:34.563259+0000","last_unstale":"2024-09-10T08:28:35.556778+0000","last_undegraded":"2024-09-10T08:28:35.556778+0000","last_fullsized":"2024-09-10T08:28:35.556778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:44.899351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581971+0000","last_change":"2024-09-10T08:28:35.574107+0000","last_active":"2024-09-10T08:28:35.581971+0000","last_peered":"2024-09-10T08:28:35.581971+0000","last_clean":"2024-09-10T08:28:35.581971+0000","last_became_active":"2024-09-10T08:28:35.573851+0000","last_became_peered":"2024-09-10T08:28:35.573851+0000","last_unstale":"2024-09-10T08:28:35.581971+0000","last_undegraded":"2024-09-10T08:28:35.581971+0000","last_fullsized":"2024-09-10T08:28:35.581971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:24.848264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-10T08:28:33.545282+0000","last_change":"2024-09-10T08:28:33.545282+0000","last_active":"2024-09-10T08:28:33.538281+0000","last_peered":"2024-09-10T08:28:33.538281+0000","last_clean":"2024-09-10T08:28:33.538281+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:33.545282+0000","last_undegraded":"2024-09-10T08:28:33.545282+0000","last_fullsized":"2024-09-10T08:28:33.545282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579227+0000","last_change":"2024-09-10T08:28:35.575106+0000","last_active":"2024-09-10T08:28:35.579227+0000","last_peered":"2024-09-10T08:28:35.579227+0000","last_clean":"2024-09-10T08:28:35.579227+0000","last_became_active":"2024-09-10T08:28:35.574815+0000","last_became_peered":"2024-09-10T08:28:35.574815+0000","last_unstale":"2024-09-10T08:28:35.579227+0000","last_undegraded":"2024-09-10T08:28:35.579227+0000","last_fullsized":"2024-09-10T08:28:35.579227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:39.473943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.565374+0000","last_change":"2024-09-10T08:28:34.571069+0000","last_active":"2024-09-10T08:28:35.565374+0000","last_peered":"2024-09-10T08:28:35.565374+0000","last_clean":"2024-09-10T08:28:35.565374+0000","last_became_active":"2024-09-10T08:28:34.570766+0000","last_became_peered":"2024-09-10T08:28:34.570766+0000","last_unstale":"2024-09-10T08:28:35.565374+0000","last_undegraded":"2024-09-10T08:28:35.565374+0000","last_fullsized":"2024-09-10T08:28:35.565374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:47.458195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.574702+0000","last_change":"2024-09-10T08:28:35.569938+0000","last_active":"2024-09-10T08:28:35.574702+0000","last_peered":"2024-09-10T08:28:35.574702+0000","last_clean":"2024-09-10T08:28:35.574702+0000","last_became_active":"2024-09-10T08:28:35.569109+0000","last_became_peered":"2024-09-10T08:28:35.569109+0000","last_unstale":"2024-09-10T08:28:35.574702+0000","last_undegraded":"2024-09-10T08:28:35.574702+0000","last_fullsized":"2024-09-10T08:28:35.574702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:40.936585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.557127+0000","last_change":"2024-09-10T08:28:34.564813+0000","last_active":"2024-09-10T08:28:35.557127+0000","last_peered":"2024-09-10T08:28:35.557127+0000","last_clean":"2024-09-10T08:28:35.557127+0000","last_became_active":"2024-09-10T08:28:34.564557+0000","last_became_peered":"2024-09-10T08:28:34.564557+0000","last_unstale":"2024-09-10T08:28:35.557127+0000","last_undegraded":"2024-09-10T08:28:35.557127+0000","last_fullsized":"2024-09-10T08:28:35.557127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:48.356069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581850+0000","last_change":"2024-09-10T08:28:35.572363+0000","last_active":"2024-09-10T08:28:35.581850+0000","last_peered":"2024-09-10T08:28:35.581850+0000","last_clean":"2024-09-10T08:28:35.581850+0000","last_became_active":"2024-09-10T08:28:35.572108+0000","last_became_peered":"2024-09-10T08:28:35.572108+0000","last_unstale":"2024-09-10T08:28:35.581850+0000","last_undegraded":"2024-09-10T08:28:35.581850+0000","last_fullsized":"2024-09-10T08:28:35.581850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:47.800442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556782+0000","last_change":"2024-09-10T08:28:34.561324+0000","last_active":"2024-09-10T08:28:35.556782+0000","last_peered":"2024-09-10T08:28:35.556782+0000","last_clean":"2024-09-10T08:28:35.556782+0000","last_became_active":"2024-09-10T08:28:34.560974+0000","last_became_peered":"2024-09-10T08:28:34.560974+0000","last_unstale":"2024-09-10T08:28:35.556782+0000","last_undegraded":"2024-09-10T08:28:35.556782+0000","last_fullsized":"2024-09-10T08:28:35.556782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:18.790965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.584262+0000","last_change":"2024-09-10T08:28:35.577024+0000","last_active":"2024-09-10T08:28:35.584262+0000","last_peered":"2024-09-10T08:28:35.584262+0000","last_clean":"2024-09-10T08:28:35.584262+0000","last_became_active":"2024-09-10T08:28:35.576771+0000","last_became_peered":"2024-09-10T08:28:35.576771+0000","last_unstale":"2024-09-10T08:28:35.584262+0000","last_undegraded":"2024-09-10T08:28:35.584262+0000","last_fullsized":"2024-09-10T08:28:35.584262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:42.944227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.586398+0000","last_change":"2024-09-10T08:28:34.569235+0000","last_active":"2024-09-10T08:28:35.586398+0000","last_peered":"2024-09-10T08:28:35.586398+0000","last_clean":"2024-09-10T08:28:35.586398+0000","last_became_active":"2024-09-10T08:28:34.568899+0000","last_became_peered":"2024-09-10T08:28:34.568899+0000","last_unstale":"2024-09-10T08:28:35.586398+0000","last_undegraded":"2024-09-10T08:28:35.586398+0000","last_fullsized":"2024-09-10T08:28:35.586398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:21.927656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:34.539900+0000","last_change":"2024-09-10T08:28:34.539900+0000","last_active":"2024-09-10T08:28:34.539900+0000","last_peered":"2024-09-10T08:28:34.539900+0000","last_clean":"2024-09-10T08:28:34.539900+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:34.539900+0000","last_undegraded":"2024-09-10T08:28:34.539900+0000","last_fullsized":"2024-09-10T08:28:34.539900+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.561221+0000","last_change":"2024-09-10T08:28:35.560380+0000","last_active":"2024-09-10T08:28:35.561221+0000","last_peered":"2024-09-10T08:28:35.561221+0000","last_clean":"2024-09-10T08:28:35.561221+0000","last_became_active":"2024-09-10T08:28:35.560095+0000","last_became_peered":"2024-09-10T08:28:35.560095+0000","last_unstale":"2024-09-10T08:28:35.561221+0000","last_undegraded":"2024-09-10T08:28:35.561221+0000","last_fullsized":"2024-09-10T08:28:35.561221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:10.493163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.586370+0000","last_change":"2024-09-10T08:28:34.566560+0000","last_active":"2024-09-10T08:28:35.586370+0000","last_peered":"2024-09-10T08:28:35.586370+0000","last_clean":"2024-09-10T08:28:35.586370+0000","last_became_active":"2024-09-10T08:28:34.566275+0000","last_became_peered":"2024-09-10T08:28:34.566275+0000","last_unstale":"2024-09-10T08:28:35.586370+0000","last_undegraded":"2024-09-10T08:28:35.586370+0000","last_fullsized":"2024-09-10T08:28:35.586370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:03.507683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.564414+0000","last_change":"2024-09-10T08:28:35.562132+0000","last_active":"2024-09-10T08:28:35.564414+0000","last_peered":"2024-09-10T08:28:35.564414+0000","last_clean":"2024-09-10T08:28:35.564414+0000","last_became_active":"2024-09-10T08:28:35.561842+0000","last_became_peered":"2024-09-10T08:28:35.561842+0000","last_unstale":"2024-09-10T08:28:35.564414+0000","last_undegraded":"2024-09-10T08:28:35.564414+0000","last_fullsized":"2024-09-10T08:28:35.564414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:55.020192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.586634+0000","last_change":"2024-09-10T08:28:34.571965+0000","last_active":"2024-09-10T08:28:35.586634+0000","last_peered":"2024-09-10T08:28:35.586634+0000","last_clean":"2024-09-10T08:28:35.586634+0000","last_became_active":"2024-09-10T08:28:34.571640+0000","last_became_peered":"2024-09-10T08:28:34.571640+0000","last_unstale":"2024-09-10T08:28:35.586634+0000","last_undegraded":"2024-09-10T08:28:35.586634+0000","last_fullsized":"2024-09-10T08:28:35.586634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:53.047030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.584568+0000","last_change":"2024-09-10T08:28:35.579033+0000","last_active":"2024-09-10T08:28:35.584568+0000","last_peered":"2024-09-10T08:28:35.584568+0000","last_clean":"2024-09-10T08:28:35.584568+0000","last_became_active":"2024-09-10T08:28:35.578333+0000","last_became_peered":"2024-09-10T08:28:35.578333+0000","last_unstale":"2024-09-10T08:28:35.584568+0000","last_undegraded":"2024-09-10T08:28:35.584568+0000","last_fullsized":"2024-09-10T08:28:35.584568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:33.115063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582973+0000","last_change":"2024-09-10T08:28:34.561691+0000","last_active":"2024-09-10T08:28:35.582973+0000","last_peered":"2024-09-10T08:28:35.582973+0000","last_clean":"2024-09-10T08:28:35.582973+0000","last_became_active":"2024-09-10T08:28:34.561410+0000","last_became_peered":"2024-09-10T08:28:34.561410+0000","last_unstale":"2024-09-10T08:28:35.582973+0000","last_undegraded":"2024-09-10T08:28:35.582973+0000","last_fullsized":"2024-09-10T08:28:35.582973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.629982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582221+0000","last_change":"2024-09-10T08:28:35.575267+0000","last_active":"2024-09-10T08:28:35.582221+0000","last_peered":"2024-09-10T08:28:35.582221+0000","last_clean":"2024-09-10T08:28:35.582221+0000","last_became_active":"2024-09-10T08:28:35.575019+0000","last_became_peered":"2024-09-10T08:28:35.575019+0000","last_unstale":"2024-09-10T08:28:35.582221+0000","last_undegraded":"2024-09-10T08:28:35.582221+0000","last_fullsized":"2024-09-10T08:28:35.582221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:56.550243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581879+0000","last_change":"2024-09-10T08:28:34.564816+0000","last_active":"2024-09-10T08:28:35.581879+0000","last_peered":"2024-09-10T08:28:35.581879+0000","last_clean":"2024-09-10T08:28:35.581879+0000","last_became_active":"2024-09-10T08:28:34.564545+0000","last_became_peered":"2024-09-10T08:28:34.564545+0000","last_unstale":"2024-09-10T08:28:35.581879+0000","last_undegraded":"2024-09-10T08:28:35.581879+0000","last_fullsized":"2024-09-10T08:28:35.581879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:34.365104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":650015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":59647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":59647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":68004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":59647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":650015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":72667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:28:40.173 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-10T08:28:40.173 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:34.539900+0000', 'last_change': '2024-09-10T08:28:34.539900+0000', 'last_active': '2024-09-10T08:28:34.539900+0000', 'last_peered': '2024-09-10T08:28:34.539900+0000', 'last_clean': '2024-09-10T08:28:34.539900+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:34.539900+0000', 'last_undegraded': '2024-09-10T08:28:34.539900+0000', 'last_fullsized': '2024-09-10T08:28:34.539900+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:34.539900+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:34.539900+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:34.539900+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:40.173 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-10T08:28:40.173 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:34.539900+0000', 'last_change': '2024-09-10T08:28:34.539900+0000', 'last_active': '2024-09-10T08:28:34.539900+0000', 'last_peered': '2024-09-10T08:28:34.539900+0000', 'last_clean': '2024-09-10T08:28:34.539900+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:34.539900+0000', 'last_undegraded': '2024-09-10T08:28:34.539900+0000', 'last_fullsized': '2024-09-10T08:28:34.539900+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:34.539900+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:34.539900+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:34.539900+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:40.173 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-10T08:28:40.173 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:34.539900+0000', 'last_change': '2024-09-10T08:28:34.539900+0000', 'last_active': '2024-09-10T08:28:34.539900+0000', 'last_peered': '2024-09-10T08:28:34.539900+0000', 'last_clean': '2024-09-10T08:28:34.539900+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:34.539900+0000', 'last_undegraded': '2024-09-10T08:28:34.539900+0000', 'last_fullsized': '2024-09-10T08:28:34.539900+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:34.539900+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:34.539900+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:34.539900+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:40.173 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-10T08:28:40.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:34.539900+0000', 'last_change': '2024-09-10T08:28:34.539900+0000', 'last_active': '2024-09-10T08:28:34.539900+0000', 'last_peered': '2024-09-10T08:28:34.539900+0000', 'last_clean': '2024-09-10T08:28:34.539900+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:34.539900+0000', 'last_undegraded': '2024-09-10T08:28:34.539900+0000', 'last_fullsized': '2024-09-10T08:28:34.539900+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:34.539900+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:34.539900+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:34.539900+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:40.174 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-10T08:28:40.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:34.539900+0000', 'last_change': '2024-09-10T08:28:34.539900+0000', 'last_active': '2024-09-10T08:28:34.539900+0000', 'last_peered': '2024-09-10T08:28:34.539900+0000', 'last_clean': '2024-09-10T08:28:34.539900+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:34.539900+0000', 'last_undegraded': '2024-09-10T08:28:34.539900+0000', 'last_fullsized': '2024-09-10T08:28:34.539900+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:34.539900+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:34.539900+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:34.539900+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:40.174 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1a is not active+clean 2024-09-10T08:28:40.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:33.545183+0000', 'last_change': '2024-09-10T08:28:33.545183+0000', 'last_active': '2024-09-10T08:28:33.538281+0000', 'last_peered': '2024-09-10T08:28:33.538281+0000', 'last_clean': '2024-09-10T08:28:33.538281+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:33.545183+0000', 'last_undegraded': '2024-09-10T08:28:33.545183+0000', 'last_fullsized': '2024-09-10T08:28:33.545183+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:33.538281+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:33.538281+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:33.538281+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:28:40.174 INFO:tasks.ceph.ceph_manager.ceph:PG 2.17 is not active+clean 2024-09-10T08:28:40.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:33.545852+0000', 'last_change': '2024-09-10T08:28:33.545852+0000', 'last_active': '2024-09-10T08:28:33.538281+0000', 'last_peered': '2024-09-10T08:28:33.538281+0000', 'last_clean': '2024-09-10T08:28:33.538281+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:33.545852+0000', 'last_undegraded': '2024-09-10T08:28:33.545852+0000', 'last_fullsized': '2024-09-10T08:28:33.545852+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:33.538281+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:33.538281+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:33.538281+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:28:40.174 INFO:tasks.ceph.ceph_manager.ceph:PG 2.14 is not active+clean 2024-09-10T08:28:40.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:33.545269+0000', 'last_change': '2024-09-10T08:28:33.545269+0000', 'last_active': '2024-09-10T08:28:33.538281+0000', 'last_peered': '2024-09-10T08:28:33.538281+0000', 'last_clean': '2024-09-10T08:28:33.538281+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:33.545269+0000', 'last_undegraded': '2024-09-10T08:28:33.545269+0000', 'last_fullsized': '2024-09-10T08:28:33.545269+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:33.538281+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:33.538281+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:33.538281+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:28:40.174 INFO:tasks.ceph.ceph_manager.ceph:PG 2.11 is not active+clean 2024-09-10T08:28:40.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:33.545130+0000', 'last_change': '2024-09-10T08:28:33.545130+0000', 'last_active': '2024-09-10T08:28:33.538281+0000', 'last_peered': '2024-09-10T08:28:33.538281+0000', 'last_clean': '2024-09-10T08:28:33.538281+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:33.545130+0000', 'last_undegraded': '2024-09-10T08:28:33.545130+0000', 'last_fullsized': '2024-09-10T08:28:33.545130+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:33.538281+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:33.538281+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:33.538281+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:28:40.175 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-10T08:28:40.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:34.539900+0000', 'last_change': '2024-09-10T08:28:34.539900+0000', 'last_active': '2024-09-10T08:28:34.539900+0000', 'last_peered': '2024-09-10T08:28:34.539900+0000', 'last_clean': '2024-09-10T08:28:34.539900+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:34.539900+0000', 'last_undegraded': '2024-09-10T08:28:34.539900+0000', 'last_fullsized': '2024-09-10T08:28:34.539900+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:34.539900+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:34.539900+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:34.539900+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:40.175 INFO:tasks.ceph.ceph_manager.ceph:PG 2.7 is not active+clean 2024-09-10T08:28:40.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:33.545282+0000', 'last_change': '2024-09-10T08:28:33.545282+0000', 'last_active': '2024-09-10T08:28:33.538281+0000', 'last_peered': '2024-09-10T08:28:33.538281+0000', 'last_clean': '2024-09-10T08:28:33.538281+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:33.545282+0000', 'last_undegraded': '2024-09-10T08:28:33.545282+0000', 'last_fullsized': '2024-09-10T08:28:33.545282+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:33.538281+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:33.538281+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:33.538281+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:28:40.175 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-10T08:28:40.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:34.539900+0000', 'last_change': '2024-09-10T08:28:34.539900+0000', 'last_active': '2024-09-10T08:28:34.539900+0000', 'last_peered': '2024-09-10T08:28:34.539900+0000', 'last_clean': '2024-09-10T08:28:34.539900+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:34.539900+0000', 'last_undegraded': '2024-09-10T08:28:34.539900+0000', 'last_fullsized': '2024-09-10T08:28:34.539900+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:34.539900+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:34.539900+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:34.539900+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:40.175 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:28:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.307+0000 7f0d6a2ba640 1 Processor -- start 2024-09-10T08:28:40.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.307+0000 7f0d6a2ba640 1 -- start start 2024-09-10T08:28:40.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.308+0000 7f0d6a2ba640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0d641505f0 0x7f0d64153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:40.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.308+0000 7f0d6a2ba640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d640c69c0 0x7f0d640c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:40.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.308+0000 7f0d6a2ba640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d640c2980 0x7f0d640c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:40.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.308+0000 7f0d6a2ba640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f0d640c7860 con 0x7f0d641505f0 2024-09-10T08:28:40.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.308+0000 7f0d6a2ba640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f0d640c5940 con 0x7f0d640c69c0 2024-09-10T08:28:40.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.308+0000 7f0d6a2ba640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0d640c5c00 con 0x7f0d640c2980 2024-09-10T08:28:40.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.308+0000 7f0d63fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0d641505f0 0x7f0d64153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:40.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.308+0000 7f0d63fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0d641505f0 0x7f0d64153910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57562/0 (socket says 172.21.15.103:57562) 2024-09-10T08:28:40.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.308+0000 7f0d63fff640 1 -- 172.21.15.103:0/2301840743 learned_addr learned my addr 172.21.15.103:0/2301840743 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:40.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.308+0000 7f0d68857640 1 --2- 172.21.15.103:0/2301840743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d640c2980 0x7f0d640c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:40.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.308+0000 7f0d63fff640 1 -- 172.21.15.103:0/2301840743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d640c2980 msgr2=0x7f0d640c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:40.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.308+0000 7f0d63fff640 1 --2- 172.21.15.103:0/2301840743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d640c2980 0x7f0d640c42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.308+0000 7f0d637fe640 1 --2- 172.21.15.103:0/2301840743 >> v2:172.21.15.154:3300/0 conn(0x7f0d640c69c0 0x7f0d640c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:40.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.308+0000 7f0d63fff640 1 -- 172.21.15.103:0/2301840743 >> v2:172.21.15.154:3300/0 conn(0x7f0d640c69c0 msgr2=0x7f0d640c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:40.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.308+0000 7f0d63fff640 1 --2- 172.21.15.103:0/2301840743 >> v2:172.21.15.154:3300/0 conn(0x7f0d640c69c0 0x7f0d640c2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.308+0000 7f0d63fff640 1 -- 172.21.15.103:0/2301840743 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d640c5ee0 con 0x7f0d641505f0 2024-09-10T08:28:40.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.309+0000 7f0d63fff640 1 --2- 172.21.15.103:0/2301840743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d641505f0 0x7f0d64153910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0d640c5580 tx=0x7f0d5402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f05454049f7c045 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:40.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.309+0000 7f0d62ffd640 1 -- 172.21.15.103:0/2301840743 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54037070 con 0x7f0d641505f0 2024-09-10T08:28:40.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.309+0000 7f0d62ffd640 1 -- 172.21.15.103:0/2301840743 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d54032440 con 0x7f0d641505f0 2024-09-10T08:28:40.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.309+0000 7f0d62ffd640 1 -- 172.21.15.103:0/2301840743 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54032810 con 0x7f0d641505f0 2024-09-10T08:28:40.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.310+0000 7f0d6a2ba640 1 -- 172.21.15.103:0/2301840743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d641505f0 msgr2=0x7f0d64153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:40.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.310+0000 7f0d6a2ba640 1 --2- 172.21.15.103:0/2301840743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d641505f0 0x7f0d64153910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0d640c5580 tx=0x7f0d5402a140 comp rx=0 tx=0).stop 2024-09-10T08:28:40.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.310+0000 7f0d6a2ba640 1 -- 172.21.15.103:0/2301840743 shutdown_connections 2024-09-10T08:28:40.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.310+0000 7f0d6a2ba640 1 --2- 172.21.15.103:0/2301840743 >> v2:172.21.15.154:3300/0 conn(0x7f0d640c69c0 0x7f0d640c2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.310+0000 7f0d6a2ba640 1 --2- 172.21.15.103:0/2301840743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d640c2980 0x7f0d640c42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.310+0000 7f0d6a2ba640 1 --2- 172.21.15.103:0/2301840743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d641505f0 0x7f0d64153910 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.310+0000 7f0d6a2ba640 1 -- 172.21.15.103:0/2301840743 >> 172.21.15.103:0/2301840743 conn(0x7f0d640c7a40 msgr2=0x7f0d640c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:40.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.310+0000 7f0d6a2ba640 1 -- 172.21.15.103:0/2301840743 shutdown_connections 2024-09-10T08:28:40.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.310+0000 7f0d6a2ba640 1 -- 172.21.15.103:0/2301840743 wait complete. 2024-09-10T08:28:40.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.311+0000 7f0d6a2ba640 1 Processor -- start 2024-09-10T08:28:40.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.311+0000 7f0d6a2ba640 1 -- start start 2024-09-10T08:28:40.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d6a2ba640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d640c2980 0x7f0d64147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:40.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d6a2ba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d641505f0 0x7f0d64148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:40.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d6a2ba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d64149cc0 0x7f0d6414a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:40.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d6a2ba640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0d641509d0 con 0x7f0d641505f0 2024-09-10T08:28:40.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d6a2ba640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0d640c64a0 con 0x7f0d64149cc0 2024-09-10T08:28:40.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d6a2ba640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0d64150b50 con 0x7f0d640c2980 2024-09-10T08:28:40.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d637fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d641505f0 0x7f0d64148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:40.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d637fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d641505f0 0x7f0d64148230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57576/0 (socket says 172.21.15.103:57576) 2024-09-10T08:28:40.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d637fe640 1 -- 172.21.15.103:0/2028322221 learned_addr learned my addr 172.21.15.103:0/2028322221 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:40.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d68857640 1 --2- 172.21.15.103:0/2028322221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d64149cc0 0x7f0d6414a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:40.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d63fff640 1 --2- 172.21.15.103:0/2028322221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d640c2980 0x7f0d64147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:40.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d637fe640 1 -- 172.21.15.103:0/2028322221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d640c2980 msgr2=0x7f0d64147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:40.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d637fe640 1 --2- 172.21.15.103:0/2028322221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d640c2980 0x7f0d64147cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d637fe640 1 -- 172.21.15.103:0/2028322221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d64149cc0 msgr2=0x7f0d6414a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:40.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d637fe640 1 --2- 172.21.15.103:0/2028322221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d64149cc0 0x7f0d6414a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d637fe640 1 -- 172.21.15.103:0/2028322221 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d640abe00 con 0x7f0d641505f0 2024-09-10T08:28:40.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d63fff640 1 --2- 172.21.15.103:0/2028322221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d640c2980 0x7f0d64147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:40.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d68857640 1 --2- 172.21.15.103:0/2028322221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d64149cc0 0x7f0d6414a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:40.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d637fe640 1 --2- 172.21.15.103:0/2028322221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d641505f0 0x7f0d64148230 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800c820 tx=0x7f0d5800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:40.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d60ff9640 1 -- 172.21.15.103:0/2028322221 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d58015070 con 0x7f0d641505f0 2024-09-10T08:28:40.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d60ff9640 1 -- 172.21.15.103:0/2028322221 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d58004240 con 0x7f0d641505f0 2024-09-10T08:28:40.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d6a2ba640 1 -- 172.21.15.103:0/2028322221 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d640ac0a0 con 0x7f0d641505f0 2024-09-10T08:28:40.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d60ff9640 1 -- 172.21.15.103:0/2028322221 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5800ce10 con 0x7f0d641505f0 2024-09-10T08:28:40.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.312+0000 7f0d6a2ba640 1 -- 172.21.15.103:0/2028322221 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d640ac970 con 0x7f0d641505f0 2024-09-10T08:28:40.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.313+0000 7f0d6a2ba640 1 -- 172.21.15.103:0/2028322221 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d6414ea50 con 0x7f0d641505f0 2024-09-10T08:28:40.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.314+0000 7f0d60ff9640 1 -- 172.21.15.103:0/2028322221 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d58007830 con 0x7f0d641505f0 2024-09-10T08:28:40.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.314+0000 7f0d60ff9640 1 --2- 172.21.15.103:0/2028322221 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0d5006be60 0x7f0d5006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:40.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.314+0000 7f0d60ff9640 1 -- 172.21.15.103:0/2028322221 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f0d5808ac30 con 0x7f0d641505f0 2024-09-10T08:28:40.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.314+0000 7f0d63fff640 1 --2- 172.21.15.103:0/2028322221 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0d5006be60 0x7f0d5006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:40.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.315+0000 7f0d63fff640 1 --2- 172.21.15.103:0/2028322221 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0d5006be60 0x7f0d5006e320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0d54034000 tx=0x7f0d5402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:40.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.318+0000 7f0d60ff9640 1 -- 172.21.15.103:0/2028322221 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0d6414ea50 con 0x7f0d641505f0 2024-09-10T08:28:40.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.547+0000 7f0d6a2ba640 1 -- 172.21.15.103:0/2028322221 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f0d640c2440 con 0x7f0d641505f0 2024-09-10T08:28:40.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.548+0000 7f0d60ff9640 1 -- 172.21.15.103:0/2028322221 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1215 (secure 0 0 0) 0x7f0d58059680 con 0x7f0d641505f0 2024-09-10T08:28:40.549 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:40.549 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":27,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956905,"num_in_osds":8,"osd_in_since":1725956894,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":85},{"state_name":"unknown","count":7},{"state_name":"creating+peering","count":5}],"num_pgs":97,"num_pools":3,"num_objects":18,"data_bytes":591166,"bytes_used":224137216,"bytes_avail":772869976064,"bytes_total":773094113280,"unknown_pgs_ratio":0.072164945304393768,"inactive_pgs_ratio":0.051546391099691391,"write_bytes_sec":2143,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":7,"btime":"2024-09-10T08:28:38:573857+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4284}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-10T08:28:12.655958+0000","services":{}},"progress_events":{}} 2024-09-10T08:28:40.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.550+0000 7f0d6a2ba640 1 -- 172.21.15.103:0/2028322221 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0d5006be60 msgr2=0x7f0d5006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:40.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.550+0000 7f0d6a2ba640 1 --2- 172.21.15.103:0/2028322221 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0d5006be60 0x7f0d5006e320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0d54034000 tx=0x7f0d5402e000 comp rx=0 tx=0).stop 2024-09-10T08:28:40.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.550+0000 7f0d6a2ba640 1 -- 172.21.15.103:0/2028322221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d641505f0 msgr2=0x7f0d64148230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:40.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.550+0000 7f0d6a2ba640 1 --2- 172.21.15.103:0/2028322221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d641505f0 0x7f0d64148230 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800c820 tx=0x7f0d5800cce0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.550+0000 7f0d6a2ba640 1 -- 172.21.15.103:0/2028322221 shutdown_connections 2024-09-10T08:28:40.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.550+0000 7f0d6a2ba640 1 --2- 172.21.15.103:0/2028322221 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0d5006be60 0x7f0d5006e320 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.550+0000 7f0d6a2ba640 1 --2- 172.21.15.103:0/2028322221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d64149cc0 0x7f0d6414a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.550+0000 7f0d6a2ba640 1 --2- 172.21.15.103:0/2028322221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d641505f0 0x7f0d64148230 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.550+0000 7f0d6a2ba640 1 --2- 172.21.15.103:0/2028322221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d640c2980 0x7f0d64147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.550+0000 7f0d6a2ba640 1 -- 172.21.15.103:0/2028322221 >> 172.21.15.103:0/2028322221 conn(0x7f0d640c7a40 msgr2=0x7f0d64156470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:40.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.550+0000 7f0d6a2ba640 1 -- 172.21.15.103:0/2028322221 shutdown_connections 2024-09-10T08:28:40.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.550+0000 7f0d6a2ba640 1 -- 172.21.15.103:0/2028322221 wait complete. 2024-09-10T08:28:40.561 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T08:28:40.561 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:28:40.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.660+0000 7f60be1b7640 1 Processor -- start 2024-09-10T08:28:40.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.660+0000 7f60be1b7640 1 -- start start 2024-09-10T08:28:40.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.661+0000 7f60be1b7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f60b81598c0 0x7f60b8159d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:40.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.661+0000 7f60be1b7640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60b80c6b20 con 0x7f60b8153de0 2024-09-10T08:28:40.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.661+0000 7f60be1b7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60b80c6e00 con 0x7f60b806bbe0 2024-09-10T08:28:40.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.661+0000 7f60be1b7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f60b80c9480 con 0x7f60b81598c0 2024-09-10T08:28:40.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.661+0000 7f60b77fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f60b8153de0 0x7f60b80ca640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51218/0 (socket says 172.21.15.103:51218) 2024-09-10T08:28:40.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.661+0000 7f60b77fe640 1 -- 172.21.15.103:0/1433405573 learned_addr learned my addr 172.21.15.103:0/1433405573 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:40.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.661+0000 7f60b67fc640 1 -- 172.21.15.103:0/1433405573 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2253272915 0 0) 0x7f60b80c6b20 con 0x7f60b8153de0 2024-09-10T08:28:40.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.661+0000 7f60b7fff640 1 --2- 172.21.15.103:0/1433405573 >> v2:172.21.15.154:3300/0 conn(0x7f60b81598c0 0x7f60b8159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:40.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.661+0000 7f60b67fc640 1 -- 172.21.15.103:0/1433405573 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60a0003520 con 0x7f60b8153de0 2024-09-10T08:28:40.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.661+0000 7f60b67fc640 1 -- 172.21.15.103:0/1433405573 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2551459679 0 0) 0x7f60a0003520 con 0x7f60b8153de0 2024-09-10T08:28:40.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.661+0000 7f60b67fc640 1 -- 172.21.15.103:0/1433405573 >> v2:172.21.15.154:3300/0 conn(0x7f60b81598c0 msgr2=0x7f60b8159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:40.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.661+0000 7f60b67fc640 1 --2- 172.21.15.103:0/1433405573 >> v2:172.21.15.154:3300/0 conn(0x7f60b81598c0 0x7f60b8159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.661+0000 7f60b67fc640 1 -- 172.21.15.103:0/1433405573 >> v1:172.21.15.154:6789/0 conn(0x7f60b806bbe0 legacy=0x7f60b806c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:40.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.661+0000 7f60b67fc640 1 -- 172.21.15.103:0/1433405573 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b80c70e0 con 0x7f60b8153de0 2024-09-10T08:28:40.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.661+0000 7f60b67fc640 1 -- 172.21.15.103:0/1433405573 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f60a8001670 con 0x7f60b8153de0 2024-09-10T08:28:40.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.661+0000 7f60b67fc640 1 -- 172.21.15.103:0/1433405573 >> v1:172.21.15.103:6789/0 conn(0x7f60b8153de0 legacy=0x7f60b80ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:40.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.661+0000 7f60b67fc640 1 --2- 172.21.15.103:0/1433405573 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a00039b0 0x7f60a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:40.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.661+0000 7f60b67fc640 1 --2- 172.21.15.103:0/1433405573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60a0004800 0x7f60a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:40.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.661+0000 7f60b67fc640 1 --2- 172.21.15.103:0/1433405573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60a00051c0 0x7f60a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:40.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.661+0000 7f60b67fc640 1 -- 172.21.15.103:0/1433405573 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f60b80c9480 con 0x7f60a00039b0 2024-09-10T08:28:40.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.661+0000 7f60b67fc640 1 -- 172.21.15.103:0/1433405573 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f60a000c060 con 0x7f60a0004800 2024-09-10T08:28:40.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.661+0000 7f60b67fc640 1 -- 172.21.15.103:0/1433405573 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f60a000c260 con 0x7f60a00051c0 2024-09-10T08:28:40.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.662+0000 7f60b77fe640 1 --2- 172.21.15.103:0/1433405573 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a00039b0 0x7f60a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:40.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.662+0000 7f60b6ffd640 1 --2- 172.21.15.103:0/1433405573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60a0004800 0x7f60a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:40.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.662+0000 7f60b7fff640 1 --2- 172.21.15.103:0/1433405573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60a00051c0 0x7f60a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:40.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.662+0000 7f60b77fe640 1 -- 172.21.15.103:0/1433405573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60a00051c0 msgr2=0x7f60a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:40.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.662+0000 7f60b77fe640 1 --2- 172.21.15.103:0/1433405573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60a00051c0 0x7f60a000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.662+0000 7f60b77fe640 1 -- 172.21.15.103:0/1433405573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60a0004800 msgr2=0x7f60a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:40.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.662+0000 7f60b77fe640 1 --2- 172.21.15.103:0/1433405573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60a0004800 0x7f60a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.662+0000 7f60b77fe640 1 -- 172.21.15.103:0/1433405573 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a0003520 con 0x7f60a00039b0 2024-09-10T08:28:40.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.662+0000 7f60b7fff640 1 -- 172.21.15.103:0/1433405573 reap_dead start 2024-09-10T08:28:40.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.662+0000 7f60b77fe640 1 --2- 172.21.15.103:0/1433405573 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a00039b0 0x7f60a0003dd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f60a800c240 tx=0x7f60a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51dd2138d1ed200c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:40.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.663+0000 7f60b67fc640 1 -- 172.21.15.103:0/1433405573 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a8007d10 con 0x7f60a00039b0 2024-09-10T08:28:40.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.663+0000 7f60b67fc640 1 -- 172.21.15.103:0/1433405573 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60a8005ad0 con 0x7f60a00039b0 2024-09-10T08:28:40.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.663+0000 7f60b67fc640 1 -- 172.21.15.103:0/1433405573 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a8007070 con 0x7f60a00039b0 2024-09-10T08:28:40.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.663+0000 7f60be1b7640 1 -- 172.21.15.103:0/1433405573 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a00039b0 msgr2=0x7f60a0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:40.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.663+0000 7f60be1b7640 1 --2- 172.21.15.103:0/1433405573 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a00039b0 0x7f60a0003dd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f60a800c240 tx=0x7f60a0005830 comp rx=0 tx=0).stop 2024-09-10T08:28:40.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.663+0000 7f60be1b7640 1 -- 172.21.15.103:0/1433405573 shutdown_connections 2024-09-10T08:28:40.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.663+0000 7f60be1b7640 1 --2- 172.21.15.103:0/1433405573 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60a00039b0 0x7f60a0003dd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.663+0000 7f60be1b7640 1 -- 172.21.15.103:0/1433405573 >> 172.21.15.103:0/1433405573 conn(0x7f60b80c8800 msgr2=0x7f60b80c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:40.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.663+0000 7f60be1b7640 1 -- 172.21.15.103:0/1433405573 shutdown_connections 2024-09-10T08:28:40.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.663+0000 7f60be1b7640 1 -- 172.21.15.103:0/1433405573 wait complete. 2024-09-10T08:28:40.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.664+0000 7f60be1b7640 1 Processor -- start 2024-09-10T08:28:40.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.664+0000 7f60be1b7640 1 -- start start 2024-09-10T08:28:40.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.665+0000 7f60be1b7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60a00039b0 0x7f60b8158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:40.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.665+0000 7f60be1b7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60b80af150 0x7f60b814c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:40.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.665+0000 7f60be1b7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60b80af5d0 0x7f60b814cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:40.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.665+0000 7f60be1b7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f60b80ca640 con 0x7f60b80af5d0 2024-09-10T08:28:40.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.665+0000 7f60be1b7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f60b80cb620 con 0x7f60b80af150 2024-09-10T08:28:40.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.665+0000 7f60be1b7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f60b80ca7c0 con 0x7f60a00039b0 2024-09-10T08:28:40.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.665+0000 7f60b7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60b80af5d0 0x7f60b814cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:40.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.665+0000 7f60b7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60b80af5d0 0x7f60b814cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57588/0 (socket says 172.21.15.103:57588) 2024-09-10T08:28:40.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.665+0000 7f60b7fff640 1 -- 172.21.15.103:0/2195529991 learned_addr learned my addr 172.21.15.103:0/2195529991 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:40.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.665+0000 7f60b77fe640 1 --2- 172.21.15.103:0/2195529991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60a00039b0 0x7f60b8158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:40.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.665+0000 7f60b6ffd640 1 --2- 172.21.15.103:0/2195529991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60b80af150 0x7f60b814c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:40.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.665+0000 7f60b7fff640 1 -- 172.21.15.103:0/2195529991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60a00039b0 msgr2=0x7f60b8158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:40.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.665+0000 7f60b7fff640 1 --2- 172.21.15.103:0/2195529991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60a00039b0 0x7f60b8158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.665+0000 7f60b7fff640 1 -- 172.21.15.103:0/2195529991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60b80af150 msgr2=0x7f60b814c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:40.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.665+0000 7f60b7fff640 1 --2- 172.21.15.103:0/2195529991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60b80af150 0x7f60b814c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.665+0000 7f60b7fff640 1 -- 172.21.15.103:0/2195529991 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b81ef3f0 con 0x7f60b80af5d0 2024-09-10T08:28:40.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.665+0000 7f60b6ffd640 1 --2- 172.21.15.103:0/2195529991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60b80af150 0x7f60b814c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:40.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.666+0000 7f60b7fff640 1 --2- 172.21.15.103:0/2195529991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60b80af5d0 0x7f60b814cda0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f60b8074870 tx=0x7f60b000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:40.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.666+0000 7f609ffff640 1 -- 172.21.15.103:0/2195529991 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b000fc80 con 0x7f60b80af5d0 2024-09-10T08:28:40.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.666+0000 7f609ffff640 1 -- 172.21.15.103:0/2195529991 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60b000fe20 con 0x7f60b80af5d0 2024-09-10T08:28:40.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.666+0000 7f60be1b7640 1 -- 172.21.15.103:0/2195529991 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b81ef6d0 con 0x7f60b80af5d0 2024-09-10T08:28:40.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.666+0000 7f609ffff640 1 -- 172.21.15.103:0/2195529991 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b0015670 con 0x7f60b80af5d0 2024-09-10T08:28:40.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.666+0000 7f60be1b7640 1 -- 172.21.15.103:0/2195529991 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b81efc90 con 0x7f60b80af5d0 2024-09-10T08:28:40.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.667+0000 7f60be1b7640 1 -- 172.21.15.103:0/2195529991 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60b80caac0 con 0x7f60b80af5d0 2024-09-10T08:28:40.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.667+0000 7f609ffff640 1 -- 172.21.15.103:0/2195529991 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f60b0015810 con 0x7f60b80af5d0 2024-09-10T08:28:40.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.668+0000 7f609ffff640 1 --2- 172.21.15.103:0/2195529991 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f60a406be30 0x7f60a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:40.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.668+0000 7f609ffff640 1 -- 172.21.15.103:0/2195529991 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f60b008ba90 con 0x7f60b80af5d0 2024-09-10T08:28:40.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.668+0000 7f60b77fe640 1 --2- 172.21.15.103:0/2195529991 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f60a406be30 0x7f60a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:40.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.668+0000 7f60b77fe640 1 --2- 172.21.15.103:0/2195529991 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f60a406be30 0x7f60a406e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f60a8032000 tx=0x7f60a802d000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:40.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.672+0000 7f609ffff640 1 -- 172.21.15.103:0/2195529991 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f60b0019030 con 0x7f60b80af5d0 2024-09-10T08:28:40.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.835+0000 7f60be1b7640 1 -- 172.21.15.103:0/2195529991 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f60b814f6d0 con 0x7f60a406be30 2024-09-10T08:28:40.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.841+0000 7f609ffff640 1 -- 172.21.15.103:0/2195529991 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251887 (secure 0 0 0) 0x7f60b814f6d0 con 0x7f60a406be30 2024-09-10T08:28:40.844 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:40.846 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T08:28:40.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.845+0000 7f60be1b7640 1 -- 172.21.15.103:0/2195529991 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f60a406be30 msgr2=0x7f60a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:40.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.845+0000 7f60be1b7640 1 --2- 172.21.15.103:0/2195529991 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f60a406be30 0x7f60a406e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f60a8032000 tx=0x7f60a802d000 comp rx=0 tx=0).stop 2024-09-10T08:28:40.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.845+0000 7f60be1b7640 1 -- 172.21.15.103:0/2195529991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60b80af5d0 msgr2=0x7f60b814cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:40.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.845+0000 7f60be1b7640 1 --2- 172.21.15.103:0/2195529991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60b80af5d0 0x7f60b814cda0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f60b8074870 tx=0x7f60b000f1b0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.845+0000 7f60be1b7640 1 -- 172.21.15.103:0/2195529991 shutdown_connections 2024-09-10T08:28:40.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.845+0000 7f60be1b7640 1 --2- 172.21.15.103:0/2195529991 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f60a406be30 0x7f60a406e2f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.845+0000 7f60be1b7640 1 --2- 172.21.15.103:0/2195529991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60b80af5d0 0x7f60b814cda0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.845+0000 7f60be1b7640 1 --2- 172.21.15.103:0/2195529991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60b80af150 0x7f60b814c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.845+0000 7f60be1b7640 1 --2- 172.21.15.103:0/2195529991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60a00039b0 0x7f60b8158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:40.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.845+0000 7f60be1b7640 1 -- 172.21.15.103:0/2195529991 >> 172.21.15.103:0/2195529991 conn(0x7f60b80c8800 msgr2=0x7f60b80ac160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:40.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.845+0000 7f60be1b7640 1 -- 172.21.15.103:0/2195529991 shutdown_connections 2024-09-10T08:28:40.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:40.845+0000 7f60be1b7640 1 -- 172.21.15.103:0/2195529991 wait complete. 2024-09-10T08:28:40.856 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-10T08:28:40.794592+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218936,"kb_used_data":2684,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755784,"statfs":{"total":773094113280,"available":772869922816,"internally_reserved":0,"allocated":2748416,"data_stored":1693921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.251470"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.572264+0000","last_change":"2024-09-10T08:28:35.571065+0000","last_active":"2024-09-10T08:28:35.572264+0000","last_peered":"2024-09-10T08:28:35.572264+0000","last_clean":"2024-09-10T08:28:35.572264+0000","last_became_active":"2024-09-10T08:28:35.570749+0000","last_became_peered":"2024-09-10T08:28:35.570749+0000","last_unstale":"2024-09-10T08:28:35.572264+0000","last_undegraded":"2024-09-10T08:28:35.572264+0000","last_fullsized":"2024-09-10T08:28:35.572264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:45:43.769092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582300+0000","last_change":"2024-09-10T08:28:35.578197+0000","last_active":"2024-09-10T08:28:35.582300+0000","last_peered":"2024-09-10T08:28:35.582300+0000","last_clean":"2024-09-10T08:28:35.582300+0000","last_became_active":"2024-09-10T08:28:35.577852+0000","last_became_peered":"2024-09-10T08:28:35.577852+0000","last_unstale":"2024-09-10T08:28:35.582300+0000","last_undegraded":"2024-09-10T08:28:35.582300+0000","last_fullsized":"2024-09-10T08:28:35.582300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:42.678700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579443+0000","last_change":"2024-09-10T08:28:35.573918+0000","last_active":"2024-09-10T08:28:35.579443+0000","last_peered":"2024-09-10T08:28:35.579443+0000","last_clean":"2024-09-10T08:28:35.579443+0000","last_became_active":"2024-09-10T08:28:35.573646+0000","last_became_peered":"2024-09-10T08:28:35.573646+0000","last_unstale":"2024-09-10T08:28:35.579443+0000","last_undegraded":"2024-09-10T08:28:35.579443+0000","last_fullsized":"2024-09-10T08:28:35.579443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:33.686562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582117+0000","last_change":"2024-09-10T08:28:35.578961+0000","last_active":"2024-09-10T08:28:35.582117+0000","last_peered":"2024-09-10T08:28:35.582117+0000","last_clean":"2024-09-10T08:28:35.582117+0000","last_became_active":"2024-09-10T08:28:35.578680+0000","last_became_peered":"2024-09-10T08:28:35.578680+0000","last_unstale":"2024-09-10T08:28:35.582117+0000","last_undegraded":"2024-09-10T08:28:35.582117+0000","last_fullsized":"2024-09-10T08:28:35.582117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:59.172004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.574504+0000","last_change":"2024-09-10T08:28:35.572112+0000","last_active":"2024-09-10T08:28:35.574504+0000","last_peered":"2024-09-10T08:28:35.574504+0000","last_clean":"2024-09-10T08:28:35.574504+0000","last_became_active":"2024-09-10T08:28:35.571803+0000","last_became_peered":"2024-09-10T08:28:35.571803+0000","last_unstale":"2024-09-10T08:28:35.574504+0000","last_undegraded":"2024-09-10T08:28:35.574504+0000","last_fullsized":"2024-09-10T08:28:35.574504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:10.044940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582149+0000","last_change":"2024-09-10T08:28:35.578978+0000","last_active":"2024-09-10T08:28:35.582149+0000","last_peered":"2024-09-10T08:28:35.582149+0000","last_clean":"2024-09-10T08:28:35.582149+0000","last_became_active":"2024-09-10T08:28:35.578475+0000","last_became_peered":"2024-09-10T08:28:35.578475+0000","last_unstale":"2024-09-10T08:28:35.582149+0000","last_undegraded":"2024-09-10T08:28:35.582149+0000","last_fullsized":"2024-09-10T08:28:35.582149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:42.164241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.585683+0000","last_change":"2024-09-10T08:28:35.578664+0000","last_active":"2024-09-10T08:28:35.585683+0000","last_peered":"2024-09-10T08:28:35.585683+0000","last_clean":"2024-09-10T08:28:35.585683+0000","last_became_active":"2024-09-10T08:28:35.578384+0000","last_became_peered":"2024-09-10T08:28:35.578384+0000","last_unstale":"2024-09-10T08:28:35.585683+0000","last_undegraded":"2024-09-10T08:28:35.585683+0000","last_fullsized":"2024-09-10T08:28:35.585683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:34.146373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582054+0000","last_change":"2024-09-10T08:28:35.575275+0000","last_active":"2024-09-10T08:28:35.582054+0000","last_peered":"2024-09-10T08:28:35.582054+0000","last_clean":"2024-09-10T08:28:35.582054+0000","last_became_active":"2024-09-10T08:28:35.575052+0000","last_became_peered":"2024-09-10T08:28:35.575052+0000","last_unstale":"2024-09-10T08:28:35.582054+0000","last_undegraded":"2024-09-10T08:28:35.582054+0000","last_fullsized":"2024-09-10T08:28:35.582054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:06.466029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.585429+0000","last_change":"2024-09-10T08:28:35.577345+0000","last_active":"2024-09-10T08:28:35.585429+0000","last_peered":"2024-09-10T08:28:35.585429+0000","last_clean":"2024-09-10T08:28:35.585429+0000","last_became_active":"2024-09-10T08:28:35.576191+0000","last_became_peered":"2024-09-10T08:28:35.576191+0000","last_unstale":"2024-09-10T08:28:35.585429+0000","last_undegraded":"2024-09-10T08:28:35.585429+0000","last_fullsized":"2024-09-10T08:28:35.585429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:24.323783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619553+0000","last_change":"2024-09-10T08:28:35.570619+0000","last_active":"2024-09-10T08:28:36.619553+0000","last_peered":"2024-09-10T08:28:36.619553+0000","last_clean":"2024-09-10T08:28:36.619553+0000","last_became_active":"2024-09-10T08:28:35.570351+0000","last_became_peered":"2024-09-10T08:28:35.570351+0000","last_unstale":"2024-09-10T08:28:36.619553+0000","last_undegraded":"2024-09-10T08:28:36.619553+0000","last_fullsized":"2024-09-10T08:28:36.619553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:35.161279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619511+0000","last_change":"2024-09-10T08:28:35.565023+0000","last_active":"2024-09-10T08:28:36.619511+0000","last_peered":"2024-09-10T08:28:36.619511+0000","last_clean":"2024-09-10T08:28:36.619511+0000","last_became_active":"2024-09-10T08:28:35.564747+0000","last_became_peered":"2024-09-10T08:28:35.564747+0000","last_unstale":"2024-09-10T08:28:36.619511+0000","last_undegraded":"2024-09-10T08:28:36.619511+0000","last_fullsized":"2024-09-10T08:28:36.619511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:32.419621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.573460+0000","last_change":"2024-09-10T08:28:35.566574+0000","last_active":"2024-09-10T08:28:35.573460+0000","last_peered":"2024-09-10T08:28:35.573460+0000","last_clean":"2024-09-10T08:28:35.573460+0000","last_became_active":"2024-09-10T08:28:35.566205+0000","last_became_peered":"2024-09-10T08:28:35.566205+0000","last_unstale":"2024-09-10T08:28:35.573460+0000","last_undegraded":"2024-09-10T08:28:35.573460+0000","last_fullsized":"2024-09-10T08:28:35.573460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:44.800134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582120+0000","last_change":"2024-09-10T08:28:35.573330+0000","last_active":"2024-09-10T08:28:35.582120+0000","last_peered":"2024-09-10T08:28:35.582120+0000","last_clean":"2024-09-10T08:28:35.582120+0000","last_became_active":"2024-09-10T08:28:35.572992+0000","last_became_peered":"2024-09-10T08:28:35.572992+0000","last_unstale":"2024-09-10T08:28:35.582120+0000","last_undegraded":"2024-09-10T08:28:35.582120+0000","last_fullsized":"2024-09-10T08:28:35.582120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:17.660618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579134+0000","last_change":"2024-09-10T08:28:35.574551+0000","last_active":"2024-09-10T08:28:35.579134+0000","last_peered":"2024-09-10T08:28:35.579134+0000","last_clean":"2024-09-10T08:28:35.579134+0000","last_became_active":"2024-09-10T08:28:35.574256+0000","last_became_peered":"2024-09-10T08:28:35.574256+0000","last_unstale":"2024-09-10T08:28:35.579134+0000","last_undegraded":"2024-09-10T08:28:35.579134+0000","last_fullsized":"2024-09-10T08:28:35.579134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:46.296836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.566154+0000","last_change":"2024-09-10T08:28:35.560693+0000","last_active":"2024-09-10T08:28:35.566154+0000","last_peered":"2024-09-10T08:28:35.566154+0000","last_clean":"2024-09-10T08:28:35.566154+0000","last_became_active":"2024-09-10T08:28:35.560409+0000","last_became_peered":"2024-09-10T08:28:35.560409+0000","last_unstale":"2024-09-10T08:28:35.566154+0000","last_undegraded":"2024-09-10T08:28:35.566154+0000","last_fullsized":"2024-09-10T08:28:35.566154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:17:35.028101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.573680+0000","last_change":"2024-09-10T08:28:35.570249+0000","last_active":"2024-09-10T08:28:35.573680+0000","last_peered":"2024-09-10T08:28:35.573680+0000","last_clean":"2024-09-10T08:28:35.573680+0000","last_became_active":"2024-09-10T08:28:35.569960+0000","last_became_peered":"2024-09-10T08:28:35.569960+0000","last_unstale":"2024-09-10T08:28:35.573680+0000","last_undegraded":"2024-09-10T08:28:35.573680+0000","last_fullsized":"2024-09-10T08:28:35.573680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:38.524087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.571052+0000","last_change":"2024-09-10T08:28:35.567296+0000","last_active":"2024-09-10T08:28:35.571052+0000","last_peered":"2024-09-10T08:28:35.571052+0000","last_clean":"2024-09-10T08:28:35.571052+0000","last_became_active":"2024-09-10T08:28:35.567074+0000","last_became_peered":"2024-09-10T08:28:35.567074+0000","last_unstale":"2024-09-10T08:28:35.571052+0000","last_undegraded":"2024-09-10T08:28:35.571052+0000","last_fullsized":"2024-09-10T08:28:35.571052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:05.005278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619264+0000","last_change":"2024-09-10T08:28:35.574438+0000","last_active":"2024-09-10T08:28:36.619264+0000","last_peered":"2024-09-10T08:28:36.619264+0000","last_clean":"2024-09-10T08:28:36.619264+0000","last_became_active":"2024-09-10T08:28:35.574175+0000","last_became_peered":"2024-09-10T08:28:35.574175+0000","last_unstale":"2024-09-10T08:28:36.619264+0000","last_undegraded":"2024-09-10T08:28:36.619264+0000","last_fullsized":"2024-09-10T08:28:36.619264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:55.808543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.574680+0000","last_change":"2024-09-10T08:28:35.572709+0000","last_active":"2024-09-10T08:28:35.574680+0000","last_peered":"2024-09-10T08:28:35.574680+0000","last_clean":"2024-09-10T08:28:35.574680+0000","last_became_active":"2024-09-10T08:28:35.572392+0000","last_became_peered":"2024-09-10T08:28:35.572392+0000","last_unstale":"2024-09-10T08:28:35.574680+0000","last_undegraded":"2024-09-10T08:28:35.574680+0000","last_fullsized":"2024-09-10T08:28:35.574680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:58.255939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619373+0000","last_change":"2024-09-10T08:28:35.574499+0000","last_active":"2024-09-10T08:28:36.619373+0000","last_peered":"2024-09-10T08:28:36.619373+0000","last_clean":"2024-09-10T08:28:36.619373+0000","last_became_active":"2024-09-10T08:28:35.574249+0000","last_became_peered":"2024-09-10T08:28:35.574249+0000","last_unstale":"2024-09-10T08:28:36.619373+0000","last_undegraded":"2024-09-10T08:28:36.619373+0000","last_fullsized":"2024-09-10T08:28:36.619373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:55.952307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579258+0000","last_change":"2024-09-10T08:28:35.575802+0000","last_active":"2024-09-10T08:28:35.579258+0000","last_peered":"2024-09-10T08:28:35.579258+0000","last_clean":"2024-09-10T08:28:35.579258+0000","last_became_active":"2024-09-10T08:28:35.575388+0000","last_became_peered":"2024-09-10T08:28:35.575388+0000","last_unstale":"2024-09-10T08:28:35.579258+0000","last_undegraded":"2024-09-10T08:28:35.579258+0000","last_fullsized":"2024-09-10T08:28:35.579258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:59.338559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.571167+0000","last_change":"2024-09-10T08:28:35.568044+0000","last_active":"2024-09-10T08:28:35.571167+0000","last_peered":"2024-09-10T08:28:35.571167+0000","last_clean":"2024-09-10T08:28:35.571167+0000","last_became_active":"2024-09-10T08:28:35.567744+0000","last_became_peered":"2024-09-10T08:28:35.567744+0000","last_unstale":"2024-09-10T08:28:35.571167+0000","last_undegraded":"2024-09-10T08:28:35.571167+0000","last_fullsized":"2024-09-10T08:28:35.571167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:09:31.071067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581919+0000","last_change":"2024-09-10T08:28:35.571566+0000","last_active":"2024-09-10T08:28:35.581919+0000","last_peered":"2024-09-10T08:28:35.581919+0000","last_clean":"2024-09-10T08:28:35.581919+0000","last_became_active":"2024-09-10T08:28:35.571285+0000","last_became_peered":"2024-09-10T08:28:35.571285+0000","last_unstale":"2024-09-10T08:28:35.581919+0000","last_undegraded":"2024-09-10T08:28:35.581919+0000","last_fullsized":"2024-09-10T08:28:35.581919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:32.338136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582042+0000","last_change":"2024-09-10T08:28:35.578285+0000","last_active":"2024-09-10T08:28:35.582042+0000","last_peered":"2024-09-10T08:28:35.582042+0000","last_clean":"2024-09-10T08:28:35.582042+0000","last_became_active":"2024-09-10T08:28:35.576805+0000","last_became_peered":"2024-09-10T08:28:35.576805+0000","last_unstale":"2024-09-10T08:28:35.582042+0000","last_undegraded":"2024-09-10T08:28:35.582042+0000","last_fullsized":"2024-09-10T08:28:35.582042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:36.953572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582073+0000","last_change":"2024-09-10T08:28:35.575902+0000","last_active":"2024-09-10T08:28:35.582073+0000","last_peered":"2024-09-10T08:28:35.582073+0000","last_clean":"2024-09-10T08:28:35.582073+0000","last_became_active":"2024-09-10T08:28:35.575614+0000","last_became_peered":"2024-09-10T08:28:35.575614+0000","last_unstale":"2024-09-10T08:28:35.582073+0000","last_undegraded":"2024-09-10T08:28:35.582073+0000","last_fullsized":"2024-09-10T08:28:35.582073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:47.654980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619695+0000","last_change":"2024-09-10T08:28:35.573217+0000","last_active":"2024-09-10T08:28:36.619695+0000","last_peered":"2024-09-10T08:28:36.619695+0000","last_clean":"2024-09-10T08:28:36.619695+0000","last_became_active":"2024-09-10T08:28:35.572955+0000","last_became_peered":"2024-09-10T08:28:35.572955+0000","last_unstale":"2024-09-10T08:28:36.619695+0000","last_undegraded":"2024-09-10T08:28:36.619695+0000","last_fullsized":"2024-09-10T08:28:36.619695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:24.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.575566+0000","last_change":"2024-09-10T08:28:35.572550+0000","last_active":"2024-09-10T08:28:35.575566+0000","last_peered":"2024-09-10T08:28:35.575566+0000","last_clean":"2024-09-10T08:28:35.575566+0000","last_became_active":"2024-09-10T08:28:35.572184+0000","last_became_peered":"2024-09-10T08:28:35.572184+0000","last_unstale":"2024-09-10T08:28:35.575566+0000","last_undegraded":"2024-09-10T08:28:35.575566+0000","last_fullsized":"2024-09-10T08:28:35.575566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:29.422204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582039+0000","last_change":"2024-09-10T08:28:35.574676+0000","last_active":"2024-09-10T08:28:35.582039+0000","last_peered":"2024-09-10T08:28:35.582039+0000","last_clean":"2024-09-10T08:28:35.582039+0000","last_became_active":"2024-09-10T08:28:35.574437+0000","last_became_peered":"2024-09-10T08:28:35.574437+0000","last_unstale":"2024-09-10T08:28:35.582039+0000","last_undegraded":"2024-09-10T08:28:35.582039+0000","last_fullsized":"2024-09-10T08:28:35.582039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:31.398284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582245+0000","last_change":"2024-09-10T08:28:35.577852+0000","last_active":"2024-09-10T08:28:35.582245+0000","last_peered":"2024-09-10T08:28:35.582245+0000","last_clean":"2024-09-10T08:28:35.582245+0000","last_became_active":"2024-09-10T08:28:35.577571+0000","last_became_peered":"2024-09-10T08:28:35.577571+0000","last_unstale":"2024-09-10T08:28:35.582245+0000","last_undegraded":"2024-09-10T08:28:35.582245+0000","last_fullsized":"2024-09-10T08:28:35.582245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:07:32.121601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582131+0000","last_change":"2024-09-10T08:28:35.578735+0000","last_active":"2024-09-10T08:28:35.582131+0000","last_peered":"2024-09-10T08:28:35.582131+0000","last_clean":"2024-09-10T08:28:35.582131+0000","last_became_active":"2024-09-10T08:28:35.577995+0000","last_became_peered":"2024-09-10T08:28:35.577995+0000","last_unstale":"2024-09-10T08:28:35.582131+0000","last_undegraded":"2024-09-10T08:28:35.582131+0000","last_fullsized":"2024-09-10T08:28:35.582131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:32.178282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620517+0000","last_change":"2024-09-10T08:28:35.566780+0000","last_active":"2024-09-10T08:28:36.620517+0000","last_peered":"2024-09-10T08:28:36.620517+0000","last_clean":"2024-09-10T08:28:36.620517+0000","last_became_active":"2024-09-10T08:28:35.566529+0000","last_became_peered":"2024-09-10T08:28:35.566529+0000","last_unstale":"2024-09-10T08:28:36.620517+0000","last_undegraded":"2024-09-10T08:28:36.620517+0000","last_fullsized":"2024-09-10T08:28:36.620517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:09.481166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619112+0000","last_change":"2024-09-10T08:28:35.579106+0000","last_active":"2024-09-10T08:28:36.619112+0000","last_peered":"2024-09-10T08:28:36.619112+0000","last_clean":"2024-09-10T08:28:36.619112+0000","last_became_active":"2024-09-10T08:28:35.578631+0000","last_became_peered":"2024-09-10T08:28:35.578631+0000","last_unstale":"2024-09-10T08:28:36.619112+0000","last_undegraded":"2024-09-10T08:28:36.619112+0000","last_fullsized":"2024-09-10T08:28:36.619112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:31.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.560246+0000","last_change":"2024-09-10T08:28:35.559371+0000","last_active":"2024-09-10T08:28:35.560246+0000","last_peered":"2024-09-10T08:28:35.560246+0000","last_clean":"2024-09-10T08:28:35.560246+0000","last_became_active":"2024-09-10T08:28:35.559145+0000","last_became_peered":"2024-09-10T08:28:35.559145+0000","last_unstale":"2024-09-10T08:28:35.560246+0000","last_undegraded":"2024-09-10T08:28:35.560246+0000","last_fullsized":"2024-09-10T08:28:35.560246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:34:56.302624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582149+0000","last_change":"2024-09-10T08:28:34.566606+0000","last_active":"2024-09-10T08:28:35.582149+0000","last_peered":"2024-09-10T08:28:35.582149+0000","last_clean":"2024-09-10T08:28:35.582149+0000","last_became_active":"2024-09-10T08:28:34.566388+0000","last_became_peered":"2024-09-10T08:28:34.566388+0000","last_unstale":"2024-09-10T08:28:35.582149+0000","last_undegraded":"2024-09-10T08:28:35.582149+0000","last_fullsized":"2024-09-10T08:28:35.582149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:33.528801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582227+0000","last_change":"2024-09-10T08:28:35.576406+0000","last_active":"2024-09-10T08:28:35.582227+0000","last_peered":"2024-09-10T08:28:35.582227+0000","last_clean":"2024-09-10T08:28:35.582227+0000","last_became_active":"2024-09-10T08:28:35.576145+0000","last_became_peered":"2024-09-10T08:28:35.576145+0000","last_unstale":"2024-09-10T08:28:35.582227+0000","last_undegraded":"2024-09-10T08:28:35.582227+0000","last_fullsized":"2024-09-10T08:28:35.582227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:55.026157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619146+0000","last_change":"2024-09-10T08:28:34.561906+0000","last_active":"2024-09-10T08:28:36.619146+0000","last_peered":"2024-09-10T08:28:36.619146+0000","last_clean":"2024-09-10T08:28:36.619146+0000","last_became_active":"2024-09-10T08:28:34.561613+0000","last_became_peered":"2024-09-10T08:28:34.561613+0000","last_unstale":"2024-09-10T08:28:36.619146+0000","last_undegraded":"2024-09-10T08:28:36.619146+0000","last_fullsized":"2024-09-10T08:28:36.619146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:56.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.568578+0000","last_change":"2024-09-10T08:28:34.564751+0000","last_active":"2024-09-10T08:28:35.568578+0000","last_peered":"2024-09-10T08:28:35.568578+0000","last_clean":"2024-09-10T08:28:35.568578+0000","last_became_active":"2024-09-10T08:28:34.564479+0000","last_became_peered":"2024-09-10T08:28:34.564479+0000","last_unstale":"2024-09-10T08:28:35.568578+0000","last_undegraded":"2024-09-10T08:28:35.568578+0000","last_fullsized":"2024-09-10T08:28:35.568578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:29.618224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.584085+0000","last_change":"2024-09-10T08:28:35.580244+0000","last_active":"2024-09-10T08:28:35.584085+0000","last_peered":"2024-09-10T08:28:35.584085+0000","last_clean":"2024-09-10T08:28:35.584085+0000","last_became_active":"2024-09-10T08:28:35.579975+0000","last_became_peered":"2024-09-10T08:28:35.579975+0000","last_unstale":"2024-09-10T08:28:35.584085+0000","last_undegraded":"2024-09-10T08:28:35.584085+0000","last_fullsized":"2024-09-10T08:28:35.584085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:07.055709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556929+0000","last_change":"2024-09-10T08:28:34.554346+0000","last_active":"2024-09-10T08:28:35.556929+0000","last_peered":"2024-09-10T08:28:35.556929+0000","last_clean":"2024-09-10T08:28:35.556929+0000","last_became_active":"2024-09-10T08:28:34.553933+0000","last_became_peered":"2024-09-10T08:28:34.553933+0000","last_unstale":"2024-09-10T08:28:35.556929+0000","last_undegraded":"2024-09-10T08:28:35.556929+0000","last_fullsized":"2024-09-10T08:28:35.556929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:07.639671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.576475+0000","last_change":"2024-09-10T08:28:35.572803+0000","last_active":"2024-09-10T08:28:35.576475+0000","last_peered":"2024-09-10T08:28:35.576475+0000","last_clean":"2024-09-10T08:28:35.576475+0000","last_became_active":"2024-09-10T08:28:35.572219+0000","last_became_peered":"2024-09-10T08:28:35.572219+0000","last_unstale":"2024-09-10T08:28:35.576475+0000","last_undegraded":"2024-09-10T08:28:35.576475+0000","last_fullsized":"2024-09-10T08:28:35.576475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:01:26.046238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619315+0000","last_change":"2024-09-10T08:28:34.562935+0000","last_active":"2024-09-10T08:28:36.619315+0000","last_peered":"2024-09-10T08:28:36.619315+0000","last_clean":"2024-09-10T08:28:36.619315+0000","last_became_active":"2024-09-10T08:28:34.562647+0000","last_became_peered":"2024-09-10T08:28:34.562647+0000","last_unstale":"2024-09-10T08:28:36.619315+0000","last_undegraded":"2024-09-10T08:28:36.619315+0000","last_fullsized":"2024-09-10T08:28:36.619315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:47.492281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.576172+0000","last_change":"2024-09-10T08:28:35.572944+0000","last_active":"2024-09-10T08:28:35.576172+0000","last_peered":"2024-09-10T08:28:35.576172+0000","last_clean":"2024-09-10T08:28:35.576172+0000","last_became_active":"2024-09-10T08:28:35.572620+0000","last_became_peered":"2024-09-10T08:28:35.572620+0000","last_unstale":"2024-09-10T08:28:35.576172+0000","last_undegraded":"2024-09-10T08:28:35.576172+0000","last_fullsized":"2024-09-10T08:28:35.576172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:59.209973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556683+0000","last_change":"2024-09-10T08:28:34.564571+0000","last_active":"2024-09-10T08:28:35.556683+0000","last_peered":"2024-09-10T08:28:35.556683+0000","last_clean":"2024-09-10T08:28:35.556683+0000","last_became_active":"2024-09-10T08:28:34.564189+0000","last_became_peered":"2024-09-10T08:28:34.564189+0000","last_unstale":"2024-09-10T08:28:35.556683+0000","last_undegraded":"2024-09-10T08:28:35.556683+0000","last_fullsized":"2024-09-10T08:28:35.556683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:46.055510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582203+0000","last_change":"2024-09-10T08:28:35.577913+0000","last_active":"2024-09-10T08:28:35.582203+0000","last_peered":"2024-09-10T08:28:35.582203+0000","last_clean":"2024-09-10T08:28:35.582203+0000","last_became_active":"2024-09-10T08:28:35.577255+0000","last_became_peered":"2024-09-10T08:28:35.577255+0000","last_unstale":"2024-09-10T08:28:35.582203+0000","last_undegraded":"2024-09-10T08:28:35.582203+0000","last_fullsized":"2024-09-10T08:28:35.582203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:17.573799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581974+0000","last_change":"2024-09-10T08:28:34.557352+0000","last_active":"2024-09-10T08:28:35.581974+0000","last_peered":"2024-09-10T08:28:35.581974+0000","last_clean":"2024-09-10T08:28:35.581974+0000","last_became_active":"2024-09-10T08:28:34.557076+0000","last_became_peered":"2024-09-10T08:28:34.557076+0000","last_unstale":"2024-09-10T08:28:35.581974+0000","last_undegraded":"2024-09-10T08:28:35.581974+0000","last_fullsized":"2024-09-10T08:28:35.581974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:04.957739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.575391+0000","last_change":"2024-09-10T08:28:35.571262+0000","last_active":"2024-09-10T08:28:35.575391+0000","last_peered":"2024-09-10T08:28:35.575391+0000","last_clean":"2024-09-10T08:28:35.575391+0000","last_became_active":"2024-09-10T08:28:35.570711+0000","last_became_peered":"2024-09-10T08:28:35.570711+0000","last_unstale":"2024-09-10T08:28:35.575391+0000","last_undegraded":"2024-09-10T08:28:35.575391+0000","last_fullsized":"2024-09-10T08:28:35.575391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:26.384552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619300+0000","last_change":"2024-09-10T08:28:34.559823+0000","last_active":"2024-09-10T08:28:36.619300+0000","last_peered":"2024-09-10T08:28:36.619300+0000","last_clean":"2024-09-10T08:28:36.619300+0000","last_became_active":"2024-09-10T08:28:34.559560+0000","last_became_peered":"2024-09-10T08:28:34.559560+0000","last_unstale":"2024-09-10T08:28:36.619300+0000","last_undegraded":"2024-09-10T08:28:36.619300+0000","last_fullsized":"2024-09-10T08:28:36.619300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:53.724382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.586558+0000","last_change":"2024-09-10T08:28:35.582473+0000","last_active":"2024-09-10T08:28:35.586558+0000","last_peered":"2024-09-10T08:28:35.586558+0000","last_clean":"2024-09-10T08:28:35.586558+0000","last_became_active":"2024-09-10T08:28:35.582205+0000","last_became_peered":"2024-09-10T08:28:35.582205+0000","last_unstale":"2024-09-10T08:28:35.586558+0000","last_undegraded":"2024-09-10T08:28:35.586558+0000","last_fullsized":"2024-09-10T08:28:35.586558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:51.531897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.583031+0000","last_change":"2024-09-10T08:28:34.553556+0000","last_active":"2024-09-10T08:28:35.583031+0000","last_peered":"2024-09-10T08:28:35.583031+0000","last_clean":"2024-09-10T08:28:35.583031+0000","last_became_active":"2024-09-10T08:28:34.553275+0000","last_became_peered":"2024-09-10T08:28:34.553275+0000","last_unstale":"2024-09-10T08:28:35.583031+0000","last_undegraded":"2024-09-10T08:28:35.583031+0000","last_fullsized":"2024-09-10T08:28:35.583031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:45.957635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579158+0000","last_change":"2024-09-10T08:28:35.574810+0000","last_active":"2024-09-10T08:28:35.579158+0000","last_peered":"2024-09-10T08:28:35.579158+0000","last_clean":"2024-09-10T08:28:35.579158+0000","last_became_active":"2024-09-10T08:28:35.574567+0000","last_became_peered":"2024-09-10T08:28:35.574567+0000","last_unstale":"2024-09-10T08:28:35.579158+0000","last_undegraded":"2024-09-10T08:28:35.579158+0000","last_fullsized":"2024-09-10T08:28:35.579158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:28.056169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556821+0000","last_change":"2024-09-10T08:28:34.560699+0000","last_active":"2024-09-10T08:28:35.556821+0000","last_peered":"2024-09-10T08:28:35.556821+0000","last_clean":"2024-09-10T08:28:35.556821+0000","last_became_active":"2024-09-10T08:28:34.560376+0000","last_became_peered":"2024-09-10T08:28:34.560376+0000","last_unstale":"2024-09-10T08:28:35.556821+0000","last_undegraded":"2024-09-10T08:28:35.556821+0000","last_fullsized":"2024-09-10T08:28:35.556821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:09.981216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.580029+0000","last_change":"2024-09-10T08:28:35.575788+0000","last_active":"2024-09-10T08:28:35.580029+0000","last_peered":"2024-09-10T08:28:35.580029+0000","last_clean":"2024-09-10T08:28:35.580029+0000","last_became_active":"2024-09-10T08:28:35.575333+0000","last_became_peered":"2024-09-10T08:28:35.575333+0000","last_unstale":"2024-09-10T08:28:35.580029+0000","last_undegraded":"2024-09-10T08:28:35.580029+0000","last_fullsized":"2024-09-10T08:28:35.580029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:17.994128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619034+0000","last_change":"2024-09-10T08:28:34.560444+0000","last_active":"2024-09-10T08:28:36.619034+0000","last_peered":"2024-09-10T08:28:36.619034+0000","last_clean":"2024-09-10T08:28:36.619034+0000","last_became_active":"2024-09-10T08:28:34.560188+0000","last_became_peered":"2024-09-10T08:28:34.560188+0000","last_unstale":"2024-09-10T08:28:36.619034+0000","last_undegraded":"2024-09-10T08:28:36.619034+0000","last_fullsized":"2024-09-10T08:28:36.619034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:15.727780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619112+0000","last_change":"2024-09-10T08:28:35.578892+0000","last_active":"2024-09-10T08:28:36.619112+0000","last_peered":"2024-09-10T08:28:36.619112+0000","last_clean":"2024-09-10T08:28:36.619112+0000","last_became_active":"2024-09-10T08:28:35.578299+0000","last_became_peered":"2024-09-10T08:28:35.578299+0000","last_unstale":"2024-09-10T08:28:36.619112+0000","last_undegraded":"2024-09-10T08:28:36.619112+0000","last_fullsized":"2024-09-10T08:28:36.619112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:27.485392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619641+0000","last_change":"2024-09-10T08:28:34.555542+0000","last_active":"2024-09-10T08:28:36.619641+0000","last_peered":"2024-09-10T08:28:36.619641+0000","last_clean":"2024-09-10T08:28:36.619641+0000","last_became_active":"2024-09-10T08:28:34.555179+0000","last_became_peered":"2024-09-10T08:28:34.555179+0000","last_unstale":"2024-09-10T08:28:36.619641+0000","last_undegraded":"2024-09-10T08:28:36.619641+0000","last_fullsized":"2024-09-10T08:28:36.619641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:53.313161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.577350+0000","last_change":"2024-09-10T08:28:35.575307+0000","last_active":"2024-09-10T08:28:35.577350+0000","last_peered":"2024-09-10T08:28:35.577350+0000","last_clean":"2024-09-10T08:28:35.577350+0000","last_became_active":"2024-09-10T08:28:35.575038+0000","last_became_peered":"2024-09-10T08:28:35.575038+0000","last_unstale":"2024-09-10T08:28:35.577350+0000","last_undegraded":"2024-09-10T08:28:35.577350+0000","last_fullsized":"2024-09-10T08:28:35.577350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:12.751231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.584686+0000","last_change":"2024-09-10T08:28:34.551102+0000","last_active":"2024-09-10T08:28:35.584686+0000","last_peered":"2024-09-10T08:28:35.584686+0000","last_clean":"2024-09-10T08:28:35.584686+0000","last_became_active":"2024-09-10T08:28:34.550773+0000","last_became_peered":"2024-09-10T08:28:34.550773+0000","last_unstale":"2024-09-10T08:28:35.584686+0000","last_undegraded":"2024-09-10T08:28:35.584686+0000","last_fullsized":"2024-09-10T08:28:35.584686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:35.393695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.585491+0000","last_change":"2024-09-10T08:28:35.577476+0000","last_active":"2024-09-10T08:28:35.585491+0000","last_peered":"2024-09-10T08:28:35.585491+0000","last_clean":"2024-09-10T08:28:35.585491+0000","last_became_active":"2024-09-10T08:28:35.576786+0000","last_became_peered":"2024-09-10T08:28:35.576786+0000","last_unstale":"2024-09-10T08:28:35.585491+0000","last_undegraded":"2024-09-10T08:28:35.585491+0000","last_fullsized":"2024-09-10T08:28:35.585491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:17.606334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619362+0000","last_change":"2024-09-10T08:28:34.560313+0000","last_active":"2024-09-10T08:28:36.619362+0000","last_peered":"2024-09-10T08:28:36.619362+0000","last_clean":"2024-09-10T08:28:36.619362+0000","last_became_active":"2024-09-10T08:28:34.560035+0000","last_became_peered":"2024-09-10T08:28:34.560035+0000","last_unstale":"2024-09-10T08:28:36.619362+0000","last_undegraded":"2024-09-10T08:28:36.619362+0000","last_fullsized":"2024-09-10T08:28:36.619362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:56.945537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.585563+0000","last_change":"2024-09-10T08:28:35.577577+0000","last_active":"2024-09-10T08:28:35.585563+0000","last_peered":"2024-09-10T08:28:35.585563+0000","last_clean":"2024-09-10T08:28:35.585563+0000","last_became_active":"2024-09-10T08:28:35.576686+0000","last_became_peered":"2024-09-10T08:28:35.576686+0000","last_unstale":"2024-09-10T08:28:35.585563+0000","last_undegraded":"2024-09-10T08:28:35.585563+0000","last_fullsized":"2024-09-10T08:28:35.585563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:51.251652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582053+0000","last_change":"2024-09-10T08:28:34.560694+0000","last_active":"2024-09-10T08:28:35.582053+0000","last_peered":"2024-09-10T08:28:35.582053+0000","last_clean":"2024-09-10T08:28:35.582053+0000","last_became_active":"2024-09-10T08:28:34.560429+0000","last_became_peered":"2024-09-10T08:28:34.560429+0000","last_unstale":"2024-09-10T08:28:35.582053+0000","last_undegraded":"2024-09-10T08:28:35.582053+0000","last_fullsized":"2024-09-10T08:28:35.582053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:54.514467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581989+0000","last_change":"2024-09-10T08:28:35.577124+0000","last_active":"2024-09-10T08:28:35.581989+0000","last_peered":"2024-09-10T08:28:35.581989+0000","last_clean":"2024-09-10T08:28:35.581989+0000","last_became_active":"2024-09-10T08:28:35.576655+0000","last_became_peered":"2024-09-10T08:28:35.576655+0000","last_unstale":"2024-09-10T08:28:35.581989+0000","last_undegraded":"2024-09-10T08:28:35.581989+0000","last_fullsized":"2024-09-10T08:28:35.581989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:57.339318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619122+0000","last_change":"2024-09-10T08:28:34.559911+0000","last_active":"2024-09-10T08:28:36.619122+0000","last_peered":"2024-09-10T08:28:36.619122+0000","last_clean":"2024-09-10T08:28:36.619122+0000","last_became_active":"2024-09-10T08:28:34.559635+0000","last_became_peered":"2024-09-10T08:28:34.559635+0000","last_unstale":"2024-09-10T08:28:36.619122+0000","last_undegraded":"2024-09-10T08:28:36.619122+0000","last_fullsized":"2024-09-10T08:28:36.619122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:40.892609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.577384+0000","last_change":"2024-09-10T08:28:35.574532+0000","last_active":"2024-09-10T08:28:35.577384+0000","last_peered":"2024-09-10T08:28:35.577384+0000","last_clean":"2024-09-10T08:28:35.577384+0000","last_became_active":"2024-09-10T08:28:35.574215+0000","last_became_peered":"2024-09-10T08:28:35.574215+0000","last_unstale":"2024-09-10T08:28:35.577384+0000","last_undegraded":"2024-09-10T08:28:35.577384+0000","last_fullsized":"2024-09-10T08:28:35.577384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:54.299622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.565625+0000","last_change":"2024-09-10T08:28:26.724394+0000","last_active":"2024-09-10T08:28:35.565625+0000","last_peered":"2024-09-10T08:28:35.565625+0000","last_clean":"2024-09-10T08:28:35.565625+0000","last_became_active":"2024-09-10T08:28:26.723452+0000","last_became_peered":"2024-09-10T08:28:26.723452+0000","last_unstale":"2024-09-10T08:28:35.565625+0000","last_undegraded":"2024-09-10T08:28:35.565625+0000","last_fullsized":"2024-09-10T08:28:35.565625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_clean_scrub_stamp":"2024-09-10T08:28:25.445753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:00.811505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556142+0000","last_change":"2024-09-10T08:28:34.555587+0000","last_active":"2024-09-10T08:28:35.556142+0000","last_peered":"2024-09-10T08:28:35.556142+0000","last_clean":"2024-09-10T08:28:35.556142+0000","last_became_active":"2024-09-10T08:28:34.555269+0000","last_became_peered":"2024-09-10T08:28:34.555269+0000","last_unstale":"2024-09-10T08:28:35.556142+0000","last_undegraded":"2024-09-10T08:28:35.556142+0000","last_fullsized":"2024-09-10T08:28:35.556142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:19.499870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582012+0000","last_change":"2024-09-10T08:28:35.572658+0000","last_active":"2024-09-10T08:28:35.582012+0000","last_peered":"2024-09-10T08:28:35.582012+0000","last_clean":"2024-09-10T08:28:35.582012+0000","last_became_active":"2024-09-10T08:28:35.571611+0000","last_became_peered":"2024-09-10T08:28:35.571611+0000","last_unstale":"2024-09-10T08:28:35.582012+0000","last_undegraded":"2024-09-10T08:28:35.582012+0000","last_fullsized":"2024-09-10T08:28:35.582012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:44.555736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.565556+0000","last_change":"2024-09-10T08:28:34.568477+0000","last_active":"2024-09-10T08:28:35.565556+0000","last_peered":"2024-09-10T08:28:35.565556+0000","last_clean":"2024-09-10T08:28:35.565556+0000","last_became_active":"2024-09-10T08:28:34.568249+0000","last_became_peered":"2024-09-10T08:28:34.568249+0000","last_unstale":"2024-09-10T08:28:35.565556+0000","last_undegraded":"2024-09-10T08:28:35.565556+0000","last_fullsized":"2024-09-10T08:28:35.565556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:08.640043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579232+0000","last_change":"2024-09-10T08:28:35.576360+0000","last_active":"2024-09-10T08:28:35.579232+0000","last_peered":"2024-09-10T08:28:35.579232+0000","last_clean":"2024-09-10T08:28:35.579232+0000","last_became_active":"2024-09-10T08:28:35.576096+0000","last_became_peered":"2024-09-10T08:28:35.576096+0000","last_unstale":"2024-09-10T08:28:35.579232+0000","last_undegraded":"2024-09-10T08:28:35.579232+0000","last_fullsized":"2024-09-10T08:28:35.579232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:51.274979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620584+0000","last_change":"2024-09-10T08:28:34.560745+0000","last_active":"2024-09-10T08:28:36.620584+0000","last_peered":"2024-09-10T08:28:36.620584+0000","last_clean":"2024-09-10T08:28:36.620584+0000","last_became_active":"2024-09-10T08:28:34.559911+0000","last_became_peered":"2024-09-10T08:28:34.559911+0000","last_unstale":"2024-09-10T08:28:36.620584+0000","last_undegraded":"2024-09-10T08:28:36.620584+0000","last_fullsized":"2024-09-10T08:28:36.620584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:00.234067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.572722+0000","last_change":"2024-09-10T08:28:35.566745+0000","last_active":"2024-09-10T08:28:35.572722+0000","last_peered":"2024-09-10T08:28:35.572722+0000","last_clean":"2024-09-10T08:28:35.572722+0000","last_became_active":"2024-09-10T08:28:35.566444+0000","last_became_peered":"2024-09-10T08:28:35.566444+0000","last_unstale":"2024-09-10T08:28:35.572722+0000","last_undegraded":"2024-09-10T08:28:35.572722+0000","last_fullsized":"2024-09-10T08:28:35.572722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:37.924675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.557028+0000","last_change":"2024-09-10T08:28:34.553983+0000","last_active":"2024-09-10T08:28:35.557028+0000","last_peered":"2024-09-10T08:28:35.557028+0000","last_clean":"2024-09-10T08:28:35.557028+0000","last_became_active":"2024-09-10T08:28:34.553693+0000","last_became_peered":"2024-09-10T08:28:34.553693+0000","last_unstale":"2024-09-10T08:28:35.557028+0000","last_undegraded":"2024-09-10T08:28:35.557028+0000","last_fullsized":"2024-09-10T08:28:35.557028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:40.001685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.580684+0000","last_change":"2024-09-10T08:28:35.577978+0000","last_active":"2024-09-10T08:28:35.580684+0000","last_peered":"2024-09-10T08:28:35.580684+0000","last_clean":"2024-09-10T08:28:35.580684+0000","last_became_active":"2024-09-10T08:28:35.577718+0000","last_became_peered":"2024-09-10T08:28:35.577718+0000","last_unstale":"2024-09-10T08:28:35.580684+0000","last_undegraded":"2024-09-10T08:28:35.580684+0000","last_fullsized":"2024-09-10T08:28:35.580684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:46.194153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.557039+0000","last_change":"2024-09-10T08:28:34.555212+0000","last_active":"2024-09-10T08:28:35.557039+0000","last_peered":"2024-09-10T08:28:35.557039+0000","last_clean":"2024-09-10T08:28:35.557039+0000","last_became_active":"2024-09-10T08:28:34.554922+0000","last_became_peered":"2024-09-10T08:28:34.554922+0000","last_unstale":"2024-09-10T08:28:35.557039+0000","last_undegraded":"2024-09-10T08:28:35.557039+0000","last_fullsized":"2024-09-10T08:28:35.557039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581944+0000","last_change":"2024-09-10T08:28:35.576280+0000","last_active":"2024-09-10T08:28:35.581944+0000","last_peered":"2024-09-10T08:28:35.581944+0000","last_clean":"2024-09-10T08:28:35.581944+0000","last_became_active":"2024-09-10T08:28:35.576002+0000","last_became_peered":"2024-09-10T08:28:35.576002+0000","last_unstale":"2024-09-10T08:28:35.581944+0000","last_undegraded":"2024-09-10T08:28:35.581944+0000","last_fullsized":"2024-09-10T08:28:35.581944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:47.191902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.565441+0000","last_change":"2024-09-10T08:28:34.571283+0000","last_active":"2024-09-10T08:28:35.565441+0000","last_peered":"2024-09-10T08:28:35.565441+0000","last_clean":"2024-09-10T08:28:35.565441+0000","last_became_active":"2024-09-10T08:28:34.570791+0000","last_became_peered":"2024-09-10T08:28:34.570791+0000","last_unstale":"2024-09-10T08:28:35.565441+0000","last_undegraded":"2024-09-10T08:28:35.565441+0000","last_fullsized":"2024-09-10T08:28:35.565441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:17.427597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.572702+0000","last_change":"2024-09-10T08:28:35.567481+0000","last_active":"2024-09-10T08:28:35.572702+0000","last_peered":"2024-09-10T08:28:35.572702+0000","last_clean":"2024-09-10T08:28:35.572702+0000","last_became_active":"2024-09-10T08:28:35.567167+0000","last_became_peered":"2024-09-10T08:28:35.567167+0000","last_unstale":"2024-09-10T08:28:35.572702+0000","last_undegraded":"2024-09-10T08:28:35.572702+0000","last_fullsized":"2024-09-10T08:28:35.572702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:45.440275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556778+0000","last_change":"2024-09-10T08:28:34.563451+0000","last_active":"2024-09-10T08:28:35.556778+0000","last_peered":"2024-09-10T08:28:35.556778+0000","last_clean":"2024-09-10T08:28:35.556778+0000","last_became_active":"2024-09-10T08:28:34.563259+0000","last_became_peered":"2024-09-10T08:28:34.563259+0000","last_unstale":"2024-09-10T08:28:35.556778+0000","last_undegraded":"2024-09-10T08:28:35.556778+0000","last_fullsized":"2024-09-10T08:28:35.556778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:44.899351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581971+0000","last_change":"2024-09-10T08:28:35.574107+0000","last_active":"2024-09-10T08:28:35.581971+0000","last_peered":"2024-09-10T08:28:35.581971+0000","last_clean":"2024-09-10T08:28:35.581971+0000","last_became_active":"2024-09-10T08:28:35.573851+0000","last_became_peered":"2024-09-10T08:28:35.573851+0000","last_unstale":"2024-09-10T08:28:35.581971+0000","last_undegraded":"2024-09-10T08:28:35.581971+0000","last_fullsized":"2024-09-10T08:28:35.581971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:24.848264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619376+0000","last_change":"2024-09-10T08:28:34.564865+0000","last_active":"2024-09-10T08:28:36.619376+0000","last_peered":"2024-09-10T08:28:36.619376+0000","last_clean":"2024-09-10T08:28:36.619376+0000","last_became_active":"2024-09-10T08:28:34.564549+0000","last_became_peered":"2024-09-10T08:28:34.564549+0000","last_unstale":"2024-09-10T08:28:36.619376+0000","last_undegraded":"2024-09-10T08:28:36.619376+0000","last_fullsized":"2024-09-10T08:28:36.619376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:05.523637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.579227+0000","last_change":"2024-09-10T08:28:35.575106+0000","last_active":"2024-09-10T08:28:35.579227+0000","last_peered":"2024-09-10T08:28:35.579227+0000","last_clean":"2024-09-10T08:28:35.579227+0000","last_became_active":"2024-09-10T08:28:35.574815+0000","last_became_peered":"2024-09-10T08:28:35.574815+0000","last_unstale":"2024-09-10T08:28:35.579227+0000","last_undegraded":"2024-09-10T08:28:35.579227+0000","last_fullsized":"2024-09-10T08:28:35.579227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:39.473943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.565374+0000","last_change":"2024-09-10T08:28:34.571069+0000","last_active":"2024-09-10T08:28:35.565374+0000","last_peered":"2024-09-10T08:28:35.565374+0000","last_clean":"2024-09-10T08:28:35.565374+0000","last_became_active":"2024-09-10T08:28:34.570766+0000","last_became_peered":"2024-09-10T08:28:34.570766+0000","last_unstale":"2024-09-10T08:28:35.565374+0000","last_undegraded":"2024-09-10T08:28:35.565374+0000","last_fullsized":"2024-09-10T08:28:35.565374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:47.458195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.574702+0000","last_change":"2024-09-10T08:28:35.569938+0000","last_active":"2024-09-10T08:28:35.574702+0000","last_peered":"2024-09-10T08:28:35.574702+0000","last_clean":"2024-09-10T08:28:35.574702+0000","last_became_active":"2024-09-10T08:28:35.569109+0000","last_became_peered":"2024-09-10T08:28:35.569109+0000","last_unstale":"2024-09-10T08:28:35.574702+0000","last_undegraded":"2024-09-10T08:28:35.574702+0000","last_fullsized":"2024-09-10T08:28:35.574702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:40.936585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.557127+0000","last_change":"2024-09-10T08:28:34.564813+0000","last_active":"2024-09-10T08:28:35.557127+0000","last_peered":"2024-09-10T08:28:35.557127+0000","last_clean":"2024-09-10T08:28:35.557127+0000","last_became_active":"2024-09-10T08:28:34.564557+0000","last_became_peered":"2024-09-10T08:28:34.564557+0000","last_unstale":"2024-09-10T08:28:35.557127+0000","last_undegraded":"2024-09-10T08:28:35.557127+0000","last_fullsized":"2024-09-10T08:28:35.557127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:48.356069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581850+0000","last_change":"2024-09-10T08:28:35.572363+0000","last_active":"2024-09-10T08:28:35.581850+0000","last_peered":"2024-09-10T08:28:35.581850+0000","last_clean":"2024-09-10T08:28:35.581850+0000","last_became_active":"2024-09-10T08:28:35.572108+0000","last_became_peered":"2024-09-10T08:28:35.572108+0000","last_unstale":"2024-09-10T08:28:35.581850+0000","last_undegraded":"2024-09-10T08:28:35.581850+0000","last_fullsized":"2024-09-10T08:28:35.581850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:47.800442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.556782+0000","last_change":"2024-09-10T08:28:34.561324+0000","last_active":"2024-09-10T08:28:35.556782+0000","last_peered":"2024-09-10T08:28:35.556782+0000","last_clean":"2024-09-10T08:28:35.556782+0000","last_became_active":"2024-09-10T08:28:34.560974+0000","last_became_peered":"2024-09-10T08:28:34.560974+0000","last_unstale":"2024-09-10T08:28:35.556782+0000","last_undegraded":"2024-09-10T08:28:35.556782+0000","last_fullsized":"2024-09-10T08:28:35.556782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:18.790965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.584262+0000","last_change":"2024-09-10T08:28:35.577024+0000","last_active":"2024-09-10T08:28:35.584262+0000","last_peered":"2024-09-10T08:28:35.584262+0000","last_clean":"2024-09-10T08:28:35.584262+0000","last_became_active":"2024-09-10T08:28:35.576771+0000","last_became_peered":"2024-09-10T08:28:35.576771+0000","last_unstale":"2024-09-10T08:28:35.584262+0000","last_undegraded":"2024-09-10T08:28:35.584262+0000","last_fullsized":"2024-09-10T08:28:35.584262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:42.944227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.586398+0000","last_change":"2024-09-10T08:28:34.569235+0000","last_active":"2024-09-10T08:28:35.586398+0000","last_peered":"2024-09-10T08:28:35.586398+0000","last_clean":"2024-09-10T08:28:35.586398+0000","last_became_active":"2024-09-10T08:28:34.568899+0000","last_became_peered":"2024-09-10T08:28:34.568899+0000","last_unstale":"2024-09-10T08:28:35.586398+0000","last_undegraded":"2024-09-10T08:28:35.586398+0000","last_fullsized":"2024-09-10T08:28:35.586398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:21.927656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619164+0000","last_change":"2024-09-10T08:28:35.572478+0000","last_active":"2024-09-10T08:28:36.619164+0000","last_peered":"2024-09-10T08:28:36.619164+0000","last_clean":"2024-09-10T08:28:36.619164+0000","last_became_active":"2024-09-10T08:28:35.572215+0000","last_became_peered":"2024-09-10T08:28:35.572215+0000","last_unstale":"2024-09-10T08:28:36.619164+0000","last_undegraded":"2024-09-10T08:28:36.619164+0000","last_fullsized":"2024-09-10T08:28:36.619164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:40.397318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.561221+0000","last_change":"2024-09-10T08:28:35.560380+0000","last_active":"2024-09-10T08:28:35.561221+0000","last_peered":"2024-09-10T08:28:35.561221+0000","last_clean":"2024-09-10T08:28:35.561221+0000","last_became_active":"2024-09-10T08:28:35.560095+0000","last_became_peered":"2024-09-10T08:28:35.560095+0000","last_unstale":"2024-09-10T08:28:35.561221+0000","last_undegraded":"2024-09-10T08:28:35.561221+0000","last_fullsized":"2024-09-10T08:28:35.561221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:10.493163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.586370+0000","last_change":"2024-09-10T08:28:34.566560+0000","last_active":"2024-09-10T08:28:35.586370+0000","last_peered":"2024-09-10T08:28:35.586370+0000","last_clean":"2024-09-10T08:28:35.586370+0000","last_became_active":"2024-09-10T08:28:34.566275+0000","last_became_peered":"2024-09-10T08:28:34.566275+0000","last_unstale":"2024-09-10T08:28:35.586370+0000","last_undegraded":"2024-09-10T08:28:35.586370+0000","last_fullsized":"2024-09-10T08:28:35.586370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:03.507683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.564414+0000","last_change":"2024-09-10T08:28:35.562132+0000","last_active":"2024-09-10T08:28:35.564414+0000","last_peered":"2024-09-10T08:28:35.564414+0000","last_clean":"2024-09-10T08:28:35.564414+0000","last_became_active":"2024-09-10T08:28:35.561842+0000","last_became_peered":"2024-09-10T08:28:35.561842+0000","last_unstale":"2024-09-10T08:28:35.564414+0000","last_undegraded":"2024-09-10T08:28:35.564414+0000","last_fullsized":"2024-09-10T08:28:35.564414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:55.020192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.586634+0000","last_change":"2024-09-10T08:28:34.571965+0000","last_active":"2024-09-10T08:28:35.586634+0000","last_peered":"2024-09-10T08:28:35.586634+0000","last_clean":"2024-09-10T08:28:35.586634+0000","last_became_active":"2024-09-10T08:28:34.571640+0000","last_became_peered":"2024-09-10T08:28:34.571640+0000","last_unstale":"2024-09-10T08:28:35.586634+0000","last_undegraded":"2024-09-10T08:28:35.586634+0000","last_fullsized":"2024-09-10T08:28:35.586634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:53.047030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.584568+0000","last_change":"2024-09-10T08:28:35.579033+0000","last_active":"2024-09-10T08:28:35.584568+0000","last_peered":"2024-09-10T08:28:35.584568+0000","last_clean":"2024-09-10T08:28:35.584568+0000","last_became_active":"2024-09-10T08:28:35.578333+0000","last_became_peered":"2024-09-10T08:28:35.578333+0000","last_unstale":"2024-09-10T08:28:35.584568+0000","last_undegraded":"2024-09-10T08:28:35.584568+0000","last_fullsized":"2024-09-10T08:28:35.584568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:33.115063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582973+0000","last_change":"2024-09-10T08:28:34.561691+0000","last_active":"2024-09-10T08:28:35.582973+0000","last_peered":"2024-09-10T08:28:35.582973+0000","last_clean":"2024-09-10T08:28:35.582973+0000","last_became_active":"2024-09-10T08:28:34.561410+0000","last_became_peered":"2024-09-10T08:28:34.561410+0000","last_unstale":"2024-09-10T08:28:35.582973+0000","last_undegraded":"2024-09-10T08:28:35.582973+0000","last_fullsized":"2024-09-10T08:28:35.582973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.629982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.582221+0000","last_change":"2024-09-10T08:28:35.575267+0000","last_active":"2024-09-10T08:28:35.582221+0000","last_peered":"2024-09-10T08:28:35.582221+0000","last_clean":"2024-09-10T08:28:35.582221+0000","last_became_active":"2024-09-10T08:28:35.575019+0000","last_became_peered":"2024-09-10T08:28:35.575019+0000","last_unstale":"2024-09-10T08:28:35.582221+0000","last_undegraded":"2024-09-10T08:28:35.582221+0000","last_fullsized":"2024-09-10T08:28:35.582221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:56.550243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:35.581879+0000","last_change":"2024-09-10T08:28:34.564816+0000","last_active":"2024-09-10T08:28:35.581879+0000","last_peered":"2024-09-10T08:28:35.581879+0000","last_clean":"2024-09-10T08:28:35.581879+0000","last_became_active":"2024-09-10T08:28:34.564545+0000","last_became_peered":"2024-09-10T08:28:34.564545+0000","last_unstale":"2024-09-10T08:28:35.581879+0000","last_undegraded":"2024-09-10T08:28:35.581879+0000","last_fullsized":"2024-09-10T08:28:35.581879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:34.365104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":650015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":59647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":59647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":68004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":59647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":650015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":72667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:28:41.311 INFO:tasks.ceph.mds.c.smithi103.stderr:2024-09-10T08:28:41.311+0000 7fb9f9e8a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:28:43.861 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:28:43.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.971+0000 7f9cde786640 1 Processor -- start 2024-09-10T08:28:43.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.971+0000 7f9cde786640 1 -- start start 2024-09-10T08:28:43.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.971+0000 7f9cde786640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cd806c650 0x7f9cd80c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:43.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.971+0000 7f9cde786640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9cd80ca1c0 0x7f9cd8160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:43.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.971+0000 7f9cde786640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd815a7c0 con 0x7f9cd8150480 2024-09-10T08:28:43.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.971+0000 7f9cde786640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f9cd806c240 con 0x7f9cd80ca1c0 2024-09-10T08:28:43.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.971+0000 7f9cde786640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd815a330 con 0x7f9cd806c650 2024-09-10T08:28:43.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.972+0000 7f9cdcd23640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9cd80ca1c0 0x7f9cd8160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:43.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.972+0000 7f9cdcd23640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9cd80ca1c0 0x7f9cd8160bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57594/0 (socket says 172.21.15.103:57594) 2024-09-10T08:28:43.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.972+0000 7f9cdcd23640 1 -- 172.21.15.103:0/2969884027 learned_addr learned my addr 172.21.15.103:0/2969884027 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:43.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.972+0000 7f9cd77fe640 1 --2- 172.21.15.103:0/2969884027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cd806c650 0x7f9cd80c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:43.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.972+0000 7f9cdcd23640 1 -- 172.21.15.103:0/2969884027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cd806c650 msgr2=0x7f9cd80c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:43.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.972+0000 7f9cdcd23640 1 --2- 172.21.15.103:0/2969884027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cd806c650 0x7f9cd80c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:43.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.972+0000 7f9cdcd23640 1 -- 172.21.15.103:0/2969884027 >> v1:172.21.15.154:6789/0 conn(0x7f9cd8150480 legacy=0x7f9cd80c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:43.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.972+0000 7f9cdcd23640 1 -- 172.21.15.103:0/2969884027 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd8159a00 con 0x7f9cd80ca1c0 2024-09-10T08:28:43.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.973+0000 7f9cdcd23640 1 --2- 172.21.15.103:0/2969884027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd80ca1c0 0x7f9cd8160bf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009e50 tx=0x7f9cd002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38ed9e7e0d02ef8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:43.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.973+0000 7f9cd6ffd640 1 -- 172.21.15.103:0/2969884027 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0036070 con 0x7f9cd80ca1c0 2024-09-10T08:28:43.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.973+0000 7f9cd6ffd640 1 -- 172.21.15.103:0/2969884027 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd0031600 con 0x7f9cd80ca1c0 2024-09-10T08:28:43.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.973+0000 7f9cd6ffd640 1 -- 172.21.15.103:0/2969884027 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd00319d0 con 0x7f9cd80ca1c0 2024-09-10T08:28:43.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.973+0000 7f9cde786640 1 -- 172.21.15.103:0/2969884027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd80ca1c0 msgr2=0x7f9cd8160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:43.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.973+0000 7f9cde786640 1 --2- 172.21.15.103:0/2969884027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd80ca1c0 0x7f9cd8160bf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009e50 tx=0x7f9cd002a6c0 comp rx=0 tx=0).stop 2024-09-10T08:28:43.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.973+0000 7f9cde786640 1 -- 172.21.15.103:0/2969884027 shutdown_connections 2024-09-10T08:28:43.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.973+0000 7f9cde786640 1 --2- 172.21.15.103:0/2969884027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd80ca1c0 0x7f9cd8160bf0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:43.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.973+0000 7f9cde786640 1 --2- 172.21.15.103:0/2969884027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cd806c650 0x7f9cd80c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:43.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.973+0000 7f9cde786640 1 -- 172.21.15.103:0/2969884027 >> 172.21.15.103:0/2969884027 conn(0x7f9cd8068030 msgr2=0x7f9cd8073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:43.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.973+0000 7f9cde786640 1 -- 172.21.15.103:0/2969884027 shutdown_connections 2024-09-10T08:28:43.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.973+0000 7f9cde786640 1 -- 172.21.15.103:0/2969884027 wait complete. 2024-09-10T08:28:43.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.974+0000 7f9cde786640 1 Processor -- start 2024-09-10T08:28:43.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.975+0000 7f9cde786640 1 -- start start 2024-09-10T08:28:43.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.975+0000 7f9cde786640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd806c650 0x7f9cd81ef220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:43.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.975+0000 7f9cde786640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd80ca1c0 0x7f9cd81e34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:43.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.975+0000 7f9cde786640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cd8150480 0x7f9cd81508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:43.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.975+0000 7f9cde786640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd80ca670 con 0x7f9cd80ca1c0 2024-09-10T08:28:43.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.975+0000 7f9cde786640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd8159fc0 con 0x7f9cd806c650 2024-09-10T08:28:43.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.975+0000 7f9cde786640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd806d270 con 0x7f9cd8150480 2024-09-10T08:28:43.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.976+0000 7f9cd77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd80ca1c0 0x7f9cd81e34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:43.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.976+0000 7f9cd77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd80ca1c0 0x7f9cd81e34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57596/0 (socket says 172.21.15.103:57596) 2024-09-10T08:28:43.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.976+0000 7f9cd77fe640 1 -- 172.21.15.103:0/2516090224 learned_addr learned my addr 172.21.15.103:0/2516090224 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:43.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.976+0000 7f9cdcd23640 1 --2- 172.21.15.103:0/2516090224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cd8150480 0x7f9cd81508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:43.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.976+0000 7f9cd7fff640 1 --2- 172.21.15.103:0/2516090224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd806c650 0x7f9cd81ef220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:43.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.976+0000 7f9cd77fe640 1 -- 172.21.15.103:0/2516090224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cd8150480 msgr2=0x7f9cd81508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:43.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.976+0000 7f9cd77fe640 1 --2- 172.21.15.103:0/2516090224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cd8150480 0x7f9cd81508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:43.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.976+0000 7f9cd77fe640 1 -- 172.21.15.103:0/2516090224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd806c650 msgr2=0x7f9cd81ef220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:43.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.976+0000 7f9cd77fe640 1 --2- 172.21.15.103:0/2516090224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd806c650 0x7f9cd81ef220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:43.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.976+0000 7f9cd77fe640 1 -- 172.21.15.103:0/2516090224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd814f760 con 0x7f9cd80ca1c0 2024-09-10T08:28:43.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.976+0000 7f9cd7fff640 1 --2- 172.21.15.103:0/2516090224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd806c650 0x7f9cd81ef220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:43.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.976+0000 7f9cd77fe640 1 --2- 172.21.15.103:0/2516090224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd80ca1c0 0x7f9cd81e34e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc00d5d0 tx=0x7f9ccc00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:43.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.976+0000 7f9cd4ff9640 1 -- 172.21.15.103:0/2516090224 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc004240 con 0x7f9cd80ca1c0 2024-09-10T08:28:43.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.976+0000 7f9cd4ff9640 1 -- 172.21.15.103:0/2516090224 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ccc0043e0 con 0x7f9cd80ca1c0 2024-09-10T08:28:43.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.976+0000 7f9cde786640 1 -- 172.21.15.103:0/2516090224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd80aecf0 con 0x7f9cd80ca1c0 2024-09-10T08:28:43.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.976+0000 7f9cd4ff9640 1 -- 172.21.15.103:0/2516090224 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc003830 con 0x7f9cd80ca1c0 2024-09-10T08:28:43.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.976+0000 7f9cde786640 1 -- 172.21.15.103:0/2516090224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd80cc4f0 con 0x7f9cd80ca1c0 2024-09-10T08:28:43.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.977+0000 7f9cde786640 1 -- 172.21.15.103:0/2516090224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cd80aeae0 con 0x7f9cd80ca1c0 2024-09-10T08:28:43.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.978+0000 7f9cd4ff9640 1 -- 172.21.15.103:0/2516090224 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ccc0039d0 con 0x7f9cd80ca1c0 2024-09-10T08:28:43.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.978+0000 7f9cd4ff9640 1 --2- 172.21.15.103:0/2516090224 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9cc406be30 0x7f9cc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:43.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.978+0000 7f9cd4ff9640 1 -- 172.21.15.103:0/2516090224 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f9ccc08b0d0 con 0x7f9cd80ca1c0 2024-09-10T08:28:43.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.978+0000 7f9cd7fff640 1 --2- 172.21.15.103:0/2516090224 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9cc406be30 0x7f9cc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:43.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.979+0000 7f9cd7fff640 1 --2- 172.21.15.103:0/2516090224 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9cc406be30 0x7f9cc406e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8003eb0 tx=0x7f9cc8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:43.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:43.983+0000 7f9cd4ff9640 1 -- 172.21.15.103:0/2516090224 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ccc0594d0 con 0x7f9cd80ca1c0 2024-09-10T08:28:44.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.145+0000 7f9cde786640 1 -- 172.21.15.103:0/2516090224 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9cd806c430 con 0x7f9cc406be30 2024-09-10T08:28:44.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.151+0000 7f9cd4ff9640 1 -- 172.21.15.103:0/2516090224 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251896 (secure 0 0 0) 0x7f9cc8055810 con 0x7f9cc406be30 2024-09-10T08:28:44.154 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:44.155 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T08:28:44.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.154+0000 7f9cde786640 1 -- 172.21.15.103:0/2516090224 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9cc406be30 msgr2=0x7f9cc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:44.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.154+0000 7f9cde786640 1 --2- 172.21.15.103:0/2516090224 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9cc406be30 0x7f9cc406e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8003eb0 tx=0x7f9cc8009040 comp rx=0 tx=0).stop 2024-09-10T08:28:44.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.154+0000 7f9cde786640 1 -- 172.21.15.103:0/2516090224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd80ca1c0 msgr2=0x7f9cd81e34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:44.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.154+0000 7f9cde786640 1 --2- 172.21.15.103:0/2516090224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd80ca1c0 0x7f9cd81e34e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc00d5d0 tx=0x7f9ccc00da90 comp rx=0 tx=0).stop 2024-09-10T08:28:44.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.154+0000 7f9cde786640 1 -- 172.21.15.103:0/2516090224 shutdown_connections 2024-09-10T08:28:44.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.154+0000 7f9cde786640 1 --2- 172.21.15.103:0/2516090224 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9cc406be30 0x7f9cc406e2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.154+0000 7f9cde786640 1 --2- 172.21.15.103:0/2516090224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cd8150480 0x7f9cd81508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.154+0000 7f9cde786640 1 --2- 172.21.15.103:0/2516090224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9cd80ca1c0 0x7f9cd81e34e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.154+0000 7f9cde786640 1 --2- 172.21.15.103:0/2516090224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd806c650 0x7f9cd81ef220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.154+0000 7f9cde786640 1 -- 172.21.15.103:0/2516090224 >> 172.21.15.103:0/2516090224 conn(0x7f9cd8068030 msgr2=0x7f9cd80c79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:44.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.154+0000 7f9cde786640 1 -- 172.21.15.103:0/2516090224 shutdown_connections 2024-09-10T08:28:44.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.154+0000 7f9cde786640 1 -- 172.21.15.103:0/2516090224 wait complete. 2024-09-10T08:28:44.165 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-10T08:28:42.794930+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219104,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755616,"statfs":{"total":773094113280,"available":772869750784,"internally_reserved":0,"allocated":2924544,"data_stored":1766892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001197"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619937+0000","last_change":"2024-09-10T08:28:35.571065+0000","last_active":"2024-09-10T08:28:36.619937+0000","last_peered":"2024-09-10T08:28:36.619937+0000","last_clean":"2024-09-10T08:28:36.619937+0000","last_became_active":"2024-09-10T08:28:35.570749+0000","last_became_peered":"2024-09-10T08:28:35.570749+0000","last_unstale":"2024-09-10T08:28:36.619937+0000","last_undegraded":"2024-09-10T08:28:36.619937+0000","last_fullsized":"2024-09-10T08:28:36.619937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:04.628661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.555896+0000","last_change":"2024-09-10T08:28:35.578197+0000","last_active":"2024-09-10T08:28:36.555896+0000","last_peered":"2024-09-10T08:28:36.555896+0000","last_clean":"2024-09-10T08:28:36.555896+0000","last_became_active":"2024-09-10T08:28:35.577852+0000","last_became_peered":"2024-09-10T08:28:35.577852+0000","last_unstale":"2024-09-10T08:28:36.555896+0000","last_undegraded":"2024-09-10T08:28:36.555896+0000","last_fullsized":"2024-09-10T08:28:36.555896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:44.348299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619390+0000","last_change":"2024-09-10T08:28:35.573918+0000","last_active":"2024-09-10T08:28:36.619390+0000","last_peered":"2024-09-10T08:28:36.619390+0000","last_clean":"2024-09-10T08:28:36.619390+0000","last_became_active":"2024-09-10T08:28:35.573646+0000","last_became_peered":"2024-09-10T08:28:35.573646+0000","last_unstale":"2024-09-10T08:28:36.619390+0000","last_undegraded":"2024-09-10T08:28:36.619390+0000","last_fullsized":"2024-09-10T08:28:36.619390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:24.295630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.558403+0000","last_change":"2024-09-10T08:28:35.578961+0000","last_active":"2024-09-10T08:28:36.558403+0000","last_peered":"2024-09-10T08:28:36.558403+0000","last_clean":"2024-09-10T08:28:36.558403+0000","last_became_active":"2024-09-10T08:28:35.578680+0000","last_became_peered":"2024-09-10T08:28:35.578680+0000","last_unstale":"2024-09-10T08:28:36.558403+0000","last_undegraded":"2024-09-10T08:28:36.558403+0000","last_fullsized":"2024-09-10T08:28:36.558403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:53.737412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619649+0000","last_change":"2024-09-10T08:28:35.572112+0000","last_active":"2024-09-10T08:28:36.619649+0000","last_peered":"2024-09-10T08:28:36.619649+0000","last_clean":"2024-09-10T08:28:36.619649+0000","last_became_active":"2024-09-10T08:28:35.571803+0000","last_became_peered":"2024-09-10T08:28:35.571803+0000","last_unstale":"2024-09-10T08:28:36.619649+0000","last_undegraded":"2024-09-10T08:28:36.619649+0000","last_fullsized":"2024-09-10T08:28:36.619649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:29.969987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.557591+0000","last_change":"2024-09-10T08:28:35.578978+0000","last_active":"2024-09-10T08:28:36.557591+0000","last_peered":"2024-09-10T08:28:36.557591+0000","last_clean":"2024-09-10T08:28:36.557591+0000","last_became_active":"2024-09-10T08:28:35.578475+0000","last_became_peered":"2024-09-10T08:28:35.578475+0000","last_unstale":"2024-09-10T08:28:36.557591+0000","last_undegraded":"2024-09-10T08:28:36.557591+0000","last_fullsized":"2024-09-10T08:28:36.557591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:08.520314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619255+0000","last_change":"2024-09-10T08:28:35.578664+0000","last_active":"2024-09-10T08:28:36.619255+0000","last_peered":"2024-09-10T08:28:36.619255+0000","last_clean":"2024-09-10T08:28:36.619255+0000","last_became_active":"2024-09-10T08:28:35.578384+0000","last_became_peered":"2024-09-10T08:28:35.578384+0000","last_unstale":"2024-09-10T08:28:36.619255+0000","last_undegraded":"2024-09-10T08:28:36.619255+0000","last_fullsized":"2024-09-10T08:28:36.619255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:44.278718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.618915+0000","last_change":"2024-09-10T08:28:35.575275+0000","last_active":"2024-09-10T08:28:36.618915+0000","last_peered":"2024-09-10T08:28:36.618915+0000","last_clean":"2024-09-10T08:28:36.618915+0000","last_became_active":"2024-09-10T08:28:35.575052+0000","last_became_peered":"2024-09-10T08:28:35.575052+0000","last_unstale":"2024-09-10T08:28:36.618915+0000","last_undegraded":"2024-09-10T08:28:36.618915+0000","last_fullsized":"2024-09-10T08:28:36.618915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:24.313017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620001+0000","last_change":"2024-09-10T08:28:35.577345+0000","last_active":"2024-09-10T08:28:36.620001+0000","last_peered":"2024-09-10T08:28:36.620001+0000","last_clean":"2024-09-10T08:28:36.620001+0000","last_became_active":"2024-09-10T08:28:35.576191+0000","last_became_peered":"2024-09-10T08:28:35.576191+0000","last_unstale":"2024-09-10T08:28:36.620001+0000","last_undegraded":"2024-09-10T08:28:36.620001+0000","last_fullsized":"2024-09-10T08:28:36.620001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:29.218797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619553+0000","last_change":"2024-09-10T08:28:35.570619+0000","last_active":"2024-09-10T08:28:36.619553+0000","last_peered":"2024-09-10T08:28:36.619553+0000","last_clean":"2024-09-10T08:28:36.619553+0000","last_became_active":"2024-09-10T08:28:35.570351+0000","last_became_peered":"2024-09-10T08:28:35.570351+0000","last_unstale":"2024-09-10T08:28:36.619553+0000","last_undegraded":"2024-09-10T08:28:36.619553+0000","last_fullsized":"2024-09-10T08:28:36.619553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:35.161279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619511+0000","last_change":"2024-09-10T08:28:35.565023+0000","last_active":"2024-09-10T08:28:36.619511+0000","last_peered":"2024-09-10T08:28:36.619511+0000","last_clean":"2024-09-10T08:28:36.619511+0000","last_became_active":"2024-09-10T08:28:35.564747+0000","last_became_peered":"2024-09-10T08:28:35.564747+0000","last_unstale":"2024-09-10T08:28:36.619511+0000","last_undegraded":"2024-09-10T08:28:36.619511+0000","last_fullsized":"2024-09-10T08:28:36.619511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:32.419621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.558835+0000","last_change":"2024-09-10T08:28:35.566574+0000","last_active":"2024-09-10T08:28:36.558835+0000","last_peered":"2024-09-10T08:28:36.558835+0000","last_clean":"2024-09-10T08:28:36.558835+0000","last_became_active":"2024-09-10T08:28:35.566205+0000","last_became_peered":"2024-09-10T08:28:35.566205+0000","last_unstale":"2024-09-10T08:28:36.558835+0000","last_undegraded":"2024-09-10T08:28:36.558835+0000","last_fullsized":"2024-09-10T08:28:36.558835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:49.876773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619846+0000","last_change":"2024-09-10T08:28:35.573330+0000","last_active":"2024-09-10T08:28:36.619846+0000","last_peered":"2024-09-10T08:28:36.619846+0000","last_clean":"2024-09-10T08:28:36.619846+0000","last_became_active":"2024-09-10T08:28:35.572992+0000","last_became_peered":"2024-09-10T08:28:35.572992+0000","last_unstale":"2024-09-10T08:28:36.619846+0000","last_undegraded":"2024-09-10T08:28:36.619846+0000","last_fullsized":"2024-09-10T08:28:36.619846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:15.412219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619605+0000","last_change":"2024-09-10T08:28:35.574551+0000","last_active":"2024-09-10T08:28:36.619605+0000","last_peered":"2024-09-10T08:28:36.619605+0000","last_clean":"2024-09-10T08:28:36.619605+0000","last_became_active":"2024-09-10T08:28:35.574256+0000","last_became_peered":"2024-09-10T08:28:35.574256+0000","last_unstale":"2024-09-10T08:28:36.619605+0000","last_undegraded":"2024-09-10T08:28:36.619605+0000","last_fullsized":"2024-09-10T08:28:36.619605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:43.401552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.555806+0000","last_change":"2024-09-10T08:28:35.560693+0000","last_active":"2024-09-10T08:28:36.555806+0000","last_peered":"2024-09-10T08:28:36.555806+0000","last_clean":"2024-09-10T08:28:36.555806+0000","last_became_active":"2024-09-10T08:28:35.560409+0000","last_became_peered":"2024-09-10T08:28:35.560409+0000","last_unstale":"2024-09-10T08:28:36.555806+0000","last_undegraded":"2024-09-10T08:28:36.555806+0000","last_fullsized":"2024-09-10T08:28:36.555806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:10.597654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.557604+0000","last_change":"2024-09-10T08:28:35.570249+0000","last_active":"2024-09-10T08:28:36.557604+0000","last_peered":"2024-09-10T08:28:36.557604+0000","last_clean":"2024-09-10T08:28:36.557604+0000","last_became_active":"2024-09-10T08:28:35.569960+0000","last_became_peered":"2024-09-10T08:28:35.569960+0000","last_unstale":"2024-09-10T08:28:36.557604+0000","last_undegraded":"2024-09-10T08:28:36.557604+0000","last_fullsized":"2024-09-10T08:28:36.557604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:29.787554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.558578+0000","last_change":"2024-09-10T08:28:35.567296+0000","last_active":"2024-09-10T08:28:36.558578+0000","last_peered":"2024-09-10T08:28:36.558578+0000","last_clean":"2024-09-10T08:28:36.558578+0000","last_became_active":"2024-09-10T08:28:35.567074+0000","last_became_peered":"2024-09-10T08:28:35.567074+0000","last_unstale":"2024-09-10T08:28:36.558578+0000","last_undegraded":"2024-09-10T08:28:36.558578+0000","last_fullsized":"2024-09-10T08:28:36.558578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:55.698345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619264+0000","last_change":"2024-09-10T08:28:35.574438+0000","last_active":"2024-09-10T08:28:36.619264+0000","last_peered":"2024-09-10T08:28:36.619264+0000","last_clean":"2024-09-10T08:28:36.619264+0000","last_became_active":"2024-09-10T08:28:35.574175+0000","last_became_peered":"2024-09-10T08:28:35.574175+0000","last_unstale":"2024-09-10T08:28:36.619264+0000","last_undegraded":"2024-09-10T08:28:36.619264+0000","last_fullsized":"2024-09-10T08:28:36.619264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:55.808543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619989+0000","last_change":"2024-09-10T08:28:35.572709+0000","last_active":"2024-09-10T08:28:36.619989+0000","last_peered":"2024-09-10T08:28:36.619989+0000","last_clean":"2024-09-10T08:28:36.619989+0000","last_became_active":"2024-09-10T08:28:35.572392+0000","last_became_peered":"2024-09-10T08:28:35.572392+0000","last_unstale":"2024-09-10T08:28:36.619989+0000","last_undegraded":"2024-09-10T08:28:36.619989+0000","last_fullsized":"2024-09-10T08:28:36.619989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:42.636299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619373+0000","last_change":"2024-09-10T08:28:35.574499+0000","last_active":"2024-09-10T08:28:36.619373+0000","last_peered":"2024-09-10T08:28:36.619373+0000","last_clean":"2024-09-10T08:28:36.619373+0000","last_became_active":"2024-09-10T08:28:35.574249+0000","last_became_peered":"2024-09-10T08:28:35.574249+0000","last_unstale":"2024-09-10T08:28:36.619373+0000","last_undegraded":"2024-09-10T08:28:36.619373+0000","last_fullsized":"2024-09-10T08:28:36.619373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:55.952307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619988+0000","last_change":"2024-09-10T08:28:35.575802+0000","last_active":"2024-09-10T08:28:36.619988+0000","last_peered":"2024-09-10T08:28:36.619988+0000","last_clean":"2024-09-10T08:28:36.619988+0000","last_became_active":"2024-09-10T08:28:35.575388+0000","last_became_peered":"2024-09-10T08:28:35.575388+0000","last_unstale":"2024-09-10T08:28:36.619988+0000","last_undegraded":"2024-09-10T08:28:36.619988+0000","last_fullsized":"2024-09-10T08:28:36.619988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:01.424265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.557960+0000","last_change":"2024-09-10T08:28:35.568044+0000","last_active":"2024-09-10T08:28:36.557960+0000","last_peered":"2024-09-10T08:28:36.557960+0000","last_clean":"2024-09-10T08:28:36.557960+0000","last_became_active":"2024-09-10T08:28:35.567744+0000","last_became_peered":"2024-09-10T08:28:35.567744+0000","last_unstale":"2024-09-10T08:28:36.557960+0000","last_undegraded":"2024-09-10T08:28:36.557960+0000","last_fullsized":"2024-09-10T08:28:36.557960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:19.081138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619134+0000","last_change":"2024-09-10T08:28:35.571566+0000","last_active":"2024-09-10T08:28:36.619134+0000","last_peered":"2024-09-10T08:28:36.619134+0000","last_clean":"2024-09-10T08:28:36.619134+0000","last_became_active":"2024-09-10T08:28:35.571285+0000","last_became_peered":"2024-09-10T08:28:35.571285+0000","last_unstale":"2024-09-10T08:28:36.619134+0000","last_undegraded":"2024-09-10T08:28:36.619134+0000","last_fullsized":"2024-09-10T08:28:36.619134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:23.587691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.557766+0000","last_change":"2024-09-10T08:28:35.578285+0000","last_active":"2024-09-10T08:28:36.557766+0000","last_peered":"2024-09-10T08:28:36.557766+0000","last_clean":"2024-09-10T08:28:36.557766+0000","last_became_active":"2024-09-10T08:28:35.576805+0000","last_became_peered":"2024-09-10T08:28:35.576805+0000","last_unstale":"2024-09-10T08:28:36.557766+0000","last_undegraded":"2024-09-10T08:28:36.557766+0000","last_fullsized":"2024-09-10T08:28:36.557766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:46.203320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619641+0000","last_change":"2024-09-10T08:28:35.575902+0000","last_active":"2024-09-10T08:28:36.619641+0000","last_peered":"2024-09-10T08:28:36.619641+0000","last_clean":"2024-09-10T08:28:36.619641+0000","last_became_active":"2024-09-10T08:28:35.575614+0000","last_became_peered":"2024-09-10T08:28:35.575614+0000","last_unstale":"2024-09-10T08:28:36.619641+0000","last_undegraded":"2024-09-10T08:28:36.619641+0000","last_fullsized":"2024-09-10T08:28:36.619641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:11.277682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619695+0000","last_change":"2024-09-10T08:28:35.573217+0000","last_active":"2024-09-10T08:28:36.619695+0000","last_peered":"2024-09-10T08:28:36.619695+0000","last_clean":"2024-09-10T08:28:36.619695+0000","last_became_active":"2024-09-10T08:28:35.572955+0000","last_became_peered":"2024-09-10T08:28:35.572955+0000","last_unstale":"2024-09-10T08:28:36.619695+0000","last_undegraded":"2024-09-10T08:28:36.619695+0000","last_fullsized":"2024-09-10T08:28:36.619695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:24.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.555960+0000","last_change":"2024-09-10T08:28:35.572550+0000","last_active":"2024-09-10T08:28:36.555960+0000","last_peered":"2024-09-10T08:28:36.555960+0000","last_clean":"2024-09-10T08:28:36.555960+0000","last_became_active":"2024-09-10T08:28:35.572184+0000","last_became_peered":"2024-09-10T08:28:35.572184+0000","last_unstale":"2024-09-10T08:28:36.555960+0000","last_undegraded":"2024-09-10T08:28:36.555960+0000","last_fullsized":"2024-09-10T08:28:36.555960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:08.490734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620280+0000","last_change":"2024-09-10T08:28:35.574676+0000","last_active":"2024-09-10T08:28:36.620280+0000","last_peered":"2024-09-10T08:28:36.620280+0000","last_clean":"2024-09-10T08:28:36.620280+0000","last_became_active":"2024-09-10T08:28:35.574437+0000","last_became_peered":"2024-09-10T08:28:35.574437+0000","last_unstale":"2024-09-10T08:28:36.620280+0000","last_undegraded":"2024-09-10T08:28:36.620280+0000","last_fullsized":"2024-09-10T08:28:36.620280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:45.422506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620112+0000","last_change":"2024-09-10T08:28:35.577852+0000","last_active":"2024-09-10T08:28:36.620112+0000","last_peered":"2024-09-10T08:28:36.620112+0000","last_clean":"2024-09-10T08:28:36.620112+0000","last_became_active":"2024-09-10T08:28:35.577571+0000","last_became_peered":"2024-09-10T08:28:35.577571+0000","last_unstale":"2024-09-10T08:28:36.620112+0000","last_undegraded":"2024-09-10T08:28:36.620112+0000","last_fullsized":"2024-09-10T08:28:36.620112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:22.713732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.558128+0000","last_change":"2024-09-10T08:28:35.578735+0000","last_active":"2024-09-10T08:28:36.558128+0000","last_peered":"2024-09-10T08:28:36.558128+0000","last_clean":"2024-09-10T08:28:36.558128+0000","last_became_active":"2024-09-10T08:28:35.577995+0000","last_became_peered":"2024-09-10T08:28:35.577995+0000","last_unstale":"2024-09-10T08:28:36.558128+0000","last_undegraded":"2024-09-10T08:28:36.558128+0000","last_fullsized":"2024-09-10T08:28:36.558128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:11.033441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620517+0000","last_change":"2024-09-10T08:28:35.566780+0000","last_active":"2024-09-10T08:28:36.620517+0000","last_peered":"2024-09-10T08:28:36.620517+0000","last_clean":"2024-09-10T08:28:36.620517+0000","last_became_active":"2024-09-10T08:28:35.566529+0000","last_became_peered":"2024-09-10T08:28:35.566529+0000","last_unstale":"2024-09-10T08:28:36.620517+0000","last_undegraded":"2024-09-10T08:28:36.620517+0000","last_fullsized":"2024-09-10T08:28:36.620517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:09.481166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619112+0000","last_change":"2024-09-10T08:28:35.579106+0000","last_active":"2024-09-10T08:28:36.619112+0000","last_peered":"2024-09-10T08:28:36.619112+0000","last_clean":"2024-09-10T08:28:36.619112+0000","last_became_active":"2024-09-10T08:28:35.578631+0000","last_became_peered":"2024-09-10T08:28:35.578631+0000","last_unstale":"2024-09-10T08:28:36.619112+0000","last_undegraded":"2024-09-10T08:28:36.619112+0000","last_fullsized":"2024-09-10T08:28:36.619112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:31.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.558090+0000","last_change":"2024-09-10T08:28:35.559371+0000","last_active":"2024-09-10T08:28:36.558090+0000","last_peered":"2024-09-10T08:28:36.558090+0000","last_clean":"2024-09-10T08:28:36.558090+0000","last_became_active":"2024-09-10T08:28:35.559145+0000","last_became_peered":"2024-09-10T08:28:35.559145+0000","last_unstale":"2024-09-10T08:28:36.558090+0000","last_undegraded":"2024-09-10T08:28:36.558090+0000","last_fullsized":"2024-09-10T08:28:36.558090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:57.339318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620049+0000","last_change":"2024-09-10T08:28:34.566606+0000","last_active":"2024-09-10T08:28:36.620049+0000","last_peered":"2024-09-10T08:28:36.620049+0000","last_clean":"2024-09-10T08:28:36.620049+0000","last_became_active":"2024-09-10T08:28:34.566388+0000","last_became_peered":"2024-09-10T08:28:34.566388+0000","last_unstale":"2024-09-10T08:28:36.620049+0000","last_undegraded":"2024-09-10T08:28:36.620049+0000","last_fullsized":"2024-09-10T08:28:36.620049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:33.528801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620240+0000","last_change":"2024-09-10T08:28:35.576406+0000","last_active":"2024-09-10T08:28:36.620240+0000","last_peered":"2024-09-10T08:28:36.620240+0000","last_clean":"2024-09-10T08:28:36.620240+0000","last_became_active":"2024-09-10T08:28:35.576145+0000","last_became_peered":"2024-09-10T08:28:35.576145+0000","last_unstale":"2024-09-10T08:28:36.620240+0000","last_undegraded":"2024-09-10T08:28:36.620240+0000","last_fullsized":"2024-09-10T08:28:36.620240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:57.667098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619146+0000","last_change":"2024-09-10T08:28:34.561906+0000","last_active":"2024-09-10T08:28:36.619146+0000","last_peered":"2024-09-10T08:28:36.619146+0000","last_clean":"2024-09-10T08:28:36.619146+0000","last_became_active":"2024-09-10T08:28:34.561613+0000","last_became_peered":"2024-09-10T08:28:34.561613+0000","last_unstale":"2024-09-10T08:28:36.619146+0000","last_undegraded":"2024-09-10T08:28:36.619146+0000","last_fullsized":"2024-09-10T08:28:36.619146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:56.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619271+0000","last_change":"2024-09-10T08:28:34.564751+0000","last_active":"2024-09-10T08:28:36.619271+0000","last_peered":"2024-09-10T08:28:36.619271+0000","last_clean":"2024-09-10T08:28:36.619271+0000","last_became_active":"2024-09-10T08:28:34.564479+0000","last_became_peered":"2024-09-10T08:28:34.564479+0000","last_unstale":"2024-09-10T08:28:36.619271+0000","last_undegraded":"2024-09-10T08:28:36.619271+0000","last_fullsized":"2024-09-10T08:28:36.619271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:29.618224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619074+0000","last_change":"2024-09-10T08:28:35.580244+0000","last_active":"2024-09-10T08:28:36.619074+0000","last_peered":"2024-09-10T08:28:36.619074+0000","last_clean":"2024-09-10T08:28:36.619074+0000","last_became_active":"2024-09-10T08:28:35.579975+0000","last_became_peered":"2024-09-10T08:28:35.579975+0000","last_unstale":"2024-09-10T08:28:36.619074+0000","last_undegraded":"2024-09-10T08:28:36.619074+0000","last_fullsized":"2024-09-10T08:28:36.619074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:16.498045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.557866+0000","last_change":"2024-09-10T08:28:34.554346+0000","last_active":"2024-09-10T08:28:36.557866+0000","last_peered":"2024-09-10T08:28:36.557866+0000","last_clean":"2024-09-10T08:28:36.557866+0000","last_became_active":"2024-09-10T08:28:34.553933+0000","last_became_peered":"2024-09-10T08:28:34.553933+0000","last_unstale":"2024-09-10T08:28:36.557866+0000","last_undegraded":"2024-09-10T08:28:36.557866+0000","last_fullsized":"2024-09-10T08:28:36.557866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:07.639671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.555776+0000","last_change":"2024-09-10T08:28:35.572803+0000","last_active":"2024-09-10T08:28:36.555776+0000","last_peered":"2024-09-10T08:28:36.555776+0000","last_clean":"2024-09-10T08:28:36.555776+0000","last_became_active":"2024-09-10T08:28:35.572219+0000","last_became_peered":"2024-09-10T08:28:35.572219+0000","last_unstale":"2024-09-10T08:28:36.555776+0000","last_undegraded":"2024-09-10T08:28:36.555776+0000","last_fullsized":"2024-09-10T08:28:36.555776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:45.920218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619315+0000","last_change":"2024-09-10T08:28:34.562935+0000","last_active":"2024-09-10T08:28:36.619315+0000","last_peered":"2024-09-10T08:28:36.619315+0000","last_clean":"2024-09-10T08:28:36.619315+0000","last_became_active":"2024-09-10T08:28:34.562647+0000","last_became_peered":"2024-09-10T08:28:34.562647+0000","last_unstale":"2024-09-10T08:28:36.619315+0000","last_undegraded":"2024-09-10T08:28:36.619315+0000","last_fullsized":"2024-09-10T08:28:36.619315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:47.492281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.558201+0000","last_change":"2024-09-10T08:28:35.572944+0000","last_active":"2024-09-10T08:28:36.558201+0000","last_peered":"2024-09-10T08:28:36.558201+0000","last_clean":"2024-09-10T08:28:36.558201+0000","last_became_active":"2024-09-10T08:28:35.572620+0000","last_became_peered":"2024-09-10T08:28:35.572620+0000","last_unstale":"2024-09-10T08:28:36.558201+0000","last_undegraded":"2024-09-10T08:28:36.558201+0000","last_fullsized":"2024-09-10T08:28:36.558201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:04.524048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.558051+0000","last_change":"2024-09-10T08:28:34.564571+0000","last_active":"2024-09-10T08:28:36.558051+0000","last_peered":"2024-09-10T08:28:36.558051+0000","last_clean":"2024-09-10T08:28:36.558051+0000","last_became_active":"2024-09-10T08:28:34.564189+0000","last_became_peered":"2024-09-10T08:28:34.564189+0000","last_unstale":"2024-09-10T08:28:36.558051+0000","last_undegraded":"2024-09-10T08:28:36.558051+0000","last_fullsized":"2024-09-10T08:28:36.558051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:46.055510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619533+0000","last_change":"2024-09-10T08:28:35.577913+0000","last_active":"2024-09-10T08:28:36.619533+0000","last_peered":"2024-09-10T08:28:36.619533+0000","last_clean":"2024-09-10T08:28:36.619533+0000","last_became_active":"2024-09-10T08:28:35.577255+0000","last_became_peered":"2024-09-10T08:28:35.577255+0000","last_unstale":"2024-09-10T08:28:36.619533+0000","last_undegraded":"2024-09-10T08:28:36.619533+0000","last_fullsized":"2024-09-10T08:28:36.619533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:17.413525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.556030+0000","last_change":"2024-09-10T08:28:34.557352+0000","last_active":"2024-09-10T08:28:36.556030+0000","last_peered":"2024-09-10T08:28:36.556030+0000","last_clean":"2024-09-10T08:28:36.556030+0000","last_became_active":"2024-09-10T08:28:34.557076+0000","last_became_peered":"2024-09-10T08:28:34.557076+0000","last_unstale":"2024-09-10T08:28:36.556030+0000","last_undegraded":"2024-09-10T08:28:36.556030+0000","last_fullsized":"2024-09-10T08:28:36.556030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:04.957739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.558840+0000","last_change":"2024-09-10T08:28:35.571262+0000","last_active":"2024-09-10T08:28:36.558840+0000","last_peered":"2024-09-10T08:28:36.558840+0000","last_clean":"2024-09-10T08:28:36.558840+0000","last_became_active":"2024-09-10T08:28:35.570711+0000","last_became_peered":"2024-09-10T08:28:35.570711+0000","last_unstale":"2024-09-10T08:28:36.558840+0000","last_undegraded":"2024-09-10T08:28:36.558840+0000","last_fullsized":"2024-09-10T08:28:36.558840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:29.116422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619300+0000","last_change":"2024-09-10T08:28:34.559823+0000","last_active":"2024-09-10T08:28:36.619300+0000","last_peered":"2024-09-10T08:28:36.619300+0000","last_clean":"2024-09-10T08:28:36.619300+0000","last_became_active":"2024-09-10T08:28:34.559560+0000","last_became_peered":"2024-09-10T08:28:34.559560+0000","last_unstale":"2024-09-10T08:28:36.619300+0000","last_undegraded":"2024-09-10T08:28:36.619300+0000","last_fullsized":"2024-09-10T08:28:36.619300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:53.724382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619650+0000","last_change":"2024-09-10T08:28:35.582473+0000","last_active":"2024-09-10T08:28:36.619650+0000","last_peered":"2024-09-10T08:28:36.619650+0000","last_clean":"2024-09-10T08:28:36.619650+0000","last_became_active":"2024-09-10T08:28:35.582205+0000","last_became_peered":"2024-09-10T08:28:35.582205+0000","last_unstale":"2024-09-10T08:28:36.619650+0000","last_undegraded":"2024-09-10T08:28:36.619650+0000","last_fullsized":"2024-09-10T08:28:36.619650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:11.200963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620328+0000","last_change":"2024-09-10T08:28:34.553556+0000","last_active":"2024-09-10T08:28:36.620328+0000","last_peered":"2024-09-10T08:28:36.620328+0000","last_clean":"2024-09-10T08:28:36.620328+0000","last_became_active":"2024-09-10T08:28:34.553275+0000","last_became_peered":"2024-09-10T08:28:34.553275+0000","last_unstale":"2024-09-10T08:28:36.620328+0000","last_undegraded":"2024-09-10T08:28:36.620328+0000","last_fullsized":"2024-09-10T08:28:36.620328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:45.957635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619742+0000","last_change":"2024-09-10T08:28:35.574810+0000","last_active":"2024-09-10T08:28:36.619742+0000","last_peered":"2024-09-10T08:28:36.619742+0000","last_clean":"2024-09-10T08:28:36.619742+0000","last_became_active":"2024-09-10T08:28:35.574567+0000","last_became_peered":"2024-09-10T08:28:35.574567+0000","last_unstale":"2024-09-10T08:28:36.619742+0000","last_undegraded":"2024-09-10T08:28:36.619742+0000","last_fullsized":"2024-09-10T08:28:36.619742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:29.315833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.558188+0000","last_change":"2024-09-10T08:28:34.560699+0000","last_active":"2024-09-10T08:28:36.558188+0000","last_peered":"2024-09-10T08:28:36.558188+0000","last_clean":"2024-09-10T08:28:36.558188+0000","last_became_active":"2024-09-10T08:28:34.560376+0000","last_became_peered":"2024-09-10T08:28:34.560376+0000","last_unstale":"2024-09-10T08:28:36.558188+0000","last_undegraded":"2024-09-10T08:28:36.558188+0000","last_fullsized":"2024-09-10T08:28:36.558188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:09.981216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619899+0000","last_change":"2024-09-10T08:28:35.575788+0000","last_active":"2024-09-10T08:28:36.619899+0000","last_peered":"2024-09-10T08:28:36.619899+0000","last_clean":"2024-09-10T08:28:36.619899+0000","last_became_active":"2024-09-10T08:28:35.575333+0000","last_became_peered":"2024-09-10T08:28:35.575333+0000","last_unstale":"2024-09-10T08:28:36.619899+0000","last_undegraded":"2024-09-10T08:28:36.619899+0000","last_fullsized":"2024-09-10T08:28:36.619899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:39.756390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619034+0000","last_change":"2024-09-10T08:28:34.560444+0000","last_active":"2024-09-10T08:28:36.619034+0000","last_peered":"2024-09-10T08:28:36.619034+0000","last_clean":"2024-09-10T08:28:36.619034+0000","last_became_active":"2024-09-10T08:28:34.560188+0000","last_became_peered":"2024-09-10T08:28:34.560188+0000","last_unstale":"2024-09-10T08:28:36.619034+0000","last_undegraded":"2024-09-10T08:28:36.619034+0000","last_fullsized":"2024-09-10T08:28:36.619034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:15.727780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619112+0000","last_change":"2024-09-10T08:28:35.578892+0000","last_active":"2024-09-10T08:28:36.619112+0000","last_peered":"2024-09-10T08:28:36.619112+0000","last_clean":"2024-09-10T08:28:36.619112+0000","last_became_active":"2024-09-10T08:28:35.578299+0000","last_became_peered":"2024-09-10T08:28:35.578299+0000","last_unstale":"2024-09-10T08:28:36.619112+0000","last_undegraded":"2024-09-10T08:28:36.619112+0000","last_fullsized":"2024-09-10T08:28:36.619112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:27.485392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619641+0000","last_change":"2024-09-10T08:28:34.555542+0000","last_active":"2024-09-10T08:28:36.619641+0000","last_peered":"2024-09-10T08:28:36.619641+0000","last_clean":"2024-09-10T08:28:36.619641+0000","last_became_active":"2024-09-10T08:28:34.555179+0000","last_became_peered":"2024-09-10T08:28:34.555179+0000","last_unstale":"2024-09-10T08:28:36.619641+0000","last_undegraded":"2024-09-10T08:28:36.619641+0000","last_fullsized":"2024-09-10T08:28:36.619641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:53.313161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619507+0000","last_change":"2024-09-10T08:28:35.575307+0000","last_active":"2024-09-10T08:28:36.619507+0000","last_peered":"2024-09-10T08:28:36.619507+0000","last_clean":"2024-09-10T08:28:36.619507+0000","last_became_active":"2024-09-10T08:28:35.575038+0000","last_became_peered":"2024-09-10T08:28:35.575038+0000","last_unstale":"2024-09-10T08:28:36.619507+0000","last_undegraded":"2024-09-10T08:28:36.619507+0000","last_fullsized":"2024-09-10T08:28:36.619507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:36.478822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.558524+0000","last_change":"2024-09-10T08:28:34.551102+0000","last_active":"2024-09-10T08:28:36.558524+0000","last_peered":"2024-09-10T08:28:36.558524+0000","last_clean":"2024-09-10T08:28:36.558524+0000","last_became_active":"2024-09-10T08:28:34.550773+0000","last_became_peered":"2024-09-10T08:28:34.550773+0000","last_unstale":"2024-09-10T08:28:36.558524+0000","last_undegraded":"2024-09-10T08:28:36.558524+0000","last_fullsized":"2024-09-10T08:28:36.558524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:35.393695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619908+0000","last_change":"2024-09-10T08:28:35.577476+0000","last_active":"2024-09-10T08:28:36.619908+0000","last_peered":"2024-09-10T08:28:36.619908+0000","last_clean":"2024-09-10T08:28:36.619908+0000","last_became_active":"2024-09-10T08:28:35.576786+0000","last_became_peered":"2024-09-10T08:28:35.576786+0000","last_unstale":"2024-09-10T08:28:36.619908+0000","last_undegraded":"2024-09-10T08:28:36.619908+0000","last_fullsized":"2024-09-10T08:28:36.619908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:46.914074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619362+0000","last_change":"2024-09-10T08:28:34.560313+0000","last_active":"2024-09-10T08:28:36.619362+0000","last_peered":"2024-09-10T08:28:36.619362+0000","last_clean":"2024-09-10T08:28:36.619362+0000","last_became_active":"2024-09-10T08:28:34.560035+0000","last_became_peered":"2024-09-10T08:28:34.560035+0000","last_unstale":"2024-09-10T08:28:36.619362+0000","last_undegraded":"2024-09-10T08:28:36.619362+0000","last_fullsized":"2024-09-10T08:28:36.619362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:56.945537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620144+0000","last_change":"2024-09-10T08:28:35.577577+0000","last_active":"2024-09-10T08:28:36.620144+0000","last_peered":"2024-09-10T08:28:36.620144+0000","last_clean":"2024-09-10T08:28:36.620144+0000","last_became_active":"2024-09-10T08:28:35.576686+0000","last_became_peered":"2024-09-10T08:28:35.576686+0000","last_unstale":"2024-09-10T08:28:36.620144+0000","last_undegraded":"2024-09-10T08:28:36.620144+0000","last_fullsized":"2024-09-10T08:28:36.620144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:36.334494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.556060+0000","last_change":"2024-09-10T08:28:34.560694+0000","last_active":"2024-09-10T08:28:36.556060+0000","last_peered":"2024-09-10T08:28:36.556060+0000","last_clean":"2024-09-10T08:28:36.556060+0000","last_became_active":"2024-09-10T08:28:34.560429+0000","last_became_peered":"2024-09-10T08:28:34.560429+0000","last_unstale":"2024-09-10T08:28:36.556060+0000","last_undegraded":"2024-09-10T08:28:36.556060+0000","last_fullsized":"2024-09-10T08:28:36.556060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:54.514467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.558587+0000","last_change":"2024-09-10T08:28:35.577124+0000","last_active":"2024-09-10T08:28:36.558587+0000","last_peered":"2024-09-10T08:28:36.558587+0000","last_clean":"2024-09-10T08:28:36.558587+0000","last_became_active":"2024-09-10T08:28:35.576655+0000","last_became_peered":"2024-09-10T08:28:35.576655+0000","last_unstale":"2024-09-10T08:28:36.558587+0000","last_undegraded":"2024-09-10T08:28:36.558587+0000","last_fullsized":"2024-09-10T08:28:36.558587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:29.878600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619122+0000","last_change":"2024-09-10T08:28:34.559911+0000","last_active":"2024-09-10T08:28:36.619122+0000","last_peered":"2024-09-10T08:28:36.619122+0000","last_clean":"2024-09-10T08:28:36.619122+0000","last_became_active":"2024-09-10T08:28:34.559635+0000","last_became_peered":"2024-09-10T08:28:34.559635+0000","last_unstale":"2024-09-10T08:28:36.619122+0000","last_undegraded":"2024-09-10T08:28:36.619122+0000","last_fullsized":"2024-09-10T08:28:36.619122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:40.892609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619822+0000","last_change":"2024-09-10T08:28:35.574532+0000","last_active":"2024-09-10T08:28:36.619822+0000","last_peered":"2024-09-10T08:28:36.619822+0000","last_clean":"2024-09-10T08:28:36.619822+0000","last_became_active":"2024-09-10T08:28:35.574215+0000","last_became_peered":"2024-09-10T08:28:35.574215+0000","last_unstale":"2024-09-10T08:28:36.619822+0000","last_undegraded":"2024-09-10T08:28:36.619822+0000","last_fullsized":"2024-09-10T08:28:36.619822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:28.455653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619171+0000","last_change":"2024-09-10T08:28:26.724394+0000","last_active":"2024-09-10T08:28:36.619171+0000","last_peered":"2024-09-10T08:28:36.619171+0000","last_clean":"2024-09-10T08:28:36.619171+0000","last_became_active":"2024-09-10T08:28:26.723452+0000","last_became_peered":"2024-09-10T08:28:26.723452+0000","last_unstale":"2024-09-10T08:28:36.619171+0000","last_undegraded":"2024-09-10T08:28:36.619171+0000","last_fullsized":"2024-09-10T08:28:36.619171+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_clean_scrub_stamp":"2024-09-10T08:28:25.445753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:00.811505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.557801+0000","last_change":"2024-09-10T08:28:34.555587+0000","last_active":"2024-09-10T08:28:36.557801+0000","last_peered":"2024-09-10T08:28:36.557801+0000","last_clean":"2024-09-10T08:28:36.557801+0000","last_became_active":"2024-09-10T08:28:34.555269+0000","last_became_peered":"2024-09-10T08:28:34.555269+0000","last_unstale":"2024-09-10T08:28:36.557801+0000","last_undegraded":"2024-09-10T08:28:36.557801+0000","last_fullsized":"2024-09-10T08:28:36.557801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:19.499870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619866+0000","last_change":"2024-09-10T08:28:35.572658+0000","last_active":"2024-09-10T08:28:36.619866+0000","last_peered":"2024-09-10T08:28:36.619866+0000","last_clean":"2024-09-10T08:28:36.619866+0000","last_became_active":"2024-09-10T08:28:35.571611+0000","last_became_peered":"2024-09-10T08:28:35.571611+0000","last_unstale":"2024-09-10T08:28:36.619866+0000","last_undegraded":"2024-09-10T08:28:36.619866+0000","last_fullsized":"2024-09-10T08:28:36.619866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:42.726996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619008+0000","last_change":"2024-09-10T08:28:34.568477+0000","last_active":"2024-09-10T08:28:36.619008+0000","last_peered":"2024-09-10T08:28:36.619008+0000","last_clean":"2024-09-10T08:28:36.619008+0000","last_became_active":"2024-09-10T08:28:34.568249+0000","last_became_peered":"2024-09-10T08:28:34.568249+0000","last_unstale":"2024-09-10T08:28:36.619008+0000","last_undegraded":"2024-09-10T08:28:36.619008+0000","last_fullsized":"2024-09-10T08:28:36.619008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:08.640043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619165+0000","last_change":"2024-09-10T08:28:35.576360+0000","last_active":"2024-09-10T08:28:36.619165+0000","last_peered":"2024-09-10T08:28:36.619165+0000","last_clean":"2024-09-10T08:28:36.619165+0000","last_became_active":"2024-09-10T08:28:35.576096+0000","last_became_peered":"2024-09-10T08:28:35.576096+0000","last_unstale":"2024-09-10T08:28:36.619165+0000","last_undegraded":"2024-09-10T08:28:36.619165+0000","last_fullsized":"2024-09-10T08:28:36.619165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:34.159275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620584+0000","last_change":"2024-09-10T08:28:34.560745+0000","last_active":"2024-09-10T08:28:36.620584+0000","last_peered":"2024-09-10T08:28:36.620584+0000","last_clean":"2024-09-10T08:28:36.620584+0000","last_became_active":"2024-09-10T08:28:34.559911+0000","last_became_peered":"2024-09-10T08:28:34.559911+0000","last_unstale":"2024-09-10T08:28:36.620584+0000","last_undegraded":"2024-09-10T08:28:36.620584+0000","last_fullsized":"2024-09-10T08:28:36.620584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:00.234067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.555809+0000","last_change":"2024-09-10T08:28:35.566745+0000","last_active":"2024-09-10T08:28:36.555809+0000","last_peered":"2024-09-10T08:28:36.555809+0000","last_clean":"2024-09-10T08:28:36.555809+0000","last_became_active":"2024-09-10T08:28:35.566444+0000","last_became_peered":"2024-09-10T08:28:35.566444+0000","last_unstale":"2024-09-10T08:28:36.555809+0000","last_undegraded":"2024-09-10T08:28:36.555809+0000","last_fullsized":"2024-09-10T08:28:36.555809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:52.735296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.558587+0000","last_change":"2024-09-10T08:28:34.553983+0000","last_active":"2024-09-10T08:28:36.558587+0000","last_peered":"2024-09-10T08:28:36.558587+0000","last_clean":"2024-09-10T08:28:36.558587+0000","last_became_active":"2024-09-10T08:28:34.553693+0000","last_became_peered":"2024-09-10T08:28:34.553693+0000","last_unstale":"2024-09-10T08:28:36.558587+0000","last_undegraded":"2024-09-10T08:28:36.558587+0000","last_fullsized":"2024-09-10T08:28:36.558587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:40.001685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.558673+0000","last_change":"2024-09-10T08:28:35.577978+0000","last_active":"2024-09-10T08:28:36.558673+0000","last_peered":"2024-09-10T08:28:36.558673+0000","last_clean":"2024-09-10T08:28:36.558673+0000","last_became_active":"2024-09-10T08:28:35.577718+0000","last_became_peered":"2024-09-10T08:28:35.577718+0000","last_unstale":"2024-09-10T08:28:36.558673+0000","last_undegraded":"2024-09-10T08:28:36.558673+0000","last_fullsized":"2024-09-10T08:28:36.558673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:01:57.257817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.555940+0000","last_change":"2024-09-10T08:28:34.555212+0000","last_active":"2024-09-10T08:28:36.555940+0000","last_peered":"2024-09-10T08:28:36.555940+0000","last_clean":"2024-09-10T08:28:36.555940+0000","last_became_active":"2024-09-10T08:28:34.554922+0000","last_became_peered":"2024-09-10T08:28:34.554922+0000","last_unstale":"2024-09-10T08:28:36.555940+0000","last_undegraded":"2024-09-10T08:28:36.555940+0000","last_fullsized":"2024-09-10T08:28:36.555940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.558395+0000","last_change":"2024-09-10T08:28:35.576280+0000","last_active":"2024-09-10T08:28:36.558395+0000","last_peered":"2024-09-10T08:28:36.558395+0000","last_clean":"2024-09-10T08:28:36.558395+0000","last_became_active":"2024-09-10T08:28:35.576002+0000","last_became_peered":"2024-09-10T08:28:35.576002+0000","last_unstale":"2024-09-10T08:28:36.558395+0000","last_undegraded":"2024-09-10T08:28:36.558395+0000","last_fullsized":"2024-09-10T08:28:36.558395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:46.278441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620007+0000","last_change":"2024-09-10T08:28:34.571283+0000","last_active":"2024-09-10T08:28:36.620007+0000","last_peered":"2024-09-10T08:28:36.620007+0000","last_clean":"2024-09-10T08:28:36.620007+0000","last_became_active":"2024-09-10T08:28:34.570791+0000","last_became_peered":"2024-09-10T08:28:34.570791+0000","last_unstale":"2024-09-10T08:28:36.620007+0000","last_undegraded":"2024-09-10T08:28:36.620007+0000","last_fullsized":"2024-09-10T08:28:36.620007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:17.427597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.555959+0000","last_change":"2024-09-10T08:28:35.567481+0000","last_active":"2024-09-10T08:28:36.555959+0000","last_peered":"2024-09-10T08:28:36.555959+0000","last_clean":"2024-09-10T08:28:36.555959+0000","last_became_active":"2024-09-10T08:28:35.567167+0000","last_became_peered":"2024-09-10T08:28:35.567167+0000","last_unstale":"2024-09-10T08:28:36.555959+0000","last_undegraded":"2024-09-10T08:28:36.555959+0000","last_fullsized":"2024-09-10T08:28:36.555959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:44.110012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.555948+0000","last_change":"2024-09-10T08:28:34.563451+0000","last_active":"2024-09-10T08:28:36.555948+0000","last_peered":"2024-09-10T08:28:36.555948+0000","last_clean":"2024-09-10T08:28:36.555948+0000","last_became_active":"2024-09-10T08:28:34.563259+0000","last_became_peered":"2024-09-10T08:28:34.563259+0000","last_unstale":"2024-09-10T08:28:36.555948+0000","last_undegraded":"2024-09-10T08:28:36.555948+0000","last_fullsized":"2024-09-10T08:28:36.555948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:44.899351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619769+0000","last_change":"2024-09-10T08:28:35.574107+0000","last_active":"2024-09-10T08:28:36.619769+0000","last_peered":"2024-09-10T08:28:36.619769+0000","last_clean":"2024-09-10T08:28:36.619769+0000","last_became_active":"2024-09-10T08:28:35.573851+0000","last_became_peered":"2024-09-10T08:28:35.573851+0000","last_unstale":"2024-09-10T08:28:36.619769+0000","last_undegraded":"2024-09-10T08:28:36.619769+0000","last_fullsized":"2024-09-10T08:28:36.619769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:53.240223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619376+0000","last_change":"2024-09-10T08:28:34.564865+0000","last_active":"2024-09-10T08:28:36.619376+0000","last_peered":"2024-09-10T08:28:36.619376+0000","last_clean":"2024-09-10T08:28:36.619376+0000","last_became_active":"2024-09-10T08:28:34.564549+0000","last_became_peered":"2024-09-10T08:28:34.564549+0000","last_unstale":"2024-09-10T08:28:36.619376+0000","last_undegraded":"2024-09-10T08:28:36.619376+0000","last_fullsized":"2024-09-10T08:28:36.619376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:05.523637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619239+0000","last_change":"2024-09-10T08:28:35.575106+0000","last_active":"2024-09-10T08:28:36.619239+0000","last_peered":"2024-09-10T08:28:36.619239+0000","last_clean":"2024-09-10T08:28:36.619239+0000","last_became_active":"2024-09-10T08:28:35.574815+0000","last_became_peered":"2024-09-10T08:28:35.574815+0000","last_unstale":"2024-09-10T08:28:36.619239+0000","last_undegraded":"2024-09-10T08:28:36.619239+0000","last_fullsized":"2024-09-10T08:28:36.619239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:26.512181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.618987+0000","last_change":"2024-09-10T08:28:34.571069+0000","last_active":"2024-09-10T08:28:36.618987+0000","last_peered":"2024-09-10T08:28:36.618987+0000","last_clean":"2024-09-10T08:28:36.618987+0000","last_became_active":"2024-09-10T08:28:34.570766+0000","last_became_peered":"2024-09-10T08:28:34.570766+0000","last_unstale":"2024-09-10T08:28:36.618987+0000","last_undegraded":"2024-09-10T08:28:36.618987+0000","last_fullsized":"2024-09-10T08:28:36.618987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:47.458195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.557685+0000","last_change":"2024-09-10T08:28:35.569938+0000","last_active":"2024-09-10T08:28:36.557685+0000","last_peered":"2024-09-10T08:28:36.557685+0000","last_clean":"2024-09-10T08:28:36.557685+0000","last_became_active":"2024-09-10T08:28:35.569109+0000","last_became_peered":"2024-09-10T08:28:35.569109+0000","last_unstale":"2024-09-10T08:28:36.557685+0000","last_undegraded":"2024-09-10T08:28:36.557685+0000","last_fullsized":"2024-09-10T08:28:36.557685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:51.680564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.555877+0000","last_change":"2024-09-10T08:28:34.564813+0000","last_active":"2024-09-10T08:28:36.555877+0000","last_peered":"2024-09-10T08:28:36.555877+0000","last_clean":"2024-09-10T08:28:36.555877+0000","last_became_active":"2024-09-10T08:28:34.564557+0000","last_became_peered":"2024-09-10T08:28:34.564557+0000","last_unstale":"2024-09-10T08:28:36.555877+0000","last_undegraded":"2024-09-10T08:28:36.555877+0000","last_fullsized":"2024-09-10T08:28:36.555877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:48.356069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619213+0000","last_change":"2024-09-10T08:28:35.572363+0000","last_active":"2024-09-10T08:28:36.619213+0000","last_peered":"2024-09-10T08:28:36.619213+0000","last_clean":"2024-09-10T08:28:36.619213+0000","last_became_active":"2024-09-10T08:28:35.572108+0000","last_became_peered":"2024-09-10T08:28:35.572108+0000","last_unstale":"2024-09-10T08:28:36.619213+0000","last_undegraded":"2024-09-10T08:28:36.619213+0000","last_fullsized":"2024-09-10T08:28:36.619213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:48.358634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.555991+0000","last_change":"2024-09-10T08:28:34.561324+0000","last_active":"2024-09-10T08:28:36.555991+0000","last_peered":"2024-09-10T08:28:36.555991+0000","last_clean":"2024-09-10T08:28:36.555991+0000","last_became_active":"2024-09-10T08:28:34.560974+0000","last_became_peered":"2024-09-10T08:28:34.560974+0000","last_unstale":"2024-09-10T08:28:36.555991+0000","last_undegraded":"2024-09-10T08:28:36.555991+0000","last_fullsized":"2024-09-10T08:28:36.555991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:18.790965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619969+0000","last_change":"2024-09-10T08:28:35.577024+0000","last_active":"2024-09-10T08:28:36.619969+0000","last_peered":"2024-09-10T08:28:36.619969+0000","last_clean":"2024-09-10T08:28:36.619969+0000","last_became_active":"2024-09-10T08:28:35.576771+0000","last_became_peered":"2024-09-10T08:28:35.576771+0000","last_unstale":"2024-09-10T08:28:36.619969+0000","last_undegraded":"2024-09-10T08:28:36.619969+0000","last_fullsized":"2024-09-10T08:28:36.619969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:07.162941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619951+0000","last_change":"2024-09-10T08:28:34.569235+0000","last_active":"2024-09-10T08:28:36.619951+0000","last_peered":"2024-09-10T08:28:36.619951+0000","last_clean":"2024-09-10T08:28:36.619951+0000","last_became_active":"2024-09-10T08:28:34.568899+0000","last_became_peered":"2024-09-10T08:28:34.568899+0000","last_unstale":"2024-09-10T08:28:36.619951+0000","last_undegraded":"2024-09-10T08:28:36.619951+0000","last_fullsized":"2024-09-10T08:28:36.619951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:21.927656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619164+0000","last_change":"2024-09-10T08:28:35.572478+0000","last_active":"2024-09-10T08:28:36.619164+0000","last_peered":"2024-09-10T08:28:36.619164+0000","last_clean":"2024-09-10T08:28:36.619164+0000","last_became_active":"2024-09-10T08:28:35.572215+0000","last_became_peered":"2024-09-10T08:28:35.572215+0000","last_unstale":"2024-09-10T08:28:36.619164+0000","last_undegraded":"2024-09-10T08:28:36.619164+0000","last_fullsized":"2024-09-10T08:28:36.619164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:40.397318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.558353+0000","last_change":"2024-09-10T08:28:35.560380+0000","last_active":"2024-09-10T08:28:36.558353+0000","last_peered":"2024-09-10T08:28:36.558353+0000","last_clean":"2024-09-10T08:28:36.558353+0000","last_became_active":"2024-09-10T08:28:35.560095+0000","last_became_peered":"2024-09-10T08:28:35.560095+0000","last_unstale":"2024-09-10T08:28:36.558353+0000","last_undegraded":"2024-09-10T08:28:36.558353+0000","last_fullsized":"2024-09-10T08:28:36.558353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:20.047446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619693+0000","last_change":"2024-09-10T08:28:34.566560+0000","last_active":"2024-09-10T08:28:36.619693+0000","last_peered":"2024-09-10T08:28:36.619693+0000","last_clean":"2024-09-10T08:28:36.619693+0000","last_became_active":"2024-09-10T08:28:34.566275+0000","last_became_peered":"2024-09-10T08:28:34.566275+0000","last_unstale":"2024-09-10T08:28:36.619693+0000","last_undegraded":"2024-09-10T08:28:36.619693+0000","last_fullsized":"2024-09-10T08:28:36.619693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:03.507683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.558412+0000","last_change":"2024-09-10T08:28:35.562132+0000","last_active":"2024-09-10T08:28:36.558412+0000","last_peered":"2024-09-10T08:28:36.558412+0000","last_clean":"2024-09-10T08:28:36.558412+0000","last_became_active":"2024-09-10T08:28:35.561842+0000","last_became_peered":"2024-09-10T08:28:35.561842+0000","last_unstale":"2024-09-10T08:28:36.558412+0000","last_undegraded":"2024-09-10T08:28:36.558412+0000","last_fullsized":"2024-09-10T08:28:36.558412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:48.810258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619895+0000","last_change":"2024-09-10T08:28:34.571965+0000","last_active":"2024-09-10T08:28:36.619895+0000","last_peered":"2024-09-10T08:28:36.619895+0000","last_clean":"2024-09-10T08:28:36.619895+0000","last_became_active":"2024-09-10T08:28:34.571640+0000","last_became_peered":"2024-09-10T08:28:34.571640+0000","last_unstale":"2024-09-10T08:28:36.619895+0000","last_undegraded":"2024-09-10T08:28:36.619895+0000","last_fullsized":"2024-09-10T08:28:36.619895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:53.047030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619392+0000","last_change":"2024-09-10T08:28:35.579033+0000","last_active":"2024-09-10T08:28:36.619392+0000","last_peered":"2024-09-10T08:28:36.619392+0000","last_clean":"2024-09-10T08:28:36.619392+0000","last_became_active":"2024-09-10T08:28:35.578333+0000","last_became_peered":"2024-09-10T08:28:35.578333+0000","last_unstale":"2024-09-10T08:28:36.619392+0000","last_undegraded":"2024-09-10T08:28:36.619392+0000","last_fullsized":"2024-09-10T08:28:36.619392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:58.779491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620130+0000","last_change":"2024-09-10T08:28:34.561691+0000","last_active":"2024-09-10T08:28:36.620130+0000","last_peered":"2024-09-10T08:28:36.620130+0000","last_clean":"2024-09-10T08:28:36.620130+0000","last_became_active":"2024-09-10T08:28:34.561410+0000","last_became_peered":"2024-09-10T08:28:34.561410+0000","last_unstale":"2024-09-10T08:28:36.620130+0000","last_undegraded":"2024-09-10T08:28:36.620130+0000","last_fullsized":"2024-09-10T08:28:36.620130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.629982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619996+0000","last_change":"2024-09-10T08:28:35.575267+0000","last_active":"2024-09-10T08:28:36.619996+0000","last_peered":"2024-09-10T08:28:36.619996+0000","last_clean":"2024-09-10T08:28:36.619996+0000","last_became_active":"2024-09-10T08:28:35.575019+0000","last_became_peered":"2024-09-10T08:28:35.575019+0000","last_unstale":"2024-09-10T08:28:36.619996+0000","last_undegraded":"2024-09-10T08:28:36.619996+0000","last_fullsized":"2024-09-10T08:28:36.619996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:00.810645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619680+0000","last_change":"2024-09-10T08:28:34.564816+0000","last_active":"2024-09-10T08:28:36.619680+0000","last_peered":"2024-09-10T08:28:36.619680+0000","last_clean":"2024-09-10T08:28:36.619680+0000","last_became_active":"2024-09-10T08:28:34.564545+0000","last_became_peered":"2024-09-10T08:28:34.564545+0000","last_unstale":"2024-09-10T08:28:36.619680+0000","last_undegraded":"2024-09-10T08:28:36.619680+0000","last_fullsized":"2024-09-10T08:28:36.619680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:34.365104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":806912,"data_stored":663617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":72793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":663673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":72667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:28:44.169 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:28:44.169 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T08:28:44.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.303+0000 7f5a4fcb7640 1 Processor -- start 2024-09-10T08:28:44.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.303+0000 7f5a4fcb7640 1 -- start start 2024-09-10T08:28:44.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.304+0000 7f5a4fcb7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5a480afdd0 0x7f5a480c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:44.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.304+0000 7f5a4fcb7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a480af870 0x7f5a480c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:44.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.304+0000 7f5a4fcb7640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a480c54e0 con 0x7f5a48153af0 2024-09-10T08:28:44.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.304+0000 7f5a4fcb7640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f5a480c74a0 con 0x7f5a480afdd0 2024-09-10T08:28:44.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.304+0000 7f5a4fcb7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f5a480c7740 con 0x7f5a480af870 2024-09-10T08:28:44.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.304+0000 7f5a4da53640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5a48153af0 0x7f5a481563a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51222/0 (socket says 172.21.15.103:51222) 2024-09-10T08:28:44.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.304+0000 7f5a4da53640 1 -- 172.21.15.103:0/410371462 learned_addr learned my addr 172.21.15.103:0/410371462 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:44.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.304+0000 7f5a4d252640 1 --2- 172.21.15.103:0/410371462 >> v2:172.21.15.103:3300/0 conn(0x7f5a480afdd0 0x7f5a480c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:44.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.304+0000 7f5a4d252640 1 -- 172.21.15.103:0/410371462 >> v2:172.21.15.154:3300/0 conn(0x7f5a480af870 msgr2=0x7f5a480c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:44.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.304+0000 7f5a4e254640 1 --2- 172.21.15.103:0/410371462 >> v2:172.21.15.154:3300/0 conn(0x7f5a480af870 0x7f5a480c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:44.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.305+0000 7f5a4d252640 1 --2- 172.21.15.103:0/410371462 >> v2:172.21.15.154:3300/0 conn(0x7f5a480af870 0x7f5a480c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.305+0000 7f5a4d252640 1 -- 172.21.15.103:0/410371462 >> v1:172.21.15.103:6789/0 conn(0x7f5a48153af0 legacy=0x7f5a481563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:44.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.305+0000 7f5a4ca51640 1 -- 172.21.15.103:0/410371462 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2507095094 0 0) 0x7f5a480c54e0 con 0x7f5a48153af0 2024-09-10T08:28:44.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.305+0000 7f5a4d252640 1 -- 172.21.15.103:0/410371462 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4815a3c0 con 0x7f5a480afdd0 2024-09-10T08:28:44.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.305+0000 7f5a4d252640 1 --2- 172.21.15.103:0/410371462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a480afdd0 0x7f5a480c5900 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5a480747c0 tx=0x7f5a3802a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75afdb1a81f5a61f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:44.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.305+0000 7f5a4ca51640 1 -- 172.21.15.103:0/410371462 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a38037070 con 0x7f5a480afdd0 2024-09-10T08:28:44.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.305+0000 7f5a4ca51640 1 -- 172.21.15.103:0/410371462 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a3802add0 con 0x7f5a480afdd0 2024-09-10T08:28:44.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.305+0000 7f5a4ca51640 1 -- 172.21.15.103:0/410371462 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a38032660 con 0x7f5a480afdd0 2024-09-10T08:28:44.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.306+0000 7f5a4fcb7640 1 -- 172.21.15.103:0/410371462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a480afdd0 msgr2=0x7f5a480c5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:44.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.306+0000 7f5a4fcb7640 1 --2- 172.21.15.103:0/410371462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a480afdd0 0x7f5a480c5900 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5a480747c0 tx=0x7f5a3802a080 comp rx=0 tx=0).stop 2024-09-10T08:28:44.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.306+0000 7f5a4fcb7640 1 -- 172.21.15.103:0/410371462 shutdown_connections 2024-09-10T08:28:44.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.306+0000 7f5a4fcb7640 1 --2- 172.21.15.103:0/410371462 >> v2:172.21.15.154:3300/0 conn(0x7f5a480af870 0x7f5a480c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.306+0000 7f5a4fcb7640 1 --2- 172.21.15.103:0/410371462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a480afdd0 0x7f5a480c5900 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.306+0000 7f5a4fcb7640 1 -- 172.21.15.103:0/410371462 >> 172.21.15.103:0/410371462 conn(0x7f5a480c6880 msgr2=0x7f5a480c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:44.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.306+0000 7f5a4fcb7640 1 -- 172.21.15.103:0/410371462 shutdown_connections 2024-09-10T08:28:44.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.306+0000 7f5a4fcb7640 1 -- 172.21.15.103:0/410371462 wait complete. 2024-09-10T08:28:44.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.307+0000 7f5a4fcb7640 1 Processor -- start 2024-09-10T08:28:44.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.307+0000 7f5a4fcb7640 1 -- start start 2024-09-10T08:28:44.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.308+0000 7f5a4fcb7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a480af870 0x7f5a481ef3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:44.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.308+0000 7f5a4fcb7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a480afdd0 0x7f5a481ebe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:44.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.308+0000 7f5a4fcb7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a48153af0 0x7f5a4814de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:44.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.308+0000 7f5a4fcb7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5a48154050 con 0x7f5a48153af0 2024-09-10T08:28:44.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.308+0000 7f5a4fcb7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5a48153ed0 con 0x7f5a480af870 2024-09-10T08:28:44.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.308+0000 7f5a4fcb7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5a480c4cc0 con 0x7f5a480afdd0 2024-09-10T08:28:44.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.308+0000 7f5a4e254640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a48153af0 0x7f5a4814de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:44.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.308+0000 7f5a4e254640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a48153af0 0x7f5a4814de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57620/0 (socket says 172.21.15.103:57620) 2024-09-10T08:28:44.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.308+0000 7f5a4e254640 1 -- 172.21.15.103:0/3572965380 learned_addr learned my addr 172.21.15.103:0/3572965380 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:44.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.308+0000 7f5a4e254640 1 -- 172.21.15.103:0/3572965380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a480afdd0 msgr2=0x7f5a481ebe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:44.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.308+0000 7f5a4e254640 1 --2- 172.21.15.103:0/3572965380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a480afdd0 0x7f5a481ebe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.308+0000 7f5a4e254640 1 -- 172.21.15.103:0/3572965380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a480af870 msgr2=0x7f5a481ef3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:44.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.308+0000 7f5a4e254640 1 --2- 172.21.15.103:0/3572965380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a480af870 0x7f5a481ef3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.308+0000 7f5a4e254640 1 -- 172.21.15.103:0/3572965380 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a481ec370 con 0x7f5a48153af0 2024-09-10T08:28:44.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.308+0000 7f5a4e254640 1 --2- 172.21.15.103:0/3572965380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a48153af0 0x7f5a4814de20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000cd70 tx=0x7f5a4000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:44.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.308+0000 7f5a3e7fc640 1 -- 172.21.15.103:0/3572965380 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a40003b90 con 0x7f5a48153af0 2024-09-10T08:28:44.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.308+0000 7f5a3e7fc640 1 -- 172.21.15.103:0/3572965380 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a40003d30 con 0x7f5a48153af0 2024-09-10T08:28:44.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.308+0000 7f5a4fcb7640 1 -- 172.21.15.103:0/3572965380 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a481541d0 con 0x7f5a48153af0 2024-09-10T08:28:44.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.308+0000 7f5a3e7fc640 1 -- 172.21.15.103:0/3572965380 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a40004240 con 0x7f5a48153af0 2024-09-10T08:28:44.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.309+0000 7f5a4fcb7640 1 -- 172.21.15.103:0/3572965380 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a48154770 con 0x7f5a48153af0 2024-09-10T08:28:44.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.309+0000 7f5a4fcb7640 1 -- 172.21.15.103:0/3572965380 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a480c5110 con 0x7f5a48153af0 2024-09-10T08:28:44.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.310+0000 7f5a3e7fc640 1 -- 172.21.15.103:0/3572965380 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5a400043e0 con 0x7f5a48153af0 2024-09-10T08:28:44.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.310+0000 7f5a3e7fc640 1 --2- 172.21.15.103:0/3572965380 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5a2c06be30 0x7f5a2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:44.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.310+0000 7f5a3e7fc640 1 -- 172.21.15.103:0/3572965380 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f5a4008b8c0 con 0x7f5a48153af0 2024-09-10T08:28:44.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.310+0000 7f5a4da53640 1 --2- 172.21.15.103:0/3572965380 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5a2c06be30 0x7f5a2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:44.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.311+0000 7f5a4da53640 1 --2- 172.21.15.103:0/3572965380 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5a2c06be30 0x7f5a2c06e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5a44007fd0 tx=0x7f5a44007960 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:44.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.315+0000 7f5a3e7fc640 1 -- 172.21.15.103:0/3572965380 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5a4005a310 con 0x7f5a48153af0 2024-09-10T08:28:44.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.482+0000 7f5a4fcb7640 1 -- 172.21.15.103:0/3572965380 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5a4814e360 con 0x7f5a48153af0 2024-09-10T08:28:44.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.482+0000 7f5a3e7fc640 1 -- 172.21.15.103:0/3572965380 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v21) ==== 84+0+197 (secure 0 0 0) 0x7f5a40059c10 con 0x7f5a48153af0 2024-09-10T08:28:44.483 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:44.483 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-09-10T08:28:44.483 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:28:44.483 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2024-09-10T08:28:44.483 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": ".mgr" 2024-09-10T08:28:44.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:28:44.484 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:28:44.484 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 2, 2024-09-10T08:28:44.484 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "a_metadata" 2024-09-10T08:28:44.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:28:44.484 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:28:44.484 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 3, 2024-09-10T08:28:44.484 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": "a_data" 2024-09-10T08:28:44.484 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:28:44.484 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-09-10T08:28:44.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.484+0000 7f5a4fcb7640 1 -- 172.21.15.103:0/3572965380 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5a2c06be30 msgr2=0x7f5a2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:44.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.484+0000 7f5a4fcb7640 1 --2- 172.21.15.103:0/3572965380 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5a2c06be30 0x7f5a2c06e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5a44007fd0 tx=0x7f5a44007960 comp rx=0 tx=0).stop 2024-09-10T08:28:44.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.484+0000 7f5a4fcb7640 1 -- 172.21.15.103:0/3572965380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a48153af0 msgr2=0x7f5a4814de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:44.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.484+0000 7f5a4fcb7640 1 --2- 172.21.15.103:0/3572965380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a48153af0 0x7f5a4814de20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000cd70 tx=0x7f5a4000a660 comp rx=0 tx=0).stop 2024-09-10T08:28:44.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.484+0000 7f5a4fcb7640 1 -- 172.21.15.103:0/3572965380 shutdown_connections 2024-09-10T08:28:44.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.484+0000 7f5a4fcb7640 1 --2- 172.21.15.103:0/3572965380 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5a2c06be30 0x7f5a2c06e2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.484+0000 7f5a4fcb7640 1 --2- 172.21.15.103:0/3572965380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a48153af0 0x7f5a4814de20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.484+0000 7f5a4fcb7640 1 --2- 172.21.15.103:0/3572965380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a480afdd0 0x7f5a481ebe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.484+0000 7f5a4fcb7640 1 --2- 172.21.15.103:0/3572965380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a480af870 0x7f5a481ef3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.484+0000 7f5a4fcb7640 1 -- 172.21.15.103:0/3572965380 >> 172.21.15.103:0/3572965380 conn(0x7f5a480c6880 msgr2=0x7f5a480c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:44.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.484+0000 7f5a4fcb7640 1 -- 172.21.15.103:0/3572965380 shutdown_connections 2024-09-10T08:28:44.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.484+0000 7f5a4fcb7640 1 -- 172.21.15.103:0/3572965380 wait complete. 2024-09-10T08:28:44.495 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'b' 2024-09-10T08:28:44.496 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_metadata --pg_num_min 64 2024-09-10T08:28:44.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.597+0000 7f5d6f5fd640 1 Processor -- start 2024-09-10T08:28:44.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.598+0000 7f5d6f5fd640 1 -- start start 2024-09-10T08:28:44.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.598+0000 7f5d6f5fd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5d68151c50 0x7f5d680c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:44.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.598+0000 7f5d6f5fd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d680c3890 0x7f5d680c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:44.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.598+0000 7f5d6f5fd640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d681551c0 con 0x7f5d680a8290 2024-09-10T08:28:44.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.598+0000 7f5d6f5fd640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f5d68074940 con 0x7f5d68151c50 2024-09-10T08:28:44.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.598+0000 7f5d6f5fd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5d680c8750 con 0x7f5d680c3890 2024-09-10T08:28:44.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.598+0000 7f5d6d399640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5d68151c50 0x7f5d680c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:44.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.598+0000 7f5d6d399640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5d68151c50 0x7f5d680c7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57622/0 (socket says 172.21.15.103:57622) 2024-09-10T08:28:44.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.598+0000 7f5d6d399640 1 -- 172.21.15.103:0/520826995 learned_addr learned my addr 172.21.15.103:0/520826995 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:44.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.599+0000 7f5d6db9a640 1 --2- 172.21.15.103:0/520826995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d680c3890 0x7f5d680c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:44.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.599+0000 7f5d6d399640 1 -- 172.21.15.103:0/520826995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d680c3890 msgr2=0x7f5d680c3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:44.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.599+0000 7f5d6d399640 1 --2- 172.21.15.103:0/520826995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d680c3890 0x7f5d680c3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.599+0000 7f5d6d399640 1 -- 172.21.15.103:0/520826995 >> v1:172.21.15.154:6789/0 conn(0x7f5d680a8290 legacy=0x7f5d680c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:44.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.599+0000 7f5d6d399640 1 -- 172.21.15.103:0/520826995 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d680c5300 con 0x7f5d68151c50 2024-09-10T08:28:44.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.599+0000 7f5d6d399640 1 --2- 172.21.15.103:0/520826995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d68151c50 0x7f5d680c7b00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5d64009870 tx=0x7f5d6402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b954c22ef1e0f9e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:44.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.600+0000 7f5d5ffff640 1 -- 172.21.15.103:0/520826995 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64037070 con 0x7f5d68151c50 2024-09-10T08:28:44.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.600+0000 7f5d5ffff640 1 -- 172.21.15.103:0/520826995 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d64032440 con 0x7f5d68151c50 2024-09-10T08:28:44.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.600+0000 7f5d5ffff640 1 -- 172.21.15.103:0/520826995 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64032810 con 0x7f5d68151c50 2024-09-10T08:28:44.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.600+0000 7f5d6f5fd640 1 -- 172.21.15.103:0/520826995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d68151c50 msgr2=0x7f5d680c7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:44.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.600+0000 7f5d6f5fd640 1 --2- 172.21.15.103:0/520826995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d68151c50 0x7f5d680c7b00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5d64009870 tx=0x7f5d6402a130 comp rx=0 tx=0).stop 2024-09-10T08:28:44.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.600+0000 7f5d6f5fd640 1 -- 172.21.15.103:0/520826995 shutdown_connections 2024-09-10T08:28:44.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.600+0000 7f5d6f5fd640 1 --2- 172.21.15.103:0/520826995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d680c3890 0x7f5d680c3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.600+0000 7f5d6f5fd640 1 --2- 172.21.15.103:0/520826995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d68151c50 0x7f5d680c7b00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.600+0000 7f5d6f5fd640 1 -- 172.21.15.103:0/520826995 >> 172.21.15.103:0/520826995 conn(0x7f5d680c56f0 msgr2=0x7f5d680c5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:44.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.600+0000 7f5d6f5fd640 1 -- 172.21.15.103:0/520826995 shutdown_connections 2024-09-10T08:28:44.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.600+0000 7f5d6f5fd640 1 -- 172.21.15.103:0/520826995 wait complete. 2024-09-10T08:28:44.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.601+0000 7f5d6f5fd640 1 Processor -- start 2024-09-10T08:28:44.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.601+0000 7f5d6f5fd640 1 -- start start 2024-09-10T08:28:44.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.602+0000 7f5d6f5fd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d680a8290 0x7f5d68153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:44.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.602+0000 7f5d6f5fd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d680c3890 0x7f5d681575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:44.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.602+0000 7f5d6f5fd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d68151c50 0x7f5d68157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:44.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.602+0000 7f5d6f5fd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5d68074650 con 0x7f5d680c3890 2024-09-10T08:28:44.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.602+0000 7f5d6f5fd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5d680744d0 con 0x7f5d680a8290 2024-09-10T08:28:44.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.602+0000 7f5d6f5fd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5d680c4220 con 0x7f5d68151c50 2024-09-10T08:28:44.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.602+0000 7f5d6cb98640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d680c3890 0x7f5d681575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:44.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.602+0000 7f5d6cb98640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d680c3890 0x7f5d681575a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57626/0 (socket says 172.21.15.103:57626) 2024-09-10T08:28:44.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.602+0000 7f5d6cb98640 1 -- 172.21.15.103:0/1785018540 learned_addr learned my addr 172.21.15.103:0/1785018540 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:44.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.602+0000 7f5d6db9a640 1 --2- 172.21.15.103:0/1785018540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d68151c50 0x7f5d68157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:44.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.602+0000 7f5d6cb98640 1 -- 172.21.15.103:0/1785018540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d68151c50 msgr2=0x7f5d68157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:44.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.602+0000 7f5d6d399640 1 --2- 172.21.15.103:0/1785018540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d680a8290 0x7f5d68153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:44.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.602+0000 7f5d6cb98640 1 --2- 172.21.15.103:0/1785018540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d68151c50 0x7f5d68157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.602+0000 7f5d6cb98640 1 -- 172.21.15.103:0/1785018540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d680a8290 msgr2=0x7f5d68153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:44.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.602+0000 7f5d6cb98640 1 --2- 172.21.15.103:0/1785018540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d680a8290 0x7f5d68153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.602+0000 7f5d6cb98640 1 -- 172.21.15.103:0/1785018540 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d681553b0 con 0x7f5d680c3890 2024-09-10T08:28:44.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.602+0000 7f5d6db9a640 1 --2- 172.21.15.103:0/1785018540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d68151c50 0x7f5d68157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:44.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.602+0000 7f5d6d399640 1 --2- 172.21.15.103:0/1785018540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d680a8290 0x7f5d68153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:44.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.603+0000 7f5d6cb98640 1 --2- 172.21.15.103:0/1785018540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d680c3890 0x7f5d681575a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800c430 tx=0x7f5d5800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:44.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.603+0000 7f5d5dffb640 1 -- 172.21.15.103:0/1785018540 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d580052d0 con 0x7f5d680c3890 2024-09-10T08:28:44.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.603+0000 7f5d5dffb640 1 -- 172.21.15.103:0/1785018540 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d58005490 con 0x7f5d680c3890 2024-09-10T08:28:44.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.603+0000 7f5d6f5fd640 1 -- 172.21.15.103:0/1785018540 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d681df110 con 0x7f5d680c3890 2024-09-10T08:28:44.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.603+0000 7f5d5dffb640 1 -- 172.21.15.103:0/1785018540 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d58007260 con 0x7f5d680c3890 2024-09-10T08:28:44.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.603+0000 7f5d6f5fd640 1 -- 172.21.15.103:0/1785018540 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d68155950 con 0x7f5d680c3890 2024-09-10T08:28:44.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.604+0000 7f5d6f5fd640 1 -- 172.21.15.103:0/1785018540 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d680aef90 con 0x7f5d680c3890 2024-09-10T08:28:44.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.604+0000 7f5d5dffb640 1 -- 172.21.15.103:0/1785018540 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d58007400 con 0x7f5d680c3890 2024-09-10T08:28:44.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.604+0000 7f5d5dffb640 1 --2- 172.21.15.103:0/1785018540 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5d4c06be30 0x7f5d4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:44.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.605+0000 7f5d5dffb640 1 -- 172.21.15.103:0/1785018540 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f5d5808a2e0 con 0x7f5d680c3890 2024-09-10T08:28:44.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.605+0000 7f5d6d399640 1 --2- 172.21.15.103:0/1785018540 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5d4c06be30 0x7f5d4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:44.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.605+0000 7f5d6d399640 1 --2- 172.21.15.103:0/1785018540 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5d4c06be30 0x7f5d4c06e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5d64034000 tx=0x7f5d6402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:44.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.609+0000 7f5d5dffb640 1 -- 172.21.15.103:0/1785018540 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5d680aef90 con 0x7f5d680c3890 2024-09-10T08:28:44.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:44.774+0000 7f5d6f5fd640 1 -- 172.21.15.103:0/1785018540 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64} v 0) -- 0x7f5d680c3ce0 con 0x7f5d680c3890 2024-09-10T08:28:45.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.596+0000 7f5d5dffb640 1 -- 172.21.15.103:0/1785018540 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64}]=0 pool 'b_metadata' created v22) ==== 128+0+0 (secure 0 0 0) 0x7f5d58058d30 con 0x7f5d680c3890 2024-09-10T08:28:45.597 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'b_metadata' created 2024-09-10T08:28:45.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.600+0000 7f5d6f5fd640 1 -- 172.21.15.103:0/1785018540 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5d4c06be30 msgr2=0x7f5d4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:45.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.600+0000 7f5d6f5fd640 1 --2- 172.21.15.103:0/1785018540 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5d4c06be30 0x7f5d4c06e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5d64034000 tx=0x7f5d6402e000 comp rx=0 tx=0).stop 2024-09-10T08:28:45.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.600+0000 7f5d6f5fd640 1 -- 172.21.15.103:0/1785018540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d680c3890 msgr2=0x7f5d681575a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:45.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.600+0000 7f5d6f5fd640 1 --2- 172.21.15.103:0/1785018540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d680c3890 0x7f5d681575a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800c430 tx=0x7f5d5800c8f0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.600+0000 7f5d6f5fd640 1 -- 172.21.15.103:0/1785018540 shutdown_connections 2024-09-10T08:28:45.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.600+0000 7f5d6f5fd640 1 --2- 172.21.15.103:0/1785018540 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5d4c06be30 0x7f5d4c06e2f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.600+0000 7f5d6f5fd640 1 --2- 172.21.15.103:0/1785018540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d68151c50 0x7f5d68157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.600+0000 7f5d6f5fd640 1 --2- 172.21.15.103:0/1785018540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d680c3890 0x7f5d681575a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.600+0000 7f5d6f5fd640 1 --2- 172.21.15.103:0/1785018540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d680a8290 0x7f5d68153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.600+0000 7f5d6f5fd640 1 -- 172.21.15.103:0/1785018540 >> 172.21.15.103:0/1785018540 conn(0x7f5d680c56f0 msgr2=0x7f5d681e0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:45.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.600+0000 7f5d6f5fd640 1 -- 172.21.15.103:0/1785018540 shutdown_connections 2024-09-10T08:28:45.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.600+0000 7f5d6f5fd640 1 -- 172.21.15.103:0/1785018540 wait complete. 2024-09-10T08:28:45.617 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T08:28:45.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.728+0000 7f099d3e8640 1 Processor -- start 2024-09-10T08:28:45.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.728+0000 7f099d3e8640 1 -- start start 2024-09-10T08:28:45.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.729+0000 7f099d3e8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0998159b30 0x7f0998159f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:45.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.729+0000 7f099d3e8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0998067a50 0x7f0998067f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:45.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.729+0000 7f099d3e8640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f099806cbc0 con 0x7f09980c9c60 2024-09-10T08:28:45.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.729+0000 7f099d3e8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f09980c66e0 con 0x7f0998067a50 2024-09-10T08:28:45.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.729+0000 7f099d3e8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f099806cea0 con 0x7f0998159b30 2024-09-10T08:28:45.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.729+0000 7f09977fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0998067a50 0x7f0998067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:45.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.729+0000 7f09977fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0998067a50 0x7f0998067f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57268/0 (socket says 172.21.15.103:57268) 2024-09-10T08:28:45.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.729+0000 7f09977fe640 1 -- 172.21.15.103:0/3230371370 learned_addr learned my addr 172.21.15.103:0/3230371370 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:45.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.729+0000 7f09977fe640 1 -- 172.21.15.103:0/3230371370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0998159b30 msgr2=0x7f0998159f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:45.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.729+0000 7f0996ffd640 1 --2- 172.21.15.103:0/3230371370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0998159b30 0x7f0998159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:45.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.729+0000 7f09977fe640 1 --2- 172.21.15.103:0/3230371370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0998159b30 0x7f0998159f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.729+0000 7f09977fe640 1 -- 172.21.15.103:0/3230371370 >> v1:172.21.15.103:6789/0 conn(0x7f09980c9c60 legacy=0x7f099814feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:45.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.729+0000 7f09967fc640 1 -- 172.21.15.103:0/3230371370 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2031501513 0 0) 0x7f099806cbc0 con 0x7f09980c9c60 2024-09-10T08:28:45.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.729+0000 7f09977fe640 1 -- 172.21.15.103:0/3230371370 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09980c6930 con 0x7f0998067a50 2024-09-10T08:28:45.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.730+0000 7f09977fe640 1 --2- 172.21.15.103:0/3230371370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0998067a50 0x7f0998067f00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0990009e50 tx=0x7f099002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a68f10255ab558f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:45.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.730+0000 7f09967fc640 1 -- 172.21.15.103:0/3230371370 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0990036070 con 0x7f0998067a50 2024-09-10T08:28:45.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.730+0000 7f09967fc640 1 -- 172.21.15.103:0/3230371370 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0990031600 con 0x7f0998067a50 2024-09-10T08:28:45.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.730+0000 7f09967fc640 1 -- 172.21.15.103:0/3230371370 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09900319d0 con 0x7f0998067a50 2024-09-10T08:28:45.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.731+0000 7f099d3e8640 1 -- 172.21.15.103:0/3230371370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0998067a50 msgr2=0x7f0998067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:45.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.731+0000 7f099d3e8640 1 --2- 172.21.15.103:0/3230371370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0998067a50 0x7f0998067f00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0990009e50 tx=0x7f099002a5f0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.731+0000 7f099d3e8640 1 -- 172.21.15.103:0/3230371370 shutdown_connections 2024-09-10T08:28:45.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.731+0000 7f099d3e8640 1 --2- 172.21.15.103:0/3230371370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0998067a50 0x7f0998067f00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.731+0000 7f099d3e8640 1 --2- 172.21.15.103:0/3230371370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0998159b30 0x7f0998159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.731+0000 7f099d3e8640 1 -- 172.21.15.103:0/3230371370 >> 172.21.15.103:0/3230371370 conn(0x7f09980cbd60 msgr2=0x7f09980cc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.731+0000 7f099d3e8640 1 -- 172.21.15.103:0/3230371370 shutdown_connections 2024-09-10T08:28:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.731+0000 7f099d3e8640 1 -- 172.21.15.103:0/3230371370 wait complete. 2024-09-10T08:28:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.732+0000 7f099d3e8640 1 Processor -- start 2024-09-10T08:28:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.732+0000 7f099d3e8640 1 -- start start 2024-09-10T08:28:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.733+0000 7f099d3e8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0998067a50 0x7f09981468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.733+0000 7f099d3e8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09980c9c60 0x7f09981ece20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.733+0000 7f099d3e8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0998159b30 0x7f099814fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.733+0000 7f099d3e8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f09980cca00 con 0x7f0998159b30 2024-09-10T08:28:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.733+0000 7f099d3e8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f09980cc880 con 0x7f0998067a50 2024-09-10T08:28:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.733+0000 7f099d3e8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f099815a450 con 0x7f09980c9c60 2024-09-10T08:28:45.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.733+0000 7f09977fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0998159b30 0x7f099814fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:45.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.733+0000 7f09977fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0998159b30 0x7f099814fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57270/0 (socket says 172.21.15.103:57270) 2024-09-10T08:28:45.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.733+0000 7f09977fe640 1 -- 172.21.15.103:0/3851766014 learned_addr learned my addr 172.21.15.103:0/3851766014 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:45.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.733+0000 7f098e7fc640 1 --2- 172.21.15.103:0/3851766014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09980c9c60 0x7f09981ece20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:45.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.733+0000 7f09977fe640 1 -- 172.21.15.103:0/3851766014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09980c9c60 msgr2=0x7f09981ece20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:45.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.733+0000 7f0996ffd640 1 --2- 172.21.15.103:0/3851766014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0998067a50 0x7f09981468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:45.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.733+0000 7f09977fe640 1 --2- 172.21.15.103:0/3851766014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09980c9c60 0x7f09981ece20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.733+0000 7f09977fe640 1 -- 172.21.15.103:0/3851766014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0998067a50 msgr2=0x7f09981468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:45.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.733+0000 7f09977fe640 1 --2- 172.21.15.103:0/3851766014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0998067a50 0x7f09981468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.733+0000 7f09977fe640 1 -- 172.21.15.103:0/3851766014 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0998157160 con 0x7f0998159b30 2024-09-10T08:28:45.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.733+0000 7f098e7fc640 1 --2- 172.21.15.103:0/3851766014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09980c9c60 0x7f09981ece20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:45.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.733+0000 7f0996ffd640 1 --2- 172.21.15.103:0/3851766014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0998067a50 0x7f09981468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:45.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.733+0000 7f09977fe640 1 --2- 172.21.15.103:0/3851766014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0998159b30 0x7f099814fc80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0990034040 tx=0x7f0990004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:45.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.733+0000 7f098ffff640 1 -- 172.21.15.103:0/3851766014 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0990036050 con 0x7f0998159b30 2024-09-10T08:28:45.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.733+0000 7f098ffff640 1 -- 172.21.15.103:0/3851766014 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0990042070 con 0x7f0998159b30 2024-09-10T08:28:45.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.734+0000 7f098ffff640 1 -- 172.21.15.103:0/3851766014 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0990007bd0 con 0x7f0998159b30 2024-09-10T08:28:45.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.734+0000 7f099d3e8640 1 -- 172.21.15.103:0/3851766014 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09981ed360 con 0x7f0998159b30 2024-09-10T08:28:45.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.734+0000 7f099d3e8640 1 -- 172.21.15.103:0/3851766014 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0998146610 con 0x7f0998159b30 2024-09-10T08:28:45.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.734+0000 7f099d3e8640 1 -- 172.21.15.103:0/3851766014 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0998159f10 con 0x7f0998159b30 2024-09-10T08:28:45.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.735+0000 7f098ffff640 1 -- 172.21.15.103:0/3851766014 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0990047460 con 0x7f0998159b30 2024-09-10T08:28:45.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.735+0000 7f098ffff640 1 --2- 172.21.15.103:0/3851766014 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f097806be30 0x7f097806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:45.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.736+0000 7f0996ffd640 1 --2- 172.21.15.103:0/3851766014 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f097806be30 0x7f097806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:45.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.736+0000 7f098ffff640 1 -- 172.21.15.103:0/3851766014 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6054+0+0 (secure 0 0 0) 0x7f09900abfa0 con 0x7f0998159b30 2024-09-10T08:28:45.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.736+0000 7f0996ffd640 1 --2- 172.21.15.103:0/3851766014 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f097806be30 0x7f097806e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f09981596b0 tx=0x7f0988008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:45.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.740+0000 7f098ffff640 1 -- 172.21.15.103:0/3851766014 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0990045360 con 0x7f0998159b30 2024-09-10T08:28:45.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:45.910+0000 7f099d3e8640 1 -- 172.21.15.103:0/3851766014 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f09980764a0 con 0x7f0998159b30 2024-09-10T08:28:46.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.601+0000 7f098ffff640 1 -- 172.21.15.103:0/3851766014 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'b_data' created v23) ==== 160+0+0 (secure 0 0 0) 0x7f099007a880 con 0x7f0998159b30 2024-09-10T08:28:46.602 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'b_data' created 2024-09-10T08:28:46.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.605+0000 7f099d3e8640 1 -- 172.21.15.103:0/3851766014 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f097806be30 msgr2=0x7f097806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:46.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.605+0000 7f099d3e8640 1 --2- 172.21.15.103:0/3851766014 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f097806be30 0x7f097806e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f09981596b0 tx=0x7f0988008040 comp rx=0 tx=0).stop 2024-09-10T08:28:46.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.605+0000 7f099d3e8640 1 -- 172.21.15.103:0/3851766014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0998159b30 msgr2=0x7f099814fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:46.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.605+0000 7f099d3e8640 1 --2- 172.21.15.103:0/3851766014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0998159b30 0x7f099814fc80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0990034040 tx=0x7f0990004a40 comp rx=0 tx=0).stop 2024-09-10T08:28:46.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.605+0000 7f099d3e8640 1 -- 172.21.15.103:0/3851766014 shutdown_connections 2024-09-10T08:28:46.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.605+0000 7f099d3e8640 1 --2- 172.21.15.103:0/3851766014 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f097806be30 0x7f097806e2f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.605+0000 7f099d3e8640 1 --2- 172.21.15.103:0/3851766014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0998159b30 0x7f099814fc80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.605+0000 7f099d3e8640 1 --2- 172.21.15.103:0/3851766014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09980c9c60 0x7f09981ece20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.605+0000 7f099d3e8640 1 --2- 172.21.15.103:0/3851766014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0998067a50 0x7f09981468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.605+0000 7f099d3e8640 1 -- 172.21.15.103:0/3851766014 >> 172.21.15.103:0/3851766014 conn(0x7f09980cbd60 msgr2=0x7f09980aca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:46.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.606+0000 7f099d3e8640 1 -- 172.21.15.103:0/3851766014 shutdown_connections 2024-09-10T08:28:46.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.606+0000 7f099d3e8640 1 -- 172.21.15.103:0/3851766014 wait complete. 2024-09-10T08:28:46.631 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new b b_metadata b_data 2024-09-10T08:28:46.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.732+0000 7f75a0f11640 1 Processor -- start 2024-09-10T08:28:46.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.732+0000 7f75a0f11640 1 -- start start 2024-09-10T08:28:46.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.733+0000 7f75a0f11640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f759c0731e0 0x7f759c0c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:46.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.733+0000 7f75a0f11640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f759c0c5280 0x7f759c0c5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:46.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.733+0000 7f75a0f11640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f759c0c80d0 con 0x7f759c073be0 2024-09-10T08:28:46.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.733+0000 7f75a0f11640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f759c0c8430 con 0x7f759c0c5280 2024-09-10T08:28:46.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.733+0000 7f75a0f11640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f759c0c8680 con 0x7f759c0731e0 2024-09-10T08:28:46.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.734+0000 7f759ad9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f759c0c5280 0x7f759c0c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:46.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.734+0000 7f7599d9b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f759c073be0 0x7f759c15a030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50072/0 (socket says 172.21.15.103:50072) 2024-09-10T08:28:46.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.734+0000 7f7599d9b640 1 -- 172.21.15.103:0/68267169 learned_addr learned my addr 172.21.15.103:0/68267169 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:46.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.734+0000 7f759a59c640 1 --2- 172.21.15.103:0/68267169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f759c0731e0 0x7f759c0c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:46.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.734+0000 7f759ad9d640 1 -- 172.21.15.103:0/68267169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f759c0731e0 msgr2=0x7f759c0c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:46.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.734+0000 7f759ad9d640 1 --2- 172.21.15.103:0/68267169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f759c0731e0 0x7f759c0c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.734+0000 7f759ad9d640 1 -- 172.21.15.103:0/68267169 >> v1:172.21.15.103:6789/0 conn(0x7f759c073be0 legacy=0x7f759c15a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:46.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.734+0000 7f759ad9d640 1 -- 172.21.15.103:0/68267169 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759c0c8960 con 0x7f759c0c5280 2024-09-10T08:28:46.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.734+0000 7f759959a640 1 -- 172.21.15.103:0/68267169 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 502112518 0 0) 0x7f7590001110 con 0x7f759c073be0 2024-09-10T08:28:46.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.735+0000 7f759ad9d640 1 --2- 172.21.15.103:0/68267169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f759c0c5280 0x7f759c0c5730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7594009d90 tx=0x7f759402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dbf8a8e9d459a81 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:46.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.735+0000 7f759959a640 1 -- 172.21.15.103:0/68267169 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7594031600 con 0x7f759c0c5280 2024-09-10T08:28:46.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.735+0000 7f759959a640 1 -- 172.21.15.103:0/68267169 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75940317a0 con 0x7f759c0c5280 2024-09-10T08:28:46.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.735+0000 7f759959a640 1 -- 172.21.15.103:0/68267169 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7594031b70 con 0x7f759c0c5280 2024-09-10T08:28:46.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.735+0000 7f75a0f11640 1 -- 172.21.15.103:0/68267169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f759c0c5280 msgr2=0x7f759c0c5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:46.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.735+0000 7f75a0f11640 1 --2- 172.21.15.103:0/68267169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f759c0c5280 0x7f759c0c5730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7594009d90 tx=0x7f759402a5d0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.735+0000 7f75a0f11640 1 -- 172.21.15.103:0/68267169 shutdown_connections 2024-09-10T08:28:46.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.735+0000 7f75a0f11640 1 --2- 172.21.15.103:0/68267169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f759c0c5280 0x7f759c0c5730 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.735+0000 7f75a0f11640 1 --2- 172.21.15.103:0/68267169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f759c0731e0 0x7f759c0c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.735+0000 7f75a0f11640 1 -- 172.21.15.103:0/68267169 >> 172.21.15.103:0/68267169 conn(0x7f759c0c9c00 msgr2=0x7f759c0ca010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:46.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.735+0000 7f75a0f11640 1 -- 172.21.15.103:0/68267169 shutdown_connections 2024-09-10T08:28:46.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.735+0000 7f75a0f11640 1 -- 172.21.15.103:0/68267169 wait complete. 2024-09-10T08:28:46.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.737+0000 7f75a0f11640 1 Processor -- start 2024-09-10T08:28:46.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.737+0000 7f75a0f11640 1 -- start start 2024-09-10T08:28:46.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.737+0000 7f75a0f11640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f759c0731e0 0x7f759c1ef3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:46.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.737+0000 7f75a0f11640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f759c073be0 0x7f759c1ed340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:46.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.737+0000 7f75a0f11640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f759c0c5280 0x7f759c1ed880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:46.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.737+0000 7f75a0f11640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f759c15a740 con 0x7f759c0731e0 2024-09-10T08:28:46.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.737+0000 7f75a0f11640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f759c0c8f20 con 0x7f759c073be0 2024-09-10T08:28:46.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.737+0000 7f75a0f11640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f759c15a8c0 con 0x7f759c0c5280 2024-09-10T08:28:46.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.737+0000 7f759a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f759c0731e0 0x7f759c1ef3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:46.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.737+0000 7f759a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f759c0731e0 0x7f759c1ef3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57276/0 (socket says 172.21.15.103:57276) 2024-09-10T08:28:46.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.737+0000 7f759a59c640 1 -- 172.21.15.103:0/3112908927 learned_addr learned my addr 172.21.15.103:0/3112908927 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:46.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.738+0000 7f759ad9d640 1 --2- 172.21.15.103:0/3112908927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f759c0c5280 0x7f759c1ed880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:46.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.738+0000 7f7599d9b640 1 --2- 172.21.15.103:0/3112908927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f759c073be0 0x7f759c1ed340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:46.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.738+0000 7f759a59c640 1 -- 172.21.15.103:0/3112908927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f759c0c5280 msgr2=0x7f759c1ed880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:46.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.738+0000 7f759a59c640 1 --2- 172.21.15.103:0/3112908927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f759c0c5280 0x7f759c1ed880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.738+0000 7f759a59c640 1 -- 172.21.15.103:0/3112908927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f759c073be0 msgr2=0x7f759c1ed340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:46.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.738+0000 7f759a59c640 1 --2- 172.21.15.103:0/3112908927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f759c073be0 0x7f759c1ed340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.738+0000 7f759a59c640 1 -- 172.21.15.103:0/3112908927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759c1efe50 con 0x7f759c0731e0 2024-09-10T08:28:46.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.738+0000 7f759a59c640 1 --2- 172.21.15.103:0/3112908927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f759c0731e0 0x7f759c1ef3d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f758c00e9e0 tx=0x7f758c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:46.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.738+0000 7f758affd640 1 -- 172.21.15.103:0/3112908927 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c017070 con 0x7f759c0731e0 2024-09-10T08:28:46.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.738+0000 7f758affd640 1 -- 172.21.15.103:0/3112908927 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f758c00c9d0 con 0x7f759c0731e0 2024-09-10T08:28:46.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.738+0000 7f75a0f11640 1 -- 172.21.15.103:0/3112908927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f759c1e0450 con 0x7f759c0731e0 2024-09-10T08:28:46.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.738+0000 7f758affd640 1 -- 172.21.15.103:0/3112908927 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c00cdc0 con 0x7f759c0731e0 2024-09-10T08:28:46.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.738+0000 7f75a0f11640 1 -- 172.21.15.103:0/3112908927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f759c0ac760 con 0x7f759c0731e0 2024-09-10T08:28:46.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.739+0000 7f75a0f11640 1 -- 172.21.15.103:0/3112908927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f759c0735c0 con 0x7f759c0731e0 2024-09-10T08:28:46.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.740+0000 7f758affd640 1 -- 172.21.15.103:0/3112908927 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f758c01a070 con 0x7f759c0731e0 2024-09-10T08:28:46.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.740+0000 7f758affd640 1 --2- 172.21.15.103:0/3112908927 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f757c06be60 0x7f757c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:46.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.740+0000 7f758affd640 1 -- 172.21.15.103:0/3112908927 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6431+0+0 (secure 0 0 0) 0x7f758c08b400 con 0x7f759c0731e0 2024-09-10T08:28:46.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.740+0000 7f7599d9b640 1 --2- 172.21.15.103:0/3112908927 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f757c06be60 0x7f757c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:46.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.741+0000 7f7599d9b640 1 --2- 172.21.15.103:0/3112908927 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f757c06be60 0x7f757c06e320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f759c1ef0c0 tx=0x7f7590009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:46.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.745+0000 7f758affd640 1 -- 172.21.15.103:0/3112908927 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f758c059b70 con 0x7f759c0731e0 2024-09-10T08:28:46.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:46.946+0000 7f75a0f11640 1 -- 172.21.15.103:0/3112908927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"} v 0) -- 0x7f759c156150 con 0x7f759c0731e0 2024-09-10T08:28:47.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.616+0000 7f758affd640 1 -- 172.21.15.103:0/3112908927 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"}]=0 new fs with metadata pool 4 and data pool 5 v8) ==== 157+0+0 (secure 0 0 0) 0x7f758c059470 con 0x7f759c0731e0 2024-09-10T08:28:47.617 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 4 and data pool 5 2024-09-10T08:28:47.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.629+0000 7f75a0f11640 1 -- 172.21.15.103:0/3112908927 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f757c06be60 msgr2=0x7f757c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:47.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.629+0000 7f75a0f11640 1 --2- 172.21.15.103:0/3112908927 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f757c06be60 0x7f757c06e320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f759c1ef0c0 tx=0x7f7590009040 comp rx=0 tx=0).stop 2024-09-10T08:28:47.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.629+0000 7f75a0f11640 1 -- 172.21.15.103:0/3112908927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f759c0731e0 msgr2=0x7f759c1ef3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:47.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.629+0000 7f75a0f11640 1 --2- 172.21.15.103:0/3112908927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f759c0731e0 0x7f759c1ef3d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f758c00e9e0 tx=0x7f758c00eea0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.631+0000 7f75a0f11640 1 -- 172.21.15.103:0/3112908927 shutdown_connections 2024-09-10T08:28:47.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.631+0000 7f75a0f11640 1 --2- 172.21.15.103:0/3112908927 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f757c06be60 0x7f757c06e320 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.631+0000 7f75a0f11640 1 --2- 172.21.15.103:0/3112908927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f759c0c5280 0x7f759c1ed880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.631+0000 7f75a0f11640 1 --2- 172.21.15.103:0/3112908927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f759c073be0 0x7f759c1ed340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.631+0000 7f75a0f11640 1 --2- 172.21.15.103:0/3112908927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f759c0731e0 0x7f759c1ef3d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.631+0000 7f75a0f11640 1 -- 172.21.15.103:0/3112908927 >> 172.21.15.103:0/3112908927 conn(0x7f759c0c9c00 msgr2=0x7f759c0aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:47.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.633+0000 7f75a0f11640 1 -- 172.21.15.103:0/3112908927 shutdown_connections 2024-09-10T08:28:47.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.634+0000 7f75a0f11640 1 -- 172.21.15.103:0/3112908927 wait complete. 2024-09-10T08:28:47.649 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:28:47.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.751+0000 7f35318d7640 1 Processor -- start 2024-09-10T08:28:47.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.751+0000 7f35318d7640 1 -- start start 2024-09-10T08:28:47.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.751+0000 7f35318d7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f352c150480 0x7f352c0c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:47.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.751+0000 7f35318d7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f352c06c650 0x7f352c0c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:47.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.751+0000 7f35318d7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f352c0c9c80 0x7f352c0ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:47.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.751+0000 7f35318d7640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f352c06c240 con 0x7f352c0c9c80 2024-09-10T08:28:47.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.751+0000 7f35318d7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f352c15a330 con 0x7f352c150480 2024-09-10T08:28:47.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.751+0000 7f35318d7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f352c15a7c0 con 0x7f352c06c650 2024-09-10T08:28:47.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.752+0000 7f352b7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f352c0c9c80 0x7f352c0ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:47.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.752+0000 7f352b7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f352c0c9c80 0x7f352c0ca130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57294/0 (socket says 172.21.15.103:57294) 2024-09-10T08:28:47.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.752+0000 7f352b7fe640 1 -- 172.21.15.103:0/1709820449 learned_addr learned my addr 172.21.15.103:0/1709820449 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:47.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.752+0000 7f35227fc640 1 --2- 172.21.15.103:0/1709820449 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f352c06c650 0x7f352c0c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:47.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.752+0000 7f352affd640 1 --2- 172.21.15.103:0/1709820449 >> v2:172.21.15.154:3300/0 conn(0x7f352c150480 0x7f352c0c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:47.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.752+0000 7f352b7fe640 1 -- 172.21.15.103:0/1709820449 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f352c06c650 msgr2=0x7f352c0c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:47.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.752+0000 7f352b7fe640 1 --2- 172.21.15.103:0/1709820449 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f352c06c650 0x7f352c0c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.752+0000 7f352b7fe640 1 -- 172.21.15.103:0/1709820449 >> v2:172.21.15.154:3300/0 conn(0x7f352c150480 msgr2=0x7f352c0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:47.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.752+0000 7f352b7fe640 1 --2- 172.21.15.103:0/1709820449 >> v2:172.21.15.154:3300/0 conn(0x7f352c150480 0x7f352c0c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.752+0000 7f352b7fe640 1 -- 172.21.15.103:0/1709820449 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f352c159a00 con 0x7f352c0c9c80 2024-09-10T08:28:47.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.752+0000 7f352affd640 1 --2- 172.21.15.103:0/1709820449 >> v2:172.21.15.154:3300/0 conn(0x7f352c150480 0x7f352c0c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:47.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.753+0000 7f352b7fe640 1 --2- 172.21.15.103:0/1709820449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f352c0c9c80 0x7f352c0ca130 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f352c0ccac0 tx=0x7f352402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4425f1f29dc85419 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:47.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.753+0000 7f352a7fc640 1 -- 172.21.15.103:0/1709820449 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3524036070 con 0x7f352c0c9c80 2024-09-10T08:28:47.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.753+0000 7f352a7fc640 1 -- 172.21.15.103:0/1709820449 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3524031600 con 0x7f352c0c9c80 2024-09-10T08:28:47.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.753+0000 7f352a7fc640 1 -- 172.21.15.103:0/1709820449 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35240319d0 con 0x7f352c0c9c80 2024-09-10T08:28:47.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.753+0000 7f35318d7640 1 -- 172.21.15.103:0/1709820449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f352c0c9c80 msgr2=0x7f352c0ca130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:47.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.753+0000 7f35318d7640 1 --2- 172.21.15.103:0/1709820449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f352c0c9c80 0x7f352c0ca130 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f352c0ccac0 tx=0x7f352402a6a0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.753+0000 7f35318d7640 1 -- 172.21.15.103:0/1709820449 shutdown_connections 2024-09-10T08:28:47.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.753+0000 7f35318d7640 1 --2- 172.21.15.103:0/1709820449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f352c0c9c80 0x7f352c0ca130 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.753+0000 7f35318d7640 1 --2- 172.21.15.103:0/1709820449 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f352c06c650 0x7f352c0c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.753+0000 7f35318d7640 1 --2- 172.21.15.103:0/1709820449 >> v2:172.21.15.154:3300/0 conn(0x7f352c150480 0x7f352c0c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.753+0000 7f35318d7640 1 -- 172.21.15.103:0/1709820449 >> 172.21.15.103:0/1709820449 conn(0x7f352c068030 msgr2=0x7f352c073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:47.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.753+0000 7f35318d7640 1 -- 172.21.15.103:0/1709820449 shutdown_connections 2024-09-10T08:28:47.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.753+0000 7f35318d7640 1 -- 172.21.15.103:0/1709820449 wait complete. 2024-09-10T08:28:47.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.754+0000 7f35318d7640 1 Processor -- start 2024-09-10T08:28:47.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.755+0000 7f35318d7640 1 -- start start 2024-09-10T08:28:47.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.755+0000 7f35318d7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f352c06c650 0x7f352c157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:47.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.755+0000 7f35318d7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f352c0c9c80 0x7f352c1e3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:47.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.755+0000 7f35318d7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f352c150480 0x7f352c149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:47.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.755+0000 7f35318d7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f352c0ca670 con 0x7f352c150480 2024-09-10T08:28:47.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.755+0000 7f35318d7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f352c159fc0 con 0x7f352c06c650 2024-09-10T08:28:47.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.755+0000 7f35318d7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f352c06d270 con 0x7f352c0c9c80 2024-09-10T08:28:47.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.755+0000 7f352b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f352c150480 0x7f352c149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:47.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.755+0000 7f352b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f352c150480 0x7f352c149d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57304/0 (socket says 172.21.15.103:57304) 2024-09-10T08:28:47.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.755+0000 7f352b7fe640 1 -- 172.21.15.103:0/943673446 learned_addr learned my addr 172.21.15.103:0/943673446 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:47.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.756+0000 7f352affd640 1 --2- 172.21.15.103:0/943673446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f352c06c650 0x7f352c157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:47.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.756+0000 7f35227fc640 1 --2- 172.21.15.103:0/943673446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f352c0c9c80 0x7f352c1e3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:47.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.756+0000 7f352b7fe640 1 -- 172.21.15.103:0/943673446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f352c0c9c80 msgr2=0x7f352c1e3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:47.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.756+0000 7f352b7fe640 1 --2- 172.21.15.103:0/943673446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f352c0c9c80 0x7f352c1e3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.756+0000 7f352b7fe640 1 -- 172.21.15.103:0/943673446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f352c06c650 msgr2=0x7f352c157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:47.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.756+0000 7f352b7fe640 1 --2- 172.21.15.103:0/943673446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f352c06c650 0x7f352c157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.756+0000 7f352b7fe640 1 -- 172.21.15.103:0/943673446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f352c157770 con 0x7f352c150480 2024-09-10T08:28:47.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.756+0000 7f352b7fe640 1 --2- 172.21.15.103:0/943673446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f352c150480 0x7f352c149d00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3524034040 tx=0x7f3524004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:47.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.756+0000 7f3528ff9640 1 -- 172.21.15.103:0/943673446 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3524036050 con 0x7f352c150480 2024-09-10T08:28:47.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.756+0000 7f3528ff9640 1 -- 172.21.15.103:0/943673446 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3524042070 con 0x7f352c150480 2024-09-10T08:28:47.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.756+0000 7f3528ff9640 1 -- 172.21.15.103:0/943673446 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3524009510 con 0x7f352c150480 2024-09-10T08:28:47.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.756+0000 7f35318d7640 1 -- 172.21.15.103:0/943673446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f352c0b07c0 con 0x7f352c150480 2024-09-10T08:28:47.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.756+0000 7f35318d7640 1 -- 172.21.15.103:0/943673446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f352c1ef4c0 con 0x7f352c150480 2024-09-10T08:28:47.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.757+0000 7f35318d7640 1 -- 172.21.15.103:0/943673446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f352c156270 con 0x7f352c150480 2024-09-10T08:28:47.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.758+0000 7f3528ff9640 1 -- 172.21.15.103:0/943673446 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3524007bd0 con 0x7f352c150480 2024-09-10T08:28:47.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.758+0000 7f3528ff9640 1 --2- 172.21.15.103:0/943673446 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f350c06be30 0x7f350c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:47.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.758+0000 7f3528ff9640 1 -- 172.21.15.103:0/943673446 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f35240abdd0 con 0x7f352c150480 2024-09-10T08:28:47.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.758+0000 7f352affd640 1 --2- 172.21.15.103:0/943673446 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f350c06be30 0x7f350c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:47.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.758+0000 7f352affd640 1 --2- 172.21.15.103:0/943673446 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f350c06be30 0x7f350c06e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f351c006fd0 tx=0x7f351c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:47.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.762+0000 7f3528ff9640 1 -- 172.21.15.103:0/943673446 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3524079e90 con 0x7f352c150480 2024-09-10T08:28:47.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.931+0000 7f35318d7640 1 -- 172.21.15.103:0/943673446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f352c1ef690 con 0x7f352c150480 2024-09-10T08:28:47.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.933+0000 7f3528ff9640 1 -- 172.21.15.103:0/943673446 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20512 (secure 0 0 0) 0x7f35240ad090 con 0x7f352c150480 2024-09-10T08:28:47.933 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:47.934 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","created":"2024-09-10T08:28:12.654957+0000","modified":"2024-09-10T08:28:46.948769+0000","last_up_change":"2024-09-10T08:28:25.445753+0000","last_in_change":"2024-09-10T08:28:14.741133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:24.821696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-10T08:28:33.488154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-10T08:28:33.857868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-10T08:28:44.793084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-10T08:28:45.930823+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1abe08f4-0348-435e-9f97-cec00e96992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6809","nonce":2707863099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6811","nonce":2707863099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6815","nonce":2707863099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6813","nonce":2707863099}]},"public_addr":"172.21.15.103:6809/2707863099","cluster_addr":"172.21.15.103:6811/2707863099","heartbeat_back_addr":"172.21.15.103:6815/2707863099","heartbeat_front_addr":"172.21.15.103:6813/2707863099","state":["exists","up"]},{"osd":1,"uuid":"df342e58-1026-4739-82f6-7a216707444c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6818","nonce":4029892782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6822","nonce":4029892782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6830","nonce":4029892782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6826","nonce":4029892782}]},"public_addr":"172.21.15.103:6818/4029892782","cluster_addr":"172.21.15.103:6822/4029892782","heartbeat_back_addr":"172.21.15.103:6830/4029892782","heartbeat_front_addr":"172.21.15.103:6826/4029892782","state":["exists","up"]},{"osd":2,"uuid":"f7aea2cf-208c-41ed-a0f6-8948d70b9a0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6819","nonce":428484432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6821","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6823","nonce":428484432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6829","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6831","nonce":428484432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6825","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6827","nonce":428484432}]},"public_addr":"172.21.15.103:6819/428484432","cluster_addr":"172.21.15.103:6823/428484432","heartbeat_back_addr":"172.21.15.103:6831/428484432","heartbeat_front_addr":"172.21.15.103:6827/428484432","state":["exists","up"]},{"osd":3,"uuid":"615ef8b0-12a5-4503-96d0-f7ec17dbc792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6801","nonce":3453676282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6803","nonce":3453676282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6807","nonce":3453676282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6805","nonce":3453676282}]},"public_addr":"172.21.15.103:6801/3453676282","cluster_addr":"172.21.15.103:6803/3453676282","heartbeat_back_addr":"172.21.15.103:6807/3453676282","heartbeat_front_addr":"172.21.15.103:6805/3453676282","state":["exists","up"]},{"osd":4,"uuid":"644c5e94-db18-4b83-b5cd-3762ae2647a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6809","nonce":1808157069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6811","nonce":1808157069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6815","nonce":1808157069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6813","nonce":1808157069}]},"public_addr":"172.21.15.154:6809/1808157069","cluster_addr":"172.21.15.154:6811/1808157069","heartbeat_back_addr":"172.21.15.154:6815/1808157069","heartbeat_front_addr":"172.21.15.154:6813/1808157069","state":["exists","up"]},{"osd":5,"uuid":"f40210bd-f4ca-442e-baac-729ced5a9f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6817","nonce":1048015779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6819","nonce":1048015779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6823","nonce":1048015779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6821","nonce":1048015779}]},"public_addr":"172.21.15.154:6817/1048015779","cluster_addr":"172.21.15.154:6819/1048015779","heartbeat_back_addr":"172.21.15.154:6823/1048015779","heartbeat_front_addr":"172.21.15.154:6821/1048015779","state":["exists","up"]},{"osd":6,"uuid":"eebac31e-aaef-47b0-90d7-4af08f36d7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6801","nonce":345273812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6803","nonce":345273812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6807","nonce":345273812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6805","nonce":345273812}]},"public_addr":"172.21.15.154:6801/345273812","cluster_addr":"172.21.15.154:6803/345273812","heartbeat_back_addr":"172.21.15.154:6807/345273812","heartbeat_front_addr":"172.21.15.154:6805/345273812","state":["exists","up"]},{"osd":7,"uuid":"58406c9a-036f-4618-bfb6-0beddbd71605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6825","nonce":3439481239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6827","nonce":3439481239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6831","nonce":3439481239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6829","nonce":3439481239}]},"public_addr":"172.21.15.154:6825/3439481239","cluster_addr":"172.21.15.154:6827/3439481239","heartbeat_back_addr":"172.21.15.154:6831/3439481239","heartbeat_front_addr":"172.21.15.154:6829/3439481239","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.032718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.126448+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.781158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.808718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.050591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.038245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.586989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.223326+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:28:47.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.934+0000 7f35318d7640 1 -- 172.21.15.103:0/943673446 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f350c06be30 msgr2=0x7f350c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:47.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.935+0000 7f35318d7640 1 --2- 172.21.15.103:0/943673446 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f350c06be30 0x7f350c06e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f351c006fd0 tx=0x7f351c008040 comp rx=0 tx=0).stop 2024-09-10T08:28:47.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.935+0000 7f35318d7640 1 -- 172.21.15.103:0/943673446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f352c150480 msgr2=0x7f352c149d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:47.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.935+0000 7f35318d7640 1 --2- 172.21.15.103:0/943673446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f352c150480 0x7f352c149d00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3524034040 tx=0x7f3524004a40 comp rx=0 tx=0).stop 2024-09-10T08:28:47.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.935+0000 7f35318d7640 1 -- 172.21.15.103:0/943673446 shutdown_connections 2024-09-10T08:28:47.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.935+0000 7f35318d7640 1 --2- 172.21.15.103:0/943673446 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f350c06be30 0x7f350c06e2f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.935+0000 7f35318d7640 1 --2- 172.21.15.103:0/943673446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f352c150480 0x7f352c149d00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.935+0000 7f35318d7640 1 --2- 172.21.15.103:0/943673446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f352c0c9c80 0x7f352c1e3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.935+0000 7f35318d7640 1 --2- 172.21.15.103:0/943673446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f352c06c650 0x7f352c157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.935+0000 7f35318d7640 1 -- 172.21.15.103:0/943673446 >> 172.21.15.103:0/943673446 conn(0x7f352c068030 msgr2=0x7f352c154d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:47.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.935+0000 7f35318d7640 1 -- 172.21.15.103:0/943673446 shutdown_connections 2024-09-10T08:28:47.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:47.935+0000 7f35318d7640 1 -- 172.21.15.103:0/943673446 wait complete. 2024-09-10T08:28:47.948 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:28:48.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.074+0000 7f5cadd3b640 1 Processor -- start 2024-09-10T08:28:48.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.074+0000 7f5cadd3b640 1 -- start start 2024-09-10T08:28:48.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.075+0000 7f5cadd3b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ca80afdd0 0x7f5ca80c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:48.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.075+0000 7f5cadd3b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ca80c54e0 con 0x7f5ca8153af0 2024-09-10T08:28:48.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.075+0000 7f5cadd3b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ca80c74a0 con 0x7f5ca80af870 2024-09-10T08:28:48.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.075+0000 7f5cadd3b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5ca80c7740 con 0x7f5ca80afdd0 2024-09-10T08:28:48.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.075+0000 7f5ca77fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5ca8153af0 0x7f5ca81563a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50082/0 (socket says 172.21.15.103:50082) 2024-09-10T08:28:48.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.075+0000 7f5ca77fe640 1 -- 172.21.15.103:0/1546611154 learned_addr learned my addr 172.21.15.103:0/1546611154 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:48.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.075+0000 7f5ca6ffd640 1 --2- 172.21.15.103:0/1546611154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ca80afdd0 0x7f5ca80c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:48.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.075+0000 7f5ca67fc640 1 -- 172.21.15.103:0/1546611154 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1717509688 0 0) 0x7f5ca80c54e0 con 0x7f5ca8153af0 2024-09-10T08:28:48.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.075+0000 7f5ca67fc640 1 -- 172.21.15.103:0/1546611154 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c90003520 con 0x7f5ca8153af0 2024-09-10T08:28:48.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.076+0000 7f5ca6ffd640 1 -- 172.21.15.103:0/1546611154 >> v1:172.21.15.154:6789/0 conn(0x7f5ca80af870 legacy=0x7f5ca80c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.076+0000 7f5ca6ffd640 1 -- 172.21.15.103:0/1546611154 >> v1:172.21.15.103:6789/0 conn(0x7f5ca8153af0 legacy=0x7f5ca81563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.076+0000 7f5ca67fc640 1 -- 172.21.15.103:0/1546611154 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 332858122 0 0) 0x7f5c90003520 con 0x7f5ca8153af0 2024-09-10T08:28:48.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.076+0000 7f5ca6ffd640 1 -- 172.21.15.103:0/1546611154 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca815a3c0 con 0x7f5ca80afdd0 2024-09-10T08:28:48.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.076+0000 7f5ca6ffd640 1 --2- 172.21.15.103:0/1546611154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ca80afdd0 0x7f5ca80c5900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c0097d0 tx=0x7f5c9c02a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f3340fb7f123f53 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:48.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.077+0000 7f5ca67fc640 1 -- 172.21.15.103:0/1546611154 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c037070 con 0x7f5ca80afdd0 2024-09-10T08:28:48.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.077+0000 7f5ca67fc640 1 -- 172.21.15.103:0/1546611154 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c9c02ab10 con 0x7f5ca80afdd0 2024-09-10T08:28:48.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.077+0000 7f5ca67fc640 1 -- 172.21.15.103:0/1546611154 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98001670 con 0x7f5ca80afdd0 2024-09-10T08:28:48.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.077+0000 7f5cadd3b640 1 -- 172.21.15.103:0/1546611154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ca80afdd0 msgr2=0x7f5ca80c5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.077+0000 7f5cadd3b640 1 --2- 172.21.15.103:0/1546611154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ca80afdd0 0x7f5ca80c5900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c0097d0 tx=0x7f5c9c02a080 comp rx=0 tx=0).stop 2024-09-10T08:28:48.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.077+0000 7f5cadd3b640 1 -- 172.21.15.103:0/1546611154 shutdown_connections 2024-09-10T08:28:48.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.077+0000 7f5cadd3b640 1 --2- 172.21.15.103:0/1546611154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ca80afdd0 0x7f5ca80c5900 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.077+0000 7f5cadd3b640 1 -- 172.21.15.103:0/1546611154 >> 172.21.15.103:0/1546611154 conn(0x7f5ca80c6880 msgr2=0x7f5ca80c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:48.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.077+0000 7f5cadd3b640 1 -- 172.21.15.103:0/1546611154 shutdown_connections 2024-09-10T08:28:48.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.077+0000 7f5cadd3b640 1 -- 172.21.15.103:0/1546611154 wait complete. 2024-09-10T08:28:48.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.078+0000 7f5cadd3b640 1 Processor -- start 2024-09-10T08:28:48.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.078+0000 7f5cadd3b640 1 -- start start 2024-09-10T08:28:48.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.079+0000 7f5cadd3b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ca80af870 0x7f5ca8156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:48.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.079+0000 7f5cadd3b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ca80afdd0 0x7f5ca8154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:48.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.079+0000 7f5cadd3b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ca8153af0 0x7f5ca8155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:48.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.079+0000 7f5cadd3b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca8154050 con 0x7f5ca8153af0 2024-09-10T08:28:48.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.079+0000 7f5cadd3b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca8153ed0 con 0x7f5ca80af870 2024-09-10T08:28:48.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.079+0000 7f5cadd3b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5ca80c4e90 con 0x7f5ca80afdd0 2024-09-10T08:28:48.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.079+0000 7f5ca7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ca8153af0 0x7f5ca8155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:48.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.079+0000 7f5ca7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ca8153af0 0x7f5ca8155490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57314/0 (socket says 172.21.15.103:57314) 2024-09-10T08:28:48.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.079+0000 7f5ca7fff640 1 -- 172.21.15.103:0/1707185556 learned_addr learned my addr 172.21.15.103:0/1707185556 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:48.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.079+0000 7f5ca6ffd640 1 --2- 172.21.15.103:0/1707185556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ca80afdd0 0x7f5ca8154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:48.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.079+0000 7f5ca77fe640 1 --2- 172.21.15.103:0/1707185556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ca80af870 0x7f5ca8156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:48.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.079+0000 7f5ca7fff640 1 -- 172.21.15.103:0/1707185556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ca80afdd0 msgr2=0x7f5ca8154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.079+0000 7f5ca7fff640 1 --2- 172.21.15.103:0/1707185556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ca80afdd0 0x7f5ca8154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.079+0000 7f5ca7fff640 1 -- 172.21.15.103:0/1707185556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ca80af870 msgr2=0x7f5ca8156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.079+0000 7f5ca7fff640 1 --2- 172.21.15.103:0/1707185556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ca80af870 0x7f5ca8156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.079+0000 7f5ca7fff640 1 -- 172.21.15.103:0/1707185556 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca81ef390 con 0x7f5ca8153af0 2024-09-10T08:28:48.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.080+0000 7f5ca7fff640 1 --2- 172.21.15.103:0/1707185556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ca8153af0 0x7f5ca8155490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5ca000c7d0 tx=0x7f5ca000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:48.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.080+0000 7f5c8ffff640 1 -- 172.21.15.103:0/1707185556 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca0003b70 con 0x7f5ca8153af0 2024-09-10T08:28:48.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.080+0000 7f5c8ffff640 1 -- 172.21.15.103:0/1707185556 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ca0003d30 con 0x7f5ca8153af0 2024-09-10T08:28:48.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.080+0000 7f5cadd3b640 1 -- 172.21.15.103:0/1707185556 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca81ef670 con 0x7f5ca8153af0 2024-09-10T08:28:48.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.080+0000 7f5c8ffff640 1 -- 172.21.15.103:0/1707185556 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca000aa90 con 0x7f5ca8153af0 2024-09-10T08:28:48.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.080+0000 7f5cadd3b640 1 -- 172.21.15.103:0/1707185556 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca81efc30 con 0x7f5ca8153af0 2024-09-10T08:28:48.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.081+0000 7f5cadd3b640 1 -- 172.21.15.103:0/1707185556 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca80c58e0 con 0x7f5ca8153af0 2024-09-10T08:28:48.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.081+0000 7f5c8ffff640 1 -- 172.21.15.103:0/1707185556 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ca000ac30 con 0x7f5ca8153af0 2024-09-10T08:28:48.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.082+0000 7f5c8ffff640 1 --2- 172.21.15.103:0/1707185556 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5c9406be30 0x7f5c9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:48.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.082+0000 7f5c8ffff640 1 -- 172.21.15.103:0/1707185556 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f5ca008af60 con 0x7f5ca8153af0 2024-09-10T08:28:48.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.082+0000 7f5ca77fe640 1 --2- 172.21.15.103:0/1707185556 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5c9406be30 0x7f5c9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:48.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.082+0000 7f5ca77fe640 1 --2- 172.21.15.103:0/1707185556 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5c9406be30 0x7f5c9406e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5c98005880 tx=0x7f5c98000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:48.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.086+0000 7f5c8ffff640 1 -- 172.21.15.103:0/1707185556 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5ca0058f90 con 0x7f5ca8153af0 2024-09-10T08:28:48.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.253+0000 7f5cadd3b640 1 -- 172.21.15.103:0/1707185556 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ca80c8630 con 0x7f5ca8153af0 2024-09-10T08:28:48.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.254+0000 7f5c8ffff640 1 -- 172.21.15.103:0/1707185556 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20512 (secure 0 0 0) 0x7f5ca005d290 con 0x7f5ca8153af0 2024-09-10T08:28:48.255 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:48.255 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","created":"2024-09-10T08:28:12.654957+0000","modified":"2024-09-10T08:28:46.948769+0000","last_up_change":"2024-09-10T08:28:25.445753+0000","last_in_change":"2024-09-10T08:28:14.741133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:24.821696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-10T08:28:33.488154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-10T08:28:33.857868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-10T08:28:44.793084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-10T08:28:45.930823+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1abe08f4-0348-435e-9f97-cec00e96992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6809","nonce":2707863099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6811","nonce":2707863099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6815","nonce":2707863099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6813","nonce":2707863099}]},"public_addr":"172.21.15.103:6809/2707863099","cluster_addr":"172.21.15.103:6811/2707863099","heartbeat_back_addr":"172.21.15.103:6815/2707863099","heartbeat_front_addr":"172.21.15.103:6813/2707863099","state":["exists","up"]},{"osd":1,"uuid":"df342e58-1026-4739-82f6-7a216707444c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6818","nonce":4029892782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6822","nonce":4029892782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6830","nonce":4029892782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6826","nonce":4029892782}]},"public_addr":"172.21.15.103:6818/4029892782","cluster_addr":"172.21.15.103:6822/4029892782","heartbeat_back_addr":"172.21.15.103:6830/4029892782","heartbeat_front_addr":"172.21.15.103:6826/4029892782","state":["exists","up"]},{"osd":2,"uuid":"f7aea2cf-208c-41ed-a0f6-8948d70b9a0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6819","nonce":428484432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6821","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6823","nonce":428484432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6829","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6831","nonce":428484432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6825","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6827","nonce":428484432}]},"public_addr":"172.21.15.103:6819/428484432","cluster_addr":"172.21.15.103:6823/428484432","heartbeat_back_addr":"172.21.15.103:6831/428484432","heartbeat_front_addr":"172.21.15.103:6827/428484432","state":["exists","up"]},{"osd":3,"uuid":"615ef8b0-12a5-4503-96d0-f7ec17dbc792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6801","nonce":3453676282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6803","nonce":3453676282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6807","nonce":3453676282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6805","nonce":3453676282}]},"public_addr":"172.21.15.103:6801/3453676282","cluster_addr":"172.21.15.103:6803/3453676282","heartbeat_back_addr":"172.21.15.103:6807/3453676282","heartbeat_front_addr":"172.21.15.103:6805/3453676282","state":["exists","up"]},{"osd":4,"uuid":"644c5e94-db18-4b83-b5cd-3762ae2647a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6809","nonce":1808157069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6811","nonce":1808157069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6815","nonce":1808157069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6813","nonce":1808157069}]},"public_addr":"172.21.15.154:6809/1808157069","cluster_addr":"172.21.15.154:6811/1808157069","heartbeat_back_addr":"172.21.15.154:6815/1808157069","heartbeat_front_addr":"172.21.15.154:6813/1808157069","state":["exists","up"]},{"osd":5,"uuid":"f40210bd-f4ca-442e-baac-729ced5a9f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6817","nonce":1048015779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6819","nonce":1048015779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6823","nonce":1048015779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6821","nonce":1048015779}]},"public_addr":"172.21.15.154:6817/1048015779","cluster_addr":"172.21.15.154:6819/1048015779","heartbeat_back_addr":"172.21.15.154:6823/1048015779","heartbeat_front_addr":"172.21.15.154:6821/1048015779","state":["exists","up"]},{"osd":6,"uuid":"eebac31e-aaef-47b0-90d7-4af08f36d7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6801","nonce":345273812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6803","nonce":345273812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6807","nonce":345273812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6805","nonce":345273812}]},"public_addr":"172.21.15.154:6801/345273812","cluster_addr":"172.21.15.154:6803/345273812","heartbeat_back_addr":"172.21.15.154:6807/345273812","heartbeat_front_addr":"172.21.15.154:6805/345273812","state":["exists","up"]},{"osd":7,"uuid":"58406c9a-036f-4618-bfb6-0beddbd71605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6825","nonce":3439481239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6827","nonce":3439481239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6831","nonce":3439481239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6829","nonce":3439481239}]},"public_addr":"172.21.15.154:6825/3439481239","cluster_addr":"172.21.15.154:6827/3439481239","heartbeat_back_addr":"172.21.15.154:6831/3439481239","heartbeat_front_addr":"172.21.15.154:6829/3439481239","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.032718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.126448+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.781158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.808718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.050591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.038245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.586989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.223326+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:28:48.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.256+0000 7f5cadd3b640 1 -- 172.21.15.103:0/1707185556 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5c9406be30 msgr2=0x7f5c9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.256+0000 7f5cadd3b640 1 --2- 172.21.15.103:0/1707185556 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5c9406be30 0x7f5c9406e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5c98005880 tx=0x7f5c98000bc0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.256+0000 7f5cadd3b640 1 -- 172.21.15.103:0/1707185556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ca8153af0 msgr2=0x7f5ca8155490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.256+0000 7f5cadd3b640 1 --2- 172.21.15.103:0/1707185556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ca8153af0 0x7f5ca8155490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5ca000c7d0 tx=0x7f5ca000cc90 comp rx=0 tx=0).stop 2024-09-10T08:28:48.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.256+0000 7f5cadd3b640 1 -- 172.21.15.103:0/1707185556 shutdown_connections 2024-09-10T08:28:48.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.256+0000 7f5cadd3b640 1 --2- 172.21.15.103:0/1707185556 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5c9406be30 0x7f5c9406e2f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.256+0000 7f5cadd3b640 1 --2- 172.21.15.103:0/1707185556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ca8153af0 0x7f5ca8155490 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.256+0000 7f5cadd3b640 1 --2- 172.21.15.103:0/1707185556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ca80afdd0 0x7f5ca8154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.256+0000 7f5cadd3b640 1 --2- 172.21.15.103:0/1707185556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ca80af870 0x7f5ca8156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.256+0000 7f5cadd3b640 1 -- 172.21.15.103:0/1707185556 >> 172.21.15.103:0/1707185556 conn(0x7f5ca80c6880 msgr2=0x7f5ca8159820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:48.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.256+0000 7f5cadd3b640 1 -- 172.21.15.103:0/1707185556 shutdown_connections 2024-09-10T08:28:48.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.256+0000 7f5cadd3b640 1 -- 172.21.15.103:0/1707185556 wait complete. 2024-09-10T08:28:48.268 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b standby_count_wanted 0 2024-09-10T08:28:48.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.371+0000 7faab09c4640 1 Processor -- start 2024-09-10T08:28:48.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.371+0000 7faab09c4640 1 -- start start 2024-09-10T08:28:48.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.372+0000 7faab09c4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faaac0c6850 0x7faaac073d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:48.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.372+0000 7faab09c4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faaac15a5c0 0x7faaac0c50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:48.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.372+0000 7faab09c4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaac0745f0 con 0x7faaac0734c0 2024-09-10T08:28:48.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.372+0000 7faab09c4640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7faaac0c86d0 con 0x7faaac0c6850 2024-09-10T08:28:48.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.372+0000 7faab09c4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7faaac0c89b0 con 0x7faaac15a5c0 2024-09-10T08:28:48.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.372+0000 7faaaa59c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faaac0c6850 0x7faaac073d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:48.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.372+0000 7faaaa59c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faaac0c6850 0x7faaac073d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57318/0 (socket says 172.21.15.103:57318) 2024-09-10T08:28:48.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.372+0000 7faaaa59c640 1 -- 172.21.15.103:0/90671530 learned_addr learned my addr 172.21.15.103:0/90671530 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:48.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.372+0000 7faaa9d9b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7faaac0734c0 0x7faaac159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50084/0 (socket says 172.21.15.103:50084) 2024-09-10T08:28:48.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.372+0000 7faaaad9d640 1 --2- 172.21.15.103:0/90671530 >> v2:172.21.15.154:3300/0 conn(0x7faaac15a5c0 0x7faaac0c50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:48.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.372+0000 7faaaa59c640 1 -- 172.21.15.103:0/90671530 >> v2:172.21.15.154:3300/0 conn(0x7faaac15a5c0 msgr2=0x7faaac0c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:48.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.372+0000 7faaaa59c640 1 --2- 172.21.15.103:0/90671530 >> v2:172.21.15.154:3300/0 conn(0x7faaac15a5c0 0x7faaac0c50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.372+0000 7faaaa59c640 1 -- 172.21.15.103:0/90671530 >> v1:172.21.15.103:6789/0 conn(0x7faaac0734c0 legacy=0x7faaac159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.372+0000 7faaa959a640 1 -- 172.21.15.103:0/90671530 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3882417288 0 0) 0x7faaac0745f0 con 0x7faaac0734c0 2024-09-10T08:28:48.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.372+0000 7faaaa59c640 1 -- 172.21.15.103:0/90671530 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaac0c8c90 con 0x7faaac0c6850 2024-09-10T08:28:48.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.373+0000 7faaaa59c640 1 --2- 172.21.15.103:0/90671530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaac0c6850 0x7faaac073d10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faaac072d70 tx=0x7faa9c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381173f223615869 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:48.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.373+0000 7faaa959a640 1 -- 172.21.15.103:0/90671530 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c037070 con 0x7faaac0c6850 2024-09-10T08:28:48.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.373+0000 7faaa959a640 1 -- 172.21.15.103:0/90671530 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa9c032440 con 0x7faaac0c6850 2024-09-10T08:28:48.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.373+0000 7faaa959a640 1 -- 172.21.15.103:0/90671530 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c032810 con 0x7faaac0c6850 2024-09-10T08:28:48.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.373+0000 7faab09c4640 1 -- 172.21.15.103:0/90671530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaac0c6850 msgr2=0x7faaac073d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.373+0000 7faab09c4640 1 --2- 172.21.15.103:0/90671530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaac0c6850 0x7faaac073d10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faaac072d70 tx=0x7faa9c02a270 comp rx=0 tx=0).stop 2024-09-10T08:28:48.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.373+0000 7faab09c4640 1 -- 172.21.15.103:0/90671530 shutdown_connections 2024-09-10T08:28:48.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.373+0000 7faab09c4640 1 --2- 172.21.15.103:0/90671530 >> v2:172.21.15.154:3300/0 conn(0x7faaac15a5c0 0x7faaac0c50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.373+0000 7faab09c4640 1 --2- 172.21.15.103:0/90671530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaac0c6850 0x7faaac073d10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.373+0000 7faab09c4640 1 -- 172.21.15.103:0/90671530 >> 172.21.15.103:0/90671530 conn(0x7faaac0c9c00 msgr2=0x7faaac0ca010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:48.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.374+0000 7faab09c4640 1 -- 172.21.15.103:0/90671530 shutdown_connections 2024-09-10T08:28:48.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.374+0000 7faab09c4640 1 -- 172.21.15.103:0/90671530 wait complete. 2024-09-10T08:28:48.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.375+0000 7faab09c4640 1 Processor -- start 2024-09-10T08:28:48.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.375+0000 7faab09c4640 1 -- start start 2024-09-10T08:28:48.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.375+0000 7faab09c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaac0734c0 0x7faaac1502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:48.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.375+0000 7faab09c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaac0c6850 0x7faaac154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:48.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.375+0000 7faab09c4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaac15a5c0 0x7faaac1ec960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:48.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.375+0000 7faab09c4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faaac0c6db0 con 0x7faaac0734c0 2024-09-10T08:28:48.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.375+0000 7faab09c4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faaac0c6c30 con 0x7faaac0c6850 2024-09-10T08:28:48.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.375+0000 7faab09c4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7faaac0c55f0 con 0x7faaac15a5c0 2024-09-10T08:28:48.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.376+0000 7faaaa59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaac0734c0 0x7faaac1502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:48.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.376+0000 7faaaa59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaac0734c0 0x7faaac1502d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57324/0 (socket says 172.21.15.103:57324) 2024-09-10T08:28:48.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.376+0000 7faaaa59c640 1 -- 172.21.15.103:0/1850143097 learned_addr learned my addr 172.21.15.103:0/1850143097 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:48.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.376+0000 7faaaad9d640 1 --2- 172.21.15.103:0/1850143097 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaac15a5c0 0x7faaac1ec960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:48.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.376+0000 7faaa9d9b640 1 --2- 172.21.15.103:0/1850143097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaac0c6850 0x7faaac154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:48.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.376+0000 7faaaa59c640 1 -- 172.21.15.103:0/1850143097 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaac15a5c0 msgr2=0x7faaac1ec960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.376+0000 7faaaa59c640 1 --2- 172.21.15.103:0/1850143097 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaac15a5c0 0x7faaac1ec960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.376+0000 7faaaa59c640 1 -- 172.21.15.103:0/1850143097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaac0c6850 msgr2=0x7faaac154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.376+0000 7faaaa59c640 1 --2- 172.21.15.103:0/1850143097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaac0c6850 0x7faaac154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.376+0000 7faaaa59c640 1 -- 172.21.15.103:0/1850143097 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaac1e1d90 con 0x7faaac0734c0 2024-09-10T08:28:48.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.376+0000 7faaa9d9b640 1 --2- 172.21.15.103:0/1850143097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaac0c6850 0x7faaac154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:48.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.376+0000 7faaaa59c640 1 --2- 172.21.15.103:0/1850143097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaac0734c0 0x7faaac1502d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faa9c02a2b0 tx=0x7faa9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:48.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.376+0000 7faa9affd640 1 -- 172.21.15.103:0/1850143097 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c041020 con 0x7faaac0734c0 2024-09-10T08:28:48.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.376+0000 7faa9affd640 1 -- 172.21.15.103:0/1850143097 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa9c0306c0 con 0x7faaac0734c0 2024-09-10T08:28:48.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.376+0000 7faab09c4640 1 -- 172.21.15.103:0/1850143097 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaac1e2840 con 0x7faaac0734c0 2024-09-10T08:28:48.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.376+0000 7faa9affd640 1 -- 172.21.15.103:0/1850143097 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c037040 con 0x7faaac0734c0 2024-09-10T08:28:48.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.376+0000 7faab09c4640 1 -- 172.21.15.103:0/1850143097 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaac1ec160 con 0x7faaac0734c0 2024-09-10T08:28:48.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.377+0000 7faab09c4640 1 -- 172.21.15.103:0/1850143097 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaac0695d0 con 0x7faaac0734c0 2024-09-10T08:28:48.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.378+0000 7faa9affd640 1 -- 172.21.15.103:0/1850143097 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa9c044020 con 0x7faaac0734c0 2024-09-10T08:28:48.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.378+0000 7faa9affd640 1 --2- 172.21.15.103:0/1850143097 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7faa8c06be30 0x7faa8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:48.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.378+0000 7faaa9d9b640 1 --2- 172.21.15.103:0/1850143097 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7faa8c06be30 0x7faa8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:48.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.378+0000 7faa9affd640 1 -- 172.21.15.103:0/1850143097 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7faa9c0ab8f0 con 0x7faaac0734c0 2024-09-10T08:28:48.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.378+0000 7faaa9d9b640 1 --2- 172.21.15.103:0/1850143097 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7faa8c06be30 0x7faa8c06e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faaac15a4e0 tx=0x7faaa0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:48.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.382+0000 7faa9affd640 1 -- 172.21.15.103:0/1850143097 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faaac0695d0 con 0x7faaac0734c0 2024-09-10T08:28:48.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.581+0000 7faab09c4640 1 -- 172.21.15.103:0/1850143097 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7faaac0c59e0 con 0x7faaac0734c0 2024-09-10T08:28:48.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.623+0000 7faa9affd640 1 -- 172.21.15.103:0/1850143097 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"}]=0 v9) ==== 113+0+0 (secure 0 0 0) 0x7faa9c04b030 con 0x7faaac0734c0 2024-09-10T08:28:48.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.626+0000 7faab09c4640 1 -- 172.21.15.103:0/1850143097 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7faa8c06be30 msgr2=0x7faa8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.626+0000 7faab09c4640 1 --2- 172.21.15.103:0/1850143097 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7faa8c06be30 0x7faa8c06e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faaac15a4e0 tx=0x7faaa0009040 comp rx=0 tx=0).stop 2024-09-10T08:28:48.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.626+0000 7faab09c4640 1 -- 172.21.15.103:0/1850143097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaac0734c0 msgr2=0x7faaac1502d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.626+0000 7faab09c4640 1 --2- 172.21.15.103:0/1850143097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaac0734c0 0x7faaac1502d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faa9c02a2b0 tx=0x7faa9c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.626+0000 7faab09c4640 1 -- 172.21.15.103:0/1850143097 shutdown_connections 2024-09-10T08:28:48.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.626+0000 7faab09c4640 1 --2- 172.21.15.103:0/1850143097 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7faa8c06be30 0x7faa8c06e2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.626+0000 7faab09c4640 1 --2- 172.21.15.103:0/1850143097 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaac15a5c0 0x7faaac1ec960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.626+0000 7faab09c4640 1 --2- 172.21.15.103:0/1850143097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaac0c6850 0x7faaac154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.626+0000 7faab09c4640 1 --2- 172.21.15.103:0/1850143097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaac0734c0 0x7faaac1502d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.626+0000 7faab09c4640 1 -- 172.21.15.103:0/1850143097 >> 172.21.15.103:0/1850143097 conn(0x7faaac0c9c00 msgr2=0x7faaac1582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:48.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.626+0000 7faab09c4640 1 -- 172.21.15.103:0/1850143097 shutdown_connections 2024-09-10T08:28:48.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.626+0000 7faab09c4640 1 -- 172.21.15.103:0/1850143097 wait complete. 2024-09-10T08:28:48.638 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-09-10T08:28:48.639 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b allow_standby_replay false 2024-09-10T08:28:48.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.741+0000 7f19d9277640 1 Processor -- start 2024-09-10T08:28:48.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.741+0000 7f19d9277640 1 -- start start 2024-09-10T08:28:48.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.741+0000 7f19d9277640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f19d40c7bb0 0x7f19d40c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:48.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.741+0000 7f19d9277640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19d4156310 0x7f19d41567a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:48.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.741+0000 7f19d9277640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19d4159900 con 0x7f19d4153a40 2024-09-10T08:28:48.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.741+0000 7f19d9277640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f19d4159be0 con 0x7f19d40c7bb0 2024-09-10T08:28:48.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.741+0000 7f19d9277640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f19d4159ec0 con 0x7f19d4156310 2024-09-10T08:28:48.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.742+0000 7f19d27fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f19d40c7bb0 0x7f19d40c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:48.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.742+0000 7f19d27fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f19d40c7bb0 0x7f19d40c7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57328/0 (socket says 172.21.15.103:57328) 2024-09-10T08:28:48.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.742+0000 7f19d27fc640 1 -- 172.21.15.103:0/1215428632 learned_addr learned my addr 172.21.15.103:0/1215428632 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:48.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.742+0000 7f19d37fe640 1 --2- 172.21.15.103:0/1215428632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19d4156310 0x7f19d41567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:48.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.742+0000 7f19d27fc640 1 -- 172.21.15.103:0/1215428632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19d4156310 msgr2=0x7f19d41567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:48.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.742+0000 7f19d27fc640 1 --2- 172.21.15.103:0/1215428632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19d4156310 0x7f19d41567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.742+0000 7f19d27fc640 1 -- 172.21.15.103:0/1215428632 >> v1:172.21.15.154:6789/0 conn(0x7f19d4153a40 legacy=0x7f19d406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:48.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.742+0000 7f19d27fc640 1 -- 172.21.15.103:0/1215428632 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d415a1a0 con 0x7f19d40c7bb0 2024-09-10T08:28:48.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.742+0000 7f19d27fc640 1 --2- 172.21.15.103:0/1215428632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d40c7bb0 0x7f19d40c7ff0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009870 tx=0x7f19c802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b83c36fe11b3970 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:48.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.743+0000 7f19d1ffb640 1 -- 172.21.15.103:0/1215428632 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c8037070 con 0x7f19d40c7bb0 2024-09-10T08:28:48.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.743+0000 7f19d1ffb640 1 -- 172.21.15.103:0/1215428632 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c8032440 con 0x7f19d40c7bb0 2024-09-10T08:28:48.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.743+0000 7f19d1ffb640 1 -- 172.21.15.103:0/1215428632 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c8032810 con 0x7f19d40c7bb0 2024-09-10T08:28:48.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.743+0000 7f19d9277640 1 -- 172.21.15.103:0/1215428632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d40c7bb0 msgr2=0x7f19d40c7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.743+0000 7f19d9277640 1 --2- 172.21.15.103:0/1215428632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d40c7bb0 0x7f19d40c7ff0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009870 tx=0x7f19c802a210 comp rx=0 tx=0).stop 2024-09-10T08:28:48.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.743+0000 7f19d9277640 1 -- 172.21.15.103:0/1215428632 shutdown_connections 2024-09-10T08:28:48.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.743+0000 7f19d9277640 1 --2- 172.21.15.103:0/1215428632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19d4156310 0x7f19d41567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.743+0000 7f19d9277640 1 --2- 172.21.15.103:0/1215428632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d40c7bb0 0x7f19d40c7ff0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.743+0000 7f19d9277640 1 -- 172.21.15.103:0/1215428632 >> 172.21.15.103:0/1215428632 conn(0x7f19d4073310 msgr2=0x7f19d40736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:48.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.743+0000 7f19d9277640 1 -- 172.21.15.103:0/1215428632 shutdown_connections 2024-09-10T08:28:48.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.743+0000 7f19d9277640 1 -- 172.21.15.103:0/1215428632 wait complete. 2024-09-10T08:28:48.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.744+0000 7f19d9277640 1 Processor -- start 2024-09-10T08:28:48.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.744+0000 7f19d9277640 1 -- start start 2024-09-10T08:28:48.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.745+0000 7f19d9277640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19d40c7bb0 0x7f19d41ef520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:48.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.745+0000 7f19d9277640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19d4153a40 0x7f19d414a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:48.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.745+0000 7f19d9277640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d4156310 0x7f19d414a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:48.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.745+0000 7f19d9277640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f19d406cdb0 con 0x7f19d4156310 2024-09-10T08:28:48.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.745+0000 7f19d9277640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f19d40c9270 con 0x7f19d4153a40 2024-09-10T08:28:48.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.745+0000 7f19d9277640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f19d4153210 con 0x7f19d40c7bb0 2024-09-10T08:28:48.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.745+0000 7f19d37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d4156310 0x7f19d414a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:48.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.745+0000 7f19d37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d4156310 0x7f19d414a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57344/0 (socket says 172.21.15.103:57344) 2024-09-10T08:28:48.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.745+0000 7f19d37fe640 1 -- 172.21.15.103:0/3909735595 learned_addr learned my addr 172.21.15.103:0/3909735595 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:48.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.745+0000 7f19d2ffd640 1 --2- 172.21.15.103:0/3909735595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19d40c7bb0 0x7f19d41ef520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:48.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.745+0000 7f19d27fc640 1 --2- 172.21.15.103:0/3909735595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19d4153a40 0x7f19d414a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:48.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.745+0000 7f19d37fe640 1 -- 172.21.15.103:0/3909735595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19d40c7bb0 msgr2=0x7f19d41ef520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.745+0000 7f19d37fe640 1 --2- 172.21.15.103:0/3909735595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19d40c7bb0 0x7f19d41ef520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.745+0000 7f19d37fe640 1 -- 172.21.15.103:0/3909735595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19d4153a40 msgr2=0x7f19d414a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.745+0000 7f19d37fe640 1 --2- 172.21.15.103:0/3909735595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19d4153a40 0x7f19d414a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.745+0000 7f19d37fe640 1 -- 172.21.15.103:0/3909735595 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d41580e0 con 0x7f19d4156310 2024-09-10T08:28:48.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.745+0000 7f19d2ffd640 1 --2- 172.21.15.103:0/3909735595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19d40c7bb0 0x7f19d41ef520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:48.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.746+0000 7f19d37fe640 1 --2- 172.21.15.103:0/3909735595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d4156310 0x7f19d414a610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f19c400cc30 tx=0x7f19c400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:48.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.746+0000 7f19bb7fe640 1 -- 172.21.15.103:0/3909735595 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c400ce40 con 0x7f19d4156310 2024-09-10T08:28:48.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.746+0000 7f19bb7fe640 1 -- 172.21.15.103:0/3909735595 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c4003990 con 0x7f19d4156310 2024-09-10T08:28:48.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.746+0000 7f19d9277640 1 -- 172.21.15.103:0/3909735595 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d41efe60 con 0x7f19d4156310 2024-09-10T08:28:48.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.746+0000 7f19bb7fe640 1 -- 172.21.15.103:0/3909735595 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c4003d40 con 0x7f19d4156310 2024-09-10T08:28:48.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.746+0000 7f19d9277640 1 -- 172.21.15.103:0/3909735595 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d41f0140 con 0x7f19d4156310 2024-09-10T08:28:48.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.747+0000 7f19d9277640 1 -- 172.21.15.103:0/3909735595 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19d4153e20 con 0x7f19d4156310 2024-09-10T08:28:48.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.747+0000 7f19bb7fe640 1 -- 172.21.15.103:0/3909735595 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f19c4004000 con 0x7f19d4156310 2024-09-10T08:28:48.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.748+0000 7f19bb7fe640 1 --2- 172.21.15.103:0/3909735595 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f19c006be30 0x7f19c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:48.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.748+0000 7f19bb7fe640 1 -- 172.21.15.103:0/3909735595 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f19c408b5c0 con 0x7f19d4156310 2024-09-10T08:28:48.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.748+0000 7f19d2ffd640 1 --2- 172.21.15.103:0/3909735595 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f19c006be30 0x7f19c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:48.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.748+0000 7f19d2ffd640 1 --2- 172.21.15.103:0/3909735595 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f19c006be30 0x7f19c006e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f19d414ae20 tx=0x7f19cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:48.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.752+0000 7f19bb7fe640 1 -- 172.21.15.103:0/3909735595 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f19c4014030 con 0x7f19d4156310 2024-09-10T08:28:48.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:48.951+0000 7f19d9277640 1 -- 172.21.15.103:0/3909735595 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f19d40c5fa0 con 0x7f19d4156310 2024-09-10T08:28:49.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.630+0000 7f19bb7fe640 1 -- 172.21.15.103:0/3909735595 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"}]=0 v10) ==== 117+0+0 (secure 0 0 0) 0x7f19c4059cd0 con 0x7f19d4156310 2024-09-10T08:28:49.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.633+0000 7f19d9277640 1 -- 172.21.15.103:0/3909735595 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f19c006be30 msgr2=0x7f19c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:49.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.633+0000 7f19d9277640 1 --2- 172.21.15.103:0/3909735595 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f19c006be30 0x7f19c006e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f19d414ae20 tx=0x7f19cc009040 comp rx=0 tx=0).stop 2024-09-10T08:28:49.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.633+0000 7f19d9277640 1 -- 172.21.15.103:0/3909735595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d4156310 msgr2=0x7f19d414a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:49.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.633+0000 7f19d9277640 1 --2- 172.21.15.103:0/3909735595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d4156310 0x7f19d414a610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f19c400cc30 tx=0x7f19c400a5c0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.633+0000 7f19d9277640 1 -- 172.21.15.103:0/3909735595 shutdown_connections 2024-09-10T08:28:49.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.633+0000 7f19d9277640 1 --2- 172.21.15.103:0/3909735595 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f19c006be30 0x7f19c006e2f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.633+0000 7f19d9277640 1 --2- 172.21.15.103:0/3909735595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19d4156310 0x7f19d414a610 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.633+0000 7f19d9277640 1 --2- 172.21.15.103:0/3909735595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19d4153a40 0x7f19d414a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.633+0000 7f19d9277640 1 --2- 172.21.15.103:0/3909735595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19d40c7bb0 0x7f19d41ef520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.633+0000 7f19d9277640 1 -- 172.21.15.103:0/3909735595 >> 172.21.15.103:0/3909735595 conn(0x7f19d4073310 msgr2=0x7f19d406c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:49.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.633+0000 7f19d9277640 1 -- 172.21.15.103:0/3909735595 shutdown_connections 2024-09-10T08:28:49.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.633+0000 7f19d9277640 1 -- 172.21.15.103:0/3909735595 wait complete. 2024-09-10T08:28:49.647 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b session_timeout 300 2024-09-10T08:28:49.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.753+0000 7f693468d640 1 Processor -- start 2024-09-10T08:28:49.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.753+0000 7f693468d640 1 -- start start 2024-09-10T08:28:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.754+0000 7f693468d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f692c159b30 0x7f692c159f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.754+0000 7f693468d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f692c06cbc0 con 0x7f692c0c9c60 2024-09-10T08:28:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.754+0000 7f693468d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f692c06cea0 con 0x7f692c067a50 2024-09-10T08:28:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.754+0000 7f693468d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f692c0c66e0 con 0x7f692c159b30 2024-09-10T08:28:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.754+0000 7f6932429640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f692c159b30 0x7f692c159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.754+0000 7f6931c28640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f692c0c9c60 0x7f692c14feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50096/0 (socket says 172.21.15.103:50096) 2024-09-10T08:28:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.754+0000 7f6931c28640 1 -- 172.21.15.103:0/3289472193 learned_addr learned my addr 172.21.15.103:0/3289472193 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.754+0000 7f6932429640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f692c159b30 0x7f692c159f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57348/0 (socket says 172.21.15.103:57348) 2024-09-10T08:28:49.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.754+0000 7f6932429640 1 -- 172.21.15.103:0/3289472193 >> v1:172.21.15.154:6789/0 conn(0x7f692c067a50 legacy=0x7f692c067ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:49.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.754+0000 7f6932429640 1 -- 172.21.15.103:0/3289472193 >> v1:172.21.15.103:6789/0 conn(0x7f692c0c9c60 legacy=0x7f692c14feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:49.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.754+0000 7f6932429640 1 -- 172.21.15.103:0/3289472193 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f692c0c6930 con 0x7f692c159b30 2024-09-10T08:28:49.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.754+0000 7f6931427640 1 -- 172.21.15.103:0/3289472193 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3756364227 0 0) 0x7f692c06cbc0 con 0x7f692c0c9c60 2024-09-10T08:28:49.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.755+0000 7f6932429640 1 --2- 172.21.15.103:0/3289472193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f692c159b30 0x7f692c159f10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f69280097a0 tx=0x7f692802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209ecfe032485b82 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:49.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.755+0000 7f6931427640 1 -- 172.21.15.103:0/3289472193 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928037070 con 0x7f692c159b30 2024-09-10T08:28:49.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.755+0000 7f6931427640 1 -- 172.21.15.103:0/3289472193 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692802adc0 con 0x7f692c159b30 2024-09-10T08:28:49.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.755+0000 7f6931427640 1 -- 172.21.15.103:0/3289472193 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928032660 con 0x7f692c159b30 2024-09-10T08:28:49.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.756+0000 7f693468d640 1 -- 172.21.15.103:0/3289472193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f692c159b30 msgr2=0x7f692c159f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.756+0000 7f693468d640 1 --2- 172.21.15.103:0/3289472193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f692c159b30 0x7f692c159f10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f69280097a0 tx=0x7f692802a0b0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.756+0000 7f693468d640 1 -- 172.21.15.103:0/3289472193 shutdown_connections 2024-09-10T08:28:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.756+0000 7f693468d640 1 --2- 172.21.15.103:0/3289472193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f692c159b30 0x7f692c159f10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.756+0000 7f693468d640 1 -- 172.21.15.103:0/3289472193 >> 172.21.15.103:0/3289472193 conn(0x7f692c0cbd60 msgr2=0x7f692c0cc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.756+0000 7f693468d640 1 -- 172.21.15.103:0/3289472193 shutdown_connections 2024-09-10T08:28:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.756+0000 7f693468d640 1 -- 172.21.15.103:0/3289472193 wait complete. 2024-09-10T08:28:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.757+0000 7f693468d640 1 Processor -- start 2024-09-10T08:28:49.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.757+0000 7f693468d640 1 -- start start 2024-09-10T08:28:49.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.758+0000 7f693468d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f692c067a50 0x7f692c1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.758+0000 7f693468d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f692c0c9c60 0x7f692c1526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.758+0000 7f693468d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f692c159b30 0x7f692c152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.758+0000 7f693468d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f692c0685f0 con 0x7f692c0c9c60 2024-09-10T08:28:49.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.758+0000 7f693468d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f692c0cc880 con 0x7f692c159b30 2024-09-10T08:28:49.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.758+0000 7f693468d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f692c1ed1c0 con 0x7f692c067a50 2024-09-10T08:28:49.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.758+0000 7f6931c28640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f692c0c9c60 0x7f692c1526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.758+0000 7f6931c28640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f692c0c9c60 0x7f692c1526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57360/0 (socket says 172.21.15.103:57360) 2024-09-10T08:28:49.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.758+0000 7f6931c28640 1 -- 172.21.15.103:0/4244612154 learned_addr learned my addr 172.21.15.103:0/4244612154 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:49.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.758+0000 7f6932429640 1 --2- 172.21.15.103:0/4244612154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f692c067a50 0x7f692c1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.758+0000 7f6932c2a640 1 --2- 172.21.15.103:0/4244612154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f692c159b30 0x7f692c152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.758+0000 7f6931c28640 1 -- 172.21.15.103:0/4244612154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f692c067a50 msgr2=0x7f692c1568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:49.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.758+0000 7f6931c28640 1 --2- 172.21.15.103:0/4244612154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f692c067a50 0x7f692c1568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.758+0000 7f6931c28640 1 -- 172.21.15.103:0/4244612154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f692c159b30 msgr2=0x7f692c152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.758+0000 7f6931c28640 1 --2- 172.21.15.103:0/4244612154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f692c159b30 0x7f692c152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.758+0000 7f6931c28640 1 -- 172.21.15.103:0/4244612154 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f692c1555d0 con 0x7f692c0c9c60 2024-09-10T08:28:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.758+0000 7f6931c28640 1 --2- 172.21.15.103:0/4244612154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f692c0c9c60 0x7f692c1526a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f691c00c460 tx=0x7f691c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.758+0000 7f6922ffd640 1 -- 172.21.15.103:0/4244612154 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691c018070 con 0x7f692c0c9c60 2024-09-10T08:28:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.758+0000 7f6922ffd640 1 -- 172.21.15.103:0/4244612154 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f691c007520 con 0x7f692c0c9c60 2024-09-10T08:28:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.758+0000 7f693468d640 1 -- 172.21.15.103:0/4244612154 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f692c1558b0 con 0x7f692c0c9c60 2024-09-10T08:28:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.758+0000 7f6922ffd640 1 -- 172.21.15.103:0/4244612154 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691c004a20 con 0x7f692c0c9c60 2024-09-10T08:28:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.758+0000 7f693468d640 1 -- 172.21.15.103:0/4244612154 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f692c1ece50 con 0x7f692c0c9c60 2024-09-10T08:28:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.759+0000 7f693468d640 1 -- 172.21.15.103:0/4244612154 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f692c067ee0 con 0x7f692c0c9c60 2024-09-10T08:28:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.760+0000 7f6922ffd640 1 -- 172.21.15.103:0/4244612154 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f691c01b070 con 0x7f692c0c9c60 2024-09-10T08:28:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.760+0000 7f6922ffd640 1 --2- 172.21.15.103:0/4244612154 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f691006be60 0x7f691006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.760+0000 7f6932429640 1 --2- 172.21.15.103:0/4244612154 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f691006be60 0x7f691006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.760+0000 7f6922ffd640 1 -- 172.21.15.103:0/4244612154 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f691c08a530 con 0x7f692c0c9c60 2024-09-10T08:28:49.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.761+0000 7f6932429640 1 --2- 172.21.15.103:0/4244612154 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f691006be60 0x7f691006e320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6928034000 tx=0x7f692802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:49.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.765+0000 7f6922ffd640 1 -- 172.21.15.103:0/4244612154 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f691c058bb0 con 0x7f692c0c9c60 2024-09-10T08:28:49.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:49.964+0000 7f693468d640 1 -- 172.21.15.103:0/4244612154 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"} v 0) -- 0x7f692c14e6e0 con 0x7f692c0c9c60 2024-09-10T08:28:50.310 INFO:tasks.ceph.mds.a.smithi103.stderr:2024-09-10T08:28:50.310+0000 7fc906252640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:28:50.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.632+0000 7f6922ffd640 1 -- 172.21.15.103:0/4244612154 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"}]=0 v11) ==== 110+0+0 (secure 0 0 0) 0x7f691c0584b0 con 0x7f692c0c9c60 2024-09-10T08:28:50.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.635+0000 7f693468d640 1 -- 172.21.15.103:0/4244612154 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f691006be60 msgr2=0x7f691006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.635+0000 7f693468d640 1 --2- 172.21.15.103:0/4244612154 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f691006be60 0x7f691006e320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6928034000 tx=0x7f692802e000 comp rx=0 tx=0).stop 2024-09-10T08:28:50.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.635+0000 7f693468d640 1 -- 172.21.15.103:0/4244612154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f692c0c9c60 msgr2=0x7f692c1526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.635+0000 7f693468d640 1 --2- 172.21.15.103:0/4244612154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f692c0c9c60 0x7f692c1526a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f691c00c460 tx=0x7f691c00c920 comp rx=0 tx=0).stop 2024-09-10T08:28:50.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.635+0000 7f693468d640 1 -- 172.21.15.103:0/4244612154 shutdown_connections 2024-09-10T08:28:50.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.635+0000 7f693468d640 1 --2- 172.21.15.103:0/4244612154 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f691006be60 0x7f691006e320 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.635+0000 7f693468d640 1 --2- 172.21.15.103:0/4244612154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f692c159b30 0x7f692c152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.635+0000 7f693468d640 1 --2- 172.21.15.103:0/4244612154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f692c0c9c60 0x7f692c1526a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.635+0000 7f693468d640 1 --2- 172.21.15.103:0/4244612154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f692c067a50 0x7f692c1568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.635+0000 7f693468d640 1 -- 172.21.15.103:0/4244612154 >> 172.21.15.103:0/4244612154 conn(0x7f692c0cbd60 msgr2=0x7f692c14c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:50.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.635+0000 7f693468d640 1 -- 172.21.15.103:0/4244612154 shutdown_connections 2024-09-10T08:28:50.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.635+0000 7f693468d640 1 -- 172.21.15.103:0/4244612154 wait complete. 2024-09-10T08:28:50.647 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'b' 2024-09-10T08:28:50.647 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:28:50.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.748+0000 7efcfb8ba640 1 Processor -- start 2024-09-10T08:28:50.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.748+0000 7efcfb8ba640 1 -- start start 2024-09-10T08:28:50.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.749+0000 7efcfb8ba640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efcf4153de0 0x7efcf40ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:50.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.749+0000 7efcfb8ba640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcf40cab80 con 0x7efcf41598c0 2024-09-10T08:28:50.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.749+0000 7efcfb8ba640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcf40c6b20 con 0x7efcf406bbe0 2024-09-10T08:28:50.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.749+0000 7efcfb8ba640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7efcf40c9480 con 0x7efcf4153de0 2024-09-10T08:28:50.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.749+0000 7efcf9656640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efcf4153de0 0x7efcf40ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:50.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.749+0000 7efcf9656640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efcf4153de0 0x7efcf40ca640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57362/0 (socket says 172.21.15.103:57362) 2024-09-10T08:28:50.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.749+0000 7efcf9e57640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7efcf41598c0 0x7efcf4159d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50104/0 (socket says 172.21.15.103:50104) 2024-09-10T08:28:50.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.749+0000 7efcf9656640 1 -- 172.21.15.103:0/1264373799 learned_addr learned my addr 172.21.15.103:0/1264373799 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:50.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.749+0000 7efcf9656640 1 -- 172.21.15.103:0/1264373799 >> v1:172.21.15.154:6789/0 conn(0x7efcf406bbe0 legacy=0x7efcf406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.749+0000 7efcf9656640 1 -- 172.21.15.103:0/1264373799 >> v1:172.21.15.103:6789/0 conn(0x7efcf41598c0 legacy=0x7efcf4159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.749+0000 7efcf9656640 1 -- 172.21.15.103:0/1264373799 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf40c6e00 con 0x7efcf4153de0 2024-09-10T08:28:50.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.749+0000 7efcebfff640 1 -- 172.21.15.103:0/1264373799 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 182553429 0 0) 0x7efcec001490 con 0x7efcf41598c0 2024-09-10T08:28:50.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.750+0000 7efcf9656640 1 --2- 172.21.15.103:0/1264373799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf4153de0 0x7efcf40ca640 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009870 tx=0x7efcf002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6065ff5c120ad3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:50.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.750+0000 7efcebfff640 1 -- 172.21.15.103:0/1264373799 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf0037070 con 0x7efcf4153de0 2024-09-10T08:28:50.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.750+0000 7efcebfff640 1 -- 172.21.15.103:0/1264373799 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf002ae50 con 0x7efcf4153de0 2024-09-10T08:28:50.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.750+0000 7efcebfff640 1 -- 172.21.15.103:0/1264373799 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf0032860 con 0x7efcf4153de0 2024-09-10T08:28:50.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.751+0000 7efcfb8ba640 1 -- 172.21.15.103:0/1264373799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf4153de0 msgr2=0x7efcf40ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.751+0000 7efcfb8ba640 1 --2- 172.21.15.103:0/1264373799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf4153de0 0x7efcf40ca640 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009870 tx=0x7efcf002a300 comp rx=0 tx=0).stop 2024-09-10T08:28:50.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.751+0000 7efcfb8ba640 1 -- 172.21.15.103:0/1264373799 shutdown_connections 2024-09-10T08:28:50.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.751+0000 7efcfb8ba640 1 --2- 172.21.15.103:0/1264373799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf4153de0 0x7efcf40ca640 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.751+0000 7efcfb8ba640 1 -- 172.21.15.103:0/1264373799 >> 172.21.15.103:0/1264373799 conn(0x7efcf40c8800 msgr2=0x7efcf40c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:50.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.751+0000 7efcfb8ba640 1 -- 172.21.15.103:0/1264373799 shutdown_connections 2024-09-10T08:28:50.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.751+0000 7efcfb8ba640 1 -- 172.21.15.103:0/1264373799 wait complete. 2024-09-10T08:28:50.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.752+0000 7efcfb8ba640 1 Processor -- start 2024-09-10T08:28:50.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.752+0000 7efcfb8ba640 1 -- start start 2024-09-10T08:28:50.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.753+0000 7efcfb8ba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf406bbe0 0x7efcf41549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:50.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.753+0000 7efcfb8ba640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efcf4153de0 0x7efcf40af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:50.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.753+0000 7efcfb8ba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcf41598c0 0x7efcf41e14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:50.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.753+0000 7efcfb8ba640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efcf40cbab0 con 0x7efcf406bbe0 2024-09-10T08:28:50.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.753+0000 7efcfb8ba640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efcf40cb620 con 0x7efcf41598c0 2024-09-10T08:28:50.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.753+0000 7efcfb8ba640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7efcf415a460 con 0x7efcf4153de0 2024-09-10T08:28:50.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.753+0000 7efcf9656640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf406bbe0 0x7efcf41549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:50.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.753+0000 7efcf9656640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf406bbe0 0x7efcf41549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57368/0 (socket says 172.21.15.103:57368) 2024-09-10T08:28:50.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.753+0000 7efcf9656640 1 -- 172.21.15.103:0/455910694 learned_addr learned my addr 172.21.15.103:0/455910694 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:50.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.753+0000 7efcf9e57640 1 --2- 172.21.15.103:0/455910694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcf41598c0 0x7efcf41e14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:50.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.753+0000 7efcf8e55640 1 --2- 172.21.15.103:0/455910694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efcf4153de0 0x7efcf40af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:50.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.753+0000 7efcf9656640 1 -- 172.21.15.103:0/455910694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efcf4153de0 msgr2=0x7efcf40af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.753+0000 7efcf9656640 1 --2- 172.21.15.103:0/455910694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efcf4153de0 0x7efcf40af5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.753+0000 7efcf9656640 1 -- 172.21.15.103:0/455910694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcf41598c0 msgr2=0x7efcf41e14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.753+0000 7efcf9656640 1 --2- 172.21.15.103:0/455910694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcf41598c0 0x7efcf41e14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.753+0000 7efcf9656640 1 -- 172.21.15.103:0/455910694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf40afae0 con 0x7efcf406bbe0 2024-09-10T08:28:50.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.753+0000 7efcf9e57640 1 --2- 172.21.15.103:0/455910694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcf41598c0 0x7efcf41e14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:50.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.753+0000 7efcf9656640 1 --2- 172.21.15.103:0/455910694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf406bbe0 0x7efcf41549e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efcf0000c00 tx=0x7efcf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:50.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.753+0000 7efce9ffb640 1 -- 172.21.15.103:0/455910694 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf0041070 con 0x7efcf406bbe0 2024-09-10T08:28:50.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.753+0000 7efce9ffb640 1 -- 172.21.15.103:0/455910694 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf003c890 con 0x7efcf406bbe0 2024-09-10T08:28:50.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.753+0000 7efcfb8ba640 1 -- 172.21.15.103:0/455910694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcf414e640 con 0x7efcf406bbe0 2024-09-10T08:28:50.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.753+0000 7efce9ffb640 1 -- 172.21.15.103:0/455910694 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf0037040 con 0x7efcf406bbe0 2024-09-10T08:28:50.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.754+0000 7efcfb8ba640 1 -- 172.21.15.103:0/455910694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcf4152410 con 0x7efcf406bbe0 2024-09-10T08:28:50.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.755+0000 7efcfb8ba640 1 -- 172.21.15.103:0/455910694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcf4076230 con 0x7efcf406bbe0 2024-09-10T08:28:50.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.755+0000 7efce9ffb640 1 -- 172.21.15.103:0/455910694 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efcf0044070 con 0x7efcf406bbe0 2024-09-10T08:28:50.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.756+0000 7efce9ffb640 1 --2- 172.21.15.103:0/455910694 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efcd806be30 0x7efcd806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:50.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.756+0000 7efcf8e55640 1 --2- 172.21.15.103:0/455910694 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efcd806be30 0x7efcd806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:50.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.756+0000 7efce9ffb640 1 -- 172.21.15.103:0/455910694 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7efcf00abcd0 con 0x7efcf406bbe0 2024-09-10T08:28:50.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.756+0000 7efcf8e55640 1 --2- 172.21.15.103:0/455910694 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efcd806be30 0x7efcd806e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efcf40c5ef0 tx=0x7efce4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:50.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.760+0000 7efce9ffb640 1 -- 172.21.15.103:0/455910694 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efcf4076230 con 0x7efcf406bbe0 2024-09-10T08:28:50.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.963+0000 7efcfb8ba640 1 -- 172.21.15.103:0/455910694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efcf40c8180 con 0x7efcf406bbe0 2024-09-10T08:28:50.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.963+0000 7efce9ffb640 1 -- 172.21.15.103:0/455910694 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6536 (secure 0 0 0) 0x7efcf40c8180 con 0x7efcf406bbe0 2024-09-10T08:28:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:50.964 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":11,"btime":"2024-09-10T08:28:50:632324+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3378269214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3378269214},{"type":"v1","addr":"172.21.15.154:6833","nonce":3378269214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2141115327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2141115327},{"type":"v1","addr":"172.21.15.154:6835","nonce":2141115327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:34.885455+0000","modified":"2024-09-10T08:28:37.905202+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/3032037784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":3032037784},{"type":"v1","addr":"172.21.15.103:6837","nonce":3032037784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:46.949092+0000","modified":"2024-09-10T08:28:49.966725+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.103:6836/2250136134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2250136134},{"type":"v1","addr":"172.21.15.103:6836","nonce":2250136134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":2}]} 2024-09-10T08:28:50.964 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 11 2024-09-10T08:28:50.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.965+0000 7efcfb8ba640 1 -- 172.21.15.103:0/455910694 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efcd806be30 msgr2=0x7efcd806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.965+0000 7efcfb8ba640 1 --2- 172.21.15.103:0/455910694 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efcd806be30 0x7efcd806e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efcf40c5ef0 tx=0x7efce4009040 comp rx=0 tx=0).stop 2024-09-10T08:28:50.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.965+0000 7efcfb8ba640 1 -- 172.21.15.103:0/455910694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf406bbe0 msgr2=0x7efcf41549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.965+0000 7efcfb8ba640 1 --2- 172.21.15.103:0/455910694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf406bbe0 0x7efcf41549e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efcf0000c00 tx=0x7efcf00046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.965+0000 7efcfb8ba640 1 -- 172.21.15.103:0/455910694 shutdown_connections 2024-09-10T08:28:50.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.965+0000 7efcfb8ba640 1 --2- 172.21.15.103:0/455910694 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efcd806be30 0x7efcd806e2f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.965+0000 7efcfb8ba640 1 --2- 172.21.15.103:0/455910694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcf41598c0 0x7efcf41e14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.965+0000 7efcfb8ba640 1 --2- 172.21.15.103:0/455910694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efcf4153de0 0x7efcf40af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.965+0000 7efcfb8ba640 1 --2- 172.21.15.103:0/455910694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcf406bbe0 0x7efcf41549e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.965+0000 7efcfb8ba640 1 -- 172.21.15.103:0/455910694 >> 172.21.15.103:0/455910694 conn(0x7efcf40c8800 msgr2=0x7efcf406c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:50.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.965+0000 7efcfb8ba640 1 -- 172.21.15.103:0/455910694 shutdown_connections 2024-09-10T08:28:50.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:50.965+0000 7efcfb8ba640 1 -- 172.21.15.103:0/455910694 wait complete. 2024-09-10T08:28:50.977 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:28:51.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.075+0000 7f62366a5640 1 Processor -- start 2024-09-10T08:28:51.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.075+0000 7f62366a5640 1 -- start start 2024-09-10T08:28:51.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.076+0000 7f62366a5640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6230150480 0x7f62300c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.076+0000 7f62366a5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62300ca390 0x7f62300c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.076+0000 7f62366a5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f623015a7c0 con 0x7f623006c650 2024-09-10T08:28:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.076+0000 7f62366a5640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f623006c240 con 0x7f6230150480 2024-09-10T08:28:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.076+0000 7f62366a5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f623015a330 con 0x7f62300ca390 2024-09-10T08:28:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.076+0000 7f622ffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6230150480 0x7f62300c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.076+0000 7f622ffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6230150480 0x7f62300c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57370/0 (socket says 172.21.15.103:57370) 2024-09-10T08:28:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.076+0000 7f622ffff640 1 -- 172.21.15.103:0/3477944191 learned_addr learned my addr 172.21.15.103:0/3477944191 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.076+0000 7f6234c42640 1 --2- 172.21.15.103:0/3477944191 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62300ca390 0x7f62300c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.076+0000 7f622ffff640 1 -- 172.21.15.103:0/3477944191 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62300ca390 msgr2=0x7f62300c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.076+0000 7f622ffff640 1 --2- 172.21.15.103:0/3477944191 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62300ca390 0x7f62300c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.076+0000 7f622ffff640 1 -- 172.21.15.103:0/3477944191 >> v1:172.21.15.154:6789/0 conn(0x7f623006c650 legacy=0x7f62300c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.076+0000 7f622ffff640 1 -- 172.21.15.103:0/3477944191 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6230159a00 con 0x7f6230150480 2024-09-10T08:28:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.076+0000 7f6234c42640 1 --2- 172.21.15.103:0/3477944191 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62300ca390 0x7f62300c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:51.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.077+0000 7f622ffff640 1 --2- 172.21.15.103:0/3477944191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6230150480 0x7f62300c7a90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6220009870 tx=0x7f622002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b8d00325def5ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:51.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.077+0000 7f622effd640 1 -- 172.21.15.103:0/3477944191 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6220037070 con 0x7f6230150480 2024-09-10T08:28:51.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.077+0000 7f622effd640 1 -- 172.21.15.103:0/3477944191 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6220032440 con 0x7f6230150480 2024-09-10T08:28:51.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.077+0000 7f622effd640 1 -- 172.21.15.103:0/3477944191 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6220032810 con 0x7f6230150480 2024-09-10T08:28:51.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.078+0000 7f62366a5640 1 -- 172.21.15.103:0/3477944191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6230150480 msgr2=0x7f62300c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.078+0000 7f62366a5640 1 --2- 172.21.15.103:0/3477944191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6230150480 0x7f62300c7a90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6220009870 tx=0x7f622002a270 comp rx=0 tx=0).stop 2024-09-10T08:28:51.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.078+0000 7f62366a5640 1 -- 172.21.15.103:0/3477944191 shutdown_connections 2024-09-10T08:28:51.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.078+0000 7f62366a5640 1 --2- 172.21.15.103:0/3477944191 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62300ca390 0x7f62300c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.078+0000 7f62366a5640 1 --2- 172.21.15.103:0/3477944191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6230150480 0x7f62300c7a90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.078+0000 7f62366a5640 1 -- 172.21.15.103:0/3477944191 >> 172.21.15.103:0/3477944191 conn(0x7f6230068030 msgr2=0x7f6230073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:51.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.078+0000 7f62366a5640 1 -- 172.21.15.103:0/3477944191 shutdown_connections 2024-09-10T08:28:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.078+0000 7f62366a5640 1 -- 172.21.15.103:0/3477944191 wait complete. 2024-09-10T08:28:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.079+0000 7f62366a5640 1 Processor -- start 2024-09-10T08:28:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.079+0000 7f62366a5640 1 -- start start 2024-09-10T08:28:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.080+0000 7f62366a5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f623006c650 0x7f623014ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.080+0000 7f62366a5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62300ca390 0x7f62300afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.080+0000 7f62366a5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6230150480 0x7f62301ef570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.080+0000 7f62366a5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f623006d270 con 0x7f6230150480 2024-09-10T08:28:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.080+0000 7f62366a5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6230159fc0 con 0x7f62300ca390 2024-09-10T08:28:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.080+0000 7f62366a5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6230156270 con 0x7f623006c650 2024-09-10T08:28:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.080+0000 7f6234c42640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6230150480 0x7f62301ef570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.080+0000 7f6234c42640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6230150480 0x7f62301ef570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57374/0 (socket says 172.21.15.103:57374) 2024-09-10T08:28:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.080+0000 7f6234c42640 1 -- 172.21.15.103:0/1610791444 learned_addr learned my addr 172.21.15.103:0/1610791444 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.080+0000 7f622ffff640 1 --2- 172.21.15.103:0/1610791444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f623006c650 0x7f623014ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.080+0000 7f622f7fe640 1 --2- 172.21.15.103:0/1610791444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62300ca390 0x7f62300afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.080+0000 7f6234c42640 1 -- 172.21.15.103:0/1610791444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f623006c650 msgr2=0x7f623014ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.080+0000 7f6234c42640 1 --2- 172.21.15.103:0/1610791444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f623006c650 0x7f623014ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.080+0000 7f6234c42640 1 -- 172.21.15.103:0/1610791444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62300ca390 msgr2=0x7f62300afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.080+0000 7f6234c42640 1 --2- 172.21.15.103:0/1610791444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62300ca390 0x7f62300afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.080+0000 7f6234c42640 1 -- 172.21.15.103:0/1610791444 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6230159310 con 0x7f6230150480 2024-09-10T08:28:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.080+0000 7f6234c42640 1 --2- 172.21.15.103:0/1610791444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6230150480 0x7f62301ef570 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6228007df0 tx=0x7f622800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.080+0000 7f622cff9640 1 -- 172.21.15.103:0/1610791444 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622801a070 con 0x7f6230150480 2024-09-10T08:28:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.080+0000 7f622cff9640 1 -- 172.21.15.103:0/1610791444 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6228003990 con 0x7f6230150480 2024-09-10T08:28:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.080+0000 7f62366a5640 1 -- 172.21.15.103:0/1610791444 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62301595f0 con 0x7f6230150480 2024-09-10T08:28:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.080+0000 7f622cff9640 1 -- 172.21.15.103:0/1610791444 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6228003d80 con 0x7f6230150480 2024-09-10T08:28:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.081+0000 7f62366a5640 1 -- 172.21.15.103:0/1610791444 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f623014b240 con 0x7f6230150480 2024-09-10T08:28:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.081+0000 7f62366a5640 1 -- 172.21.15.103:0/1610791444 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62300c7040 con 0x7f6230150480 2024-09-10T08:28:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.082+0000 7f622cff9640 1 -- 172.21.15.103:0/1610791444 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f622801d070 con 0x7f6230150480 2024-09-10T08:28:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.082+0000 7f622cff9640 1 --2- 172.21.15.103:0/1610791444 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f621c06be30 0x7f621c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.082+0000 7f622cff9640 1 -- 172.21.15.103:0/1610791444 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f622808b360 con 0x7f6230150480 2024-09-10T08:28:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.082+0000 7f622ffff640 1 --2- 172.21.15.103:0/1610791444 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f621c06be30 0x7f621c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.083+0000 7f622ffff640 1 --2- 172.21.15.103:0/1610791444 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f621c06be30 0x7f621c06e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6220034000 tx=0x7f622002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:51.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.087+0000 7f622cff9640 1 -- 172.21.15.103:0/1610791444 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f62300c7040 con 0x7f6230150480 2024-09-10T08:28:51.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.254+0000 7f62366a5640 1 -- 172.21.15.103:0/1610791444 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f62300c9c80 con 0x7f6230150480 2024-09-10T08:28:51.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.255+0000 7f622cff9640 1 -- 172.21.15.103:0/1610791444 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20499 (secure 0 0 0) 0x7f6228010070 con 0x7f6230150480 2024-09-10T08:28:51.256 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:51.256 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","created":"2024-09-10T08:28:12.654957+0000","modified":"2024-09-10T08:28:48.615871+0000","last_up_change":"2024-09-10T08:28:25.445753+0000","last_in_change":"2024-09-10T08:28:14.741133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:24.821696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-10T08:28:33.488154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-10T08:28:33.857868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-10T08:28:44.793084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-10T08:28:45.930823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1abe08f4-0348-435e-9f97-cec00e96992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6809","nonce":2707863099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6811","nonce":2707863099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6815","nonce":2707863099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6813","nonce":2707863099}]},"public_addr":"172.21.15.103:6809/2707863099","cluster_addr":"172.21.15.103:6811/2707863099","heartbeat_back_addr":"172.21.15.103:6815/2707863099","heartbeat_front_addr":"172.21.15.103:6813/2707863099","state":["exists","up"]},{"osd":1,"uuid":"df342e58-1026-4739-82f6-7a216707444c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6818","nonce":4029892782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6822","nonce":4029892782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6830","nonce":4029892782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6826","nonce":4029892782}]},"public_addr":"172.21.15.103:6818/4029892782","cluster_addr":"172.21.15.103:6822/4029892782","heartbeat_back_addr":"172.21.15.103:6830/4029892782","heartbeat_front_addr":"172.21.15.103:6826/4029892782","state":["exists","up"]},{"osd":2,"uuid":"f7aea2cf-208c-41ed-a0f6-8948d70b9a0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6819","nonce":428484432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6821","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6823","nonce":428484432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6829","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6831","nonce":428484432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6825","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6827","nonce":428484432}]},"public_addr":"172.21.15.103:6819/428484432","cluster_addr":"172.21.15.103:6823/428484432","heartbeat_back_addr":"172.21.15.103:6831/428484432","heartbeat_front_addr":"172.21.15.103:6827/428484432","state":["exists","up"]},{"osd":3,"uuid":"615ef8b0-12a5-4503-96d0-f7ec17dbc792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6801","nonce":3453676282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6803","nonce":3453676282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6807","nonce":3453676282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6805","nonce":3453676282}]},"public_addr":"172.21.15.103:6801/3453676282","cluster_addr":"172.21.15.103:6803/3453676282","heartbeat_back_addr":"172.21.15.103:6807/3453676282","heartbeat_front_addr":"172.21.15.103:6805/3453676282","state":["exists","up"]},{"osd":4,"uuid":"644c5e94-db18-4b83-b5cd-3762ae2647a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6809","nonce":1808157069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6811","nonce":1808157069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6815","nonce":1808157069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6813","nonce":1808157069}]},"public_addr":"172.21.15.154:6809/1808157069","cluster_addr":"172.21.15.154:6811/1808157069","heartbeat_back_addr":"172.21.15.154:6815/1808157069","heartbeat_front_addr":"172.21.15.154:6813/1808157069","state":["exists","up"]},{"osd":5,"uuid":"f40210bd-f4ca-442e-baac-729ced5a9f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6817","nonce":1048015779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6819","nonce":1048015779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6823","nonce":1048015779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6821","nonce":1048015779}]},"public_addr":"172.21.15.154:6817/1048015779","cluster_addr":"172.21.15.154:6819/1048015779","heartbeat_back_addr":"172.21.15.154:6823/1048015779","heartbeat_front_addr":"172.21.15.154:6821/1048015779","state":["exists","up"]},{"osd":6,"uuid":"eebac31e-aaef-47b0-90d7-4af08f36d7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6801","nonce":345273812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6803","nonce":345273812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6807","nonce":345273812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6805","nonce":345273812}]},"public_addr":"172.21.15.154:6801/345273812","cluster_addr":"172.21.15.154:6803/345273812","heartbeat_back_addr":"172.21.15.154:6807/345273812","heartbeat_front_addr":"172.21.15.154:6805/345273812","state":["exists","up"]},{"osd":7,"uuid":"58406c9a-036f-4618-bfb6-0beddbd71605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6825","nonce":3439481239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6827","nonce":3439481239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6831","nonce":3439481239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6829","nonce":3439481239}]},"public_addr":"172.21.15.154:6825/3439481239","cluster_addr":"172.21.15.154:6827/3439481239","heartbeat_back_addr":"172.21.15.154:6831/3439481239","heartbeat_front_addr":"172.21.15.154:6829/3439481239","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.032718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.126448+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.781158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.808718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.050591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.038245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.586989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.223326+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:28:51.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.257+0000 7f62366a5640 1 -- 172.21.15.103:0/1610791444 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f621c06be30 msgr2=0x7f621c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.257+0000 7f62366a5640 1 --2- 172.21.15.103:0/1610791444 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f621c06be30 0x7f621c06e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6220034000 tx=0x7f622002e000 comp rx=0 tx=0).stop 2024-09-10T08:28:51.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.257+0000 7f62366a5640 1 -- 172.21.15.103:0/1610791444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6230150480 msgr2=0x7f62301ef570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.257+0000 7f62366a5640 1 --2- 172.21.15.103:0/1610791444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6230150480 0x7f62301ef570 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6228007df0 tx=0x7f622800d4a0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.257+0000 7f62366a5640 1 -- 172.21.15.103:0/1610791444 shutdown_connections 2024-09-10T08:28:51.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.257+0000 7f62366a5640 1 --2- 172.21.15.103:0/1610791444 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f621c06be30 0x7f621c06e2f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.257+0000 7f62366a5640 1 --2- 172.21.15.103:0/1610791444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6230150480 0x7f62301ef570 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.257+0000 7f62366a5640 1 --2- 172.21.15.103:0/1610791444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62300ca390 0x7f62300afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.257+0000 7f62366a5640 1 --2- 172.21.15.103:0/1610791444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f623006c650 0x7f623014ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.257+0000 7f62366a5640 1 -- 172.21.15.103:0/1610791444 >> 172.21.15.103:0/1610791444 conn(0x7f6230068030 msgr2=0x7f62300c79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:51.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.257+0000 7f62366a5640 1 -- 172.21.15.103:0/1610791444 shutdown_connections 2024-09-10T08:28:51.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.257+0000 7f62366a5640 1 -- 172.21.15.103:0/1610791444 wait complete. 2024-09-10T08:28:51.269 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:28:51.269 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:28:51.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.368+0000 7f413f853640 1 Processor -- start 2024-09-10T08:28:51.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.368+0000 7f413f853640 1 -- start start 2024-09-10T08:28:51.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.368+0000 7f413f853640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f413815a450 0x7f41380c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.368+0000 7f413f853640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41380c84e0 0x7f413806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.369+0000 7f413f853640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f413815a830 con 0x7f41380c3fd0 2024-09-10T08:28:51.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.369+0000 7f413f853640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f413806e240 con 0x7f413815a450 2024-09-10T08:28:51.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.369+0000 7f413f853640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f41380c7490 con 0x7f41380c84e0 2024-09-10T08:28:51.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.369+0000 7f413d5ef640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f413815a450 0x7f41380c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.369+0000 7f413ddf0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41380c84e0 0x7f413806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.369+0000 7f413cdee640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f41380c3fd0 0x7f413806e6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:56544/0 (socket says 172.21.15.103:56544) 2024-09-10T08:28:51.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.369+0000 7f413cdee640 1 -- 172.21.15.103:0/2019096702 learned_addr learned my addr 172.21.15.103:0/2019096702 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:51.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.369+0000 7f413d5ef640 1 -- 172.21.15.103:0/2019096702 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41380c84e0 msgr2=0x7f413806ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:51.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.369+0000 7f413d5ef640 1 --2- 172.21.15.103:0/2019096702 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41380c84e0 0x7f413806ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.369+0000 7f413d5ef640 1 -- 172.21.15.103:0/2019096702 >> v1:172.21.15.154:6789/0 conn(0x7f41380c3fd0 legacy=0x7f413806e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.369+0000 7f413d5ef640 1 -- 172.21.15.103:0/2019096702 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41380c7770 con 0x7f413815a450 2024-09-10T08:28:51.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.370+0000 7f413d5ef640 1 --2- 172.21.15.103:0/2019096702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f413815a450 0x7f41380c3a90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f412c0097a0 tx=0x7f412c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=810fb7d2d99e2a46 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:51.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.370+0000 7f412bfff640 1 -- 172.21.15.103:0/2019096702 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c037070 con 0x7f413815a450 2024-09-10T08:28:51.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.370+0000 7f412bfff640 1 -- 172.21.15.103:0/2019096702 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f412c032440 con 0x7f413815a450 2024-09-10T08:28:51.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.370+0000 7f412bfff640 1 -- 172.21.15.103:0/2019096702 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c032810 con 0x7f413815a450 2024-09-10T08:28:51.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.371+0000 7f413f853640 1 -- 172.21.15.103:0/2019096702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f413815a450 msgr2=0x7f41380c3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.371+0000 7f413f853640 1 --2- 172.21.15.103:0/2019096702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f413815a450 0x7f41380c3a90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f412c0097a0 tx=0x7f412c02a180 comp rx=0 tx=0).stop 2024-09-10T08:28:51.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.371+0000 7f413f853640 1 -- 172.21.15.103:0/2019096702 shutdown_connections 2024-09-10T08:28:51.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.371+0000 7f413f853640 1 --2- 172.21.15.103:0/2019096702 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41380c84e0 0x7f413806ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.371+0000 7f413f853640 1 --2- 172.21.15.103:0/2019096702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f413815a450 0x7f41380c3a90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.371+0000 7f413f853640 1 -- 172.21.15.103:0/2019096702 >> 172.21.15.103:0/2019096702 conn(0x7f41380c5660 msgr2=0x7f41380c5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:51.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.371+0000 7f413f853640 1 -- 172.21.15.103:0/2019096702 shutdown_connections 2024-09-10T08:28:51.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.371+0000 7f413f853640 1 -- 172.21.15.103:0/2019096702 wait complete. 2024-09-10T08:28:51.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.372+0000 7f413f853640 1 Processor -- start 2024-09-10T08:28:51.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.372+0000 7f413f853640 1 -- start start 2024-09-10T08:28:51.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.373+0000 7f413f853640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41380c3fd0 0x7f4138072d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.373+0000 7f413f853640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41380c84e0 0x7f41381edeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.373+0000 7f413f853640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f413815a450 0x7f41381ee3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.373+0000 7f413f853640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f413806f320 con 0x7f413815a450 2024-09-10T08:28:51.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.373+0000 7f413f853640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f41380c7d30 con 0x7f41380c3fd0 2024-09-10T08:28:51.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.373+0000 7f413f853640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f41380c70d0 con 0x7f41380c84e0 2024-09-10T08:28:51.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.373+0000 7f413ddf0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f413815a450 0x7f41381ee3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.373+0000 7f413ddf0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f413815a450 0x7f41381ee3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57382/0 (socket says 172.21.15.103:57382) 2024-09-10T08:28:51.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.373+0000 7f413ddf0640 1 -- 172.21.15.103:0/3224630888 learned_addr learned my addr 172.21.15.103:0/3224630888 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:51.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.373+0000 7f413cdee640 1 --2- 172.21.15.103:0/3224630888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41380c84e0 0x7f41381edeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.373+0000 7f413d5ef640 1 --2- 172.21.15.103:0/3224630888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41380c3fd0 0x7f4138072d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.373+0000 7f413ddf0640 1 -- 172.21.15.103:0/3224630888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41380c84e0 msgr2=0x7f41381edeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.373+0000 7f413ddf0640 1 --2- 172.21.15.103:0/3224630888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41380c84e0 0x7f41381edeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.373+0000 7f413ddf0640 1 -- 172.21.15.103:0/3224630888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41380c3fd0 msgr2=0x7f4138072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.373+0000 7f413ddf0640 1 --2- 172.21.15.103:0/3224630888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41380c3fd0 0x7f4138072d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.373+0000 7f413ddf0640 1 -- 172.21.15.103:0/3224630888 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413809ccb0 con 0x7f413815a450 2024-09-10T08:28:51.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.373+0000 7f413ddf0640 1 --2- 172.21.15.103:0/3224630888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f413815a450 0x7f41381ee3f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4130009dd0 tx=0x7f413000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:51.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.373+0000 7f4129ffb640 1 -- 172.21.15.103:0/3224630888 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4130018020 con 0x7f413815a450 2024-09-10T08:28:51.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.373+0000 7f4129ffb640 1 -- 172.21.15.103:0/3224630888 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4130014480 con 0x7f413815a450 2024-09-10T08:28:51.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.373+0000 7f413f853640 1 -- 172.21.15.103:0/3224630888 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f413809cf90 con 0x7f413815a450 2024-09-10T08:28:51.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.373+0000 7f4129ffb640 1 -- 172.21.15.103:0/3224630888 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4130014870 con 0x7f413815a450 2024-09-10T08:28:51.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.374+0000 7f413f853640 1 -- 172.21.15.103:0/3224630888 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4138157520 con 0x7f413815a450 2024-09-10T08:28:51.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.375+0000 7f413f853640 1 -- 172.21.15.103:0/3224630888 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f413806c5c0 con 0x7f413815a450 2024-09-10T08:28:51.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.375+0000 7f4129ffb640 1 -- 172.21.15.103:0/3224630888 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4130005d10 con 0x7f413815a450 2024-09-10T08:28:51.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.375+0000 7f4129ffb640 1 --2- 172.21.15.103:0/3224630888 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f411c06be30 0x7f411c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.376+0000 7f4129ffb640 1 -- 172.21.15.103:0/3224630888 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f413008bb70 con 0x7f413815a450 2024-09-10T08:28:51.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.376+0000 7f413d5ef640 1 --2- 172.21.15.103:0/3224630888 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f411c06be30 0x7f411c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.376+0000 7f413d5ef640 1 --2- 172.21.15.103:0/3224630888 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f411c06be30 0x7f411c06e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f412c034000 tx=0x7f412c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:51.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.380+0000 7f4129ffb640 1 -- 172.21.15.103:0/3224630888 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4130022070 con 0x7f413815a450 2024-09-10T08:28:51.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.541+0000 7f413f853640 1 -- 172.21.15.103:0/3224630888 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f41380c3660 con 0x7f411c06be30 2024-09-10T08:28:51.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.553+0000 7f4129ffb640 1 -- 172.21.15.103:0/3224630888 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+480184 (secure 0 0 0) 0x7f41380c3660 con 0x7f411c06be30 2024-09-10T08:28:51.560 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:51.563 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T08:28:51.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.557+0000 7f413f853640 1 -- 172.21.15.103:0/3224630888 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f411c06be30 msgr2=0x7f411c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.557+0000 7f413f853640 1 --2- 172.21.15.103:0/3224630888 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f411c06be30 0x7f411c06e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f412c034000 tx=0x7f412c02e000 comp rx=0 tx=0).stop 2024-09-10T08:28:51.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.557+0000 7f413f853640 1 -- 172.21.15.103:0/3224630888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f413815a450 msgr2=0x7f41381ee3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.557+0000 7f413f853640 1 --2- 172.21.15.103:0/3224630888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f413815a450 0x7f41381ee3f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4130009dd0 tx=0x7f413000c490 comp rx=0 tx=0).stop 2024-09-10T08:28:51.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.557+0000 7f413f853640 1 -- 172.21.15.103:0/3224630888 shutdown_connections 2024-09-10T08:28:51.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.557+0000 7f413f853640 1 --2- 172.21.15.103:0/3224630888 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f411c06be30 0x7f411c06e2f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.557+0000 7f413f853640 1 --2- 172.21.15.103:0/3224630888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f413815a450 0x7f41381ee3f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.557+0000 7f413f853640 1 --2- 172.21.15.103:0/3224630888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41380c84e0 0x7f41381edeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.557+0000 7f413f853640 1 --2- 172.21.15.103:0/3224630888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41380c3fd0 0x7f4138072d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.557+0000 7f413f853640 1 -- 172.21.15.103:0/3224630888 >> 172.21.15.103:0/3224630888 conn(0x7f41380c5660 msgr2=0x7f413806ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:51.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.558+0000 7f413f853640 1 -- 172.21.15.103:0/3224630888 shutdown_connections 2024-09-10T08:28:51.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.558+0000 7f413f853640 1 -- 172.21.15.103:0/3224630888 wait complete. 2024-09-10T08:28:51.569 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-09-10T08:28:50.796414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593360,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":211,"num_write_kb":2431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":213,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219180,"kb_used_data":2936,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755540,"statfs":{"total":773094113280,"available":772869672960,"internally_reserved":0,"allocated":3006464,"data_stored":1809170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.197957"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619680+0000","last_change":"2024-09-10T08:28:34.564816+0000","last_active":"2024-09-10T08:28:36.619680+0000","last_peered":"2024-09-10T08:28:36.619680+0000","last_clean":"2024-09-10T08:28:36.619680+0000","last_became_active":"2024-09-10T08:28:34.564545+0000","last_became_peered":"2024-09-10T08:28:34.564545+0000","last_unstale":"2024-09-10T08:28:36.619680+0000","last_undegraded":"2024-09-10T08:28:36.619680+0000","last_fullsized":"2024-09-10T08:28:36.619680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:34.365104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605257+0000","last_change":"2024-09-10T08:28:35.575267+0000","last_active":"2024-09-10T08:28:45.605257+0000","last_peered":"2024-09-10T08:28:45.605257+0000","last_clean":"2024-09-10T08:28:45.605257+0000","last_became_active":"2024-09-10T08:28:35.575019+0000","last_became_peered":"2024-09-10T08:28:35.575019+0000","last_unstale":"2024-09-10T08:28:45.605257+0000","last_undegraded":"2024-09-10T08:28:45.605257+0000","last_fullsized":"2024-09-10T08:28:45.605257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:00.810645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.603322+0000","last_change":"2024-09-10T08:28:45.603322+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.603322+0000","last_undegraded":"2024-09-10T08:28:45.603322+0000","last_fullsized":"2024-09-10T08:28:45.603322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605311+0000","last_change":"2024-09-10T08:28:34.561691+0000","last_active":"2024-09-10T08:28:45.605311+0000","last_peered":"2024-09-10T08:28:45.605311+0000","last_clean":"2024-09-10T08:28:45.605311+0000","last_became_active":"2024-09-10T08:28:34.561410+0000","last_became_peered":"2024-09-10T08:28:34.561410+0000","last_unstale":"2024-09-10T08:28:45.605311+0000","last_undegraded":"2024-09-10T08:28:45.605311+0000","last_fullsized":"2024-09-10T08:28:45.605311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.629982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619392+0000","last_change":"2024-09-10T08:28:35.579033+0000","last_active":"2024-09-10T08:28:36.619392+0000","last_peered":"2024-09-10T08:28:36.619392+0000","last_clean":"2024-09-10T08:28:36.619392+0000","last_became_active":"2024-09-10T08:28:35.578333+0000","last_became_peered":"2024-09-10T08:28:35.578333+0000","last_unstale":"2024-09-10T08:28:36.619392+0000","last_undegraded":"2024-09-10T08:28:36.619392+0000","last_fullsized":"2024-09-10T08:28:36.619392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:58.779491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.600401+0000","last_change":"2024-09-10T08:28:45.600401+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.600401+0000","last_undegraded":"2024-09-10T08:28:45.600401+0000","last_fullsized":"2024-09-10T08:28:45.600401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604808+0000","last_change":"2024-09-10T08:28:34.571965+0000","last_active":"2024-09-10T08:28:45.604808+0000","last_peered":"2024-09-10T08:28:45.604808+0000","last_clean":"2024-09-10T08:28:45.604808+0000","last_became_active":"2024-09-10T08:28:34.571640+0000","last_became_peered":"2024-09-10T08:28:34.571640+0000","last_unstale":"2024-09-10T08:28:45.604808+0000","last_undegraded":"2024-09-10T08:28:45.604808+0000","last_fullsized":"2024-09-10T08:28:45.604808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:53.047030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604063+0000","last_change":"2024-09-10T08:28:35.562132+0000","last_active":"2024-09-10T08:28:45.604063+0000","last_peered":"2024-09-10T08:28:45.604063+0000","last_clean":"2024-09-10T08:28:45.604063+0000","last_became_active":"2024-09-10T08:28:35.561842+0000","last_became_peered":"2024-09-10T08:28:35.561842+0000","last_unstale":"2024-09-10T08:28:45.604063+0000","last_undegraded":"2024-09-10T08:28:45.604063+0000","last_fullsized":"2024-09-10T08:28:45.604063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:48.810258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.602052+0000","last_change":"2024-09-10T08:28:45.602052+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.602052+0000","last_undegraded":"2024-09-10T08:28:45.602052+0000","last_fullsized":"2024-09-10T08:28:45.602052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603801+0000","last_change":"2024-09-10T08:28:34.566560+0000","last_active":"2024-09-10T08:28:45.603801+0000","last_peered":"2024-09-10T08:28:45.603801+0000","last_clean":"2024-09-10T08:28:45.603801+0000","last_became_active":"2024-09-10T08:28:34.566275+0000","last_became_peered":"2024-09-10T08:28:34.566275+0000","last_unstale":"2024-09-10T08:28:45.603801+0000","last_undegraded":"2024-09-10T08:28:45.603801+0000","last_fullsized":"2024-09-10T08:28:45.603801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:03.507683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603990+0000","last_change":"2024-09-10T08:28:35.560380+0000","last_active":"2024-09-10T08:28:45.603990+0000","last_peered":"2024-09-10T08:28:45.603990+0000","last_clean":"2024-09-10T08:28:45.603990+0000","last_became_active":"2024-09-10T08:28:35.560095+0000","last_became_peered":"2024-09-10T08:28:35.560095+0000","last_unstale":"2024-09-10T08:28:45.603990+0000","last_undegraded":"2024-09-10T08:28:45.603990+0000","last_fullsized":"2024-09-10T08:28:45.603990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:20.047446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.601642+0000","last_change":"2024-09-10T08:28:45.601642+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.601642+0000","last_undegraded":"2024-09-10T08:28:45.601642+0000","last_fullsized":"2024-09-10T08:28:45.601642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.618091+0000","last_change":"2024-09-10T08:28:35.572478+0000","last_active":"2024-09-10T08:28:47.618091+0000","last_peered":"2024-09-10T08:28:47.618091+0000","last_clean":"2024-09-10T08:28:47.618091+0000","last_became_active":"2024-09-10T08:28:35.572215+0000","last_became_peered":"2024-09-10T08:28:35.572215+0000","last_unstale":"2024-09-10T08:28:47.618091+0000","last_undegraded":"2024-09-10T08:28:47.618091+0000","last_fullsized":"2024-09-10T08:28:47.618091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:40.397318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604677+0000","last_change":"2024-09-10T08:28:34.569235+0000","last_active":"2024-09-10T08:28:45.604677+0000","last_peered":"2024-09-10T08:28:45.604677+0000","last_clean":"2024-09-10T08:28:45.604677+0000","last_became_active":"2024-09-10T08:28:34.568899+0000","last_became_peered":"2024-09-10T08:28:34.568899+0000","last_unstale":"2024-09-10T08:28:45.604677+0000","last_undegraded":"2024-09-10T08:28:45.604677+0000","last_fullsized":"2024-09-10T08:28:45.604677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:21.927656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.600794+0000","last_change":"2024-09-10T08:28:45.600794+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.600794+0000","last_undegraded":"2024-09-10T08:28:45.600794+0000","last_fullsized":"2024-09-10T08:28:45.600794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.630431+0000","last_change":"2024-09-10T08:28:47.627138+0000","last_active":"2024-09-10T08:28:47.630431+0000","last_peered":"2024-09-10T08:28:47.630431+0000","last_clean":"2024-09-10T08:28:47.630431+0000","last_became_active":"2024-09-10T08:28:47.626871+0000","last_became_peered":"2024-09-10T08:28:47.626871+0000","last_unstale":"2024-09-10T08:28:47.630431+0000","last_undegraded":"2024-09-10T08:28:47.630431+0000","last_fullsized":"2024-09-10T08:28:47.630431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:01.469893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605836+0000","last_change":"2024-09-10T08:28:35.577024+0000","last_active":"2024-09-10T08:28:45.605836+0000","last_peered":"2024-09-10T08:28:45.605836+0000","last_clean":"2024-09-10T08:28:45.605836+0000","last_became_active":"2024-09-10T08:28:35.576771+0000","last_became_peered":"2024-09-10T08:28:35.576771+0000","last_unstale":"2024-09-10T08:28:45.605836+0000","last_undegraded":"2024-09-10T08:28:45.605836+0000","last_fullsized":"2024-09-10T08:28:45.605836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:07.162941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606550+0000","last_change":"2024-09-10T08:28:34.561324+0000","last_active":"2024-09-10T08:28:45.606550+0000","last_peered":"2024-09-10T08:28:45.606550+0000","last_clean":"2024-09-10T08:28:45.606550+0000","last_became_active":"2024-09-10T08:28:34.560974+0000","last_became_peered":"2024-09-10T08:28:34.560974+0000","last_unstale":"2024-09-10T08:28:45.606550+0000","last_undegraded":"2024-09-10T08:28:45.606550+0000","last_fullsized":"2024-09-10T08:28:45.606550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:18.790965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.600502+0000","last_change":"2024-09-10T08:28:45.600502+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.600502+0000","last_undegraded":"2024-09-10T08:28:45.600502+0000","last_fullsized":"2024-09-10T08:28:45.600502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604743+0000","last_change":"2024-09-10T08:28:35.572363+0000","last_active":"2024-09-10T08:28:45.604743+0000","last_peered":"2024-09-10T08:28:45.604743+0000","last_clean":"2024-09-10T08:28:45.604743+0000","last_became_active":"2024-09-10T08:28:35.572108+0000","last_became_peered":"2024-09-10T08:28:35.572108+0000","last_unstale":"2024-09-10T08:28:45.604743+0000","last_undegraded":"2024-09-10T08:28:45.604743+0000","last_fullsized":"2024-09-10T08:28:45.604743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:48.358634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606610+0000","last_change":"2024-09-10T08:28:34.564813+0000","last_active":"2024-09-10T08:28:45.606610+0000","last_peered":"2024-09-10T08:28:45.606610+0000","last_clean":"2024-09-10T08:28:45.606610+0000","last_became_active":"2024-09-10T08:28:34.564557+0000","last_became_peered":"2024-09-10T08:28:34.564557+0000","last_unstale":"2024-09-10T08:28:45.606610+0000","last_undegraded":"2024-09-10T08:28:45.606610+0000","last_fullsized":"2024-09-10T08:28:45.606610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:48.356069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.605451+0000","last_change":"2024-09-10T08:28:45.605451+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.605451+0000","last_undegraded":"2024-09-10T08:28:45.605451+0000","last_fullsized":"2024-09-10T08:28:45.605451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603108+0000","last_change":"2024-09-10T08:28:35.569938+0000","last_active":"2024-09-10T08:28:45.603108+0000","last_peered":"2024-09-10T08:28:45.603108+0000","last_clean":"2024-09-10T08:28:45.603108+0000","last_became_active":"2024-09-10T08:28:35.569109+0000","last_became_peered":"2024-09-10T08:28:35.569109+0000","last_unstale":"2024-09-10T08:28:45.603108+0000","last_undegraded":"2024-09-10T08:28:45.603108+0000","last_fullsized":"2024-09-10T08:28:45.603108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:51.680564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603546+0000","last_change":"2024-09-10T08:28:34.571069+0000","last_active":"2024-09-10T08:28:45.603546+0000","last_peered":"2024-09-10T08:28:45.603546+0000","last_clean":"2024-09-10T08:28:45.603546+0000","last_became_active":"2024-09-10T08:28:34.570766+0000","last_became_peered":"2024-09-10T08:28:34.570766+0000","last_unstale":"2024-09-10T08:28:45.603546+0000","last_undegraded":"2024-09-10T08:28:45.603546+0000","last_fullsized":"2024-09-10T08:28:45.603546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:47.458195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.600452+0000","last_change":"2024-09-10T08:28:45.600452+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.600452+0000","last_undegraded":"2024-09-10T08:28:45.600452+0000","last_fullsized":"2024-09-10T08:28:45.600452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619239+0000","last_change":"2024-09-10T08:28:35.575106+0000","last_active":"2024-09-10T08:28:36.619239+0000","last_peered":"2024-09-10T08:28:36.619239+0000","last_clean":"2024-09-10T08:28:36.619239+0000","last_became_active":"2024-09-10T08:28:35.574815+0000","last_became_peered":"2024-09-10T08:28:35.574815+0000","last_unstale":"2024-09-10T08:28:36.619239+0000","last_undegraded":"2024-09-10T08:28:36.619239+0000","last_fullsized":"2024-09-10T08:28:36.619239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:26.512181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.619552+0000","last_change":"2024-09-10T08:28:34.564865+0000","last_active":"2024-09-10T08:28:47.619552+0000","last_peered":"2024-09-10T08:28:47.619552+0000","last_clean":"2024-09-10T08:28:47.619552+0000","last_became_active":"2024-09-10T08:28:34.564549+0000","last_became_peered":"2024-09-10T08:28:34.564549+0000","last_unstale":"2024-09-10T08:28:47.619552+0000","last_undegraded":"2024-09-10T08:28:47.619552+0000","last_fullsized":"2024-09-10T08:28:47.619552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:05.523637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.600402+0000","last_change":"2024-09-10T08:28:45.600402+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.600402+0000","last_undegraded":"2024-09-10T08:28:45.600402+0000","last_fullsized":"2024-09-10T08:28:45.600402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606015+0000","last_change":"2024-09-10T08:28:35.574107+0000","last_active":"2024-09-10T08:28:45.606015+0000","last_peered":"2024-09-10T08:28:45.606015+0000","last_clean":"2024-09-10T08:28:45.606015+0000","last_became_active":"2024-09-10T08:28:35.573851+0000","last_became_peered":"2024-09-10T08:28:35.573851+0000","last_unstale":"2024-09-10T08:28:45.606015+0000","last_undegraded":"2024-09-10T08:28:45.606015+0000","last_fullsized":"2024-09-10T08:28:45.606015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:53.240223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606704+0000","last_change":"2024-09-10T08:28:34.563451+0000","last_active":"2024-09-10T08:28:45.606704+0000","last_peered":"2024-09-10T08:28:45.606704+0000","last_clean":"2024-09-10T08:28:45.606704+0000","last_became_active":"2024-09-10T08:28:34.563259+0000","last_became_peered":"2024-09-10T08:28:34.563259+0000","last_unstale":"2024-09-10T08:28:45.606704+0000","last_undegraded":"2024-09-10T08:28:45.606704+0000","last_fullsized":"2024-09-10T08:28:45.606704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:44.899351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.603287+0000","last_change":"2024-09-10T08:28:45.603287+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.603287+0000","last_undegraded":"2024-09-10T08:28:45.603287+0000","last_fullsized":"2024-09-10T08:28:45.603287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.639830+0000","last_change":"2024-09-10T08:28:47.634754+0000","last_active":"2024-09-10T08:28:47.639830+0000","last_peered":"2024-09-10T08:28:47.639830+0000","last_clean":"2024-09-10T08:28:47.639830+0000","last_became_active":"2024-09-10T08:28:47.634382+0000","last_became_peered":"2024-09-10T08:28:47.634382+0000","last_unstale":"2024-09-10T08:28:47.639830+0000","last_undegraded":"2024-09-10T08:28:47.639830+0000","last_fullsized":"2024-09-10T08:28:47.639830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:08.900176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606350+0000","last_change":"2024-09-10T08:28:35.567481+0000","last_active":"2024-09-10T08:28:45.606350+0000","last_peered":"2024-09-10T08:28:45.606350+0000","last_clean":"2024-09-10T08:28:45.606350+0000","last_became_active":"2024-09-10T08:28:35.567167+0000","last_became_peered":"2024-09-10T08:28:35.567167+0000","last_unstale":"2024-09-10T08:28:45.606350+0000","last_undegraded":"2024-09-10T08:28:45.606350+0000","last_fullsized":"2024-09-10T08:28:45.606350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:44.110012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605020+0000","last_change":"2024-09-10T08:28:34.571283+0000","last_active":"2024-09-10T08:28:45.605020+0000","last_peered":"2024-09-10T08:28:45.605020+0000","last_clean":"2024-09-10T08:28:45.605020+0000","last_became_active":"2024-09-10T08:28:34.570791+0000","last_became_peered":"2024-09-10T08:28:34.570791+0000","last_unstale":"2024-09-10T08:28:45.605020+0000","last_undegraded":"2024-09-10T08:28:45.605020+0000","last_fullsized":"2024-09-10T08:28:45.605020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:17.427597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:45.593387+0000","last_change":"2024-09-10T08:28:45.593387+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.593387+0000","last_undegraded":"2024-09-10T08:28:45.593387+0000","last_fullsized":"2024-09-10T08:28:45.593387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604102+0000","last_change":"2024-09-10T08:28:35.576280+0000","last_active":"2024-09-10T08:28:45.604102+0000","last_peered":"2024-09-10T08:28:45.604102+0000","last_clean":"2024-09-10T08:28:45.604102+0000","last_became_active":"2024-09-10T08:28:35.576002+0000","last_became_peered":"2024-09-10T08:28:35.576002+0000","last_unstale":"2024-09-10T08:28:45.604102+0000","last_undegraded":"2024-09-10T08:28:45.604102+0000","last_fullsized":"2024-09-10T08:28:45.604102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:46.278441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606425+0000","last_change":"2024-09-10T08:28:34.555212+0000","last_active":"2024-09-10T08:28:45.606425+0000","last_peered":"2024-09-10T08:28:45.606425+0000","last_clean":"2024-09-10T08:28:45.606425+0000","last_became_active":"2024-09-10T08:28:34.554922+0000","last_became_peered":"2024-09-10T08:28:34.554922+0000","last_unstale":"2024-09-10T08:28:45.606425+0000","last_undegraded":"2024-09-10T08:28:45.606425+0000","last_fullsized":"2024-09-10T08:28:45.606425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.604756+0000","last_change":"2024-09-10T08:28:45.604756+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.604756+0000","last_undegraded":"2024-09-10T08:28:45.604756+0000","last_fullsized":"2024-09-10T08:28:45.604756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604254+0000","last_change":"2024-09-10T08:28:35.577978+0000","last_active":"2024-09-10T08:28:45.604254+0000","last_peered":"2024-09-10T08:28:45.604254+0000","last_clean":"2024-09-10T08:28:45.604254+0000","last_became_active":"2024-09-10T08:28:35.577718+0000","last_became_peered":"2024-09-10T08:28:35.577718+0000","last_unstale":"2024-09-10T08:28:45.604254+0000","last_undegraded":"2024-09-10T08:28:45.604254+0000","last_fullsized":"2024-09-10T08:28:45.604254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:01:57.257817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604509+0000","last_change":"2024-09-10T08:28:34.553983+0000","last_active":"2024-09-10T08:28:45.604509+0000","last_peered":"2024-09-10T08:28:45.604509+0000","last_clean":"2024-09-10T08:28:45.604509+0000","last_became_active":"2024-09-10T08:28:34.553693+0000","last_became_peered":"2024-09-10T08:28:34.553693+0000","last_unstale":"2024-09-10T08:28:45.604509+0000","last_undegraded":"2024-09-10T08:28:45.604509+0000","last_fullsized":"2024-09-10T08:28:45.604509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:40.001685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.605137+0000","last_change":"2024-09-10T08:28:45.605137+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.605137+0000","last_undegraded":"2024-09-10T08:28:45.605137+0000","last_fullsized":"2024-09-10T08:28:45.605137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.629847+0000","last_change":"2024-09-10T08:28:47.621588+0000","last_active":"2024-09-10T08:28:47.629847+0000","last_peered":"2024-09-10T08:28:47.629847+0000","last_clean":"2024-09-10T08:28:47.629847+0000","last_became_active":"2024-09-10T08:28:47.621122+0000","last_became_peered":"2024-09-10T08:28:47.621122+0000","last_unstale":"2024-09-10T08:28:47.629847+0000","last_undegraded":"2024-09-10T08:28:47.629847+0000","last_fullsized":"2024-09-10T08:28:47.629847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:19.727552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606067+0000","last_change":"2024-09-10T08:28:35.566745+0000","last_active":"2024-09-10T08:28:45.606067+0000","last_peered":"2024-09-10T08:28:45.606067+0000","last_clean":"2024-09-10T08:28:45.606067+0000","last_became_active":"2024-09-10T08:28:35.566444+0000","last_became_peered":"2024-09-10T08:28:35.566444+0000","last_unstale":"2024-09-10T08:28:45.606067+0000","last_undegraded":"2024-09-10T08:28:45.606067+0000","last_fullsized":"2024-09-10T08:28:45.606067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:52.735296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.607113+0000","last_change":"2024-09-10T08:28:34.560745+0000","last_active":"2024-09-10T08:28:47.607113+0000","last_peered":"2024-09-10T08:28:47.607113+0000","last_clean":"2024-09-10T08:28:47.607113+0000","last_became_active":"2024-09-10T08:28:34.559911+0000","last_became_peered":"2024-09-10T08:28:34.559911+0000","last_unstale":"2024-09-10T08:28:47.607113+0000","last_undegraded":"2024-09-10T08:28:47.607113+0000","last_fullsized":"2024-09-10T08:28:47.607113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:00.234067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.604789+0000","last_change":"2024-09-10T08:28:45.604789+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.604789+0000","last_undegraded":"2024-09-10T08:28:45.604789+0000","last_fullsized":"2024-09-10T08:28:45.604789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619165+0000","last_change":"2024-09-10T08:28:35.576360+0000","last_active":"2024-09-10T08:28:36.619165+0000","last_peered":"2024-09-10T08:28:36.619165+0000","last_clean":"2024-09-10T08:28:36.619165+0000","last_became_active":"2024-09-10T08:28:35.576096+0000","last_became_peered":"2024-09-10T08:28:35.576096+0000","last_unstale":"2024-09-10T08:28:36.619165+0000","last_undegraded":"2024-09-10T08:28:36.619165+0000","last_fullsized":"2024-09-10T08:28:36.619165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:34.159275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603675+0000","last_change":"2024-09-10T08:28:34.568477+0000","last_active":"2024-09-10T08:28:45.603675+0000","last_peered":"2024-09-10T08:28:45.603675+0000","last_clean":"2024-09-10T08:28:45.603675+0000","last_became_active":"2024-09-10T08:28:34.568249+0000","last_became_peered":"2024-09-10T08:28:34.568249+0000","last_unstale":"2024-09-10T08:28:45.603675+0000","last_undegraded":"2024-09-10T08:28:45.603675+0000","last_fullsized":"2024-09-10T08:28:45.603675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:08.640043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:45.593387+0000","last_change":"2024-09-10T08:28:45.593387+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.593387+0000","last_undegraded":"2024-09-10T08:28:45.593387+0000","last_fullsized":"2024-09-10T08:28:45.593387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605156+0000","last_change":"2024-09-10T08:28:35.572658+0000","last_active":"2024-09-10T08:28:45.605156+0000","last_peered":"2024-09-10T08:28:45.605156+0000","last_clean":"2024-09-10T08:28:45.605156+0000","last_became_active":"2024-09-10T08:28:35.571611+0000","last_became_peered":"2024-09-10T08:28:35.571611+0000","last_unstale":"2024-09-10T08:28:45.605156+0000","last_undegraded":"2024-09-10T08:28:45.605156+0000","last_fullsized":"2024-09-10T08:28:45.605156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:42.726996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.602860+0000","last_change":"2024-09-10T08:28:34.555587+0000","last_active":"2024-09-10T08:28:45.602860+0000","last_peered":"2024-09-10T08:28:45.602860+0000","last_clean":"2024-09-10T08:28:45.602860+0000","last_became_active":"2024-09-10T08:28:34.555269+0000","last_became_peered":"2024-09-10T08:28:34.555269+0000","last_unstale":"2024-09-10T08:28:45.602860+0000","last_undegraded":"2024-09-10T08:28:45.602860+0000","last_fullsized":"2024-09-10T08:28:45.602860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:19.499870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603786+0000","last_change":"2024-09-10T08:28:26.724394+0000","last_active":"2024-09-10T08:28:45.603786+0000","last_peered":"2024-09-10T08:28:45.603786+0000","last_clean":"2024-09-10T08:28:45.603786+0000","last_became_active":"2024-09-10T08:28:26.723452+0000","last_became_peered":"2024-09-10T08:28:26.723452+0000","last_unstale":"2024-09-10T08:28:45.603786+0000","last_undegraded":"2024-09-10T08:28:45.603786+0000","last_fullsized":"2024-09-10T08:28:45.603786+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_clean_scrub_stamp":"2024-09-10T08:28:25.445753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:00.811505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.618510+0000","last_change":"2024-09-10T08:28:46.622048+0000","last_active":"2024-09-10T08:28:47.618510+0000","last_peered":"2024-09-10T08:28:47.618510+0000","last_clean":"2024-09-10T08:28:47.618510+0000","last_became_active":"2024-09-10T08:28:46.621770+0000","last_became_peered":"2024-09-10T08:28:46.621770+0000","last_unstale":"2024-09-10T08:28:47.618510+0000","last_undegraded":"2024-09-10T08:28:47.618510+0000","last_fullsized":"2024-09-10T08:28:47.618510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:51.430760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.623784+0000","last_change":"2024-09-10T08:28:47.620746+0000","last_active":"2024-09-10T08:28:47.623784+0000","last_peered":"2024-09-10T08:28:47.623784+0000","last_clean":"2024-09-10T08:28:47.623784+0000","last_became_active":"2024-09-10T08:28:47.620492+0000","last_became_peered":"2024-09-10T08:28:47.620492+0000","last_unstale":"2024-09-10T08:28:47.623784+0000","last_undegraded":"2024-09-10T08:28:47.623784+0000","last_fullsized":"2024-09-10T08:28:47.623784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:55.065641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603848+0000","last_change":"2024-09-10T08:28:35.574532+0000","last_active":"2024-09-10T08:28:45.603848+0000","last_peered":"2024-09-10T08:28:45.603848+0000","last_clean":"2024-09-10T08:28:45.603848+0000","last_became_active":"2024-09-10T08:28:35.574215+0000","last_became_peered":"2024-09-10T08:28:35.574215+0000","last_unstale":"2024-09-10T08:28:45.603848+0000","last_undegraded":"2024-09-10T08:28:45.603848+0000","last_fullsized":"2024-09-10T08:28:45.603848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:28.455653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.608591+0000","last_change":"2024-09-10T08:28:34.559911+0000","last_active":"2024-09-10T08:28:47.608591+0000","last_peered":"2024-09-10T08:28:47.608591+0000","last_clean":"2024-09-10T08:28:47.608591+0000","last_became_active":"2024-09-10T08:28:34.559635+0000","last_became_peered":"2024-09-10T08:28:34.559635+0000","last_unstale":"2024-09-10T08:28:47.608591+0000","last_undegraded":"2024-09-10T08:28:47.608591+0000","last_fullsized":"2024-09-10T08:28:47.608591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:40.892609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.617943+0000","last_change":"2024-09-10T08:28:46.620352+0000","last_active":"2024-09-10T08:28:47.617943+0000","last_peered":"2024-09-10T08:28:47.617943+0000","last_clean":"2024-09-10T08:28:47.617943+0000","last_became_active":"2024-09-10T08:28:46.620064+0000","last_became_peered":"2024-09-10T08:28:46.620064+0000","last_unstale":"2024-09-10T08:28:47.617943+0000","last_undegraded":"2024-09-10T08:28:47.617943+0000","last_fullsized":"2024-09-10T08:28:47.617943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:59.333579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.623859+0000","last_change":"2024-09-10T08:28:47.620305+0000","last_active":"2024-09-10T08:28:47.623859+0000","last_peered":"2024-09-10T08:28:47.623859+0000","last_clean":"2024-09-10T08:28:47.623859+0000","last_became_active":"2024-09-10T08:28:47.620014+0000","last_became_peered":"2024-09-10T08:28:47.620014+0000","last_unstale":"2024-09-10T08:28:47.623859+0000","last_undegraded":"2024-09-10T08:28:47.623859+0000","last_fullsized":"2024-09-10T08:28:47.623859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:26.503891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604168+0000","last_change":"2024-09-10T08:28:35.577124+0000","last_active":"2024-09-10T08:28:45.604168+0000","last_peered":"2024-09-10T08:28:45.604168+0000","last_clean":"2024-09-10T08:28:45.604168+0000","last_became_active":"2024-09-10T08:28:35.576655+0000","last_became_peered":"2024-09-10T08:28:35.576655+0000","last_unstale":"2024-09-10T08:28:45.604168+0000","last_undegraded":"2024-09-10T08:28:45.604168+0000","last_fullsized":"2024-09-10T08:28:45.604168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:29.878600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.607127+0000","last_change":"2024-09-10T08:28:34.560694+0000","last_active":"2024-09-10T08:28:45.607127+0000","last_peered":"2024-09-10T08:28:45.607127+0000","last_clean":"2024-09-10T08:28:45.607127+0000","last_became_active":"2024-09-10T08:28:34.560429+0000","last_became_peered":"2024-09-10T08:28:34.560429+0000","last_unstale":"2024-09-10T08:28:45.607127+0000","last_undegraded":"2024-09-10T08:28:45.607127+0000","last_fullsized":"2024-09-10T08:28:45.607127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:54.514467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:45.593387+0000","last_change":"2024-09-10T08:28:45.593387+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.593387+0000","last_undegraded":"2024-09-10T08:28:45.593387+0000","last_fullsized":"2024-09-10T08:28:45.593387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604619+0000","last_change":"2024-09-10T08:28:35.577577+0000","last_active":"2024-09-10T08:28:45.604619+0000","last_peered":"2024-09-10T08:28:45.604619+0000","last_clean":"2024-09-10T08:28:45.604619+0000","last_became_active":"2024-09-10T08:28:35.576686+0000","last_became_peered":"2024-09-10T08:28:35.576686+0000","last_unstale":"2024-09-10T08:28:45.604619+0000","last_undegraded":"2024-09-10T08:28:45.604619+0000","last_fullsized":"2024-09-10T08:28:45.604619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:36.334494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.608095+0000","last_change":"2024-09-10T08:28:34.560313+0000","last_active":"2024-09-10T08:28:47.608095+0000","last_peered":"2024-09-10T08:28:47.608095+0000","last_clean":"2024-09-10T08:28:47.608095+0000","last_became_active":"2024-09-10T08:28:34.560035+0000","last_became_peered":"2024-09-10T08:28:34.560035+0000","last_unstale":"2024-09-10T08:28:47.608095+0000","last_undegraded":"2024-09-10T08:28:47.608095+0000","last_fullsized":"2024-09-10T08:28:47.608095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:56.945537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.601907+0000","last_change":"2024-09-10T08:28:45.601907+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.601907+0000","last_undegraded":"2024-09-10T08:28:45.601907+0000","last_fullsized":"2024-09-10T08:28:45.601907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.621115+0000","last_change":"2024-09-10T08:28:47.619805+0000","last_active":"2024-09-10T08:28:47.621115+0000","last_peered":"2024-09-10T08:28:47.621115+0000","last_clean":"2024-09-10T08:28:47.621115+0000","last_became_active":"2024-09-10T08:28:47.619452+0000","last_became_peered":"2024-09-10T08:28:47.619452+0000","last_unstale":"2024-09-10T08:28:47.621115+0000","last_undegraded":"2024-09-10T08:28:47.621115+0000","last_fullsized":"2024-09-10T08:28:47.621115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:41:58.798577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604071+0000","last_change":"2024-09-10T08:28:35.577476+0000","last_active":"2024-09-10T08:28:45.604071+0000","last_peered":"2024-09-10T08:28:45.604071+0000","last_clean":"2024-09-10T08:28:45.604071+0000","last_became_active":"2024-09-10T08:28:35.576786+0000","last_became_peered":"2024-09-10T08:28:35.576786+0000","last_unstale":"2024-09-10T08:28:45.604071+0000","last_undegraded":"2024-09-10T08:28:45.604071+0000","last_fullsized":"2024-09-10T08:28:45.604071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:46.914074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603504+0000","last_change":"2024-09-10T08:28:34.551102+0000","last_active":"2024-09-10T08:28:45.603504+0000","last_peered":"2024-09-10T08:28:45.603504+0000","last_clean":"2024-09-10T08:28:45.603504+0000","last_became_active":"2024-09-10T08:28:34.550773+0000","last_became_peered":"2024-09-10T08:28:34.550773+0000","last_unstale":"2024-09-10T08:28:45.603504+0000","last_undegraded":"2024-09-10T08:28:45.603504+0000","last_fullsized":"2024-09-10T08:28:45.603504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:35.393695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.600953+0000","last_change":"2024-09-10T08:28:45.600953+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.600953+0000","last_undegraded":"2024-09-10T08:28:45.600953+0000","last_fullsized":"2024-09-10T08:28:45.600953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604205+0000","last_change":"2024-09-10T08:28:35.575307+0000","last_active":"2024-09-10T08:28:45.604205+0000","last_peered":"2024-09-10T08:28:45.604205+0000","last_clean":"2024-09-10T08:28:45.604205+0000","last_became_active":"2024-09-10T08:28:35.575038+0000","last_became_peered":"2024-09-10T08:28:35.575038+0000","last_unstale":"2024-09-10T08:28:45.604205+0000","last_undegraded":"2024-09-10T08:28:45.604205+0000","last_fullsized":"2024-09-10T08:28:45.604205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:36.478822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.607008+0000","last_change":"2024-09-10T08:28:34.555542+0000","last_active":"2024-09-10T08:28:47.607008+0000","last_peered":"2024-09-10T08:28:47.607008+0000","last_clean":"2024-09-10T08:28:47.607008+0000","last_became_active":"2024-09-10T08:28:34.555179+0000","last_became_peered":"2024-09-10T08:28:34.555179+0000","last_unstale":"2024-09-10T08:28:47.607008+0000","last_undegraded":"2024-09-10T08:28:47.607008+0000","last_fullsized":"2024-09-10T08:28:47.607008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:53.313161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:45.593387+0000","last_change":"2024-09-10T08:28:45.593387+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.593387+0000","last_undegraded":"2024-09-10T08:28:45.593387+0000","last_fullsized":"2024-09-10T08:28:45.593387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.617179+0000","last_change":"2024-09-10T08:28:35.578892+0000","last_active":"2024-09-10T08:28:47.617179+0000","last_peered":"2024-09-10T08:28:47.617179+0000","last_clean":"2024-09-10T08:28:47.617179+0000","last_became_active":"2024-09-10T08:28:35.578299+0000","last_became_peered":"2024-09-10T08:28:35.578299+0000","last_unstale":"2024-09-10T08:28:47.617179+0000","last_undegraded":"2024-09-10T08:28:47.617179+0000","last_fullsized":"2024-09-10T08:28:47.617179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:27.485392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.617702+0000","last_change":"2024-09-10T08:28:34.560444+0000","last_active":"2024-09-10T08:28:47.617702+0000","last_peered":"2024-09-10T08:28:47.617702+0000","last_clean":"2024-09-10T08:28:47.617702+0000","last_became_active":"2024-09-10T08:28:34.560188+0000","last_became_peered":"2024-09-10T08:28:34.560188+0000","last_unstale":"2024-09-10T08:28:47.617702+0000","last_undegraded":"2024-09-10T08:28:47.617702+0000","last_fullsized":"2024-09-10T08:28:47.617702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:15.727780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.604116+0000","last_change":"2024-09-10T08:28:45.604116+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.604116+0000","last_undegraded":"2024-09-10T08:28:45.604116+0000","last_fullsized":"2024-09-10T08:28:45.604116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604484+0000","last_change":"2024-09-10T08:28:35.575788+0000","last_active":"2024-09-10T08:28:45.604484+0000","last_peered":"2024-09-10T08:28:45.604484+0000","last_clean":"2024-09-10T08:28:45.604484+0000","last_became_active":"2024-09-10T08:28:35.575333+0000","last_became_peered":"2024-09-10T08:28:35.575333+0000","last_unstale":"2024-09-10T08:28:45.604484+0000","last_undegraded":"2024-09-10T08:28:45.604484+0000","last_fullsized":"2024-09-10T08:28:45.604484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:39.756390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604482+0000","last_change":"2024-09-10T08:28:34.560699+0000","last_active":"2024-09-10T08:28:45.604482+0000","last_peered":"2024-09-10T08:28:45.604482+0000","last_clean":"2024-09-10T08:28:45.604482+0000","last_became_active":"2024-09-10T08:28:34.560376+0000","last_became_peered":"2024-09-10T08:28:34.560376+0000","last_unstale":"2024-09-10T08:28:45.604482+0000","last_undegraded":"2024-09-10T08:28:45.604482+0000","last_fullsized":"2024-09-10T08:28:45.604482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:09.981216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.603603+0000","last_change":"2024-09-10T08:28:45.603603+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.603603+0000","last_undegraded":"2024-09-10T08:28:45.603603+0000","last_fullsized":"2024-09-10T08:28:45.603603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619742+0000","last_change":"2024-09-10T08:28:35.574810+0000","last_active":"2024-09-10T08:28:36.619742+0000","last_peered":"2024-09-10T08:28:36.619742+0000","last_clean":"2024-09-10T08:28:36.619742+0000","last_became_active":"2024-09-10T08:28:35.574567+0000","last_became_peered":"2024-09-10T08:28:35.574567+0000","last_unstale":"2024-09-10T08:28:36.619742+0000","last_undegraded":"2024-09-10T08:28:36.619742+0000","last_fullsized":"2024-09-10T08:28:36.619742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:29.315833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620328+0000","last_change":"2024-09-10T08:28:34.553556+0000","last_active":"2024-09-10T08:28:36.620328+0000","last_peered":"2024-09-10T08:28:36.620328+0000","last_clean":"2024-09-10T08:28:36.620328+0000","last_became_active":"2024-09-10T08:28:34.553275+0000","last_became_peered":"2024-09-10T08:28:34.553275+0000","last_unstale":"2024-09-10T08:28:36.620328+0000","last_undegraded":"2024-09-10T08:28:36.620328+0000","last_fullsized":"2024-09-10T08:28:36.620328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:45.957635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.600401+0000","last_change":"2024-09-10T08:28:45.600401+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.600401+0000","last_undegraded":"2024-09-10T08:28:45.600401+0000","last_fullsized":"2024-09-10T08:28:45.600401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603744+0000","last_change":"2024-09-10T08:28:35.582473+0000","last_active":"2024-09-10T08:28:45.603744+0000","last_peered":"2024-09-10T08:28:45.603744+0000","last_clean":"2024-09-10T08:28:45.603744+0000","last_became_active":"2024-09-10T08:28:35.582205+0000","last_became_peered":"2024-09-10T08:28:35.582205+0000","last_unstale":"2024-09-10T08:28:45.603744+0000","last_undegraded":"2024-09-10T08:28:45.603744+0000","last_fullsized":"2024-09-10T08:28:45.603744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:11.200963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.618829+0000","last_change":"2024-09-10T08:28:34.559823+0000","last_active":"2024-09-10T08:28:47.618829+0000","last_peered":"2024-09-10T08:28:47.618829+0000","last_clean":"2024-09-10T08:28:47.618829+0000","last_became_active":"2024-09-10T08:28:34.559560+0000","last_became_peered":"2024-09-10T08:28:34.559560+0000","last_unstale":"2024-09-10T08:28:47.618829+0000","last_undegraded":"2024-09-10T08:28:47.618829+0000","last_fullsized":"2024-09-10T08:28:47.618829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:53.724382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.605252+0000","last_change":"2024-09-10T08:28:45.605252+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.605252+0000","last_undegraded":"2024-09-10T08:28:45.605252+0000","last_fullsized":"2024-09-10T08:28:45.605252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603930+0000","last_change":"2024-09-10T08:28:35.571262+0000","last_active":"2024-09-10T08:28:45.603930+0000","last_peered":"2024-09-10T08:28:45.603930+0000","last_clean":"2024-09-10T08:28:45.603930+0000","last_became_active":"2024-09-10T08:28:35.570711+0000","last_became_peered":"2024-09-10T08:28:35.570711+0000","last_unstale":"2024-09-10T08:28:45.603930+0000","last_undegraded":"2024-09-10T08:28:45.603930+0000","last_fullsized":"2024-09-10T08:28:45.603930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:29.116422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.607025+0000","last_change":"2024-09-10T08:28:34.557352+0000","last_active":"2024-09-10T08:28:45.607025+0000","last_peered":"2024-09-10T08:28:45.607025+0000","last_clean":"2024-09-10T08:28:45.607025+0000","last_became_active":"2024-09-10T08:28:34.557076+0000","last_became_peered":"2024-09-10T08:28:34.557076+0000","last_unstale":"2024-09-10T08:28:45.607025+0000","last_undegraded":"2024-09-10T08:28:45.607025+0000","last_fullsized":"2024-09-10T08:28:45.607025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:04.957739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.601549+0000","last_change":"2024-09-10T08:28:45.601549+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.601549+0000","last_undegraded":"2024-09-10T08:28:45.601549+0000","last_fullsized":"2024-09-10T08:28:45.601549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.627287+0000","last_change":"2024-09-10T08:28:47.623223+0000","last_active":"2024-09-10T08:28:47.627287+0000","last_peered":"2024-09-10T08:28:47.627287+0000","last_clean":"2024-09-10T08:28:47.627287+0000","last_became_active":"2024-09-10T08:28:47.622961+0000","last_became_peered":"2024-09-10T08:28:47.622961+0000","last_unstale":"2024-09-10T08:28:47.627287+0000","last_undegraded":"2024-09-10T08:28:47.627287+0000","last_fullsized":"2024-09-10T08:28:47.627287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:03.024023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619533+0000","last_change":"2024-09-10T08:28:35.577913+0000","last_active":"2024-09-10T08:28:36.619533+0000","last_peered":"2024-09-10T08:28:36.619533+0000","last_clean":"2024-09-10T08:28:36.619533+0000","last_became_active":"2024-09-10T08:28:35.577255+0000","last_became_peered":"2024-09-10T08:28:35.577255+0000","last_unstale":"2024-09-10T08:28:36.619533+0000","last_undegraded":"2024-09-10T08:28:36.619533+0000","last_fullsized":"2024-09-10T08:28:36.619533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:17.413525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603259+0000","last_change":"2024-09-10T08:28:34.564571+0000","last_active":"2024-09-10T08:28:45.603259+0000","last_peered":"2024-09-10T08:28:45.603259+0000","last_clean":"2024-09-10T08:28:45.603259+0000","last_became_active":"2024-09-10T08:28:34.564189+0000","last_became_peered":"2024-09-10T08:28:34.564189+0000","last_unstale":"2024-09-10T08:28:45.603259+0000","last_undegraded":"2024-09-10T08:28:45.603259+0000","last_fullsized":"2024-09-10T08:28:45.603259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:46.055510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.604073+0000","last_change":"2024-09-10T08:28:45.604073+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.604073+0000","last_undegraded":"2024-09-10T08:28:45.604073+0000","last_fullsized":"2024-09-10T08:28:45.604073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603156+0000","last_change":"2024-09-10T08:28:35.572944+0000","last_active":"2024-09-10T08:28:45.603156+0000","last_peered":"2024-09-10T08:28:45.603156+0000","last_clean":"2024-09-10T08:28:45.603156+0000","last_became_active":"2024-09-10T08:28:35.572620+0000","last_became_peered":"2024-09-10T08:28:35.572620+0000","last_unstale":"2024-09-10T08:28:45.603156+0000","last_undegraded":"2024-09-10T08:28:45.603156+0000","last_fullsized":"2024-09-10T08:28:45.603156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:04.524048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.619511+0000","last_change":"2024-09-10T08:28:34.562935+0000","last_active":"2024-09-10T08:28:47.619511+0000","last_peered":"2024-09-10T08:28:47.619511+0000","last_clean":"2024-09-10T08:28:47.619511+0000","last_became_active":"2024-09-10T08:28:34.562647+0000","last_became_peered":"2024-09-10T08:28:34.562647+0000","last_unstale":"2024-09-10T08:28:47.619511+0000","last_undegraded":"2024-09-10T08:28:47.619511+0000","last_fullsized":"2024-09-10T08:28:47.619511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:47.492281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.603885+0000","last_change":"2024-09-10T08:28:45.603885+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.603885+0000","last_undegraded":"2024-09-10T08:28:45.603885+0000","last_fullsized":"2024-09-10T08:28:45.603885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.634964+0000","last_change":"2024-09-10T08:28:47.627750+0000","last_active":"2024-09-10T08:28:47.634964+0000","last_peered":"2024-09-10T08:28:47.634964+0000","last_clean":"2024-09-10T08:28:47.634964+0000","last_became_active":"2024-09-10T08:28:47.627481+0000","last_became_peered":"2024-09-10T08:28:47.627481+0000","last_unstale":"2024-09-10T08:28:47.634964+0000","last_undegraded":"2024-09-10T08:28:47.634964+0000","last_fullsized":"2024-09-10T08:28:47.634964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:10.323020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:45.593387+0000","last_change":"2024-09-10T08:28:45.593387+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.593387+0000","last_undegraded":"2024-09-10T08:28:45.593387+0000","last_fullsized":"2024-09-10T08:28:45.593387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606276+0000","last_change":"2024-09-10T08:28:35.572803+0000","last_active":"2024-09-10T08:28:45.606276+0000","last_peered":"2024-09-10T08:28:45.606276+0000","last_clean":"2024-09-10T08:28:45.606276+0000","last_became_active":"2024-09-10T08:28:35.572219+0000","last_became_peered":"2024-09-10T08:28:35.572219+0000","last_unstale":"2024-09-10T08:28:45.606276+0000","last_undegraded":"2024-09-10T08:28:45.606276+0000","last_fullsized":"2024-09-10T08:28:45.606276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:45.920218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603662+0000","last_change":"2024-09-10T08:28:34.554346+0000","last_active":"2024-09-10T08:28:45.603662+0000","last_peered":"2024-09-10T08:28:45.603662+0000","last_clean":"2024-09-10T08:28:45.603662+0000","last_became_active":"2024-09-10T08:28:34.553933+0000","last_became_peered":"2024-09-10T08:28:34.553933+0000","last_unstale":"2024-09-10T08:28:45.603662+0000","last_undegraded":"2024-09-10T08:28:45.603662+0000","last_fullsized":"2024-09-10T08:28:45.603662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:07.639671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.640842+0000","last_change":"2024-09-10T08:28:46.630904+0000","last_active":"2024-09-10T08:28:47.640842+0000","last_peered":"2024-09-10T08:28:47.640842+0000","last_clean":"2024-09-10T08:28:47.640842+0000","last_became_active":"2024-09-10T08:28:46.630530+0000","last_became_peered":"2024-09-10T08:28:46.630530+0000","last_unstale":"2024-09-10T08:28:47.640842+0000","last_undegraded":"2024-09-10T08:28:47.640842+0000","last_fullsized":"2024-09-10T08:28:47.640842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:33.599739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604633+0000","last_change":"2024-09-10T08:28:35.580244+0000","last_active":"2024-09-10T08:28:45.604633+0000","last_peered":"2024-09-10T08:28:45.604633+0000","last_clean":"2024-09-10T08:28:45.604633+0000","last_became_active":"2024-09-10T08:28:35.579975+0000","last_became_peered":"2024-09-10T08:28:35.579975+0000","last_unstale":"2024-09-10T08:28:45.604633+0000","last_undegraded":"2024-09-10T08:28:45.604633+0000","last_fullsized":"2024-09-10T08:28:45.604633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:16.498045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604937+0000","last_change":"2024-09-10T08:28:34.564751+0000","last_active":"2024-09-10T08:28:45.604937+0000","last_peered":"2024-09-10T08:28:45.604937+0000","last_clean":"2024-09-10T08:28:45.604937+0000","last_became_active":"2024-09-10T08:28:34.564479+0000","last_became_peered":"2024-09-10T08:28:34.564479+0000","last_unstale":"2024-09-10T08:28:45.604937+0000","last_undegraded":"2024-09-10T08:28:45.604937+0000","last_fullsized":"2024-09-10T08:28:45.604937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:29.618224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.618194+0000","last_change":"2024-09-10T08:28:34.561906+0000","last_active":"2024-09-10T08:28:47.618194+0000","last_peered":"2024-09-10T08:28:47.618194+0000","last_clean":"2024-09-10T08:28:47.618194+0000","last_became_active":"2024-09-10T08:28:34.561613+0000","last_became_peered":"2024-09-10T08:28:34.561613+0000","last_unstale":"2024-09-10T08:28:47.618194+0000","last_undegraded":"2024-09-10T08:28:47.618194+0000","last_fullsized":"2024-09-10T08:28:47.618194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:56.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620240+0000","last_change":"2024-09-10T08:28:35.576406+0000","last_active":"2024-09-10T08:28:36.620240+0000","last_peered":"2024-09-10T08:28:36.620240+0000","last_clean":"2024-09-10T08:28:36.620240+0000","last_became_active":"2024-09-10T08:28:35.576145+0000","last_became_peered":"2024-09-10T08:28:35.576145+0000","last_unstale":"2024-09-10T08:28:36.620240+0000","last_undegraded":"2024-09-10T08:28:36.620240+0000","last_fullsized":"2024-09-10T08:28:36.620240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:57.667098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.641416+0000","last_change":"2024-09-10T08:28:46.622395+0000","last_active":"2024-09-10T08:28:47.641416+0000","last_peered":"2024-09-10T08:28:47.641416+0000","last_clean":"2024-09-10T08:28:47.641416+0000","last_became_active":"2024-09-10T08:28:46.621941+0000","last_became_peered":"2024-09-10T08:28:46.621941+0000","last_unstale":"2024-09-10T08:28:47.641416+0000","last_undegraded":"2024-09-10T08:28:47.641416+0000","last_fullsized":"2024-09-10T08:28:47.641416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:54.928969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605876+0000","last_change":"2024-09-10T08:28:34.566606+0000","last_active":"2024-09-10T08:28:45.605876+0000","last_peered":"2024-09-10T08:28:45.605876+0000","last_clean":"2024-09-10T08:28:45.605876+0000","last_became_active":"2024-09-10T08:28:34.566388+0000","last_became_peered":"2024-09-10T08:28:34.566388+0000","last_unstale":"2024-09-10T08:28:45.605876+0000","last_undegraded":"2024-09-10T08:28:45.605876+0000","last_fullsized":"2024-09-10T08:28:45.605876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:33.528801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.602832+0000","last_change":"2024-09-10T08:28:35.559371+0000","last_active":"2024-09-10T08:28:45.602832+0000","last_peered":"2024-09-10T08:28:45.602832+0000","last_clean":"2024-09-10T08:28:45.602832+0000","last_became_active":"2024-09-10T08:28:35.559145+0000","last_became_peered":"2024-09-10T08:28:35.559145+0000","last_unstale":"2024-09-10T08:28:45.602832+0000","last_undegraded":"2024-09-10T08:28:45.602832+0000","last_fullsized":"2024-09-10T08:28:45.602832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:57.339318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.603493+0000","last_change":"2024-09-10T08:28:45.603493+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.603493+0000","last_undegraded":"2024-09-10T08:28:45.603493+0000","last_fullsized":"2024-09-10T08:28:45.603493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.617081+0000","last_change":"2024-09-10T08:28:35.579106+0000","last_active":"2024-09-10T08:28:47.617081+0000","last_peered":"2024-09-10T08:28:47.617081+0000","last_clean":"2024-09-10T08:28:47.617081+0000","last_became_active":"2024-09-10T08:28:35.578631+0000","last_became_peered":"2024-09-10T08:28:35.578631+0000","last_unstale":"2024-09-10T08:28:47.617081+0000","last_undegraded":"2024-09-10T08:28:47.617081+0000","last_fullsized":"2024-09-10T08:28:47.617081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:31.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.606957+0000","last_change":"2024-09-10T08:28:35.566780+0000","last_active":"2024-09-10T08:28:47.606957+0000","last_peered":"2024-09-10T08:28:47.606957+0000","last_clean":"2024-09-10T08:28:47.606957+0000","last_became_active":"2024-09-10T08:28:35.566529+0000","last_became_peered":"2024-09-10T08:28:35.566529+0000","last_unstale":"2024-09-10T08:28:47.606957+0000","last_undegraded":"2024-09-10T08:28:47.606957+0000","last_fullsized":"2024-09-10T08:28:47.606957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:09.481166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604413+0000","last_change":"2024-09-10T08:28:35.578735+0000","last_active":"2024-09-10T08:28:45.604413+0000","last_peered":"2024-09-10T08:28:45.604413+0000","last_clean":"2024-09-10T08:28:45.604413+0000","last_became_active":"2024-09-10T08:28:35.577995+0000","last_became_peered":"2024-09-10T08:28:35.577995+0000","last_unstale":"2024-09-10T08:28:45.604413+0000","last_undegraded":"2024-09-10T08:28:45.604413+0000","last_fullsized":"2024-09-10T08:28:45.604413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:11.033441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620112+0000","last_change":"2024-09-10T08:28:35.577852+0000","last_active":"2024-09-10T08:28:36.620112+0000","last_peered":"2024-09-10T08:28:36.620112+0000","last_clean":"2024-09-10T08:28:36.620112+0000","last_became_active":"2024-09-10T08:28:35.577571+0000","last_became_peered":"2024-09-10T08:28:35.577571+0000","last_unstale":"2024-09-10T08:28:36.620112+0000","last_undegraded":"2024-09-10T08:28:36.620112+0000","last_fullsized":"2024-09-10T08:28:36.620112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:22.713732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605491+0000","last_change":"2024-09-10T08:28:35.574676+0000","last_active":"2024-09-10T08:28:45.605491+0000","last_peered":"2024-09-10T08:28:45.605491+0000","last_clean":"2024-09-10T08:28:45.605491+0000","last_became_active":"2024-09-10T08:28:35.574437+0000","last_became_peered":"2024-09-10T08:28:35.574437+0000","last_unstale":"2024-09-10T08:28:45.605491+0000","last_undegraded":"2024-09-10T08:28:45.605491+0000","last_fullsized":"2024-09-10T08:28:45.605491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:45.422506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606933+0000","last_change":"2024-09-10T08:28:35.572550+0000","last_active":"2024-09-10T08:28:45.606933+0000","last_peered":"2024-09-10T08:28:45.606933+0000","last_clean":"2024-09-10T08:28:45.606933+0000","last_became_active":"2024-09-10T08:28:35.572184+0000","last_became_peered":"2024-09-10T08:28:35.572184+0000","last_unstale":"2024-09-10T08:28:45.606933+0000","last_undegraded":"2024-09-10T08:28:45.606933+0000","last_fullsized":"2024-09-10T08:28:45.606933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:08.490734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.619603+0000","last_change":"2024-09-10T08:28:35.573217+0000","last_active":"2024-09-10T08:28:47.619603+0000","last_peered":"2024-09-10T08:28:47.619603+0000","last_clean":"2024-09-10T08:28:47.619603+0000","last_became_active":"2024-09-10T08:28:35.572955+0000","last_became_peered":"2024-09-10T08:28:35.572955+0000","last_unstale":"2024-09-10T08:28:47.619603+0000","last_undegraded":"2024-09-10T08:28:47.619603+0000","last_fullsized":"2024-09-10T08:28:47.619603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:24.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.627308+0000","last_change":"2024-09-10T08:28:47.623365+0000","last_active":"2024-09-10T08:28:47.627308+0000","last_peered":"2024-09-10T08:28:47.627308+0000","last_clean":"2024-09-10T08:28:47.627308+0000","last_became_active":"2024-09-10T08:28:47.623082+0000","last_became_peered":"2024-09-10T08:28:47.623082+0000","last_unstale":"2024-09-10T08:28:47.627308+0000","last_undegraded":"2024-09-10T08:28:47.627308+0000","last_fullsized":"2024-09-10T08:28:47.627308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:44.700683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606011+0000","last_change":"2024-09-10T08:28:35.575902+0000","last_active":"2024-09-10T08:28:45.606011+0000","last_peered":"2024-09-10T08:28:45.606011+0000","last_clean":"2024-09-10T08:28:45.606011+0000","last_became_active":"2024-09-10T08:28:35.575614+0000","last_became_peered":"2024-09-10T08:28:35.575614+0000","last_unstale":"2024-09-10T08:28:45.606011+0000","last_undegraded":"2024-09-10T08:28:45.606011+0000","last_fullsized":"2024-09-10T08:28:45.606011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:11.277682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603554+0000","last_change":"2024-09-10T08:28:35.578285+0000","last_active":"2024-09-10T08:28:45.603554+0000","last_peered":"2024-09-10T08:28:45.603554+0000","last_clean":"2024-09-10T08:28:45.603554+0000","last_became_active":"2024-09-10T08:28:35.576805+0000","last_became_peered":"2024-09-10T08:28:35.576805+0000","last_unstale":"2024-09-10T08:28:45.603554+0000","last_undegraded":"2024-09-10T08:28:45.603554+0000","last_fullsized":"2024-09-10T08:28:45.603554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:46.203320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604782+0000","last_change":"2024-09-10T08:28:35.571566+0000","last_active":"2024-09-10T08:28:45.604782+0000","last_peered":"2024-09-10T08:28:45.604782+0000","last_clean":"2024-09-10T08:28:45.604782+0000","last_became_active":"2024-09-10T08:28:35.571285+0000","last_became_peered":"2024-09-10T08:28:35.571285+0000","last_unstale":"2024-09-10T08:28:45.604782+0000","last_undegraded":"2024-09-10T08:28:45.604782+0000","last_fullsized":"2024-09-10T08:28:45.604782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:23.587691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.621106+0000","last_change":"2024-09-10T08:28:47.619863+0000","last_active":"2024-09-10T08:28:47.621106+0000","last_peered":"2024-09-10T08:28:47.621106+0000","last_clean":"2024-09-10T08:28:47.621106+0000","last_became_active":"2024-09-10T08:28:47.619525+0000","last_became_peered":"2024-09-10T08:28:47.619525+0000","last_unstale":"2024-09-10T08:28:47.621106+0000","last_undegraded":"2024-09-10T08:28:47.621106+0000","last_fullsized":"2024-09-10T08:28:47.621106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:15.220842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604300+0000","last_change":"2024-09-10T08:28:35.568044+0000","last_active":"2024-09-10T08:28:45.604300+0000","last_peered":"2024-09-10T08:28:45.604300+0000","last_clean":"2024-09-10T08:28:45.604300+0000","last_became_active":"2024-09-10T08:28:35.567744+0000","last_became_peered":"2024-09-10T08:28:35.567744+0000","last_unstale":"2024-09-10T08:28:45.604300+0000","last_undegraded":"2024-09-10T08:28:45.604300+0000","last_fullsized":"2024-09-10T08:28:45.604300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:19.081138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619988+0000","last_change":"2024-09-10T08:28:35.575802+0000","last_active":"2024-09-10T08:28:36.619988+0000","last_peered":"2024-09-10T08:28:36.619988+0000","last_clean":"2024-09-10T08:28:36.619988+0000","last_became_active":"2024-09-10T08:28:35.575388+0000","last_became_peered":"2024-09-10T08:28:35.575388+0000","last_unstale":"2024-09-10T08:28:36.619988+0000","last_undegraded":"2024-09-10T08:28:36.619988+0000","last_fullsized":"2024-09-10T08:28:36.619988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:01.424265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.619820+0000","last_change":"2024-09-10T08:28:35.574499+0000","last_active":"2024-09-10T08:28:47.619820+0000","last_peered":"2024-09-10T08:28:47.619820+0000","last_clean":"2024-09-10T08:28:47.619820+0000","last_became_active":"2024-09-10T08:28:35.574249+0000","last_became_peered":"2024-09-10T08:28:35.574249+0000","last_unstale":"2024-09-10T08:28:47.619820+0000","last_undegraded":"2024-09-10T08:28:47.619820+0000","last_fullsized":"2024-09-10T08:28:47.619820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:55.952307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604916+0000","last_change":"2024-09-10T08:28:35.572709+0000","last_active":"2024-09-10T08:28:45.604916+0000","last_peered":"2024-09-10T08:28:45.604916+0000","last_clean":"2024-09-10T08:28:45.604916+0000","last_became_active":"2024-09-10T08:28:35.572392+0000","last_became_peered":"2024-09-10T08:28:35.572392+0000","last_unstale":"2024-09-10T08:28:45.604916+0000","last_undegraded":"2024-09-10T08:28:45.604916+0000","last_fullsized":"2024-09-10T08:28:45.604916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:42.636299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.608016+0000","last_change":"2024-09-10T08:28:35.574438+0000","last_active":"2024-09-10T08:28:47.608016+0000","last_peered":"2024-09-10T08:28:47.608016+0000","last_clean":"2024-09-10T08:28:47.608016+0000","last_became_active":"2024-09-10T08:28:35.574175+0000","last_became_peered":"2024-09-10T08:28:35.574175+0000","last_unstale":"2024-09-10T08:28:47.608016+0000","last_undegraded":"2024-09-10T08:28:47.608016+0000","last_fullsized":"2024-09-10T08:28:47.608016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:55.808543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603841+0000","last_change":"2024-09-10T08:28:35.567296+0000","last_active":"2024-09-10T08:28:45.603841+0000","last_peered":"2024-09-10T08:28:45.603841+0000","last_clean":"2024-09-10T08:28:45.603841+0000","last_became_active":"2024-09-10T08:28:35.567074+0000","last_became_peered":"2024-09-10T08:28:35.567074+0000","last_unstale":"2024-09-10T08:28:45.603841+0000","last_undegraded":"2024-09-10T08:28:45.603841+0000","last_fullsized":"2024-09-10T08:28:45.603841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:55.698345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603434+0000","last_change":"2024-09-10T08:28:35.570249+0000","last_active":"2024-09-10T08:28:45.603434+0000","last_peered":"2024-09-10T08:28:45.603434+0000","last_clean":"2024-09-10T08:28:45.603434+0000","last_became_active":"2024-09-10T08:28:35.569960+0000","last_became_peered":"2024-09-10T08:28:35.569960+0000","last_unstale":"2024-09-10T08:28:45.603434+0000","last_undegraded":"2024-09-10T08:28:45.603434+0000","last_fullsized":"2024-09-10T08:28:45.603434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:29.787554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606384+0000","last_change":"2024-09-10T08:28:35.560693+0000","last_active":"2024-09-10T08:28:45.606384+0000","last_peered":"2024-09-10T08:28:45.606384+0000","last_clean":"2024-09-10T08:28:45.606384+0000","last_became_active":"2024-09-10T08:28:35.560409+0000","last_became_peered":"2024-09-10T08:28:35.560409+0000","last_unstale":"2024-09-10T08:28:45.606384+0000","last_undegraded":"2024-09-10T08:28:45.606384+0000","last_fullsized":"2024-09-10T08:28:45.606384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:10.597654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619605+0000","last_change":"2024-09-10T08:28:35.574551+0000","last_active":"2024-09-10T08:28:36.619605+0000","last_peered":"2024-09-10T08:28:36.619605+0000","last_clean":"2024-09-10T08:28:36.619605+0000","last_became_active":"2024-09-10T08:28:35.574256+0000","last_became_peered":"2024-09-10T08:28:35.574256+0000","last_unstale":"2024-09-10T08:28:36.619605+0000","last_undegraded":"2024-09-10T08:28:36.619605+0000","last_fullsized":"2024-09-10T08:28:36.619605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:43.401552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605768+0000","last_change":"2024-09-10T08:28:35.573330+0000","last_active":"2024-09-10T08:28:45.605768+0000","last_peered":"2024-09-10T08:28:45.605768+0000","last_clean":"2024-09-10T08:28:45.605768+0000","last_became_active":"2024-09-10T08:28:35.572992+0000","last_became_peered":"2024-09-10T08:28:35.572992+0000","last_unstale":"2024-09-10T08:28:45.605768+0000","last_undegraded":"2024-09-10T08:28:45.605768+0000","last_fullsized":"2024-09-10T08:28:45.605768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:15.412219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603819+0000","last_change":"2024-09-10T08:28:35.566574+0000","last_active":"2024-09-10T08:28:45.603819+0000","last_peered":"2024-09-10T08:28:45.603819+0000","last_clean":"2024-09-10T08:28:45.603819+0000","last_became_active":"2024-09-10T08:28:35.566205+0000","last_became_peered":"2024-09-10T08:28:35.566205+0000","last_unstale":"2024-09-10T08:28:45.603819+0000","last_undegraded":"2024-09-10T08:28:45.603819+0000","last_fullsized":"2024-09-10T08:28:45.603819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:49.876773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.632473+0000","last_change":"2024-09-10T08:28:47.628051+0000","last_active":"2024-09-10T08:28:47.632473+0000","last_peered":"2024-09-10T08:28:47.632473+0000","last_clean":"2024-09-10T08:28:47.632473+0000","last_became_active":"2024-09-10T08:28:47.627747+0000","last_became_peered":"2024-09-10T08:28:47.627747+0000","last_unstale":"2024-09-10T08:28:47.632473+0000","last_undegraded":"2024-09-10T08:28:47.632473+0000","last_fullsized":"2024-09-10T08:28:47.632473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:38.999743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.618654+0000","last_change":"2024-09-10T08:28:35.565023+0000","last_active":"2024-09-10T08:28:47.618654+0000","last_peered":"2024-09-10T08:28:47.618654+0000","last_clean":"2024-09-10T08:28:47.618654+0000","last_became_active":"2024-09-10T08:28:35.564747+0000","last_became_peered":"2024-09-10T08:28:35.564747+0000","last_unstale":"2024-09-10T08:28:47.618654+0000","last_undegraded":"2024-09-10T08:28:47.618654+0000","last_fullsized":"2024-09-10T08:28:47.618654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:32.419621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.619510+0000","last_change":"2024-09-10T08:28:35.570619+0000","last_active":"2024-09-10T08:28:47.619510+0000","last_peered":"2024-09-10T08:28:47.619510+0000","last_clean":"2024-09-10T08:28:47.619510+0000","last_became_active":"2024-09-10T08:28:35.570351+0000","last_became_peered":"2024-09-10T08:28:35.570351+0000","last_unstale":"2024-09-10T08:28:47.619510+0000","last_undegraded":"2024-09-10T08:28:47.619510+0000","last_fullsized":"2024-09-10T08:28:47.619510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:35.161279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604535+0000","last_change":"2024-09-10T08:28:35.577345+0000","last_active":"2024-09-10T08:28:45.604535+0000","last_peered":"2024-09-10T08:28:45.604535+0000","last_clean":"2024-09-10T08:28:45.604535+0000","last_became_active":"2024-09-10T08:28:35.576191+0000","last_became_peered":"2024-09-10T08:28:35.576191+0000","last_unstale":"2024-09-10T08:28:45.604535+0000","last_undegraded":"2024-09-10T08:28:45.604535+0000","last_fullsized":"2024-09-10T08:28:45.604535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:29.218797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604605+0000","last_change":"2024-09-10T08:28:35.575275+0000","last_active":"2024-09-10T08:28:45.604605+0000","last_peered":"2024-09-10T08:28:45.604605+0000","last_clean":"2024-09-10T08:28:45.604605+0000","last_became_active":"2024-09-10T08:28:35.575052+0000","last_became_peered":"2024-09-10T08:28:35.575052+0000","last_unstale":"2024-09-10T08:28:45.604605+0000","last_undegraded":"2024-09-10T08:28:45.604605+0000","last_fullsized":"2024-09-10T08:28:45.604605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:24.313017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.635033+0000","last_change":"2024-09-10T08:28:47.628651+0000","last_active":"2024-09-10T08:28:47.635033+0000","last_peered":"2024-09-10T08:28:47.635033+0000","last_clean":"2024-09-10T08:28:47.635033+0000","last_became_active":"2024-09-10T08:28:47.628343+0000","last_became_peered":"2024-09-10T08:28:47.628343+0000","last_unstale":"2024-09-10T08:28:47.635033+0000","last_undegraded":"2024-09-10T08:28:47.635033+0000","last_fullsized":"2024-09-10T08:28:47.635033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:07.325085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604153+0000","last_change":"2024-09-10T08:28:35.578664+0000","last_active":"2024-09-10T08:28:45.604153+0000","last_peered":"2024-09-10T08:28:45.604153+0000","last_clean":"2024-09-10T08:28:45.604153+0000","last_became_active":"2024-09-10T08:28:35.578384+0000","last_became_peered":"2024-09-10T08:28:35.578384+0000","last_unstale":"2024-09-10T08:28:45.604153+0000","last_undegraded":"2024-09-10T08:28:45.604153+0000","last_fullsized":"2024-09-10T08:28:45.604153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:44.278718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604028+0000","last_change":"2024-09-10T08:28:35.578978+0000","last_active":"2024-09-10T08:28:45.604028+0000","last_peered":"2024-09-10T08:28:45.604028+0000","last_clean":"2024-09-10T08:28:45.604028+0000","last_became_active":"2024-09-10T08:28:35.578475+0000","last_became_peered":"2024-09-10T08:28:35.578475+0000","last_unstale":"2024-09-10T08:28:45.604028+0000","last_undegraded":"2024-09-10T08:28:45.604028+0000","last_fullsized":"2024-09-10T08:28:45.604028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:08.520314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604389+0000","last_change":"2024-09-10T08:28:35.572112+0000","last_active":"2024-09-10T08:28:45.604389+0000","last_peered":"2024-09-10T08:28:45.604389+0000","last_clean":"2024-09-10T08:28:45.604389+0000","last_became_active":"2024-09-10T08:28:35.571803+0000","last_became_peered":"2024-09-10T08:28:35.571803+0000","last_unstale":"2024-09-10T08:28:45.604389+0000","last_undegraded":"2024-09-10T08:28:45.604389+0000","last_fullsized":"2024-09-10T08:28:45.604389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:29.969987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603946+0000","last_change":"2024-09-10T08:28:35.578961+0000","last_active":"2024-09-10T08:28:45.603946+0000","last_peered":"2024-09-10T08:28:45.603946+0000","last_clean":"2024-09-10T08:28:45.603946+0000","last_became_active":"2024-09-10T08:28:35.578680+0000","last_became_peered":"2024-09-10T08:28:35.578680+0000","last_unstale":"2024-09-10T08:28:45.603946+0000","last_undegraded":"2024-09-10T08:28:45.603946+0000","last_fullsized":"2024-09-10T08:28:45.603946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:53.737412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.630179+0000","last_change":"2024-09-10T08:28:47.624859+0000","last_active":"2024-09-10T08:28:47.630179+0000","last_peered":"2024-09-10T08:28:47.630179+0000","last_clean":"2024-09-10T08:28:47.630179+0000","last_became_active":"2024-09-10T08:28:47.624585+0000","last_became_peered":"2024-09-10T08:28:47.624585+0000","last_unstale":"2024-09-10T08:28:47.630179+0000","last_undegraded":"2024-09-10T08:28:47.630179+0000","last_fullsized":"2024-09-10T08:28:47.630179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:07:09.719664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619390+0000","last_change":"2024-09-10T08:28:35.573918+0000","last_active":"2024-09-10T08:28:36.619390+0000","last_peered":"2024-09-10T08:28:36.619390+0000","last_clean":"2024-09-10T08:28:36.619390+0000","last_became_active":"2024-09-10T08:28:35.573646+0000","last_became_peered":"2024-09-10T08:28:35.573646+0000","last_unstale":"2024-09-10T08:28:36.619390+0000","last_undegraded":"2024-09-10T08:28:36.619390+0000","last_fullsized":"2024-09-10T08:28:36.619390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:24.295630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606597+0000","last_change":"2024-09-10T08:28:35.578197+0000","last_active":"2024-09-10T08:28:45.606597+0000","last_peered":"2024-09-10T08:28:45.606597+0000","last_clean":"2024-09-10T08:28:45.606597+0000","last_became_active":"2024-09-10T08:28:35.577852+0000","last_became_peered":"2024-09-10T08:28:35.577852+0000","last_unstale":"2024-09-10T08:28:45.606597+0000","last_undegraded":"2024-09-10T08:28:45.606597+0000","last_fullsized":"2024-09-10T08:28:45.606597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:44.348299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604447+0000","last_change":"2024-09-10T08:28:35.571065+0000","last_active":"2024-09-10T08:28:45.604447+0000","last_peered":"2024-09-10T08:28:45.604447+0000","last_clean":"2024-09-10T08:28:45.604447+0000","last_became_active":"2024-09-10T08:28:35.570749+0000","last_became_peered":"2024-09-10T08:28:35.570749+0000","last_unstale":"2024-09-10T08:28:45.604447+0000","last_undegraded":"2024-09-10T08:28:45.604447+0000","last_fullsized":"2024-09-10T08:28:45.604447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:04.628661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":2},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":54,"acting":54,"num_store_stats":6},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":806912,"data_stored":663617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":72793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":80918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":663673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":96195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":86390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:28:51.577 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:28:51.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.708+0000 7f8c2ae53640 1 Processor -- start 2024-09-10T08:28:51.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.708+0000 7f8c2ae53640 1 -- start start 2024-09-10T08:28:51.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.709+0000 7f8c2ae53640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c24073ae0 0x7f8c24153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.709+0000 7f8c2ae53640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c2406dd50 con 0x7f8c240733d0 2024-09-10T08:28:51.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.709+0000 7f8c2ae53640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c2406e030 con 0x7f8c24156f50 2024-09-10T08:28:51.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.709+0000 7f8c2ae53640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8c2406e310 con 0x7f8c24073ae0 2024-09-10T08:28:51.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.709+0000 7f8c23fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8c240733d0 0x7f8c24156840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50114/0 (socket says 172.21.15.103:50114) 2024-09-10T08:28:51.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.709+0000 7f8c23fff640 1 -- 172.21.15.103:0/1211892306 learned_addr learned my addr 172.21.15.103:0/1211892306 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:51.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.709+0000 7f8c28bef640 1 --2- 172.21.15.103:0/1211892306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c24073ae0 0x7f8c24153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.709+0000 7f8c237fe640 1 -- 172.21.15.103:0/1211892306 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2464109245 0 0) 0x7f8c2406dd50 con 0x7f8c240733d0 2024-09-10T08:28:51.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.709+0000 7f8c237fe640 1 -- 172.21.15.103:0/1211892306 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c14003520 con 0x7f8c240733d0 2024-09-10T08:28:51.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.709+0000 7f8c237fe640 1 -- 172.21.15.103:0/1211892306 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3095521162 0 0) 0x7f8c14003520 con 0x7f8c240733d0 2024-09-10T08:28:51.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.709+0000 7f8c237fe640 1 -- 172.21.15.103:0/1211892306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c24073ae0 msgr2=0x7f8c24153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:51.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.709+0000 7f8c237fe640 1 --2- 172.21.15.103:0/1211892306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c24073ae0 0x7f8c24153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.709+0000 7f8c237fe640 1 -- 172.21.15.103:0/1211892306 >> v1:172.21.15.154:6789/0 conn(0x7f8c24156f50 legacy=0x7f8c24160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.709+0000 7f8c237fe640 1 -- 172.21.15.103:0/1211892306 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2406e5f0 con 0x7f8c240733d0 2024-09-10T08:28:51.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.709+0000 7f8c237fe640 1 -- 172.21.15.103:0/1211892306 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f8c10001670 con 0x7f8c240733d0 2024-09-10T08:28:51.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.709+0000 7f8c237fe640 1 -- 172.21.15.103:0/1211892306 >> v1:172.21.15.103:6789/0 conn(0x7f8c240733d0 legacy=0x7f8c24156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.709+0000 7f8c237fe640 1 --2- 172.21.15.103:0/1211892306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c24073ae0 0x7f8c140039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.709+0000 7f8c237fe640 1 --2- 172.21.15.103:0/1211892306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c14003f20 0x7f8c14004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.709+0000 7f8c237fe640 1 --2- 172.21.15.103:0/1211892306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c14004d40 0x7f8c140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.709+0000 7f8c237fe640 1 -- 172.21.15.103:0/1211892306 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2406e310 con 0x7f8c14003f20 2024-09-10T08:28:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.709+0000 7f8c237fe640 1 -- 172.21.15.103:0/1211892306 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1400ba20 con 0x7f8c14004d40 2024-09-10T08:28:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.709+0000 7f8c237fe640 1 -- 172.21.15.103:0/1211892306 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8c1400bc20 con 0x7f8c24073ae0 2024-09-10T08:28:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.710+0000 7f8c23fff640 1 --2- 172.21.15.103:0/1211892306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c14003f20 0x7f8c14004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.710+0000 7f8c28bef640 1 --2- 172.21.15.103:0/1211892306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c24073ae0 0x7f8c140039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.710+0000 7f8c293f0640 1 --2- 172.21.15.103:0/1211892306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c14004d40 0x7f8c140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.710+0000 7f8c23fff640 1 -- 172.21.15.103:0/1211892306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c24073ae0 msgr2=0x7f8c140039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.710+0000 7f8c23fff640 1 --2- 172.21.15.103:0/1211892306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c24073ae0 0x7f8c140039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.710+0000 7f8c23fff640 1 -- 172.21.15.103:0/1211892306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c14004d40 msgr2=0x7f8c140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.710+0000 7f8c23fff640 1 --2- 172.21.15.103:0/1211892306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c14004d40 0x7f8c140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.710+0000 7f8c23fff640 1 -- 172.21.15.103:0/1211892306 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c14003520 con 0x7f8c14003f20 2024-09-10T08:28:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.710+0000 7f8c23fff640 1 --2- 172.21.15.103:0/1211892306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c14003f20 0x7f8c14004800 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8c240737d0 tx=0x7f8c14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba329ae6b7e7c7f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.711+0000 7f8c237fe640 1 -- 172.21.15.103:0/1211892306 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c10007ca0 con 0x7f8c14003f20 2024-09-10T08:28:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.711+0000 7f8c237fe640 1 -- 172.21.15.103:0/1211892306 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c10005ad0 con 0x7f8c14003f20 2024-09-10T08:28:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.711+0000 7f8c237fe640 1 -- 172.21.15.103:0/1211892306 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c10007070 con 0x7f8c14003f20 2024-09-10T08:28:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.711+0000 7f8c2ae53640 1 -- 172.21.15.103:0/1211892306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c14003f20 msgr2=0x7f8c14004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.711+0000 7f8c2ae53640 1 --2- 172.21.15.103:0/1211892306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c14003f20 0x7f8c14004800 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8c240737d0 tx=0x7f8c14005830 comp rx=0 tx=0).stop 2024-09-10T08:28:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.711+0000 7f8c293f0640 1 -- 172.21.15.103:0/1211892306 reap_dead start 2024-09-10T08:28:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.711+0000 7f8c2ae53640 1 -- 172.21.15.103:0/1211892306 shutdown_connections 2024-09-10T08:28:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.711+0000 7f8c2ae53640 1 -- 172.21.15.103:0/1211892306 >> 172.21.15.103:0/1211892306 conn(0x7f8c240c9d80 msgr2=0x7f8c240ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.711+0000 7f8c2ae53640 1 -- 172.21.15.103:0/1211892306 shutdown_connections 2024-09-10T08:28:51.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.711+0000 7f8c2ae53640 1 -- 172.21.15.103:0/1211892306 wait complete. 2024-09-10T08:28:51.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.712+0000 7f8c2ae53640 1 Processor -- start 2024-09-10T08:28:51.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.712+0000 7f8c2ae53640 1 -- start start 2024-09-10T08:28:51.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.713+0000 7f8c2ae53640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c14003f20 0x7f8c2414e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.713+0000 7f8c2ae53640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c24157600 0x7f8c24150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.713+0000 7f8c2ae53640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c2414d850 0x7f8c241506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.713+0000 7f8c2ae53640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2406edd0 con 0x7f8c24157600 2024-09-10T08:28:51.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.713+0000 7f8c2ae53640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2406ec50 con 0x7f8c14003f20 2024-09-10T08:28:51.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.713+0000 7f8c2ae53640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8c24073ec0 con 0x7f8c2414d850 2024-09-10T08:28:51.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.713+0000 7f8c23fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c24157600 0x7f8c24150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.713+0000 7f8c23fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c24157600 0x7f8c24150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57396/0 (socket says 172.21.15.103:57396) 2024-09-10T08:28:51.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.713+0000 7f8c23fff640 1 -- 172.21.15.103:0/3307906288 learned_addr learned my addr 172.21.15.103:0/3307906288 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:51.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.713+0000 7f8c293f0640 1 --2- 172.21.15.103:0/3307906288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c2414d850 0x7f8c241506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.713+0000 7f8c28bef640 1 --2- 172.21.15.103:0/3307906288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c14003f20 0x7f8c2414e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.714+0000 7f8c23fff640 1 -- 172.21.15.103:0/3307906288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c2414d850 msgr2=0x7f8c241506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.714+0000 7f8c23fff640 1 --2- 172.21.15.103:0/3307906288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c2414d850 0x7f8c241506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.714+0000 7f8c23fff640 1 -- 172.21.15.103:0/3307906288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c14003f20 msgr2=0x7f8c2414e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.714+0000 7f8c23fff640 1 --2- 172.21.15.103:0/3307906288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c14003f20 0x7f8c2414e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.714+0000 7f8c23fff640 1 -- 172.21.15.103:0/3307906288 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c24150c00 con 0x7f8c24157600 2024-09-10T08:28:51.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.714+0000 7f8c23fff640 1 --2- 172.21.15.103:0/3307906288 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c24157600 0x7f8c24150180 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8c24154050 tx=0x7f8c2406e200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:51.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.714+0000 7f8c217fa640 1 -- 172.21.15.103:0/3307906288 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c10040020 con 0x7f8c24157600 2024-09-10T08:28:51.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.714+0000 7f8c217fa640 1 -- 172.21.15.103:0/3307906288 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c10001430 con 0x7f8c24157600 2024-09-10T08:28:51.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.714+0000 7f8c2ae53640 1 -- 172.21.15.103:0/3307906288 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c24150eb0 con 0x7f8c24157600 2024-09-10T08:28:51.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.714+0000 7f8c217fa640 1 -- 172.21.15.103:0/3307906288 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c10037040 con 0x7f8c24157600 2024-09-10T08:28:51.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.714+0000 7f8c2ae53640 1 -- 172.21.15.103:0/3307906288 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c24152ca0 con 0x7f8c24157600 2024-09-10T08:28:51.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.715+0000 7f8c2ae53640 1 -- 172.21.15.103:0/3307906288 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c2406d850 con 0x7f8c24157600 2024-09-10T08:28:51.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.715+0000 7f8c217fa640 1 -- 172.21.15.103:0/3307906288 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c10043020 con 0x7f8c24157600 2024-09-10T08:28:51.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.716+0000 7f8c217fa640 1 --2- 172.21.15.103:0/3307906288 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8c0806be30 0x7f8c0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.716+0000 7f8c217fa640 1 -- 172.21.15.103:0/3307906288 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f8c100aaf10 con 0x7f8c24157600 2024-09-10T08:28:51.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.716+0000 7f8c28bef640 1 --2- 172.21.15.103:0/3307906288 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8c0806be30 0x7f8c0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.716+0000 7f8c28bef640 1 --2- 172.21.15.103:0/3307906288 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8c0806be30 0x7f8c0806e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8c241561e0 tx=0x7f8c18009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:51.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.720+0000 7f8c217fa640 1 -- 172.21.15.103:0/3307906288 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8c24150c00 con 0x7f8c24157600 2024-09-10T08:28:51.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.882+0000 7f8c2ae53640 1 -- 172.21.15.103:0/3307906288 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8c24157ae0 con 0x7f8c0806be30 2024-09-10T08:28:51.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.892+0000 7f8c217fa640 1 -- 172.21.15.103:0/3307906288 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+480184 (secure 0 0 0) 0x7f8c18014bb0 con 0x7f8c0806be30 2024-09-10T08:28:51.898 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:51.904 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T08:28:51.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.896+0000 7f8c2ae53640 1 -- 172.21.15.103:0/3307906288 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8c0806be30 msgr2=0x7f8c0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.896+0000 7f8c2ae53640 1 --2- 172.21.15.103:0/3307906288 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8c0806be30 0x7f8c0806e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8c241561e0 tx=0x7f8c18009190 comp rx=0 tx=0).stop 2024-09-10T08:28:51.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.896+0000 7f8c2ae53640 1 -- 172.21.15.103:0/3307906288 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c24157600 msgr2=0x7f8c24150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.896+0000 7f8c2ae53640 1 --2- 172.21.15.103:0/3307906288 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c24157600 0x7f8c24150180 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8c24154050 tx=0x7f8c2406e200 comp rx=0 tx=0).stop 2024-09-10T08:28:51.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.896+0000 7f8c2ae53640 1 -- 172.21.15.103:0/3307906288 shutdown_connections 2024-09-10T08:28:51.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.896+0000 7f8c2ae53640 1 --2- 172.21.15.103:0/3307906288 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8c0806be30 0x7f8c0806e2f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.896+0000 7f8c2ae53640 1 --2- 172.21.15.103:0/3307906288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c2414d850 0x7f8c241506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.896+0000 7f8c2ae53640 1 --2- 172.21.15.103:0/3307906288 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c24157600 0x7f8c24150180 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.896+0000 7f8c2ae53640 1 --2- 172.21.15.103:0/3307906288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c14003f20 0x7f8c2414e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.896+0000 7f8c2ae53640 1 -- 172.21.15.103:0/3307906288 >> 172.21.15.103:0/3307906288 conn(0x7f8c240c9d80 msgr2=0x7f8c2414c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:51.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.896+0000 7f8c2ae53640 1 -- 172.21.15.103:0/3307906288 shutdown_connections 2024-09-10T08:28:51.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:51.896+0000 7f8c2ae53640 1 -- 172.21.15.103:0/3307906288 wait complete. 2024-09-10T08:28:51.909 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-09-10T08:28:50.796414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593360,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":211,"num_write_kb":2431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":213,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219180,"kb_used_data":2936,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755540,"statfs":{"total":773094113280,"available":772869672960,"internally_reserved":0,"allocated":3006464,"data_stored":1809170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.197957"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619680+0000","last_change":"2024-09-10T08:28:34.564816+0000","last_active":"2024-09-10T08:28:36.619680+0000","last_peered":"2024-09-10T08:28:36.619680+0000","last_clean":"2024-09-10T08:28:36.619680+0000","last_became_active":"2024-09-10T08:28:34.564545+0000","last_became_peered":"2024-09-10T08:28:34.564545+0000","last_unstale":"2024-09-10T08:28:36.619680+0000","last_undegraded":"2024-09-10T08:28:36.619680+0000","last_fullsized":"2024-09-10T08:28:36.619680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:34.365104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605257+0000","last_change":"2024-09-10T08:28:35.575267+0000","last_active":"2024-09-10T08:28:45.605257+0000","last_peered":"2024-09-10T08:28:45.605257+0000","last_clean":"2024-09-10T08:28:45.605257+0000","last_became_active":"2024-09-10T08:28:35.575019+0000","last_became_peered":"2024-09-10T08:28:35.575019+0000","last_unstale":"2024-09-10T08:28:45.605257+0000","last_undegraded":"2024-09-10T08:28:45.605257+0000","last_fullsized":"2024-09-10T08:28:45.605257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:00.810645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.603322+0000","last_change":"2024-09-10T08:28:45.603322+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.603322+0000","last_undegraded":"2024-09-10T08:28:45.603322+0000","last_fullsized":"2024-09-10T08:28:45.603322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605311+0000","last_change":"2024-09-10T08:28:34.561691+0000","last_active":"2024-09-10T08:28:45.605311+0000","last_peered":"2024-09-10T08:28:45.605311+0000","last_clean":"2024-09-10T08:28:45.605311+0000","last_became_active":"2024-09-10T08:28:34.561410+0000","last_became_peered":"2024-09-10T08:28:34.561410+0000","last_unstale":"2024-09-10T08:28:45.605311+0000","last_undegraded":"2024-09-10T08:28:45.605311+0000","last_fullsized":"2024-09-10T08:28:45.605311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.629982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619392+0000","last_change":"2024-09-10T08:28:35.579033+0000","last_active":"2024-09-10T08:28:36.619392+0000","last_peered":"2024-09-10T08:28:36.619392+0000","last_clean":"2024-09-10T08:28:36.619392+0000","last_became_active":"2024-09-10T08:28:35.578333+0000","last_became_peered":"2024-09-10T08:28:35.578333+0000","last_unstale":"2024-09-10T08:28:36.619392+0000","last_undegraded":"2024-09-10T08:28:36.619392+0000","last_fullsized":"2024-09-10T08:28:36.619392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:58.779491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.600401+0000","last_change":"2024-09-10T08:28:45.600401+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.600401+0000","last_undegraded":"2024-09-10T08:28:45.600401+0000","last_fullsized":"2024-09-10T08:28:45.600401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604808+0000","last_change":"2024-09-10T08:28:34.571965+0000","last_active":"2024-09-10T08:28:45.604808+0000","last_peered":"2024-09-10T08:28:45.604808+0000","last_clean":"2024-09-10T08:28:45.604808+0000","last_became_active":"2024-09-10T08:28:34.571640+0000","last_became_peered":"2024-09-10T08:28:34.571640+0000","last_unstale":"2024-09-10T08:28:45.604808+0000","last_undegraded":"2024-09-10T08:28:45.604808+0000","last_fullsized":"2024-09-10T08:28:45.604808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:53.047030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604063+0000","last_change":"2024-09-10T08:28:35.562132+0000","last_active":"2024-09-10T08:28:45.604063+0000","last_peered":"2024-09-10T08:28:45.604063+0000","last_clean":"2024-09-10T08:28:45.604063+0000","last_became_active":"2024-09-10T08:28:35.561842+0000","last_became_peered":"2024-09-10T08:28:35.561842+0000","last_unstale":"2024-09-10T08:28:45.604063+0000","last_undegraded":"2024-09-10T08:28:45.604063+0000","last_fullsized":"2024-09-10T08:28:45.604063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:48.810258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.602052+0000","last_change":"2024-09-10T08:28:45.602052+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.602052+0000","last_undegraded":"2024-09-10T08:28:45.602052+0000","last_fullsized":"2024-09-10T08:28:45.602052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603801+0000","last_change":"2024-09-10T08:28:34.566560+0000","last_active":"2024-09-10T08:28:45.603801+0000","last_peered":"2024-09-10T08:28:45.603801+0000","last_clean":"2024-09-10T08:28:45.603801+0000","last_became_active":"2024-09-10T08:28:34.566275+0000","last_became_peered":"2024-09-10T08:28:34.566275+0000","last_unstale":"2024-09-10T08:28:45.603801+0000","last_undegraded":"2024-09-10T08:28:45.603801+0000","last_fullsized":"2024-09-10T08:28:45.603801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:03.507683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603990+0000","last_change":"2024-09-10T08:28:35.560380+0000","last_active":"2024-09-10T08:28:45.603990+0000","last_peered":"2024-09-10T08:28:45.603990+0000","last_clean":"2024-09-10T08:28:45.603990+0000","last_became_active":"2024-09-10T08:28:35.560095+0000","last_became_peered":"2024-09-10T08:28:35.560095+0000","last_unstale":"2024-09-10T08:28:45.603990+0000","last_undegraded":"2024-09-10T08:28:45.603990+0000","last_fullsized":"2024-09-10T08:28:45.603990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:20.047446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.601642+0000","last_change":"2024-09-10T08:28:45.601642+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.601642+0000","last_undegraded":"2024-09-10T08:28:45.601642+0000","last_fullsized":"2024-09-10T08:28:45.601642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.618091+0000","last_change":"2024-09-10T08:28:35.572478+0000","last_active":"2024-09-10T08:28:47.618091+0000","last_peered":"2024-09-10T08:28:47.618091+0000","last_clean":"2024-09-10T08:28:47.618091+0000","last_became_active":"2024-09-10T08:28:35.572215+0000","last_became_peered":"2024-09-10T08:28:35.572215+0000","last_unstale":"2024-09-10T08:28:47.618091+0000","last_undegraded":"2024-09-10T08:28:47.618091+0000","last_fullsized":"2024-09-10T08:28:47.618091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:40.397318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604677+0000","last_change":"2024-09-10T08:28:34.569235+0000","last_active":"2024-09-10T08:28:45.604677+0000","last_peered":"2024-09-10T08:28:45.604677+0000","last_clean":"2024-09-10T08:28:45.604677+0000","last_became_active":"2024-09-10T08:28:34.568899+0000","last_became_peered":"2024-09-10T08:28:34.568899+0000","last_unstale":"2024-09-10T08:28:45.604677+0000","last_undegraded":"2024-09-10T08:28:45.604677+0000","last_fullsized":"2024-09-10T08:28:45.604677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:21.927656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.600794+0000","last_change":"2024-09-10T08:28:45.600794+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.600794+0000","last_undegraded":"2024-09-10T08:28:45.600794+0000","last_fullsized":"2024-09-10T08:28:45.600794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.630431+0000","last_change":"2024-09-10T08:28:47.627138+0000","last_active":"2024-09-10T08:28:47.630431+0000","last_peered":"2024-09-10T08:28:47.630431+0000","last_clean":"2024-09-10T08:28:47.630431+0000","last_became_active":"2024-09-10T08:28:47.626871+0000","last_became_peered":"2024-09-10T08:28:47.626871+0000","last_unstale":"2024-09-10T08:28:47.630431+0000","last_undegraded":"2024-09-10T08:28:47.630431+0000","last_fullsized":"2024-09-10T08:28:47.630431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:01.469893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605836+0000","last_change":"2024-09-10T08:28:35.577024+0000","last_active":"2024-09-10T08:28:45.605836+0000","last_peered":"2024-09-10T08:28:45.605836+0000","last_clean":"2024-09-10T08:28:45.605836+0000","last_became_active":"2024-09-10T08:28:35.576771+0000","last_became_peered":"2024-09-10T08:28:35.576771+0000","last_unstale":"2024-09-10T08:28:45.605836+0000","last_undegraded":"2024-09-10T08:28:45.605836+0000","last_fullsized":"2024-09-10T08:28:45.605836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:07.162941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606550+0000","last_change":"2024-09-10T08:28:34.561324+0000","last_active":"2024-09-10T08:28:45.606550+0000","last_peered":"2024-09-10T08:28:45.606550+0000","last_clean":"2024-09-10T08:28:45.606550+0000","last_became_active":"2024-09-10T08:28:34.560974+0000","last_became_peered":"2024-09-10T08:28:34.560974+0000","last_unstale":"2024-09-10T08:28:45.606550+0000","last_undegraded":"2024-09-10T08:28:45.606550+0000","last_fullsized":"2024-09-10T08:28:45.606550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:18.790965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.600502+0000","last_change":"2024-09-10T08:28:45.600502+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.600502+0000","last_undegraded":"2024-09-10T08:28:45.600502+0000","last_fullsized":"2024-09-10T08:28:45.600502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604743+0000","last_change":"2024-09-10T08:28:35.572363+0000","last_active":"2024-09-10T08:28:45.604743+0000","last_peered":"2024-09-10T08:28:45.604743+0000","last_clean":"2024-09-10T08:28:45.604743+0000","last_became_active":"2024-09-10T08:28:35.572108+0000","last_became_peered":"2024-09-10T08:28:35.572108+0000","last_unstale":"2024-09-10T08:28:45.604743+0000","last_undegraded":"2024-09-10T08:28:45.604743+0000","last_fullsized":"2024-09-10T08:28:45.604743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:48.358634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606610+0000","last_change":"2024-09-10T08:28:34.564813+0000","last_active":"2024-09-10T08:28:45.606610+0000","last_peered":"2024-09-10T08:28:45.606610+0000","last_clean":"2024-09-10T08:28:45.606610+0000","last_became_active":"2024-09-10T08:28:34.564557+0000","last_became_peered":"2024-09-10T08:28:34.564557+0000","last_unstale":"2024-09-10T08:28:45.606610+0000","last_undegraded":"2024-09-10T08:28:45.606610+0000","last_fullsized":"2024-09-10T08:28:45.606610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:48.356069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.605451+0000","last_change":"2024-09-10T08:28:45.605451+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.605451+0000","last_undegraded":"2024-09-10T08:28:45.605451+0000","last_fullsized":"2024-09-10T08:28:45.605451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603108+0000","last_change":"2024-09-10T08:28:35.569938+0000","last_active":"2024-09-10T08:28:45.603108+0000","last_peered":"2024-09-10T08:28:45.603108+0000","last_clean":"2024-09-10T08:28:45.603108+0000","last_became_active":"2024-09-10T08:28:35.569109+0000","last_became_peered":"2024-09-10T08:28:35.569109+0000","last_unstale":"2024-09-10T08:28:45.603108+0000","last_undegraded":"2024-09-10T08:28:45.603108+0000","last_fullsized":"2024-09-10T08:28:45.603108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:51.680564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603546+0000","last_change":"2024-09-10T08:28:34.571069+0000","last_active":"2024-09-10T08:28:45.603546+0000","last_peered":"2024-09-10T08:28:45.603546+0000","last_clean":"2024-09-10T08:28:45.603546+0000","last_became_active":"2024-09-10T08:28:34.570766+0000","last_became_peered":"2024-09-10T08:28:34.570766+0000","last_unstale":"2024-09-10T08:28:45.603546+0000","last_undegraded":"2024-09-10T08:28:45.603546+0000","last_fullsized":"2024-09-10T08:28:45.603546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:47.458195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.600452+0000","last_change":"2024-09-10T08:28:45.600452+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.600452+0000","last_undegraded":"2024-09-10T08:28:45.600452+0000","last_fullsized":"2024-09-10T08:28:45.600452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619239+0000","last_change":"2024-09-10T08:28:35.575106+0000","last_active":"2024-09-10T08:28:36.619239+0000","last_peered":"2024-09-10T08:28:36.619239+0000","last_clean":"2024-09-10T08:28:36.619239+0000","last_became_active":"2024-09-10T08:28:35.574815+0000","last_became_peered":"2024-09-10T08:28:35.574815+0000","last_unstale":"2024-09-10T08:28:36.619239+0000","last_undegraded":"2024-09-10T08:28:36.619239+0000","last_fullsized":"2024-09-10T08:28:36.619239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:26.512181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.619552+0000","last_change":"2024-09-10T08:28:34.564865+0000","last_active":"2024-09-10T08:28:47.619552+0000","last_peered":"2024-09-10T08:28:47.619552+0000","last_clean":"2024-09-10T08:28:47.619552+0000","last_became_active":"2024-09-10T08:28:34.564549+0000","last_became_peered":"2024-09-10T08:28:34.564549+0000","last_unstale":"2024-09-10T08:28:47.619552+0000","last_undegraded":"2024-09-10T08:28:47.619552+0000","last_fullsized":"2024-09-10T08:28:47.619552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:05.523637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.600402+0000","last_change":"2024-09-10T08:28:45.600402+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.600402+0000","last_undegraded":"2024-09-10T08:28:45.600402+0000","last_fullsized":"2024-09-10T08:28:45.600402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606015+0000","last_change":"2024-09-10T08:28:35.574107+0000","last_active":"2024-09-10T08:28:45.606015+0000","last_peered":"2024-09-10T08:28:45.606015+0000","last_clean":"2024-09-10T08:28:45.606015+0000","last_became_active":"2024-09-10T08:28:35.573851+0000","last_became_peered":"2024-09-10T08:28:35.573851+0000","last_unstale":"2024-09-10T08:28:45.606015+0000","last_undegraded":"2024-09-10T08:28:45.606015+0000","last_fullsized":"2024-09-10T08:28:45.606015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:53.240223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606704+0000","last_change":"2024-09-10T08:28:34.563451+0000","last_active":"2024-09-10T08:28:45.606704+0000","last_peered":"2024-09-10T08:28:45.606704+0000","last_clean":"2024-09-10T08:28:45.606704+0000","last_became_active":"2024-09-10T08:28:34.563259+0000","last_became_peered":"2024-09-10T08:28:34.563259+0000","last_unstale":"2024-09-10T08:28:45.606704+0000","last_undegraded":"2024-09-10T08:28:45.606704+0000","last_fullsized":"2024-09-10T08:28:45.606704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:44.899351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.603287+0000","last_change":"2024-09-10T08:28:45.603287+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.603287+0000","last_undegraded":"2024-09-10T08:28:45.603287+0000","last_fullsized":"2024-09-10T08:28:45.603287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.639830+0000","last_change":"2024-09-10T08:28:47.634754+0000","last_active":"2024-09-10T08:28:47.639830+0000","last_peered":"2024-09-10T08:28:47.639830+0000","last_clean":"2024-09-10T08:28:47.639830+0000","last_became_active":"2024-09-10T08:28:47.634382+0000","last_became_peered":"2024-09-10T08:28:47.634382+0000","last_unstale":"2024-09-10T08:28:47.639830+0000","last_undegraded":"2024-09-10T08:28:47.639830+0000","last_fullsized":"2024-09-10T08:28:47.639830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:08.900176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606350+0000","last_change":"2024-09-10T08:28:35.567481+0000","last_active":"2024-09-10T08:28:45.606350+0000","last_peered":"2024-09-10T08:28:45.606350+0000","last_clean":"2024-09-10T08:28:45.606350+0000","last_became_active":"2024-09-10T08:28:35.567167+0000","last_became_peered":"2024-09-10T08:28:35.567167+0000","last_unstale":"2024-09-10T08:28:45.606350+0000","last_undegraded":"2024-09-10T08:28:45.606350+0000","last_fullsized":"2024-09-10T08:28:45.606350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:44.110012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605020+0000","last_change":"2024-09-10T08:28:34.571283+0000","last_active":"2024-09-10T08:28:45.605020+0000","last_peered":"2024-09-10T08:28:45.605020+0000","last_clean":"2024-09-10T08:28:45.605020+0000","last_became_active":"2024-09-10T08:28:34.570791+0000","last_became_peered":"2024-09-10T08:28:34.570791+0000","last_unstale":"2024-09-10T08:28:45.605020+0000","last_undegraded":"2024-09-10T08:28:45.605020+0000","last_fullsized":"2024-09-10T08:28:45.605020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:17.427597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:45.593387+0000","last_change":"2024-09-10T08:28:45.593387+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.593387+0000","last_undegraded":"2024-09-10T08:28:45.593387+0000","last_fullsized":"2024-09-10T08:28:45.593387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604102+0000","last_change":"2024-09-10T08:28:35.576280+0000","last_active":"2024-09-10T08:28:45.604102+0000","last_peered":"2024-09-10T08:28:45.604102+0000","last_clean":"2024-09-10T08:28:45.604102+0000","last_became_active":"2024-09-10T08:28:35.576002+0000","last_became_peered":"2024-09-10T08:28:35.576002+0000","last_unstale":"2024-09-10T08:28:45.604102+0000","last_undegraded":"2024-09-10T08:28:45.604102+0000","last_fullsized":"2024-09-10T08:28:45.604102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:46.278441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606425+0000","last_change":"2024-09-10T08:28:34.555212+0000","last_active":"2024-09-10T08:28:45.606425+0000","last_peered":"2024-09-10T08:28:45.606425+0000","last_clean":"2024-09-10T08:28:45.606425+0000","last_became_active":"2024-09-10T08:28:34.554922+0000","last_became_peered":"2024-09-10T08:28:34.554922+0000","last_unstale":"2024-09-10T08:28:45.606425+0000","last_undegraded":"2024-09-10T08:28:45.606425+0000","last_fullsized":"2024-09-10T08:28:45.606425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.604756+0000","last_change":"2024-09-10T08:28:45.604756+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.604756+0000","last_undegraded":"2024-09-10T08:28:45.604756+0000","last_fullsized":"2024-09-10T08:28:45.604756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604254+0000","last_change":"2024-09-10T08:28:35.577978+0000","last_active":"2024-09-10T08:28:45.604254+0000","last_peered":"2024-09-10T08:28:45.604254+0000","last_clean":"2024-09-10T08:28:45.604254+0000","last_became_active":"2024-09-10T08:28:35.577718+0000","last_became_peered":"2024-09-10T08:28:35.577718+0000","last_unstale":"2024-09-10T08:28:45.604254+0000","last_undegraded":"2024-09-10T08:28:45.604254+0000","last_fullsized":"2024-09-10T08:28:45.604254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:01:57.257817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604509+0000","last_change":"2024-09-10T08:28:34.553983+0000","last_active":"2024-09-10T08:28:45.604509+0000","last_peered":"2024-09-10T08:28:45.604509+0000","last_clean":"2024-09-10T08:28:45.604509+0000","last_became_active":"2024-09-10T08:28:34.553693+0000","last_became_peered":"2024-09-10T08:28:34.553693+0000","last_unstale":"2024-09-10T08:28:45.604509+0000","last_undegraded":"2024-09-10T08:28:45.604509+0000","last_fullsized":"2024-09-10T08:28:45.604509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:40.001685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.605137+0000","last_change":"2024-09-10T08:28:45.605137+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.605137+0000","last_undegraded":"2024-09-10T08:28:45.605137+0000","last_fullsized":"2024-09-10T08:28:45.605137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.629847+0000","last_change":"2024-09-10T08:28:47.621588+0000","last_active":"2024-09-10T08:28:47.629847+0000","last_peered":"2024-09-10T08:28:47.629847+0000","last_clean":"2024-09-10T08:28:47.629847+0000","last_became_active":"2024-09-10T08:28:47.621122+0000","last_became_peered":"2024-09-10T08:28:47.621122+0000","last_unstale":"2024-09-10T08:28:47.629847+0000","last_undegraded":"2024-09-10T08:28:47.629847+0000","last_fullsized":"2024-09-10T08:28:47.629847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:19.727552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606067+0000","last_change":"2024-09-10T08:28:35.566745+0000","last_active":"2024-09-10T08:28:45.606067+0000","last_peered":"2024-09-10T08:28:45.606067+0000","last_clean":"2024-09-10T08:28:45.606067+0000","last_became_active":"2024-09-10T08:28:35.566444+0000","last_became_peered":"2024-09-10T08:28:35.566444+0000","last_unstale":"2024-09-10T08:28:45.606067+0000","last_undegraded":"2024-09-10T08:28:45.606067+0000","last_fullsized":"2024-09-10T08:28:45.606067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:52.735296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.607113+0000","last_change":"2024-09-10T08:28:34.560745+0000","last_active":"2024-09-10T08:28:47.607113+0000","last_peered":"2024-09-10T08:28:47.607113+0000","last_clean":"2024-09-10T08:28:47.607113+0000","last_became_active":"2024-09-10T08:28:34.559911+0000","last_became_peered":"2024-09-10T08:28:34.559911+0000","last_unstale":"2024-09-10T08:28:47.607113+0000","last_undegraded":"2024-09-10T08:28:47.607113+0000","last_fullsized":"2024-09-10T08:28:47.607113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:00.234067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.604789+0000","last_change":"2024-09-10T08:28:45.604789+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.604789+0000","last_undegraded":"2024-09-10T08:28:45.604789+0000","last_fullsized":"2024-09-10T08:28:45.604789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619165+0000","last_change":"2024-09-10T08:28:35.576360+0000","last_active":"2024-09-10T08:28:36.619165+0000","last_peered":"2024-09-10T08:28:36.619165+0000","last_clean":"2024-09-10T08:28:36.619165+0000","last_became_active":"2024-09-10T08:28:35.576096+0000","last_became_peered":"2024-09-10T08:28:35.576096+0000","last_unstale":"2024-09-10T08:28:36.619165+0000","last_undegraded":"2024-09-10T08:28:36.619165+0000","last_fullsized":"2024-09-10T08:28:36.619165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:34.159275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603675+0000","last_change":"2024-09-10T08:28:34.568477+0000","last_active":"2024-09-10T08:28:45.603675+0000","last_peered":"2024-09-10T08:28:45.603675+0000","last_clean":"2024-09-10T08:28:45.603675+0000","last_became_active":"2024-09-10T08:28:34.568249+0000","last_became_peered":"2024-09-10T08:28:34.568249+0000","last_unstale":"2024-09-10T08:28:45.603675+0000","last_undegraded":"2024-09-10T08:28:45.603675+0000","last_fullsized":"2024-09-10T08:28:45.603675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:08.640043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:45.593387+0000","last_change":"2024-09-10T08:28:45.593387+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.593387+0000","last_undegraded":"2024-09-10T08:28:45.593387+0000","last_fullsized":"2024-09-10T08:28:45.593387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605156+0000","last_change":"2024-09-10T08:28:35.572658+0000","last_active":"2024-09-10T08:28:45.605156+0000","last_peered":"2024-09-10T08:28:45.605156+0000","last_clean":"2024-09-10T08:28:45.605156+0000","last_became_active":"2024-09-10T08:28:35.571611+0000","last_became_peered":"2024-09-10T08:28:35.571611+0000","last_unstale":"2024-09-10T08:28:45.605156+0000","last_undegraded":"2024-09-10T08:28:45.605156+0000","last_fullsized":"2024-09-10T08:28:45.605156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:42.726996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.602860+0000","last_change":"2024-09-10T08:28:34.555587+0000","last_active":"2024-09-10T08:28:45.602860+0000","last_peered":"2024-09-10T08:28:45.602860+0000","last_clean":"2024-09-10T08:28:45.602860+0000","last_became_active":"2024-09-10T08:28:34.555269+0000","last_became_peered":"2024-09-10T08:28:34.555269+0000","last_unstale":"2024-09-10T08:28:45.602860+0000","last_undegraded":"2024-09-10T08:28:45.602860+0000","last_fullsized":"2024-09-10T08:28:45.602860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:19.499870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603786+0000","last_change":"2024-09-10T08:28:26.724394+0000","last_active":"2024-09-10T08:28:45.603786+0000","last_peered":"2024-09-10T08:28:45.603786+0000","last_clean":"2024-09-10T08:28:45.603786+0000","last_became_active":"2024-09-10T08:28:26.723452+0000","last_became_peered":"2024-09-10T08:28:26.723452+0000","last_unstale":"2024-09-10T08:28:45.603786+0000","last_undegraded":"2024-09-10T08:28:45.603786+0000","last_fullsized":"2024-09-10T08:28:45.603786+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_clean_scrub_stamp":"2024-09-10T08:28:25.445753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:00.811505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.618510+0000","last_change":"2024-09-10T08:28:46.622048+0000","last_active":"2024-09-10T08:28:47.618510+0000","last_peered":"2024-09-10T08:28:47.618510+0000","last_clean":"2024-09-10T08:28:47.618510+0000","last_became_active":"2024-09-10T08:28:46.621770+0000","last_became_peered":"2024-09-10T08:28:46.621770+0000","last_unstale":"2024-09-10T08:28:47.618510+0000","last_undegraded":"2024-09-10T08:28:47.618510+0000","last_fullsized":"2024-09-10T08:28:47.618510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:51.430760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.623784+0000","last_change":"2024-09-10T08:28:47.620746+0000","last_active":"2024-09-10T08:28:47.623784+0000","last_peered":"2024-09-10T08:28:47.623784+0000","last_clean":"2024-09-10T08:28:47.623784+0000","last_became_active":"2024-09-10T08:28:47.620492+0000","last_became_peered":"2024-09-10T08:28:47.620492+0000","last_unstale":"2024-09-10T08:28:47.623784+0000","last_undegraded":"2024-09-10T08:28:47.623784+0000","last_fullsized":"2024-09-10T08:28:47.623784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:55.065641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603848+0000","last_change":"2024-09-10T08:28:35.574532+0000","last_active":"2024-09-10T08:28:45.603848+0000","last_peered":"2024-09-10T08:28:45.603848+0000","last_clean":"2024-09-10T08:28:45.603848+0000","last_became_active":"2024-09-10T08:28:35.574215+0000","last_became_peered":"2024-09-10T08:28:35.574215+0000","last_unstale":"2024-09-10T08:28:45.603848+0000","last_undegraded":"2024-09-10T08:28:45.603848+0000","last_fullsized":"2024-09-10T08:28:45.603848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:28.455653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.608591+0000","last_change":"2024-09-10T08:28:34.559911+0000","last_active":"2024-09-10T08:28:47.608591+0000","last_peered":"2024-09-10T08:28:47.608591+0000","last_clean":"2024-09-10T08:28:47.608591+0000","last_became_active":"2024-09-10T08:28:34.559635+0000","last_became_peered":"2024-09-10T08:28:34.559635+0000","last_unstale":"2024-09-10T08:28:47.608591+0000","last_undegraded":"2024-09-10T08:28:47.608591+0000","last_fullsized":"2024-09-10T08:28:47.608591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:40.892609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.617943+0000","last_change":"2024-09-10T08:28:46.620352+0000","last_active":"2024-09-10T08:28:47.617943+0000","last_peered":"2024-09-10T08:28:47.617943+0000","last_clean":"2024-09-10T08:28:47.617943+0000","last_became_active":"2024-09-10T08:28:46.620064+0000","last_became_peered":"2024-09-10T08:28:46.620064+0000","last_unstale":"2024-09-10T08:28:47.617943+0000","last_undegraded":"2024-09-10T08:28:47.617943+0000","last_fullsized":"2024-09-10T08:28:47.617943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:59.333579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.623859+0000","last_change":"2024-09-10T08:28:47.620305+0000","last_active":"2024-09-10T08:28:47.623859+0000","last_peered":"2024-09-10T08:28:47.623859+0000","last_clean":"2024-09-10T08:28:47.623859+0000","last_became_active":"2024-09-10T08:28:47.620014+0000","last_became_peered":"2024-09-10T08:28:47.620014+0000","last_unstale":"2024-09-10T08:28:47.623859+0000","last_undegraded":"2024-09-10T08:28:47.623859+0000","last_fullsized":"2024-09-10T08:28:47.623859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:26.503891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604168+0000","last_change":"2024-09-10T08:28:35.577124+0000","last_active":"2024-09-10T08:28:45.604168+0000","last_peered":"2024-09-10T08:28:45.604168+0000","last_clean":"2024-09-10T08:28:45.604168+0000","last_became_active":"2024-09-10T08:28:35.576655+0000","last_became_peered":"2024-09-10T08:28:35.576655+0000","last_unstale":"2024-09-10T08:28:45.604168+0000","last_undegraded":"2024-09-10T08:28:45.604168+0000","last_fullsized":"2024-09-10T08:28:45.604168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:29.878600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.607127+0000","last_change":"2024-09-10T08:28:34.560694+0000","last_active":"2024-09-10T08:28:45.607127+0000","last_peered":"2024-09-10T08:28:45.607127+0000","last_clean":"2024-09-10T08:28:45.607127+0000","last_became_active":"2024-09-10T08:28:34.560429+0000","last_became_peered":"2024-09-10T08:28:34.560429+0000","last_unstale":"2024-09-10T08:28:45.607127+0000","last_undegraded":"2024-09-10T08:28:45.607127+0000","last_fullsized":"2024-09-10T08:28:45.607127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:54.514467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:45.593387+0000","last_change":"2024-09-10T08:28:45.593387+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.593387+0000","last_undegraded":"2024-09-10T08:28:45.593387+0000","last_fullsized":"2024-09-10T08:28:45.593387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604619+0000","last_change":"2024-09-10T08:28:35.577577+0000","last_active":"2024-09-10T08:28:45.604619+0000","last_peered":"2024-09-10T08:28:45.604619+0000","last_clean":"2024-09-10T08:28:45.604619+0000","last_became_active":"2024-09-10T08:28:35.576686+0000","last_became_peered":"2024-09-10T08:28:35.576686+0000","last_unstale":"2024-09-10T08:28:45.604619+0000","last_undegraded":"2024-09-10T08:28:45.604619+0000","last_fullsized":"2024-09-10T08:28:45.604619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:36.334494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.608095+0000","last_change":"2024-09-10T08:28:34.560313+0000","last_active":"2024-09-10T08:28:47.608095+0000","last_peered":"2024-09-10T08:28:47.608095+0000","last_clean":"2024-09-10T08:28:47.608095+0000","last_became_active":"2024-09-10T08:28:34.560035+0000","last_became_peered":"2024-09-10T08:28:34.560035+0000","last_unstale":"2024-09-10T08:28:47.608095+0000","last_undegraded":"2024-09-10T08:28:47.608095+0000","last_fullsized":"2024-09-10T08:28:47.608095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:56.945537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.601907+0000","last_change":"2024-09-10T08:28:45.601907+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.601907+0000","last_undegraded":"2024-09-10T08:28:45.601907+0000","last_fullsized":"2024-09-10T08:28:45.601907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.621115+0000","last_change":"2024-09-10T08:28:47.619805+0000","last_active":"2024-09-10T08:28:47.621115+0000","last_peered":"2024-09-10T08:28:47.621115+0000","last_clean":"2024-09-10T08:28:47.621115+0000","last_became_active":"2024-09-10T08:28:47.619452+0000","last_became_peered":"2024-09-10T08:28:47.619452+0000","last_unstale":"2024-09-10T08:28:47.621115+0000","last_undegraded":"2024-09-10T08:28:47.621115+0000","last_fullsized":"2024-09-10T08:28:47.621115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:41:58.798577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604071+0000","last_change":"2024-09-10T08:28:35.577476+0000","last_active":"2024-09-10T08:28:45.604071+0000","last_peered":"2024-09-10T08:28:45.604071+0000","last_clean":"2024-09-10T08:28:45.604071+0000","last_became_active":"2024-09-10T08:28:35.576786+0000","last_became_peered":"2024-09-10T08:28:35.576786+0000","last_unstale":"2024-09-10T08:28:45.604071+0000","last_undegraded":"2024-09-10T08:28:45.604071+0000","last_fullsized":"2024-09-10T08:28:45.604071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:46.914074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603504+0000","last_change":"2024-09-10T08:28:34.551102+0000","last_active":"2024-09-10T08:28:45.603504+0000","last_peered":"2024-09-10T08:28:45.603504+0000","last_clean":"2024-09-10T08:28:45.603504+0000","last_became_active":"2024-09-10T08:28:34.550773+0000","last_became_peered":"2024-09-10T08:28:34.550773+0000","last_unstale":"2024-09-10T08:28:45.603504+0000","last_undegraded":"2024-09-10T08:28:45.603504+0000","last_fullsized":"2024-09-10T08:28:45.603504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:35.393695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.600953+0000","last_change":"2024-09-10T08:28:45.600953+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.600953+0000","last_undegraded":"2024-09-10T08:28:45.600953+0000","last_fullsized":"2024-09-10T08:28:45.600953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604205+0000","last_change":"2024-09-10T08:28:35.575307+0000","last_active":"2024-09-10T08:28:45.604205+0000","last_peered":"2024-09-10T08:28:45.604205+0000","last_clean":"2024-09-10T08:28:45.604205+0000","last_became_active":"2024-09-10T08:28:35.575038+0000","last_became_peered":"2024-09-10T08:28:35.575038+0000","last_unstale":"2024-09-10T08:28:45.604205+0000","last_undegraded":"2024-09-10T08:28:45.604205+0000","last_fullsized":"2024-09-10T08:28:45.604205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:36.478822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.607008+0000","last_change":"2024-09-10T08:28:34.555542+0000","last_active":"2024-09-10T08:28:47.607008+0000","last_peered":"2024-09-10T08:28:47.607008+0000","last_clean":"2024-09-10T08:28:47.607008+0000","last_became_active":"2024-09-10T08:28:34.555179+0000","last_became_peered":"2024-09-10T08:28:34.555179+0000","last_unstale":"2024-09-10T08:28:47.607008+0000","last_undegraded":"2024-09-10T08:28:47.607008+0000","last_fullsized":"2024-09-10T08:28:47.607008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:53.313161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:45.593387+0000","last_change":"2024-09-10T08:28:45.593387+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.593387+0000","last_undegraded":"2024-09-10T08:28:45.593387+0000","last_fullsized":"2024-09-10T08:28:45.593387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.617179+0000","last_change":"2024-09-10T08:28:35.578892+0000","last_active":"2024-09-10T08:28:47.617179+0000","last_peered":"2024-09-10T08:28:47.617179+0000","last_clean":"2024-09-10T08:28:47.617179+0000","last_became_active":"2024-09-10T08:28:35.578299+0000","last_became_peered":"2024-09-10T08:28:35.578299+0000","last_unstale":"2024-09-10T08:28:47.617179+0000","last_undegraded":"2024-09-10T08:28:47.617179+0000","last_fullsized":"2024-09-10T08:28:47.617179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:27.485392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.617702+0000","last_change":"2024-09-10T08:28:34.560444+0000","last_active":"2024-09-10T08:28:47.617702+0000","last_peered":"2024-09-10T08:28:47.617702+0000","last_clean":"2024-09-10T08:28:47.617702+0000","last_became_active":"2024-09-10T08:28:34.560188+0000","last_became_peered":"2024-09-10T08:28:34.560188+0000","last_unstale":"2024-09-10T08:28:47.617702+0000","last_undegraded":"2024-09-10T08:28:47.617702+0000","last_fullsized":"2024-09-10T08:28:47.617702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:15.727780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.604116+0000","last_change":"2024-09-10T08:28:45.604116+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.604116+0000","last_undegraded":"2024-09-10T08:28:45.604116+0000","last_fullsized":"2024-09-10T08:28:45.604116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604484+0000","last_change":"2024-09-10T08:28:35.575788+0000","last_active":"2024-09-10T08:28:45.604484+0000","last_peered":"2024-09-10T08:28:45.604484+0000","last_clean":"2024-09-10T08:28:45.604484+0000","last_became_active":"2024-09-10T08:28:35.575333+0000","last_became_peered":"2024-09-10T08:28:35.575333+0000","last_unstale":"2024-09-10T08:28:45.604484+0000","last_undegraded":"2024-09-10T08:28:45.604484+0000","last_fullsized":"2024-09-10T08:28:45.604484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:39.756390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604482+0000","last_change":"2024-09-10T08:28:34.560699+0000","last_active":"2024-09-10T08:28:45.604482+0000","last_peered":"2024-09-10T08:28:45.604482+0000","last_clean":"2024-09-10T08:28:45.604482+0000","last_became_active":"2024-09-10T08:28:34.560376+0000","last_became_peered":"2024-09-10T08:28:34.560376+0000","last_unstale":"2024-09-10T08:28:45.604482+0000","last_undegraded":"2024-09-10T08:28:45.604482+0000","last_fullsized":"2024-09-10T08:28:45.604482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:09.981216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.603603+0000","last_change":"2024-09-10T08:28:45.603603+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.603603+0000","last_undegraded":"2024-09-10T08:28:45.603603+0000","last_fullsized":"2024-09-10T08:28:45.603603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619742+0000","last_change":"2024-09-10T08:28:35.574810+0000","last_active":"2024-09-10T08:28:36.619742+0000","last_peered":"2024-09-10T08:28:36.619742+0000","last_clean":"2024-09-10T08:28:36.619742+0000","last_became_active":"2024-09-10T08:28:35.574567+0000","last_became_peered":"2024-09-10T08:28:35.574567+0000","last_unstale":"2024-09-10T08:28:36.619742+0000","last_undegraded":"2024-09-10T08:28:36.619742+0000","last_fullsized":"2024-09-10T08:28:36.619742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:29.315833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620328+0000","last_change":"2024-09-10T08:28:34.553556+0000","last_active":"2024-09-10T08:28:36.620328+0000","last_peered":"2024-09-10T08:28:36.620328+0000","last_clean":"2024-09-10T08:28:36.620328+0000","last_became_active":"2024-09-10T08:28:34.553275+0000","last_became_peered":"2024-09-10T08:28:34.553275+0000","last_unstale":"2024-09-10T08:28:36.620328+0000","last_undegraded":"2024-09-10T08:28:36.620328+0000","last_fullsized":"2024-09-10T08:28:36.620328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:45.957635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.600401+0000","last_change":"2024-09-10T08:28:45.600401+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.600401+0000","last_undegraded":"2024-09-10T08:28:45.600401+0000","last_fullsized":"2024-09-10T08:28:45.600401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603744+0000","last_change":"2024-09-10T08:28:35.582473+0000","last_active":"2024-09-10T08:28:45.603744+0000","last_peered":"2024-09-10T08:28:45.603744+0000","last_clean":"2024-09-10T08:28:45.603744+0000","last_became_active":"2024-09-10T08:28:35.582205+0000","last_became_peered":"2024-09-10T08:28:35.582205+0000","last_unstale":"2024-09-10T08:28:45.603744+0000","last_undegraded":"2024-09-10T08:28:45.603744+0000","last_fullsized":"2024-09-10T08:28:45.603744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:11.200963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.618829+0000","last_change":"2024-09-10T08:28:34.559823+0000","last_active":"2024-09-10T08:28:47.618829+0000","last_peered":"2024-09-10T08:28:47.618829+0000","last_clean":"2024-09-10T08:28:47.618829+0000","last_became_active":"2024-09-10T08:28:34.559560+0000","last_became_peered":"2024-09-10T08:28:34.559560+0000","last_unstale":"2024-09-10T08:28:47.618829+0000","last_undegraded":"2024-09-10T08:28:47.618829+0000","last_fullsized":"2024-09-10T08:28:47.618829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:53.724382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.605252+0000","last_change":"2024-09-10T08:28:45.605252+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.605252+0000","last_undegraded":"2024-09-10T08:28:45.605252+0000","last_fullsized":"2024-09-10T08:28:45.605252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603930+0000","last_change":"2024-09-10T08:28:35.571262+0000","last_active":"2024-09-10T08:28:45.603930+0000","last_peered":"2024-09-10T08:28:45.603930+0000","last_clean":"2024-09-10T08:28:45.603930+0000","last_became_active":"2024-09-10T08:28:35.570711+0000","last_became_peered":"2024-09-10T08:28:35.570711+0000","last_unstale":"2024-09-10T08:28:45.603930+0000","last_undegraded":"2024-09-10T08:28:45.603930+0000","last_fullsized":"2024-09-10T08:28:45.603930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:29.116422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.607025+0000","last_change":"2024-09-10T08:28:34.557352+0000","last_active":"2024-09-10T08:28:45.607025+0000","last_peered":"2024-09-10T08:28:45.607025+0000","last_clean":"2024-09-10T08:28:45.607025+0000","last_became_active":"2024-09-10T08:28:34.557076+0000","last_became_peered":"2024-09-10T08:28:34.557076+0000","last_unstale":"2024-09-10T08:28:45.607025+0000","last_undegraded":"2024-09-10T08:28:45.607025+0000","last_fullsized":"2024-09-10T08:28:45.607025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:04.957739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.601549+0000","last_change":"2024-09-10T08:28:45.601549+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.601549+0000","last_undegraded":"2024-09-10T08:28:45.601549+0000","last_fullsized":"2024-09-10T08:28:45.601549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.627287+0000","last_change":"2024-09-10T08:28:47.623223+0000","last_active":"2024-09-10T08:28:47.627287+0000","last_peered":"2024-09-10T08:28:47.627287+0000","last_clean":"2024-09-10T08:28:47.627287+0000","last_became_active":"2024-09-10T08:28:47.622961+0000","last_became_peered":"2024-09-10T08:28:47.622961+0000","last_unstale":"2024-09-10T08:28:47.627287+0000","last_undegraded":"2024-09-10T08:28:47.627287+0000","last_fullsized":"2024-09-10T08:28:47.627287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:03.024023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619533+0000","last_change":"2024-09-10T08:28:35.577913+0000","last_active":"2024-09-10T08:28:36.619533+0000","last_peered":"2024-09-10T08:28:36.619533+0000","last_clean":"2024-09-10T08:28:36.619533+0000","last_became_active":"2024-09-10T08:28:35.577255+0000","last_became_peered":"2024-09-10T08:28:35.577255+0000","last_unstale":"2024-09-10T08:28:36.619533+0000","last_undegraded":"2024-09-10T08:28:36.619533+0000","last_fullsized":"2024-09-10T08:28:36.619533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:17.413525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603259+0000","last_change":"2024-09-10T08:28:34.564571+0000","last_active":"2024-09-10T08:28:45.603259+0000","last_peered":"2024-09-10T08:28:45.603259+0000","last_clean":"2024-09-10T08:28:45.603259+0000","last_became_active":"2024-09-10T08:28:34.564189+0000","last_became_peered":"2024-09-10T08:28:34.564189+0000","last_unstale":"2024-09-10T08:28:45.603259+0000","last_undegraded":"2024-09-10T08:28:45.603259+0000","last_fullsized":"2024-09-10T08:28:45.603259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:46.055510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.604073+0000","last_change":"2024-09-10T08:28:45.604073+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.604073+0000","last_undegraded":"2024-09-10T08:28:45.604073+0000","last_fullsized":"2024-09-10T08:28:45.604073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603156+0000","last_change":"2024-09-10T08:28:35.572944+0000","last_active":"2024-09-10T08:28:45.603156+0000","last_peered":"2024-09-10T08:28:45.603156+0000","last_clean":"2024-09-10T08:28:45.603156+0000","last_became_active":"2024-09-10T08:28:35.572620+0000","last_became_peered":"2024-09-10T08:28:35.572620+0000","last_unstale":"2024-09-10T08:28:45.603156+0000","last_undegraded":"2024-09-10T08:28:45.603156+0000","last_fullsized":"2024-09-10T08:28:45.603156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:04.524048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.619511+0000","last_change":"2024-09-10T08:28:34.562935+0000","last_active":"2024-09-10T08:28:47.619511+0000","last_peered":"2024-09-10T08:28:47.619511+0000","last_clean":"2024-09-10T08:28:47.619511+0000","last_became_active":"2024-09-10T08:28:34.562647+0000","last_became_peered":"2024-09-10T08:28:34.562647+0000","last_unstale":"2024-09-10T08:28:47.619511+0000","last_undegraded":"2024-09-10T08:28:47.619511+0000","last_fullsized":"2024-09-10T08:28:47.619511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:47.492281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.603885+0000","last_change":"2024-09-10T08:28:45.603885+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.603885+0000","last_undegraded":"2024-09-10T08:28:45.603885+0000","last_fullsized":"2024-09-10T08:28:45.603885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.634964+0000","last_change":"2024-09-10T08:28:47.627750+0000","last_active":"2024-09-10T08:28:47.634964+0000","last_peered":"2024-09-10T08:28:47.634964+0000","last_clean":"2024-09-10T08:28:47.634964+0000","last_became_active":"2024-09-10T08:28:47.627481+0000","last_became_peered":"2024-09-10T08:28:47.627481+0000","last_unstale":"2024-09-10T08:28:47.634964+0000","last_undegraded":"2024-09-10T08:28:47.634964+0000","last_fullsized":"2024-09-10T08:28:47.634964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:10.323020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:45.593387+0000","last_change":"2024-09-10T08:28:45.593387+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.593387+0000","last_undegraded":"2024-09-10T08:28:45.593387+0000","last_fullsized":"2024-09-10T08:28:45.593387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606276+0000","last_change":"2024-09-10T08:28:35.572803+0000","last_active":"2024-09-10T08:28:45.606276+0000","last_peered":"2024-09-10T08:28:45.606276+0000","last_clean":"2024-09-10T08:28:45.606276+0000","last_became_active":"2024-09-10T08:28:35.572219+0000","last_became_peered":"2024-09-10T08:28:35.572219+0000","last_unstale":"2024-09-10T08:28:45.606276+0000","last_undegraded":"2024-09-10T08:28:45.606276+0000","last_fullsized":"2024-09-10T08:28:45.606276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:45.920218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603662+0000","last_change":"2024-09-10T08:28:34.554346+0000","last_active":"2024-09-10T08:28:45.603662+0000","last_peered":"2024-09-10T08:28:45.603662+0000","last_clean":"2024-09-10T08:28:45.603662+0000","last_became_active":"2024-09-10T08:28:34.553933+0000","last_became_peered":"2024-09-10T08:28:34.553933+0000","last_unstale":"2024-09-10T08:28:45.603662+0000","last_undegraded":"2024-09-10T08:28:45.603662+0000","last_fullsized":"2024-09-10T08:28:45.603662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:07.639671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.640842+0000","last_change":"2024-09-10T08:28:46.630904+0000","last_active":"2024-09-10T08:28:47.640842+0000","last_peered":"2024-09-10T08:28:47.640842+0000","last_clean":"2024-09-10T08:28:47.640842+0000","last_became_active":"2024-09-10T08:28:46.630530+0000","last_became_peered":"2024-09-10T08:28:46.630530+0000","last_unstale":"2024-09-10T08:28:47.640842+0000","last_undegraded":"2024-09-10T08:28:47.640842+0000","last_fullsized":"2024-09-10T08:28:47.640842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:33.599739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604633+0000","last_change":"2024-09-10T08:28:35.580244+0000","last_active":"2024-09-10T08:28:45.604633+0000","last_peered":"2024-09-10T08:28:45.604633+0000","last_clean":"2024-09-10T08:28:45.604633+0000","last_became_active":"2024-09-10T08:28:35.579975+0000","last_became_peered":"2024-09-10T08:28:35.579975+0000","last_unstale":"2024-09-10T08:28:45.604633+0000","last_undegraded":"2024-09-10T08:28:45.604633+0000","last_fullsized":"2024-09-10T08:28:45.604633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:16.498045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604937+0000","last_change":"2024-09-10T08:28:34.564751+0000","last_active":"2024-09-10T08:28:45.604937+0000","last_peered":"2024-09-10T08:28:45.604937+0000","last_clean":"2024-09-10T08:28:45.604937+0000","last_became_active":"2024-09-10T08:28:34.564479+0000","last_became_peered":"2024-09-10T08:28:34.564479+0000","last_unstale":"2024-09-10T08:28:45.604937+0000","last_undegraded":"2024-09-10T08:28:45.604937+0000","last_fullsized":"2024-09-10T08:28:45.604937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:29.618224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.618194+0000","last_change":"2024-09-10T08:28:34.561906+0000","last_active":"2024-09-10T08:28:47.618194+0000","last_peered":"2024-09-10T08:28:47.618194+0000","last_clean":"2024-09-10T08:28:47.618194+0000","last_became_active":"2024-09-10T08:28:34.561613+0000","last_became_peered":"2024-09-10T08:28:34.561613+0000","last_unstale":"2024-09-10T08:28:47.618194+0000","last_undegraded":"2024-09-10T08:28:47.618194+0000","last_fullsized":"2024-09-10T08:28:47.618194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:56.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620240+0000","last_change":"2024-09-10T08:28:35.576406+0000","last_active":"2024-09-10T08:28:36.620240+0000","last_peered":"2024-09-10T08:28:36.620240+0000","last_clean":"2024-09-10T08:28:36.620240+0000","last_became_active":"2024-09-10T08:28:35.576145+0000","last_became_peered":"2024-09-10T08:28:35.576145+0000","last_unstale":"2024-09-10T08:28:36.620240+0000","last_undegraded":"2024-09-10T08:28:36.620240+0000","last_fullsized":"2024-09-10T08:28:36.620240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:57.667098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.641416+0000","last_change":"2024-09-10T08:28:46.622395+0000","last_active":"2024-09-10T08:28:47.641416+0000","last_peered":"2024-09-10T08:28:47.641416+0000","last_clean":"2024-09-10T08:28:47.641416+0000","last_became_active":"2024-09-10T08:28:46.621941+0000","last_became_peered":"2024-09-10T08:28:46.621941+0000","last_unstale":"2024-09-10T08:28:47.641416+0000","last_undegraded":"2024-09-10T08:28:47.641416+0000","last_fullsized":"2024-09-10T08:28:47.641416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:54.928969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605876+0000","last_change":"2024-09-10T08:28:34.566606+0000","last_active":"2024-09-10T08:28:45.605876+0000","last_peered":"2024-09-10T08:28:45.605876+0000","last_clean":"2024-09-10T08:28:45.605876+0000","last_became_active":"2024-09-10T08:28:34.566388+0000","last_became_peered":"2024-09-10T08:28:34.566388+0000","last_unstale":"2024-09-10T08:28:45.605876+0000","last_undegraded":"2024-09-10T08:28:45.605876+0000","last_fullsized":"2024-09-10T08:28:45.605876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:33.528801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.602832+0000","last_change":"2024-09-10T08:28:35.559371+0000","last_active":"2024-09-10T08:28:45.602832+0000","last_peered":"2024-09-10T08:28:45.602832+0000","last_clean":"2024-09-10T08:28:45.602832+0000","last_became_active":"2024-09-10T08:28:35.559145+0000","last_became_peered":"2024-09-10T08:28:35.559145+0000","last_unstale":"2024-09-10T08:28:45.602832+0000","last_undegraded":"2024-09-10T08:28:45.602832+0000","last_fullsized":"2024-09-10T08:28:45.602832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:57.339318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.603493+0000","last_change":"2024-09-10T08:28:45.603493+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.603493+0000","last_undegraded":"2024-09-10T08:28:45.603493+0000","last_fullsized":"2024-09-10T08:28:45.603493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.617081+0000","last_change":"2024-09-10T08:28:35.579106+0000","last_active":"2024-09-10T08:28:47.617081+0000","last_peered":"2024-09-10T08:28:47.617081+0000","last_clean":"2024-09-10T08:28:47.617081+0000","last_became_active":"2024-09-10T08:28:35.578631+0000","last_became_peered":"2024-09-10T08:28:35.578631+0000","last_unstale":"2024-09-10T08:28:47.617081+0000","last_undegraded":"2024-09-10T08:28:47.617081+0000","last_fullsized":"2024-09-10T08:28:47.617081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:31.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.606957+0000","last_change":"2024-09-10T08:28:35.566780+0000","last_active":"2024-09-10T08:28:47.606957+0000","last_peered":"2024-09-10T08:28:47.606957+0000","last_clean":"2024-09-10T08:28:47.606957+0000","last_became_active":"2024-09-10T08:28:35.566529+0000","last_became_peered":"2024-09-10T08:28:35.566529+0000","last_unstale":"2024-09-10T08:28:47.606957+0000","last_undegraded":"2024-09-10T08:28:47.606957+0000","last_fullsized":"2024-09-10T08:28:47.606957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:09.481166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604413+0000","last_change":"2024-09-10T08:28:35.578735+0000","last_active":"2024-09-10T08:28:45.604413+0000","last_peered":"2024-09-10T08:28:45.604413+0000","last_clean":"2024-09-10T08:28:45.604413+0000","last_became_active":"2024-09-10T08:28:35.577995+0000","last_became_peered":"2024-09-10T08:28:35.577995+0000","last_unstale":"2024-09-10T08:28:45.604413+0000","last_undegraded":"2024-09-10T08:28:45.604413+0000","last_fullsized":"2024-09-10T08:28:45.604413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:11.033441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620112+0000","last_change":"2024-09-10T08:28:35.577852+0000","last_active":"2024-09-10T08:28:36.620112+0000","last_peered":"2024-09-10T08:28:36.620112+0000","last_clean":"2024-09-10T08:28:36.620112+0000","last_became_active":"2024-09-10T08:28:35.577571+0000","last_became_peered":"2024-09-10T08:28:35.577571+0000","last_unstale":"2024-09-10T08:28:36.620112+0000","last_undegraded":"2024-09-10T08:28:36.620112+0000","last_fullsized":"2024-09-10T08:28:36.620112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:22.713732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605491+0000","last_change":"2024-09-10T08:28:35.574676+0000","last_active":"2024-09-10T08:28:45.605491+0000","last_peered":"2024-09-10T08:28:45.605491+0000","last_clean":"2024-09-10T08:28:45.605491+0000","last_became_active":"2024-09-10T08:28:35.574437+0000","last_became_peered":"2024-09-10T08:28:35.574437+0000","last_unstale":"2024-09-10T08:28:45.605491+0000","last_undegraded":"2024-09-10T08:28:45.605491+0000","last_fullsized":"2024-09-10T08:28:45.605491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:45.422506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606933+0000","last_change":"2024-09-10T08:28:35.572550+0000","last_active":"2024-09-10T08:28:45.606933+0000","last_peered":"2024-09-10T08:28:45.606933+0000","last_clean":"2024-09-10T08:28:45.606933+0000","last_became_active":"2024-09-10T08:28:35.572184+0000","last_became_peered":"2024-09-10T08:28:35.572184+0000","last_unstale":"2024-09-10T08:28:45.606933+0000","last_undegraded":"2024-09-10T08:28:45.606933+0000","last_fullsized":"2024-09-10T08:28:45.606933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:08.490734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.619603+0000","last_change":"2024-09-10T08:28:35.573217+0000","last_active":"2024-09-10T08:28:47.619603+0000","last_peered":"2024-09-10T08:28:47.619603+0000","last_clean":"2024-09-10T08:28:47.619603+0000","last_became_active":"2024-09-10T08:28:35.572955+0000","last_became_peered":"2024-09-10T08:28:35.572955+0000","last_unstale":"2024-09-10T08:28:47.619603+0000","last_undegraded":"2024-09-10T08:28:47.619603+0000","last_fullsized":"2024-09-10T08:28:47.619603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:24.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.627308+0000","last_change":"2024-09-10T08:28:47.623365+0000","last_active":"2024-09-10T08:28:47.627308+0000","last_peered":"2024-09-10T08:28:47.627308+0000","last_clean":"2024-09-10T08:28:47.627308+0000","last_became_active":"2024-09-10T08:28:47.623082+0000","last_became_peered":"2024-09-10T08:28:47.623082+0000","last_unstale":"2024-09-10T08:28:47.627308+0000","last_undegraded":"2024-09-10T08:28:47.627308+0000","last_fullsized":"2024-09-10T08:28:47.627308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:44.700683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606011+0000","last_change":"2024-09-10T08:28:35.575902+0000","last_active":"2024-09-10T08:28:45.606011+0000","last_peered":"2024-09-10T08:28:45.606011+0000","last_clean":"2024-09-10T08:28:45.606011+0000","last_became_active":"2024-09-10T08:28:35.575614+0000","last_became_peered":"2024-09-10T08:28:35.575614+0000","last_unstale":"2024-09-10T08:28:45.606011+0000","last_undegraded":"2024-09-10T08:28:45.606011+0000","last_fullsized":"2024-09-10T08:28:45.606011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:11.277682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603554+0000","last_change":"2024-09-10T08:28:35.578285+0000","last_active":"2024-09-10T08:28:45.603554+0000","last_peered":"2024-09-10T08:28:45.603554+0000","last_clean":"2024-09-10T08:28:45.603554+0000","last_became_active":"2024-09-10T08:28:35.576805+0000","last_became_peered":"2024-09-10T08:28:35.576805+0000","last_unstale":"2024-09-10T08:28:45.603554+0000","last_undegraded":"2024-09-10T08:28:45.603554+0000","last_fullsized":"2024-09-10T08:28:45.603554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:46.203320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604782+0000","last_change":"2024-09-10T08:28:35.571566+0000","last_active":"2024-09-10T08:28:45.604782+0000","last_peered":"2024-09-10T08:28:45.604782+0000","last_clean":"2024-09-10T08:28:45.604782+0000","last_became_active":"2024-09-10T08:28:35.571285+0000","last_became_peered":"2024-09-10T08:28:35.571285+0000","last_unstale":"2024-09-10T08:28:45.604782+0000","last_undegraded":"2024-09-10T08:28:45.604782+0000","last_fullsized":"2024-09-10T08:28:45.604782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:23.587691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.621106+0000","last_change":"2024-09-10T08:28:47.619863+0000","last_active":"2024-09-10T08:28:47.621106+0000","last_peered":"2024-09-10T08:28:47.621106+0000","last_clean":"2024-09-10T08:28:47.621106+0000","last_became_active":"2024-09-10T08:28:47.619525+0000","last_became_peered":"2024-09-10T08:28:47.619525+0000","last_unstale":"2024-09-10T08:28:47.621106+0000","last_undegraded":"2024-09-10T08:28:47.621106+0000","last_fullsized":"2024-09-10T08:28:47.621106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:15.220842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604300+0000","last_change":"2024-09-10T08:28:35.568044+0000","last_active":"2024-09-10T08:28:45.604300+0000","last_peered":"2024-09-10T08:28:45.604300+0000","last_clean":"2024-09-10T08:28:45.604300+0000","last_became_active":"2024-09-10T08:28:35.567744+0000","last_became_peered":"2024-09-10T08:28:35.567744+0000","last_unstale":"2024-09-10T08:28:45.604300+0000","last_undegraded":"2024-09-10T08:28:45.604300+0000","last_fullsized":"2024-09-10T08:28:45.604300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:19.081138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619988+0000","last_change":"2024-09-10T08:28:35.575802+0000","last_active":"2024-09-10T08:28:36.619988+0000","last_peered":"2024-09-10T08:28:36.619988+0000","last_clean":"2024-09-10T08:28:36.619988+0000","last_became_active":"2024-09-10T08:28:35.575388+0000","last_became_peered":"2024-09-10T08:28:35.575388+0000","last_unstale":"2024-09-10T08:28:36.619988+0000","last_undegraded":"2024-09-10T08:28:36.619988+0000","last_fullsized":"2024-09-10T08:28:36.619988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:01.424265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.619820+0000","last_change":"2024-09-10T08:28:35.574499+0000","last_active":"2024-09-10T08:28:47.619820+0000","last_peered":"2024-09-10T08:28:47.619820+0000","last_clean":"2024-09-10T08:28:47.619820+0000","last_became_active":"2024-09-10T08:28:35.574249+0000","last_became_peered":"2024-09-10T08:28:35.574249+0000","last_unstale":"2024-09-10T08:28:47.619820+0000","last_undegraded":"2024-09-10T08:28:47.619820+0000","last_fullsized":"2024-09-10T08:28:47.619820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:55.952307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604916+0000","last_change":"2024-09-10T08:28:35.572709+0000","last_active":"2024-09-10T08:28:45.604916+0000","last_peered":"2024-09-10T08:28:45.604916+0000","last_clean":"2024-09-10T08:28:45.604916+0000","last_became_active":"2024-09-10T08:28:35.572392+0000","last_became_peered":"2024-09-10T08:28:35.572392+0000","last_unstale":"2024-09-10T08:28:45.604916+0000","last_undegraded":"2024-09-10T08:28:45.604916+0000","last_fullsized":"2024-09-10T08:28:45.604916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:42.636299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.608016+0000","last_change":"2024-09-10T08:28:35.574438+0000","last_active":"2024-09-10T08:28:47.608016+0000","last_peered":"2024-09-10T08:28:47.608016+0000","last_clean":"2024-09-10T08:28:47.608016+0000","last_became_active":"2024-09-10T08:28:35.574175+0000","last_became_peered":"2024-09-10T08:28:35.574175+0000","last_unstale":"2024-09-10T08:28:47.608016+0000","last_undegraded":"2024-09-10T08:28:47.608016+0000","last_fullsized":"2024-09-10T08:28:47.608016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:55.808543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603841+0000","last_change":"2024-09-10T08:28:35.567296+0000","last_active":"2024-09-10T08:28:45.603841+0000","last_peered":"2024-09-10T08:28:45.603841+0000","last_clean":"2024-09-10T08:28:45.603841+0000","last_became_active":"2024-09-10T08:28:35.567074+0000","last_became_peered":"2024-09-10T08:28:35.567074+0000","last_unstale":"2024-09-10T08:28:45.603841+0000","last_undegraded":"2024-09-10T08:28:45.603841+0000","last_fullsized":"2024-09-10T08:28:45.603841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:55.698345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603434+0000","last_change":"2024-09-10T08:28:35.570249+0000","last_active":"2024-09-10T08:28:45.603434+0000","last_peered":"2024-09-10T08:28:45.603434+0000","last_clean":"2024-09-10T08:28:45.603434+0000","last_became_active":"2024-09-10T08:28:35.569960+0000","last_became_peered":"2024-09-10T08:28:35.569960+0000","last_unstale":"2024-09-10T08:28:45.603434+0000","last_undegraded":"2024-09-10T08:28:45.603434+0000","last_fullsized":"2024-09-10T08:28:45.603434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:29.787554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606384+0000","last_change":"2024-09-10T08:28:35.560693+0000","last_active":"2024-09-10T08:28:45.606384+0000","last_peered":"2024-09-10T08:28:45.606384+0000","last_clean":"2024-09-10T08:28:45.606384+0000","last_became_active":"2024-09-10T08:28:35.560409+0000","last_became_peered":"2024-09-10T08:28:35.560409+0000","last_unstale":"2024-09-10T08:28:45.606384+0000","last_undegraded":"2024-09-10T08:28:45.606384+0000","last_fullsized":"2024-09-10T08:28:45.606384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:10.597654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619605+0000","last_change":"2024-09-10T08:28:35.574551+0000","last_active":"2024-09-10T08:28:36.619605+0000","last_peered":"2024-09-10T08:28:36.619605+0000","last_clean":"2024-09-10T08:28:36.619605+0000","last_became_active":"2024-09-10T08:28:35.574256+0000","last_became_peered":"2024-09-10T08:28:35.574256+0000","last_unstale":"2024-09-10T08:28:36.619605+0000","last_undegraded":"2024-09-10T08:28:36.619605+0000","last_fullsized":"2024-09-10T08:28:36.619605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:43.401552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605768+0000","last_change":"2024-09-10T08:28:35.573330+0000","last_active":"2024-09-10T08:28:45.605768+0000","last_peered":"2024-09-10T08:28:45.605768+0000","last_clean":"2024-09-10T08:28:45.605768+0000","last_became_active":"2024-09-10T08:28:35.572992+0000","last_became_peered":"2024-09-10T08:28:35.572992+0000","last_unstale":"2024-09-10T08:28:45.605768+0000","last_undegraded":"2024-09-10T08:28:45.605768+0000","last_fullsized":"2024-09-10T08:28:45.605768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:15.412219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603819+0000","last_change":"2024-09-10T08:28:35.566574+0000","last_active":"2024-09-10T08:28:45.603819+0000","last_peered":"2024-09-10T08:28:45.603819+0000","last_clean":"2024-09-10T08:28:45.603819+0000","last_became_active":"2024-09-10T08:28:35.566205+0000","last_became_peered":"2024-09-10T08:28:35.566205+0000","last_unstale":"2024-09-10T08:28:45.603819+0000","last_undegraded":"2024-09-10T08:28:45.603819+0000","last_fullsized":"2024-09-10T08:28:45.603819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:49.876773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.632473+0000","last_change":"2024-09-10T08:28:47.628051+0000","last_active":"2024-09-10T08:28:47.632473+0000","last_peered":"2024-09-10T08:28:47.632473+0000","last_clean":"2024-09-10T08:28:47.632473+0000","last_became_active":"2024-09-10T08:28:47.627747+0000","last_became_peered":"2024-09-10T08:28:47.627747+0000","last_unstale":"2024-09-10T08:28:47.632473+0000","last_undegraded":"2024-09-10T08:28:47.632473+0000","last_fullsized":"2024-09-10T08:28:47.632473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:38.999743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.618654+0000","last_change":"2024-09-10T08:28:35.565023+0000","last_active":"2024-09-10T08:28:47.618654+0000","last_peered":"2024-09-10T08:28:47.618654+0000","last_clean":"2024-09-10T08:28:47.618654+0000","last_became_active":"2024-09-10T08:28:35.564747+0000","last_became_peered":"2024-09-10T08:28:35.564747+0000","last_unstale":"2024-09-10T08:28:47.618654+0000","last_undegraded":"2024-09-10T08:28:47.618654+0000","last_fullsized":"2024-09-10T08:28:47.618654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:32.419621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.619510+0000","last_change":"2024-09-10T08:28:35.570619+0000","last_active":"2024-09-10T08:28:47.619510+0000","last_peered":"2024-09-10T08:28:47.619510+0000","last_clean":"2024-09-10T08:28:47.619510+0000","last_became_active":"2024-09-10T08:28:35.570351+0000","last_became_peered":"2024-09-10T08:28:35.570351+0000","last_unstale":"2024-09-10T08:28:47.619510+0000","last_undegraded":"2024-09-10T08:28:47.619510+0000","last_fullsized":"2024-09-10T08:28:47.619510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:35.161279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604535+0000","last_change":"2024-09-10T08:28:35.577345+0000","last_active":"2024-09-10T08:28:45.604535+0000","last_peered":"2024-09-10T08:28:45.604535+0000","last_clean":"2024-09-10T08:28:45.604535+0000","last_became_active":"2024-09-10T08:28:35.576191+0000","last_became_peered":"2024-09-10T08:28:35.576191+0000","last_unstale":"2024-09-10T08:28:45.604535+0000","last_undegraded":"2024-09-10T08:28:45.604535+0000","last_fullsized":"2024-09-10T08:28:45.604535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:29.218797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604605+0000","last_change":"2024-09-10T08:28:35.575275+0000","last_active":"2024-09-10T08:28:45.604605+0000","last_peered":"2024-09-10T08:28:45.604605+0000","last_clean":"2024-09-10T08:28:45.604605+0000","last_became_active":"2024-09-10T08:28:35.575052+0000","last_became_peered":"2024-09-10T08:28:35.575052+0000","last_unstale":"2024-09-10T08:28:45.604605+0000","last_undegraded":"2024-09-10T08:28:45.604605+0000","last_fullsized":"2024-09-10T08:28:45.604605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:24.313017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.635033+0000","last_change":"2024-09-10T08:28:47.628651+0000","last_active":"2024-09-10T08:28:47.635033+0000","last_peered":"2024-09-10T08:28:47.635033+0000","last_clean":"2024-09-10T08:28:47.635033+0000","last_became_active":"2024-09-10T08:28:47.628343+0000","last_became_peered":"2024-09-10T08:28:47.628343+0000","last_unstale":"2024-09-10T08:28:47.635033+0000","last_undegraded":"2024-09-10T08:28:47.635033+0000","last_fullsized":"2024-09-10T08:28:47.635033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:07.325085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604153+0000","last_change":"2024-09-10T08:28:35.578664+0000","last_active":"2024-09-10T08:28:45.604153+0000","last_peered":"2024-09-10T08:28:45.604153+0000","last_clean":"2024-09-10T08:28:45.604153+0000","last_became_active":"2024-09-10T08:28:35.578384+0000","last_became_peered":"2024-09-10T08:28:35.578384+0000","last_unstale":"2024-09-10T08:28:45.604153+0000","last_undegraded":"2024-09-10T08:28:45.604153+0000","last_fullsized":"2024-09-10T08:28:45.604153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:44.278718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604028+0000","last_change":"2024-09-10T08:28:35.578978+0000","last_active":"2024-09-10T08:28:45.604028+0000","last_peered":"2024-09-10T08:28:45.604028+0000","last_clean":"2024-09-10T08:28:45.604028+0000","last_became_active":"2024-09-10T08:28:35.578475+0000","last_became_peered":"2024-09-10T08:28:35.578475+0000","last_unstale":"2024-09-10T08:28:45.604028+0000","last_undegraded":"2024-09-10T08:28:45.604028+0000","last_fullsized":"2024-09-10T08:28:45.604028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:08.520314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604389+0000","last_change":"2024-09-10T08:28:35.572112+0000","last_active":"2024-09-10T08:28:45.604389+0000","last_peered":"2024-09-10T08:28:45.604389+0000","last_clean":"2024-09-10T08:28:45.604389+0000","last_became_active":"2024-09-10T08:28:35.571803+0000","last_became_peered":"2024-09-10T08:28:35.571803+0000","last_unstale":"2024-09-10T08:28:45.604389+0000","last_undegraded":"2024-09-10T08:28:45.604389+0000","last_fullsized":"2024-09-10T08:28:45.604389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:29.969987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603946+0000","last_change":"2024-09-10T08:28:35.578961+0000","last_active":"2024-09-10T08:28:45.603946+0000","last_peered":"2024-09-10T08:28:45.603946+0000","last_clean":"2024-09-10T08:28:45.603946+0000","last_became_active":"2024-09-10T08:28:35.578680+0000","last_became_peered":"2024-09-10T08:28:35.578680+0000","last_unstale":"2024-09-10T08:28:45.603946+0000","last_undegraded":"2024-09-10T08:28:45.603946+0000","last_fullsized":"2024-09-10T08:28:45.603946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:53.737412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.630179+0000","last_change":"2024-09-10T08:28:47.624859+0000","last_active":"2024-09-10T08:28:47.630179+0000","last_peered":"2024-09-10T08:28:47.630179+0000","last_clean":"2024-09-10T08:28:47.630179+0000","last_became_active":"2024-09-10T08:28:47.624585+0000","last_became_peered":"2024-09-10T08:28:47.624585+0000","last_unstale":"2024-09-10T08:28:47.630179+0000","last_undegraded":"2024-09-10T08:28:47.630179+0000","last_fullsized":"2024-09-10T08:28:47.630179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:07:09.719664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619390+0000","last_change":"2024-09-10T08:28:35.573918+0000","last_active":"2024-09-10T08:28:36.619390+0000","last_peered":"2024-09-10T08:28:36.619390+0000","last_clean":"2024-09-10T08:28:36.619390+0000","last_became_active":"2024-09-10T08:28:35.573646+0000","last_became_peered":"2024-09-10T08:28:35.573646+0000","last_unstale":"2024-09-10T08:28:36.619390+0000","last_undegraded":"2024-09-10T08:28:36.619390+0000","last_fullsized":"2024-09-10T08:28:36.619390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:24.295630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606597+0000","last_change":"2024-09-10T08:28:35.578197+0000","last_active":"2024-09-10T08:28:45.606597+0000","last_peered":"2024-09-10T08:28:45.606597+0000","last_clean":"2024-09-10T08:28:45.606597+0000","last_became_active":"2024-09-10T08:28:35.577852+0000","last_became_peered":"2024-09-10T08:28:35.577852+0000","last_unstale":"2024-09-10T08:28:45.606597+0000","last_undegraded":"2024-09-10T08:28:45.606597+0000","last_fullsized":"2024-09-10T08:28:45.606597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:44.348299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604447+0000","last_change":"2024-09-10T08:28:35.571065+0000","last_active":"2024-09-10T08:28:45.604447+0000","last_peered":"2024-09-10T08:28:45.604447+0000","last_clean":"2024-09-10T08:28:45.604447+0000","last_became_active":"2024-09-10T08:28:35.570749+0000","last_became_peered":"2024-09-10T08:28:35.570749+0000","last_unstale":"2024-09-10T08:28:45.604447+0000","last_undegraded":"2024-09-10T08:28:45.604447+0000","last_fullsized":"2024-09-10T08:28:45.604447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:04.628661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":2},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":54,"acting":54,"num_store_stats":6},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":806912,"data_stored":663617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":72793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":80918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":663673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":96195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":86390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:28:51.916 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:28:52.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.048+0000 7f65dc18d640 1 Processor -- start 2024-09-10T08:28:52.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.049+0000 7f65dc18d640 1 -- start start 2024-09-10T08:28:52.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.049+0000 7f65dc18d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f65d4150480 0x7f65d40c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:52.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.049+0000 7f65dc18d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f65d406c650 0x7f65d40c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:52.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.049+0000 7f65dc18d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65d40c9c80 0x7f65d40ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:52.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.049+0000 7f65dc18d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f65d406c240 con 0x7f65d4150480 2024-09-10T08:28:52.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.049+0000 7f65dc18d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f65d415a330 con 0x7f65d406c650 2024-09-10T08:28:52.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.049+0000 7f65dc18d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f65d415a7c0 con 0x7f65d40c9c80 2024-09-10T08:28:52.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.050+0000 7f65d9f29640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f65d4150480 0x7f65d40c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:52.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.050+0000 7f65d9f29640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f65d4150480 0x7f65d40c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57408/0 (socket says 172.21.15.103:57408) 2024-09-10T08:28:52.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.050+0000 7f65d9f29640 1 -- 172.21.15.103:0/3642998635 learned_addr learned my addr 172.21.15.103:0/3642998635 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:52.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.050+0000 7f65d9728640 1 --2- 172.21.15.103:0/3642998635 >> v2:172.21.15.154:3300/0 conn(0x7f65d406c650 0x7f65d40c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:52.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.050+0000 7f65da72a640 1 --2- 172.21.15.103:0/3642998635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65d40c9c80 0x7f65d40ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:52.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.050+0000 7f65d9f29640 1 -- 172.21.15.103:0/3642998635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65d40c9c80 msgr2=0x7f65d40ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:52.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.050+0000 7f65d9f29640 1 --2- 172.21.15.103:0/3642998635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65d40c9c80 0x7f65d40ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.050+0000 7f65d9f29640 1 -- 172.21.15.103:0/3642998635 >> v2:172.21.15.154:3300/0 conn(0x7f65d406c650 msgr2=0x7f65d40c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:52.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.050+0000 7f65d9f29640 1 --2- 172.21.15.103:0/3642998635 >> v2:172.21.15.154:3300/0 conn(0x7f65d406c650 0x7f65d40c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.050+0000 7f65d9f29640 1 -- 172.21.15.103:0/3642998635 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d4159a00 con 0x7f65d4150480 2024-09-10T08:28:52.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.050+0000 7f65da72a640 1 --2- 172.21.15.103:0/3642998635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65d40c9c80 0x7f65d40ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:52.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.051+0000 7f65d9f29640 1 --2- 172.21.15.103:0/3642998635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65d4150480 0x7f65d40c7a90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f65d40c6110 tx=0x7f65c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862d8c3117e9ee57 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:52.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.051+0000 7f65d8f27640 1 -- 172.21.15.103:0/3642998635 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8037070 con 0x7f65d4150480 2024-09-10T08:28:52.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.051+0000 7f65d8f27640 1 -- 172.21.15.103:0/3642998635 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c8032440 con 0x7f65d4150480 2024-09-10T08:28:52.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.051+0000 7f65d8f27640 1 -- 172.21.15.103:0/3642998635 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8032810 con 0x7f65d4150480 2024-09-10T08:28:52.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.051+0000 7f65dc18d640 1 -- 172.21.15.103:0/3642998635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65d4150480 msgr2=0x7f65d40c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:52.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.051+0000 7f65dc18d640 1 --2- 172.21.15.103:0/3642998635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65d4150480 0x7f65d40c7a90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f65d40c6110 tx=0x7f65c802a1e0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.051+0000 7f65dc18d640 1 -- 172.21.15.103:0/3642998635 shutdown_connections 2024-09-10T08:28:52.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.051+0000 7f65dc18d640 1 --2- 172.21.15.103:0/3642998635 >> v2:172.21.15.154:3300/0 conn(0x7f65d406c650 0x7f65d40c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.051+0000 7f65dc18d640 1 --2- 172.21.15.103:0/3642998635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65d40c9c80 0x7f65d40ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.051+0000 7f65dc18d640 1 --2- 172.21.15.103:0/3642998635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65d4150480 0x7f65d40c7a90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.051+0000 7f65dc18d640 1 -- 172.21.15.103:0/3642998635 >> 172.21.15.103:0/3642998635 conn(0x7f65d4068030 msgr2=0x7f65d4073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:52.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.051+0000 7f65dc18d640 1 -- 172.21.15.103:0/3642998635 shutdown_connections 2024-09-10T08:28:52.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.051+0000 7f65dc18d640 1 -- 172.21.15.103:0/3642998635 wait complete. 2024-09-10T08:28:52.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.052+0000 7f65dc18d640 1 Processor -- start 2024-09-10T08:28:52.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.052+0000 7f65dc18d640 1 -- start start 2024-09-10T08:28:52.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.053+0000 7f65dc18d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65d406c650 0x7f65d40ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:52.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.053+0000 7f65dc18d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65d40c9c80 0x7f65d4151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:52.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.053+0000 7f65dc18d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65d4150480 0x7f65d41ef700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:52.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.053+0000 7f65dc18d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f65d40ca670 con 0x7f65d406c650 2024-09-10T08:28:52.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.053+0000 7f65dc18d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65d4159fc0 con 0x7f65d4150480 2024-09-10T08:28:52.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.053+0000 7f65dc18d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f65d406d270 con 0x7f65d40c9c80 2024-09-10T08:28:52.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.053+0000 7f65d9f29640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65d406c650 0x7f65d40ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:52.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.053+0000 7f65d9f29640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65d406c650 0x7f65d40ac6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57418/0 (socket says 172.21.15.103:57418) 2024-09-10T08:28:52.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.053+0000 7f65d9f29640 1 -- 172.21.15.103:0/1446856036 learned_addr learned my addr 172.21.15.103:0/1446856036 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:52.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.053+0000 7f65d9f29640 1 -- 172.21.15.103:0/1446856036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65d40c9c80 msgr2=0x7f65d4151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:52.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.053+0000 7f65d9f29640 1 --2- 172.21.15.103:0/1446856036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65d40c9c80 0x7f65d4151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.053+0000 7f65d9f29640 1 -- 172.21.15.103:0/1446856036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65d4150480 msgr2=0x7f65d41ef700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:52.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.053+0000 7f65d9f29640 1 --2- 172.21.15.103:0/1446856036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65d4150480 0x7f65d41ef700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.053+0000 7f65d9f29640 1 -- 172.21.15.103:0/1446856036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d41e2440 con 0x7f65d406c650 2024-09-10T08:28:52.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.054+0000 7f65d9f29640 1 --2- 172.21.15.103:0/1446856036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65d406c650 0x7f65d40ac6c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f65c802a220 tx=0x7f65c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:52.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.054+0000 7f65c67fc640 1 -- 172.21.15.103:0/1446856036 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8037040 con 0x7f65d406c650 2024-09-10T08:28:52.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.054+0000 7f65c67fc640 1 -- 172.21.15.103:0/1446856036 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c8042070 con 0x7f65d406c650 2024-09-10T08:28:52.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.054+0000 7f65dc18d640 1 -- 172.21.15.103:0/1446856036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d40acc00 con 0x7f65d406c650 2024-09-10T08:28:52.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.054+0000 7f65c67fc640 1 -- 172.21.15.103:0/1446856036 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8030880 con 0x7f65d406c650 2024-09-10T08:28:52.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.054+0000 7f65dc18d640 1 -- 172.21.15.103:0/1446856036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d41e2720 con 0x7f65d406c650 2024-09-10T08:28:52.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.055+0000 7f65dc18d640 1 -- 172.21.15.103:0/1446856036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65d41ef360 con 0x7f65d406c650 2024-09-10T08:28:52.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.055+0000 7f65c67fc640 1 -- 172.21.15.103:0/1446856036 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f65c8030a20 con 0x7f65d406c650 2024-09-10T08:28:52.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.056+0000 7f65c67fc640 1 --2- 172.21.15.103:0/1446856036 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f65b806be30 0x7f65b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:52.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.056+0000 7f65c67fc640 1 -- 172.21.15.103:0/1446856036 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f65c80ab980 con 0x7f65d406c650 2024-09-10T08:28:52.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.056+0000 7f65d9728640 1 --2- 172.21.15.103:0/1446856036 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f65b806be30 0x7f65b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:52.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.056+0000 7f65d9728640 1 --2- 172.21.15.103:0/1446856036 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f65b806be30 0x7f65b806e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f65d40abd10 tx=0x7f65d0009460 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:52.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.060+0000 7f65c67fc640 1 -- 172.21.15.103:0/1446856036 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f65c807a090 con 0x7f65d406c650 2024-09-10T08:28:52.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.223+0000 7f65dc18d640 1 -- 172.21.15.103:0/1446856036 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f65d4156270 con 0x7f65b806be30 2024-09-10T08:28:52.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.233+0000 7f65c67fc640 1 -- 172.21.15.103:0/1446856036 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+480184 (secure 0 0 0) 0x7f65d4156270 con 0x7f65b806be30 2024-09-10T08:28:52.239 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:52.242 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T08:28:52.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.237+0000 7f65dc18d640 1 -- 172.21.15.103:0/1446856036 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f65b806be30 msgr2=0x7f65b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:52.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.237+0000 7f65dc18d640 1 --2- 172.21.15.103:0/1446856036 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f65b806be30 0x7f65b806e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f65d40abd10 tx=0x7f65d0009460 comp rx=0 tx=0).stop 2024-09-10T08:28:52.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.237+0000 7f65dc18d640 1 -- 172.21.15.103:0/1446856036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65d406c650 msgr2=0x7f65d40ac6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:52.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.237+0000 7f65dc18d640 1 --2- 172.21.15.103:0/1446856036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65d406c650 0x7f65d40ac6c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f65c802a220 tx=0x7f65c80046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.237+0000 7f65dc18d640 1 -- 172.21.15.103:0/1446856036 shutdown_connections 2024-09-10T08:28:52.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.237+0000 7f65dc18d640 1 --2- 172.21.15.103:0/1446856036 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f65b806be30 0x7f65b806e2f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.237+0000 7f65dc18d640 1 --2- 172.21.15.103:0/1446856036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65d4150480 0x7f65d41ef700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.237+0000 7f65dc18d640 1 --2- 172.21.15.103:0/1446856036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65d40c9c80 0x7f65d4151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.237+0000 7f65dc18d640 1 --2- 172.21.15.103:0/1446856036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65d406c650 0x7f65d40ac6c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.237+0000 7f65dc18d640 1 -- 172.21.15.103:0/1446856036 >> 172.21.15.103:0/1446856036 conn(0x7f65d4068030 msgr2=0x7f65d4154e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:52.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.237+0000 7f65dc18d640 1 -- 172.21.15.103:0/1446856036 shutdown_connections 2024-09-10T08:28:52.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.237+0000 7f65dc18d640 1 -- 172.21.15.103:0/1446856036 wait complete. 2024-09-10T08:28:52.249 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-09-10T08:28:50.796414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593360,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":211,"num_write_kb":2431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":213,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219180,"kb_used_data":2936,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755540,"statfs":{"total":773094113280,"available":772869672960,"internally_reserved":0,"allocated":3006464,"data_stored":1809170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.197957"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619680+0000","last_change":"2024-09-10T08:28:34.564816+0000","last_active":"2024-09-10T08:28:36.619680+0000","last_peered":"2024-09-10T08:28:36.619680+0000","last_clean":"2024-09-10T08:28:36.619680+0000","last_became_active":"2024-09-10T08:28:34.564545+0000","last_became_peered":"2024-09-10T08:28:34.564545+0000","last_unstale":"2024-09-10T08:28:36.619680+0000","last_undegraded":"2024-09-10T08:28:36.619680+0000","last_fullsized":"2024-09-10T08:28:36.619680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:34.365104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605257+0000","last_change":"2024-09-10T08:28:35.575267+0000","last_active":"2024-09-10T08:28:45.605257+0000","last_peered":"2024-09-10T08:28:45.605257+0000","last_clean":"2024-09-10T08:28:45.605257+0000","last_became_active":"2024-09-10T08:28:35.575019+0000","last_became_peered":"2024-09-10T08:28:35.575019+0000","last_unstale":"2024-09-10T08:28:45.605257+0000","last_undegraded":"2024-09-10T08:28:45.605257+0000","last_fullsized":"2024-09-10T08:28:45.605257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:00.810645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.603322+0000","last_change":"2024-09-10T08:28:45.603322+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.603322+0000","last_undegraded":"2024-09-10T08:28:45.603322+0000","last_fullsized":"2024-09-10T08:28:45.603322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605311+0000","last_change":"2024-09-10T08:28:34.561691+0000","last_active":"2024-09-10T08:28:45.605311+0000","last_peered":"2024-09-10T08:28:45.605311+0000","last_clean":"2024-09-10T08:28:45.605311+0000","last_became_active":"2024-09-10T08:28:34.561410+0000","last_became_peered":"2024-09-10T08:28:34.561410+0000","last_unstale":"2024-09-10T08:28:45.605311+0000","last_undegraded":"2024-09-10T08:28:45.605311+0000","last_fullsized":"2024-09-10T08:28:45.605311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.629982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619392+0000","last_change":"2024-09-10T08:28:35.579033+0000","last_active":"2024-09-10T08:28:36.619392+0000","last_peered":"2024-09-10T08:28:36.619392+0000","last_clean":"2024-09-10T08:28:36.619392+0000","last_became_active":"2024-09-10T08:28:35.578333+0000","last_became_peered":"2024-09-10T08:28:35.578333+0000","last_unstale":"2024-09-10T08:28:36.619392+0000","last_undegraded":"2024-09-10T08:28:36.619392+0000","last_fullsized":"2024-09-10T08:28:36.619392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:58.779491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.600401+0000","last_change":"2024-09-10T08:28:45.600401+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.600401+0000","last_undegraded":"2024-09-10T08:28:45.600401+0000","last_fullsized":"2024-09-10T08:28:45.600401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604808+0000","last_change":"2024-09-10T08:28:34.571965+0000","last_active":"2024-09-10T08:28:45.604808+0000","last_peered":"2024-09-10T08:28:45.604808+0000","last_clean":"2024-09-10T08:28:45.604808+0000","last_became_active":"2024-09-10T08:28:34.571640+0000","last_became_peered":"2024-09-10T08:28:34.571640+0000","last_unstale":"2024-09-10T08:28:45.604808+0000","last_undegraded":"2024-09-10T08:28:45.604808+0000","last_fullsized":"2024-09-10T08:28:45.604808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:53.047030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604063+0000","last_change":"2024-09-10T08:28:35.562132+0000","last_active":"2024-09-10T08:28:45.604063+0000","last_peered":"2024-09-10T08:28:45.604063+0000","last_clean":"2024-09-10T08:28:45.604063+0000","last_became_active":"2024-09-10T08:28:35.561842+0000","last_became_peered":"2024-09-10T08:28:35.561842+0000","last_unstale":"2024-09-10T08:28:45.604063+0000","last_undegraded":"2024-09-10T08:28:45.604063+0000","last_fullsized":"2024-09-10T08:28:45.604063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:48.810258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.602052+0000","last_change":"2024-09-10T08:28:45.602052+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.602052+0000","last_undegraded":"2024-09-10T08:28:45.602052+0000","last_fullsized":"2024-09-10T08:28:45.602052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603801+0000","last_change":"2024-09-10T08:28:34.566560+0000","last_active":"2024-09-10T08:28:45.603801+0000","last_peered":"2024-09-10T08:28:45.603801+0000","last_clean":"2024-09-10T08:28:45.603801+0000","last_became_active":"2024-09-10T08:28:34.566275+0000","last_became_peered":"2024-09-10T08:28:34.566275+0000","last_unstale":"2024-09-10T08:28:45.603801+0000","last_undegraded":"2024-09-10T08:28:45.603801+0000","last_fullsized":"2024-09-10T08:28:45.603801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:03.507683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603990+0000","last_change":"2024-09-10T08:28:35.560380+0000","last_active":"2024-09-10T08:28:45.603990+0000","last_peered":"2024-09-10T08:28:45.603990+0000","last_clean":"2024-09-10T08:28:45.603990+0000","last_became_active":"2024-09-10T08:28:35.560095+0000","last_became_peered":"2024-09-10T08:28:35.560095+0000","last_unstale":"2024-09-10T08:28:45.603990+0000","last_undegraded":"2024-09-10T08:28:45.603990+0000","last_fullsized":"2024-09-10T08:28:45.603990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:20.047446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.601642+0000","last_change":"2024-09-10T08:28:45.601642+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.601642+0000","last_undegraded":"2024-09-10T08:28:45.601642+0000","last_fullsized":"2024-09-10T08:28:45.601642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.618091+0000","last_change":"2024-09-10T08:28:35.572478+0000","last_active":"2024-09-10T08:28:47.618091+0000","last_peered":"2024-09-10T08:28:47.618091+0000","last_clean":"2024-09-10T08:28:47.618091+0000","last_became_active":"2024-09-10T08:28:35.572215+0000","last_became_peered":"2024-09-10T08:28:35.572215+0000","last_unstale":"2024-09-10T08:28:47.618091+0000","last_undegraded":"2024-09-10T08:28:47.618091+0000","last_fullsized":"2024-09-10T08:28:47.618091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:40.397318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604677+0000","last_change":"2024-09-10T08:28:34.569235+0000","last_active":"2024-09-10T08:28:45.604677+0000","last_peered":"2024-09-10T08:28:45.604677+0000","last_clean":"2024-09-10T08:28:45.604677+0000","last_became_active":"2024-09-10T08:28:34.568899+0000","last_became_peered":"2024-09-10T08:28:34.568899+0000","last_unstale":"2024-09-10T08:28:45.604677+0000","last_undegraded":"2024-09-10T08:28:45.604677+0000","last_fullsized":"2024-09-10T08:28:45.604677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:21.927656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.600794+0000","last_change":"2024-09-10T08:28:45.600794+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.600794+0000","last_undegraded":"2024-09-10T08:28:45.600794+0000","last_fullsized":"2024-09-10T08:28:45.600794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.630431+0000","last_change":"2024-09-10T08:28:47.627138+0000","last_active":"2024-09-10T08:28:47.630431+0000","last_peered":"2024-09-10T08:28:47.630431+0000","last_clean":"2024-09-10T08:28:47.630431+0000","last_became_active":"2024-09-10T08:28:47.626871+0000","last_became_peered":"2024-09-10T08:28:47.626871+0000","last_unstale":"2024-09-10T08:28:47.630431+0000","last_undegraded":"2024-09-10T08:28:47.630431+0000","last_fullsized":"2024-09-10T08:28:47.630431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:01.469893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605836+0000","last_change":"2024-09-10T08:28:35.577024+0000","last_active":"2024-09-10T08:28:45.605836+0000","last_peered":"2024-09-10T08:28:45.605836+0000","last_clean":"2024-09-10T08:28:45.605836+0000","last_became_active":"2024-09-10T08:28:35.576771+0000","last_became_peered":"2024-09-10T08:28:35.576771+0000","last_unstale":"2024-09-10T08:28:45.605836+0000","last_undegraded":"2024-09-10T08:28:45.605836+0000","last_fullsized":"2024-09-10T08:28:45.605836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:07.162941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606550+0000","last_change":"2024-09-10T08:28:34.561324+0000","last_active":"2024-09-10T08:28:45.606550+0000","last_peered":"2024-09-10T08:28:45.606550+0000","last_clean":"2024-09-10T08:28:45.606550+0000","last_became_active":"2024-09-10T08:28:34.560974+0000","last_became_peered":"2024-09-10T08:28:34.560974+0000","last_unstale":"2024-09-10T08:28:45.606550+0000","last_undegraded":"2024-09-10T08:28:45.606550+0000","last_fullsized":"2024-09-10T08:28:45.606550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:18.790965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.600502+0000","last_change":"2024-09-10T08:28:45.600502+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.600502+0000","last_undegraded":"2024-09-10T08:28:45.600502+0000","last_fullsized":"2024-09-10T08:28:45.600502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604743+0000","last_change":"2024-09-10T08:28:35.572363+0000","last_active":"2024-09-10T08:28:45.604743+0000","last_peered":"2024-09-10T08:28:45.604743+0000","last_clean":"2024-09-10T08:28:45.604743+0000","last_became_active":"2024-09-10T08:28:35.572108+0000","last_became_peered":"2024-09-10T08:28:35.572108+0000","last_unstale":"2024-09-10T08:28:45.604743+0000","last_undegraded":"2024-09-10T08:28:45.604743+0000","last_fullsized":"2024-09-10T08:28:45.604743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:48.358634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606610+0000","last_change":"2024-09-10T08:28:34.564813+0000","last_active":"2024-09-10T08:28:45.606610+0000","last_peered":"2024-09-10T08:28:45.606610+0000","last_clean":"2024-09-10T08:28:45.606610+0000","last_became_active":"2024-09-10T08:28:34.564557+0000","last_became_peered":"2024-09-10T08:28:34.564557+0000","last_unstale":"2024-09-10T08:28:45.606610+0000","last_undegraded":"2024-09-10T08:28:45.606610+0000","last_fullsized":"2024-09-10T08:28:45.606610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:48.356069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.605451+0000","last_change":"2024-09-10T08:28:45.605451+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.605451+0000","last_undegraded":"2024-09-10T08:28:45.605451+0000","last_fullsized":"2024-09-10T08:28:45.605451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603108+0000","last_change":"2024-09-10T08:28:35.569938+0000","last_active":"2024-09-10T08:28:45.603108+0000","last_peered":"2024-09-10T08:28:45.603108+0000","last_clean":"2024-09-10T08:28:45.603108+0000","last_became_active":"2024-09-10T08:28:35.569109+0000","last_became_peered":"2024-09-10T08:28:35.569109+0000","last_unstale":"2024-09-10T08:28:45.603108+0000","last_undegraded":"2024-09-10T08:28:45.603108+0000","last_fullsized":"2024-09-10T08:28:45.603108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:51.680564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603546+0000","last_change":"2024-09-10T08:28:34.571069+0000","last_active":"2024-09-10T08:28:45.603546+0000","last_peered":"2024-09-10T08:28:45.603546+0000","last_clean":"2024-09-10T08:28:45.603546+0000","last_became_active":"2024-09-10T08:28:34.570766+0000","last_became_peered":"2024-09-10T08:28:34.570766+0000","last_unstale":"2024-09-10T08:28:45.603546+0000","last_undegraded":"2024-09-10T08:28:45.603546+0000","last_fullsized":"2024-09-10T08:28:45.603546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:47.458195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.600452+0000","last_change":"2024-09-10T08:28:45.600452+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.600452+0000","last_undegraded":"2024-09-10T08:28:45.600452+0000","last_fullsized":"2024-09-10T08:28:45.600452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619239+0000","last_change":"2024-09-10T08:28:35.575106+0000","last_active":"2024-09-10T08:28:36.619239+0000","last_peered":"2024-09-10T08:28:36.619239+0000","last_clean":"2024-09-10T08:28:36.619239+0000","last_became_active":"2024-09-10T08:28:35.574815+0000","last_became_peered":"2024-09-10T08:28:35.574815+0000","last_unstale":"2024-09-10T08:28:36.619239+0000","last_undegraded":"2024-09-10T08:28:36.619239+0000","last_fullsized":"2024-09-10T08:28:36.619239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:26.512181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.619552+0000","last_change":"2024-09-10T08:28:34.564865+0000","last_active":"2024-09-10T08:28:47.619552+0000","last_peered":"2024-09-10T08:28:47.619552+0000","last_clean":"2024-09-10T08:28:47.619552+0000","last_became_active":"2024-09-10T08:28:34.564549+0000","last_became_peered":"2024-09-10T08:28:34.564549+0000","last_unstale":"2024-09-10T08:28:47.619552+0000","last_undegraded":"2024-09-10T08:28:47.619552+0000","last_fullsized":"2024-09-10T08:28:47.619552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:05.523637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.600402+0000","last_change":"2024-09-10T08:28:45.600402+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.600402+0000","last_undegraded":"2024-09-10T08:28:45.600402+0000","last_fullsized":"2024-09-10T08:28:45.600402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606015+0000","last_change":"2024-09-10T08:28:35.574107+0000","last_active":"2024-09-10T08:28:45.606015+0000","last_peered":"2024-09-10T08:28:45.606015+0000","last_clean":"2024-09-10T08:28:45.606015+0000","last_became_active":"2024-09-10T08:28:35.573851+0000","last_became_peered":"2024-09-10T08:28:35.573851+0000","last_unstale":"2024-09-10T08:28:45.606015+0000","last_undegraded":"2024-09-10T08:28:45.606015+0000","last_fullsized":"2024-09-10T08:28:45.606015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:53.240223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606704+0000","last_change":"2024-09-10T08:28:34.563451+0000","last_active":"2024-09-10T08:28:45.606704+0000","last_peered":"2024-09-10T08:28:45.606704+0000","last_clean":"2024-09-10T08:28:45.606704+0000","last_became_active":"2024-09-10T08:28:34.563259+0000","last_became_peered":"2024-09-10T08:28:34.563259+0000","last_unstale":"2024-09-10T08:28:45.606704+0000","last_undegraded":"2024-09-10T08:28:45.606704+0000","last_fullsized":"2024-09-10T08:28:45.606704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:44.899351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.603287+0000","last_change":"2024-09-10T08:28:45.603287+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.603287+0000","last_undegraded":"2024-09-10T08:28:45.603287+0000","last_fullsized":"2024-09-10T08:28:45.603287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.639830+0000","last_change":"2024-09-10T08:28:47.634754+0000","last_active":"2024-09-10T08:28:47.639830+0000","last_peered":"2024-09-10T08:28:47.639830+0000","last_clean":"2024-09-10T08:28:47.639830+0000","last_became_active":"2024-09-10T08:28:47.634382+0000","last_became_peered":"2024-09-10T08:28:47.634382+0000","last_unstale":"2024-09-10T08:28:47.639830+0000","last_undegraded":"2024-09-10T08:28:47.639830+0000","last_fullsized":"2024-09-10T08:28:47.639830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:08.900176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606350+0000","last_change":"2024-09-10T08:28:35.567481+0000","last_active":"2024-09-10T08:28:45.606350+0000","last_peered":"2024-09-10T08:28:45.606350+0000","last_clean":"2024-09-10T08:28:45.606350+0000","last_became_active":"2024-09-10T08:28:35.567167+0000","last_became_peered":"2024-09-10T08:28:35.567167+0000","last_unstale":"2024-09-10T08:28:45.606350+0000","last_undegraded":"2024-09-10T08:28:45.606350+0000","last_fullsized":"2024-09-10T08:28:45.606350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:44.110012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605020+0000","last_change":"2024-09-10T08:28:34.571283+0000","last_active":"2024-09-10T08:28:45.605020+0000","last_peered":"2024-09-10T08:28:45.605020+0000","last_clean":"2024-09-10T08:28:45.605020+0000","last_became_active":"2024-09-10T08:28:34.570791+0000","last_became_peered":"2024-09-10T08:28:34.570791+0000","last_unstale":"2024-09-10T08:28:45.605020+0000","last_undegraded":"2024-09-10T08:28:45.605020+0000","last_fullsized":"2024-09-10T08:28:45.605020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:17.427597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:45.593387+0000","last_change":"2024-09-10T08:28:45.593387+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.593387+0000","last_undegraded":"2024-09-10T08:28:45.593387+0000","last_fullsized":"2024-09-10T08:28:45.593387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604102+0000","last_change":"2024-09-10T08:28:35.576280+0000","last_active":"2024-09-10T08:28:45.604102+0000","last_peered":"2024-09-10T08:28:45.604102+0000","last_clean":"2024-09-10T08:28:45.604102+0000","last_became_active":"2024-09-10T08:28:35.576002+0000","last_became_peered":"2024-09-10T08:28:35.576002+0000","last_unstale":"2024-09-10T08:28:45.604102+0000","last_undegraded":"2024-09-10T08:28:45.604102+0000","last_fullsized":"2024-09-10T08:28:45.604102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:46.278441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606425+0000","last_change":"2024-09-10T08:28:34.555212+0000","last_active":"2024-09-10T08:28:45.606425+0000","last_peered":"2024-09-10T08:28:45.606425+0000","last_clean":"2024-09-10T08:28:45.606425+0000","last_became_active":"2024-09-10T08:28:34.554922+0000","last_became_peered":"2024-09-10T08:28:34.554922+0000","last_unstale":"2024-09-10T08:28:45.606425+0000","last_undegraded":"2024-09-10T08:28:45.606425+0000","last_fullsized":"2024-09-10T08:28:45.606425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.604756+0000","last_change":"2024-09-10T08:28:45.604756+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.604756+0000","last_undegraded":"2024-09-10T08:28:45.604756+0000","last_fullsized":"2024-09-10T08:28:45.604756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604254+0000","last_change":"2024-09-10T08:28:35.577978+0000","last_active":"2024-09-10T08:28:45.604254+0000","last_peered":"2024-09-10T08:28:45.604254+0000","last_clean":"2024-09-10T08:28:45.604254+0000","last_became_active":"2024-09-10T08:28:35.577718+0000","last_became_peered":"2024-09-10T08:28:35.577718+0000","last_unstale":"2024-09-10T08:28:45.604254+0000","last_undegraded":"2024-09-10T08:28:45.604254+0000","last_fullsized":"2024-09-10T08:28:45.604254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:01:57.257817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604509+0000","last_change":"2024-09-10T08:28:34.553983+0000","last_active":"2024-09-10T08:28:45.604509+0000","last_peered":"2024-09-10T08:28:45.604509+0000","last_clean":"2024-09-10T08:28:45.604509+0000","last_became_active":"2024-09-10T08:28:34.553693+0000","last_became_peered":"2024-09-10T08:28:34.553693+0000","last_unstale":"2024-09-10T08:28:45.604509+0000","last_undegraded":"2024-09-10T08:28:45.604509+0000","last_fullsized":"2024-09-10T08:28:45.604509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:40.001685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.605137+0000","last_change":"2024-09-10T08:28:45.605137+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.605137+0000","last_undegraded":"2024-09-10T08:28:45.605137+0000","last_fullsized":"2024-09-10T08:28:45.605137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.629847+0000","last_change":"2024-09-10T08:28:47.621588+0000","last_active":"2024-09-10T08:28:47.629847+0000","last_peered":"2024-09-10T08:28:47.629847+0000","last_clean":"2024-09-10T08:28:47.629847+0000","last_became_active":"2024-09-10T08:28:47.621122+0000","last_became_peered":"2024-09-10T08:28:47.621122+0000","last_unstale":"2024-09-10T08:28:47.629847+0000","last_undegraded":"2024-09-10T08:28:47.629847+0000","last_fullsized":"2024-09-10T08:28:47.629847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:19.727552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606067+0000","last_change":"2024-09-10T08:28:35.566745+0000","last_active":"2024-09-10T08:28:45.606067+0000","last_peered":"2024-09-10T08:28:45.606067+0000","last_clean":"2024-09-10T08:28:45.606067+0000","last_became_active":"2024-09-10T08:28:35.566444+0000","last_became_peered":"2024-09-10T08:28:35.566444+0000","last_unstale":"2024-09-10T08:28:45.606067+0000","last_undegraded":"2024-09-10T08:28:45.606067+0000","last_fullsized":"2024-09-10T08:28:45.606067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:52.735296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.607113+0000","last_change":"2024-09-10T08:28:34.560745+0000","last_active":"2024-09-10T08:28:47.607113+0000","last_peered":"2024-09-10T08:28:47.607113+0000","last_clean":"2024-09-10T08:28:47.607113+0000","last_became_active":"2024-09-10T08:28:34.559911+0000","last_became_peered":"2024-09-10T08:28:34.559911+0000","last_unstale":"2024-09-10T08:28:47.607113+0000","last_undegraded":"2024-09-10T08:28:47.607113+0000","last_fullsized":"2024-09-10T08:28:47.607113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:00.234067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.604789+0000","last_change":"2024-09-10T08:28:45.604789+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.604789+0000","last_undegraded":"2024-09-10T08:28:45.604789+0000","last_fullsized":"2024-09-10T08:28:45.604789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619165+0000","last_change":"2024-09-10T08:28:35.576360+0000","last_active":"2024-09-10T08:28:36.619165+0000","last_peered":"2024-09-10T08:28:36.619165+0000","last_clean":"2024-09-10T08:28:36.619165+0000","last_became_active":"2024-09-10T08:28:35.576096+0000","last_became_peered":"2024-09-10T08:28:35.576096+0000","last_unstale":"2024-09-10T08:28:36.619165+0000","last_undegraded":"2024-09-10T08:28:36.619165+0000","last_fullsized":"2024-09-10T08:28:36.619165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:34.159275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603675+0000","last_change":"2024-09-10T08:28:34.568477+0000","last_active":"2024-09-10T08:28:45.603675+0000","last_peered":"2024-09-10T08:28:45.603675+0000","last_clean":"2024-09-10T08:28:45.603675+0000","last_became_active":"2024-09-10T08:28:34.568249+0000","last_became_peered":"2024-09-10T08:28:34.568249+0000","last_unstale":"2024-09-10T08:28:45.603675+0000","last_undegraded":"2024-09-10T08:28:45.603675+0000","last_fullsized":"2024-09-10T08:28:45.603675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:08.640043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:45.593387+0000","last_change":"2024-09-10T08:28:45.593387+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.593387+0000","last_undegraded":"2024-09-10T08:28:45.593387+0000","last_fullsized":"2024-09-10T08:28:45.593387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605156+0000","last_change":"2024-09-10T08:28:35.572658+0000","last_active":"2024-09-10T08:28:45.605156+0000","last_peered":"2024-09-10T08:28:45.605156+0000","last_clean":"2024-09-10T08:28:45.605156+0000","last_became_active":"2024-09-10T08:28:35.571611+0000","last_became_peered":"2024-09-10T08:28:35.571611+0000","last_unstale":"2024-09-10T08:28:45.605156+0000","last_undegraded":"2024-09-10T08:28:45.605156+0000","last_fullsized":"2024-09-10T08:28:45.605156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:42.726996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.602860+0000","last_change":"2024-09-10T08:28:34.555587+0000","last_active":"2024-09-10T08:28:45.602860+0000","last_peered":"2024-09-10T08:28:45.602860+0000","last_clean":"2024-09-10T08:28:45.602860+0000","last_became_active":"2024-09-10T08:28:34.555269+0000","last_became_peered":"2024-09-10T08:28:34.555269+0000","last_unstale":"2024-09-10T08:28:45.602860+0000","last_undegraded":"2024-09-10T08:28:45.602860+0000","last_fullsized":"2024-09-10T08:28:45.602860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:19.499870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603786+0000","last_change":"2024-09-10T08:28:26.724394+0000","last_active":"2024-09-10T08:28:45.603786+0000","last_peered":"2024-09-10T08:28:45.603786+0000","last_clean":"2024-09-10T08:28:45.603786+0000","last_became_active":"2024-09-10T08:28:26.723452+0000","last_became_peered":"2024-09-10T08:28:26.723452+0000","last_unstale":"2024-09-10T08:28:45.603786+0000","last_undegraded":"2024-09-10T08:28:45.603786+0000","last_fullsized":"2024-09-10T08:28:45.603786+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_clean_scrub_stamp":"2024-09-10T08:28:25.445753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:00.811505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.618510+0000","last_change":"2024-09-10T08:28:46.622048+0000","last_active":"2024-09-10T08:28:47.618510+0000","last_peered":"2024-09-10T08:28:47.618510+0000","last_clean":"2024-09-10T08:28:47.618510+0000","last_became_active":"2024-09-10T08:28:46.621770+0000","last_became_peered":"2024-09-10T08:28:46.621770+0000","last_unstale":"2024-09-10T08:28:47.618510+0000","last_undegraded":"2024-09-10T08:28:47.618510+0000","last_fullsized":"2024-09-10T08:28:47.618510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:51.430760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.623784+0000","last_change":"2024-09-10T08:28:47.620746+0000","last_active":"2024-09-10T08:28:47.623784+0000","last_peered":"2024-09-10T08:28:47.623784+0000","last_clean":"2024-09-10T08:28:47.623784+0000","last_became_active":"2024-09-10T08:28:47.620492+0000","last_became_peered":"2024-09-10T08:28:47.620492+0000","last_unstale":"2024-09-10T08:28:47.623784+0000","last_undegraded":"2024-09-10T08:28:47.623784+0000","last_fullsized":"2024-09-10T08:28:47.623784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:55.065641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603848+0000","last_change":"2024-09-10T08:28:35.574532+0000","last_active":"2024-09-10T08:28:45.603848+0000","last_peered":"2024-09-10T08:28:45.603848+0000","last_clean":"2024-09-10T08:28:45.603848+0000","last_became_active":"2024-09-10T08:28:35.574215+0000","last_became_peered":"2024-09-10T08:28:35.574215+0000","last_unstale":"2024-09-10T08:28:45.603848+0000","last_undegraded":"2024-09-10T08:28:45.603848+0000","last_fullsized":"2024-09-10T08:28:45.603848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:28.455653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.608591+0000","last_change":"2024-09-10T08:28:34.559911+0000","last_active":"2024-09-10T08:28:47.608591+0000","last_peered":"2024-09-10T08:28:47.608591+0000","last_clean":"2024-09-10T08:28:47.608591+0000","last_became_active":"2024-09-10T08:28:34.559635+0000","last_became_peered":"2024-09-10T08:28:34.559635+0000","last_unstale":"2024-09-10T08:28:47.608591+0000","last_undegraded":"2024-09-10T08:28:47.608591+0000","last_fullsized":"2024-09-10T08:28:47.608591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:40.892609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.617943+0000","last_change":"2024-09-10T08:28:46.620352+0000","last_active":"2024-09-10T08:28:47.617943+0000","last_peered":"2024-09-10T08:28:47.617943+0000","last_clean":"2024-09-10T08:28:47.617943+0000","last_became_active":"2024-09-10T08:28:46.620064+0000","last_became_peered":"2024-09-10T08:28:46.620064+0000","last_unstale":"2024-09-10T08:28:47.617943+0000","last_undegraded":"2024-09-10T08:28:47.617943+0000","last_fullsized":"2024-09-10T08:28:47.617943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:59.333579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.623859+0000","last_change":"2024-09-10T08:28:47.620305+0000","last_active":"2024-09-10T08:28:47.623859+0000","last_peered":"2024-09-10T08:28:47.623859+0000","last_clean":"2024-09-10T08:28:47.623859+0000","last_became_active":"2024-09-10T08:28:47.620014+0000","last_became_peered":"2024-09-10T08:28:47.620014+0000","last_unstale":"2024-09-10T08:28:47.623859+0000","last_undegraded":"2024-09-10T08:28:47.623859+0000","last_fullsized":"2024-09-10T08:28:47.623859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:26.503891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604168+0000","last_change":"2024-09-10T08:28:35.577124+0000","last_active":"2024-09-10T08:28:45.604168+0000","last_peered":"2024-09-10T08:28:45.604168+0000","last_clean":"2024-09-10T08:28:45.604168+0000","last_became_active":"2024-09-10T08:28:35.576655+0000","last_became_peered":"2024-09-10T08:28:35.576655+0000","last_unstale":"2024-09-10T08:28:45.604168+0000","last_undegraded":"2024-09-10T08:28:45.604168+0000","last_fullsized":"2024-09-10T08:28:45.604168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:29.878600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.607127+0000","last_change":"2024-09-10T08:28:34.560694+0000","last_active":"2024-09-10T08:28:45.607127+0000","last_peered":"2024-09-10T08:28:45.607127+0000","last_clean":"2024-09-10T08:28:45.607127+0000","last_became_active":"2024-09-10T08:28:34.560429+0000","last_became_peered":"2024-09-10T08:28:34.560429+0000","last_unstale":"2024-09-10T08:28:45.607127+0000","last_undegraded":"2024-09-10T08:28:45.607127+0000","last_fullsized":"2024-09-10T08:28:45.607127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:54.514467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:45.593387+0000","last_change":"2024-09-10T08:28:45.593387+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.593387+0000","last_undegraded":"2024-09-10T08:28:45.593387+0000","last_fullsized":"2024-09-10T08:28:45.593387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604619+0000","last_change":"2024-09-10T08:28:35.577577+0000","last_active":"2024-09-10T08:28:45.604619+0000","last_peered":"2024-09-10T08:28:45.604619+0000","last_clean":"2024-09-10T08:28:45.604619+0000","last_became_active":"2024-09-10T08:28:35.576686+0000","last_became_peered":"2024-09-10T08:28:35.576686+0000","last_unstale":"2024-09-10T08:28:45.604619+0000","last_undegraded":"2024-09-10T08:28:45.604619+0000","last_fullsized":"2024-09-10T08:28:45.604619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:36.334494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.608095+0000","last_change":"2024-09-10T08:28:34.560313+0000","last_active":"2024-09-10T08:28:47.608095+0000","last_peered":"2024-09-10T08:28:47.608095+0000","last_clean":"2024-09-10T08:28:47.608095+0000","last_became_active":"2024-09-10T08:28:34.560035+0000","last_became_peered":"2024-09-10T08:28:34.560035+0000","last_unstale":"2024-09-10T08:28:47.608095+0000","last_undegraded":"2024-09-10T08:28:47.608095+0000","last_fullsized":"2024-09-10T08:28:47.608095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:56.945537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.601907+0000","last_change":"2024-09-10T08:28:45.601907+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.601907+0000","last_undegraded":"2024-09-10T08:28:45.601907+0000","last_fullsized":"2024-09-10T08:28:45.601907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.621115+0000","last_change":"2024-09-10T08:28:47.619805+0000","last_active":"2024-09-10T08:28:47.621115+0000","last_peered":"2024-09-10T08:28:47.621115+0000","last_clean":"2024-09-10T08:28:47.621115+0000","last_became_active":"2024-09-10T08:28:47.619452+0000","last_became_peered":"2024-09-10T08:28:47.619452+0000","last_unstale":"2024-09-10T08:28:47.621115+0000","last_undegraded":"2024-09-10T08:28:47.621115+0000","last_fullsized":"2024-09-10T08:28:47.621115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:41:58.798577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604071+0000","last_change":"2024-09-10T08:28:35.577476+0000","last_active":"2024-09-10T08:28:45.604071+0000","last_peered":"2024-09-10T08:28:45.604071+0000","last_clean":"2024-09-10T08:28:45.604071+0000","last_became_active":"2024-09-10T08:28:35.576786+0000","last_became_peered":"2024-09-10T08:28:35.576786+0000","last_unstale":"2024-09-10T08:28:45.604071+0000","last_undegraded":"2024-09-10T08:28:45.604071+0000","last_fullsized":"2024-09-10T08:28:45.604071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:46.914074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603504+0000","last_change":"2024-09-10T08:28:34.551102+0000","last_active":"2024-09-10T08:28:45.603504+0000","last_peered":"2024-09-10T08:28:45.603504+0000","last_clean":"2024-09-10T08:28:45.603504+0000","last_became_active":"2024-09-10T08:28:34.550773+0000","last_became_peered":"2024-09-10T08:28:34.550773+0000","last_unstale":"2024-09-10T08:28:45.603504+0000","last_undegraded":"2024-09-10T08:28:45.603504+0000","last_fullsized":"2024-09-10T08:28:45.603504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:35.393695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.600953+0000","last_change":"2024-09-10T08:28:45.600953+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.600953+0000","last_undegraded":"2024-09-10T08:28:45.600953+0000","last_fullsized":"2024-09-10T08:28:45.600953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604205+0000","last_change":"2024-09-10T08:28:35.575307+0000","last_active":"2024-09-10T08:28:45.604205+0000","last_peered":"2024-09-10T08:28:45.604205+0000","last_clean":"2024-09-10T08:28:45.604205+0000","last_became_active":"2024-09-10T08:28:35.575038+0000","last_became_peered":"2024-09-10T08:28:35.575038+0000","last_unstale":"2024-09-10T08:28:45.604205+0000","last_undegraded":"2024-09-10T08:28:45.604205+0000","last_fullsized":"2024-09-10T08:28:45.604205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:36.478822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.607008+0000","last_change":"2024-09-10T08:28:34.555542+0000","last_active":"2024-09-10T08:28:47.607008+0000","last_peered":"2024-09-10T08:28:47.607008+0000","last_clean":"2024-09-10T08:28:47.607008+0000","last_became_active":"2024-09-10T08:28:34.555179+0000","last_became_peered":"2024-09-10T08:28:34.555179+0000","last_unstale":"2024-09-10T08:28:47.607008+0000","last_undegraded":"2024-09-10T08:28:47.607008+0000","last_fullsized":"2024-09-10T08:28:47.607008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:53.313161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:45.593387+0000","last_change":"2024-09-10T08:28:45.593387+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.593387+0000","last_undegraded":"2024-09-10T08:28:45.593387+0000","last_fullsized":"2024-09-10T08:28:45.593387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.617179+0000","last_change":"2024-09-10T08:28:35.578892+0000","last_active":"2024-09-10T08:28:47.617179+0000","last_peered":"2024-09-10T08:28:47.617179+0000","last_clean":"2024-09-10T08:28:47.617179+0000","last_became_active":"2024-09-10T08:28:35.578299+0000","last_became_peered":"2024-09-10T08:28:35.578299+0000","last_unstale":"2024-09-10T08:28:47.617179+0000","last_undegraded":"2024-09-10T08:28:47.617179+0000","last_fullsized":"2024-09-10T08:28:47.617179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:27.485392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.617702+0000","last_change":"2024-09-10T08:28:34.560444+0000","last_active":"2024-09-10T08:28:47.617702+0000","last_peered":"2024-09-10T08:28:47.617702+0000","last_clean":"2024-09-10T08:28:47.617702+0000","last_became_active":"2024-09-10T08:28:34.560188+0000","last_became_peered":"2024-09-10T08:28:34.560188+0000","last_unstale":"2024-09-10T08:28:47.617702+0000","last_undegraded":"2024-09-10T08:28:47.617702+0000","last_fullsized":"2024-09-10T08:28:47.617702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:15.727780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.604116+0000","last_change":"2024-09-10T08:28:45.604116+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.604116+0000","last_undegraded":"2024-09-10T08:28:45.604116+0000","last_fullsized":"2024-09-10T08:28:45.604116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604484+0000","last_change":"2024-09-10T08:28:35.575788+0000","last_active":"2024-09-10T08:28:45.604484+0000","last_peered":"2024-09-10T08:28:45.604484+0000","last_clean":"2024-09-10T08:28:45.604484+0000","last_became_active":"2024-09-10T08:28:35.575333+0000","last_became_peered":"2024-09-10T08:28:35.575333+0000","last_unstale":"2024-09-10T08:28:45.604484+0000","last_undegraded":"2024-09-10T08:28:45.604484+0000","last_fullsized":"2024-09-10T08:28:45.604484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:39.756390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604482+0000","last_change":"2024-09-10T08:28:34.560699+0000","last_active":"2024-09-10T08:28:45.604482+0000","last_peered":"2024-09-10T08:28:45.604482+0000","last_clean":"2024-09-10T08:28:45.604482+0000","last_became_active":"2024-09-10T08:28:34.560376+0000","last_became_peered":"2024-09-10T08:28:34.560376+0000","last_unstale":"2024-09-10T08:28:45.604482+0000","last_undegraded":"2024-09-10T08:28:45.604482+0000","last_fullsized":"2024-09-10T08:28:45.604482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:09.981216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.603603+0000","last_change":"2024-09-10T08:28:45.603603+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.603603+0000","last_undegraded":"2024-09-10T08:28:45.603603+0000","last_fullsized":"2024-09-10T08:28:45.603603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619742+0000","last_change":"2024-09-10T08:28:35.574810+0000","last_active":"2024-09-10T08:28:36.619742+0000","last_peered":"2024-09-10T08:28:36.619742+0000","last_clean":"2024-09-10T08:28:36.619742+0000","last_became_active":"2024-09-10T08:28:35.574567+0000","last_became_peered":"2024-09-10T08:28:35.574567+0000","last_unstale":"2024-09-10T08:28:36.619742+0000","last_undegraded":"2024-09-10T08:28:36.619742+0000","last_fullsized":"2024-09-10T08:28:36.619742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:29.315833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620328+0000","last_change":"2024-09-10T08:28:34.553556+0000","last_active":"2024-09-10T08:28:36.620328+0000","last_peered":"2024-09-10T08:28:36.620328+0000","last_clean":"2024-09-10T08:28:36.620328+0000","last_became_active":"2024-09-10T08:28:34.553275+0000","last_became_peered":"2024-09-10T08:28:34.553275+0000","last_unstale":"2024-09-10T08:28:36.620328+0000","last_undegraded":"2024-09-10T08:28:36.620328+0000","last_fullsized":"2024-09-10T08:28:36.620328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:45.957635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.600401+0000","last_change":"2024-09-10T08:28:45.600401+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.600401+0000","last_undegraded":"2024-09-10T08:28:45.600401+0000","last_fullsized":"2024-09-10T08:28:45.600401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603744+0000","last_change":"2024-09-10T08:28:35.582473+0000","last_active":"2024-09-10T08:28:45.603744+0000","last_peered":"2024-09-10T08:28:45.603744+0000","last_clean":"2024-09-10T08:28:45.603744+0000","last_became_active":"2024-09-10T08:28:35.582205+0000","last_became_peered":"2024-09-10T08:28:35.582205+0000","last_unstale":"2024-09-10T08:28:45.603744+0000","last_undegraded":"2024-09-10T08:28:45.603744+0000","last_fullsized":"2024-09-10T08:28:45.603744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:11.200963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.618829+0000","last_change":"2024-09-10T08:28:34.559823+0000","last_active":"2024-09-10T08:28:47.618829+0000","last_peered":"2024-09-10T08:28:47.618829+0000","last_clean":"2024-09-10T08:28:47.618829+0000","last_became_active":"2024-09-10T08:28:34.559560+0000","last_became_peered":"2024-09-10T08:28:34.559560+0000","last_unstale":"2024-09-10T08:28:47.618829+0000","last_undegraded":"2024-09-10T08:28:47.618829+0000","last_fullsized":"2024-09-10T08:28:47.618829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:53.724382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.605252+0000","last_change":"2024-09-10T08:28:45.605252+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.605252+0000","last_undegraded":"2024-09-10T08:28:45.605252+0000","last_fullsized":"2024-09-10T08:28:45.605252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603930+0000","last_change":"2024-09-10T08:28:35.571262+0000","last_active":"2024-09-10T08:28:45.603930+0000","last_peered":"2024-09-10T08:28:45.603930+0000","last_clean":"2024-09-10T08:28:45.603930+0000","last_became_active":"2024-09-10T08:28:35.570711+0000","last_became_peered":"2024-09-10T08:28:35.570711+0000","last_unstale":"2024-09-10T08:28:45.603930+0000","last_undegraded":"2024-09-10T08:28:45.603930+0000","last_fullsized":"2024-09-10T08:28:45.603930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:29.116422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.607025+0000","last_change":"2024-09-10T08:28:34.557352+0000","last_active":"2024-09-10T08:28:45.607025+0000","last_peered":"2024-09-10T08:28:45.607025+0000","last_clean":"2024-09-10T08:28:45.607025+0000","last_became_active":"2024-09-10T08:28:34.557076+0000","last_became_peered":"2024-09-10T08:28:34.557076+0000","last_unstale":"2024-09-10T08:28:45.607025+0000","last_undegraded":"2024-09-10T08:28:45.607025+0000","last_fullsized":"2024-09-10T08:28:45.607025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:04.957739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.601549+0000","last_change":"2024-09-10T08:28:45.601549+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.601549+0000","last_undegraded":"2024-09-10T08:28:45.601549+0000","last_fullsized":"2024-09-10T08:28:45.601549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.627287+0000","last_change":"2024-09-10T08:28:47.623223+0000","last_active":"2024-09-10T08:28:47.627287+0000","last_peered":"2024-09-10T08:28:47.627287+0000","last_clean":"2024-09-10T08:28:47.627287+0000","last_became_active":"2024-09-10T08:28:47.622961+0000","last_became_peered":"2024-09-10T08:28:47.622961+0000","last_unstale":"2024-09-10T08:28:47.627287+0000","last_undegraded":"2024-09-10T08:28:47.627287+0000","last_fullsized":"2024-09-10T08:28:47.627287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:03.024023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619533+0000","last_change":"2024-09-10T08:28:35.577913+0000","last_active":"2024-09-10T08:28:36.619533+0000","last_peered":"2024-09-10T08:28:36.619533+0000","last_clean":"2024-09-10T08:28:36.619533+0000","last_became_active":"2024-09-10T08:28:35.577255+0000","last_became_peered":"2024-09-10T08:28:35.577255+0000","last_unstale":"2024-09-10T08:28:36.619533+0000","last_undegraded":"2024-09-10T08:28:36.619533+0000","last_fullsized":"2024-09-10T08:28:36.619533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:17.413525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603259+0000","last_change":"2024-09-10T08:28:34.564571+0000","last_active":"2024-09-10T08:28:45.603259+0000","last_peered":"2024-09-10T08:28:45.603259+0000","last_clean":"2024-09-10T08:28:45.603259+0000","last_became_active":"2024-09-10T08:28:34.564189+0000","last_became_peered":"2024-09-10T08:28:34.564189+0000","last_unstale":"2024-09-10T08:28:45.603259+0000","last_undegraded":"2024-09-10T08:28:45.603259+0000","last_fullsized":"2024-09-10T08:28:45.603259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:46.055510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.604073+0000","last_change":"2024-09-10T08:28:45.604073+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.604073+0000","last_undegraded":"2024-09-10T08:28:45.604073+0000","last_fullsized":"2024-09-10T08:28:45.604073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603156+0000","last_change":"2024-09-10T08:28:35.572944+0000","last_active":"2024-09-10T08:28:45.603156+0000","last_peered":"2024-09-10T08:28:45.603156+0000","last_clean":"2024-09-10T08:28:45.603156+0000","last_became_active":"2024-09-10T08:28:35.572620+0000","last_became_peered":"2024-09-10T08:28:35.572620+0000","last_unstale":"2024-09-10T08:28:45.603156+0000","last_undegraded":"2024-09-10T08:28:45.603156+0000","last_fullsized":"2024-09-10T08:28:45.603156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:04.524048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.619511+0000","last_change":"2024-09-10T08:28:34.562935+0000","last_active":"2024-09-10T08:28:47.619511+0000","last_peered":"2024-09-10T08:28:47.619511+0000","last_clean":"2024-09-10T08:28:47.619511+0000","last_became_active":"2024-09-10T08:28:34.562647+0000","last_became_peered":"2024-09-10T08:28:34.562647+0000","last_unstale":"2024-09-10T08:28:47.619511+0000","last_undegraded":"2024-09-10T08:28:47.619511+0000","last_fullsized":"2024-09-10T08:28:47.619511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:47.492281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.603885+0000","last_change":"2024-09-10T08:28:45.603885+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.603885+0000","last_undegraded":"2024-09-10T08:28:45.603885+0000","last_fullsized":"2024-09-10T08:28:45.603885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.634964+0000","last_change":"2024-09-10T08:28:47.627750+0000","last_active":"2024-09-10T08:28:47.634964+0000","last_peered":"2024-09-10T08:28:47.634964+0000","last_clean":"2024-09-10T08:28:47.634964+0000","last_became_active":"2024-09-10T08:28:47.627481+0000","last_became_peered":"2024-09-10T08:28:47.627481+0000","last_unstale":"2024-09-10T08:28:47.634964+0000","last_undegraded":"2024-09-10T08:28:47.634964+0000","last_fullsized":"2024-09-10T08:28:47.634964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:10.323020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:45.593387+0000","last_change":"2024-09-10T08:28:45.593387+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.593387+0000","last_undegraded":"2024-09-10T08:28:45.593387+0000","last_fullsized":"2024-09-10T08:28:45.593387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606276+0000","last_change":"2024-09-10T08:28:35.572803+0000","last_active":"2024-09-10T08:28:45.606276+0000","last_peered":"2024-09-10T08:28:45.606276+0000","last_clean":"2024-09-10T08:28:45.606276+0000","last_became_active":"2024-09-10T08:28:35.572219+0000","last_became_peered":"2024-09-10T08:28:35.572219+0000","last_unstale":"2024-09-10T08:28:45.606276+0000","last_undegraded":"2024-09-10T08:28:45.606276+0000","last_fullsized":"2024-09-10T08:28:45.606276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:45.920218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603662+0000","last_change":"2024-09-10T08:28:34.554346+0000","last_active":"2024-09-10T08:28:45.603662+0000","last_peered":"2024-09-10T08:28:45.603662+0000","last_clean":"2024-09-10T08:28:45.603662+0000","last_became_active":"2024-09-10T08:28:34.553933+0000","last_became_peered":"2024-09-10T08:28:34.553933+0000","last_unstale":"2024-09-10T08:28:45.603662+0000","last_undegraded":"2024-09-10T08:28:45.603662+0000","last_fullsized":"2024-09-10T08:28:45.603662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:07.639671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.640842+0000","last_change":"2024-09-10T08:28:46.630904+0000","last_active":"2024-09-10T08:28:47.640842+0000","last_peered":"2024-09-10T08:28:47.640842+0000","last_clean":"2024-09-10T08:28:47.640842+0000","last_became_active":"2024-09-10T08:28:46.630530+0000","last_became_peered":"2024-09-10T08:28:46.630530+0000","last_unstale":"2024-09-10T08:28:47.640842+0000","last_undegraded":"2024-09-10T08:28:47.640842+0000","last_fullsized":"2024-09-10T08:28:47.640842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:33.599739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604633+0000","last_change":"2024-09-10T08:28:35.580244+0000","last_active":"2024-09-10T08:28:45.604633+0000","last_peered":"2024-09-10T08:28:45.604633+0000","last_clean":"2024-09-10T08:28:45.604633+0000","last_became_active":"2024-09-10T08:28:35.579975+0000","last_became_peered":"2024-09-10T08:28:35.579975+0000","last_unstale":"2024-09-10T08:28:45.604633+0000","last_undegraded":"2024-09-10T08:28:45.604633+0000","last_fullsized":"2024-09-10T08:28:45.604633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:16.498045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604937+0000","last_change":"2024-09-10T08:28:34.564751+0000","last_active":"2024-09-10T08:28:45.604937+0000","last_peered":"2024-09-10T08:28:45.604937+0000","last_clean":"2024-09-10T08:28:45.604937+0000","last_became_active":"2024-09-10T08:28:34.564479+0000","last_became_peered":"2024-09-10T08:28:34.564479+0000","last_unstale":"2024-09-10T08:28:45.604937+0000","last_undegraded":"2024-09-10T08:28:45.604937+0000","last_fullsized":"2024-09-10T08:28:45.604937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:29.618224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.618194+0000","last_change":"2024-09-10T08:28:34.561906+0000","last_active":"2024-09-10T08:28:47.618194+0000","last_peered":"2024-09-10T08:28:47.618194+0000","last_clean":"2024-09-10T08:28:47.618194+0000","last_became_active":"2024-09-10T08:28:34.561613+0000","last_became_peered":"2024-09-10T08:28:34.561613+0000","last_unstale":"2024-09-10T08:28:47.618194+0000","last_undegraded":"2024-09-10T08:28:47.618194+0000","last_fullsized":"2024-09-10T08:28:47.618194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:56.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620240+0000","last_change":"2024-09-10T08:28:35.576406+0000","last_active":"2024-09-10T08:28:36.620240+0000","last_peered":"2024-09-10T08:28:36.620240+0000","last_clean":"2024-09-10T08:28:36.620240+0000","last_became_active":"2024-09-10T08:28:35.576145+0000","last_became_peered":"2024-09-10T08:28:35.576145+0000","last_unstale":"2024-09-10T08:28:36.620240+0000","last_undegraded":"2024-09-10T08:28:36.620240+0000","last_fullsized":"2024-09-10T08:28:36.620240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:57.667098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.641416+0000","last_change":"2024-09-10T08:28:46.622395+0000","last_active":"2024-09-10T08:28:47.641416+0000","last_peered":"2024-09-10T08:28:47.641416+0000","last_clean":"2024-09-10T08:28:47.641416+0000","last_became_active":"2024-09-10T08:28:46.621941+0000","last_became_peered":"2024-09-10T08:28:46.621941+0000","last_unstale":"2024-09-10T08:28:47.641416+0000","last_undegraded":"2024-09-10T08:28:47.641416+0000","last_fullsized":"2024-09-10T08:28:47.641416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:54.928969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605876+0000","last_change":"2024-09-10T08:28:34.566606+0000","last_active":"2024-09-10T08:28:45.605876+0000","last_peered":"2024-09-10T08:28:45.605876+0000","last_clean":"2024-09-10T08:28:45.605876+0000","last_became_active":"2024-09-10T08:28:34.566388+0000","last_became_peered":"2024-09-10T08:28:34.566388+0000","last_unstale":"2024-09-10T08:28:45.605876+0000","last_undegraded":"2024-09-10T08:28:45.605876+0000","last_fullsized":"2024-09-10T08:28:45.605876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:33.528801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.602832+0000","last_change":"2024-09-10T08:28:35.559371+0000","last_active":"2024-09-10T08:28:45.602832+0000","last_peered":"2024-09-10T08:28:45.602832+0000","last_clean":"2024-09-10T08:28:45.602832+0000","last_became_active":"2024-09-10T08:28:35.559145+0000","last_became_peered":"2024-09-10T08:28:35.559145+0000","last_unstale":"2024-09-10T08:28:45.602832+0000","last_undegraded":"2024-09-10T08:28:45.602832+0000","last_fullsized":"2024-09-10T08:28:45.602832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:57.339318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":22,"state":"creating+peering","last_fresh":"2024-09-10T08:28:45.603493+0000","last_change":"2024-09-10T08:28:45.603493+0000","last_active":"2024-09-10T08:28:45.593387+0000","last_peered":"2024-09-10T08:28:45.593387+0000","last_clean":"2024-09-10T08:28:45.593387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:45.603493+0000","last_undegraded":"2024-09-10T08:28:45.603493+0000","last_fullsized":"2024-09-10T08:28:45.603493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.617081+0000","last_change":"2024-09-10T08:28:35.579106+0000","last_active":"2024-09-10T08:28:47.617081+0000","last_peered":"2024-09-10T08:28:47.617081+0000","last_clean":"2024-09-10T08:28:47.617081+0000","last_became_active":"2024-09-10T08:28:35.578631+0000","last_became_peered":"2024-09-10T08:28:35.578631+0000","last_unstale":"2024-09-10T08:28:47.617081+0000","last_undegraded":"2024-09-10T08:28:47.617081+0000","last_fullsized":"2024-09-10T08:28:47.617081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:31.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.606957+0000","last_change":"2024-09-10T08:28:35.566780+0000","last_active":"2024-09-10T08:28:47.606957+0000","last_peered":"2024-09-10T08:28:47.606957+0000","last_clean":"2024-09-10T08:28:47.606957+0000","last_became_active":"2024-09-10T08:28:35.566529+0000","last_became_peered":"2024-09-10T08:28:35.566529+0000","last_unstale":"2024-09-10T08:28:47.606957+0000","last_undegraded":"2024-09-10T08:28:47.606957+0000","last_fullsized":"2024-09-10T08:28:47.606957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:09.481166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604413+0000","last_change":"2024-09-10T08:28:35.578735+0000","last_active":"2024-09-10T08:28:45.604413+0000","last_peered":"2024-09-10T08:28:45.604413+0000","last_clean":"2024-09-10T08:28:45.604413+0000","last_became_active":"2024-09-10T08:28:35.577995+0000","last_became_peered":"2024-09-10T08:28:35.577995+0000","last_unstale":"2024-09-10T08:28:45.604413+0000","last_undegraded":"2024-09-10T08:28:45.604413+0000","last_fullsized":"2024-09-10T08:28:45.604413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:11.033441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.620112+0000","last_change":"2024-09-10T08:28:35.577852+0000","last_active":"2024-09-10T08:28:36.620112+0000","last_peered":"2024-09-10T08:28:36.620112+0000","last_clean":"2024-09-10T08:28:36.620112+0000","last_became_active":"2024-09-10T08:28:35.577571+0000","last_became_peered":"2024-09-10T08:28:35.577571+0000","last_unstale":"2024-09-10T08:28:36.620112+0000","last_undegraded":"2024-09-10T08:28:36.620112+0000","last_fullsized":"2024-09-10T08:28:36.620112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:22.713732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605491+0000","last_change":"2024-09-10T08:28:35.574676+0000","last_active":"2024-09-10T08:28:45.605491+0000","last_peered":"2024-09-10T08:28:45.605491+0000","last_clean":"2024-09-10T08:28:45.605491+0000","last_became_active":"2024-09-10T08:28:35.574437+0000","last_became_peered":"2024-09-10T08:28:35.574437+0000","last_unstale":"2024-09-10T08:28:45.605491+0000","last_undegraded":"2024-09-10T08:28:45.605491+0000","last_fullsized":"2024-09-10T08:28:45.605491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:45.422506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606933+0000","last_change":"2024-09-10T08:28:35.572550+0000","last_active":"2024-09-10T08:28:45.606933+0000","last_peered":"2024-09-10T08:28:45.606933+0000","last_clean":"2024-09-10T08:28:45.606933+0000","last_became_active":"2024-09-10T08:28:35.572184+0000","last_became_peered":"2024-09-10T08:28:35.572184+0000","last_unstale":"2024-09-10T08:28:45.606933+0000","last_undegraded":"2024-09-10T08:28:45.606933+0000","last_fullsized":"2024-09-10T08:28:45.606933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:08.490734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.619603+0000","last_change":"2024-09-10T08:28:35.573217+0000","last_active":"2024-09-10T08:28:47.619603+0000","last_peered":"2024-09-10T08:28:47.619603+0000","last_clean":"2024-09-10T08:28:47.619603+0000","last_became_active":"2024-09-10T08:28:35.572955+0000","last_became_peered":"2024-09-10T08:28:35.572955+0000","last_unstale":"2024-09-10T08:28:47.619603+0000","last_undegraded":"2024-09-10T08:28:47.619603+0000","last_fullsized":"2024-09-10T08:28:47.619603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:24.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.627308+0000","last_change":"2024-09-10T08:28:47.623365+0000","last_active":"2024-09-10T08:28:47.627308+0000","last_peered":"2024-09-10T08:28:47.627308+0000","last_clean":"2024-09-10T08:28:47.627308+0000","last_became_active":"2024-09-10T08:28:47.623082+0000","last_became_peered":"2024-09-10T08:28:47.623082+0000","last_unstale":"2024-09-10T08:28:47.627308+0000","last_undegraded":"2024-09-10T08:28:47.627308+0000","last_fullsized":"2024-09-10T08:28:47.627308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:44.700683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606011+0000","last_change":"2024-09-10T08:28:35.575902+0000","last_active":"2024-09-10T08:28:45.606011+0000","last_peered":"2024-09-10T08:28:45.606011+0000","last_clean":"2024-09-10T08:28:45.606011+0000","last_became_active":"2024-09-10T08:28:35.575614+0000","last_became_peered":"2024-09-10T08:28:35.575614+0000","last_unstale":"2024-09-10T08:28:45.606011+0000","last_undegraded":"2024-09-10T08:28:45.606011+0000","last_fullsized":"2024-09-10T08:28:45.606011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:11.277682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603554+0000","last_change":"2024-09-10T08:28:35.578285+0000","last_active":"2024-09-10T08:28:45.603554+0000","last_peered":"2024-09-10T08:28:45.603554+0000","last_clean":"2024-09-10T08:28:45.603554+0000","last_became_active":"2024-09-10T08:28:35.576805+0000","last_became_peered":"2024-09-10T08:28:35.576805+0000","last_unstale":"2024-09-10T08:28:45.603554+0000","last_undegraded":"2024-09-10T08:28:45.603554+0000","last_fullsized":"2024-09-10T08:28:45.603554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:46.203320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604782+0000","last_change":"2024-09-10T08:28:35.571566+0000","last_active":"2024-09-10T08:28:45.604782+0000","last_peered":"2024-09-10T08:28:45.604782+0000","last_clean":"2024-09-10T08:28:45.604782+0000","last_became_active":"2024-09-10T08:28:35.571285+0000","last_became_peered":"2024-09-10T08:28:35.571285+0000","last_unstale":"2024-09-10T08:28:45.604782+0000","last_undegraded":"2024-09-10T08:28:45.604782+0000","last_fullsized":"2024-09-10T08:28:45.604782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:23.587691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.621106+0000","last_change":"2024-09-10T08:28:47.619863+0000","last_active":"2024-09-10T08:28:47.621106+0000","last_peered":"2024-09-10T08:28:47.621106+0000","last_clean":"2024-09-10T08:28:47.621106+0000","last_became_active":"2024-09-10T08:28:47.619525+0000","last_became_peered":"2024-09-10T08:28:47.619525+0000","last_unstale":"2024-09-10T08:28:47.621106+0000","last_undegraded":"2024-09-10T08:28:47.621106+0000","last_fullsized":"2024-09-10T08:28:47.621106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:15.220842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604300+0000","last_change":"2024-09-10T08:28:35.568044+0000","last_active":"2024-09-10T08:28:45.604300+0000","last_peered":"2024-09-10T08:28:45.604300+0000","last_clean":"2024-09-10T08:28:45.604300+0000","last_became_active":"2024-09-10T08:28:35.567744+0000","last_became_peered":"2024-09-10T08:28:35.567744+0000","last_unstale":"2024-09-10T08:28:45.604300+0000","last_undegraded":"2024-09-10T08:28:45.604300+0000","last_fullsized":"2024-09-10T08:28:45.604300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:19.081138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619988+0000","last_change":"2024-09-10T08:28:35.575802+0000","last_active":"2024-09-10T08:28:36.619988+0000","last_peered":"2024-09-10T08:28:36.619988+0000","last_clean":"2024-09-10T08:28:36.619988+0000","last_became_active":"2024-09-10T08:28:35.575388+0000","last_became_peered":"2024-09-10T08:28:35.575388+0000","last_unstale":"2024-09-10T08:28:36.619988+0000","last_undegraded":"2024-09-10T08:28:36.619988+0000","last_fullsized":"2024-09-10T08:28:36.619988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:01.424265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.619820+0000","last_change":"2024-09-10T08:28:35.574499+0000","last_active":"2024-09-10T08:28:47.619820+0000","last_peered":"2024-09-10T08:28:47.619820+0000","last_clean":"2024-09-10T08:28:47.619820+0000","last_became_active":"2024-09-10T08:28:35.574249+0000","last_became_peered":"2024-09-10T08:28:35.574249+0000","last_unstale":"2024-09-10T08:28:47.619820+0000","last_undegraded":"2024-09-10T08:28:47.619820+0000","last_fullsized":"2024-09-10T08:28:47.619820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:55.952307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604916+0000","last_change":"2024-09-10T08:28:35.572709+0000","last_active":"2024-09-10T08:28:45.604916+0000","last_peered":"2024-09-10T08:28:45.604916+0000","last_clean":"2024-09-10T08:28:45.604916+0000","last_became_active":"2024-09-10T08:28:35.572392+0000","last_became_peered":"2024-09-10T08:28:35.572392+0000","last_unstale":"2024-09-10T08:28:45.604916+0000","last_undegraded":"2024-09-10T08:28:45.604916+0000","last_fullsized":"2024-09-10T08:28:45.604916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:42.636299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.608016+0000","last_change":"2024-09-10T08:28:35.574438+0000","last_active":"2024-09-10T08:28:47.608016+0000","last_peered":"2024-09-10T08:28:47.608016+0000","last_clean":"2024-09-10T08:28:47.608016+0000","last_became_active":"2024-09-10T08:28:35.574175+0000","last_became_peered":"2024-09-10T08:28:35.574175+0000","last_unstale":"2024-09-10T08:28:47.608016+0000","last_undegraded":"2024-09-10T08:28:47.608016+0000","last_fullsized":"2024-09-10T08:28:47.608016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:55.808543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603841+0000","last_change":"2024-09-10T08:28:35.567296+0000","last_active":"2024-09-10T08:28:45.603841+0000","last_peered":"2024-09-10T08:28:45.603841+0000","last_clean":"2024-09-10T08:28:45.603841+0000","last_became_active":"2024-09-10T08:28:35.567074+0000","last_became_peered":"2024-09-10T08:28:35.567074+0000","last_unstale":"2024-09-10T08:28:45.603841+0000","last_undegraded":"2024-09-10T08:28:45.603841+0000","last_fullsized":"2024-09-10T08:28:45.603841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:55.698345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603434+0000","last_change":"2024-09-10T08:28:35.570249+0000","last_active":"2024-09-10T08:28:45.603434+0000","last_peered":"2024-09-10T08:28:45.603434+0000","last_clean":"2024-09-10T08:28:45.603434+0000","last_became_active":"2024-09-10T08:28:35.569960+0000","last_became_peered":"2024-09-10T08:28:35.569960+0000","last_unstale":"2024-09-10T08:28:45.603434+0000","last_undegraded":"2024-09-10T08:28:45.603434+0000","last_fullsized":"2024-09-10T08:28:45.603434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:29.787554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606384+0000","last_change":"2024-09-10T08:28:35.560693+0000","last_active":"2024-09-10T08:28:45.606384+0000","last_peered":"2024-09-10T08:28:45.606384+0000","last_clean":"2024-09-10T08:28:45.606384+0000","last_became_active":"2024-09-10T08:28:35.560409+0000","last_became_peered":"2024-09-10T08:28:35.560409+0000","last_unstale":"2024-09-10T08:28:45.606384+0000","last_undegraded":"2024-09-10T08:28:45.606384+0000","last_fullsized":"2024-09-10T08:28:45.606384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:10.597654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619605+0000","last_change":"2024-09-10T08:28:35.574551+0000","last_active":"2024-09-10T08:28:36.619605+0000","last_peered":"2024-09-10T08:28:36.619605+0000","last_clean":"2024-09-10T08:28:36.619605+0000","last_became_active":"2024-09-10T08:28:35.574256+0000","last_became_peered":"2024-09-10T08:28:35.574256+0000","last_unstale":"2024-09-10T08:28:36.619605+0000","last_undegraded":"2024-09-10T08:28:36.619605+0000","last_fullsized":"2024-09-10T08:28:36.619605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:43.401552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.605768+0000","last_change":"2024-09-10T08:28:35.573330+0000","last_active":"2024-09-10T08:28:45.605768+0000","last_peered":"2024-09-10T08:28:45.605768+0000","last_clean":"2024-09-10T08:28:45.605768+0000","last_became_active":"2024-09-10T08:28:35.572992+0000","last_became_peered":"2024-09-10T08:28:35.572992+0000","last_unstale":"2024-09-10T08:28:45.605768+0000","last_undegraded":"2024-09-10T08:28:45.605768+0000","last_fullsized":"2024-09-10T08:28:45.605768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:15.412219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603819+0000","last_change":"2024-09-10T08:28:35.566574+0000","last_active":"2024-09-10T08:28:45.603819+0000","last_peered":"2024-09-10T08:28:45.603819+0000","last_clean":"2024-09-10T08:28:45.603819+0000","last_became_active":"2024-09-10T08:28:35.566205+0000","last_became_peered":"2024-09-10T08:28:35.566205+0000","last_unstale":"2024-09-10T08:28:45.603819+0000","last_undegraded":"2024-09-10T08:28:45.603819+0000","last_fullsized":"2024-09-10T08:28:45.603819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:49.876773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.632473+0000","last_change":"2024-09-10T08:28:47.628051+0000","last_active":"2024-09-10T08:28:47.632473+0000","last_peered":"2024-09-10T08:28:47.632473+0000","last_clean":"2024-09-10T08:28:47.632473+0000","last_became_active":"2024-09-10T08:28:47.627747+0000","last_became_peered":"2024-09-10T08:28:47.627747+0000","last_unstale":"2024-09-10T08:28:47.632473+0000","last_undegraded":"2024-09-10T08:28:47.632473+0000","last_fullsized":"2024-09-10T08:28:47.632473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:38.999743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.618654+0000","last_change":"2024-09-10T08:28:35.565023+0000","last_active":"2024-09-10T08:28:47.618654+0000","last_peered":"2024-09-10T08:28:47.618654+0000","last_clean":"2024-09-10T08:28:47.618654+0000","last_became_active":"2024-09-10T08:28:35.564747+0000","last_became_peered":"2024-09-10T08:28:35.564747+0000","last_unstale":"2024-09-10T08:28:47.618654+0000","last_undegraded":"2024-09-10T08:28:47.618654+0000","last_fullsized":"2024-09-10T08:28:47.618654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:32.419621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.619510+0000","last_change":"2024-09-10T08:28:35.570619+0000","last_active":"2024-09-10T08:28:47.619510+0000","last_peered":"2024-09-10T08:28:47.619510+0000","last_clean":"2024-09-10T08:28:47.619510+0000","last_became_active":"2024-09-10T08:28:35.570351+0000","last_became_peered":"2024-09-10T08:28:35.570351+0000","last_unstale":"2024-09-10T08:28:47.619510+0000","last_undegraded":"2024-09-10T08:28:47.619510+0000","last_fullsized":"2024-09-10T08:28:47.619510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:35.161279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604535+0000","last_change":"2024-09-10T08:28:35.577345+0000","last_active":"2024-09-10T08:28:45.604535+0000","last_peered":"2024-09-10T08:28:45.604535+0000","last_clean":"2024-09-10T08:28:45.604535+0000","last_became_active":"2024-09-10T08:28:35.576191+0000","last_became_peered":"2024-09-10T08:28:35.576191+0000","last_unstale":"2024-09-10T08:28:45.604535+0000","last_undegraded":"2024-09-10T08:28:45.604535+0000","last_fullsized":"2024-09-10T08:28:45.604535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:29.218797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604605+0000","last_change":"2024-09-10T08:28:35.575275+0000","last_active":"2024-09-10T08:28:45.604605+0000","last_peered":"2024-09-10T08:28:45.604605+0000","last_clean":"2024-09-10T08:28:45.604605+0000","last_became_active":"2024-09-10T08:28:35.575052+0000","last_became_peered":"2024-09-10T08:28:35.575052+0000","last_unstale":"2024-09-10T08:28:45.604605+0000","last_undegraded":"2024-09-10T08:28:45.604605+0000","last_fullsized":"2024-09-10T08:28:45.604605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:24.313017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.635033+0000","last_change":"2024-09-10T08:28:47.628651+0000","last_active":"2024-09-10T08:28:47.635033+0000","last_peered":"2024-09-10T08:28:47.635033+0000","last_clean":"2024-09-10T08:28:47.635033+0000","last_became_active":"2024-09-10T08:28:47.628343+0000","last_became_peered":"2024-09-10T08:28:47.628343+0000","last_unstale":"2024-09-10T08:28:47.635033+0000","last_undegraded":"2024-09-10T08:28:47.635033+0000","last_fullsized":"2024-09-10T08:28:47.635033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:07.325085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604153+0000","last_change":"2024-09-10T08:28:35.578664+0000","last_active":"2024-09-10T08:28:45.604153+0000","last_peered":"2024-09-10T08:28:45.604153+0000","last_clean":"2024-09-10T08:28:45.604153+0000","last_became_active":"2024-09-10T08:28:35.578384+0000","last_became_peered":"2024-09-10T08:28:35.578384+0000","last_unstale":"2024-09-10T08:28:45.604153+0000","last_undegraded":"2024-09-10T08:28:45.604153+0000","last_fullsized":"2024-09-10T08:28:45.604153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:44.278718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604028+0000","last_change":"2024-09-10T08:28:35.578978+0000","last_active":"2024-09-10T08:28:45.604028+0000","last_peered":"2024-09-10T08:28:45.604028+0000","last_clean":"2024-09-10T08:28:45.604028+0000","last_became_active":"2024-09-10T08:28:35.578475+0000","last_became_peered":"2024-09-10T08:28:35.578475+0000","last_unstale":"2024-09-10T08:28:45.604028+0000","last_undegraded":"2024-09-10T08:28:45.604028+0000","last_fullsized":"2024-09-10T08:28:45.604028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:08.520314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604389+0000","last_change":"2024-09-10T08:28:35.572112+0000","last_active":"2024-09-10T08:28:45.604389+0000","last_peered":"2024-09-10T08:28:45.604389+0000","last_clean":"2024-09-10T08:28:45.604389+0000","last_became_active":"2024-09-10T08:28:35.571803+0000","last_became_peered":"2024-09-10T08:28:35.571803+0000","last_unstale":"2024-09-10T08:28:45.604389+0000","last_undegraded":"2024-09-10T08:28:45.604389+0000","last_fullsized":"2024-09-10T08:28:45.604389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:29.969987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.603946+0000","last_change":"2024-09-10T08:28:35.578961+0000","last_active":"2024-09-10T08:28:45.603946+0000","last_peered":"2024-09-10T08:28:45.603946+0000","last_clean":"2024-09-10T08:28:45.603946+0000","last_became_active":"2024-09-10T08:28:35.578680+0000","last_became_peered":"2024-09-10T08:28:35.578680+0000","last_unstale":"2024-09-10T08:28:45.603946+0000","last_undegraded":"2024-09-10T08:28:45.603946+0000","last_fullsized":"2024-09-10T08:28:45.603946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:53.737412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.630179+0000","last_change":"2024-09-10T08:28:47.624859+0000","last_active":"2024-09-10T08:28:47.630179+0000","last_peered":"2024-09-10T08:28:47.630179+0000","last_clean":"2024-09-10T08:28:47.630179+0000","last_became_active":"2024-09-10T08:28:47.624585+0000","last_became_peered":"2024-09-10T08:28:47.624585+0000","last_unstale":"2024-09-10T08:28:47.630179+0000","last_undegraded":"2024-09-10T08:28:47.630179+0000","last_fullsized":"2024-09-10T08:28:47.630179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:07:09.719664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T08:28:36.619390+0000","last_change":"2024-09-10T08:28:35.573918+0000","last_active":"2024-09-10T08:28:36.619390+0000","last_peered":"2024-09-10T08:28:36.619390+0000","last_clean":"2024-09-10T08:28:36.619390+0000","last_became_active":"2024-09-10T08:28:35.573646+0000","last_became_peered":"2024-09-10T08:28:35.573646+0000","last_unstale":"2024-09-10T08:28:36.619390+0000","last_undegraded":"2024-09-10T08:28:36.619390+0000","last_fullsized":"2024-09-10T08:28:36.619390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:24.295630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.606597+0000","last_change":"2024-09-10T08:28:35.578197+0000","last_active":"2024-09-10T08:28:45.606597+0000","last_peered":"2024-09-10T08:28:45.606597+0000","last_clean":"2024-09-10T08:28:45.606597+0000","last_became_active":"2024-09-10T08:28:35.577852+0000","last_became_peered":"2024-09-10T08:28:35.577852+0000","last_unstale":"2024-09-10T08:28:45.606597+0000","last_undegraded":"2024-09-10T08:28:45.606597+0000","last_fullsized":"2024-09-10T08:28:45.606597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:44.348299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:28:46.598195+0000","last_change":"2024-09-10T08:28:46.598195+0000","last_active":"2024-09-10T08:28:46.598195+0000","last_peered":"2024-09-10T08:28:46.598195+0000","last_clean":"2024-09-10T08:28:46.598195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:46.598195+0000","last_undegraded":"2024-09-10T08:28:46.598195+0000","last_fullsized":"2024-09-10T08:28:46.598195+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:45.604447+0000","last_change":"2024-09-10T08:28:35.571065+0000","last_active":"2024-09-10T08:28:45.604447+0000","last_peered":"2024-09-10T08:28:45.604447+0000","last_clean":"2024-09-10T08:28:45.604447+0000","last_became_active":"2024-09-10T08:28:35.570749+0000","last_became_peered":"2024-09-10T08:28:35.570749+0000","last_unstale":"2024-09-10T08:28:45.604447+0000","last_undegraded":"2024-09-10T08:28:45.604447+0000","last_fullsized":"2024-09-10T08:28:45.604447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:04.628661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":2},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":54,"acting":54,"num_store_stats":6},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":806912,"data_stored":663617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":72793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":80918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":663673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":96195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":86390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:28:52.256 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-09-10T08:28:52.256 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.256 INFO:tasks.ceph.ceph_manager.ceph:PG 4.19 is not active+clean 2024-09-10T08:28:52.256 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.603322+0000', 'last_change': '2024-09-10T08:28:45.603322+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.603322+0000', 'last_undegraded': '2024-09-10T08:28:45.603322+0000', 'last_fullsized': '2024-09-10T08:28:45.603322+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:28:52.256 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-09-10T08:28:52.256 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.257 INFO:tasks.ceph.ceph_manager.ceph:PG 4.18 is not active+clean 2024-09-10T08:28:52.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.600401+0000', 'last_change': '2024-09-10T08:28:45.600401+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.600401+0000', 'last_undegraded': '2024-09-10T08:28:45.600401+0000', 'last_fullsized': '2024-09-10T08:28:45.600401+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:28:52.257 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-09-10T08:28:52.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.257 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1b is not active+clean 2024-09-10T08:28:52.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.602052+0000', 'last_change': '2024-09-10T08:28:45.602052+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.602052+0000', 'last_undegraded': '2024-09-10T08:28:45.602052+0000', 'last_fullsized': '2024-09-10T08:28:45.602052+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:28:52.257 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1b is not active+clean 2024-09-10T08:28:52.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.257 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1a is not active+clean 2024-09-10T08:28:52.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.601642+0000', 'last_change': '2024-09-10T08:28:45.601642+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.601642+0000', 'last_undegraded': '2024-09-10T08:28:45.601642+0000', 'last_fullsized': '2024-09-10T08:28:45.601642+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:28:52.258 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-09-10T08:28:52.258 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.258 INFO:tasks.ceph.ceph_manager.ceph:PG 4.d is not active+clean 2024-09-10T08:28:52.258 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.600794+0000', 'last_change': '2024-09-10T08:28:45.600794+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.600794+0000', 'last_undegraded': '2024-09-10T08:28:45.600794+0000', 'last_fullsized': '2024-09-10T08:28:45.600794+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:28:52.258 INFO:tasks.ceph.ceph_manager.ceph:PG 4.c is not active+clean 2024-09-10T08:28:52.258 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.600502+0000', 'last_change': '2024-09-10T08:28:45.600502+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.600502+0000', 'last_undegraded': '2024-09-10T08:28:45.600502+0000', 'last_fullsized': '2024-09-10T08:28:45.600502+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:28:52.258 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-09-10T08:28:52.258 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.258 INFO:tasks.ceph.ceph_manager.ceph:PG 4.f is not active+clean 2024-09-10T08:28:52.259 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.605451+0000', 'last_change': '2024-09-10T08:28:45.605451+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.605451+0000', 'last_undegraded': '2024-09-10T08:28:45.605451+0000', 'last_fullsized': '2024-09-10T08:28:45.605451+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T08:28:52.259 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-09-10T08:28:52.259 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.259 INFO:tasks.ceph.ceph_manager.ceph:PG 4.e is not active+clean 2024-09-10T08:28:52.259 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.600452+0000', 'last_change': '2024-09-10T08:28:45.600452+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.600452+0000', 'last_undegraded': '2024-09-10T08:28:45.600452+0000', 'last_fullsized': '2024-09-10T08:28:45.600452+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:28:52.259 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-09-10T08:28:52.259 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.259 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1 is not active+clean 2024-09-10T08:28:52.259 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.600402+0000', 'last_change': '2024-09-10T08:28:45.600402+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.600402+0000', 'last_undegraded': '2024-09-10T08:28:45.600402+0000', 'last_fullsized': '2024-09-10T08:28:45.600402+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:28:52.259 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-09-10T08:28:52.260 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.260 INFO:tasks.ceph.ceph_manager.ceph:PG 4.0 is not active+clean 2024-09-10T08:28:52.260 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.603287+0000', 'last_change': '2024-09-10T08:28:45.603287+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.603287+0000', 'last_undegraded': '2024-09-10T08:28:45.603287+0000', 'last_fullsized': '2024-09-10T08:28:45.603287+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:28:52.260 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3 is not active+clean 2024-09-10T08:28:52.260 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:45.593387+0000', 'last_change': '2024-09-10T08:28:45.593387+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.593387+0000', 'last_undegraded': '2024-09-10T08:28:45.593387+0000', 'last_fullsized': '2024-09-10T08:28:45.593387+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.260 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-09-10T08:28:52.260 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.260 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2 is not active+clean 2024-09-10T08:28:52.260 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.604756+0000', 'last_change': '2024-09-10T08:28:45.604756+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.604756+0000', 'last_undegraded': '2024-09-10T08:28:45.604756+0000', 'last_fullsized': '2024-09-10T08:28:45.604756+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T08:28:52.260 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-09-10T08:28:52.260 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.260 INFO:tasks.ceph.ceph_manager.ceph:PG 4.4 is not active+clean 2024-09-10T08:28:52.261 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.605137+0000', 'last_change': '2024-09-10T08:28:45.605137+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.605137+0000', 'last_undegraded': '2024-09-10T08:28:45.605137+0000', 'last_fullsized': '2024-09-10T08:28:45.605137+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T08:28:52.261 INFO:tasks.ceph.ceph_manager.ceph:PG 4.7 is not active+clean 2024-09-10T08:28:52.261 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.604789+0000', 'last_change': '2024-09-10T08:28:45.604789+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.604789+0000', 'last_undegraded': '2024-09-10T08:28:45.604789+0000', 'last_fullsized': '2024-09-10T08:28:45.604789+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T08:28:52.261 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-09-10T08:28:52.261 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.261 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-09-10T08:28:52.261 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:45.593387+0000', 'last_change': '2024-09-10T08:28:45.593387+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.593387+0000', 'last_undegraded': '2024-09-10T08:28:45.593387+0000', 'last_fullsized': '2024-09-10T08:28:45.593387+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.261 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-09-10T08:28:52.261 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.261 INFO:tasks.ceph.ceph_manager.ceph:PG 4.b is not active+clean 2024-09-10T08:28:52.261 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:45.593387+0000', 'last_change': '2024-09-10T08:28:45.593387+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.593387+0000', 'last_undegraded': '2024-09-10T08:28:45.593387+0000', 'last_fullsized': '2024-09-10T08:28:45.593387+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.262 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-09-10T08:28:52.262 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.262 INFO:tasks.ceph.ceph_manager.ceph:PG 4.8 is not active+clean 2024-09-10T08:28:52.262 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.601907+0000', 'last_change': '2024-09-10T08:28:45.601907+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.601907+0000', 'last_undegraded': '2024-09-10T08:28:45.601907+0000', 'last_fullsized': '2024-09-10T08:28:45.601907+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:28:52.262 INFO:tasks.ceph.ceph_manager.ceph:PG 4.9 is not active+clean 2024-09-10T08:28:52.262 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.600953+0000', 'last_change': '2024-09-10T08:28:45.600953+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.600953+0000', 'last_undegraded': '2024-09-10T08:28:45.600953+0000', 'last_fullsized': '2024-09-10T08:28:45.600953+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:28:52.262 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-09-10T08:28:52.262 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.262 INFO:tasks.ceph.ceph_manager.ceph:PG 4.16 is not active+clean 2024-09-10T08:28:52.262 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:45.593387+0000', 'last_change': '2024-09-10T08:28:45.593387+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.593387+0000', 'last_undegraded': '2024-09-10T08:28:45.593387+0000', 'last_fullsized': '2024-09-10T08:28:45.593387+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.262 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-09-10T08:28:52.262 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.263 INFO:tasks.ceph.ceph_manager.ceph:PG 4.17 is not active+clean 2024-09-10T08:28:52.263 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.604116+0000', 'last_change': '2024-09-10T08:28:45.604116+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.604116+0000', 'last_undegraded': '2024-09-10T08:28:45.604116+0000', 'last_fullsized': '2024-09-10T08:28:45.604116+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:28:52.263 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-09-10T08:28:52.263 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.263 INFO:tasks.ceph.ceph_manager.ceph:PG 4.14 is not active+clean 2024-09-10T08:28:52.263 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.603603+0000', 'last_change': '2024-09-10T08:28:45.603603+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.603603+0000', 'last_undegraded': '2024-09-10T08:28:45.603603+0000', 'last_fullsized': '2024-09-10T08:28:45.603603+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:28:52.263 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-09-10T08:28:52.263 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.264 INFO:tasks.ceph.ceph_manager.ceph:PG 4.15 is not active+clean 2024-09-10T08:28:52.264 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.600401+0000', 'last_change': '2024-09-10T08:28:45.600401+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.600401+0000', 'last_undegraded': '2024-09-10T08:28:45.600401+0000', 'last_fullsized': '2024-09-10T08:28:45.600401+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:28:52.264 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-09-10T08:28:52.264 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.264 INFO:tasks.ceph.ceph_manager.ceph:PG 4.12 is not active+clean 2024-09-10T08:28:52.264 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.605252+0000', 'last_change': '2024-09-10T08:28:45.605252+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.605252+0000', 'last_undegraded': '2024-09-10T08:28:45.605252+0000', 'last_fullsized': '2024-09-10T08:28:45.605252+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T08:28:52.264 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-09-10T08:28:52.264 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.264 INFO:tasks.ceph.ceph_manager.ceph:PG 4.13 is not active+clean 2024-09-10T08:28:52.264 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.601549+0000', 'last_change': '2024-09-10T08:28:45.601549+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.601549+0000', 'last_undegraded': '2024-09-10T08:28:45.601549+0000', 'last_fullsized': '2024-09-10T08:28:45.601549+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:28:52.264 INFO:tasks.ceph.ceph_manager.ceph:PG 4.10 is not active+clean 2024-09-10T08:28:52.265 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.604073+0000', 'last_change': '2024-09-10T08:28:45.604073+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.604073+0000', 'last_undegraded': '2024-09-10T08:28:45.604073+0000', 'last_fullsized': '2024-09-10T08:28:45.604073+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:28:52.265 INFO:tasks.ceph.ceph_manager.ceph:PG 5.10 is not active+clean 2024-09-10T08:28:52.265 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.265 INFO:tasks.ceph.ceph_manager.ceph:PG 4.11 is not active+clean 2024-09-10T08:28:52.265 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.603885+0000', 'last_change': '2024-09-10T08:28:45.603885+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.603885+0000', 'last_undegraded': '2024-09-10T08:28:45.603885+0000', 'last_fullsized': '2024-09-10T08:28:45.603885+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:28:52.265 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1e is not active+clean 2024-09-10T08:28:52.265 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:45.593387+0000', 'last_change': '2024-09-10T08:28:45.593387+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.593387+0000', 'last_undegraded': '2024-09-10T08:28:45.593387+0000', 'last_fullsized': '2024-09-10T08:28:45.593387+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.265 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-09-10T08:28:52.265 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.265 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-09-10T08:28:52.265 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.266 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1c is not active+clean 2024-09-10T08:28:52.266 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.266 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1d is not active+clean 2024-09-10T08:28:52.266 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 22, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:45.603493+0000', 'last_change': '2024-09-10T08:28:45.603493+0000', 'last_active': '2024-09-10T08:28:45.593387+0000', 'last_peered': '2024-09-10T08:28:45.593387+0000', 'last_clean': '2024-09-10T08:28:45.593387+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:45.603493+0000', 'last_undegraded': '2024-09-10T08:28:45.603493+0000', 'last_fullsized': '2024-09-10T08:28:45.603493+0000', 'mapping_epoch': 22, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 22, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:45.593387+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:28:52.266 INFO:tasks.ceph.ceph_manager.ceph:PG 5.26 is not active+clean 2024-09-10T08:28:52.266 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.266 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-09-10T08:28:52.266 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.266 INFO:tasks.ceph.ceph_manager.ceph:PG 5.24 is not active+clean 2024-09-10T08:28:52.266 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.267 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-09-10T08:28:52.267 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.267 INFO:tasks.ceph.ceph_manager.ceph:PG 5.22 is not active+clean 2024-09-10T08:28:52.267 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.267 INFO:tasks.ceph.ceph_manager.ceph:PG 5.23 is not active+clean 2024-09-10T08:28:52.267 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.267 INFO:tasks.ceph.ceph_manager.ceph:PG 5.20 is not active+clean 2024-09-10T08:28:52.267 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.267 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2e is not active+clean 2024-09-10T08:28:52.267 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.268 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2f is not active+clean 2024-09-10T08:28:52.268 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.268 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2d is not active+clean 2024-09-10T08:28:52.268 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.268 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2a is not active+clean 2024-09-10T08:28:52.268 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.268 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2b is not active+clean 2024-09-10T08:28:52.268 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.268 INFO:tasks.ceph.ceph_manager.ceph:PG 5.28 is not active+clean 2024-09-10T08:28:52.268 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.269 INFO:tasks.ceph.ceph_manager.ceph:PG 5.29 is not active+clean 2024-09-10T08:28:52.269 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.269 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-09-10T08:28:52.269 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.269 INFO:tasks.ceph.ceph_manager.ceph:PG 5.37 is not active+clean 2024-09-10T08:28:52.269 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.269 INFO:tasks.ceph.ceph_manager.ceph:PG 5.34 is not active+clean 2024-09-10T08:28:52.269 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.269 INFO:tasks.ceph.ceph_manager.ceph:PG 5.35 is not active+clean 2024-09-10T08:28:52.269 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.269 INFO:tasks.ceph.ceph_manager.ceph:PG 5.32 is not active+clean 2024-09-10T08:28:52.269 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.270 INFO:tasks.ceph.ceph_manager.ceph:PG 5.30 is not active+clean 2024-09-10T08:28:52.270 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.270 INFO:tasks.ceph.ceph_manager.ceph:PG 5.31 is not active+clean 2024-09-10T08:28:52.270 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.270 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3e is not active+clean 2024-09-10T08:28:52.270 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.270 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-09-10T08:28:52.270 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.270 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3d is not active+clean 2024-09-10T08:28:52.270 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.270 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3a is not active+clean 2024-09-10T08:28:52.270 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.271 INFO:tasks.ceph.ceph_manager.ceph:PG 5.38 is not active+clean 2024-09-10T08:28:52.271 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.271 INFO:tasks.ceph.ceph_manager.ceph:PG 5.39 is not active+clean 2024-09-10T08:28:52.271 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-10T08:28:46.598195+0000', 'last_change': '2024-09-10T08:28:46.598195+0000', 'last_active': '2024-09-10T08:28:46.598195+0000', 'last_peered': '2024-09-10T08:28:46.598195+0000', 'last_clean': '2024-09-10T08:28:46.598195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:46.598195+0000', 'last_undegraded': '2024-09-10T08:28:46.598195+0000', 'last_fullsized': '2024-09-10T08:28:46.598195+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:46.598195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-10T08:28:52.271 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:28:52.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.386+0000 7fcaccbd8640 1 Processor -- start 2024-09-10T08:28:52.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.386+0000 7fcaccbd8640 1 -- start start 2024-09-10T08:28:52.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.387+0000 7fcaccbd8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcac8072ec0 0x7fcac8153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:52.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.387+0000 7fcaccbd8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcac80c4ac0 0x7fcac8070040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:52.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.387+0000 7fcaccbd8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcac80afc60 0x7fcac8151380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:52.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.387+0000 7fcaccbd8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fcac806efa0 con 0x7fcac8072ec0 2024-09-10T08:28:52.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.387+0000 7fcaccbd8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fcac806f280 con 0x7fcac80c4ac0 2024-09-10T08:28:52.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.387+0000 7fcaccbd8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcac806f560 con 0x7fcac80afc60 2024-09-10T08:28:52.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.387+0000 7fcac659c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcac8072ec0 0x7fcac8153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:52.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.387+0000 7fcac659c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcac8072ec0 0x7fcac8153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57426/0 (socket says 172.21.15.103:57426) 2024-09-10T08:28:52.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.387+0000 7fcac659c640 1 -- 172.21.15.103:0/3900106592 learned_addr learned my addr 172.21.15.103:0/3900106592 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:52.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.388+0000 7fcac6d9d640 1 --2- 172.21.15.103:0/3900106592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcac80afc60 0x7fcac8151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:52.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.388+0000 7fcac659c640 1 -- 172.21.15.103:0/3900106592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcac80afc60 msgr2=0x7fcac8151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:52.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.388+0000 7fcac5d9b640 1 --2- 172.21.15.103:0/3900106592 >> v2:172.21.15.154:3300/0 conn(0x7fcac80c4ac0 0x7fcac8070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:52.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.388+0000 7fcac659c640 1 --2- 172.21.15.103:0/3900106592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcac80afc60 0x7fcac8151380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.388+0000 7fcac659c640 1 -- 172.21.15.103:0/3900106592 >> v2:172.21.15.154:3300/0 conn(0x7fcac80c4ac0 msgr2=0x7fcac8070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:52.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.388+0000 7fcac659c640 1 --2- 172.21.15.103:0/3900106592 >> v2:172.21.15.154:3300/0 conn(0x7fcac80c4ac0 0x7fcac8070040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.388+0000 7fcac659c640 1 -- 172.21.15.103:0/3900106592 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac806f840 con 0x7fcac8072ec0 2024-09-10T08:28:52.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.388+0000 7fcac6d9d640 1 --2- 172.21.15.103:0/3900106592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcac80afc60 0x7fcac8151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:52.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.388+0000 7fcac5d9b640 1 --2- 172.21.15.103:0/3900106592 >> v2:172.21.15.154:3300/0 conn(0x7fcac80c4ac0 0x7fcac8070040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:52.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.388+0000 7fcac659c640 1 --2- 172.21.15.103:0/3900106592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcac8072ec0 0x7fcac8153ff0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcac8074760 tx=0x7fcac002a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475d16bc438c1624 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:52.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.389+0000 7fcac559a640 1 -- 172.21.15.103:0/3900106592 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac0036070 con 0x7fcac8072ec0 2024-09-10T08:28:52.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.389+0000 7fcac559a640 1 -- 172.21.15.103:0/3900106592 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcac0031600 con 0x7fcac8072ec0 2024-09-10T08:28:52.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.389+0000 7fcac559a640 1 -- 172.21.15.103:0/3900106592 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac00319d0 con 0x7fcac8072ec0 2024-09-10T08:28:52.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.389+0000 7fcaccbd8640 1 -- 172.21.15.103:0/3900106592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcac8072ec0 msgr2=0x7fcac8153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:52.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.389+0000 7fcaccbd8640 1 --2- 172.21.15.103:0/3900106592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcac8072ec0 0x7fcac8153ff0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcac8074760 tx=0x7fcac002a570 comp rx=0 tx=0).stop 2024-09-10T08:28:52.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.389+0000 7fcaccbd8640 1 -- 172.21.15.103:0/3900106592 shutdown_connections 2024-09-10T08:28:52.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.389+0000 7fcaccbd8640 1 --2- 172.21.15.103:0/3900106592 >> v2:172.21.15.154:3300/0 conn(0x7fcac80c4ac0 0x7fcac8070040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.389+0000 7fcaccbd8640 1 --2- 172.21.15.103:0/3900106592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcac80afc60 0x7fcac8151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.389+0000 7fcaccbd8640 1 --2- 172.21.15.103:0/3900106592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcac8072ec0 0x7fcac8153ff0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.389+0000 7fcaccbd8640 1 -- 172.21.15.103:0/3900106592 >> 172.21.15.103:0/3900106592 conn(0x7fcac80c9d80 msgr2=0x7fcac80ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:52.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.389+0000 7fcaccbd8640 1 -- 172.21.15.103:0/3900106592 shutdown_connections 2024-09-10T08:28:52.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.389+0000 7fcaccbd8640 1 -- 172.21.15.103:0/3900106592 wait complete. 2024-09-10T08:28:52.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.390+0000 7fcaccbd8640 1 Processor -- start 2024-09-10T08:28:52.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.391+0000 7fcaccbd8640 1 -- start start 2024-09-10T08:28:52.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.391+0000 7fcaccbd8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcac8072ec0 0x7fcac81494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:52.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.391+0000 7fcaccbd8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcac80afc60 0x7fcac8157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:52.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.391+0000 7fcaccbd8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcac80c4ac0 0x7fcac8158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:52.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.391+0000 7fcaccbd8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcac80732a0 con 0x7fcac80afc60 2024-09-10T08:28:52.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.391+0000 7fcaccbd8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcac80c47f0 con 0x7fcac8072ec0 2024-09-10T08:28:52.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.391+0000 7fcaccbd8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcac8073420 con 0x7fcac80c4ac0 2024-09-10T08:28:52.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.391+0000 7fcac5d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcac80afc60 0x7fcac8157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:52.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.391+0000 7fcac5d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcac80afc60 0x7fcac8157d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57438/0 (socket says 172.21.15.103:57438) 2024-09-10T08:28:52.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.391+0000 7fcac5d9b640 1 -- 172.21.15.103:0/233118811 learned_addr learned my addr 172.21.15.103:0/233118811 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:52.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.391+0000 7fcac6d9d640 1 --2- 172.21.15.103:0/233118811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcac80c4ac0 0x7fcac8158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:52.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.392+0000 7fcac659c640 1 --2- 172.21.15.103:0/233118811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcac8072ec0 0x7fcac81494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:52.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.392+0000 7fcac5d9b640 1 -- 172.21.15.103:0/233118811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcac80c4ac0 msgr2=0x7fcac8158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:52.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.392+0000 7fcac5d9b640 1 --2- 172.21.15.103:0/233118811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcac80c4ac0 0x7fcac8158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.392+0000 7fcac5d9b640 1 -- 172.21.15.103:0/233118811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcac8072ec0 msgr2=0x7fcac81494d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:52.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.392+0000 7fcac5d9b640 1 --2- 172.21.15.103:0/233118811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcac8072ec0 0x7fcac81494d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.392+0000 7fcac5d9b640 1 -- 172.21.15.103:0/233118811 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac8149f70 con 0x7fcac80afc60 2024-09-10T08:28:52.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.392+0000 7fcac6d9d640 1 --2- 172.21.15.103:0/233118811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcac80c4ac0 0x7fcac8158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:52.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.392+0000 7fcac5d9b640 1 --2- 172.21.15.103:0/233118811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcac80afc60 0x7fcac8157d10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcab000c820 tx=0x7fcab000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:52.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.392+0000 7fcabeffd640 1 -- 172.21.15.103:0/233118811 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab0015070 con 0x7fcac80afc60 2024-09-10T08:28:52.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.392+0000 7fcabeffd640 1 -- 172.21.15.103:0/233118811 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcab0007a30 con 0x7fcac80afc60 2024-09-10T08:28:52.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.392+0000 7fcaccbd8640 1 -- 172.21.15.103:0/233118811 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcac814a250 con 0x7fcac80afc60 2024-09-10T08:28:52.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.392+0000 7fcabeffd640 1 -- 172.21.15.103:0/233118811 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab0007e00 con 0x7fcac80afc60 2024-09-10T08:28:52.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.392+0000 7fcaccbd8640 1 -- 172.21.15.103:0/233118811 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcac80af3f0 con 0x7fcac80afc60 2024-09-10T08:28:52.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.393+0000 7fcaccbd8640 1 -- 172.21.15.103:0/233118811 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcac8153ff0 con 0x7fcac80afc60 2024-09-10T08:28:52.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.393+0000 7fcabeffd640 1 -- 172.21.15.103:0/233118811 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcab0018070 con 0x7fcac80afc60 2024-09-10T08:28:52.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.394+0000 7fcabeffd640 1 --2- 172.21.15.103:0/233118811 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcaa806be60 0x7fcaa806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:52.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.394+0000 7fcac659c640 1 --2- 172.21.15.103:0/233118811 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcaa806be60 0x7fcaa806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:52.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.394+0000 7fcabeffd640 1 -- 172.21.15.103:0/233118811 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fcab008b0a0 con 0x7fcac80afc60 2024-09-10T08:28:52.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.394+0000 7fcac659c640 1 --2- 172.21.15.103:0/233118811 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcaa806be60 0x7fcaa806e320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcac0033000 tx=0x7fcac0009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:52.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.398+0000 7fcabeffd640 1 -- 172.21.15.103:0/233118811 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcab00597b0 con 0x7fcac80afc60 2024-09-10T08:28:52.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.624+0000 7fcaccbd8640 1 -- 172.21.15.103:0/233118811 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fcac80c5ea0 con 0x7fcac80afc60 2024-09-10T08:28:52.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.624+0000 7fcabeffd640 1 -- 172.21.15.103:0/233118811 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1318 (secure 0 0 0) 0x7fcab00590b0 con 0x7fcac80afc60 2024-09-10T08:28:52.625 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:52.625 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":39,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":25,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956905,"num_in_osds":8,"osd_in_since":1725956894,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":114},{"state_name":"unknown","count":56},{"state_name":"creating+peering","count":23}],"num_pgs":193,"num_pools":5,"num_objects":27,"data_bytes":593360,"bytes_used":224440320,"bytes_avail":772869672960,"bytes_total":773094113280,"unknown_pgs_ratio":0.29015544056892395,"inactive_pgs_ratio":0.11917098611593246,"write_bytes_sec":197,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":11,"btime":"2024-09-10T08:28:50:632324+0000","id":1,"up":1,"in":1,"max":1,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4281},{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4284}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-10T08:28:12.655958+0000","services":{}},"progress_events":{}} 2024-09-10T08:28:52.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.626+0000 7fcaccbd8640 1 -- 172.21.15.103:0/233118811 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcaa806be60 msgr2=0x7fcaa806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:52.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.626+0000 7fcaccbd8640 1 --2- 172.21.15.103:0/233118811 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcaa806be60 0x7fcaa806e320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcac0033000 tx=0x7fcac0009000 comp rx=0 tx=0).stop 2024-09-10T08:28:52.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.626+0000 7fcaccbd8640 1 -- 172.21.15.103:0/233118811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcac80afc60 msgr2=0x7fcac8157d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:52.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.626+0000 7fcaccbd8640 1 --2- 172.21.15.103:0/233118811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcac80afc60 0x7fcac8157d10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcab000c820 tx=0x7fcab000cc20 comp rx=0 tx=0).stop 2024-09-10T08:28:52.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.626+0000 7fcaccbd8640 1 -- 172.21.15.103:0/233118811 shutdown_connections 2024-09-10T08:28:52.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.626+0000 7fcaccbd8640 1 --2- 172.21.15.103:0/233118811 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcaa806be60 0x7fcaa806e320 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.626+0000 7fcaccbd8640 1 --2- 172.21.15.103:0/233118811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcac80c4ac0 0x7fcac8158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.626+0000 7fcaccbd8640 1 --2- 172.21.15.103:0/233118811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcac80afc60 0x7fcac8157d10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.626+0000 7fcaccbd8640 1 --2- 172.21.15.103:0/233118811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcac8072ec0 0x7fcac81494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.626+0000 7fcaccbd8640 1 -- 172.21.15.103:0/233118811 >> 172.21.15.103:0/233118811 conn(0x7fcac80c9d80 msgr2=0x7fcac8151bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:52.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.626+0000 7fcaccbd8640 1 -- 172.21.15.103:0/233118811 shutdown_connections 2024-09-10T08:28:52.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.626+0000 7fcaccbd8640 1 -- 172.21.15.103:0/233118811 wait complete. 2024-09-10T08:28:52.637 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T08:28:52.638 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:28:52.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.736+0000 7fd4dd58d640 1 Processor -- start 2024-09-10T08:28:52.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.736+0000 7fd4dd58d640 1 -- start start 2024-09-10T08:28:52.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.737+0000 7fd4dd58d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd4d80ca390 0x7fd4d8161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:52.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.737+0000 7fd4dd58d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4d815a7c0 con 0x7fd4d8150480 2024-09-10T08:28:52.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.737+0000 7fd4dd58d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4d8159a00 con 0x7fd4d806c650 2024-09-10T08:28:52.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.737+0000 7fd4dd58d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fd4d806c240 con 0x7fd4d80ca390 2024-09-10T08:28:52.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.737+0000 7fd4d77fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd4d80ca390 0x7fd4d8161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:52.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.737+0000 7fd4d6ffd640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd4d8150480 0x7fd4d80c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50118/0 (socket says 172.21.15.103:50118) 2024-09-10T08:28:52.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.737+0000 7fd4d6ffd640 1 -- 172.21.15.103:0/793217167 learned_addr learned my addr 172.21.15.103:0/793217167 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:52.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.737+0000 7fd4d77fe640 1 -- 172.21.15.103:0/793217167 >> v1:172.21.15.154:6789/0 conn(0x7fd4d806c650 legacy=0x7fd4d80c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:52.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.737+0000 7fd4d77fe640 1 -- 172.21.15.103:0/793217167 >> v1:172.21.15.103:6789/0 conn(0x7fd4d8150480 legacy=0x7fd4d80c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:52.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.737+0000 7fd4d5ffb640 1 -- 172.21.15.103:0/793217167 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4261702576 0 0) 0x7fd4d815a7c0 con 0x7fd4d8150480 2024-09-10T08:28:52.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.737+0000 7fd4d77fe640 1 -- 172.21.15.103:0/793217167 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d8159ce0 con 0x7fd4d80ca390 2024-09-10T08:28:52.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.738+0000 7fd4d77fe640 1 --2- 172.21.15.103:0/793217167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4d80ca390 0x7fd4d8161c00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009d90 tx=0x7fd4d002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af66fb8c6690852 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:52.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.738+0000 7fd4d5ffb640 1 -- 172.21.15.103:0/793217167 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0007740 con 0x7fd4d80ca390 2024-09-10T08:28:52.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.738+0000 7fd4d5ffb640 1 -- 172.21.15.103:0/793217167 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d00078e0 con 0x7fd4d80ca390 2024-09-10T08:28:52.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.738+0000 7fd4d5ffb640 1 -- 172.21.15.103:0/793217167 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0007cb0 con 0x7fd4d80ca390 2024-09-10T08:28:52.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.738+0000 7fd4dd58d640 1 -- 172.21.15.103:0/793217167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4d80ca390 msgr2=0x7fd4d8161c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:52.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.738+0000 7fd4dd58d640 1 --2- 172.21.15.103:0/793217167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4d80ca390 0x7fd4d8161c00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009d90 tx=0x7fd4d002a6f0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.738+0000 7fd4dd58d640 1 -- 172.21.15.103:0/793217167 shutdown_connections 2024-09-10T08:28:52.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.738+0000 7fd4dd58d640 1 --2- 172.21.15.103:0/793217167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4d80ca390 0x7fd4d8161c00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.738+0000 7fd4dd58d640 1 -- 172.21.15.103:0/793217167 >> 172.21.15.103:0/793217167 conn(0x7fd4d8068030 msgr2=0x7fd4d8073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:52.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.738+0000 7fd4dd58d640 1 -- 172.21.15.103:0/793217167 shutdown_connections 2024-09-10T08:28:52.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.738+0000 7fd4dd58d640 1 -- 172.21.15.103:0/793217167 wait complete. 2024-09-10T08:28:52.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.740+0000 7fd4dd58d640 1 Processor -- start 2024-09-10T08:28:52.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.740+0000 7fd4dd58d640 1 -- start start 2024-09-10T08:28:52.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.740+0000 7fd4dd58d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d806c650 0x7fd4d814f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:52.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.740+0000 7fd4dd58d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4d80ca390 0x7fd4d8152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:52.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.740+0000 7fd4dd58d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4d8150480 0x7fd4d81e2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:52.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.740+0000 7fd4dd58d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d806d270 con 0x7fd4d80ca390 2024-09-10T08:28:52.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.740+0000 7fd4dd58d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d815a330 con 0x7fd4d806c650 2024-09-10T08:28:52.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.740+0000 7fd4dd58d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd4d80c81a0 con 0x7fd4d8150480 2024-09-10T08:28:52.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.740+0000 7fd4d67fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4d80ca390 0x7fd4d8152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:52.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.741+0000 7fd4d67fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4d80ca390 0x7fd4d8152510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57454/0 (socket says 172.21.15.103:57454) 2024-09-10T08:28:52.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.741+0000 7fd4d67fc640 1 -- 172.21.15.103:0/1146528332 learned_addr learned my addr 172.21.15.103:0/1146528332 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:52.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.741+0000 7fd4d77fe640 1 --2- 172.21.15.103:0/1146528332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4d8150480 0x7fd4d81e2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:52.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.741+0000 7fd4d6ffd640 1 --2- 172.21.15.103:0/1146528332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d806c650 0x7fd4d814f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:52.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.741+0000 7fd4d67fc640 1 -- 172.21.15.103:0/1146528332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4d8150480 msgr2=0x7fd4d81e2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:52.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.741+0000 7fd4d67fc640 1 --2- 172.21.15.103:0/1146528332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4d8150480 0x7fd4d81e2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.741+0000 7fd4d67fc640 1 -- 172.21.15.103:0/1146528332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d806c650 msgr2=0x7fd4d814f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:52.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.741+0000 7fd4d67fc640 1 --2- 172.21.15.103:0/1146528332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d806c650 0x7fd4d814f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.741+0000 7fd4d67fc640 1 -- 172.21.15.103:0/1146528332 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d81539d0 con 0x7fd4d80ca390 2024-09-10T08:28:52.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.741+0000 7fd4d6ffd640 1 --2- 172.21.15.103:0/1146528332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d806c650 0x7fd4d814f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:52.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.741+0000 7fd4d77fe640 1 --2- 172.21.15.103:0/1146528332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4d8150480 0x7fd4d81e2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:52.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.741+0000 7fd4d67fc640 1 --2- 172.21.15.103:0/1146528332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4d80ca390 0x7fd4d8152510 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc00c450 tx=0x7fd4cc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:52.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.741+0000 7fd4bf7fe640 1 -- 172.21.15.103:0/1146528332 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc017070 con 0x7fd4d80ca390 2024-09-10T08:28:52.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.741+0000 7fd4bf7fe640 1 -- 172.21.15.103:0/1146528332 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4cc0052d0 con 0x7fd4d80ca390 2024-09-10T08:28:52.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.741+0000 7fd4bf7fe640 1 -- 172.21.15.103:0/1146528332 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc003830 con 0x7fd4d80ca390 2024-09-10T08:28:52.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.741+0000 7fd4dd58d640 1 -- 172.21.15.103:0/1146528332 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4d814f3c0 con 0x7fd4d80ca390 2024-09-10T08:28:52.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.741+0000 7fd4dd58d640 1 -- 172.21.15.103:0/1146528332 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4d81e32c0 con 0x7fd4d80ca390 2024-09-10T08:28:52.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.742+0000 7fd4dd58d640 1 -- 172.21.15.103:0/1146528332 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4d8156270 con 0x7fd4d80ca390 2024-09-10T08:28:52.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.743+0000 7fd4bf7fe640 1 -- 172.21.15.103:0/1146528332 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd4cc01a070 con 0x7fd4d80ca390 2024-09-10T08:28:52.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.743+0000 7fd4bf7fe640 1 --2- 172.21.15.103:0/1146528332 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd4c406be30 0x7fd4c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:52.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.743+0000 7fd4d6ffd640 1 --2- 172.21.15.103:0/1146528332 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd4c406be30 0x7fd4c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:52.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.743+0000 7fd4bf7fe640 1 -- 172.21.15.103:0/1146528332 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fd4cc08a4f0 con 0x7fd4d80ca390 2024-09-10T08:28:52.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.743+0000 7fd4d6ffd640 1 --2- 172.21.15.103:0/1146528332 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd4c406be30 0x7fd4c406e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8000f60 tx=0x7fd4c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:52.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.747+0000 7fd4bf7fe640 1 -- 172.21.15.103:0/1146528332 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd4cc058c00 con 0x7fd4d80ca390 2024-09-10T08:28:52.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.911+0000 7fd4dd58d640 1 -- 172.21.15.103:0/1146528332 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd4d806c430 con 0x7fd4c406be30 2024-09-10T08:28:52.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.922+0000 7fd4bf7fe640 1 -- 172.21.15.103:0/1146528332 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490404 (secure 0 0 0) 0x7fd4d806c430 con 0x7fd4c406be30 2024-09-10T08:28:52.930 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:52.933 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T08:28:52.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.926+0000 7fd4dd58d640 1 -- 172.21.15.103:0/1146528332 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd4c406be30 msgr2=0x7fd4c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:52.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.926+0000 7fd4dd58d640 1 --2- 172.21.15.103:0/1146528332 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd4c406be30 0x7fd4c406e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8000f60 tx=0x7fd4c8009040 comp rx=0 tx=0).stop 2024-09-10T08:28:52.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.926+0000 7fd4dd58d640 1 -- 172.21.15.103:0/1146528332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4d80ca390 msgr2=0x7fd4d8152510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:52.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.926+0000 7fd4dd58d640 1 --2- 172.21.15.103:0/1146528332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4d80ca390 0x7fd4d8152510 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc00c450 tx=0x7fd4cc00c910 comp rx=0 tx=0).stop 2024-09-10T08:28:52.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.926+0000 7fd4dd58d640 1 -- 172.21.15.103:0/1146528332 shutdown_connections 2024-09-10T08:28:52.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.926+0000 7fd4dd58d640 1 --2- 172.21.15.103:0/1146528332 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd4c406be30 0x7fd4c406e2f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.926+0000 7fd4dd58d640 1 --2- 172.21.15.103:0/1146528332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4d8150480 0x7fd4d81e2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.926+0000 7fd4dd58d640 1 --2- 172.21.15.103:0/1146528332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4d80ca390 0x7fd4d8152510 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.926+0000 7fd4dd58d640 1 --2- 172.21.15.103:0/1146528332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d806c650 0x7fd4d814f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.926+0000 7fd4dd58d640 1 -- 172.21.15.103:0/1146528332 >> 172.21.15.103:0/1146528332 conn(0x7fd4d8068030 msgr2=0x7fd4d80ca8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.926+0000 7fd4dd58d640 1 -- 172.21.15.103:0/1146528332 shutdown_connections 2024-09-10T08:28:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:52.926+0000 7fd4dd58d640 1 -- 172.21.15.103:0/1146528332 wait complete. 2024-09-10T08:28:52.937 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-09-10T08:28:52.796774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":361,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219500,"kb_used_data":3264,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755220,"statfs":{"total":773094113280,"available":772869345280,"internally_reserved":0,"allocated":3342336,"data_stored":1977107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.193292"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619978+0000","last_change":"2024-09-10T08:28:47.627476+0000","last_active":"2024-09-10T08:28:48.619978+0000","last_peered":"2024-09-10T08:28:48.619978+0000","last_clean":"2024-09-10T08:28:48.619978+0000","last_became_active":"2024-09-10T08:28:47.627217+0000","last_became_peered":"2024-09-10T08:28:47.627217+0000","last_unstale":"2024-09-10T08:28:48.619978+0000","last_undegraded":"2024-09-10T08:28:48.619978+0000","last_fullsized":"2024-09-10T08:28:48.619978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:25.152836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632023+0000","last_change":"2024-09-10T08:28:34.564816+0000","last_active":"2024-09-10T08:28:48.632023+0000","last_peered":"2024-09-10T08:28:48.632023+0000","last_clean":"2024-09-10T08:28:48.632023+0000","last_became_active":"2024-09-10T08:28:34.564545+0000","last_became_peered":"2024-09-10T08:28:34.564545+0000","last_unstale":"2024-09-10T08:28:48.632023+0000","last_undegraded":"2024-09-10T08:28:48.632023+0000","last_fullsized":"2024-09-10T08:28:48.632023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:34.365104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622355+0000","last_change":"2024-09-10T08:28:35.575267+0000","last_active":"2024-09-10T08:28:48.622355+0000","last_peered":"2024-09-10T08:28:48.622355+0000","last_clean":"2024-09-10T08:28:48.622355+0000","last_became_active":"2024-09-10T08:28:35.575019+0000","last_became_peered":"2024-09-10T08:28:35.575019+0000","last_unstale":"2024-09-10T08:28:48.622355+0000","last_undegraded":"2024-09-10T08:28:48.622355+0000","last_fullsized":"2024-09-10T08:28:48.622355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:00.810645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621493+0000","last_change":"2024-09-10T08:28:46.620227+0000","last_active":"2024-09-10T08:28:48.621493+0000","last_peered":"2024-09-10T08:28:48.621493+0000","last_clean":"2024-09-10T08:28:48.621493+0000","last_became_active":"2024-09-10T08:28:46.619540+0000","last_became_peered":"2024-09-10T08:28:46.619540+0000","last_unstale":"2024-09-10T08:28:48.621493+0000","last_undegraded":"2024-09-10T08:28:48.621493+0000","last_fullsized":"2024-09-10T08:28:48.621493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:13.402155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633949+0000","last_change":"2024-09-10T08:28:47.633586+0000","last_active":"2024-09-10T08:28:48.633949+0000","last_peered":"2024-09-10T08:28:48.633949+0000","last_clean":"2024-09-10T08:28:48.633949+0000","last_became_active":"2024-09-10T08:28:47.633292+0000","last_became_peered":"2024-09-10T08:28:47.633292+0000","last_unstale":"2024-09-10T08:28:48.633949+0000","last_undegraded":"2024-09-10T08:28:48.633949+0000","last_fullsized":"2024-09-10T08:28:48.633949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:19.473028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622448+0000","last_change":"2024-09-10T08:28:34.561691+0000","last_active":"2024-09-10T08:28:48.622448+0000","last_peered":"2024-09-10T08:28:48.622448+0000","last_clean":"2024-09-10T08:28:48.622448+0000","last_became_active":"2024-09-10T08:28:34.561410+0000","last_became_peered":"2024-09-10T08:28:34.561410+0000","last_unstale":"2024-09-10T08:28:48.622448+0000","last_undegraded":"2024-09-10T08:28:48.622448+0000","last_fullsized":"2024-09-10T08:28:48.622448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.629982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631878+0000","last_change":"2024-09-10T08:28:35.579033+0000","last_active":"2024-09-10T08:28:48.631878+0000","last_peered":"2024-09-10T08:28:48.631878+0000","last_clean":"2024-09-10T08:28:48.631878+0000","last_became_active":"2024-09-10T08:28:35.578333+0000","last_became_peered":"2024-09-10T08:28:35.578333+0000","last_unstale":"2024-09-10T08:28:48.631878+0000","last_undegraded":"2024-09-10T08:28:48.631878+0000","last_fullsized":"2024-09-10T08:28:48.631878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:58.779491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619633+0000","last_change":"2024-09-10T08:28:46.617317+0000","last_active":"2024-09-10T08:28:48.619633+0000","last_peered":"2024-09-10T08:28:48.619633+0000","last_clean":"2024-09-10T08:28:48.619633+0000","last_became_active":"2024-09-10T08:28:46.616806+0000","last_became_peered":"2024-09-10T08:28:46.616806+0000","last_unstale":"2024-09-10T08:28:48.619633+0000","last_undegraded":"2024-09-10T08:28:48.619633+0000","last_fullsized":"2024-09-10T08:28:48.619633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:46.916848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354201+0000","last_change":"2024-09-10T08:28:47.633194+0000","last_active":"2024-09-10T08:28:49.354201+0000","last_peered":"2024-09-10T08:28:49.354201+0000","last_clean":"2024-09-10T08:28:49.354201+0000","last_became_active":"2024-09-10T08:28:47.632772+0000","last_became_peered":"2024-09-10T08:28:47.632772+0000","last_unstale":"2024-09-10T08:28:49.354201+0000","last_undegraded":"2024-09-10T08:28:49.354201+0000","last_fullsized":"2024-09-10T08:28:49.354201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:59.228438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354864+0000","last_change":"2024-09-10T08:28:34.571965+0000","last_active":"2024-09-10T08:28:49.354864+0000","last_peered":"2024-09-10T08:28:49.354864+0000","last_clean":"2024-09-10T08:28:49.354864+0000","last_became_active":"2024-09-10T08:28:34.571640+0000","last_became_peered":"2024-09-10T08:28:34.571640+0000","last_unstale":"2024-09-10T08:28:49.354864+0000","last_undegraded":"2024-09-10T08:28:49.354864+0000","last_fullsized":"2024-09-10T08:28:49.354864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:53.047030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621272+0000","last_change":"2024-09-10T08:28:35.562132+0000","last_active":"2024-09-10T08:28:48.621272+0000","last_peered":"2024-09-10T08:28:48.621272+0000","last_clean":"2024-09-10T08:28:48.621272+0000","last_became_active":"2024-09-10T08:28:35.561842+0000","last_became_peered":"2024-09-10T08:28:35.561842+0000","last_unstale":"2024-09-10T08:28:48.621272+0000","last_undegraded":"2024-09-10T08:28:48.621272+0000","last_fullsized":"2024-09-10T08:28:48.621272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:48.810258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620177+0000","last_change":"2024-09-10T08:28:46.621093+0000","last_active":"2024-09-10T08:28:48.620177+0000","last_peered":"2024-09-10T08:28:48.620177+0000","last_clean":"2024-09-10T08:28:48.620177+0000","last_became_active":"2024-09-10T08:28:46.620794+0000","last_became_peered":"2024-09-10T08:28:46.620794+0000","last_unstale":"2024-09-10T08:28:48.620177+0000","last_undegraded":"2024-09-10T08:28:48.620177+0000","last_fullsized":"2024-09-10T08:28:48.620177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:20.501262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620906+0000","last_change":"2024-09-10T08:28:47.627756+0000","last_active":"2024-09-10T08:28:48.620906+0000","last_peered":"2024-09-10T08:28:48.620906+0000","last_clean":"2024-09-10T08:28:48.620906+0000","last_became_active":"2024-09-10T08:28:47.627476+0000","last_became_peered":"2024-09-10T08:28:47.627476+0000","last_unstale":"2024-09-10T08:28:48.620906+0000","last_undegraded":"2024-09-10T08:28:48.620906+0000","last_fullsized":"2024-09-10T08:28:48.620906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:25.945793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354598+0000","last_change":"2024-09-10T08:28:34.566560+0000","last_active":"2024-09-10T08:28:49.354598+0000","last_peered":"2024-09-10T08:28:49.354598+0000","last_clean":"2024-09-10T08:28:49.354598+0000","last_became_active":"2024-09-10T08:28:34.566275+0000","last_became_peered":"2024-09-10T08:28:34.566275+0000","last_unstale":"2024-09-10T08:28:49.354598+0000","last_undegraded":"2024-09-10T08:28:49.354598+0000","last_fullsized":"2024-09-10T08:28:49.354598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:03.507683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621503+0000","last_change":"2024-09-10T08:28:35.560380+0000","last_active":"2024-09-10T08:28:48.621503+0000","last_peered":"2024-09-10T08:28:48.621503+0000","last_clean":"2024-09-10T08:28:48.621503+0000","last_became_active":"2024-09-10T08:28:35.560095+0000","last_became_peered":"2024-09-10T08:28:35.560095+0000","last_unstale":"2024-09-10T08:28:48.621503+0000","last_undegraded":"2024-09-10T08:28:48.621503+0000","last_fullsized":"2024-09-10T08:28:48.621503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:20.047446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621446+0000","last_change":"2024-09-10T08:28:46.620162+0000","last_active":"2024-09-10T08:28:48.621446+0000","last_peered":"2024-09-10T08:28:48.621446+0000","last_clean":"2024-09-10T08:28:48.621446+0000","last_became_active":"2024-09-10T08:28:46.619889+0000","last_became_peered":"2024-09-10T08:28:46.619889+0000","last_unstale":"2024-09-10T08:28:48.621446+0000","last_undegraded":"2024-09-10T08:28:48.621446+0000","last_fullsized":"2024-09-10T08:28:48.621446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:13.820143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634225+0000","last_change":"2024-09-10T08:28:47.631094+0000","last_active":"2024-09-10T08:28:48.634225+0000","last_peered":"2024-09-10T08:28:48.634225+0000","last_clean":"2024-09-10T08:28:48.634225+0000","last_became_active":"2024-09-10T08:28:47.630787+0000","last_became_peered":"2024-09-10T08:28:47.630787+0000","last_unstale":"2024-09-10T08:28:48.634225+0000","last_undegraded":"2024-09-10T08:28:48.634225+0000","last_fullsized":"2024-09-10T08:28:48.634225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:06.277094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.618091+0000","last_change":"2024-09-10T08:28:35.572478+0000","last_active":"2024-09-10T08:28:47.618091+0000","last_peered":"2024-09-10T08:28:47.618091+0000","last_clean":"2024-09-10T08:28:47.618091+0000","last_became_active":"2024-09-10T08:28:35.572215+0000","last_became_peered":"2024-09-10T08:28:35.572215+0000","last_unstale":"2024-09-10T08:28:47.618091+0000","last_undegraded":"2024-09-10T08:28:47.618091+0000","last_fullsized":"2024-09-10T08:28:47.618091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:40.397318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354464+0000","last_change":"2024-09-10T08:28:34.569235+0000","last_active":"2024-09-10T08:28:49.354464+0000","last_peered":"2024-09-10T08:28:49.354464+0000","last_clean":"2024-09-10T08:28:49.354464+0000","last_became_active":"2024-09-10T08:28:34.568899+0000","last_became_peered":"2024-09-10T08:28:34.568899+0000","last_unstale":"2024-09-10T08:28:49.354464+0000","last_undegraded":"2024-09-10T08:28:49.354464+0000","last_fullsized":"2024-09-10T08:28:49.354464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:21.927656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620338+0000","last_change":"2024-09-10T08:28:46.618502+0000","last_active":"2024-09-10T08:28:48.620338+0000","last_peered":"2024-09-10T08:28:48.620338+0000","last_clean":"2024-09-10T08:28:48.620338+0000","last_became_active":"2024-09-10T08:28:46.616824+0000","last_became_peered":"2024-09-10T08:28:46.616824+0000","last_unstale":"2024-09-10T08:28:48.620338+0000","last_undegraded":"2024-09-10T08:28:48.620338+0000","last_fullsized":"2024-09-10T08:28:48.620338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:06.554102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.630431+0000","last_change":"2024-09-10T08:28:47.627138+0000","last_active":"2024-09-10T08:28:47.630431+0000","last_peered":"2024-09-10T08:28:47.630431+0000","last_clean":"2024-09-10T08:28:47.630431+0000","last_became_active":"2024-09-10T08:28:47.626871+0000","last_became_peered":"2024-09-10T08:28:47.626871+0000","last_unstale":"2024-09-10T08:28:47.630431+0000","last_undegraded":"2024-09-10T08:28:47.630431+0000","last_fullsized":"2024-09-10T08:28:47.630431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:01.469893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621888+0000","last_change":"2024-09-10T08:28:35.577024+0000","last_active":"2024-09-10T08:28:48.621888+0000","last_peered":"2024-09-10T08:28:48.621888+0000","last_clean":"2024-09-10T08:28:48.621888+0000","last_became_active":"2024-09-10T08:28:35.576771+0000","last_became_peered":"2024-09-10T08:28:35.576771+0000","last_unstale":"2024-09-10T08:28:48.621888+0000","last_undegraded":"2024-09-10T08:28:48.621888+0000","last_fullsized":"2024-09-10T08:28:48.621888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:07.162941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634491+0000","last_change":"2024-09-10T08:28:34.561324+0000","last_active":"2024-09-10T08:28:48.634491+0000","last_peered":"2024-09-10T08:28:48.634491+0000","last_clean":"2024-09-10T08:28:48.634491+0000","last_became_active":"2024-09-10T08:28:34.560974+0000","last_became_peered":"2024-09-10T08:28:34.560974+0000","last_unstale":"2024-09-10T08:28:48.634491+0000","last_undegraded":"2024-09-10T08:28:48.634491+0000","last_fullsized":"2024-09-10T08:28:48.634491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:18.790965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621289+0000","last_change":"2024-09-10T08:28:46.620411+0000","last_active":"2024-09-10T08:28:48.621289+0000","last_peered":"2024-09-10T08:28:48.621289+0000","last_clean":"2024-09-10T08:28:48.621289+0000","last_became_active":"2024-09-10T08:28:46.619553+0000","last_became_peered":"2024-09-10T08:28:46.619553+0000","last_unstale":"2024-09-10T08:28:48.621289+0000","last_undegraded":"2024-09-10T08:28:48.621289+0000","last_fullsized":"2024-09-10T08:28:48.621289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:04.414048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620412+0000","last_change":"2024-09-10T08:28:47.628563+0000","last_active":"2024-09-10T08:28:48.620412+0000","last_peered":"2024-09-10T08:28:48.620412+0000","last_clean":"2024-09-10T08:28:48.620412+0000","last_became_active":"2024-09-10T08:28:47.628290+0000","last_became_peered":"2024-09-10T08:28:47.628290+0000","last_unstale":"2024-09-10T08:28:48.620412+0000","last_undegraded":"2024-09-10T08:28:48.620412+0000","last_fullsized":"2024-09-10T08:28:48.620412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:15.652718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621892+0000","last_change":"2024-09-10T08:28:35.572363+0000","last_active":"2024-09-10T08:28:48.621892+0000","last_peered":"2024-09-10T08:28:48.621892+0000","last_clean":"2024-09-10T08:28:48.621892+0000","last_became_active":"2024-09-10T08:28:35.572108+0000","last_became_peered":"2024-09-10T08:28:35.572108+0000","last_unstale":"2024-09-10T08:28:48.621892+0000","last_undegraded":"2024-09-10T08:28:48.621892+0000","last_fullsized":"2024-09-10T08:28:48.621892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:48.358634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634057+0000","last_change":"2024-09-10T08:28:34.564813+0000","last_active":"2024-09-10T08:28:48.634057+0000","last_peered":"2024-09-10T08:28:48.634057+0000","last_clean":"2024-09-10T08:28:48.634057+0000","last_became_active":"2024-09-10T08:28:34.564557+0000","last_became_peered":"2024-09-10T08:28:34.564557+0000","last_unstale":"2024-09-10T08:28:48.634057+0000","last_undegraded":"2024-09-10T08:28:48.634057+0000","last_fullsized":"2024-09-10T08:28:48.634057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:48.356069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634748+0000","last_change":"2024-09-10T08:28:46.625346+0000","last_active":"2024-09-10T08:28:48.634748+0000","last_peered":"2024-09-10T08:28:48.634748+0000","last_clean":"2024-09-10T08:28:48.634748+0000","last_became_active":"2024-09-10T08:28:46.625059+0000","last_became_peered":"2024-09-10T08:28:46.625059+0000","last_unstale":"2024-09-10T08:28:48.634748+0000","last_undegraded":"2024-09-10T08:28:48.634748+0000","last_fullsized":"2024-09-10T08:28:48.634748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:44.512285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621820+0000","last_change":"2024-09-10T08:28:47.621307+0000","last_active":"2024-09-10T08:28:48.621820+0000","last_peered":"2024-09-10T08:28:48.621820+0000","last_clean":"2024-09-10T08:28:48.621820+0000","last_became_active":"2024-09-10T08:28:47.621043+0000","last_became_peered":"2024-09-10T08:28:47.621043+0000","last_unstale":"2024-09-10T08:28:48.621820+0000","last_undegraded":"2024-09-10T08:28:48.621820+0000","last_fullsized":"2024-09-10T08:28:48.621820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:30.300108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620871+0000","last_change":"2024-09-10T08:28:35.569938+0000","last_active":"2024-09-10T08:28:48.620871+0000","last_peered":"2024-09-10T08:28:48.620871+0000","last_clean":"2024-09-10T08:28:48.620871+0000","last_became_active":"2024-09-10T08:28:35.569109+0000","last_became_peered":"2024-09-10T08:28:35.569109+0000","last_unstale":"2024-09-10T08:28:48.620871+0000","last_undegraded":"2024-09-10T08:28:48.620871+0000","last_fullsized":"2024-09-10T08:28:48.620871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:51.680564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354401+0000","last_change":"2024-09-10T08:28:34.571069+0000","last_active":"2024-09-10T08:28:49.354401+0000","last_peered":"2024-09-10T08:28:49.354401+0000","last_clean":"2024-09-10T08:28:49.354401+0000","last_became_active":"2024-09-10T08:28:34.570766+0000","last_became_peered":"2024-09-10T08:28:34.570766+0000","last_unstale":"2024-09-10T08:28:49.354401+0000","last_undegraded":"2024-09-10T08:28:49.354401+0000","last_fullsized":"2024-09-10T08:28:49.354401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:47.458195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620340+0000","last_change":"2024-09-10T08:28:46.616531+0000","last_active":"2024-09-10T08:28:48.620340+0000","last_peered":"2024-09-10T08:28:48.620340+0000","last_clean":"2024-09-10T08:28:48.620340+0000","last_became_active":"2024-09-10T08:28:46.616254+0000","last_became_peered":"2024-09-10T08:28:46.616254+0000","last_unstale":"2024-09-10T08:28:48.620340+0000","last_undegraded":"2024-09-10T08:28:48.620340+0000","last_fullsized":"2024-09-10T08:28:48.620340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:44.162368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621422+0000","last_change":"2024-09-10T08:28:47.628177+0000","last_active":"2024-09-10T08:28:48.621422+0000","last_peered":"2024-09-10T08:28:48.621422+0000","last_clean":"2024-09-10T08:28:48.621422+0000","last_became_active":"2024-09-10T08:28:47.627869+0000","last_became_peered":"2024-09-10T08:28:47.627869+0000","last_unstale":"2024-09-10T08:28:48.621422+0000","last_undegraded":"2024-09-10T08:28:48.621422+0000","last_fullsized":"2024-09-10T08:28:48.621422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:19.075558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632136+0000","last_change":"2024-09-10T08:28:35.575106+0000","last_active":"2024-09-10T08:28:48.632136+0000","last_peered":"2024-09-10T08:28:48.632136+0000","last_clean":"2024-09-10T08:28:48.632136+0000","last_became_active":"2024-09-10T08:28:35.574815+0000","last_became_peered":"2024-09-10T08:28:35.574815+0000","last_unstale":"2024-09-10T08:28:48.632136+0000","last_undegraded":"2024-09-10T08:28:48.632136+0000","last_fullsized":"2024-09-10T08:28:48.632136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:26.512181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.619552+0000","last_change":"2024-09-10T08:28:34.564865+0000","last_active":"2024-09-10T08:28:47.619552+0000","last_peered":"2024-09-10T08:28:47.619552+0000","last_clean":"2024-09-10T08:28:47.619552+0000","last_became_active":"2024-09-10T08:28:34.564549+0000","last_became_peered":"2024-09-10T08:28:34.564549+0000","last_unstale":"2024-09-10T08:28:47.619552+0000","last_undegraded":"2024-09-10T08:28:47.619552+0000","last_fullsized":"2024-09-10T08:28:47.619552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:05.523637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620344+0000","last_change":"2024-09-10T08:28:46.622505+0000","last_active":"2024-09-10T08:28:48.620344+0000","last_peered":"2024-09-10T08:28:48.620344+0000","last_clean":"2024-09-10T08:28:48.620344+0000","last_became_active":"2024-09-10T08:28:46.621052+0000","last_became_peered":"2024-09-10T08:28:46.621052+0000","last_unstale":"2024-09-10T08:28:48.620344+0000","last_undegraded":"2024-09-10T08:28:48.620344+0000","last_fullsized":"2024-09-10T08:28:48.620344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:37.411404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620146+0000","last_change":"2024-09-10T08:28:47.624919+0000","last_active":"2024-09-10T08:28:48.620146+0000","last_peered":"2024-09-10T08:28:48.620146+0000","last_clean":"2024-09-10T08:28:48.620146+0000","last_became_active":"2024-09-10T08:28:47.624651+0000","last_became_peered":"2024-09-10T08:28:47.624651+0000","last_unstale":"2024-09-10T08:28:48.620146+0000","last_undegraded":"2024-09-10T08:28:48.620146+0000","last_fullsized":"2024-09-10T08:28:48.620146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:11.049160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622219+0000","last_change":"2024-09-10T08:28:35.574107+0000","last_active":"2024-09-10T08:28:48.622219+0000","last_peered":"2024-09-10T08:28:48.622219+0000","last_clean":"2024-09-10T08:28:48.622219+0000","last_became_active":"2024-09-10T08:28:35.573851+0000","last_became_peered":"2024-09-10T08:28:35.573851+0000","last_unstale":"2024-09-10T08:28:48.622219+0000","last_undegraded":"2024-09-10T08:28:48.622219+0000","last_fullsized":"2024-09-10T08:28:48.622219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:53.240223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634865+0000","last_change":"2024-09-10T08:28:34.563451+0000","last_active":"2024-09-10T08:28:48.634865+0000","last_peered":"2024-09-10T08:28:48.634865+0000","last_clean":"2024-09-10T08:28:48.634865+0000","last_became_active":"2024-09-10T08:28:34.563259+0000","last_became_peered":"2024-09-10T08:28:34.563259+0000","last_unstale":"2024-09-10T08:28:48.634865+0000","last_undegraded":"2024-09-10T08:28:48.634865+0000","last_fullsized":"2024-09-10T08:28:48.634865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:44.899351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621717+0000","last_change":"2024-09-10T08:28:46.623396+0000","last_active":"2024-09-10T08:28:48.621717+0000","last_peered":"2024-09-10T08:28:48.621717+0000","last_clean":"2024-09-10T08:28:48.621717+0000","last_became_active":"2024-09-10T08:28:46.623139+0000","last_became_peered":"2024-09-10T08:28:46.623139+0000","last_unstale":"2024-09-10T08:28:48.621717+0000","last_undegraded":"2024-09-10T08:28:48.621717+0000","last_fullsized":"2024-09-10T08:28:48.621717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:00.210413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.639830+0000","last_change":"2024-09-10T08:28:47.634754+0000","last_active":"2024-09-10T08:28:47.639830+0000","last_peered":"2024-09-10T08:28:47.639830+0000","last_clean":"2024-09-10T08:28:47.639830+0000","last_became_active":"2024-09-10T08:28:47.634382+0000","last_became_peered":"2024-09-10T08:28:47.634382+0000","last_unstale":"2024-09-10T08:28:47.639830+0000","last_undegraded":"2024-09-10T08:28:47.639830+0000","last_fullsized":"2024-09-10T08:28:47.639830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:08.900176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634270+0000","last_change":"2024-09-10T08:28:35.567481+0000","last_active":"2024-09-10T08:28:48.634270+0000","last_peered":"2024-09-10T08:28:48.634270+0000","last_clean":"2024-09-10T08:28:48.634270+0000","last_became_active":"2024-09-10T08:28:35.567167+0000","last_became_peered":"2024-09-10T08:28:35.567167+0000","last_unstale":"2024-09-10T08:28:48.634270+0000","last_undegraded":"2024-09-10T08:28:48.634270+0000","last_fullsized":"2024-09-10T08:28:48.634270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:44.110012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355009+0000","last_change":"2024-09-10T08:28:34.571283+0000","last_active":"2024-09-10T08:28:49.355009+0000","last_peered":"2024-09-10T08:28:49.355009+0000","last_clean":"2024-09-10T08:28:49.355009+0000","last_became_active":"2024-09-10T08:28:34.570791+0000","last_became_peered":"2024-09-10T08:28:34.570791+0000","last_unstale":"2024-09-10T08:28:49.355009+0000","last_undegraded":"2024-09-10T08:28:49.355009+0000","last_fullsized":"2024-09-10T08:28:49.355009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:17.427597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631943+0000","last_change":"2024-09-10T08:28:46.630983+0000","last_active":"2024-09-10T08:28:48.631943+0000","last_peered":"2024-09-10T08:28:48.631943+0000","last_clean":"2024-09-10T08:28:48.631943+0000","last_became_active":"2024-09-10T08:28:46.630658+0000","last_became_peered":"2024-09-10T08:28:46.630658+0000","last_unstale":"2024-09-10T08:28:48.631943+0000","last_undegraded":"2024-09-10T08:28:48.631943+0000","last_fullsized":"2024-09-10T08:28:48.631943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:11.219022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632221+0000","last_change":"2024-09-10T08:28:47.625475+0000","last_active":"2024-09-10T08:28:48.632221+0000","last_peered":"2024-09-10T08:28:48.632221+0000","last_clean":"2024-09-10T08:28:48.632221+0000","last_became_active":"2024-09-10T08:28:47.625186+0000","last_became_peered":"2024-09-10T08:28:47.625186+0000","last_unstale":"2024-09-10T08:28:48.632221+0000","last_undegraded":"2024-09-10T08:28:48.632221+0000","last_fullsized":"2024-09-10T08:28:48.632221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:15.932769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621392+0000","last_change":"2024-09-10T08:28:35.576280+0000","last_active":"2024-09-10T08:28:48.621392+0000","last_peered":"2024-09-10T08:28:48.621392+0000","last_clean":"2024-09-10T08:28:48.621392+0000","last_became_active":"2024-09-10T08:28:35.576002+0000","last_became_peered":"2024-09-10T08:28:35.576002+0000","last_unstale":"2024-09-10T08:28:48.621392+0000","last_undegraded":"2024-09-10T08:28:48.621392+0000","last_fullsized":"2024-09-10T08:28:48.621392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:46.278441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634285+0000","last_change":"2024-09-10T08:28:34.555212+0000","last_active":"2024-09-10T08:28:48.634285+0000","last_peered":"2024-09-10T08:28:48.634285+0000","last_clean":"2024-09-10T08:28:48.634285+0000","last_became_active":"2024-09-10T08:28:34.554922+0000","last_became_peered":"2024-09-10T08:28:34.554922+0000","last_unstale":"2024-09-10T08:28:48.634285+0000","last_undegraded":"2024-09-10T08:28:48.634285+0000","last_fullsized":"2024-09-10T08:28:48.634285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634109+0000","last_change":"2024-09-10T08:28:46.624886+0000","last_active":"2024-09-10T08:28:48.634109+0000","last_peered":"2024-09-10T08:28:48.634109+0000","last_clean":"2024-09-10T08:28:48.634109+0000","last_became_active":"2024-09-10T08:28:46.624690+0000","last_became_peered":"2024-09-10T08:28:46.624690+0000","last_unstale":"2024-09-10T08:28:48.634109+0000","last_undegraded":"2024-09-10T08:28:48.634109+0000","last_fullsized":"2024-09-10T08:28:48.634109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:15.023379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631808+0000","last_change":"2024-09-10T08:28:47.634161+0000","last_active":"2024-09-10T08:28:48.631808+0000","last_peered":"2024-09-10T08:28:48.631808+0000","last_clean":"2024-09-10T08:28:48.631808+0000","last_became_active":"2024-09-10T08:28:47.633893+0000","last_became_peered":"2024-09-10T08:28:47.633893+0000","last_unstale":"2024-09-10T08:28:48.631808+0000","last_undegraded":"2024-09-10T08:28:48.631808+0000","last_fullsized":"2024-09-10T08:28:48.631808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:37.072370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620594+0000","last_change":"2024-09-10T08:28:35.577978+0000","last_active":"2024-09-10T08:28:48.620594+0000","last_peered":"2024-09-10T08:28:48.620594+0000","last_clean":"2024-09-10T08:28:48.620594+0000","last_became_active":"2024-09-10T08:28:35.577718+0000","last_became_peered":"2024-09-10T08:28:35.577718+0000","last_unstale":"2024-09-10T08:28:48.620594+0000","last_undegraded":"2024-09-10T08:28:48.620594+0000","last_fullsized":"2024-09-10T08:28:48.620594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:01:57.257817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621126+0000","last_change":"2024-09-10T08:28:34.553983+0000","last_active":"2024-09-10T08:28:48.621126+0000","last_peered":"2024-09-10T08:28:48.621126+0000","last_clean":"2024-09-10T08:28:48.621126+0000","last_became_active":"2024-09-10T08:28:34.553693+0000","last_became_peered":"2024-09-10T08:28:34.553693+0000","last_unstale":"2024-09-10T08:28:48.621126+0000","last_undegraded":"2024-09-10T08:28:48.621126+0000","last_fullsized":"2024-09-10T08:28:48.621126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:40.001685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634238+0000","last_change":"2024-09-10T08:28:46.620165+0000","last_active":"2024-09-10T08:28:48.634238+0000","last_peered":"2024-09-10T08:28:48.634238+0000","last_clean":"2024-09-10T08:28:48.634238+0000","last_became_active":"2024-09-10T08:28:46.619853+0000","last_became_peered":"2024-09-10T08:28:46.619853+0000","last_unstale":"2024-09-10T08:28:48.634238+0000","last_undegraded":"2024-09-10T08:28:48.634238+0000","last_fullsized":"2024-09-10T08:28:48.634238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:36.006532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.629847+0000","last_change":"2024-09-10T08:28:47.621588+0000","last_active":"2024-09-10T08:28:47.629847+0000","last_peered":"2024-09-10T08:28:47.629847+0000","last_clean":"2024-09-10T08:28:47.629847+0000","last_became_active":"2024-09-10T08:28:47.621122+0000","last_became_peered":"2024-09-10T08:28:47.621122+0000","last_unstale":"2024-09-10T08:28:47.629847+0000","last_undegraded":"2024-09-10T08:28:47.629847+0000","last_fullsized":"2024-09-10T08:28:47.629847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:19.727552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633943+0000","last_change":"2024-09-10T08:28:35.566745+0000","last_active":"2024-09-10T08:28:48.633943+0000","last_peered":"2024-09-10T08:28:48.633943+0000","last_clean":"2024-09-10T08:28:48.633943+0000","last_became_active":"2024-09-10T08:28:35.566444+0000","last_became_peered":"2024-09-10T08:28:35.566444+0000","last_unstale":"2024-09-10T08:28:48.633943+0000","last_undegraded":"2024-09-10T08:28:48.633943+0000","last_fullsized":"2024-09-10T08:28:48.633943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:52.735296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.607113+0000","last_change":"2024-09-10T08:28:34.560745+0000","last_active":"2024-09-10T08:28:47.607113+0000","last_peered":"2024-09-10T08:28:47.607113+0000","last_clean":"2024-09-10T08:28:47.607113+0000","last_became_active":"2024-09-10T08:28:34.559911+0000","last_became_peered":"2024-09-10T08:28:34.559911+0000","last_unstale":"2024-09-10T08:28:47.607113+0000","last_undegraded":"2024-09-10T08:28:47.607113+0000","last_fullsized":"2024-09-10T08:28:47.607113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:00.234067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634838+0000","last_change":"2024-09-10T08:28:46.623886+0000","last_active":"2024-09-10T08:28:48.634838+0000","last_peered":"2024-09-10T08:28:48.634838+0000","last_clean":"2024-09-10T08:28:48.634838+0000","last_became_active":"2024-09-10T08:28:46.622790+0000","last_became_peered":"2024-09-10T08:28:46.622790+0000","last_unstale":"2024-09-10T08:28:48.634838+0000","last_undegraded":"2024-09-10T08:28:48.634838+0000","last_fullsized":"2024-09-10T08:28:48.634838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:06:32.333116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621918+0000","last_change":"2024-09-10T08:28:47.634500+0000","last_active":"2024-09-10T08:28:48.621918+0000","last_peered":"2024-09-10T08:28:48.621918+0000","last_clean":"2024-09-10T08:28:48.621918+0000","last_became_active":"2024-09-10T08:28:47.634219+0000","last_became_peered":"2024-09-10T08:28:47.634219+0000","last_unstale":"2024-09-10T08:28:48.621918+0000","last_undegraded":"2024-09-10T08:28:48.621918+0000","last_fullsized":"2024-09-10T08:28:48.621918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:59.689554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631587+0000","last_change":"2024-09-10T08:28:35.576360+0000","last_active":"2024-09-10T08:28:48.631587+0000","last_peered":"2024-09-10T08:28:48.631587+0000","last_clean":"2024-09-10T08:28:48.631587+0000","last_became_active":"2024-09-10T08:28:35.576096+0000","last_became_peered":"2024-09-10T08:28:35.576096+0000","last_unstale":"2024-09-10T08:28:48.631587+0000","last_undegraded":"2024-09-10T08:28:48.631587+0000","last_fullsized":"2024-09-10T08:28:48.631587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:34.159275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354630+0000","last_change":"2024-09-10T08:28:34.568477+0000","last_active":"2024-09-10T08:28:49.354630+0000","last_peered":"2024-09-10T08:28:49.354630+0000","last_clean":"2024-09-10T08:28:49.354630+0000","last_became_active":"2024-09-10T08:28:34.568249+0000","last_became_peered":"2024-09-10T08:28:34.568249+0000","last_unstale":"2024-09-10T08:28:49.354630+0000","last_undegraded":"2024-09-10T08:28:49.354630+0000","last_fullsized":"2024-09-10T08:28:49.354630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:08.640043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633193+0000","last_change":"2024-09-10T08:28:46.621567+0000","last_active":"2024-09-10T08:28:48.633193+0000","last_peered":"2024-09-10T08:28:48.633193+0000","last_clean":"2024-09-10T08:28:48.633193+0000","last_became_active":"2024-09-10T08:28:46.621272+0000","last_became_peered":"2024-09-10T08:28:46.621272+0000","last_unstale":"2024-09-10T08:28:48.633193+0000","last_undegraded":"2024-09-10T08:28:48.633193+0000","last_fullsized":"2024-09-10T08:28:48.633193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:37:34.936213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354521+0000","last_change":"2024-09-10T08:28:47.631621+0000","last_active":"2024-09-10T08:28:49.354521+0000","last_peered":"2024-09-10T08:28:49.354521+0000","last_clean":"2024-09-10T08:28:49.354521+0000","last_became_active":"2024-09-10T08:28:47.631337+0000","last_became_peered":"2024-09-10T08:28:47.631337+0000","last_unstale":"2024-09-10T08:28:49.354521+0000","last_undegraded":"2024-09-10T08:28:49.354521+0000","last_fullsized":"2024-09-10T08:28:49.354521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:04.196705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621993+0000","last_change":"2024-09-10T08:28:35.572658+0000","last_active":"2024-09-10T08:28:48.621993+0000","last_peered":"2024-09-10T08:28:48.621993+0000","last_clean":"2024-09-10T08:28:48.621993+0000","last_became_active":"2024-09-10T08:28:35.571611+0000","last_became_peered":"2024-09-10T08:28:35.571611+0000","last_unstale":"2024-09-10T08:28:48.621993+0000","last_undegraded":"2024-09-10T08:28:48.621993+0000","last_fullsized":"2024-09-10T08:28:48.621993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:42.726996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620845+0000","last_change":"2024-09-10T08:28:34.555587+0000","last_active":"2024-09-10T08:28:48.620845+0000","last_peered":"2024-09-10T08:28:48.620845+0000","last_clean":"2024-09-10T08:28:48.620845+0000","last_became_active":"2024-09-10T08:28:34.555269+0000","last_became_peered":"2024-09-10T08:28:34.555269+0000","last_unstale":"2024-09-10T08:28:48.620845+0000","last_undegraded":"2024-09-10T08:28:48.620845+0000","last_fullsized":"2024-09-10T08:28:48.620845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:19.499870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354756+0000","last_change":"2024-09-10T08:28:26.724394+0000","last_active":"2024-09-10T08:28:49.354756+0000","last_peered":"2024-09-10T08:28:49.354756+0000","last_clean":"2024-09-10T08:28:49.354756+0000","last_became_active":"2024-09-10T08:28:26.723452+0000","last_became_peered":"2024-09-10T08:28:26.723452+0000","last_unstale":"2024-09-10T08:28:49.354756+0000","last_undegraded":"2024-09-10T08:28:49.354756+0000","last_fullsized":"2024-09-10T08:28:49.354756+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_clean_scrub_stamp":"2024-09-10T08:28:25.445753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:00.811505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.618510+0000","last_change":"2024-09-10T08:28:46.622048+0000","last_active":"2024-09-10T08:28:47.618510+0000","last_peered":"2024-09-10T08:28:47.618510+0000","last_clean":"2024-09-10T08:28:47.618510+0000","last_became_active":"2024-09-10T08:28:46.621770+0000","last_became_peered":"2024-09-10T08:28:46.621770+0000","last_unstale":"2024-09-10T08:28:47.618510+0000","last_undegraded":"2024-09-10T08:28:47.618510+0000","last_fullsized":"2024-09-10T08:28:47.618510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:51.430760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.623784+0000","last_change":"2024-09-10T08:28:47.620746+0000","last_active":"2024-09-10T08:28:47.623784+0000","last_peered":"2024-09-10T08:28:47.623784+0000","last_clean":"2024-09-10T08:28:47.623784+0000","last_became_active":"2024-09-10T08:28:47.620492+0000","last_became_peered":"2024-09-10T08:28:47.620492+0000","last_unstale":"2024-09-10T08:28:47.623784+0000","last_undegraded":"2024-09-10T08:28:47.623784+0000","last_fullsized":"2024-09-10T08:28:47.623784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:55.065641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354858+0000","last_change":"2024-09-10T08:28:35.574532+0000","last_active":"2024-09-10T08:28:49.354858+0000","last_peered":"2024-09-10T08:28:49.354858+0000","last_clean":"2024-09-10T08:28:49.354858+0000","last_became_active":"2024-09-10T08:28:35.574215+0000","last_became_peered":"2024-09-10T08:28:35.574215+0000","last_unstale":"2024-09-10T08:28:49.354858+0000","last_undegraded":"2024-09-10T08:28:49.354858+0000","last_fullsized":"2024-09-10T08:28:49.354858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:28.455653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.608591+0000","last_change":"2024-09-10T08:28:34.559911+0000","last_active":"2024-09-10T08:28:47.608591+0000","last_peered":"2024-09-10T08:28:47.608591+0000","last_clean":"2024-09-10T08:28:47.608591+0000","last_became_active":"2024-09-10T08:28:34.559635+0000","last_became_peered":"2024-09-10T08:28:34.559635+0000","last_unstale":"2024-09-10T08:28:47.608591+0000","last_undegraded":"2024-09-10T08:28:47.608591+0000","last_fullsized":"2024-09-10T08:28:47.608591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:40.892609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.617943+0000","last_change":"2024-09-10T08:28:46.620352+0000","last_active":"2024-09-10T08:28:47.617943+0000","last_peered":"2024-09-10T08:28:47.617943+0000","last_clean":"2024-09-10T08:28:47.617943+0000","last_became_active":"2024-09-10T08:28:46.620064+0000","last_became_peered":"2024-09-10T08:28:46.620064+0000","last_unstale":"2024-09-10T08:28:47.617943+0000","last_undegraded":"2024-09-10T08:28:47.617943+0000","last_fullsized":"2024-09-10T08:28:47.617943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:59.333579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.623859+0000","last_change":"2024-09-10T08:28:47.620305+0000","last_active":"2024-09-10T08:28:47.623859+0000","last_peered":"2024-09-10T08:28:47.623859+0000","last_clean":"2024-09-10T08:28:47.623859+0000","last_became_active":"2024-09-10T08:28:47.620014+0000","last_became_peered":"2024-09-10T08:28:47.620014+0000","last_unstale":"2024-09-10T08:28:47.623859+0000","last_undegraded":"2024-09-10T08:28:47.623859+0000","last_fullsized":"2024-09-10T08:28:47.623859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:26.503891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621484+0000","last_change":"2024-09-10T08:28:35.577124+0000","last_active":"2024-09-10T08:28:48.621484+0000","last_peered":"2024-09-10T08:28:48.621484+0000","last_clean":"2024-09-10T08:28:48.621484+0000","last_became_active":"2024-09-10T08:28:35.576655+0000","last_became_peered":"2024-09-10T08:28:35.576655+0000","last_unstale":"2024-09-10T08:28:48.621484+0000","last_undegraded":"2024-09-10T08:28:48.621484+0000","last_fullsized":"2024-09-10T08:28:48.621484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:29.878600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634772+0000","last_change":"2024-09-10T08:28:34.560694+0000","last_active":"2024-09-10T08:28:48.634772+0000","last_peered":"2024-09-10T08:28:48.634772+0000","last_clean":"2024-09-10T08:28:48.634772+0000","last_became_active":"2024-09-10T08:28:34.560429+0000","last_became_peered":"2024-09-10T08:28:34.560429+0000","last_unstale":"2024-09-10T08:28:48.634772+0000","last_undegraded":"2024-09-10T08:28:48.634772+0000","last_fullsized":"2024-09-10T08:28:48.634772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:54.514467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631770+0000","last_change":"2024-09-10T08:28:46.622232+0000","last_active":"2024-09-10T08:28:48.631770+0000","last_peered":"2024-09-10T08:28:48.631770+0000","last_clean":"2024-09-10T08:28:48.631770+0000","last_became_active":"2024-09-10T08:28:46.621966+0000","last_became_peered":"2024-09-10T08:28:46.621966+0000","last_unstale":"2024-09-10T08:28:48.631770+0000","last_undegraded":"2024-09-10T08:28:48.631770+0000","last_fullsized":"2024-09-10T08:28:48.631770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:28.897045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354068+0000","last_change":"2024-09-10T08:28:47.630602+0000","last_active":"2024-09-10T08:28:49.354068+0000","last_peered":"2024-09-10T08:28:49.354068+0000","last_clean":"2024-09-10T08:28:49.354068+0000","last_became_active":"2024-09-10T08:28:47.630234+0000","last_became_peered":"2024-09-10T08:28:47.630234+0000","last_unstale":"2024-09-10T08:28:49.354068+0000","last_undegraded":"2024-09-10T08:28:49.354068+0000","last_fullsized":"2024-09-10T08:28:49.354068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:03.808098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355126+0000","last_change":"2024-09-10T08:28:35.577577+0000","last_active":"2024-09-10T08:28:49.355126+0000","last_peered":"2024-09-10T08:28:49.355126+0000","last_clean":"2024-09-10T08:28:49.355126+0000","last_became_active":"2024-09-10T08:28:35.576686+0000","last_became_peered":"2024-09-10T08:28:35.576686+0000","last_unstale":"2024-09-10T08:28:49.355126+0000","last_undegraded":"2024-09-10T08:28:49.355126+0000","last_fullsized":"2024-09-10T08:28:49.355126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:36.334494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.608095+0000","last_change":"2024-09-10T08:28:34.560313+0000","last_active":"2024-09-10T08:28:47.608095+0000","last_peered":"2024-09-10T08:28:47.608095+0000","last_clean":"2024-09-10T08:28:47.608095+0000","last_became_active":"2024-09-10T08:28:34.560035+0000","last_became_peered":"2024-09-10T08:28:34.560035+0000","last_unstale":"2024-09-10T08:28:47.608095+0000","last_undegraded":"2024-09-10T08:28:47.608095+0000","last_fullsized":"2024-09-10T08:28:47.608095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:56.945537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619792+0000","last_change":"2024-09-10T08:28:46.623371+0000","last_active":"2024-09-10T08:28:48.619792+0000","last_peered":"2024-09-10T08:28:48.619792+0000","last_clean":"2024-09-10T08:28:48.619792+0000","last_became_active":"2024-09-10T08:28:46.623092+0000","last_became_peered":"2024-09-10T08:28:46.623092+0000","last_unstale":"2024-09-10T08:28:48.619792+0000","last_undegraded":"2024-09-10T08:28:48.619792+0000","last_fullsized":"2024-09-10T08:28:48.619792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:36.359127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.621115+0000","last_change":"2024-09-10T08:28:47.619805+0000","last_active":"2024-09-10T08:28:47.621115+0000","last_peered":"2024-09-10T08:28:47.621115+0000","last_clean":"2024-09-10T08:28:47.621115+0000","last_became_active":"2024-09-10T08:28:47.619452+0000","last_became_peered":"2024-09-10T08:28:47.619452+0000","last_unstale":"2024-09-10T08:28:47.621115+0000","last_undegraded":"2024-09-10T08:28:47.621115+0000","last_fullsized":"2024-09-10T08:28:47.621115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:41:58.798577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355004+0000","last_change":"2024-09-10T08:28:35.577476+0000","last_active":"2024-09-10T08:28:49.355004+0000","last_peered":"2024-09-10T08:28:49.355004+0000","last_clean":"2024-09-10T08:28:49.355004+0000","last_became_active":"2024-09-10T08:28:35.576786+0000","last_became_peered":"2024-09-10T08:28:35.576786+0000","last_unstale":"2024-09-10T08:28:49.355004+0000","last_undegraded":"2024-09-10T08:28:49.355004+0000","last_fullsized":"2024-09-10T08:28:49.355004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:46.914074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620800+0000","last_change":"2024-09-10T08:28:34.551102+0000","last_active":"2024-09-10T08:28:48.620800+0000","last_peered":"2024-09-10T08:28:48.620800+0000","last_clean":"2024-09-10T08:28:48.620800+0000","last_became_active":"2024-09-10T08:28:34.550773+0000","last_became_peered":"2024-09-10T08:28:34.550773+0000","last_unstale":"2024-09-10T08:28:48.620800+0000","last_undegraded":"2024-09-10T08:28:48.620800+0000","last_fullsized":"2024-09-10T08:28:48.620800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:35.393695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620218+0000","last_change":"2024-09-10T08:28:46.619639+0000","last_active":"2024-09-10T08:28:48.620218+0000","last_peered":"2024-09-10T08:28:48.620218+0000","last_clean":"2024-09-10T08:28:48.620218+0000","last_became_active":"2024-09-10T08:28:46.619330+0000","last_became_peered":"2024-09-10T08:28:46.619330+0000","last_unstale":"2024-09-10T08:28:48.620218+0000","last_undegraded":"2024-09-10T08:28:48.620218+0000","last_fullsized":"2024-09-10T08:28:48.620218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:10.371693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622150+0000","last_change":"2024-09-10T08:28:47.633627+0000","last_active":"2024-09-10T08:28:48.622150+0000","last_peered":"2024-09-10T08:28:48.622150+0000","last_clean":"2024-09-10T08:28:48.622150+0000","last_became_active":"2024-09-10T08:28:47.633362+0000","last_became_peered":"2024-09-10T08:28:47.633362+0000","last_unstale":"2024-09-10T08:28:48.622150+0000","last_undegraded":"2024-09-10T08:28:48.622150+0000","last_fullsized":"2024-09-10T08:28:48.622150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:19.473028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354525+0000","last_change":"2024-09-10T08:28:35.575307+0000","last_active":"2024-09-10T08:28:49.354525+0000","last_peered":"2024-09-10T08:28:49.354525+0000","last_clean":"2024-09-10T08:28:49.354525+0000","last_became_active":"2024-09-10T08:28:35.575038+0000","last_became_peered":"2024-09-10T08:28:35.575038+0000","last_unstale":"2024-09-10T08:28:49.354525+0000","last_undegraded":"2024-09-10T08:28:49.354525+0000","last_fullsized":"2024-09-10T08:28:49.354525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:36.478822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.607008+0000","last_change":"2024-09-10T08:28:34.555542+0000","last_active":"2024-09-10T08:28:47.607008+0000","last_peered":"2024-09-10T08:28:47.607008+0000","last_clean":"2024-09-10T08:28:47.607008+0000","last_became_active":"2024-09-10T08:28:34.555179+0000","last_became_peered":"2024-09-10T08:28:34.555179+0000","last_unstale":"2024-09-10T08:28:47.607008+0000","last_undegraded":"2024-09-10T08:28:47.607008+0000","last_fullsized":"2024-09-10T08:28:47.607008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:53.313161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632119+0000","last_change":"2024-09-10T08:28:46.618615+0000","last_active":"2024-09-10T08:28:48.632119+0000","last_peered":"2024-09-10T08:28:48.632119+0000","last_clean":"2024-09-10T08:28:48.632119+0000","last_became_active":"2024-09-10T08:28:46.618318+0000","last_became_peered":"2024-09-10T08:28:46.618318+0000","last_unstale":"2024-09-10T08:28:48.632119+0000","last_undegraded":"2024-09-10T08:28:48.632119+0000","last_fullsized":"2024-09-10T08:28:48.632119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:44:08.185748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621616+0000","last_change":"2024-09-10T08:28:47.625025+0000","last_active":"2024-09-10T08:28:48.621616+0000","last_peered":"2024-09-10T08:28:48.621616+0000","last_clean":"2024-09-10T08:28:48.621616+0000","last_became_active":"2024-09-10T08:28:47.624230+0000","last_became_peered":"2024-09-10T08:28:47.624230+0000","last_unstale":"2024-09-10T08:28:48.621616+0000","last_undegraded":"2024-09-10T08:28:48.621616+0000","last_fullsized":"2024-09-10T08:28:48.621616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:25.530264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.617179+0000","last_change":"2024-09-10T08:28:35.578892+0000","last_active":"2024-09-10T08:28:47.617179+0000","last_peered":"2024-09-10T08:28:47.617179+0000","last_clean":"2024-09-10T08:28:47.617179+0000","last_became_active":"2024-09-10T08:28:35.578299+0000","last_became_peered":"2024-09-10T08:28:35.578299+0000","last_unstale":"2024-09-10T08:28:47.617179+0000","last_undegraded":"2024-09-10T08:28:47.617179+0000","last_fullsized":"2024-09-10T08:28:47.617179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:27.485392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.617702+0000","last_change":"2024-09-10T08:28:34.560444+0000","last_active":"2024-09-10T08:28:47.617702+0000","last_peered":"2024-09-10T08:28:47.617702+0000","last_clean":"2024-09-10T08:28:47.617702+0000","last_became_active":"2024-09-10T08:28:34.560188+0000","last_became_peered":"2024-09-10T08:28:34.560188+0000","last_unstale":"2024-09-10T08:28:47.617702+0000","last_undegraded":"2024-09-10T08:28:47.617702+0000","last_fullsized":"2024-09-10T08:28:47.617702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:15.727780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622124+0000","last_change":"2024-09-10T08:28:46.623483+0000","last_active":"2024-09-10T08:28:48.622124+0000","last_peered":"2024-09-10T08:28:48.622124+0000","last_clean":"2024-09-10T08:28:48.622124+0000","last_became_active":"2024-09-10T08:28:46.623211+0000","last_became_peered":"2024-09-10T08:28:46.623211+0000","last_unstale":"2024-09-10T08:28:48.622124+0000","last_undegraded":"2024-09-10T08:28:48.622124+0000","last_fullsized":"2024-09-10T08:28:48.622124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:24.611015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621121+0000","last_change":"2024-09-10T08:28:47.635185+0000","last_active":"2024-09-10T08:28:48.621121+0000","last_peered":"2024-09-10T08:28:48.621121+0000","last_clean":"2024-09-10T08:28:48.621121+0000","last_became_active":"2024-09-10T08:28:47.634782+0000","last_became_peered":"2024-09-10T08:28:47.634782+0000","last_unstale":"2024-09-10T08:28:48.621121+0000","last_undegraded":"2024-09-10T08:28:48.621121+0000","last_fullsized":"2024-09-10T08:28:48.621121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:05.512645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354247+0000","last_change":"2024-09-10T08:28:35.575788+0000","last_active":"2024-09-10T08:28:49.354247+0000","last_peered":"2024-09-10T08:28:49.354247+0000","last_clean":"2024-09-10T08:28:49.354247+0000","last_became_active":"2024-09-10T08:28:35.575333+0000","last_became_peered":"2024-09-10T08:28:35.575333+0000","last_unstale":"2024-09-10T08:28:49.354247+0000","last_undegraded":"2024-09-10T08:28:49.354247+0000","last_fullsized":"2024-09-10T08:28:49.354247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:39.756390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621367+0000","last_change":"2024-09-10T08:28:34.560699+0000","last_active":"2024-09-10T08:28:48.621367+0000","last_peered":"2024-09-10T08:28:48.621367+0000","last_clean":"2024-09-10T08:28:48.621367+0000","last_became_active":"2024-09-10T08:28:34.560376+0000","last_became_peered":"2024-09-10T08:28:34.560376+0000","last_unstale":"2024-09-10T08:28:48.621367+0000","last_undegraded":"2024-09-10T08:28:48.621367+0000","last_fullsized":"2024-09-10T08:28:48.621367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:09.981216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622076+0000","last_change":"2024-09-10T08:28:46.620745+0000","last_active":"2024-09-10T08:28:48.622076+0000","last_peered":"2024-09-10T08:28:48.622076+0000","last_clean":"2024-09-10T08:28:48.622076+0000","last_became_active":"2024-09-10T08:28:46.619030+0000","last_became_peered":"2024-09-10T08:28:46.619030+0000","last_unstale":"2024-09-10T08:28:48.622076+0000","last_undegraded":"2024-09-10T08:28:48.622076+0000","last_fullsized":"2024-09-10T08:28:48.622076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:07.653226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622129+0000","last_change":"2024-09-10T08:28:47.626648+0000","last_active":"2024-09-10T08:28:48.622129+0000","last_peered":"2024-09-10T08:28:48.622129+0000","last_clean":"2024-09-10T08:28:48.622129+0000","last_became_active":"2024-09-10T08:28:47.626330+0000","last_became_peered":"2024-09-10T08:28:47.626330+0000","last_unstale":"2024-09-10T08:28:48.622129+0000","last_undegraded":"2024-09-10T08:28:48.622129+0000","last_fullsized":"2024-09-10T08:28:48.622129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:02.346881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631691+0000","last_change":"2024-09-10T08:28:35.574810+0000","last_active":"2024-09-10T08:28:48.631691+0000","last_peered":"2024-09-10T08:28:48.631691+0000","last_clean":"2024-09-10T08:28:48.631691+0000","last_became_active":"2024-09-10T08:28:35.574567+0000","last_became_peered":"2024-09-10T08:28:35.574567+0000","last_unstale":"2024-09-10T08:28:48.631691+0000","last_undegraded":"2024-09-10T08:28:48.631691+0000","last_fullsized":"2024-09-10T08:28:48.631691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:29.315833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632297+0000","last_change":"2024-09-10T08:28:34.553556+0000","last_active":"2024-09-10T08:28:48.632297+0000","last_peered":"2024-09-10T08:28:48.632297+0000","last_clean":"2024-09-10T08:28:48.632297+0000","last_became_active":"2024-09-10T08:28:34.553275+0000","last_became_peered":"2024-09-10T08:28:34.553275+0000","last_unstale":"2024-09-10T08:28:48.632297+0000","last_undegraded":"2024-09-10T08:28:48.632297+0000","last_fullsized":"2024-09-10T08:28:48.632297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:45.957635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621256+0000","last_change":"2024-09-10T08:28:46.619760+0000","last_active":"2024-09-10T08:28:48.621256+0000","last_peered":"2024-09-10T08:28:48.621256+0000","last_clean":"2024-09-10T08:28:48.621256+0000","last_became_active":"2024-09-10T08:28:46.619165+0000","last_became_peered":"2024-09-10T08:28:46.619165+0000","last_unstale":"2024-09-10T08:28:48.621256+0000","last_undegraded":"2024-09-10T08:28:48.621256+0000","last_fullsized":"2024-09-10T08:28:48.621256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:27.691197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621842+0000","last_change":"2024-09-10T08:28:47.620135+0000","last_active":"2024-09-10T08:28:48.621842+0000","last_peered":"2024-09-10T08:28:48.621842+0000","last_clean":"2024-09-10T08:28:48.621842+0000","last_became_active":"2024-09-10T08:28:47.619661+0000","last_became_peered":"2024-09-10T08:28:47.619661+0000","last_unstale":"2024-09-10T08:28:48.621842+0000","last_undegraded":"2024-09-10T08:28:48.621842+0000","last_fullsized":"2024-09-10T08:28:48.621842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:34.815426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354721+0000","last_change":"2024-09-10T08:28:35.582473+0000","last_active":"2024-09-10T08:28:49.354721+0000","last_peered":"2024-09-10T08:28:49.354721+0000","last_clean":"2024-09-10T08:28:49.354721+0000","last_became_active":"2024-09-10T08:28:35.582205+0000","last_became_peered":"2024-09-10T08:28:35.582205+0000","last_unstale":"2024-09-10T08:28:49.354721+0000","last_undegraded":"2024-09-10T08:28:49.354721+0000","last_fullsized":"2024-09-10T08:28:49.354721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:11.200963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.618829+0000","last_change":"2024-09-10T08:28:34.559823+0000","last_active":"2024-09-10T08:28:47.618829+0000","last_peered":"2024-09-10T08:28:47.618829+0000","last_clean":"2024-09-10T08:28:47.618829+0000","last_became_active":"2024-09-10T08:28:34.559560+0000","last_became_peered":"2024-09-10T08:28:34.559560+0000","last_unstale":"2024-09-10T08:28:47.618829+0000","last_undegraded":"2024-09-10T08:28:47.618829+0000","last_fullsized":"2024-09-10T08:28:47.618829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:53.724382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633994+0000","last_change":"2024-09-10T08:28:46.628040+0000","last_active":"2024-09-10T08:28:48.633994+0000","last_peered":"2024-09-10T08:28:48.633994+0000","last_clean":"2024-09-10T08:28:48.633994+0000","last_became_active":"2024-09-10T08:28:46.627819+0000","last_became_peered":"2024-09-10T08:28:46.627819+0000","last_unstale":"2024-09-10T08:28:48.633994+0000","last_undegraded":"2024-09-10T08:28:48.633994+0000","last_fullsized":"2024-09-10T08:28:48.633994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:29.467540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634305+0000","last_change":"2024-09-10T08:28:47.628067+0000","last_active":"2024-09-10T08:28:48.634305+0000","last_peered":"2024-09-10T08:28:48.634305+0000","last_clean":"2024-09-10T08:28:48.634305+0000","last_became_active":"2024-09-10T08:28:47.627775+0000","last_became_peered":"2024-09-10T08:28:47.627775+0000","last_unstale":"2024-09-10T08:28:48.634305+0000","last_undegraded":"2024-09-10T08:28:48.634305+0000","last_fullsized":"2024-09-10T08:28:48.634305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:43.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621613+0000","last_change":"2024-09-10T08:28:35.571262+0000","last_active":"2024-09-10T08:28:48.621613+0000","last_peered":"2024-09-10T08:28:48.621613+0000","last_clean":"2024-09-10T08:28:48.621613+0000","last_became_active":"2024-09-10T08:28:35.570711+0000","last_became_peered":"2024-09-10T08:28:35.570711+0000","last_unstale":"2024-09-10T08:28:48.621613+0000","last_undegraded":"2024-09-10T08:28:48.621613+0000","last_fullsized":"2024-09-10T08:28:48.621613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:29.116422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634766+0000","last_change":"2024-09-10T08:28:34.557352+0000","last_active":"2024-09-10T08:28:48.634766+0000","last_peered":"2024-09-10T08:28:48.634766+0000","last_clean":"2024-09-10T08:28:48.634766+0000","last_became_active":"2024-09-10T08:28:34.557076+0000","last_became_peered":"2024-09-10T08:28:34.557076+0000","last_unstale":"2024-09-10T08:28:48.634766+0000","last_undegraded":"2024-09-10T08:28:48.634766+0000","last_fullsized":"2024-09-10T08:28:48.634766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:04.957739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620317+0000","last_change":"2024-09-10T08:28:46.615923+0000","last_active":"2024-09-10T08:28:48.620317+0000","last_peered":"2024-09-10T08:28:48.620317+0000","last_clean":"2024-09-10T08:28:48.620317+0000","last_became_active":"2024-09-10T08:28:46.615451+0000","last_became_peered":"2024-09-10T08:28:46.615451+0000","last_unstale":"2024-09-10T08:28:48.620317+0000","last_undegraded":"2024-09-10T08:28:48.620317+0000","last_fullsized":"2024-09-10T08:28:48.620317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:22.612001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.627287+0000","last_change":"2024-09-10T08:28:47.623223+0000","last_active":"2024-09-10T08:28:47.627287+0000","last_peered":"2024-09-10T08:28:47.627287+0000","last_clean":"2024-09-10T08:28:47.627287+0000","last_became_active":"2024-09-10T08:28:47.622961+0000","last_became_peered":"2024-09-10T08:28:47.622961+0000","last_unstale":"2024-09-10T08:28:47.627287+0000","last_undegraded":"2024-09-10T08:28:47.627287+0000","last_fullsized":"2024-09-10T08:28:47.627287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:03.024023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631925+0000","last_change":"2024-09-10T08:28:35.577913+0000","last_active":"2024-09-10T08:28:48.631925+0000","last_peered":"2024-09-10T08:28:48.631925+0000","last_clean":"2024-09-10T08:28:48.631925+0000","last_became_active":"2024-09-10T08:28:35.577255+0000","last_became_peered":"2024-09-10T08:28:35.577255+0000","last_unstale":"2024-09-10T08:28:48.631925+0000","last_undegraded":"2024-09-10T08:28:48.631925+0000","last_fullsized":"2024-09-10T08:28:48.631925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:17.413525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621690+0000","last_change":"2024-09-10T08:28:34.564571+0000","last_active":"2024-09-10T08:28:48.621690+0000","last_peered":"2024-09-10T08:28:48.621690+0000","last_clean":"2024-09-10T08:28:48.621690+0000","last_became_active":"2024-09-10T08:28:34.564189+0000","last_became_peered":"2024-09-10T08:28:34.564189+0000","last_unstale":"2024-09-10T08:28:48.621690+0000","last_undegraded":"2024-09-10T08:28:48.621690+0000","last_fullsized":"2024-09-10T08:28:48.621690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:46.055510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621316+0000","last_change":"2024-09-10T08:28:46.618917+0000","last_active":"2024-09-10T08:28:48.621316+0000","last_peered":"2024-09-10T08:28:48.621316+0000","last_clean":"2024-09-10T08:28:48.621316+0000","last_became_active":"2024-09-10T08:28:46.618625+0000","last_became_peered":"2024-09-10T08:28:46.618625+0000","last_unstale":"2024-09-10T08:28:48.621316+0000","last_undegraded":"2024-09-10T08:28:48.621316+0000","last_fullsized":"2024-09-10T08:28:48.621316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:19.431857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354237+0000","last_change":"2024-09-10T08:28:47.630243+0000","last_active":"2024-09-10T08:28:49.354237+0000","last_peered":"2024-09-10T08:28:49.354237+0000","last_clean":"2024-09-10T08:28:49.354237+0000","last_became_active":"2024-09-10T08:28:47.629869+0000","last_became_peered":"2024-09-10T08:28:47.629869+0000","last_unstale":"2024-09-10T08:28:49.354237+0000","last_undegraded":"2024-09-10T08:28:49.354237+0000","last_fullsized":"2024-09-10T08:28:49.354237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:58.696156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621683+0000","last_change":"2024-09-10T08:28:35.572944+0000","last_active":"2024-09-10T08:28:48.621683+0000","last_peered":"2024-09-10T08:28:48.621683+0000","last_clean":"2024-09-10T08:28:48.621683+0000","last_became_active":"2024-09-10T08:28:35.572620+0000","last_became_peered":"2024-09-10T08:28:35.572620+0000","last_unstale":"2024-09-10T08:28:48.621683+0000","last_undegraded":"2024-09-10T08:28:48.621683+0000","last_fullsized":"2024-09-10T08:28:48.621683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:04.524048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.619511+0000","last_change":"2024-09-10T08:28:34.562935+0000","last_active":"2024-09-10T08:28:47.619511+0000","last_peered":"2024-09-10T08:28:47.619511+0000","last_clean":"2024-09-10T08:28:47.619511+0000","last_became_active":"2024-09-10T08:28:34.562647+0000","last_became_peered":"2024-09-10T08:28:34.562647+0000","last_unstale":"2024-09-10T08:28:47.619511+0000","last_undegraded":"2024-09-10T08:28:47.619511+0000","last_fullsized":"2024-09-10T08:28:47.619511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:47.492281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621382+0000","last_change":"2024-09-10T08:28:46.621472+0000","last_active":"2024-09-10T08:28:48.621382+0000","last_peered":"2024-09-10T08:28:48.621382+0000","last_clean":"2024-09-10T08:28:48.621382+0000","last_became_active":"2024-09-10T08:28:46.621157+0000","last_became_peered":"2024-09-10T08:28:46.621157+0000","last_unstale":"2024-09-10T08:28:48.621382+0000","last_undegraded":"2024-09-10T08:28:48.621382+0000","last_fullsized":"2024-09-10T08:28:48.621382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:44.166068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.634964+0000","last_change":"2024-09-10T08:28:47.627750+0000","last_active":"2024-09-10T08:28:47.634964+0000","last_peered":"2024-09-10T08:28:47.634964+0000","last_clean":"2024-09-10T08:28:47.634964+0000","last_became_active":"2024-09-10T08:28:47.627481+0000","last_became_peered":"2024-09-10T08:28:47.627481+0000","last_unstale":"2024-09-10T08:28:47.634964+0000","last_undegraded":"2024-09-10T08:28:47.634964+0000","last_fullsized":"2024-09-10T08:28:47.634964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:10.323020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631930+0000","last_change":"2024-09-10T08:28:46.620162+0000","last_active":"2024-09-10T08:28:48.631930+0000","last_peered":"2024-09-10T08:28:48.631930+0000","last_clean":"2024-09-10T08:28:48.631930+0000","last_became_active":"2024-09-10T08:28:46.619843+0000","last_became_peered":"2024-09-10T08:28:46.619843+0000","last_unstale":"2024-09-10T08:28:48.631930+0000","last_undegraded":"2024-09-10T08:28:48.631930+0000","last_fullsized":"2024-09-10T08:28:48.631930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:21.376123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633938+0000","last_change":"2024-09-10T08:28:35.572803+0000","last_active":"2024-09-10T08:28:48.633938+0000","last_peered":"2024-09-10T08:28:48.633938+0000","last_clean":"2024-09-10T08:28:48.633938+0000","last_became_active":"2024-09-10T08:28:35.572219+0000","last_became_peered":"2024-09-10T08:28:35.572219+0000","last_unstale":"2024-09-10T08:28:48.633938+0000","last_undegraded":"2024-09-10T08:28:48.633938+0000","last_fullsized":"2024-09-10T08:28:48.633938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:45.920218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620645+0000","last_change":"2024-09-10T08:28:34.554346+0000","last_active":"2024-09-10T08:28:48.620645+0000","last_peered":"2024-09-10T08:28:48.620645+0000","last_clean":"2024-09-10T08:28:48.620645+0000","last_became_active":"2024-09-10T08:28:34.553933+0000","last_became_peered":"2024-09-10T08:28:34.553933+0000","last_unstale":"2024-09-10T08:28:48.620645+0000","last_undegraded":"2024-09-10T08:28:48.620645+0000","last_fullsized":"2024-09-10T08:28:48.620645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:07.639671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631936+0000","last_change":"2024-09-10T08:28:47.629468+0000","last_active":"2024-09-10T08:28:48.631936+0000","last_peered":"2024-09-10T08:28:48.631936+0000","last_clean":"2024-09-10T08:28:48.631936+0000","last_became_active":"2024-09-10T08:28:47.629177+0000","last_became_peered":"2024-09-10T08:28:47.629177+0000","last_unstale":"2024-09-10T08:28:48.631936+0000","last_undegraded":"2024-09-10T08:28:48.631936+0000","last_fullsized":"2024-09-10T08:28:48.631936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:10.443235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.640842+0000","last_change":"2024-09-10T08:28:46.630904+0000","last_active":"2024-09-10T08:28:47.640842+0000","last_peered":"2024-09-10T08:28:47.640842+0000","last_clean":"2024-09-10T08:28:47.640842+0000","last_became_active":"2024-09-10T08:28:46.630530+0000","last_became_peered":"2024-09-10T08:28:46.630530+0000","last_unstale":"2024-09-10T08:28:47.640842+0000","last_undegraded":"2024-09-10T08:28:47.640842+0000","last_fullsized":"2024-09-10T08:28:47.640842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:33.599739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621556+0000","last_change":"2024-09-10T08:28:35.580244+0000","last_active":"2024-09-10T08:28:48.621556+0000","last_peered":"2024-09-10T08:28:48.621556+0000","last_clean":"2024-09-10T08:28:48.621556+0000","last_became_active":"2024-09-10T08:28:35.579975+0000","last_became_peered":"2024-09-10T08:28:35.579975+0000","last_unstale":"2024-09-10T08:28:48.621556+0000","last_undegraded":"2024-09-10T08:28:48.621556+0000","last_fullsized":"2024-09-10T08:28:48.621556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:16.498045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621654+0000","last_change":"2024-09-10T08:28:34.564751+0000","last_active":"2024-09-10T08:28:48.621654+0000","last_peered":"2024-09-10T08:28:48.621654+0000","last_clean":"2024-09-10T08:28:48.621654+0000","last_became_active":"2024-09-10T08:28:34.564479+0000","last_became_peered":"2024-09-10T08:28:34.564479+0000","last_unstale":"2024-09-10T08:28:48.621654+0000","last_undegraded":"2024-09-10T08:28:48.621654+0000","last_fullsized":"2024-09-10T08:28:48.621654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:29.618224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634645+0000","last_change":"2024-09-10T08:28:47.627041+0000","last_active":"2024-09-10T08:28:48.634645+0000","last_peered":"2024-09-10T08:28:48.634645+0000","last_clean":"2024-09-10T08:28:48.634645+0000","last_became_active":"2024-09-10T08:28:47.626692+0000","last_became_peered":"2024-09-10T08:28:47.626692+0000","last_unstale":"2024-09-10T08:28:48.634645+0000","last_undegraded":"2024-09-10T08:28:48.634645+0000","last_fullsized":"2024-09-10T08:28:48.634645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:57.666849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.618194+0000","last_change":"2024-09-10T08:28:34.561906+0000","last_active":"2024-09-10T08:28:47.618194+0000","last_peered":"2024-09-10T08:28:47.618194+0000","last_clean":"2024-09-10T08:28:47.618194+0000","last_became_active":"2024-09-10T08:28:34.561613+0000","last_became_peered":"2024-09-10T08:28:34.561613+0000","last_unstale":"2024-09-10T08:28:47.618194+0000","last_undegraded":"2024-09-10T08:28:47.618194+0000","last_fullsized":"2024-09-10T08:28:47.618194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:56.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632248+0000","last_change":"2024-09-10T08:28:35.576406+0000","last_active":"2024-09-10T08:28:48.632248+0000","last_peered":"2024-09-10T08:28:48.632248+0000","last_clean":"2024-09-10T08:28:48.632248+0000","last_became_active":"2024-09-10T08:28:35.576145+0000","last_became_peered":"2024-09-10T08:28:35.576145+0000","last_unstale":"2024-09-10T08:28:48.632248+0000","last_undegraded":"2024-09-10T08:28:48.632248+0000","last_fullsized":"2024-09-10T08:28:48.632248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:57.667098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.641416+0000","last_change":"2024-09-10T08:28:46.622395+0000","last_active":"2024-09-10T08:28:47.641416+0000","last_peered":"2024-09-10T08:28:47.641416+0000","last_clean":"2024-09-10T08:28:47.641416+0000","last_became_active":"2024-09-10T08:28:46.621941+0000","last_became_peered":"2024-09-10T08:28:46.621941+0000","last_unstale":"2024-09-10T08:28:47.641416+0000","last_undegraded":"2024-09-10T08:28:47.641416+0000","last_fullsized":"2024-09-10T08:28:47.641416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:54.928969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621387+0000","last_change":"2024-09-10T08:28:47.626495+0000","last_active":"2024-09-10T08:28:48.621387+0000","last_peered":"2024-09-10T08:28:48.621387+0000","last_clean":"2024-09-10T08:28:48.621387+0000","last_became_active":"2024-09-10T08:28:47.625258+0000","last_became_peered":"2024-09-10T08:28:47.625258+0000","last_unstale":"2024-09-10T08:28:48.621387+0000","last_undegraded":"2024-09-10T08:28:48.621387+0000","last_fullsized":"2024-09-10T08:28:48.621387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:00.101586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622005+0000","last_change":"2024-09-10T08:28:34.566606+0000","last_active":"2024-09-10T08:28:48.622005+0000","last_peered":"2024-09-10T08:28:48.622005+0000","last_clean":"2024-09-10T08:28:48.622005+0000","last_became_active":"2024-09-10T08:28:34.566388+0000","last_became_peered":"2024-09-10T08:28:34.566388+0000","last_unstale":"2024-09-10T08:28:48.622005+0000","last_undegraded":"2024-09-10T08:28:48.622005+0000","last_fullsized":"2024-09-10T08:28:48.622005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:33.528801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621394+0000","last_change":"2024-09-10T08:28:35.559371+0000","last_active":"2024-09-10T08:28:48.621394+0000","last_peered":"2024-09-10T08:28:48.621394+0000","last_clean":"2024-09-10T08:28:48.621394+0000","last_became_active":"2024-09-10T08:28:35.559145+0000","last_became_peered":"2024-09-10T08:28:35.559145+0000","last_unstale":"2024-09-10T08:28:48.621394+0000","last_undegraded":"2024-09-10T08:28:48.621394+0000","last_fullsized":"2024-09-10T08:28:48.621394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:57.339318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621811+0000","last_change":"2024-09-10T08:28:46.620231+0000","last_active":"2024-09-10T08:28:48.621811+0000","last_peered":"2024-09-10T08:28:48.621811+0000","last_clean":"2024-09-10T08:28:48.621811+0000","last_became_active":"2024-09-10T08:28:46.619403+0000","last_became_peered":"2024-09-10T08:28:46.619403+0000","last_unstale":"2024-09-10T08:28:48.621811+0000","last_undegraded":"2024-09-10T08:28:48.621811+0000","last_fullsized":"2024-09-10T08:28:48.621811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:26.308749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622383+0000","last_change":"2024-09-10T08:28:47.627135+0000","last_active":"2024-09-10T08:28:48.622383+0000","last_peered":"2024-09-10T08:28:48.622383+0000","last_clean":"2024-09-10T08:28:48.622383+0000","last_became_active":"2024-09-10T08:28:47.626791+0000","last_became_peered":"2024-09-10T08:28:47.626791+0000","last_unstale":"2024-09-10T08:28:48.622383+0000","last_undegraded":"2024-09-10T08:28:48.622383+0000","last_fullsized":"2024-09-10T08:28:48.622383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:43.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.617081+0000","last_change":"2024-09-10T08:28:35.579106+0000","last_active":"2024-09-10T08:28:47.617081+0000","last_peered":"2024-09-10T08:28:47.617081+0000","last_clean":"2024-09-10T08:28:47.617081+0000","last_became_active":"2024-09-10T08:28:35.578631+0000","last_became_peered":"2024-09-10T08:28:35.578631+0000","last_unstale":"2024-09-10T08:28:47.617081+0000","last_undegraded":"2024-09-10T08:28:47.617081+0000","last_fullsized":"2024-09-10T08:28:47.617081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:31.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634751+0000","last_change":"2024-09-10T08:28:47.632052+0000","last_active":"2024-09-10T08:28:48.634751+0000","last_peered":"2024-09-10T08:28:48.634751+0000","last_clean":"2024-09-10T08:28:48.634751+0000","last_became_active":"2024-09-10T08:28:47.631578+0000","last_became_peered":"2024-09-10T08:28:47.631578+0000","last_unstale":"2024-09-10T08:28:48.634751+0000","last_undegraded":"2024-09-10T08:28:48.634751+0000","last_fullsized":"2024-09-10T08:28:48.634751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:24.570729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.606957+0000","last_change":"2024-09-10T08:28:35.566780+0000","last_active":"2024-09-10T08:28:47.606957+0000","last_peered":"2024-09-10T08:28:47.606957+0000","last_clean":"2024-09-10T08:28:47.606957+0000","last_became_active":"2024-09-10T08:28:35.566529+0000","last_became_peered":"2024-09-10T08:28:35.566529+0000","last_unstale":"2024-09-10T08:28:47.606957+0000","last_undegraded":"2024-09-10T08:28:47.606957+0000","last_fullsized":"2024-09-10T08:28:47.606957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:09.481166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621043+0000","last_change":"2024-09-10T08:28:47.629148+0000","last_active":"2024-09-10T08:28:48.621043+0000","last_peered":"2024-09-10T08:28:48.621043+0000","last_clean":"2024-09-10T08:28:48.621043+0000","last_became_active":"2024-09-10T08:28:47.628741+0000","last_became_peered":"2024-09-10T08:28:47.628741+0000","last_unstale":"2024-09-10T08:28:48.621043+0000","last_undegraded":"2024-09-10T08:28:48.621043+0000","last_fullsized":"2024-09-10T08:28:48.621043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:48.950503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621017+0000","last_change":"2024-09-10T08:28:35.578735+0000","last_active":"2024-09-10T08:28:48.621017+0000","last_peered":"2024-09-10T08:28:48.621017+0000","last_clean":"2024-09-10T08:28:48.621017+0000","last_became_active":"2024-09-10T08:28:35.577995+0000","last_became_peered":"2024-09-10T08:28:35.577995+0000","last_unstale":"2024-09-10T08:28:48.621017+0000","last_undegraded":"2024-09-10T08:28:48.621017+0000","last_fullsized":"2024-09-10T08:28:48.621017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:11.033441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634650+0000","last_change":"2024-09-10T08:28:47.628639+0000","last_active":"2024-09-10T08:28:48.634650+0000","last_peered":"2024-09-10T08:28:48.634650+0000","last_clean":"2024-09-10T08:28:48.634650+0000","last_became_active":"2024-09-10T08:28:47.628317+0000","last_became_peered":"2024-09-10T08:28:47.628317+0000","last_unstale":"2024-09-10T08:28:48.634650+0000","last_undegraded":"2024-09-10T08:28:48.634650+0000","last_fullsized":"2024-09-10T08:28:48.634650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:50.314678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632190+0000","last_change":"2024-09-10T08:28:35.577852+0000","last_active":"2024-09-10T08:28:48.632190+0000","last_peered":"2024-09-10T08:28:48.632190+0000","last_clean":"2024-09-10T08:28:48.632190+0000","last_became_active":"2024-09-10T08:28:35.577571+0000","last_became_peered":"2024-09-10T08:28:35.577571+0000","last_unstale":"2024-09-10T08:28:48.632190+0000","last_undegraded":"2024-09-10T08:28:48.632190+0000","last_fullsized":"2024-09-10T08:28:48.632190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:22.713732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354207+0000","last_change":"2024-09-10T08:28:47.629931+0000","last_active":"2024-09-10T08:28:49.354207+0000","last_peered":"2024-09-10T08:28:49.354207+0000","last_clean":"2024-09-10T08:28:49.354207+0000","last_became_active":"2024-09-10T08:28:47.629634+0000","last_became_peered":"2024-09-10T08:28:47.629634+0000","last_unstale":"2024-09-10T08:28:49.354207+0000","last_undegraded":"2024-09-10T08:28:49.354207+0000","last_fullsized":"2024-09-10T08:28:49.354207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:57.964208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622194+0000","last_change":"2024-09-10T08:28:35.574676+0000","last_active":"2024-09-10T08:28:48.622194+0000","last_peered":"2024-09-10T08:28:48.622194+0000","last_clean":"2024-09-10T08:28:48.622194+0000","last_became_active":"2024-09-10T08:28:35.574437+0000","last_became_peered":"2024-09-10T08:28:35.574437+0000","last_unstale":"2024-09-10T08:28:48.622194+0000","last_undegraded":"2024-09-10T08:28:48.622194+0000","last_fullsized":"2024-09-10T08:28:48.622194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:45.422506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620118+0000","last_change":"2024-09-10T08:28:47.624178+0000","last_active":"2024-09-10T08:28:48.620118+0000","last_peered":"2024-09-10T08:28:48.620118+0000","last_clean":"2024-09-10T08:28:48.620118+0000","last_became_active":"2024-09-10T08:28:47.623671+0000","last_became_peered":"2024-09-10T08:28:47.623671+0000","last_unstale":"2024-09-10T08:28:48.620118+0000","last_undegraded":"2024-09-10T08:28:48.620118+0000","last_fullsized":"2024-09-10T08:28:48.620118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:48.613870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634693+0000","last_change":"2024-09-10T08:28:35.572550+0000","last_active":"2024-09-10T08:28:48.634693+0000","last_peered":"2024-09-10T08:28:48.634693+0000","last_clean":"2024-09-10T08:28:48.634693+0000","last_became_active":"2024-09-10T08:28:35.572184+0000","last_became_peered":"2024-09-10T08:28:35.572184+0000","last_unstale":"2024-09-10T08:28:48.634693+0000","last_undegraded":"2024-09-10T08:28:48.634693+0000","last_fullsized":"2024-09-10T08:28:48.634693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:08.490734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354228+0000","last_change":"2024-09-10T08:28:47.630214+0000","last_active":"2024-09-10T08:28:49.354228+0000","last_peered":"2024-09-10T08:28:49.354228+0000","last_clean":"2024-09-10T08:28:49.354228+0000","last_became_active":"2024-09-10T08:28:47.629512+0000","last_became_peered":"2024-09-10T08:28:47.629512+0000","last_unstale":"2024-09-10T08:28:49.354228+0000","last_undegraded":"2024-09-10T08:28:49.354228+0000","last_fullsized":"2024-09-10T08:28:49.354228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:35.692107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.619603+0000","last_change":"2024-09-10T08:28:35.573217+0000","last_active":"2024-09-10T08:28:47.619603+0000","last_peered":"2024-09-10T08:28:47.619603+0000","last_clean":"2024-09-10T08:28:47.619603+0000","last_became_active":"2024-09-10T08:28:35.572955+0000","last_became_peered":"2024-09-10T08:28:35.572955+0000","last_unstale":"2024-09-10T08:28:47.619603+0000","last_undegraded":"2024-09-10T08:28:47.619603+0000","last_fullsized":"2024-09-10T08:28:47.619603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:24.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.627308+0000","last_change":"2024-09-10T08:28:47.623365+0000","last_active":"2024-09-10T08:28:47.627308+0000","last_peered":"2024-09-10T08:28:47.627308+0000","last_clean":"2024-09-10T08:28:47.627308+0000","last_became_active":"2024-09-10T08:28:47.623082+0000","last_became_peered":"2024-09-10T08:28:47.623082+0000","last_unstale":"2024-09-10T08:28:47.627308+0000","last_undegraded":"2024-09-10T08:28:47.627308+0000","last_fullsized":"2024-09-10T08:28:47.627308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:44.700683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622192+0000","last_change":"2024-09-10T08:28:35.575902+0000","last_active":"2024-09-10T08:28:48.622192+0000","last_peered":"2024-09-10T08:28:48.622192+0000","last_clean":"2024-09-10T08:28:48.622192+0000","last_became_active":"2024-09-10T08:28:35.575614+0000","last_became_peered":"2024-09-10T08:28:35.575614+0000","last_unstale":"2024-09-10T08:28:48.622192+0000","last_undegraded":"2024-09-10T08:28:48.622192+0000","last_fullsized":"2024-09-10T08:28:48.622192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:11.277682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622312+0000","last_change":"2024-09-10T08:28:47.629795+0000","last_active":"2024-09-10T08:28:48.622312+0000","last_peered":"2024-09-10T08:28:48.622312+0000","last_clean":"2024-09-10T08:28:48.622312+0000","last_became_active":"2024-09-10T08:28:47.628861+0000","last_became_peered":"2024-09-10T08:28:47.628861+0000","last_unstale":"2024-09-10T08:28:48.622312+0000","last_undegraded":"2024-09-10T08:28:48.622312+0000","last_fullsized":"2024-09-10T08:28:48.622312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:06.277094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620538+0000","last_change":"2024-09-10T08:28:35.578285+0000","last_active":"2024-09-10T08:28:48.620538+0000","last_peered":"2024-09-10T08:28:48.620538+0000","last_clean":"2024-09-10T08:28:48.620538+0000","last_became_active":"2024-09-10T08:28:35.576805+0000","last_became_peered":"2024-09-10T08:28:35.576805+0000","last_unstale":"2024-09-10T08:28:48.620538+0000","last_undegraded":"2024-09-10T08:28:48.620538+0000","last_fullsized":"2024-09-10T08:28:48.620538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:46.203320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355252+0000","last_change":"2024-09-10T08:28:47.635713+0000","last_active":"2024-09-10T08:28:49.355252+0000","last_peered":"2024-09-10T08:28:49.355252+0000","last_clean":"2024-09-10T08:28:49.355252+0000","last_became_active":"2024-09-10T08:28:47.635381+0000","last_became_peered":"2024-09-10T08:28:47.635381+0000","last_unstale":"2024-09-10T08:28:49.355252+0000","last_undegraded":"2024-09-10T08:28:49.355252+0000","last_fullsized":"2024-09-10T08:28:49.355252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:39.419510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621520+0000","last_change":"2024-09-10T08:28:35.571566+0000","last_active":"2024-09-10T08:28:48.621520+0000","last_peered":"2024-09-10T08:28:48.621520+0000","last_clean":"2024-09-10T08:28:48.621520+0000","last_became_active":"2024-09-10T08:28:35.571285+0000","last_became_peered":"2024-09-10T08:28:35.571285+0000","last_unstale":"2024-09-10T08:28:48.621520+0000","last_undegraded":"2024-09-10T08:28:48.621520+0000","last_fullsized":"2024-09-10T08:28:48.621520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:23.587691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.621106+0000","last_change":"2024-09-10T08:28:47.619863+0000","last_active":"2024-09-10T08:28:47.621106+0000","last_peered":"2024-09-10T08:28:47.621106+0000","last_clean":"2024-09-10T08:28:47.621106+0000","last_became_active":"2024-09-10T08:28:47.619525+0000","last_became_peered":"2024-09-10T08:28:47.619525+0000","last_unstale":"2024-09-10T08:28:47.621106+0000","last_undegraded":"2024-09-10T08:28:47.621106+0000","last_fullsized":"2024-09-10T08:28:47.621106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:15.220842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620937+0000","last_change":"2024-09-10T08:28:35.568044+0000","last_active":"2024-09-10T08:28:48.620937+0000","last_peered":"2024-09-10T08:28:48.620937+0000","last_clean":"2024-09-10T08:28:48.620937+0000","last_became_active":"2024-09-10T08:28:35.567744+0000","last_became_peered":"2024-09-10T08:28:35.567744+0000","last_unstale":"2024-09-10T08:28:48.620937+0000","last_undegraded":"2024-09-10T08:28:48.620937+0000","last_fullsized":"2024-09-10T08:28:48.620937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:19.081138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621697+0000","last_change":"2024-09-10T08:28:47.629417+0000","last_active":"2024-09-10T08:28:48.621697+0000","last_peered":"2024-09-10T08:28:48.621697+0000","last_clean":"2024-09-10T08:28:48.621697+0000","last_became_active":"2024-09-10T08:28:47.629095+0000","last_became_peered":"2024-09-10T08:28:47.629095+0000","last_unstale":"2024-09-10T08:28:48.621697+0000","last_undegraded":"2024-09-10T08:28:48.621697+0000","last_fullsized":"2024-09-10T08:28:48.621697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:05.606381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632075+0000","last_change":"2024-09-10T08:28:35.575802+0000","last_active":"2024-09-10T08:28:48.632075+0000","last_peered":"2024-09-10T08:28:48.632075+0000","last_clean":"2024-09-10T08:28:48.632075+0000","last_became_active":"2024-09-10T08:28:35.575388+0000","last_became_peered":"2024-09-10T08:28:35.575388+0000","last_unstale":"2024-09-10T08:28:48.632075+0000","last_undegraded":"2024-09-10T08:28:48.632075+0000","last_fullsized":"2024-09-10T08:28:48.632075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:01.424265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620142+0000","last_change":"2024-09-10T08:28:47.624305+0000","last_active":"2024-09-10T08:28:48.620142+0000","last_peered":"2024-09-10T08:28:48.620142+0000","last_clean":"2024-09-10T08:28:48.620142+0000","last_became_active":"2024-09-10T08:28:47.624026+0000","last_became_peered":"2024-09-10T08:28:47.624026+0000","last_unstale":"2024-09-10T08:28:48.620142+0000","last_undegraded":"2024-09-10T08:28:48.620142+0000","last_fullsized":"2024-09-10T08:28:48.620142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:01.194271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.619820+0000","last_change":"2024-09-10T08:28:35.574499+0000","last_active":"2024-09-10T08:28:47.619820+0000","last_peered":"2024-09-10T08:28:47.619820+0000","last_clean":"2024-09-10T08:28:47.619820+0000","last_became_active":"2024-09-10T08:28:35.574249+0000","last_became_peered":"2024-09-10T08:28:35.574249+0000","last_unstale":"2024-09-10T08:28:47.619820+0000","last_undegraded":"2024-09-10T08:28:47.619820+0000","last_fullsized":"2024-09-10T08:28:47.619820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:55.952307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620349+0000","last_change":"2024-09-10T08:28:47.629525+0000","last_active":"2024-09-10T08:28:48.620349+0000","last_peered":"2024-09-10T08:28:48.620349+0000","last_clean":"2024-09-10T08:28:48.620349+0000","last_became_active":"2024-09-10T08:28:47.629259+0000","last_became_peered":"2024-09-10T08:28:47.629259+0000","last_unstale":"2024-09-10T08:28:48.620349+0000","last_undegraded":"2024-09-10T08:28:48.620349+0000","last_fullsized":"2024-09-10T08:28:48.620349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:11.864322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355002+0000","last_change":"2024-09-10T08:28:35.572709+0000","last_active":"2024-09-10T08:28:49.355002+0000","last_peered":"2024-09-10T08:28:49.355002+0000","last_clean":"2024-09-10T08:28:49.355002+0000","last_became_active":"2024-09-10T08:28:35.572392+0000","last_became_peered":"2024-09-10T08:28:35.572392+0000","last_unstale":"2024-09-10T08:28:49.355002+0000","last_undegraded":"2024-09-10T08:28:49.355002+0000","last_fullsized":"2024-09-10T08:28:49.355002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:42.636299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619769+0000","last_change":"2024-09-10T08:28:47.623285+0000","last_active":"2024-09-10T08:28:48.619769+0000","last_peered":"2024-09-10T08:28:48.619769+0000","last_clean":"2024-09-10T08:28:48.619769+0000","last_became_active":"2024-09-10T08:28:47.621776+0000","last_became_peered":"2024-09-10T08:28:47.621776+0000","last_unstale":"2024-09-10T08:28:48.619769+0000","last_undegraded":"2024-09-10T08:28:48.619769+0000","last_fullsized":"2024-09-10T08:28:48.619769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:32.543418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.608016+0000","last_change":"2024-09-10T08:28:35.574438+0000","last_active":"2024-09-10T08:28:47.608016+0000","last_peered":"2024-09-10T08:28:47.608016+0000","last_clean":"2024-09-10T08:28:47.608016+0000","last_became_active":"2024-09-10T08:28:35.574175+0000","last_became_peered":"2024-09-10T08:28:35.574175+0000","last_unstale":"2024-09-10T08:28:47.608016+0000","last_undegraded":"2024-09-10T08:28:47.608016+0000","last_fullsized":"2024-09-10T08:28:47.608016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:55.808543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631598+0000","last_change":"2024-09-10T08:28:47.629092+0000","last_active":"2024-09-10T08:28:48.631598+0000","last_peered":"2024-09-10T08:28:48.631598+0000","last_clean":"2024-09-10T08:28:48.631598+0000","last_became_active":"2024-09-10T08:28:47.628806+0000","last_became_peered":"2024-09-10T08:28:47.628806+0000","last_unstale":"2024-09-10T08:28:48.631598+0000","last_undegraded":"2024-09-10T08:28:48.631598+0000","last_fullsized":"2024-09-10T08:28:48.631598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:46.440290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622000+0000","last_change":"2024-09-10T08:28:35.567296+0000","last_active":"2024-09-10T08:28:48.622000+0000","last_peered":"2024-09-10T08:28:48.622000+0000","last_clean":"2024-09-10T08:28:48.622000+0000","last_became_active":"2024-09-10T08:28:35.567074+0000","last_became_peered":"2024-09-10T08:28:35.567074+0000","last_unstale":"2024-09-10T08:28:48.622000+0000","last_undegraded":"2024-09-10T08:28:48.622000+0000","last_fullsized":"2024-09-10T08:28:48.622000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:55.698345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634643+0000","last_change":"2024-09-10T08:28:47.631797+0000","last_active":"2024-09-10T08:28:48.634643+0000","last_peered":"2024-09-10T08:28:48.634643+0000","last_clean":"2024-09-10T08:28:48.634643+0000","last_became_active":"2024-09-10T08:28:47.631523+0000","last_became_peered":"2024-09-10T08:28:47.631523+0000","last_unstale":"2024-09-10T08:28:48.634643+0000","last_undegraded":"2024-09-10T08:28:48.634643+0000","last_fullsized":"2024-09-10T08:28:48.634643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:05.829116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619838+0000","last_change":"2024-09-10T08:28:35.570249+0000","last_active":"2024-09-10T08:28:48.619838+0000","last_peered":"2024-09-10T08:28:48.619838+0000","last_clean":"2024-09-10T08:28:48.619838+0000","last_became_active":"2024-09-10T08:28:35.569960+0000","last_became_peered":"2024-09-10T08:28:35.569960+0000","last_unstale":"2024-09-10T08:28:48.619838+0000","last_undegraded":"2024-09-10T08:28:48.619838+0000","last_fullsized":"2024-09-10T08:28:48.619838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:29.787554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620473+0000","last_change":"2024-09-10T08:28:47.633644+0000","last_active":"2024-09-10T08:28:48.620473+0000","last_peered":"2024-09-10T08:28:48.620473+0000","last_clean":"2024-09-10T08:28:48.620473+0000","last_became_active":"2024-09-10T08:28:47.633315+0000","last_became_peered":"2024-09-10T08:28:47.633315+0000","last_unstale":"2024-09-10T08:28:48.620473+0000","last_undegraded":"2024-09-10T08:28:48.620473+0000","last_fullsized":"2024-09-10T08:28:48.620473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:45:55.827386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634008+0000","last_change":"2024-09-10T08:28:35.560693+0000","last_active":"2024-09-10T08:28:48.634008+0000","last_peered":"2024-09-10T08:28:48.634008+0000","last_clean":"2024-09-10T08:28:48.634008+0000","last_became_active":"2024-09-10T08:28:35.560409+0000","last_became_peered":"2024-09-10T08:28:35.560409+0000","last_unstale":"2024-09-10T08:28:48.634008+0000","last_undegraded":"2024-09-10T08:28:48.634008+0000","last_fullsized":"2024-09-10T08:28:48.634008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:10.597654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621112+0000","last_change":"2024-09-10T08:28:47.622614+0000","last_active":"2024-09-10T08:28:48.621112+0000","last_peered":"2024-09-10T08:28:48.621112+0000","last_clean":"2024-09-10T08:28:48.621112+0000","last_became_active":"2024-09-10T08:28:47.622205+0000","last_became_peered":"2024-09-10T08:28:47.622205+0000","last_unstale":"2024-09-10T08:28:48.621112+0000","last_undegraded":"2024-09-10T08:28:48.621112+0000","last_fullsized":"2024-09-10T08:28:48.621112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:47.090782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631666+0000","last_change":"2024-09-10T08:28:35.574551+0000","last_active":"2024-09-10T08:28:48.631666+0000","last_peered":"2024-09-10T08:28:48.631666+0000","last_clean":"2024-09-10T08:28:48.631666+0000","last_became_active":"2024-09-10T08:28:35.574256+0000","last_became_peered":"2024-09-10T08:28:35.574256+0000","last_unstale":"2024-09-10T08:28:48.631666+0000","last_undegraded":"2024-09-10T08:28:48.631666+0000","last_fullsized":"2024-09-10T08:28:48.631666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:43.401552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354791+0000","last_change":"2024-09-10T08:28:47.633476+0000","last_active":"2024-09-10T08:28:49.354791+0000","last_peered":"2024-09-10T08:28:49.354791+0000","last_clean":"2024-09-10T08:28:49.354791+0000","last_became_active":"2024-09-10T08:28:47.633189+0000","last_became_peered":"2024-09-10T08:28:47.633189+0000","last_unstale":"2024-09-10T08:28:49.354791+0000","last_undegraded":"2024-09-10T08:28:49.354791+0000","last_fullsized":"2024-09-10T08:28:49.354791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:46.175490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621900+0000","last_change":"2024-09-10T08:28:35.573330+0000","last_active":"2024-09-10T08:28:48.621900+0000","last_peered":"2024-09-10T08:28:48.621900+0000","last_clean":"2024-09-10T08:28:48.621900+0000","last_became_active":"2024-09-10T08:28:35.572992+0000","last_became_peered":"2024-09-10T08:28:35.572992+0000","last_unstale":"2024-09-10T08:28:48.621900+0000","last_undegraded":"2024-09-10T08:28:48.621900+0000","last_fullsized":"2024-09-10T08:28:48.621900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:15.412219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621967+0000","last_change":"2024-09-10T08:28:47.630733+0000","last_active":"2024-09-10T08:28:48.621967+0000","last_peered":"2024-09-10T08:28:48.621967+0000","last_clean":"2024-09-10T08:28:48.621967+0000","last_became_active":"2024-09-10T08:28:47.630447+0000","last_became_peered":"2024-09-10T08:28:47.630447+0000","last_unstale":"2024-09-10T08:28:48.621967+0000","last_undegraded":"2024-09-10T08:28:48.621967+0000","last_fullsized":"2024-09-10T08:28:48.621967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:08.797818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621594+0000","last_change":"2024-09-10T08:28:35.566574+0000","last_active":"2024-09-10T08:28:48.621594+0000","last_peered":"2024-09-10T08:28:48.621594+0000","last_clean":"2024-09-10T08:28:48.621594+0000","last_became_active":"2024-09-10T08:28:35.566205+0000","last_became_peered":"2024-09-10T08:28:35.566205+0000","last_unstale":"2024-09-10T08:28:48.621594+0000","last_undegraded":"2024-09-10T08:28:48.621594+0000","last_fullsized":"2024-09-10T08:28:48.621594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:49.876773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.632473+0000","last_change":"2024-09-10T08:28:47.628051+0000","last_active":"2024-09-10T08:28:47.632473+0000","last_peered":"2024-09-10T08:28:47.632473+0000","last_clean":"2024-09-10T08:28:47.632473+0000","last_became_active":"2024-09-10T08:28:47.627747+0000","last_became_peered":"2024-09-10T08:28:47.627747+0000","last_unstale":"2024-09-10T08:28:47.632473+0000","last_undegraded":"2024-09-10T08:28:47.632473+0000","last_fullsized":"2024-09-10T08:28:47.632473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:38.999743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.618654+0000","last_change":"2024-09-10T08:28:35.565023+0000","last_active":"2024-09-10T08:28:47.618654+0000","last_peered":"2024-09-10T08:28:47.618654+0000","last_clean":"2024-09-10T08:28:47.618654+0000","last_became_active":"2024-09-10T08:28:35.564747+0000","last_became_peered":"2024-09-10T08:28:35.564747+0000","last_unstale":"2024-09-10T08:28:47.618654+0000","last_undegraded":"2024-09-10T08:28:47.618654+0000","last_fullsized":"2024-09-10T08:28:47.618654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:32.419621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354688+0000","last_change":"2024-09-10T08:28:47.631047+0000","last_active":"2024-09-10T08:28:49.354688+0000","last_peered":"2024-09-10T08:28:49.354688+0000","last_clean":"2024-09-10T08:28:49.354688+0000","last_became_active":"2024-09-10T08:28:47.630617+0000","last_became_peered":"2024-09-10T08:28:47.630617+0000","last_unstale":"2024-09-10T08:28:49.354688+0000","last_undegraded":"2024-09-10T08:28:49.354688+0000","last_fullsized":"2024-09-10T08:28:49.354688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:29.867640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.619510+0000","last_change":"2024-09-10T08:28:35.570619+0000","last_active":"2024-09-10T08:28:47.619510+0000","last_peered":"2024-09-10T08:28:47.619510+0000","last_clean":"2024-09-10T08:28:47.619510+0000","last_became_active":"2024-09-10T08:28:35.570351+0000","last_became_peered":"2024-09-10T08:28:35.570351+0000","last_unstale":"2024-09-10T08:28:47.619510+0000","last_undegraded":"2024-09-10T08:28:47.619510+0000","last_fullsized":"2024-09-10T08:28:47.619510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:35.161279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620557+0000","last_change":"2024-09-10T08:28:47.626191+0000","last_active":"2024-09-10T08:28:48.620557+0000","last_peered":"2024-09-10T08:28:48.620557+0000","last_clean":"2024-09-10T08:28:48.620557+0000","last_became_active":"2024-09-10T08:28:47.625781+0000","last_became_peered":"2024-09-10T08:28:47.625781+0000","last_unstale":"2024-09-10T08:28:48.620557+0000","last_undegraded":"2024-09-10T08:28:48.620557+0000","last_fullsized":"2024-09-10T08:28:48.620557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:36:38.651973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355079+0000","last_change":"2024-09-10T08:28:35.577345+0000","last_active":"2024-09-10T08:28:49.355079+0000","last_peered":"2024-09-10T08:28:49.355079+0000","last_clean":"2024-09-10T08:28:49.355079+0000","last_became_active":"2024-09-10T08:28:35.576191+0000","last_became_peered":"2024-09-10T08:28:35.576191+0000","last_unstale":"2024-09-10T08:28:49.355079+0000","last_undegraded":"2024-09-10T08:28:49.355079+0000","last_fullsized":"2024-09-10T08:28:49.355079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:29.218797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622171+0000","last_change":"2024-09-10T08:28:47.623129+0000","last_active":"2024-09-10T08:28:48.622171+0000","last_peered":"2024-09-10T08:28:48.622171+0000","last_clean":"2024-09-10T08:28:48.622171+0000","last_became_active":"2024-09-10T08:28:47.622851+0000","last_became_peered":"2024-09-10T08:28:47.622851+0000","last_unstale":"2024-09-10T08:28:48.622171+0000","last_undegraded":"2024-09-10T08:28:48.622171+0000","last_fullsized":"2024-09-10T08:28:48.622171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:16.045213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621426+0000","last_change":"2024-09-10T08:28:35.575275+0000","last_active":"2024-09-10T08:28:48.621426+0000","last_peered":"2024-09-10T08:28:48.621426+0000","last_clean":"2024-09-10T08:28:48.621426+0000","last_became_active":"2024-09-10T08:28:35.575052+0000","last_became_peered":"2024-09-10T08:28:35.575052+0000","last_unstale":"2024-09-10T08:28:48.621426+0000","last_undegraded":"2024-09-10T08:28:48.621426+0000","last_fullsized":"2024-09-10T08:28:48.621426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:24.313017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.635033+0000","last_change":"2024-09-10T08:28:47.628651+0000","last_active":"2024-09-10T08:28:47.635033+0000","last_peered":"2024-09-10T08:28:47.635033+0000","last_clean":"2024-09-10T08:28:47.635033+0000","last_became_active":"2024-09-10T08:28:47.628343+0000","last_became_peered":"2024-09-10T08:28:47.628343+0000","last_unstale":"2024-09-10T08:28:47.635033+0000","last_undegraded":"2024-09-10T08:28:47.635033+0000","last_fullsized":"2024-09-10T08:28:47.635033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:07.325085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354299+0000","last_change":"2024-09-10T08:28:35.578664+0000","last_active":"2024-09-10T08:28:49.354299+0000","last_peered":"2024-09-10T08:28:49.354299+0000","last_clean":"2024-09-10T08:28:49.354299+0000","last_became_active":"2024-09-10T08:28:35.578384+0000","last_became_peered":"2024-09-10T08:28:35.578384+0000","last_unstale":"2024-09-10T08:28:49.354299+0000","last_undegraded":"2024-09-10T08:28:49.354299+0000","last_fullsized":"2024-09-10T08:28:49.354299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:44.278718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634174+0000","last_change":"2024-09-10T08:28:47.627593+0000","last_active":"2024-09-10T08:28:48.634174+0000","last_peered":"2024-09-10T08:28:48.634174+0000","last_clean":"2024-09-10T08:28:48.634174+0000","last_became_active":"2024-09-10T08:28:47.627237+0000","last_became_peered":"2024-09-10T08:28:47.627237+0000","last_unstale":"2024-09-10T08:28:48.634174+0000","last_undegraded":"2024-09-10T08:28:48.634174+0000","last_fullsized":"2024-09-10T08:28:48.634174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:16.045213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620920+0000","last_change":"2024-09-10T08:28:35.578978+0000","last_active":"2024-09-10T08:28:48.620920+0000","last_peered":"2024-09-10T08:28:48.620920+0000","last_clean":"2024-09-10T08:28:48.620920+0000","last_became_active":"2024-09-10T08:28:35.578475+0000","last_became_peered":"2024-09-10T08:28:35.578475+0000","last_unstale":"2024-09-10T08:28:48.620920+0000","last_undegraded":"2024-09-10T08:28:48.620920+0000","last_fullsized":"2024-09-10T08:28:48.620920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:08.520314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621323+0000","last_change":"2024-09-10T08:28:47.634072+0000","last_active":"2024-09-10T08:28:48.621323+0000","last_peered":"2024-09-10T08:28:48.621323+0000","last_clean":"2024-09-10T08:28:48.621323+0000","last_became_active":"2024-09-10T08:28:47.633776+0000","last_became_peered":"2024-09-10T08:28:47.633776+0000","last_unstale":"2024-09-10T08:28:48.621323+0000","last_undegraded":"2024-09-10T08:28:48.621323+0000","last_fullsized":"2024-09-10T08:28:48.621323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:30.690202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354159+0000","last_change":"2024-09-10T08:28:35.572112+0000","last_active":"2024-09-10T08:28:49.354159+0000","last_peered":"2024-09-10T08:28:49.354159+0000","last_clean":"2024-09-10T08:28:49.354159+0000","last_became_active":"2024-09-10T08:28:35.571803+0000","last_became_peered":"2024-09-10T08:28:35.571803+0000","last_unstale":"2024-09-10T08:28:49.354159+0000","last_undegraded":"2024-09-10T08:28:49.354159+0000","last_fullsized":"2024-09-10T08:28:49.354159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:29.969987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621621+0000","last_change":"2024-09-10T08:28:47.620523+0000","last_active":"2024-09-10T08:28:48.621621+0000","last_peered":"2024-09-10T08:28:48.621621+0000","last_clean":"2024-09-10T08:28:48.621621+0000","last_became_active":"2024-09-10T08:28:47.620220+0000","last_became_peered":"2024-09-10T08:28:47.620220+0000","last_unstale":"2024-09-10T08:28:48.621621+0000","last_undegraded":"2024-09-10T08:28:48.621621+0000","last_fullsized":"2024-09-10T08:28:48.621621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:14.405210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621263+0000","last_change":"2024-09-10T08:28:35.578961+0000","last_active":"2024-09-10T08:28:48.621263+0000","last_peered":"2024-09-10T08:28:48.621263+0000","last_clean":"2024-09-10T08:28:48.621263+0000","last_became_active":"2024-09-10T08:28:35.578680+0000","last_became_peered":"2024-09-10T08:28:35.578680+0000","last_unstale":"2024-09-10T08:28:48.621263+0000","last_undegraded":"2024-09-10T08:28:48.621263+0000","last_fullsized":"2024-09-10T08:28:48.621263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:53.737412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:28:47.630179+0000","last_change":"2024-09-10T08:28:47.624859+0000","last_active":"2024-09-10T08:28:47.630179+0000","last_peered":"2024-09-10T08:28:47.630179+0000","last_clean":"2024-09-10T08:28:47.630179+0000","last_became_active":"2024-09-10T08:28:47.624585+0000","last_became_peered":"2024-09-10T08:28:47.624585+0000","last_unstale":"2024-09-10T08:28:47.630179+0000","last_undegraded":"2024-09-10T08:28:47.630179+0000","last_fullsized":"2024-09-10T08:28:47.630179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:07:09.719664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631870+0000","last_change":"2024-09-10T08:28:35.573918+0000","last_active":"2024-09-10T08:28:48.631870+0000","last_peered":"2024-09-10T08:28:48.631870+0000","last_clean":"2024-09-10T08:28:48.631870+0000","last_became_active":"2024-09-10T08:28:35.573646+0000","last_became_peered":"2024-09-10T08:28:35.573646+0000","last_unstale":"2024-09-10T08:28:48.631870+0000","last_undegraded":"2024-09-10T08:28:48.631870+0000","last_fullsized":"2024-09-10T08:28:48.631870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:24.295630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354036+0000","last_change":"2024-09-10T08:28:47.631802+0000","last_active":"2024-09-10T08:28:49.354036+0000","last_peered":"2024-09-10T08:28:49.354036+0000","last_clean":"2024-09-10T08:28:49.354036+0000","last_became_active":"2024-09-10T08:28:47.631456+0000","last_became_peered":"2024-09-10T08:28:47.631456+0000","last_unstale":"2024-09-10T08:28:49.354036+0000","last_undegraded":"2024-09-10T08:28:49.354036+0000","last_fullsized":"2024-09-10T08:28:49.354036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:56.571659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634799+0000","last_change":"2024-09-10T08:28:35.578197+0000","last_active":"2024-09-10T08:28:48.634799+0000","last_peered":"2024-09-10T08:28:48.634799+0000","last_clean":"2024-09-10T08:28:48.634799+0000","last_became_active":"2024-09-10T08:28:35.577852+0000","last_became_peered":"2024-09-10T08:28:35.577852+0000","last_unstale":"2024-09-10T08:28:48.634799+0000","last_undegraded":"2024-09-10T08:28:48.634799+0000","last_fullsized":"2024-09-10T08:28:48.634799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:44.348299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354168+0000","last_change":"2024-09-10T08:28:47.629993+0000","last_active":"2024-09-10T08:28:49.354168+0000","last_peered":"2024-09-10T08:28:49.354168+0000","last_clean":"2024-09-10T08:28:49.354168+0000","last_became_active":"2024-09-10T08:28:47.629713+0000","last_became_peered":"2024-09-10T08:28:47.629713+0000","last_unstale":"2024-09-10T08:28:49.354168+0000","last_undegraded":"2024-09-10T08:28:49.354168+0000","last_fullsized":"2024-09-10T08:28:49.354168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:56.640722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355024+0000","last_change":"2024-09-10T08:28:35.571065+0000","last_active":"2024-09-10T08:28:49.355024+0000","last_peered":"2024-09-10T08:28:49.355024+0000","last_clean":"2024-09-10T08:28:49.355024+0000","last_became_active":"2024-09-10T08:28:35.570749+0000","last_became_peered":"2024-09-10T08:28:35.570749+0000","last_unstale":"2024-09-10T08:28:49.355024+0000","last_undegraded":"2024-09-10T08:28:49.355024+0000","last_fullsized":"2024-09-10T08:28:49.355024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:04.628661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":692114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":101836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":101304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":104320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":102868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":864256,"data_stored":692080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":96195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":86390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:28:55.946 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:28:56.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.057+0000 7ff6df44c640 1 Processor -- start 2024-09-10T08:28:56.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.057+0000 7ff6df44c640 1 -- start start 2024-09-10T08:28:56.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.058+0000 7ff6df44c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6d80c4fe0 0x7ff6d806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.058+0000 7ff6df44c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff6d80c53c0 0x7ff6d8159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.058+0000 7ff6df44c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6d8067c30 con 0x7ff6d80adbc0 2024-09-10T08:28:56.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.058+0000 7ff6df44c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff6d806e640 con 0x7ff6d80c53c0 2024-09-10T08:28:56.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.058+0000 7ff6df44c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d806f140 con 0x7ff6d80c4fe0 2024-09-10T08:28:56.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.058+0000 7ff6dc9e7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff6d80c53c0 0x7ff6d8159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.058+0000 7ff6dd1e8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6d80c4fe0 0x7ff6d806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.058+0000 7ff6dd9e9640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff6d80adbc0 0x7ff6d81559c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:33382/0 (socket says 172.21.15.103:33382) 2024-09-10T08:28:56.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.058+0000 7ff6dd9e9640 1 -- 172.21.15.103:0/348980945 learned_addr learned my addr 172.21.15.103:0/348980945 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:56.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.059+0000 7ff6cffff640 1 -- 172.21.15.103:0/348980945 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1742289918 0 0) 0x7ff6d8067c30 con 0x7ff6d80adbc0 2024-09-10T08:28:56.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.059+0000 7ff6cffff640 1 -- 172.21.15.103:0/348980945 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6c4003520 con 0x7ff6d80adbc0 2024-09-10T08:28:56.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.059+0000 7ff6dd1e8640 1 -- 172.21.15.103:0/348980945 >> v2:172.21.15.154:3300/0 conn(0x7ff6d80c53c0 msgr2=0x7ff6d8159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.059+0000 7ff6dd1e8640 1 --2- 172.21.15.103:0/348980945 >> v2:172.21.15.154:3300/0 conn(0x7ff6d80c53c0 0x7ff6d8159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.059+0000 7ff6dd1e8640 1 -- 172.21.15.103:0/348980945 >> v1:172.21.15.154:6789/0 conn(0x7ff6d80adbc0 legacy=0x7ff6d81559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.059+0000 7ff6dd1e8640 1 -- 172.21.15.103:0/348980945 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d8067f10 con 0x7ff6d80c4fe0 2024-09-10T08:28:56.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.059+0000 7ff6dc9e7640 1 --2- 172.21.15.103:0/348980945 >> v2:172.21.15.154:3300/0 conn(0x7ff6d80c53c0 0x7ff6d8159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:56.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.060+0000 7ff6dd1e8640 1 --2- 172.21.15.103:0/348980945 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6d80c4fe0 0x7ff6d806f5d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40097a0 tx=0x7ff6d402a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41bdc2aa1b788d2c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.060+0000 7ff6cffff640 1 -- 172.21.15.103:0/348980945 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4037070 con 0x7ff6d80c4fe0 2024-09-10T08:28:56.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.060+0000 7ff6cffff640 1 -- 172.21.15.103:0/348980945 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d402adb0 con 0x7ff6d80c4fe0 2024-09-10T08:28:56.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.060+0000 7ff6cffff640 1 -- 172.21.15.103:0/348980945 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4032640 con 0x7ff6d80c4fe0 2024-09-10T08:28:56.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.060+0000 7ff6df44c640 1 -- 172.21.15.103:0/348980945 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6d80c4fe0 msgr2=0x7ff6d806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.060+0000 7ff6df44c640 1 --2- 172.21.15.103:0/348980945 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6d80c4fe0 0x7ff6d806f5d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40097a0 tx=0x7ff6d402a060 comp rx=0 tx=0).stop 2024-09-10T08:28:56.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.060+0000 7ff6df44c640 1 -- 172.21.15.103:0/348980945 shutdown_connections 2024-09-10T08:28:56.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.060+0000 7ff6df44c640 1 --2- 172.21.15.103:0/348980945 >> v2:172.21.15.154:3300/0 conn(0x7ff6d80c53c0 0x7ff6d8159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.060+0000 7ff6df44c640 1 --2- 172.21.15.103:0/348980945 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6d80c4fe0 0x7ff6d806f5d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.060+0000 7ff6df44c640 1 -- 172.21.15.103:0/348980945 >> 172.21.15.103:0/348980945 conn(0x7ff6d80c8410 msgr2=0x7ff6d80c87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.061+0000 7ff6df44c640 1 -- 172.21.15.103:0/348980945 shutdown_connections 2024-09-10T08:28:56.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.061+0000 7ff6df44c640 1 -- 172.21.15.103:0/348980945 wait complete. 2024-09-10T08:28:56.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.062+0000 7ff6df44c640 1 Processor -- start 2024-09-10T08:28:56.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.062+0000 7ff6df44c640 1 -- start start 2024-09-10T08:28:56.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.062+0000 7ff6df44c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6d80adbc0 0x7ff6d81efa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.062+0000 7ff6df44c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6d80c4fe0 0x7ff6d80c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.062+0000 7ff6df44c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6d80c53c0 0x7ff6d80a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.062+0000 7ff6df44c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d806e3e0 con 0x7ff6d80c4fe0 2024-09-10T08:28:56.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.062+0000 7ff6df44c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d806e260 con 0x7ff6d80c53c0 2024-09-10T08:28:56.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.062+0000 7ff6df44c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d8159f80 con 0x7ff6d80adbc0 2024-09-10T08:28:56.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.063+0000 7ff6dc9e7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6d80c4fe0 0x7ff6d80c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.063+0000 7ff6dc9e7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6d80c4fe0 0x7ff6d80c74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49386/0 (socket says 172.21.15.103:49386) 2024-09-10T08:28:56.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.063+0000 7ff6dc9e7640 1 -- 172.21.15.103:0/1258864086 learned_addr learned my addr 172.21.15.103:0/1258864086 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:56.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.063+0000 7ff6dd1e8640 1 --2- 172.21.15.103:0/1258864086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6d80adbc0 0x7ff6d81efa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.063+0000 7ff6dd9e9640 1 --2- 172.21.15.103:0/1258864086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6d80c53c0 0x7ff6d80a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.063+0000 7ff6dc9e7640 1 -- 172.21.15.103:0/1258864086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6d80adbc0 msgr2=0x7ff6d81efa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.063+0000 7ff6dc9e7640 1 --2- 172.21.15.103:0/1258864086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6d80adbc0 0x7ff6d81efa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.063+0000 7ff6dc9e7640 1 -- 172.21.15.103:0/1258864086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6d80c53c0 msgr2=0x7ff6d80a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.063+0000 7ff6dc9e7640 1 --2- 172.21.15.103:0/1258864086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6d80c53c0 0x7ff6d80a9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.063+0000 7ff6dc9e7640 1 -- 172.21.15.103:0/1258864086 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d8159da0 con 0x7ff6d80c4fe0 2024-09-10T08:28:56.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.063+0000 7ff6dc9e7640 1 --2- 172.21.15.103:0/1258864086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6d80c4fe0 0x7ff6d80c74d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800e980 tx=0x7ff6c800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.063+0000 7ff6cdffb640 1 -- 172.21.15.103:0/1258864086 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8017070 con 0x7ff6d80c4fe0 2024-09-10T08:28:56.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.063+0000 7ff6cdffb640 1 -- 172.21.15.103:0/1258864086 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c800ca00 con 0x7ff6d80c4fe0 2024-09-10T08:28:56.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.063+0000 7ff6df44c640 1 -- 172.21.15.103:0/1258864086 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6d81597e0 con 0x7ff6d80c4fe0 2024-09-10T08:28:56.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.063+0000 7ff6cdffb640 1 -- 172.21.15.103:0/1258864086 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c800cdb0 con 0x7ff6d80c4fe0 2024-09-10T08:28:56.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.064+0000 7ff6df44c640 1 -- 172.21.15.103:0/1258864086 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6d8158970 con 0x7ff6d80c4fe0 2024-09-10T08:28:56.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.065+0000 7ff6df44c640 1 -- 172.21.15.103:0/1258864086 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6d80c3aa0 con 0x7ff6d80c4fe0 2024-09-10T08:28:56.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.065+0000 7ff6cdffb640 1 -- 172.21.15.103:0/1258864086 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff6c801a070 con 0x7ff6d80c4fe0 2024-09-10T08:28:56.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.065+0000 7ff6cdffb640 1 --2- 172.21.15.103:0/1258864086 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff6bc06be30 0x7ff6bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.066+0000 7ff6dd1e8640 1 --2- 172.21.15.103:0/1258864086 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff6bc06be30 0x7ff6bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.066+0000 7ff6cdffb640 1 -- 172.21.15.103:0/1258864086 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7ff6c808afc0 con 0x7ff6d80c4fe0 2024-09-10T08:28:56.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.066+0000 7ff6dd1e8640 1 --2- 172.21.15.103:0/1258864086 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff6bc06be30 0x7ff6bc06e2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4034000 tx=0x7ff6d402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.070+0000 7ff6cdffb640 1 -- 172.21.15.103:0/1258864086 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff6d8159da0 con 0x7ff6d80c4fe0 2024-09-10T08:28:56.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.230+0000 7ff6df44c640 1 -- 172.21.15.103:0/1258864086 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff6d81eff90 con 0x7ff6bc06be30 2024-09-10T08:28:56.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.240+0000 7ff6cdffb640 1 -- 172.21.15.103:0/1258864086 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490395 (secure 0 0 0) 0x7ff6d4004040 con 0x7ff6bc06be30 2024-09-10T08:28:56.246 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:56.249 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T08:28:56.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.245+0000 7ff6df44c640 1 -- 172.21.15.103:0/1258864086 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff6bc06be30 msgr2=0x7ff6bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.245+0000 7ff6df44c640 1 --2- 172.21.15.103:0/1258864086 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff6bc06be30 0x7ff6bc06e2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4034000 tx=0x7ff6d402e000 comp rx=0 tx=0).stop 2024-09-10T08:28:56.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.245+0000 7ff6df44c640 1 -- 172.21.15.103:0/1258864086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6d80c4fe0 msgr2=0x7ff6d80c74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.245+0000 7ff6df44c640 1 --2- 172.21.15.103:0/1258864086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6d80c4fe0 0x7ff6d80c74d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800e980 tx=0x7ff6c800ee40 comp rx=0 tx=0).stop 2024-09-10T08:28:56.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.245+0000 7ff6df44c640 1 -- 172.21.15.103:0/1258864086 shutdown_connections 2024-09-10T08:28:56.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.245+0000 7ff6df44c640 1 --2- 172.21.15.103:0/1258864086 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff6bc06be30 0x7ff6bc06e2f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.245+0000 7ff6df44c640 1 --2- 172.21.15.103:0/1258864086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6d80c53c0 0x7ff6d80a9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.245+0000 7ff6df44c640 1 --2- 172.21.15.103:0/1258864086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6d80c4fe0 0x7ff6d80c74d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.245+0000 7ff6df44c640 1 --2- 172.21.15.103:0/1258864086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6d80adbc0 0x7ff6d81efa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.245+0000 7ff6df44c640 1 -- 172.21.15.103:0/1258864086 >> 172.21.15.103:0/1258864086 conn(0x7ff6d80c8410 msgr2=0x7ff6d80accf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.245+0000 7ff6df44c640 1 -- 172.21.15.103:0/1258864086 shutdown_connections 2024-09-10T08:28:56.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.245+0000 7ff6df44c640 1 -- 172.21.15.103:0/1258864086 wait complete. 2024-09-10T08:28:56.256 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-10T08:28:54.797546+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":378,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219544,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755176,"statfs":{"total":773094113280,"available":772869300224,"internally_reserved":0,"allocated":3383296,"data_stored":1998968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001803"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619978+0000","last_change":"2024-09-10T08:28:47.627476+0000","last_active":"2024-09-10T08:28:48.619978+0000","last_peered":"2024-09-10T08:28:48.619978+0000","last_clean":"2024-09-10T08:28:48.619978+0000","last_became_active":"2024-09-10T08:28:47.627217+0000","last_became_peered":"2024-09-10T08:28:47.627217+0000","last_unstale":"2024-09-10T08:28:48.619978+0000","last_undegraded":"2024-09-10T08:28:48.619978+0000","last_fullsized":"2024-09-10T08:28:48.619978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:25.152836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632023+0000","last_change":"2024-09-10T08:28:34.564816+0000","last_active":"2024-09-10T08:28:48.632023+0000","last_peered":"2024-09-10T08:28:48.632023+0000","last_clean":"2024-09-10T08:28:48.632023+0000","last_became_active":"2024-09-10T08:28:34.564545+0000","last_became_peered":"2024-09-10T08:28:34.564545+0000","last_unstale":"2024-09-10T08:28:48.632023+0000","last_undegraded":"2024-09-10T08:28:48.632023+0000","last_fullsized":"2024-09-10T08:28:48.632023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:34.365104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622355+0000","last_change":"2024-09-10T08:28:35.575267+0000","last_active":"2024-09-10T08:28:48.622355+0000","last_peered":"2024-09-10T08:28:48.622355+0000","last_clean":"2024-09-10T08:28:48.622355+0000","last_became_active":"2024-09-10T08:28:35.575019+0000","last_became_peered":"2024-09-10T08:28:35.575019+0000","last_unstale":"2024-09-10T08:28:48.622355+0000","last_undegraded":"2024-09-10T08:28:48.622355+0000","last_fullsized":"2024-09-10T08:28:48.622355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:00.810645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621493+0000","last_change":"2024-09-10T08:28:46.620227+0000","last_active":"2024-09-10T08:28:48.621493+0000","last_peered":"2024-09-10T08:28:48.621493+0000","last_clean":"2024-09-10T08:28:48.621493+0000","last_became_active":"2024-09-10T08:28:46.619540+0000","last_became_peered":"2024-09-10T08:28:46.619540+0000","last_unstale":"2024-09-10T08:28:48.621493+0000","last_undegraded":"2024-09-10T08:28:48.621493+0000","last_fullsized":"2024-09-10T08:28:48.621493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:13.402155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633949+0000","last_change":"2024-09-10T08:28:47.633586+0000","last_active":"2024-09-10T08:28:48.633949+0000","last_peered":"2024-09-10T08:28:48.633949+0000","last_clean":"2024-09-10T08:28:48.633949+0000","last_became_active":"2024-09-10T08:28:47.633292+0000","last_became_peered":"2024-09-10T08:28:47.633292+0000","last_unstale":"2024-09-10T08:28:48.633949+0000","last_undegraded":"2024-09-10T08:28:48.633949+0000","last_fullsized":"2024-09-10T08:28:48.633949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:19.473028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622448+0000","last_change":"2024-09-10T08:28:34.561691+0000","last_active":"2024-09-10T08:28:48.622448+0000","last_peered":"2024-09-10T08:28:48.622448+0000","last_clean":"2024-09-10T08:28:48.622448+0000","last_became_active":"2024-09-10T08:28:34.561410+0000","last_became_peered":"2024-09-10T08:28:34.561410+0000","last_unstale":"2024-09-10T08:28:48.622448+0000","last_undegraded":"2024-09-10T08:28:48.622448+0000","last_fullsized":"2024-09-10T08:28:48.622448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.629982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631878+0000","last_change":"2024-09-10T08:28:35.579033+0000","last_active":"2024-09-10T08:28:48.631878+0000","last_peered":"2024-09-10T08:28:48.631878+0000","last_clean":"2024-09-10T08:28:48.631878+0000","last_became_active":"2024-09-10T08:28:35.578333+0000","last_became_peered":"2024-09-10T08:28:35.578333+0000","last_unstale":"2024-09-10T08:28:48.631878+0000","last_undegraded":"2024-09-10T08:28:48.631878+0000","last_fullsized":"2024-09-10T08:28:48.631878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:58.779491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619633+0000","last_change":"2024-09-10T08:28:46.617317+0000","last_active":"2024-09-10T08:28:48.619633+0000","last_peered":"2024-09-10T08:28:48.619633+0000","last_clean":"2024-09-10T08:28:48.619633+0000","last_became_active":"2024-09-10T08:28:46.616806+0000","last_became_peered":"2024-09-10T08:28:46.616806+0000","last_unstale":"2024-09-10T08:28:48.619633+0000","last_undegraded":"2024-09-10T08:28:48.619633+0000","last_fullsized":"2024-09-10T08:28:48.619633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:46.916848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354201+0000","last_change":"2024-09-10T08:28:47.633194+0000","last_active":"2024-09-10T08:28:49.354201+0000","last_peered":"2024-09-10T08:28:49.354201+0000","last_clean":"2024-09-10T08:28:49.354201+0000","last_became_active":"2024-09-10T08:28:47.632772+0000","last_became_peered":"2024-09-10T08:28:47.632772+0000","last_unstale":"2024-09-10T08:28:49.354201+0000","last_undegraded":"2024-09-10T08:28:49.354201+0000","last_fullsized":"2024-09-10T08:28:49.354201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:59.228438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354864+0000","last_change":"2024-09-10T08:28:34.571965+0000","last_active":"2024-09-10T08:28:49.354864+0000","last_peered":"2024-09-10T08:28:49.354864+0000","last_clean":"2024-09-10T08:28:49.354864+0000","last_became_active":"2024-09-10T08:28:34.571640+0000","last_became_peered":"2024-09-10T08:28:34.571640+0000","last_unstale":"2024-09-10T08:28:49.354864+0000","last_undegraded":"2024-09-10T08:28:49.354864+0000","last_fullsized":"2024-09-10T08:28:49.354864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:53.047030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621272+0000","last_change":"2024-09-10T08:28:35.562132+0000","last_active":"2024-09-10T08:28:48.621272+0000","last_peered":"2024-09-10T08:28:48.621272+0000","last_clean":"2024-09-10T08:28:48.621272+0000","last_became_active":"2024-09-10T08:28:35.561842+0000","last_became_peered":"2024-09-10T08:28:35.561842+0000","last_unstale":"2024-09-10T08:28:48.621272+0000","last_undegraded":"2024-09-10T08:28:48.621272+0000","last_fullsized":"2024-09-10T08:28:48.621272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:48.810258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620177+0000","last_change":"2024-09-10T08:28:46.621093+0000","last_active":"2024-09-10T08:28:48.620177+0000","last_peered":"2024-09-10T08:28:48.620177+0000","last_clean":"2024-09-10T08:28:48.620177+0000","last_became_active":"2024-09-10T08:28:46.620794+0000","last_became_peered":"2024-09-10T08:28:46.620794+0000","last_unstale":"2024-09-10T08:28:48.620177+0000","last_undegraded":"2024-09-10T08:28:48.620177+0000","last_fullsized":"2024-09-10T08:28:48.620177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:20.501262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620906+0000","last_change":"2024-09-10T08:28:47.627756+0000","last_active":"2024-09-10T08:28:48.620906+0000","last_peered":"2024-09-10T08:28:48.620906+0000","last_clean":"2024-09-10T08:28:48.620906+0000","last_became_active":"2024-09-10T08:28:47.627476+0000","last_became_peered":"2024-09-10T08:28:47.627476+0000","last_unstale":"2024-09-10T08:28:48.620906+0000","last_undegraded":"2024-09-10T08:28:48.620906+0000","last_fullsized":"2024-09-10T08:28:48.620906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:25.945793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354598+0000","last_change":"2024-09-10T08:28:34.566560+0000","last_active":"2024-09-10T08:28:49.354598+0000","last_peered":"2024-09-10T08:28:49.354598+0000","last_clean":"2024-09-10T08:28:49.354598+0000","last_became_active":"2024-09-10T08:28:34.566275+0000","last_became_peered":"2024-09-10T08:28:34.566275+0000","last_unstale":"2024-09-10T08:28:49.354598+0000","last_undegraded":"2024-09-10T08:28:49.354598+0000","last_fullsized":"2024-09-10T08:28:49.354598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:03.507683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621503+0000","last_change":"2024-09-10T08:28:35.560380+0000","last_active":"2024-09-10T08:28:48.621503+0000","last_peered":"2024-09-10T08:28:48.621503+0000","last_clean":"2024-09-10T08:28:48.621503+0000","last_became_active":"2024-09-10T08:28:35.560095+0000","last_became_peered":"2024-09-10T08:28:35.560095+0000","last_unstale":"2024-09-10T08:28:48.621503+0000","last_undegraded":"2024-09-10T08:28:48.621503+0000","last_fullsized":"2024-09-10T08:28:48.621503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:20.047446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621446+0000","last_change":"2024-09-10T08:28:46.620162+0000","last_active":"2024-09-10T08:28:48.621446+0000","last_peered":"2024-09-10T08:28:48.621446+0000","last_clean":"2024-09-10T08:28:48.621446+0000","last_became_active":"2024-09-10T08:28:46.619889+0000","last_became_peered":"2024-09-10T08:28:46.619889+0000","last_unstale":"2024-09-10T08:28:48.621446+0000","last_undegraded":"2024-09-10T08:28:48.621446+0000","last_fullsized":"2024-09-10T08:28:48.621446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:13.820143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634225+0000","last_change":"2024-09-10T08:28:47.631094+0000","last_active":"2024-09-10T08:28:48.634225+0000","last_peered":"2024-09-10T08:28:48.634225+0000","last_clean":"2024-09-10T08:28:48.634225+0000","last_became_active":"2024-09-10T08:28:47.630787+0000","last_became_peered":"2024-09-10T08:28:47.630787+0000","last_unstale":"2024-09-10T08:28:48.634225+0000","last_undegraded":"2024-09-10T08:28:48.634225+0000","last_fullsized":"2024-09-10T08:28:48.634225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:06.277094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421323+0000","last_change":"2024-09-10T08:28:35.572478+0000","last_active":"2024-09-10T08:28:49.421323+0000","last_peered":"2024-09-10T08:28:49.421323+0000","last_clean":"2024-09-10T08:28:49.421323+0000","last_became_active":"2024-09-10T08:28:35.572215+0000","last_became_peered":"2024-09-10T08:28:35.572215+0000","last_unstale":"2024-09-10T08:28:49.421323+0000","last_undegraded":"2024-09-10T08:28:49.421323+0000","last_fullsized":"2024-09-10T08:28:49.421323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:40.397318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354464+0000","last_change":"2024-09-10T08:28:34.569235+0000","last_active":"2024-09-10T08:28:49.354464+0000","last_peered":"2024-09-10T08:28:49.354464+0000","last_clean":"2024-09-10T08:28:49.354464+0000","last_became_active":"2024-09-10T08:28:34.568899+0000","last_became_peered":"2024-09-10T08:28:34.568899+0000","last_unstale":"2024-09-10T08:28:49.354464+0000","last_undegraded":"2024-09-10T08:28:49.354464+0000","last_fullsized":"2024-09-10T08:28:49.354464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:21.927656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620338+0000","last_change":"2024-09-10T08:28:46.618502+0000","last_active":"2024-09-10T08:28:48.620338+0000","last_peered":"2024-09-10T08:28:48.620338+0000","last_clean":"2024-09-10T08:28:48.620338+0000","last_became_active":"2024-09-10T08:28:46.616824+0000","last_became_peered":"2024-09-10T08:28:46.616824+0000","last_unstale":"2024-09-10T08:28:48.620338+0000","last_undegraded":"2024-09-10T08:28:48.620338+0000","last_fullsized":"2024-09-10T08:28:48.620338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:06.554102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299968+0000","last_change":"2024-09-10T08:28:47.627138+0000","last_active":"2024-09-10T08:28:49.299968+0000","last_peered":"2024-09-10T08:28:49.299968+0000","last_clean":"2024-09-10T08:28:49.299968+0000","last_became_active":"2024-09-10T08:28:47.626871+0000","last_became_peered":"2024-09-10T08:28:47.626871+0000","last_unstale":"2024-09-10T08:28:49.299968+0000","last_undegraded":"2024-09-10T08:28:49.299968+0000","last_fullsized":"2024-09-10T08:28:49.299968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:10.927283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621888+0000","last_change":"2024-09-10T08:28:35.577024+0000","last_active":"2024-09-10T08:28:48.621888+0000","last_peered":"2024-09-10T08:28:48.621888+0000","last_clean":"2024-09-10T08:28:48.621888+0000","last_became_active":"2024-09-10T08:28:35.576771+0000","last_became_peered":"2024-09-10T08:28:35.576771+0000","last_unstale":"2024-09-10T08:28:48.621888+0000","last_undegraded":"2024-09-10T08:28:48.621888+0000","last_fullsized":"2024-09-10T08:28:48.621888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:07.162941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634491+0000","last_change":"2024-09-10T08:28:34.561324+0000","last_active":"2024-09-10T08:28:48.634491+0000","last_peered":"2024-09-10T08:28:48.634491+0000","last_clean":"2024-09-10T08:28:48.634491+0000","last_became_active":"2024-09-10T08:28:34.560974+0000","last_became_peered":"2024-09-10T08:28:34.560974+0000","last_unstale":"2024-09-10T08:28:48.634491+0000","last_undegraded":"2024-09-10T08:28:48.634491+0000","last_fullsized":"2024-09-10T08:28:48.634491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:18.790965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621289+0000","last_change":"2024-09-10T08:28:46.620411+0000","last_active":"2024-09-10T08:28:48.621289+0000","last_peered":"2024-09-10T08:28:48.621289+0000","last_clean":"2024-09-10T08:28:48.621289+0000","last_became_active":"2024-09-10T08:28:46.619553+0000","last_became_peered":"2024-09-10T08:28:46.619553+0000","last_unstale":"2024-09-10T08:28:48.621289+0000","last_undegraded":"2024-09-10T08:28:48.621289+0000","last_fullsized":"2024-09-10T08:28:48.621289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:04.414048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620412+0000","last_change":"2024-09-10T08:28:47.628563+0000","last_active":"2024-09-10T08:28:48.620412+0000","last_peered":"2024-09-10T08:28:48.620412+0000","last_clean":"2024-09-10T08:28:48.620412+0000","last_became_active":"2024-09-10T08:28:47.628290+0000","last_became_peered":"2024-09-10T08:28:47.628290+0000","last_unstale":"2024-09-10T08:28:48.620412+0000","last_undegraded":"2024-09-10T08:28:48.620412+0000","last_fullsized":"2024-09-10T08:28:48.620412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:15.652718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621892+0000","last_change":"2024-09-10T08:28:35.572363+0000","last_active":"2024-09-10T08:28:48.621892+0000","last_peered":"2024-09-10T08:28:48.621892+0000","last_clean":"2024-09-10T08:28:48.621892+0000","last_became_active":"2024-09-10T08:28:35.572108+0000","last_became_peered":"2024-09-10T08:28:35.572108+0000","last_unstale":"2024-09-10T08:28:48.621892+0000","last_undegraded":"2024-09-10T08:28:48.621892+0000","last_fullsized":"2024-09-10T08:28:48.621892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:48.358634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634057+0000","last_change":"2024-09-10T08:28:34.564813+0000","last_active":"2024-09-10T08:28:48.634057+0000","last_peered":"2024-09-10T08:28:48.634057+0000","last_clean":"2024-09-10T08:28:48.634057+0000","last_became_active":"2024-09-10T08:28:34.564557+0000","last_became_peered":"2024-09-10T08:28:34.564557+0000","last_unstale":"2024-09-10T08:28:48.634057+0000","last_undegraded":"2024-09-10T08:28:48.634057+0000","last_fullsized":"2024-09-10T08:28:48.634057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:48.356069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634748+0000","last_change":"2024-09-10T08:28:46.625346+0000","last_active":"2024-09-10T08:28:48.634748+0000","last_peered":"2024-09-10T08:28:48.634748+0000","last_clean":"2024-09-10T08:28:48.634748+0000","last_became_active":"2024-09-10T08:28:46.625059+0000","last_became_peered":"2024-09-10T08:28:46.625059+0000","last_unstale":"2024-09-10T08:28:48.634748+0000","last_undegraded":"2024-09-10T08:28:48.634748+0000","last_fullsized":"2024-09-10T08:28:48.634748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:44.512285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621820+0000","last_change":"2024-09-10T08:28:47.621307+0000","last_active":"2024-09-10T08:28:48.621820+0000","last_peered":"2024-09-10T08:28:48.621820+0000","last_clean":"2024-09-10T08:28:48.621820+0000","last_became_active":"2024-09-10T08:28:47.621043+0000","last_became_peered":"2024-09-10T08:28:47.621043+0000","last_unstale":"2024-09-10T08:28:48.621820+0000","last_undegraded":"2024-09-10T08:28:48.621820+0000","last_fullsized":"2024-09-10T08:28:48.621820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:30.300108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620871+0000","last_change":"2024-09-10T08:28:35.569938+0000","last_active":"2024-09-10T08:28:48.620871+0000","last_peered":"2024-09-10T08:28:48.620871+0000","last_clean":"2024-09-10T08:28:48.620871+0000","last_became_active":"2024-09-10T08:28:35.569109+0000","last_became_peered":"2024-09-10T08:28:35.569109+0000","last_unstale":"2024-09-10T08:28:48.620871+0000","last_undegraded":"2024-09-10T08:28:48.620871+0000","last_fullsized":"2024-09-10T08:28:48.620871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:51.680564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354401+0000","last_change":"2024-09-10T08:28:34.571069+0000","last_active":"2024-09-10T08:28:49.354401+0000","last_peered":"2024-09-10T08:28:49.354401+0000","last_clean":"2024-09-10T08:28:49.354401+0000","last_became_active":"2024-09-10T08:28:34.570766+0000","last_became_peered":"2024-09-10T08:28:34.570766+0000","last_unstale":"2024-09-10T08:28:49.354401+0000","last_undegraded":"2024-09-10T08:28:49.354401+0000","last_fullsized":"2024-09-10T08:28:49.354401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:47.458195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620340+0000","last_change":"2024-09-10T08:28:46.616531+0000","last_active":"2024-09-10T08:28:48.620340+0000","last_peered":"2024-09-10T08:28:48.620340+0000","last_clean":"2024-09-10T08:28:48.620340+0000","last_became_active":"2024-09-10T08:28:46.616254+0000","last_became_peered":"2024-09-10T08:28:46.616254+0000","last_unstale":"2024-09-10T08:28:48.620340+0000","last_undegraded":"2024-09-10T08:28:48.620340+0000","last_fullsized":"2024-09-10T08:28:48.620340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:44.162368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621422+0000","last_change":"2024-09-10T08:28:47.628177+0000","last_active":"2024-09-10T08:28:48.621422+0000","last_peered":"2024-09-10T08:28:48.621422+0000","last_clean":"2024-09-10T08:28:48.621422+0000","last_became_active":"2024-09-10T08:28:47.627869+0000","last_became_peered":"2024-09-10T08:28:47.627869+0000","last_unstale":"2024-09-10T08:28:48.621422+0000","last_undegraded":"2024-09-10T08:28:48.621422+0000","last_fullsized":"2024-09-10T08:28:48.621422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:19.075558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632136+0000","last_change":"2024-09-10T08:28:35.575106+0000","last_active":"2024-09-10T08:28:48.632136+0000","last_peered":"2024-09-10T08:28:48.632136+0000","last_clean":"2024-09-10T08:28:48.632136+0000","last_became_active":"2024-09-10T08:28:35.574815+0000","last_became_peered":"2024-09-10T08:28:35.574815+0000","last_unstale":"2024-09-10T08:28:48.632136+0000","last_undegraded":"2024-09-10T08:28:48.632136+0000","last_fullsized":"2024-09-10T08:28:48.632136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:26.512181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421953+0000","last_change":"2024-09-10T08:28:34.564865+0000","last_active":"2024-09-10T08:28:49.421953+0000","last_peered":"2024-09-10T08:28:49.421953+0000","last_clean":"2024-09-10T08:28:49.421953+0000","last_became_active":"2024-09-10T08:28:34.564549+0000","last_became_peered":"2024-09-10T08:28:34.564549+0000","last_unstale":"2024-09-10T08:28:49.421953+0000","last_undegraded":"2024-09-10T08:28:49.421953+0000","last_fullsized":"2024-09-10T08:28:49.421953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:05.523637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620344+0000","last_change":"2024-09-10T08:28:46.622505+0000","last_active":"2024-09-10T08:28:48.620344+0000","last_peered":"2024-09-10T08:28:48.620344+0000","last_clean":"2024-09-10T08:28:48.620344+0000","last_became_active":"2024-09-10T08:28:46.621052+0000","last_became_peered":"2024-09-10T08:28:46.621052+0000","last_unstale":"2024-09-10T08:28:48.620344+0000","last_undegraded":"2024-09-10T08:28:48.620344+0000","last_fullsized":"2024-09-10T08:28:48.620344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:37.411404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620146+0000","last_change":"2024-09-10T08:28:47.624919+0000","last_active":"2024-09-10T08:28:48.620146+0000","last_peered":"2024-09-10T08:28:48.620146+0000","last_clean":"2024-09-10T08:28:48.620146+0000","last_became_active":"2024-09-10T08:28:47.624651+0000","last_became_peered":"2024-09-10T08:28:47.624651+0000","last_unstale":"2024-09-10T08:28:48.620146+0000","last_undegraded":"2024-09-10T08:28:48.620146+0000","last_fullsized":"2024-09-10T08:28:48.620146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:11.049160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622219+0000","last_change":"2024-09-10T08:28:35.574107+0000","last_active":"2024-09-10T08:28:48.622219+0000","last_peered":"2024-09-10T08:28:48.622219+0000","last_clean":"2024-09-10T08:28:48.622219+0000","last_became_active":"2024-09-10T08:28:35.573851+0000","last_became_peered":"2024-09-10T08:28:35.573851+0000","last_unstale":"2024-09-10T08:28:48.622219+0000","last_undegraded":"2024-09-10T08:28:48.622219+0000","last_fullsized":"2024-09-10T08:28:48.622219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:53.240223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634865+0000","last_change":"2024-09-10T08:28:34.563451+0000","last_active":"2024-09-10T08:28:48.634865+0000","last_peered":"2024-09-10T08:28:48.634865+0000","last_clean":"2024-09-10T08:28:48.634865+0000","last_became_active":"2024-09-10T08:28:34.563259+0000","last_became_peered":"2024-09-10T08:28:34.563259+0000","last_unstale":"2024-09-10T08:28:48.634865+0000","last_undegraded":"2024-09-10T08:28:48.634865+0000","last_fullsized":"2024-09-10T08:28:48.634865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:44.899351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621717+0000","last_change":"2024-09-10T08:28:46.623396+0000","last_active":"2024-09-10T08:28:48.621717+0000","last_peered":"2024-09-10T08:28:48.621717+0000","last_clean":"2024-09-10T08:28:48.621717+0000","last_became_active":"2024-09-10T08:28:46.623139+0000","last_became_peered":"2024-09-10T08:28:46.623139+0000","last_unstale":"2024-09-10T08:28:48.621717+0000","last_undegraded":"2024-09-10T08:28:48.621717+0000","last_fullsized":"2024-09-10T08:28:48.621717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:00.210413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421163+0000","last_change":"2024-09-10T08:28:47.634754+0000","last_active":"2024-09-10T08:28:49.421163+0000","last_peered":"2024-09-10T08:28:49.421163+0000","last_clean":"2024-09-10T08:28:49.421163+0000","last_became_active":"2024-09-10T08:28:47.634382+0000","last_became_peered":"2024-09-10T08:28:47.634382+0000","last_unstale":"2024-09-10T08:28:49.421163+0000","last_undegraded":"2024-09-10T08:28:49.421163+0000","last_fullsized":"2024-09-10T08:28:49.421163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:23.489596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634270+0000","last_change":"2024-09-10T08:28:35.567481+0000","last_active":"2024-09-10T08:28:48.634270+0000","last_peered":"2024-09-10T08:28:48.634270+0000","last_clean":"2024-09-10T08:28:48.634270+0000","last_became_active":"2024-09-10T08:28:35.567167+0000","last_became_peered":"2024-09-10T08:28:35.567167+0000","last_unstale":"2024-09-10T08:28:48.634270+0000","last_undegraded":"2024-09-10T08:28:48.634270+0000","last_fullsized":"2024-09-10T08:28:48.634270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:44.110012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355009+0000","last_change":"2024-09-10T08:28:34.571283+0000","last_active":"2024-09-10T08:28:49.355009+0000","last_peered":"2024-09-10T08:28:49.355009+0000","last_clean":"2024-09-10T08:28:49.355009+0000","last_became_active":"2024-09-10T08:28:34.570791+0000","last_became_peered":"2024-09-10T08:28:34.570791+0000","last_unstale":"2024-09-10T08:28:49.355009+0000","last_undegraded":"2024-09-10T08:28:49.355009+0000","last_fullsized":"2024-09-10T08:28:49.355009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:17.427597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631943+0000","last_change":"2024-09-10T08:28:46.630983+0000","last_active":"2024-09-10T08:28:48.631943+0000","last_peered":"2024-09-10T08:28:48.631943+0000","last_clean":"2024-09-10T08:28:48.631943+0000","last_became_active":"2024-09-10T08:28:46.630658+0000","last_became_peered":"2024-09-10T08:28:46.630658+0000","last_unstale":"2024-09-10T08:28:48.631943+0000","last_undegraded":"2024-09-10T08:28:48.631943+0000","last_fullsized":"2024-09-10T08:28:48.631943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:11.219022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632221+0000","last_change":"2024-09-10T08:28:47.625475+0000","last_active":"2024-09-10T08:28:48.632221+0000","last_peered":"2024-09-10T08:28:48.632221+0000","last_clean":"2024-09-10T08:28:48.632221+0000","last_became_active":"2024-09-10T08:28:47.625186+0000","last_became_peered":"2024-09-10T08:28:47.625186+0000","last_unstale":"2024-09-10T08:28:48.632221+0000","last_undegraded":"2024-09-10T08:28:48.632221+0000","last_fullsized":"2024-09-10T08:28:48.632221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:15.932769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621392+0000","last_change":"2024-09-10T08:28:35.576280+0000","last_active":"2024-09-10T08:28:48.621392+0000","last_peered":"2024-09-10T08:28:48.621392+0000","last_clean":"2024-09-10T08:28:48.621392+0000","last_became_active":"2024-09-10T08:28:35.576002+0000","last_became_peered":"2024-09-10T08:28:35.576002+0000","last_unstale":"2024-09-10T08:28:48.621392+0000","last_undegraded":"2024-09-10T08:28:48.621392+0000","last_fullsized":"2024-09-10T08:28:48.621392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:46.278441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634285+0000","last_change":"2024-09-10T08:28:34.555212+0000","last_active":"2024-09-10T08:28:48.634285+0000","last_peered":"2024-09-10T08:28:48.634285+0000","last_clean":"2024-09-10T08:28:48.634285+0000","last_became_active":"2024-09-10T08:28:34.554922+0000","last_became_peered":"2024-09-10T08:28:34.554922+0000","last_unstale":"2024-09-10T08:28:48.634285+0000","last_undegraded":"2024-09-10T08:28:48.634285+0000","last_fullsized":"2024-09-10T08:28:48.634285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634109+0000","last_change":"2024-09-10T08:28:46.624886+0000","last_active":"2024-09-10T08:28:48.634109+0000","last_peered":"2024-09-10T08:28:48.634109+0000","last_clean":"2024-09-10T08:28:48.634109+0000","last_became_active":"2024-09-10T08:28:46.624690+0000","last_became_peered":"2024-09-10T08:28:46.624690+0000","last_unstale":"2024-09-10T08:28:48.634109+0000","last_undegraded":"2024-09-10T08:28:48.634109+0000","last_fullsized":"2024-09-10T08:28:48.634109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:15.023379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631808+0000","last_change":"2024-09-10T08:28:47.634161+0000","last_active":"2024-09-10T08:28:48.631808+0000","last_peered":"2024-09-10T08:28:48.631808+0000","last_clean":"2024-09-10T08:28:48.631808+0000","last_became_active":"2024-09-10T08:28:47.633893+0000","last_became_peered":"2024-09-10T08:28:47.633893+0000","last_unstale":"2024-09-10T08:28:48.631808+0000","last_undegraded":"2024-09-10T08:28:48.631808+0000","last_fullsized":"2024-09-10T08:28:48.631808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:37.072370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620594+0000","last_change":"2024-09-10T08:28:35.577978+0000","last_active":"2024-09-10T08:28:48.620594+0000","last_peered":"2024-09-10T08:28:48.620594+0000","last_clean":"2024-09-10T08:28:48.620594+0000","last_became_active":"2024-09-10T08:28:35.577718+0000","last_became_peered":"2024-09-10T08:28:35.577718+0000","last_unstale":"2024-09-10T08:28:48.620594+0000","last_undegraded":"2024-09-10T08:28:48.620594+0000","last_fullsized":"2024-09-10T08:28:48.620594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:01:57.257817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621126+0000","last_change":"2024-09-10T08:28:34.553983+0000","last_active":"2024-09-10T08:28:48.621126+0000","last_peered":"2024-09-10T08:28:48.621126+0000","last_clean":"2024-09-10T08:28:48.621126+0000","last_became_active":"2024-09-10T08:28:34.553693+0000","last_became_peered":"2024-09-10T08:28:34.553693+0000","last_unstale":"2024-09-10T08:28:48.621126+0000","last_undegraded":"2024-09-10T08:28:48.621126+0000","last_fullsized":"2024-09-10T08:28:48.621126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:40.001685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634238+0000","last_change":"2024-09-10T08:28:46.620165+0000","last_active":"2024-09-10T08:28:48.634238+0000","last_peered":"2024-09-10T08:28:48.634238+0000","last_clean":"2024-09-10T08:28:48.634238+0000","last_became_active":"2024-09-10T08:28:46.619853+0000","last_became_peered":"2024-09-10T08:28:46.619853+0000","last_unstale":"2024-09-10T08:28:48.634238+0000","last_undegraded":"2024-09-10T08:28:48.634238+0000","last_fullsized":"2024-09-10T08:28:48.634238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:36.006532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.300010+0000","last_change":"2024-09-10T08:28:47.621588+0000","last_active":"2024-09-10T08:28:49.300010+0000","last_peered":"2024-09-10T08:28:49.300010+0000","last_clean":"2024-09-10T08:28:49.300010+0000","last_became_active":"2024-09-10T08:28:47.621122+0000","last_became_peered":"2024-09-10T08:28:47.621122+0000","last_unstale":"2024-09-10T08:28:49.300010+0000","last_undegraded":"2024-09-10T08:28:49.300010+0000","last_fullsized":"2024-09-10T08:28:49.300010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:11.250838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633943+0000","last_change":"2024-09-10T08:28:35.566745+0000","last_active":"2024-09-10T08:28:48.633943+0000","last_peered":"2024-09-10T08:28:48.633943+0000","last_clean":"2024-09-10T08:28:48.633943+0000","last_became_active":"2024-09-10T08:28:35.566444+0000","last_became_peered":"2024-09-10T08:28:35.566444+0000","last_unstale":"2024-09-10T08:28:48.633943+0000","last_undegraded":"2024-09-10T08:28:48.633943+0000","last_fullsized":"2024-09-10T08:28:48.633943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:52.735296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299738+0000","last_change":"2024-09-10T08:28:34.560745+0000","last_active":"2024-09-10T08:28:49.299738+0000","last_peered":"2024-09-10T08:28:49.299738+0000","last_clean":"2024-09-10T08:28:49.299738+0000","last_became_active":"2024-09-10T08:28:34.559911+0000","last_became_peered":"2024-09-10T08:28:34.559911+0000","last_unstale":"2024-09-10T08:28:49.299738+0000","last_undegraded":"2024-09-10T08:28:49.299738+0000","last_fullsized":"2024-09-10T08:28:49.299738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:00.234067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634838+0000","last_change":"2024-09-10T08:28:46.623886+0000","last_active":"2024-09-10T08:28:48.634838+0000","last_peered":"2024-09-10T08:28:48.634838+0000","last_clean":"2024-09-10T08:28:48.634838+0000","last_became_active":"2024-09-10T08:28:46.622790+0000","last_became_peered":"2024-09-10T08:28:46.622790+0000","last_unstale":"2024-09-10T08:28:48.634838+0000","last_undegraded":"2024-09-10T08:28:48.634838+0000","last_fullsized":"2024-09-10T08:28:48.634838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:06:32.333116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621918+0000","last_change":"2024-09-10T08:28:47.634500+0000","last_active":"2024-09-10T08:28:48.621918+0000","last_peered":"2024-09-10T08:28:48.621918+0000","last_clean":"2024-09-10T08:28:48.621918+0000","last_became_active":"2024-09-10T08:28:47.634219+0000","last_became_peered":"2024-09-10T08:28:47.634219+0000","last_unstale":"2024-09-10T08:28:48.621918+0000","last_undegraded":"2024-09-10T08:28:48.621918+0000","last_fullsized":"2024-09-10T08:28:48.621918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:59.689554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631587+0000","last_change":"2024-09-10T08:28:35.576360+0000","last_active":"2024-09-10T08:28:48.631587+0000","last_peered":"2024-09-10T08:28:48.631587+0000","last_clean":"2024-09-10T08:28:48.631587+0000","last_became_active":"2024-09-10T08:28:35.576096+0000","last_became_peered":"2024-09-10T08:28:35.576096+0000","last_unstale":"2024-09-10T08:28:48.631587+0000","last_undegraded":"2024-09-10T08:28:48.631587+0000","last_fullsized":"2024-09-10T08:28:48.631587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:34.159275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354630+0000","last_change":"2024-09-10T08:28:34.568477+0000","last_active":"2024-09-10T08:28:49.354630+0000","last_peered":"2024-09-10T08:28:49.354630+0000","last_clean":"2024-09-10T08:28:49.354630+0000","last_became_active":"2024-09-10T08:28:34.568249+0000","last_became_peered":"2024-09-10T08:28:34.568249+0000","last_unstale":"2024-09-10T08:28:49.354630+0000","last_undegraded":"2024-09-10T08:28:49.354630+0000","last_fullsized":"2024-09-10T08:28:49.354630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:08.640043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633193+0000","last_change":"2024-09-10T08:28:46.621567+0000","last_active":"2024-09-10T08:28:48.633193+0000","last_peered":"2024-09-10T08:28:48.633193+0000","last_clean":"2024-09-10T08:28:48.633193+0000","last_became_active":"2024-09-10T08:28:46.621272+0000","last_became_peered":"2024-09-10T08:28:46.621272+0000","last_unstale":"2024-09-10T08:28:48.633193+0000","last_undegraded":"2024-09-10T08:28:48.633193+0000","last_fullsized":"2024-09-10T08:28:48.633193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:37:34.936213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354521+0000","last_change":"2024-09-10T08:28:47.631621+0000","last_active":"2024-09-10T08:28:49.354521+0000","last_peered":"2024-09-10T08:28:49.354521+0000","last_clean":"2024-09-10T08:28:49.354521+0000","last_became_active":"2024-09-10T08:28:47.631337+0000","last_became_peered":"2024-09-10T08:28:47.631337+0000","last_unstale":"2024-09-10T08:28:49.354521+0000","last_undegraded":"2024-09-10T08:28:49.354521+0000","last_fullsized":"2024-09-10T08:28:49.354521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:04.196705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621993+0000","last_change":"2024-09-10T08:28:35.572658+0000","last_active":"2024-09-10T08:28:48.621993+0000","last_peered":"2024-09-10T08:28:48.621993+0000","last_clean":"2024-09-10T08:28:48.621993+0000","last_became_active":"2024-09-10T08:28:35.571611+0000","last_became_peered":"2024-09-10T08:28:35.571611+0000","last_unstale":"2024-09-10T08:28:48.621993+0000","last_undegraded":"2024-09-10T08:28:48.621993+0000","last_fullsized":"2024-09-10T08:28:48.621993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:42.726996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620845+0000","last_change":"2024-09-10T08:28:34.555587+0000","last_active":"2024-09-10T08:28:48.620845+0000","last_peered":"2024-09-10T08:28:48.620845+0000","last_clean":"2024-09-10T08:28:48.620845+0000","last_became_active":"2024-09-10T08:28:34.555269+0000","last_became_peered":"2024-09-10T08:28:34.555269+0000","last_unstale":"2024-09-10T08:28:48.620845+0000","last_undegraded":"2024-09-10T08:28:48.620845+0000","last_fullsized":"2024-09-10T08:28:48.620845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:19.499870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354756+0000","last_change":"2024-09-10T08:28:26.724394+0000","last_active":"2024-09-10T08:28:49.354756+0000","last_peered":"2024-09-10T08:28:49.354756+0000","last_clean":"2024-09-10T08:28:49.354756+0000","last_became_active":"2024-09-10T08:28:26.723452+0000","last_became_peered":"2024-09-10T08:28:26.723452+0000","last_unstale":"2024-09-10T08:28:49.354756+0000","last_undegraded":"2024-09-10T08:28:49.354756+0000","last_fullsized":"2024-09-10T08:28:49.354756+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_clean_scrub_stamp":"2024-09-10T08:28:25.445753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:00.811505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421307+0000","last_change":"2024-09-10T08:28:46.622048+0000","last_active":"2024-09-10T08:28:49.421307+0000","last_peered":"2024-09-10T08:28:49.421307+0000","last_clean":"2024-09-10T08:28:49.421307+0000","last_became_active":"2024-09-10T08:28:46.621770+0000","last_became_peered":"2024-09-10T08:28:46.621770+0000","last_unstale":"2024-09-10T08:28:49.421307+0000","last_undegraded":"2024-09-10T08:28:49.421307+0000","last_fullsized":"2024-09-10T08:28:49.421307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:51.430760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299891+0000","last_change":"2024-09-10T08:28:47.620746+0000","last_active":"2024-09-10T08:28:49.299891+0000","last_peered":"2024-09-10T08:28:49.299891+0000","last_clean":"2024-09-10T08:28:49.299891+0000","last_became_active":"2024-09-10T08:28:47.620492+0000","last_became_peered":"2024-09-10T08:28:47.620492+0000","last_unstale":"2024-09-10T08:28:49.299891+0000","last_undegraded":"2024-09-10T08:28:49.299891+0000","last_fullsized":"2024-09-10T08:28:49.299891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:40.117978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354858+0000","last_change":"2024-09-10T08:28:35.574532+0000","last_active":"2024-09-10T08:28:49.354858+0000","last_peered":"2024-09-10T08:28:49.354858+0000","last_clean":"2024-09-10T08:28:49.354858+0000","last_became_active":"2024-09-10T08:28:35.574215+0000","last_became_peered":"2024-09-10T08:28:35.574215+0000","last_unstale":"2024-09-10T08:28:49.354858+0000","last_undegraded":"2024-09-10T08:28:49.354858+0000","last_fullsized":"2024-09-10T08:28:49.354858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:28.455653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.300028+0000","last_change":"2024-09-10T08:28:34.559911+0000","last_active":"2024-09-10T08:28:49.300028+0000","last_peered":"2024-09-10T08:28:49.300028+0000","last_clean":"2024-09-10T08:28:49.300028+0000","last_became_active":"2024-09-10T08:28:34.559635+0000","last_became_peered":"2024-09-10T08:28:34.559635+0000","last_unstale":"2024-09-10T08:28:49.300028+0000","last_undegraded":"2024-09-10T08:28:49.300028+0000","last_fullsized":"2024-09-10T08:28:49.300028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:40.892609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421181+0000","last_change":"2024-09-10T08:28:46.620352+0000","last_active":"2024-09-10T08:28:49.421181+0000","last_peered":"2024-09-10T08:28:49.421181+0000","last_clean":"2024-09-10T08:28:49.421181+0000","last_became_active":"2024-09-10T08:28:46.620064+0000","last_became_peered":"2024-09-10T08:28:46.620064+0000","last_unstale":"2024-09-10T08:28:49.421181+0000","last_undegraded":"2024-09-10T08:28:49.421181+0000","last_fullsized":"2024-09-10T08:28:49.421181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:59.333579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299701+0000","last_change":"2024-09-10T08:28:47.620305+0000","last_active":"2024-09-10T08:28:49.299701+0000","last_peered":"2024-09-10T08:28:49.299701+0000","last_clean":"2024-09-10T08:28:49.299701+0000","last_became_active":"2024-09-10T08:28:47.620014+0000","last_became_peered":"2024-09-10T08:28:47.620014+0000","last_unstale":"2024-09-10T08:28:49.299701+0000","last_undegraded":"2024-09-10T08:28:49.299701+0000","last_fullsized":"2024-09-10T08:28:49.299701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:44.916136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621484+0000","last_change":"2024-09-10T08:28:35.577124+0000","last_active":"2024-09-10T08:28:48.621484+0000","last_peered":"2024-09-10T08:28:48.621484+0000","last_clean":"2024-09-10T08:28:48.621484+0000","last_became_active":"2024-09-10T08:28:35.576655+0000","last_became_peered":"2024-09-10T08:28:35.576655+0000","last_unstale":"2024-09-10T08:28:48.621484+0000","last_undegraded":"2024-09-10T08:28:48.621484+0000","last_fullsized":"2024-09-10T08:28:48.621484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:29.878600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634772+0000","last_change":"2024-09-10T08:28:34.560694+0000","last_active":"2024-09-10T08:28:48.634772+0000","last_peered":"2024-09-10T08:28:48.634772+0000","last_clean":"2024-09-10T08:28:48.634772+0000","last_became_active":"2024-09-10T08:28:34.560429+0000","last_became_peered":"2024-09-10T08:28:34.560429+0000","last_unstale":"2024-09-10T08:28:48.634772+0000","last_undegraded":"2024-09-10T08:28:48.634772+0000","last_fullsized":"2024-09-10T08:28:48.634772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:54.514467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631770+0000","last_change":"2024-09-10T08:28:46.622232+0000","last_active":"2024-09-10T08:28:48.631770+0000","last_peered":"2024-09-10T08:28:48.631770+0000","last_clean":"2024-09-10T08:28:48.631770+0000","last_became_active":"2024-09-10T08:28:46.621966+0000","last_became_peered":"2024-09-10T08:28:46.621966+0000","last_unstale":"2024-09-10T08:28:48.631770+0000","last_undegraded":"2024-09-10T08:28:48.631770+0000","last_fullsized":"2024-09-10T08:28:48.631770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:28.897045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354068+0000","last_change":"2024-09-10T08:28:47.630602+0000","last_active":"2024-09-10T08:28:49.354068+0000","last_peered":"2024-09-10T08:28:49.354068+0000","last_clean":"2024-09-10T08:28:49.354068+0000","last_became_active":"2024-09-10T08:28:47.630234+0000","last_became_peered":"2024-09-10T08:28:47.630234+0000","last_unstale":"2024-09-10T08:28:49.354068+0000","last_undegraded":"2024-09-10T08:28:49.354068+0000","last_fullsized":"2024-09-10T08:28:49.354068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:03.808098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355126+0000","last_change":"2024-09-10T08:28:35.577577+0000","last_active":"2024-09-10T08:28:49.355126+0000","last_peered":"2024-09-10T08:28:49.355126+0000","last_clean":"2024-09-10T08:28:49.355126+0000","last_became_active":"2024-09-10T08:28:35.576686+0000","last_became_peered":"2024-09-10T08:28:35.576686+0000","last_unstale":"2024-09-10T08:28:49.355126+0000","last_undegraded":"2024-09-10T08:28:49.355126+0000","last_fullsized":"2024-09-10T08:28:49.355126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:36.334494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.300074+0000","last_change":"2024-09-10T08:28:34.560313+0000","last_active":"2024-09-10T08:28:49.300074+0000","last_peered":"2024-09-10T08:28:49.300074+0000","last_clean":"2024-09-10T08:28:49.300074+0000","last_became_active":"2024-09-10T08:28:34.560035+0000","last_became_peered":"2024-09-10T08:28:34.560035+0000","last_unstale":"2024-09-10T08:28:49.300074+0000","last_undegraded":"2024-09-10T08:28:49.300074+0000","last_fullsized":"2024-09-10T08:28:49.300074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:56.945537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619792+0000","last_change":"2024-09-10T08:28:46.623371+0000","last_active":"2024-09-10T08:28:48.619792+0000","last_peered":"2024-09-10T08:28:48.619792+0000","last_clean":"2024-09-10T08:28:48.619792+0000","last_became_active":"2024-09-10T08:28:46.623092+0000","last_became_peered":"2024-09-10T08:28:46.623092+0000","last_unstale":"2024-09-10T08:28:48.619792+0000","last_undegraded":"2024-09-10T08:28:48.619792+0000","last_fullsized":"2024-09-10T08:28:48.619792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:36.359127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299671+0000","last_change":"2024-09-10T08:28:47.619805+0000","last_active":"2024-09-10T08:28:49.299671+0000","last_peered":"2024-09-10T08:28:49.299671+0000","last_clean":"2024-09-10T08:28:49.299671+0000","last_became_active":"2024-09-10T08:28:47.619452+0000","last_became_peered":"2024-09-10T08:28:47.619452+0000","last_unstale":"2024-09-10T08:28:49.299671+0000","last_undegraded":"2024-09-10T08:28:49.299671+0000","last_fullsized":"2024-09-10T08:28:49.299671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:20.052707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355004+0000","last_change":"2024-09-10T08:28:35.577476+0000","last_active":"2024-09-10T08:28:49.355004+0000","last_peered":"2024-09-10T08:28:49.355004+0000","last_clean":"2024-09-10T08:28:49.355004+0000","last_became_active":"2024-09-10T08:28:35.576786+0000","last_became_peered":"2024-09-10T08:28:35.576786+0000","last_unstale":"2024-09-10T08:28:49.355004+0000","last_undegraded":"2024-09-10T08:28:49.355004+0000","last_fullsized":"2024-09-10T08:28:49.355004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:46.914074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620800+0000","last_change":"2024-09-10T08:28:34.551102+0000","last_active":"2024-09-10T08:28:48.620800+0000","last_peered":"2024-09-10T08:28:48.620800+0000","last_clean":"2024-09-10T08:28:48.620800+0000","last_became_active":"2024-09-10T08:28:34.550773+0000","last_became_peered":"2024-09-10T08:28:34.550773+0000","last_unstale":"2024-09-10T08:28:48.620800+0000","last_undegraded":"2024-09-10T08:28:48.620800+0000","last_fullsized":"2024-09-10T08:28:48.620800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:35.393695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620218+0000","last_change":"2024-09-10T08:28:46.619639+0000","last_active":"2024-09-10T08:28:48.620218+0000","last_peered":"2024-09-10T08:28:48.620218+0000","last_clean":"2024-09-10T08:28:48.620218+0000","last_became_active":"2024-09-10T08:28:46.619330+0000","last_became_peered":"2024-09-10T08:28:46.619330+0000","last_unstale":"2024-09-10T08:28:48.620218+0000","last_undegraded":"2024-09-10T08:28:48.620218+0000","last_fullsized":"2024-09-10T08:28:48.620218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:10.371693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622150+0000","last_change":"2024-09-10T08:28:47.633627+0000","last_active":"2024-09-10T08:28:48.622150+0000","last_peered":"2024-09-10T08:28:48.622150+0000","last_clean":"2024-09-10T08:28:48.622150+0000","last_became_active":"2024-09-10T08:28:47.633362+0000","last_became_peered":"2024-09-10T08:28:47.633362+0000","last_unstale":"2024-09-10T08:28:48.622150+0000","last_undegraded":"2024-09-10T08:28:48.622150+0000","last_fullsized":"2024-09-10T08:28:48.622150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:19.473028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354525+0000","last_change":"2024-09-10T08:28:35.575307+0000","last_active":"2024-09-10T08:28:49.354525+0000","last_peered":"2024-09-10T08:28:49.354525+0000","last_clean":"2024-09-10T08:28:49.354525+0000","last_became_active":"2024-09-10T08:28:35.575038+0000","last_became_peered":"2024-09-10T08:28:35.575038+0000","last_unstale":"2024-09-10T08:28:49.354525+0000","last_undegraded":"2024-09-10T08:28:49.354525+0000","last_fullsized":"2024-09-10T08:28:49.354525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:36.478822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299678+0000","last_change":"2024-09-10T08:28:34.555542+0000","last_active":"2024-09-10T08:28:49.299678+0000","last_peered":"2024-09-10T08:28:49.299678+0000","last_clean":"2024-09-10T08:28:49.299678+0000","last_became_active":"2024-09-10T08:28:34.555179+0000","last_became_peered":"2024-09-10T08:28:34.555179+0000","last_unstale":"2024-09-10T08:28:49.299678+0000","last_undegraded":"2024-09-10T08:28:49.299678+0000","last_fullsized":"2024-09-10T08:28:49.299678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:53.313161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632119+0000","last_change":"2024-09-10T08:28:46.618615+0000","last_active":"2024-09-10T08:28:48.632119+0000","last_peered":"2024-09-10T08:28:48.632119+0000","last_clean":"2024-09-10T08:28:48.632119+0000","last_became_active":"2024-09-10T08:28:46.618318+0000","last_became_peered":"2024-09-10T08:28:46.618318+0000","last_unstale":"2024-09-10T08:28:48.632119+0000","last_undegraded":"2024-09-10T08:28:48.632119+0000","last_fullsized":"2024-09-10T08:28:48.632119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:44:08.185748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621616+0000","last_change":"2024-09-10T08:28:47.625025+0000","last_active":"2024-09-10T08:28:48.621616+0000","last_peered":"2024-09-10T08:28:48.621616+0000","last_clean":"2024-09-10T08:28:48.621616+0000","last_became_active":"2024-09-10T08:28:47.624230+0000","last_became_peered":"2024-09-10T08:28:47.624230+0000","last_unstale":"2024-09-10T08:28:48.621616+0000","last_undegraded":"2024-09-10T08:28:48.621616+0000","last_fullsized":"2024-09-10T08:28:48.621616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:25.530264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421027+0000","last_change":"2024-09-10T08:28:35.578892+0000","last_active":"2024-09-10T08:28:49.421027+0000","last_peered":"2024-09-10T08:28:49.421027+0000","last_clean":"2024-09-10T08:28:49.421027+0000","last_became_active":"2024-09-10T08:28:35.578299+0000","last_became_peered":"2024-09-10T08:28:35.578299+0000","last_unstale":"2024-09-10T08:28:49.421027+0000","last_undegraded":"2024-09-10T08:28:49.421027+0000","last_fullsized":"2024-09-10T08:28:49.421027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:27.485392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421503+0000","last_change":"2024-09-10T08:28:34.560444+0000","last_active":"2024-09-10T08:28:49.421503+0000","last_peered":"2024-09-10T08:28:49.421503+0000","last_clean":"2024-09-10T08:28:49.421503+0000","last_became_active":"2024-09-10T08:28:34.560188+0000","last_became_peered":"2024-09-10T08:28:34.560188+0000","last_unstale":"2024-09-10T08:28:49.421503+0000","last_undegraded":"2024-09-10T08:28:49.421503+0000","last_fullsized":"2024-09-10T08:28:49.421503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:15.727780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622124+0000","last_change":"2024-09-10T08:28:46.623483+0000","last_active":"2024-09-10T08:28:48.622124+0000","last_peered":"2024-09-10T08:28:48.622124+0000","last_clean":"2024-09-10T08:28:48.622124+0000","last_became_active":"2024-09-10T08:28:46.623211+0000","last_became_peered":"2024-09-10T08:28:46.623211+0000","last_unstale":"2024-09-10T08:28:48.622124+0000","last_undegraded":"2024-09-10T08:28:48.622124+0000","last_fullsized":"2024-09-10T08:28:48.622124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:24.611015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621121+0000","last_change":"2024-09-10T08:28:47.635185+0000","last_active":"2024-09-10T08:28:48.621121+0000","last_peered":"2024-09-10T08:28:48.621121+0000","last_clean":"2024-09-10T08:28:48.621121+0000","last_became_active":"2024-09-10T08:28:47.634782+0000","last_became_peered":"2024-09-10T08:28:47.634782+0000","last_unstale":"2024-09-10T08:28:48.621121+0000","last_undegraded":"2024-09-10T08:28:48.621121+0000","last_fullsized":"2024-09-10T08:28:48.621121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:05.512645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354247+0000","last_change":"2024-09-10T08:28:35.575788+0000","last_active":"2024-09-10T08:28:49.354247+0000","last_peered":"2024-09-10T08:28:49.354247+0000","last_clean":"2024-09-10T08:28:49.354247+0000","last_became_active":"2024-09-10T08:28:35.575333+0000","last_became_peered":"2024-09-10T08:28:35.575333+0000","last_unstale":"2024-09-10T08:28:49.354247+0000","last_undegraded":"2024-09-10T08:28:49.354247+0000","last_fullsized":"2024-09-10T08:28:49.354247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:39.756390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621367+0000","last_change":"2024-09-10T08:28:34.560699+0000","last_active":"2024-09-10T08:28:48.621367+0000","last_peered":"2024-09-10T08:28:48.621367+0000","last_clean":"2024-09-10T08:28:48.621367+0000","last_became_active":"2024-09-10T08:28:34.560376+0000","last_became_peered":"2024-09-10T08:28:34.560376+0000","last_unstale":"2024-09-10T08:28:48.621367+0000","last_undegraded":"2024-09-10T08:28:48.621367+0000","last_fullsized":"2024-09-10T08:28:48.621367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:09.981216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622076+0000","last_change":"2024-09-10T08:28:46.620745+0000","last_active":"2024-09-10T08:28:48.622076+0000","last_peered":"2024-09-10T08:28:48.622076+0000","last_clean":"2024-09-10T08:28:48.622076+0000","last_became_active":"2024-09-10T08:28:46.619030+0000","last_became_peered":"2024-09-10T08:28:46.619030+0000","last_unstale":"2024-09-10T08:28:48.622076+0000","last_undegraded":"2024-09-10T08:28:48.622076+0000","last_fullsized":"2024-09-10T08:28:48.622076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:07.653226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622129+0000","last_change":"2024-09-10T08:28:47.626648+0000","last_active":"2024-09-10T08:28:48.622129+0000","last_peered":"2024-09-10T08:28:48.622129+0000","last_clean":"2024-09-10T08:28:48.622129+0000","last_became_active":"2024-09-10T08:28:47.626330+0000","last_became_peered":"2024-09-10T08:28:47.626330+0000","last_unstale":"2024-09-10T08:28:48.622129+0000","last_undegraded":"2024-09-10T08:28:48.622129+0000","last_fullsized":"2024-09-10T08:28:48.622129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:02.346881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631691+0000","last_change":"2024-09-10T08:28:35.574810+0000","last_active":"2024-09-10T08:28:48.631691+0000","last_peered":"2024-09-10T08:28:48.631691+0000","last_clean":"2024-09-10T08:28:48.631691+0000","last_became_active":"2024-09-10T08:28:35.574567+0000","last_became_peered":"2024-09-10T08:28:35.574567+0000","last_unstale":"2024-09-10T08:28:48.631691+0000","last_undegraded":"2024-09-10T08:28:48.631691+0000","last_fullsized":"2024-09-10T08:28:48.631691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:29.315833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632297+0000","last_change":"2024-09-10T08:28:34.553556+0000","last_active":"2024-09-10T08:28:48.632297+0000","last_peered":"2024-09-10T08:28:48.632297+0000","last_clean":"2024-09-10T08:28:48.632297+0000","last_became_active":"2024-09-10T08:28:34.553275+0000","last_became_peered":"2024-09-10T08:28:34.553275+0000","last_unstale":"2024-09-10T08:28:48.632297+0000","last_undegraded":"2024-09-10T08:28:48.632297+0000","last_fullsized":"2024-09-10T08:28:48.632297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:45.957635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621256+0000","last_change":"2024-09-10T08:28:46.619760+0000","last_active":"2024-09-10T08:28:48.621256+0000","last_peered":"2024-09-10T08:28:48.621256+0000","last_clean":"2024-09-10T08:28:48.621256+0000","last_became_active":"2024-09-10T08:28:46.619165+0000","last_became_peered":"2024-09-10T08:28:46.619165+0000","last_unstale":"2024-09-10T08:28:48.621256+0000","last_undegraded":"2024-09-10T08:28:48.621256+0000","last_fullsized":"2024-09-10T08:28:48.621256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:27.691197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621842+0000","last_change":"2024-09-10T08:28:47.620135+0000","last_active":"2024-09-10T08:28:48.621842+0000","last_peered":"2024-09-10T08:28:48.621842+0000","last_clean":"2024-09-10T08:28:48.621842+0000","last_became_active":"2024-09-10T08:28:47.619661+0000","last_became_peered":"2024-09-10T08:28:47.619661+0000","last_unstale":"2024-09-10T08:28:48.621842+0000","last_undegraded":"2024-09-10T08:28:48.621842+0000","last_fullsized":"2024-09-10T08:28:48.621842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:34.815426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354721+0000","last_change":"2024-09-10T08:28:35.582473+0000","last_active":"2024-09-10T08:28:49.354721+0000","last_peered":"2024-09-10T08:28:49.354721+0000","last_clean":"2024-09-10T08:28:49.354721+0000","last_became_active":"2024-09-10T08:28:35.582205+0000","last_became_peered":"2024-09-10T08:28:35.582205+0000","last_unstale":"2024-09-10T08:28:49.354721+0000","last_undegraded":"2024-09-10T08:28:49.354721+0000","last_fullsized":"2024-09-10T08:28:49.354721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:11.200963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421457+0000","last_change":"2024-09-10T08:28:34.559823+0000","last_active":"2024-09-10T08:28:49.421457+0000","last_peered":"2024-09-10T08:28:49.421457+0000","last_clean":"2024-09-10T08:28:49.421457+0000","last_became_active":"2024-09-10T08:28:34.559560+0000","last_became_peered":"2024-09-10T08:28:34.559560+0000","last_unstale":"2024-09-10T08:28:49.421457+0000","last_undegraded":"2024-09-10T08:28:49.421457+0000","last_fullsized":"2024-09-10T08:28:49.421457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:53.724382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633994+0000","last_change":"2024-09-10T08:28:46.628040+0000","last_active":"2024-09-10T08:28:48.633994+0000","last_peered":"2024-09-10T08:28:48.633994+0000","last_clean":"2024-09-10T08:28:48.633994+0000","last_became_active":"2024-09-10T08:28:46.627819+0000","last_became_peered":"2024-09-10T08:28:46.627819+0000","last_unstale":"2024-09-10T08:28:48.633994+0000","last_undegraded":"2024-09-10T08:28:48.633994+0000","last_fullsized":"2024-09-10T08:28:48.633994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:29.467540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634305+0000","last_change":"2024-09-10T08:28:47.628067+0000","last_active":"2024-09-10T08:28:48.634305+0000","last_peered":"2024-09-10T08:28:48.634305+0000","last_clean":"2024-09-10T08:28:48.634305+0000","last_became_active":"2024-09-10T08:28:47.627775+0000","last_became_peered":"2024-09-10T08:28:47.627775+0000","last_unstale":"2024-09-10T08:28:48.634305+0000","last_undegraded":"2024-09-10T08:28:48.634305+0000","last_fullsized":"2024-09-10T08:28:48.634305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:43.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621613+0000","last_change":"2024-09-10T08:28:35.571262+0000","last_active":"2024-09-10T08:28:48.621613+0000","last_peered":"2024-09-10T08:28:48.621613+0000","last_clean":"2024-09-10T08:28:48.621613+0000","last_became_active":"2024-09-10T08:28:35.570711+0000","last_became_peered":"2024-09-10T08:28:35.570711+0000","last_unstale":"2024-09-10T08:28:48.621613+0000","last_undegraded":"2024-09-10T08:28:48.621613+0000","last_fullsized":"2024-09-10T08:28:48.621613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:29.116422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634766+0000","last_change":"2024-09-10T08:28:34.557352+0000","last_active":"2024-09-10T08:28:48.634766+0000","last_peered":"2024-09-10T08:28:48.634766+0000","last_clean":"2024-09-10T08:28:48.634766+0000","last_became_active":"2024-09-10T08:28:34.557076+0000","last_became_peered":"2024-09-10T08:28:34.557076+0000","last_unstale":"2024-09-10T08:28:48.634766+0000","last_undegraded":"2024-09-10T08:28:48.634766+0000","last_fullsized":"2024-09-10T08:28:48.634766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:04.957739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620317+0000","last_change":"2024-09-10T08:28:46.615923+0000","last_active":"2024-09-10T08:28:48.620317+0000","last_peered":"2024-09-10T08:28:48.620317+0000","last_clean":"2024-09-10T08:28:48.620317+0000","last_became_active":"2024-09-10T08:28:46.615451+0000","last_became_peered":"2024-09-10T08:28:46.615451+0000","last_unstale":"2024-09-10T08:28:48.620317+0000","last_undegraded":"2024-09-10T08:28:48.620317+0000","last_fullsized":"2024-09-10T08:28:48.620317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:22.612001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421320+0000","last_change":"2024-09-10T08:28:47.623223+0000","last_active":"2024-09-10T08:28:49.421320+0000","last_peered":"2024-09-10T08:28:49.421320+0000","last_clean":"2024-09-10T08:28:49.421320+0000","last_became_active":"2024-09-10T08:28:47.622961+0000","last_became_peered":"2024-09-10T08:28:47.622961+0000","last_unstale":"2024-09-10T08:28:49.421320+0000","last_undegraded":"2024-09-10T08:28:49.421320+0000","last_fullsized":"2024-09-10T08:28:49.421320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:30.979580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631925+0000","last_change":"2024-09-10T08:28:35.577913+0000","last_active":"2024-09-10T08:28:48.631925+0000","last_peered":"2024-09-10T08:28:48.631925+0000","last_clean":"2024-09-10T08:28:48.631925+0000","last_became_active":"2024-09-10T08:28:35.577255+0000","last_became_peered":"2024-09-10T08:28:35.577255+0000","last_unstale":"2024-09-10T08:28:48.631925+0000","last_undegraded":"2024-09-10T08:28:48.631925+0000","last_fullsized":"2024-09-10T08:28:48.631925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:17.413525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621690+0000","last_change":"2024-09-10T08:28:34.564571+0000","last_active":"2024-09-10T08:28:48.621690+0000","last_peered":"2024-09-10T08:28:48.621690+0000","last_clean":"2024-09-10T08:28:48.621690+0000","last_became_active":"2024-09-10T08:28:34.564189+0000","last_became_peered":"2024-09-10T08:28:34.564189+0000","last_unstale":"2024-09-10T08:28:48.621690+0000","last_undegraded":"2024-09-10T08:28:48.621690+0000","last_fullsized":"2024-09-10T08:28:48.621690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:46.055510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621316+0000","last_change":"2024-09-10T08:28:46.618917+0000","last_active":"2024-09-10T08:28:48.621316+0000","last_peered":"2024-09-10T08:28:48.621316+0000","last_clean":"2024-09-10T08:28:48.621316+0000","last_became_active":"2024-09-10T08:28:46.618625+0000","last_became_peered":"2024-09-10T08:28:46.618625+0000","last_unstale":"2024-09-10T08:28:48.621316+0000","last_undegraded":"2024-09-10T08:28:48.621316+0000","last_fullsized":"2024-09-10T08:28:48.621316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:19.431857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354237+0000","last_change":"2024-09-10T08:28:47.630243+0000","last_active":"2024-09-10T08:28:49.354237+0000","last_peered":"2024-09-10T08:28:49.354237+0000","last_clean":"2024-09-10T08:28:49.354237+0000","last_became_active":"2024-09-10T08:28:47.629869+0000","last_became_peered":"2024-09-10T08:28:47.629869+0000","last_unstale":"2024-09-10T08:28:49.354237+0000","last_undegraded":"2024-09-10T08:28:49.354237+0000","last_fullsized":"2024-09-10T08:28:49.354237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:58.696156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621683+0000","last_change":"2024-09-10T08:28:35.572944+0000","last_active":"2024-09-10T08:28:48.621683+0000","last_peered":"2024-09-10T08:28:48.621683+0000","last_clean":"2024-09-10T08:28:48.621683+0000","last_became_active":"2024-09-10T08:28:35.572620+0000","last_became_peered":"2024-09-10T08:28:35.572620+0000","last_unstale":"2024-09-10T08:28:48.621683+0000","last_undegraded":"2024-09-10T08:28:48.621683+0000","last_fullsized":"2024-09-10T08:28:48.621683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:04.524048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421956+0000","last_change":"2024-09-10T08:28:34.562935+0000","last_active":"2024-09-10T08:28:49.421956+0000","last_peered":"2024-09-10T08:28:49.421956+0000","last_clean":"2024-09-10T08:28:49.421956+0000","last_became_active":"2024-09-10T08:28:34.562647+0000","last_became_peered":"2024-09-10T08:28:34.562647+0000","last_unstale":"2024-09-10T08:28:49.421956+0000","last_undegraded":"2024-09-10T08:28:49.421956+0000","last_fullsized":"2024-09-10T08:28:49.421956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:47.492281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621382+0000","last_change":"2024-09-10T08:28:46.621472+0000","last_active":"2024-09-10T08:28:48.621382+0000","last_peered":"2024-09-10T08:28:48.621382+0000","last_clean":"2024-09-10T08:28:48.621382+0000","last_became_active":"2024-09-10T08:28:46.621157+0000","last_became_peered":"2024-09-10T08:28:46.621157+0000","last_unstale":"2024-09-10T08:28:48.621382+0000","last_undegraded":"2024-09-10T08:28:48.621382+0000","last_fullsized":"2024-09-10T08:28:48.621382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:44.166068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421835+0000","last_change":"2024-09-10T08:28:47.627750+0000","last_active":"2024-09-10T08:28:49.421835+0000","last_peered":"2024-09-10T08:28:49.421835+0000","last_clean":"2024-09-10T08:28:49.421835+0000","last_became_active":"2024-09-10T08:28:47.627481+0000","last_became_peered":"2024-09-10T08:28:47.627481+0000","last_unstale":"2024-09-10T08:28:49.421835+0000","last_undegraded":"2024-09-10T08:28:49.421835+0000","last_fullsized":"2024-09-10T08:28:49.421835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:01.105133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631930+0000","last_change":"2024-09-10T08:28:46.620162+0000","last_active":"2024-09-10T08:28:48.631930+0000","last_peered":"2024-09-10T08:28:48.631930+0000","last_clean":"2024-09-10T08:28:48.631930+0000","last_became_active":"2024-09-10T08:28:46.619843+0000","last_became_peered":"2024-09-10T08:28:46.619843+0000","last_unstale":"2024-09-10T08:28:48.631930+0000","last_undegraded":"2024-09-10T08:28:48.631930+0000","last_fullsized":"2024-09-10T08:28:48.631930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:21.376123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633938+0000","last_change":"2024-09-10T08:28:35.572803+0000","last_active":"2024-09-10T08:28:48.633938+0000","last_peered":"2024-09-10T08:28:48.633938+0000","last_clean":"2024-09-10T08:28:48.633938+0000","last_became_active":"2024-09-10T08:28:35.572219+0000","last_became_peered":"2024-09-10T08:28:35.572219+0000","last_unstale":"2024-09-10T08:28:48.633938+0000","last_undegraded":"2024-09-10T08:28:48.633938+0000","last_fullsized":"2024-09-10T08:28:48.633938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:45.920218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620645+0000","last_change":"2024-09-10T08:28:34.554346+0000","last_active":"2024-09-10T08:28:48.620645+0000","last_peered":"2024-09-10T08:28:48.620645+0000","last_clean":"2024-09-10T08:28:48.620645+0000","last_became_active":"2024-09-10T08:28:34.553933+0000","last_became_peered":"2024-09-10T08:28:34.553933+0000","last_unstale":"2024-09-10T08:28:48.620645+0000","last_undegraded":"2024-09-10T08:28:48.620645+0000","last_fullsized":"2024-09-10T08:28:48.620645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:07.639671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631936+0000","last_change":"2024-09-10T08:28:47.629468+0000","last_active":"2024-09-10T08:28:48.631936+0000","last_peered":"2024-09-10T08:28:48.631936+0000","last_clean":"2024-09-10T08:28:48.631936+0000","last_became_active":"2024-09-10T08:28:47.629177+0000","last_became_peered":"2024-09-10T08:28:47.629177+0000","last_unstale":"2024-09-10T08:28:48.631936+0000","last_undegraded":"2024-09-10T08:28:48.631936+0000","last_fullsized":"2024-09-10T08:28:48.631936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:10.443235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421808+0000","last_change":"2024-09-10T08:28:46.630904+0000","last_active":"2024-09-10T08:28:49.421808+0000","last_peered":"2024-09-10T08:28:49.421808+0000","last_clean":"2024-09-10T08:28:49.421808+0000","last_became_active":"2024-09-10T08:28:46.630530+0000","last_became_peered":"2024-09-10T08:28:46.630530+0000","last_unstale":"2024-09-10T08:28:49.421808+0000","last_undegraded":"2024-09-10T08:28:49.421808+0000","last_fullsized":"2024-09-10T08:28:49.421808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:33.599739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621556+0000","last_change":"2024-09-10T08:28:35.580244+0000","last_active":"2024-09-10T08:28:48.621556+0000","last_peered":"2024-09-10T08:28:48.621556+0000","last_clean":"2024-09-10T08:28:48.621556+0000","last_became_active":"2024-09-10T08:28:35.579975+0000","last_became_peered":"2024-09-10T08:28:35.579975+0000","last_unstale":"2024-09-10T08:28:48.621556+0000","last_undegraded":"2024-09-10T08:28:48.621556+0000","last_fullsized":"2024-09-10T08:28:48.621556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:16.498045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621654+0000","last_change":"2024-09-10T08:28:34.564751+0000","last_active":"2024-09-10T08:28:48.621654+0000","last_peered":"2024-09-10T08:28:48.621654+0000","last_clean":"2024-09-10T08:28:48.621654+0000","last_became_active":"2024-09-10T08:28:34.564479+0000","last_became_peered":"2024-09-10T08:28:34.564479+0000","last_unstale":"2024-09-10T08:28:48.621654+0000","last_undegraded":"2024-09-10T08:28:48.621654+0000","last_fullsized":"2024-09-10T08:28:48.621654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:29.618224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634645+0000","last_change":"2024-09-10T08:28:47.627041+0000","last_active":"2024-09-10T08:28:48.634645+0000","last_peered":"2024-09-10T08:28:48.634645+0000","last_clean":"2024-09-10T08:28:48.634645+0000","last_became_active":"2024-09-10T08:28:47.626692+0000","last_became_peered":"2024-09-10T08:28:47.626692+0000","last_unstale":"2024-09-10T08:28:48.634645+0000","last_undegraded":"2024-09-10T08:28:48.634645+0000","last_fullsized":"2024-09-10T08:28:48.634645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:57.666849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421403+0000","last_change":"2024-09-10T08:28:34.561906+0000","last_active":"2024-09-10T08:28:49.421403+0000","last_peered":"2024-09-10T08:28:49.421403+0000","last_clean":"2024-09-10T08:28:49.421403+0000","last_became_active":"2024-09-10T08:28:34.561613+0000","last_became_peered":"2024-09-10T08:28:34.561613+0000","last_unstale":"2024-09-10T08:28:49.421403+0000","last_undegraded":"2024-09-10T08:28:49.421403+0000","last_fullsized":"2024-09-10T08:28:49.421403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:56.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632248+0000","last_change":"2024-09-10T08:28:35.576406+0000","last_active":"2024-09-10T08:28:48.632248+0000","last_peered":"2024-09-10T08:28:48.632248+0000","last_clean":"2024-09-10T08:28:48.632248+0000","last_became_active":"2024-09-10T08:28:35.576145+0000","last_became_peered":"2024-09-10T08:28:35.576145+0000","last_unstale":"2024-09-10T08:28:48.632248+0000","last_undegraded":"2024-09-10T08:28:48.632248+0000","last_fullsized":"2024-09-10T08:28:48.632248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:57.667098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299845+0000","last_change":"2024-09-10T08:28:46.622395+0000","last_active":"2024-09-10T08:28:49.299845+0000","last_peered":"2024-09-10T08:28:49.299845+0000","last_clean":"2024-09-10T08:28:49.299845+0000","last_became_active":"2024-09-10T08:28:46.621941+0000","last_became_peered":"2024-09-10T08:28:46.621941+0000","last_unstale":"2024-09-10T08:28:49.299845+0000","last_undegraded":"2024-09-10T08:28:49.299845+0000","last_fullsized":"2024-09-10T08:28:49.299845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:54.928969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621387+0000","last_change":"2024-09-10T08:28:47.626495+0000","last_active":"2024-09-10T08:28:48.621387+0000","last_peered":"2024-09-10T08:28:48.621387+0000","last_clean":"2024-09-10T08:28:48.621387+0000","last_became_active":"2024-09-10T08:28:47.625258+0000","last_became_peered":"2024-09-10T08:28:47.625258+0000","last_unstale":"2024-09-10T08:28:48.621387+0000","last_undegraded":"2024-09-10T08:28:48.621387+0000","last_fullsized":"2024-09-10T08:28:48.621387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:00.101586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622005+0000","last_change":"2024-09-10T08:28:34.566606+0000","last_active":"2024-09-10T08:28:48.622005+0000","last_peered":"2024-09-10T08:28:48.622005+0000","last_clean":"2024-09-10T08:28:48.622005+0000","last_became_active":"2024-09-10T08:28:34.566388+0000","last_became_peered":"2024-09-10T08:28:34.566388+0000","last_unstale":"2024-09-10T08:28:48.622005+0000","last_undegraded":"2024-09-10T08:28:48.622005+0000","last_fullsized":"2024-09-10T08:28:48.622005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:33.528801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621394+0000","last_change":"2024-09-10T08:28:35.559371+0000","last_active":"2024-09-10T08:28:48.621394+0000","last_peered":"2024-09-10T08:28:48.621394+0000","last_clean":"2024-09-10T08:28:48.621394+0000","last_became_active":"2024-09-10T08:28:35.559145+0000","last_became_peered":"2024-09-10T08:28:35.559145+0000","last_unstale":"2024-09-10T08:28:48.621394+0000","last_undegraded":"2024-09-10T08:28:48.621394+0000","last_fullsized":"2024-09-10T08:28:48.621394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:57.339318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621811+0000","last_change":"2024-09-10T08:28:46.620231+0000","last_active":"2024-09-10T08:28:48.621811+0000","last_peered":"2024-09-10T08:28:48.621811+0000","last_clean":"2024-09-10T08:28:48.621811+0000","last_became_active":"2024-09-10T08:28:46.619403+0000","last_became_peered":"2024-09-10T08:28:46.619403+0000","last_unstale":"2024-09-10T08:28:48.621811+0000","last_undegraded":"2024-09-10T08:28:48.621811+0000","last_fullsized":"2024-09-10T08:28:48.621811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:26.308749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622383+0000","last_change":"2024-09-10T08:28:47.627135+0000","last_active":"2024-09-10T08:28:48.622383+0000","last_peered":"2024-09-10T08:28:48.622383+0000","last_clean":"2024-09-10T08:28:48.622383+0000","last_became_active":"2024-09-10T08:28:47.626791+0000","last_became_peered":"2024-09-10T08:28:47.626791+0000","last_unstale":"2024-09-10T08:28:48.622383+0000","last_undegraded":"2024-09-10T08:28:48.622383+0000","last_fullsized":"2024-09-10T08:28:48.622383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:43.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.420972+0000","last_change":"2024-09-10T08:28:35.579106+0000","last_active":"2024-09-10T08:28:49.420972+0000","last_peered":"2024-09-10T08:28:49.420972+0000","last_clean":"2024-09-10T08:28:49.420972+0000","last_became_active":"2024-09-10T08:28:35.578631+0000","last_became_peered":"2024-09-10T08:28:35.578631+0000","last_unstale":"2024-09-10T08:28:49.420972+0000","last_undegraded":"2024-09-10T08:28:49.420972+0000","last_fullsized":"2024-09-10T08:28:49.420972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:31.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634751+0000","last_change":"2024-09-10T08:28:47.632052+0000","last_active":"2024-09-10T08:28:48.634751+0000","last_peered":"2024-09-10T08:28:48.634751+0000","last_clean":"2024-09-10T08:28:48.634751+0000","last_became_active":"2024-09-10T08:28:47.631578+0000","last_became_peered":"2024-09-10T08:28:47.631578+0000","last_unstale":"2024-09-10T08:28:48.634751+0000","last_undegraded":"2024-09-10T08:28:48.634751+0000","last_fullsized":"2024-09-10T08:28:48.634751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:24.570729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299570+0000","last_change":"2024-09-10T08:28:35.566780+0000","last_active":"2024-09-10T08:28:49.299570+0000","last_peered":"2024-09-10T08:28:49.299570+0000","last_clean":"2024-09-10T08:28:49.299570+0000","last_became_active":"2024-09-10T08:28:35.566529+0000","last_became_peered":"2024-09-10T08:28:35.566529+0000","last_unstale":"2024-09-10T08:28:49.299570+0000","last_undegraded":"2024-09-10T08:28:49.299570+0000","last_fullsized":"2024-09-10T08:28:49.299570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:09.481166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621043+0000","last_change":"2024-09-10T08:28:47.629148+0000","last_active":"2024-09-10T08:28:48.621043+0000","last_peered":"2024-09-10T08:28:48.621043+0000","last_clean":"2024-09-10T08:28:48.621043+0000","last_became_active":"2024-09-10T08:28:47.628741+0000","last_became_peered":"2024-09-10T08:28:47.628741+0000","last_unstale":"2024-09-10T08:28:48.621043+0000","last_undegraded":"2024-09-10T08:28:48.621043+0000","last_fullsized":"2024-09-10T08:28:48.621043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:48.950503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621017+0000","last_change":"2024-09-10T08:28:35.578735+0000","last_active":"2024-09-10T08:28:48.621017+0000","last_peered":"2024-09-10T08:28:48.621017+0000","last_clean":"2024-09-10T08:28:48.621017+0000","last_became_active":"2024-09-10T08:28:35.577995+0000","last_became_peered":"2024-09-10T08:28:35.577995+0000","last_unstale":"2024-09-10T08:28:48.621017+0000","last_undegraded":"2024-09-10T08:28:48.621017+0000","last_fullsized":"2024-09-10T08:28:48.621017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:11.033441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634650+0000","last_change":"2024-09-10T08:28:47.628639+0000","last_active":"2024-09-10T08:28:48.634650+0000","last_peered":"2024-09-10T08:28:48.634650+0000","last_clean":"2024-09-10T08:28:48.634650+0000","last_became_active":"2024-09-10T08:28:47.628317+0000","last_became_peered":"2024-09-10T08:28:47.628317+0000","last_unstale":"2024-09-10T08:28:48.634650+0000","last_undegraded":"2024-09-10T08:28:48.634650+0000","last_fullsized":"2024-09-10T08:28:48.634650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:50.314678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632190+0000","last_change":"2024-09-10T08:28:35.577852+0000","last_active":"2024-09-10T08:28:48.632190+0000","last_peered":"2024-09-10T08:28:48.632190+0000","last_clean":"2024-09-10T08:28:48.632190+0000","last_became_active":"2024-09-10T08:28:35.577571+0000","last_became_peered":"2024-09-10T08:28:35.577571+0000","last_unstale":"2024-09-10T08:28:48.632190+0000","last_undegraded":"2024-09-10T08:28:48.632190+0000","last_fullsized":"2024-09-10T08:28:48.632190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:22.713732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354207+0000","last_change":"2024-09-10T08:28:47.629931+0000","last_active":"2024-09-10T08:28:49.354207+0000","last_peered":"2024-09-10T08:28:49.354207+0000","last_clean":"2024-09-10T08:28:49.354207+0000","last_became_active":"2024-09-10T08:28:47.629634+0000","last_became_peered":"2024-09-10T08:28:47.629634+0000","last_unstale":"2024-09-10T08:28:49.354207+0000","last_undegraded":"2024-09-10T08:28:49.354207+0000","last_fullsized":"2024-09-10T08:28:49.354207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:57.964208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622194+0000","last_change":"2024-09-10T08:28:35.574676+0000","last_active":"2024-09-10T08:28:48.622194+0000","last_peered":"2024-09-10T08:28:48.622194+0000","last_clean":"2024-09-10T08:28:48.622194+0000","last_became_active":"2024-09-10T08:28:35.574437+0000","last_became_peered":"2024-09-10T08:28:35.574437+0000","last_unstale":"2024-09-10T08:28:48.622194+0000","last_undegraded":"2024-09-10T08:28:48.622194+0000","last_fullsized":"2024-09-10T08:28:48.622194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:45.422506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620118+0000","last_change":"2024-09-10T08:28:47.624178+0000","last_active":"2024-09-10T08:28:48.620118+0000","last_peered":"2024-09-10T08:28:48.620118+0000","last_clean":"2024-09-10T08:28:48.620118+0000","last_became_active":"2024-09-10T08:28:47.623671+0000","last_became_peered":"2024-09-10T08:28:47.623671+0000","last_unstale":"2024-09-10T08:28:48.620118+0000","last_undegraded":"2024-09-10T08:28:48.620118+0000","last_fullsized":"2024-09-10T08:28:48.620118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:48.613870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634693+0000","last_change":"2024-09-10T08:28:35.572550+0000","last_active":"2024-09-10T08:28:48.634693+0000","last_peered":"2024-09-10T08:28:48.634693+0000","last_clean":"2024-09-10T08:28:48.634693+0000","last_became_active":"2024-09-10T08:28:35.572184+0000","last_became_peered":"2024-09-10T08:28:35.572184+0000","last_unstale":"2024-09-10T08:28:48.634693+0000","last_undegraded":"2024-09-10T08:28:48.634693+0000","last_fullsized":"2024-09-10T08:28:48.634693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:08.490734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354228+0000","last_change":"2024-09-10T08:28:47.630214+0000","last_active":"2024-09-10T08:28:49.354228+0000","last_peered":"2024-09-10T08:28:49.354228+0000","last_clean":"2024-09-10T08:28:49.354228+0000","last_became_active":"2024-09-10T08:28:47.629512+0000","last_became_peered":"2024-09-10T08:28:47.629512+0000","last_unstale":"2024-09-10T08:28:49.354228+0000","last_undegraded":"2024-09-10T08:28:49.354228+0000","last_fullsized":"2024-09-10T08:28:49.354228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:35.692107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421683+0000","last_change":"2024-09-10T08:28:35.573217+0000","last_active":"2024-09-10T08:28:49.421683+0000","last_peered":"2024-09-10T08:28:49.421683+0000","last_clean":"2024-09-10T08:28:49.421683+0000","last_became_active":"2024-09-10T08:28:35.572955+0000","last_became_peered":"2024-09-10T08:28:35.572955+0000","last_unstale":"2024-09-10T08:28:49.421683+0000","last_undegraded":"2024-09-10T08:28:49.421683+0000","last_fullsized":"2024-09-10T08:28:49.421683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:24.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421176+0000","last_change":"2024-09-10T08:28:47.623365+0000","last_active":"2024-09-10T08:28:49.421176+0000","last_peered":"2024-09-10T08:28:49.421176+0000","last_clean":"2024-09-10T08:28:49.421176+0000","last_became_active":"2024-09-10T08:28:47.623082+0000","last_became_peered":"2024-09-10T08:28:47.623082+0000","last_unstale":"2024-09-10T08:28:49.421176+0000","last_undegraded":"2024-09-10T08:28:49.421176+0000","last_fullsized":"2024-09-10T08:28:49.421176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:20.558484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622192+0000","last_change":"2024-09-10T08:28:35.575902+0000","last_active":"2024-09-10T08:28:48.622192+0000","last_peered":"2024-09-10T08:28:48.622192+0000","last_clean":"2024-09-10T08:28:48.622192+0000","last_became_active":"2024-09-10T08:28:35.575614+0000","last_became_peered":"2024-09-10T08:28:35.575614+0000","last_unstale":"2024-09-10T08:28:48.622192+0000","last_undegraded":"2024-09-10T08:28:48.622192+0000","last_fullsized":"2024-09-10T08:28:48.622192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:11.277682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622312+0000","last_change":"2024-09-10T08:28:47.629795+0000","last_active":"2024-09-10T08:28:48.622312+0000","last_peered":"2024-09-10T08:28:48.622312+0000","last_clean":"2024-09-10T08:28:48.622312+0000","last_became_active":"2024-09-10T08:28:47.628861+0000","last_became_peered":"2024-09-10T08:28:47.628861+0000","last_unstale":"2024-09-10T08:28:48.622312+0000","last_undegraded":"2024-09-10T08:28:48.622312+0000","last_fullsized":"2024-09-10T08:28:48.622312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:06.277094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620538+0000","last_change":"2024-09-10T08:28:35.578285+0000","last_active":"2024-09-10T08:28:48.620538+0000","last_peered":"2024-09-10T08:28:48.620538+0000","last_clean":"2024-09-10T08:28:48.620538+0000","last_became_active":"2024-09-10T08:28:35.576805+0000","last_became_peered":"2024-09-10T08:28:35.576805+0000","last_unstale":"2024-09-10T08:28:48.620538+0000","last_undegraded":"2024-09-10T08:28:48.620538+0000","last_fullsized":"2024-09-10T08:28:48.620538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:46.203320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355252+0000","last_change":"2024-09-10T08:28:47.635713+0000","last_active":"2024-09-10T08:28:49.355252+0000","last_peered":"2024-09-10T08:28:49.355252+0000","last_clean":"2024-09-10T08:28:49.355252+0000","last_became_active":"2024-09-10T08:28:47.635381+0000","last_became_peered":"2024-09-10T08:28:47.635381+0000","last_unstale":"2024-09-10T08:28:49.355252+0000","last_undegraded":"2024-09-10T08:28:49.355252+0000","last_fullsized":"2024-09-10T08:28:49.355252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:39.419510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621520+0000","last_change":"2024-09-10T08:28:35.571566+0000","last_active":"2024-09-10T08:28:48.621520+0000","last_peered":"2024-09-10T08:28:48.621520+0000","last_clean":"2024-09-10T08:28:48.621520+0000","last_became_active":"2024-09-10T08:28:35.571285+0000","last_became_peered":"2024-09-10T08:28:35.571285+0000","last_unstale":"2024-09-10T08:28:48.621520+0000","last_undegraded":"2024-09-10T08:28:48.621520+0000","last_fullsized":"2024-09-10T08:28:48.621520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:23.587691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299893+0000","last_change":"2024-09-10T08:28:47.619863+0000","last_active":"2024-09-10T08:28:49.299893+0000","last_peered":"2024-09-10T08:28:49.299893+0000","last_clean":"2024-09-10T08:28:49.299893+0000","last_became_active":"2024-09-10T08:28:47.619525+0000","last_became_peered":"2024-09-10T08:28:47.619525+0000","last_unstale":"2024-09-10T08:28:49.299893+0000","last_undegraded":"2024-09-10T08:28:49.299893+0000","last_fullsized":"2024-09-10T08:28:49.299893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:49.591318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620937+0000","last_change":"2024-09-10T08:28:35.568044+0000","last_active":"2024-09-10T08:28:48.620937+0000","last_peered":"2024-09-10T08:28:48.620937+0000","last_clean":"2024-09-10T08:28:48.620937+0000","last_became_active":"2024-09-10T08:28:35.567744+0000","last_became_peered":"2024-09-10T08:28:35.567744+0000","last_unstale":"2024-09-10T08:28:48.620937+0000","last_undegraded":"2024-09-10T08:28:48.620937+0000","last_fullsized":"2024-09-10T08:28:48.620937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:19.081138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621697+0000","last_change":"2024-09-10T08:28:47.629417+0000","last_active":"2024-09-10T08:28:48.621697+0000","last_peered":"2024-09-10T08:28:48.621697+0000","last_clean":"2024-09-10T08:28:48.621697+0000","last_became_active":"2024-09-10T08:28:47.629095+0000","last_became_peered":"2024-09-10T08:28:47.629095+0000","last_unstale":"2024-09-10T08:28:48.621697+0000","last_undegraded":"2024-09-10T08:28:48.621697+0000","last_fullsized":"2024-09-10T08:28:48.621697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:05.606381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632075+0000","last_change":"2024-09-10T08:28:35.575802+0000","last_active":"2024-09-10T08:28:48.632075+0000","last_peered":"2024-09-10T08:28:48.632075+0000","last_clean":"2024-09-10T08:28:48.632075+0000","last_became_active":"2024-09-10T08:28:35.575388+0000","last_became_peered":"2024-09-10T08:28:35.575388+0000","last_unstale":"2024-09-10T08:28:48.632075+0000","last_undegraded":"2024-09-10T08:28:48.632075+0000","last_fullsized":"2024-09-10T08:28:48.632075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:01.424265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620142+0000","last_change":"2024-09-10T08:28:47.624305+0000","last_active":"2024-09-10T08:28:48.620142+0000","last_peered":"2024-09-10T08:28:48.620142+0000","last_clean":"2024-09-10T08:28:48.620142+0000","last_became_active":"2024-09-10T08:28:47.624026+0000","last_became_peered":"2024-09-10T08:28:47.624026+0000","last_unstale":"2024-09-10T08:28:48.620142+0000","last_undegraded":"2024-09-10T08:28:48.620142+0000","last_fullsized":"2024-09-10T08:28:48.620142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:01.194271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421368+0000","last_change":"2024-09-10T08:28:35.574499+0000","last_active":"2024-09-10T08:28:49.421368+0000","last_peered":"2024-09-10T08:28:49.421368+0000","last_clean":"2024-09-10T08:28:49.421368+0000","last_became_active":"2024-09-10T08:28:35.574249+0000","last_became_peered":"2024-09-10T08:28:35.574249+0000","last_unstale":"2024-09-10T08:28:49.421368+0000","last_undegraded":"2024-09-10T08:28:49.421368+0000","last_fullsized":"2024-09-10T08:28:49.421368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:55.952307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620349+0000","last_change":"2024-09-10T08:28:47.629525+0000","last_active":"2024-09-10T08:28:48.620349+0000","last_peered":"2024-09-10T08:28:48.620349+0000","last_clean":"2024-09-10T08:28:48.620349+0000","last_became_active":"2024-09-10T08:28:47.629259+0000","last_became_peered":"2024-09-10T08:28:47.629259+0000","last_unstale":"2024-09-10T08:28:48.620349+0000","last_undegraded":"2024-09-10T08:28:48.620349+0000","last_fullsized":"2024-09-10T08:28:48.620349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:11.864322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355002+0000","last_change":"2024-09-10T08:28:35.572709+0000","last_active":"2024-09-10T08:28:49.355002+0000","last_peered":"2024-09-10T08:28:49.355002+0000","last_clean":"2024-09-10T08:28:49.355002+0000","last_became_active":"2024-09-10T08:28:35.572392+0000","last_became_peered":"2024-09-10T08:28:35.572392+0000","last_unstale":"2024-09-10T08:28:49.355002+0000","last_undegraded":"2024-09-10T08:28:49.355002+0000","last_fullsized":"2024-09-10T08:28:49.355002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:42.636299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619769+0000","last_change":"2024-09-10T08:28:47.623285+0000","last_active":"2024-09-10T08:28:48.619769+0000","last_peered":"2024-09-10T08:28:48.619769+0000","last_clean":"2024-09-10T08:28:48.619769+0000","last_became_active":"2024-09-10T08:28:47.621776+0000","last_became_peered":"2024-09-10T08:28:47.621776+0000","last_unstale":"2024-09-10T08:28:48.619769+0000","last_undegraded":"2024-09-10T08:28:48.619769+0000","last_fullsized":"2024-09-10T08:28:48.619769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:32.543418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.300034+0000","last_change":"2024-09-10T08:28:35.574438+0000","last_active":"2024-09-10T08:28:49.300034+0000","last_peered":"2024-09-10T08:28:49.300034+0000","last_clean":"2024-09-10T08:28:49.300034+0000","last_became_active":"2024-09-10T08:28:35.574175+0000","last_became_peered":"2024-09-10T08:28:35.574175+0000","last_unstale":"2024-09-10T08:28:49.300034+0000","last_undegraded":"2024-09-10T08:28:49.300034+0000","last_fullsized":"2024-09-10T08:28:49.300034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:55.808543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631598+0000","last_change":"2024-09-10T08:28:47.629092+0000","last_active":"2024-09-10T08:28:48.631598+0000","last_peered":"2024-09-10T08:28:48.631598+0000","last_clean":"2024-09-10T08:28:48.631598+0000","last_became_active":"2024-09-10T08:28:47.628806+0000","last_became_peered":"2024-09-10T08:28:47.628806+0000","last_unstale":"2024-09-10T08:28:48.631598+0000","last_undegraded":"2024-09-10T08:28:48.631598+0000","last_fullsized":"2024-09-10T08:28:48.631598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:46.440290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622000+0000","last_change":"2024-09-10T08:28:35.567296+0000","last_active":"2024-09-10T08:28:48.622000+0000","last_peered":"2024-09-10T08:28:48.622000+0000","last_clean":"2024-09-10T08:28:48.622000+0000","last_became_active":"2024-09-10T08:28:35.567074+0000","last_became_peered":"2024-09-10T08:28:35.567074+0000","last_unstale":"2024-09-10T08:28:48.622000+0000","last_undegraded":"2024-09-10T08:28:48.622000+0000","last_fullsized":"2024-09-10T08:28:48.622000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:55.698345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634643+0000","last_change":"2024-09-10T08:28:47.631797+0000","last_active":"2024-09-10T08:28:48.634643+0000","last_peered":"2024-09-10T08:28:48.634643+0000","last_clean":"2024-09-10T08:28:48.634643+0000","last_became_active":"2024-09-10T08:28:47.631523+0000","last_became_peered":"2024-09-10T08:28:47.631523+0000","last_unstale":"2024-09-10T08:28:48.634643+0000","last_undegraded":"2024-09-10T08:28:48.634643+0000","last_fullsized":"2024-09-10T08:28:48.634643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:05.829116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619838+0000","last_change":"2024-09-10T08:28:35.570249+0000","last_active":"2024-09-10T08:28:48.619838+0000","last_peered":"2024-09-10T08:28:48.619838+0000","last_clean":"2024-09-10T08:28:48.619838+0000","last_became_active":"2024-09-10T08:28:35.569960+0000","last_became_peered":"2024-09-10T08:28:35.569960+0000","last_unstale":"2024-09-10T08:28:48.619838+0000","last_undegraded":"2024-09-10T08:28:48.619838+0000","last_fullsized":"2024-09-10T08:28:48.619838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:29.787554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620473+0000","last_change":"2024-09-10T08:28:47.633644+0000","last_active":"2024-09-10T08:28:48.620473+0000","last_peered":"2024-09-10T08:28:48.620473+0000","last_clean":"2024-09-10T08:28:48.620473+0000","last_became_active":"2024-09-10T08:28:47.633315+0000","last_became_peered":"2024-09-10T08:28:47.633315+0000","last_unstale":"2024-09-10T08:28:48.620473+0000","last_undegraded":"2024-09-10T08:28:48.620473+0000","last_fullsized":"2024-09-10T08:28:48.620473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:45:55.827386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634008+0000","last_change":"2024-09-10T08:28:35.560693+0000","last_active":"2024-09-10T08:28:48.634008+0000","last_peered":"2024-09-10T08:28:48.634008+0000","last_clean":"2024-09-10T08:28:48.634008+0000","last_became_active":"2024-09-10T08:28:35.560409+0000","last_became_peered":"2024-09-10T08:28:35.560409+0000","last_unstale":"2024-09-10T08:28:48.634008+0000","last_undegraded":"2024-09-10T08:28:48.634008+0000","last_fullsized":"2024-09-10T08:28:48.634008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:10.597654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621112+0000","last_change":"2024-09-10T08:28:47.622614+0000","last_active":"2024-09-10T08:28:48.621112+0000","last_peered":"2024-09-10T08:28:48.621112+0000","last_clean":"2024-09-10T08:28:48.621112+0000","last_became_active":"2024-09-10T08:28:47.622205+0000","last_became_peered":"2024-09-10T08:28:47.622205+0000","last_unstale":"2024-09-10T08:28:48.621112+0000","last_undegraded":"2024-09-10T08:28:48.621112+0000","last_fullsized":"2024-09-10T08:28:48.621112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:47.090782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631666+0000","last_change":"2024-09-10T08:28:35.574551+0000","last_active":"2024-09-10T08:28:48.631666+0000","last_peered":"2024-09-10T08:28:48.631666+0000","last_clean":"2024-09-10T08:28:48.631666+0000","last_became_active":"2024-09-10T08:28:35.574256+0000","last_became_peered":"2024-09-10T08:28:35.574256+0000","last_unstale":"2024-09-10T08:28:48.631666+0000","last_undegraded":"2024-09-10T08:28:48.631666+0000","last_fullsized":"2024-09-10T08:28:48.631666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:43.401552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354791+0000","last_change":"2024-09-10T08:28:47.633476+0000","last_active":"2024-09-10T08:28:49.354791+0000","last_peered":"2024-09-10T08:28:49.354791+0000","last_clean":"2024-09-10T08:28:49.354791+0000","last_became_active":"2024-09-10T08:28:47.633189+0000","last_became_peered":"2024-09-10T08:28:47.633189+0000","last_unstale":"2024-09-10T08:28:49.354791+0000","last_undegraded":"2024-09-10T08:28:49.354791+0000","last_fullsized":"2024-09-10T08:28:49.354791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:46.175490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621900+0000","last_change":"2024-09-10T08:28:35.573330+0000","last_active":"2024-09-10T08:28:48.621900+0000","last_peered":"2024-09-10T08:28:48.621900+0000","last_clean":"2024-09-10T08:28:48.621900+0000","last_became_active":"2024-09-10T08:28:35.572992+0000","last_became_peered":"2024-09-10T08:28:35.572992+0000","last_unstale":"2024-09-10T08:28:48.621900+0000","last_undegraded":"2024-09-10T08:28:48.621900+0000","last_fullsized":"2024-09-10T08:28:48.621900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:15.412219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621967+0000","last_change":"2024-09-10T08:28:47.630733+0000","last_active":"2024-09-10T08:28:48.621967+0000","last_peered":"2024-09-10T08:28:48.621967+0000","last_clean":"2024-09-10T08:28:48.621967+0000","last_became_active":"2024-09-10T08:28:47.630447+0000","last_became_peered":"2024-09-10T08:28:47.630447+0000","last_unstale":"2024-09-10T08:28:48.621967+0000","last_undegraded":"2024-09-10T08:28:48.621967+0000","last_fullsized":"2024-09-10T08:28:48.621967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:08.797818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621594+0000","last_change":"2024-09-10T08:28:35.566574+0000","last_active":"2024-09-10T08:28:48.621594+0000","last_peered":"2024-09-10T08:28:48.621594+0000","last_clean":"2024-09-10T08:28:48.621594+0000","last_became_active":"2024-09-10T08:28:35.566205+0000","last_became_peered":"2024-09-10T08:28:35.566205+0000","last_unstale":"2024-09-10T08:28:48.621594+0000","last_undegraded":"2024-09-10T08:28:48.621594+0000","last_fullsized":"2024-09-10T08:28:48.621594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:49.876773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299778+0000","last_change":"2024-09-10T08:28:47.628051+0000","last_active":"2024-09-10T08:28:49.299778+0000","last_peered":"2024-09-10T08:28:49.299778+0000","last_clean":"2024-09-10T08:28:49.299778+0000","last_became_active":"2024-09-10T08:28:47.627747+0000","last_became_peered":"2024-09-10T08:28:47.627747+0000","last_unstale":"2024-09-10T08:28:49.299778+0000","last_undegraded":"2024-09-10T08:28:49.299778+0000","last_fullsized":"2024-09-10T08:28:49.299778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:54.210449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421487+0000","last_change":"2024-09-10T08:28:35.565023+0000","last_active":"2024-09-10T08:28:49.421487+0000","last_peered":"2024-09-10T08:28:49.421487+0000","last_clean":"2024-09-10T08:28:49.421487+0000","last_became_active":"2024-09-10T08:28:35.564747+0000","last_became_peered":"2024-09-10T08:28:35.564747+0000","last_unstale":"2024-09-10T08:28:49.421487+0000","last_undegraded":"2024-09-10T08:28:49.421487+0000","last_fullsized":"2024-09-10T08:28:49.421487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:32.419621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354688+0000","last_change":"2024-09-10T08:28:47.631047+0000","last_active":"2024-09-10T08:28:49.354688+0000","last_peered":"2024-09-10T08:28:49.354688+0000","last_clean":"2024-09-10T08:28:49.354688+0000","last_became_active":"2024-09-10T08:28:47.630617+0000","last_became_peered":"2024-09-10T08:28:47.630617+0000","last_unstale":"2024-09-10T08:28:49.354688+0000","last_undegraded":"2024-09-10T08:28:49.354688+0000","last_fullsized":"2024-09-10T08:28:49.354688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:29.867640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421612+0000","last_change":"2024-09-10T08:28:35.570619+0000","last_active":"2024-09-10T08:28:49.421612+0000","last_peered":"2024-09-10T08:28:49.421612+0000","last_clean":"2024-09-10T08:28:49.421612+0000","last_became_active":"2024-09-10T08:28:35.570351+0000","last_became_peered":"2024-09-10T08:28:35.570351+0000","last_unstale":"2024-09-10T08:28:49.421612+0000","last_undegraded":"2024-09-10T08:28:49.421612+0000","last_fullsized":"2024-09-10T08:28:49.421612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:35.161279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620557+0000","last_change":"2024-09-10T08:28:47.626191+0000","last_active":"2024-09-10T08:28:48.620557+0000","last_peered":"2024-09-10T08:28:48.620557+0000","last_clean":"2024-09-10T08:28:48.620557+0000","last_became_active":"2024-09-10T08:28:47.625781+0000","last_became_peered":"2024-09-10T08:28:47.625781+0000","last_unstale":"2024-09-10T08:28:48.620557+0000","last_undegraded":"2024-09-10T08:28:48.620557+0000","last_fullsized":"2024-09-10T08:28:48.620557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:36:38.651973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355079+0000","last_change":"2024-09-10T08:28:35.577345+0000","last_active":"2024-09-10T08:28:49.355079+0000","last_peered":"2024-09-10T08:28:49.355079+0000","last_clean":"2024-09-10T08:28:49.355079+0000","last_became_active":"2024-09-10T08:28:35.576191+0000","last_became_peered":"2024-09-10T08:28:35.576191+0000","last_unstale":"2024-09-10T08:28:49.355079+0000","last_undegraded":"2024-09-10T08:28:49.355079+0000","last_fullsized":"2024-09-10T08:28:49.355079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:29.218797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622171+0000","last_change":"2024-09-10T08:28:47.623129+0000","last_active":"2024-09-10T08:28:48.622171+0000","last_peered":"2024-09-10T08:28:48.622171+0000","last_clean":"2024-09-10T08:28:48.622171+0000","last_became_active":"2024-09-10T08:28:47.622851+0000","last_became_peered":"2024-09-10T08:28:47.622851+0000","last_unstale":"2024-09-10T08:28:48.622171+0000","last_undegraded":"2024-09-10T08:28:48.622171+0000","last_fullsized":"2024-09-10T08:28:48.622171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:16.045213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621426+0000","last_change":"2024-09-10T08:28:35.575275+0000","last_active":"2024-09-10T08:28:48.621426+0000","last_peered":"2024-09-10T08:28:48.621426+0000","last_clean":"2024-09-10T08:28:48.621426+0000","last_became_active":"2024-09-10T08:28:35.575052+0000","last_became_peered":"2024-09-10T08:28:35.575052+0000","last_unstale":"2024-09-10T08:28:48.621426+0000","last_undegraded":"2024-09-10T08:28:48.621426+0000","last_fullsized":"2024-09-10T08:28:48.621426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:24.313017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421741+0000","last_change":"2024-09-10T08:28:47.628651+0000","last_active":"2024-09-10T08:28:49.421741+0000","last_peered":"2024-09-10T08:28:49.421741+0000","last_clean":"2024-09-10T08:28:49.421741+0000","last_became_active":"2024-09-10T08:28:47.628343+0000","last_became_peered":"2024-09-10T08:28:47.628343+0000","last_unstale":"2024-09-10T08:28:49.421741+0000","last_undegraded":"2024-09-10T08:28:49.421741+0000","last_fullsized":"2024-09-10T08:28:49.421741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:05.848341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354299+0000","last_change":"2024-09-10T08:28:35.578664+0000","last_active":"2024-09-10T08:28:49.354299+0000","last_peered":"2024-09-10T08:28:49.354299+0000","last_clean":"2024-09-10T08:28:49.354299+0000","last_became_active":"2024-09-10T08:28:35.578384+0000","last_became_peered":"2024-09-10T08:28:35.578384+0000","last_unstale":"2024-09-10T08:28:49.354299+0000","last_undegraded":"2024-09-10T08:28:49.354299+0000","last_fullsized":"2024-09-10T08:28:49.354299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:44.278718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634174+0000","last_change":"2024-09-10T08:28:47.627593+0000","last_active":"2024-09-10T08:28:48.634174+0000","last_peered":"2024-09-10T08:28:48.634174+0000","last_clean":"2024-09-10T08:28:48.634174+0000","last_became_active":"2024-09-10T08:28:47.627237+0000","last_became_peered":"2024-09-10T08:28:47.627237+0000","last_unstale":"2024-09-10T08:28:48.634174+0000","last_undegraded":"2024-09-10T08:28:48.634174+0000","last_fullsized":"2024-09-10T08:28:48.634174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:16.045213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620920+0000","last_change":"2024-09-10T08:28:35.578978+0000","last_active":"2024-09-10T08:28:48.620920+0000","last_peered":"2024-09-10T08:28:48.620920+0000","last_clean":"2024-09-10T08:28:48.620920+0000","last_became_active":"2024-09-10T08:28:35.578475+0000","last_became_peered":"2024-09-10T08:28:35.578475+0000","last_unstale":"2024-09-10T08:28:48.620920+0000","last_undegraded":"2024-09-10T08:28:48.620920+0000","last_fullsized":"2024-09-10T08:28:48.620920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:08.520314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621323+0000","last_change":"2024-09-10T08:28:47.634072+0000","last_active":"2024-09-10T08:28:48.621323+0000","last_peered":"2024-09-10T08:28:48.621323+0000","last_clean":"2024-09-10T08:28:48.621323+0000","last_became_active":"2024-09-10T08:28:47.633776+0000","last_became_peered":"2024-09-10T08:28:47.633776+0000","last_unstale":"2024-09-10T08:28:48.621323+0000","last_undegraded":"2024-09-10T08:28:48.621323+0000","last_fullsized":"2024-09-10T08:28:48.621323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:30.690202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354159+0000","last_change":"2024-09-10T08:28:35.572112+0000","last_active":"2024-09-10T08:28:49.354159+0000","last_peered":"2024-09-10T08:28:49.354159+0000","last_clean":"2024-09-10T08:28:49.354159+0000","last_became_active":"2024-09-10T08:28:35.571803+0000","last_became_peered":"2024-09-10T08:28:35.571803+0000","last_unstale":"2024-09-10T08:28:49.354159+0000","last_undegraded":"2024-09-10T08:28:49.354159+0000","last_fullsized":"2024-09-10T08:28:49.354159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:29.969987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621621+0000","last_change":"2024-09-10T08:28:47.620523+0000","last_active":"2024-09-10T08:28:48.621621+0000","last_peered":"2024-09-10T08:28:48.621621+0000","last_clean":"2024-09-10T08:28:48.621621+0000","last_became_active":"2024-09-10T08:28:47.620220+0000","last_became_peered":"2024-09-10T08:28:47.620220+0000","last_unstale":"2024-09-10T08:28:48.621621+0000","last_undegraded":"2024-09-10T08:28:48.621621+0000","last_fullsized":"2024-09-10T08:28:48.621621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:14.405210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621263+0000","last_change":"2024-09-10T08:28:35.578961+0000","last_active":"2024-09-10T08:28:48.621263+0000","last_peered":"2024-09-10T08:28:48.621263+0000","last_clean":"2024-09-10T08:28:48.621263+0000","last_became_active":"2024-09-10T08:28:35.578680+0000","last_became_peered":"2024-09-10T08:28:35.578680+0000","last_unstale":"2024-09-10T08:28:48.621263+0000","last_undegraded":"2024-09-10T08:28:48.621263+0000","last_fullsized":"2024-09-10T08:28:48.621263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:53.737412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299727+0000","last_change":"2024-09-10T08:28:47.624859+0000","last_active":"2024-09-10T08:28:49.299727+0000","last_peered":"2024-09-10T08:28:49.299727+0000","last_clean":"2024-09-10T08:28:49.299727+0000","last_became_active":"2024-09-10T08:28:47.624585+0000","last_became_peered":"2024-09-10T08:28:47.624585+0000","last_unstale":"2024-09-10T08:28:49.299727+0000","last_undegraded":"2024-09-10T08:28:49.299727+0000","last_fullsized":"2024-09-10T08:28:49.299727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:00.956870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631870+0000","last_change":"2024-09-10T08:28:35.573918+0000","last_active":"2024-09-10T08:28:48.631870+0000","last_peered":"2024-09-10T08:28:48.631870+0000","last_clean":"2024-09-10T08:28:48.631870+0000","last_became_active":"2024-09-10T08:28:35.573646+0000","last_became_peered":"2024-09-10T08:28:35.573646+0000","last_unstale":"2024-09-10T08:28:48.631870+0000","last_undegraded":"2024-09-10T08:28:48.631870+0000","last_fullsized":"2024-09-10T08:28:48.631870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:24.295630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354036+0000","last_change":"2024-09-10T08:28:47.631802+0000","last_active":"2024-09-10T08:28:49.354036+0000","last_peered":"2024-09-10T08:28:49.354036+0000","last_clean":"2024-09-10T08:28:49.354036+0000","last_became_active":"2024-09-10T08:28:47.631456+0000","last_became_peered":"2024-09-10T08:28:47.631456+0000","last_unstale":"2024-09-10T08:28:49.354036+0000","last_undegraded":"2024-09-10T08:28:49.354036+0000","last_fullsized":"2024-09-10T08:28:49.354036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:56.571659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634799+0000","last_change":"2024-09-10T08:28:35.578197+0000","last_active":"2024-09-10T08:28:48.634799+0000","last_peered":"2024-09-10T08:28:48.634799+0000","last_clean":"2024-09-10T08:28:48.634799+0000","last_became_active":"2024-09-10T08:28:35.577852+0000","last_became_peered":"2024-09-10T08:28:35.577852+0000","last_unstale":"2024-09-10T08:28:48.634799+0000","last_undegraded":"2024-09-10T08:28:48.634799+0000","last_fullsized":"2024-09-10T08:28:48.634799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:44.348299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354168+0000","last_change":"2024-09-10T08:28:47.629993+0000","last_active":"2024-09-10T08:28:49.354168+0000","last_peered":"2024-09-10T08:28:49.354168+0000","last_clean":"2024-09-10T08:28:49.354168+0000","last_became_active":"2024-09-10T08:28:47.629713+0000","last_became_peered":"2024-09-10T08:28:47.629713+0000","last_unstale":"2024-09-10T08:28:49.354168+0000","last_undegraded":"2024-09-10T08:28:49.354168+0000","last_fullsized":"2024-09-10T08:28:49.354168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:56.640722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355024+0000","last_change":"2024-09-10T08:28:35.571065+0000","last_active":"2024-09-10T08:28:49.355024+0000","last_peered":"2024-09-10T08:28:49.355024+0000","last_clean":"2024-09-10T08:28:49.355024+0000","last_became_active":"2024-09-10T08:28:35.570749+0000","last_became_peered":"2024-09-10T08:28:35.570749+0000","last_unstale":"2024-09-10T08:28:49.355024+0000","last_undegraded":"2024-09-10T08:28:49.355024+0000","last_fullsized":"2024-09-10T08:28:49.355024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:04.628661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":692114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":101836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":101304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":104320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":102868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":864256,"data_stored":692080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":103302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":262144,"data_stored":101144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:28:56.264 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:28:56.264 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T08:28:56.264 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-10T08:28:56.264 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-10T08:28:56.265 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-10T08:28:56.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.395+0000 7ff37068b640 1 Processor -- start 2024-09-10T08:28:56.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.395+0000 7ff37068b640 1 -- start start 2024-09-10T08:28:56.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.396+0000 7ff37068b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff36806c650 0x7ff3680c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.396+0000 7ff37068b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff3680ca1c0 0x7ff368160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.396+0000 7ff37068b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff36815a7c0 con 0x7ff368150480 2024-09-10T08:28:56.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.396+0000 7ff37068b640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7ff36806c240 con 0x7ff3680ca1c0 2024-09-10T08:28:56.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.396+0000 7ff37068b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff36815a330 con 0x7ff36806c650 2024-09-10T08:28:56.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.396+0000 7ff36ec28640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff3680ca1c0 0x7ff368160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.396+0000 7ff36ec28640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff3680ca1c0 0x7ff368160bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49388/0 (socket says 172.21.15.103:49388) 2024-09-10T08:28:56.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.396+0000 7ff36ec28640 1 -- 172.21.15.103:0/4278910333 learned_addr learned my addr 172.21.15.103:0/4278910333 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:56.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.396+0000 7ff36dc26640 1 --2- 172.21.15.103:0/4278910333 >> v2:172.21.15.154:3300/0 conn(0x7ff36806c650 0x7ff3680c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.396+0000 7ff36ec28640 1 -- 172.21.15.103:0/4278910333 >> v2:172.21.15.154:3300/0 conn(0x7ff36806c650 msgr2=0x7ff3680c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.396+0000 7ff36ec28640 1 --2- 172.21.15.103:0/4278910333 >> v2:172.21.15.154:3300/0 conn(0x7ff36806c650 0x7ff3680c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.396+0000 7ff36ec28640 1 -- 172.21.15.103:0/4278910333 >> v1:172.21.15.154:6789/0 conn(0x7ff368150480 legacy=0x7ff3680c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.396+0000 7ff36ec28640 1 -- 172.21.15.103:0/4278910333 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff368159a00 con 0x7ff3680ca1c0 2024-09-10T08:28:56.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.397+0000 7ff36ec28640 1 --2- 172.21.15.103:0/4278910333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3680ca1c0 0x7ff368160bf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff3680c6110 tx=0x7ff36002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a7e6e66bb41071 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.397+0000 7ff36d425640 1 -- 172.21.15.103:0/4278910333 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff360036070 con 0x7ff3680ca1c0 2024-09-10T08:28:56.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.397+0000 7ff36d425640 1 -- 172.21.15.103:0/4278910333 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff360031600 con 0x7ff3680ca1c0 2024-09-10T08:28:56.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.397+0000 7ff36d425640 1 -- 172.21.15.103:0/4278910333 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3600319d0 con 0x7ff3680ca1c0 2024-09-10T08:28:56.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.398+0000 7ff37068b640 1 -- 172.21.15.103:0/4278910333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3680ca1c0 msgr2=0x7ff368160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.398+0000 7ff37068b640 1 --2- 172.21.15.103:0/4278910333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3680ca1c0 0x7ff368160bf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff3680c6110 tx=0x7ff36002a6f0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.398+0000 7ff37068b640 1 -- 172.21.15.103:0/4278910333 shutdown_connections 2024-09-10T08:28:56.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.398+0000 7ff37068b640 1 --2- 172.21.15.103:0/4278910333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3680ca1c0 0x7ff368160bf0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.398+0000 7ff37068b640 1 --2- 172.21.15.103:0/4278910333 >> v2:172.21.15.154:3300/0 conn(0x7ff36806c650 0x7ff3680c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.398+0000 7ff37068b640 1 -- 172.21.15.103:0/4278910333 >> 172.21.15.103:0/4278910333 conn(0x7ff368068030 msgr2=0x7ff368073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.398+0000 7ff37068b640 1 -- 172.21.15.103:0/4278910333 shutdown_connections 2024-09-10T08:28:56.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.398+0000 7ff37068b640 1 -- 172.21.15.103:0/4278910333 wait complete. 2024-09-10T08:28:56.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.399+0000 7ff37068b640 1 Processor -- start 2024-09-10T08:28:56.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.399+0000 7ff37068b640 1 -- start start 2024-09-10T08:28:56.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.400+0000 7ff37068b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff36806c650 0x7ff3681e0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.400+0000 7ff37068b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3680ca1c0 0x7ff3680af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.400+0000 7ff37068b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff368150480 0x7ff368146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.400+0000 7ff37068b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff36806d270 con 0x7ff36806c650 2024-09-10T08:28:56.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.400+0000 7ff37068b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff368159fc0 con 0x7ff3680ca1c0 2024-09-10T08:28:56.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.400+0000 7ff37068b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff3680ca5f0 con 0x7ff368150480 2024-09-10T08:28:56.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.400+0000 7ff36e427640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff36806c650 0x7ff3681e0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.400+0000 7ff36e427640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff36806c650 0x7ff3681e0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49390/0 (socket says 172.21.15.103:49390) 2024-09-10T08:28:56.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.400+0000 7ff36e427640 1 -- 172.21.15.103:0/3314224298 learned_addr learned my addr 172.21.15.103:0/3314224298 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:56.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.400+0000 7ff36e427640 1 -- 172.21.15.103:0/3314224298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff368150480 msgr2=0x7ff368146650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.400+0000 7ff36e427640 1 --2- 172.21.15.103:0/3314224298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff368150480 0x7ff368146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.400+0000 7ff36e427640 1 -- 172.21.15.103:0/3314224298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3680ca1c0 msgr2=0x7ff3680af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.400+0000 7ff36e427640 1 --2- 172.21.15.103:0/3314224298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3680ca1c0 0x7ff3680af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.400+0000 7ff36e427640 1 -- 172.21.15.103:0/3314224298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3681e1430 con 0x7ff36806c650 2024-09-10T08:28:56.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.400+0000 7ff36e427640 1 --2- 172.21.15.103:0/3314224298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff36806c650 0x7ff3681e0b90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff36400c430 tx=0x7ff36400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.400+0000 7ff35effd640 1 -- 172.21.15.103:0/3314224298 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff364011790 con 0x7ff36806c650 2024-09-10T08:28:56.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.400+0000 7ff35effd640 1 -- 172.21.15.103:0/3314224298 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff364017070 con 0x7ff36806c650 2024-09-10T08:28:56.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.400+0000 7ff37068b640 1 -- 172.21.15.103:0/3314224298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3680af130 con 0x7ff36806c650 2024-09-10T08:28:56.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.400+0000 7ff35effd640 1 -- 172.21.15.103:0/3314224298 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff364011bb0 con 0x7ff36806c650 2024-09-10T08:28:56.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.400+0000 7ff37068b640 1 -- 172.21.15.103:0/3314224298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3681eccb0 con 0x7ff36806c650 2024-09-10T08:28:56.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.401+0000 7ff37068b640 1 -- 172.21.15.103:0/3314224298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3680697e0 con 0x7ff36806c650 2024-09-10T08:28:56.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.402+0000 7ff35effd640 1 -- 172.21.15.103:0/3314224298 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff36401c460 con 0x7ff36806c650 2024-09-10T08:28:56.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.402+0000 7ff35effd640 1 --2- 172.21.15.103:0/3314224298 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff34c06be30 0x7ff34c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.402+0000 7ff35effd640 1 -- 172.21.15.103:0/3314224298 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7ff36408b000 con 0x7ff36806c650 2024-09-10T08:28:56.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.402+0000 7ff36dc26640 1 --2- 172.21.15.103:0/3314224298 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff34c06be30 0x7ff34c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.403+0000 7ff36dc26640 1 --2- 172.21.15.103:0/3314224298 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff34c06be30 0x7ff34c06e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff3681546a0 tx=0x7ff358008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.407+0000 7ff35effd640 1 -- 172.21.15.103:0/3314224298 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff3680697e0 con 0x7ff36806c650 2024-09-10T08:28:56.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.615+0000 7ff37068b640 1 -- 172.21.15.103:0/3314224298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ff368156270 con 0x7ff36806c650 2024-09-10T08:28:56.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.618+0000 7ff35effd640 1 -- 172.21.15.103:0/3314224298 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172946 (secure 0 0 0) 0x7ff364059710 con 0x7ff36806c650 2024-09-10T08:28:56.623 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:56.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.621+0000 7ff37068b640 1 -- 172.21.15.103:0/3314224298 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff34c06be30 msgr2=0x7ff34c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.621+0000 7ff37068b640 1 --2- 172.21.15.103:0/3314224298 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff34c06be30 0x7ff34c06e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff3681546a0 tx=0x7ff358008040 comp rx=0 tx=0).stop 2024-09-10T08:28:56.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.621+0000 7ff37068b640 1 -- 172.21.15.103:0/3314224298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff36806c650 msgr2=0x7ff3681e0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.621+0000 7ff37068b640 1 --2- 172.21.15.103:0/3314224298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff36806c650 0x7ff3681e0b90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff36400c430 tx=0x7ff36400c8f0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.621+0000 7ff37068b640 1 -- 172.21.15.103:0/3314224298 shutdown_connections 2024-09-10T08:28:56.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.621+0000 7ff37068b640 1 --2- 172.21.15.103:0/3314224298 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff34c06be30 0x7ff34c06e2f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.621+0000 7ff37068b640 1 --2- 172.21.15.103:0/3314224298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff368150480 0x7ff368146650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.621+0000 7ff37068b640 1 --2- 172.21.15.103:0/3314224298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3680ca1c0 0x7ff3680af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.621+0000 7ff37068b640 1 --2- 172.21.15.103:0/3314224298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff36806c650 0x7ff3681e0b90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.621+0000 7ff37068b640 1 -- 172.21.15.103:0/3314224298 >> 172.21.15.103:0/3314224298 conn(0x7ff368068030 msgr2=0x7ff3680c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.621+0000 7ff37068b640 1 -- 172.21.15.103:0/3314224298 shutdown_connections 2024-09-10T08:28:56.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.621+0000 7ff37068b640 1 -- 172.21.15.103:0/3314224298 wait complete. 2024-09-10T08:28:56.632 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2491184865},{"type":"v1","addr":"172.21.15.103:6833","nonce":2491184865}]},"active_addr":"172.21.15.103:6833/2491184865","active_change":"2024-09-10T08:28:16.785008+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":1066094325}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":3692594875}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":1315116702}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":4146733074}]}]} 2024-09-10T08:28:56.635 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-10T08:28:56.635 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T08:28:56.636 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:28:56.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.734+0000 7f348a986640 1 Processor -- start 2024-09-10T08:28:56.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.734+0000 7f348a986640 1 -- start start 2024-09-10T08:28:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.735+0000 7f348a986640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f348406c650 0x7f34840c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.735+0000 7f348a986640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f34840ca1c0 0x7f3484160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.735+0000 7f348a986640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f348415a7c0 con 0x7f3484150480 2024-09-10T08:28:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.735+0000 7f348a986640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f348406c240 con 0x7f348406c650 2024-09-10T08:28:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.735+0000 7f348a986640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f348415a330 con 0x7f34840ca1c0 2024-09-10T08:28:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.735+0000 7f34837fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f348406c650 0x7f34840c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.735+0000 7f3483fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3484150480 0x7f34840c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50086/0 (socket says 172.21.15.103:50086) 2024-09-10T08:28:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.735+0000 7f34837fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f348406c650 0x7f34840c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49404/0 (socket says 172.21.15.103:49404) 2024-09-10T08:28:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.735+0000 7f3483fff640 1 -- 172.21.15.103:0/570676112 learned_addr learned my addr 172.21.15.103:0/570676112 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.735+0000 7f3488f23640 1 --2- 172.21.15.103:0/570676112 >> v2:172.21.15.154:3300/0 conn(0x7f34840ca1c0 0x7f3484160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.735+0000 7f34837fe640 1 -- 172.21.15.103:0/570676112 >> v2:172.21.15.154:3300/0 conn(0x7f34840ca1c0 msgr2=0x7f3484160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.735+0000 7f34837fe640 1 --2- 172.21.15.103:0/570676112 >> v2:172.21.15.154:3300/0 conn(0x7f34840ca1c0 0x7f3484160bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.735+0000 7f34837fe640 1 -- 172.21.15.103:0/570676112 >> v1:172.21.15.103:6789/0 conn(0x7f3484150480 legacy=0x7f34840c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.735+0000 7f34837fe640 1 -- 172.21.15.103:0/570676112 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3484159a00 con 0x7f348406c650 2024-09-10T08:28:56.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.735+0000 7f3482ffd640 1 -- 172.21.15.103:0/570676112 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1721166582 0 0) 0x7f348415a7c0 con 0x7f3484150480 2024-09-10T08:28:56.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.736+0000 7f34837fe640 1 --2- 172.21.15.103:0/570676112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f348406c650 0x7f34840c9c80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f348406bc70 tx=0x7f347802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d935213ff962cbca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.736+0000 7f3482ffd640 1 -- 172.21.15.103:0/570676112 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3478037070 con 0x7f348406c650 2024-09-10T08:28:56.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.736+0000 7f3482ffd640 1 -- 172.21.15.103:0/570676112 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3478032440 con 0x7f348406c650 2024-09-10T08:28:56.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.736+0000 7f3482ffd640 1 -- 172.21.15.103:0/570676112 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3478032810 con 0x7f348406c650 2024-09-10T08:28:56.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.736+0000 7f348a986640 1 -- 172.21.15.103:0/570676112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f348406c650 msgr2=0x7f34840c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.736+0000 7f348a986640 1 --2- 172.21.15.103:0/570676112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f348406c650 0x7f34840c9c80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f348406bc70 tx=0x7f347802a1a0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.737+0000 7f348a986640 1 -- 172.21.15.103:0/570676112 shutdown_connections 2024-09-10T08:28:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.737+0000 7f348a986640 1 --2- 172.21.15.103:0/570676112 >> v2:172.21.15.154:3300/0 conn(0x7f34840ca1c0 0x7f3484160bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.737+0000 7f348a986640 1 --2- 172.21.15.103:0/570676112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f348406c650 0x7f34840c9c80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.737+0000 7f348a986640 1 -- 172.21.15.103:0/570676112 >> 172.21.15.103:0/570676112 conn(0x7f3484068030 msgr2=0x7f3484073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.737+0000 7f348a986640 1 -- 172.21.15.103:0/570676112 shutdown_connections 2024-09-10T08:28:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.737+0000 7f348a986640 1 -- 172.21.15.103:0/570676112 wait complete. 2024-09-10T08:28:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.738+0000 7f348a986640 1 Processor -- start 2024-09-10T08:28:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.738+0000 7f348a986640 1 -- start start 2024-09-10T08:28:56.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.738+0000 7f348a986640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f348406c650 0x7f34841e2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.738+0000 7f348a986640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34840ca1c0 0x7f34841589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.738+0000 7f348a986640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3484150480 0x7f34841efb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.738+0000 7f348a986640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f348406d270 con 0x7f3484150480 2024-09-10T08:28:56.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.739+0000 7f348a986640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3484159fc0 con 0x7f34840ca1c0 2024-09-10T08:28:56.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.739+0000 7f348a986640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f34840ca5f0 con 0x7f348406c650 2024-09-10T08:28:56.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.739+0000 7f3488f23640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3484150480 0x7f34841efb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.739+0000 7f3488f23640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3484150480 0x7f34841efb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49414/0 (socket says 172.21.15.103:49414) 2024-09-10T08:28:56.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.739+0000 7f3488f23640 1 -- 172.21.15.103:0/2550204724 learned_addr learned my addr 172.21.15.103:0/2550204724 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:56.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.739+0000 7f3483fff640 1 --2- 172.21.15.103:0/2550204724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f348406c650 0x7f34841e2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.739+0000 7f34837fe640 1 --2- 172.21.15.103:0/2550204724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34840ca1c0 0x7f34841589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.739+0000 7f3488f23640 1 -- 172.21.15.103:0/2550204724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f348406c650 msgr2=0x7f34841e2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.739+0000 7f3488f23640 1 --2- 172.21.15.103:0/2550204724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f348406c650 0x7f34841e2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.739+0000 7f3488f23640 1 -- 172.21.15.103:0/2550204724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34840ca1c0 msgr2=0x7f34841589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.739+0000 7f3488f23640 1 --2- 172.21.15.103:0/2550204724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34840ca1c0 0x7f34841589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.739+0000 7f3488f23640 1 -- 172.21.15.103:0/2550204724 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34841ef640 con 0x7f3484150480 2024-09-10T08:28:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.739+0000 7f3488f23640 1 --2- 172.21.15.103:0/2550204724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3484150480 0x7f34841efb20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f347c007e60 tx=0x7f347c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.739+0000 7f3480ff9640 1 -- 172.21.15.103:0/2550204724 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c014420 con 0x7f3484150480 2024-09-10T08:28:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.739+0000 7f3480ff9640 1 -- 172.21.15.103:0/2550204724 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f347c019070 con 0x7f3484150480 2024-09-10T08:28:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.739+0000 7f348a986640 1 -- 172.21.15.103:0/2550204724 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f348414fa90 con 0x7f3484150480 2024-09-10T08:28:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.739+0000 7f3480ff9640 1 -- 172.21.15.103:0/2550204724 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c014820 con 0x7f3484150480 2024-09-10T08:28:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.739+0000 7f348a986640 1 -- 172.21.15.103:0/2550204724 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f348414fd50 con 0x7f3484150480 2024-09-10T08:28:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.740+0000 7f348a986640 1 -- 172.21.15.103:0/2550204724 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34841ef810 con 0x7f3484150480 2024-09-10T08:28:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.741+0000 7f3480ff9640 1 -- 172.21.15.103:0/2550204724 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f347c0149c0 con 0x7f3484150480 2024-09-10T08:28:56.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.741+0000 7f3480ff9640 1 --2- 172.21.15.103:0/2550204724 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f347006be30 0x7f347006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.741+0000 7f3480ff9640 1 -- 172.21.15.103:0/2550204724 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f347c08b7e0 con 0x7f3484150480 2024-09-10T08:28:56.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.741+0000 7f3483fff640 1 --2- 172.21.15.103:0/2550204724 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f347006be30 0x7f347006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.742+0000 7f3483fff640 1 --2- 172.21.15.103:0/2550204724 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f347006be30 0x7f347006e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3474000f60 tx=0x7f3474007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.745+0000 7f3480ff9640 1 -- 172.21.15.103:0/2550204724 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f347c0598a0 con 0x7f3484150480 2024-09-10T08:28:56.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.915+0000 7f348a986640 1 -- 172.21.15.103:0/2550204724 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3484156270 con 0x7f3484150480 2024-09-10T08:28:56.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.917+0000 7f3480ff9640 1 -- 172.21.15.103:0/2550204724 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20499 (secure 0 0 0) 0x7f347c0600c0 con 0x7f3484150480 2024-09-10T08:28:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:56.918 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","created":"2024-09-10T08:28:12.654957+0000","modified":"2024-09-10T08:28:48.615871+0000","last_up_change":"2024-09-10T08:28:25.445753+0000","last_in_change":"2024-09-10T08:28:14.741133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:24.821696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-10T08:28:33.488154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-10T08:28:33.857868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-10T08:28:44.793084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-10T08:28:45.930823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1abe08f4-0348-435e-9f97-cec00e96992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6809","nonce":2707863099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6811","nonce":2707863099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6815","nonce":2707863099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6813","nonce":2707863099}]},"public_addr":"172.21.15.103:6809/2707863099","cluster_addr":"172.21.15.103:6811/2707863099","heartbeat_back_addr":"172.21.15.103:6815/2707863099","heartbeat_front_addr":"172.21.15.103:6813/2707863099","state":["exists","up"]},{"osd":1,"uuid":"df342e58-1026-4739-82f6-7a216707444c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6818","nonce":4029892782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6822","nonce":4029892782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6830","nonce":4029892782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6826","nonce":4029892782}]},"public_addr":"172.21.15.103:6818/4029892782","cluster_addr":"172.21.15.103:6822/4029892782","heartbeat_back_addr":"172.21.15.103:6830/4029892782","heartbeat_front_addr":"172.21.15.103:6826/4029892782","state":["exists","up"]},{"osd":2,"uuid":"f7aea2cf-208c-41ed-a0f6-8948d70b9a0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6819","nonce":428484432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6821","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6823","nonce":428484432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6829","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6831","nonce":428484432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6825","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6827","nonce":428484432}]},"public_addr":"172.21.15.103:6819/428484432","cluster_addr":"172.21.15.103:6823/428484432","heartbeat_back_addr":"172.21.15.103:6831/428484432","heartbeat_front_addr":"172.21.15.103:6827/428484432","state":["exists","up"]},{"osd":3,"uuid":"615ef8b0-12a5-4503-96d0-f7ec17dbc792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6801","nonce":3453676282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6803","nonce":3453676282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6807","nonce":3453676282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6805","nonce":3453676282}]},"public_addr":"172.21.15.103:6801/3453676282","cluster_addr":"172.21.15.103:6803/3453676282","heartbeat_back_addr":"172.21.15.103:6807/3453676282","heartbeat_front_addr":"172.21.15.103:6805/3453676282","state":["exists","up"]},{"osd":4,"uuid":"644c5e94-db18-4b83-b5cd-3762ae2647a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6809","nonce":1808157069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6811","nonce":1808157069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6815","nonce":1808157069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6813","nonce":1808157069}]},"public_addr":"172.21.15.154:6809/1808157069","cluster_addr":"172.21.15.154:6811/1808157069","heartbeat_back_addr":"172.21.15.154:6815/1808157069","heartbeat_front_addr":"172.21.15.154:6813/1808157069","state":["exists","up"]},{"osd":5,"uuid":"f40210bd-f4ca-442e-baac-729ced5a9f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6817","nonce":1048015779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6819","nonce":1048015779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6823","nonce":1048015779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6821","nonce":1048015779}]},"public_addr":"172.21.15.154:6817/1048015779","cluster_addr":"172.21.15.154:6819/1048015779","heartbeat_back_addr":"172.21.15.154:6823/1048015779","heartbeat_front_addr":"172.21.15.154:6821/1048015779","state":["exists","up"]},{"osd":6,"uuid":"eebac31e-aaef-47b0-90d7-4af08f36d7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6801","nonce":345273812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6803","nonce":345273812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6807","nonce":345273812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6805","nonce":345273812}]},"public_addr":"172.21.15.154:6801/345273812","cluster_addr":"172.21.15.154:6803/345273812","heartbeat_back_addr":"172.21.15.154:6807/345273812","heartbeat_front_addr":"172.21.15.154:6805/345273812","state":["exists","up"]},{"osd":7,"uuid":"58406c9a-036f-4618-bfb6-0beddbd71605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6825","nonce":3439481239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6827","nonce":3439481239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6831","nonce":3439481239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6829","nonce":3439481239}]},"public_addr":"172.21.15.154:6825/3439481239","cluster_addr":"172.21.15.154:6827/3439481239","heartbeat_back_addr":"172.21.15.154:6831/3439481239","heartbeat_front_addr":"172.21.15.154:6829/3439481239","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.032718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.126448+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.781158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.808718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.050591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.038245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.586989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.223326+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:28:56.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.919+0000 7f348a986640 1 -- 172.21.15.103:0/2550204724 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f347006be30 msgr2=0x7f347006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.919+0000 7f348a986640 1 --2- 172.21.15.103:0/2550204724 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f347006be30 0x7f347006e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3474000f60 tx=0x7f3474007d50 comp rx=0 tx=0).stop 2024-09-10T08:28:56.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.919+0000 7f348a986640 1 -- 172.21.15.103:0/2550204724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3484150480 msgr2=0x7f34841efb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.919+0000 7f348a986640 1 --2- 172.21.15.103:0/2550204724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3484150480 0x7f34841efb20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f347c007e60 tx=0x7f347c00e4b0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.919+0000 7f348a986640 1 -- 172.21.15.103:0/2550204724 shutdown_connections 2024-09-10T08:28:56.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.919+0000 7f348a986640 1 --2- 172.21.15.103:0/2550204724 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f347006be30 0x7f347006e2f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.919+0000 7f348a986640 1 --2- 172.21.15.103:0/2550204724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3484150480 0x7f34841efb20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.919+0000 7f348a986640 1 --2- 172.21.15.103:0/2550204724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34840ca1c0 0x7f34841589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.919+0000 7f348a986640 1 --2- 172.21.15.103:0/2550204724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f348406c650 0x7f34841e2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.919+0000 7f348a986640 1 -- 172.21.15.103:0/2550204724 >> 172.21.15.103:0/2550204724 conn(0x7f3484068030 msgr2=0x7f3484155550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.919+0000 7f348a986640 1 -- 172.21.15.103:0/2550204724 shutdown_connections 2024-09-10T08:28:56.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:56.919+0000 7f348a986640 1 -- 172.21.15.103:0/2550204724 wait complete. 2024-09-10T08:28:56.931 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T08:28:56.931 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:28:57.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.029+0000 7f56e7d13640 1 Processor -- start 2024-09-10T08:28:57.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.029+0000 7f56e7d13640 1 -- start start 2024-09-10T08:28:57.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.030+0000 7f56e7d13640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56e00c4ac0 0x7f56e0153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.030+0000 7f56e7d13640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f56e00afc60 0x7f56e0151380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.030+0000 7f56e7d13640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56e006efa0 con 0x7f56e0072ec0 2024-09-10T08:28:57.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.030+0000 7f56e7d13640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f56e006f280 con 0x7f56e00afc60 2024-09-10T08:28:57.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.030+0000 7f56e7d13640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f56e006f560 con 0x7f56e00c4ac0 2024-09-10T08:28:57.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.030+0000 7f56e5aaf640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f56e0072ec0 0x7f56e0070040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50092/0 (socket says 172.21.15.103:50092) 2024-09-10T08:28:57.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.030+0000 7f56e5aaf640 1 -- 172.21.15.103:0/1112685108 learned_addr learned my addr 172.21.15.103:0/1112685108 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:57.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.030+0000 7f56e4aad640 1 -- 172.21.15.103:0/1112685108 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2035568211 0 0) 0x7f56e006efa0 con 0x7f56e0072ec0 2024-09-10T08:28:57.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.030+0000 7f56e52ae640 1 --2- 172.21.15.103:0/1112685108 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56e00c4ac0 0x7f56e0153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.030+0000 7f56e4aad640 1 -- 172.21.15.103:0/1112685108 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56cc003520 con 0x7f56e0072ec0 2024-09-10T08:28:57.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.030+0000 7f56e62b0640 1 --2- 172.21.15.103:0/1112685108 >> v2:172.21.15.154:3300/0 conn(0x7f56e00afc60 0x7f56e0151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.030+0000 7f56e4aad640 1 -- 172.21.15.103:0/1112685108 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 592321632 0 0) 0x7f56cc003520 con 0x7f56e0072ec0 2024-09-10T08:28:57.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.030+0000 7f56e4aad640 1 -- 172.21.15.103:0/1112685108 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56e00c4ac0 msgr2=0x7f56e0153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.031+0000 7f56e4aad640 1 --2- 172.21.15.103:0/1112685108 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56e00c4ac0 0x7f56e0153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.031+0000 7f56e4aad640 1 -- 172.21.15.103:0/1112685108 >> v2:172.21.15.154:3300/0 conn(0x7f56e00afc60 msgr2=0x7f56e0151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.031+0000 7f56e4aad640 1 --2- 172.21.15.103:0/1112685108 >> v2:172.21.15.154:3300/0 conn(0x7f56e00afc60 0x7f56e0151380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.031+0000 7f56e4aad640 1 -- 172.21.15.103:0/1112685108 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e006f840 con 0x7f56e0072ec0 2024-09-10T08:28:57.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.031+0000 7f56e4aad640 1 -- 172.21.15.103:0/1112685108 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f56dc001670 con 0x7f56e0072ec0 2024-09-10T08:28:57.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.031+0000 7f56e4aad640 1 -- 172.21.15.103:0/1112685108 >> v1:172.21.15.103:6789/0 conn(0x7f56e0072ec0 legacy=0x7f56e0070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.031+0000 7f56e4aad640 1 --2- 172.21.15.103:0/1112685108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56cc0039b0 0x7f56cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.031+0000 7f56e4aad640 1 --2- 172.21.15.103:0/1112685108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56cc004800 0x7f56cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.031+0000 7f56e4aad640 1 --2- 172.21.15.103:0/1112685108 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56e00c4ac0 0x7f56cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.031+0000 7f56e4aad640 1 -- 172.21.15.103:0/1112685108 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f56e006f280 con 0x7f56cc004800 2024-09-10T08:28:57.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.031+0000 7f56e4aad640 1 -- 172.21.15.103:0/1112685108 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f56e006f560 con 0x7f56cc0039b0 2024-09-10T08:28:57.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.031+0000 7f56e4aad640 1 -- 172.21.15.103:0/1112685108 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f56cc00ba70 con 0x7f56e00c4ac0 2024-09-10T08:28:57.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.031+0000 7f56e52ae640 1 --2- 172.21.15.103:0/1112685108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56cc004800 0x7f56cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.031+0000 7f56e5aaf640 1 --2- 172.21.15.103:0/1112685108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56cc0039b0 0x7f56cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.031+0000 7f56e62b0640 1 --2- 172.21.15.103:0/1112685108 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56e00c4ac0 0x7f56cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.031+0000 7f56e52ae640 1 -- 172.21.15.103:0/1112685108 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56e00c4ac0 msgr2=0x7f56cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.031+0000 7f56e52ae640 1 --2- 172.21.15.103:0/1112685108 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56e00c4ac0 0x7f56cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.031+0000 7f56e52ae640 1 -- 172.21.15.103:0/1112685108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56cc0039b0 msgr2=0x7f56cc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.031+0000 7f56e52ae640 1 --2- 172.21.15.103:0/1112685108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56cc0039b0 0x7f56cc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.031+0000 7f56e52ae640 1 -- 172.21.15.103:0/1112685108 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56cc003520 con 0x7f56cc004800 2024-09-10T08:28:57.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.031+0000 7f56e5aaf640 1 --2- 172.21.15.103:0/1112685108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56cc0039b0 0x7f56cc003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:57.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.032+0000 7f56e52ae640 1 --2- 172.21.15.103:0/1112685108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56cc004800 0x7f56cc004c80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009a90 tx=0x7f56cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ce102d4dda55bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.032+0000 7f56e4aad640 1 -- 172.21.15.103:0/1112685108 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0036070 con 0x7f56cc004800 2024-09-10T08:28:57.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.032+0000 7f56e4aad640 1 -- 172.21.15.103:0/1112685108 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d0031400 con 0x7f56cc004800 2024-09-10T08:28:57.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.032+0000 7f56e4aad640 1 -- 172.21.15.103:0/1112685108 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0009690 con 0x7f56cc004800 2024-09-10T08:28:57.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.032+0000 7f56e7d13640 1 -- 172.21.15.103:0/1112685108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56cc004800 msgr2=0x7f56cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.032+0000 7f56e7d13640 1 --2- 172.21.15.103:0/1112685108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56cc004800 0x7f56cc004c80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009a90 tx=0x7f56cc005830 comp rx=0 tx=0).stop 2024-09-10T08:28:57.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.032+0000 7f56e62b0640 1 -- 172.21.15.103:0/1112685108 reap_dead start 2024-09-10T08:28:57.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.032+0000 7f56e7d13640 1 -- 172.21.15.103:0/1112685108 shutdown_connections 2024-09-10T08:28:57.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.032+0000 7f56e7d13640 1 -- 172.21.15.103:0/1112685108 >> 172.21.15.103:0/1112685108 conn(0x7f56e00c9d80 msgr2=0x7f56e00ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.032+0000 7f56e7d13640 1 -- 172.21.15.103:0/1112685108 shutdown_connections 2024-09-10T08:28:57.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.032+0000 7f56e7d13640 1 -- 172.21.15.103:0/1112685108 wait complete. 2024-09-10T08:28:57.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.034+0000 7f56e7d13640 1 Processor -- start 2024-09-10T08:28:57.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.034+0000 7f56e7d13640 1 -- start start 2024-09-10T08:28:57.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.034+0000 7f56e7d13640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56cc004800 0x7f56e0148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.034+0000 7f56e7d13640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56e014f140 0x7f56e0144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.034+0000 7f56e7d13640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56e01ef230 0x7f56e0144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.034+0000 7f56e7d13640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f56e0070750 con 0x7f56e014f140 2024-09-10T08:28:57.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.034+0000 7f56e7d13640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f56e00c47f0 con 0x7f56e01ef230 2024-09-10T08:28:57.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.034+0000 7f56e7d13640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f56e00708d0 con 0x7f56cc004800 2024-09-10T08:28:57.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.034+0000 7f56e52ae640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56e014f140 0x7f56e0144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.034+0000 7f56e52ae640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56e014f140 0x7f56e0144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49434/0 (socket says 172.21.15.103:49434) 2024-09-10T08:28:57.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.034+0000 7f56e52ae640 1 -- 172.21.15.103:0/2192032555 learned_addr learned my addr 172.21.15.103:0/2192032555 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.034+0000 7f56e5aaf640 1 --2- 172.21.15.103:0/2192032555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56cc004800 0x7f56e0148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.035+0000 7f56e62b0640 1 --2- 172.21.15.103:0/2192032555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56e01ef230 0x7f56e0144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.035+0000 7f56e52ae640 1 -- 172.21.15.103:0/2192032555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56cc004800 msgr2=0x7f56e0148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.035+0000 7f56e52ae640 1 --2- 172.21.15.103:0/2192032555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56cc004800 0x7f56e0148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.035+0000 7f56e52ae640 1 -- 172.21.15.103:0/2192032555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56e01ef230 msgr2=0x7f56e0144cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.035+0000 7f56e52ae640 1 --2- 172.21.15.103:0/2192032555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56e01ef230 0x7f56e0144cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.035+0000 7f56e52ae640 1 -- 172.21.15.103:0/2192032555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e01ef7f0 con 0x7f56e014f140 2024-09-10T08:28:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.035+0000 7f56e62b0640 1 --2- 172.21.15.103:0/2192032555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56e01ef230 0x7f56e0144cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.035+0000 7f56e52ae640 1 --2- 172.21.15.103:0/2192032555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56e014f140 0x7f56e0144790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009bb0 tx=0x7f56d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.035+0000 7f56d67fc640 1 -- 172.21.15.103:0/2192032555 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0040020 con 0x7f56e014f140 2024-09-10T08:28:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.035+0000 7f56d67fc640 1 -- 172.21.15.103:0/2192032555 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d0003b40 con 0x7f56e014f140 2024-09-10T08:28:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.035+0000 7f56e7d13640 1 -- 172.21.15.103:0/2192032555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e01efad0 con 0x7f56e014f140 2024-09-10T08:28:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.035+0000 7f56d67fc640 1 -- 172.21.15.103:0/2192032555 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0036040 con 0x7f56e014f140 2024-09-10T08:28:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.035+0000 7f56e7d13640 1 -- 172.21.15.103:0/2192032555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e01494e0 con 0x7f56e014f140 2024-09-10T08:28:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.036+0000 7f56e7d13640 1 -- 172.21.15.103:0/2192032555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e0073600 con 0x7f56e014f140 2024-09-10T08:28:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.036+0000 7f56d67fc640 1 -- 172.21.15.103:0/2192032555 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f56d0043020 con 0x7f56e014f140 2024-09-10T08:28:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.037+0000 7f56d67fc640 1 --2- 172.21.15.103:0/2192032555 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f56c406be30 0x7f56c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.037+0000 7f56e5aaf640 1 --2- 172.21.15.103:0/2192032555 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f56c406be30 0x7f56c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.037+0000 7f56d67fc640 1 -- 172.21.15.103:0/2192032555 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f56d00ab210 con 0x7f56e014f140 2024-09-10T08:28:57.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.037+0000 7f56e5aaf640 1 --2- 172.21.15.103:0/2192032555 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f56c406be30 0x7f56c406e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f56dc000fb0 tx=0x7f56dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.041+0000 7f56d67fc640 1 -- 172.21.15.103:0/2192032555 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f56e0073600 con 0x7f56e014f140 2024-09-10T08:28:57.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.206+0000 7f56e7d13640 1 -- 172.21.15.103:0/2192032555 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f56e00732a0 con 0x7f56e014f140 2024-09-10T08:28:57.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.207+0000 7f56d67fc640 1 -- 172.21.15.103:0/2192032555 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20499 (secure 0 0 0) 0x7f56d004a070 con 0x7f56e014f140 2024-09-10T08:28:57.208 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:28:57.208 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","created":"2024-09-10T08:28:12.654957+0000","modified":"2024-09-10T08:28:48.615871+0000","last_up_change":"2024-09-10T08:28:25.445753+0000","last_in_change":"2024-09-10T08:28:14.741133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:24.821696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-10T08:28:33.488154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-10T08:28:33.857868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-10T08:28:44.793084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-10T08:28:45.930823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1abe08f4-0348-435e-9f97-cec00e96992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6809","nonce":2707863099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6811","nonce":2707863099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6815","nonce":2707863099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6813","nonce":2707863099}]},"public_addr":"172.21.15.103:6809/2707863099","cluster_addr":"172.21.15.103:6811/2707863099","heartbeat_back_addr":"172.21.15.103:6815/2707863099","heartbeat_front_addr":"172.21.15.103:6813/2707863099","state":["exists","up"]},{"osd":1,"uuid":"df342e58-1026-4739-82f6-7a216707444c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6818","nonce":4029892782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6822","nonce":4029892782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6830","nonce":4029892782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6826","nonce":4029892782}]},"public_addr":"172.21.15.103:6818/4029892782","cluster_addr":"172.21.15.103:6822/4029892782","heartbeat_back_addr":"172.21.15.103:6830/4029892782","heartbeat_front_addr":"172.21.15.103:6826/4029892782","state":["exists","up"]},{"osd":2,"uuid":"f7aea2cf-208c-41ed-a0f6-8948d70b9a0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6819","nonce":428484432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6821","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6823","nonce":428484432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6829","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6831","nonce":428484432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6825","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6827","nonce":428484432}]},"public_addr":"172.21.15.103:6819/428484432","cluster_addr":"172.21.15.103:6823/428484432","heartbeat_back_addr":"172.21.15.103:6831/428484432","heartbeat_front_addr":"172.21.15.103:6827/428484432","state":["exists","up"]},{"osd":3,"uuid":"615ef8b0-12a5-4503-96d0-f7ec17dbc792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6801","nonce":3453676282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6803","nonce":3453676282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6807","nonce":3453676282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6805","nonce":3453676282}]},"public_addr":"172.21.15.103:6801/3453676282","cluster_addr":"172.21.15.103:6803/3453676282","heartbeat_back_addr":"172.21.15.103:6807/3453676282","heartbeat_front_addr":"172.21.15.103:6805/3453676282","state":["exists","up"]},{"osd":4,"uuid":"644c5e94-db18-4b83-b5cd-3762ae2647a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6809","nonce":1808157069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6811","nonce":1808157069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6815","nonce":1808157069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6813","nonce":1808157069}]},"public_addr":"172.21.15.154:6809/1808157069","cluster_addr":"172.21.15.154:6811/1808157069","heartbeat_back_addr":"172.21.15.154:6815/1808157069","heartbeat_front_addr":"172.21.15.154:6813/1808157069","state":["exists","up"]},{"osd":5,"uuid":"f40210bd-f4ca-442e-baac-729ced5a9f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6817","nonce":1048015779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6819","nonce":1048015779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6823","nonce":1048015779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6821","nonce":1048015779}]},"public_addr":"172.21.15.154:6817/1048015779","cluster_addr":"172.21.15.154:6819/1048015779","heartbeat_back_addr":"172.21.15.154:6823/1048015779","heartbeat_front_addr":"172.21.15.154:6821/1048015779","state":["exists","up"]},{"osd":6,"uuid":"eebac31e-aaef-47b0-90d7-4af08f36d7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6801","nonce":345273812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6803","nonce":345273812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6807","nonce":345273812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6805","nonce":345273812}]},"public_addr":"172.21.15.154:6801/345273812","cluster_addr":"172.21.15.154:6803/345273812","heartbeat_back_addr":"172.21.15.154:6807/345273812","heartbeat_front_addr":"172.21.15.154:6805/345273812","state":["exists","up"]},{"osd":7,"uuid":"58406c9a-036f-4618-bfb6-0beddbd71605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6825","nonce":3439481239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6827","nonce":3439481239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6831","nonce":3439481239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6829","nonce":3439481239}]},"public_addr":"172.21.15.154:6825/3439481239","cluster_addr":"172.21.15.154:6827/3439481239","heartbeat_back_addr":"172.21.15.154:6831/3439481239","heartbeat_front_addr":"172.21.15.154:6829/3439481239","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.032718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.126448+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.781158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.808718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.050591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.038245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.586989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.223326+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:28:57.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.209+0000 7f56e7d13640 1 -- 172.21.15.103:0/2192032555 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f56c406be30 msgr2=0x7f56c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.209+0000 7f56e7d13640 1 --2- 172.21.15.103:0/2192032555 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f56c406be30 0x7f56c406e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f56dc000fb0 tx=0x7f56dc009040 comp rx=0 tx=0).stop 2024-09-10T08:28:57.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.209+0000 7f56e7d13640 1 -- 172.21.15.103:0/2192032555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56e014f140 msgr2=0x7f56e0144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.209+0000 7f56e7d13640 1 --2- 172.21.15.103:0/2192032555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56e014f140 0x7f56e0144790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009bb0 tx=0x7f56d0004730 comp rx=0 tx=0).stop 2024-09-10T08:28:57.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.209+0000 7f56e7d13640 1 -- 172.21.15.103:0/2192032555 shutdown_connections 2024-09-10T08:28:57.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.209+0000 7f56e7d13640 1 --2- 172.21.15.103:0/2192032555 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f56c406be30 0x7f56c406e2f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.209+0000 7f56e7d13640 1 --2- 172.21.15.103:0/2192032555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56e01ef230 0x7f56e0144cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.209+0000 7f56e7d13640 1 --2- 172.21.15.103:0/2192032555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56e014f140 0x7f56e0144790 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.209+0000 7f56e7d13640 1 --2- 172.21.15.103:0/2192032555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56cc004800 0x7f56e0148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.209+0000 7f56e7d13640 1 -- 172.21.15.103:0/2192032555 >> 172.21.15.103:0/2192032555 conn(0x7f56e00c9d80 msgr2=0x7f56e00c5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.209+0000 7f56e7d13640 1 -- 172.21.15.103:0/2192032555 shutdown_connections 2024-09-10T08:28:57.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.209+0000 7f56e7d13640 1 -- 172.21.15.103:0/2192032555 wait complete. 2024-09-10T08:28:57.222 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T08:28:57.222 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T08:28:57.223 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T08:28:57.223 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T08:28:57.223 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-10T08:28:57.224 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-10T08:28:57.224 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-10T08:28:57.225 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-10T08:28:57.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.390+0000 7f3b7759e640 1 Processor -- start 2024-09-10T08:28:57.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.390+0000 7f3b7759e640 1 -- start start 2024-09-10T08:28:57.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.390+0000 7faabf778640 1 Processor -- start 2024-09-10T08:28:57.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.391+0000 7f3b7759e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b780ab600 0x7f3b780c34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.390+0000 7faabf778640 1 -- start start 2024-09-10T08:28:57.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.391+0000 7f627ec01640 1 Processor -- start 2024-09-10T08:28:57.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.391+0000 7f3b75d9b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3b780aa980 0x7f3b7814fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50098/0 (socket says 172.21.15.103:50098) 2024-09-10T08:28:57.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.391+0000 7f3b7659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b780ab600 0x7f3b780c34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.391+0000 7f627ec01640 1 -- start start 2024-09-10T08:28:57.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.391+0000 7faabf778640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faab8157ff0 0x7faab80c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.391+0000 7faabf778640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faab815e050 con 0x7faab80c2980 2024-09-10T08:28:57.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.391+0000 7faabf778640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faab815e330 con 0x7faab80c5940 2024-09-10T08:28:57.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.391+0000 7faabf778640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7faab815e610 con 0x7faab8157ff0 2024-09-10T08:28:57.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.391+0000 7f3b7659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b780ab600 0x7f3b780c34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:52904/0 (socket says 172.21.15.103:52904) 2024-09-10T08:28:57.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.392+0000 7faabdd15640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7faab80c5940 0x7faab8164fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:33402/0 (socket says 172.21.15.103:33402) 2024-09-10T08:28:57.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.392+0000 7faabdd15640 1 -- 172.21.15.103:0/2700675520 learned_addr learned my addr 172.21.15.103:0/2700675520 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:57.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.389+0000 7f2657fff640 1 Processor -- start 2024-09-10T08:28:57.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.389+0000 7f2657fff640 1 -- start start 2024-09-10T08:28:57.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.390+0000 7f2657fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26500f5090 0x7f2650049180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.390+0000 7f2657fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f265000ac80 0x7f265000b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.390+0000 7f2657fff640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26500f78b0 con 0x7f2650005ba0 2024-09-10T08:28:57.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.390+0000 7f2657fff640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f26500f8780 con 0x7f265000ac80 2024-09-10T08:28:57.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.390+0000 7f2657fff640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f26500f7b70 con 0x7f26500f5090 2024-09-10T08:28:57.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.391+0000 7f2656ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26500f5090 0x7f2650049180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.391+0000 7f2656ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26500f5090 0x7f2650049180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:52900/0 (socket says 172.21.15.103:52900) 2024-09-10T08:28:57.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.391+0000 7f2656ffd640 1 -- 172.21.15.103:0/1960388892 learned_addr learned my addr 172.21.15.103:0/1960388892 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.391+0000 7f2655ffb640 1 -- 172.21.15.103:0/1960388892 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2596934752 0 0) 0x7f26500f78b0 con 0x7f2650005ba0 2024-09-10T08:28:57.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.392+0000 7f2655ffb640 1 -- 172.21.15.103:0/1960388892 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2640005730 con 0x7f2650005ba0 2024-09-10T08:28:57.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.391+0000 7f26567fc640 1 --2- 172.21.15.103:0/1960388892 >> v2:172.21.15.154:3300/0 conn(0x7f265000ac80 0x7f265000b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.392+0000 7f149feb7640 1 Processor -- start 2024-09-10T08:28:57.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.392+0000 7f3b75d9b640 1 -- 172.21.15.103:0/3515294645 learned_addr learned my addr 172.21.15.103:0/3515294645 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:57.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.392+0000 7f3b7759e640 1 --2- 172.21.15.103:0/3515294645 >> v2:172.21.15.103:3300/0 conn(0x7f3b780aae20 0x7f3b780c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.392+0000 7f627ec01640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627814fa90 0x7f62780c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.392+0000 7f627ec01640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f627806f1d0 0x7f62780c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.392+0000 7f627ec01640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62780c7500 con 0x7f62780c4a10 2024-09-10T08:28:57.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.392+0000 7f627ec01640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f62780c72b0 con 0x7f627806f1d0 2024-09-10T08:28:57.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.392+0000 7f627ec01640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6278152580 con 0x7f627814fa90 2024-09-10T08:28:57.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.392+0000 7f3b76d9d640 1 --2- 172.21.15.103:0/3515294645 >> v2:172.21.15.103:3300/0 conn(0x7f3b780aae20 0x7f3b780c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7f627c99d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627814fa90 0x7f62780c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7f3b7759e640 1 -- 172.21.15.103:0/3515294645 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b78153640 con 0x7f3b780aa980 2024-09-10T08:28:57.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7f627c99d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627814fa90 0x7f62780c2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:52936/0 (socket says 172.21.15.103:52936) 2024-09-10T08:28:57.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7f627c99d640 1 -- 172.21.15.103:0/810921174 learned_addr learned my addr 172.21.15.103:0/810921174 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.392+0000 7f2656ffd640 1 -- 172.21.15.103:0/1960388892 >> v2:172.21.15.154:3300/0 conn(0x7f265000ac80 msgr2=0x7f265000b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.392+0000 7f2656ffd640 1 --2- 172.21.15.103:0/1960388892 >> v2:172.21.15.154:3300/0 conn(0x7f265000ac80 0x7f265000b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.392+0000 7f2656ffd640 1 -- 172.21.15.103:0/1960388892 >> v1:172.21.15.103:6789/0 conn(0x7f2650005ba0 legacy=0x7f2650006050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.392+0000 7f2656ffd640 1 -- 172.21.15.103:0/1960388892 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26500f7e50 con 0x7f26500f5090 2024-09-10T08:28:57.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7f3b7759e640 1 -- 172.21.15.103:0/3515294645 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f3b780c2770 con 0x7f3b780aae20 2024-09-10T08:28:57.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7f627c99d640 1 -- 172.21.15.103:0/810921174 >> v2:172.21.15.154:3300/0 conn(0x7f627806f1d0 msgr2=0x7f62780c44d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T08:28:57.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7f627c99d640 1 --2- 172.21.15.103:0/810921174 >> v2:172.21.15.154:3300/0 conn(0x7f627806f1d0 0x7f62780c44d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7f3b7759e640 1 -- 172.21.15.103:0/3515294645 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3b780c29c0 con 0x7f3b780ab600 2024-09-10T08:28:57.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7f3b7559a640 1 -- 172.21.15.103:0/3515294645 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2662757606 0 0) 0x7f3b78153640 con 0x7f3b780aa980 2024-09-10T08:28:57.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7f627c99d640 1 -- 172.21.15.103:0/810921174 >> v1:172.21.15.154:6789/0 conn(0x7f62780c4a10 legacy=0x7f6278152a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T08:28:57.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7f627c99d640 1 -- 172.21.15.103:0/810921174 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6278156300 con 0x7f627814fa90 2024-09-10T08:28:57.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7f3b7559a640 1 -- 172.21.15.103:0/3515294645 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b60003520 con 0x7f3b780aa980 2024-09-10T08:28:57.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7f2656ffd640 1 --2- 172.21.15.103:0/1960388892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26500f5090 0x7f2650049180 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f26480088f0 tx=0x7f2648008230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=393afdd73af364cc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7faabd514640 1 --2- 172.21.15.103:0/2700675520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faab8157ff0 0x7faab80c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7faaaffff640 1 -- 172.21.15.103:0/2700675520 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2939094501 0 0) 0x7faab815e330 con 0x7faab80c5940 2024-09-10T08:28:57.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7faaaffff640 1 -- 172.21.15.103:0/2700675520 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faaa4003520 con 0x7faab80c5940 2024-09-10T08:28:57.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7faaaffff640 1 -- 172.21.15.103:0/2700675520 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1934569659 0 0) 0x7faab815e050 con 0x7faab80c2980 2024-09-10T08:28:57.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7faaaffff640 1 -- 172.21.15.103:0/2700675520 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faab815e330 con 0x7faab80c2980 2024-09-10T08:28:57.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7faaaffff640 1 -- 172.21.15.103:0/2700675520 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2016844170 0 0) 0x7faaa4003520 con 0x7faab80c5940 2024-09-10T08:28:57.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7faaaffff640 1 -- 172.21.15.103:0/2700675520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faab8157ff0 msgr2=0x7faab80c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7faaaffff640 1 --2- 172.21.15.103:0/2700675520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faab8157ff0 0x7faab80c2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7faaaffff640 1 -- 172.21.15.103:0/2700675520 >> v1:172.21.15.103:6789/0 conn(0x7faab80c2980 legacy=0x7faab815aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7faaaffff640 1 -- 172.21.15.103:0/2700675520 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab815e8f0 con 0x7faab80c5940 2024-09-10T08:28:57.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7faaaffff640 1 -- 172.21.15.103:0/2700675520 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7faab00019f0 con 0x7faab80c5940 2024-09-10T08:28:57.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7faaaffff640 1 -- 172.21.15.103:0/2700675520 >> v1:172.21.15.154:6789/0 conn(0x7faab80c5940 legacy=0x7faab8164fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7faaaffff640 1 --2- 172.21.15.103:0/2700675520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa4004ba0 0x7faaa4004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7faaaffff640 1 --2- 172.21.15.103:0/2700675520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaa40037a0 0x7faaa4003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7faaaffff640 1 --2- 172.21.15.103:0/2700675520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaa4004160 0x7faaa401c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7faaaffff640 1 -- 172.21.15.103:0/2700675520 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faab815e610 con 0x7faaa4004ba0 2024-09-10T08:28:57.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7faaaffff640 1 -- 172.21.15.103:0/2700675520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faaa401d0d0 con 0x7faaa4004160 2024-09-10T08:28:57.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7faaaffff640 1 -- 172.21.15.103:0/2700675520 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7faaa401d2d0 con 0x7faaa40037a0 2024-09-10T08:28:57.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7faabcd13640 1 --2- 172.21.15.103:0/2700675520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaa40037a0 0x7faaa4003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.392+0000 7f149feb7640 1 -- start start 2024-09-10T08:28:57.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7f149feb7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f14980a6c10 0x7f14980c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7f149feb7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f14980c6010 0x7f149806dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7f149feb7640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f149815a970 con 0x7f14980c5940 2024-09-10T08:28:57.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7f149feb7640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f149815ac50 con 0x7f14980c6010 2024-09-10T08:28:57.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7f149feb7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f149815af30 con 0x7f14980a6c10 2024-09-10T08:28:57.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7f149dc53640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f14980a6c10 0x7f14980c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7f149dc53640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f14980a6c10 0x7f14980c2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:56350/0 (socket says 172.21.15.103:56350) 2024-09-10T08:28:57.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7f149dc53640 1 -- 172.21.15.103:0/2356382214 learned_addr learned my addr 172.21.15.103:0/2356382214 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7f149d452640 1 --2- 172.21.15.103:0/2356382214 >> v2:172.21.15.103:3300/0 conn(0x7f14980c6010 0x7f149806dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7f149dc53640 1 -- 172.21.15.103:0/2356382214 >> v2:172.21.15.103:3300/0 conn(0x7f14980c6010 msgr2=0x7f149806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7f149dc53640 1 --2- 172.21.15.103:0/2356382214 >> v2:172.21.15.103:3300/0 conn(0x7f14980c6010 0x7f149806dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7f149dc53640 1 -- 172.21.15.103:0/2356382214 >> v1:172.21.15.103:6789/0 conn(0x7f14980c5940 legacy=0x7f149806dff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:28:57.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7f3b76d9d640 1 -- 172.21.15.103:0/3515294645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b780ab600 msgr2=0x7f3b780c34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7f3b76d9d640 1 --2- 172.21.15.103:0/3515294645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b780ab600 0x7f3b780c34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7f3b76d9d640 1 -- 172.21.15.103:0/3515294645 >> v1:172.21.15.103:6789/0 conn(0x7f3b780aa980 legacy=0x7f3b7814fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7f3b76d9d640 1 -- 172.21.15.103:0/3515294645 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b780c2ca0 con 0x7f3b780aae20 2024-09-10T08:28:57.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.393+0000 7f2655ffb640 1 -- 172.21.15.103:0/1960388892 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26480325f0 con 0x7f26500f5090 2024-09-10T08:28:57.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7f2655ffb640 1 -- 172.21.15.103:0/1960388892 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f264800ae50 con 0x7f26500f5090 2024-09-10T08:28:57.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7f2655ffb640 1 -- 172.21.15.103:0/1960388892 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26480329f0 con 0x7f26500f5090 2024-09-10T08:28:57.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7fb5ff59e640 1 Processor -- start 2024-09-10T08:28:57.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7fb5ff59e640 1 -- start start 2024-09-10T08:28:57.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7ff5ec037640 1 Processor -- start 2024-09-10T08:28:57.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7f627c99d640 1 --2- 172.21.15.103:0/810921174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627814fa90 0x7f62780c2e50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6274009870 tx=0x7f627402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41366b9c32cd3895 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7ff5ec037640 1 -- start start 2024-09-10T08:28:57.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.395+0000 7f2657fff640 1 -- 172.21.15.103:0/1960388892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26500f5090 msgr2=0x7f2650049180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.395+0000 7f2657fff640 1 --2- 172.21.15.103:0/1960388892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26500f5090 0x7f2650049180 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f26480088f0 tx=0x7f2648008230 comp rx=0 tx=0).stop 2024-09-10T08:28:57.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.395+0000 7faabdd15640 1 --2- 172.21.15.103:0/2700675520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaa4004160 0x7faaa401c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.394+0000 7f149dc53640 1 -- 172.21.15.103:0/2356382214 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f149815b210 con 0x7f14980a6c10 2024-09-10T08:28:57.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.395+0000 7f2657fff640 1 -- 172.21.15.103:0/1960388892 shutdown_connections 2024-09-10T08:28:57.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.395+0000 7f2657fff640 1 --2- 172.21.15.103:0/1960388892 >> v2:172.21.15.154:3300/0 conn(0x7f265000ac80 0x7f265000b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.395+0000 7f2657fff640 1 --2- 172.21.15.103:0/1960388892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26500f5090 0x7f2650049180 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.395+0000 7f2657fff640 1 -- 172.21.15.103:0/1960388892 >> 172.21.15.103:0/1960388892 conn(0x7f2650047d00 msgr2=0x7f2650048110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.395+0000 7f626f7fe640 1 -- 172.21.15.103:0/810921174 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6274037070 con 0x7f627814fa90 2024-09-10T08:28:57.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.395+0000 7f626f7fe640 1 -- 172.21.15.103:0/810921174 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6274032440 con 0x7f627814fa90 2024-09-10T08:28:57.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.395+0000 7f626f7fe640 1 -- 172.21.15.103:0/810921174 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6274032810 con 0x7f627814fa90 2024-09-10T08:28:57.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.395+0000 7f2657fff640 1 -- 172.21.15.103:0/1960388892 shutdown_connections 2024-09-10T08:28:57.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.395+0000 7f2657fff640 1 -- 172.21.15.103:0/1960388892 wait complete. 2024-09-10T08:28:57.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.395+0000 7faabdd15640 1 -- 172.21.15.103:0/2700675520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaa40037a0 msgr2=0x7faaa4003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7ff5ec037640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5dc006d10 0x7ff5dc007180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7ff5ec037640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff5dc00de70 0x7ff5dc00e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7ff5ec037640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5dc0d9cb0 con 0x7ff5dc0d7430 2024-09-10T08:28:57.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7ff5ec037640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7ff5dc0dab80 con 0x7ff5dc00de70 2024-09-10T08:28:57.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7ff5ec037640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff5dc0d9f70 con 0x7ff5dc006d10 2024-09-10T08:28:57.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7fb5ff59e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb60006ddc0 0x7fb6000a6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7f627ec01640 1 -- 172.21.15.103:0/810921174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627814fa90 msgr2=0x7f62780c2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7f627ec01640 1 --2- 172.21.15.103:0/810921174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627814fa90 0x7f62780c2e50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6274009870 tx=0x7f627402a1a0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.395+0000 7f3b76d9d640 1 --2- 172.21.15.103:0/3515294645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b780aae20 0x7f3b780c39e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000bfa0 tx=0x7f3b7002e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984dcd8a56adb14e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7f3b7559a640 1 -- 172.21.15.103:0/3515294645 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b70009540 con 0x7f3b780aae20 2024-09-10T08:28:57.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7f3b7559a640 1 -- 172.21.15.103:0/3515294645 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b70039070 con 0x7f3b780aae20 2024-09-10T08:28:57.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7f3b7559a640 1 -- 172.21.15.103:0/3515294645 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b70009940 con 0x7f3b780aae20 2024-09-10T08:28:57.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.395+0000 7faabdd15640 1 --2- 172.21.15.103:0/2700675520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaa40037a0 0x7faaa4003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.395+0000 7faabd514640 1 --2- 172.21.15.103:0/2700675520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa4004ba0 0x7faaa4004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.395+0000 7faabdd15640 1 -- 172.21.15.103:0/2700675520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa4004ba0 msgr2=0x7faaa4004fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7fb5ff59e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6000c3a80 0x7fb6000ab400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.395+0000 7faabdd15640 1 --2- 172.21.15.103:0/2700675520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa4004ba0 0x7faaa4004fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.395+0000 7faabdd15640 1 -- 172.21.15.103:0/2700675520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab815e8f0 con 0x7faaa4004160 2024-09-10T08:28:57.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.395+0000 7faabd514640 1 --2- 172.21.15.103:0/2700675520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa4004ba0 0x7faaa4004fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:57.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7ff5e95d2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5dc006d10 0x7ff5dc007180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7ff5e9dd3640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff5dc0d7430 0x7ff5dc04d530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:33432/0 (socket says 172.21.15.103:33432) 2024-09-10T08:28:57.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7ff5e9dd3640 1 -- 172.21.15.103:0/3256298660 learned_addr learned my addr 172.21.15.103:0/3256298660 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:57.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7ff5ea5d4640 1 --2- 172.21.15.103:0/3256298660 >> v2:172.21.15.103:3300/0 conn(0x7ff5dc00de70 0x7ff5dc00e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7f149dc53640 1 --2- 172.21.15.103:0/2356382214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14980a6c10 0x7f14980c2440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f14980c5510 tx=0x7f149002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49fb669d082f52de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7f627ec01640 1 -- 172.21.15.103:0/810921174 shutdown_connections 2024-09-10T08:28:57.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7f627ec01640 1 --2- 172.21.15.103:0/810921174 >> v2:172.21.15.154:3300/0 conn(0x7f627806f1d0 0x7f62780c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7f627ec01640 1 --2- 172.21.15.103:0/810921174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627814fa90 0x7f62780c2e50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7f627ec01640 1 -- 172.21.15.103:0/810921174 >> 172.21.15.103:0/810921174 conn(0x7f62780c7a40 msgr2=0x7f62780c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7fb5fe59c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb6000c36a0 0x7fb6000c2460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50106/0 (socket says 172.21.15.103:50106) 2024-09-10T08:28:57.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7f627ec01640 1 -- 172.21.15.103:0/810921174 shutdown_connections 2024-09-10T08:28:57.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7f149cc51640 1 -- 172.21.15.103:0/2356382214 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1490036070 con 0x7f14980a6c10 2024-09-10T08:28:57.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7fb5fe59c640 1 -- 172.21.15.103:0/1861774285 learned_addr learned my addr 172.21.15.103:0/1861774285 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:57.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7ff5e8dd1640 1 -- 172.21.15.103:0/3256298660 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1113447268 0 0) 0x7ff5dc0d9cb0 con 0x7ff5dc0d7430 2024-09-10T08:28:57.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7ff5e8dd1640 1 -- 172.21.15.103:0/3256298660 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5d0003520 con 0x7ff5dc0d7430 2024-09-10T08:28:57.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7f149cc51640 1 -- 172.21.15.103:0/2356382214 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1490031600 con 0x7f14980a6c10 2024-09-10T08:28:57.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.397+0000 7f627ec01640 1 -- 172.21.15.103:0/810921174 wait complete. 2024-09-10T08:28:57.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7ff5ea5d4640 1 -- 172.21.15.103:0/3256298660 >> v2:172.21.15.154:3300/0 conn(0x7ff5dc006d10 msgr2=0x7ff5dc007180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7ff5ea5d4640 1 --2- 172.21.15.103:0/3256298660 >> v2:172.21.15.154:3300/0 conn(0x7ff5dc006d10 0x7ff5dc007180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7ff5ea5d4640 1 -- 172.21.15.103:0/3256298660 >> v1:172.21.15.154:6789/0 conn(0x7ff5dc0d7430 legacy=0x7ff5dc04d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.397+0000 7ff5ea5d4640 1 -- 172.21.15.103:0/3256298660 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5dc0da250 con 0x7ff5dc00de70 2024-09-10T08:28:57.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.397+0000 7f149cc51640 1 -- 172.21.15.103:0/2356382214 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14900319d0 con 0x7f14980a6c10 2024-09-10T08:28:57.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.397+0000 7faabdd15640 1 --2- 172.21.15.103:0/2700675520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaa4004160 0x7faaa401c9d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faab000a8a0 tx=0x7faaa4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e09d6ffa7dd34672 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.397+0000 7f2657fff640 1 Processor -- start 2024-09-10T08:28:57.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.396+0000 7fb5fdd9b640 1 --2- 172.21.15.103:0/1861774285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb60006ddc0 0x7fb6000a6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.397+0000 7f2657fff640 1 -- start start 2024-09-10T08:28:57.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.397+0000 7faaaffff640 1 -- 172.21.15.103:0/2700675520 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab000a4a0 con 0x7faaa4004160 2024-09-10T08:28:57.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.397+0000 7faaaffff640 1 -- 172.21.15.103:0/2700675520 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab002f070 con 0x7faaa4004160 2024-09-10T08:28:57.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.397+0000 7faaaffff640 1 -- 172.21.15.103:0/2700675520 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab002bc80 con 0x7faaa4004160 2024-09-10T08:28:57.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.397+0000 7f3b7759e640 1 -- 172.21.15.103:0/3515294645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b780aae20 msgr2=0x7f3b780c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.397+0000 7f3b7759e640 1 --2- 172.21.15.103:0/3515294645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b780aae20 0x7f3b780c39e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000bfa0 tx=0x7f3b7002e960 comp rx=0 tx=0).stop 2024-09-10T08:28:57.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.397+0000 7ff5ea5d4640 1 --2- 172.21.15.103:0/3256298660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5dc00de70 0x7ff5dc00e2e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0dad00 tx=0x7ff5e40a6c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4b470dd1228c0d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.397+0000 7f489572b640 1 Processor -- start 2024-09-10T08:28:57.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.397+0000 7f3b7759e640 1 -- 172.21.15.103:0/3515294645 shutdown_connections 2024-09-10T08:28:57.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.397+0000 7f149feb7640 1 -- 172.21.15.103:0/2356382214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14980a6c10 msgr2=0x7f14980c2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.397+0000 7f149feb7640 1 --2- 172.21.15.103:0/2356382214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14980a6c10 0x7f14980c2440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f14980c5510 tx=0x7f149002a660 comp rx=0 tx=0).stop 2024-09-10T08:28:57.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7f149feb7640 1 -- 172.21.15.103:0/2356382214 shutdown_connections 2024-09-10T08:28:57.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7f489572b640 1 -- start start 2024-09-10T08:28:57.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7f149feb7640 1 --2- 172.21.15.103:0/2356382214 >> v2:172.21.15.103:3300/0 conn(0x7f14980c6010 0x7f149806dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7f149feb7640 1 --2- 172.21.15.103:0/2356382214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14980a6c10 0x7f14980c2440 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7f149feb7640 1 -- 172.21.15.103:0/2356382214 >> 172.21.15.103:0/2356382214 conn(0x7f14980c7a40 msgr2=0x7f14980c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7ff5e8dd1640 1 -- 172.21.15.103:0/3256298660 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e40b4070 con 0x7ff5dc00de70 2024-09-10T08:28:57.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7ff5e8dd1640 1 -- 172.21.15.103:0/3256298660 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e40a7a90 con 0x7ff5dc00de70 2024-09-10T08:28:57.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7ff5e8dd1640 1 -- 172.21.15.103:0/3256298660 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e40af440 con 0x7ff5dc00de70 2024-09-10T08:28:57.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7f3b7759e640 1 --2- 172.21.15.103:0/3515294645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b780aae20 0x7f3b780c39e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7f3b7759e640 1 --2- 172.21.15.103:0/3515294645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b780ab600 0x7f3b780c34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7f3b7759e640 1 -- 172.21.15.103:0/3515294645 >> 172.21.15.103:0/3515294645 conn(0x7f3b780c7f00 msgr2=0x7f3b780a9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.397+0000 7fb5fed9d640 1 --2- 172.21.15.103:0/1861774285 >> v2:172.21.15.154:3300/0 conn(0x7fb6000c3a80 0x7fb6000ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7fb5ff59e640 1 -- 172.21.15.103:0/1861774285 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6000c2d50 con 0x7fb6000c36a0 2024-09-10T08:28:57.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7fb5ff59e640 1 -- 172.21.15.103:0/1861774285 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb6000c30a0 con 0x7fb6000c3a80 2024-09-10T08:28:57.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7fb5ff59e640 1 -- 172.21.15.103:0/1861774285 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb6000c40e0 con 0x7fb60006ddc0 2024-09-10T08:28:57.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7f2657fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2650005ba0 0x7f2650049a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7f2657fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f265000ac80 0x7f26500f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7f2657fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26500f5090 0x7f26500f1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7fb5fed9d640 1 -- 172.21.15.103:0/1861774285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb60006ddc0 msgr2=0x7fb6000a6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7faabf778640 1 -- 172.21.15.103:0/2700675520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaa4004160 msgr2=0x7faaa401c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7faabf778640 1 --2- 172.21.15.103:0/2700675520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaa4004160 0x7faaa401c9d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faab000a8a0 tx=0x7faaa4005830 comp rx=0 tx=0).stop 2024-09-10T08:28:57.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7faabdd15640 1 -- 172.21.15.103:0/2700675520 reap_dead start 2024-09-10T08:28:57.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7faabf778640 1 -- 172.21.15.103:0/2700675520 shutdown_connections 2024-09-10T08:28:57.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7faabf778640 1 -- 172.21.15.103:0/2700675520 >> 172.21.15.103:0/2700675520 conn(0x7faab80c7a40 msgr2=0x7faab80c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7f2657fff640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2650007200 con 0x7f265000ac80 2024-09-10T08:28:57.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7f2657fff640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26500f8410 con 0x7f2650005ba0 2024-09-10T08:28:57.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7fb5fed9d640 1 --2- 172.21.15.103:0/1861774285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb60006ddc0 0x7fb6000a6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7faabf778640 1 -- 172.21.15.103:0/2700675520 shutdown_connections 2024-09-10T08:28:57.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7f26577fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26500f5090 0x7f26500f1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7fb5fed9d640 1 -- 172.21.15.103:0/1861774285 >> v1:172.21.15.103:6789/0 conn(0x7fb6000c36a0 legacy=0x7fb6000c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7fb5fed9d640 1 -- 172.21.15.103:0/1861774285 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6000aa980 con 0x7fb6000c3a80 2024-09-10T08:28:57.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7f627ec01640 1 Processor -- start 2024-09-10T08:28:57.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7fb5fdd9b640 1 --2- 172.21.15.103:0/1861774285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb60006ddc0 0x7fb6000a6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:57.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7faabf778640 1 -- 172.21.15.103:0/2700675520 wait complete. 2024-09-10T08:28:57.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7f26577fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26500f5090 0x7f26500f1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:52958/0 (socket says 172.21.15.103:52958) 2024-09-10T08:28:57.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7f26577fe640 1 -- 172.21.15.103:0/2218660631 learned_addr learned my addr 172.21.15.103:0/2218660631 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7f149feb7640 1 -- 172.21.15.103:0/2356382214 shutdown_connections 2024-09-10T08:28:57.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7f2656ffd640 1 --2- 172.21.15.103:0/2218660631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2650005ba0 0x7f2650049a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7f2657fff640 1 -- 172.21.15.103:0/2218660631 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f26500f5470 con 0x7f26500f5090 2024-09-10T08:28:57.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7ff5ec037640 1 -- 172.21.15.103:0/3256298660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5dc00de70 msgr2=0x7ff5dc00e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7ff5ec037640 1 --2- 172.21.15.103:0/3256298660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5dc00de70 0x7ff5dc00e2e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0dad00 tx=0x7ff5e40a6c40 comp rx=0 tx=0).stop 2024-09-10T08:28:57.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7ff5ec037640 1 -- 172.21.15.103:0/3256298660 shutdown_connections 2024-09-10T08:28:57.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7ff5ec037640 1 --2- 172.21.15.103:0/3256298660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5dc00de70 0x7ff5dc00e2e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7ff5ec037640 1 --2- 172.21.15.103:0/3256298660 >> v2:172.21.15.154:3300/0 conn(0x7ff5dc006d10 0x7ff5dc007180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7ff5ec037640 1 -- 172.21.15.103:0/3256298660 >> 172.21.15.103:0/3256298660 conn(0x7ff5dc04c0b0 msgr2=0x7ff5dc04c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7f489572b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f48901509a0 0x7f489006f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7f489572b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f48900adbc0 0x7f48901530a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7f149feb7640 1 -- 172.21.15.103:0/2356382214 wait complete. 2024-09-10T08:28:57.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7ff5ec037640 1 -- 172.21.15.103:0/3256298660 shutdown_connections 2024-09-10T08:28:57.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7fb5fed9d640 1 --2- 172.21.15.103:0/1861774285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6000c3a80 0x7fb6000ab400 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009e10 tx=0x7fb5f8032e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6977a2f7b4fb7678 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7ff5ec037640 1 -- 172.21.15.103:0/3256298660 wait complete. 2024-09-10T08:28:57.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7f2656ffd640 1 -- 172.21.15.103:0/2218660631 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26500f5090 msgr2=0x7f26500f1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7f2656ffd640 1 --2- 172.21.15.103:0/2218660631 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26500f5090 0x7f26500f1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7f2656ffd640 1 -- 172.21.15.103:0/2218660631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f265000ac80 msgr2=0x7f26500f0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7f2656ffd640 1 --2- 172.21.15.103:0/2218660631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f265000ac80 0x7f26500f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7f2656ffd640 1 -- 172.21.15.103:0/2218660631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26500433e0 con 0x7f2650005ba0 2024-09-10T08:28:57.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7f489572b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48900c3020 con 0x7f48900c3350 2024-09-10T08:28:57.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7f489572b640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f48900ad950 con 0x7f48901509a0 2024-09-10T08:28:57.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7f489572b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f48900ad670 con 0x7f48900adbc0 2024-09-10T08:28:57.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.399+0000 7fb5fd59a640 1 -- 172.21.15.103:0/1861774285 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8040070 con 0x7fb6000c3a80 2024-09-10T08:28:57.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.398+0000 7f627ec01640 1 -- start start 2024-09-10T08:28:57.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f627ec01640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627806f1d0 0x7f6278073460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f627ec01640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62780c4a10 0x7f62780725d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f627ec01640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f627814fa90 0x7f6278072b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f627ec01640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f627814fe70 con 0x7f62780c4a10 2024-09-10T08:28:57.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f627ec01640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f62780c2b10 con 0x7f627814fa90 2024-09-10T08:28:57.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f627ec01640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6278153120 con 0x7f627806f1d0 2024-09-10T08:28:57.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f627c99d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627806f1d0 0x7f6278073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f627c99d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627806f1d0 0x7f6278073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:52974/0 (socket says 172.21.15.103:52974) 2024-09-10T08:28:57.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f2656ffd640 1 --2- 172.21.15.103:0/2218660631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2650005ba0 0x7f2650049a80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2648030000 tx=0x7f26480046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f263f7fe640 1 -- 172.21.15.103:0/2218660631 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2648042020 con 0x7f2650005ba0 2024-09-10T08:28:57.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f263f7fe640 1 -- 172.21.15.103:0/2218660631 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26480319e0 con 0x7f2650005ba0 2024-09-10T08:28:57.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f263f7fe640 1 -- 172.21.15.103:0/2218660631 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2648031dd0 con 0x7f2650005ba0 2024-09-10T08:28:57.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f2657fff640 1 -- 172.21.15.103:0/2218660631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2650044d70 con 0x7f2650005ba0 2024-09-10T08:28:57.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7fb5fd59a640 1 -- 172.21.15.103:0/1861774285 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f8033bc0 con 0x7fb6000c3a80 2024-09-10T08:28:57.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7fb5fd59a640 1 -- 172.21.15.103:0/1861774285 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f803b440 con 0x7fb6000c3a80 2024-09-10T08:28:57.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f488ffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f48901509a0 0x7f489006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f488ffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f48901509a0 0x7f489006f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49492/0 (socket says 172.21.15.103:49492) 2024-09-10T08:28:57.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f488ffff640 1 -- 172.21.15.103:0/257984630 learned_addr learned my addr 172.21.15.103:0/257984630 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f488f7fe640 1 --2- 172.21.15.103:0/257984630 >> v2:172.21.15.154:3300/0 conn(0x7f48900adbc0 0x7f48901530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f627c99d640 1 -- 172.21.15.103:0/2517434232 learned_addr learned my addr 172.21.15.103:0/2517434232 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f626ffff640 1 --2- 172.21.15.103:0/2517434232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62780c4a10 0x7f62780725d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f149feb7640 1 Processor -- start 2024-09-10T08:28:57.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f2657fff640 1 -- 172.21.15.103:0/2218660631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2650049fc0 con 0x7f2650005ba0 2024-09-10T08:28:57.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f149feb7640 1 -- start start 2024-09-10T08:28:57.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7f627c99d640 1 -- 172.21.15.103:0/2517434232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f627814fa90 msgr2=0x7f6278072b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:28:57.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7f627c99d640 1 --2- 172.21.15.103:0/2517434232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f627814fa90 0x7f6278072b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7f627c99d640 1 -- 172.21.15.103:0/2517434232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62780c4a10 msgr2=0x7f62780725d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7f627c99d640 1 --2- 172.21.15.103:0/2517434232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62780c4a10 0x7f62780725d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7f627c99d640 1 -- 172.21.15.103:0/2517434232 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62780c82c0 con 0x7f627806f1d0 2024-09-10T08:28:57.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7fb5ff59e640 1 -- 172.21.15.103:0/1861774285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6000c3a80 msgr2=0x7fb6000ab400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7fb5ff59e640 1 --2- 172.21.15.103:0/1861774285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6000c3a80 0x7fb6000ab400 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009e10 tx=0x7fb5f8032e70 comp rx=0 tx=0).stop 2024-09-10T08:28:57.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7fb5ff59e640 1 -- 172.21.15.103:0/1861774285 shutdown_connections 2024-09-10T08:28:57.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f488ffff640 1 -- 172.21.15.103:0/257984630 >> v2:172.21.15.154:3300/0 conn(0x7f48900adbc0 msgr2=0x7f48901530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f488ffff640 1 --2- 172.21.15.103:0/257984630 >> v2:172.21.15.154:3300/0 conn(0x7f48900adbc0 0x7f48901530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f488ffff640 1 -- 172.21.15.103:0/257984630 >> v1:172.21.15.103:6789/0 conn(0x7f48900c3350 legacy=0x7f48901535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7f488ffff640 1 -- 172.21.15.103:0/257984630 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4890156fc0 con 0x7f48901509a0 2024-09-10T08:28:57.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7f626ffff640 1 --2- 172.21.15.103:0/2517434232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62780c4a10 0x7f62780725d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:57.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7fb5ff59e640 1 --2- 172.21.15.103:0/1861774285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6000c3a80 0x7fb6000ab400 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7fb5ff59e640 1 --2- 172.21.15.103:0/1861774285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb60006ddc0 0x7fb6000a6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7faabf778640 1 Processor -- start 2024-09-10T08:28:57.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.400+0000 7faabf778640 1 -- start start 2024-09-10T08:28:57.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7f3b7759e640 1 -- 172.21.15.103:0/3515294645 shutdown_connections 2024-09-10T08:28:57.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7faabf778640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaa4004160 0x7faab8148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7faabf778640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faab81458d0 0x7faab81e8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7faabf778640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faab814df60 0x7faab81eaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7faabf778640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faab806f3d0 con 0x7faab81458d0 2024-09-10T08:28:57.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7faabf778640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faab806f250 con 0x7faab814df60 2024-09-10T08:28:57.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7faabf778640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7faab80c2440 con 0x7faaa4004160 2024-09-10T08:28:57.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7f627c99d640 1 --2- 172.21.15.103:0/2517434232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627806f1d0 0x7f6278073460 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f62740090b0 tx=0x7f62740046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7faabdd15640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faab814df60 0x7faab81eaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7fb5ff59e640 1 -- 172.21.15.103:0/1861774285 >> 172.21.15.103:0/1861774285 conn(0x7fb6000c7ae0 msgr2=0x7fb6000c7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7faabdd15640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faab814df60 0x7faab81eaef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:56408/0 (socket says 172.21.15.103:56408) 2024-09-10T08:28:57.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7f149feb7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14980a6c10 0x7f14980bd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7f3b7759e640 1 -- 172.21.15.103:0/3515294645 wait complete. 2024-09-10T08:28:57.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7f488ffff640 1 --2- 172.21.15.103:0/257984630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48901509a0 0x7f489006f160 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f48900c8140 tx=0x7f488002a670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6a13a4b4b88110 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7f626d7fa640 1 -- 172.21.15.103:0/2517434232 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6274042020 con 0x7f627806f1d0 2024-09-10T08:28:57.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7f149feb7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14980c5940 0x7f14980ad010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7f149feb7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14980c6010 0x7f14980716d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7f149feb7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f14980a73a0 con 0x7f14980c5940 2024-09-10T08:28:57.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7f627ec01640 1 -- 172.21.15.103:0/2517434232 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62780720f0 con 0x7f627806f1d0 2024-09-10T08:28:57.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7f149feb7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f149815a620 con 0x7f14980a6c10 2024-09-10T08:28:57.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7f149feb7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f14980a7520 con 0x7f14980c6010 2024-09-10T08:28:57.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7f149dc53640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14980a6c10 0x7f14980bd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7f627ec01640 1 -- 172.21.15.103:0/2517434232 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6278154fd0 con 0x7f627806f1d0 2024-09-10T08:28:57.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7f263d7fa640 1 -- 172.21.15.103:0/2218660631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2650007960 con 0x7f2650005ba0 2024-09-10T08:28:57.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7f626d7fa640 1 -- 172.21.15.103:0/2517434232 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6274030970 con 0x7f627806f1d0 2024-09-10T08:28:57.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7faabdd15640 1 -- 172.21.15.103:0/358679024 learned_addr learned my addr 172.21.15.103:0/358679024 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.401+0000 7faabd514640 1 --2- 172.21.15.103:0/358679024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaa4004160 0x7faab8148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7f149dc53640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14980a6c10 0x7f14980bd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:56412/0 (socket says 172.21.15.103:56412) 2024-09-10T08:28:57.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7f149dc53640 1 -- 172.21.15.103:0/3725623173 learned_addr learned my addr 172.21.15.103:0/3725623173 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7f149d452640 1 --2- 172.21.15.103:0/3725623173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14980c5940 0x7f14980ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7f149e454640 1 --2- 172.21.15.103:0/3725623173 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14980c6010 0x7f14980716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7f488effd640 1 -- 172.21.15.103:0/257984630 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488002f710 con 0x7f48901509a0 2024-09-10T08:28:57.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7f488effd640 1 -- 172.21.15.103:0/257984630 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f488002ae50 con 0x7f48901509a0 2024-09-10T08:28:57.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7ff5ec037640 1 Processor -- start 2024-09-10T08:28:57.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7faabdd15640 1 -- 172.21.15.103:0/358679024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaa4004160 msgr2=0x7faab8148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7f626d7fa640 1 -- 172.21.15.103:0/2517434232 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6274037040 con 0x7f627806f1d0 2024-09-10T08:28:57.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7faabdd15640 1 --2- 172.21.15.103:0/358679024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaa4004160 0x7faab8148cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7f488effd640 1 -- 172.21.15.103:0/257984630 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488002fad0 con 0x7f48901509a0 2024-09-10T08:28:57.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7fb5ff59e640 1 -- 172.21.15.103:0/1861774285 shutdown_connections 2024-09-10T08:28:57.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7faabdd15640 1 -- 172.21.15.103:0/358679024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faab81458d0 msgr2=0x7faab81e8df0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:28:57.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7faabcd13640 1 --2- 172.21.15.103:0/358679024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faab81458d0 0x7faab81e8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7f149d452640 1 -- 172.21.15.103:0/3725623173 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14980c6010 msgr2=0x7f14980716d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7f149d452640 1 --2- 172.21.15.103:0/3725623173 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14980c6010 0x7f14980716d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7faabdd15640 1 --2- 172.21.15.103:0/358679024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faab81458d0 0x7faab81e8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7faabdd15640 1 -- 172.21.15.103:0/358679024 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab814f340 con 0x7faab814df60 2024-09-10T08:28:57.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7ff5ec037640 1 -- start start 2024-09-10T08:28:57.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7f149d452640 1 -- 172.21.15.103:0/3725623173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14980a6c10 msgr2=0x7f14980bd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7f263f7fe640 1 -- 172.21.15.103:0/2218660631 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2648045020 con 0x7f2650005ba0 2024-09-10T08:28:57.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7f149d452640 1 --2- 172.21.15.103:0/3725623173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14980a6c10 0x7f14980bd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.402+0000 7f149d452640 1 -- 172.21.15.103:0/3725623173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1498151ae0 con 0x7f14980c5940 2024-09-10T08:28:57.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7faabcd13640 1 --2- 172.21.15.103:0/358679024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faab81458d0 0x7faab81e8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:57.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7f149d452640 1 --2- 172.21.15.103:0/3725623173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14980c5940 0x7f14980ad010 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f149400c5c0 tx=0x7f149400ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7f263f7fe640 1 --2- 172.21.15.103:0/2218660631 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f264406be30 0x7f264406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7fb5ff59e640 1 -- 172.21.15.103:0/1861774285 wait complete. 2024-09-10T08:28:57.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7f488f7fe640 1 --2- 172.21.15.103:0/257984630 >> v2:172.21.15.154:3300/0 conn(0x7f48900adbc0 0x7f48901530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:57.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7f489572b640 1 -- 172.21.15.103:0/257984630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48901509a0 msgr2=0x7f489006f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7f489572b640 1 --2- 172.21.15.103:0/257984630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48901509a0 0x7f489006f160 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f48900c8140 tx=0x7f488002a670 comp rx=0 tx=0).stop 2024-09-10T08:28:57.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7f489572b640 1 -- 172.21.15.103:0/257984630 shutdown_connections 2024-09-10T08:28:57.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7f489572b640 1 --2- 172.21.15.103:0/257984630 >> v2:172.21.15.154:3300/0 conn(0x7f48900adbc0 0x7f48901530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7f489572b640 1 --2- 172.21.15.103:0/257984630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48901509a0 0x7f489006f160 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7f489572b640 1 -- 172.21.15.103:0/257984630 >> 172.21.15.103:0/257984630 conn(0x7f4890067d70 msgr2=0x7f489006ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7ff5ec037640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5dc006d10 0x7ff5dc1732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7ff5ec037640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5dc00de70 0x7ff5dc0493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7ff5ec037640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5dc0d7430 0x7ff5dc0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7ff5ec037640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc0d7810 con 0x7ff5dc006d10 2024-09-10T08:28:57.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7ff5ec037640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc0da810 con 0x7ff5dc00de70 2024-09-10T08:28:57.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7ff5ec037640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff5dc165970 con 0x7ff5dc0d7430 2024-09-10T08:28:57.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7faabdd15640 1 --2- 172.21.15.103:0/358679024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faab814df60 0x7faab81eaef0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faab000a990 tx=0x7faab0001cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7f148e7fc640 1 -- 172.21.15.103:0/3725623173 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1494015070 con 0x7f14980c5940 2024-09-10T08:28:57.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7ff5ea5d4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5dc0d7430 0x7ff5dc0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7ff5ea5d4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5dc0d7430 0x7ff5dc0d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:53000/0 (socket says 172.21.15.103:53000) 2024-09-10T08:28:57.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7ff5ea5d4640 1 -- 172.21.15.103:0/3028237842 learned_addr learned my addr 172.21.15.103:0/3028237842 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7f627ec01640 1 -- 172.21.15.103:0/2517434232 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6258001030 con 0x7f627806f1d0 2024-09-10T08:28:57.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7f149feb7640 1 -- 172.21.15.103:0/3725623173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1498070930 con 0x7f14980c5940 2024-09-10T08:28:57.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.403+0000 7f263f7fe640 1 -- 172.21.15.103:0/2218660631 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f26480ac030 con 0x7f2650005ba0 2024-09-10T08:28:57.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7f263f7fe640 1 --2- 172.21.15.103:0/2218660631 >> [v2:172.21.15.154:6808/1808157069,v1:172.21.15.154:6809/1808157069] conn(0x7f2644076640 0x7f2644078a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7f263f7fe640 1 -- 172.21.15.103:0/2218660631 --> [v2:172.21.15.154:6808/1808157069,v1:172.21.15.154:6809/1808157069] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2648009e50 con 0x7f2644076640 2024-09-10T08:28:57.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7f263f7fe640 1 -- 172.21.15.103:0/2218660631 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f26480b3050 con 0x7f2650005ba0 2024-09-10T08:28:57.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7f3b7759e640 1 Processor -- start 2024-09-10T08:28:57.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7faaadffb640 1 -- 172.21.15.103:0/358679024 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab000a4a0 con 0x7faab814df60 2024-09-10T08:28:57.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7faaadffb640 1 -- 172.21.15.103:0/358679024 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab0004b60 con 0x7faab814df60 2024-09-10T08:28:57.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7faaadffb640 1 -- 172.21.15.103:0/358679024 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab00011c0 con 0x7faab814df60 2024-09-10T08:28:57.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7faabf778640 1 -- 172.21.15.103:0/358679024 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faab814f620 con 0x7faab814df60 2024-09-10T08:28:57.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7faabf778640 1 -- 172.21.15.103:0/358679024 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faab814e3f0 con 0x7faab814df60 2024-09-10T08:28:57.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7f148e7fc640 1 -- 172.21.15.103:0/3725623173 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1494004220 con 0x7f14980c5940 2024-09-10T08:28:57.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7f149feb7640 1 -- 172.21.15.103:0/3725623173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1498070ed0 con 0x7f14980c5940 2024-09-10T08:28:57.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7f148e7fc640 1 -- 172.21.15.103:0/3725623173 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1494003610 con 0x7f14980c5940 2024-09-10T08:28:57.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7f3b7759e640 1 -- start start 2024-09-10T08:28:57.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7f26577fe640 1 --2- 172.21.15.103:0/2218660631 >> [v2:172.21.15.154:6808/1808157069,v1:172.21.15.154:6809/1808157069] conn(0x7f2644076640 0x7f2644078a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7f489572b640 1 -- 172.21.15.103:0/257984630 shutdown_connections 2024-09-10T08:28:57.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7f489572b640 1 -- 172.21.15.103:0/257984630 wait complete. 2024-09-10T08:28:57.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7ff5e9dd3640 1 --2- 172.21.15.103:0/3028237842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5dc006d10 0x7ff5dc1732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7ff5ea5d4640 1 -- 172.21.15.103:0/3028237842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5dc00de70 msgr2=0x7ff5dc0493c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:28:57.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7ff5ea5d4640 1 --2- 172.21.15.103:0/3028237842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5dc00de70 0x7ff5dc0493c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7ff5ea5d4640 1 -- 172.21.15.103:0/3028237842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5dc006d10 msgr2=0x7ff5dc1732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7ff5ea5d4640 1 --2- 172.21.15.103:0/3028237842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5dc006d10 0x7ff5dc1732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7ff5ea5d4640 1 -- 172.21.15.103:0/3028237842 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5dc173810 con 0x7ff5dc0d7430 2024-09-10T08:28:57.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.404+0000 7ff5ea5d4640 1 --2- 172.21.15.103:0/3028237842 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5dc0d7430 0x7ff5dc0d0a10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff5e402dd50 tx=0x7ff5e4069d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.405+0000 7f626d7fa640 1 -- 172.21.15.103:0/2517434232 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6274045020 con 0x7f627806f1d0 2024-09-10T08:28:57.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.405+0000 7ff5e9dd3640 1 --2- 172.21.15.103:0/3028237842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5dc006d10 0x7ff5dc1732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:57.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.405+0000 7ff5da7fc640 1 -- 172.21.15.103:0/3028237842 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e40b4050 con 0x7ff5dc0d7430 2024-09-10T08:28:57.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.406+0000 7faa9b7fe640 1 -- 172.21.15.103:0/358679024 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa94001030 con 0x7faab814df60 2024-09-10T08:28:57.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.405+0000 7f3b7759e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b780aa980 0x7f3b781eb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.405+0000 7fb5ff59e640 1 Processor -- start 2024-09-10T08:28:57.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.406+0000 7fb5ff59e640 1 -- start start 2024-09-10T08:28:57.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.405+0000 7ff5ec037640 1 -- 172.21.15.103:0/3028237842 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5dc165c10 con 0x7ff5dc0d7430 2024-09-10T08:28:57.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.405+0000 7ff5ec037640 1 -- 172.21.15.103:0/3028237842 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5dc1634b0 con 0x7ff5dc0d7430 2024-09-10T08:28:57.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.406+0000 7ff5da7fc640 1 -- 172.21.15.103:0/3028237842 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e40b5040 con 0x7ff5dc0d7430 2024-09-10T08:28:57.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.406+0000 7ff5da7fc640 1 -- 172.21.15.103:0/3028237842 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e40bb650 con 0x7ff5dc0d7430 2024-09-10T08:28:57.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.406+0000 7f626d7fa640 1 --2- 172.21.15.103:0/2517434232 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f626406bf00 0x7f626406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.406+0000 7f148e7fc640 1 -- 172.21.15.103:0/3725623173 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f14940037b0 con 0x7f14980c5940 2024-09-10T08:28:57.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.406+0000 7f626ffff640 1 --2- 172.21.15.103:0/2517434232 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f626406bf00 0x7f626406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7f148e7fc640 1 --2- 172.21.15.103:0/3725623173 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f147c06bf00 0x7f147c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.406+0000 7f489572b640 1 Processor -- start 2024-09-10T08:28:57.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.406+0000 7f489572b640 1 -- start start 2024-09-10T08:28:57.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.406+0000 7f26567fc640 1 --2- 172.21.15.103:0/2218660631 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f264406be30 0x7f264406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7f148e7fc640 1 -- 172.21.15.103:0/3725623173 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f149408adc0 con 0x7f14980c5940 2024-09-10T08:28:57.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.406+0000 7f26577fe640 1 --2- 172.21.15.103:0/2218660631 >> [v2:172.21.15.154:6808/1808157069,v1:172.21.15.154:6809/1808157069] conn(0x7f2644076640 0x7f2644078a60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7fb5ff59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60006ddc0 0x7fb6000a7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7f3b7659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b780aa980 0x7f3b781eb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7f3b7659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b780aa980 0x7f3b781eb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49520/0 (socket says 172.21.15.103:49520) 2024-09-10T08:28:57.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7f3b7659c640 1 -- 172.21.15.103:0/1767977471 learned_addr learned my addr 172.21.15.103:0/1767977471 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7faaadffb640 1 -- 172.21.15.103:0/358679024 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faab0034470 con 0x7faab814df60 2024-09-10T08:28:57.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7f3b7759e640 1 --2- 172.21.15.103:0/1767977471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b780aae20 0x7f3b78146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7f26567fc640 1 --2- 172.21.15.103:0/2218660631 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f264406be30 0x7f264406e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2658050d60 tx=0x7f265806f040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7fb5ff59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6000c36a0 0x7fb6001e7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7f626d7fa640 1 -- 172.21.15.103:0/2517434232 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f62740abea0 con 0x7f627806f1d0 2024-09-10T08:28:57.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7fb5fe59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60006ddc0 0x7fb6000a7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7fb5fe59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60006ddc0 0x7fb6000a7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:56432/0 (socket says 172.21.15.103:56432) 2024-09-10T08:28:57.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7fb5fe59c640 1 -- 172.21.15.103:0/392163505 learned_addr learned my addr 172.21.15.103:0/392163505 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7f626d7fa640 1 --2- 172.21.15.103:0/2517434232 >> [v2:172.21.15.103:6808/2707863099,v1:172.21.15.103:6809/2707863099] conn(0x7f6264076790 0x7f6264078bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7ff5ec037640 1 -- 172.21.15.103:0/3028237842 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff5cc001030 con 0x7ff5dc0d7430 2024-09-10T08:28:57.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7f626d7fa640 1 -- 172.21.15.103:0/2517434232 --> [v2:172.21.15.103:6808/2707863099,v1:172.21.15.103:6809/2707863099] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6264079260 con 0x7f6264076790 2024-09-10T08:28:57.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7f626d7fa640 1 -- 172.21.15.103:0/2517434232 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f62740ac290 con 0x7f627806f1d0 2024-09-10T08:28:57.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7f626ffff640 1 --2- 172.21.15.103:0/2517434232 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f626406bf00 0x7f626406e3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6278161650 tx=0x7f6268009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7fb5fdd9b640 1 --2- 172.21.15.103:0/392163505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6000c36a0 0x7fb6001e7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7f489572b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48900adbc0 0x7f4890155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7faaadffb640 1 --2- 172.21.15.103:0/358679024 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7faa9c06bf00 0x7faa9c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.407+0000 7fb5ff59e640 1 --2- 172.21.15.103:0/392163505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6000c3a80 0x7fb6001e7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f627d19e640 1 --2- 172.21.15.103:0/2517434232 >> [v2:172.21.15.103:6808/2707863099,v1:172.21.15.103:6809/2707863099] conn(0x7f6264076790 0x7f6264078bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f488ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48900adbc0 0x7f4890155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7fb5ff59e640 1 -- 172.21.15.103:0/392163505 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb6000c4550 con 0x7fb6000c36a0 2024-09-10T08:28:57.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f489572b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48900c3350 0x7f489014f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7fb5ff59e640 1 -- 172.21.15.103:0/392163505 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb6000c43d0 con 0x7fb60006ddc0 2024-09-10T08:28:57.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f489572b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48901509a0 0x7f489014f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f489572b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f48900c4e80 con 0x7f48900adbc0 2024-09-10T08:28:57.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f488ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48900adbc0 0x7f4890155960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49552/0 (socket says 172.21.15.103:49552) 2024-09-10T08:28:57.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f488ffff640 1 -- 172.21.15.103:0/2064388475 learned_addr learned my addr 172.21.15.103:0/2064388475 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f489572b640 1 -- 172.21.15.103:0/2064388475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f48900c4ba0 con 0x7f48900c3350 2024-09-10T08:28:57.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f489572b640 1 -- 172.21.15.103:0/2064388475 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4890153cf0 con 0x7f48901509a0 2024-09-10T08:28:57.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7fb5fed9d640 1 --2- 172.21.15.103:0/392163505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6000c3a80 0x7fb6001e7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f3b75d9b640 1 --2- 172.21.15.103:0/1767977471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b780aae20 0x7f3b78146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7fb5ff59e640 1 -- 172.21.15.103:0/392163505 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb600152a80 con 0x7fb6000c3a80 2024-09-10T08:28:57.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f4894f2a640 1 --2- 172.21.15.103:0/2064388475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48901509a0 0x7f489014f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f149feb7640 1 --2- 172.21.15.103:0/3725623173 >> [v2:172.21.15.103:6817/428484432,v1:172.21.15.103:6819/428484432] conn(0x7f1480001650 0x7f1480003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7faaadffb640 1 -- 172.21.15.103:0/358679024 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7faab00ab420 con 0x7faab814df60 2024-09-10T08:28:57.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7faaadffb640 1 --2- 172.21.15.103:0/358679024 >> [v2:172.21.15.103:6816/4029892782,v1:172.21.15.103:6818/4029892782] conn(0x7faa9c0767a0 0x7faa9c078bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f149feb7640 1 -- 172.21.15.103:0/3725623173 --> [v2:172.21.15.103:6817/428484432,v1:172.21.15.103:6819/428484432] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1480006bb0 con 0x7f1480001650 2024-09-10T08:28:57.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7faaadffb640 1 -- 172.21.15.103:0/358679024 --> [v2:172.21.15.103:6816/4029892782,v1:172.21.15.103:6818/4029892782] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa9c079270 con 0x7faa9c0767a0 2024-09-10T08:28:57.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7faaadffb640 1 -- 172.21.15.103:0/358679024 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faab00b2050 con 0x7faab814df60 2024-09-10T08:28:57.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f263f7fe640 1 -- 172.21.15.103:0/2218660631 <== osd.4 v2:172.21.15.154:6808/1808157069 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2648009e50 con 0x7f2644076640 2024-09-10T08:28:57.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f149dc53640 1 --2- 172.21.15.103:0/3725623173 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f147c06bf00 0x7f147c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f627d19e640 1 --2- 172.21.15.103:0/2517434232 >> [v2:172.21.15.103:6808/2707863099,v1:172.21.15.103:6809/2707863099] conn(0x7f6264076790 0x7f6264078bb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7faabd514640 1 --2- 172.21.15.103:0/358679024 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7faa9c06bf00 0x7faa9c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7faabcd13640 1 --2- 172.21.15.103:0/358679024 >> [v2:172.21.15.103:6816/4029892782,v1:172.21.15.103:6818/4029892782] conn(0x7faa9c0767a0 0x7faa9c078bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f149e454640 1 --2- 172.21.15.103:0/3725623173 >> [v2:172.21.15.103:6817/428484432,v1:172.21.15.103:6819/428484432] conn(0x7f1480001650 0x7f1480003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.409+0000 7fb5fe59c640 1 -- 172.21.15.103:0/392163505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6000c3a80 msgr2=0x7fb6001e7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.409+0000 7fb5fe59c640 1 --2- 172.21.15.103:0/392163505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6000c3a80 0x7fb6001e7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.409+0000 7fb5fe59c640 1 -- 172.21.15.103:0/392163505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6000c36a0 msgr2=0x7fb6001e7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.409+0000 7fb5fe59c640 1 --2- 172.21.15.103:0/392163505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6000c36a0 0x7fb6001e7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.409+0000 7fb5fe59c640 1 -- 172.21.15.103:0/392163505 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6001561f0 con 0x7fb60006ddc0 2024-09-10T08:28:57.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.409+0000 7f149e454640 1 --2- 172.21.15.103:0/3725623173 >> [v2:172.21.15.103:6817/428484432,v1:172.21.15.103:6819/428484432] conn(0x7f1480001650 0x7f1480003b10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.409+0000 7f149dc53640 1 --2- 172.21.15.103:0/3725623173 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f147c06bf00 0x7f147c06e3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1490009c90 tx=0x7f1490009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f488ffff640 1 -- 172.21.15.103:0/2064388475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48901509a0 msgr2=0x7f489014f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f488ffff640 1 --2- 172.21.15.103:0/2064388475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48901509a0 0x7f489014f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f488ffff640 1 -- 172.21.15.103:0/2064388475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48900c3350 msgr2=0x7f489014f140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:28:57.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f488ffff640 1 --2- 172.21.15.103:0/2064388475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48900c3350 0x7f489014f140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f488ffff640 1 -- 172.21.15.103:0/2064388475 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f489014fda0 con 0x7f48900adbc0 2024-09-10T08:28:57.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.409+0000 7f488ffff640 1 --2- 172.21.15.103:0/2064388475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48900adbc0 0x7f4890155960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f488000ba10 tx=0x7f48800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.409+0000 7faabd514640 1 --2- 172.21.15.103:0/358679024 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7faa9c06bf00 0x7faa9c06e3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faab81ebfb0 tx=0x7faab4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.409+0000 7faabcd13640 1 --2- 172.21.15.103:0/358679024 >> [v2:172.21.15.103:6816/4029892782,v1:172.21.15.103:6818/4029892782] conn(0x7faa9c0767a0 0x7faa9c078bc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.409+0000 7f488cff9640 1 -- 172.21.15.103:0/2064388475 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488003f070 con 0x7f48900adbc0 2024-09-10T08:28:57.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.409+0000 7f488cff9640 1 -- 172.21.15.103:0/2064388475 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4880031950 con 0x7f48900adbc0 2024-09-10T08:28:57.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.409+0000 7f489572b640 1 -- 172.21.15.103:0/2064388475 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48900be4d0 con 0x7f48900adbc0 2024-09-10T08:28:57.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.409+0000 7f488cff9640 1 -- 172.21.15.103:0/2064388475 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488003f070 con 0x7f48900adbc0 2024-09-10T08:28:57.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.409+0000 7f489572b640 1 -- 172.21.15.103:0/2064388475 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4890155ea0 con 0x7f48900adbc0 2024-09-10T08:28:57.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.408+0000 7f3b7759e640 1 --2- 172.21.15.103:0/1767977471 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b780ab600 0x7f3b781e7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.409+0000 7f3b7759e640 1 -- 172.21.15.103:0/1767977471 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3b780ab9e0 con 0x7f3b780aa980 2024-09-10T08:28:57.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.409+0000 7f3b7759e640 1 -- 172.21.15.103:0/1767977471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3b781532d0 con 0x7f3b780aae20 2024-09-10T08:28:57.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.409+0000 7f3b7759e640 1 -- 172.21.15.103:0/1767977471 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3b780abb60 con 0x7f3b780ab600 2024-09-10T08:28:57.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.409+0000 7f626d7fa640 1 -- 172.21.15.103:0/2517434232 <== osd.0 v2:172.21.15.103:6808/2707863099 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6264079260 con 0x7f6264076790 2024-09-10T08:28:57.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.410+0000 7f3b76d9d640 1 --2- 172.21.15.103:0/1767977471 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b780ab600 0x7f3b781e7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.409+0000 7fb5fe59c640 1 --2- 172.21.15.103:0/392163505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60006ddc0 0x7fb6000a7ae0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000c4a0 tx=0x7fb5f000c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.410+0000 7faaadffb640 1 -- 172.21.15.103:0/358679024 <== osd.1 v2:172.21.15.103:6816/4029892782 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faa9c079270 con 0x7faa9c0767a0 2024-09-10T08:28:57.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.410+0000 7f3b76d9d640 1 -- 172.21.15.103:0/1767977471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b780aae20 msgr2=0x7f3b78146ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.410+0000 7f3b76d9d640 1 --2- 172.21.15.103:0/1767977471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b780aae20 0x7f3b78146ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.410+0000 7f3b76d9d640 1 -- 172.21.15.103:0/1767977471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b780aa980 msgr2=0x7f3b781eb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.410+0000 7f3b76d9d640 1 --2- 172.21.15.103:0/1767977471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b780aa980 0x7f3b781eb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.410+0000 7f3b76d9d640 1 -- 172.21.15.103:0/1767977471 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b781ebe80 con 0x7f3b780ab600 2024-09-10T08:28:57.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.410+0000 7f3b75d9b640 1 --2- 172.21.15.103:0/1767977471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b780aae20 0x7f3b78146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:57.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.410+0000 7fb5eeffd640 1 -- 172.21.15.103:0/392163505 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0017070 con 0x7fb60006ddc0 2024-09-10T08:28:57.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.410+0000 7fb5eeffd640 1 -- 172.21.15.103:0/392163505 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f0005ce0 con 0x7fb60006ddc0 2024-09-10T08:28:57.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.410+0000 7ff5da7fc640 1 -- 172.21.15.103:0/3028237842 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff5e40c2020 con 0x7ff5dc0d7430 2024-09-10T08:28:57.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.410+0000 7f3b76d9d640 1 --2- 172.21.15.103:0/1767977471 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b780ab600 0x7f3b781e7aa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3b70035000 tx=0x7f3b70004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.411+0000 7f489572b640 1 -- 172.21.15.103:0/2064388475 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f48901568e0 con 0x7f48900adbc0 2024-09-10T08:28:57.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.411+0000 7f3b66ffd640 1 -- 172.21.15.103:0/1767977471 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b700099e0 con 0x7f3b780ab600 2024-09-10T08:28:57.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.411+0000 7f3b66ffd640 1 -- 172.21.15.103:0/1767977471 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b70030040 con 0x7f3b780ab600 2024-09-10T08:28:57.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.411+0000 7f3b7759e640 1 -- 172.21.15.103:0/1767977471 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b78147000 con 0x7f3b780ab600 2024-09-10T08:28:57.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.410+0000 7f148e7fc640 1 -- 172.21.15.103:0/3725623173 <== osd.2 v2:172.21.15.103:6817/428484432 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1480006bb0 con 0x7f1480001650 2024-09-10T08:28:57.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.411+0000 7ff5da7fc640 1 --2- 172.21.15.103:0/3028237842 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff5c806bf00 0x7ff5c806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.411+0000 7f3b7759e640 1 -- 172.21.15.103:0/1767977471 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b78147e70 con 0x7f3b780ab600 2024-09-10T08:28:57.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.411+0000 7f3b66ffd640 1 -- 172.21.15.103:0/1767977471 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b700496c0 con 0x7f3b780ab600 2024-09-10T08:28:57.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.411+0000 7fb5eeffd640 1 -- 172.21.15.103:0/392163505 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0007270 con 0x7fb60006ddc0 2024-09-10T08:28:57.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.411+0000 7fb5ff59e640 1 -- 172.21.15.103:0/392163505 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6001564d0 con 0x7fb60006ddc0 2024-09-10T08:28:57.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.411+0000 7ff5e9dd3640 1 --2- 172.21.15.103:0/3028237842 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff5c806bf00 0x7ff5c806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.411+0000 7fb5ff59e640 1 -- 172.21.15.103:0/392163505 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6000a9e60 con 0x7fb60006ddc0 2024-09-10T08:28:57.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.412+0000 7f488cff9640 1 -- 172.21.15.103:0/2064388475 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4880031b00 con 0x7f48900adbc0 2024-09-10T08:28:57.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.412+0000 7ff5da7fc640 1 -- 172.21.15.103:0/3028237842 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7ff5e4127e90 con 0x7ff5dc0d7430 2024-09-10T08:28:57.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.412+0000 7ff5da7fc640 1 --2- 172.21.15.103:0/3028237842 >> [v2:172.21.15.154:6824/3439481239,v1:172.21.15.154:6825/3439481239] conn(0x7ff5c8076790 0x7ff5c8078bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.412+0000 7ff5da7fc640 1 -- 172.21.15.103:0/3028237842 --> [v2:172.21.15.154:6824/3439481239,v1:172.21.15.154:6825/3439481239] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5e40a8e50 con 0x7ff5c8076790 2024-09-10T08:28:57.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.412+0000 7ff5da7fc640 1 -- 172.21.15.103:0/3028237842 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff5e412a4f0 con 0x7ff5dc0d7430 2024-09-10T08:28:57.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.413+0000 7ff5e95d2640 1 --2- 172.21.15.103:0/3028237842 >> [v2:172.21.15.154:6824/3439481239,v1:172.21.15.154:6825/3439481239] conn(0x7ff5c8076790 0x7ff5c8078bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.412+0000 7f488cff9640 1 --2- 172.21.15.103:0/2064388475 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f487006c230 0x7f487006e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.412+0000 7f488cff9640 1 -- 172.21.15.103:0/2064388475 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f4880031750 con 0x7f48900adbc0 2024-09-10T08:28:57.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.412+0000 7f488cff9640 1 --2- 172.21.15.103:0/2064388475 >> [v2:172.21.15.154:6800/345273812,v1:172.21.15.154:6801/345273812] conn(0x7f4870076a50 0x7f4870078e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.412+0000 7f488cff9640 1 -- 172.21.15.103:0/2064388475 --> [v2:172.21.15.154:6800/345273812,v1:172.21.15.154:6801/345273812] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f488004de50 con 0x7f4870076a50 2024-09-10T08:28:57.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.412+0000 7f488cff9640 1 -- 172.21.15.103:0/2064388475 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f48800ae550 con 0x7f48900adbc0 2024-09-10T08:28:57.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.413+0000 7f4894f2a640 1 --2- 172.21.15.103:0/2064388475 >> [v2:172.21.15.154:6800/345273812,v1:172.21.15.154:6801/345273812] conn(0x7f4870076a50 0x7f4870078e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.413+0000 7f488f7fe640 1 --2- 172.21.15.103:0/2064388475 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f487006c230 0x7f487006e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.413+0000 7ff5e9dd3640 1 --2- 172.21.15.103:0/3028237842 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff5c806bf00 0x7ff5c806e3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0005880 tx=0x7ff5e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.413+0000 7f3b7759e640 1 -- 172.21.15.103:0/1767977471 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3b5c001030 con 0x7f3b780ab600 2024-09-10T08:28:57.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.413+0000 7ff5e95d2640 1 --2- 172.21.15.103:0/3028237842 >> [v2:172.21.15.154:6824/3439481239,v1:172.21.15.154:6825/3439481239] conn(0x7ff5c8076790 0x7ff5c8078bb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.413+0000 7f488f7fe640 1 --2- 172.21.15.103:0/2064388475 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f487006c230 0x7f487006e6f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f489006c350 tx=0x7f488800f040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.414+0000 7f3b66ffd640 1 -- 172.21.15.103:0/1767977471 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b70049860 con 0x7f3b780ab600 2024-09-10T08:28:57.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.414+0000 7fb5ff59e640 1 -- 172.21.15.103:0/392163505 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb6001503d0 con 0x7fb60006ddc0 2024-09-10T08:28:57.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.414+0000 7f3b66ffd640 1 --2- 172.21.15.103:0/1767977471 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3b5806be80 0x7f3b5806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.414+0000 7fb5eeffd640 1 -- 172.21.15.103:0/392163505 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb5f001a070 con 0x7fb60006ddc0 2024-09-10T08:28:57.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.414+0000 7ff5da7fc640 1 -- 172.21.15.103:0/3028237842 <== osd.7 v2:172.21.15.154:6824/3439481239 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff5e40a8e50 con 0x7ff5c8076790 2024-09-10T08:28:57.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.414+0000 7f3b66ffd640 1 -- 172.21.15.103:0/1767977471 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f3b700b0dc0 con 0x7f3b780ab600 2024-09-10T08:28:57.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.414+0000 7f3b7659c640 1 --2- 172.21.15.103:0/1767977471 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3b5806be80 0x7f3b5806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.414+0000 7f3b66ffd640 1 --2- 172.21.15.103:0/1767977471 >> [v2:172.21.15.103:6800/3453676282,v1:172.21.15.103:6801/3453676282] conn(0x7f3b58076720 0x7f3b58078b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.414+0000 7f3b66ffd640 1 -- 172.21.15.103:0/1767977471 --> [v2:172.21.15.103:6800/3453676282,v1:172.21.15.103:6801/3453676282] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b580791f0 con 0x7f3b58076720 2024-09-10T08:28:57.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.414+0000 7f3b66ffd640 1 -- 172.21.15.103:0/1767977471 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3b700b33e0 con 0x7f3b780ab600 2024-09-10T08:28:57.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.415+0000 7f3b75d9b640 1 --2- 172.21.15.103:0/1767977471 >> [v2:172.21.15.103:6800/3453676282,v1:172.21.15.103:6801/3453676282] conn(0x7f3b58076720 0x7f3b58078b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.415+0000 7f3b7659c640 1 --2- 172.21.15.103:0/1767977471 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3b5806be80 0x7f3b5806e340 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0044d0 tx=0x7f3b6c00a720 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.415+0000 7fb5eeffd640 1 --2- 172.21.15.103:0/392163505 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb5e006bf00 0x7fb5e006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.415+0000 7fb5eeffd640 1 -- 172.21.15.103:0/392163505 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fb5f008a4c0 con 0x7fb60006ddc0 2024-09-10T08:28:57.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.415+0000 7fb5eeffd640 1 --2- 172.21.15.103:0/392163505 >> [v2:172.21.15.154:6816/1048015779,v1:172.21.15.154:6817/1048015779] conn(0x7fb5e0076790 0x7fb5e0078bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.415+0000 7fb5eeffd640 1 -- 172.21.15.103:0/392163505 --> [v2:172.21.15.154:6816/1048015779,v1:172.21.15.154:6817/1048015779] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5f0020e50 con 0x7fb5e0076790 2024-09-10T08:28:57.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.415+0000 7fb5eeffd640 1 -- 172.21.15.103:0/392163505 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb5f0091050 con 0x7fb60006ddc0 2024-09-10T08:28:57.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.415+0000 7f3b75d9b640 1 --2- 172.21.15.103:0/1767977471 >> [v2:172.21.15.103:6800/3453676282,v1:172.21.15.103:6801/3453676282] conn(0x7f3b58076720 0x7f3b58078b40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.415+0000 7f4894f2a640 1 --2- 172.21.15.103:0/2064388475 >> [v2:172.21.15.154:6800/345273812,v1:172.21.15.154:6801/345273812] conn(0x7f4870076a50 0x7f4870078e70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.415+0000 7fb5fdd9b640 1 --2- 172.21.15.103:0/392163505 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb5e006bf00 0x7fb5e006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.416+0000 7fb5fdd9b640 1 --2- 172.21.15.103:0/392163505 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb5e006bf00 0x7fb5e006e3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400d440 tx=0x7fb5f400f040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.416+0000 7fb5fed9d640 1 --2- 172.21.15.103:0/392163505 >> [v2:172.21.15.154:6816/1048015779,v1:172.21.15.154:6817/1048015779] conn(0x7fb5e0076790 0x7fb5e0078bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.416+0000 7f488cff9640 1 -- 172.21.15.103:0/2064388475 <== osd.6 v2:172.21.15.154:6800/345273812 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f488004de50 con 0x7f4870076a50 2024-09-10T08:28:57.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.416+0000 7f3b66ffd640 1 -- 172.21.15.103:0/1767977471 <== osd.3 v2:172.21.15.103:6800/3453676282 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3b580791f0 con 0x7f3b58076720 2024-09-10T08:28:57.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.417+0000 7fb5fed9d640 1 --2- 172.21.15.103:0/392163505 >> [v2:172.21.15.154:6816/1048015779,v1:172.21.15.154:6817/1048015779] conn(0x7fb5e0076790 0x7fb5e0078bb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.418+0000 7fb5eeffd640 1 -- 172.21.15.103:0/392163505 <== osd.5 v2:172.21.15.154:6816/1048015779 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb5f0020e50 con 0x7fb5e0076790 2024-09-10T08:28:57.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.439+0000 7f149feb7640 1 -- 172.21.15.103:0/3725623173 --> [v2:172.21.15.103:6817/428484432,v1:172.21.15.103:6819/428484432] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1480005c90 con 0x7f1480001650 2024-09-10T08:28:57.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.439+0000 7f148e7fc640 1 -- 172.21.15.103:0/3725623173 <== osd.2 v2:172.21.15.103:6817/428484432 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1480005c90 con 0x7f1480001650 2024-09-10T08:28:57.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.440+0000 7f147bfff640 1 -- 172.21.15.103:0/3725623173 >> [v2:172.21.15.103:6817/428484432,v1:172.21.15.103:6819/428484432] conn(0x7f1480001650 msgr2=0x7f1480003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.440+0000 7f147bfff640 1 --2- 172.21.15.103:0/3725623173 >> [v2:172.21.15.103:6817/428484432,v1:172.21.15.103:6819/428484432] conn(0x7f1480001650 0x7f1480003b10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.440+0000 7f263d7fa640 1 -- 172.21.15.103:0/2218660631 --> [v2:172.21.15.154:6808/1808157069,v1:172.21.15.154:6809/1808157069] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2650006fe0 con 0x7f2644076640 2024-09-10T08:28:57.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.440+0000 7f627ec01640 1 -- 172.21.15.103:0/2517434232 --> [v2:172.21.15.103:6808/2707863099,v1:172.21.15.103:6809/2707863099] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6258002dd0 con 0x7f6264076790 2024-09-10T08:28:57.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.441+0000 7f147bfff640 1 -- 172.21.15.103:0/3725623173 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f147c06bf00 msgr2=0x7f147c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.441+0000 7f147bfff640 1 --2- 172.21.15.103:0/3725623173 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f147c06bf00 0x7f147c06e3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1490009c90 tx=0x7f1490009000 comp rx=0 tx=0).stop 2024-09-10T08:28:57.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.441+0000 7f147bfff640 1 -- 172.21.15.103:0/3725623173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14980c5940 msgr2=0x7f14980ad010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.441+0000 7f147bfff640 1 --2- 172.21.15.103:0/3725623173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14980c5940 0x7f14980ad010 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f149400c5c0 tx=0x7f149400ca80 comp rx=0 tx=0).stop 2024-09-10T08:28:57.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.441+0000 7f626d7fa640 1 -- 172.21.15.103:0/2517434232 <== osd.0 v2:172.21.15.103:6808/2707863099 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6258002dd0 con 0x7f6264076790 2024-09-10T08:28:57.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.441+0000 7f149e454640 1 -- 172.21.15.103:0/3725623173 reap_dead start 2024-09-10T08:28:57.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.441+0000 7f147bfff640 1 -- 172.21.15.103:0/3725623173 shutdown_connections 2024-09-10T08:28:57.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.441+0000 7f147bfff640 1 -- 172.21.15.103:0/3725623173 >> 172.21.15.103:0/3725623173 conn(0x7f14980c7a40 msgr2=0x7f149806dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.441+0000 7f263f7fe640 1 -- 172.21.15.103:0/2218660631 <== osd.4 v2:172.21.15.154:6808/1808157069 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2650006fe0 con 0x7f2644076640 2024-09-10T08:28:57.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.441+0000 7f147bfff640 1 -- 172.21.15.103:0/3725623173 shutdown_connections 2024-09-10T08:28:57.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.442+0000 7f627ec01640 1 -- 172.21.15.103:0/2517434232 >> [v2:172.21.15.103:6808/2707863099,v1:172.21.15.103:6809/2707863099] conn(0x7f6264076790 msgr2=0x7f6264078bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.442+0000 7f627ec01640 1 --2- 172.21.15.103:0/2517434232 >> [v2:172.21.15.103:6808/2707863099,v1:172.21.15.103:6809/2707863099] conn(0x7f6264076790 0x7f6264078bb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.442+0000 7f147bfff640 1 -- 172.21.15.103:0/3725623173 wait complete. 2024-09-10T08:28:57.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.442+0000 7f2657fff640 1 -- 172.21.15.103:0/2218660631 >> [v2:172.21.15.154:6808/1808157069,v1:172.21.15.154:6809/1808157069] conn(0x7f2644076640 msgr2=0x7f2644078a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.442+0000 7f2657fff640 1 --2- 172.21.15.103:0/2218660631 >> [v2:172.21.15.154:6808/1808157069,v1:172.21.15.154:6809/1808157069] conn(0x7f2644076640 0x7f2644078a60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.442+0000 7faa9b7fe640 1 -- 172.21.15.103:0/358679024 --> [v2:172.21.15.103:6816/4029892782,v1:172.21.15.103:6818/4029892782] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faa94002dd0 con 0x7faa9c0767a0 2024-09-10T08:28:57.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.442+0000 7f627ec01640 1 -- 172.21.15.103:0/2517434232 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f626406bf00 msgr2=0x7f626406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.442+0000 7f627ec01640 1 --2- 172.21.15.103:0/2517434232 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f626406bf00 0x7f626406e3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6278161650 tx=0x7f6268009110 comp rx=0 tx=0).stop 2024-09-10T08:28:57.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.442+0000 7f627ec01640 1 -- 172.21.15.103:0/2517434232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627806f1d0 msgr2=0x7f6278073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.442+0000 7f2657fff640 1 -- 172.21.15.103:0/2218660631 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f264406be30 msgr2=0x7f264406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.442+0000 7f627ec01640 1 --2- 172.21.15.103:0/2517434232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f627806f1d0 0x7f6278073460 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f62740090b0 tx=0x7f62740046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.442+0000 7f2657fff640 1 --2- 172.21.15.103:0/2218660631 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f264406be30 0x7f264406e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2658050d60 tx=0x7f265806f040 comp rx=0 tx=0).stop 2024-09-10T08:28:57.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.442+0000 7f2657fff640 1 -- 172.21.15.103:0/2218660631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2650005ba0 msgr2=0x7f2650049a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.442+0000 7f627d19e640 1 -- 172.21.15.103:0/2517434232 reap_dead start 2024-09-10T08:28:57.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.442+0000 7f2657fff640 1 --2- 172.21.15.103:0/2218660631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2650005ba0 0x7f2650049a80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2648030000 tx=0x7f26480046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.442+0000 7f26577fe640 1 -- 172.21.15.103:0/2218660631 reap_dead start 2024-09-10T08:28:57.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.442+0000 7f2657fff640 1 -- 172.21.15.103:0/2218660631 shutdown_connections 2024-09-10T08:28:57.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.442+0000 7f2657fff640 1 -- 172.21.15.103:0/2218660631 >> 172.21.15.103:0/2218660631 conn(0x7f2650047d00 msgr2=0x7f2650009c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.442+0000 7faaadffb640 1 -- 172.21.15.103:0/358679024 <== osd.1 v2:172.21.15.103:6816/4029892782 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faa94002dd0 con 0x7faa9c0767a0 2024-09-10T08:28:57.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.442+0000 7f627ec01640 1 -- 172.21.15.103:0/2517434232 shutdown_connections 2024-09-10T08:28:57.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.442+0000 7f627ec01640 1 -- 172.21.15.103:0/2517434232 >> 172.21.15.103:0/2517434232 conn(0x7f62780c7a40 msgr2=0x7f62780a76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.443+0000 7f2657fff640 1 -- 172.21.15.103:0/2218660631 shutdown_connections 2024-09-10T08:28:57.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.443+0000 7f2657fff640 1 -- 172.21.15.103:0/2218660631 wait complete. 2024-09-10T08:28:57.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.443+0000 7f627ec01640 1 -- 172.21.15.103:0/2517434232 shutdown_connections 2024-09-10T08:28:57.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.443+0000 7f627ec01640 1 -- 172.21.15.103:0/2517434232 wait complete. 2024-09-10T08:28:57.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.443+0000 7faa9b7fe640 1 -- 172.21.15.103:0/358679024 >> [v2:172.21.15.103:6816/4029892782,v1:172.21.15.103:6818/4029892782] conn(0x7faa9c0767a0 msgr2=0x7faa9c078bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.443+0000 7faa9b7fe640 1 --2- 172.21.15.103:0/358679024 >> [v2:172.21.15.103:6816/4029892782,v1:172.21.15.103:6818/4029892782] conn(0x7faa9c0767a0 0x7faa9c078bc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.443+0000 7faa9b7fe640 1 -- 172.21.15.103:0/358679024 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7faa9c06bf00 msgr2=0x7faa9c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.443+0000 7faa9b7fe640 1 --2- 172.21.15.103:0/358679024 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7faa9c06bf00 0x7faa9c06e3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faab81ebfb0 tx=0x7faab4008040 comp rx=0 tx=0).stop 2024-09-10T08:28:57.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.443+0000 7faa9b7fe640 1 -- 172.21.15.103:0/358679024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faab814df60 msgr2=0x7faab81eaef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.443+0000 7faa9b7fe640 1 --2- 172.21.15.103:0/358679024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faab814df60 0x7faab81eaef0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faab000a990 tx=0x7faab0001cf0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.443+0000 7faabdd15640 1 -- 172.21.15.103:0/358679024 reap_dead start 2024-09-10T08:28:57.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.444+0000 7faa9b7fe640 1 -- 172.21.15.103:0/358679024 shutdown_connections 2024-09-10T08:28:57.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.444+0000 7faa9b7fe640 1 -- 172.21.15.103:0/358679024 >> 172.21.15.103:0/358679024 conn(0x7faab80c7a40 msgr2=0x7faab815c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.444+0000 7faa9b7fe640 1 -- 172.21.15.103:0/358679024 shutdown_connections 2024-09-10T08:28:57.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.444+0000 7faa9b7fe640 1 -- 172.21.15.103:0/358679024 wait complete. 2024-09-10T08:28:57.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.446+0000 7ff5ec037640 1 -- 172.21.15.103:0/3028237842 --> [v2:172.21.15.154:6824/3439481239,v1:172.21.15.154:6825/3439481239] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff5cc002dd0 con 0x7ff5c8076790 2024-09-10T08:28:57.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.446+0000 7fb5ff59e640 1 -- 172.21.15.103:0/392163505 --> [v2:172.21.15.154:6816/1048015779,v1:172.21.15.154:6817/1048015779] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb6000a8020 con 0x7fb5e0076790 2024-09-10T08:28:57.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.446+0000 7ff5da7fc640 1 -- 172.21.15.103:0/3028237842 <== osd.7 v2:172.21.15.154:6824/3439481239 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff5cc002dd0 con 0x7ff5c8076790 2024-09-10T08:28:57.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.447+0000 7fb5eeffd640 1 -- 172.21.15.103:0/392163505 <== osd.5 v2:172.21.15.154:6816/1048015779 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb6000a8020 con 0x7fb5e0076790 2024-09-10T08:28:57.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.447+0000 7f3b7759e640 1 -- 172.21.15.103:0/1767977471 --> [v2:172.21.15.103:6800/3453676282,v1:172.21.15.103:6801/3453676282] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3b5c002dd0 con 0x7f3b58076720 2024-09-10T08:28:57.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.447+0000 7ff5ec037640 1 -- 172.21.15.103:0/3028237842 >> [v2:172.21.15.154:6824/3439481239,v1:172.21.15.154:6825/3439481239] conn(0x7ff5c8076790 msgr2=0x7ff5c8078bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.447+0000 7ff5ec037640 1 --2- 172.21.15.103:0/3028237842 >> [v2:172.21.15.154:6824/3439481239,v1:172.21.15.154:6825/3439481239] conn(0x7ff5c8076790 0x7ff5c8078bb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.448+0000 7fb5ff59e640 1 -- 172.21.15.103:0/392163505 >> [v2:172.21.15.154:6816/1048015779,v1:172.21.15.154:6817/1048015779] conn(0x7fb5e0076790 msgr2=0x7fb5e0078bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.448+0000 7fb5ff59e640 1 --2- 172.21.15.103:0/392163505 >> [v2:172.21.15.154:6816/1048015779,v1:172.21.15.154:6817/1048015779] conn(0x7fb5e0076790 0x7fb5e0078bb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.448+0000 7f489572b640 1 -- 172.21.15.103:0/2064388475 --> [v2:172.21.15.154:6800/345273812,v1:172.21.15.154:6801/345273812] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f48900c8fd0 con 0x7f4870076a50 2024-09-10T08:28:57.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.448+0000 7f3b66ffd640 1 -- 172.21.15.103:0/1767977471 <== osd.3 v2:172.21.15.103:6800/3453676282 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3b5c002dd0 con 0x7f3b58076720 2024-09-10T08:28:57.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.448+0000 7ff5ec037640 1 -- 172.21.15.103:0/3028237842 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff5c806bf00 msgr2=0x7ff5c806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.448+0000 7ff5ec037640 1 --2- 172.21.15.103:0/3028237842 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff5c806bf00 0x7ff5c806e3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0005880 tx=0x7ff5e0009040 comp rx=0 tx=0).stop 2024-09-10T08:28:57.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.448+0000 7ff5ec037640 1 -- 172.21.15.103:0/3028237842 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5dc0d7430 msgr2=0x7ff5dc0d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.448+0000 7ff5ec037640 1 --2- 172.21.15.103:0/3028237842 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5dc0d7430 0x7ff5dc0d0a10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff5e402dd50 tx=0x7ff5e4069d60 comp rx=0 tx=0).stop 2024-09-10T08:28:57.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.448+0000 7ff5ea5d4640 1 -- 172.21.15.103:0/3028237842 reap_dead start 2024-09-10T08:28:57.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.448+0000 7fb5ff59e640 1 -- 172.21.15.103:0/392163505 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb5e006bf00 msgr2=0x7fb5e006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.448+0000 7fb5ff59e640 1 --2- 172.21.15.103:0/392163505 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb5e006bf00 0x7fb5e006e3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400d440 tx=0x7fb5f400f040 comp rx=0 tx=0).stop 2024-09-10T08:28:57.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.448+0000 7fb5ff59e640 1 -- 172.21.15.103:0/392163505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60006ddc0 msgr2=0x7fb6000a7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.448+0000 7ff5ec037640 1 -- 172.21.15.103:0/3028237842 shutdown_connections 2024-09-10T08:28:57.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.448+0000 7ff5ec037640 1 -- 172.21.15.103:0/3028237842 >> 172.21.15.103:0/3028237842 conn(0x7ff5dc04c0b0 msgr2=0x7ff5dc0d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.448+0000 7fb5ff59e640 1 --2- 172.21.15.103:0/392163505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60006ddc0 0x7fb6000a7ae0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000c4a0 tx=0x7fb5f000c960 comp rx=0 tx=0).stop 2024-09-10T08:28:57.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.448+0000 7fb5fed9d640 1 -- 172.21.15.103:0/392163505 reap_dead start 2024-09-10T08:28:57.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.448+0000 7ff5ec037640 1 -- 172.21.15.103:0/3028237842 shutdown_connections 2024-09-10T08:28:57.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.448+0000 7f488cff9640 1 -- 172.21.15.103:0/2064388475 <== osd.6 v2:172.21.15.154:6800/345273812 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f48900c8fd0 con 0x7f4870076a50 2024-09-10T08:28:57.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.448+0000 7ff5ec037640 1 -- 172.21.15.103:0/3028237842 wait complete. 2024-09-10T08:28:57.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.449+0000 7f3b7759e640 1 -- 172.21.15.103:0/1767977471 >> [v2:172.21.15.103:6800/3453676282,v1:172.21.15.103:6801/3453676282] conn(0x7f3b58076720 msgr2=0x7f3b58078b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.449+0000 7f3b7759e640 1 --2- 172.21.15.103:0/1767977471 >> [v2:172.21.15.103:6800/3453676282,v1:172.21.15.103:6801/3453676282] conn(0x7f3b58076720 0x7f3b58078b40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.449+0000 7f3b7759e640 1 -- 172.21.15.103:0/1767977471 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3b5806be80 msgr2=0x7f3b5806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.449+0000 7f3b7759e640 1 --2- 172.21.15.103:0/1767977471 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3b5806be80 0x7f3b5806e340 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0044d0 tx=0x7f3b6c00a720 comp rx=0 tx=0).stop 2024-09-10T08:28:57.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.449+0000 7f3b7759e640 1 -- 172.21.15.103:0/1767977471 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b780ab600 msgr2=0x7f3b781e7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.449+0000 7f3b7759e640 1 --2- 172.21.15.103:0/1767977471 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b780ab600 0x7f3b781e7aa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3b70035000 tx=0x7f3b70004a40 comp rx=0 tx=0).stop 2024-09-10T08:28:57.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.449+0000 7f3b76d9d640 1 -- 172.21.15.103:0/1767977471 reap_dead start 2024-09-10T08:28:57.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.449+0000 7f3b7759e640 1 -- 172.21.15.103:0/1767977471 shutdown_connections 2024-09-10T08:28:57.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.449+0000 7f3b7759e640 1 -- 172.21.15.103:0/1767977471 >> 172.21.15.103:0/1767977471 conn(0x7f3b780c7f00 msgr2=0x7f3b7814fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.449+0000 7f489572b640 1 -- 172.21.15.103:0/2064388475 >> [v2:172.21.15.154:6800/345273812,v1:172.21.15.154:6801/345273812] conn(0x7f4870076a50 msgr2=0x7f4870078e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.449+0000 7f489572b640 1 --2- 172.21.15.103:0/2064388475 >> [v2:172.21.15.154:6800/345273812,v1:172.21.15.154:6801/345273812] conn(0x7f4870076a50 0x7f4870078e70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.449+0000 7f3b7759e640 1 -- 172.21.15.103:0/1767977471 shutdown_connections 2024-09-10T08:28:57.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.449+0000 7f3b7759e640 1 -- 172.21.15.103:0/1767977471 wait complete. 2024-09-10T08:28:57.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.449+0000 7f489572b640 1 -- 172.21.15.103:0/2064388475 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f487006c230 msgr2=0x7f487006e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.449+0000 7f489572b640 1 --2- 172.21.15.103:0/2064388475 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f487006c230 0x7f487006e6f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f489006c350 tx=0x7f488800f040 comp rx=0 tx=0).stop 2024-09-10T08:28:57.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.449+0000 7f489572b640 1 -- 172.21.15.103:0/2064388475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48900adbc0 msgr2=0x7f4890155960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.449+0000 7f489572b640 1 --2- 172.21.15.103:0/2064388475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48900adbc0 0x7f4890155960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f488000ba10 tx=0x7f48800046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.449+0000 7f4894f2a640 1 -- 172.21.15.103:0/2064388475 reap_dead start 2024-09-10T08:28:57.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.449+0000 7f489572b640 1 -- 172.21.15.103:0/2064388475 shutdown_connections 2024-09-10T08:28:57.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.449+0000 7f489572b640 1 -- 172.21.15.103:0/2064388475 >> 172.21.15.103:0/2064388475 conn(0x7f4890067d70 msgr2=0x7f48901530a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.450+0000 7fb5ff59e640 1 -- 172.21.15.103:0/392163505 shutdown_connections 2024-09-10T08:28:57.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.450+0000 7fb5ff59e640 1 -- 172.21.15.103:0/392163505 >> 172.21.15.103:0/392163505 conn(0x7fb6000c7ae0 msgr2=0x7fb6000ab1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.450+0000 7fb5ff59e640 1 -- 172.21.15.103:0/392163505 shutdown_connections 2024-09-10T08:28:57.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.450+0000 7f489572b640 1 -- 172.21.15.103:0/2064388475 shutdown_connections 2024-09-10T08:28:57.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.450+0000 7f489572b640 1 -- 172.21.15.103:0/2064388475 wait complete. 2024-09-10T08:28:57.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.450+0000 7fb5ff59e640 1 -- 172.21.15.103:0/392163505 wait complete. 2024-09-10T08:28:57.533 INFO:teuthology.orchestra.run.smithi103.stdout:55834574857 2024-09-10T08:28:57.533 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T08:28:57.534 INFO:teuthology.orchestra.run.smithi103.stdout:64424509450 2024-09-10T08:28:57.535 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T08:28:57.535 INFO:teuthology.orchestra.run.smithi103.stdout:64424509450 2024-09-10T08:28:57.535 INFO:teuthology.orchestra.run.smithi103.stdout:64424509451 2024-09-10T08:28:57.536 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T08:28:57.537 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T08:28:57.537 INFO:teuthology.orchestra.run.smithi103.stdout:64424509451 2024-09-10T08:28:57.538 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T08:28:57.538 INFO:teuthology.orchestra.run.smithi103.stdout:64424509450 2024-09-10T08:28:57.539 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T08:28:57.539 INFO:teuthology.orchestra.run.smithi103.stdout:55834574856 2024-09-10T08:28:57.540 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T08:28:57.540 INFO:teuthology.orchestra.run.smithi103.stdout:64424509449 2024-09-10T08:28:57.541 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T08:28:57.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.741+0000 7fd487fff640 1 Processor -- start 2024-09-10T08:28:57.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.740+0000 7f48e359e640 1 Processor -- start 2024-09-10T08:28:57.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.740+0000 7f48e359e640 1 -- start start 2024-09-10T08:28:57.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.741+0000 7f48e359e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48dc0f50a0 0x7f48dc049190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.741+0000 7f48e359e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48dc0f78c0 con 0x7f48dc00b090 2024-09-10T08:28:57.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.741+0000 7f48e359e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48dc0f7b80 con 0x7f48dc00ac90 2024-09-10T08:28:57.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.741+0000 7f48e359e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f48dc0f8790 con 0x7f48dc0f50a0 2024-09-10T08:28:57.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.741+0000 7f48e259c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48dc0f50a0 0x7f48dc049190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.741+0000 7f48e2d9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f48dc00b090 0x7f48dc0062c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50120/0 (socket says 172.21.15.103:50120) 2024-09-10T08:28:57.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.741+0000 7f48e2d9d640 1 -- 172.21.15.103:0/2556018936 learned_addr learned my addr 172.21.15.103:0/2556018936 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:57.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.742+0000 7f48e159a640 1 -- 172.21.15.103:0/2556018936 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 402983978 0 0) 0x7f48dc0f78c0 con 0x7f48dc00b090 2024-09-10T08:28:57.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.742+0000 7f48e159a640 1 -- 172.21.15.103:0/2556018936 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48cc003db0 con 0x7f48dc00b090 2024-09-10T08:28:57.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.742+0000 7f48e259c640 1 -- 172.21.15.103:0/2556018936 >> v1:172.21.15.154:6789/0 conn(0x7f48dc00ac90 legacy=0x7f48dc005bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T08:28:57.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.742+0000 7f48e259c640 1 -- 172.21.15.103:0/2556018936 >> v1:172.21.15.103:6789/0 conn(0x7f48dc00b090 legacy=0x7f48dc0062c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.742+0000 7f48e259c640 1 -- 172.21.15.103:0/2556018936 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48dc0f7e60 con 0x7f48dc0f50a0 2024-09-10T08:28:57.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.742+0000 7fd487fff640 1 -- start start 2024-09-10T08:28:57.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.743+0000 7f48e259c640 1 --2- 172.21.15.103:0/2556018936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48dc0f50a0 0x7f48dc049190 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f48d4007390 tx=0x7f48d402a0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=637ab3d78b80f114 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.743+0000 7fcc5567b640 1 Processor -- start 2024-09-10T08:28:57.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.744+0000 7fd487fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd488157e60 0x7fd4880c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.744+0000 7fd487fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4880c3e20 0x7fd4880c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.744+0000 7fcc5567b640 1 -- start start 2024-09-10T08:28:57.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.744+0000 7fd487fff640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4880a5ba0 con 0x7fd4880c2890 2024-09-10T08:28:57.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.744+0000 7fd487fff640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fd4880a5ed0 con 0x7fd488157e60 2024-09-10T08:28:57.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.744+0000 7fd487fff640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd488158240 con 0x7fd4880c3e20 2024-09-10T08:28:57.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.744+0000 7fd4877fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd4880c2890 0x7fd4880c5e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50128/0 (socket says 172.21.15.103:50128) 2024-09-10T08:28:57.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.744+0000 7fd4877fe640 1 -- 172.21.15.103:0/254767676 learned_addr learned my addr 172.21.15.103:0/254767676 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:57.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.744+0000 7fd486ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd488157e60 0x7fd4880c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.744+0000 7fd4867fc640 1 --2- 172.21.15.103:0/254767676 >> v2:172.21.15.154:3300/0 conn(0x7fd4880c3e20 0x7fd4880c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.744+0000 7fd485ffb640 1 -- 172.21.15.103:0/254767676 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2065076942 0 0) 0x7fd4880a5ba0 con 0x7fd4880c2890 2024-09-10T08:28:57.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.744+0000 7fd485ffb640 1 -- 172.21.15.103:0/254767676 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd470003520 con 0x7fd4880c2890 2024-09-10T08:28:57.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.744+0000 7f97dc48b640 1 Processor -- start 2024-09-10T08:28:57.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.745+0000 7fd486ffd640 1 -- 172.21.15.103:0/254767676 >> v2:172.21.15.154:3300/0 conn(0x7fd4880c3e20 msgr2=0x7fd4880c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.745+0000 7fd486ffd640 1 --2- 172.21.15.103:0/254767676 >> v2:172.21.15.154:3300/0 conn(0x7fd4880c3e20 0x7fd4880c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.745+0000 7fd485ffb640 1 -- 172.21.15.103:0/254767676 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2435715724 0 0) 0x7fd470003520 con 0x7fd4880c2890 2024-09-10T08:28:57.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.745+0000 7fd486ffd640 1 -- 172.21.15.103:0/254767676 >> v1:172.21.15.103:6789/0 conn(0x7fd4880c2890 legacy=0x7fd4880c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.743+0000 7fdc627c4640 1 Processor -- start 2024-09-10T08:28:57.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.745+0000 7f97dc48b640 1 -- start start 2024-09-10T08:28:57.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.744+0000 7fcc5567b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcc480d5360 0x7fcc48049ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.745+0000 7fcc5567b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc480d7f40 0x7fcc480d83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.745+0000 7fcc5567b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc480db010 con 0x7fcc48045c10 2024-09-10T08:28:57.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.745+0000 7fcc5567b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fcc480d5740 con 0x7fcc480d5360 2024-09-10T08:28:57.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.745+0000 7fcc5567b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcc480d7a80 con 0x7fcc480d7f40 2024-09-10T08:28:57.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.745+0000 7fd486ffd640 1 -- 172.21.15.103:0/254767676 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4880a6360 con 0x7fd488157e60 2024-09-10T08:28:57.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.743+0000 7fdc627c4640 1 -- start start 2024-09-10T08:28:57.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.745+0000 7fcc4f7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fcc48045c10 0x7fcc48006a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50140/0 (socket says 172.21.15.103:50140) 2024-09-10T08:28:57.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.745+0000 7fcc4f7fe640 1 -- 172.21.15.103:0/3317497164 learned_addr learned my addr 172.21.15.103:0/3317497164 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:57.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.745+0000 7fcc54e7a640 1 --2- 172.21.15.103:0/3317497164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc480d7f40 0x7fcc480d83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.745+0000 7fcc4effd640 1 -- 172.21.15.103:0/3317497164 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 273075391 0 0) 0x7fcc480db010 con 0x7fcc48045c10 2024-09-10T08:28:57.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.745+0000 7fcc4effd640 1 -- 172.21.15.103:0/3317497164 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc40003520 con 0x7fcc48045c10 2024-09-10T08:28:57.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.745+0000 7fcc4ffff640 1 --2- 172.21.15.103:0/3317497164 >> v2:172.21.15.154:3300/0 conn(0x7fcc480d5360 0x7fcc48049ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7fcc4effd640 1 -- 172.21.15.103:0/3317497164 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 465665289 0 0) 0x7fcc40003520 con 0x7fcc48045c10 2024-09-10T08:28:57.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7fcc4ffff640 1 -- 172.21.15.103:0/3317497164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc480d7f40 msgr2=0x7fcc480d83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7f134ffff640 1 Processor -- start 2024-09-10T08:28:57.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7fdc627c4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdc5c0cb950 0x7fdc5c0c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7fdc627c4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc5c15a5c0 0x7fdc5c0ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7fdc627c4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc5c154a70 con 0x7fdc5c154690 2024-09-10T08:28:57.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7fdc627c4640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fdc5c15aac0 con 0x7fdc5c0cb950 2024-09-10T08:28:57.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7fdc627c4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fdc5c15ada0 con 0x7fdc5c15a5c0 2024-09-10T08:28:57.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7fdc5bfff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdc5c154690 0x7fdc5c067950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50142/0 (socket says 172.21.15.103:50142) 2024-09-10T08:28:57.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7fdc5bfff640 1 -- 172.21.15.103:0/2785142880 learned_addr learned my addr 172.21.15.103:0/2785142880 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:57.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7f97dc48b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97d40acc30 0x7f97d40c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7f134ffff640 1 -- start start 2024-09-10T08:28:57.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7fdc5b7fe640 1 --2- 172.21.15.103:0/2785142880 >> v2:172.21.15.103:3300/0 conn(0x7fdc5c0cb950 0x7fdc5c0c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7f97dc48b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f97d40c44b0 0x7f97d40c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7f48e159a640 1 -- 172.21.15.103:0/2556018936 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d402abb0 con 0x7f48dc0f50a0 2024-09-10T08:28:57.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7f48e159a640 1 -- 172.21.15.103:0/2556018936 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d402ad50 con 0x7f48dc0f50a0 2024-09-10T08:28:57.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7f48e159a640 1 -- 172.21.15.103:0/2556018936 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d40076b0 con 0x7f48dc0f50a0 2024-09-10T08:28:57.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7fdc5affd640 1 -- 172.21.15.103:0/2785142880 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2414228559 0 0) 0x7fdc5c154a70 con 0x7fdc5c154690 2024-09-10T08:28:57.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7f97da227640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97d40acc30 0x7f97d40c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7f97da227640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97d40acc30 0x7f97d40c3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:53060/0 (socket says 172.21.15.103:53060) 2024-09-10T08:28:57.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7f97da227640 1 -- 172.21.15.103:0/827595191 learned_addr learned my addr 172.21.15.103:0/827595191 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7fdc5affd640 1 -- 172.21.15.103:0/2785142880 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc44003520 con 0x7fdc5c154690 2024-09-10T08:28:57.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7fdc5b7fe640 1 -- 172.21.15.103:0/2785142880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc5c15a5c0 msgr2=0x7fdc5c0ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7fcc4ffff640 1 --2- 172.21.15.103:0/3317497164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc480d7f40 0x7fcc480d83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7fcc4ffff640 1 -- 172.21.15.103:0/3317497164 >> v1:172.21.15.103:6789/0 conn(0x7fcc48045c10 legacy=0x7fcc48006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.746+0000 7fcc4ffff640 1 -- 172.21.15.103:0/3317497164 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc480d8910 con 0x7fcc480d5360 2024-09-10T08:28:57.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7fdc5b7fe640 1 --2- 172.21.15.103:0/2785142880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc5c15a5c0 0x7fdc5c0ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7f97dc48b640 1 --2- 172.21.15.103:0/827595191 >> v2:172.21.15.154:3300/0 conn(0x7f97d40c7fb0 0x7f97d40c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7fcc54e7a640 1 --2- 172.21.15.103:0/3317497164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc480d7f40 0x7fcc480d83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:57.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7fdc5b7fe640 1 -- 172.21.15.103:0/2785142880 >> v1:172.21.15.103:6789/0 conn(0x7fdc5c154690 legacy=0x7fdc5c067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7fdc5b7fe640 1 -- 172.21.15.103:0/2785142880 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5c15b080 con 0x7fdc5c0cb950 2024-09-10T08:28:57.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7f97daa28640 1 --2- 172.21.15.103:0/827595191 >> v2:172.21.15.154:3300/0 conn(0x7f97d40c7fb0 0x7f97d40c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7f97dc48b640 1 -- 172.21.15.103:0/827595191 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f97d40c4ea0 con 0x7f97d40c44b0 2024-09-10T08:28:57.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7f97d9a26640 1 --2- 172.21.15.103:0/827595191 >> v2:172.21.15.103:3300/0 conn(0x7f97d40c44b0 0x7f97d40c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7f97dc48b640 1 -- 172.21.15.103:0/827595191 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f97d4070590 con 0x7f97d40c7fb0 2024-09-10T08:28:57.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7f97dc48b640 1 -- 172.21.15.103:0/827595191 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f97d40a8220 con 0x7f97d40acc30 2024-09-10T08:28:57.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7f134ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f135015b450 0x7f13500a5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7f134ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f13500c6d90 0x7f13500a5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7f134ffff640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13500c3c70 con 0x7f13500c69b0 2024-09-10T08:28:57.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7f134ffff640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f13500c4230 con 0x7f13500c6d90 2024-09-10T08:28:57.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7f134ffff640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f135015afc0 con 0x7f135015b450 2024-09-10T08:28:57.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7f48e359e640 1 -- 172.21.15.103:0/2556018936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48dc0f50a0 msgr2=0x7f48dc049190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7f48e359e640 1 --2- 172.21.15.103:0/2556018936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48dc0f50a0 0x7f48dc049190 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f48d4007390 tx=0x7f48d402a0b0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7fd486ffd640 1 --2- 172.21.15.103:0/254767676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd488157e60 0x7fd4880c38e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd4880a6a10 tx=0x7fd47c02a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10bc17499649aa90 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7fd485ffb640 1 -- 172.21.15.103:0/254767676 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c037070 con 0x7fd488157e60 2024-09-10T08:28:57.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7fd485ffb640 1 -- 172.21.15.103:0/254767676 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd47c02aaa0 con 0x7fd488157e60 2024-09-10T08:28:57.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7fd485ffb640 1 -- 172.21.15.103:0/254767676 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4800019f0 con 0x7fd488157e60 2024-09-10T08:28:57.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7f48e359e640 1 -- 172.21.15.103:0/2556018936 shutdown_connections 2024-09-10T08:28:57.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7f48e359e640 1 --2- 172.21.15.103:0/2556018936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48dc0f50a0 0x7f48dc049190 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.747+0000 7f48e359e640 1 -- 172.21.15.103:0/2556018936 >> 172.21.15.103:0/2556018936 conn(0x7f48dc047d10 msgr2=0x7f48dc048120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.748+0000 7f134effd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f13500c69b0 0x7f13500c57d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:33448/0 (socket says 172.21.15.103:33448) 2024-09-10T08:28:57.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.748+0000 7f134effd640 1 -- 172.21.15.103:0/2763675571 learned_addr learned my addr 172.21.15.103:0/2763675571 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:57.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.748+0000 7f134f7fe640 1 --2- 172.21.15.103:0/2763675571 >> v2:172.21.15.154:3300/0 conn(0x7f13500c6d90 0x7f13500a5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.748+0000 7f97da227640 1 -- 172.21.15.103:0/827595191 >> v2:172.21.15.154:3300/0 conn(0x7f97d40c7fb0 msgr2=0x7f97d40c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.748+0000 7f97da227640 1 --2- 172.21.15.103:0/827595191 >> v2:172.21.15.154:3300/0 conn(0x7f97d40c7fb0 0x7f97d40c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.748+0000 7f97da227640 1 -- 172.21.15.103:0/827595191 >> v2:172.21.15.103:3300/0 conn(0x7f97d40c44b0 msgr2=0x7f97d40c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.748+0000 7f134e7fc640 1 --2- 172.21.15.103:0/2763675571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f135015b450 0x7f13500a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.748+0000 7f134e7fc640 1 -- 172.21.15.103:0/2763675571 >> v2:172.21.15.154:3300/0 conn(0x7f13500c6d90 msgr2=0x7f13500a5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.748+0000 7f134e7fc640 1 --2- 172.21.15.103:0/2763675571 >> v2:172.21.15.154:3300/0 conn(0x7f13500c6d90 0x7f13500a5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.748+0000 7f134e7fc640 1 -- 172.21.15.103:0/2763675571 >> v1:172.21.15.154:6789/0 conn(0x7f13500c69b0 legacy=0x7f13500c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.748+0000 7f134e7fc640 1 -- 172.21.15.103:0/2763675571 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13500c3f50 con 0x7f135015b450 2024-09-10T08:28:57.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.748+0000 7fd487fff640 1 -- 172.21.15.103:0/254767676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd488157e60 msgr2=0x7fd4880c38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.748+0000 7fd487fff640 1 --2- 172.21.15.103:0/254767676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd488157e60 0x7fd4880c38e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd4880a6a10 tx=0x7fd47c02a010 comp rx=0 tx=0).stop 2024-09-10T08:28:57.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.748+0000 7fcc4ffff640 1 --2- 172.21.15.103:0/3317497164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc480d5360 0x7fcc48049ba0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcc440097a0 tx=0x7fcc4402a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=266e9cafb627c3f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.748+0000 7fcc4effd640 1 -- 172.21.15.103:0/3317497164 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44037070 con 0x7fcc480d5360 2024-09-10T08:28:57.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.748+0000 7fcc4effd640 1 -- 172.21.15.103:0/3317497164 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc4402ab30 con 0x7fcc480d5360 2024-09-10T08:28:57.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.748+0000 7fcc4effd640 1 -- 172.21.15.103:0/3317497164 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c001670 con 0x7fcc480d5360 2024-09-10T08:28:57.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.748+0000 7f97da227640 1 --2- 172.21.15.103:0/827595191 >> v2:172.21.15.103:3300/0 conn(0x7f97d40c44b0 0x7f97d40c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.748+0000 7f97da227640 1 -- 172.21.15.103:0/827595191 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d40a84f0 con 0x7f97d40acc30 2024-09-10T08:28:57.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7f97d9a26640 1 --2- 172.21.15.103:0/827595191 >> v2:172.21.15.103:3300/0 conn(0x7f97d40c44b0 0x7f97d40c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:57.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7fd487fff640 1 -- 172.21.15.103:0/254767676 shutdown_connections 2024-09-10T08:28:57.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7fd487fff640 1 --2- 172.21.15.103:0/254767676 >> v2:172.21.15.154:3300/0 conn(0x7fd4880c3e20 0x7fd4880c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7fd487fff640 1 --2- 172.21.15.103:0/254767676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd488157e60 0x7fd4880c38e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7fd487fff640 1 -- 172.21.15.103:0/254767676 >> 172.21.15.103:0/254767676 conn(0x7fd4880a9780 msgr2=0x7fd4880a9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7fcc5567b640 1 -- 172.21.15.103:0/3317497164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc480d5360 msgr2=0x7fcc48049ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7fcc5567b640 1 --2- 172.21.15.103:0/3317497164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc480d5360 0x7fcc48049ba0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcc440097a0 tx=0x7fcc4402a0a0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7fcc5567b640 1 -- 172.21.15.103:0/3317497164 shutdown_connections 2024-09-10T08:28:57.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7fcc5567b640 1 --2- 172.21.15.103:0/3317497164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc480d7f40 0x7fcc480d83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7fcc5567b640 1 --2- 172.21.15.103:0/3317497164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc480d5360 0x7fcc48049ba0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7fcc5567b640 1 -- 172.21.15.103:0/3317497164 >> 172.21.15.103:0/3317497164 conn(0x7fcc48047d10 msgr2=0x7fcc48048120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7fdc5b7fe640 1 --2- 172.21.15.103:0/2785142880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc5c0cb950 0x7fdc5c0c9fd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0097a0 tx=0x7fdc4c02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f3c992b8a0f343 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7fcc5567b640 1 -- 172.21.15.103:0/3317497164 shutdown_connections 2024-09-10T08:28:57.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7fcc5567b640 1 -- 172.21.15.103:0/3317497164 wait complete. 2024-09-10T08:28:57.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7fd487fff640 1 -- 172.21.15.103:0/254767676 shutdown_connections 2024-09-10T08:28:57.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7fd487fff640 1 -- 172.21.15.103:0/254767676 wait complete. 2024-09-10T08:28:57.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7f97da227640 1 --2- 172.21.15.103:0/827595191 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97d40acc30 0x7f97d40c3f70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f97d40adbc0 tx=0x7f97d002c2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2f8dd0a150ec7a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7f134e7fc640 1 --2- 172.21.15.103:0/2763675571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f135015b450 0x7f13500a5210 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f13400097a0 tx=0x7f134002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bef3e17ffef9fd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7f48e359e640 1 -- 172.21.15.103:0/2556018936 shutdown_connections 2024-09-10T08:28:57.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7fdc5affd640 1 -- 172.21.15.103:0/2785142880 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c037070 con 0x7fdc5c0cb950 2024-09-10T08:28:57.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7fdc5affd640 1 -- 172.21.15.103:0/2785142880 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4c02add0 con 0x7fdc5c0cb950 2024-09-10T08:28:57.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7f48e359e640 1 -- 172.21.15.103:0/2556018936 wait complete. 2024-09-10T08:28:57.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.750+0000 7f97d9225640 1 -- 172.21.15.103:0/827595191 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d0039070 con 0x7f97d40acc30 2024-09-10T08:28:57.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.750+0000 7f97d9225640 1 -- 172.21.15.103:0/827595191 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d0034640 con 0x7f97d40acc30 2024-09-10T08:28:57.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.750+0000 7f97d9225640 1 -- 172.21.15.103:0/827595191 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d0034a10 con 0x7f97d40acc30 2024-09-10T08:28:57.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.749+0000 7f134dffb640 1 -- 172.21.15.103:0/2763675571 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1340037070 con 0x7f135015b450 2024-09-10T08:28:57.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.750+0000 7f134dffb640 1 -- 172.21.15.103:0/2763675571 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f134002ae50 con 0x7f135015b450 2024-09-10T08:28:57.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.750+0000 7fdc5affd640 1 -- 172.21.15.103:0/2785142880 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c037070 con 0x7fdc5c0cb950 2024-09-10T08:28:57.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.750+0000 7fdc627c4640 1 -- 172.21.15.103:0/2785142880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc5c0cb950 msgr2=0x7fdc5c0c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.750+0000 7fdc627c4640 1 --2- 172.21.15.103:0/2785142880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc5c0cb950 0x7fdc5c0c9fd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0097a0 tx=0x7fdc4c02a080 comp rx=0 tx=0).stop 2024-09-10T08:28:57.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.750+0000 7fdc627c4640 1 -- 172.21.15.103:0/2785142880 shutdown_connections 2024-09-10T08:28:57.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.750+0000 7fdc627c4640 1 --2- 172.21.15.103:0/2785142880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc5c15a5c0 0x7fdc5c0ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.750+0000 7fdc627c4640 1 --2- 172.21.15.103:0/2785142880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc5c0cb950 0x7fdc5c0c9fd0 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0097a0 tx=0x7fdc4c02a080 comp rx=0 tx=0).stop 2024-09-10T08:28:57.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.750+0000 7fdc627c4640 1 -- 172.21.15.103:0/2785142880 >> 172.21.15.103:0/2785142880 conn(0x7fdc5c0c87f0 msgr2=0x7fdc5c0c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.751+0000 7fcc5567b640 1 Processor -- start 2024-09-10T08:28:57.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.750+0000 7f134ffff640 1 -- 172.21.15.103:0/2763675571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f135015b450 msgr2=0x7f13500a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.750+0000 7f134ffff640 1 --2- 172.21.15.103:0/2763675571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f135015b450 0x7f13500a5210 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f13400097a0 tx=0x7f134002a100 comp rx=0 tx=0).stop 2024-09-10T08:28:57.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.751+0000 7f134ffff640 1 -- 172.21.15.103:0/2763675571 shutdown_connections 2024-09-10T08:28:57.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.751+0000 7f134ffff640 1 --2- 172.21.15.103:0/2763675571 >> v2:172.21.15.154:3300/0 conn(0x7f13500c6d90 0x7f13500a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.751+0000 7f134ffff640 1 --2- 172.21.15.103:0/2763675571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f135015b450 0x7f13500a5210 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f13400097a0 tx=0x7f134002a100 comp rx=0 tx=0).stop 2024-09-10T08:28:57.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.751+0000 7f134ffff640 1 -- 172.21.15.103:0/2763675571 >> 172.21.15.103:0/2763675571 conn(0x7f13500c7f00 msgr2=0x7f13500a9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.751+0000 7fdc627c4640 1 -- 172.21.15.103:0/2785142880 shutdown_connections 2024-09-10T08:28:57.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.751+0000 7f134ffff640 1 -- 172.21.15.103:0/2763675571 shutdown_connections 2024-09-10T08:28:57.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.751+0000 7fd487fff640 1 Processor -- start 2024-09-10T08:28:57.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.751+0000 7fcc5567b640 1 -- start start 2024-09-10T08:28:57.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.751+0000 7f97dc48b640 1 -- 172.21.15.103:0/827595191 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97d40acc30 msgr2=0x7f97d40c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.751+0000 7f97dc48b640 1 --2- 172.21.15.103:0/827595191 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97d40acc30 0x7f97d40c3f70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f97d40adbc0 tx=0x7f97d002c2c0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.751+0000 7f134ffff640 1 -- 172.21.15.103:0/2763675571 wait complete. 2024-09-10T08:28:57.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.751+0000 7fdc627c4640 1 -- 172.21.15.103:0/2785142880 wait complete. 2024-09-10T08:28:57.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.751+0000 7f48e359e640 1 Processor -- start 2024-09-10T08:28:57.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.751+0000 7f48e359e640 1 -- start start 2024-09-10T08:28:57.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.751+0000 7fd487fff640 1 -- start start 2024-09-10T08:28:57.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.752+0000 7fe33b191640 1 Processor -- start 2024-09-10T08:28:57.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.752+0000 7fcc5567b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc48045c10 0x7fcc480462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.752+0000 7fe33b191640 1 -- start start 2024-09-10T08:28:57.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.752+0000 7fcc5567b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc480d5360 0x7fcc480d3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7fcc5567b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc480d7f40 0x7fcc480d41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f48e359e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48dc00ac90 0x7f48dc19ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7fcc4ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc48045c10 0x7fcc480462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7fcc4f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc480d5360 0x7fcc480d3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7fcc4f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc480d5360 0x7fcc480d3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:56506/0 (socket says 172.21.15.103:56506) 2024-09-10T08:28:57.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f48e359e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48dc00b090 0x7f48dc1a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f48e359e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48dc0f50a0 0x7f48dc1a23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f48e359e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc007210 con 0x7f48dc00ac90 2024-09-10T08:28:57.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f48e359e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc0f8420 con 0x7f48dc0f50a0 2024-09-10T08:28:57.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f48e259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48dc00ac90 0x7f48dc19ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f48e359e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f48dc0f5480 con 0x7f48dc00b090 2024-09-10T08:28:57.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7fcc4ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc48045c10 0x7fcc480462c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:53080/0 (socket says 172.21.15.103:53080) 2024-09-10T08:28:57.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f134ffff640 1 Processor -- start 2024-09-10T08:28:57.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7fcc4f7fe640 1 -- 172.21.15.103:0/4239386859 learned_addr learned my addr 172.21.15.103:0/4239386859 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f48e259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48dc00ac90 0x7f48dc19ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49594/0 (socket says 172.21.15.103:49594) 2024-09-10T08:28:57.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f48e259c640 1 -- 172.21.15.103:0/823879445 learned_addr learned my addr 172.21.15.103:0/823879445 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f48e2d9d640 1 --2- 172.21.15.103:0/823879445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48dc0f50a0 0x7f48dc1a23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7fcc5567b640 1 -- 172.21.15.103:0/4239386859 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4802e880 con 0x7fcc480d7f40 2024-09-10T08:28:57.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7fcc5567b640 1 -- 172.21.15.103:0/4239386859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4802e5a0 con 0x7fcc480d5360 2024-09-10T08:28:57.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7fcc5567b640 1 -- 172.21.15.103:0/4239386859 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcc4802eb60 con 0x7fcc48045c10 2024-09-10T08:28:57.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7fcc54e7a640 1 --2- 172.21.15.103:0/4239386859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc480d7f40 0x7fcc480d41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f134ffff640 1 -- start start 2024-09-10T08:28:57.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.752+0000 7fdc627c4640 1 Processor -- start 2024-09-10T08:28:57.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f4d51957640 1 Processor -- start 2024-09-10T08:28:57.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f48e1d9b640 1 --2- 172.21.15.103:0/823879445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48dc00b090 0x7f48dc1a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f97dc48b640 1 -- 172.21.15.103:0/827595191 shutdown_connections 2024-09-10T08:28:57.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f97dc48b640 1 --2- 172.21.15.103:0/827595191 >> v2:172.21.15.154:3300/0 conn(0x7f97d40c7fb0 0x7f97d40c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f97dc48b640 1 --2- 172.21.15.103:0/827595191 >> v2:172.21.15.103:3300/0 conn(0x7f97d40c44b0 0x7f97d40c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f97dc48b640 1 --2- 172.21.15.103:0/827595191 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97d40acc30 0x7f97d40c3f70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f97dc48b640 1 -- 172.21.15.103:0/827595191 >> 172.21.15.103:0/827595191 conn(0x7f97d40c5660 msgr2=0x7f97d40c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f48e2d9d640 1 -- 172.21.15.103:0/823879445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48dc00b090 msgr2=0x7f48dc1a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f48e2d9d640 1 --2- 172.21.15.103:0/823879445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48dc00b090 0x7f48dc1a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f48e2d9d640 1 -- 172.21.15.103:0/823879445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48dc00ac90 msgr2=0x7f48dc19ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f48e2d9d640 1 --2- 172.21.15.103:0/823879445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48dc00ac90 0x7f48dc19ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f48e2d9d640 1 -- 172.21.15.103:0/823879445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48dc1a19c0 con 0x7f48dc0f50a0 2024-09-10T08:28:57.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.753+0000 7f4d51957640 1 -- start start 2024-09-10T08:28:57.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7fe33b191640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe3340c5940 0x7fe33406e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7f97dc48b640 1 -- 172.21.15.103:0/827595191 shutdown_connections 2024-09-10T08:28:57.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7f97dc48b640 1 -- 172.21.15.103:0/827595191 wait complete. 2024-09-10T08:28:57.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7fe33b191640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe33415a970 con 0x7fe3340c6010 2024-09-10T08:28:57.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7fcc4ffff640 1 -- 172.21.15.103:0/4239386859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc480d5360 msgr2=0x7fcc480d3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7fcc4ffff640 1 --2- 172.21.15.103:0/4239386859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc480d5360 0x7fcc480d3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7fcc4ffff640 1 -- 172.21.15.103:0/4239386859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc480d7f40 msgr2=0x7fcc480d41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7fcc4ffff640 1 --2- 172.21.15.103:0/4239386859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc480d7f40 0x7fcc480d41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7fcc4ffff640 1 -- 172.21.15.103:0/4239386859 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc4816b6f0 con 0x7fcc48045c10 2024-09-10T08:28:57.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7fe33b191640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe33415ac50 con 0x7fe3340a6c10 2024-09-10T08:28:57.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7fe33b191640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe33415af30 con 0x7fe3340c5940 2024-09-10T08:28:57.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7fe33972e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe3340c5940 0x7fe33406e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7fe33972e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe3340c5940 0x7fe33406e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:56522/0 (socket says 172.21.15.103:56522) 2024-09-10T08:28:57.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7fe33972e640 1 -- 172.21.15.103:0/2688635981 learned_addr learned my addr 172.21.15.103:0/2688635981 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7fdc627c4640 1 -- start start 2024-09-10T08:28:57.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7fcc4ffff640 1 --2- 172.21.15.103:0/4239386859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc48045c10 0x7fcc480462c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcc48048e10 tx=0x7fcc440046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7f48e2d9d640 1 --2- 172.21.15.103:0/823879445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48dc0f50a0 0x7f48dc1a23e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f48e4000b60 tx=0x7f48e40699a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7f134ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13500c69b0 0x7f13500a9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7f134ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13500c6d90 0x7f13501f3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7fe3337fe640 1 -- 172.21.15.103:0/2688635981 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 88799944 0 0) 0x7fe33415a970 con 0x7fe3340c6010 2024-09-10T08:28:57.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7fe3337fe640 1 -- 172.21.15.103:0/2688635981 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe320003520 con 0x7fe3340c6010 2024-09-10T08:28:57.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7fcc4cff9640 1 -- 172.21.15.103:0/4239386859 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44040020 con 0x7fcc48045c10 2024-09-10T08:28:57.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7fcc4cff9640 1 -- 172.21.15.103:0/4239386859 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc44003ba0 con 0x7fcc48045c10 2024-09-10T08:28:57.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7fcc4cff9640 1 -- 172.21.15.103:0/4239386859 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44037040 con 0x7fcc48045c10 2024-09-10T08:28:57.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7f48d2ffd640 1 -- 172.21.15.103:0/823879445 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e406bbe0 con 0x7f48dc0f50a0 2024-09-10T08:28:57.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7f48d2ffd640 1 -- 172.21.15.103:0/823879445 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e4081020 con 0x7f48dc0f50a0 2024-09-10T08:28:57.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.754+0000 7f48d2ffd640 1 -- 172.21.15.103:0/823879445 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e40741c0 con 0x7f48dc0f50a0 2024-09-10T08:28:57.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fd487fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4880c2890 0x7fd4881fc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fd487fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4880c3e20 0x7fd4881fc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fd487fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd488157e60 0x7fd488159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fd487fff640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd4880c2de0 con 0x7fd4880c3e20 2024-09-10T08:28:57.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fd487fff640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd48815b4e0 con 0x7fd488157e60 2024-09-10T08:28:57.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fd487fff640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd4880c2f60 con 0x7fd4880c2890 2024-09-10T08:28:57.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fd4877fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd488157e60 0x7fd488159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7f48e359e640 1 -- 172.21.15.103:0/823879445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48dc181b20 con 0x7f48dc0f50a0 2024-09-10T08:28:57.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7f48e359e640 1 -- 172.21.15.103:0/823879445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48dc183c30 con 0x7f48dc0f50a0 2024-09-10T08:28:57.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fdc627c4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc5c154690 0x7fdc5c157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fdc627c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc5c15a5c0 0x7fdc5c0ace10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fdc627c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc5c12d2c0 0x7fdc5c1fc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fdc627c4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5c0681e0 con 0x7fdc5c12d2c0 2024-09-10T08:28:57.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fdc627c4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5c068060 con 0x7fdc5c15a5c0 2024-09-10T08:28:57.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fdc627c4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fdc5c0caa50 con 0x7fdc5c154690 2024-09-10T08:28:57.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fdc5b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc5c15a5c0 0x7fdc5c0ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fe3337fe640 1 -- 172.21.15.103:0/2688635981 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2997302271 0 0) 0x7fe320003520 con 0x7fe3340c6010 2024-09-10T08:28:57.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fe3337fe640 1 -- 172.21.15.103:0/2688635981 >> v2:172.21.15.154:3300/0 conn(0x7fe3340c5940 msgr2=0x7fe33406e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fe3337fe640 1 --2- 172.21.15.103:0/2688635981 >> v2:172.21.15.154:3300/0 conn(0x7fe3340c5940 0x7fe33406e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fe3337fe640 1 -- 172.21.15.103:0/2688635981 >> v1:172.21.15.154:6789/0 conn(0x7fe3340a6c10 legacy=0x7fe3340c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fe3337fe640 1 -- 172.21.15.103:0/2688635981 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33415b210 con 0x7fe3340c6010 2024-09-10T08:28:57.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fe3337fe640 1 -- 172.21.15.103:0/2688635981 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7fe324001670 con 0x7fe3340c6010 2024-09-10T08:28:57.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fe3337fe640 1 -- 172.21.15.103:0/2688635981 >> v1:172.21.15.103:6789/0 conn(0x7fe3340c6010 legacy=0x7fe33406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fe3337fe640 1 --2- 172.21.15.103:0/2688635981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe320003a00 0x7fe320003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fe3337fe640 1 --2- 172.21.15.103:0/2688635981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe320004800 0x7fe320004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fe3337fe640 1 --2- 172.21.15.103:0/2688635981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe320005210 0x7fe32000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fe3337fe640 1 -- 172.21.15.103:0/2688635981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe33415af30 con 0x7fe320003a00 2024-09-10T08:28:57.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fe3337fe640 1 -- 172.21.15.103:0/2688635981 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe32000c140 con 0x7fe320005210 2024-09-10T08:28:57.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7f4d51957640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d4c06d560 0x7f4d4c06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7f4d51957640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4d4c0a8180 0x7f4d4c1501c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7f4d4bfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4d4c0a8180 0x7f4d4c1501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7f4d4bfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4d4c0a8180 0x7f4d4c1501c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49642/0 (socket says 172.21.15.103:49642) 2024-09-10T08:28:57.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7f134e7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13500c6d90 0x7f13501f3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7f134e7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13500c6d90 0x7f13501f3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49626/0 (socket says 172.21.15.103:49626) 2024-09-10T08:28:57.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7f134e7fc640 1 -- 172.21.15.103:0/1528888549 learned_addr learned my addr 172.21.15.103:0/1528888549 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fd4877fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd488157e60 0x7fd488159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:56552/0 (socket says 172.21.15.103:56552) 2024-09-10T08:28:57.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fd4877fe640 1 -- 172.21.15.103:0/2332147154 learned_addr learned my addr 172.21.15.103:0/2332147154 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fe3337fe640 1 -- 172.21.15.103:0/2688635981 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe32000c340 con 0x7fe320004800 2024-09-10T08:28:57.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7f4d4bfff640 1 -- 172.21.15.103:0/210961004 learned_addr learned my addr 172.21.15.103:0/210961004 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7f4d51957640 1 -- 172.21.15.103:0/210961004 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d4c153a50 con 0x7f4d4c150700 2024-09-10T08:28:57.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fcc5567b640 1 -- 172.21.15.103:0/4239386859 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc480d46f0 con 0x7fcc48045c10 2024-09-10T08:28:57.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fe333fff640 1 --2- 172.21.15.103:0/2688635981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe320004800 0x7fe320004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fe33972e640 1 --2- 172.21.15.103:0/2688635981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe320005210 0x7fe32000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7f4d51957640 1 -- 172.21.15.103:0/210961004 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f4d4c150b90 con 0x7f4d4c0a8180 2024-09-10T08:28:57.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7f4d51957640 1 -- 172.21.15.103:0/210961004 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4d4c06cd90 con 0x7f4d4c06d560 2024-09-10T08:28:57.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7fcc5567b640 1 -- 172.21.15.103:0/4239386859 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc4816bc90 con 0x7fcc48045c10 2024-09-10T08:28:57.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7fd4877fe640 1 -- 172.21.15.103:0/2332147154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4880c2890 msgr2=0x7fd4881fc0a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:28:57.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7fd4877fe640 1 --2- 172.21.15.103:0/2332147154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4880c2890 0x7fd4881fc0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7fd4877fe640 1 -- 172.21.15.103:0/2332147154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4880c3e20 msgr2=0x7fd4881fc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7fd4877fe640 1 --2- 172.21.15.103:0/2332147154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4880c3e20 0x7fd4881fc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7fd4877fe640 1 -- 172.21.15.103:0/2332147154 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48815be90 con 0x7fd488157e60 2024-09-10T08:28:57.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7f4d50955640 1 --2- 172.21.15.103:0/210961004 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d4c06d560 0x7f4d4c06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7f4d4bfff640 1 -- 172.21.15.103:0/210961004 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d4c06d560 msgr2=0x7f4d4c06dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7f4d4bfff640 1 --2- 172.21.15.103:0/210961004 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d4c06d560 0x7f4d4c06dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7f4d4bfff640 1 -- 172.21.15.103:0/210961004 >> v1:172.21.15.103:6789/0 conn(0x7f4d4c150700 legacy=0x7f4d4c0c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7f4d4bfff640 1 -- 172.21.15.103:0/210961004 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4c06d070 con 0x7f4d4c0a8180 2024-09-10T08:28:57.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7fdc5b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc5c15a5c0 0x7fdc5c0ace10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:56536/0 (socket says 172.21.15.103:56536) 2024-09-10T08:28:57.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7fdc5b7fe640 1 -- 172.21.15.103:0/2532272938 learned_addr learned my addr 172.21.15.103:0/2532272938 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7fdc60d61640 1 --2- 172.21.15.103:0/2532272938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc5c12d2c0 0x7fdc5c1fc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7fdc5b7fe640 1 -- 172.21.15.103:0/2532272938 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc5c154690 msgr2=0x7fdc5c157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7fdc5b7fe640 1 --2- 172.21.15.103:0/2532272938 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc5c154690 0x7fdc5c157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7fdc5b7fe640 1 -- 172.21.15.103:0/2532272938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc5c12d2c0 msgr2=0x7fdc5c1fc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7fdc5b7fe640 1 --2- 172.21.15.103:0/2532272938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc5c12d2c0 0x7fdc5c1fc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7fdc5b7fe640 1 -- 172.21.15.103:0/2532272938 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5c1f8c30 con 0x7fdc5c15a5c0 2024-09-10T08:28:57.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7f97dc48b640 1 Processor -- start 2024-09-10T08:28:57.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7f97dc48b640 1 -- start start 2024-09-10T08:28:57.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.755+0000 7f134effd640 1 --2- 172.21.15.103:0/1528888549 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13500c69b0 0x7f13500a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7f134ffff640 1 --2- 172.21.15.103:0/1528888549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13501521c0 0x7f13501f3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7f134ffff640 1 -- 172.21.15.103:0/1528888549 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f13500c5ee0 con 0x7f13500c6d90 2024-09-10T08:28:57.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7f134ffff640 1 -- 172.21.15.103:0/1528888549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f135015ac50 con 0x7f13501521c0 2024-09-10T08:28:57.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7f134ffff640 1 -- 172.21.15.103:0/1528888549 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f13500c6060 con 0x7f13500c69b0 2024-09-10T08:28:57.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7fe333fff640 1 -- 172.21.15.103:0/2688635981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe320005210 msgr2=0x7fe32000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7f48e359e640 1 -- 172.21.15.103:0/823879445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48c8005290 con 0x7f48dc0f50a0 2024-09-10T08:28:57.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7fe333fff640 1 --2- 172.21.15.103:0/2688635981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe320005210 0x7fe32000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7fe333fff640 1 -- 172.21.15.103:0/2688635981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe320003a00 msgr2=0x7fe320003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:57.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7fe333fff640 1 --2- 172.21.15.103:0/2688635981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe320003a00 0x7fe320003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7fe333fff640 1 -- 172.21.15.103:0/2688635981 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe320003520 con 0x7fe320004800 2024-09-10T08:28:57.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7fe33972e640 1 -- 172.21.15.103:0/2688635981 reap_dead start 2024-09-10T08:28:57.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.756+0000 7fcc3a7fc640 1 -- 172.21.15.103:0/4239386859 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc480d83d0 con 0x7fcc48045c10 2024-09-10T08:28:57.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7fdc60d61640 1 --2- 172.21.15.103:0/2532272938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc5c12d2c0 0x7fdc5c1fc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:57.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7f134f7fe640 1 --2- 172.21.15.103:0/1528888549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13501521c0 0x7f13501f3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7fdc5b7fe640 1 --2- 172.21.15.103:0/2532272938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc5c15a5c0 0x7fdc5c0ace10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c000c00 tx=0x7fdc4c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7f4d4bfff640 1 --2- 172.21.15.103:0/210961004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d4c0a8180 0x7f4d4c1501c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c00dc90 tx=0x7f4d3c02e4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28717ffac54cdab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7fd4877fe640 1 --2- 172.21.15.103:0/2332147154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd488157e60 0x7fd488159420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd48000cc90 tx=0x7fd48000a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7fe333fff640 1 --2- 172.21.15.103:0/2688635981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe320004800 0x7fe320004c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe324007f40 tx=0x7fe320005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12b47979c254e01b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7fd46f7fe640 1 -- 172.21.15.103:0/2332147154 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd480017070 con 0x7fd488157e60 2024-09-10T08:28:57.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7f97dc48b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97d40acc30 0x7f97d41df500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7fd46f7fe640 1 -- 172.21.15.103:0/2332147154 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd480012400 con 0x7fd488157e60 2024-09-10T08:28:57.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7fd46f7fe640 1 -- 172.21.15.103:0/2332147154 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4800127b0 con 0x7fd488157e60 2024-09-10T08:28:57.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7f97dc48b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97d40c44b0 0x7f97d41f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7fd487fff640 1 -- 172.21.15.103:0/2332147154 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd48815c170 con 0x7fd488157e60 2024-09-10T08:28:57.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7f97dc48b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97d40c7fb0 0x7f97d41f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7f134e7fc640 1 -- 172.21.15.103:0/1528888549 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13500c69b0 msgr2=0x7f13500a9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7f134e7fc640 1 --2- 172.21.15.103:0/1528888549 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13500c69b0 0x7f13500a9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7f134e7fc640 1 -- 172.21.15.103:0/1528888549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13501521c0 msgr2=0x7f13501f3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7f134e7fc640 1 --2- 172.21.15.103:0/1528888549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13501521c0 0x7f13501f3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7f134e7fc640 1 -- 172.21.15.103:0/1528888549 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13501f10f0 con 0x7f13500c6d90 2024-09-10T08:28:57.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7f97dc48b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f97d40c5330 con 0x7f97d40acc30 2024-09-10T08:28:57.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7f97dc48b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f97d40702b0 con 0x7f97d40c7fb0 2024-09-10T08:28:57.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7f97dc48b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f97d40c63f0 con 0x7f97d40c44b0 2024-09-10T08:28:57.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7fd487fff640 1 -- 172.21.15.103:0/2332147154 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd488158f00 con 0x7fd488157e60 2024-09-10T08:28:57.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7fdc58ff9640 1 -- 172.21.15.103:0/2532272938 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c037050 con 0x7fdc5c15a5c0 2024-09-10T08:28:57.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.758+0000 7fdc58ff9640 1 -- 172.21.15.103:0/2532272938 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4c038040 con 0x7fdc5c15a5c0 2024-09-10T08:28:57.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7fe3337fe640 1 -- 172.21.15.103:0/2688635981 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324007b90 con 0x7fe320004800 2024-09-10T08:28:57.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7fe3337fe640 1 -- 172.21.15.103:0/2688635981 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe324031600 con 0x7fe320004800 2024-09-10T08:28:57.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.758+0000 7fe3337fe640 1 -- 172.21.15.103:0/2688635981 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324031a70 con 0x7fe320004800 2024-09-10T08:28:57.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.758+0000 7fe33b191640 1 -- 172.21.15.103:0/2688635981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe320004800 msgr2=0x7fe320004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.758+0000 7fe33b191640 1 --2- 172.21.15.103:0/2688635981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe320004800 0x7fe320004c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe324007f40 tx=0x7fe320005830 comp rx=0 tx=0).stop 2024-09-10T08:28:57.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.758+0000 7fcc4cff9640 1 -- 172.21.15.103:0/4239386859 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc44043020 con 0x7fcc48045c10 2024-09-10T08:28:57.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.757+0000 7f4d4b7fe640 1 -- 172.21.15.103:0/210961004 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c03a070 con 0x7f4d4c0a8180 2024-09-10T08:28:57.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.758+0000 7f4d4b7fe640 1 -- 172.21.15.103:0/210961004 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d3c00b650 con 0x7f4d4c0a8180 2024-09-10T08:28:57.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.758+0000 7f4d4b7fe640 1 -- 172.21.15.103:0/210961004 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c00ba20 con 0x7f4d4c0a8180 2024-09-10T08:28:57.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7f4d51957640 1 -- 172.21.15.103:0/210961004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d4c0a8180 msgr2=0x7f4d4c1501c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7f4d51957640 1 --2- 172.21.15.103:0/210961004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d4c0a8180 0x7f4d4c1501c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c00dc90 tx=0x7f4d3c02e4c0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.758+0000 7f134e7fc640 1 --2- 172.21.15.103:0/1528888549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13500c6d90 0x7f13501f3820 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f13400097a0 tx=0x7f13400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.758+0000 7f13477fe640 1 -- 172.21.15.103:0/1528888549 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1340042020 con 0x7f13500c6d90 2024-09-10T08:28:57.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.758+0000 7f134ffff640 1 -- 172.21.15.103:0/1528888549 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1350152dd0 con 0x7f13500c6d90 2024-09-10T08:28:57.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.758+0000 7f134ffff640 1 -- 172.21.15.103:0/1528888549 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f135015eac0 con 0x7f13500c6d90 2024-09-10T08:28:57.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7f4d51957640 1 -- 172.21.15.103:0/210961004 shutdown_connections 2024-09-10T08:28:57.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7f97da227640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97d40acc30 0x7f97d41df500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7f4d51957640 1 --2- 172.21.15.103:0/210961004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d4c0a8180 0x7f4d4c1501c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7f97da227640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97d40acc30 0x7f97d41df500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49688/0 (socket says 172.21.15.103:49688) 2024-09-10T08:28:57.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7f97da227640 1 -- 172.21.15.103:0/3550601806 learned_addr learned my addr 172.21.15.103:0/3550601806 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7f4d51957640 1 --2- 172.21.15.103:0/210961004 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d4c06d560 0x7f4d4c06dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.758+0000 7f48d2ffd640 1 -- 172.21.15.103:0/823879445 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48e4074380 con 0x7f48dc0f50a0 2024-09-10T08:28:57.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.758+0000 7f48d2ffd640 1 --2- 172.21.15.103:0/823879445 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f48c406bf00 0x7f48c406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.758+0000 7f48d2ffd640 1 -- 172.21.15.103:0/823879445 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f48e40f6070 con 0x7f48dc0f50a0 2024-09-10T08:28:57.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7f4d51957640 1 -- 172.21.15.103:0/210961004 >> 172.21.15.103:0/210961004 conn(0x7f4d4c0aa700 msgr2=0x7f4d4c0aab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7f4d51957640 1 -- 172.21.15.103:0/210961004 shutdown_connections 2024-09-10T08:28:57.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7f48e259c640 1 --2- 172.21.15.103:0/823879445 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f48c406bf00 0x7f48c406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7f97da227640 1 -- 172.21.15.103:0/3550601806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97d40c44b0 msgr2=0x7f97d41f59f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:28:57.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7f97da227640 1 --2- 172.21.15.103:0/3550601806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97d40c44b0 0x7f97d41f59f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7f97da227640 1 -- 172.21.15.103:0/3550601806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97d40c7fb0 msgr2=0x7f97d41f5f30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:28:57.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7f97da227640 1 --2- 172.21.15.103:0/3550601806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97d40c7fb0 0x7f97d41f5f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7f97da227640 1 -- 172.21.15.103:0/3550601806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d406fce0 con 0x7f97d40acc30 2024-09-10T08:28:57.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7f13477fe640 1 -- 172.21.15.103:0/1528888549 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1340038040 con 0x7f13500c6d90 2024-09-10T08:28:57.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7fdc58ff9640 1 -- 172.21.15.103:0/2532272938 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0044c0 con 0x7fdc5c15a5c0 2024-09-10T08:28:57.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7fdc627c4640 1 -- 172.21.15.103:0/2532272938 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5c1f8f10 con 0x7fdc5c15a5c0 2024-09-10T08:28:57.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7fdc627c4640 1 -- 172.21.15.103:0/2532272938 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc5c1f94d0 con 0x7fdc5c15a5c0 2024-09-10T08:28:57.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7f13477fe640 1 -- 172.21.15.103:0/1528888549 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1340037050 con 0x7f13500c6d90 2024-09-10T08:28:57.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7f4d51957640 1 -- 172.21.15.103:0/210961004 wait complete. 2024-09-10T08:28:57.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.760+0000 7f97da227640 1 --2- 172.21.15.103:0/3550601806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97d40acc30 0x7f97d41df500 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f97d0000c00 tx=0x7f97d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.760+0000 7f97caffd640 1 -- 172.21.15.103:0/3550601806 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d0039070 con 0x7f97d40acc30 2024-09-10T08:28:57.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.760+0000 7f48e259c640 1 --2- 172.21.15.103:0/823879445 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f48c406bf00 0x7f48c406e3c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f48d40071a0 tx=0x7f48d402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.760+0000 7fdc427fc640 1 -- 172.21.15.103:0/2532272938 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc34005290 con 0x7fdc5c15a5c0 2024-09-10T08:28:57.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7fcc4cff9640 1 --2- 172.21.15.103:0/4239386859 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcc3406bf30 0x7fcc3406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7fcc4cff9640 1 -- 172.21.15.103:0/4239386859 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fcc440aad10 con 0x7fcc48045c10 2024-09-10T08:28:57.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.760+0000 7fcc4f7fe640 1 --2- 172.21.15.103:0/4239386859 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcc3406bf30 0x7fcc3406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.760+0000 7f134ffff640 1 -- 172.21.15.103:0/1528888549 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13500c22d0 con 0x7f13500c6d90 2024-09-10T08:28:57.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.760+0000 7f97caffd640 1 -- 172.21.15.103:0/3550601806 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d00328f0 con 0x7f97d40acc30 2024-09-10T08:28:57.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.760+0000 7f97caffd640 1 -- 172.21.15.103:0/3550601806 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d0032cc0 con 0x7f97d40acc30 2024-09-10T08:28:57.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.760+0000 7f97dc48b640 1 -- 172.21.15.103:0/3550601806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d41de7e0 con 0x7f97d40acc30 2024-09-10T08:28:57.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.760+0000 7f97dc48b640 1 -- 172.21.15.103:0/3550601806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d41dcf40 con 0x7f97d40acc30 2024-09-10T08:28:57.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.761+0000 7fcc4f7fe640 1 --2- 172.21.15.103:0/4239386859 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcc3406bf30 0x7fcc3406e3f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c001eb0 tx=0x7fcc3c001170 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.761+0000 7f4d51957640 1 Processor -- start 2024-09-10T08:28:57.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.761+0000 7f4d51957640 1 -- start start 2024-09-10T08:28:57.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.761+0000 7f13477fe640 1 -- 172.21.15.103:0/1528888549 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1340003610 con 0x7f13500c6d90 2024-09-10T08:28:57.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.759+0000 7fd46d7fa640 1 -- 172.21.15.103:0/2332147154 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd488159100 con 0x7fd488157e60 2024-09-10T08:28:57.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.760+0000 7fd46f7fe640 1 -- 172.21.15.103:0/2332147154 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd48001a070 con 0x7fd488157e60 2024-09-10T08:28:57.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.761+0000 7fd46f7fe640 1 --2- 172.21.15.103:0/2332147154 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd47406bf00 0x7fd47406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.761+0000 7fe33b191640 1 -- 172.21.15.103:0/2688635981 shutdown_connections 2024-09-10T08:28:57.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.761+0000 7fe33b191640 1 --2- 172.21.15.103:0/2688635981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe320004800 0x7fe320004c80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.761+0000 7fe33b191640 1 -- 172.21.15.103:0/2688635981 >> 172.21.15.103:0/2688635981 conn(0x7fe3340c7a40 msgr2=0x7fe3340c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.761+0000 7fd46f7fe640 1 -- 172.21.15.103:0/2332147154 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fd48008b440 con 0x7fd488157e60 2024-09-10T08:28:57.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.761+0000 7fd486ffd640 1 --2- 172.21.15.103:0/2332147154 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd47406bf00 0x7fd47406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.761+0000 7fe33b191640 1 -- 172.21.15.103:0/2688635981 shutdown_connections 2024-09-10T08:28:57.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.761+0000 7fe33b191640 1 -- 172.21.15.103:0/2688635981 wait complete. 2024-09-10T08:28:57.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.762+0000 7f13477fe640 1 --2- 172.21.15.103:0/1528888549 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f133006bf00 0x7f133006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.762+0000 7f97c8ff9640 1 -- 172.21.15.103:0/3550601806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97b0005290 con 0x7f97d40acc30 2024-09-10T08:28:57.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.762+0000 7fd486ffd640 1 --2- 172.21.15.103:0/2332147154 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd47406bf00 0x7fd47406e3c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd47c034000 tx=0x7fd47c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.762+0000 7f13477fe640 1 -- 172.21.15.103:0/1528888549 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f13400ab4a0 con 0x7f13500c6d90 2024-09-10T08:28:57.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.762+0000 7f134effd640 1 --2- 172.21.15.103:0/1528888549 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f133006bf00 0x7f133006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.762+0000 7f4d51957640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d4c06d560 0x7f4d4c148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.762+0000 7f4d51957640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d4c0a8180 0x7f4d4c0a8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.762+0000 7f4d51957640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d4c150700 0x7f4d4c0a8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.762+0000 7f4d51957640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c153d30 con 0x7f4d4c06d560 2024-09-10T08:28:57.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.762+0000 7f4d51957640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c0c5040 con 0x7f4d4c150700 2024-09-10T08:28:57.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.762+0000 7f4d51957640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4d4c0c4480 con 0x7f4d4c0a8180 2024-09-10T08:28:57.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.762+0000 7f4d50955640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d4c06d560 0x7f4d4c148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.762+0000 7f4d50955640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d4c06d560 0x7f4d4c148370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49698/0 (socket says 172.21.15.103:49698) 2024-09-10T08:28:57.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.762+0000 7f4d50955640 1 -- 172.21.15.103:0/3955567117 learned_addr learned my addr 172.21.15.103:0/3955567117 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.762+0000 7f4d4bfff640 1 --2- 172.21.15.103:0/3955567117 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d4c0a8180 0x7f4d4c0a8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.763+0000 7f134effd640 1 --2- 172.21.15.103:0/1528888549 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f133006bf00 0x7f133006e3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1338005880 tx=0x7f1338009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.763+0000 7f4d51156640 1 --2- 172.21.15.103:0/3955567117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d4c150700 0x7f4d4c0a8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.763+0000 7f4d50955640 1 -- 172.21.15.103:0/3955567117 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d4c0a8180 msgr2=0x7f4d4c0a8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.763+0000 7f4d50955640 1 --2- 172.21.15.103:0/3955567117 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d4c0a8180 0x7f4d4c0a8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.763+0000 7f4d50955640 1 -- 172.21.15.103:0/3955567117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d4c150700 msgr2=0x7f4d4c0a8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.763+0000 7f4d50955640 1 --2- 172.21.15.103:0/3955567117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d4c150700 0x7f4d4c0a8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.763+0000 7fe33b191640 1 Processor -- start 2024-09-10T08:28:57.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.763+0000 7f4d50955640 1 -- 172.21.15.103:0/3955567117 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4c072890 con 0x7f4d4c06d560 2024-09-10T08:28:57.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.763+0000 7fe33b191640 1 -- start start 2024-09-10T08:28:57.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.763+0000 7f97caffd640 1 -- 172.21.15.103:0/3550601806 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f97d003f440 con 0x7f97d40acc30 2024-09-10T08:28:57.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.763+0000 7f4d50955640 1 --2- 172.21.15.103:0/3955567117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d4c06d560 0x7f4d4c148370 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000c7f0 tx=0x7f4d4000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.764+0000 7f48d2ffd640 1 -- 172.21.15.103:0/823879445 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f48e408b030 con 0x7f48dc0f50a0 2024-09-10T08:28:57.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.764+0000 7fcc4cff9640 1 -- 172.21.15.103:0/4239386859 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcc4404a030 con 0x7fcc48045c10 2024-09-10T08:28:57.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.764+0000 7f97caffd640 1 --2- 172.21.15.103:0/3550601806 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f97b806be80 0x7f97b806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.764+0000 7fe33b191640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe320004800 0x7fe334154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.764+0000 7fe33b191640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe33415e360 0x7fe33415ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.764+0000 7fe33b191640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3340acda0 0x7fe3341f3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.764+0000 7fe33b191640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe3340a7520 con 0x7fe3340acda0 2024-09-10T08:28:57.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.764+0000 7f97d9a26640 1 --2- 172.21.15.103:0/3550601806 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f97b806be80 0x7f97b806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.764+0000 7fe33b191640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe3340a73a0 con 0x7fe320004800 2024-09-10T08:28:57.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.764+0000 7fe33b191640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe3340c2440 con 0x7fe33415e360 2024-09-10T08:28:57.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.764+0000 7fe338f2d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe320004800 0x7fe334154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.764+0000 7fe338f2d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe320004800 0x7fe334154220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:56588/0 (socket says 172.21.15.103:56588) 2024-09-10T08:28:57.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.764+0000 7fe333fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe33415e360 0x7fe33415ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.764+0000 7fe338f2d640 1 -- 172.21.15.103:0/381078687 learned_addr learned my addr 172.21.15.103:0/381078687 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:57.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.764+0000 7fe33972e640 1 --2- 172.21.15.103:0/381078687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3340acda0 0x7fe3341f3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.764+0000 7fe338f2d640 1 -- 172.21.15.103:0/381078687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe33415e360 msgr2=0x7fe33415ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.764+0000 7fe338f2d640 1 --2- 172.21.15.103:0/381078687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe33415e360 0x7fe33415ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.764+0000 7fe338f2d640 1 -- 172.21.15.103:0/381078687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3340acda0 msgr2=0x7fe3341f3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.764+0000 7fe338f2d640 1 --2- 172.21.15.103:0/381078687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3340acda0 0x7fe3341f3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.764+0000 7fe338f2d640 1 -- 172.21.15.103:0/381078687 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe334153480 con 0x7fe320004800 2024-09-10T08:28:57.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.764+0000 7fe33972e640 1 --2- 172.21.15.103:0/381078687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3340acda0 0x7fe3341f3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:57.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.765+0000 7f97d9a26640 1 --2- 172.21.15.103:0/3550601806 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f97b806be80 0x7f97b806e340 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f97d4071db0 tx=0x7f97c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.765+0000 7fe338f2d640 1 --2- 172.21.15.103:0/381078687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe320004800 0x7fe334154220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00c480 tx=0x7fe31c00c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.765+0000 7fdc58ff9640 1 -- 172.21.15.103:0/2532272938 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc4c045020 con 0x7fdc5c15a5c0 2024-09-10T08:28:57.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.765+0000 7fdc58ff9640 1 --2- 172.21.15.103:0/2532272938 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc4806be80 0x7fdc4806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.766+0000 7fdc5bfff640 1 --2- 172.21.15.103:0/2532272938 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc4806be80 0x7fdc4806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.766+0000 7fdc5bfff640 1 --2- 172.21.15.103:0/2532272938 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc4806be80 0x7fdc4806e340 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdc50000f60 tx=0x7fdc500078f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.768+0000 7fe3317fa640 1 -- 172.21.15.103:0/381078687 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c016020 con 0x7fe320004800 2024-09-10T08:28:57.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.768+0000 7fe33b191640 1 -- 172.21.15.103:0/381078687 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe33415e860 con 0x7fe320004800 2024-09-10T08:28:57.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.768+0000 7fe33b191640 1 -- 172.21.15.103:0/381078687 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe334153a20 con 0x7fe320004800 2024-09-10T08:28:57.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.768+0000 7fdc58ff9640 1 -- 172.21.15.103:0/2532272938 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fdc4c077da0 con 0x7fdc5c15a5c0 2024-09-10T08:28:57.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.768+0000 7fd46f7fe640 1 -- 172.21.15.103:0/2332147154 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd488159100 con 0x7fd488157e60 2024-09-10T08:28:57.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.769+0000 7fe33b191640 1 -- 172.21.15.103:0/381078687 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3340c27d0 con 0x7fe320004800 2024-09-10T08:28:57.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.771+0000 7f97caffd640 1 -- 172.21.15.103:0/3550601806 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f97d00345d0 con 0x7f97d40acc30 2024-09-10T08:28:57.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.771+0000 7f13477fe640 1 -- 172.21.15.103:0/1528888549 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f134004c020 con 0x7f13500c6d90 2024-09-10T08:28:57.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.771+0000 7f4d497fa640 1 -- 172.21.15.103:0/3955567117 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40015070 con 0x7f4d4c06d560 2024-09-10T08:28:57.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.771+0000 7f4d51957640 1 -- 172.21.15.103:0/3955567117 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d4c0aa2b0 con 0x7f4d4c06d560 2024-09-10T08:28:57.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.771+0000 7f4d51957640 1 -- 172.21.15.103:0/3955567117 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d4c072090 con 0x7f4d4c06d560 2024-09-10T08:28:57.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.773+0000 7f4d51957640 1 -- 172.21.15.103:0/3955567117 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d4c0c7840 con 0x7f4d4c06d560 2024-09-10T08:28:57.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.773+0000 7fe3317fa640 1 -- 172.21.15.103:0/381078687 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31c005030 con 0x7fe320004800 2024-09-10T08:28:57.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.773+0000 7fe3317fa640 1 -- 172.21.15.103:0/381078687 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c005420 con 0x7fe320004800 2024-09-10T08:28:57.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.773+0000 7fdc58ff9640 1 -- 172.21.15.103:0/2532272938 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc4c07a400 con 0x7fdc5c15a5c0 2024-09-10T08:28:57.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.775+0000 7fe3317fa640 1 -- 172.21.15.103:0/381078687 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe31c019020 con 0x7fe320004800 2024-09-10T08:28:57.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.776+0000 7fe3317fa640 1 --2- 172.21.15.103:0/381078687 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe31406be30 0x7fe31406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.776+0000 7fe3317fa640 1 -- 172.21.15.103:0/381078687 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fe31c08b200 con 0x7fe320004800 2024-09-10T08:28:57.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.776+0000 7fe333fff640 1 --2- 172.21.15.103:0/381078687 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe31406be30 0x7fe31406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.777+0000 7fe333fff640 1 --2- 172.21.15.103:0/381078687 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe31406be30 0x7fe31406e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe324034000 tx=0x7fe32402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.778+0000 7fe3317fa640 1 -- 172.21.15.103:0/381078687 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe31c020030 con 0x7fe320004800 2024-09-10T08:28:57.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.780+0000 7f97caffd640 1 -- 172.21.15.103:0/3550601806 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f97d007ad90 con 0x7f97d40acc30 2024-09-10T08:28:57.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.791+0000 7f4d497fa640 1 -- 172.21.15.103:0/3955567117 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d40004430 con 0x7f4d4c06d560 2024-09-10T08:28:57.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.791+0000 7f4d497fa640 1 -- 172.21.15.103:0/3955567117 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4001e060 con 0x7f4d4c06d560 2024-09-10T08:28:57.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.792+0000 7f4d497fa640 1 -- 172.21.15.103:0/3955567117 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d40007820 con 0x7f4d4c06d560 2024-09-10T08:28:57.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.793+0000 7f4d497fa640 1 --2- 172.21.15.103:0/3955567117 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4d3806c030 0x7f4d3806e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:57.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.793+0000 7f4d4bfff640 1 --2- 172.21.15.103:0/3955567117 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4d3806c030 0x7f4d3806e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:57.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.794+0000 7f4d4bfff640 1 --2- 172.21.15.103:0/3955567117 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4d3806c030 0x7f4d3806e4f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c037000 tx=0x7f4d3c00d000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:57.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.794+0000 7f4d497fa640 1 -- 172.21.15.103:0/3955567117 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f4d40007620 con 0x7f4d4c06d560 2024-09-10T08:28:57.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:57.795+0000 7f4d497fa640 1 -- 172.21.15.103:0/3955567117 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d4c0c7840 con 0x7f4d4c06d560 2024-09-10T08:28:58.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.130+0000 7f48e359e640 1 -- 172.21.15.103:0/823879445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f48c8005580 con 0x7f48dc0f50a0 2024-09-10T08:28:58.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.130+0000 7f48d2ffd640 1 -- 172.21.15.103:0/823879445 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f48e40c4760 con 0x7f48dc0f50a0 2024-09-10T08:28:58.131 INFO:teuthology.orchestra.run.smithi103.stdout:55834574856 2024-09-10T08:28:58.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.134+0000 7f48d0ff9640 1 -- 172.21.15.103:0/823879445 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f48c406bf00 msgr2=0x7f48c406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.134+0000 7f48d0ff9640 1 --2- 172.21.15.103:0/823879445 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f48c406bf00 0x7f48c406e3c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f48d40071a0 tx=0x7f48d402e000 comp rx=0 tx=0).stop 2024-09-10T08:28:58.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.134+0000 7f48d0ff9640 1 -- 172.21.15.103:0/823879445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48dc0f50a0 msgr2=0x7f48dc1a23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.134+0000 7f48d0ff9640 1 --2- 172.21.15.103:0/823879445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48dc0f50a0 0x7f48dc1a23e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f48e4000b60 tx=0x7f48e40699a0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.134+0000 7f48d0ff9640 1 -- 172.21.15.103:0/823879445 shutdown_connections 2024-09-10T08:28:58.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.134+0000 7f48d0ff9640 1 --2- 172.21.15.103:0/823879445 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f48c406bf00 0x7f48c406e3c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.134+0000 7f48d0ff9640 1 --2- 172.21.15.103:0/823879445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48dc0f50a0 0x7f48dc1a23e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.135+0000 7f48d0ff9640 1 --2- 172.21.15.103:0/823879445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48dc00b090 0x7f48dc1a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.135+0000 7f48d0ff9640 1 --2- 172.21.15.103:0/823879445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48dc00ac90 0x7f48dc19ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.135+0000 7f48d0ff9640 1 -- 172.21.15.103:0/823879445 >> 172.21.15.103:0/823879445 conn(0x7f48dc047d10 msgr2=0x7f48dc04a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:58.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.135+0000 7f48d0ff9640 1 -- 172.21.15.103:0/823879445 shutdown_connections 2024-09-10T08:28:58.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.135+0000 7f48d0ff9640 1 -- 172.21.15.103:0/823879445 wait complete. 2024-09-10T08:28:58.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2024-09-10T08:28:58.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.154+0000 7fd46d7fa640 1 -- 172.21.15.103:0/2332147154 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd48806d300 con 0x7fd488157e60 2024-09-10T08:28:58.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.155+0000 7fd46f7fe640 1 -- 172.21.15.103:0/2332147154 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd4800594e0 con 0x7fd488157e60 2024-09-10T08:28:58.155 INFO:teuthology.orchestra.run.smithi103.stdout:64424509449 2024-09-10T08:28:58.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.157+0000 7fd46d7fa640 1 -- 172.21.15.103:0/2332147154 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd47406bf00 msgr2=0x7fd47406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.157+0000 7fd46d7fa640 1 --2- 172.21.15.103:0/2332147154 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd47406bf00 0x7fd47406e3c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd47c034000 tx=0x7fd47c02e000 comp rx=0 tx=0).stop 2024-09-10T08:28:58.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.157+0000 7fd46d7fa640 1 -- 172.21.15.103:0/2332147154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd488157e60 msgr2=0x7fd488159420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.157+0000 7fd46d7fa640 1 --2- 172.21.15.103:0/2332147154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd488157e60 0x7fd488159420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd48000cc90 tx=0x7fd48000a430 comp rx=0 tx=0).stop 2024-09-10T08:28:58.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.157+0000 7fd46d7fa640 1 -- 172.21.15.103:0/2332147154 shutdown_connections 2024-09-10T08:28:58.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.157+0000 7fd46d7fa640 1 --2- 172.21.15.103:0/2332147154 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd47406bf00 0x7fd47406e3c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.157+0000 7fd46d7fa640 1 --2- 172.21.15.103:0/2332147154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd488157e60 0x7fd488159420 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.157+0000 7fd46d7fa640 1 --2- 172.21.15.103:0/2332147154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4880c3e20 0x7fd4881fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.157+0000 7fd46d7fa640 1 --2- 172.21.15.103:0/2332147154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4880c2890 0x7fd4881fc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.157+0000 7fd46d7fa640 1 -- 172.21.15.103:0/2332147154 >> 172.21.15.103:0/2332147154 conn(0x7fd4880a9780 msgr2=0x7fd488155990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:58.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.157+0000 7fd46d7fa640 1 -- 172.21.15.103:0/2332147154 shutdown_connections 2024-09-10T08:28:58.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.157+0000 7fd46d7fa640 1 -- 172.21.15.103:0/2332147154 wait complete. 2024-09-10T08:28:58.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.162+0000 7fcc3a7fc640 1 -- 172.21.15.103:0/4239386859 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fcc48008700 con 0x7fcc48045c10 2024-09-10T08:28:58.164 INFO:teuthology.orchestra.run.smithi103.stdout:64424509449 2024-09-10T08:28:58.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.163+0000 7fcc4cff9640 1 -- 172.21.15.103:0/4239386859 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcc44078db0 con 0x7fcc48045c10 2024-09-10T08:28:58.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.166+0000 7fcc3a7fc640 1 -- 172.21.15.103:0/4239386859 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcc3406bf30 msgr2=0x7fcc3406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.166+0000 7fcc3a7fc640 1 --2- 172.21.15.103:0/4239386859 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcc3406bf30 0x7fcc3406e3f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c001eb0 tx=0x7fcc3c001170 comp rx=0 tx=0).stop 2024-09-10T08:28:58.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.166+0000 7fcc3a7fc640 1 -- 172.21.15.103:0/4239386859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc48045c10 msgr2=0x7fcc480462c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.166+0000 7fcc3a7fc640 1 --2- 172.21.15.103:0/4239386859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc48045c10 0x7fcc480462c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcc48048e10 tx=0x7fcc440046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.166+0000 7fcc3a7fc640 1 -- 172.21.15.103:0/4239386859 shutdown_connections 2024-09-10T08:28:58.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.167+0000 7fcc3a7fc640 1 --2- 172.21.15.103:0/4239386859 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcc3406bf30 0x7fcc3406e3f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.167+0000 7fcc3a7fc640 1 --2- 172.21.15.103:0/4239386859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc480d7f40 0x7fcc480d41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.167+0000 7fcc3a7fc640 1 --2- 172.21.15.103:0/4239386859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc480d5360 0x7fcc480d3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.167+0000 7fcc3a7fc640 1 --2- 172.21.15.103:0/4239386859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc48045c10 0x7fcc480462c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.167+0000 7fcc3a7fc640 1 -- 172.21.15.103:0/4239386859 >> 172.21.15.103:0/4239386859 conn(0x7fcc48047d10 msgr2=0x7fcc480d6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:58.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.167+0000 7fcc3a7fc640 1 -- 172.21.15.103:0/4239386859 shutdown_connections 2024-09-10T08:28:58.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.167+0000 7fcc3a7fc640 1 -- 172.21.15.103:0/4239386859 wait complete. 2024-09-10T08:28:58.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.0 2024-09-10T08:28:58.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.174+0000 7fdc427fc640 1 -- 172.21.15.103:0/2532272938 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fdc34005850 con 0x7fdc5c15a5c0 2024-09-10T08:28:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.174+0000 7f134ffff640 1 -- 172.21.15.103:0/1528888549 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f13500c3a50 con 0x7f13500c6d90 2024-09-10T08:28:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.174+0000 7f13477fe640 1 -- 172.21.15.103:0/1528888549 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1340079540 con 0x7f13500c6d90 2024-09-10T08:28:58.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.175+0000 7fdc58ff9640 1 -- 172.21.15.103:0/2532272938 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdc4c079d00 con 0x7fdc5c15a5c0 2024-09-10T08:28:58.175 INFO:teuthology.orchestra.run.smithi103.stdout:64424509448 2024-09-10T08:28:58.176 INFO:teuthology.orchestra.run.smithi103.stdout:64424509450 2024-09-10T08:28:58.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.176+0000 7fe33b191640 1 -- 172.21.15.103:0/381078687 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe3340764a0 con 0x7fe320004800 2024-09-10T08:28:58.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.177+0000 7fe3317fa640 1 -- 172.21.15.103:0/381078687 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe31c059870 con 0x7fe320004800 2024-09-10T08:28:58.177 INFO:teuthology.orchestra.run.smithi103.stdout:64424509449 2024-09-10T08:28:58.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.177+0000 7fdc427fc640 1 -- 172.21.15.103:0/2532272938 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc4806be80 msgr2=0x7fdc4806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.177+0000 7fdc427fc640 1 --2- 172.21.15.103:0/2532272938 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc4806be80 0x7fdc4806e340 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdc50000f60 tx=0x7fdc500078f0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.177+0000 7fdc427fc640 1 -- 172.21.15.103:0/2532272938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc5c15a5c0 msgr2=0x7fdc5c0ace10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.177+0000 7fdc427fc640 1 --2- 172.21.15.103:0/2532272938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc5c15a5c0 0x7fdc5c0ace10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c000c00 tx=0x7fdc4c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.177+0000 7fdc427fc640 1 -- 172.21.15.103:0/2532272938 shutdown_connections 2024-09-10T08:28:58.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.177+0000 7fdc427fc640 1 --2- 172.21.15.103:0/2532272938 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc4806be80 0x7fdc4806e340 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.177+0000 7fdc427fc640 1 --2- 172.21.15.103:0/2532272938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc5c12d2c0 0x7fdc5c1fc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.177+0000 7fdc427fc640 1 --2- 172.21.15.103:0/2532272938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc5c15a5c0 0x7fdc5c0ace10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.177+0000 7fdc427fc640 1 --2- 172.21.15.103:0/2532272938 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc5c154690 0x7fdc5c157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.177+0000 7fdc427fc640 1 -- 172.21.15.103:0/2532272938 >> 172.21.15.103:0/2532272938 conn(0x7fdc5c0c87f0 msgr2=0x7fdc5c159ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:58.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.178+0000 7fdc427fc640 1 -- 172.21.15.103:0/2532272938 shutdown_connections 2024-09-10T08:28:58.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.178+0000 7fdc427fc640 1 -- 172.21.15.103:0/2532272938 wait complete. 2024-09-10T08:28:58.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.178+0000 7f134ffff640 1 -- 172.21.15.103:0/1528888549 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f133006bf00 msgr2=0x7f133006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.178+0000 7f134ffff640 1 --2- 172.21.15.103:0/1528888549 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f133006bf00 0x7f133006e3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1338005880 tx=0x7f1338009040 comp rx=0 tx=0).stop 2024-09-10T08:28:58.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.178+0000 7f134ffff640 1 -- 172.21.15.103:0/1528888549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13500c6d90 msgr2=0x7f13501f3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.178+0000 7f134ffff640 1 --2- 172.21.15.103:0/1528888549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13500c6d90 0x7f13501f3820 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f13400097a0 tx=0x7f13400046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.178+0000 7f134ffff640 1 -- 172.21.15.103:0/1528888549 shutdown_connections 2024-09-10T08:28:58.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.178+0000 7f134ffff640 1 --2- 172.21.15.103:0/1528888549 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f133006bf00 0x7f133006e3c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.178+0000 7f134ffff640 1 --2- 172.21.15.103:0/1528888549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13501521c0 0x7f13501f3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.178+0000 7f134ffff640 1 --2- 172.21.15.103:0/1528888549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13500c6d90 0x7f13501f3820 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.178+0000 7f134ffff640 1 --2- 172.21.15.103:0/1528888549 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13500c69b0 0x7f13500a9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.178+0000 7f134ffff640 1 -- 172.21.15.103:0/1528888549 >> 172.21.15.103:0/1528888549 conn(0x7f13500c7f00 msgr2=0x7f13500c2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:58.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.178+0000 7f134ffff640 1 -- 172.21.15.103:0/1528888549 shutdown_connections 2024-09-10T08:28:58.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.178+0000 7f134ffff640 1 -- 172.21.15.103:0/1528888549 wait complete. 2024-09-10T08:28:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.181+0000 7fe33b191640 1 -- 172.21.15.103:0/381078687 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe31406be30 msgr2=0x7fe31406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.181+0000 7fe33b191640 1 --2- 172.21.15.103:0/381078687 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe31406be30 0x7fe31406e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe324034000 tx=0x7fe32402f000 comp rx=0 tx=0).stop 2024-09-10T08:28:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.181+0000 7fe33b191640 1 -- 172.21.15.103:0/381078687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe320004800 msgr2=0x7fe334154220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.181+0000 7fe33b191640 1 --2- 172.21.15.103:0/381078687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe320004800 0x7fe334154220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00c480 tx=0x7fe31c00c940 comp rx=0 tx=0).stop 2024-09-10T08:28:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.181+0000 7fe33b191640 1 -- 172.21.15.103:0/381078687 shutdown_connections 2024-09-10T08:28:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.181+0000 7fe33b191640 1 --2- 172.21.15.103:0/381078687 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe31406be30 0x7fe31406e2f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.181+0000 7fe33b191640 1 --2- 172.21.15.103:0/381078687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3340acda0 0x7fe3341f3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.181+0000 7fe33b191640 1 --2- 172.21.15.103:0/381078687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe33415e360 0x7fe33415ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.181+0000 7fe33b191640 1 --2- 172.21.15.103:0/381078687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe320004800 0x7fe334154220 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.181+0000 7fe33b191640 1 -- 172.21.15.103:0/381078687 >> 172.21.15.103:0/381078687 conn(0x7fe3340c7a40 msgr2=0x7fe3340c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:58.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.181+0000 7fe33b191640 1 -- 172.21.15.103:0/381078687 shutdown_connections 2024-09-10T08:28:58.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.7 2024-09-10T08:28:58.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.182+0000 7fe33b191640 1 -- 172.21.15.103:0/381078687 wait complete. 2024-09-10T08:28:58.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.185+0000 7f4d51957640 1 -- 172.21.15.103:0/3955567117 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4d4c0723a0 con 0x7f4d4c06d560 2024-09-10T08:28:58.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.185+0000 7f4d497fa640 1 -- 172.21.15.103:0/3955567117 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4d4c0c7840 con 0x7f4d4c06d560 2024-09-10T08:28:58.186 INFO:teuthology.orchestra.run.smithi103.stdout:55834574855 2024-09-10T08:28:58.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.187+0000 7f97c8ff9640 1 -- 172.21.15.103:0/3550601806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f97b0005850 con 0x7f97d40acc30 2024-09-10T08:28:58.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.187+0000 7f4d51957640 1 -- 172.21.15.103:0/3955567117 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4d3806c030 msgr2=0x7f4d3806e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.187+0000 7f4d51957640 1 --2- 172.21.15.103:0/3955567117 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4d3806c030 0x7f4d3806e4f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c037000 tx=0x7f4d3c00d000 comp rx=0 tx=0).stop 2024-09-10T08:28:58.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.187+0000 7f4d51957640 1 -- 172.21.15.103:0/3955567117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d4c06d560 msgr2=0x7f4d4c148370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.187+0000 7f4d51957640 1 --2- 172.21.15.103:0/3955567117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d4c06d560 0x7f4d4c148370 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000c7f0 tx=0x7f4d4000ccb0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.188+0000 7f4d51957640 1 -- 172.21.15.103:0/3955567117 shutdown_connections 2024-09-10T08:28:58.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.188+0000 7f4d51957640 1 --2- 172.21.15.103:0/3955567117 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4d3806c030 0x7f4d3806e4f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.188+0000 7f4d51957640 1 --2- 172.21.15.103:0/3955567117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d4c150700 0x7f4d4c0a8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.188+0000 7f4d51957640 1 --2- 172.21.15.103:0/3955567117 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d4c0a8180 0x7f4d4c0a8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.188+0000 7f4d51957640 1 --2- 172.21.15.103:0/3955567117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d4c06d560 0x7f4d4c148370 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.188+0000 7f4d51957640 1 -- 172.21.15.103:0/3955567117 >> 172.21.15.103:0/3955567117 conn(0x7f4d4c0aa700 msgr2=0x7f4d4c0aaae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:58.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.188+0000 7f4d51957640 1 -- 172.21.15.103:0/3955567117 shutdown_connections 2024-09-10T08:28:58.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.188+0000 7f4d51957640 1 -- 172.21.15.103:0/3955567117 wait complete. 2024-09-10T08:28:58.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.188+0000 7f97caffd640 1 -- 172.21.15.103:0/3550601806 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f97d007a690 con 0x7f97d40acc30 2024-09-10T08:28:58.190 INFO:teuthology.orchestra.run.smithi103.stdout:64424509450 2024-09-10T08:28:58.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.190+0000 7f97c8ff9640 1 -- 172.21.15.103:0/3550601806 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f97b806be80 msgr2=0x7f97b806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.190+0000 7f97c8ff9640 1 --2- 172.21.15.103:0/3550601806 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f97b806be80 0x7f97b806e340 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f97d4071db0 tx=0x7f97c4008040 comp rx=0 tx=0).stop 2024-09-10T08:28:58.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.190+0000 7f97c8ff9640 1 -- 172.21.15.103:0/3550601806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97d40acc30 msgr2=0x7f97d41df500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.190+0000 7f97c8ff9640 1 --2- 172.21.15.103:0/3550601806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97d40acc30 0x7f97d41df500 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f97d0000c00 tx=0x7f97d00046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.190+0000 7f97c8ff9640 1 -- 172.21.15.103:0/3550601806 shutdown_connections 2024-09-10T08:28:58.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.190+0000 7f97c8ff9640 1 --2- 172.21.15.103:0/3550601806 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f97b806be80 0x7f97b806e340 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.190+0000 7f97c8ff9640 1 --2- 172.21.15.103:0/3550601806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97d40c7fb0 0x7f97d41f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.190+0000 7f97c8ff9640 1 --2- 172.21.15.103:0/3550601806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97d40c44b0 0x7f97d41f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.190+0000 7f97c8ff9640 1 --2- 172.21.15.103:0/3550601806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97d40acc30 0x7f97d41df500 secure :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f97d0000c00 tx=0x7f97d00046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.190+0000 7f97c8ff9640 1 -- 172.21.15.103:0/3550601806 >> 172.21.15.103:0/3550601806 conn(0x7f97d40c5660 msgr2=0x7f97d4072ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:58.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.190+0000 7f97c8ff9640 1 -- 172.21.15.103:0/3550601806 shutdown_connections 2024-09-10T08:28:58.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:58.191+0000 7f97c8ff9640 1 -- 172.21.15.103:0/3550601806 wait complete. 2024-09-10T08:28:58.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.5 2024-09-10T08:28:58.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.4 2024-09-10T08:28:58.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.1 2024-09-10T08:28:58.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2024-09-10T08:28:58.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.3 2024-09-10T08:28:58.622 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:28:58.625 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:28:59.152 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T08:28:59.171 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T08:28:59.184 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T08:28:59.197 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T08:28:59.198 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T08:28:59.202 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T08:28:59.203 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T08:28:59.206 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T08:28:59.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.271+0000 7f8c03f2a640 1 Processor -- start 2024-09-10T08:28:59.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.272+0000 7f8c03f2a640 1 -- start start 2024-09-10T08:28:59.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.273+0000 7f8c03f2a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bfc0a6f60 0x7f8bfc0ad040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.273+0000 7f8c03f2a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8bfc0c2360 0x7f8bfc0c2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.273+0000 7f8c03f2a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bfc0c7660 con 0x7f8bfc06eb90 2024-09-10T08:28:59.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.273+0000 7f8c03f2a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8bfc0c5ee0 con 0x7f8bfc0c2360 2024-09-10T08:28:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.273+0000 7f8c03f2a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8bfc0c6190 con 0x7f8bfc0a6f60 2024-09-10T08:28:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.273+0000 7f8c024c7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8bfc0c2360 0x7f8bfc0c2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.273+0000 7f8c024c7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8bfc0c2360 0x7f8bfc0c2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:56598/0 (socket says 172.21.15.103:56598) 2024-09-10T08:28:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.273+0000 7f8c024c7640 1 -- 172.21.15.103:0/2650691091 learned_addr learned my addr 172.21.15.103:0/2650691091 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.273+0000 7f8c01cc6640 1 --2- 172.21.15.103:0/2650691091 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bfc0a6f60 0x7f8bfc0ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.274+0000 7f8c024c7640 1 -- 172.21.15.103:0/2650691091 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bfc0a6f60 msgr2=0x7f8bfc0ad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.274+0000 7f8c024c7640 1 --2- 172.21.15.103:0/2650691091 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bfc0a6f60 0x7f8bfc0ad040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.274+0000 7f8c024c7640 1 -- 172.21.15.103:0/2650691091 >> v1:172.21.15.103:6789/0 conn(0x7f8bfc06eb90 legacy=0x7f8bfc0c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.274+0000 7f8c024c7640 1 -- 172.21.15.103:0/2650691091 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bfc152cb0 con 0x7f8bfc0c2360 2024-09-10T08:28:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.275+0000 7f8c024c7640 1 --2- 172.21.15.103:0/2650691091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bfc0c2360 0x7f8bfc0c2e00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009e50 tx=0x7f8bf402a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6aac093e5e775d3b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.275+0000 7f8c00cc4640 1 -- 172.21.15.103:0/2650691091 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4036070 con 0x7f8bfc0c2360 2024-09-10T08:28:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.275+0000 7f8c00cc4640 1 -- 172.21.15.103:0/2650691091 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf4031600 con 0x7f8bfc0c2360 2024-09-10T08:28:59.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.275+0000 7f8c00cc4640 1 -- 172.21.15.103:0/2650691091 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40319d0 con 0x7f8bfc0c2360 2024-09-10T08:28:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.276+0000 7f8c03f2a640 1 -- 172.21.15.103:0/2650691091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bfc0c2360 msgr2=0x7f8bfc0c2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.276+0000 7f8c03f2a640 1 --2- 172.21.15.103:0/2650691091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bfc0c2360 0x7f8bfc0c2e00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009e50 tx=0x7f8bf402a6c0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.276+0000 7f8c03f2a640 1 -- 172.21.15.103:0/2650691091 shutdown_connections 2024-09-10T08:28:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.276+0000 7f8c03f2a640 1 --2- 172.21.15.103:0/2650691091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bfc0c2360 0x7f8bfc0c2e00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.276+0000 7f8c03f2a640 1 --2- 172.21.15.103:0/2650691091 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bfc0a6f60 0x7f8bfc0ad040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.276+0000 7f8c03f2a640 1 -- 172.21.15.103:0/2650691091 >> 172.21.15.103:0/2650691091 conn(0x7f8bfc0a9680 msgr2=0x7f8bfc0a9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.278+0000 7f8c03f2a640 1 -- 172.21.15.103:0/2650691091 shutdown_connections 2024-09-10T08:28:59.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.278+0000 7f8c03f2a640 1 -- 172.21.15.103:0/2650691091 wait complete. 2024-09-10T08:28:59.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.279+0000 7f8c03f2a640 1 Processor -- start 2024-09-10T08:28:59.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.279+0000 7f8c03f2a640 1 -- start start 2024-09-10T08:28:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.281+0000 7f8c03f2a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bfc06eb90 0x7f8bfc14db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.281+0000 7f8c03f2a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bfc0c2360 0x7f8bfc151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.281+0000 7f8c01cc6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bfc06eb90 0x7f8bfc14db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.281+0000 7f8c03f2a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bfc14e250 0x7f8bfc1f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.281+0000 7f8c03f2a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc153250 con 0x7f8bfc06eb90 2024-09-10T08:28:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.281+0000 7f8c03f2a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc1530d0 con 0x7f8bfc14e250 2024-09-10T08:28:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.281+0000 7f8c03f2a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8bfc1533d0 con 0x7f8bfc0c2360 2024-09-10T08:28:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.281+0000 7f8c01cc6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bfc06eb90 0x7f8bfc14db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49716/0 (socket says 172.21.15.103:49716) 2024-09-10T08:28:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.281+0000 7f8c01cc6640 1 -- 172.21.15.103:0/592887235 learned_addr learned my addr 172.21.15.103:0/592887235 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.281+0000 7f8c014c5640 1 --2- 172.21.15.103:0/592887235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bfc0c2360 0x7f8bfc151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.281+0000 7f8c024c7640 1 --2- 172.21.15.103:0/592887235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bfc14e250 0x7f8bfc1f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.282+0000 7f8c01cc6640 1 -- 172.21.15.103:0/592887235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bfc0c2360 msgr2=0x7f8bfc151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.282+0000 7f8c01cc6640 1 --2- 172.21.15.103:0/592887235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bfc0c2360 0x7f8bfc151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.282+0000 7f8c01cc6640 1 -- 172.21.15.103:0/592887235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bfc14e250 msgr2=0x7f8bfc1f3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.282+0000 7f8c01cc6640 1 --2- 172.21.15.103:0/592887235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bfc14e250 0x7f8bfc1f3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.282+0000 7f8c01cc6640 1 -- 172.21.15.103:0/592887235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bfc13fd60 con 0x7f8bfc06eb90 2024-09-10T08:28:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.282+0000 7f8c01cc6640 1 --2- 172.21.15.103:0/592887235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bfc06eb90 0x7f8bfc14db60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8bf800e9b0 tx=0x7f8bf800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.283+0000 7f8bf27fc640 1 -- 172.21.15.103:0/592887235 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8017070 con 0x7f8bfc06eb90 2024-09-10T08:28:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.283+0000 7f8bf27fc640 1 -- 172.21.15.103:0/592887235 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf800c9a0 con 0x7f8bfc06eb90 2024-09-10T08:28:59.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.283+0000 7f8bf27fc640 1 -- 172.21.15.103:0/592887235 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf800cd50 con 0x7f8bfc06eb90 2024-09-10T08:28:59.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.284+0000 7f8c03f2a640 1 -- 172.21.15.103:0/592887235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bfc14f100 con 0x7f8bfc06eb90 2024-09-10T08:28:59.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.287+0000 7f8bf27fc640 1 -- 172.21.15.103:0/592887235 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8bf801a070 con 0x7f8bfc06eb90 2024-09-10T08:28:59.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.288+0000 7f8bf27fc640 1 --2- 172.21.15.103:0/592887235 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8be006be80 0x7f8be006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.288+0000 7f8c03f2a640 1 -- 172.21.15.103:0/592887235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bfc13fa80 con 0x7f8bfc06eb90 2024-09-10T08:28:59.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.288+0000 7f8c014c5640 1 --2- 172.21.15.103:0/592887235 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8be006be80 0x7f8be006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.289+0000 7f8bf27fc640 1 -- 172.21.15.103:0/592887235 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f8bf805f0d0 con 0x7f8bfc06eb90 2024-09-10T08:28:59.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.290+0000 7f8c014c5640 1 --2- 172.21.15.103:0/592887235 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8be006be80 0x7f8be006e340 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc06e2e0 tx=0x7f8bec009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.291+0000 7f8c03f2a640 1 -- 172.21.15.103:0/592887235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bfc0ad040 con 0x7f8bfc06eb90 2024-09-10T08:28:59.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.300+0000 7f8bf27fc640 1 -- 172.21.15.103:0/592887235 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8bf80588e0 con 0x7f8bfc06eb90 2024-09-10T08:28:59.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.340+0000 7f5299f24640 1 Processor -- start 2024-09-10T08:28:59.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.340+0000 7f5299f24640 1 -- start start 2024-09-10T08:28:59.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.339+0000 7fc17623c640 1 Processor -- start 2024-09-10T08:28:59.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.339+0000 7fc17623c640 1 -- start start 2024-09-10T08:28:59.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.341+0000 7fc17623c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc170157ff0 0x7fc1700c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.341+0000 7fc17623c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc1700c2980 0x7fc17015aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.341+0000 7fc17623c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc17015e050 con 0x7fc1700c5940 2024-09-10T08:28:59.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.341+0000 7fc17623c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fc17015b670 con 0x7fc1700c2980 2024-09-10T08:28:59.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.341+0000 7fc17623c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc17015e330 con 0x7fc170157ff0 2024-09-10T08:28:59.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.341+0000 7fc16effd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc1700c2980 0x7fc17015aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.341+0000 7fc16effd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc1700c2980 0x7fc17015aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49732/0 (socket says 172.21.15.103:49732) 2024-09-10T08:28:59.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.341+0000 7fc16effd640 1 -- 172.21.15.103:0/1849225508 learned_addr learned my addr 172.21.15.103:0/1849225508 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:59.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.341+0000 7fc16f7fe640 1 --2- 172.21.15.103:0/1849225508 >> v2:172.21.15.154:3300/0 conn(0x7fc170157ff0 0x7fc1700c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.342+0000 7fc16effd640 1 -- 172.21.15.103:0/1849225508 >> v2:172.21.15.154:3300/0 conn(0x7fc170157ff0 msgr2=0x7fc1700c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:59.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.342+0000 7fc16effd640 1 --2- 172.21.15.103:0/1849225508 >> v2:172.21.15.154:3300/0 conn(0x7fc170157ff0 0x7fc1700c2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.342+0000 7f00d4ae9640 1 Processor -- start 2024-09-10T08:28:59.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.342+0000 7f00d4ae9640 1 -- start start 2024-09-10T08:28:59.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.342+0000 7f5299f24640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f528c049940 0x7f528c047100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.342+0000 7f5298f22640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f528c046d20 0x7f528c04b870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:33474/0 (socket says 172.21.15.103:33474) 2024-09-10T08:28:59.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.342+0000 7f5298f22640 1 -- 172.21.15.103:0/3023454405 learned_addr learned my addr 172.21.15.103:0/3023454405 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:59.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.342+0000 7fc16effd640 1 -- 172.21.15.103:0/1849225508 >> v1:172.21.15.154:6789/0 conn(0x7fc1700c5940 legacy=0x7fc17015af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:59.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.342+0000 7fc16effd640 1 -- 172.21.15.103:0/1849225508 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17015e610 con 0x7fc1700c2980 2024-09-10T08:28:59.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.342+0000 7f5299f24640 1 --2- 172.21.15.103:0/3023454405 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f528c007730 0x7f528c0e1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.342+0000 7fc16f7fe640 1 --2- 172.21.15.103:0/1849225508 >> v2:172.21.15.154:3300/0 conn(0x7fc170157ff0 0x7fc1700c2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:59.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.342+0000 7f5299f24640 1 -- 172.21.15.103:0/3023454405 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f528c00cf80 con 0x7f528c046d20 2024-09-10T08:28:59.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.342+0000 7f5299723640 1 --2- 172.21.15.103:0/3023454405 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f528c007730 0x7f528c0e1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.342+0000 7f5299f24640 1 -- 172.21.15.103:0/3023454405 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f528c04ab40 con 0x7f528c049940 2024-09-10T08:28:59.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.343+0000 7f5299f24640 1 -- 172.21.15.103:0/3023454405 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f528c0d77a0 con 0x7f528c007730 2024-09-10T08:28:59.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.343+0000 7f52937fe640 1 -- 172.21.15.103:0/3023454405 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1214712029 0 0) 0x7f528c00cf80 con 0x7f528c046d20 2024-09-10T08:28:59.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.343+0000 7f52937fe640 1 -- 172.21.15.103:0/3023454405 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5284003520 con 0x7f528c046d20 2024-09-10T08:28:59.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.343+0000 7f00d4ae9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f00d006f660 0x7f00d00c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.343+0000 7f00d4ae9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f00d00c5ee0 0x7f00d0156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.343+0000 7f00d4ae9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00d006fa40 con 0x7f00d00c5a70 2024-09-10T08:28:59.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.343+0000 7f00d4ae9640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f00d00c51b0 con 0x7f00d00c5ee0 2024-09-10T08:28:59.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.343+0000 7f00d4ae9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f00d00c62f0 con 0x7f00d006f660 2024-09-10T08:28:59.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.343+0000 7f5293fff640 1 --2- 172.21.15.103:0/3023454405 >> v2:172.21.15.154:3300/0 conn(0x7f528c049940 0x7f528c047100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.343+0000 7f00cffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f00d00c5ee0 0x7f00d0156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.343+0000 7f00ceffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f00d00c5a70 0x7f00d01564a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:33488/0 (socket says 172.21.15.103:33488) 2024-09-10T08:28:59.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.343+0000 7f00ceffd640 1 -- 172.21.15.103:0/3742483128 learned_addr learned my addr 172.21.15.103:0/3742483128 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:59.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.344+0000 7f52937fe640 1 -- 172.21.15.103:0/3023454405 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2985213990 0 0) 0x7f5284003520 con 0x7f528c046d20 2024-09-10T08:28:59.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.344+0000 7f52937fe640 1 -- 172.21.15.103:0/3023454405 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f528c007730 msgr2=0x7f528c0e1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:59.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.344+0000 7f52937fe640 1 --2- 172.21.15.103:0/3023454405 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f528c007730 0x7f528c0e1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.344+0000 7f52937fe640 1 -- 172.21.15.103:0/3023454405 >> v2:172.21.15.154:3300/0 conn(0x7f528c049940 msgr2=0x7f528c047100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:59.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.344+0000 7f52937fe640 1 --2- 172.21.15.103:0/3023454405 >> v2:172.21.15.154:3300/0 conn(0x7f528c049940 0x7f528c047100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.344+0000 7f52937fe640 1 -- 172.21.15.103:0/3023454405 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528c04ad90 con 0x7f528c046d20 2024-09-10T08:28:59.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.344+0000 7f00ce7fc640 1 -- 172.21.15.103:0/3742483128 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1138458683 0 0) 0x7f00c4001110 con 0x7f00d00c5a70 2024-09-10T08:28:59.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.344+0000 7f00ce7fc640 1 -- 172.21.15.103:0/3742483128 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00b8003520 con 0x7f00d00c5a70 2024-09-10T08:28:59.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.344+0000 7f5299723640 1 --2- 172.21.15.103:0/3023454405 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f528c007730 0x7f528c0e1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:59.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.344+0000 7f52937fe640 1 -- 172.21.15.103:0/3023454405 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f5288001690 con 0x7f528c046d20 2024-09-10T08:28:59.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.344+0000 7f5293fff640 1 --2- 172.21.15.103:0/3023454405 >> v2:172.21.15.154:3300/0 conn(0x7f528c049940 0x7f528c047100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:59.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.344+0000 7f52937fe640 1 -- 172.21.15.103:0/3023454405 >> v1:172.21.15.154:6789/0 conn(0x7f528c046d20 legacy=0x7f528c04b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.344+0000 7f00cffff640 1 -- 172.21.15.103:0/3742483128 >> v2:172.21.15.154:3300/0 conn(0x7f00d006f660 msgr2=0x7f00d00c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:59.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.344+0000 7f52937fe640 1 --2- 172.21.15.103:0/3023454405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52840039b0 0x7f5284003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.344+0000 7f00cffff640 1 --2- 172.21.15.103:0/3742483128 >> v2:172.21.15.154:3300/0 conn(0x7f00d006f660 0x7f00d00c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.344+0000 7f00cffff640 1 -- 172.21.15.103:0/3742483128 >> v1:172.21.15.154:6789/0 conn(0x7f00d00c5a70 legacy=0x7f00d01564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.345+0000 7f52937fe640 1 --2- 172.21.15.103:0/3023454405 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f528c007730 0x7f5284004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.345+0000 7f52937fe640 1 --2- 172.21.15.103:0/3023454405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5284004d40 0x7f52840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.343+0000 7fc16effd640 1 --2- 172.21.15.103:0/1849225508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1700c2980 0x7fc17015aa20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc1700706c0 tx=0x7fc16802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67d9263823803a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.345+0000 7f5293fff640 1 --2- 172.21.15.103:0/3023454405 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f528c007730 0x7f5284004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.345+0000 7f00cffff640 1 -- 172.21.15.103:0/3742483128 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d00c6af0 con 0x7f00d00c5ee0 2024-09-10T08:28:59.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.343+0000 7fc16e7fc640 1 -- 172.21.15.103:0/1849225508 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc168036070 con 0x7fc1700c2980 2024-09-10T08:28:59.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.345+0000 7f52937fe640 1 -- 172.21.15.103:0/3023454405 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f528c04ab40 con 0x7f52840039b0 2024-09-10T08:28:59.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.344+0000 7fc16e7fc640 1 -- 172.21.15.103:0/1849225508 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc168031600 con 0x7fc1700c2980 2024-09-10T08:28:59.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.345+0000 7f5298f22640 1 --2- 172.21.15.103:0/3023454405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52840039b0 0x7f5284003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.345+0000 7f5299723640 1 --2- 172.21.15.103:0/3023454405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5284004d40 0x7f52840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.345+0000 7f52937fe640 1 -- 172.21.15.103:0/3023454405 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f528c0d77a0 con 0x7f5284004d40 2024-09-10T08:28:59.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.345+0000 7f52937fe640 1 -- 172.21.15.103:0/3023454405 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f528400bbf0 con 0x7f528c007730 2024-09-10T08:28:59.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.345+0000 7fc17623c640 1 -- 172.21.15.103:0/1849225508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1700c2980 msgr2=0x7fc17015aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.345+0000 7fc17623c640 1 --2- 172.21.15.103:0/1849225508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1700c2980 0x7fc17015aa20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc1700706c0 tx=0x7fc16802a5d0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.345+0000 7fc17623c640 1 -- 172.21.15.103:0/1849225508 shutdown_connections 2024-09-10T08:28:59.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.345+0000 7fc17623c640 1 --2- 172.21.15.103:0/1849225508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1700c2980 0x7fc17015aa20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.345+0000 7fc17623c640 1 --2- 172.21.15.103:0/1849225508 >> v2:172.21.15.154:3300/0 conn(0x7fc170157ff0 0x7fc1700c2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.345+0000 7fc17623c640 1 -- 172.21.15.103:0/1849225508 >> 172.21.15.103:0/1849225508 conn(0x7fc1700c7a40 msgr2=0x7fc1700c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.345+0000 7f5299723640 1 -- 172.21.15.103:0/3023454405 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f528c007730 msgr2=0x7f5284004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:59.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.345+0000 7f5299723640 1 --2- 172.21.15.103:0/3023454405 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f528c007730 0x7f5284004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.345+0000 7f5299723640 1 -- 172.21.15.103:0/3023454405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52840039b0 msgr2=0x7f5284003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:59.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.345+0000 7f5299723640 1 --2- 172.21.15.103:0/3023454405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52840039b0 0x7f5284003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.345+0000 7f5299723640 1 -- 172.21.15.103:0/3023454405 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5284003520 con 0x7f5284004d40 2024-09-10T08:28:59.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.346+0000 7f00cffff640 1 --2- 172.21.15.103:0/3742483128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d00c5ee0 0x7f00d0156bb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f00d00c9a00 tx=0x7f00c802a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fedc68e4757a947 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.346+0000 7f5298f22640 1 --2- 172.21.15.103:0/3023454405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52840039b0 0x7f5284003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:59.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.346+0000 7f5299723640 1 --2- 172.21.15.103:0/3023454405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5284004d40 0x7f52840051c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f529406ae80 tx=0x7f5284005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15491c9a10c56a00 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.346+0000 7f52937fe640 1 -- 172.21.15.103:0/3023454405 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52940b8070 con 0x7f5284004d40 2024-09-10T08:28:59.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.347+0000 7f52937fe640 1 -- 172.21.15.103:0/3023454405 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52940abe30 con 0x7f5284004d40 2024-09-10T08:28:59.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.347+0000 7f00ce7fc640 1 -- 172.21.15.103:0/3742483128 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c8035020 con 0x7f00d00c5ee0 2024-09-10T08:28:59.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.347+0000 7f52937fe640 1 -- 172.21.15.103:0/3023454405 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5294050520 con 0x7f5284004d40 2024-09-10T08:28:59.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.347+0000 7f00ce7fc640 1 -- 172.21.15.103:0/3742483128 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00c8007540 con 0x7f00d00c5ee0 2024-09-10T08:28:59.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.347+0000 7f00ce7fc640 1 -- 172.21.15.103:0/3742483128 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c4001840 con 0x7f00d00c5ee0 2024-09-10T08:28:59.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.348+0000 7f5299f24640 1 -- 172.21.15.103:0/3023454405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5284004d40 msgr2=0x7f52840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.348+0000 7f5299f24640 1 --2- 172.21.15.103:0/3023454405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5284004d40 0x7f52840051c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f529406ae80 tx=0x7f5284005830 comp rx=0 tx=0).stop 2024-09-10T08:28:59.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.348+0000 7f5299723640 1 -- 172.21.15.103:0/3023454405 reap_dead start 2024-09-10T08:28:59.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.348+0000 7f5299f24640 1 -- 172.21.15.103:0/3023454405 shutdown_connections 2024-09-10T08:28:59.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.348+0000 7f5299f24640 1 -- 172.21.15.103:0/3023454405 >> 172.21.15.103:0/3023454405 conn(0x7f528c048e20 msgr2=0x7f528c049230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.348+0000 7f5299f24640 1 -- 172.21.15.103:0/3023454405 shutdown_connections 2024-09-10T08:28:59.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.348+0000 7f5299f24640 1 -- 172.21.15.103:0/3023454405 wait complete. 2024-09-10T08:28:59.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.348+0000 7f00d4ae9640 1 -- 172.21.15.103:0/3742483128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d00c5ee0 msgr2=0x7f00d0156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.348+0000 7f00d4ae9640 1 --2- 172.21.15.103:0/3742483128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d00c5ee0 0x7f00d0156bb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f00d00c9a00 tx=0x7f00c802a560 comp rx=0 tx=0).stop 2024-09-10T08:28:59.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.349+0000 7f00d4ae9640 1 -- 172.21.15.103:0/3742483128 shutdown_connections 2024-09-10T08:28:59.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.349+0000 7f00d4ae9640 1 --2- 172.21.15.103:0/3742483128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d00c5ee0 0x7f00d0156bb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.349+0000 7f00d4ae9640 1 --2- 172.21.15.103:0/3742483128 >> v2:172.21.15.154:3300/0 conn(0x7f00d006f660 0x7f00d00c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.349+0000 7f00d4ae9640 1 -- 172.21.15.103:0/3742483128 >> 172.21.15.103:0/3742483128 conn(0x7f00d00c8e70 msgr2=0x7f00d00c9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.349+0000 7f00d4ae9640 1 -- 172.21.15.103:0/3742483128 shutdown_connections 2024-09-10T08:28:59.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.349+0000 7f00d4ae9640 1 -- 172.21.15.103:0/3742483128 wait complete. 2024-09-10T08:28:59.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.346+0000 7fc17623c640 1 -- 172.21.15.103:0/1849225508 shutdown_connections 2024-09-10T08:28:59.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.346+0000 7fc17623c640 1 -- 172.21.15.103:0/1849225508 wait complete. 2024-09-10T08:28:59.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.348+0000 7fc17623c640 1 Processor -- start 2024-09-10T08:28:59.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.348+0000 7fc17623c640 1 -- start start 2024-09-10T08:28:59.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.350+0000 7f5299f24640 1 Processor -- start 2024-09-10T08:28:59.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.350+0000 7f5299f24640 1 -- start start 2024-09-10T08:28:59.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.349+0000 7fc17623c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1700c2980 0x7fc17014f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.350+0000 7fc17623c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1700c5940 0x7fc1701ec590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.351+0000 7f00d4ae9640 1 Processor -- start 2024-09-10T08:28:59.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.350+0000 7fc17623c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc170157ff0 0x7fc17014ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.350+0000 7fc17623c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc17015ddb0 con 0x7fc1700c2980 2024-09-10T08:28:59.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.350+0000 7fc17623c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc17015dc30 con 0x7fc1700c5940 2024-09-10T08:28:59.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.350+0000 7fc17623c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc17006f250 con 0x7fc170157ff0 2024-09-10T08:28:59.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.350+0000 7fc16f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1700c2980 0x7fc17014f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.352+0000 7f00d4ae9640 1 -- start start 2024-09-10T08:28:59.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.352+0000 7f5299f24640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5284004d40 0x7f528c0d1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.352+0000 7f5299f24640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f528c0402a0 0x7f528c16d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.352+0000 7f5298f22640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5284004d40 0x7f528c0d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.352+0000 7f5298f22640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5284004d40 0x7f528c0d1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:53214/0 (socket says 172.21.15.103:53214) 2024-09-10T08:28:59.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.352+0000 7f5298f22640 1 -- 172.21.15.103:0/3361244668 learned_addr learned my addr 172.21.15.103:0/3361244668 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:59.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.352+0000 7f5299f24640 1 --2- 172.21.15.103:0/3361244668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528c040720 0x7f528c16dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.352+0000 7f5293fff640 1 --2- 172.21.15.103:0/3361244668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f528c0402a0 0x7f528c16d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.352+0000 7f5299f24640 1 -- 172.21.15.103:0/3361244668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f528c0d45d0 con 0x7f528c0402a0 2024-09-10T08:28:59.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.352+0000 7f5299723640 1 --2- 172.21.15.103:0/3361244668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528c040720 0x7f528c16dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.352+0000 7f5299f24640 1 -- 172.21.15.103:0/3361244668 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f528c04b350 con 0x7f528c040720 2024-09-10T08:28:59.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.352+0000 7f5299f24640 1 -- 172.21.15.103:0/3361244668 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f528c0d73e0 con 0x7f5284004d40 2024-09-10T08:28:59.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.353+0000 7f5293fff640 1 -- 172.21.15.103:0/3361244668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5284004d40 msgr2=0x7f528c0d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.353+0000 7f5293fff640 1 --2- 172.21.15.103:0/3361244668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5284004d40 0x7f528c0d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.353+0000 7f5293fff640 1 -- 172.21.15.103:0/3361244668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528c040720 msgr2=0x7f528c16dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.353+0000 7f5293fff640 1 --2- 172.21.15.103:0/3361244668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528c040720 0x7f528c16dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.353+0000 7f00d4ae9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00d006f660 0x7f00d00bdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.353+0000 7f00d4ae9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00d00c5a70 0x7f00d014f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.353+0000 7f00d4ae9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d00c5ee0 0x7f00d014f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.353+0000 7f00d4ae9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f00d01570f0 con 0x7f00d00c5ee0 2024-09-10T08:28:59.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.353+0000 7f00d4ae9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f00d0150bf0 con 0x7f00d00c5a70 2024-09-10T08:28:59.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.353+0000 7f00d4ae9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f00d00c70b0 con 0x7f00d006f660 2024-09-10T08:28:59.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.354+0000 7f5293fff640 1 -- 172.21.15.103:0/3361244668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528c041a90 con 0x7f528c0402a0 2024-09-10T08:28:59.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.354+0000 7f5299723640 1 --2- 172.21.15.103:0/3361244668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528c040720 0x7f528c16dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:59.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.354+0000 7f00cf7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00d006f660 0x7f00d00bdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.354+0000 7f00ceffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00d00c5a70 0x7f00d014f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.354+0000 7f00ceffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00d00c5a70 0x7f00d014f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:56674/0 (socket says 172.21.15.103:56674) 2024-09-10T08:28:59.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.354+0000 7f00ceffd640 1 -- 172.21.15.103:0/1020269090 learned_addr learned my addr 172.21.15.103:0/1020269090 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:59.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.354+0000 7f00cffff640 1 --2- 172.21.15.103:0/1020269090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d00c5ee0 0x7f00d014f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.355+0000 7f00ceffd640 1 -- 172.21.15.103:0/1020269090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00d006f660 msgr2=0x7f00d00bdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.355+0000 7f00ceffd640 1 --2- 172.21.15.103:0/1020269090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00d006f660 0x7f00d00bdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.355+0000 7f00ceffd640 1 -- 172.21.15.103:0/1020269090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d00c5ee0 msgr2=0x7f00d014f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.355+0000 7f00ceffd640 1 --2- 172.21.15.103:0/1020269090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d00c5ee0 0x7f00d014f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.355+0000 7f00ceffd640 1 -- 172.21.15.103:0/1020269090 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d006dbd0 con 0x7f00d00c5a70 2024-09-10T08:28:59.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.355+0000 7f5293fff640 1 --2- 172.21.15.103:0/3361244668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f528c0402a0 0x7f528c16d6a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f528000f8e0 tx=0x7f528000fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.355+0000 7f00ceffd640 1 --2- 172.21.15.103:0/1020269090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00d00c5a70 0x7f00d014f440 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f00c400c7d0 tx=0x7f00c400cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.355+0000 7f52917fa640 1 -- 172.21.15.103:0/3361244668 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528000dc10 con 0x7f528c0402a0 2024-09-10T08:28:59.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.350+0000 7fc16f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1700c2980 0x7fc17014f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49764/0 (socket says 172.21.15.103:49764) 2024-09-10T08:28:59.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.350+0000 7fc16f7fe640 1 -- 172.21.15.103:0/2684316051 learned_addr learned my addr 172.21.15.103:0/2684316051 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:59.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.350+0000 7fc16effd640 1 --2- 172.21.15.103:0/2684316051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1700c5940 0x7fc1701ec590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.356+0000 7f5299f24640 1 -- 172.21.15.103:0/3361244668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f528c041fc0 con 0x7f528c0402a0 2024-09-10T08:28:59.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.356+0000 7f5299f24640 1 -- 172.21.15.103:0/3361244668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f528c042540 con 0x7f528c0402a0 2024-09-10T08:28:59.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.357+0000 7f52917fa640 1 -- 172.21.15.103:0/3361244668 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528000ddb0 con 0x7f528c0402a0 2024-09-10T08:28:59.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.357+0000 7f52917fa640 1 -- 172.21.15.103:0/3361244668 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5280013660 con 0x7f528c0402a0 2024-09-10T08:28:59.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.350+0000 7fc16ffff640 1 --2- 172.21.15.103:0/2684316051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc170157ff0 0x7fc17014ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.350+0000 7fc16f7fe640 1 -- 172.21.15.103:0/2684316051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc170157ff0 msgr2=0x7fc17014ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.350+0000 7fc16f7fe640 1 --2- 172.21.15.103:0/2684316051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc170157ff0 0x7fc17014ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.350+0000 7fc16f7fe640 1 -- 172.21.15.103:0/2684316051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1700c5940 msgr2=0x7fc1701ec590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.350+0000 7fc16f7fe640 1 --2- 172.21.15.103:0/2684316051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1700c5940 0x7fc1701ec590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.350+0000 7fc16f7fe640 1 -- 172.21.15.103:0/2684316051 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc170150d00 con 0x7fc1700c2980 2024-09-10T08:28:59.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.351+0000 7fc16f7fe640 1 --2- 172.21.15.103:0/2684316051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1700c2980 0x7fc17014f770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc16000e9b0 tx=0x7fc16000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.351+0000 7fc157fff640 1 -- 172.21.15.103:0/2684316051 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160017070 con 0x7fc1700c2980 2024-09-10T08:28:59.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.351+0000 7fc17623c640 1 -- 172.21.15.103:0/2684316051 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc17015cfe0 con 0x7fc1700c2980 2024-09-10T08:28:59.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.354+0000 7fc17623c640 1 -- 172.21.15.103:0/2684316051 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc170156820 con 0x7fc1700c2980 2024-09-10T08:28:59.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.356+0000 7fc157fff640 1 -- 172.21.15.103:0/2684316051 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc16000ca00 con 0x7fc1700c2980 2024-09-10T08:28:59.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.357+0000 7fc157fff640 1 -- 172.21.15.103:0/2684316051 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16000cdd0 con 0x7fc1700c2980 2024-09-10T08:28:59.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.358+0000 7f5299f24640 1 -- 172.21.15.103:0/3361244668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f528c16ae40 con 0x7f528c0402a0 2024-09-10T08:28:59.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.357+0000 7fc157fff640 1 -- 172.21.15.103:0/2684316051 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc16001a070 con 0x7fc1700c2980 2024-09-10T08:28:59.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.358+0000 7fc157fff640 1 --2- 172.21.15.103:0/2684316051 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc15c06bf30 0x7fc15c06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.358+0000 7f00b7fff640 1 -- 172.21.15.103:0/1020269090 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c4018070 con 0x7f00d00c5a70 2024-09-10T08:28:59.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.358+0000 7f00b7fff640 1 -- 172.21.15.103:0/1020269090 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00c40074e0 con 0x7f00d00c5a70 2024-09-10T08:28:59.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.358+0000 7f00d4ae9640 1 -- 172.21.15.103:0/1020269090 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00d006deb0 con 0x7f00d00c5a70 2024-09-10T08:28:59.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.359+0000 7f00d4ae9640 1 -- 172.21.15.103:0/1020269090 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00d006e470 con 0x7f00d00c5a70 2024-09-10T08:28:59.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.359+0000 7f00b7fff640 1 -- 172.21.15.103:0/1020269090 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c4004a00 con 0x7f00d00c5a70 2024-09-10T08:28:59.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.358+0000 7f52917fa640 1 -- 172.21.15.103:0/3361244668 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5280013800 con 0x7f528c0402a0 2024-09-10T08:28:59.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.359+0000 7f52917fa640 1 --2- 172.21.15.103:0/3361244668 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f527806be30 0x7f527806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.359+0000 7f52917fa640 1 -- 172.21.15.103:0/3361244668 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f528008b880 con 0x7f528c0402a0 2024-09-10T08:28:59.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.359+0000 7fc16effd640 1 --2- 172.21.15.103:0/2684316051 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc15c06bf30 0x7fc15c06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.360+0000 7f5298f22640 1 --2- 172.21.15.103:0/3361244668 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f527806be30 0x7f527806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.360+0000 7f5298f22640 1 --2- 172.21.15.103:0/3361244668 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f527806be30 0x7f527806e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5288000c00 tx=0x7f5288001d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.360+0000 7fc16effd640 1 --2- 172.21.15.103:0/2684316051 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc15c06bf30 0x7fc15c06e3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc168033000 tx=0x7fc168009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.360+0000 7fc155ffb640 1 -- 172.21.15.103:0/2684316051 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc150005290 con 0x7fc1700c2980 2024-09-10T08:28:59.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.361+0000 7fc157fff640 1 -- 172.21.15.103:0/2684316051 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fc16008f060 con 0x7fc1700c2980 2024-09-10T08:28:59.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.362+0000 7f00b7fff640 1 -- 172.21.15.103:0/1020269090 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f00c401b070 con 0x7f00d00c5a70 2024-09-10T08:28:59.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.363+0000 7f00b7fff640 1 --2- 172.21.15.103:0/1020269090 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f00bc06bf00 0x7f00bc06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.363+0000 7f00b7fff640 1 -- 172.21.15.103:0/1020269090 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f00c408a780 con 0x7f00d00c5a70 2024-09-10T08:28:59.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.364+0000 7f00cf7fe640 1 --2- 172.21.15.103:0/1020269090 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f00bc06bf00 0x7f00bc06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.364+0000 7f00cf7fe640 1 --2- 172.21.15.103:0/1020269090 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f00bc06bf00 0x7f00bc06e3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f00c0009990 tx=0x7f00c0009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.364+0000 7f00d4ae9640 1 -- 172.21.15.103:0/1020269090 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00b0005290 con 0x7f00d00c5a70 2024-09-10T08:28:59.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.366+0000 7f52917fa640 1 -- 172.21.15.103:0/3361244668 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5280017030 con 0x7f528c0402a0 2024-09-10T08:28:59.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.370+0000 7f00b7fff640 1 -- 172.21.15.103:0/1020269090 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f00d006fa40 con 0x7f00d00c5a70 2024-09-10T08:28:59.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.375+0000 7fc157fff640 1 -- 172.21.15.103:0/2684316051 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc160058a10 con 0x7fc1700c2980 2024-09-10T08:28:59.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.408+0000 7f6e05bc0640 1 Processor -- start 2024-09-10T08:28:59.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.408+0000 7f6e05bc0640 1 -- start start 2024-09-10T08:28:59.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.408+0000 7fbf81b3b640 1 Processor -- start 2024-09-10T08:28:59.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.408+0000 7fbf81b3b640 1 -- start start 2024-09-10T08:28:59.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.410+0000 7f6e05bc0640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6e0006efd0 0x7f6e00071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.410+0000 7f6dff7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6e00150860 0x7f6e0006d7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50182/0 (socket says 172.21.15.103:50182) 2024-09-10T08:28:59.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.410+0000 7fbf81b3b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbf7c0c6bd0 0x7fbf7c1562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.410+0000 7f6dff7fe640 1 -- 172.21.15.103:0/997741875 learned_addr learned my addr 172.21.15.103:0/997741875 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:59.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.410+0000 7fbf81b3b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf7c0c2d60 con 0x7fbf7c06edd0 2024-09-10T08:28:59.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.410+0000 7f6e05bc0640 1 --2- 172.21.15.103:0/997741875 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e000721a0 0x7f6e000c4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.410+0000 7fbf81b3b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf7c0c3040 con 0x7fbf7c0c7230 2024-09-10T08:28:59.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.410+0000 7fbf81b3b640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fbf7c1532d0 con 0x7fbf7c0c6bd0 2024-09-10T08:28:59.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.410+0000 7f6e05bc0640 1 -- 172.21.15.103:0/997741875 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e0006e030 con 0x7f6e00150860 2024-09-10T08:28:59.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.410+0000 7f6e05bc0640 1 -- 172.21.15.103:0/997741875 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f6e0006f770 con 0x7f6e0006efd0 2024-09-10T08:28:59.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.410+0000 7f6dfffff640 1 --2- 172.21.15.103:0/997741875 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e000721a0 0x7f6e000c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.410+0000 7f6dfeffd640 1 --2- 172.21.15.103:0/997741875 >> v2:172.21.15.103:3300/0 conn(0x7f6e0006efd0 0x7f6e00071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.410+0000 7f6e05bc0640 1 -- 172.21.15.103:0/997741875 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6e00150c40 con 0x7f6e000721a0 2024-09-10T08:28:59.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.410+0000 7fbf7bfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbf7c0c6bd0 0x7fbf7c1562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.410+0000 7fbf7bfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbf7c0c6bd0 0x7fbf7c1562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49802/0 (socket says 172.21.15.103:49802) 2024-09-10T08:28:59.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.410+0000 7fbf7bfff640 1 -- 172.21.15.103:0/120470883 learned_addr learned my addr 172.21.15.103:0/120470883 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:59.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.411+0000 7fbf7bfff640 1 -- 172.21.15.103:0/120470883 >> v1:172.21.15.154:6789/0 conn(0x7fbf7c0c7230 legacy=0x7fbf7c14f820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T08:28:59.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.411+0000 7fbf7bfff640 1 -- 172.21.15.103:0/120470883 >> v1:172.21.15.103:6789/0 conn(0x7fbf7c06edd0 legacy=0x7fbf7c152bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:28:59.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.411+0000 7fbf7bfff640 1 -- 172.21.15.103:0/120470883 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf7c1526a0 con 0x7fbf7c0c6bd0 2024-09-10T08:28:59.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.412+0000 7f3819fd5640 1 Processor -- start 2024-09-10T08:28:59.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.411+0000 7f6dfeffd640 1 -- 172.21.15.103:0/997741875 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e000721a0 msgr2=0x7f6e000c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:59.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.411+0000 7f6dfeffd640 1 --2- 172.21.15.103:0/997741875 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e000721a0 0x7f6e000c4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.411+0000 7f6dfeffd640 1 -- 172.21.15.103:0/997741875 >> v1:172.21.15.103:6789/0 conn(0x7f6e00150860 legacy=0x7f6e0006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.411+0000 7f6dfeffd640 1 -- 172.21.15.103:0/997741875 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e0006f9c0 con 0x7f6e0006efd0 2024-09-10T08:28:59.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.412+0000 7f3819fd5640 1 -- start start 2024-09-10T08:28:59.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.412+0000 7fac8ad2a640 1 Processor -- start 2024-09-10T08:28:59.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.412+0000 7f6dfeffd640 1 --2- 172.21.15.103:0/997741875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e0006efd0 0x7f6e00071c60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6df8009d90 tx=0x7f6df802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b14bf0dd1ca1a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.413+0000 7f6dfe7fc640 1 -- 172.21.15.103:0/997741875 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df8033640 con 0x7f6e0006efd0 2024-09-10T08:28:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.413+0000 7f6dfe7fc640 1 -- 172.21.15.103:0/997741875 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df8038070 con 0x7f6e0006efd0 2024-09-10T08:28:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.413+0000 7fbf7bfff640 1 --2- 172.21.15.103:0/120470883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c0c6bd0 0x7fbf7c1562d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c06ed00 tx=0x7fbf7402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912fae53ddffc0c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.413+0000 7f6dfe7fc640 1 -- 172.21.15.103:0/997741875 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df8033640 con 0x7f6e0006efd0 2024-09-10T08:28:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.413+0000 7f3819fd5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f381414f7b0 0x7f3814152d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.413+0000 7f3819fd5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38140c27d0 0x7f38140c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.413+0000 7f3819fd5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3814152280 con 0x7f381414fb90 2024-09-10T08:28:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.413+0000 7f3819fd5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3814152890 con 0x7f381414f7b0 2024-09-10T08:28:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.413+0000 7f3819fd5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f38140c2c60 con 0x7f38140c27d0 2024-09-10T08:28:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.413+0000 7fac8ad2a640 1 -- start start 2024-09-10T08:28:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.414+0000 7f6e05bc0640 1 -- 172.21.15.103:0/997741875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e0006efd0 msgr2=0x7f6e00071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.414+0000 7f6e05bc0640 1 --2- 172.21.15.103:0/997741875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e0006efd0 0x7f6e00071c60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6df8009d90 tx=0x7f6df802c8b0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.413+0000 7f38197d4640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f381414fb90 0x7f381406cbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:33494/0 (socket says 172.21.15.103:33494) 2024-09-10T08:28:59.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.413+0000 7f38197d4640 1 -- 172.21.15.103:0/2011028958 learned_addr learned my addr 172.21.15.103:0/2011028958 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:59.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.414+0000 7f3818fd3640 1 --2- 172.21.15.103:0/2011028958 >> v2:172.21.15.154:3300/0 conn(0x7f381414f7b0 0x7f3814152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.414+0000 7f3813fff640 1 --2- 172.21.15.103:0/2011028958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38140c27d0 0x7f38140c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.414+0000 7fac8ad2a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fac840aba60 0x7fac84153390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.414+0000 7f3813fff640 1 -- 172.21.15.103:0/2011028958 >> v2:172.21.15.154:3300/0 conn(0x7f381414f7b0 msgr2=0x7f3814152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:59.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.414+0000 7f3813fff640 1 --2- 172.21.15.103:0/2011028958 >> v2:172.21.15.154:3300/0 conn(0x7f381414f7b0 0x7f3814152d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.414+0000 7f6e05bc0640 1 -- 172.21.15.103:0/997741875 shutdown_connections 2024-09-10T08:28:59.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.414+0000 7f3813fff640 1 -- 172.21.15.103:0/2011028958 >> v1:172.21.15.154:6789/0 conn(0x7f381414fb90 legacy=0x7f381406cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.414+0000 7f6e05bc0640 1 --2- 172.21.15.103:0/997741875 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e000721a0 0x7f6e000c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.414+0000 7f6e05bc0640 1 --2- 172.21.15.103:0/997741875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e0006efd0 0x7f6e00071c60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.414+0000 7f3813fff640 1 -- 172.21.15.103:0/2011028958 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3814152520 con 0x7f38140c27d0 2024-09-10T08:28:59.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.414+0000 7f6e05bc0640 1 -- 172.21.15.103:0/997741875 >> 172.21.15.103:0/997741875 conn(0x7f6e0006ccf0 msgr2=0x7f6e0006d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.414+0000 7f6e05bc0640 1 -- 172.21.15.103:0/997741875 shutdown_connections 2024-09-10T08:28:59.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.414+0000 7fac8ad2a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fac840c3d60 0x7fac8414fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.415+0000 7fac8ad2a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac840c37a0 con 0x7fac840c2e30 2024-09-10T08:28:59.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.415+0000 7fac8ad2a640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fac840c3a80 con 0x7fac840aba60 2024-09-10T08:28:59.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.415+0000 7fac8ad2a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fac84155fb0 con 0x7fac840c3d60 2024-09-10T08:28:59.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.415+0000 7fac83fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fac840c2e30 0x7fac841567b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50194/0 (socket says 172.21.15.103:50194) 2024-09-10T08:28:59.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.413+0000 7fbf7a7fc640 1 -- 172.21.15.103:0/120470883 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf74036070 con 0x7fbf7c0c6bd0 2024-09-10T08:28:59.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.414+0000 7fbf7a7fc640 1 -- 172.21.15.103:0/120470883 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf74031600 con 0x7fbf7c0c6bd0 2024-09-10T08:28:59.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.414+0000 7fbf7a7fc640 1 -- 172.21.15.103:0/120470883 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7402ae60 con 0x7fbf7c0c6bd0 2024-09-10T08:28:59.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.415+0000 7fbf81b3b640 1 -- 172.21.15.103:0/120470883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c0c6bd0 msgr2=0x7fbf7c1562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.415+0000 7fbf81b3b640 1 --2- 172.21.15.103:0/120470883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c0c6bd0 0x7fbf7c1562d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c06ed00 tx=0x7fbf7402a680 comp rx=0 tx=0).stop 2024-09-10T08:28:59.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.415+0000 7fbf81b3b640 1 -- 172.21.15.103:0/120470883 shutdown_connections 2024-09-10T08:28:59.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.415+0000 7fbf81b3b640 1 --2- 172.21.15.103:0/120470883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c0c6bd0 0x7fbf7c1562d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.415+0000 7fbf81b3b640 1 -- 172.21.15.103:0/120470883 >> 172.21.15.103:0/120470883 conn(0x7fbf7c0c7a40 msgr2=0x7fbf7c0c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.415+0000 7fac83fff640 1 -- 172.21.15.103:0/596924018 learned_addr learned my addr 172.21.15.103:0/596924018 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:28:59.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.415+0000 7fac892c7640 1 --2- 172.21.15.103:0/596924018 >> v2:172.21.15.154:3300/0 conn(0x7fac840c3d60 0x7fac8414fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.415+0000 7f6e05bc0640 1 -- 172.21.15.103:0/997741875 wait complete. 2024-09-10T08:28:59.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.415+0000 7f3813fff640 1 --2- 172.21.15.103:0/2011028958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38140c27d0 0x7f38140c58d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f38080097a0 tx=0x7f380802a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c7d6590c73aa8eb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.416+0000 7f38137fe640 1 -- 172.21.15.103:0/2011028958 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3808037070 con 0x7f38140c27d0 2024-09-10T08:28:59.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.416+0000 7f38137fe640 1 -- 172.21.15.103:0/2011028958 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f380802adb0 con 0x7f38140c27d0 2024-09-10T08:28:59.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.416+0000 7fac88ac6640 1 --2- 172.21.15.103:0/596924018 >> v2:172.21.15.103:3300/0 conn(0x7fac840aba60 0x7fac84153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.416+0000 7f38137fe640 1 -- 172.21.15.103:0/2011028958 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3808032660 con 0x7f38140c27d0 2024-09-10T08:28:59.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.416+0000 7fac892c7640 1 -- 172.21.15.103:0/596924018 >> v2:172.21.15.103:3300/0 conn(0x7fac840aba60 msgr2=0x7fac84153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:59.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.416+0000 7fac892c7640 1 --2- 172.21.15.103:0/596924018 >> v2:172.21.15.103:3300/0 conn(0x7fac840aba60 0x7fac84153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.416+0000 7fac892c7640 1 -- 172.21.15.103:0/596924018 >> v1:172.21.15.103:6789/0 conn(0x7fac840c2e30 legacy=0x7fac841567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.416+0000 7fac892c7640 1 -- 172.21.15.103:0/596924018 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac84156290 con 0x7fac840c3d60 2024-09-10T08:28:59.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.415+0000 7fbf81b3b640 1 -- 172.21.15.103:0/120470883 shutdown_connections 2024-09-10T08:28:59.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.415+0000 7fbf81b3b640 1 -- 172.21.15.103:0/120470883 wait complete. 2024-09-10T08:28:59.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.417+0000 7fbf81b3b640 1 Processor -- start 2024-09-10T08:28:59.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.417+0000 7f3819fd5640 1 -- 172.21.15.103:0/2011028958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38140c27d0 msgr2=0x7f38140c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.417+0000 7f3819fd5640 1 --2- 172.21.15.103:0/2011028958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38140c27d0 0x7f38140c58d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f38080097a0 tx=0x7f380802a060 comp rx=0 tx=0).stop 2024-09-10T08:28:59.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.417+0000 7f6e05bc0640 1 Processor -- start 2024-09-10T08:28:59.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.417+0000 7f3819fd5640 1 -- 172.21.15.103:0/2011028958 shutdown_connections 2024-09-10T08:28:59.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.417+0000 7f3819fd5640 1 --2- 172.21.15.103:0/2011028958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f38140c27d0 0x7f38140c58d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.417+0000 7f3819fd5640 1 --2- 172.21.15.103:0/2011028958 >> v2:172.21.15.154:3300/0 conn(0x7f381414f7b0 0x7f3814152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.417+0000 7f3819fd5640 1 -- 172.21.15.103:0/2011028958 >> 172.21.15.103:0/2011028958 conn(0x7f38140a9780 msgr2=0x7f38140a9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.417+0000 7f3819fd5640 1 -- 172.21.15.103:0/2011028958 shutdown_connections 2024-09-10T08:28:59.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.418+0000 7f6e05bc0640 1 -- start start 2024-09-10T08:28:59.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.417+0000 7f3819fd5640 1 -- 172.21.15.103:0/2011028958 wait complete. 2024-09-10T08:28:59.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.417+0000 7fbf81b3b640 1 -- start start 2024-09-10T08:28:59.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.418+0000 7fbf81b3b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c06edd0 0x7fbf7c0a7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.418+0000 7fbf81b3b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf7c0c6bd0 0x7fbf7c0a8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.418+0000 7fbf81b3b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf7c0c7230 0x7fbf7c153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.418+0000 7fbf81b3b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c152350 con 0x7fbf7c06edd0 2024-09-10T08:28:59.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.418+0000 7fbf81b3b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c14ff30 con 0x7fbf7c0c6bd0 2024-09-10T08:28:59.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.418+0000 7fbf81b3b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fbf7c0c41e0 con 0x7fbf7c0c7230 2024-09-10T08:28:59.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.418+0000 7fbf7affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf7c0c6bd0 0x7fbf7c0a8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.419+0000 7fbf7affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf7c0c6bd0 0x7fbf7c0a8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:56704/0 (socket says 172.21.15.103:56704) 2024-09-10T08:28:59.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.419+0000 7fbf7affd640 1 -- 172.21.15.103:0/1735772235 learned_addr learned my addr 172.21.15.103:0/1735772235 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:59.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.419+0000 7fbf7bfff640 1 --2- 172.21.15.103:0/1735772235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf7c0c7230 0x7fbf7c153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.419+0000 7f6e05bc0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e0006efd0 0x7f6e001e8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.419+0000 7f6e05bc0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e000721a0 0x7f6e000ae410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.419+0000 7fbf7affd640 1 -- 172.21.15.103:0/1735772235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf7c0c7230 msgr2=0x7fbf7c153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.419+0000 7f3819fd5640 1 Processor -- start 2024-09-10T08:28:59.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.419+0000 7f6dff7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e0006efd0 0x7f6e001e8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.419+0000 7fbf7affd640 1 --2- 172.21.15.103:0/1735772235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf7c0c7230 0x7fbf7c153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.419+0000 7fbf7affd640 1 -- 172.21.15.103:0/1735772235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c06edd0 msgr2=0x7fbf7c0a7b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:28:59.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.419+0000 7fbf7b7fe640 1 --2- 172.21.15.103:0/1735772235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c06edd0 0x7fbf7c0a7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.419+0000 7f6dfeffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e000721a0 0x7f6e000ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.419+0000 7fbf7affd640 1 --2- 172.21.15.103:0/1735772235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c06edd0 0x7fbf7c0a7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.419+0000 7fbf7affd640 1 -- 172.21.15.103:0/1735772235 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf7c0a78b0 con 0x7fbf7c0c6bd0 2024-09-10T08:28:59.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.419+0000 7f6dff7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e0006efd0 0x7f6e001e8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:56718/0 (socket says 172.21.15.103:56718) 2024-09-10T08:28:59.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.419+0000 7f6dfeffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e000721a0 0x7f6e000ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:53252/0 (socket says 172.21.15.103:53252) 2024-09-10T08:28:59.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.419+0000 7f6dfeffd640 1 -- 172.21.15.103:0/319599166 learned_addr learned my addr 172.21.15.103:0/319599166 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:59.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.420+0000 7f6e05bc0640 1 --2- 172.21.15.103:0/319599166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e00150860 0x7f6e000c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.419+0000 7f3819fd5640 1 -- start start 2024-09-10T08:28:59.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.419+0000 7fbf7b7fe640 1 --2- 172.21.15.103:0/1735772235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c06edd0 0x7fbf7c0a7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:59.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.420+0000 7fbf7affd640 1 --2- 172.21.15.103:0/1735772235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf7c0c6bd0 0x7fbf7c0a8620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbf7000b3e0 tx=0x7fbf7000b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.419+0000 7fac892c7640 1 --2- 172.21.15.103:0/596924018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac840c3d60 0x7fac8414fba0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fac840c9400 tx=0x7fac7c02c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc40040eac98ae38 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.420+0000 7fac837fe640 1 -- 172.21.15.103:0/596924018 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c007740 con 0x7fac840c3d60 2024-09-10T08:28:59.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.420+0000 7f6dfffff640 1 --2- 172.21.15.103:0/319599166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e00150860 0x7f6e000c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.420+0000 7f6e05bc0640 1 -- 172.21.15.103:0/319599166 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6e000704a0 con 0x7f6e00150860 2024-09-10T08:28:59.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.420+0000 7f6e05bc0640 1 -- 172.21.15.103:0/319599166 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0006ff80 con 0x7f6e0006efd0 2024-09-10T08:28:59.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.420+0000 7f6e05bc0640 1 -- 172.21.15.103:0/319599166 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6e000c4a80 con 0x7f6e000721a0 2024-09-10T08:28:59.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.420+0000 7f3819fd5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f381414f7b0 0x7f3814153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.420+0000 7f3819fd5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f381414fb90 0x7f381414e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7f3819fd5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381414ad50 0x7f381414b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7f3819fd5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f381406d480 con 0x7f381414f7b0 2024-09-10T08:28:59.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7f3819fd5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f381406d300 con 0x7f381414ad50 2024-09-10T08:28:59.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7f3819fd5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f38140a7210 con 0x7f381414fb90 2024-09-10T08:28:59.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7f6dfeffd640 1 -- 172.21.15.103:0/319599166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e0006efd0 msgr2=0x7f6e001e8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7f6dfeffd640 1 --2- 172.21.15.103:0/319599166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e0006efd0 0x7f6e001e8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7f6dfeffd640 1 -- 172.21.15.103:0/319599166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e00150860 msgr2=0x7f6e000c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7f6dfeffd640 1 --2- 172.21.15.103:0/319599166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e00150860 0x7f6e000c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7f6dfeffd640 1 -- 172.21.15.103:0/319599166 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e0014d700 con 0x7f6e000721a0 2024-09-10T08:28:59.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.420+0000 7fac837fe640 1 -- 172.21.15.103:0/596924018 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac7c0078e0 con 0x7fac840c3d60 2024-09-10T08:28:59.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.420+0000 7fac837fe640 1 -- 172.21.15.103:0/596924018 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c007740 con 0x7fac840c3d60 2024-09-10T08:28:59.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7fac8ad2a640 1 -- 172.21.15.103:0/596924018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac840c3d60 msgr2=0x7fac8414fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7fac8ad2a640 1 --2- 172.21.15.103:0/596924018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac840c3d60 0x7fac8414fba0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fac840c9400 tx=0x7fac7c02c760 comp rx=0 tx=0).stop 2024-09-10T08:28:59.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7f3818fd3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f381414f7b0 0x7f3814153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7f6dfffff640 1 --2- 172.21.15.103:0/319599166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e00150860 0x7f6e000c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:59.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.420+0000 7fbf63fff640 1 -- 172.21.15.103:0/1735772235 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf70015020 con 0x7fbf7c0c6bd0 2024-09-10T08:28:59.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.420+0000 7fbf63fff640 1 -- 172.21.15.103:0/1735772235 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf70011850 con 0x7fbf7c0c6bd0 2024-09-10T08:28:59.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.420+0000 7fbf63fff640 1 -- 172.21.15.103:0/1735772235 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf70011c40 con 0x7fbf7c0c6bd0 2024-09-10T08:28:59.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7fbf81b3b640 1 -- 172.21.15.103:0/1735772235 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf7c1f37b0 con 0x7fbf7c0c6bd0 2024-09-10T08:28:59.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7fbf81b3b640 1 -- 172.21.15.103:0/1735772235 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf7c1f3d70 con 0x7fbf7c0c6bd0 2024-09-10T08:28:59.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7f3818fd3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f381414f7b0 0x7f3814153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49844/0 (socket says 172.21.15.103:49844) 2024-09-10T08:28:59.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7f3818fd3640 1 -- 172.21.15.103:0/2522557638 learned_addr learned my addr 172.21.15.103:0/2522557638 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:59.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7f3813fff640 1 --2- 172.21.15.103:0/2522557638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f381414fb90 0x7f381414e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7fac8ad2a640 1 -- 172.21.15.103:0/596924018 shutdown_connections 2024-09-10T08:28:59.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7fac8ad2a640 1 --2- 172.21.15.103:0/596924018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac840c3d60 0x7fac8414fba0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7fac8ad2a640 1 --2- 172.21.15.103:0/596924018 >> v2:172.21.15.103:3300/0 conn(0x7fac840aba60 0x7fac84153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7fac8ad2a640 1 -- 172.21.15.103:0/596924018 >> 172.21.15.103:0/596924018 conn(0x7fac840c8430 msgr2=0x7fac840c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.421+0000 7f6dfeffd640 1 --2- 172.21.15.103:0/319599166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e000721a0 0x7f6e000ae410 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6df8035040 tx=0x7f6df8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.422+0000 7fac8ad2a640 1 -- 172.21.15.103:0/596924018 shutdown_connections 2024-09-10T08:28:59.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.422+0000 7f6de7fff640 1 -- 172.21.15.103:0/319599166 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df8046030 con 0x7f6e000721a0 2024-09-10T08:28:59.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.422+0000 7f6de7fff640 1 -- 172.21.15.103:0/319599166 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df8042a30 con 0x7f6e000721a0 2024-09-10T08:28:59.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.422+0000 7f6de7fff640 1 -- 172.21.15.103:0/319599166 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df8033640 con 0x7f6e000721a0 2024-09-10T08:28:59.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.422+0000 7f6e05bc0640 1 -- 172.21.15.103:0/319599166 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e0014d9e0 con 0x7f6e000721a0 2024-09-10T08:28:59.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.422+0000 7f6e05bc0640 1 -- 172.21.15.103:0/319599166 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e00150e60 con 0x7f6e000721a0 2024-09-10T08:28:59.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.423+0000 7f38197d4640 1 --2- 172.21.15.103:0/2522557638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381414ad50 0x7f381414b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.423+0000 7f3813fff640 1 -- 172.21.15.103:0/2522557638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381414ad50 msgr2=0x7f381414b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.423+0000 7f3813fff640 1 --2- 172.21.15.103:0/2522557638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381414ad50 0x7f381414b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.423+0000 7f3813fff640 1 -- 172.21.15.103:0/2522557638 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f381414f7b0 msgr2=0x7f3814153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.423+0000 7f3813fff640 1 --2- 172.21.15.103:0/2522557638 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f381414f7b0 0x7f3814153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.423+0000 7f3813fff640 1 -- 172.21.15.103:0/2522557638 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38141531c0 con 0x7f381414fb90 2024-09-10T08:28:59.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.423+0000 7f38197d4640 1 --2- 172.21.15.103:0/2522557638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381414ad50 0x7f381414b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:59.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.424+0000 7f6e05bc0640 1 -- 172.21.15.103:0/319599166 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e000695d0 con 0x7f6e000721a0 2024-09-10T08:28:59.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.424+0000 7f3813fff640 1 --2- 172.21.15.103:0/2522557638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f381414fb90 0x7f381414e340 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3814152450 tx=0x7f3808004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.422+0000 7fac8ad2a640 1 -- 172.21.15.103:0/596924018 wait complete. 2024-09-10T08:28:59.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.423+0000 7fac8ad2a640 1 Processor -- start 2024-09-10T08:28:59.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.424+0000 7f6de7fff640 1 -- 172.21.15.103:0/319599166 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6df8042c20 con 0x7f6e000721a0 2024-09-10T08:28:59.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.424+0000 7f38117fa640 1 -- 172.21.15.103:0/2522557638 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3808048070 con 0x7f381414fb90 2024-09-10T08:28:59.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.424+0000 7f38117fa640 1 -- 172.21.15.103:0/2522557638 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3808032850 con 0x7f381414fb90 2024-09-10T08:28:59.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.424+0000 7f38117fa640 1 -- 172.21.15.103:0/2522557638 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3808032c00 con 0x7f381414fb90 2024-09-10T08:28:59.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.424+0000 7f3819fd5640 1 -- 172.21.15.103:0/2522557638 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38141e7690 con 0x7f381414fb90 2024-09-10T08:28:59.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.424+0000 7f3819fd5640 1 -- 172.21.15.103:0/2522557638 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f38141e7c50 con 0x7f381414fb90 2024-09-10T08:28:59.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.425+0000 7f6de7fff640 1 --2- 172.21.15.103:0/319599166 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6dec06be80 0x7f6dec06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.425+0000 7f6de7fff640 1 -- 172.21.15.103:0/319599166 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f6df80b0af0 con 0x7f6e000721a0 2024-09-10T08:28:59.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.424+0000 7fac8ad2a640 1 -- start start 2024-09-10T08:28:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.425+0000 7f6dff7fe640 1 --2- 172.21.15.103:0/319599166 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6dec06be80 0x7f6dec06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.426+0000 7f6dff7fe640 1 --2- 172.21.15.103:0/319599166 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6dec06be80 0x7f6dec06e340 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6df0005880 tx=0x7f6df0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.422+0000 7fbf81b3b640 1 -- 172.21.15.103:0/1735772235 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf7c1562d0 con 0x7fbf7c0c6bd0 2024-09-10T08:28:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.426+0000 7fbf63fff640 1 -- 172.21.15.103:0/1735772235 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf70018020 con 0x7fbf7c0c6bd0 2024-09-10T08:28:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.426+0000 7fac8ad2a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac840aba60 0x7fac841de960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.426+0000 7f3819fd5640 1 -- 172.21.15.103:0/2522557638 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38140aa270 con 0x7f381414fb90 2024-09-10T08:28:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.426+0000 7fac88ac6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac840aba60 0x7fac841de960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.426+0000 7fac88ac6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac840aba60 0x7fac841de960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49860/0 (socket says 172.21.15.103:49860) 2024-09-10T08:28:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.426+0000 7fac88ac6640 1 -- 172.21.15.103:0/3511533630 learned_addr learned my addr 172.21.15.103:0/3511533630 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:28:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.426+0000 7fac8ad2a640 1 --2- 172.21.15.103:0/3511533630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac840c2e30 0x7fac8414e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.426+0000 7fac8ad2a640 1 --2- 172.21.15.103:0/3511533630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac840c3d60 0x7fac8414ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.426+0000 7fbf63fff640 1 --2- 172.21.15.103:0/1735772235 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbf6806bf00 0x7fbf6806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.426+0000 7fbf63fff640 1 -- 172.21.15.103:0/1735772235 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fbf7008b340 con 0x7fbf7c0c6bd0 2024-09-10T08:28:59.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.426+0000 7fac8ad2a640 1 -- 172.21.15.103:0/3511533630 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fac840c4160 con 0x7fac840aba60 2024-09-10T08:28:59.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.427+0000 7fbf7b7fe640 1 --2- 172.21.15.103:0/1735772235 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbf6806bf00 0x7fbf6806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.426+0000 7fac8ad2a640 1 -- 172.21.15.103:0/3511533630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fac840ac050 con 0x7fac840c2e30 2024-09-10T08:28:59.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.426+0000 7fac8ad2a640 1 -- 172.21.15.103:0/3511533630 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fac840c42e0 con 0x7fac840c3d60 2024-09-10T08:28:59.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.426+0000 7fac83fff640 1 --2- 172.21.15.103:0/3511533630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac840c2e30 0x7fac8414e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.427+0000 7fac892c7640 1 --2- 172.21.15.103:0/3511533630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac840c3d60 0x7fac8414ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.427+0000 7fac83fff640 1 -- 172.21.15.103:0/3511533630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac840c3d60 msgr2=0x7fac8414ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.427+0000 7fac83fff640 1 --2- 172.21.15.103:0/3511533630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac840c3d60 0x7fac8414ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.427+0000 7fac83fff640 1 -- 172.21.15.103:0/3511533630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac840aba60 msgr2=0x7fac841de960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.427+0000 7fac83fff640 1 --2- 172.21.15.103:0/3511533630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac840aba60 0x7fac841de960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.427+0000 7fac83fff640 1 -- 172.21.15.103:0/3511533630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac84153c10 con 0x7fac840c2e30 2024-09-10T08:28:59.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.427+0000 7fac892c7640 1 --2- 172.21.15.103:0/3511533630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac840c3d60 0x7fac8414ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:59.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.427+0000 7fac88ac6640 1 --2- 172.21.15.103:0/3511533630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac840aba60 0x7fac841de960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:59.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.427+0000 7fac83fff640 1 --2- 172.21.15.103:0/3511533630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac840c2e30 0x7fac8414e7d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fac70000f60 tx=0x7fac7000c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.427+0000 7fbf7b7fe640 1 --2- 172.21.15.103:0/1735772235 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbf6806bf00 0x7fbf6806e3c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c151e60 tx=0x7fbf6c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.429+0000 7fac817fa640 1 -- 172.21.15.103:0/3511533630 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70017070 con 0x7fac840c2e30 2024-09-10T08:28:59.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.429+0000 7fac817fa640 1 -- 172.21.15.103:0/3511533630 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac70005ce0 con 0x7fac840c2e30 2024-09-10T08:28:59.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.429+0000 7fac817fa640 1 -- 172.21.15.103:0/3511533630 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac700072f0 con 0x7fac840c2e30 2024-09-10T08:28:59.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.430+0000 7fbf63fff640 1 -- 172.21.15.103:0/1735772235 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbf7001f020 con 0x7fbf7c0c6bd0 2024-09-10T08:28:59.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.430+0000 7fac8ad2a640 1 -- 172.21.15.103:0/3511533630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac84153ef0 con 0x7fac840c2e30 2024-09-10T08:28:59.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.430+0000 7f6de7fff640 1 -- 172.21.15.103:0/319599166 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6df807eb00 con 0x7f6e000721a0 2024-09-10T08:28:59.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.430+0000 7fac8ad2a640 1 -- 172.21.15.103:0/3511533630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac841deea0 con 0x7fac840c2e30 2024-09-10T08:28:59.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.431+0000 7fac8ad2a640 1 -- 172.21.15.103:0/3511533630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac84154ad0 con 0x7fac840c2e30 2024-09-10T08:28:59.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.432+0000 7f38117fa640 1 -- 172.21.15.103:0/2522557638 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f380804b070 con 0x7f381414fb90 2024-09-10T08:28:59.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.433+0000 7f38117fa640 1 --2- 172.21.15.103:0/2522557638 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f380006bf30 0x7f380006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.433+0000 7f38117fa640 1 -- 172.21.15.103:0/2522557638 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f38080af4e0 con 0x7f381414fb90 2024-09-10T08:28:59.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.433+0000 7f3818fd3640 1 --2- 172.21.15.103:0/2522557638 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f380006bf30 0x7f380006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.433+0000 7fac817fa640 1 -- 172.21.15.103:0/3511533630 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fac7001a070 con 0x7fac840c2e30 2024-09-10T08:28:59.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.433+0000 7fac817fa640 1 --2- 172.21.15.103:0/3511533630 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fac6806be30 0x7fac6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.434+0000 7fac817fa640 1 -- 172.21.15.103:0/3511533630 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fac7008a410 con 0x7fac840c2e30 2024-09-10T08:28:59.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.434+0000 7fac88ac6640 1 --2- 172.21.15.103:0/3511533630 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fac6806be30 0x7fac6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.434+0000 7fac88ac6640 1 --2- 172.21.15.103:0/3511533630 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fac6806be30 0x7fac6806e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fac84150490 tx=0x7fac78009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.435+0000 7f3818fd3640 1 --2- 172.21.15.103:0/2522557638 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f380006bf30 0x7f380006e3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f381406cc40 tx=0x7f380c0075f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.435+0000 7f38117fa640 1 -- 172.21.15.103:0/2522557638 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3808052020 con 0x7f381414fb90 2024-09-10T08:28:59.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.438+0000 7fac817fa640 1 -- 172.21.15.103:0/3511533630 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac70058430 con 0x7fac840c2e30 2024-09-10T08:28:59.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.666+0000 7f8c03f2a640 1 -- 172.21.15.103:0/592887235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8bfc0ab130 con 0x7f8bfc06eb90 2024-09-10T08:28:59.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.667+0000 7f8bf27fc640 1 -- 172.21.15.103:0/592887235 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8bf805cbe0 con 0x7f8bfc06eb90 2024-09-10T08:28:59.670 INFO:teuthology.orchestra.run.smithi103.stdout:55834574858 2024-09-10T08:28:59.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.670+0000 7f8c03f2a640 1 -- 172.21.15.103:0/592887235 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8be006be80 msgr2=0x7f8be006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.670+0000 7f8c03f2a640 1 --2- 172.21.15.103:0/592887235 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8be006be80 0x7f8be006e340 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc06e2e0 tx=0x7f8bec009060 comp rx=0 tx=0).stop 2024-09-10T08:28:59.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.670+0000 7f8c03f2a640 1 -- 172.21.15.103:0/592887235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bfc06eb90 msgr2=0x7f8bfc14db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.670+0000 7f8c03f2a640 1 --2- 172.21.15.103:0/592887235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bfc06eb90 0x7f8bfc14db60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8bf800e9b0 tx=0x7f8bf800ee70 comp rx=0 tx=0).stop 2024-09-10T08:28:59.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.670+0000 7f8c03f2a640 1 -- 172.21.15.103:0/592887235 shutdown_connections 2024-09-10T08:28:59.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.670+0000 7f8c03f2a640 1 --2- 172.21.15.103:0/592887235 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8be006be80 0x7f8be006e340 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc06e2e0 tx=0x7f8bec009060 comp rx=0 tx=0).stop 2024-09-10T08:28:59.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.670+0000 7f8c03f2a640 1 --2- 172.21.15.103:0/592887235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bfc14e250 0x7f8bfc1f3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.670+0000 7f8c03f2a640 1 --2- 172.21.15.103:0/592887235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bfc0c2360 0x7f8bfc151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.670+0000 7f8c03f2a640 1 --2- 172.21.15.103:0/592887235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bfc06eb90 0x7f8bfc14db60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.671+0000 7f8c03f2a640 1 -- 172.21.15.103:0/592887235 >> 172.21.15.103:0/592887235 conn(0x7f8bfc0a9680 msgr2=0x7f8bfc0c66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.671+0000 7f8c03f2a640 1 -- 172.21.15.103:0/592887235 shutdown_connections 2024-09-10T08:28:59.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.671+0000 7f8c03f2a640 1 -- 172.21.15.103:0/592887235 wait complete. 2024-09-10T08:28:59.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.2 2024-09-10T08:28:59.688 DEBUG:teuthology.parallel:result is None 2024-09-10T08:28:59.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.750+0000 7f3819fd5640 1 -- 172.21.15.103:0/2522557638 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3814152dc0 con 0x7f381414fb90 2024-09-10T08:28:59.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.751+0000 7f38117fa640 1 -- 172.21.15.103:0/2522557638 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f380807d580 con 0x7f381414fb90 2024-09-10T08:28:59.752 INFO:teuthology.orchestra.run.smithi103.stdout:64424509450 2024-09-10T08:28:59.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.754+0000 7f3819fd5640 1 -- 172.21.15.103:0/2522557638 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f380006bf30 msgr2=0x7f380006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.754+0000 7f3819fd5640 1 --2- 172.21.15.103:0/2522557638 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f380006bf30 0x7f380006e3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f381406cc40 tx=0x7f380c0075f0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.754+0000 7f3819fd5640 1 -- 172.21.15.103:0/2522557638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f381414fb90 msgr2=0x7f381414e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.754+0000 7f3819fd5640 1 --2- 172.21.15.103:0/2522557638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f381414fb90 0x7f381414e340 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3814152450 tx=0x7f3808004730 comp rx=0 tx=0).stop 2024-09-10T08:28:59.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.754+0000 7f3819fd5640 1 -- 172.21.15.103:0/2522557638 shutdown_connections 2024-09-10T08:28:59.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.754+0000 7f3819fd5640 1 --2- 172.21.15.103:0/2522557638 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f380006bf30 0x7f380006e3f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.754+0000 7f3819fd5640 1 --2- 172.21.15.103:0/2522557638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381414ad50 0x7f381414b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.754+0000 7f3819fd5640 1 --2- 172.21.15.103:0/2522557638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f381414fb90 0x7f381414e340 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.755+0000 7f3819fd5640 1 --2- 172.21.15.103:0/2522557638 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f381414f7b0 0x7f3814153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.755+0000 7f3819fd5640 1 -- 172.21.15.103:0/2522557638 >> 172.21.15.103:0/2522557638 conn(0x7f38140a9780 msgr2=0x7f38140a7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.755+0000 7f3819fd5640 1 -- 172.21.15.103:0/2522557638 shutdown_connections 2024-09-10T08:28:59.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.755+0000 7f3819fd5640 1 -- 172.21.15.103:0/2522557638 wait complete. 2024-09-10T08:28:59.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.758+0000 7fc155ffb640 1 -- 172.21.15.103:0/2684316051 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fc150005850 con 0x7fc1700c2980 2024-09-10T08:28:59.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.759+0000 7fc157fff640 1 -- 172.21.15.103:0/2684316051 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc16005cd10 con 0x7fc1700c2980 2024-09-10T08:28:59.760 INFO:teuthology.orchestra.run.smithi103.stdout:64424509450 2024-09-10T08:28:59.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.762+0000 7fc155ffb640 1 -- 172.21.15.103:0/2684316051 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc15c06bf30 msgr2=0x7fc15c06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.762+0000 7fc155ffb640 1 --2- 172.21.15.103:0/2684316051 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc15c06bf30 0x7fc15c06e3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc168033000 tx=0x7fc168009000 comp rx=0 tx=0).stop 2024-09-10T08:28:59.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.762+0000 7fc155ffb640 1 -- 172.21.15.103:0/2684316051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1700c2980 msgr2=0x7fc17014f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.762+0000 7fc155ffb640 1 --2- 172.21.15.103:0/2684316051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1700c2980 0x7fc17014f770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc16000e9b0 tx=0x7fc16000ee70 comp rx=0 tx=0).stop 2024-09-10T08:28:59.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.762+0000 7fc155ffb640 1 -- 172.21.15.103:0/2684316051 shutdown_connections 2024-09-10T08:28:59.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.762+0000 7fc155ffb640 1 --2- 172.21.15.103:0/2684316051 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc15c06bf30 0x7fc15c06e3f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.762+0000 7fc155ffb640 1 --2- 172.21.15.103:0/2684316051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc170157ff0 0x7fc17014ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.762+0000 7fc155ffb640 1 --2- 172.21.15.103:0/2684316051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1700c5940 0x7fc1701ec590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.762+0000 7fc155ffb640 1 --2- 172.21.15.103:0/2684316051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1700c2980 0x7fc17014f770 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.762+0000 7fc155ffb640 1 -- 172.21.15.103:0/2684316051 >> 172.21.15.103:0/2684316051 conn(0x7fc1700c7a40 msgr2=0x7fc1701584b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.763+0000 7fc155ffb640 1 -- 172.21.15.103:0/2684316051 shutdown_connections 2024-09-10T08:28:59.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.763+0000 7fc155ffb640 1 -- 172.21.15.103:0/2684316051 wait complete. 2024-09-10T08:28:59.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.764+0000 7f5299f24640 1 -- 172.21.15.103:0/3361244668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f528c04a2a0 con 0x7f528c0402a0 2024-09-10T08:28:59.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.764+0000 7f52917fa640 1 -- 172.21.15.103:0/3361244668 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5280059940 con 0x7f528c0402a0 2024-09-10T08:28:59.765 INFO:teuthology.orchestra.run.smithi103.stdout:64424509450 2024-09-10T08:28:59.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.1 2024-09-10T08:28:59.768 DEBUG:teuthology.parallel:result is None 2024-09-10T08:28:59.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.767+0000 7f5299f24640 1 -- 172.21.15.103:0/3361244668 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f527806be30 msgr2=0x7f527806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.767+0000 7f5299f24640 1 --2- 172.21.15.103:0/3361244668 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f527806be30 0x7f527806e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5288000c00 tx=0x7f5288001d60 comp rx=0 tx=0).stop 2024-09-10T08:28:59.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.767+0000 7f5299f24640 1 -- 172.21.15.103:0/3361244668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f528c0402a0 msgr2=0x7f528c16d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.767+0000 7f5299f24640 1 --2- 172.21.15.103:0/3361244668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f528c0402a0 0x7f528c16d6a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f528000f8e0 tx=0x7f528000fda0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.768+0000 7f5299f24640 1 -- 172.21.15.103:0/3361244668 shutdown_connections 2024-09-10T08:28:59.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.768+0000 7f5299f24640 1 --2- 172.21.15.103:0/3361244668 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f527806be30 0x7f527806e2f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.768+0000 7f5299f24640 1 --2- 172.21.15.103:0/3361244668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528c040720 0x7f528c16dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.768+0000 7f5299f24640 1 --2- 172.21.15.103:0/3361244668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f528c0402a0 0x7f528c16d6a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.768+0000 7f5299f24640 1 --2- 172.21.15.103:0/3361244668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5284004d40 0x7f528c0d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.768+0000 7f5299f24640 1 -- 172.21.15.103:0/3361244668 >> 172.21.15.103:0/3361244668 conn(0x7f528c048e20 msgr2=0x7f528c047310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.768+0000 7f5299f24640 1 -- 172.21.15.103:0/3361244668 shutdown_connections 2024-09-10T08:28:59.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.768+0000 7f5299f24640 1 -- 172.21.15.103:0/3361244668 wait complete. 2024-09-10T08:28:59.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.770+0000 7f00d4ae9640 1 -- 172.21.15.103:0/1020269090 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f00b0005580 con 0x7f00d00c5a70 2024-09-10T08:28:59.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.771+0000 7f00b7fff640 1 -- 172.21.15.103:0/1020269090 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f00c400ce20 con 0x7f00d00c5a70 2024-09-10T08:28:59.771 INFO:teuthology.orchestra.run.smithi103.stdout:64424509449 2024-09-10T08:28:59.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.773+0000 7f00d4ae9640 1 -- 172.21.15.103:0/1020269090 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f00bc06bf00 msgr2=0x7f00bc06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.773+0000 7f00d4ae9640 1 --2- 172.21.15.103:0/1020269090 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f00bc06bf00 0x7f00bc06e3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f00c0009990 tx=0x7f00c0009110 comp rx=0 tx=0).stop 2024-09-10T08:28:59.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.773+0000 7f00d4ae9640 1 -- 172.21.15.103:0/1020269090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00d00c5a70 msgr2=0x7f00d014f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.773+0000 7f00d4ae9640 1 --2- 172.21.15.103:0/1020269090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00d00c5a70 0x7f00d014f440 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f00c400c7d0 tx=0x7f00c400cbd0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.773+0000 7f00d4ae9640 1 -- 172.21.15.103:0/1020269090 shutdown_connections 2024-09-10T08:28:59.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.773+0000 7f00d4ae9640 1 --2- 172.21.15.103:0/1020269090 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f00bc06bf00 0x7f00bc06e3c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.773+0000 7f00d4ae9640 1 --2- 172.21.15.103:0/1020269090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d00c5ee0 0x7f00d014f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.773+0000 7f00d4ae9640 1 --2- 172.21.15.103:0/1020269090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00d00c5a70 0x7f00d014f440 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.773+0000 7f00d4ae9640 1 --2- 172.21.15.103:0/1020269090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00d006f660 0x7f00d00bdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.773+0000 7f00d4ae9640 1 -- 172.21.15.103:0/1020269090 >> 172.21.15.103:0/1020269090 conn(0x7f00d00c8e70 msgr2=0x7f00d0152010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.773+0000 7f00d4ae9640 1 -- 172.21.15.103:0/1020269090 shutdown_connections 2024-09-10T08:28:59.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.773+0000 7f00d4ae9640 1 -- 172.21.15.103:0/1020269090 wait complete. 2024-09-10T08:28:59.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.7 2024-09-10T08:28:59.781 DEBUG:teuthology.parallel:result is None 2024-09-10T08:28:59.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.0 2024-09-10T08:28:59.784 DEBUG:teuthology.parallel:result is None 2024-09-10T08:28:59.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.5 2024-09-10T08:28:59.787 DEBUG:teuthology.parallel:result is None 2024-09-10T08:28:59.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.800+0000 7f6e05bc0640 1 -- 172.21.15.103:0/319599166 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f6e0006edb0 con 0x7f6e000721a0 2024-09-10T08:28:59.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.801+0000 7f6de7fff640 1 -- 172.21.15.103:0/319599166 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6df8082e00 con 0x7f6e000721a0 2024-09-10T08:28:59.801 INFO:teuthology.orchestra.run.smithi103.stdout:64424509451 2024-09-10T08:28:59.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.803+0000 7f6e05bc0640 1 -- 172.21.15.103:0/319599166 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6dec06be80 msgr2=0x7f6dec06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.803+0000 7f6e05bc0640 1 --2- 172.21.15.103:0/319599166 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6dec06be80 0x7f6dec06e340 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6df0005880 tx=0x7f6df0009040 comp rx=0 tx=0).stop 2024-09-10T08:28:59.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.803+0000 7f6e05bc0640 1 -- 172.21.15.103:0/319599166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e000721a0 msgr2=0x7f6e000ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.803+0000 7f6e05bc0640 1 --2- 172.21.15.103:0/319599166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e000721a0 0x7f6e000ae410 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6df8035040 tx=0x7f6df8004a40 comp rx=0 tx=0).stop 2024-09-10T08:28:59.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.803+0000 7f6e05bc0640 1 -- 172.21.15.103:0/319599166 shutdown_connections 2024-09-10T08:28:59.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.803+0000 7f6e05bc0640 1 --2- 172.21.15.103:0/319599166 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6dec06be80 0x7f6dec06e340 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.803+0000 7f6e05bc0640 1 --2- 172.21.15.103:0/319599166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e00150860 0x7f6e000c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.803+0000 7f6e05bc0640 1 --2- 172.21.15.103:0/319599166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e000721a0 0x7f6e000ae410 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.803+0000 7f6e05bc0640 1 --2- 172.21.15.103:0/319599166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e0006efd0 0x7f6e001e8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.803+0000 7f6e05bc0640 1 -- 172.21.15.103:0/319599166 >> 172.21.15.103:0/319599166 conn(0x7f6e0006ccf0 msgr2=0x7f6e00145e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.803+0000 7f6e05bc0640 1 -- 172.21.15.103:0/319599166 shutdown_connections 2024-09-10T08:28:59.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.803+0000 7f6e05bc0640 1 -- 172.21.15.103:0/319599166 wait complete. 2024-09-10T08:28:59.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.4 2024-09-10T08:28:59.814 DEBUG:teuthology.parallel:result is None 2024-09-10T08:28:59.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.832+0000 7fbf81b3b640 1 -- 172.21.15.103:0/1735772235 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fbf7c0ab5e0 con 0x7fbf7c0c6bd0 2024-09-10T08:28:59.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.833+0000 7fbf63fff640 1 -- 172.21.15.103:0/1735772235 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbf70059a30 con 0x7fbf7c0c6bd0 2024-09-10T08:28:59.833 INFO:teuthology.orchestra.run.smithi103.stdout:55834574856 2024-09-10T08:28:59.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.836+0000 7fbf81b3b640 1 -- 172.21.15.103:0/1735772235 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbf6806bf00 msgr2=0x7fbf6806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.836+0000 7fbf81b3b640 1 --2- 172.21.15.103:0/1735772235 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbf6806bf00 0x7fbf6806e3c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c151e60 tx=0x7fbf6c008040 comp rx=0 tx=0).stop 2024-09-10T08:28:59.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.836+0000 7fbf81b3b640 1 -- 172.21.15.103:0/1735772235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf7c0c6bd0 msgr2=0x7fbf7c0a8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.836+0000 7fbf81b3b640 1 --2- 172.21.15.103:0/1735772235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf7c0c6bd0 0x7fbf7c0a8620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbf7000b3e0 tx=0x7fbf7000b8a0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.836+0000 7fbf81b3b640 1 -- 172.21.15.103:0/1735772235 shutdown_connections 2024-09-10T08:28:59.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.836+0000 7fbf81b3b640 1 --2- 172.21.15.103:0/1735772235 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbf6806bf00 0x7fbf6806e3c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.836+0000 7fbf81b3b640 1 --2- 172.21.15.103:0/1735772235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf7c0c7230 0x7fbf7c153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.836+0000 7fbf81b3b640 1 --2- 172.21.15.103:0/1735772235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf7c0c6bd0 0x7fbf7c0a8620 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.836+0000 7fbf81b3b640 1 --2- 172.21.15.103:0/1735772235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c06edd0 0x7fbf7c0a7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.836+0000 7fbf81b3b640 1 -- 172.21.15.103:0/1735772235 >> 172.21.15.103:0/1735772235 conn(0x7fbf7c0c7a40 msgr2=0x7fbf7c0abe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.836+0000 7fbf81b3b640 1 -- 172.21.15.103:0/1735772235 shutdown_connections 2024-09-10T08:28:59.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.836+0000 7fbf81b3b640 1 -- 172.21.15.103:0/1735772235 wait complete. 2024-09-10T08:28:59.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.850+0000 7fac8ad2a640 1 -- 172.21.15.103:0/3511533630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fac84153390 con 0x7fac840c2e30 2024-09-10T08:28:59.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2024-09-10T08:28:59.851 INFO:teuthology.orchestra.run.smithi103.stdout:64424509451 2024-09-10T08:28:59.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.850+0000 7fac817fa640 1 -- 172.21.15.103:0/3511533630 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fac7005c730 con 0x7fac840c2e30 2024-09-10T08:28:59.851 DEBUG:teuthology.parallel:result is None 2024-09-10T08:28:59.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.852+0000 7fac8ad2a640 1 -- 172.21.15.103:0/3511533630 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fac6806be30 msgr2=0x7fac6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.852+0000 7fac8ad2a640 1 --2- 172.21.15.103:0/3511533630 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fac6806be30 0x7fac6806e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fac84150490 tx=0x7fac78009190 comp rx=0 tx=0).stop 2024-09-10T08:28:59.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.852+0000 7fac8ad2a640 1 -- 172.21.15.103:0/3511533630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac840c2e30 msgr2=0x7fac8414e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.852+0000 7fac8ad2a640 1 --2- 172.21.15.103:0/3511533630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac840c2e30 0x7fac8414e7d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fac70000f60 tx=0x7fac7000c800 comp rx=0 tx=0).stop 2024-09-10T08:28:59.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.852+0000 7fac8ad2a640 1 -- 172.21.15.103:0/3511533630 shutdown_connections 2024-09-10T08:28:59.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.852+0000 7fac8ad2a640 1 --2- 172.21.15.103:0/3511533630 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fac6806be30 0x7fac6806e2f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.852+0000 7fac8ad2a640 1 --2- 172.21.15.103:0/3511533630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac840c3d60 0x7fac8414ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.852+0000 7fac8ad2a640 1 --2- 172.21.15.103:0/3511533630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac840c2e30 0x7fac8414e7d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.852+0000 7fac8ad2a640 1 --2- 172.21.15.103:0/3511533630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac840aba60 0x7fac841de960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.852+0000 7fac8ad2a640 1 -- 172.21.15.103:0/3511533630 >> 172.21.15.103:0/3511533630 conn(0x7fac840c8430 msgr2=0x7fac840c4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.852+0000 7fac8ad2a640 1 -- 172.21.15.103:0/3511533630 shutdown_connections 2024-09-10T08:28:59.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:28:59.852+0000 7fac8ad2a640 1 -- 172.21.15.103:0/3511533630 wait complete. 2024-09-10T08:28:59.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.3 2024-09-10T08:28:59.863 DEBUG:teuthology.parallel:result is None 2024-09-10T08:28:59.864 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:28:59.864 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:29:00.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.001+0000 7f1cb45c4640 1 Processor -- start 2024-09-10T08:29:00.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.001+0000 7f1cb45c4640 1 -- start start 2024-09-10T08:29:00.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.002+0000 7f1cb45c4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cac0c84e0 0x7f1cac06e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.002+0000 7f1cb45c4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1cac06ec10 0x7f1cac160c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.002+0000 7f1cb45c4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cac15a830 con 0x7f1cac15a450 2024-09-10T08:29:00.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.002+0000 7f1cb45c4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1cac06e240 con 0x7f1cac06ec10 2024-09-10T08:29:00.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.002+0000 7f1cb45c4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1cac0c7490 con 0x7f1cac0c84e0 2024-09-10T08:29:00.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.002+0000 7f1cb2360640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1cac15a450 0x7f1cac0c3a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50198/0 (socket says 172.21.15.103:50198) 2024-09-10T08:29:00.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.002+0000 7f1cb2360640 1 -- 172.21.15.103:0/1973797760 learned_addr learned my addr 172.21.15.103:0/1973797760 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:29:00.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb1b5f640 1 --2- 172.21.15.103:0/1973797760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cac0c84e0 0x7f1cac06e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb135e640 1 -- 172.21.15.103:0/1973797760 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 40826043 0 0) 0x7f1cac15a830 con 0x7f1cac15a450 2024-09-10T08:29:00.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb2b61640 1 --2- 172.21.15.103:0/1973797760 >> v2:172.21.15.154:3300/0 conn(0x7f1cac06ec10 0x7f1cac160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb135e640 1 -- 172.21.15.103:0/1973797760 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c98003520 con 0x7f1cac15a450 2024-09-10T08:29:00.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb135e640 1 -- 172.21.15.103:0/1973797760 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 630960889 0 0) 0x7f1c98003520 con 0x7f1cac15a450 2024-09-10T08:29:00.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb135e640 1 -- 172.21.15.103:0/1973797760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cac0c84e0 msgr2=0x7f1cac06e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:00.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb135e640 1 --2- 172.21.15.103:0/1973797760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cac0c84e0 0x7f1cac06e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb135e640 1 -- 172.21.15.103:0/1973797760 >> v2:172.21.15.154:3300/0 conn(0x7f1cac06ec10 msgr2=0x7f1cac160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:00.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb135e640 1 --2- 172.21.15.103:0/1973797760 >> v2:172.21.15.154:3300/0 conn(0x7f1cac06ec10 0x7f1cac160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb135e640 1 -- 172.21.15.103:0/1973797760 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cac0c7770 con 0x7f1cac15a450 2024-09-10T08:29:00.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb135e640 1 -- 172.21.15.103:0/1973797760 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f1c9c001670 con 0x7f1cac15a450 2024-09-10T08:29:00.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb135e640 1 -- 172.21.15.103:0/1973797760 >> v1:172.21.15.103:6789/0 conn(0x7f1cac15a450 legacy=0x7f1cac0c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb135e640 1 --2- 172.21.15.103:0/1973797760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c980039b0 0x7f1c98003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb135e640 1 --2- 172.21.15.103:0/1973797760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cac0c84e0 0x7f1c98004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb135e640 1 --2- 172.21.15.103:0/1973797760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c98004d40 0x7f1c980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb135e640 1 -- 172.21.15.103:0/1973797760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac06e240 con 0x7f1c980039b0 2024-09-10T08:29:00.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb135e640 1 -- 172.21.15.103:0/1973797760 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac0c7490 con 0x7f1c98004d40 2024-09-10T08:29:00.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb135e640 1 -- 172.21.15.103:0/1973797760 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1c9800b9c0 con 0x7f1cac0c84e0 2024-09-10T08:29:00.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb2360640 1 --2- 172.21.15.103:0/1973797760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c980039b0 0x7f1c98003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb1b5f640 1 --2- 172.21.15.103:0/1973797760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cac0c84e0 0x7f1c98004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb2b61640 1 --2- 172.21.15.103:0/1973797760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c98004d40 0x7f1c980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb2360640 1 -- 172.21.15.103:0/1973797760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cac0c84e0 msgr2=0x7f1c98004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:00.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb2360640 1 --2- 172.21.15.103:0/1973797760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cac0c84e0 0x7f1c98004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb2360640 1 -- 172.21.15.103:0/1973797760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c98004d40 msgr2=0x7f1c980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:00.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb2360640 1 --2- 172.21.15.103:0/1973797760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c98004d40 0x7f1c980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.003+0000 7f1cb2360640 1 -- 172.21.15.103:0/1973797760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c98003520 con 0x7f1c980039b0 2024-09-10T08:29:00.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.004+0000 7f1cb2360640 1 --2- 172.21.15.103:0/1973797760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c980039b0 0x7f1c98003dd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c00c290 tx=0x7f1c98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f01de02cb28141a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:00.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.004+0000 7f1cb135e640 1 -- 172.21.15.103:0/1973797760 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c007d50 con 0x7f1c980039b0 2024-09-10T08:29:00.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.004+0000 7f1cb135e640 1 -- 172.21.15.103:0/1973797760 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c9c005af0 con 0x7f1c980039b0 2024-09-10T08:29:00.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.004+0000 7f1cb135e640 1 -- 172.21.15.103:0/1973797760 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c007070 con 0x7f1c980039b0 2024-09-10T08:29:00.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.005+0000 7f1cb45c4640 1 -- 172.21.15.103:0/1973797760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c980039b0 msgr2=0x7f1c98003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.005+0000 7f1cb45c4640 1 --2- 172.21.15.103:0/1973797760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c980039b0 0x7f1c98003dd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c00c290 tx=0x7f1c98005830 comp rx=0 tx=0).stop 2024-09-10T08:29:00.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.005+0000 7f1cb2b61640 1 -- 172.21.15.103:0/1973797760 reap_dead start 2024-09-10T08:29:00.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.005+0000 7f1cb45c4640 1 -- 172.21.15.103:0/1973797760 shutdown_connections 2024-09-10T08:29:00.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.005+0000 7f1cb45c4640 1 -- 172.21.15.103:0/1973797760 >> 172.21.15.103:0/1973797760 conn(0x7f1cac0c5660 msgr2=0x7f1cac0c5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:00.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.005+0000 7f1cb45c4640 1 -- 172.21.15.103:0/1973797760 shutdown_connections 2024-09-10T08:29:00.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.005+0000 7f1cb45c4640 1 -- 172.21.15.103:0/1973797760 wait complete. 2024-09-10T08:29:00.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.006+0000 7f1cb45c4640 1 Processor -- start 2024-09-10T08:29:00.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.006+0000 7f1cb45c4640 1 -- start start 2024-09-10T08:29:00.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1cb45c4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c980039b0 0x7f1cac14ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1cb45c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cac071a40 0x7f1cac073900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1cb45c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cac073e40 0x7f1cac1552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1cb45c4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac0c41a0 con 0x7f1cac071a40 2024-09-10T08:29:00.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1cb45c4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac0c7d30 con 0x7f1cac073e40 2024-09-10T08:29:00.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1cb45c4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1cac0c4320 con 0x7f1c980039b0 2024-09-10T08:29:00.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1cb1b5f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cac071a40 0x7f1cac073900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1cb1b5f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cac071a40 0x7f1cac073900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49874/0 (socket says 172.21.15.103:49874) 2024-09-10T08:29:00.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1cb1b5f640 1 -- 172.21.15.103:0/1748396057 learned_addr learned my addr 172.21.15.103:0/1748396057 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:00.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1cb2b61640 1 --2- 172.21.15.103:0/1748396057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cac073e40 0x7f1cac1552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1cb2360640 1 --2- 172.21.15.103:0/1748396057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c980039b0 0x7f1cac14ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1cb1b5f640 1 -- 172.21.15.103:0/1748396057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c980039b0 msgr2=0x7f1cac14ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1cb1b5f640 1 --2- 172.21.15.103:0/1748396057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c980039b0 0x7f1cac14ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1cb1b5f640 1 -- 172.21.15.103:0/1748396057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cac073e40 msgr2=0x7f1cac1552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1cb1b5f640 1 --2- 172.21.15.103:0/1748396057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cac073e40 0x7f1cac1552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1cb1b5f640 1 -- 172.21.15.103:0/1748396057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cac1f0150 con 0x7f1cac071a40 2024-09-10T08:29:00.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1cb2b61640 1 --2- 172.21.15.103:0/1748396057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cac073e40 0x7f1cac1552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:00.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1cb1b5f640 1 --2- 172.21.15.103:0/1748396057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cac071a40 0x7f1cac073900 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8011940 tx=0x7f1ca8011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:00.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1ca2ffd640 1 -- 172.21.15.103:0/1748396057 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca800faf0 con 0x7f1cac071a40 2024-09-10T08:29:00.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1ca2ffd640 1 -- 172.21.15.103:0/1748396057 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca800fc90 con 0x7f1cac071a40 2024-09-10T08:29:00.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1ca2ffd640 1 -- 172.21.15.103:0/1748396057 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8014440 con 0x7f1cac071a40 2024-09-10T08:29:00.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1cb45c4640 1 -- 172.21.15.103:0/1748396057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cac0a7d60 con 0x7f1cac071a40 2024-09-10T08:29:00.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.007+0000 7f1cb45c4640 1 -- 172.21.15.103:0/1748396057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cac06ff90 con 0x7f1cac071a40 2024-09-10T08:29:00.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.008+0000 7f1cb45c4640 1 -- 172.21.15.103:0/1748396057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cac06c710 con 0x7f1cac071a40 2024-09-10T08:29:00.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.009+0000 7f1ca2ffd640 1 -- 172.21.15.103:0/1748396057 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1ca8012040 con 0x7f1cac071a40 2024-09-10T08:29:00.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.009+0000 7f1ca2ffd640 1 --2- 172.21.15.103:0/1748396057 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1c9006be60 0x7f1c9006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.009+0000 7f1cb2360640 1 --2- 172.21.15.103:0/1748396057 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1c9006be60 0x7f1c9006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.009+0000 7f1ca2ffd640 1 -- 172.21.15.103:0/1748396057 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f1ca808b7f0 con 0x7f1cac071a40 2024-09-10T08:29:00.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.010+0000 7f1cb2360640 1 --2- 172.21.15.103:0/1748396057 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1c9006be60 0x7f1c9006e320 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c033000 tx=0x7f1c9c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:00.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.014+0000 7f1ca2ffd640 1 -- 172.21.15.103:0/1748396057 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1ca8019030 con 0x7f1cac071a40 2024-09-10T08:29:00.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.176+0000 7f1cb45c4640 1 -- 172.21.15.103:0/1748396057 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1cac0c3660 con 0x7f1c9006be60 2024-09-10T08:29:00.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.186+0000 7f1ca2ffd640 1 -- 172.21.15.103:0/1748396057 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490308 (secure 0 0 0) 0x7f1cac0c3660 con 0x7f1c9006be60 2024-09-10T08:29:00.192 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:29:00.196 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T08:29:00.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.191+0000 7f1cb45c4640 1 -- 172.21.15.103:0/1748396057 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1c9006be60 msgr2=0x7f1c9006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.191+0000 7f1cb45c4640 1 --2- 172.21.15.103:0/1748396057 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1c9006be60 0x7f1c9006e320 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c033000 tx=0x7f1c9c009030 comp rx=0 tx=0).stop 2024-09-10T08:29:00.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.191+0000 7f1cb45c4640 1 -- 172.21.15.103:0/1748396057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cac071a40 msgr2=0x7f1cac073900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.191+0000 7f1cb45c4640 1 --2- 172.21.15.103:0/1748396057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cac071a40 0x7f1cac073900 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8011940 tx=0x7f1ca8011e00 comp rx=0 tx=0).stop 2024-09-10T08:29:00.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.191+0000 7f1cb45c4640 1 -- 172.21.15.103:0/1748396057 shutdown_connections 2024-09-10T08:29:00.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.191+0000 7f1cb45c4640 1 --2- 172.21.15.103:0/1748396057 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1c9006be60 0x7f1c9006e320 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.191+0000 7f1cb45c4640 1 --2- 172.21.15.103:0/1748396057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cac073e40 0x7f1cac1552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.191+0000 7f1cb45c4640 1 --2- 172.21.15.103:0/1748396057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cac071a40 0x7f1cac073900 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.191+0000 7f1cb45c4640 1 --2- 172.21.15.103:0/1748396057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c980039b0 0x7f1cac14ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.191+0000 7f1cb45c4640 1 -- 172.21.15.103:0/1748396057 >> 172.21.15.103:0/1748396057 conn(0x7f1cac0c5660 msgr2=0x7f1cac0c3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:00.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.191+0000 7f1cb45c4640 1 -- 172.21.15.103:0/1748396057 shutdown_connections 2024-09-10T08:29:00.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.191+0000 7f1cb45c4640 1 -- 172.21.15.103:0/1748396057 wait complete. 2024-09-10T08:29:00.202 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-10T08:28:58.798642+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219544,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755176,"statfs":{"total":773094113280,"available":772869300224,"internally_reserved":0,"allocated":3383296,"data_stored":1998968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.178713"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619978+0000","last_change":"2024-09-10T08:28:47.627476+0000","last_active":"2024-09-10T08:28:48.619978+0000","last_peered":"2024-09-10T08:28:48.619978+0000","last_clean":"2024-09-10T08:28:48.619978+0000","last_became_active":"2024-09-10T08:28:47.627217+0000","last_became_peered":"2024-09-10T08:28:47.627217+0000","last_unstale":"2024-09-10T08:28:48.619978+0000","last_undegraded":"2024-09-10T08:28:48.619978+0000","last_fullsized":"2024-09-10T08:28:48.619978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:25.152836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632023+0000","last_change":"2024-09-10T08:28:34.564816+0000","last_active":"2024-09-10T08:28:48.632023+0000","last_peered":"2024-09-10T08:28:48.632023+0000","last_clean":"2024-09-10T08:28:48.632023+0000","last_became_active":"2024-09-10T08:28:34.564545+0000","last_became_peered":"2024-09-10T08:28:34.564545+0000","last_unstale":"2024-09-10T08:28:48.632023+0000","last_undegraded":"2024-09-10T08:28:48.632023+0000","last_fullsized":"2024-09-10T08:28:48.632023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:34.365104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622355+0000","last_change":"2024-09-10T08:28:35.575267+0000","last_active":"2024-09-10T08:28:48.622355+0000","last_peered":"2024-09-10T08:28:48.622355+0000","last_clean":"2024-09-10T08:28:48.622355+0000","last_became_active":"2024-09-10T08:28:35.575019+0000","last_became_peered":"2024-09-10T08:28:35.575019+0000","last_unstale":"2024-09-10T08:28:48.622355+0000","last_undegraded":"2024-09-10T08:28:48.622355+0000","last_fullsized":"2024-09-10T08:28:48.622355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:00.810645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621493+0000","last_change":"2024-09-10T08:28:46.620227+0000","last_active":"2024-09-10T08:28:48.621493+0000","last_peered":"2024-09-10T08:28:48.621493+0000","last_clean":"2024-09-10T08:28:48.621493+0000","last_became_active":"2024-09-10T08:28:46.619540+0000","last_became_peered":"2024-09-10T08:28:46.619540+0000","last_unstale":"2024-09-10T08:28:48.621493+0000","last_undegraded":"2024-09-10T08:28:48.621493+0000","last_fullsized":"2024-09-10T08:28:48.621493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:13.402155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633949+0000","last_change":"2024-09-10T08:28:47.633586+0000","last_active":"2024-09-10T08:28:48.633949+0000","last_peered":"2024-09-10T08:28:48.633949+0000","last_clean":"2024-09-10T08:28:48.633949+0000","last_became_active":"2024-09-10T08:28:47.633292+0000","last_became_peered":"2024-09-10T08:28:47.633292+0000","last_unstale":"2024-09-10T08:28:48.633949+0000","last_undegraded":"2024-09-10T08:28:48.633949+0000","last_fullsized":"2024-09-10T08:28:48.633949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:19.473028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622448+0000","last_change":"2024-09-10T08:28:34.561691+0000","last_active":"2024-09-10T08:28:48.622448+0000","last_peered":"2024-09-10T08:28:48.622448+0000","last_clean":"2024-09-10T08:28:48.622448+0000","last_became_active":"2024-09-10T08:28:34.561410+0000","last_became_peered":"2024-09-10T08:28:34.561410+0000","last_unstale":"2024-09-10T08:28:48.622448+0000","last_undegraded":"2024-09-10T08:28:48.622448+0000","last_fullsized":"2024-09-10T08:28:48.622448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.629982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631878+0000","last_change":"2024-09-10T08:28:35.579033+0000","last_active":"2024-09-10T08:28:48.631878+0000","last_peered":"2024-09-10T08:28:48.631878+0000","last_clean":"2024-09-10T08:28:48.631878+0000","last_became_active":"2024-09-10T08:28:35.578333+0000","last_became_peered":"2024-09-10T08:28:35.578333+0000","last_unstale":"2024-09-10T08:28:48.631878+0000","last_undegraded":"2024-09-10T08:28:48.631878+0000","last_fullsized":"2024-09-10T08:28:48.631878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:58.779491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619633+0000","last_change":"2024-09-10T08:28:46.617317+0000","last_active":"2024-09-10T08:28:48.619633+0000","last_peered":"2024-09-10T08:28:48.619633+0000","last_clean":"2024-09-10T08:28:48.619633+0000","last_became_active":"2024-09-10T08:28:46.616806+0000","last_became_peered":"2024-09-10T08:28:46.616806+0000","last_unstale":"2024-09-10T08:28:48.619633+0000","last_undegraded":"2024-09-10T08:28:48.619633+0000","last_fullsized":"2024-09-10T08:28:48.619633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:46.916848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354201+0000","last_change":"2024-09-10T08:28:47.633194+0000","last_active":"2024-09-10T08:28:49.354201+0000","last_peered":"2024-09-10T08:28:49.354201+0000","last_clean":"2024-09-10T08:28:49.354201+0000","last_became_active":"2024-09-10T08:28:47.632772+0000","last_became_peered":"2024-09-10T08:28:47.632772+0000","last_unstale":"2024-09-10T08:28:49.354201+0000","last_undegraded":"2024-09-10T08:28:49.354201+0000","last_fullsized":"2024-09-10T08:28:49.354201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:59.228438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354864+0000","last_change":"2024-09-10T08:28:34.571965+0000","last_active":"2024-09-10T08:28:49.354864+0000","last_peered":"2024-09-10T08:28:49.354864+0000","last_clean":"2024-09-10T08:28:49.354864+0000","last_became_active":"2024-09-10T08:28:34.571640+0000","last_became_peered":"2024-09-10T08:28:34.571640+0000","last_unstale":"2024-09-10T08:28:49.354864+0000","last_undegraded":"2024-09-10T08:28:49.354864+0000","last_fullsized":"2024-09-10T08:28:49.354864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:53.047030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621272+0000","last_change":"2024-09-10T08:28:35.562132+0000","last_active":"2024-09-10T08:28:48.621272+0000","last_peered":"2024-09-10T08:28:48.621272+0000","last_clean":"2024-09-10T08:28:48.621272+0000","last_became_active":"2024-09-10T08:28:35.561842+0000","last_became_peered":"2024-09-10T08:28:35.561842+0000","last_unstale":"2024-09-10T08:28:48.621272+0000","last_undegraded":"2024-09-10T08:28:48.621272+0000","last_fullsized":"2024-09-10T08:28:48.621272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:48.810258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620177+0000","last_change":"2024-09-10T08:28:46.621093+0000","last_active":"2024-09-10T08:28:48.620177+0000","last_peered":"2024-09-10T08:28:48.620177+0000","last_clean":"2024-09-10T08:28:48.620177+0000","last_became_active":"2024-09-10T08:28:46.620794+0000","last_became_peered":"2024-09-10T08:28:46.620794+0000","last_unstale":"2024-09-10T08:28:48.620177+0000","last_undegraded":"2024-09-10T08:28:48.620177+0000","last_fullsized":"2024-09-10T08:28:48.620177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:20.501262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620906+0000","last_change":"2024-09-10T08:28:47.627756+0000","last_active":"2024-09-10T08:28:48.620906+0000","last_peered":"2024-09-10T08:28:48.620906+0000","last_clean":"2024-09-10T08:28:48.620906+0000","last_became_active":"2024-09-10T08:28:47.627476+0000","last_became_peered":"2024-09-10T08:28:47.627476+0000","last_unstale":"2024-09-10T08:28:48.620906+0000","last_undegraded":"2024-09-10T08:28:48.620906+0000","last_fullsized":"2024-09-10T08:28:48.620906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:25.945793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354598+0000","last_change":"2024-09-10T08:28:34.566560+0000","last_active":"2024-09-10T08:28:49.354598+0000","last_peered":"2024-09-10T08:28:49.354598+0000","last_clean":"2024-09-10T08:28:49.354598+0000","last_became_active":"2024-09-10T08:28:34.566275+0000","last_became_peered":"2024-09-10T08:28:34.566275+0000","last_unstale":"2024-09-10T08:28:49.354598+0000","last_undegraded":"2024-09-10T08:28:49.354598+0000","last_fullsized":"2024-09-10T08:28:49.354598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:03.507683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621503+0000","last_change":"2024-09-10T08:28:35.560380+0000","last_active":"2024-09-10T08:28:48.621503+0000","last_peered":"2024-09-10T08:28:48.621503+0000","last_clean":"2024-09-10T08:28:48.621503+0000","last_became_active":"2024-09-10T08:28:35.560095+0000","last_became_peered":"2024-09-10T08:28:35.560095+0000","last_unstale":"2024-09-10T08:28:48.621503+0000","last_undegraded":"2024-09-10T08:28:48.621503+0000","last_fullsized":"2024-09-10T08:28:48.621503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:20.047446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621446+0000","last_change":"2024-09-10T08:28:46.620162+0000","last_active":"2024-09-10T08:28:48.621446+0000","last_peered":"2024-09-10T08:28:48.621446+0000","last_clean":"2024-09-10T08:28:48.621446+0000","last_became_active":"2024-09-10T08:28:46.619889+0000","last_became_peered":"2024-09-10T08:28:46.619889+0000","last_unstale":"2024-09-10T08:28:48.621446+0000","last_undegraded":"2024-09-10T08:28:48.621446+0000","last_fullsized":"2024-09-10T08:28:48.621446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:13.820143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634225+0000","last_change":"2024-09-10T08:28:47.631094+0000","last_active":"2024-09-10T08:28:48.634225+0000","last_peered":"2024-09-10T08:28:48.634225+0000","last_clean":"2024-09-10T08:28:48.634225+0000","last_became_active":"2024-09-10T08:28:47.630787+0000","last_became_peered":"2024-09-10T08:28:47.630787+0000","last_unstale":"2024-09-10T08:28:48.634225+0000","last_undegraded":"2024-09-10T08:28:48.634225+0000","last_fullsized":"2024-09-10T08:28:48.634225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:06.277094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421323+0000","last_change":"2024-09-10T08:28:35.572478+0000","last_active":"2024-09-10T08:28:49.421323+0000","last_peered":"2024-09-10T08:28:49.421323+0000","last_clean":"2024-09-10T08:28:49.421323+0000","last_became_active":"2024-09-10T08:28:35.572215+0000","last_became_peered":"2024-09-10T08:28:35.572215+0000","last_unstale":"2024-09-10T08:28:49.421323+0000","last_undegraded":"2024-09-10T08:28:49.421323+0000","last_fullsized":"2024-09-10T08:28:49.421323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:40.397318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354464+0000","last_change":"2024-09-10T08:28:34.569235+0000","last_active":"2024-09-10T08:28:49.354464+0000","last_peered":"2024-09-10T08:28:49.354464+0000","last_clean":"2024-09-10T08:28:49.354464+0000","last_became_active":"2024-09-10T08:28:34.568899+0000","last_became_peered":"2024-09-10T08:28:34.568899+0000","last_unstale":"2024-09-10T08:28:49.354464+0000","last_undegraded":"2024-09-10T08:28:49.354464+0000","last_fullsized":"2024-09-10T08:28:49.354464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:21.927656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620338+0000","last_change":"2024-09-10T08:28:46.618502+0000","last_active":"2024-09-10T08:28:48.620338+0000","last_peered":"2024-09-10T08:28:48.620338+0000","last_clean":"2024-09-10T08:28:48.620338+0000","last_became_active":"2024-09-10T08:28:46.616824+0000","last_became_peered":"2024-09-10T08:28:46.616824+0000","last_unstale":"2024-09-10T08:28:48.620338+0000","last_undegraded":"2024-09-10T08:28:48.620338+0000","last_fullsized":"2024-09-10T08:28:48.620338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:06.554102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299968+0000","last_change":"2024-09-10T08:28:47.627138+0000","last_active":"2024-09-10T08:28:49.299968+0000","last_peered":"2024-09-10T08:28:49.299968+0000","last_clean":"2024-09-10T08:28:49.299968+0000","last_became_active":"2024-09-10T08:28:47.626871+0000","last_became_peered":"2024-09-10T08:28:47.626871+0000","last_unstale":"2024-09-10T08:28:49.299968+0000","last_undegraded":"2024-09-10T08:28:49.299968+0000","last_fullsized":"2024-09-10T08:28:49.299968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:10.927283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621888+0000","last_change":"2024-09-10T08:28:35.577024+0000","last_active":"2024-09-10T08:28:48.621888+0000","last_peered":"2024-09-10T08:28:48.621888+0000","last_clean":"2024-09-10T08:28:48.621888+0000","last_became_active":"2024-09-10T08:28:35.576771+0000","last_became_peered":"2024-09-10T08:28:35.576771+0000","last_unstale":"2024-09-10T08:28:48.621888+0000","last_undegraded":"2024-09-10T08:28:48.621888+0000","last_fullsized":"2024-09-10T08:28:48.621888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:07.162941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634491+0000","last_change":"2024-09-10T08:28:34.561324+0000","last_active":"2024-09-10T08:28:48.634491+0000","last_peered":"2024-09-10T08:28:48.634491+0000","last_clean":"2024-09-10T08:28:48.634491+0000","last_became_active":"2024-09-10T08:28:34.560974+0000","last_became_peered":"2024-09-10T08:28:34.560974+0000","last_unstale":"2024-09-10T08:28:48.634491+0000","last_undegraded":"2024-09-10T08:28:48.634491+0000","last_fullsized":"2024-09-10T08:28:48.634491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:18.790965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621289+0000","last_change":"2024-09-10T08:28:46.620411+0000","last_active":"2024-09-10T08:28:48.621289+0000","last_peered":"2024-09-10T08:28:48.621289+0000","last_clean":"2024-09-10T08:28:48.621289+0000","last_became_active":"2024-09-10T08:28:46.619553+0000","last_became_peered":"2024-09-10T08:28:46.619553+0000","last_unstale":"2024-09-10T08:28:48.621289+0000","last_undegraded":"2024-09-10T08:28:48.621289+0000","last_fullsized":"2024-09-10T08:28:48.621289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:04.414048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620412+0000","last_change":"2024-09-10T08:28:47.628563+0000","last_active":"2024-09-10T08:28:48.620412+0000","last_peered":"2024-09-10T08:28:48.620412+0000","last_clean":"2024-09-10T08:28:48.620412+0000","last_became_active":"2024-09-10T08:28:47.628290+0000","last_became_peered":"2024-09-10T08:28:47.628290+0000","last_unstale":"2024-09-10T08:28:48.620412+0000","last_undegraded":"2024-09-10T08:28:48.620412+0000","last_fullsized":"2024-09-10T08:28:48.620412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:15.652718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621892+0000","last_change":"2024-09-10T08:28:35.572363+0000","last_active":"2024-09-10T08:28:48.621892+0000","last_peered":"2024-09-10T08:28:48.621892+0000","last_clean":"2024-09-10T08:28:48.621892+0000","last_became_active":"2024-09-10T08:28:35.572108+0000","last_became_peered":"2024-09-10T08:28:35.572108+0000","last_unstale":"2024-09-10T08:28:48.621892+0000","last_undegraded":"2024-09-10T08:28:48.621892+0000","last_fullsized":"2024-09-10T08:28:48.621892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:48.358634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634057+0000","last_change":"2024-09-10T08:28:34.564813+0000","last_active":"2024-09-10T08:28:48.634057+0000","last_peered":"2024-09-10T08:28:48.634057+0000","last_clean":"2024-09-10T08:28:48.634057+0000","last_became_active":"2024-09-10T08:28:34.564557+0000","last_became_peered":"2024-09-10T08:28:34.564557+0000","last_unstale":"2024-09-10T08:28:48.634057+0000","last_undegraded":"2024-09-10T08:28:48.634057+0000","last_fullsized":"2024-09-10T08:28:48.634057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:48.356069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634748+0000","last_change":"2024-09-10T08:28:46.625346+0000","last_active":"2024-09-10T08:28:48.634748+0000","last_peered":"2024-09-10T08:28:48.634748+0000","last_clean":"2024-09-10T08:28:48.634748+0000","last_became_active":"2024-09-10T08:28:46.625059+0000","last_became_peered":"2024-09-10T08:28:46.625059+0000","last_unstale":"2024-09-10T08:28:48.634748+0000","last_undegraded":"2024-09-10T08:28:48.634748+0000","last_fullsized":"2024-09-10T08:28:48.634748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:44.512285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621820+0000","last_change":"2024-09-10T08:28:47.621307+0000","last_active":"2024-09-10T08:28:48.621820+0000","last_peered":"2024-09-10T08:28:48.621820+0000","last_clean":"2024-09-10T08:28:48.621820+0000","last_became_active":"2024-09-10T08:28:47.621043+0000","last_became_peered":"2024-09-10T08:28:47.621043+0000","last_unstale":"2024-09-10T08:28:48.621820+0000","last_undegraded":"2024-09-10T08:28:48.621820+0000","last_fullsized":"2024-09-10T08:28:48.621820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:30.300108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620871+0000","last_change":"2024-09-10T08:28:35.569938+0000","last_active":"2024-09-10T08:28:48.620871+0000","last_peered":"2024-09-10T08:28:48.620871+0000","last_clean":"2024-09-10T08:28:48.620871+0000","last_became_active":"2024-09-10T08:28:35.569109+0000","last_became_peered":"2024-09-10T08:28:35.569109+0000","last_unstale":"2024-09-10T08:28:48.620871+0000","last_undegraded":"2024-09-10T08:28:48.620871+0000","last_fullsized":"2024-09-10T08:28:48.620871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:51.680564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354401+0000","last_change":"2024-09-10T08:28:34.571069+0000","last_active":"2024-09-10T08:28:49.354401+0000","last_peered":"2024-09-10T08:28:49.354401+0000","last_clean":"2024-09-10T08:28:49.354401+0000","last_became_active":"2024-09-10T08:28:34.570766+0000","last_became_peered":"2024-09-10T08:28:34.570766+0000","last_unstale":"2024-09-10T08:28:49.354401+0000","last_undegraded":"2024-09-10T08:28:49.354401+0000","last_fullsized":"2024-09-10T08:28:49.354401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:47.458195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620340+0000","last_change":"2024-09-10T08:28:46.616531+0000","last_active":"2024-09-10T08:28:48.620340+0000","last_peered":"2024-09-10T08:28:48.620340+0000","last_clean":"2024-09-10T08:28:48.620340+0000","last_became_active":"2024-09-10T08:28:46.616254+0000","last_became_peered":"2024-09-10T08:28:46.616254+0000","last_unstale":"2024-09-10T08:28:48.620340+0000","last_undegraded":"2024-09-10T08:28:48.620340+0000","last_fullsized":"2024-09-10T08:28:48.620340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:44.162368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621422+0000","last_change":"2024-09-10T08:28:47.628177+0000","last_active":"2024-09-10T08:28:48.621422+0000","last_peered":"2024-09-10T08:28:48.621422+0000","last_clean":"2024-09-10T08:28:48.621422+0000","last_became_active":"2024-09-10T08:28:47.627869+0000","last_became_peered":"2024-09-10T08:28:47.627869+0000","last_unstale":"2024-09-10T08:28:48.621422+0000","last_undegraded":"2024-09-10T08:28:48.621422+0000","last_fullsized":"2024-09-10T08:28:48.621422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:19.075558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632136+0000","last_change":"2024-09-10T08:28:35.575106+0000","last_active":"2024-09-10T08:28:48.632136+0000","last_peered":"2024-09-10T08:28:48.632136+0000","last_clean":"2024-09-10T08:28:48.632136+0000","last_became_active":"2024-09-10T08:28:35.574815+0000","last_became_peered":"2024-09-10T08:28:35.574815+0000","last_unstale":"2024-09-10T08:28:48.632136+0000","last_undegraded":"2024-09-10T08:28:48.632136+0000","last_fullsized":"2024-09-10T08:28:48.632136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:26.512181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421953+0000","last_change":"2024-09-10T08:28:34.564865+0000","last_active":"2024-09-10T08:28:49.421953+0000","last_peered":"2024-09-10T08:28:49.421953+0000","last_clean":"2024-09-10T08:28:49.421953+0000","last_became_active":"2024-09-10T08:28:34.564549+0000","last_became_peered":"2024-09-10T08:28:34.564549+0000","last_unstale":"2024-09-10T08:28:49.421953+0000","last_undegraded":"2024-09-10T08:28:49.421953+0000","last_fullsized":"2024-09-10T08:28:49.421953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:05.523637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620344+0000","last_change":"2024-09-10T08:28:46.622505+0000","last_active":"2024-09-10T08:28:48.620344+0000","last_peered":"2024-09-10T08:28:48.620344+0000","last_clean":"2024-09-10T08:28:48.620344+0000","last_became_active":"2024-09-10T08:28:46.621052+0000","last_became_peered":"2024-09-10T08:28:46.621052+0000","last_unstale":"2024-09-10T08:28:48.620344+0000","last_undegraded":"2024-09-10T08:28:48.620344+0000","last_fullsized":"2024-09-10T08:28:48.620344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:37.411404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620146+0000","last_change":"2024-09-10T08:28:47.624919+0000","last_active":"2024-09-10T08:28:48.620146+0000","last_peered":"2024-09-10T08:28:48.620146+0000","last_clean":"2024-09-10T08:28:48.620146+0000","last_became_active":"2024-09-10T08:28:47.624651+0000","last_became_peered":"2024-09-10T08:28:47.624651+0000","last_unstale":"2024-09-10T08:28:48.620146+0000","last_undegraded":"2024-09-10T08:28:48.620146+0000","last_fullsized":"2024-09-10T08:28:48.620146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:11.049160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622219+0000","last_change":"2024-09-10T08:28:35.574107+0000","last_active":"2024-09-10T08:28:48.622219+0000","last_peered":"2024-09-10T08:28:48.622219+0000","last_clean":"2024-09-10T08:28:48.622219+0000","last_became_active":"2024-09-10T08:28:35.573851+0000","last_became_peered":"2024-09-10T08:28:35.573851+0000","last_unstale":"2024-09-10T08:28:48.622219+0000","last_undegraded":"2024-09-10T08:28:48.622219+0000","last_fullsized":"2024-09-10T08:28:48.622219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:53.240223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634865+0000","last_change":"2024-09-10T08:28:34.563451+0000","last_active":"2024-09-10T08:28:48.634865+0000","last_peered":"2024-09-10T08:28:48.634865+0000","last_clean":"2024-09-10T08:28:48.634865+0000","last_became_active":"2024-09-10T08:28:34.563259+0000","last_became_peered":"2024-09-10T08:28:34.563259+0000","last_unstale":"2024-09-10T08:28:48.634865+0000","last_undegraded":"2024-09-10T08:28:48.634865+0000","last_fullsized":"2024-09-10T08:28:48.634865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:44.899351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621717+0000","last_change":"2024-09-10T08:28:46.623396+0000","last_active":"2024-09-10T08:28:48.621717+0000","last_peered":"2024-09-10T08:28:48.621717+0000","last_clean":"2024-09-10T08:28:48.621717+0000","last_became_active":"2024-09-10T08:28:46.623139+0000","last_became_peered":"2024-09-10T08:28:46.623139+0000","last_unstale":"2024-09-10T08:28:48.621717+0000","last_undegraded":"2024-09-10T08:28:48.621717+0000","last_fullsized":"2024-09-10T08:28:48.621717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:00.210413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421163+0000","last_change":"2024-09-10T08:28:47.634754+0000","last_active":"2024-09-10T08:28:49.421163+0000","last_peered":"2024-09-10T08:28:49.421163+0000","last_clean":"2024-09-10T08:28:49.421163+0000","last_became_active":"2024-09-10T08:28:47.634382+0000","last_became_peered":"2024-09-10T08:28:47.634382+0000","last_unstale":"2024-09-10T08:28:49.421163+0000","last_undegraded":"2024-09-10T08:28:49.421163+0000","last_fullsized":"2024-09-10T08:28:49.421163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:23.489596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634270+0000","last_change":"2024-09-10T08:28:35.567481+0000","last_active":"2024-09-10T08:28:48.634270+0000","last_peered":"2024-09-10T08:28:48.634270+0000","last_clean":"2024-09-10T08:28:48.634270+0000","last_became_active":"2024-09-10T08:28:35.567167+0000","last_became_peered":"2024-09-10T08:28:35.567167+0000","last_unstale":"2024-09-10T08:28:48.634270+0000","last_undegraded":"2024-09-10T08:28:48.634270+0000","last_fullsized":"2024-09-10T08:28:48.634270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:44.110012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355009+0000","last_change":"2024-09-10T08:28:34.571283+0000","last_active":"2024-09-10T08:28:49.355009+0000","last_peered":"2024-09-10T08:28:49.355009+0000","last_clean":"2024-09-10T08:28:49.355009+0000","last_became_active":"2024-09-10T08:28:34.570791+0000","last_became_peered":"2024-09-10T08:28:34.570791+0000","last_unstale":"2024-09-10T08:28:49.355009+0000","last_undegraded":"2024-09-10T08:28:49.355009+0000","last_fullsized":"2024-09-10T08:28:49.355009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:17.427597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631943+0000","last_change":"2024-09-10T08:28:46.630983+0000","last_active":"2024-09-10T08:28:48.631943+0000","last_peered":"2024-09-10T08:28:48.631943+0000","last_clean":"2024-09-10T08:28:48.631943+0000","last_became_active":"2024-09-10T08:28:46.630658+0000","last_became_peered":"2024-09-10T08:28:46.630658+0000","last_unstale":"2024-09-10T08:28:48.631943+0000","last_undegraded":"2024-09-10T08:28:48.631943+0000","last_fullsized":"2024-09-10T08:28:48.631943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:11.219022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632221+0000","last_change":"2024-09-10T08:28:47.625475+0000","last_active":"2024-09-10T08:28:48.632221+0000","last_peered":"2024-09-10T08:28:48.632221+0000","last_clean":"2024-09-10T08:28:48.632221+0000","last_became_active":"2024-09-10T08:28:47.625186+0000","last_became_peered":"2024-09-10T08:28:47.625186+0000","last_unstale":"2024-09-10T08:28:48.632221+0000","last_undegraded":"2024-09-10T08:28:48.632221+0000","last_fullsized":"2024-09-10T08:28:48.632221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:15.932769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621392+0000","last_change":"2024-09-10T08:28:35.576280+0000","last_active":"2024-09-10T08:28:48.621392+0000","last_peered":"2024-09-10T08:28:48.621392+0000","last_clean":"2024-09-10T08:28:48.621392+0000","last_became_active":"2024-09-10T08:28:35.576002+0000","last_became_peered":"2024-09-10T08:28:35.576002+0000","last_unstale":"2024-09-10T08:28:48.621392+0000","last_undegraded":"2024-09-10T08:28:48.621392+0000","last_fullsized":"2024-09-10T08:28:48.621392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:46.278441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634285+0000","last_change":"2024-09-10T08:28:34.555212+0000","last_active":"2024-09-10T08:28:48.634285+0000","last_peered":"2024-09-10T08:28:48.634285+0000","last_clean":"2024-09-10T08:28:48.634285+0000","last_became_active":"2024-09-10T08:28:34.554922+0000","last_became_peered":"2024-09-10T08:28:34.554922+0000","last_unstale":"2024-09-10T08:28:48.634285+0000","last_undegraded":"2024-09-10T08:28:48.634285+0000","last_fullsized":"2024-09-10T08:28:48.634285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634109+0000","last_change":"2024-09-10T08:28:46.624886+0000","last_active":"2024-09-10T08:28:48.634109+0000","last_peered":"2024-09-10T08:28:48.634109+0000","last_clean":"2024-09-10T08:28:48.634109+0000","last_became_active":"2024-09-10T08:28:46.624690+0000","last_became_peered":"2024-09-10T08:28:46.624690+0000","last_unstale":"2024-09-10T08:28:48.634109+0000","last_undegraded":"2024-09-10T08:28:48.634109+0000","last_fullsized":"2024-09-10T08:28:48.634109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:15.023379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631808+0000","last_change":"2024-09-10T08:28:47.634161+0000","last_active":"2024-09-10T08:28:48.631808+0000","last_peered":"2024-09-10T08:28:48.631808+0000","last_clean":"2024-09-10T08:28:48.631808+0000","last_became_active":"2024-09-10T08:28:47.633893+0000","last_became_peered":"2024-09-10T08:28:47.633893+0000","last_unstale":"2024-09-10T08:28:48.631808+0000","last_undegraded":"2024-09-10T08:28:48.631808+0000","last_fullsized":"2024-09-10T08:28:48.631808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:37.072370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620594+0000","last_change":"2024-09-10T08:28:35.577978+0000","last_active":"2024-09-10T08:28:48.620594+0000","last_peered":"2024-09-10T08:28:48.620594+0000","last_clean":"2024-09-10T08:28:48.620594+0000","last_became_active":"2024-09-10T08:28:35.577718+0000","last_became_peered":"2024-09-10T08:28:35.577718+0000","last_unstale":"2024-09-10T08:28:48.620594+0000","last_undegraded":"2024-09-10T08:28:48.620594+0000","last_fullsized":"2024-09-10T08:28:48.620594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:01:57.257817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621126+0000","last_change":"2024-09-10T08:28:34.553983+0000","last_active":"2024-09-10T08:28:48.621126+0000","last_peered":"2024-09-10T08:28:48.621126+0000","last_clean":"2024-09-10T08:28:48.621126+0000","last_became_active":"2024-09-10T08:28:34.553693+0000","last_became_peered":"2024-09-10T08:28:34.553693+0000","last_unstale":"2024-09-10T08:28:48.621126+0000","last_undegraded":"2024-09-10T08:28:48.621126+0000","last_fullsized":"2024-09-10T08:28:48.621126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:40.001685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634238+0000","last_change":"2024-09-10T08:28:46.620165+0000","last_active":"2024-09-10T08:28:48.634238+0000","last_peered":"2024-09-10T08:28:48.634238+0000","last_clean":"2024-09-10T08:28:48.634238+0000","last_became_active":"2024-09-10T08:28:46.619853+0000","last_became_peered":"2024-09-10T08:28:46.619853+0000","last_unstale":"2024-09-10T08:28:48.634238+0000","last_undegraded":"2024-09-10T08:28:48.634238+0000","last_fullsized":"2024-09-10T08:28:48.634238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:36.006532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.300010+0000","last_change":"2024-09-10T08:28:47.621588+0000","last_active":"2024-09-10T08:28:49.300010+0000","last_peered":"2024-09-10T08:28:49.300010+0000","last_clean":"2024-09-10T08:28:49.300010+0000","last_became_active":"2024-09-10T08:28:47.621122+0000","last_became_peered":"2024-09-10T08:28:47.621122+0000","last_unstale":"2024-09-10T08:28:49.300010+0000","last_undegraded":"2024-09-10T08:28:49.300010+0000","last_fullsized":"2024-09-10T08:28:49.300010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:11.250838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633943+0000","last_change":"2024-09-10T08:28:35.566745+0000","last_active":"2024-09-10T08:28:48.633943+0000","last_peered":"2024-09-10T08:28:48.633943+0000","last_clean":"2024-09-10T08:28:48.633943+0000","last_became_active":"2024-09-10T08:28:35.566444+0000","last_became_peered":"2024-09-10T08:28:35.566444+0000","last_unstale":"2024-09-10T08:28:48.633943+0000","last_undegraded":"2024-09-10T08:28:48.633943+0000","last_fullsized":"2024-09-10T08:28:48.633943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:52.735296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299738+0000","last_change":"2024-09-10T08:28:34.560745+0000","last_active":"2024-09-10T08:28:49.299738+0000","last_peered":"2024-09-10T08:28:49.299738+0000","last_clean":"2024-09-10T08:28:49.299738+0000","last_became_active":"2024-09-10T08:28:34.559911+0000","last_became_peered":"2024-09-10T08:28:34.559911+0000","last_unstale":"2024-09-10T08:28:49.299738+0000","last_undegraded":"2024-09-10T08:28:49.299738+0000","last_fullsized":"2024-09-10T08:28:49.299738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:00.234067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634838+0000","last_change":"2024-09-10T08:28:46.623886+0000","last_active":"2024-09-10T08:28:48.634838+0000","last_peered":"2024-09-10T08:28:48.634838+0000","last_clean":"2024-09-10T08:28:48.634838+0000","last_became_active":"2024-09-10T08:28:46.622790+0000","last_became_peered":"2024-09-10T08:28:46.622790+0000","last_unstale":"2024-09-10T08:28:48.634838+0000","last_undegraded":"2024-09-10T08:28:48.634838+0000","last_fullsized":"2024-09-10T08:28:48.634838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:06:32.333116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621918+0000","last_change":"2024-09-10T08:28:47.634500+0000","last_active":"2024-09-10T08:28:48.621918+0000","last_peered":"2024-09-10T08:28:48.621918+0000","last_clean":"2024-09-10T08:28:48.621918+0000","last_became_active":"2024-09-10T08:28:47.634219+0000","last_became_peered":"2024-09-10T08:28:47.634219+0000","last_unstale":"2024-09-10T08:28:48.621918+0000","last_undegraded":"2024-09-10T08:28:48.621918+0000","last_fullsized":"2024-09-10T08:28:48.621918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:59.689554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631587+0000","last_change":"2024-09-10T08:28:35.576360+0000","last_active":"2024-09-10T08:28:48.631587+0000","last_peered":"2024-09-10T08:28:48.631587+0000","last_clean":"2024-09-10T08:28:48.631587+0000","last_became_active":"2024-09-10T08:28:35.576096+0000","last_became_peered":"2024-09-10T08:28:35.576096+0000","last_unstale":"2024-09-10T08:28:48.631587+0000","last_undegraded":"2024-09-10T08:28:48.631587+0000","last_fullsized":"2024-09-10T08:28:48.631587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:34.159275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354630+0000","last_change":"2024-09-10T08:28:34.568477+0000","last_active":"2024-09-10T08:28:49.354630+0000","last_peered":"2024-09-10T08:28:49.354630+0000","last_clean":"2024-09-10T08:28:49.354630+0000","last_became_active":"2024-09-10T08:28:34.568249+0000","last_became_peered":"2024-09-10T08:28:34.568249+0000","last_unstale":"2024-09-10T08:28:49.354630+0000","last_undegraded":"2024-09-10T08:28:49.354630+0000","last_fullsized":"2024-09-10T08:28:49.354630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:08.640043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633193+0000","last_change":"2024-09-10T08:28:46.621567+0000","last_active":"2024-09-10T08:28:48.633193+0000","last_peered":"2024-09-10T08:28:48.633193+0000","last_clean":"2024-09-10T08:28:48.633193+0000","last_became_active":"2024-09-10T08:28:46.621272+0000","last_became_peered":"2024-09-10T08:28:46.621272+0000","last_unstale":"2024-09-10T08:28:48.633193+0000","last_undegraded":"2024-09-10T08:28:48.633193+0000","last_fullsized":"2024-09-10T08:28:48.633193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:37:34.936213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354521+0000","last_change":"2024-09-10T08:28:47.631621+0000","last_active":"2024-09-10T08:28:49.354521+0000","last_peered":"2024-09-10T08:28:49.354521+0000","last_clean":"2024-09-10T08:28:49.354521+0000","last_became_active":"2024-09-10T08:28:47.631337+0000","last_became_peered":"2024-09-10T08:28:47.631337+0000","last_unstale":"2024-09-10T08:28:49.354521+0000","last_undegraded":"2024-09-10T08:28:49.354521+0000","last_fullsized":"2024-09-10T08:28:49.354521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:04.196705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621993+0000","last_change":"2024-09-10T08:28:35.572658+0000","last_active":"2024-09-10T08:28:48.621993+0000","last_peered":"2024-09-10T08:28:48.621993+0000","last_clean":"2024-09-10T08:28:48.621993+0000","last_became_active":"2024-09-10T08:28:35.571611+0000","last_became_peered":"2024-09-10T08:28:35.571611+0000","last_unstale":"2024-09-10T08:28:48.621993+0000","last_undegraded":"2024-09-10T08:28:48.621993+0000","last_fullsized":"2024-09-10T08:28:48.621993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:42.726996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620845+0000","last_change":"2024-09-10T08:28:34.555587+0000","last_active":"2024-09-10T08:28:48.620845+0000","last_peered":"2024-09-10T08:28:48.620845+0000","last_clean":"2024-09-10T08:28:48.620845+0000","last_became_active":"2024-09-10T08:28:34.555269+0000","last_became_peered":"2024-09-10T08:28:34.555269+0000","last_unstale":"2024-09-10T08:28:48.620845+0000","last_undegraded":"2024-09-10T08:28:48.620845+0000","last_fullsized":"2024-09-10T08:28:48.620845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:19.499870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354756+0000","last_change":"2024-09-10T08:28:26.724394+0000","last_active":"2024-09-10T08:28:49.354756+0000","last_peered":"2024-09-10T08:28:49.354756+0000","last_clean":"2024-09-10T08:28:49.354756+0000","last_became_active":"2024-09-10T08:28:26.723452+0000","last_became_peered":"2024-09-10T08:28:26.723452+0000","last_unstale":"2024-09-10T08:28:49.354756+0000","last_undegraded":"2024-09-10T08:28:49.354756+0000","last_fullsized":"2024-09-10T08:28:49.354756+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_clean_scrub_stamp":"2024-09-10T08:28:25.445753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:00.811505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421307+0000","last_change":"2024-09-10T08:28:46.622048+0000","last_active":"2024-09-10T08:28:49.421307+0000","last_peered":"2024-09-10T08:28:49.421307+0000","last_clean":"2024-09-10T08:28:49.421307+0000","last_became_active":"2024-09-10T08:28:46.621770+0000","last_became_peered":"2024-09-10T08:28:46.621770+0000","last_unstale":"2024-09-10T08:28:49.421307+0000","last_undegraded":"2024-09-10T08:28:49.421307+0000","last_fullsized":"2024-09-10T08:28:49.421307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:51.430760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299891+0000","last_change":"2024-09-10T08:28:47.620746+0000","last_active":"2024-09-10T08:28:49.299891+0000","last_peered":"2024-09-10T08:28:49.299891+0000","last_clean":"2024-09-10T08:28:49.299891+0000","last_became_active":"2024-09-10T08:28:47.620492+0000","last_became_peered":"2024-09-10T08:28:47.620492+0000","last_unstale":"2024-09-10T08:28:49.299891+0000","last_undegraded":"2024-09-10T08:28:49.299891+0000","last_fullsized":"2024-09-10T08:28:49.299891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:40.117978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354858+0000","last_change":"2024-09-10T08:28:35.574532+0000","last_active":"2024-09-10T08:28:49.354858+0000","last_peered":"2024-09-10T08:28:49.354858+0000","last_clean":"2024-09-10T08:28:49.354858+0000","last_became_active":"2024-09-10T08:28:35.574215+0000","last_became_peered":"2024-09-10T08:28:35.574215+0000","last_unstale":"2024-09-10T08:28:49.354858+0000","last_undegraded":"2024-09-10T08:28:49.354858+0000","last_fullsized":"2024-09-10T08:28:49.354858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:28.455653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.300028+0000","last_change":"2024-09-10T08:28:34.559911+0000","last_active":"2024-09-10T08:28:49.300028+0000","last_peered":"2024-09-10T08:28:49.300028+0000","last_clean":"2024-09-10T08:28:49.300028+0000","last_became_active":"2024-09-10T08:28:34.559635+0000","last_became_peered":"2024-09-10T08:28:34.559635+0000","last_unstale":"2024-09-10T08:28:49.300028+0000","last_undegraded":"2024-09-10T08:28:49.300028+0000","last_fullsized":"2024-09-10T08:28:49.300028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:40.892609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421181+0000","last_change":"2024-09-10T08:28:46.620352+0000","last_active":"2024-09-10T08:28:49.421181+0000","last_peered":"2024-09-10T08:28:49.421181+0000","last_clean":"2024-09-10T08:28:49.421181+0000","last_became_active":"2024-09-10T08:28:46.620064+0000","last_became_peered":"2024-09-10T08:28:46.620064+0000","last_unstale":"2024-09-10T08:28:49.421181+0000","last_undegraded":"2024-09-10T08:28:49.421181+0000","last_fullsized":"2024-09-10T08:28:49.421181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:59.333579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299701+0000","last_change":"2024-09-10T08:28:47.620305+0000","last_active":"2024-09-10T08:28:49.299701+0000","last_peered":"2024-09-10T08:28:49.299701+0000","last_clean":"2024-09-10T08:28:49.299701+0000","last_became_active":"2024-09-10T08:28:47.620014+0000","last_became_peered":"2024-09-10T08:28:47.620014+0000","last_unstale":"2024-09-10T08:28:49.299701+0000","last_undegraded":"2024-09-10T08:28:49.299701+0000","last_fullsized":"2024-09-10T08:28:49.299701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:44.916136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621484+0000","last_change":"2024-09-10T08:28:35.577124+0000","last_active":"2024-09-10T08:28:48.621484+0000","last_peered":"2024-09-10T08:28:48.621484+0000","last_clean":"2024-09-10T08:28:48.621484+0000","last_became_active":"2024-09-10T08:28:35.576655+0000","last_became_peered":"2024-09-10T08:28:35.576655+0000","last_unstale":"2024-09-10T08:28:48.621484+0000","last_undegraded":"2024-09-10T08:28:48.621484+0000","last_fullsized":"2024-09-10T08:28:48.621484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:29.878600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634772+0000","last_change":"2024-09-10T08:28:34.560694+0000","last_active":"2024-09-10T08:28:48.634772+0000","last_peered":"2024-09-10T08:28:48.634772+0000","last_clean":"2024-09-10T08:28:48.634772+0000","last_became_active":"2024-09-10T08:28:34.560429+0000","last_became_peered":"2024-09-10T08:28:34.560429+0000","last_unstale":"2024-09-10T08:28:48.634772+0000","last_undegraded":"2024-09-10T08:28:48.634772+0000","last_fullsized":"2024-09-10T08:28:48.634772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:54.514467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631770+0000","last_change":"2024-09-10T08:28:46.622232+0000","last_active":"2024-09-10T08:28:48.631770+0000","last_peered":"2024-09-10T08:28:48.631770+0000","last_clean":"2024-09-10T08:28:48.631770+0000","last_became_active":"2024-09-10T08:28:46.621966+0000","last_became_peered":"2024-09-10T08:28:46.621966+0000","last_unstale":"2024-09-10T08:28:48.631770+0000","last_undegraded":"2024-09-10T08:28:48.631770+0000","last_fullsized":"2024-09-10T08:28:48.631770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:28.897045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354068+0000","last_change":"2024-09-10T08:28:47.630602+0000","last_active":"2024-09-10T08:28:49.354068+0000","last_peered":"2024-09-10T08:28:49.354068+0000","last_clean":"2024-09-10T08:28:49.354068+0000","last_became_active":"2024-09-10T08:28:47.630234+0000","last_became_peered":"2024-09-10T08:28:47.630234+0000","last_unstale":"2024-09-10T08:28:49.354068+0000","last_undegraded":"2024-09-10T08:28:49.354068+0000","last_fullsized":"2024-09-10T08:28:49.354068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:03.808098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355126+0000","last_change":"2024-09-10T08:28:35.577577+0000","last_active":"2024-09-10T08:28:49.355126+0000","last_peered":"2024-09-10T08:28:49.355126+0000","last_clean":"2024-09-10T08:28:49.355126+0000","last_became_active":"2024-09-10T08:28:35.576686+0000","last_became_peered":"2024-09-10T08:28:35.576686+0000","last_unstale":"2024-09-10T08:28:49.355126+0000","last_undegraded":"2024-09-10T08:28:49.355126+0000","last_fullsized":"2024-09-10T08:28:49.355126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:36.334494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.300074+0000","last_change":"2024-09-10T08:28:34.560313+0000","last_active":"2024-09-10T08:28:49.300074+0000","last_peered":"2024-09-10T08:28:49.300074+0000","last_clean":"2024-09-10T08:28:49.300074+0000","last_became_active":"2024-09-10T08:28:34.560035+0000","last_became_peered":"2024-09-10T08:28:34.560035+0000","last_unstale":"2024-09-10T08:28:49.300074+0000","last_undegraded":"2024-09-10T08:28:49.300074+0000","last_fullsized":"2024-09-10T08:28:49.300074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:56.945537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619792+0000","last_change":"2024-09-10T08:28:46.623371+0000","last_active":"2024-09-10T08:28:48.619792+0000","last_peered":"2024-09-10T08:28:48.619792+0000","last_clean":"2024-09-10T08:28:48.619792+0000","last_became_active":"2024-09-10T08:28:46.623092+0000","last_became_peered":"2024-09-10T08:28:46.623092+0000","last_unstale":"2024-09-10T08:28:48.619792+0000","last_undegraded":"2024-09-10T08:28:48.619792+0000","last_fullsized":"2024-09-10T08:28:48.619792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:36.359127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299671+0000","last_change":"2024-09-10T08:28:47.619805+0000","last_active":"2024-09-10T08:28:49.299671+0000","last_peered":"2024-09-10T08:28:49.299671+0000","last_clean":"2024-09-10T08:28:49.299671+0000","last_became_active":"2024-09-10T08:28:47.619452+0000","last_became_peered":"2024-09-10T08:28:47.619452+0000","last_unstale":"2024-09-10T08:28:49.299671+0000","last_undegraded":"2024-09-10T08:28:49.299671+0000","last_fullsized":"2024-09-10T08:28:49.299671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:20.052707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355004+0000","last_change":"2024-09-10T08:28:35.577476+0000","last_active":"2024-09-10T08:28:49.355004+0000","last_peered":"2024-09-10T08:28:49.355004+0000","last_clean":"2024-09-10T08:28:49.355004+0000","last_became_active":"2024-09-10T08:28:35.576786+0000","last_became_peered":"2024-09-10T08:28:35.576786+0000","last_unstale":"2024-09-10T08:28:49.355004+0000","last_undegraded":"2024-09-10T08:28:49.355004+0000","last_fullsized":"2024-09-10T08:28:49.355004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:46.914074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620800+0000","last_change":"2024-09-10T08:28:34.551102+0000","last_active":"2024-09-10T08:28:48.620800+0000","last_peered":"2024-09-10T08:28:48.620800+0000","last_clean":"2024-09-10T08:28:48.620800+0000","last_became_active":"2024-09-10T08:28:34.550773+0000","last_became_peered":"2024-09-10T08:28:34.550773+0000","last_unstale":"2024-09-10T08:28:48.620800+0000","last_undegraded":"2024-09-10T08:28:48.620800+0000","last_fullsized":"2024-09-10T08:28:48.620800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:35.393695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620218+0000","last_change":"2024-09-10T08:28:46.619639+0000","last_active":"2024-09-10T08:28:48.620218+0000","last_peered":"2024-09-10T08:28:48.620218+0000","last_clean":"2024-09-10T08:28:48.620218+0000","last_became_active":"2024-09-10T08:28:46.619330+0000","last_became_peered":"2024-09-10T08:28:46.619330+0000","last_unstale":"2024-09-10T08:28:48.620218+0000","last_undegraded":"2024-09-10T08:28:48.620218+0000","last_fullsized":"2024-09-10T08:28:48.620218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:10.371693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622150+0000","last_change":"2024-09-10T08:28:47.633627+0000","last_active":"2024-09-10T08:28:48.622150+0000","last_peered":"2024-09-10T08:28:48.622150+0000","last_clean":"2024-09-10T08:28:48.622150+0000","last_became_active":"2024-09-10T08:28:47.633362+0000","last_became_peered":"2024-09-10T08:28:47.633362+0000","last_unstale":"2024-09-10T08:28:48.622150+0000","last_undegraded":"2024-09-10T08:28:48.622150+0000","last_fullsized":"2024-09-10T08:28:48.622150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:19.473028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354525+0000","last_change":"2024-09-10T08:28:35.575307+0000","last_active":"2024-09-10T08:28:49.354525+0000","last_peered":"2024-09-10T08:28:49.354525+0000","last_clean":"2024-09-10T08:28:49.354525+0000","last_became_active":"2024-09-10T08:28:35.575038+0000","last_became_peered":"2024-09-10T08:28:35.575038+0000","last_unstale":"2024-09-10T08:28:49.354525+0000","last_undegraded":"2024-09-10T08:28:49.354525+0000","last_fullsized":"2024-09-10T08:28:49.354525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:36.478822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299678+0000","last_change":"2024-09-10T08:28:34.555542+0000","last_active":"2024-09-10T08:28:49.299678+0000","last_peered":"2024-09-10T08:28:49.299678+0000","last_clean":"2024-09-10T08:28:49.299678+0000","last_became_active":"2024-09-10T08:28:34.555179+0000","last_became_peered":"2024-09-10T08:28:34.555179+0000","last_unstale":"2024-09-10T08:28:49.299678+0000","last_undegraded":"2024-09-10T08:28:49.299678+0000","last_fullsized":"2024-09-10T08:28:49.299678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:53.313161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632119+0000","last_change":"2024-09-10T08:28:46.618615+0000","last_active":"2024-09-10T08:28:48.632119+0000","last_peered":"2024-09-10T08:28:48.632119+0000","last_clean":"2024-09-10T08:28:48.632119+0000","last_became_active":"2024-09-10T08:28:46.618318+0000","last_became_peered":"2024-09-10T08:28:46.618318+0000","last_unstale":"2024-09-10T08:28:48.632119+0000","last_undegraded":"2024-09-10T08:28:48.632119+0000","last_fullsized":"2024-09-10T08:28:48.632119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:44:08.185748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621616+0000","last_change":"2024-09-10T08:28:47.625025+0000","last_active":"2024-09-10T08:28:48.621616+0000","last_peered":"2024-09-10T08:28:48.621616+0000","last_clean":"2024-09-10T08:28:48.621616+0000","last_became_active":"2024-09-10T08:28:47.624230+0000","last_became_peered":"2024-09-10T08:28:47.624230+0000","last_unstale":"2024-09-10T08:28:48.621616+0000","last_undegraded":"2024-09-10T08:28:48.621616+0000","last_fullsized":"2024-09-10T08:28:48.621616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:25.530264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421027+0000","last_change":"2024-09-10T08:28:35.578892+0000","last_active":"2024-09-10T08:28:49.421027+0000","last_peered":"2024-09-10T08:28:49.421027+0000","last_clean":"2024-09-10T08:28:49.421027+0000","last_became_active":"2024-09-10T08:28:35.578299+0000","last_became_peered":"2024-09-10T08:28:35.578299+0000","last_unstale":"2024-09-10T08:28:49.421027+0000","last_undegraded":"2024-09-10T08:28:49.421027+0000","last_fullsized":"2024-09-10T08:28:49.421027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:27.485392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421503+0000","last_change":"2024-09-10T08:28:34.560444+0000","last_active":"2024-09-10T08:28:49.421503+0000","last_peered":"2024-09-10T08:28:49.421503+0000","last_clean":"2024-09-10T08:28:49.421503+0000","last_became_active":"2024-09-10T08:28:34.560188+0000","last_became_peered":"2024-09-10T08:28:34.560188+0000","last_unstale":"2024-09-10T08:28:49.421503+0000","last_undegraded":"2024-09-10T08:28:49.421503+0000","last_fullsized":"2024-09-10T08:28:49.421503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:15.727780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622124+0000","last_change":"2024-09-10T08:28:46.623483+0000","last_active":"2024-09-10T08:28:48.622124+0000","last_peered":"2024-09-10T08:28:48.622124+0000","last_clean":"2024-09-10T08:28:48.622124+0000","last_became_active":"2024-09-10T08:28:46.623211+0000","last_became_peered":"2024-09-10T08:28:46.623211+0000","last_unstale":"2024-09-10T08:28:48.622124+0000","last_undegraded":"2024-09-10T08:28:48.622124+0000","last_fullsized":"2024-09-10T08:28:48.622124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:24.611015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621121+0000","last_change":"2024-09-10T08:28:47.635185+0000","last_active":"2024-09-10T08:28:48.621121+0000","last_peered":"2024-09-10T08:28:48.621121+0000","last_clean":"2024-09-10T08:28:48.621121+0000","last_became_active":"2024-09-10T08:28:47.634782+0000","last_became_peered":"2024-09-10T08:28:47.634782+0000","last_unstale":"2024-09-10T08:28:48.621121+0000","last_undegraded":"2024-09-10T08:28:48.621121+0000","last_fullsized":"2024-09-10T08:28:48.621121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:05.512645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354247+0000","last_change":"2024-09-10T08:28:35.575788+0000","last_active":"2024-09-10T08:28:49.354247+0000","last_peered":"2024-09-10T08:28:49.354247+0000","last_clean":"2024-09-10T08:28:49.354247+0000","last_became_active":"2024-09-10T08:28:35.575333+0000","last_became_peered":"2024-09-10T08:28:35.575333+0000","last_unstale":"2024-09-10T08:28:49.354247+0000","last_undegraded":"2024-09-10T08:28:49.354247+0000","last_fullsized":"2024-09-10T08:28:49.354247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:39.756390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621367+0000","last_change":"2024-09-10T08:28:34.560699+0000","last_active":"2024-09-10T08:28:48.621367+0000","last_peered":"2024-09-10T08:28:48.621367+0000","last_clean":"2024-09-10T08:28:48.621367+0000","last_became_active":"2024-09-10T08:28:34.560376+0000","last_became_peered":"2024-09-10T08:28:34.560376+0000","last_unstale":"2024-09-10T08:28:48.621367+0000","last_undegraded":"2024-09-10T08:28:48.621367+0000","last_fullsized":"2024-09-10T08:28:48.621367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:09.981216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622076+0000","last_change":"2024-09-10T08:28:46.620745+0000","last_active":"2024-09-10T08:28:48.622076+0000","last_peered":"2024-09-10T08:28:48.622076+0000","last_clean":"2024-09-10T08:28:48.622076+0000","last_became_active":"2024-09-10T08:28:46.619030+0000","last_became_peered":"2024-09-10T08:28:46.619030+0000","last_unstale":"2024-09-10T08:28:48.622076+0000","last_undegraded":"2024-09-10T08:28:48.622076+0000","last_fullsized":"2024-09-10T08:28:48.622076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:07.653226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622129+0000","last_change":"2024-09-10T08:28:47.626648+0000","last_active":"2024-09-10T08:28:48.622129+0000","last_peered":"2024-09-10T08:28:48.622129+0000","last_clean":"2024-09-10T08:28:48.622129+0000","last_became_active":"2024-09-10T08:28:47.626330+0000","last_became_peered":"2024-09-10T08:28:47.626330+0000","last_unstale":"2024-09-10T08:28:48.622129+0000","last_undegraded":"2024-09-10T08:28:48.622129+0000","last_fullsized":"2024-09-10T08:28:48.622129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:02.346881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631691+0000","last_change":"2024-09-10T08:28:35.574810+0000","last_active":"2024-09-10T08:28:48.631691+0000","last_peered":"2024-09-10T08:28:48.631691+0000","last_clean":"2024-09-10T08:28:48.631691+0000","last_became_active":"2024-09-10T08:28:35.574567+0000","last_became_peered":"2024-09-10T08:28:35.574567+0000","last_unstale":"2024-09-10T08:28:48.631691+0000","last_undegraded":"2024-09-10T08:28:48.631691+0000","last_fullsized":"2024-09-10T08:28:48.631691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:29.315833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632297+0000","last_change":"2024-09-10T08:28:34.553556+0000","last_active":"2024-09-10T08:28:48.632297+0000","last_peered":"2024-09-10T08:28:48.632297+0000","last_clean":"2024-09-10T08:28:48.632297+0000","last_became_active":"2024-09-10T08:28:34.553275+0000","last_became_peered":"2024-09-10T08:28:34.553275+0000","last_unstale":"2024-09-10T08:28:48.632297+0000","last_undegraded":"2024-09-10T08:28:48.632297+0000","last_fullsized":"2024-09-10T08:28:48.632297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:45.957635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621256+0000","last_change":"2024-09-10T08:28:46.619760+0000","last_active":"2024-09-10T08:28:48.621256+0000","last_peered":"2024-09-10T08:28:48.621256+0000","last_clean":"2024-09-10T08:28:48.621256+0000","last_became_active":"2024-09-10T08:28:46.619165+0000","last_became_peered":"2024-09-10T08:28:46.619165+0000","last_unstale":"2024-09-10T08:28:48.621256+0000","last_undegraded":"2024-09-10T08:28:48.621256+0000","last_fullsized":"2024-09-10T08:28:48.621256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:27.691197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621842+0000","last_change":"2024-09-10T08:28:47.620135+0000","last_active":"2024-09-10T08:28:48.621842+0000","last_peered":"2024-09-10T08:28:48.621842+0000","last_clean":"2024-09-10T08:28:48.621842+0000","last_became_active":"2024-09-10T08:28:47.619661+0000","last_became_peered":"2024-09-10T08:28:47.619661+0000","last_unstale":"2024-09-10T08:28:48.621842+0000","last_undegraded":"2024-09-10T08:28:48.621842+0000","last_fullsized":"2024-09-10T08:28:48.621842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:34.815426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354721+0000","last_change":"2024-09-10T08:28:35.582473+0000","last_active":"2024-09-10T08:28:49.354721+0000","last_peered":"2024-09-10T08:28:49.354721+0000","last_clean":"2024-09-10T08:28:49.354721+0000","last_became_active":"2024-09-10T08:28:35.582205+0000","last_became_peered":"2024-09-10T08:28:35.582205+0000","last_unstale":"2024-09-10T08:28:49.354721+0000","last_undegraded":"2024-09-10T08:28:49.354721+0000","last_fullsized":"2024-09-10T08:28:49.354721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:11.200963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421457+0000","last_change":"2024-09-10T08:28:34.559823+0000","last_active":"2024-09-10T08:28:49.421457+0000","last_peered":"2024-09-10T08:28:49.421457+0000","last_clean":"2024-09-10T08:28:49.421457+0000","last_became_active":"2024-09-10T08:28:34.559560+0000","last_became_peered":"2024-09-10T08:28:34.559560+0000","last_unstale":"2024-09-10T08:28:49.421457+0000","last_undegraded":"2024-09-10T08:28:49.421457+0000","last_fullsized":"2024-09-10T08:28:49.421457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:53.724382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633994+0000","last_change":"2024-09-10T08:28:46.628040+0000","last_active":"2024-09-10T08:28:48.633994+0000","last_peered":"2024-09-10T08:28:48.633994+0000","last_clean":"2024-09-10T08:28:48.633994+0000","last_became_active":"2024-09-10T08:28:46.627819+0000","last_became_peered":"2024-09-10T08:28:46.627819+0000","last_unstale":"2024-09-10T08:28:48.633994+0000","last_undegraded":"2024-09-10T08:28:48.633994+0000","last_fullsized":"2024-09-10T08:28:48.633994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:29.467540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634305+0000","last_change":"2024-09-10T08:28:47.628067+0000","last_active":"2024-09-10T08:28:48.634305+0000","last_peered":"2024-09-10T08:28:48.634305+0000","last_clean":"2024-09-10T08:28:48.634305+0000","last_became_active":"2024-09-10T08:28:47.627775+0000","last_became_peered":"2024-09-10T08:28:47.627775+0000","last_unstale":"2024-09-10T08:28:48.634305+0000","last_undegraded":"2024-09-10T08:28:48.634305+0000","last_fullsized":"2024-09-10T08:28:48.634305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:43.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621613+0000","last_change":"2024-09-10T08:28:35.571262+0000","last_active":"2024-09-10T08:28:48.621613+0000","last_peered":"2024-09-10T08:28:48.621613+0000","last_clean":"2024-09-10T08:28:48.621613+0000","last_became_active":"2024-09-10T08:28:35.570711+0000","last_became_peered":"2024-09-10T08:28:35.570711+0000","last_unstale":"2024-09-10T08:28:48.621613+0000","last_undegraded":"2024-09-10T08:28:48.621613+0000","last_fullsized":"2024-09-10T08:28:48.621613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:29.116422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634766+0000","last_change":"2024-09-10T08:28:34.557352+0000","last_active":"2024-09-10T08:28:48.634766+0000","last_peered":"2024-09-10T08:28:48.634766+0000","last_clean":"2024-09-10T08:28:48.634766+0000","last_became_active":"2024-09-10T08:28:34.557076+0000","last_became_peered":"2024-09-10T08:28:34.557076+0000","last_unstale":"2024-09-10T08:28:48.634766+0000","last_undegraded":"2024-09-10T08:28:48.634766+0000","last_fullsized":"2024-09-10T08:28:48.634766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:04.957739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620317+0000","last_change":"2024-09-10T08:28:46.615923+0000","last_active":"2024-09-10T08:28:48.620317+0000","last_peered":"2024-09-10T08:28:48.620317+0000","last_clean":"2024-09-10T08:28:48.620317+0000","last_became_active":"2024-09-10T08:28:46.615451+0000","last_became_peered":"2024-09-10T08:28:46.615451+0000","last_unstale":"2024-09-10T08:28:48.620317+0000","last_undegraded":"2024-09-10T08:28:48.620317+0000","last_fullsized":"2024-09-10T08:28:48.620317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:22.612001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421320+0000","last_change":"2024-09-10T08:28:47.623223+0000","last_active":"2024-09-10T08:28:49.421320+0000","last_peered":"2024-09-10T08:28:49.421320+0000","last_clean":"2024-09-10T08:28:49.421320+0000","last_became_active":"2024-09-10T08:28:47.622961+0000","last_became_peered":"2024-09-10T08:28:47.622961+0000","last_unstale":"2024-09-10T08:28:49.421320+0000","last_undegraded":"2024-09-10T08:28:49.421320+0000","last_fullsized":"2024-09-10T08:28:49.421320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:30.979580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631925+0000","last_change":"2024-09-10T08:28:35.577913+0000","last_active":"2024-09-10T08:28:48.631925+0000","last_peered":"2024-09-10T08:28:48.631925+0000","last_clean":"2024-09-10T08:28:48.631925+0000","last_became_active":"2024-09-10T08:28:35.577255+0000","last_became_peered":"2024-09-10T08:28:35.577255+0000","last_unstale":"2024-09-10T08:28:48.631925+0000","last_undegraded":"2024-09-10T08:28:48.631925+0000","last_fullsized":"2024-09-10T08:28:48.631925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:17.413525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621690+0000","last_change":"2024-09-10T08:28:34.564571+0000","last_active":"2024-09-10T08:28:48.621690+0000","last_peered":"2024-09-10T08:28:48.621690+0000","last_clean":"2024-09-10T08:28:48.621690+0000","last_became_active":"2024-09-10T08:28:34.564189+0000","last_became_peered":"2024-09-10T08:28:34.564189+0000","last_unstale":"2024-09-10T08:28:48.621690+0000","last_undegraded":"2024-09-10T08:28:48.621690+0000","last_fullsized":"2024-09-10T08:28:48.621690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:46.055510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621316+0000","last_change":"2024-09-10T08:28:46.618917+0000","last_active":"2024-09-10T08:28:48.621316+0000","last_peered":"2024-09-10T08:28:48.621316+0000","last_clean":"2024-09-10T08:28:48.621316+0000","last_became_active":"2024-09-10T08:28:46.618625+0000","last_became_peered":"2024-09-10T08:28:46.618625+0000","last_unstale":"2024-09-10T08:28:48.621316+0000","last_undegraded":"2024-09-10T08:28:48.621316+0000","last_fullsized":"2024-09-10T08:28:48.621316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:19.431857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354237+0000","last_change":"2024-09-10T08:28:47.630243+0000","last_active":"2024-09-10T08:28:49.354237+0000","last_peered":"2024-09-10T08:28:49.354237+0000","last_clean":"2024-09-10T08:28:49.354237+0000","last_became_active":"2024-09-10T08:28:47.629869+0000","last_became_peered":"2024-09-10T08:28:47.629869+0000","last_unstale":"2024-09-10T08:28:49.354237+0000","last_undegraded":"2024-09-10T08:28:49.354237+0000","last_fullsized":"2024-09-10T08:28:49.354237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:58.696156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621683+0000","last_change":"2024-09-10T08:28:35.572944+0000","last_active":"2024-09-10T08:28:48.621683+0000","last_peered":"2024-09-10T08:28:48.621683+0000","last_clean":"2024-09-10T08:28:48.621683+0000","last_became_active":"2024-09-10T08:28:35.572620+0000","last_became_peered":"2024-09-10T08:28:35.572620+0000","last_unstale":"2024-09-10T08:28:48.621683+0000","last_undegraded":"2024-09-10T08:28:48.621683+0000","last_fullsized":"2024-09-10T08:28:48.621683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:04.524048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421956+0000","last_change":"2024-09-10T08:28:34.562935+0000","last_active":"2024-09-10T08:28:49.421956+0000","last_peered":"2024-09-10T08:28:49.421956+0000","last_clean":"2024-09-10T08:28:49.421956+0000","last_became_active":"2024-09-10T08:28:34.562647+0000","last_became_peered":"2024-09-10T08:28:34.562647+0000","last_unstale":"2024-09-10T08:28:49.421956+0000","last_undegraded":"2024-09-10T08:28:49.421956+0000","last_fullsized":"2024-09-10T08:28:49.421956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:47.492281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621382+0000","last_change":"2024-09-10T08:28:46.621472+0000","last_active":"2024-09-10T08:28:48.621382+0000","last_peered":"2024-09-10T08:28:48.621382+0000","last_clean":"2024-09-10T08:28:48.621382+0000","last_became_active":"2024-09-10T08:28:46.621157+0000","last_became_peered":"2024-09-10T08:28:46.621157+0000","last_unstale":"2024-09-10T08:28:48.621382+0000","last_undegraded":"2024-09-10T08:28:48.621382+0000","last_fullsized":"2024-09-10T08:28:48.621382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:44.166068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421835+0000","last_change":"2024-09-10T08:28:47.627750+0000","last_active":"2024-09-10T08:28:49.421835+0000","last_peered":"2024-09-10T08:28:49.421835+0000","last_clean":"2024-09-10T08:28:49.421835+0000","last_became_active":"2024-09-10T08:28:47.627481+0000","last_became_peered":"2024-09-10T08:28:47.627481+0000","last_unstale":"2024-09-10T08:28:49.421835+0000","last_undegraded":"2024-09-10T08:28:49.421835+0000","last_fullsized":"2024-09-10T08:28:49.421835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:01.105133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631930+0000","last_change":"2024-09-10T08:28:46.620162+0000","last_active":"2024-09-10T08:28:48.631930+0000","last_peered":"2024-09-10T08:28:48.631930+0000","last_clean":"2024-09-10T08:28:48.631930+0000","last_became_active":"2024-09-10T08:28:46.619843+0000","last_became_peered":"2024-09-10T08:28:46.619843+0000","last_unstale":"2024-09-10T08:28:48.631930+0000","last_undegraded":"2024-09-10T08:28:48.631930+0000","last_fullsized":"2024-09-10T08:28:48.631930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:21.376123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633938+0000","last_change":"2024-09-10T08:28:35.572803+0000","last_active":"2024-09-10T08:28:48.633938+0000","last_peered":"2024-09-10T08:28:48.633938+0000","last_clean":"2024-09-10T08:28:48.633938+0000","last_became_active":"2024-09-10T08:28:35.572219+0000","last_became_peered":"2024-09-10T08:28:35.572219+0000","last_unstale":"2024-09-10T08:28:48.633938+0000","last_undegraded":"2024-09-10T08:28:48.633938+0000","last_fullsized":"2024-09-10T08:28:48.633938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:45.920218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620645+0000","last_change":"2024-09-10T08:28:34.554346+0000","last_active":"2024-09-10T08:28:48.620645+0000","last_peered":"2024-09-10T08:28:48.620645+0000","last_clean":"2024-09-10T08:28:48.620645+0000","last_became_active":"2024-09-10T08:28:34.553933+0000","last_became_peered":"2024-09-10T08:28:34.553933+0000","last_unstale":"2024-09-10T08:28:48.620645+0000","last_undegraded":"2024-09-10T08:28:48.620645+0000","last_fullsized":"2024-09-10T08:28:48.620645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:07.639671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631936+0000","last_change":"2024-09-10T08:28:47.629468+0000","last_active":"2024-09-10T08:28:48.631936+0000","last_peered":"2024-09-10T08:28:48.631936+0000","last_clean":"2024-09-10T08:28:48.631936+0000","last_became_active":"2024-09-10T08:28:47.629177+0000","last_became_peered":"2024-09-10T08:28:47.629177+0000","last_unstale":"2024-09-10T08:28:48.631936+0000","last_undegraded":"2024-09-10T08:28:48.631936+0000","last_fullsized":"2024-09-10T08:28:48.631936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:10.443235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421808+0000","last_change":"2024-09-10T08:28:46.630904+0000","last_active":"2024-09-10T08:28:49.421808+0000","last_peered":"2024-09-10T08:28:49.421808+0000","last_clean":"2024-09-10T08:28:49.421808+0000","last_became_active":"2024-09-10T08:28:46.630530+0000","last_became_peered":"2024-09-10T08:28:46.630530+0000","last_unstale":"2024-09-10T08:28:49.421808+0000","last_undegraded":"2024-09-10T08:28:49.421808+0000","last_fullsized":"2024-09-10T08:28:49.421808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:33.599739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621556+0000","last_change":"2024-09-10T08:28:35.580244+0000","last_active":"2024-09-10T08:28:48.621556+0000","last_peered":"2024-09-10T08:28:48.621556+0000","last_clean":"2024-09-10T08:28:48.621556+0000","last_became_active":"2024-09-10T08:28:35.579975+0000","last_became_peered":"2024-09-10T08:28:35.579975+0000","last_unstale":"2024-09-10T08:28:48.621556+0000","last_undegraded":"2024-09-10T08:28:48.621556+0000","last_fullsized":"2024-09-10T08:28:48.621556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:16.498045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621654+0000","last_change":"2024-09-10T08:28:34.564751+0000","last_active":"2024-09-10T08:28:48.621654+0000","last_peered":"2024-09-10T08:28:48.621654+0000","last_clean":"2024-09-10T08:28:48.621654+0000","last_became_active":"2024-09-10T08:28:34.564479+0000","last_became_peered":"2024-09-10T08:28:34.564479+0000","last_unstale":"2024-09-10T08:28:48.621654+0000","last_undegraded":"2024-09-10T08:28:48.621654+0000","last_fullsized":"2024-09-10T08:28:48.621654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:29.618224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634645+0000","last_change":"2024-09-10T08:28:47.627041+0000","last_active":"2024-09-10T08:28:48.634645+0000","last_peered":"2024-09-10T08:28:48.634645+0000","last_clean":"2024-09-10T08:28:48.634645+0000","last_became_active":"2024-09-10T08:28:47.626692+0000","last_became_peered":"2024-09-10T08:28:47.626692+0000","last_unstale":"2024-09-10T08:28:48.634645+0000","last_undegraded":"2024-09-10T08:28:48.634645+0000","last_fullsized":"2024-09-10T08:28:48.634645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:57.666849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421403+0000","last_change":"2024-09-10T08:28:34.561906+0000","last_active":"2024-09-10T08:28:49.421403+0000","last_peered":"2024-09-10T08:28:49.421403+0000","last_clean":"2024-09-10T08:28:49.421403+0000","last_became_active":"2024-09-10T08:28:34.561613+0000","last_became_peered":"2024-09-10T08:28:34.561613+0000","last_unstale":"2024-09-10T08:28:49.421403+0000","last_undegraded":"2024-09-10T08:28:49.421403+0000","last_fullsized":"2024-09-10T08:28:49.421403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:56.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632248+0000","last_change":"2024-09-10T08:28:35.576406+0000","last_active":"2024-09-10T08:28:48.632248+0000","last_peered":"2024-09-10T08:28:48.632248+0000","last_clean":"2024-09-10T08:28:48.632248+0000","last_became_active":"2024-09-10T08:28:35.576145+0000","last_became_peered":"2024-09-10T08:28:35.576145+0000","last_unstale":"2024-09-10T08:28:48.632248+0000","last_undegraded":"2024-09-10T08:28:48.632248+0000","last_fullsized":"2024-09-10T08:28:48.632248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:57.667098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299845+0000","last_change":"2024-09-10T08:28:46.622395+0000","last_active":"2024-09-10T08:28:49.299845+0000","last_peered":"2024-09-10T08:28:49.299845+0000","last_clean":"2024-09-10T08:28:49.299845+0000","last_became_active":"2024-09-10T08:28:46.621941+0000","last_became_peered":"2024-09-10T08:28:46.621941+0000","last_unstale":"2024-09-10T08:28:49.299845+0000","last_undegraded":"2024-09-10T08:28:49.299845+0000","last_fullsized":"2024-09-10T08:28:49.299845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:54.928969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621387+0000","last_change":"2024-09-10T08:28:47.626495+0000","last_active":"2024-09-10T08:28:48.621387+0000","last_peered":"2024-09-10T08:28:48.621387+0000","last_clean":"2024-09-10T08:28:48.621387+0000","last_became_active":"2024-09-10T08:28:47.625258+0000","last_became_peered":"2024-09-10T08:28:47.625258+0000","last_unstale":"2024-09-10T08:28:48.621387+0000","last_undegraded":"2024-09-10T08:28:48.621387+0000","last_fullsized":"2024-09-10T08:28:48.621387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:00.101586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622005+0000","last_change":"2024-09-10T08:28:34.566606+0000","last_active":"2024-09-10T08:28:48.622005+0000","last_peered":"2024-09-10T08:28:48.622005+0000","last_clean":"2024-09-10T08:28:48.622005+0000","last_became_active":"2024-09-10T08:28:34.566388+0000","last_became_peered":"2024-09-10T08:28:34.566388+0000","last_unstale":"2024-09-10T08:28:48.622005+0000","last_undegraded":"2024-09-10T08:28:48.622005+0000","last_fullsized":"2024-09-10T08:28:48.622005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:33.528801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621394+0000","last_change":"2024-09-10T08:28:35.559371+0000","last_active":"2024-09-10T08:28:48.621394+0000","last_peered":"2024-09-10T08:28:48.621394+0000","last_clean":"2024-09-10T08:28:48.621394+0000","last_became_active":"2024-09-10T08:28:35.559145+0000","last_became_peered":"2024-09-10T08:28:35.559145+0000","last_unstale":"2024-09-10T08:28:48.621394+0000","last_undegraded":"2024-09-10T08:28:48.621394+0000","last_fullsized":"2024-09-10T08:28:48.621394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:57.339318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621811+0000","last_change":"2024-09-10T08:28:46.620231+0000","last_active":"2024-09-10T08:28:48.621811+0000","last_peered":"2024-09-10T08:28:48.621811+0000","last_clean":"2024-09-10T08:28:48.621811+0000","last_became_active":"2024-09-10T08:28:46.619403+0000","last_became_peered":"2024-09-10T08:28:46.619403+0000","last_unstale":"2024-09-10T08:28:48.621811+0000","last_undegraded":"2024-09-10T08:28:48.621811+0000","last_fullsized":"2024-09-10T08:28:48.621811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:26.308749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622383+0000","last_change":"2024-09-10T08:28:47.627135+0000","last_active":"2024-09-10T08:28:48.622383+0000","last_peered":"2024-09-10T08:28:48.622383+0000","last_clean":"2024-09-10T08:28:48.622383+0000","last_became_active":"2024-09-10T08:28:47.626791+0000","last_became_peered":"2024-09-10T08:28:47.626791+0000","last_unstale":"2024-09-10T08:28:48.622383+0000","last_undegraded":"2024-09-10T08:28:48.622383+0000","last_fullsized":"2024-09-10T08:28:48.622383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:43.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.420972+0000","last_change":"2024-09-10T08:28:35.579106+0000","last_active":"2024-09-10T08:28:49.420972+0000","last_peered":"2024-09-10T08:28:49.420972+0000","last_clean":"2024-09-10T08:28:49.420972+0000","last_became_active":"2024-09-10T08:28:35.578631+0000","last_became_peered":"2024-09-10T08:28:35.578631+0000","last_unstale":"2024-09-10T08:28:49.420972+0000","last_undegraded":"2024-09-10T08:28:49.420972+0000","last_fullsized":"2024-09-10T08:28:49.420972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:31.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634751+0000","last_change":"2024-09-10T08:28:47.632052+0000","last_active":"2024-09-10T08:28:48.634751+0000","last_peered":"2024-09-10T08:28:48.634751+0000","last_clean":"2024-09-10T08:28:48.634751+0000","last_became_active":"2024-09-10T08:28:47.631578+0000","last_became_peered":"2024-09-10T08:28:47.631578+0000","last_unstale":"2024-09-10T08:28:48.634751+0000","last_undegraded":"2024-09-10T08:28:48.634751+0000","last_fullsized":"2024-09-10T08:28:48.634751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:24.570729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299570+0000","last_change":"2024-09-10T08:28:35.566780+0000","last_active":"2024-09-10T08:28:49.299570+0000","last_peered":"2024-09-10T08:28:49.299570+0000","last_clean":"2024-09-10T08:28:49.299570+0000","last_became_active":"2024-09-10T08:28:35.566529+0000","last_became_peered":"2024-09-10T08:28:35.566529+0000","last_unstale":"2024-09-10T08:28:49.299570+0000","last_undegraded":"2024-09-10T08:28:49.299570+0000","last_fullsized":"2024-09-10T08:28:49.299570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:09.481166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621043+0000","last_change":"2024-09-10T08:28:47.629148+0000","last_active":"2024-09-10T08:28:48.621043+0000","last_peered":"2024-09-10T08:28:48.621043+0000","last_clean":"2024-09-10T08:28:48.621043+0000","last_became_active":"2024-09-10T08:28:47.628741+0000","last_became_peered":"2024-09-10T08:28:47.628741+0000","last_unstale":"2024-09-10T08:28:48.621043+0000","last_undegraded":"2024-09-10T08:28:48.621043+0000","last_fullsized":"2024-09-10T08:28:48.621043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:48.950503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621017+0000","last_change":"2024-09-10T08:28:35.578735+0000","last_active":"2024-09-10T08:28:48.621017+0000","last_peered":"2024-09-10T08:28:48.621017+0000","last_clean":"2024-09-10T08:28:48.621017+0000","last_became_active":"2024-09-10T08:28:35.577995+0000","last_became_peered":"2024-09-10T08:28:35.577995+0000","last_unstale":"2024-09-10T08:28:48.621017+0000","last_undegraded":"2024-09-10T08:28:48.621017+0000","last_fullsized":"2024-09-10T08:28:48.621017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:11.033441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634650+0000","last_change":"2024-09-10T08:28:47.628639+0000","last_active":"2024-09-10T08:28:48.634650+0000","last_peered":"2024-09-10T08:28:48.634650+0000","last_clean":"2024-09-10T08:28:48.634650+0000","last_became_active":"2024-09-10T08:28:47.628317+0000","last_became_peered":"2024-09-10T08:28:47.628317+0000","last_unstale":"2024-09-10T08:28:48.634650+0000","last_undegraded":"2024-09-10T08:28:48.634650+0000","last_fullsized":"2024-09-10T08:28:48.634650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:50.314678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632190+0000","last_change":"2024-09-10T08:28:35.577852+0000","last_active":"2024-09-10T08:28:48.632190+0000","last_peered":"2024-09-10T08:28:48.632190+0000","last_clean":"2024-09-10T08:28:48.632190+0000","last_became_active":"2024-09-10T08:28:35.577571+0000","last_became_peered":"2024-09-10T08:28:35.577571+0000","last_unstale":"2024-09-10T08:28:48.632190+0000","last_undegraded":"2024-09-10T08:28:48.632190+0000","last_fullsized":"2024-09-10T08:28:48.632190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:22.713732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354207+0000","last_change":"2024-09-10T08:28:47.629931+0000","last_active":"2024-09-10T08:28:49.354207+0000","last_peered":"2024-09-10T08:28:49.354207+0000","last_clean":"2024-09-10T08:28:49.354207+0000","last_became_active":"2024-09-10T08:28:47.629634+0000","last_became_peered":"2024-09-10T08:28:47.629634+0000","last_unstale":"2024-09-10T08:28:49.354207+0000","last_undegraded":"2024-09-10T08:28:49.354207+0000","last_fullsized":"2024-09-10T08:28:49.354207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:57.964208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622194+0000","last_change":"2024-09-10T08:28:35.574676+0000","last_active":"2024-09-10T08:28:48.622194+0000","last_peered":"2024-09-10T08:28:48.622194+0000","last_clean":"2024-09-10T08:28:48.622194+0000","last_became_active":"2024-09-10T08:28:35.574437+0000","last_became_peered":"2024-09-10T08:28:35.574437+0000","last_unstale":"2024-09-10T08:28:48.622194+0000","last_undegraded":"2024-09-10T08:28:48.622194+0000","last_fullsized":"2024-09-10T08:28:48.622194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:45.422506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620118+0000","last_change":"2024-09-10T08:28:47.624178+0000","last_active":"2024-09-10T08:28:48.620118+0000","last_peered":"2024-09-10T08:28:48.620118+0000","last_clean":"2024-09-10T08:28:48.620118+0000","last_became_active":"2024-09-10T08:28:47.623671+0000","last_became_peered":"2024-09-10T08:28:47.623671+0000","last_unstale":"2024-09-10T08:28:48.620118+0000","last_undegraded":"2024-09-10T08:28:48.620118+0000","last_fullsized":"2024-09-10T08:28:48.620118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:48.613870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634693+0000","last_change":"2024-09-10T08:28:35.572550+0000","last_active":"2024-09-10T08:28:48.634693+0000","last_peered":"2024-09-10T08:28:48.634693+0000","last_clean":"2024-09-10T08:28:48.634693+0000","last_became_active":"2024-09-10T08:28:35.572184+0000","last_became_peered":"2024-09-10T08:28:35.572184+0000","last_unstale":"2024-09-10T08:28:48.634693+0000","last_undegraded":"2024-09-10T08:28:48.634693+0000","last_fullsized":"2024-09-10T08:28:48.634693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:08.490734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354228+0000","last_change":"2024-09-10T08:28:47.630214+0000","last_active":"2024-09-10T08:28:49.354228+0000","last_peered":"2024-09-10T08:28:49.354228+0000","last_clean":"2024-09-10T08:28:49.354228+0000","last_became_active":"2024-09-10T08:28:47.629512+0000","last_became_peered":"2024-09-10T08:28:47.629512+0000","last_unstale":"2024-09-10T08:28:49.354228+0000","last_undegraded":"2024-09-10T08:28:49.354228+0000","last_fullsized":"2024-09-10T08:28:49.354228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:35.692107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421683+0000","last_change":"2024-09-10T08:28:35.573217+0000","last_active":"2024-09-10T08:28:49.421683+0000","last_peered":"2024-09-10T08:28:49.421683+0000","last_clean":"2024-09-10T08:28:49.421683+0000","last_became_active":"2024-09-10T08:28:35.572955+0000","last_became_peered":"2024-09-10T08:28:35.572955+0000","last_unstale":"2024-09-10T08:28:49.421683+0000","last_undegraded":"2024-09-10T08:28:49.421683+0000","last_fullsized":"2024-09-10T08:28:49.421683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:24.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421176+0000","last_change":"2024-09-10T08:28:47.623365+0000","last_active":"2024-09-10T08:28:49.421176+0000","last_peered":"2024-09-10T08:28:49.421176+0000","last_clean":"2024-09-10T08:28:49.421176+0000","last_became_active":"2024-09-10T08:28:47.623082+0000","last_became_peered":"2024-09-10T08:28:47.623082+0000","last_unstale":"2024-09-10T08:28:49.421176+0000","last_undegraded":"2024-09-10T08:28:49.421176+0000","last_fullsized":"2024-09-10T08:28:49.421176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:20.558484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622192+0000","last_change":"2024-09-10T08:28:35.575902+0000","last_active":"2024-09-10T08:28:48.622192+0000","last_peered":"2024-09-10T08:28:48.622192+0000","last_clean":"2024-09-10T08:28:48.622192+0000","last_became_active":"2024-09-10T08:28:35.575614+0000","last_became_peered":"2024-09-10T08:28:35.575614+0000","last_unstale":"2024-09-10T08:28:48.622192+0000","last_undegraded":"2024-09-10T08:28:48.622192+0000","last_fullsized":"2024-09-10T08:28:48.622192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:11.277682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622312+0000","last_change":"2024-09-10T08:28:47.629795+0000","last_active":"2024-09-10T08:28:48.622312+0000","last_peered":"2024-09-10T08:28:48.622312+0000","last_clean":"2024-09-10T08:28:48.622312+0000","last_became_active":"2024-09-10T08:28:47.628861+0000","last_became_peered":"2024-09-10T08:28:47.628861+0000","last_unstale":"2024-09-10T08:28:48.622312+0000","last_undegraded":"2024-09-10T08:28:48.622312+0000","last_fullsized":"2024-09-10T08:28:48.622312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:06.277094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620538+0000","last_change":"2024-09-10T08:28:35.578285+0000","last_active":"2024-09-10T08:28:48.620538+0000","last_peered":"2024-09-10T08:28:48.620538+0000","last_clean":"2024-09-10T08:28:48.620538+0000","last_became_active":"2024-09-10T08:28:35.576805+0000","last_became_peered":"2024-09-10T08:28:35.576805+0000","last_unstale":"2024-09-10T08:28:48.620538+0000","last_undegraded":"2024-09-10T08:28:48.620538+0000","last_fullsized":"2024-09-10T08:28:48.620538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:46.203320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355252+0000","last_change":"2024-09-10T08:28:47.635713+0000","last_active":"2024-09-10T08:28:49.355252+0000","last_peered":"2024-09-10T08:28:49.355252+0000","last_clean":"2024-09-10T08:28:49.355252+0000","last_became_active":"2024-09-10T08:28:47.635381+0000","last_became_peered":"2024-09-10T08:28:47.635381+0000","last_unstale":"2024-09-10T08:28:49.355252+0000","last_undegraded":"2024-09-10T08:28:49.355252+0000","last_fullsized":"2024-09-10T08:28:49.355252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:39.419510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621520+0000","last_change":"2024-09-10T08:28:35.571566+0000","last_active":"2024-09-10T08:28:48.621520+0000","last_peered":"2024-09-10T08:28:48.621520+0000","last_clean":"2024-09-10T08:28:48.621520+0000","last_became_active":"2024-09-10T08:28:35.571285+0000","last_became_peered":"2024-09-10T08:28:35.571285+0000","last_unstale":"2024-09-10T08:28:48.621520+0000","last_undegraded":"2024-09-10T08:28:48.621520+0000","last_fullsized":"2024-09-10T08:28:48.621520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:23.587691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299893+0000","last_change":"2024-09-10T08:28:47.619863+0000","last_active":"2024-09-10T08:28:49.299893+0000","last_peered":"2024-09-10T08:28:49.299893+0000","last_clean":"2024-09-10T08:28:49.299893+0000","last_became_active":"2024-09-10T08:28:47.619525+0000","last_became_peered":"2024-09-10T08:28:47.619525+0000","last_unstale":"2024-09-10T08:28:49.299893+0000","last_undegraded":"2024-09-10T08:28:49.299893+0000","last_fullsized":"2024-09-10T08:28:49.299893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:49.591318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620937+0000","last_change":"2024-09-10T08:28:35.568044+0000","last_active":"2024-09-10T08:28:48.620937+0000","last_peered":"2024-09-10T08:28:48.620937+0000","last_clean":"2024-09-10T08:28:48.620937+0000","last_became_active":"2024-09-10T08:28:35.567744+0000","last_became_peered":"2024-09-10T08:28:35.567744+0000","last_unstale":"2024-09-10T08:28:48.620937+0000","last_undegraded":"2024-09-10T08:28:48.620937+0000","last_fullsized":"2024-09-10T08:28:48.620937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:19.081138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621697+0000","last_change":"2024-09-10T08:28:47.629417+0000","last_active":"2024-09-10T08:28:48.621697+0000","last_peered":"2024-09-10T08:28:48.621697+0000","last_clean":"2024-09-10T08:28:48.621697+0000","last_became_active":"2024-09-10T08:28:47.629095+0000","last_became_peered":"2024-09-10T08:28:47.629095+0000","last_unstale":"2024-09-10T08:28:48.621697+0000","last_undegraded":"2024-09-10T08:28:48.621697+0000","last_fullsized":"2024-09-10T08:28:48.621697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:05.606381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632075+0000","last_change":"2024-09-10T08:28:35.575802+0000","last_active":"2024-09-10T08:28:48.632075+0000","last_peered":"2024-09-10T08:28:48.632075+0000","last_clean":"2024-09-10T08:28:48.632075+0000","last_became_active":"2024-09-10T08:28:35.575388+0000","last_became_peered":"2024-09-10T08:28:35.575388+0000","last_unstale":"2024-09-10T08:28:48.632075+0000","last_undegraded":"2024-09-10T08:28:48.632075+0000","last_fullsized":"2024-09-10T08:28:48.632075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:01.424265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620142+0000","last_change":"2024-09-10T08:28:47.624305+0000","last_active":"2024-09-10T08:28:48.620142+0000","last_peered":"2024-09-10T08:28:48.620142+0000","last_clean":"2024-09-10T08:28:48.620142+0000","last_became_active":"2024-09-10T08:28:47.624026+0000","last_became_peered":"2024-09-10T08:28:47.624026+0000","last_unstale":"2024-09-10T08:28:48.620142+0000","last_undegraded":"2024-09-10T08:28:48.620142+0000","last_fullsized":"2024-09-10T08:28:48.620142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:01.194271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421368+0000","last_change":"2024-09-10T08:28:35.574499+0000","last_active":"2024-09-10T08:28:49.421368+0000","last_peered":"2024-09-10T08:28:49.421368+0000","last_clean":"2024-09-10T08:28:49.421368+0000","last_became_active":"2024-09-10T08:28:35.574249+0000","last_became_peered":"2024-09-10T08:28:35.574249+0000","last_unstale":"2024-09-10T08:28:49.421368+0000","last_undegraded":"2024-09-10T08:28:49.421368+0000","last_fullsized":"2024-09-10T08:28:49.421368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:55.952307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620349+0000","last_change":"2024-09-10T08:28:47.629525+0000","last_active":"2024-09-10T08:28:48.620349+0000","last_peered":"2024-09-10T08:28:48.620349+0000","last_clean":"2024-09-10T08:28:48.620349+0000","last_became_active":"2024-09-10T08:28:47.629259+0000","last_became_peered":"2024-09-10T08:28:47.629259+0000","last_unstale":"2024-09-10T08:28:48.620349+0000","last_undegraded":"2024-09-10T08:28:48.620349+0000","last_fullsized":"2024-09-10T08:28:48.620349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:11.864322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355002+0000","last_change":"2024-09-10T08:28:35.572709+0000","last_active":"2024-09-10T08:28:49.355002+0000","last_peered":"2024-09-10T08:28:49.355002+0000","last_clean":"2024-09-10T08:28:49.355002+0000","last_became_active":"2024-09-10T08:28:35.572392+0000","last_became_peered":"2024-09-10T08:28:35.572392+0000","last_unstale":"2024-09-10T08:28:49.355002+0000","last_undegraded":"2024-09-10T08:28:49.355002+0000","last_fullsized":"2024-09-10T08:28:49.355002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:42.636299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619769+0000","last_change":"2024-09-10T08:28:47.623285+0000","last_active":"2024-09-10T08:28:48.619769+0000","last_peered":"2024-09-10T08:28:48.619769+0000","last_clean":"2024-09-10T08:28:48.619769+0000","last_became_active":"2024-09-10T08:28:47.621776+0000","last_became_peered":"2024-09-10T08:28:47.621776+0000","last_unstale":"2024-09-10T08:28:48.619769+0000","last_undegraded":"2024-09-10T08:28:48.619769+0000","last_fullsized":"2024-09-10T08:28:48.619769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:32.543418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.300034+0000","last_change":"2024-09-10T08:28:35.574438+0000","last_active":"2024-09-10T08:28:49.300034+0000","last_peered":"2024-09-10T08:28:49.300034+0000","last_clean":"2024-09-10T08:28:49.300034+0000","last_became_active":"2024-09-10T08:28:35.574175+0000","last_became_peered":"2024-09-10T08:28:35.574175+0000","last_unstale":"2024-09-10T08:28:49.300034+0000","last_undegraded":"2024-09-10T08:28:49.300034+0000","last_fullsized":"2024-09-10T08:28:49.300034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:55.808543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631598+0000","last_change":"2024-09-10T08:28:47.629092+0000","last_active":"2024-09-10T08:28:48.631598+0000","last_peered":"2024-09-10T08:28:48.631598+0000","last_clean":"2024-09-10T08:28:48.631598+0000","last_became_active":"2024-09-10T08:28:47.628806+0000","last_became_peered":"2024-09-10T08:28:47.628806+0000","last_unstale":"2024-09-10T08:28:48.631598+0000","last_undegraded":"2024-09-10T08:28:48.631598+0000","last_fullsized":"2024-09-10T08:28:48.631598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:46.440290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622000+0000","last_change":"2024-09-10T08:28:35.567296+0000","last_active":"2024-09-10T08:28:48.622000+0000","last_peered":"2024-09-10T08:28:48.622000+0000","last_clean":"2024-09-10T08:28:48.622000+0000","last_became_active":"2024-09-10T08:28:35.567074+0000","last_became_peered":"2024-09-10T08:28:35.567074+0000","last_unstale":"2024-09-10T08:28:48.622000+0000","last_undegraded":"2024-09-10T08:28:48.622000+0000","last_fullsized":"2024-09-10T08:28:48.622000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:55.698345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634643+0000","last_change":"2024-09-10T08:28:47.631797+0000","last_active":"2024-09-10T08:28:48.634643+0000","last_peered":"2024-09-10T08:28:48.634643+0000","last_clean":"2024-09-10T08:28:48.634643+0000","last_became_active":"2024-09-10T08:28:47.631523+0000","last_became_peered":"2024-09-10T08:28:47.631523+0000","last_unstale":"2024-09-10T08:28:48.634643+0000","last_undegraded":"2024-09-10T08:28:48.634643+0000","last_fullsized":"2024-09-10T08:28:48.634643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:05.829116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619838+0000","last_change":"2024-09-10T08:28:35.570249+0000","last_active":"2024-09-10T08:28:48.619838+0000","last_peered":"2024-09-10T08:28:48.619838+0000","last_clean":"2024-09-10T08:28:48.619838+0000","last_became_active":"2024-09-10T08:28:35.569960+0000","last_became_peered":"2024-09-10T08:28:35.569960+0000","last_unstale":"2024-09-10T08:28:48.619838+0000","last_undegraded":"2024-09-10T08:28:48.619838+0000","last_fullsized":"2024-09-10T08:28:48.619838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:29.787554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620473+0000","last_change":"2024-09-10T08:28:47.633644+0000","last_active":"2024-09-10T08:28:48.620473+0000","last_peered":"2024-09-10T08:28:48.620473+0000","last_clean":"2024-09-10T08:28:48.620473+0000","last_became_active":"2024-09-10T08:28:47.633315+0000","last_became_peered":"2024-09-10T08:28:47.633315+0000","last_unstale":"2024-09-10T08:28:48.620473+0000","last_undegraded":"2024-09-10T08:28:48.620473+0000","last_fullsized":"2024-09-10T08:28:48.620473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:45:55.827386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634008+0000","last_change":"2024-09-10T08:28:35.560693+0000","last_active":"2024-09-10T08:28:48.634008+0000","last_peered":"2024-09-10T08:28:48.634008+0000","last_clean":"2024-09-10T08:28:48.634008+0000","last_became_active":"2024-09-10T08:28:35.560409+0000","last_became_peered":"2024-09-10T08:28:35.560409+0000","last_unstale":"2024-09-10T08:28:48.634008+0000","last_undegraded":"2024-09-10T08:28:48.634008+0000","last_fullsized":"2024-09-10T08:28:48.634008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:10.597654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621112+0000","last_change":"2024-09-10T08:28:47.622614+0000","last_active":"2024-09-10T08:28:48.621112+0000","last_peered":"2024-09-10T08:28:48.621112+0000","last_clean":"2024-09-10T08:28:48.621112+0000","last_became_active":"2024-09-10T08:28:47.622205+0000","last_became_peered":"2024-09-10T08:28:47.622205+0000","last_unstale":"2024-09-10T08:28:48.621112+0000","last_undegraded":"2024-09-10T08:28:48.621112+0000","last_fullsized":"2024-09-10T08:28:48.621112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:47.090782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631666+0000","last_change":"2024-09-10T08:28:35.574551+0000","last_active":"2024-09-10T08:28:48.631666+0000","last_peered":"2024-09-10T08:28:48.631666+0000","last_clean":"2024-09-10T08:28:48.631666+0000","last_became_active":"2024-09-10T08:28:35.574256+0000","last_became_peered":"2024-09-10T08:28:35.574256+0000","last_unstale":"2024-09-10T08:28:48.631666+0000","last_undegraded":"2024-09-10T08:28:48.631666+0000","last_fullsized":"2024-09-10T08:28:48.631666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:43.401552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354791+0000","last_change":"2024-09-10T08:28:47.633476+0000","last_active":"2024-09-10T08:28:49.354791+0000","last_peered":"2024-09-10T08:28:49.354791+0000","last_clean":"2024-09-10T08:28:49.354791+0000","last_became_active":"2024-09-10T08:28:47.633189+0000","last_became_peered":"2024-09-10T08:28:47.633189+0000","last_unstale":"2024-09-10T08:28:49.354791+0000","last_undegraded":"2024-09-10T08:28:49.354791+0000","last_fullsized":"2024-09-10T08:28:49.354791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:46.175490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621900+0000","last_change":"2024-09-10T08:28:35.573330+0000","last_active":"2024-09-10T08:28:48.621900+0000","last_peered":"2024-09-10T08:28:48.621900+0000","last_clean":"2024-09-10T08:28:48.621900+0000","last_became_active":"2024-09-10T08:28:35.572992+0000","last_became_peered":"2024-09-10T08:28:35.572992+0000","last_unstale":"2024-09-10T08:28:48.621900+0000","last_undegraded":"2024-09-10T08:28:48.621900+0000","last_fullsized":"2024-09-10T08:28:48.621900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:15.412219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621967+0000","last_change":"2024-09-10T08:28:47.630733+0000","last_active":"2024-09-10T08:28:48.621967+0000","last_peered":"2024-09-10T08:28:48.621967+0000","last_clean":"2024-09-10T08:28:48.621967+0000","last_became_active":"2024-09-10T08:28:47.630447+0000","last_became_peered":"2024-09-10T08:28:47.630447+0000","last_unstale":"2024-09-10T08:28:48.621967+0000","last_undegraded":"2024-09-10T08:28:48.621967+0000","last_fullsized":"2024-09-10T08:28:48.621967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:08.797818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621594+0000","last_change":"2024-09-10T08:28:35.566574+0000","last_active":"2024-09-10T08:28:48.621594+0000","last_peered":"2024-09-10T08:28:48.621594+0000","last_clean":"2024-09-10T08:28:48.621594+0000","last_became_active":"2024-09-10T08:28:35.566205+0000","last_became_peered":"2024-09-10T08:28:35.566205+0000","last_unstale":"2024-09-10T08:28:48.621594+0000","last_undegraded":"2024-09-10T08:28:48.621594+0000","last_fullsized":"2024-09-10T08:28:48.621594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:49.876773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299778+0000","last_change":"2024-09-10T08:28:47.628051+0000","last_active":"2024-09-10T08:28:49.299778+0000","last_peered":"2024-09-10T08:28:49.299778+0000","last_clean":"2024-09-10T08:28:49.299778+0000","last_became_active":"2024-09-10T08:28:47.627747+0000","last_became_peered":"2024-09-10T08:28:47.627747+0000","last_unstale":"2024-09-10T08:28:49.299778+0000","last_undegraded":"2024-09-10T08:28:49.299778+0000","last_fullsized":"2024-09-10T08:28:49.299778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:54.210449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421487+0000","last_change":"2024-09-10T08:28:35.565023+0000","last_active":"2024-09-10T08:28:49.421487+0000","last_peered":"2024-09-10T08:28:49.421487+0000","last_clean":"2024-09-10T08:28:49.421487+0000","last_became_active":"2024-09-10T08:28:35.564747+0000","last_became_peered":"2024-09-10T08:28:35.564747+0000","last_unstale":"2024-09-10T08:28:49.421487+0000","last_undegraded":"2024-09-10T08:28:49.421487+0000","last_fullsized":"2024-09-10T08:28:49.421487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:32.419621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354688+0000","last_change":"2024-09-10T08:28:47.631047+0000","last_active":"2024-09-10T08:28:49.354688+0000","last_peered":"2024-09-10T08:28:49.354688+0000","last_clean":"2024-09-10T08:28:49.354688+0000","last_became_active":"2024-09-10T08:28:47.630617+0000","last_became_peered":"2024-09-10T08:28:47.630617+0000","last_unstale":"2024-09-10T08:28:49.354688+0000","last_undegraded":"2024-09-10T08:28:49.354688+0000","last_fullsized":"2024-09-10T08:28:49.354688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:29.867640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421612+0000","last_change":"2024-09-10T08:28:35.570619+0000","last_active":"2024-09-10T08:28:49.421612+0000","last_peered":"2024-09-10T08:28:49.421612+0000","last_clean":"2024-09-10T08:28:49.421612+0000","last_became_active":"2024-09-10T08:28:35.570351+0000","last_became_peered":"2024-09-10T08:28:35.570351+0000","last_unstale":"2024-09-10T08:28:49.421612+0000","last_undegraded":"2024-09-10T08:28:49.421612+0000","last_fullsized":"2024-09-10T08:28:49.421612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:35.161279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620557+0000","last_change":"2024-09-10T08:28:47.626191+0000","last_active":"2024-09-10T08:28:48.620557+0000","last_peered":"2024-09-10T08:28:48.620557+0000","last_clean":"2024-09-10T08:28:48.620557+0000","last_became_active":"2024-09-10T08:28:47.625781+0000","last_became_peered":"2024-09-10T08:28:47.625781+0000","last_unstale":"2024-09-10T08:28:48.620557+0000","last_undegraded":"2024-09-10T08:28:48.620557+0000","last_fullsized":"2024-09-10T08:28:48.620557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:36:38.651973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355079+0000","last_change":"2024-09-10T08:28:35.577345+0000","last_active":"2024-09-10T08:28:49.355079+0000","last_peered":"2024-09-10T08:28:49.355079+0000","last_clean":"2024-09-10T08:28:49.355079+0000","last_became_active":"2024-09-10T08:28:35.576191+0000","last_became_peered":"2024-09-10T08:28:35.576191+0000","last_unstale":"2024-09-10T08:28:49.355079+0000","last_undegraded":"2024-09-10T08:28:49.355079+0000","last_fullsized":"2024-09-10T08:28:49.355079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:29.218797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622171+0000","last_change":"2024-09-10T08:28:47.623129+0000","last_active":"2024-09-10T08:28:48.622171+0000","last_peered":"2024-09-10T08:28:48.622171+0000","last_clean":"2024-09-10T08:28:48.622171+0000","last_became_active":"2024-09-10T08:28:47.622851+0000","last_became_peered":"2024-09-10T08:28:47.622851+0000","last_unstale":"2024-09-10T08:28:48.622171+0000","last_undegraded":"2024-09-10T08:28:48.622171+0000","last_fullsized":"2024-09-10T08:28:48.622171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:16.045213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621426+0000","last_change":"2024-09-10T08:28:35.575275+0000","last_active":"2024-09-10T08:28:48.621426+0000","last_peered":"2024-09-10T08:28:48.621426+0000","last_clean":"2024-09-10T08:28:48.621426+0000","last_became_active":"2024-09-10T08:28:35.575052+0000","last_became_peered":"2024-09-10T08:28:35.575052+0000","last_unstale":"2024-09-10T08:28:48.621426+0000","last_undegraded":"2024-09-10T08:28:48.621426+0000","last_fullsized":"2024-09-10T08:28:48.621426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:24.313017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421741+0000","last_change":"2024-09-10T08:28:47.628651+0000","last_active":"2024-09-10T08:28:49.421741+0000","last_peered":"2024-09-10T08:28:49.421741+0000","last_clean":"2024-09-10T08:28:49.421741+0000","last_became_active":"2024-09-10T08:28:47.628343+0000","last_became_peered":"2024-09-10T08:28:47.628343+0000","last_unstale":"2024-09-10T08:28:49.421741+0000","last_undegraded":"2024-09-10T08:28:49.421741+0000","last_fullsized":"2024-09-10T08:28:49.421741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:05.848341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354299+0000","last_change":"2024-09-10T08:28:35.578664+0000","last_active":"2024-09-10T08:28:49.354299+0000","last_peered":"2024-09-10T08:28:49.354299+0000","last_clean":"2024-09-10T08:28:49.354299+0000","last_became_active":"2024-09-10T08:28:35.578384+0000","last_became_peered":"2024-09-10T08:28:35.578384+0000","last_unstale":"2024-09-10T08:28:49.354299+0000","last_undegraded":"2024-09-10T08:28:49.354299+0000","last_fullsized":"2024-09-10T08:28:49.354299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:44.278718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634174+0000","last_change":"2024-09-10T08:28:47.627593+0000","last_active":"2024-09-10T08:28:48.634174+0000","last_peered":"2024-09-10T08:28:48.634174+0000","last_clean":"2024-09-10T08:28:48.634174+0000","last_became_active":"2024-09-10T08:28:47.627237+0000","last_became_peered":"2024-09-10T08:28:47.627237+0000","last_unstale":"2024-09-10T08:28:48.634174+0000","last_undegraded":"2024-09-10T08:28:48.634174+0000","last_fullsized":"2024-09-10T08:28:48.634174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:16.045213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620920+0000","last_change":"2024-09-10T08:28:35.578978+0000","last_active":"2024-09-10T08:28:48.620920+0000","last_peered":"2024-09-10T08:28:48.620920+0000","last_clean":"2024-09-10T08:28:48.620920+0000","last_became_active":"2024-09-10T08:28:35.578475+0000","last_became_peered":"2024-09-10T08:28:35.578475+0000","last_unstale":"2024-09-10T08:28:48.620920+0000","last_undegraded":"2024-09-10T08:28:48.620920+0000","last_fullsized":"2024-09-10T08:28:48.620920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:08.520314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621323+0000","last_change":"2024-09-10T08:28:47.634072+0000","last_active":"2024-09-10T08:28:48.621323+0000","last_peered":"2024-09-10T08:28:48.621323+0000","last_clean":"2024-09-10T08:28:48.621323+0000","last_became_active":"2024-09-10T08:28:47.633776+0000","last_became_peered":"2024-09-10T08:28:47.633776+0000","last_unstale":"2024-09-10T08:28:48.621323+0000","last_undegraded":"2024-09-10T08:28:48.621323+0000","last_fullsized":"2024-09-10T08:28:48.621323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:30.690202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354159+0000","last_change":"2024-09-10T08:28:35.572112+0000","last_active":"2024-09-10T08:28:49.354159+0000","last_peered":"2024-09-10T08:28:49.354159+0000","last_clean":"2024-09-10T08:28:49.354159+0000","last_became_active":"2024-09-10T08:28:35.571803+0000","last_became_peered":"2024-09-10T08:28:35.571803+0000","last_unstale":"2024-09-10T08:28:49.354159+0000","last_undegraded":"2024-09-10T08:28:49.354159+0000","last_fullsized":"2024-09-10T08:28:49.354159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:29.969987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621621+0000","last_change":"2024-09-10T08:28:47.620523+0000","last_active":"2024-09-10T08:28:48.621621+0000","last_peered":"2024-09-10T08:28:48.621621+0000","last_clean":"2024-09-10T08:28:48.621621+0000","last_became_active":"2024-09-10T08:28:47.620220+0000","last_became_peered":"2024-09-10T08:28:47.620220+0000","last_unstale":"2024-09-10T08:28:48.621621+0000","last_undegraded":"2024-09-10T08:28:48.621621+0000","last_fullsized":"2024-09-10T08:28:48.621621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:14.405210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621263+0000","last_change":"2024-09-10T08:28:35.578961+0000","last_active":"2024-09-10T08:28:48.621263+0000","last_peered":"2024-09-10T08:28:48.621263+0000","last_clean":"2024-09-10T08:28:48.621263+0000","last_became_active":"2024-09-10T08:28:35.578680+0000","last_became_peered":"2024-09-10T08:28:35.578680+0000","last_unstale":"2024-09-10T08:28:48.621263+0000","last_undegraded":"2024-09-10T08:28:48.621263+0000","last_fullsized":"2024-09-10T08:28:48.621263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:53.737412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299727+0000","last_change":"2024-09-10T08:28:47.624859+0000","last_active":"2024-09-10T08:28:49.299727+0000","last_peered":"2024-09-10T08:28:49.299727+0000","last_clean":"2024-09-10T08:28:49.299727+0000","last_became_active":"2024-09-10T08:28:47.624585+0000","last_became_peered":"2024-09-10T08:28:47.624585+0000","last_unstale":"2024-09-10T08:28:49.299727+0000","last_undegraded":"2024-09-10T08:28:49.299727+0000","last_fullsized":"2024-09-10T08:28:49.299727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:00.956870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631870+0000","last_change":"2024-09-10T08:28:35.573918+0000","last_active":"2024-09-10T08:28:48.631870+0000","last_peered":"2024-09-10T08:28:48.631870+0000","last_clean":"2024-09-10T08:28:48.631870+0000","last_became_active":"2024-09-10T08:28:35.573646+0000","last_became_peered":"2024-09-10T08:28:35.573646+0000","last_unstale":"2024-09-10T08:28:48.631870+0000","last_undegraded":"2024-09-10T08:28:48.631870+0000","last_fullsized":"2024-09-10T08:28:48.631870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:24.295630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354036+0000","last_change":"2024-09-10T08:28:47.631802+0000","last_active":"2024-09-10T08:28:49.354036+0000","last_peered":"2024-09-10T08:28:49.354036+0000","last_clean":"2024-09-10T08:28:49.354036+0000","last_became_active":"2024-09-10T08:28:47.631456+0000","last_became_peered":"2024-09-10T08:28:47.631456+0000","last_unstale":"2024-09-10T08:28:49.354036+0000","last_undegraded":"2024-09-10T08:28:49.354036+0000","last_fullsized":"2024-09-10T08:28:49.354036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:56.571659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634799+0000","last_change":"2024-09-10T08:28:35.578197+0000","last_active":"2024-09-10T08:28:48.634799+0000","last_peered":"2024-09-10T08:28:48.634799+0000","last_clean":"2024-09-10T08:28:48.634799+0000","last_became_active":"2024-09-10T08:28:35.577852+0000","last_became_peered":"2024-09-10T08:28:35.577852+0000","last_unstale":"2024-09-10T08:28:48.634799+0000","last_undegraded":"2024-09-10T08:28:48.634799+0000","last_fullsized":"2024-09-10T08:28:48.634799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:44.348299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354168+0000","last_change":"2024-09-10T08:28:47.629993+0000","last_active":"2024-09-10T08:28:49.354168+0000","last_peered":"2024-09-10T08:28:49.354168+0000","last_clean":"2024-09-10T08:28:49.354168+0000","last_became_active":"2024-09-10T08:28:47.629713+0000","last_became_peered":"2024-09-10T08:28:47.629713+0000","last_unstale":"2024-09-10T08:28:49.354168+0000","last_undegraded":"2024-09-10T08:28:49.354168+0000","last_fullsized":"2024-09-10T08:28:49.354168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:56.640722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355024+0000","last_change":"2024-09-10T08:28:35.571065+0000","last_active":"2024-09-10T08:28:49.355024+0000","last_peered":"2024-09-10T08:28:49.355024+0000","last_clean":"2024-09-10T08:28:49.355024+0000","last_became_active":"2024-09-10T08:28:35.570749+0000","last_became_peered":"2024-09-10T08:28:35.570749+0000","last_unstale":"2024-09-10T08:28:49.355024+0000","last_undegraded":"2024-09-10T08:28:49.355024+0000","last_fullsized":"2024-09-10T08:28:49.355024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:04.628661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":692114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":101836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":101304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":104320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":102868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":864256,"data_stored":692080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":103302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":262144,"data_stored":101144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:29:00.261 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:29:00.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.360+0000 7f2c00674640 1 Processor -- start 2024-09-10T08:29:00.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.360+0000 7f2c00674640 1 -- start start 2024-09-10T08:29:00.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.361+0000 7f2c00674640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf80afdd0 0x7f2bf80c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.361+0000 7f2c00674640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2bf80af870 0x7f2bf80c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.361+0000 7f2c00674640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf80c54e0 con 0x7f2bf8153af0 2024-09-10T08:29:00.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.361+0000 7f2c00674640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f2bf80c74a0 con 0x7f2bf80af870 2024-09-10T08:29:00.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.361+0000 7f2c00674640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf80c7740 con 0x7f2bf80afdd0 2024-09-10T08:29:00.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.361+0000 7f2bfec11640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2bf80af870 0x7f2bf80c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.361+0000 7f2bfdc0f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf80afdd0 0x7f2bf80c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.361+0000 7f2bfe410640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2bf8153af0 0x7f2bf81563a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:33504/0 (socket says 172.21.15.103:33504) 2024-09-10T08:29:00.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.361+0000 7f2bfe410640 1 -- 172.21.15.103:0/1702187858 learned_addr learned my addr 172.21.15.103:0/1702187858 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:29:00.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.361+0000 7f2bfdc0f640 1 -- 172.21.15.103:0/1702187858 >> v2:172.21.15.154:3300/0 conn(0x7f2bf80af870 msgr2=0x7f2bf80c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:00.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.361+0000 7f2bfdc0f640 1 --2- 172.21.15.103:0/1702187858 >> v2:172.21.15.154:3300/0 conn(0x7f2bf80af870 0x7f2bf80c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.361+0000 7f2bfdc0f640 1 -- 172.21.15.103:0/1702187858 >> v1:172.21.15.154:6789/0 conn(0x7f2bf8153af0 legacy=0x7f2bf81563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.361+0000 7f2bfdc0f640 1 -- 172.21.15.103:0/1702187858 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf815a3c0 con 0x7f2bf80afdd0 2024-09-10T08:29:00.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.362+0000 7f2bfdc0f640 1 --2- 172.21.15.103:0/1702187858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf80afdd0 0x7f2bf80c5900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2be80097a0 tx=0x7f2be802a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b9883b2657cc3d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:00.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.362+0000 7f2bfd40e640 1 -- 172.21.15.103:0/1702187858 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be8037070 con 0x7f2bf80afdd0 2024-09-10T08:29:00.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.362+0000 7f2bfd40e640 1 -- 172.21.15.103:0/1702187858 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2be802adb0 con 0x7f2bf80afdd0 2024-09-10T08:29:00.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.362+0000 7f2bfd40e640 1 -- 172.21.15.103:0/1702187858 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be8032660 con 0x7f2bf80afdd0 2024-09-10T08:29:00.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.363+0000 7f2c00674640 1 -- 172.21.15.103:0/1702187858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf80afdd0 msgr2=0x7f2bf80c5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.363+0000 7f2c00674640 1 --2- 172.21.15.103:0/1702187858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf80afdd0 0x7f2bf80c5900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2be80097a0 tx=0x7f2be802a060 comp rx=0 tx=0).stop 2024-09-10T08:29:00.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.363+0000 7f2c00674640 1 -- 172.21.15.103:0/1702187858 shutdown_connections 2024-09-10T08:29:00.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.363+0000 7f2c00674640 1 --2- 172.21.15.103:0/1702187858 >> v2:172.21.15.154:3300/0 conn(0x7f2bf80af870 0x7f2bf80c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.363+0000 7f2c00674640 1 --2- 172.21.15.103:0/1702187858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf80afdd0 0x7f2bf80c5900 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.363+0000 7f2c00674640 1 -- 172.21.15.103:0/1702187858 >> 172.21.15.103:0/1702187858 conn(0x7f2bf80c6880 msgr2=0x7f2bf80c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:00.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.363+0000 7f2c00674640 1 -- 172.21.15.103:0/1702187858 shutdown_connections 2024-09-10T08:29:00.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.363+0000 7f2c00674640 1 -- 172.21.15.103:0/1702187858 wait complete. 2024-09-10T08:29:00.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.364+0000 7f2c00674640 1 Processor -- start 2024-09-10T08:29:00.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.364+0000 7f2c00674640 1 -- start start 2024-09-10T08:29:00.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.365+0000 7f2c00674640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf80af870 0x7f2bf806f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.365+0000 7f2c00674640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf80afdd0 0x7f2bf814cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.365+0000 7f2c00674640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bf8153af0 0x7f2bf81559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.365+0000 7f2c00674640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf8154050 con 0x7f2bf80af870 2024-09-10T08:29:00.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.365+0000 7f2c00674640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf8153ed0 con 0x7f2bf8153af0 2024-09-10T08:29:00.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.365+0000 7f2c00674640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf80c4cc0 con 0x7f2bf80afdd0 2024-09-10T08:29:00.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.365+0000 7f2bfe410640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf80af870 0x7f2bf806f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.365+0000 7f2bfe410640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf80af870 0x7f2bf806f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49880/0 (socket says 172.21.15.103:49880) 2024-09-10T08:29:00.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.365+0000 7f2bfe410640 1 -- 172.21.15.103:0/2940662800 learned_addr learned my addr 172.21.15.103:0/2940662800 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:00.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.365+0000 7f2bfec11640 1 --2- 172.21.15.103:0/2940662800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bf8153af0 0x7f2bf81559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.365+0000 7f2bfdc0f640 1 --2- 172.21.15.103:0/2940662800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf80afdd0 0x7f2bf814cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.365+0000 7f2bfe410640 1 -- 172.21.15.103:0/2940662800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf80afdd0 msgr2=0x7f2bf814cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.365+0000 7f2bfe410640 1 --2- 172.21.15.103:0/2940662800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf80afdd0 0x7f2bf814cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.365+0000 7f2bfe410640 1 -- 172.21.15.103:0/2940662800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bf8153af0 msgr2=0x7f2bf81559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.365+0000 7f2bfe410640 1 --2- 172.21.15.103:0/2940662800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bf8153af0 0x7f2bf81559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.365+0000 7f2bfe410640 1 -- 172.21.15.103:0/2940662800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf81efba0 con 0x7f2bf80af870 2024-09-10T08:29:00.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.365+0000 7f2bfe410640 1 --2- 172.21.15.103:0/2940662800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf80af870 0x7f2bf806f4b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400c3c0 tx=0x7f2bf400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:00.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.365+0000 7f2beeffd640 1 -- 172.21.15.103:0/2940662800 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4017070 con 0x7f2bf80af870 2024-09-10T08:29:00.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.365+0000 7f2beeffd640 1 -- 172.21.15.103:0/2940662800 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bf4005ce0 con 0x7f2bf80af870 2024-09-10T08:29:00.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.365+0000 7f2beeffd640 1 -- 172.21.15.103:0/2940662800 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf40072f0 con 0x7f2bf80af870 2024-09-10T08:29:00.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.365+0000 7f2c00674640 1 -- 172.21.15.103:0/2940662800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf81efe80 con 0x7f2bf80af870 2024-09-10T08:29:00.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.365+0000 7f2c00674640 1 -- 172.21.15.103:0/2940662800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf8148ff0 con 0x7f2bf80af870 2024-09-10T08:29:00.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.366+0000 7f2c00674640 1 -- 172.21.15.103:0/2940662800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf81547c0 con 0x7f2bf80af870 2024-09-10T08:29:00.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.367+0000 7f2beeffd640 1 -- 172.21.15.103:0/2940662800 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2bf401a070 con 0x7f2bf80af870 2024-09-10T08:29:00.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.367+0000 7f2beeffd640 1 --2- 172.21.15.103:0/2940662800 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2bdc06be30 0x7f2bdc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.367+0000 7f2beeffd640 1 -- 172.21.15.103:0/2940662800 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f2bf408a400 con 0x7f2bf80af870 2024-09-10T08:29:00.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.367+0000 7f2bfdc0f640 1 --2- 172.21.15.103:0/2940662800 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2bdc06be30 0x7f2bdc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.368+0000 7f2bfdc0f640 1 --2- 172.21.15.103:0/2940662800 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2bdc06be30 0x7f2bdc06e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2be8034000 tx=0x7f2be802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:00.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.372+0000 7f2beeffd640 1 -- 172.21.15.103:0/2940662800 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2bf40584c0 con 0x7f2bf80af870 2024-09-10T08:29:00.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.535+0000 7f2c00674640 1 -- 172.21.15.103:0/2940662800 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2bf80c5110 con 0x7f2bdc06be30 2024-09-10T08:29:00.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.545+0000 7f2beeffd640 1 -- 172.21.15.103:0/2940662800 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490308 (secure 0 0 0) 0x7f2bf80c5110 con 0x7f2bdc06be30 2024-09-10T08:29:00.551 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:29:00.554 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T08:29:00.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.550+0000 7f2c00674640 1 -- 172.21.15.103:0/2940662800 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2bdc06be30 msgr2=0x7f2bdc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.550+0000 7f2c00674640 1 --2- 172.21.15.103:0/2940662800 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2bdc06be30 0x7f2bdc06e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2be8034000 tx=0x7f2be802e000 comp rx=0 tx=0).stop 2024-09-10T08:29:00.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.550+0000 7f2c00674640 1 -- 172.21.15.103:0/2940662800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf80af870 msgr2=0x7f2bf806f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.550+0000 7f2c00674640 1 --2- 172.21.15.103:0/2940662800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf80af870 0x7f2bf806f4b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400c3c0 tx=0x7f2bf400c880 comp rx=0 tx=0).stop 2024-09-10T08:29:00.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.550+0000 7f2c00674640 1 -- 172.21.15.103:0/2940662800 shutdown_connections 2024-09-10T08:29:00.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.550+0000 7f2c00674640 1 --2- 172.21.15.103:0/2940662800 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2bdc06be30 0x7f2bdc06e2f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.550+0000 7f2c00674640 1 --2- 172.21.15.103:0/2940662800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bf8153af0 0x7f2bf81559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.550+0000 7f2c00674640 1 --2- 172.21.15.103:0/2940662800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2bf80afdd0 0x7f2bf814cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.550+0000 7f2c00674640 1 --2- 172.21.15.103:0/2940662800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bf80af870 0x7f2bf806f4b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.550+0000 7f2c00674640 1 -- 172.21.15.103:0/2940662800 >> 172.21.15.103:0/2940662800 conn(0x7f2bf80c6880 msgr2=0x7f2bf80c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:00.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.550+0000 7f2c00674640 1 -- 172.21.15.103:0/2940662800 shutdown_connections 2024-09-10T08:29:00.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.550+0000 7f2c00674640 1 -- 172.21.15.103:0/2940662800 wait complete. 2024-09-10T08:29:00.561 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-10T08:28:58.798642+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219544,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755176,"statfs":{"total":773094113280,"available":772869300224,"internally_reserved":0,"allocated":3383296,"data_stored":1998968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.178713"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619978+0000","last_change":"2024-09-10T08:28:47.627476+0000","last_active":"2024-09-10T08:28:48.619978+0000","last_peered":"2024-09-10T08:28:48.619978+0000","last_clean":"2024-09-10T08:28:48.619978+0000","last_became_active":"2024-09-10T08:28:47.627217+0000","last_became_peered":"2024-09-10T08:28:47.627217+0000","last_unstale":"2024-09-10T08:28:48.619978+0000","last_undegraded":"2024-09-10T08:28:48.619978+0000","last_fullsized":"2024-09-10T08:28:48.619978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:25.152836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632023+0000","last_change":"2024-09-10T08:28:34.564816+0000","last_active":"2024-09-10T08:28:48.632023+0000","last_peered":"2024-09-10T08:28:48.632023+0000","last_clean":"2024-09-10T08:28:48.632023+0000","last_became_active":"2024-09-10T08:28:34.564545+0000","last_became_peered":"2024-09-10T08:28:34.564545+0000","last_unstale":"2024-09-10T08:28:48.632023+0000","last_undegraded":"2024-09-10T08:28:48.632023+0000","last_fullsized":"2024-09-10T08:28:48.632023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:34.365104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622355+0000","last_change":"2024-09-10T08:28:35.575267+0000","last_active":"2024-09-10T08:28:48.622355+0000","last_peered":"2024-09-10T08:28:48.622355+0000","last_clean":"2024-09-10T08:28:48.622355+0000","last_became_active":"2024-09-10T08:28:35.575019+0000","last_became_peered":"2024-09-10T08:28:35.575019+0000","last_unstale":"2024-09-10T08:28:48.622355+0000","last_undegraded":"2024-09-10T08:28:48.622355+0000","last_fullsized":"2024-09-10T08:28:48.622355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:00.810645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621493+0000","last_change":"2024-09-10T08:28:46.620227+0000","last_active":"2024-09-10T08:28:48.621493+0000","last_peered":"2024-09-10T08:28:48.621493+0000","last_clean":"2024-09-10T08:28:48.621493+0000","last_became_active":"2024-09-10T08:28:46.619540+0000","last_became_peered":"2024-09-10T08:28:46.619540+0000","last_unstale":"2024-09-10T08:28:48.621493+0000","last_undegraded":"2024-09-10T08:28:48.621493+0000","last_fullsized":"2024-09-10T08:28:48.621493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:13.402155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633949+0000","last_change":"2024-09-10T08:28:47.633586+0000","last_active":"2024-09-10T08:28:48.633949+0000","last_peered":"2024-09-10T08:28:48.633949+0000","last_clean":"2024-09-10T08:28:48.633949+0000","last_became_active":"2024-09-10T08:28:47.633292+0000","last_became_peered":"2024-09-10T08:28:47.633292+0000","last_unstale":"2024-09-10T08:28:48.633949+0000","last_undegraded":"2024-09-10T08:28:48.633949+0000","last_fullsized":"2024-09-10T08:28:48.633949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:19.473028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622448+0000","last_change":"2024-09-10T08:28:34.561691+0000","last_active":"2024-09-10T08:28:48.622448+0000","last_peered":"2024-09-10T08:28:48.622448+0000","last_clean":"2024-09-10T08:28:48.622448+0000","last_became_active":"2024-09-10T08:28:34.561410+0000","last_became_peered":"2024-09-10T08:28:34.561410+0000","last_unstale":"2024-09-10T08:28:48.622448+0000","last_undegraded":"2024-09-10T08:28:48.622448+0000","last_fullsized":"2024-09-10T08:28:48.622448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.629982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631878+0000","last_change":"2024-09-10T08:28:35.579033+0000","last_active":"2024-09-10T08:28:48.631878+0000","last_peered":"2024-09-10T08:28:48.631878+0000","last_clean":"2024-09-10T08:28:48.631878+0000","last_became_active":"2024-09-10T08:28:35.578333+0000","last_became_peered":"2024-09-10T08:28:35.578333+0000","last_unstale":"2024-09-10T08:28:48.631878+0000","last_undegraded":"2024-09-10T08:28:48.631878+0000","last_fullsized":"2024-09-10T08:28:48.631878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:58.779491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619633+0000","last_change":"2024-09-10T08:28:46.617317+0000","last_active":"2024-09-10T08:28:48.619633+0000","last_peered":"2024-09-10T08:28:48.619633+0000","last_clean":"2024-09-10T08:28:48.619633+0000","last_became_active":"2024-09-10T08:28:46.616806+0000","last_became_peered":"2024-09-10T08:28:46.616806+0000","last_unstale":"2024-09-10T08:28:48.619633+0000","last_undegraded":"2024-09-10T08:28:48.619633+0000","last_fullsized":"2024-09-10T08:28:48.619633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:46.916848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354201+0000","last_change":"2024-09-10T08:28:47.633194+0000","last_active":"2024-09-10T08:28:49.354201+0000","last_peered":"2024-09-10T08:28:49.354201+0000","last_clean":"2024-09-10T08:28:49.354201+0000","last_became_active":"2024-09-10T08:28:47.632772+0000","last_became_peered":"2024-09-10T08:28:47.632772+0000","last_unstale":"2024-09-10T08:28:49.354201+0000","last_undegraded":"2024-09-10T08:28:49.354201+0000","last_fullsized":"2024-09-10T08:28:49.354201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:59.228438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354864+0000","last_change":"2024-09-10T08:28:34.571965+0000","last_active":"2024-09-10T08:28:49.354864+0000","last_peered":"2024-09-10T08:28:49.354864+0000","last_clean":"2024-09-10T08:28:49.354864+0000","last_became_active":"2024-09-10T08:28:34.571640+0000","last_became_peered":"2024-09-10T08:28:34.571640+0000","last_unstale":"2024-09-10T08:28:49.354864+0000","last_undegraded":"2024-09-10T08:28:49.354864+0000","last_fullsized":"2024-09-10T08:28:49.354864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:53.047030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621272+0000","last_change":"2024-09-10T08:28:35.562132+0000","last_active":"2024-09-10T08:28:48.621272+0000","last_peered":"2024-09-10T08:28:48.621272+0000","last_clean":"2024-09-10T08:28:48.621272+0000","last_became_active":"2024-09-10T08:28:35.561842+0000","last_became_peered":"2024-09-10T08:28:35.561842+0000","last_unstale":"2024-09-10T08:28:48.621272+0000","last_undegraded":"2024-09-10T08:28:48.621272+0000","last_fullsized":"2024-09-10T08:28:48.621272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:48.810258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620177+0000","last_change":"2024-09-10T08:28:46.621093+0000","last_active":"2024-09-10T08:28:48.620177+0000","last_peered":"2024-09-10T08:28:48.620177+0000","last_clean":"2024-09-10T08:28:48.620177+0000","last_became_active":"2024-09-10T08:28:46.620794+0000","last_became_peered":"2024-09-10T08:28:46.620794+0000","last_unstale":"2024-09-10T08:28:48.620177+0000","last_undegraded":"2024-09-10T08:28:48.620177+0000","last_fullsized":"2024-09-10T08:28:48.620177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:20.501262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620906+0000","last_change":"2024-09-10T08:28:47.627756+0000","last_active":"2024-09-10T08:28:48.620906+0000","last_peered":"2024-09-10T08:28:48.620906+0000","last_clean":"2024-09-10T08:28:48.620906+0000","last_became_active":"2024-09-10T08:28:47.627476+0000","last_became_peered":"2024-09-10T08:28:47.627476+0000","last_unstale":"2024-09-10T08:28:48.620906+0000","last_undegraded":"2024-09-10T08:28:48.620906+0000","last_fullsized":"2024-09-10T08:28:48.620906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:25.945793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354598+0000","last_change":"2024-09-10T08:28:34.566560+0000","last_active":"2024-09-10T08:28:49.354598+0000","last_peered":"2024-09-10T08:28:49.354598+0000","last_clean":"2024-09-10T08:28:49.354598+0000","last_became_active":"2024-09-10T08:28:34.566275+0000","last_became_peered":"2024-09-10T08:28:34.566275+0000","last_unstale":"2024-09-10T08:28:49.354598+0000","last_undegraded":"2024-09-10T08:28:49.354598+0000","last_fullsized":"2024-09-10T08:28:49.354598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:03.507683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621503+0000","last_change":"2024-09-10T08:28:35.560380+0000","last_active":"2024-09-10T08:28:48.621503+0000","last_peered":"2024-09-10T08:28:48.621503+0000","last_clean":"2024-09-10T08:28:48.621503+0000","last_became_active":"2024-09-10T08:28:35.560095+0000","last_became_peered":"2024-09-10T08:28:35.560095+0000","last_unstale":"2024-09-10T08:28:48.621503+0000","last_undegraded":"2024-09-10T08:28:48.621503+0000","last_fullsized":"2024-09-10T08:28:48.621503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:20.047446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621446+0000","last_change":"2024-09-10T08:28:46.620162+0000","last_active":"2024-09-10T08:28:48.621446+0000","last_peered":"2024-09-10T08:28:48.621446+0000","last_clean":"2024-09-10T08:28:48.621446+0000","last_became_active":"2024-09-10T08:28:46.619889+0000","last_became_peered":"2024-09-10T08:28:46.619889+0000","last_unstale":"2024-09-10T08:28:48.621446+0000","last_undegraded":"2024-09-10T08:28:48.621446+0000","last_fullsized":"2024-09-10T08:28:48.621446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:13.820143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634225+0000","last_change":"2024-09-10T08:28:47.631094+0000","last_active":"2024-09-10T08:28:48.634225+0000","last_peered":"2024-09-10T08:28:48.634225+0000","last_clean":"2024-09-10T08:28:48.634225+0000","last_became_active":"2024-09-10T08:28:47.630787+0000","last_became_peered":"2024-09-10T08:28:47.630787+0000","last_unstale":"2024-09-10T08:28:48.634225+0000","last_undegraded":"2024-09-10T08:28:48.634225+0000","last_fullsized":"2024-09-10T08:28:48.634225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:06.277094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421323+0000","last_change":"2024-09-10T08:28:35.572478+0000","last_active":"2024-09-10T08:28:49.421323+0000","last_peered":"2024-09-10T08:28:49.421323+0000","last_clean":"2024-09-10T08:28:49.421323+0000","last_became_active":"2024-09-10T08:28:35.572215+0000","last_became_peered":"2024-09-10T08:28:35.572215+0000","last_unstale":"2024-09-10T08:28:49.421323+0000","last_undegraded":"2024-09-10T08:28:49.421323+0000","last_fullsized":"2024-09-10T08:28:49.421323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:40.397318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354464+0000","last_change":"2024-09-10T08:28:34.569235+0000","last_active":"2024-09-10T08:28:49.354464+0000","last_peered":"2024-09-10T08:28:49.354464+0000","last_clean":"2024-09-10T08:28:49.354464+0000","last_became_active":"2024-09-10T08:28:34.568899+0000","last_became_peered":"2024-09-10T08:28:34.568899+0000","last_unstale":"2024-09-10T08:28:49.354464+0000","last_undegraded":"2024-09-10T08:28:49.354464+0000","last_fullsized":"2024-09-10T08:28:49.354464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:21.927656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620338+0000","last_change":"2024-09-10T08:28:46.618502+0000","last_active":"2024-09-10T08:28:48.620338+0000","last_peered":"2024-09-10T08:28:48.620338+0000","last_clean":"2024-09-10T08:28:48.620338+0000","last_became_active":"2024-09-10T08:28:46.616824+0000","last_became_peered":"2024-09-10T08:28:46.616824+0000","last_unstale":"2024-09-10T08:28:48.620338+0000","last_undegraded":"2024-09-10T08:28:48.620338+0000","last_fullsized":"2024-09-10T08:28:48.620338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:06.554102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299968+0000","last_change":"2024-09-10T08:28:47.627138+0000","last_active":"2024-09-10T08:28:49.299968+0000","last_peered":"2024-09-10T08:28:49.299968+0000","last_clean":"2024-09-10T08:28:49.299968+0000","last_became_active":"2024-09-10T08:28:47.626871+0000","last_became_peered":"2024-09-10T08:28:47.626871+0000","last_unstale":"2024-09-10T08:28:49.299968+0000","last_undegraded":"2024-09-10T08:28:49.299968+0000","last_fullsized":"2024-09-10T08:28:49.299968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:10.927283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621888+0000","last_change":"2024-09-10T08:28:35.577024+0000","last_active":"2024-09-10T08:28:48.621888+0000","last_peered":"2024-09-10T08:28:48.621888+0000","last_clean":"2024-09-10T08:28:48.621888+0000","last_became_active":"2024-09-10T08:28:35.576771+0000","last_became_peered":"2024-09-10T08:28:35.576771+0000","last_unstale":"2024-09-10T08:28:48.621888+0000","last_undegraded":"2024-09-10T08:28:48.621888+0000","last_fullsized":"2024-09-10T08:28:48.621888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:07.162941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634491+0000","last_change":"2024-09-10T08:28:34.561324+0000","last_active":"2024-09-10T08:28:48.634491+0000","last_peered":"2024-09-10T08:28:48.634491+0000","last_clean":"2024-09-10T08:28:48.634491+0000","last_became_active":"2024-09-10T08:28:34.560974+0000","last_became_peered":"2024-09-10T08:28:34.560974+0000","last_unstale":"2024-09-10T08:28:48.634491+0000","last_undegraded":"2024-09-10T08:28:48.634491+0000","last_fullsized":"2024-09-10T08:28:48.634491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:18.790965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621289+0000","last_change":"2024-09-10T08:28:46.620411+0000","last_active":"2024-09-10T08:28:48.621289+0000","last_peered":"2024-09-10T08:28:48.621289+0000","last_clean":"2024-09-10T08:28:48.621289+0000","last_became_active":"2024-09-10T08:28:46.619553+0000","last_became_peered":"2024-09-10T08:28:46.619553+0000","last_unstale":"2024-09-10T08:28:48.621289+0000","last_undegraded":"2024-09-10T08:28:48.621289+0000","last_fullsized":"2024-09-10T08:28:48.621289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:04.414048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620412+0000","last_change":"2024-09-10T08:28:47.628563+0000","last_active":"2024-09-10T08:28:48.620412+0000","last_peered":"2024-09-10T08:28:48.620412+0000","last_clean":"2024-09-10T08:28:48.620412+0000","last_became_active":"2024-09-10T08:28:47.628290+0000","last_became_peered":"2024-09-10T08:28:47.628290+0000","last_unstale":"2024-09-10T08:28:48.620412+0000","last_undegraded":"2024-09-10T08:28:48.620412+0000","last_fullsized":"2024-09-10T08:28:48.620412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:15.652718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621892+0000","last_change":"2024-09-10T08:28:35.572363+0000","last_active":"2024-09-10T08:28:48.621892+0000","last_peered":"2024-09-10T08:28:48.621892+0000","last_clean":"2024-09-10T08:28:48.621892+0000","last_became_active":"2024-09-10T08:28:35.572108+0000","last_became_peered":"2024-09-10T08:28:35.572108+0000","last_unstale":"2024-09-10T08:28:48.621892+0000","last_undegraded":"2024-09-10T08:28:48.621892+0000","last_fullsized":"2024-09-10T08:28:48.621892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:48.358634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634057+0000","last_change":"2024-09-10T08:28:34.564813+0000","last_active":"2024-09-10T08:28:48.634057+0000","last_peered":"2024-09-10T08:28:48.634057+0000","last_clean":"2024-09-10T08:28:48.634057+0000","last_became_active":"2024-09-10T08:28:34.564557+0000","last_became_peered":"2024-09-10T08:28:34.564557+0000","last_unstale":"2024-09-10T08:28:48.634057+0000","last_undegraded":"2024-09-10T08:28:48.634057+0000","last_fullsized":"2024-09-10T08:28:48.634057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:48.356069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634748+0000","last_change":"2024-09-10T08:28:46.625346+0000","last_active":"2024-09-10T08:28:48.634748+0000","last_peered":"2024-09-10T08:28:48.634748+0000","last_clean":"2024-09-10T08:28:48.634748+0000","last_became_active":"2024-09-10T08:28:46.625059+0000","last_became_peered":"2024-09-10T08:28:46.625059+0000","last_unstale":"2024-09-10T08:28:48.634748+0000","last_undegraded":"2024-09-10T08:28:48.634748+0000","last_fullsized":"2024-09-10T08:28:48.634748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:44.512285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621820+0000","last_change":"2024-09-10T08:28:47.621307+0000","last_active":"2024-09-10T08:28:48.621820+0000","last_peered":"2024-09-10T08:28:48.621820+0000","last_clean":"2024-09-10T08:28:48.621820+0000","last_became_active":"2024-09-10T08:28:47.621043+0000","last_became_peered":"2024-09-10T08:28:47.621043+0000","last_unstale":"2024-09-10T08:28:48.621820+0000","last_undegraded":"2024-09-10T08:28:48.621820+0000","last_fullsized":"2024-09-10T08:28:48.621820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:30.300108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620871+0000","last_change":"2024-09-10T08:28:35.569938+0000","last_active":"2024-09-10T08:28:48.620871+0000","last_peered":"2024-09-10T08:28:48.620871+0000","last_clean":"2024-09-10T08:28:48.620871+0000","last_became_active":"2024-09-10T08:28:35.569109+0000","last_became_peered":"2024-09-10T08:28:35.569109+0000","last_unstale":"2024-09-10T08:28:48.620871+0000","last_undegraded":"2024-09-10T08:28:48.620871+0000","last_fullsized":"2024-09-10T08:28:48.620871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:51.680564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354401+0000","last_change":"2024-09-10T08:28:34.571069+0000","last_active":"2024-09-10T08:28:49.354401+0000","last_peered":"2024-09-10T08:28:49.354401+0000","last_clean":"2024-09-10T08:28:49.354401+0000","last_became_active":"2024-09-10T08:28:34.570766+0000","last_became_peered":"2024-09-10T08:28:34.570766+0000","last_unstale":"2024-09-10T08:28:49.354401+0000","last_undegraded":"2024-09-10T08:28:49.354401+0000","last_fullsized":"2024-09-10T08:28:49.354401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:47.458195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620340+0000","last_change":"2024-09-10T08:28:46.616531+0000","last_active":"2024-09-10T08:28:48.620340+0000","last_peered":"2024-09-10T08:28:48.620340+0000","last_clean":"2024-09-10T08:28:48.620340+0000","last_became_active":"2024-09-10T08:28:46.616254+0000","last_became_peered":"2024-09-10T08:28:46.616254+0000","last_unstale":"2024-09-10T08:28:48.620340+0000","last_undegraded":"2024-09-10T08:28:48.620340+0000","last_fullsized":"2024-09-10T08:28:48.620340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:44.162368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621422+0000","last_change":"2024-09-10T08:28:47.628177+0000","last_active":"2024-09-10T08:28:48.621422+0000","last_peered":"2024-09-10T08:28:48.621422+0000","last_clean":"2024-09-10T08:28:48.621422+0000","last_became_active":"2024-09-10T08:28:47.627869+0000","last_became_peered":"2024-09-10T08:28:47.627869+0000","last_unstale":"2024-09-10T08:28:48.621422+0000","last_undegraded":"2024-09-10T08:28:48.621422+0000","last_fullsized":"2024-09-10T08:28:48.621422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:19.075558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632136+0000","last_change":"2024-09-10T08:28:35.575106+0000","last_active":"2024-09-10T08:28:48.632136+0000","last_peered":"2024-09-10T08:28:48.632136+0000","last_clean":"2024-09-10T08:28:48.632136+0000","last_became_active":"2024-09-10T08:28:35.574815+0000","last_became_peered":"2024-09-10T08:28:35.574815+0000","last_unstale":"2024-09-10T08:28:48.632136+0000","last_undegraded":"2024-09-10T08:28:48.632136+0000","last_fullsized":"2024-09-10T08:28:48.632136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:26.512181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421953+0000","last_change":"2024-09-10T08:28:34.564865+0000","last_active":"2024-09-10T08:28:49.421953+0000","last_peered":"2024-09-10T08:28:49.421953+0000","last_clean":"2024-09-10T08:28:49.421953+0000","last_became_active":"2024-09-10T08:28:34.564549+0000","last_became_peered":"2024-09-10T08:28:34.564549+0000","last_unstale":"2024-09-10T08:28:49.421953+0000","last_undegraded":"2024-09-10T08:28:49.421953+0000","last_fullsized":"2024-09-10T08:28:49.421953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:05.523637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620344+0000","last_change":"2024-09-10T08:28:46.622505+0000","last_active":"2024-09-10T08:28:48.620344+0000","last_peered":"2024-09-10T08:28:48.620344+0000","last_clean":"2024-09-10T08:28:48.620344+0000","last_became_active":"2024-09-10T08:28:46.621052+0000","last_became_peered":"2024-09-10T08:28:46.621052+0000","last_unstale":"2024-09-10T08:28:48.620344+0000","last_undegraded":"2024-09-10T08:28:48.620344+0000","last_fullsized":"2024-09-10T08:28:48.620344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:37.411404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620146+0000","last_change":"2024-09-10T08:28:47.624919+0000","last_active":"2024-09-10T08:28:48.620146+0000","last_peered":"2024-09-10T08:28:48.620146+0000","last_clean":"2024-09-10T08:28:48.620146+0000","last_became_active":"2024-09-10T08:28:47.624651+0000","last_became_peered":"2024-09-10T08:28:47.624651+0000","last_unstale":"2024-09-10T08:28:48.620146+0000","last_undegraded":"2024-09-10T08:28:48.620146+0000","last_fullsized":"2024-09-10T08:28:48.620146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:11.049160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622219+0000","last_change":"2024-09-10T08:28:35.574107+0000","last_active":"2024-09-10T08:28:48.622219+0000","last_peered":"2024-09-10T08:28:48.622219+0000","last_clean":"2024-09-10T08:28:48.622219+0000","last_became_active":"2024-09-10T08:28:35.573851+0000","last_became_peered":"2024-09-10T08:28:35.573851+0000","last_unstale":"2024-09-10T08:28:48.622219+0000","last_undegraded":"2024-09-10T08:28:48.622219+0000","last_fullsized":"2024-09-10T08:28:48.622219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:53.240223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634865+0000","last_change":"2024-09-10T08:28:34.563451+0000","last_active":"2024-09-10T08:28:48.634865+0000","last_peered":"2024-09-10T08:28:48.634865+0000","last_clean":"2024-09-10T08:28:48.634865+0000","last_became_active":"2024-09-10T08:28:34.563259+0000","last_became_peered":"2024-09-10T08:28:34.563259+0000","last_unstale":"2024-09-10T08:28:48.634865+0000","last_undegraded":"2024-09-10T08:28:48.634865+0000","last_fullsized":"2024-09-10T08:28:48.634865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:44.899351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621717+0000","last_change":"2024-09-10T08:28:46.623396+0000","last_active":"2024-09-10T08:28:48.621717+0000","last_peered":"2024-09-10T08:28:48.621717+0000","last_clean":"2024-09-10T08:28:48.621717+0000","last_became_active":"2024-09-10T08:28:46.623139+0000","last_became_peered":"2024-09-10T08:28:46.623139+0000","last_unstale":"2024-09-10T08:28:48.621717+0000","last_undegraded":"2024-09-10T08:28:48.621717+0000","last_fullsized":"2024-09-10T08:28:48.621717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:00.210413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421163+0000","last_change":"2024-09-10T08:28:47.634754+0000","last_active":"2024-09-10T08:28:49.421163+0000","last_peered":"2024-09-10T08:28:49.421163+0000","last_clean":"2024-09-10T08:28:49.421163+0000","last_became_active":"2024-09-10T08:28:47.634382+0000","last_became_peered":"2024-09-10T08:28:47.634382+0000","last_unstale":"2024-09-10T08:28:49.421163+0000","last_undegraded":"2024-09-10T08:28:49.421163+0000","last_fullsized":"2024-09-10T08:28:49.421163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:23.489596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634270+0000","last_change":"2024-09-10T08:28:35.567481+0000","last_active":"2024-09-10T08:28:48.634270+0000","last_peered":"2024-09-10T08:28:48.634270+0000","last_clean":"2024-09-10T08:28:48.634270+0000","last_became_active":"2024-09-10T08:28:35.567167+0000","last_became_peered":"2024-09-10T08:28:35.567167+0000","last_unstale":"2024-09-10T08:28:48.634270+0000","last_undegraded":"2024-09-10T08:28:48.634270+0000","last_fullsized":"2024-09-10T08:28:48.634270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:44.110012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355009+0000","last_change":"2024-09-10T08:28:34.571283+0000","last_active":"2024-09-10T08:28:49.355009+0000","last_peered":"2024-09-10T08:28:49.355009+0000","last_clean":"2024-09-10T08:28:49.355009+0000","last_became_active":"2024-09-10T08:28:34.570791+0000","last_became_peered":"2024-09-10T08:28:34.570791+0000","last_unstale":"2024-09-10T08:28:49.355009+0000","last_undegraded":"2024-09-10T08:28:49.355009+0000","last_fullsized":"2024-09-10T08:28:49.355009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:17.427597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631943+0000","last_change":"2024-09-10T08:28:46.630983+0000","last_active":"2024-09-10T08:28:48.631943+0000","last_peered":"2024-09-10T08:28:48.631943+0000","last_clean":"2024-09-10T08:28:48.631943+0000","last_became_active":"2024-09-10T08:28:46.630658+0000","last_became_peered":"2024-09-10T08:28:46.630658+0000","last_unstale":"2024-09-10T08:28:48.631943+0000","last_undegraded":"2024-09-10T08:28:48.631943+0000","last_fullsized":"2024-09-10T08:28:48.631943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:11.219022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632221+0000","last_change":"2024-09-10T08:28:47.625475+0000","last_active":"2024-09-10T08:28:48.632221+0000","last_peered":"2024-09-10T08:28:48.632221+0000","last_clean":"2024-09-10T08:28:48.632221+0000","last_became_active":"2024-09-10T08:28:47.625186+0000","last_became_peered":"2024-09-10T08:28:47.625186+0000","last_unstale":"2024-09-10T08:28:48.632221+0000","last_undegraded":"2024-09-10T08:28:48.632221+0000","last_fullsized":"2024-09-10T08:28:48.632221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:15.932769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621392+0000","last_change":"2024-09-10T08:28:35.576280+0000","last_active":"2024-09-10T08:28:48.621392+0000","last_peered":"2024-09-10T08:28:48.621392+0000","last_clean":"2024-09-10T08:28:48.621392+0000","last_became_active":"2024-09-10T08:28:35.576002+0000","last_became_peered":"2024-09-10T08:28:35.576002+0000","last_unstale":"2024-09-10T08:28:48.621392+0000","last_undegraded":"2024-09-10T08:28:48.621392+0000","last_fullsized":"2024-09-10T08:28:48.621392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:46.278441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634285+0000","last_change":"2024-09-10T08:28:34.555212+0000","last_active":"2024-09-10T08:28:48.634285+0000","last_peered":"2024-09-10T08:28:48.634285+0000","last_clean":"2024-09-10T08:28:48.634285+0000","last_became_active":"2024-09-10T08:28:34.554922+0000","last_became_peered":"2024-09-10T08:28:34.554922+0000","last_unstale":"2024-09-10T08:28:48.634285+0000","last_undegraded":"2024-09-10T08:28:48.634285+0000","last_fullsized":"2024-09-10T08:28:48.634285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634109+0000","last_change":"2024-09-10T08:28:46.624886+0000","last_active":"2024-09-10T08:28:48.634109+0000","last_peered":"2024-09-10T08:28:48.634109+0000","last_clean":"2024-09-10T08:28:48.634109+0000","last_became_active":"2024-09-10T08:28:46.624690+0000","last_became_peered":"2024-09-10T08:28:46.624690+0000","last_unstale":"2024-09-10T08:28:48.634109+0000","last_undegraded":"2024-09-10T08:28:48.634109+0000","last_fullsized":"2024-09-10T08:28:48.634109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:15.023379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631808+0000","last_change":"2024-09-10T08:28:47.634161+0000","last_active":"2024-09-10T08:28:48.631808+0000","last_peered":"2024-09-10T08:28:48.631808+0000","last_clean":"2024-09-10T08:28:48.631808+0000","last_became_active":"2024-09-10T08:28:47.633893+0000","last_became_peered":"2024-09-10T08:28:47.633893+0000","last_unstale":"2024-09-10T08:28:48.631808+0000","last_undegraded":"2024-09-10T08:28:48.631808+0000","last_fullsized":"2024-09-10T08:28:48.631808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:37.072370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620594+0000","last_change":"2024-09-10T08:28:35.577978+0000","last_active":"2024-09-10T08:28:48.620594+0000","last_peered":"2024-09-10T08:28:48.620594+0000","last_clean":"2024-09-10T08:28:48.620594+0000","last_became_active":"2024-09-10T08:28:35.577718+0000","last_became_peered":"2024-09-10T08:28:35.577718+0000","last_unstale":"2024-09-10T08:28:48.620594+0000","last_undegraded":"2024-09-10T08:28:48.620594+0000","last_fullsized":"2024-09-10T08:28:48.620594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:01:57.257817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621126+0000","last_change":"2024-09-10T08:28:34.553983+0000","last_active":"2024-09-10T08:28:48.621126+0000","last_peered":"2024-09-10T08:28:48.621126+0000","last_clean":"2024-09-10T08:28:48.621126+0000","last_became_active":"2024-09-10T08:28:34.553693+0000","last_became_peered":"2024-09-10T08:28:34.553693+0000","last_unstale":"2024-09-10T08:28:48.621126+0000","last_undegraded":"2024-09-10T08:28:48.621126+0000","last_fullsized":"2024-09-10T08:28:48.621126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:40.001685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634238+0000","last_change":"2024-09-10T08:28:46.620165+0000","last_active":"2024-09-10T08:28:48.634238+0000","last_peered":"2024-09-10T08:28:48.634238+0000","last_clean":"2024-09-10T08:28:48.634238+0000","last_became_active":"2024-09-10T08:28:46.619853+0000","last_became_peered":"2024-09-10T08:28:46.619853+0000","last_unstale":"2024-09-10T08:28:48.634238+0000","last_undegraded":"2024-09-10T08:28:48.634238+0000","last_fullsized":"2024-09-10T08:28:48.634238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:36.006532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.300010+0000","last_change":"2024-09-10T08:28:47.621588+0000","last_active":"2024-09-10T08:28:49.300010+0000","last_peered":"2024-09-10T08:28:49.300010+0000","last_clean":"2024-09-10T08:28:49.300010+0000","last_became_active":"2024-09-10T08:28:47.621122+0000","last_became_peered":"2024-09-10T08:28:47.621122+0000","last_unstale":"2024-09-10T08:28:49.300010+0000","last_undegraded":"2024-09-10T08:28:49.300010+0000","last_fullsized":"2024-09-10T08:28:49.300010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:11.250838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633943+0000","last_change":"2024-09-10T08:28:35.566745+0000","last_active":"2024-09-10T08:28:48.633943+0000","last_peered":"2024-09-10T08:28:48.633943+0000","last_clean":"2024-09-10T08:28:48.633943+0000","last_became_active":"2024-09-10T08:28:35.566444+0000","last_became_peered":"2024-09-10T08:28:35.566444+0000","last_unstale":"2024-09-10T08:28:48.633943+0000","last_undegraded":"2024-09-10T08:28:48.633943+0000","last_fullsized":"2024-09-10T08:28:48.633943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:52.735296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299738+0000","last_change":"2024-09-10T08:28:34.560745+0000","last_active":"2024-09-10T08:28:49.299738+0000","last_peered":"2024-09-10T08:28:49.299738+0000","last_clean":"2024-09-10T08:28:49.299738+0000","last_became_active":"2024-09-10T08:28:34.559911+0000","last_became_peered":"2024-09-10T08:28:34.559911+0000","last_unstale":"2024-09-10T08:28:49.299738+0000","last_undegraded":"2024-09-10T08:28:49.299738+0000","last_fullsized":"2024-09-10T08:28:49.299738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:00.234067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634838+0000","last_change":"2024-09-10T08:28:46.623886+0000","last_active":"2024-09-10T08:28:48.634838+0000","last_peered":"2024-09-10T08:28:48.634838+0000","last_clean":"2024-09-10T08:28:48.634838+0000","last_became_active":"2024-09-10T08:28:46.622790+0000","last_became_peered":"2024-09-10T08:28:46.622790+0000","last_unstale":"2024-09-10T08:28:48.634838+0000","last_undegraded":"2024-09-10T08:28:48.634838+0000","last_fullsized":"2024-09-10T08:28:48.634838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:06:32.333116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621918+0000","last_change":"2024-09-10T08:28:47.634500+0000","last_active":"2024-09-10T08:28:48.621918+0000","last_peered":"2024-09-10T08:28:48.621918+0000","last_clean":"2024-09-10T08:28:48.621918+0000","last_became_active":"2024-09-10T08:28:47.634219+0000","last_became_peered":"2024-09-10T08:28:47.634219+0000","last_unstale":"2024-09-10T08:28:48.621918+0000","last_undegraded":"2024-09-10T08:28:48.621918+0000","last_fullsized":"2024-09-10T08:28:48.621918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:59.689554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631587+0000","last_change":"2024-09-10T08:28:35.576360+0000","last_active":"2024-09-10T08:28:48.631587+0000","last_peered":"2024-09-10T08:28:48.631587+0000","last_clean":"2024-09-10T08:28:48.631587+0000","last_became_active":"2024-09-10T08:28:35.576096+0000","last_became_peered":"2024-09-10T08:28:35.576096+0000","last_unstale":"2024-09-10T08:28:48.631587+0000","last_undegraded":"2024-09-10T08:28:48.631587+0000","last_fullsized":"2024-09-10T08:28:48.631587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:34.159275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354630+0000","last_change":"2024-09-10T08:28:34.568477+0000","last_active":"2024-09-10T08:28:49.354630+0000","last_peered":"2024-09-10T08:28:49.354630+0000","last_clean":"2024-09-10T08:28:49.354630+0000","last_became_active":"2024-09-10T08:28:34.568249+0000","last_became_peered":"2024-09-10T08:28:34.568249+0000","last_unstale":"2024-09-10T08:28:49.354630+0000","last_undegraded":"2024-09-10T08:28:49.354630+0000","last_fullsized":"2024-09-10T08:28:49.354630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:08.640043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633193+0000","last_change":"2024-09-10T08:28:46.621567+0000","last_active":"2024-09-10T08:28:48.633193+0000","last_peered":"2024-09-10T08:28:48.633193+0000","last_clean":"2024-09-10T08:28:48.633193+0000","last_became_active":"2024-09-10T08:28:46.621272+0000","last_became_peered":"2024-09-10T08:28:46.621272+0000","last_unstale":"2024-09-10T08:28:48.633193+0000","last_undegraded":"2024-09-10T08:28:48.633193+0000","last_fullsized":"2024-09-10T08:28:48.633193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:37:34.936213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354521+0000","last_change":"2024-09-10T08:28:47.631621+0000","last_active":"2024-09-10T08:28:49.354521+0000","last_peered":"2024-09-10T08:28:49.354521+0000","last_clean":"2024-09-10T08:28:49.354521+0000","last_became_active":"2024-09-10T08:28:47.631337+0000","last_became_peered":"2024-09-10T08:28:47.631337+0000","last_unstale":"2024-09-10T08:28:49.354521+0000","last_undegraded":"2024-09-10T08:28:49.354521+0000","last_fullsized":"2024-09-10T08:28:49.354521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:04.196705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621993+0000","last_change":"2024-09-10T08:28:35.572658+0000","last_active":"2024-09-10T08:28:48.621993+0000","last_peered":"2024-09-10T08:28:48.621993+0000","last_clean":"2024-09-10T08:28:48.621993+0000","last_became_active":"2024-09-10T08:28:35.571611+0000","last_became_peered":"2024-09-10T08:28:35.571611+0000","last_unstale":"2024-09-10T08:28:48.621993+0000","last_undegraded":"2024-09-10T08:28:48.621993+0000","last_fullsized":"2024-09-10T08:28:48.621993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:42.726996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620845+0000","last_change":"2024-09-10T08:28:34.555587+0000","last_active":"2024-09-10T08:28:48.620845+0000","last_peered":"2024-09-10T08:28:48.620845+0000","last_clean":"2024-09-10T08:28:48.620845+0000","last_became_active":"2024-09-10T08:28:34.555269+0000","last_became_peered":"2024-09-10T08:28:34.555269+0000","last_unstale":"2024-09-10T08:28:48.620845+0000","last_undegraded":"2024-09-10T08:28:48.620845+0000","last_fullsized":"2024-09-10T08:28:48.620845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:19.499870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354756+0000","last_change":"2024-09-10T08:28:26.724394+0000","last_active":"2024-09-10T08:28:49.354756+0000","last_peered":"2024-09-10T08:28:49.354756+0000","last_clean":"2024-09-10T08:28:49.354756+0000","last_became_active":"2024-09-10T08:28:26.723452+0000","last_became_peered":"2024-09-10T08:28:26.723452+0000","last_unstale":"2024-09-10T08:28:49.354756+0000","last_undegraded":"2024-09-10T08:28:49.354756+0000","last_fullsized":"2024-09-10T08:28:49.354756+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_clean_scrub_stamp":"2024-09-10T08:28:25.445753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:00.811505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421307+0000","last_change":"2024-09-10T08:28:46.622048+0000","last_active":"2024-09-10T08:28:49.421307+0000","last_peered":"2024-09-10T08:28:49.421307+0000","last_clean":"2024-09-10T08:28:49.421307+0000","last_became_active":"2024-09-10T08:28:46.621770+0000","last_became_peered":"2024-09-10T08:28:46.621770+0000","last_unstale":"2024-09-10T08:28:49.421307+0000","last_undegraded":"2024-09-10T08:28:49.421307+0000","last_fullsized":"2024-09-10T08:28:49.421307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:51.430760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299891+0000","last_change":"2024-09-10T08:28:47.620746+0000","last_active":"2024-09-10T08:28:49.299891+0000","last_peered":"2024-09-10T08:28:49.299891+0000","last_clean":"2024-09-10T08:28:49.299891+0000","last_became_active":"2024-09-10T08:28:47.620492+0000","last_became_peered":"2024-09-10T08:28:47.620492+0000","last_unstale":"2024-09-10T08:28:49.299891+0000","last_undegraded":"2024-09-10T08:28:49.299891+0000","last_fullsized":"2024-09-10T08:28:49.299891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:40.117978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354858+0000","last_change":"2024-09-10T08:28:35.574532+0000","last_active":"2024-09-10T08:28:49.354858+0000","last_peered":"2024-09-10T08:28:49.354858+0000","last_clean":"2024-09-10T08:28:49.354858+0000","last_became_active":"2024-09-10T08:28:35.574215+0000","last_became_peered":"2024-09-10T08:28:35.574215+0000","last_unstale":"2024-09-10T08:28:49.354858+0000","last_undegraded":"2024-09-10T08:28:49.354858+0000","last_fullsized":"2024-09-10T08:28:49.354858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:28.455653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.300028+0000","last_change":"2024-09-10T08:28:34.559911+0000","last_active":"2024-09-10T08:28:49.300028+0000","last_peered":"2024-09-10T08:28:49.300028+0000","last_clean":"2024-09-10T08:28:49.300028+0000","last_became_active":"2024-09-10T08:28:34.559635+0000","last_became_peered":"2024-09-10T08:28:34.559635+0000","last_unstale":"2024-09-10T08:28:49.300028+0000","last_undegraded":"2024-09-10T08:28:49.300028+0000","last_fullsized":"2024-09-10T08:28:49.300028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:40.892609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421181+0000","last_change":"2024-09-10T08:28:46.620352+0000","last_active":"2024-09-10T08:28:49.421181+0000","last_peered":"2024-09-10T08:28:49.421181+0000","last_clean":"2024-09-10T08:28:49.421181+0000","last_became_active":"2024-09-10T08:28:46.620064+0000","last_became_peered":"2024-09-10T08:28:46.620064+0000","last_unstale":"2024-09-10T08:28:49.421181+0000","last_undegraded":"2024-09-10T08:28:49.421181+0000","last_fullsized":"2024-09-10T08:28:49.421181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:59.333579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299701+0000","last_change":"2024-09-10T08:28:47.620305+0000","last_active":"2024-09-10T08:28:49.299701+0000","last_peered":"2024-09-10T08:28:49.299701+0000","last_clean":"2024-09-10T08:28:49.299701+0000","last_became_active":"2024-09-10T08:28:47.620014+0000","last_became_peered":"2024-09-10T08:28:47.620014+0000","last_unstale":"2024-09-10T08:28:49.299701+0000","last_undegraded":"2024-09-10T08:28:49.299701+0000","last_fullsized":"2024-09-10T08:28:49.299701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:44.916136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621484+0000","last_change":"2024-09-10T08:28:35.577124+0000","last_active":"2024-09-10T08:28:48.621484+0000","last_peered":"2024-09-10T08:28:48.621484+0000","last_clean":"2024-09-10T08:28:48.621484+0000","last_became_active":"2024-09-10T08:28:35.576655+0000","last_became_peered":"2024-09-10T08:28:35.576655+0000","last_unstale":"2024-09-10T08:28:48.621484+0000","last_undegraded":"2024-09-10T08:28:48.621484+0000","last_fullsized":"2024-09-10T08:28:48.621484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:29.878600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634772+0000","last_change":"2024-09-10T08:28:34.560694+0000","last_active":"2024-09-10T08:28:48.634772+0000","last_peered":"2024-09-10T08:28:48.634772+0000","last_clean":"2024-09-10T08:28:48.634772+0000","last_became_active":"2024-09-10T08:28:34.560429+0000","last_became_peered":"2024-09-10T08:28:34.560429+0000","last_unstale":"2024-09-10T08:28:48.634772+0000","last_undegraded":"2024-09-10T08:28:48.634772+0000","last_fullsized":"2024-09-10T08:28:48.634772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:54.514467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631770+0000","last_change":"2024-09-10T08:28:46.622232+0000","last_active":"2024-09-10T08:28:48.631770+0000","last_peered":"2024-09-10T08:28:48.631770+0000","last_clean":"2024-09-10T08:28:48.631770+0000","last_became_active":"2024-09-10T08:28:46.621966+0000","last_became_peered":"2024-09-10T08:28:46.621966+0000","last_unstale":"2024-09-10T08:28:48.631770+0000","last_undegraded":"2024-09-10T08:28:48.631770+0000","last_fullsized":"2024-09-10T08:28:48.631770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:28.897045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354068+0000","last_change":"2024-09-10T08:28:47.630602+0000","last_active":"2024-09-10T08:28:49.354068+0000","last_peered":"2024-09-10T08:28:49.354068+0000","last_clean":"2024-09-10T08:28:49.354068+0000","last_became_active":"2024-09-10T08:28:47.630234+0000","last_became_peered":"2024-09-10T08:28:47.630234+0000","last_unstale":"2024-09-10T08:28:49.354068+0000","last_undegraded":"2024-09-10T08:28:49.354068+0000","last_fullsized":"2024-09-10T08:28:49.354068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:03.808098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355126+0000","last_change":"2024-09-10T08:28:35.577577+0000","last_active":"2024-09-10T08:28:49.355126+0000","last_peered":"2024-09-10T08:28:49.355126+0000","last_clean":"2024-09-10T08:28:49.355126+0000","last_became_active":"2024-09-10T08:28:35.576686+0000","last_became_peered":"2024-09-10T08:28:35.576686+0000","last_unstale":"2024-09-10T08:28:49.355126+0000","last_undegraded":"2024-09-10T08:28:49.355126+0000","last_fullsized":"2024-09-10T08:28:49.355126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:36.334494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.300074+0000","last_change":"2024-09-10T08:28:34.560313+0000","last_active":"2024-09-10T08:28:49.300074+0000","last_peered":"2024-09-10T08:28:49.300074+0000","last_clean":"2024-09-10T08:28:49.300074+0000","last_became_active":"2024-09-10T08:28:34.560035+0000","last_became_peered":"2024-09-10T08:28:34.560035+0000","last_unstale":"2024-09-10T08:28:49.300074+0000","last_undegraded":"2024-09-10T08:28:49.300074+0000","last_fullsized":"2024-09-10T08:28:49.300074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:56.945537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619792+0000","last_change":"2024-09-10T08:28:46.623371+0000","last_active":"2024-09-10T08:28:48.619792+0000","last_peered":"2024-09-10T08:28:48.619792+0000","last_clean":"2024-09-10T08:28:48.619792+0000","last_became_active":"2024-09-10T08:28:46.623092+0000","last_became_peered":"2024-09-10T08:28:46.623092+0000","last_unstale":"2024-09-10T08:28:48.619792+0000","last_undegraded":"2024-09-10T08:28:48.619792+0000","last_fullsized":"2024-09-10T08:28:48.619792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:36.359127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299671+0000","last_change":"2024-09-10T08:28:47.619805+0000","last_active":"2024-09-10T08:28:49.299671+0000","last_peered":"2024-09-10T08:28:49.299671+0000","last_clean":"2024-09-10T08:28:49.299671+0000","last_became_active":"2024-09-10T08:28:47.619452+0000","last_became_peered":"2024-09-10T08:28:47.619452+0000","last_unstale":"2024-09-10T08:28:49.299671+0000","last_undegraded":"2024-09-10T08:28:49.299671+0000","last_fullsized":"2024-09-10T08:28:49.299671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:20.052707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355004+0000","last_change":"2024-09-10T08:28:35.577476+0000","last_active":"2024-09-10T08:28:49.355004+0000","last_peered":"2024-09-10T08:28:49.355004+0000","last_clean":"2024-09-10T08:28:49.355004+0000","last_became_active":"2024-09-10T08:28:35.576786+0000","last_became_peered":"2024-09-10T08:28:35.576786+0000","last_unstale":"2024-09-10T08:28:49.355004+0000","last_undegraded":"2024-09-10T08:28:49.355004+0000","last_fullsized":"2024-09-10T08:28:49.355004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:46.914074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620800+0000","last_change":"2024-09-10T08:28:34.551102+0000","last_active":"2024-09-10T08:28:48.620800+0000","last_peered":"2024-09-10T08:28:48.620800+0000","last_clean":"2024-09-10T08:28:48.620800+0000","last_became_active":"2024-09-10T08:28:34.550773+0000","last_became_peered":"2024-09-10T08:28:34.550773+0000","last_unstale":"2024-09-10T08:28:48.620800+0000","last_undegraded":"2024-09-10T08:28:48.620800+0000","last_fullsized":"2024-09-10T08:28:48.620800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:35.393695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620218+0000","last_change":"2024-09-10T08:28:46.619639+0000","last_active":"2024-09-10T08:28:48.620218+0000","last_peered":"2024-09-10T08:28:48.620218+0000","last_clean":"2024-09-10T08:28:48.620218+0000","last_became_active":"2024-09-10T08:28:46.619330+0000","last_became_peered":"2024-09-10T08:28:46.619330+0000","last_unstale":"2024-09-10T08:28:48.620218+0000","last_undegraded":"2024-09-10T08:28:48.620218+0000","last_fullsized":"2024-09-10T08:28:48.620218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:10.371693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622150+0000","last_change":"2024-09-10T08:28:47.633627+0000","last_active":"2024-09-10T08:28:48.622150+0000","last_peered":"2024-09-10T08:28:48.622150+0000","last_clean":"2024-09-10T08:28:48.622150+0000","last_became_active":"2024-09-10T08:28:47.633362+0000","last_became_peered":"2024-09-10T08:28:47.633362+0000","last_unstale":"2024-09-10T08:28:48.622150+0000","last_undegraded":"2024-09-10T08:28:48.622150+0000","last_fullsized":"2024-09-10T08:28:48.622150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:19.473028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354525+0000","last_change":"2024-09-10T08:28:35.575307+0000","last_active":"2024-09-10T08:28:49.354525+0000","last_peered":"2024-09-10T08:28:49.354525+0000","last_clean":"2024-09-10T08:28:49.354525+0000","last_became_active":"2024-09-10T08:28:35.575038+0000","last_became_peered":"2024-09-10T08:28:35.575038+0000","last_unstale":"2024-09-10T08:28:49.354525+0000","last_undegraded":"2024-09-10T08:28:49.354525+0000","last_fullsized":"2024-09-10T08:28:49.354525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:36.478822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299678+0000","last_change":"2024-09-10T08:28:34.555542+0000","last_active":"2024-09-10T08:28:49.299678+0000","last_peered":"2024-09-10T08:28:49.299678+0000","last_clean":"2024-09-10T08:28:49.299678+0000","last_became_active":"2024-09-10T08:28:34.555179+0000","last_became_peered":"2024-09-10T08:28:34.555179+0000","last_unstale":"2024-09-10T08:28:49.299678+0000","last_undegraded":"2024-09-10T08:28:49.299678+0000","last_fullsized":"2024-09-10T08:28:49.299678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:53.313161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632119+0000","last_change":"2024-09-10T08:28:46.618615+0000","last_active":"2024-09-10T08:28:48.632119+0000","last_peered":"2024-09-10T08:28:48.632119+0000","last_clean":"2024-09-10T08:28:48.632119+0000","last_became_active":"2024-09-10T08:28:46.618318+0000","last_became_peered":"2024-09-10T08:28:46.618318+0000","last_unstale":"2024-09-10T08:28:48.632119+0000","last_undegraded":"2024-09-10T08:28:48.632119+0000","last_fullsized":"2024-09-10T08:28:48.632119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:44:08.185748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621616+0000","last_change":"2024-09-10T08:28:47.625025+0000","last_active":"2024-09-10T08:28:48.621616+0000","last_peered":"2024-09-10T08:28:48.621616+0000","last_clean":"2024-09-10T08:28:48.621616+0000","last_became_active":"2024-09-10T08:28:47.624230+0000","last_became_peered":"2024-09-10T08:28:47.624230+0000","last_unstale":"2024-09-10T08:28:48.621616+0000","last_undegraded":"2024-09-10T08:28:48.621616+0000","last_fullsized":"2024-09-10T08:28:48.621616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:25.530264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421027+0000","last_change":"2024-09-10T08:28:35.578892+0000","last_active":"2024-09-10T08:28:49.421027+0000","last_peered":"2024-09-10T08:28:49.421027+0000","last_clean":"2024-09-10T08:28:49.421027+0000","last_became_active":"2024-09-10T08:28:35.578299+0000","last_became_peered":"2024-09-10T08:28:35.578299+0000","last_unstale":"2024-09-10T08:28:49.421027+0000","last_undegraded":"2024-09-10T08:28:49.421027+0000","last_fullsized":"2024-09-10T08:28:49.421027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:27.485392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421503+0000","last_change":"2024-09-10T08:28:34.560444+0000","last_active":"2024-09-10T08:28:49.421503+0000","last_peered":"2024-09-10T08:28:49.421503+0000","last_clean":"2024-09-10T08:28:49.421503+0000","last_became_active":"2024-09-10T08:28:34.560188+0000","last_became_peered":"2024-09-10T08:28:34.560188+0000","last_unstale":"2024-09-10T08:28:49.421503+0000","last_undegraded":"2024-09-10T08:28:49.421503+0000","last_fullsized":"2024-09-10T08:28:49.421503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:15.727780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622124+0000","last_change":"2024-09-10T08:28:46.623483+0000","last_active":"2024-09-10T08:28:48.622124+0000","last_peered":"2024-09-10T08:28:48.622124+0000","last_clean":"2024-09-10T08:28:48.622124+0000","last_became_active":"2024-09-10T08:28:46.623211+0000","last_became_peered":"2024-09-10T08:28:46.623211+0000","last_unstale":"2024-09-10T08:28:48.622124+0000","last_undegraded":"2024-09-10T08:28:48.622124+0000","last_fullsized":"2024-09-10T08:28:48.622124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:24.611015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621121+0000","last_change":"2024-09-10T08:28:47.635185+0000","last_active":"2024-09-10T08:28:48.621121+0000","last_peered":"2024-09-10T08:28:48.621121+0000","last_clean":"2024-09-10T08:28:48.621121+0000","last_became_active":"2024-09-10T08:28:47.634782+0000","last_became_peered":"2024-09-10T08:28:47.634782+0000","last_unstale":"2024-09-10T08:28:48.621121+0000","last_undegraded":"2024-09-10T08:28:48.621121+0000","last_fullsized":"2024-09-10T08:28:48.621121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:05.512645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354247+0000","last_change":"2024-09-10T08:28:35.575788+0000","last_active":"2024-09-10T08:28:49.354247+0000","last_peered":"2024-09-10T08:28:49.354247+0000","last_clean":"2024-09-10T08:28:49.354247+0000","last_became_active":"2024-09-10T08:28:35.575333+0000","last_became_peered":"2024-09-10T08:28:35.575333+0000","last_unstale":"2024-09-10T08:28:49.354247+0000","last_undegraded":"2024-09-10T08:28:49.354247+0000","last_fullsized":"2024-09-10T08:28:49.354247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:39.756390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621367+0000","last_change":"2024-09-10T08:28:34.560699+0000","last_active":"2024-09-10T08:28:48.621367+0000","last_peered":"2024-09-10T08:28:48.621367+0000","last_clean":"2024-09-10T08:28:48.621367+0000","last_became_active":"2024-09-10T08:28:34.560376+0000","last_became_peered":"2024-09-10T08:28:34.560376+0000","last_unstale":"2024-09-10T08:28:48.621367+0000","last_undegraded":"2024-09-10T08:28:48.621367+0000","last_fullsized":"2024-09-10T08:28:48.621367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:09.981216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622076+0000","last_change":"2024-09-10T08:28:46.620745+0000","last_active":"2024-09-10T08:28:48.622076+0000","last_peered":"2024-09-10T08:28:48.622076+0000","last_clean":"2024-09-10T08:28:48.622076+0000","last_became_active":"2024-09-10T08:28:46.619030+0000","last_became_peered":"2024-09-10T08:28:46.619030+0000","last_unstale":"2024-09-10T08:28:48.622076+0000","last_undegraded":"2024-09-10T08:28:48.622076+0000","last_fullsized":"2024-09-10T08:28:48.622076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:07.653226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622129+0000","last_change":"2024-09-10T08:28:47.626648+0000","last_active":"2024-09-10T08:28:48.622129+0000","last_peered":"2024-09-10T08:28:48.622129+0000","last_clean":"2024-09-10T08:28:48.622129+0000","last_became_active":"2024-09-10T08:28:47.626330+0000","last_became_peered":"2024-09-10T08:28:47.626330+0000","last_unstale":"2024-09-10T08:28:48.622129+0000","last_undegraded":"2024-09-10T08:28:48.622129+0000","last_fullsized":"2024-09-10T08:28:48.622129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:02.346881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631691+0000","last_change":"2024-09-10T08:28:35.574810+0000","last_active":"2024-09-10T08:28:48.631691+0000","last_peered":"2024-09-10T08:28:48.631691+0000","last_clean":"2024-09-10T08:28:48.631691+0000","last_became_active":"2024-09-10T08:28:35.574567+0000","last_became_peered":"2024-09-10T08:28:35.574567+0000","last_unstale":"2024-09-10T08:28:48.631691+0000","last_undegraded":"2024-09-10T08:28:48.631691+0000","last_fullsized":"2024-09-10T08:28:48.631691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:29.315833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632297+0000","last_change":"2024-09-10T08:28:34.553556+0000","last_active":"2024-09-10T08:28:48.632297+0000","last_peered":"2024-09-10T08:28:48.632297+0000","last_clean":"2024-09-10T08:28:48.632297+0000","last_became_active":"2024-09-10T08:28:34.553275+0000","last_became_peered":"2024-09-10T08:28:34.553275+0000","last_unstale":"2024-09-10T08:28:48.632297+0000","last_undegraded":"2024-09-10T08:28:48.632297+0000","last_fullsized":"2024-09-10T08:28:48.632297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:45.957635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621256+0000","last_change":"2024-09-10T08:28:46.619760+0000","last_active":"2024-09-10T08:28:48.621256+0000","last_peered":"2024-09-10T08:28:48.621256+0000","last_clean":"2024-09-10T08:28:48.621256+0000","last_became_active":"2024-09-10T08:28:46.619165+0000","last_became_peered":"2024-09-10T08:28:46.619165+0000","last_unstale":"2024-09-10T08:28:48.621256+0000","last_undegraded":"2024-09-10T08:28:48.621256+0000","last_fullsized":"2024-09-10T08:28:48.621256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:27.691197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621842+0000","last_change":"2024-09-10T08:28:47.620135+0000","last_active":"2024-09-10T08:28:48.621842+0000","last_peered":"2024-09-10T08:28:48.621842+0000","last_clean":"2024-09-10T08:28:48.621842+0000","last_became_active":"2024-09-10T08:28:47.619661+0000","last_became_peered":"2024-09-10T08:28:47.619661+0000","last_unstale":"2024-09-10T08:28:48.621842+0000","last_undegraded":"2024-09-10T08:28:48.621842+0000","last_fullsized":"2024-09-10T08:28:48.621842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:34.815426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354721+0000","last_change":"2024-09-10T08:28:35.582473+0000","last_active":"2024-09-10T08:28:49.354721+0000","last_peered":"2024-09-10T08:28:49.354721+0000","last_clean":"2024-09-10T08:28:49.354721+0000","last_became_active":"2024-09-10T08:28:35.582205+0000","last_became_peered":"2024-09-10T08:28:35.582205+0000","last_unstale":"2024-09-10T08:28:49.354721+0000","last_undegraded":"2024-09-10T08:28:49.354721+0000","last_fullsized":"2024-09-10T08:28:49.354721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:11.200963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421457+0000","last_change":"2024-09-10T08:28:34.559823+0000","last_active":"2024-09-10T08:28:49.421457+0000","last_peered":"2024-09-10T08:28:49.421457+0000","last_clean":"2024-09-10T08:28:49.421457+0000","last_became_active":"2024-09-10T08:28:34.559560+0000","last_became_peered":"2024-09-10T08:28:34.559560+0000","last_unstale":"2024-09-10T08:28:49.421457+0000","last_undegraded":"2024-09-10T08:28:49.421457+0000","last_fullsized":"2024-09-10T08:28:49.421457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:53.724382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633994+0000","last_change":"2024-09-10T08:28:46.628040+0000","last_active":"2024-09-10T08:28:48.633994+0000","last_peered":"2024-09-10T08:28:48.633994+0000","last_clean":"2024-09-10T08:28:48.633994+0000","last_became_active":"2024-09-10T08:28:46.627819+0000","last_became_peered":"2024-09-10T08:28:46.627819+0000","last_unstale":"2024-09-10T08:28:48.633994+0000","last_undegraded":"2024-09-10T08:28:48.633994+0000","last_fullsized":"2024-09-10T08:28:48.633994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:29.467540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634305+0000","last_change":"2024-09-10T08:28:47.628067+0000","last_active":"2024-09-10T08:28:48.634305+0000","last_peered":"2024-09-10T08:28:48.634305+0000","last_clean":"2024-09-10T08:28:48.634305+0000","last_became_active":"2024-09-10T08:28:47.627775+0000","last_became_peered":"2024-09-10T08:28:47.627775+0000","last_unstale":"2024-09-10T08:28:48.634305+0000","last_undegraded":"2024-09-10T08:28:48.634305+0000","last_fullsized":"2024-09-10T08:28:48.634305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:43.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621613+0000","last_change":"2024-09-10T08:28:35.571262+0000","last_active":"2024-09-10T08:28:48.621613+0000","last_peered":"2024-09-10T08:28:48.621613+0000","last_clean":"2024-09-10T08:28:48.621613+0000","last_became_active":"2024-09-10T08:28:35.570711+0000","last_became_peered":"2024-09-10T08:28:35.570711+0000","last_unstale":"2024-09-10T08:28:48.621613+0000","last_undegraded":"2024-09-10T08:28:48.621613+0000","last_fullsized":"2024-09-10T08:28:48.621613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:29.116422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634766+0000","last_change":"2024-09-10T08:28:34.557352+0000","last_active":"2024-09-10T08:28:48.634766+0000","last_peered":"2024-09-10T08:28:48.634766+0000","last_clean":"2024-09-10T08:28:48.634766+0000","last_became_active":"2024-09-10T08:28:34.557076+0000","last_became_peered":"2024-09-10T08:28:34.557076+0000","last_unstale":"2024-09-10T08:28:48.634766+0000","last_undegraded":"2024-09-10T08:28:48.634766+0000","last_fullsized":"2024-09-10T08:28:48.634766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:04.957739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620317+0000","last_change":"2024-09-10T08:28:46.615923+0000","last_active":"2024-09-10T08:28:48.620317+0000","last_peered":"2024-09-10T08:28:48.620317+0000","last_clean":"2024-09-10T08:28:48.620317+0000","last_became_active":"2024-09-10T08:28:46.615451+0000","last_became_peered":"2024-09-10T08:28:46.615451+0000","last_unstale":"2024-09-10T08:28:48.620317+0000","last_undegraded":"2024-09-10T08:28:48.620317+0000","last_fullsized":"2024-09-10T08:28:48.620317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:22.612001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421320+0000","last_change":"2024-09-10T08:28:47.623223+0000","last_active":"2024-09-10T08:28:49.421320+0000","last_peered":"2024-09-10T08:28:49.421320+0000","last_clean":"2024-09-10T08:28:49.421320+0000","last_became_active":"2024-09-10T08:28:47.622961+0000","last_became_peered":"2024-09-10T08:28:47.622961+0000","last_unstale":"2024-09-10T08:28:49.421320+0000","last_undegraded":"2024-09-10T08:28:49.421320+0000","last_fullsized":"2024-09-10T08:28:49.421320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:30.979580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631925+0000","last_change":"2024-09-10T08:28:35.577913+0000","last_active":"2024-09-10T08:28:48.631925+0000","last_peered":"2024-09-10T08:28:48.631925+0000","last_clean":"2024-09-10T08:28:48.631925+0000","last_became_active":"2024-09-10T08:28:35.577255+0000","last_became_peered":"2024-09-10T08:28:35.577255+0000","last_unstale":"2024-09-10T08:28:48.631925+0000","last_undegraded":"2024-09-10T08:28:48.631925+0000","last_fullsized":"2024-09-10T08:28:48.631925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:17.413525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621690+0000","last_change":"2024-09-10T08:28:34.564571+0000","last_active":"2024-09-10T08:28:48.621690+0000","last_peered":"2024-09-10T08:28:48.621690+0000","last_clean":"2024-09-10T08:28:48.621690+0000","last_became_active":"2024-09-10T08:28:34.564189+0000","last_became_peered":"2024-09-10T08:28:34.564189+0000","last_unstale":"2024-09-10T08:28:48.621690+0000","last_undegraded":"2024-09-10T08:28:48.621690+0000","last_fullsized":"2024-09-10T08:28:48.621690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:46.055510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621316+0000","last_change":"2024-09-10T08:28:46.618917+0000","last_active":"2024-09-10T08:28:48.621316+0000","last_peered":"2024-09-10T08:28:48.621316+0000","last_clean":"2024-09-10T08:28:48.621316+0000","last_became_active":"2024-09-10T08:28:46.618625+0000","last_became_peered":"2024-09-10T08:28:46.618625+0000","last_unstale":"2024-09-10T08:28:48.621316+0000","last_undegraded":"2024-09-10T08:28:48.621316+0000","last_fullsized":"2024-09-10T08:28:48.621316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:19.431857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354237+0000","last_change":"2024-09-10T08:28:47.630243+0000","last_active":"2024-09-10T08:28:49.354237+0000","last_peered":"2024-09-10T08:28:49.354237+0000","last_clean":"2024-09-10T08:28:49.354237+0000","last_became_active":"2024-09-10T08:28:47.629869+0000","last_became_peered":"2024-09-10T08:28:47.629869+0000","last_unstale":"2024-09-10T08:28:49.354237+0000","last_undegraded":"2024-09-10T08:28:49.354237+0000","last_fullsized":"2024-09-10T08:28:49.354237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:58.696156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621683+0000","last_change":"2024-09-10T08:28:35.572944+0000","last_active":"2024-09-10T08:28:48.621683+0000","last_peered":"2024-09-10T08:28:48.621683+0000","last_clean":"2024-09-10T08:28:48.621683+0000","last_became_active":"2024-09-10T08:28:35.572620+0000","last_became_peered":"2024-09-10T08:28:35.572620+0000","last_unstale":"2024-09-10T08:28:48.621683+0000","last_undegraded":"2024-09-10T08:28:48.621683+0000","last_fullsized":"2024-09-10T08:28:48.621683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:04.524048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421956+0000","last_change":"2024-09-10T08:28:34.562935+0000","last_active":"2024-09-10T08:28:49.421956+0000","last_peered":"2024-09-10T08:28:49.421956+0000","last_clean":"2024-09-10T08:28:49.421956+0000","last_became_active":"2024-09-10T08:28:34.562647+0000","last_became_peered":"2024-09-10T08:28:34.562647+0000","last_unstale":"2024-09-10T08:28:49.421956+0000","last_undegraded":"2024-09-10T08:28:49.421956+0000","last_fullsized":"2024-09-10T08:28:49.421956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:47.492281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621382+0000","last_change":"2024-09-10T08:28:46.621472+0000","last_active":"2024-09-10T08:28:48.621382+0000","last_peered":"2024-09-10T08:28:48.621382+0000","last_clean":"2024-09-10T08:28:48.621382+0000","last_became_active":"2024-09-10T08:28:46.621157+0000","last_became_peered":"2024-09-10T08:28:46.621157+0000","last_unstale":"2024-09-10T08:28:48.621382+0000","last_undegraded":"2024-09-10T08:28:48.621382+0000","last_fullsized":"2024-09-10T08:28:48.621382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:44.166068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421835+0000","last_change":"2024-09-10T08:28:47.627750+0000","last_active":"2024-09-10T08:28:49.421835+0000","last_peered":"2024-09-10T08:28:49.421835+0000","last_clean":"2024-09-10T08:28:49.421835+0000","last_became_active":"2024-09-10T08:28:47.627481+0000","last_became_peered":"2024-09-10T08:28:47.627481+0000","last_unstale":"2024-09-10T08:28:49.421835+0000","last_undegraded":"2024-09-10T08:28:49.421835+0000","last_fullsized":"2024-09-10T08:28:49.421835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:01.105133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631930+0000","last_change":"2024-09-10T08:28:46.620162+0000","last_active":"2024-09-10T08:28:48.631930+0000","last_peered":"2024-09-10T08:28:48.631930+0000","last_clean":"2024-09-10T08:28:48.631930+0000","last_became_active":"2024-09-10T08:28:46.619843+0000","last_became_peered":"2024-09-10T08:28:46.619843+0000","last_unstale":"2024-09-10T08:28:48.631930+0000","last_undegraded":"2024-09-10T08:28:48.631930+0000","last_fullsized":"2024-09-10T08:28:48.631930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:21.376123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633938+0000","last_change":"2024-09-10T08:28:35.572803+0000","last_active":"2024-09-10T08:28:48.633938+0000","last_peered":"2024-09-10T08:28:48.633938+0000","last_clean":"2024-09-10T08:28:48.633938+0000","last_became_active":"2024-09-10T08:28:35.572219+0000","last_became_peered":"2024-09-10T08:28:35.572219+0000","last_unstale":"2024-09-10T08:28:48.633938+0000","last_undegraded":"2024-09-10T08:28:48.633938+0000","last_fullsized":"2024-09-10T08:28:48.633938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:45.920218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620645+0000","last_change":"2024-09-10T08:28:34.554346+0000","last_active":"2024-09-10T08:28:48.620645+0000","last_peered":"2024-09-10T08:28:48.620645+0000","last_clean":"2024-09-10T08:28:48.620645+0000","last_became_active":"2024-09-10T08:28:34.553933+0000","last_became_peered":"2024-09-10T08:28:34.553933+0000","last_unstale":"2024-09-10T08:28:48.620645+0000","last_undegraded":"2024-09-10T08:28:48.620645+0000","last_fullsized":"2024-09-10T08:28:48.620645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:07.639671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631936+0000","last_change":"2024-09-10T08:28:47.629468+0000","last_active":"2024-09-10T08:28:48.631936+0000","last_peered":"2024-09-10T08:28:48.631936+0000","last_clean":"2024-09-10T08:28:48.631936+0000","last_became_active":"2024-09-10T08:28:47.629177+0000","last_became_peered":"2024-09-10T08:28:47.629177+0000","last_unstale":"2024-09-10T08:28:48.631936+0000","last_undegraded":"2024-09-10T08:28:48.631936+0000","last_fullsized":"2024-09-10T08:28:48.631936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:10.443235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421808+0000","last_change":"2024-09-10T08:28:46.630904+0000","last_active":"2024-09-10T08:28:49.421808+0000","last_peered":"2024-09-10T08:28:49.421808+0000","last_clean":"2024-09-10T08:28:49.421808+0000","last_became_active":"2024-09-10T08:28:46.630530+0000","last_became_peered":"2024-09-10T08:28:46.630530+0000","last_unstale":"2024-09-10T08:28:49.421808+0000","last_undegraded":"2024-09-10T08:28:49.421808+0000","last_fullsized":"2024-09-10T08:28:49.421808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:33.599739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621556+0000","last_change":"2024-09-10T08:28:35.580244+0000","last_active":"2024-09-10T08:28:48.621556+0000","last_peered":"2024-09-10T08:28:48.621556+0000","last_clean":"2024-09-10T08:28:48.621556+0000","last_became_active":"2024-09-10T08:28:35.579975+0000","last_became_peered":"2024-09-10T08:28:35.579975+0000","last_unstale":"2024-09-10T08:28:48.621556+0000","last_undegraded":"2024-09-10T08:28:48.621556+0000","last_fullsized":"2024-09-10T08:28:48.621556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:16.498045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621654+0000","last_change":"2024-09-10T08:28:34.564751+0000","last_active":"2024-09-10T08:28:48.621654+0000","last_peered":"2024-09-10T08:28:48.621654+0000","last_clean":"2024-09-10T08:28:48.621654+0000","last_became_active":"2024-09-10T08:28:34.564479+0000","last_became_peered":"2024-09-10T08:28:34.564479+0000","last_unstale":"2024-09-10T08:28:48.621654+0000","last_undegraded":"2024-09-10T08:28:48.621654+0000","last_fullsized":"2024-09-10T08:28:48.621654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:29.618224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634645+0000","last_change":"2024-09-10T08:28:47.627041+0000","last_active":"2024-09-10T08:28:48.634645+0000","last_peered":"2024-09-10T08:28:48.634645+0000","last_clean":"2024-09-10T08:28:48.634645+0000","last_became_active":"2024-09-10T08:28:47.626692+0000","last_became_peered":"2024-09-10T08:28:47.626692+0000","last_unstale":"2024-09-10T08:28:48.634645+0000","last_undegraded":"2024-09-10T08:28:48.634645+0000","last_fullsized":"2024-09-10T08:28:48.634645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:57.666849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421403+0000","last_change":"2024-09-10T08:28:34.561906+0000","last_active":"2024-09-10T08:28:49.421403+0000","last_peered":"2024-09-10T08:28:49.421403+0000","last_clean":"2024-09-10T08:28:49.421403+0000","last_became_active":"2024-09-10T08:28:34.561613+0000","last_became_peered":"2024-09-10T08:28:34.561613+0000","last_unstale":"2024-09-10T08:28:49.421403+0000","last_undegraded":"2024-09-10T08:28:49.421403+0000","last_fullsized":"2024-09-10T08:28:49.421403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:56.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632248+0000","last_change":"2024-09-10T08:28:35.576406+0000","last_active":"2024-09-10T08:28:48.632248+0000","last_peered":"2024-09-10T08:28:48.632248+0000","last_clean":"2024-09-10T08:28:48.632248+0000","last_became_active":"2024-09-10T08:28:35.576145+0000","last_became_peered":"2024-09-10T08:28:35.576145+0000","last_unstale":"2024-09-10T08:28:48.632248+0000","last_undegraded":"2024-09-10T08:28:48.632248+0000","last_fullsized":"2024-09-10T08:28:48.632248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:57.667098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299845+0000","last_change":"2024-09-10T08:28:46.622395+0000","last_active":"2024-09-10T08:28:49.299845+0000","last_peered":"2024-09-10T08:28:49.299845+0000","last_clean":"2024-09-10T08:28:49.299845+0000","last_became_active":"2024-09-10T08:28:46.621941+0000","last_became_peered":"2024-09-10T08:28:46.621941+0000","last_unstale":"2024-09-10T08:28:49.299845+0000","last_undegraded":"2024-09-10T08:28:49.299845+0000","last_fullsized":"2024-09-10T08:28:49.299845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:54.928969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621387+0000","last_change":"2024-09-10T08:28:47.626495+0000","last_active":"2024-09-10T08:28:48.621387+0000","last_peered":"2024-09-10T08:28:48.621387+0000","last_clean":"2024-09-10T08:28:48.621387+0000","last_became_active":"2024-09-10T08:28:47.625258+0000","last_became_peered":"2024-09-10T08:28:47.625258+0000","last_unstale":"2024-09-10T08:28:48.621387+0000","last_undegraded":"2024-09-10T08:28:48.621387+0000","last_fullsized":"2024-09-10T08:28:48.621387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:00.101586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622005+0000","last_change":"2024-09-10T08:28:34.566606+0000","last_active":"2024-09-10T08:28:48.622005+0000","last_peered":"2024-09-10T08:28:48.622005+0000","last_clean":"2024-09-10T08:28:48.622005+0000","last_became_active":"2024-09-10T08:28:34.566388+0000","last_became_peered":"2024-09-10T08:28:34.566388+0000","last_unstale":"2024-09-10T08:28:48.622005+0000","last_undegraded":"2024-09-10T08:28:48.622005+0000","last_fullsized":"2024-09-10T08:28:48.622005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:33.528801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621394+0000","last_change":"2024-09-10T08:28:35.559371+0000","last_active":"2024-09-10T08:28:48.621394+0000","last_peered":"2024-09-10T08:28:48.621394+0000","last_clean":"2024-09-10T08:28:48.621394+0000","last_became_active":"2024-09-10T08:28:35.559145+0000","last_became_peered":"2024-09-10T08:28:35.559145+0000","last_unstale":"2024-09-10T08:28:48.621394+0000","last_undegraded":"2024-09-10T08:28:48.621394+0000","last_fullsized":"2024-09-10T08:28:48.621394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:57.339318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621811+0000","last_change":"2024-09-10T08:28:46.620231+0000","last_active":"2024-09-10T08:28:48.621811+0000","last_peered":"2024-09-10T08:28:48.621811+0000","last_clean":"2024-09-10T08:28:48.621811+0000","last_became_active":"2024-09-10T08:28:46.619403+0000","last_became_peered":"2024-09-10T08:28:46.619403+0000","last_unstale":"2024-09-10T08:28:48.621811+0000","last_undegraded":"2024-09-10T08:28:48.621811+0000","last_fullsized":"2024-09-10T08:28:48.621811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:26.308749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622383+0000","last_change":"2024-09-10T08:28:47.627135+0000","last_active":"2024-09-10T08:28:48.622383+0000","last_peered":"2024-09-10T08:28:48.622383+0000","last_clean":"2024-09-10T08:28:48.622383+0000","last_became_active":"2024-09-10T08:28:47.626791+0000","last_became_peered":"2024-09-10T08:28:47.626791+0000","last_unstale":"2024-09-10T08:28:48.622383+0000","last_undegraded":"2024-09-10T08:28:48.622383+0000","last_fullsized":"2024-09-10T08:28:48.622383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:43.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.420972+0000","last_change":"2024-09-10T08:28:35.579106+0000","last_active":"2024-09-10T08:28:49.420972+0000","last_peered":"2024-09-10T08:28:49.420972+0000","last_clean":"2024-09-10T08:28:49.420972+0000","last_became_active":"2024-09-10T08:28:35.578631+0000","last_became_peered":"2024-09-10T08:28:35.578631+0000","last_unstale":"2024-09-10T08:28:49.420972+0000","last_undegraded":"2024-09-10T08:28:49.420972+0000","last_fullsized":"2024-09-10T08:28:49.420972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:31.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634751+0000","last_change":"2024-09-10T08:28:47.632052+0000","last_active":"2024-09-10T08:28:48.634751+0000","last_peered":"2024-09-10T08:28:48.634751+0000","last_clean":"2024-09-10T08:28:48.634751+0000","last_became_active":"2024-09-10T08:28:47.631578+0000","last_became_peered":"2024-09-10T08:28:47.631578+0000","last_unstale":"2024-09-10T08:28:48.634751+0000","last_undegraded":"2024-09-10T08:28:48.634751+0000","last_fullsized":"2024-09-10T08:28:48.634751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:24.570729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299570+0000","last_change":"2024-09-10T08:28:35.566780+0000","last_active":"2024-09-10T08:28:49.299570+0000","last_peered":"2024-09-10T08:28:49.299570+0000","last_clean":"2024-09-10T08:28:49.299570+0000","last_became_active":"2024-09-10T08:28:35.566529+0000","last_became_peered":"2024-09-10T08:28:35.566529+0000","last_unstale":"2024-09-10T08:28:49.299570+0000","last_undegraded":"2024-09-10T08:28:49.299570+0000","last_fullsized":"2024-09-10T08:28:49.299570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:09.481166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621043+0000","last_change":"2024-09-10T08:28:47.629148+0000","last_active":"2024-09-10T08:28:48.621043+0000","last_peered":"2024-09-10T08:28:48.621043+0000","last_clean":"2024-09-10T08:28:48.621043+0000","last_became_active":"2024-09-10T08:28:47.628741+0000","last_became_peered":"2024-09-10T08:28:47.628741+0000","last_unstale":"2024-09-10T08:28:48.621043+0000","last_undegraded":"2024-09-10T08:28:48.621043+0000","last_fullsized":"2024-09-10T08:28:48.621043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:48.950503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621017+0000","last_change":"2024-09-10T08:28:35.578735+0000","last_active":"2024-09-10T08:28:48.621017+0000","last_peered":"2024-09-10T08:28:48.621017+0000","last_clean":"2024-09-10T08:28:48.621017+0000","last_became_active":"2024-09-10T08:28:35.577995+0000","last_became_peered":"2024-09-10T08:28:35.577995+0000","last_unstale":"2024-09-10T08:28:48.621017+0000","last_undegraded":"2024-09-10T08:28:48.621017+0000","last_fullsized":"2024-09-10T08:28:48.621017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:11.033441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634650+0000","last_change":"2024-09-10T08:28:47.628639+0000","last_active":"2024-09-10T08:28:48.634650+0000","last_peered":"2024-09-10T08:28:48.634650+0000","last_clean":"2024-09-10T08:28:48.634650+0000","last_became_active":"2024-09-10T08:28:47.628317+0000","last_became_peered":"2024-09-10T08:28:47.628317+0000","last_unstale":"2024-09-10T08:28:48.634650+0000","last_undegraded":"2024-09-10T08:28:48.634650+0000","last_fullsized":"2024-09-10T08:28:48.634650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:50.314678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632190+0000","last_change":"2024-09-10T08:28:35.577852+0000","last_active":"2024-09-10T08:28:48.632190+0000","last_peered":"2024-09-10T08:28:48.632190+0000","last_clean":"2024-09-10T08:28:48.632190+0000","last_became_active":"2024-09-10T08:28:35.577571+0000","last_became_peered":"2024-09-10T08:28:35.577571+0000","last_unstale":"2024-09-10T08:28:48.632190+0000","last_undegraded":"2024-09-10T08:28:48.632190+0000","last_fullsized":"2024-09-10T08:28:48.632190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:22.713732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354207+0000","last_change":"2024-09-10T08:28:47.629931+0000","last_active":"2024-09-10T08:28:49.354207+0000","last_peered":"2024-09-10T08:28:49.354207+0000","last_clean":"2024-09-10T08:28:49.354207+0000","last_became_active":"2024-09-10T08:28:47.629634+0000","last_became_peered":"2024-09-10T08:28:47.629634+0000","last_unstale":"2024-09-10T08:28:49.354207+0000","last_undegraded":"2024-09-10T08:28:49.354207+0000","last_fullsized":"2024-09-10T08:28:49.354207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:57.964208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622194+0000","last_change":"2024-09-10T08:28:35.574676+0000","last_active":"2024-09-10T08:28:48.622194+0000","last_peered":"2024-09-10T08:28:48.622194+0000","last_clean":"2024-09-10T08:28:48.622194+0000","last_became_active":"2024-09-10T08:28:35.574437+0000","last_became_peered":"2024-09-10T08:28:35.574437+0000","last_unstale":"2024-09-10T08:28:48.622194+0000","last_undegraded":"2024-09-10T08:28:48.622194+0000","last_fullsized":"2024-09-10T08:28:48.622194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:45.422506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620118+0000","last_change":"2024-09-10T08:28:47.624178+0000","last_active":"2024-09-10T08:28:48.620118+0000","last_peered":"2024-09-10T08:28:48.620118+0000","last_clean":"2024-09-10T08:28:48.620118+0000","last_became_active":"2024-09-10T08:28:47.623671+0000","last_became_peered":"2024-09-10T08:28:47.623671+0000","last_unstale":"2024-09-10T08:28:48.620118+0000","last_undegraded":"2024-09-10T08:28:48.620118+0000","last_fullsized":"2024-09-10T08:28:48.620118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:48.613870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634693+0000","last_change":"2024-09-10T08:28:35.572550+0000","last_active":"2024-09-10T08:28:48.634693+0000","last_peered":"2024-09-10T08:28:48.634693+0000","last_clean":"2024-09-10T08:28:48.634693+0000","last_became_active":"2024-09-10T08:28:35.572184+0000","last_became_peered":"2024-09-10T08:28:35.572184+0000","last_unstale":"2024-09-10T08:28:48.634693+0000","last_undegraded":"2024-09-10T08:28:48.634693+0000","last_fullsized":"2024-09-10T08:28:48.634693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:08.490734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354228+0000","last_change":"2024-09-10T08:28:47.630214+0000","last_active":"2024-09-10T08:28:49.354228+0000","last_peered":"2024-09-10T08:28:49.354228+0000","last_clean":"2024-09-10T08:28:49.354228+0000","last_became_active":"2024-09-10T08:28:47.629512+0000","last_became_peered":"2024-09-10T08:28:47.629512+0000","last_unstale":"2024-09-10T08:28:49.354228+0000","last_undegraded":"2024-09-10T08:28:49.354228+0000","last_fullsized":"2024-09-10T08:28:49.354228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:35.692107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421683+0000","last_change":"2024-09-10T08:28:35.573217+0000","last_active":"2024-09-10T08:28:49.421683+0000","last_peered":"2024-09-10T08:28:49.421683+0000","last_clean":"2024-09-10T08:28:49.421683+0000","last_became_active":"2024-09-10T08:28:35.572955+0000","last_became_peered":"2024-09-10T08:28:35.572955+0000","last_unstale":"2024-09-10T08:28:49.421683+0000","last_undegraded":"2024-09-10T08:28:49.421683+0000","last_fullsized":"2024-09-10T08:28:49.421683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:24.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421176+0000","last_change":"2024-09-10T08:28:47.623365+0000","last_active":"2024-09-10T08:28:49.421176+0000","last_peered":"2024-09-10T08:28:49.421176+0000","last_clean":"2024-09-10T08:28:49.421176+0000","last_became_active":"2024-09-10T08:28:47.623082+0000","last_became_peered":"2024-09-10T08:28:47.623082+0000","last_unstale":"2024-09-10T08:28:49.421176+0000","last_undegraded":"2024-09-10T08:28:49.421176+0000","last_fullsized":"2024-09-10T08:28:49.421176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:20.558484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622192+0000","last_change":"2024-09-10T08:28:35.575902+0000","last_active":"2024-09-10T08:28:48.622192+0000","last_peered":"2024-09-10T08:28:48.622192+0000","last_clean":"2024-09-10T08:28:48.622192+0000","last_became_active":"2024-09-10T08:28:35.575614+0000","last_became_peered":"2024-09-10T08:28:35.575614+0000","last_unstale":"2024-09-10T08:28:48.622192+0000","last_undegraded":"2024-09-10T08:28:48.622192+0000","last_fullsized":"2024-09-10T08:28:48.622192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:11.277682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622312+0000","last_change":"2024-09-10T08:28:47.629795+0000","last_active":"2024-09-10T08:28:48.622312+0000","last_peered":"2024-09-10T08:28:48.622312+0000","last_clean":"2024-09-10T08:28:48.622312+0000","last_became_active":"2024-09-10T08:28:47.628861+0000","last_became_peered":"2024-09-10T08:28:47.628861+0000","last_unstale":"2024-09-10T08:28:48.622312+0000","last_undegraded":"2024-09-10T08:28:48.622312+0000","last_fullsized":"2024-09-10T08:28:48.622312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:06.277094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620538+0000","last_change":"2024-09-10T08:28:35.578285+0000","last_active":"2024-09-10T08:28:48.620538+0000","last_peered":"2024-09-10T08:28:48.620538+0000","last_clean":"2024-09-10T08:28:48.620538+0000","last_became_active":"2024-09-10T08:28:35.576805+0000","last_became_peered":"2024-09-10T08:28:35.576805+0000","last_unstale":"2024-09-10T08:28:48.620538+0000","last_undegraded":"2024-09-10T08:28:48.620538+0000","last_fullsized":"2024-09-10T08:28:48.620538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:46.203320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355252+0000","last_change":"2024-09-10T08:28:47.635713+0000","last_active":"2024-09-10T08:28:49.355252+0000","last_peered":"2024-09-10T08:28:49.355252+0000","last_clean":"2024-09-10T08:28:49.355252+0000","last_became_active":"2024-09-10T08:28:47.635381+0000","last_became_peered":"2024-09-10T08:28:47.635381+0000","last_unstale":"2024-09-10T08:28:49.355252+0000","last_undegraded":"2024-09-10T08:28:49.355252+0000","last_fullsized":"2024-09-10T08:28:49.355252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:39.419510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621520+0000","last_change":"2024-09-10T08:28:35.571566+0000","last_active":"2024-09-10T08:28:48.621520+0000","last_peered":"2024-09-10T08:28:48.621520+0000","last_clean":"2024-09-10T08:28:48.621520+0000","last_became_active":"2024-09-10T08:28:35.571285+0000","last_became_peered":"2024-09-10T08:28:35.571285+0000","last_unstale":"2024-09-10T08:28:48.621520+0000","last_undegraded":"2024-09-10T08:28:48.621520+0000","last_fullsized":"2024-09-10T08:28:48.621520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:23.587691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299893+0000","last_change":"2024-09-10T08:28:47.619863+0000","last_active":"2024-09-10T08:28:49.299893+0000","last_peered":"2024-09-10T08:28:49.299893+0000","last_clean":"2024-09-10T08:28:49.299893+0000","last_became_active":"2024-09-10T08:28:47.619525+0000","last_became_peered":"2024-09-10T08:28:47.619525+0000","last_unstale":"2024-09-10T08:28:49.299893+0000","last_undegraded":"2024-09-10T08:28:49.299893+0000","last_fullsized":"2024-09-10T08:28:49.299893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:49.591318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620937+0000","last_change":"2024-09-10T08:28:35.568044+0000","last_active":"2024-09-10T08:28:48.620937+0000","last_peered":"2024-09-10T08:28:48.620937+0000","last_clean":"2024-09-10T08:28:48.620937+0000","last_became_active":"2024-09-10T08:28:35.567744+0000","last_became_peered":"2024-09-10T08:28:35.567744+0000","last_unstale":"2024-09-10T08:28:48.620937+0000","last_undegraded":"2024-09-10T08:28:48.620937+0000","last_fullsized":"2024-09-10T08:28:48.620937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:19.081138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621697+0000","last_change":"2024-09-10T08:28:47.629417+0000","last_active":"2024-09-10T08:28:48.621697+0000","last_peered":"2024-09-10T08:28:48.621697+0000","last_clean":"2024-09-10T08:28:48.621697+0000","last_became_active":"2024-09-10T08:28:47.629095+0000","last_became_peered":"2024-09-10T08:28:47.629095+0000","last_unstale":"2024-09-10T08:28:48.621697+0000","last_undegraded":"2024-09-10T08:28:48.621697+0000","last_fullsized":"2024-09-10T08:28:48.621697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:05.606381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632075+0000","last_change":"2024-09-10T08:28:35.575802+0000","last_active":"2024-09-10T08:28:48.632075+0000","last_peered":"2024-09-10T08:28:48.632075+0000","last_clean":"2024-09-10T08:28:48.632075+0000","last_became_active":"2024-09-10T08:28:35.575388+0000","last_became_peered":"2024-09-10T08:28:35.575388+0000","last_unstale":"2024-09-10T08:28:48.632075+0000","last_undegraded":"2024-09-10T08:28:48.632075+0000","last_fullsized":"2024-09-10T08:28:48.632075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:01.424265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620142+0000","last_change":"2024-09-10T08:28:47.624305+0000","last_active":"2024-09-10T08:28:48.620142+0000","last_peered":"2024-09-10T08:28:48.620142+0000","last_clean":"2024-09-10T08:28:48.620142+0000","last_became_active":"2024-09-10T08:28:47.624026+0000","last_became_peered":"2024-09-10T08:28:47.624026+0000","last_unstale":"2024-09-10T08:28:48.620142+0000","last_undegraded":"2024-09-10T08:28:48.620142+0000","last_fullsized":"2024-09-10T08:28:48.620142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:01.194271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421368+0000","last_change":"2024-09-10T08:28:35.574499+0000","last_active":"2024-09-10T08:28:49.421368+0000","last_peered":"2024-09-10T08:28:49.421368+0000","last_clean":"2024-09-10T08:28:49.421368+0000","last_became_active":"2024-09-10T08:28:35.574249+0000","last_became_peered":"2024-09-10T08:28:35.574249+0000","last_unstale":"2024-09-10T08:28:49.421368+0000","last_undegraded":"2024-09-10T08:28:49.421368+0000","last_fullsized":"2024-09-10T08:28:49.421368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:55.952307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620349+0000","last_change":"2024-09-10T08:28:47.629525+0000","last_active":"2024-09-10T08:28:48.620349+0000","last_peered":"2024-09-10T08:28:48.620349+0000","last_clean":"2024-09-10T08:28:48.620349+0000","last_became_active":"2024-09-10T08:28:47.629259+0000","last_became_peered":"2024-09-10T08:28:47.629259+0000","last_unstale":"2024-09-10T08:28:48.620349+0000","last_undegraded":"2024-09-10T08:28:48.620349+0000","last_fullsized":"2024-09-10T08:28:48.620349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:11.864322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355002+0000","last_change":"2024-09-10T08:28:35.572709+0000","last_active":"2024-09-10T08:28:49.355002+0000","last_peered":"2024-09-10T08:28:49.355002+0000","last_clean":"2024-09-10T08:28:49.355002+0000","last_became_active":"2024-09-10T08:28:35.572392+0000","last_became_peered":"2024-09-10T08:28:35.572392+0000","last_unstale":"2024-09-10T08:28:49.355002+0000","last_undegraded":"2024-09-10T08:28:49.355002+0000","last_fullsized":"2024-09-10T08:28:49.355002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:42.636299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619769+0000","last_change":"2024-09-10T08:28:47.623285+0000","last_active":"2024-09-10T08:28:48.619769+0000","last_peered":"2024-09-10T08:28:48.619769+0000","last_clean":"2024-09-10T08:28:48.619769+0000","last_became_active":"2024-09-10T08:28:47.621776+0000","last_became_peered":"2024-09-10T08:28:47.621776+0000","last_unstale":"2024-09-10T08:28:48.619769+0000","last_undegraded":"2024-09-10T08:28:48.619769+0000","last_fullsized":"2024-09-10T08:28:48.619769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:32.543418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.300034+0000","last_change":"2024-09-10T08:28:35.574438+0000","last_active":"2024-09-10T08:28:49.300034+0000","last_peered":"2024-09-10T08:28:49.300034+0000","last_clean":"2024-09-10T08:28:49.300034+0000","last_became_active":"2024-09-10T08:28:35.574175+0000","last_became_peered":"2024-09-10T08:28:35.574175+0000","last_unstale":"2024-09-10T08:28:49.300034+0000","last_undegraded":"2024-09-10T08:28:49.300034+0000","last_fullsized":"2024-09-10T08:28:49.300034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:55.808543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631598+0000","last_change":"2024-09-10T08:28:47.629092+0000","last_active":"2024-09-10T08:28:48.631598+0000","last_peered":"2024-09-10T08:28:48.631598+0000","last_clean":"2024-09-10T08:28:48.631598+0000","last_became_active":"2024-09-10T08:28:47.628806+0000","last_became_peered":"2024-09-10T08:28:47.628806+0000","last_unstale":"2024-09-10T08:28:48.631598+0000","last_undegraded":"2024-09-10T08:28:48.631598+0000","last_fullsized":"2024-09-10T08:28:48.631598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:46.440290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622000+0000","last_change":"2024-09-10T08:28:35.567296+0000","last_active":"2024-09-10T08:28:48.622000+0000","last_peered":"2024-09-10T08:28:48.622000+0000","last_clean":"2024-09-10T08:28:48.622000+0000","last_became_active":"2024-09-10T08:28:35.567074+0000","last_became_peered":"2024-09-10T08:28:35.567074+0000","last_unstale":"2024-09-10T08:28:48.622000+0000","last_undegraded":"2024-09-10T08:28:48.622000+0000","last_fullsized":"2024-09-10T08:28:48.622000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:55.698345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634643+0000","last_change":"2024-09-10T08:28:47.631797+0000","last_active":"2024-09-10T08:28:48.634643+0000","last_peered":"2024-09-10T08:28:48.634643+0000","last_clean":"2024-09-10T08:28:48.634643+0000","last_became_active":"2024-09-10T08:28:47.631523+0000","last_became_peered":"2024-09-10T08:28:47.631523+0000","last_unstale":"2024-09-10T08:28:48.634643+0000","last_undegraded":"2024-09-10T08:28:48.634643+0000","last_fullsized":"2024-09-10T08:28:48.634643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:05.829116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619838+0000","last_change":"2024-09-10T08:28:35.570249+0000","last_active":"2024-09-10T08:28:48.619838+0000","last_peered":"2024-09-10T08:28:48.619838+0000","last_clean":"2024-09-10T08:28:48.619838+0000","last_became_active":"2024-09-10T08:28:35.569960+0000","last_became_peered":"2024-09-10T08:28:35.569960+0000","last_unstale":"2024-09-10T08:28:48.619838+0000","last_undegraded":"2024-09-10T08:28:48.619838+0000","last_fullsized":"2024-09-10T08:28:48.619838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:29.787554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620473+0000","last_change":"2024-09-10T08:28:47.633644+0000","last_active":"2024-09-10T08:28:48.620473+0000","last_peered":"2024-09-10T08:28:48.620473+0000","last_clean":"2024-09-10T08:28:48.620473+0000","last_became_active":"2024-09-10T08:28:47.633315+0000","last_became_peered":"2024-09-10T08:28:47.633315+0000","last_unstale":"2024-09-10T08:28:48.620473+0000","last_undegraded":"2024-09-10T08:28:48.620473+0000","last_fullsized":"2024-09-10T08:28:48.620473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:45:55.827386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634008+0000","last_change":"2024-09-10T08:28:35.560693+0000","last_active":"2024-09-10T08:28:48.634008+0000","last_peered":"2024-09-10T08:28:48.634008+0000","last_clean":"2024-09-10T08:28:48.634008+0000","last_became_active":"2024-09-10T08:28:35.560409+0000","last_became_peered":"2024-09-10T08:28:35.560409+0000","last_unstale":"2024-09-10T08:28:48.634008+0000","last_undegraded":"2024-09-10T08:28:48.634008+0000","last_fullsized":"2024-09-10T08:28:48.634008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:10.597654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621112+0000","last_change":"2024-09-10T08:28:47.622614+0000","last_active":"2024-09-10T08:28:48.621112+0000","last_peered":"2024-09-10T08:28:48.621112+0000","last_clean":"2024-09-10T08:28:48.621112+0000","last_became_active":"2024-09-10T08:28:47.622205+0000","last_became_peered":"2024-09-10T08:28:47.622205+0000","last_unstale":"2024-09-10T08:28:48.621112+0000","last_undegraded":"2024-09-10T08:28:48.621112+0000","last_fullsized":"2024-09-10T08:28:48.621112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:47.090782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631666+0000","last_change":"2024-09-10T08:28:35.574551+0000","last_active":"2024-09-10T08:28:48.631666+0000","last_peered":"2024-09-10T08:28:48.631666+0000","last_clean":"2024-09-10T08:28:48.631666+0000","last_became_active":"2024-09-10T08:28:35.574256+0000","last_became_peered":"2024-09-10T08:28:35.574256+0000","last_unstale":"2024-09-10T08:28:48.631666+0000","last_undegraded":"2024-09-10T08:28:48.631666+0000","last_fullsized":"2024-09-10T08:28:48.631666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:43.401552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354791+0000","last_change":"2024-09-10T08:28:47.633476+0000","last_active":"2024-09-10T08:28:49.354791+0000","last_peered":"2024-09-10T08:28:49.354791+0000","last_clean":"2024-09-10T08:28:49.354791+0000","last_became_active":"2024-09-10T08:28:47.633189+0000","last_became_peered":"2024-09-10T08:28:47.633189+0000","last_unstale":"2024-09-10T08:28:49.354791+0000","last_undegraded":"2024-09-10T08:28:49.354791+0000","last_fullsized":"2024-09-10T08:28:49.354791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:46.175490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621900+0000","last_change":"2024-09-10T08:28:35.573330+0000","last_active":"2024-09-10T08:28:48.621900+0000","last_peered":"2024-09-10T08:28:48.621900+0000","last_clean":"2024-09-10T08:28:48.621900+0000","last_became_active":"2024-09-10T08:28:35.572992+0000","last_became_peered":"2024-09-10T08:28:35.572992+0000","last_unstale":"2024-09-10T08:28:48.621900+0000","last_undegraded":"2024-09-10T08:28:48.621900+0000","last_fullsized":"2024-09-10T08:28:48.621900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:15.412219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621967+0000","last_change":"2024-09-10T08:28:47.630733+0000","last_active":"2024-09-10T08:28:48.621967+0000","last_peered":"2024-09-10T08:28:48.621967+0000","last_clean":"2024-09-10T08:28:48.621967+0000","last_became_active":"2024-09-10T08:28:47.630447+0000","last_became_peered":"2024-09-10T08:28:47.630447+0000","last_unstale":"2024-09-10T08:28:48.621967+0000","last_undegraded":"2024-09-10T08:28:48.621967+0000","last_fullsized":"2024-09-10T08:28:48.621967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:08.797818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621594+0000","last_change":"2024-09-10T08:28:35.566574+0000","last_active":"2024-09-10T08:28:48.621594+0000","last_peered":"2024-09-10T08:28:48.621594+0000","last_clean":"2024-09-10T08:28:48.621594+0000","last_became_active":"2024-09-10T08:28:35.566205+0000","last_became_peered":"2024-09-10T08:28:35.566205+0000","last_unstale":"2024-09-10T08:28:48.621594+0000","last_undegraded":"2024-09-10T08:28:48.621594+0000","last_fullsized":"2024-09-10T08:28:48.621594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:49.876773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299778+0000","last_change":"2024-09-10T08:28:47.628051+0000","last_active":"2024-09-10T08:28:49.299778+0000","last_peered":"2024-09-10T08:28:49.299778+0000","last_clean":"2024-09-10T08:28:49.299778+0000","last_became_active":"2024-09-10T08:28:47.627747+0000","last_became_peered":"2024-09-10T08:28:47.627747+0000","last_unstale":"2024-09-10T08:28:49.299778+0000","last_undegraded":"2024-09-10T08:28:49.299778+0000","last_fullsized":"2024-09-10T08:28:49.299778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:54.210449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421487+0000","last_change":"2024-09-10T08:28:35.565023+0000","last_active":"2024-09-10T08:28:49.421487+0000","last_peered":"2024-09-10T08:28:49.421487+0000","last_clean":"2024-09-10T08:28:49.421487+0000","last_became_active":"2024-09-10T08:28:35.564747+0000","last_became_peered":"2024-09-10T08:28:35.564747+0000","last_unstale":"2024-09-10T08:28:49.421487+0000","last_undegraded":"2024-09-10T08:28:49.421487+0000","last_fullsized":"2024-09-10T08:28:49.421487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:32.419621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354688+0000","last_change":"2024-09-10T08:28:47.631047+0000","last_active":"2024-09-10T08:28:49.354688+0000","last_peered":"2024-09-10T08:28:49.354688+0000","last_clean":"2024-09-10T08:28:49.354688+0000","last_became_active":"2024-09-10T08:28:47.630617+0000","last_became_peered":"2024-09-10T08:28:47.630617+0000","last_unstale":"2024-09-10T08:28:49.354688+0000","last_undegraded":"2024-09-10T08:28:49.354688+0000","last_fullsized":"2024-09-10T08:28:49.354688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:29.867640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421612+0000","last_change":"2024-09-10T08:28:35.570619+0000","last_active":"2024-09-10T08:28:49.421612+0000","last_peered":"2024-09-10T08:28:49.421612+0000","last_clean":"2024-09-10T08:28:49.421612+0000","last_became_active":"2024-09-10T08:28:35.570351+0000","last_became_peered":"2024-09-10T08:28:35.570351+0000","last_unstale":"2024-09-10T08:28:49.421612+0000","last_undegraded":"2024-09-10T08:28:49.421612+0000","last_fullsized":"2024-09-10T08:28:49.421612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:35.161279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620557+0000","last_change":"2024-09-10T08:28:47.626191+0000","last_active":"2024-09-10T08:28:48.620557+0000","last_peered":"2024-09-10T08:28:48.620557+0000","last_clean":"2024-09-10T08:28:48.620557+0000","last_became_active":"2024-09-10T08:28:47.625781+0000","last_became_peered":"2024-09-10T08:28:47.625781+0000","last_unstale":"2024-09-10T08:28:48.620557+0000","last_undegraded":"2024-09-10T08:28:48.620557+0000","last_fullsized":"2024-09-10T08:28:48.620557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:36:38.651973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355079+0000","last_change":"2024-09-10T08:28:35.577345+0000","last_active":"2024-09-10T08:28:49.355079+0000","last_peered":"2024-09-10T08:28:49.355079+0000","last_clean":"2024-09-10T08:28:49.355079+0000","last_became_active":"2024-09-10T08:28:35.576191+0000","last_became_peered":"2024-09-10T08:28:35.576191+0000","last_unstale":"2024-09-10T08:28:49.355079+0000","last_undegraded":"2024-09-10T08:28:49.355079+0000","last_fullsized":"2024-09-10T08:28:49.355079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:29.218797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622171+0000","last_change":"2024-09-10T08:28:47.623129+0000","last_active":"2024-09-10T08:28:48.622171+0000","last_peered":"2024-09-10T08:28:48.622171+0000","last_clean":"2024-09-10T08:28:48.622171+0000","last_became_active":"2024-09-10T08:28:47.622851+0000","last_became_peered":"2024-09-10T08:28:47.622851+0000","last_unstale":"2024-09-10T08:28:48.622171+0000","last_undegraded":"2024-09-10T08:28:48.622171+0000","last_fullsized":"2024-09-10T08:28:48.622171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:16.045213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621426+0000","last_change":"2024-09-10T08:28:35.575275+0000","last_active":"2024-09-10T08:28:48.621426+0000","last_peered":"2024-09-10T08:28:48.621426+0000","last_clean":"2024-09-10T08:28:48.621426+0000","last_became_active":"2024-09-10T08:28:35.575052+0000","last_became_peered":"2024-09-10T08:28:35.575052+0000","last_unstale":"2024-09-10T08:28:48.621426+0000","last_undegraded":"2024-09-10T08:28:48.621426+0000","last_fullsized":"2024-09-10T08:28:48.621426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:24.313017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421741+0000","last_change":"2024-09-10T08:28:47.628651+0000","last_active":"2024-09-10T08:28:49.421741+0000","last_peered":"2024-09-10T08:28:49.421741+0000","last_clean":"2024-09-10T08:28:49.421741+0000","last_became_active":"2024-09-10T08:28:47.628343+0000","last_became_peered":"2024-09-10T08:28:47.628343+0000","last_unstale":"2024-09-10T08:28:49.421741+0000","last_undegraded":"2024-09-10T08:28:49.421741+0000","last_fullsized":"2024-09-10T08:28:49.421741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:05.848341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354299+0000","last_change":"2024-09-10T08:28:35.578664+0000","last_active":"2024-09-10T08:28:49.354299+0000","last_peered":"2024-09-10T08:28:49.354299+0000","last_clean":"2024-09-10T08:28:49.354299+0000","last_became_active":"2024-09-10T08:28:35.578384+0000","last_became_peered":"2024-09-10T08:28:35.578384+0000","last_unstale":"2024-09-10T08:28:49.354299+0000","last_undegraded":"2024-09-10T08:28:49.354299+0000","last_fullsized":"2024-09-10T08:28:49.354299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:44.278718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634174+0000","last_change":"2024-09-10T08:28:47.627593+0000","last_active":"2024-09-10T08:28:48.634174+0000","last_peered":"2024-09-10T08:28:48.634174+0000","last_clean":"2024-09-10T08:28:48.634174+0000","last_became_active":"2024-09-10T08:28:47.627237+0000","last_became_peered":"2024-09-10T08:28:47.627237+0000","last_unstale":"2024-09-10T08:28:48.634174+0000","last_undegraded":"2024-09-10T08:28:48.634174+0000","last_fullsized":"2024-09-10T08:28:48.634174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:16.045213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620920+0000","last_change":"2024-09-10T08:28:35.578978+0000","last_active":"2024-09-10T08:28:48.620920+0000","last_peered":"2024-09-10T08:28:48.620920+0000","last_clean":"2024-09-10T08:28:48.620920+0000","last_became_active":"2024-09-10T08:28:35.578475+0000","last_became_peered":"2024-09-10T08:28:35.578475+0000","last_unstale":"2024-09-10T08:28:48.620920+0000","last_undegraded":"2024-09-10T08:28:48.620920+0000","last_fullsized":"2024-09-10T08:28:48.620920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:08.520314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621323+0000","last_change":"2024-09-10T08:28:47.634072+0000","last_active":"2024-09-10T08:28:48.621323+0000","last_peered":"2024-09-10T08:28:48.621323+0000","last_clean":"2024-09-10T08:28:48.621323+0000","last_became_active":"2024-09-10T08:28:47.633776+0000","last_became_peered":"2024-09-10T08:28:47.633776+0000","last_unstale":"2024-09-10T08:28:48.621323+0000","last_undegraded":"2024-09-10T08:28:48.621323+0000","last_fullsized":"2024-09-10T08:28:48.621323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:30.690202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354159+0000","last_change":"2024-09-10T08:28:35.572112+0000","last_active":"2024-09-10T08:28:49.354159+0000","last_peered":"2024-09-10T08:28:49.354159+0000","last_clean":"2024-09-10T08:28:49.354159+0000","last_became_active":"2024-09-10T08:28:35.571803+0000","last_became_peered":"2024-09-10T08:28:35.571803+0000","last_unstale":"2024-09-10T08:28:49.354159+0000","last_undegraded":"2024-09-10T08:28:49.354159+0000","last_fullsized":"2024-09-10T08:28:49.354159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:29.969987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621621+0000","last_change":"2024-09-10T08:28:47.620523+0000","last_active":"2024-09-10T08:28:48.621621+0000","last_peered":"2024-09-10T08:28:48.621621+0000","last_clean":"2024-09-10T08:28:48.621621+0000","last_became_active":"2024-09-10T08:28:47.620220+0000","last_became_peered":"2024-09-10T08:28:47.620220+0000","last_unstale":"2024-09-10T08:28:48.621621+0000","last_undegraded":"2024-09-10T08:28:48.621621+0000","last_fullsized":"2024-09-10T08:28:48.621621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:14.405210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621263+0000","last_change":"2024-09-10T08:28:35.578961+0000","last_active":"2024-09-10T08:28:48.621263+0000","last_peered":"2024-09-10T08:28:48.621263+0000","last_clean":"2024-09-10T08:28:48.621263+0000","last_became_active":"2024-09-10T08:28:35.578680+0000","last_became_peered":"2024-09-10T08:28:35.578680+0000","last_unstale":"2024-09-10T08:28:48.621263+0000","last_undegraded":"2024-09-10T08:28:48.621263+0000","last_fullsized":"2024-09-10T08:28:48.621263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:53.737412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299727+0000","last_change":"2024-09-10T08:28:47.624859+0000","last_active":"2024-09-10T08:28:49.299727+0000","last_peered":"2024-09-10T08:28:49.299727+0000","last_clean":"2024-09-10T08:28:49.299727+0000","last_became_active":"2024-09-10T08:28:47.624585+0000","last_became_peered":"2024-09-10T08:28:47.624585+0000","last_unstale":"2024-09-10T08:28:49.299727+0000","last_undegraded":"2024-09-10T08:28:49.299727+0000","last_fullsized":"2024-09-10T08:28:49.299727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:00.956870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631870+0000","last_change":"2024-09-10T08:28:35.573918+0000","last_active":"2024-09-10T08:28:48.631870+0000","last_peered":"2024-09-10T08:28:48.631870+0000","last_clean":"2024-09-10T08:28:48.631870+0000","last_became_active":"2024-09-10T08:28:35.573646+0000","last_became_peered":"2024-09-10T08:28:35.573646+0000","last_unstale":"2024-09-10T08:28:48.631870+0000","last_undegraded":"2024-09-10T08:28:48.631870+0000","last_fullsized":"2024-09-10T08:28:48.631870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:24.295630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354036+0000","last_change":"2024-09-10T08:28:47.631802+0000","last_active":"2024-09-10T08:28:49.354036+0000","last_peered":"2024-09-10T08:28:49.354036+0000","last_clean":"2024-09-10T08:28:49.354036+0000","last_became_active":"2024-09-10T08:28:47.631456+0000","last_became_peered":"2024-09-10T08:28:47.631456+0000","last_unstale":"2024-09-10T08:28:49.354036+0000","last_undegraded":"2024-09-10T08:28:49.354036+0000","last_fullsized":"2024-09-10T08:28:49.354036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:56.571659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634799+0000","last_change":"2024-09-10T08:28:35.578197+0000","last_active":"2024-09-10T08:28:48.634799+0000","last_peered":"2024-09-10T08:28:48.634799+0000","last_clean":"2024-09-10T08:28:48.634799+0000","last_became_active":"2024-09-10T08:28:35.577852+0000","last_became_peered":"2024-09-10T08:28:35.577852+0000","last_unstale":"2024-09-10T08:28:48.634799+0000","last_undegraded":"2024-09-10T08:28:48.634799+0000","last_fullsized":"2024-09-10T08:28:48.634799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:44.348299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354168+0000","last_change":"2024-09-10T08:28:47.629993+0000","last_active":"2024-09-10T08:28:49.354168+0000","last_peered":"2024-09-10T08:28:49.354168+0000","last_clean":"2024-09-10T08:28:49.354168+0000","last_became_active":"2024-09-10T08:28:47.629713+0000","last_became_peered":"2024-09-10T08:28:47.629713+0000","last_unstale":"2024-09-10T08:28:49.354168+0000","last_undegraded":"2024-09-10T08:28:49.354168+0000","last_fullsized":"2024-09-10T08:28:49.354168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:56.640722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355024+0000","last_change":"2024-09-10T08:28:35.571065+0000","last_active":"2024-09-10T08:28:49.355024+0000","last_peered":"2024-09-10T08:28:49.355024+0000","last_clean":"2024-09-10T08:28:49.355024+0000","last_became_active":"2024-09-10T08:28:35.570749+0000","last_became_peered":"2024-09-10T08:28:35.570749+0000","last_unstale":"2024-09-10T08:28:49.355024+0000","last_undegraded":"2024-09-10T08:28:49.355024+0000","last_fullsized":"2024-09-10T08:28:49.355024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:04.628661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":692114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":101836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":101304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":104320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":102868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":864256,"data_stored":692080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":103302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":262144,"data_stored":101144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:29:00.568 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:29:00.568 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T08:29:00.568 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-10T08:29:00.569 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T08:29:00.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.700+0000 7f3d09eaf640 1 Processor -- start 2024-09-10T08:29:00.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.700+0000 7f3d09eaf640 1 -- start start 2024-09-10T08:29:00.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.700+0000 7f3d09eaf640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3d040c4680 0x7f3d04156a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.700+0000 7f3d09eaf640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d04070590 con 0x7f3d04156fc0 2024-09-10T08:29:00.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.700+0000 7f3d09eaf640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d040a8220 con 0x7f3d040acc30 2024-09-10T08:29:00.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.700+0000 7f3d09eaf640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3d040c4ea0 con 0x7f3d040c4680 2024-09-10T08:29:00.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.700+0000 7f3d03fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3d04156fc0 0x7f3d0415dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50200/0 (socket says 172.21.15.103:50200) 2024-09-10T08:29:00.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d03fff640 1 -- 172.21.15.103:0/923315427 learned_addr learned my addr 172.21.15.103:0/923315427 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:29:00.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d02ffd640 1 --2- 172.21.15.103:0/923315427 >> v2:172.21.15.154:3300/0 conn(0x7f3d040c4680 0x7f3d04156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d027fc640 1 -- 172.21.15.103:0/923315427 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2825841015 0 0) 0x7f3d04070590 con 0x7f3d04156fc0 2024-09-10T08:29:00.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d027fc640 1 -- 172.21.15.103:0/923315427 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cf0005730 con 0x7f3d04156fc0 2024-09-10T08:29:00.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d027fc640 1 -- 172.21.15.103:0/923315427 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3163224509 0 0) 0x7f3d040a8220 con 0x7f3d040acc30 2024-09-10T08:29:00.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d027fc640 1 -- 172.21.15.103:0/923315427 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d04070590 con 0x7f3d040acc30 2024-09-10T08:29:00.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d027fc640 1 -- 172.21.15.103:0/923315427 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3559638120 0 0) 0x7f3cf0005730 con 0x7f3d04156fc0 2024-09-10T08:29:00.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d027fc640 1 -- 172.21.15.103:0/923315427 >> v2:172.21.15.154:3300/0 conn(0x7f3d040c4680 msgr2=0x7f3d04156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:00.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d027fc640 1 --2- 172.21.15.103:0/923315427 >> v2:172.21.15.154:3300/0 conn(0x7f3d040c4680 0x7f3d04156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d027fc640 1 -- 172.21.15.103:0/923315427 >> v1:172.21.15.154:6789/0 conn(0x7f3d040acc30 legacy=0x7f3d040c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d027fc640 1 -- 172.21.15.103:0/923315427 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d040a84f0 con 0x7f3d04156fc0 2024-09-10T08:29:00.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d027fc640 1 -- 172.21.15.103:0/923315427 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f3cfc0019f0 con 0x7f3d04156fc0 2024-09-10T08:29:00.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d02ffd640 1 --2- 172.21.15.103:0/923315427 >> v2:172.21.15.154:3300/0 conn(0x7f3d040c4680 0x7f3d04156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:29:00.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d027fc640 1 -- 172.21.15.103:0/923315427 >> v1:172.21.15.103:6789/0 conn(0x7f3d04156fc0 legacy=0x7f3d0415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d027fc640 1 --2- 172.21.15.103:0/923315427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cf0005da0 0x7f3cf00061a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d027fc640 1 --2- 172.21.15.103:0/923315427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cf0006a10 0x7f3cf0006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d027fc640 1 --2- 172.21.15.103:0/923315427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cf0007490 0x7f3cf000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d027fc640 1 -- 172.21.15.103:0/923315427 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf000e3a0 con 0x7f3cf0007490 2024-09-10T08:29:00.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d027fc640 1 -- 172.21.15.103:0/923315427 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf000e550 con 0x7f3cf0006a10 2024-09-10T08:29:00.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d027fc640 1 -- 172.21.15.103:0/923315427 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3cf000e750 con 0x7f3cf0005da0 2024-09-10T08:29:00.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d03fff640 1 --2- 172.21.15.103:0/923315427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cf0007490 0x7f3cf000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d02ffd640 1 --2- 172.21.15.103:0/923315427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cf0006a10 0x7f3cf0006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d037fe640 1 --2- 172.21.15.103:0/923315427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cf0005da0 0x7f3cf00061a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d03fff640 1 -- 172.21.15.103:0/923315427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cf0005da0 msgr2=0x7f3cf00061a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:00.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d03fff640 1 --2- 172.21.15.103:0/923315427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cf0005da0 0x7f3cf00061a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d03fff640 1 -- 172.21.15.103:0/923315427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cf0006a10 msgr2=0x7f3cf0006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:00.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d03fff640 1 --2- 172.21.15.103:0/923315427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cf0006a10 0x7f3cf0006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d03fff640 1 -- 172.21.15.103:0/923315427 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf0005730 con 0x7f3cf0007490 2024-09-10T08:29:00.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.701+0000 7f3d037fe640 1 --2- 172.21.15.103:0/923315427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cf0005da0 0x7f3cf00061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:00.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.702+0000 7f3d03fff640 1 -- 172.21.15.103:0/923315427 reap_dead start 2024-09-10T08:29:00.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.702+0000 7f3d03fff640 1 --2- 172.21.15.103:0/923315427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cf0007490 0x7f3cf000dbd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00a750 tx=0x7f3cf0007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258fae4e61baf65f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:00.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.702+0000 7f3d027fc640 1 -- 172.21.15.103:0/923315427 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc00a370 con 0x7f3cf0007490 2024-09-10T08:29:00.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.702+0000 7f3d027fc640 1 -- 172.21.15.103:0/923315427 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cfc02f070 con 0x7f3cf0007490 2024-09-10T08:29:00.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.702+0000 7f3d027fc640 1 -- 172.21.15.103:0/923315427 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc02bba0 con 0x7f3cf0007490 2024-09-10T08:29:00.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.703+0000 7f3d09eaf640 1 -- 172.21.15.103:0/923315427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cf0007490 msgr2=0x7f3cf000dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.703+0000 7f3d09eaf640 1 --2- 172.21.15.103:0/923315427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cf0007490 0x7f3cf000dbd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00a750 tx=0x7f3cf0007a40 comp rx=0 tx=0).stop 2024-09-10T08:29:00.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.703+0000 7f3d09eaf640 1 -- 172.21.15.103:0/923315427 shutdown_connections 2024-09-10T08:29:00.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.703+0000 7f3d09eaf640 1 --2- 172.21.15.103:0/923315427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cf0007490 0x7f3cf000dbd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.703+0000 7f3d09eaf640 1 -- 172.21.15.103:0/923315427 >> 172.21.15.103:0/923315427 conn(0x7f3d040c5660 msgr2=0x7f3d040c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:00.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.703+0000 7f3d09eaf640 1 -- 172.21.15.103:0/923315427 shutdown_connections 2024-09-10T08:29:00.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.703+0000 7f3d09eaf640 1 -- 172.21.15.103:0/923315427 wait complete. 2024-09-10T08:29:00.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.704+0000 7f3d09eaf640 1 Processor -- start 2024-09-10T08:29:00.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.704+0000 7f3d09eaf640 1 -- start start 2024-09-10T08:29:00.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.705+0000 7f3d09eaf640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cf0007490 0x7f3d041564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.705+0000 7f3d09eaf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d0409ca00 0x7f3d04151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.705+0000 7f3d09eaf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d04152370 0x7f3d041eb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.705+0000 7f3d09eaf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3d040c5330 con 0x7f3d04152370 2024-09-10T08:29:00.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.705+0000 7f3d09eaf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3d040702b0 con 0x7f3d0409ca00 2024-09-10T08:29:00.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.705+0000 7f3d09eaf640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3d040c63f0 con 0x7f3cf0007490 2024-09-10T08:29:00.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.705+0000 7f3d03fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d04152370 0x7f3d041eb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.705+0000 7f3d03fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d04152370 0x7f3d041eb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49894/0 (socket says 172.21.15.103:49894) 2024-09-10T08:29:00.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.705+0000 7f3d03fff640 1 -- 172.21.15.103:0/846798207 learned_addr learned my addr 172.21.15.103:0/846798207 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:00.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.705+0000 7f3d037fe640 1 --2- 172.21.15.103:0/846798207 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cf0007490 0x7f3d041564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.705+0000 7f3d02ffd640 1 --2- 172.21.15.103:0/846798207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d0409ca00 0x7f3d04151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.705+0000 7f3d03fff640 1 -- 172.21.15.103:0/846798207 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cf0007490 msgr2=0x7f3d041564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.705+0000 7f3d03fff640 1 --2- 172.21.15.103:0/846798207 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cf0007490 0x7f3d041564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.705+0000 7f3d03fff640 1 -- 172.21.15.103:0/846798207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d0409ca00 msgr2=0x7f3d04151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.705+0000 7f3d03fff640 1 --2- 172.21.15.103:0/846798207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d0409ca00 0x7f3d04151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.705+0000 7f3d03fff640 1 -- 172.21.15.103:0/846798207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d040727b0 con 0x7f3d04152370 2024-09-10T08:29:00.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.705+0000 7f3d037fe640 1 --2- 172.21.15.103:0/846798207 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cf0007490 0x7f3d041564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:00.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.705+0000 7f3d02ffd640 1 --2- 172.21.15.103:0/846798207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d0409ca00 0x7f3d04151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:00.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.705+0000 7f3d03fff640 1 --2- 172.21.15.103:0/846798207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d04152370 0x7f3d041eb610 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00a870 tx=0x7f3cfc02d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:00.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.705+0000 7f3cfbfff640 1 -- 172.21.15.103:0/846798207 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc00a370 con 0x7f3d04152370 2024-09-10T08:29:00.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.706+0000 7f3cfbfff640 1 -- 172.21.15.103:0/846798207 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cfc02baf0 con 0x7f3d04152370 2024-09-10T08:29:00.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.706+0000 7f3d09eaf640 1 -- 172.21.15.103:0/846798207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d041eed20 con 0x7f3d04152370 2024-09-10T08:29:00.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.706+0000 7f3cfbfff640 1 -- 172.21.15.103:0/846798207 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc034470 con 0x7f3d04152370 2024-09-10T08:29:00.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.706+0000 7f3d09eaf640 1 -- 172.21.15.103:0/846798207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d041ef2e0 con 0x7f3d04152370 2024-09-10T08:29:00.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.706+0000 7f3d09eaf640 1 -- 172.21.15.103:0/846798207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d040abc10 con 0x7f3d04152370 2024-09-10T08:29:00.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.707+0000 7f3cfbfff640 1 -- 172.21.15.103:0/846798207 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3cfc034610 con 0x7f3d04152370 2024-09-10T08:29:00.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.707+0000 7f3cfbfff640 1 --2- 172.21.15.103:0/846798207 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3ce406be60 0x7f3ce406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.708+0000 7f3cfbfff640 1 -- 172.21.15.103:0/846798207 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f3cfc0aa6e0 con 0x7f3d04152370 2024-09-10T08:29:00.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.708+0000 7f3d037fe640 1 --2- 172.21.15.103:0/846798207 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3ce406be60 0x7f3ce406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.708+0000 7f3d037fe640 1 --2- 172.21.15.103:0/846798207 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3ce406be60 0x7f3ce406e320 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3cec005490 tx=0x7f3cec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:00.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.712+0000 7f3cfbfff640 1 -- 172.21.15.103:0/846798207 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3d040727b0 con 0x7f3d04152370 2024-09-10T08:29:00.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.913+0000 7f3d09eaf640 1 -- 172.21.15.103:0/846798207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3d040c3340 con 0x7f3d04152370 2024-09-10T08:29:00.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.914+0000 7f3cfbfff640 1 -- 172.21.15.103:0/846798207 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f3cfc078df0 con 0x7f3d04152370 2024-09-10T08:29:00.918 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:29:00.918 INFO:teuthology.orchestra.run.smithi103.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T08:29:00.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.915+0000 7f3d09eaf640 1 -- 172.21.15.103:0/846798207 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3ce406be60 msgr2=0x7f3ce406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.915+0000 7f3d09eaf640 1 --2- 172.21.15.103:0/846798207 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3ce406be60 0x7f3ce406e320 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3cec005490 tx=0x7f3cec009040 comp rx=0 tx=0).stop 2024-09-10T08:29:00.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.915+0000 7f3d09eaf640 1 -- 172.21.15.103:0/846798207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d04152370 msgr2=0x7f3d041eb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.915+0000 7f3d09eaf640 1 --2- 172.21.15.103:0/846798207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d04152370 0x7f3d041eb610 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00a870 tx=0x7f3cfc02d070 comp rx=0 tx=0).stop 2024-09-10T08:29:00.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.916+0000 7f3d09eaf640 1 -- 172.21.15.103:0/846798207 shutdown_connections 2024-09-10T08:29:00.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.916+0000 7f3d09eaf640 1 --2- 172.21.15.103:0/846798207 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3ce406be60 0x7f3ce406e320 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.916+0000 7f3d09eaf640 1 --2- 172.21.15.103:0/846798207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d04152370 0x7f3d041eb610 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.916+0000 7f3d09eaf640 1 --2- 172.21.15.103:0/846798207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d0409ca00 0x7f3d04151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.916+0000 7f3d09eaf640 1 --2- 172.21.15.103:0/846798207 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cf0007490 0x7f3d041564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.916+0000 7f3d09eaf640 1 -- 172.21.15.103:0/846798207 >> 172.21.15.103:0/846798207 conn(0x7f3d040c5660 msgr2=0x7f3d040aa170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:00.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.916+0000 7f3d09eaf640 1 -- 172.21.15.103:0/846798207 shutdown_connections 2024-09-10T08:29:00.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:00.916+0000 7f3d09eaf640 1 -- 172.21.15.103:0/846798207 wait complete. 2024-09-10T08:29:00.927 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-10T08:29:00.927 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:29:01.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.024+0000 7fcff6f59640 1 Processor -- start 2024-09-10T08:29:01.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.024+0000 7fcff6f59640 1 -- start start 2024-09-10T08:29:01.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.025+0000 7fcff6f59640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcff00af870 0x7fcff00c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.025+0000 7fcff6f59640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcff00c54e0 con 0x7fcff0153af0 2024-09-10T08:29:01.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.025+0000 7fcff6f59640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcff00c74a0 con 0x7fcff00afdd0 2024-09-10T08:29:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.025+0000 7fcff6f59640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fcff00c7740 con 0x7fcff00af870 2024-09-10T08:29:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.025+0000 7fcff4cf5640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fcff0153af0 0x7fcff01563a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50204/0 (socket says 172.21.15.103:50204) 2024-09-10T08:29:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.025+0000 7fcff4cf5640 1 -- 172.21.15.103:0/204984974 learned_addr learned my addr 172.21.15.103:0/204984974 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:29:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.025+0000 7fcff54f6640 1 --2- 172.21.15.103:0/204984974 >> v2:172.21.15.103:3300/0 conn(0x7fcff00af870 0x7fcff00c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.025+0000 7fcfe77fe640 1 -- 172.21.15.103:0/204984974 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 667478075 0 0) 0x7fcff00c54e0 con 0x7fcff0153af0 2024-09-10T08:29:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.025+0000 7fcfe77fe640 1 -- 172.21.15.103:0/204984974 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfd8003520 con 0x7fcff0153af0 2024-09-10T08:29:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.025+0000 7fcff54f6640 1 -- 172.21.15.103:0/204984974 >> v1:172.21.15.154:6789/0 conn(0x7fcff00afdd0 legacy=0x7fcff00c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.025+0000 7fcff54f6640 1 -- 172.21.15.103:0/204984974 >> v1:172.21.15.103:6789/0 conn(0x7fcff0153af0 legacy=0x7fcff01563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.025+0000 7fcff54f6640 1 -- 172.21.15.103:0/204984974 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff015a3c0 con 0x7fcff00af870 2024-09-10T08:29:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.026+0000 7fcff54f6640 1 --2- 172.21.15.103:0/204984974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcff00af870 0x7fcff00c4780 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009d90 tx=0x7fcfe802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c433e7f3c6b600a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.026+0000 7fcfe77fe640 1 -- 172.21.15.103:0/204984974 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8031600 con 0x7fcff00af870 2024-09-10T08:29:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.026+0000 7fcfe77fe640 1 -- 172.21.15.103:0/204984974 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe80317a0 con 0x7fcff00af870 2024-09-10T08:29:01.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.026+0000 7fcfe77fe640 1 -- 172.21.15.103:0/204984974 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8031b70 con 0x7fcff00af870 2024-09-10T08:29:01.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.026+0000 7fcff6f59640 1 -- 172.21.15.103:0/204984974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcff00af870 msgr2=0x7fcff00c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.026+0000 7fcff6f59640 1 --2- 172.21.15.103:0/204984974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcff00af870 0x7fcff00c4780 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009d90 tx=0x7fcfe802a5d0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.027+0000 7fcff6f59640 1 -- 172.21.15.103:0/204984974 shutdown_connections 2024-09-10T08:29:01.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.027+0000 7fcff6f59640 1 --2- 172.21.15.103:0/204984974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcff00af870 0x7fcff00c4780 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.027+0000 7fcff6f59640 1 -- 172.21.15.103:0/204984974 >> 172.21.15.103:0/204984974 conn(0x7fcff00c6880 msgr2=0x7fcff00c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:01.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.027+0000 7fcff6f59640 1 -- 172.21.15.103:0/204984974 shutdown_connections 2024-09-10T08:29:01.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.027+0000 7fcff6f59640 1 -- 172.21.15.103:0/204984974 wait complete. 2024-09-10T08:29:01.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.028+0000 7fcff6f59640 1 Processor -- start 2024-09-10T08:29:01.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.028+0000 7fcff6f59640 1 -- start start 2024-09-10T08:29:01.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.028+0000 7fcff6f59640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcff00af870 0x7fcff0155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.028+0000 7fcff6f59640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcff00afdd0 0x7fcff00c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.028+0000 7fcff6f59640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcff0153af0 0x7fcff00c3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.028+0000 7fcff6f59640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcff00c4e40 con 0x7fcff00afdd0 2024-09-10T08:29:01.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.028+0000 7fcff6f59640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcff00c4cc0 con 0x7fcff00af870 2024-09-10T08:29:01.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.028+0000 7fcff6f59640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcff00c4fc0 con 0x7fcff0153af0 2024-09-10T08:29:01.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.029+0000 7fcfe7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcff00afdd0 0x7fcff00c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.029+0000 7fcfe7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcff00afdd0 0x7fcff00c2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49920/0 (socket says 172.21.15.103:49920) 2024-09-10T08:29:01.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.029+0000 7fcfe7fff640 1 -- 172.21.15.103:0/3224535434 learned_addr learned my addr 172.21.15.103:0/3224535434 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:01.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.029+0000 7fcff4cf5640 1 --2- 172.21.15.103:0/3224535434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcff00af870 0x7fcff0155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.029+0000 7fcff54f6640 1 --2- 172.21.15.103:0/3224535434 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcff0153af0 0x7fcff00c3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.029+0000 7fcfe7fff640 1 -- 172.21.15.103:0/3224535434 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcff0153af0 msgr2=0x7fcff00c3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.029+0000 7fcfe7fff640 1 --2- 172.21.15.103:0/3224535434 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcff0153af0 0x7fcff00c3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.029+0000 7fcfe7fff640 1 -- 172.21.15.103:0/3224535434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcff00af870 msgr2=0x7fcff0155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.029+0000 7fcfe7fff640 1 --2- 172.21.15.103:0/3224535434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcff00af870 0x7fcff0155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.029+0000 7fcfe7fff640 1 -- 172.21.15.103:0/3224535434 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff00c3580 con 0x7fcff00afdd0 2024-09-10T08:29:01.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.029+0000 7fcfe7fff640 1 --2- 172.21.15.103:0/3224535434 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcff00afdd0 0x7fcff00c2b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000c480 tx=0x7fcfe000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:01.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.029+0000 7fcfe57fa640 1 -- 172.21.15.103:0/3224535434 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe00052d0 con 0x7fcff00afdd0 2024-09-10T08:29:01.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.029+0000 7fcfe57fa640 1 -- 172.21.15.103:0/3224535434 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe0005470 con 0x7fcff00afdd0 2024-09-10T08:29:01.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.029+0000 7fcfe57fa640 1 -- 172.21.15.103:0/3224535434 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0012870 con 0x7fcff00afdd0 2024-09-10T08:29:01.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.029+0000 7fcff6f59640 1 -- 172.21.15.103:0/3224535434 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff01ec280 con 0x7fcff00afdd0 2024-09-10T08:29:01.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.029+0000 7fcff6f59640 1 -- 172.21.15.103:0/3224535434 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff00c3c30 con 0x7fcff00afdd0 2024-09-10T08:29:01.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.030+0000 7fcff6f59640 1 -- 172.21.15.103:0/3224535434 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcff00c4780 con 0x7fcff00afdd0 2024-09-10T08:29:01.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.031+0000 7fcfe57fa640 1 -- 172.21.15.103:0/3224535434 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcfe0012a10 con 0x7fcff00afdd0 2024-09-10T08:29:01.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.031+0000 7fcfe57fa640 1 --2- 172.21.15.103:0/3224535434 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcfdc06be30 0x7fcfdc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.031+0000 7fcfe57fa640 1 -- 172.21.15.103:0/3224535434 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fcfe008ac20 con 0x7fcff00afdd0 2024-09-10T08:29:01.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.031+0000 7fcff4cf5640 1 --2- 172.21.15.103:0/3224535434 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcfdc06be30 0x7fcfdc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.032+0000 7fcff4cf5640 1 --2- 172.21.15.103:0/3224535434 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcfdc06be30 0x7fcfdc06e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0011e0 tx=0x7fcfec007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:01.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.036+0000 7fcfe57fa640 1 -- 172.21.15.103:0/3224535434 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcfe0058ce0 con 0x7fcff00afdd0 2024-09-10T08:29:01.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.235+0000 7fcff6f59640 1 -- 172.21.15.103:0/3224535434 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcff00707b0 con 0x7fcff00afdd0 2024-09-10T08:29:01.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.235+0000 7fcfe57fa640 1 -- 172.21.15.103:0/3224535434 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6536 (secure 0 0 0) 0x7fcfe005cfe0 con 0x7fcff00afdd0 2024-09-10T08:29:01.236 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:29:01.236 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":11,"btime":"2024-09-10T08:28:50:632324+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3378269214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3378269214},{"type":"v1","addr":"172.21.15.154:6833","nonce":3378269214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2141115327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2141115327},{"type":"v1","addr":"172.21.15.154:6835","nonce":2141115327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:34.885455+0000","modified":"2024-09-10T08:28:37.905202+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/3032037784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":3032037784},{"type":"v1","addr":"172.21.15.103:6837","nonce":3032037784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:46.949092+0000","modified":"2024-09-10T08:28:49.966725+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.103:6836/2250136134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2250136134},{"type":"v1","addr":"172.21.15.103:6836","nonce":2250136134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":2}]} 2024-09-10T08:29:01.236 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 11 2024-09-10T08:29:01.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.237+0000 7fcff6f59640 1 -- 172.21.15.103:0/3224535434 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcfdc06be30 msgr2=0x7fcfdc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.237+0000 7fcff6f59640 1 --2- 172.21.15.103:0/3224535434 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcfdc06be30 0x7fcfdc06e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0011e0 tx=0x7fcfec007d30 comp rx=0 tx=0).stop 2024-09-10T08:29:01.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.237+0000 7fcff6f59640 1 -- 172.21.15.103:0/3224535434 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcff00afdd0 msgr2=0x7fcff00c2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.237+0000 7fcff6f59640 1 --2- 172.21.15.103:0/3224535434 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcff00afdd0 0x7fcff00c2b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000c480 tx=0x7fcfe000c940 comp rx=0 tx=0).stop 2024-09-10T08:29:01.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.237+0000 7fcff6f59640 1 -- 172.21.15.103:0/3224535434 shutdown_connections 2024-09-10T08:29:01.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.237+0000 7fcff6f59640 1 --2- 172.21.15.103:0/3224535434 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcfdc06be30 0x7fcfdc06e2f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.237+0000 7fcff6f59640 1 --2- 172.21.15.103:0/3224535434 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcff0153af0 0x7fcff00c3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.237+0000 7fcff6f59640 1 --2- 172.21.15.103:0/3224535434 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcff00afdd0 0x7fcff00c2b00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.237+0000 7fcff6f59640 1 --2- 172.21.15.103:0/3224535434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcff00af870 0x7fcff0155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.237+0000 7fcff6f59640 1 -- 172.21.15.103:0/3224535434 >> 172.21.15.103:0/3224535434 conn(0x7fcff00c6880 msgr2=0x7fcff00c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:01.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.238+0000 7fcff6f59640 1 -- 172.21.15.103:0/3224535434 shutdown_connections 2024-09-10T08:29:01.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.238+0000 7fcff6f59640 1 -- 172.21.15.103:0/3224535434 wait complete. 2024-09-10T08:29:01.249 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:29:01.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.346+0000 7f5189427640 1 Processor -- start 2024-09-10T08:29:01.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.347+0000 7f5189427640 1 -- start start 2024-09-10T08:29:01.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.347+0000 7f5189427640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5184073ae0 0x7f5184153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.347+0000 7f5189427640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f51840733d0 0x7f51841538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.347+0000 7f5189427640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f518406dd50 con 0x7f518406d850 2024-09-10T08:29:01.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.347+0000 7f5189427640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f518406e030 con 0x7f51840733d0 2024-09-10T08:29:01.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.347+0000 7f5189427640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f518406e310 con 0x7f5184073ae0 2024-09-10T08:29:01.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.348+0000 7f51827fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f51840733d0 0x7f51841538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.348+0000 7f51837fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f518406d850 0x7f5184156840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50210/0 (socket says 172.21.15.103:50210) 2024-09-10T08:29:01.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.348+0000 7f51827fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f51840733d0 0x7f51841538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49922/0 (socket says 172.21.15.103:49922) 2024-09-10T08:29:01.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.348+0000 7f51837fe640 1 -- 172.21.15.103:0/3380176199 learned_addr learned my addr 172.21.15.103:0/3380176199 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:29:01.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.348+0000 7f5182ffd640 1 --2- 172.21.15.103:0/3380176199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5184073ae0 0x7f5184153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.348+0000 7f51827fc640 1 -- 172.21.15.103:0/3380176199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5184073ae0 msgr2=0x7f5184153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:01.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.348+0000 7f51827fc640 1 --2- 172.21.15.103:0/3380176199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5184073ae0 0x7f5184153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.348+0000 7f51827fc640 1 -- 172.21.15.103:0/3380176199 >> v1:172.21.15.103:6789/0 conn(0x7f518406d850 legacy=0x7f5184156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.348+0000 7f5181ffb640 1 -- 172.21.15.103:0/3380176199 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1793304303 0 0) 0x7f518406dd50 con 0x7f518406d850 2024-09-10T08:29:01.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.348+0000 7f51827fc640 1 -- 172.21.15.103:0/3380176199 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518406e5f0 con 0x7f51840733d0 2024-09-10T08:29:01.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.349+0000 7f51827fc640 1 --2- 172.21.15.103:0/3380176199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51840733d0 0x7f51841538c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f51780097a0 tx=0x7f517802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24a410ae8c2e6c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:01.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.349+0000 7f5181ffb640 1 -- 172.21.15.103:0/3380176199 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178037070 con 0x7f51840733d0 2024-09-10T08:29:01.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.349+0000 7f5181ffb640 1 -- 172.21.15.103:0/3380176199 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5178032440 con 0x7f51840733d0 2024-09-10T08:29:01.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.349+0000 7f5181ffb640 1 -- 172.21.15.103:0/3380176199 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178032810 con 0x7f51840733d0 2024-09-10T08:29:01.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.349+0000 7f5189427640 1 -- 172.21.15.103:0/3380176199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51840733d0 msgr2=0x7f51841538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.349+0000 7f5189427640 1 --2- 172.21.15.103:0/3380176199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51840733d0 0x7f51841538c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f51780097a0 tx=0x7f517802a180 comp rx=0 tx=0).stop 2024-09-10T08:29:01.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.349+0000 7f5189427640 1 -- 172.21.15.103:0/3380176199 shutdown_connections 2024-09-10T08:29:01.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.349+0000 7f5189427640 1 --2- 172.21.15.103:0/3380176199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51840733d0 0x7f51841538c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.349+0000 7f5189427640 1 --2- 172.21.15.103:0/3380176199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5184073ae0 0x7f5184153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.349+0000 7f5189427640 1 -- 172.21.15.103:0/3380176199 >> 172.21.15.103:0/3380176199 conn(0x7f51840c9d80 msgr2=0x7f51840ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:01.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.349+0000 7f5189427640 1 -- 172.21.15.103:0/3380176199 shutdown_connections 2024-09-10T08:29:01.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.349+0000 7f5189427640 1 -- 172.21.15.103:0/3380176199 wait complete. 2024-09-10T08:29:01.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.350+0000 7f5189427640 1 Processor -- start 2024-09-10T08:29:01.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.351+0000 7f5189427640 1 -- start start 2024-09-10T08:29:01.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.351+0000 7f5189427640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f518406d850 0x7f5184159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.351+0000 7f5189427640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51840733d0 0x7f51841ef7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.351+0000 7f5189427640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5184073ae0 0x7f51841efd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.351+0000 7f5189427640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f518406edd0 con 0x7f51840733d0 2024-09-10T08:29:01.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.351+0000 7f5189427640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f518406ec50 con 0x7f5184073ae0 2024-09-10T08:29:01.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.351+0000 7f5189427640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5184073ec0 con 0x7f518406d850 2024-09-10T08:29:01.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.351+0000 7f51827fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51840733d0 0x7f51841ef7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.351+0000 7f51827fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51840733d0 0x7f51841ef7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49934/0 (socket says 172.21.15.103:49934) 2024-09-10T08:29:01.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.351+0000 7f51827fc640 1 -- 172.21.15.103:0/1882344964 learned_addr learned my addr 172.21.15.103:0/1882344964 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:01.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.351+0000 7f5182ffd640 1 --2- 172.21.15.103:0/1882344964 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f518406d850 0x7f5184159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.351+0000 7f51837fe640 1 --2- 172.21.15.103:0/1882344964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5184073ae0 0x7f51841efd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.352+0000 7f51827fc640 1 -- 172.21.15.103:0/1882344964 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f518406d850 msgr2=0x7f5184159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.352+0000 7f51827fc640 1 --2- 172.21.15.103:0/1882344964 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f518406d850 0x7f5184159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.352+0000 7f51827fc640 1 -- 172.21.15.103:0/1882344964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5184073ae0 msgr2=0x7f51841efd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.352+0000 7f51827fc640 1 --2- 172.21.15.103:0/1882344964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5184073ae0 0x7f51841efd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.352+0000 7f51827fc640 1 -- 172.21.15.103:0/1882344964 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51841415d0 con 0x7f51840733d0 2024-09-10T08:29:01.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.352+0000 7f51827fc640 1 --2- 172.21.15.103:0/1882344964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51840733d0 0x7f51841ef7e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5178035040 tx=0x7f51780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:01.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.352+0000 7f516b7fe640 1 -- 172.21.15.103:0/1882344964 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178037040 con 0x7f51840733d0 2024-09-10T08:29:01.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.352+0000 7f516b7fe640 1 -- 172.21.15.103:0/1882344964 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5178030770 con 0x7f51840733d0 2024-09-10T08:29:01.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.352+0000 7f5189427640 1 -- 172.21.15.103:0/1882344964 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51841418b0 con 0x7f51840733d0 2024-09-10T08:29:01.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.352+0000 7f516b7fe640 1 -- 172.21.15.103:0/1882344964 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178030b40 con 0x7f51840733d0 2024-09-10T08:29:01.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.352+0000 7f5189427640 1 -- 172.21.15.103:0/1882344964 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51841553b0 con 0x7f51840733d0 2024-09-10T08:29:01.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.353+0000 7f5189427640 1 -- 172.21.15.103:0/1882344964 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5184072c50 con 0x7f51840733d0 2024-09-10T08:29:01.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.354+0000 7f516b7fe640 1 -- 172.21.15.103:0/1882344964 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5178044020 con 0x7f51840733d0 2024-09-10T08:29:01.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.354+0000 7f516b7fe640 1 --2- 172.21.15.103:0/1882344964 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f517006be30 0x7f517006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.354+0000 7f516b7fe640 1 -- 172.21.15.103:0/1882344964 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f51780ab4d0 con 0x7f51840733d0 2024-09-10T08:29:01.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.354+0000 7f5182ffd640 1 --2- 172.21.15.103:0/1882344964 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f517006be30 0x7f517006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.354+0000 7f5182ffd640 1 --2- 172.21.15.103:0/1882344964 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f517006be30 0x7f517006e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5174003aa0 tx=0x7f5174009830 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:01.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.358+0000 7f516b7fe640 1 -- 172.21.15.103:0/1882344964 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5178032e20 con 0x7f51840733d0 2024-09-10T08:29:01.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.555+0000 7f5189427640 1 -- 172.21.15.103:0/1882344964 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f518414c890 con 0x7f51840733d0 2024-09-10T08:29:01.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.556+0000 7f516b7fe640 1 -- 172.21.15.103:0/1882344964 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6536 (secure 0 0 0) 0x7f5178079590 con 0x7f51840733d0 2024-09-10T08:29:01.557 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:29:01.557 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":11,"btime":"2024-09-10T08:28:50:632324+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3378269214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3378269214},{"type":"v1","addr":"172.21.15.154:6833","nonce":3378269214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2141115327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2141115327},{"type":"v1","addr":"172.21.15.154:6835","nonce":2141115327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:34.885455+0000","modified":"2024-09-10T08:28:37.905202+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/3032037784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":3032037784},{"type":"v1","addr":"172.21.15.103:6837","nonce":3032037784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:46.949092+0000","modified":"2024-09-10T08:28:49.966725+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.103:6836/2250136134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2250136134},{"type":"v1","addr":"172.21.15.103:6836","nonce":2250136134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":2}]} 2024-09-10T08:29:01.557 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 11 2024-09-10T08:29:01.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.558+0000 7f5189427640 1 -- 172.21.15.103:0/1882344964 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f517006be30 msgr2=0x7f517006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.558+0000 7f5189427640 1 --2- 172.21.15.103:0/1882344964 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f517006be30 0x7f517006e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5174003aa0 tx=0x7f5174009830 comp rx=0 tx=0).stop 2024-09-10T08:29:01.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.558+0000 7f5189427640 1 -- 172.21.15.103:0/1882344964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51840733d0 msgr2=0x7f51841ef7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.558+0000 7f5189427640 1 --2- 172.21.15.103:0/1882344964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51840733d0 0x7f51841ef7e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5178035040 tx=0x7f51780046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.558+0000 7f5189427640 1 -- 172.21.15.103:0/1882344964 shutdown_connections 2024-09-10T08:29:01.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.558+0000 7f5189427640 1 --2- 172.21.15.103:0/1882344964 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f517006be30 0x7f517006e2f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.558+0000 7f5189427640 1 --2- 172.21.15.103:0/1882344964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5184073ae0 0x7f51841efd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.558+0000 7f5189427640 1 --2- 172.21.15.103:0/1882344964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51840733d0 0x7f51841ef7e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.558+0000 7f5189427640 1 --2- 172.21.15.103:0/1882344964 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f518406d850 0x7f5184159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.558+0000 7f5189427640 1 -- 172.21.15.103:0/1882344964 >> 172.21.15.103:0/1882344964 conn(0x7f51840c9d80 msgr2=0x7f51840ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:01.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.558+0000 7f5189427640 1 -- 172.21.15.103:0/1882344964 shutdown_connections 2024-09-10T08:29:01.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.558+0000 7f5189427640 1 -- 172.21.15.103:0/1882344964 wait complete. 2024-09-10T08:29:01.569 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:29:01.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.668+0000 7f12a571f640 1 Processor -- start 2024-09-10T08:29:01.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.668+0000 7f12a571f640 1 -- start start 2024-09-10T08:29:01.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.669+0000 7f12a571f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12a00c44e0 0x7f12a006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.669+0000 7f12a571f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f12a006f9b0 0x7f12a00c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.669+0000 7f12a571f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a0156640 con 0x7f12a0150720 2024-09-10T08:29:01.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.669+0000 7f12a571f640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f12a0157210 con 0x7f12a006f9b0 2024-09-10T08:29:01.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.669+0000 7f12a571f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f12a01568e0 con 0x7f12a00c44e0 2024-09-10T08:29:01.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.669+0000 7f129f7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f12a006f9b0 0x7f12a00c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.669+0000 7f129f7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f12a006f9b0 0x7f12a00c30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49944/0 (socket says 172.21.15.103:49944) 2024-09-10T08:29:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.669+0000 7f129f7fe640 1 -- 172.21.15.103:0/742885024 learned_addr learned my addr 172.21.15.103:0/742885024 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.669+0000 7f129e7fc640 1 --2- 172.21.15.103:0/742885024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12a00c44e0 0x7f12a006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.669+0000 7f129f7fe640 1 -- 172.21.15.103:0/742885024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12a00c44e0 msgr2=0x7f12a006f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.669+0000 7f129f7fe640 1 --2- 172.21.15.103:0/742885024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12a00c44e0 0x7f12a006f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.669+0000 7f129f7fe640 1 -- 172.21.15.103:0/742885024 >> v1:172.21.15.154:6789/0 conn(0x7f12a0150720 legacy=0x7f12a00adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.669+0000 7f129f7fe640 1 -- 172.21.15.103:0/742885024 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a0156bc0 con 0x7f12a006f9b0 2024-09-10T08:29:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.670+0000 7f129f7fe640 1 --2- 172.21.15.103:0/742885024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12a006f9b0 0x7f12a00c30a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1298009e50 tx=0x7f129802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61816f35eb543239 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.670+0000 7f129dffb640 1 -- 172.21.15.103:0/742885024 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298036070 con 0x7f12a006f9b0 2024-09-10T08:29:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.670+0000 7f129dffb640 1 -- 172.21.15.103:0/742885024 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1298031600 con 0x7f12a006f9b0 2024-09-10T08:29:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.670+0000 7f129dffb640 1 -- 172.21.15.103:0/742885024 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12980319d0 con 0x7f12a006f9b0 2024-09-10T08:29:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.670+0000 7f12a571f640 1 -- 172.21.15.103:0/742885024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12a006f9b0 msgr2=0x7f12a00c30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.670+0000 7f12a571f640 1 --2- 172.21.15.103:0/742885024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12a006f9b0 0x7f12a00c30a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1298009e50 tx=0x7f129802a5f0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.670+0000 7f12a571f640 1 -- 172.21.15.103:0/742885024 shutdown_connections 2024-09-10T08:29:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.670+0000 7f12a571f640 1 --2- 172.21.15.103:0/742885024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12a006f9b0 0x7f12a00c30a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.670+0000 7f12a571f640 1 --2- 172.21.15.103:0/742885024 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12a00c44e0 0x7f12a006f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.670+0000 7f12a571f640 1 -- 172.21.15.103:0/742885024 >> 172.21.15.103:0/742885024 conn(0x7f12a00c8410 msgr2=0x7f12a00c87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.670+0000 7f12a571f640 1 -- 172.21.15.103:0/742885024 shutdown_connections 2024-09-10T08:29:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.670+0000 7f12a571f640 1 -- 172.21.15.103:0/742885024 wait complete. 2024-09-10T08:29:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.672+0000 7f12a571f640 1 Processor -- start 2024-09-10T08:29:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.672+0000 7f12a571f640 1 -- start start 2024-09-10T08:29:01.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.672+0000 7f12a571f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12a006f9b0 0x7f12a0150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.672+0000 7f12a571f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12a00c44e0 0x7f12a01de970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.672+0000 7f12a571f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12a0150720 0x7f12a0152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.672+0000 7f12a571f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f12a00c35e0 con 0x7f12a006f9b0 2024-09-10T08:29:01.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.672+0000 7f12a571f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f12a0150b00 con 0x7f12a0150720 2024-09-10T08:29:01.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.672+0000 7f12a571f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f12a00c3760 con 0x7f12a00c44e0 2024-09-10T08:29:01.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.672+0000 7f129effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12a006f9b0 0x7f12a0150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.673+0000 7f129effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12a006f9b0 0x7f12a0150ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49946/0 (socket says 172.21.15.103:49946) 2024-09-10T08:29:01.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.673+0000 7f129effd640 1 -- 172.21.15.103:0/338829270 learned_addr learned my addr 172.21.15.103:0/338829270 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:01.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.673+0000 7f129f7fe640 1 --2- 172.21.15.103:0/338829270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12a0150720 0x7f12a0152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.673+0000 7f129e7fc640 1 --2- 172.21.15.103:0/338829270 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12a00c44e0 0x7f12a01de970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.673+0000 7f129effd640 1 -- 172.21.15.103:0/338829270 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12a00c44e0 msgr2=0x7f12a01de970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.673+0000 7f129effd640 1 --2- 172.21.15.103:0/338829270 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12a00c44e0 0x7f12a01de970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.673+0000 7f129effd640 1 -- 172.21.15.103:0/338829270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12a0150720 msgr2=0x7f12a0152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.673+0000 7f129effd640 1 --2- 172.21.15.103:0/338829270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12a0150720 0x7f12a0152af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.673+0000 7f129effd640 1 -- 172.21.15.103:0/338829270 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a0153d10 con 0x7f12a006f9b0 2024-09-10T08:29:01.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.673+0000 7f129e7fc640 1 --2- 172.21.15.103:0/338829270 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12a00c44e0 0x7f12a01de970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:01.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.673+0000 7f129effd640 1 --2- 172.21.15.103:0/338829270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12a006f9b0 0x7f12a0150ea0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f129000c400 tx=0x7f129000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:01.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.673+0000 7f12877fe640 1 -- 172.21.15.103:0/338829270 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1290017070 con 0x7f12a006f9b0 2024-09-10T08:29:01.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.673+0000 7f12877fe640 1 -- 172.21.15.103:0/338829270 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12900052d0 con 0x7f12a006f9b0 2024-09-10T08:29:01.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.673+0000 7f12a571f640 1 -- 172.21.15.103:0/338829270 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a0153a30 con 0x7f12a006f9b0 2024-09-10T08:29:01.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.673+0000 7f12877fe640 1 -- 172.21.15.103:0/338829270 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1290003830 con 0x7f12a006f9b0 2024-09-10T08:29:01.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.673+0000 7f12a571f640 1 -- 172.21.15.103:0/338829270 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a0152210 con 0x7f12a006f9b0 2024-09-10T08:29:01.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.674+0000 7f12a571f640 1 -- 172.21.15.103:0/338829270 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12a00c3bc0 con 0x7f12a006f9b0 2024-09-10T08:29:01.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.675+0000 7f12877fe640 1 -- 172.21.15.103:0/338829270 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f129001a070 con 0x7f12a006f9b0 2024-09-10T08:29:01.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.675+0000 7f12877fe640 1 --2- 172.21.15.103:0/338829270 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f128c06be60 0x7f128c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.675+0000 7f12877fe640 1 -- 172.21.15.103:0/338829270 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f129008a3a0 con 0x7f12a006f9b0 2024-09-10T08:29:01.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.675+0000 7f129e7fc640 1 --2- 172.21.15.103:0/338829270 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f128c06be60 0x7f128c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.676+0000 7f129e7fc640 1 --2- 172.21.15.103:0/338829270 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f128c06be60 0x7f128c06e320 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f12a0074ab0 tx=0x7f1294008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:01.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.679+0000 7f12877fe640 1 -- 172.21.15.103:0/338829270 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1290058460 con 0x7f12a006f9b0 2024-09-10T08:29:01.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.851+0000 7f12a571f640 1 -- 172.21.15.103:0/338829270 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12a01deeb0 con 0x7f12a006f9b0 2024-09-10T08:29:01.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.852+0000 7f12877fe640 1 -- 172.21.15.103:0/338829270 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20499 (secure 0 0 0) 0x7f129005c760 con 0x7f12a006f9b0 2024-09-10T08:29:01.853 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:29:01.853 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","created":"2024-09-10T08:28:12.654957+0000","modified":"2024-09-10T08:28:48.615871+0000","last_up_change":"2024-09-10T08:28:25.445753+0000","last_in_change":"2024-09-10T08:28:14.741133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:24.821696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-10T08:28:33.488154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-10T08:28:33.857868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-10T08:28:44.793084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-10T08:28:45.930823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1abe08f4-0348-435e-9f97-cec00e96992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6809","nonce":2707863099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6811","nonce":2707863099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6815","nonce":2707863099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6813","nonce":2707863099}]},"public_addr":"172.21.15.103:6809/2707863099","cluster_addr":"172.21.15.103:6811/2707863099","heartbeat_back_addr":"172.21.15.103:6815/2707863099","heartbeat_front_addr":"172.21.15.103:6813/2707863099","state":["exists","up"]},{"osd":1,"uuid":"df342e58-1026-4739-82f6-7a216707444c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6818","nonce":4029892782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6822","nonce":4029892782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6830","nonce":4029892782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6826","nonce":4029892782}]},"public_addr":"172.21.15.103:6818/4029892782","cluster_addr":"172.21.15.103:6822/4029892782","heartbeat_back_addr":"172.21.15.103:6830/4029892782","heartbeat_front_addr":"172.21.15.103:6826/4029892782","state":["exists","up"]},{"osd":2,"uuid":"f7aea2cf-208c-41ed-a0f6-8948d70b9a0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6819","nonce":428484432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6821","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6823","nonce":428484432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6829","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6831","nonce":428484432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6825","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6827","nonce":428484432}]},"public_addr":"172.21.15.103:6819/428484432","cluster_addr":"172.21.15.103:6823/428484432","heartbeat_back_addr":"172.21.15.103:6831/428484432","heartbeat_front_addr":"172.21.15.103:6827/428484432","state":["exists","up"]},{"osd":3,"uuid":"615ef8b0-12a5-4503-96d0-f7ec17dbc792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6801","nonce":3453676282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6803","nonce":3453676282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6807","nonce":3453676282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6805","nonce":3453676282}]},"public_addr":"172.21.15.103:6801/3453676282","cluster_addr":"172.21.15.103:6803/3453676282","heartbeat_back_addr":"172.21.15.103:6807/3453676282","heartbeat_front_addr":"172.21.15.103:6805/3453676282","state":["exists","up"]},{"osd":4,"uuid":"644c5e94-db18-4b83-b5cd-3762ae2647a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6809","nonce":1808157069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6811","nonce":1808157069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6815","nonce":1808157069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6813","nonce":1808157069}]},"public_addr":"172.21.15.154:6809/1808157069","cluster_addr":"172.21.15.154:6811/1808157069","heartbeat_back_addr":"172.21.15.154:6815/1808157069","heartbeat_front_addr":"172.21.15.154:6813/1808157069","state":["exists","up"]},{"osd":5,"uuid":"f40210bd-f4ca-442e-baac-729ced5a9f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6817","nonce":1048015779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6819","nonce":1048015779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6823","nonce":1048015779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6821","nonce":1048015779}]},"public_addr":"172.21.15.154:6817/1048015779","cluster_addr":"172.21.15.154:6819/1048015779","heartbeat_back_addr":"172.21.15.154:6823/1048015779","heartbeat_front_addr":"172.21.15.154:6821/1048015779","state":["exists","up"]},{"osd":6,"uuid":"eebac31e-aaef-47b0-90d7-4af08f36d7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6801","nonce":345273812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6803","nonce":345273812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6807","nonce":345273812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6805","nonce":345273812}]},"public_addr":"172.21.15.154:6801/345273812","cluster_addr":"172.21.15.154:6803/345273812","heartbeat_back_addr":"172.21.15.154:6807/345273812","heartbeat_front_addr":"172.21.15.154:6805/345273812","state":["exists","up"]},{"osd":7,"uuid":"58406c9a-036f-4618-bfb6-0beddbd71605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6825","nonce":3439481239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6827","nonce":3439481239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6831","nonce":3439481239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6829","nonce":3439481239}]},"public_addr":"172.21.15.154:6825/3439481239","cluster_addr":"172.21.15.154:6827/3439481239","heartbeat_back_addr":"172.21.15.154:6831/3439481239","heartbeat_front_addr":"172.21.15.154:6829/3439481239","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.032718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.126448+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.781158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.808718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.050591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.038245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.586989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.223326+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:29:01.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.854+0000 7f12a571f640 1 -- 172.21.15.103:0/338829270 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f128c06be60 msgr2=0x7f128c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.854+0000 7f12a571f640 1 --2- 172.21.15.103:0/338829270 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f128c06be60 0x7f128c06e320 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f12a0074ab0 tx=0x7f1294008040 comp rx=0 tx=0).stop 2024-09-10T08:29:01.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.854+0000 7f12a571f640 1 -- 172.21.15.103:0/338829270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12a006f9b0 msgr2=0x7f12a0150ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.854+0000 7f12a571f640 1 --2- 172.21.15.103:0/338829270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12a006f9b0 0x7f12a0150ea0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f129000c400 tx=0x7f129000c8c0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.854+0000 7f12a571f640 1 -- 172.21.15.103:0/338829270 shutdown_connections 2024-09-10T08:29:01.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.854+0000 7f12a571f640 1 --2- 172.21.15.103:0/338829270 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f128c06be60 0x7f128c06e320 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.854+0000 7f12a571f640 1 --2- 172.21.15.103:0/338829270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12a0150720 0x7f12a0152af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.854+0000 7f12a571f640 1 --2- 172.21.15.103:0/338829270 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12a00c44e0 0x7f12a01de970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.854+0000 7f12a571f640 1 --2- 172.21.15.103:0/338829270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12a006f9b0 0x7f12a0150ea0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.854+0000 7f12a571f640 1 -- 172.21.15.103:0/338829270 >> 172.21.15.103:0/338829270 conn(0x7f12a00c8410 msgr2=0x7f12a00ab610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:01.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.854+0000 7f12a571f640 1 -- 172.21.15.103:0/338829270 shutdown_connections 2024-09-10T08:29:01.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.854+0000 7f12a571f640 1 -- 172.21.15.103:0/338829270 wait complete. 2024-09-10T08:29:01.866 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:29:01.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.964+0000 7f2ab856d640 1 Processor -- start 2024-09-10T08:29:01.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.964+0000 7f2ab856d640 1 -- start start 2024-09-10T08:29:01.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.965+0000 7f2ab856d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2ab0072ec0 0x7f2ab0153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.965+0000 7f2ab856d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ab00c4ac0 0x7f2ab0070040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.965+0000 7f2ab856d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ab006efa0 con 0x7f2ab00afc60 2024-09-10T08:29:01.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.965+0000 7f2ab856d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f2ab006f280 con 0x7f2ab0072ec0 2024-09-10T08:29:01.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.965+0000 7f2ab856d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2ab006f560 con 0x7f2ab00c4ac0 2024-09-10T08:29:01.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.965+0000 7f2ab6b0a640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2ab00afc60 0x7f2ab0151380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50214/0 (socket says 172.21.15.103:50214) 2024-09-10T08:29:01.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.965+0000 7f2ab6b0a640 1 -- 172.21.15.103:0/4153818216 learned_addr learned my addr 172.21.15.103:0/4153818216 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:29:01.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.965+0000 7f2ab5b08640 1 --2- 172.21.15.103:0/4153818216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ab00c4ac0 0x7f2ab0070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.965+0000 7f2ab6309640 1 --2- 172.21.15.103:0/4153818216 >> v2:172.21.15.154:3300/0 conn(0x7f2ab0072ec0 0x7f2ab0153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.965+0000 7f2ab5307640 1 -- 172.21.15.103:0/4153818216 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 278321180 0 0) 0x7f2ab006efa0 con 0x7f2ab00afc60 2024-09-10T08:29:01.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.965+0000 7f2ab5307640 1 -- 172.21.15.103:0/4153818216 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a9c003520 con 0x7f2ab00afc60 2024-09-10T08:29:01.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.965+0000 7f2ab5307640 1 -- 172.21.15.103:0/4153818216 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3714903756 0 0) 0x7f2a9c003520 con 0x7f2ab00afc60 2024-09-10T08:29:01.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.965+0000 7f2ab5b08640 1 -- 172.21.15.103:0/4153818216 >> v2:172.21.15.154:3300/0 conn(0x7f2ab0072ec0 msgr2=0x7f2ab0153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:01.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.965+0000 7f2ab5b08640 1 --2- 172.21.15.103:0/4153818216 >> v2:172.21.15.154:3300/0 conn(0x7f2ab0072ec0 0x7f2ab0153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.965+0000 7f2ab5b08640 1 -- 172.21.15.103:0/4153818216 >> v1:172.21.15.103:6789/0 conn(0x7f2ab00afc60 legacy=0x7f2ab0151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.965+0000 7f2ab5b08640 1 -- 172.21.15.103:0/4153818216 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab006f840 con 0x7f2ab00c4ac0 2024-09-10T08:29:01.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.965+0000 7f2ab6309640 1 --2- 172.21.15.103:0/4153818216 >> v2:172.21.15.154:3300/0 conn(0x7f2ab0072ec0 0x7f2ab0153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:29:01.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.966+0000 7f2ab5b08640 1 --2- 172.21.15.103:0/4153818216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ab00c4ac0 0x7f2ab0070040 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00097a0 tx=0x7f2aa002a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57df4b7eaa2f3072 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:01.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.966+0000 7f2ab5307640 1 -- 172.21.15.103:0/4153818216 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0037070 con 0x7f2ab00c4ac0 2024-09-10T08:29:01.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.966+0000 7f2ab5307640 1 -- 172.21.15.103:0/4153818216 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa002aa90 con 0x7f2ab00c4ac0 2024-09-10T08:29:01.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.966+0000 7f2ab5307640 1 -- 172.21.15.103:0/4153818216 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa80019f0 con 0x7f2ab00c4ac0 2024-09-10T08:29:01.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.967+0000 7f2ab856d640 1 -- 172.21.15.103:0/4153818216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ab00c4ac0 msgr2=0x7f2ab0070040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.967+0000 7f2ab856d640 1 --2- 172.21.15.103:0/4153818216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ab00c4ac0 0x7f2ab0070040 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2aa00097a0 tx=0x7f2aa002a000 comp rx=0 tx=0).stop 2024-09-10T08:29:01.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.967+0000 7f2ab856d640 1 -- 172.21.15.103:0/4153818216 shutdown_connections 2024-09-10T08:29:01.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.967+0000 7f2ab856d640 1 --2- 172.21.15.103:0/4153818216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ab00c4ac0 0x7f2ab0070040 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.967+0000 7f2ab856d640 1 --2- 172.21.15.103:0/4153818216 >> v2:172.21.15.154:3300/0 conn(0x7f2ab0072ec0 0x7f2ab0153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.967+0000 7f2ab856d640 1 -- 172.21.15.103:0/4153818216 >> 172.21.15.103:0/4153818216 conn(0x7f2ab00c9d80 msgr2=0x7f2ab00ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:01.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.967+0000 7f2ab856d640 1 -- 172.21.15.103:0/4153818216 shutdown_connections 2024-09-10T08:29:01.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.967+0000 7f2ab856d640 1 -- 172.21.15.103:0/4153818216 wait complete. 2024-09-10T08:29:01.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.968+0000 7f2ab856d640 1 Processor -- start 2024-09-10T08:29:01.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.968+0000 7f2ab856d640 1 -- start start 2024-09-10T08:29:01.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.969+0000 7f2ab856d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab0072ec0 0x7f2ab01522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.969+0000 7f2ab856d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab00afc60 0x7f2ab0157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.969+0000 7f2ab856d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ab00c4ac0 0x7f2ab01434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.969+0000 7f2ab856d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab00732a0 con 0x7f2ab0072ec0 2024-09-10T08:29:01.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.969+0000 7f2ab856d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab00c47f0 con 0x7f2ab00afc60 2024-09-10T08:29:01.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.969+0000 7f2ab856d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2ab0073420 con 0x7f2ab00c4ac0 2024-09-10T08:29:01.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.969+0000 7f2ab6309640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab0072ec0 0x7f2ab01522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.969+0000 7f2ab6309640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab0072ec0 0x7f2ab01522f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49958/0 (socket says 172.21.15.103:49958) 2024-09-10T08:29:01.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.969+0000 7f2ab6309640 1 -- 172.21.15.103:0/897340726 learned_addr learned my addr 172.21.15.103:0/897340726 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:01.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.969+0000 7f2ab6309640 1 -- 172.21.15.103:0/897340726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ab00c4ac0 msgr2=0x7f2ab01434e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.969+0000 7f2ab5b08640 1 --2- 172.21.15.103:0/897340726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab00afc60 0x7f2ab0157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.969+0000 7f2ab6309640 1 --2- 172.21.15.103:0/897340726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ab00c4ac0 0x7f2ab01434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.969+0000 7f2ab6309640 1 -- 172.21.15.103:0/897340726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab00afc60 msgr2=0x7f2ab0157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.969+0000 7f2ab6309640 1 --2- 172.21.15.103:0/897340726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab00afc60 0x7f2ab0157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.969+0000 7f2ab6309640 1 -- 172.21.15.103:0/897340726 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab014d360 con 0x7f2ab0072ec0 2024-09-10T08:29:01.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.969+0000 7f2ab6309640 1 --2- 172.21.15.103:0/897340726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab0072ec0 0x7f2ab01522f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00e990 tx=0x7f2aac00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:01.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.969+0000 7f2aa6ffd640 1 -- 172.21.15.103:0/897340726 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aac017070 con 0x7f2ab0072ec0 2024-09-10T08:29:01.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.969+0000 7f2aa6ffd640 1 -- 172.21.15.103:0/897340726 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aac00c9e0 con 0x7f2ab0072ec0 2024-09-10T08:29:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.969+0000 7f2ab856d640 1 -- 172.21.15.103:0/897340726 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab014d640 con 0x7f2ab0072ec0 2024-09-10T08:29:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.969+0000 7f2aa6ffd640 1 -- 172.21.15.103:0/897340726 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aac00cdb0 con 0x7f2ab0072ec0 2024-09-10T08:29:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.969+0000 7f2ab856d640 1 -- 172.21.15.103:0/897340726 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab0152830 con 0x7f2ab0072ec0 2024-09-10T08:29:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.970+0000 7f2ab856d640 1 -- 172.21.15.103:0/897340726 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ab0153ff0 con 0x7f2ab0072ec0 2024-09-10T08:29:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.971+0000 7f2aa6ffd640 1 -- 172.21.15.103:0/897340726 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2aac01a070 con 0x7f2ab0072ec0 2024-09-10T08:29:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.971+0000 7f2aa6ffd640 1 --2- 172.21.15.103:0/897340726 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2a9406be30 0x7f2a9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.971+0000 7f2aa6ffd640 1 -- 172.21.15.103:0/897340726 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f2aac08b350 con 0x7f2ab0072ec0 2024-09-10T08:29:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.971+0000 7f2ab5b08640 1 --2- 172.21.15.103:0/897340726 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2a9406be30 0x7f2a9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.972+0000 7f2ab5b08640 1 --2- 172.21.15.103:0/897340726 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2a9406be30 0x7f2a9406e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0034000 tx=0x7f2aa002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:01.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:01.976+0000 7f2aa6ffd640 1 -- 172.21.15.103:0/897340726 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2aac059a60 con 0x7f2ab0072ec0 2024-09-10T08:29:02.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.173+0000 7f2ab856d640 1 -- 172.21.15.103:0/897340726 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ab0158410 con 0x7f2ab0072ec0 2024-09-10T08:29:02.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.174+0000 7f2aa6ffd640 1 -- 172.21.15.103:0/897340726 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6536 (secure 0 0 0) 0x7f2aac059360 con 0x7f2ab0072ec0 2024-09-10T08:29:02.174 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:29:02.175 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":11,"btime":"2024-09-10T08:28:50:632324+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3378269214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3378269214},{"type":"v1","addr":"172.21.15.154:6833","nonce":3378269214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2141115327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2141115327},{"type":"v1","addr":"172.21.15.154:6835","nonce":2141115327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:34.885455+0000","modified":"2024-09-10T08:28:37.905202+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/3032037784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":3032037784},{"type":"v1","addr":"172.21.15.103:6837","nonce":3032037784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:46.949092+0000","modified":"2024-09-10T08:28:49.966725+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.103:6836/2250136134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2250136134},{"type":"v1","addr":"172.21.15.103:6836","nonce":2250136134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":2}]} 2024-09-10T08:29:02.175 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 11 2024-09-10T08:29:02.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.176+0000 7f2ab856d640 1 -- 172.21.15.103:0/897340726 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2a9406be30 msgr2=0x7f2a9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:02.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.176+0000 7f2ab856d640 1 --2- 172.21.15.103:0/897340726 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2a9406be30 0x7f2a9406e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0034000 tx=0x7f2aa002e000 comp rx=0 tx=0).stop 2024-09-10T08:29:02.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.176+0000 7f2ab856d640 1 -- 172.21.15.103:0/897340726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab0072ec0 msgr2=0x7f2ab01522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:02.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.176+0000 7f2ab856d640 1 --2- 172.21.15.103:0/897340726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab0072ec0 0x7f2ab01522f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00e990 tx=0x7f2aac00ee50 comp rx=0 tx=0).stop 2024-09-10T08:29:02.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.176+0000 7f2ab856d640 1 -- 172.21.15.103:0/897340726 shutdown_connections 2024-09-10T08:29:02.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.176+0000 7f2ab856d640 1 --2- 172.21.15.103:0/897340726 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2a9406be30 0x7f2a9406e2f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.176+0000 7f2ab856d640 1 --2- 172.21.15.103:0/897340726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ab00c4ac0 0x7f2ab01434e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.176+0000 7f2ab856d640 1 --2- 172.21.15.103:0/897340726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab00afc60 0x7f2ab0157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.176+0000 7f2ab856d640 1 --2- 172.21.15.103:0/897340726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab0072ec0 0x7f2ab01522f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.176+0000 7f2ab856d640 1 -- 172.21.15.103:0/897340726 >> 172.21.15.103:0/897340726 conn(0x7f2ab00c9d80 msgr2=0x7f2ab006ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:02.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.176+0000 7f2ab856d640 1 -- 172.21.15.103:0/897340726 shutdown_connections 2024-09-10T08:29:02.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.176+0000 7f2ab856d640 1 -- 172.21.15.103:0/897340726 wait complete. 2024-09-10T08:29:02.589 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:28:34.885455+0000', 'modified': '2024-09-10T08:28:37.905202+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6837/3032037784', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6835', 'nonce': 3032037784}, {'type': 'v1', 'addr': '172.21.15.103:6837', 'nonce': 3032037784}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'a', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4284, 'qdb_cluster': [4284]} 2024-09-10T08:29:02.590 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:29:02.590 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T08:29:02.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.694+0000 7f262a84c640 1 Processor -- start 2024-09-10T08:29:02.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.694+0000 7f262a84c640 1 -- start start 2024-09-10T08:29:02.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.694+0000 7f262a84c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f26241500a0 0x7f26240c3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.694+0000 7f262a84c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f262406e650 0x7f2624150930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.695+0000 7f262a84c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26240ad5c0 con 0x7f26240c3e00 2024-09-10T08:29:02.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.695+0000 7f262a84c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f262406ef50 con 0x7f262406e650 2024-09-10T08:29:02.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.695+0000 7f262a84c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f26240ad860 con 0x7f26241500a0 2024-09-10T08:29:02.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.695+0000 7f26237fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f262406e650 0x7f2624150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.695+0000 7f26237fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f262406e650 0x7f2624150930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49962/0 (socket says 172.21.15.103:49962) 2024-09-10T08:29:02.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.695+0000 7f26237fe640 1 -- 172.21.15.103:0/1529408496 learned_addr learned my addr 172.21.15.103:0/1529408496 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:02.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.695+0000 7f2623fff640 1 --2- 172.21.15.103:0/1529408496 >> v2:172.21.15.154:3300/0 conn(0x7f26241500a0 0x7f26240c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.695+0000 7f26237fe640 1 -- 172.21.15.103:0/1529408496 >> v2:172.21.15.154:3300/0 conn(0x7f26241500a0 msgr2=0x7f26240c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:02.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.695+0000 7f26237fe640 1 --2- 172.21.15.103:0/1529408496 >> v2:172.21.15.154:3300/0 conn(0x7f26241500a0 0x7f26240c3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.695+0000 7f26237fe640 1 -- 172.21.15.103:0/1529408496 >> v1:172.21.15.154:6789/0 conn(0x7f26240c3e00 legacy=0x7f262406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:02.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.695+0000 7f26237fe640 1 -- 172.21.15.103:0/1529408496 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f262406ec70 con 0x7f262406e650 2024-09-10T08:29:02.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.696+0000 7f26237fe640 1 --2- 172.21.15.103:0/1529408496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f262406e650 0x7f2624150930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f26240c8780 tx=0x7f260c02b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119f828137e41004 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:02.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.696+0000 7f2622ffd640 1 -- 172.21.15.103:0/1529408496 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c00b040 con 0x7f262406e650 2024-09-10T08:29:02.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.696+0000 7f2622ffd640 1 -- 172.21.15.103:0/1529408496 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f260c030710 con 0x7f262406e650 2024-09-10T08:29:02.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.696+0000 7f2622ffd640 1 -- 172.21.15.103:0/1529408496 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c030ae0 con 0x7f262406e650 2024-09-10T08:29:02.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.696+0000 7f262a84c640 1 -- 172.21.15.103:0/1529408496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f262406e650 msgr2=0x7f2624150930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:02.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.696+0000 7f262a84c640 1 --2- 172.21.15.103:0/1529408496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f262406e650 0x7f2624150930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f26240c8780 tx=0x7f260c02b550 comp rx=0 tx=0).stop 2024-09-10T08:29:02.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.696+0000 7f262a84c640 1 -- 172.21.15.103:0/1529408496 shutdown_connections 2024-09-10T08:29:02.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.696+0000 7f262a84c640 1 --2- 172.21.15.103:0/1529408496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f262406e650 0x7f2624150930 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.696+0000 7f262a84c640 1 --2- 172.21.15.103:0/1529408496 >> v2:172.21.15.154:3300/0 conn(0x7f26241500a0 0x7f26240c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.696+0000 7f262a84c640 1 -- 172.21.15.103:0/1529408496 >> 172.21.15.103:0/1529408496 conn(0x7f26240c7a40 msgr2=0x7f26240c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:02.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.696+0000 7f262a84c640 1 -- 172.21.15.103:0/1529408496 shutdown_connections 2024-09-10T08:29:02.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.696+0000 7f262a84c640 1 -- 172.21.15.103:0/1529408496 wait complete. 2024-09-10T08:29:02.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.698+0000 7f262a84c640 1 Processor -- start 2024-09-10T08:29:02.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.698+0000 7f262a84c640 1 -- start start 2024-09-10T08:29:02.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.698+0000 7f262a84c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f262406e650 0x7f26240a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.698+0000 7f262a84c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26240c3e00 0x7f26241487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.698+0000 7f262a84c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26241500a0 0x7f2624154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.698+0000 7f262a84c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2624150e70 con 0x7f26241500a0 2024-09-10T08:29:02.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.698+0000 7f262a84c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26240c3540 con 0x7f262406e650 2024-09-10T08:29:02.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.698+0000 7f262a84c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f26240adb10 con 0x7f26240c3e00 2024-09-10T08:29:02.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.698+0000 7f2628de9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26241500a0 0x7f2624154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.698+0000 7f2628de9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26241500a0 0x7f2624154ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49972/0 (socket says 172.21.15.103:49972) 2024-09-10T08:29:02.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.698+0000 7f2628de9640 1 -- 172.21.15.103:0/2359362833 learned_addr learned my addr 172.21.15.103:0/2359362833 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:02.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.699+0000 7f2628de9640 1 -- 172.21.15.103:0/2359362833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26240c3e00 msgr2=0x7f26241487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:02.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.699+0000 7f26237fe640 1 --2- 172.21.15.103:0/2359362833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26240c3e00 0x7f26241487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.699+0000 7f2623fff640 1 --2- 172.21.15.103:0/2359362833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f262406e650 0x7f26240a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.699+0000 7f2628de9640 1 --2- 172.21.15.103:0/2359362833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26240c3e00 0x7f26241487b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.699+0000 7f2628de9640 1 -- 172.21.15.103:0/2359362833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f262406e650 msgr2=0x7f26240a93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:02.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.699+0000 7f2628de9640 1 --2- 172.21.15.103:0/2359362833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f262406e650 0x7f26240a93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.699+0000 7f2628de9640 1 -- 172.21.15.103:0/2359362833 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26241e86f0 con 0x7f26241500a0 2024-09-10T08:29:02.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.699+0000 7f2628de9640 1 --2- 172.21.15.103:0/2359362833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26241500a0 0x7f2624154ac0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f261c00b9a0 tx=0x7f261c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:02.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.699+0000 7f2620ff9640 1 -- 172.21.15.103:0/2359362833 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261c01b070 con 0x7f26241500a0 2024-09-10T08:29:02.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.699+0000 7f2620ff9640 1 -- 172.21.15.103:0/2359362833 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f261c00edb0 con 0x7f26241500a0 2024-09-10T08:29:02.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.699+0000 7f262a84c640 1 -- 172.21.15.103:0/2359362833 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26240aa140 con 0x7f26241500a0 2024-09-10T08:29:02.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.699+0000 7f2620ff9640 1 -- 172.21.15.103:0/2359362833 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261c016680 con 0x7f26241500a0 2024-09-10T08:29:02.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.699+0000 7f262a84c640 1 -- 172.21.15.103:0/2359362833 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2624074250 con 0x7f26241500a0 2024-09-10T08:29:02.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.700+0000 7f2620ff9640 1 -- 172.21.15.103:0/2359362833 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f261c01e070 con 0x7f26241500a0 2024-09-10T08:29:02.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.701+0000 7f2620ff9640 1 --2- 172.21.15.103:0/2359362833 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f260406be60 0x7f260406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.701+0000 7f2620ff9640 1 -- 172.21.15.103:0/2359362833 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f261c08cec0 con 0x7f26241500a0 2024-09-10T08:29:02.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.701+0000 7f2623fff640 1 --2- 172.21.15.103:0/2359362833 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f260406be60 0x7f260406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.701+0000 7f2623fff640 1 --2- 172.21.15.103:0/2359362833 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f260406be60 0x7f260406e320 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2614006fd0 tx=0x7f2614008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:02.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.702+0000 7f262d5e4740 1 Processor -- start 2024-09-10T08:29:02.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.702+0000 7f262d5e4740 1 -- start start 2024-09-10T08:29:02.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.702+0000 7f262d5e4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560991d0a080 0x560991d43fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.702+0000 7f262d5e4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d0a460 0x560991d44d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.702+0000 7f262d5e4740 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x560991d45280 0x560991d06960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.702+0000 7f262d5e4740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560991c6b520 con 0x560991d0a460 2024-09-10T08:29:02.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.702+0000 7f262d5e4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560991c133e0 con 0x560991d0a080 2024-09-10T08:29:02.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.702+0000 7f262d5e4740 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x560991c674e0 con 0x560991d45280 2024-09-10T08:29:02.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.702+0000 7f26237fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d0a460 0x560991d44d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.703+0000 7f26237fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d0a460 0x560991d44d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49976/0 (socket says 172.21.15.103:49976) 2024-09-10T08:29:02.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.703+0000 7f26237fe640 1 -- 172.21.15.103:0/1845457000 learned_addr learned my addr 172.21.15.103:0/1845457000 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:02.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.703+0000 7f2623fff640 1 --2- 172.21.15.103:0/1845457000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560991d0a080 0x560991d43fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.703+0000 7f2628de9640 1 --2- 172.21.15.103:0/1845457000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x560991d45280 0x560991d06960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.703+0000 7f26237fe640 1 -- 172.21.15.103:0/1845457000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x560991d45280 msgr2=0x560991d06960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:02.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.703+0000 7f26237fe640 1 --2- 172.21.15.103:0/1845457000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x560991d45280 0x560991d06960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.703+0000 7f26237fe640 1 -- 172.21.15.103:0/1845457000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560991d0a080 msgr2=0x560991d43fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:02.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.703+0000 7f26237fe640 1 --2- 172.21.15.103:0/1845457000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560991d0a080 0x560991d43fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.703+0000 7f26237fe640 1 -- 172.21.15.103:0/1845457000 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560991c2e2f0 con 0x560991d0a460 2024-09-10T08:29:02.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.703+0000 7f2628de9640 1 --2- 172.21.15.103:0/1845457000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x560991d45280 0x560991d06960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:02.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.703+0000 7f26237fe640 1 --2- 172.21.15.103:0/1845457000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d0a460 0x560991d44d40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f260c000c00 tx=0x7f260c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a5124d04171753 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:02.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.703+0000 7f2619ffb640 1 -- 172.21.15.103:0/1845457000 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c040070 con 0x560991d0a460 2024-09-10T08:29:02.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.703+0000 7f2619ffb640 1 -- 172.21.15.103:0/1845457000 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f260c030910 con 0x560991d0a460 2024-09-10T08:29:02.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.703+0000 7f2619ffb640 1 -- 172.21.15.103:0/1845457000 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c030cc0 con 0x560991d0a460 2024-09-10T08:29:02.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.704+0000 7f262d5e4740 1 -- 172.21.15.103:0/1845457000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d0a460 msgr2=0x560991d44d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:02.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.704+0000 7f262d5e4740 1 --2- 172.21.15.103:0/1845457000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d0a460 0x560991d44d40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f260c000c00 tx=0x7f260c030000 comp rx=0 tx=0).stop 2024-09-10T08:29:02.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.704+0000 7f262d5e4740 1 -- 172.21.15.103:0/1845457000 shutdown_connections 2024-09-10T08:29:02.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.704+0000 7f262d5e4740 1 --2- 172.21.15.103:0/1845457000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x560991d45280 0x560991d06960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.704+0000 7f262d5e4740 1 --2- 172.21.15.103:0/1845457000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d0a460 0x560991d44d40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.704+0000 7f262d5e4740 1 --2- 172.21.15.103:0/1845457000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560991d0a080 0x560991d43fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.704+0000 7f262d5e4740 1 -- 172.21.15.103:0/1845457000 >> 172.21.15.103:0/1845457000 conn(0x560991d05960 msgr2=0x560991d09130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:02.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.704+0000 7f262d5e4740 1 -- 172.21.15.103:0/1845457000 shutdown_connections 2024-09-10T08:29:02.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.704+0000 7f262d5e4740 1 -- 172.21.15.103:0/1845457000 wait complete. 2024-09-10T08:29:02.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.704+0000 7f262d5e4740 1 -- start start 2024-09-10T08:29:02.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.704+0000 7f262d5e4740 1 Processor -- start 2024-09-10T08:29:02.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.705+0000 7f262d5e4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560991d0a460 0x560991d5d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.705+0000 7f262d5e4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d45280 0x560991d48830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.705+0000 7f262d5e4740 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x560991d598e0 0x560991d59d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.705+0000 7f262d5e4740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560991d43dc0 con 0x560991d45280 2024-09-10T08:29:02.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.705+0000 7f262d5e4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560991bf4450 con 0x560991d0a460 2024-09-10T08:29:02.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.705+0000 7f262d5e4740 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x560991d0a910 con 0x560991d598e0 2024-09-10T08:29:02.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.705+0000 7f262d5e4740 10 client.0 _ll_register_callbacks cb 0x56099197dac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:29:02.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.705+0000 7f26237fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d45280 0x560991d48830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.705+0000 7f26237fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d45280 0x560991d48830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49988/0 (socket says 172.21.15.103:49988) 2024-09-10T08:29:02.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.705+0000 7f26237fe640 1 -- 172.21.15.103:0/417059046 learned_addr learned my addr 172.21.15.103:0/417059046 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:02.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.705+0000 7f2623fff640 1 --2- 172.21.15.103:0/417059046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560991d0a460 0x560991d5d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.705+0000 7f2628de9640 1 --2- 172.21.15.103:0/417059046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x560991d598e0 0x560991d59d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.706+0000 7f26237fe640 1 -- 172.21.15.103:0/417059046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x560991d598e0 msgr2=0x560991d59d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:02.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.706+0000 7f26237fe640 1 --2- 172.21.15.103:0/417059046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x560991d598e0 0x560991d59d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.706+0000 7f26237fe640 1 -- 172.21.15.103:0/417059046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560991d0a460 msgr2=0x560991d5d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:02.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.706+0000 7f26237fe640 1 --2- 172.21.15.103:0/417059046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560991d0a460 0x560991d5d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.706+0000 7f26237fe640 1 -- 172.21.15.103:0/417059046 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56099197e2d0 con 0x560991d45280 2024-09-10T08:29:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.706+0000 7f26237fe640 1 --2- 172.21.15.103:0/417059046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d45280 0x560991d48830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f260c00a1c0 tx=0x7f260c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b3f7bc3bce80c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.706+0000 7f2602ffd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T08:29:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.706+0000 7f2602ffd640 1 -- 172.21.15.103:0/417059046 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c040070 con 0x560991d45280 2024-09-10T08:29:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.706+0000 7f2602ffd640 1 -- 172.21.15.103:0/417059046 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f260c003610 con 0x560991d45280 2024-09-10T08:29:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.706+0000 7f262d5e4740 1 -- 172.21.15.103:0/417059046 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f260c030910 con 0x560991d45280 2024-09-10T08:29:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.706+0000 7f2602ffd640 1 -- 172.21.15.103:0/417059046 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=11) ==== 24+0+0 (secure 0 0 0) 0x7f260c052050 con 0x560991d45280 2024-09-10T08:29:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.706+0000 7f262d5e4740 10 client.4737 fetch_fsmap learned FSMap version 11 2024-09-10T08:29:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.706+0000 7f262d5e4740 1 -- 172.21.15.103:0/417059046 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=11,monmap=2+}) -- 0x560991a486b0 con 0x560991d45280 2024-09-10T08:29:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.706+0000 7f2602ffd640 1 -- 172.21.15.103:0/417059046 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f260c030910 con 0x560991d45280 2024-09-10T08:29:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.706+0000 7f2602ffd640 1 -- 172.21.15.103:0/417059046 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 11) ==== 4136+0+0 (secure 0 0 0) 0x7f260c055020 con 0x560991d45280 2024-09-10T08:29:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.706+0000 7f262d5e4740 10 client.4737 fetch_fsmap finished waiting for FSMap version 11 2024-09-10T08:29:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.706+0000 7f262d5e4740 10 client.4737 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:29:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.706+0000 7f262d5e4740 20 client.4737 populate_metadata read hostname 'smithi103' 2024-09-10T08:29:02.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.706+0000 7f262d5e4740 1 --2- 172.21.15.103:0/417059046 >> [v2:172.21.15.103:6835/3032037784,v1:172.21.15.103:6837/3032037784] conn(0x560991d4e800 0x560991d4ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.706+0000 7f262d5e4740 4 client.4737 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:29:02.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.706+0000 7f262d5e4740 1 -- 172.21.15.103:0/417059046 --> [v2:172.21.15.103:6835/3032037784,v1:172.21.15.103:6837/3032037784] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560991c78c50 con 0x560991d4e800 2024-09-10T08:29:02.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.706+0000 7f2623fff640 1 --2- 172.21.15.103:0/417059046 >> [v2:172.21.15.103:6835/3032037784,v1:172.21.15.103:6837/3032037784] conn(0x560991d4e800 0x560991d4ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.707+0000 7f2602ffd640 10 client.4737 ms_handle_connect on v2:172.21.15.103:6835/3032037784 2024-09-10T08:29:02.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.707+0000 7f2623fff640 1 --2- 172.21.15.103:0/417059046 >> [v2:172.21.15.103:6835/3032037784,v1:172.21.15.103:6837/3032037784] conn(0x560991d4e800 0x560991d4ebe0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c98c974534334f0 server_cookie=4a5e4fe9c228e8e0 in_seq=0 out_seq=0 2024-09-10T08:29:02.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.707+0000 7f2602ffd640 1 -- 172.21.15.103:0/417059046 <== mds.0 v2:172.21.15.103:6835/3032037784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560991c78c50 con 0x560991d4e800 2024-09-10T08:29:02.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.707+0000 7f2602ffd640 10 client.4737 handle_command_reply: tid=0 2024-09-10T08:29:02.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.707+0000 7f262d5e4740 1 client.4737 shutdown 2024-09-10T08:29:02.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.708+0000 7f262d5e4740 1 -- 172.21.15.103:0/417059046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d45280 msgr2=0x560991d48830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:02.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.708+0000 7f262d5e4740 1 --2- 172.21.15.103:0/417059046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d45280 0x560991d48830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f260c00a1c0 tx=0x7f260c004730 comp rx=0 tx=0).stop 2024-09-10T08:29:02.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.708+0000 7f262d5e4740 1 -- 172.21.15.103:0/417059046 shutdown_connections 2024-09-10T08:29:02.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.708+0000 7f262d5e4740 1 --2- 172.21.15.103:0/417059046 >> [v2:172.21.15.103:6835/3032037784,v1:172.21.15.103:6837/3032037784] conn(0x560991d4e800 0x560991d4ebe0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.708+0000 7f262d5e4740 1 --2- 172.21.15.103:0/417059046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x560991d598e0 0x560991d59d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.708+0000 7f262d5e4740 1 --2- 172.21.15.103:0/417059046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d45280 0x560991d48830 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.708+0000 7f2602ffd640 0 client.4737 ms_handle_reset on v2:172.21.15.103:6835/3032037784 2024-09-10T08:29:02.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.708+0000 7f262d5e4740 1 --2- 172.21.15.103:0/417059046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560991d0a460 0x560991d5d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.708+0000 7f262d5e4740 1 -- 172.21.15.103:0/417059046 >> 172.21.15.103:0/417059046 conn(0x560991d0a080 msgr2=0x560991d088c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:02.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.708+0000 7f262d5e4740 1 -- 172.21.15.103:0/417059046 shutdown_connections 2024-09-10T08:29:02.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.708+0000 7f262d5e4740 1 -- 172.21.15.103:0/417059046 wait complete. 2024-09-10T08:29:02.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.708+0000 7f262d5e4740 20 client.4737 trim_cache size 0 max 16384 2024-09-10T08:29:02.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.726+0000 7f262d5e4740 1 Processor -- start 2024-09-10T08:29:02.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.726+0000 7f262d5e4740 1 -- start start 2024-09-10T08:29:02.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.726+0000 7f262d5e4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560991d0a460 0x560991d29860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.726+0000 7f262d5e4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d45280 0x560991d2c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.726+0000 7f262d5e4740 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x560991d598e0 0x560991d2ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.726+0000 7f262d5e4740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f26241f7720 con 0x560991d45280 2024-09-10T08:29:02.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.726+0000 7f262d5e4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26241ebae0 con 0x560991d0a460 2024-09-10T08:29:02.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.726+0000 7f262d5e4740 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f26241f5830 con 0x560991d598e0 2024-09-10T08:29:02.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.726+0000 7f26237fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d45280 0x560991d2c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.726+0000 7f26237fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d45280 0x560991d2c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49992/0 (socket says 172.21.15.103:49992) 2024-09-10T08:29:02.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.726+0000 7f26237fe640 1 -- 172.21.15.103:0/630396523 learned_addr learned my addr 172.21.15.103:0/630396523 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:02.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.726+0000 7f26237fe640 1 -- 172.21.15.103:0/630396523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x560991d598e0 msgr2=0x560991d2ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:02.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.726+0000 7f26237fe640 1 --2- 172.21.15.103:0/630396523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x560991d598e0 0x560991d2ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.726+0000 7f26237fe640 1 -- 172.21.15.103:0/630396523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560991d0a460 msgr2=0x560991d29860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:02.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.726+0000 7f26237fe640 1 --2- 172.21.15.103:0/630396523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560991d0a460 0x560991d29860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.726+0000 7f26237fe640 1 -- 172.21.15.103:0/630396523 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560991d5cd70 con 0x560991d45280 2024-09-10T08:29:02.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.727+0000 7f26237fe640 1 --2- 172.21.15.103:0/630396523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d45280 0x560991d2c540 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f260c02bd00 tx=0x7f260c00a350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a79ccd55b07c935 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:02.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.727+0000 7f26197fa640 1 -- 172.21.15.103:0/630396523 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c040040 con 0x560991d45280 2024-09-10T08:29:02.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.727+0000 7f26197fa640 1 -- 172.21.15.103:0/630396523 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f260c04a070 con 0x560991d45280 2024-09-10T08:29:02.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.727+0000 7f26197fa640 1 -- 172.21.15.103:0/630396523 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260c04d350 con 0x560991d45280 2024-09-10T08:29:02.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.727+0000 7f262d5e4740 1 -- 172.21.15.103:0/630396523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d45280 msgr2=0x560991d2c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:02.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.727+0000 7f262d5e4740 1 --2- 172.21.15.103:0/630396523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d45280 0x560991d2c540 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f260c02bd00 tx=0x7f260c00a350 comp rx=0 tx=0).stop 2024-09-10T08:29:02.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.727+0000 7f262d5e4740 1 -- 172.21.15.103:0/630396523 shutdown_connections 2024-09-10T08:29:02.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.727+0000 7f262d5e4740 1 --2- 172.21.15.103:0/630396523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x560991d598e0 0x560991d2ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.727+0000 7f262d5e4740 1 --2- 172.21.15.103:0/630396523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d45280 0x560991d2c540 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.727+0000 7f262d5e4740 1 --2- 172.21.15.103:0/630396523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560991d0a460 0x560991d29860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.727+0000 7f262d5e4740 1 -- 172.21.15.103:0/630396523 >> 172.21.15.103:0/630396523 conn(0x560991d0a080 msgr2=0x560991cfeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:02.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.727+0000 7f262d5e4740 1 -- 172.21.15.103:0/630396523 shutdown_connections 2024-09-10T08:29:02.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.727+0000 7f262d5e4740 1 -- 172.21.15.103:0/630396523 wait complete. 2024-09-10T08:29:02.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.728+0000 7f262d5e4740 1 -- start start 2024-09-10T08:29:02.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.728+0000 7f262d5e4740 1 Processor -- start 2024-09-10T08:29:02.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f262d5e4740 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x560991d0a460 0x560991dcaea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f262d5e4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560991d45280 0x560991d48410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f262d5e4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d598e0 0x560991d50bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f262d5e4740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560991d43dc0 con 0x560991d598e0 2024-09-10T08:29:02.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f262d5e4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560991bf4450 con 0x560991d45280 2024-09-10T08:29:02.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f262d5e4740 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x560991d4e0b0 con 0x560991d0a460 2024-09-10T08:29:02.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f262d5e4740 10 client.0 _ll_register_callbacks cb 0x7f260c03e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:29:02.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f2628de9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d598e0 0x560991d50bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f2628de9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d598e0 0x560991d50bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49998/0 (socket says 172.21.15.103:49998) 2024-09-10T08:29:02.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f2628de9640 1 -- 172.21.15.103:0/2253085066 learned_addr learned my addr 172.21.15.103:0/2253085066 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:02.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f2623fff640 1 --2- 172.21.15.103:0/2253085066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x560991d0a460 0x560991dcaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f26237fe640 1 --2- 172.21.15.103:0/2253085066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560991d45280 0x560991d48410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f2628de9640 1 -- 172.21.15.103:0/2253085066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x560991d0a460 msgr2=0x560991dcaea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:02.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f2628de9640 1 --2- 172.21.15.103:0/2253085066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x560991d0a460 0x560991dcaea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f2628de9640 1 -- 172.21.15.103:0/2253085066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560991d45280 msgr2=0x560991d48410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:02.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f2628de9640 1 --2- 172.21.15.103:0/2253085066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560991d45280 0x560991d48410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f2628de9640 1 -- 172.21.15.103:0/2253085066 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560991d643f0 con 0x560991d598e0 2024-09-10T08:29:02.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f2623fff640 1 --2- 172.21.15.103:0/2253085066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x560991d0a460 0x560991dcaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:02.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f26237fe640 1 --2- 172.21.15.103:0/2253085066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560991d45280 0x560991d48410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:02.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f2628de9640 1 --2- 172.21.15.103:0/2253085066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d598e0 0x560991d50bf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f261c08b0c0 tx=0x7f261c05af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d02e869fffb336 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:02.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f2602ffd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T08:29:02.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f2602ffd640 1 -- 172.21.15.103:0/2253085066 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261c063820 con 0x560991d598e0 2024-09-10T08:29:02.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f2602ffd640 1 -- 172.21.15.103:0/2253085066 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f261c05a320 con 0x560991d598e0 2024-09-10T08:29:02.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f262d5e4740 1 -- 172.21.15.103:0/2253085066 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f260c04a070 con 0x560991d598e0 2024-09-10T08:29:02.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.729+0000 7f2602ffd640 1 -- 172.21.15.103:0/2253085066 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=11) ==== 24+0+0 (secure 0 0 0) 0x7f261c05a520 con 0x560991d598e0 2024-09-10T08:29:02.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.730+0000 7f262d5e4740 10 client.4743 fetch_fsmap learned FSMap version 11 2024-09-10T08:29:02.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.730+0000 7f262d5e4740 1 -- 172.21.15.103:0/2253085066 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=11,monmap=2+}) -- 0x560991d48950 con 0x560991d598e0 2024-09-10T08:29:02.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.730+0000 7f2602ffd640 1 -- 172.21.15.103:0/2253085066 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f260c04a070 con 0x560991d598e0 2024-09-10T08:29:02.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.730+0000 7f2602ffd640 1 -- 172.21.15.103:0/2253085066 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 11) ==== 4136+0+0 (secure 0 0 0) 0x7f261c056c20 con 0x560991d598e0 2024-09-10T08:29:02.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.730+0000 7f262d5e4740 10 client.4743 fetch_fsmap finished waiting for FSMap version 11 2024-09-10T08:29:02.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.730+0000 7f262d5e4740 10 client.4743 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:29:02.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.730+0000 7f262d5e4740 20 client.4743 populate_metadata read hostname 'smithi103' 2024-09-10T08:29:02.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.730+0000 7f262d5e4740 1 --2- 172.21.15.103:0/2253085066 >> [v2:172.21.15.103:6835/3032037784,v1:172.21.15.103:6837/3032037784] conn(0x560991d517f0 0x560991dc4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.730+0000 7f262d5e4740 4 client.4743 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:29:02.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.730+0000 7f262d5e4740 1 -- 172.21.15.103:0/2253085066 --> [v2:172.21.15.103:6835/3032037784,v1:172.21.15.103:6837/3032037784] -- command(tid 0: {"prefix": "status"}) -- 0x560991c72fa0 con 0x560991d517f0 2024-09-10T08:29:02.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.730+0000 7f2623fff640 1 --2- 172.21.15.103:0/2253085066 >> [v2:172.21.15.103:6835/3032037784,v1:172.21.15.103:6837/3032037784] conn(0x560991d517f0 0x560991dc4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.730+0000 7f2623fff640 1 -- 172.21.15.103:0/2253085066 >> [v2:172.21.15.103:6835/3032037784,v1:172.21.15.103:6837/3032037784] conn(0x560991d517f0 msgr2=0x560991dc4790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-09-10T08:29:02.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.730+0000 7f2623fff640 1 -- 172.21.15.103:0/2253085066 >> [v2:172.21.15.103:6835/3032037784,v1:172.21.15.103:6837/3032037784] conn(0x560991d517f0 msgr2=0x560991dc4790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:29:02.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.730+0000 7f2623fff640 1 --2- 172.21.15.103:0/2253085066 >> [v2:172.21.15.103:6835/3032037784,v1:172.21.15.103:6837/3032037784] conn(0x560991d517f0 0x560991dc4790 crc :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:29:02.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.730+0000 7f2623fff640 1 --2- 172.21.15.103:0/2253085066 >> [v2:172.21.15.103:6835/3032037784,v1:172.21.15.103:6837/3032037784] conn(0x560991d517f0 0x560991dc4790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:29:02.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.931+0000 7f2623fff640 1 --2- 172.21.15.103:0/2253085066 >> [v2:172.21.15.103:6835/3032037784,v1:172.21.15.103:6837/3032037784] conn(0x560991d517f0 0x560991dc4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.931+0000 7f2623fff640 1 --2- 172.21.15.103:0/2253085066 >> [v2:172.21.15.103:6835/3032037784,v1:172.21.15.103:6837/3032037784] conn(0x560991d517f0 0x560991dc4790 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=987ade01f3219a87 server_cookie=d12debccf6f37750 in_seq=0 out_seq=0 2024-09-10T08:29:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.931+0000 7f2602ffd640 10 client.4743 ms_handle_connect on v2:172.21.15.103:6835/3032037784 2024-09-10T08:29:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.931+0000 7f2602ffd640 1 -- 172.21.15.103:0/2253085066 <== mds.0 v2:172.21.15.103:6835/3032037784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x560991c72fa0 con 0x560991d517f0 2024-09-10T08:29:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.931+0000 7f2602ffd640 10 client.4743 handle_command_reply: tid=0 2024-09-10T08:29:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.931+0000 7f262d5e4740 1 client.4743 shutdown 2024-09-10T08:29:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.931+0000 7f262d5e4740 1 -- 172.21.15.103:0/2253085066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d598e0 msgr2=0x560991d50bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.931+0000 7f262d5e4740 1 --2- 172.21.15.103:0/2253085066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d598e0 0x560991d50bf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f261c08b0c0 tx=0x7f261c05af90 comp rx=0 tx=0).stop 2024-09-10T08:29:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.931+0000 7f262d5e4740 1 -- 172.21.15.103:0/2253085066 shutdown_connections 2024-09-10T08:29:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.931+0000 7f262d5e4740 1 --2- 172.21.15.103:0/2253085066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560991d598e0 0x560991d50bf0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.931+0000 7f262d5e4740 1 --2- 172.21.15.103:0/2253085066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560991d45280 0x560991d48410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.931+0000 7f262d5e4740 1 --2- 172.21.15.103:0/2253085066 >> [v2:172.21.15.103:6835/3032037784,v1:172.21.15.103:6837/3032037784] conn(0x560991d517f0 0x560991dc4790 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.931+0000 7f262d5e4740 1 --2- 172.21.15.103:0/2253085066 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x560991d0a460 0x560991dcaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.931+0000 7f2602ffd640 0 client.4743 ms_handle_reset on v2:172.21.15.103:6835/3032037784 2024-09-10T08:29:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.931+0000 7f262d5e4740 1 -- 172.21.15.103:0/2253085066 >> 172.21.15.103:0/2253085066 conn(0x560991d0a080 msgr2=0x560991d02930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.931+0000 7f262d5e4740 1 -- 172.21.15.103:0/2253085066 shutdown_connections 2024-09-10T08:29:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.931+0000 7f262d5e4740 1 -- 172.21.15.103:0/2253085066 wait complete. 2024-09-10T08:29:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.931+0000 7f262d5e4740 20 client.4743 trim_cache size 0 max 16384 2024-09-10T08:29:02.934 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:29:02.934 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:29:02.934 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-10T08:29:02.935 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4284, 2024-09-10T08:29:02.935 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T08:29:02.935 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T08:29:02.935 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "a", 2024-09-10T08:29:02.935 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 27.367721913, 2024-09-10T08:29:02.935 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 7, 2024-09-10T08:29:02.935 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 25, 2024-09-10T08:29:02.935 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 21, 2024-09-10T08:29:02.935 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 32.631863997000004 2024-09-10T08:29:02.935 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:29:02.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.932+0000 7f262a84c640 1 -- 172.21.15.103:0/2359362833 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f260406be60 msgr2=0x7f260406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:02.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.932+0000 7f262a84c640 1 --2- 172.21.15.103:0/2359362833 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f260406be60 0x7f260406e320 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2614006fd0 tx=0x7f2614008040 comp rx=0 tx=0).stop 2024-09-10T08:29:02.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.932+0000 7f262a84c640 1 -- 172.21.15.103:0/2359362833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26241500a0 msgr2=0x7f2624154ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:02.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.932+0000 7f262a84c640 1 --2- 172.21.15.103:0/2359362833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26241500a0 0x7f2624154ac0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f261c00b9a0 tx=0x7f261c00be60 comp rx=0 tx=0).stop 2024-09-10T08:29:02.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.932+0000 7f262a84c640 1 -- 172.21.15.103:0/2359362833 shutdown_connections 2024-09-10T08:29:02.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.932+0000 7f262a84c640 1 --2- 172.21.15.103:0/2359362833 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f260406be60 0x7f260406e320 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.932+0000 7f262a84c640 1 --2- 172.21.15.103:0/2359362833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26241500a0 0x7f2624154ac0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.932+0000 7f262a84c640 1 --2- 172.21.15.103:0/2359362833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26240c3e00 0x7f26241487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.932+0000 7f262a84c640 1 --2- 172.21.15.103:0/2359362833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f262406e650 0x7f26240a93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.932+0000 7f262a84c640 1 -- 172.21.15.103:0/2359362833 >> 172.21.15.103:0/2359362833 conn(0x7f26240c7a40 msgr2=0x7f26240c2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:02.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.932+0000 7f262a84c640 1 -- 172.21.15.103:0/2359362833 shutdown_connections 2024-09-10T08:29:02.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:02.932+0000 7f262a84c640 1 -- 172.21.15.103:0/2359362833 wait complete. 2024-09-10T08:29:02.943 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:29:03.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.041+0000 7f7d91f4b640 1 Processor -- start 2024-09-10T08:29:03.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.041+0000 7f7d91f4b640 1 -- start start 2024-09-10T08:29:03.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.042+0000 7f7d91f4b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7d8c1578b0 0x7f7d8c1513f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.042+0000 7f7d91f4b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d8c0c9860 0x7f7d8c151930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.042+0000 7f7d91f4b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7d8c157c90 0x7f7d8c0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.042+0000 7f7d91f4b640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f7d8c073f90 con 0x7f7d8c1578b0 2024-09-10T08:29:03.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.042+0000 7f7d91f4b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f7d8c158280 con 0x7f7d8c157c90 2024-09-10T08:29:03.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.042+0000 7f7d91f4b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7d8c0741e0 con 0x7f7d8c0c9860 2024-09-10T08:29:03.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.042+0000 7f7d8b7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7d8c1578b0 0x7f7d8c1513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.042+0000 7f7d8b7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7d8c1578b0 0x7f7d8c1513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50006/0 (socket says 172.21.15.103:50006) 2024-09-10T08:29:03.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.042+0000 7f7d8b7fe640 1 -- 172.21.15.103:0/2446076979 learned_addr learned my addr 172.21.15.103:0/2446076979 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:03.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.042+0000 7f7d8affd640 1 --2- 172.21.15.103:0/2446076979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d8c0c9860 0x7f7d8c151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.042+0000 7f7d8b7fe640 1 -- 172.21.15.103:0/2446076979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d8c0c9860 msgr2=0x7f7d8c151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:03.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.042+0000 7f7d8bfff640 1 --2- 172.21.15.103:0/2446076979 >> v2:172.21.15.154:3300/0 conn(0x7f7d8c157c90 0x7f7d8c0c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.042+0000 7f7d8b7fe640 1 --2- 172.21.15.103:0/2446076979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d8c0c9860 0x7f7d8c151930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.042+0000 7f7d8b7fe640 1 -- 172.21.15.103:0/2446076979 >> v2:172.21.15.154:3300/0 conn(0x7f7d8c157c90 msgr2=0x7f7d8c0c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:03.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.042+0000 7f7d8b7fe640 1 --2- 172.21.15.103:0/2446076979 >> v2:172.21.15.154:3300/0 conn(0x7f7d8c157c90 0x7f7d8c0c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.042+0000 7f7d8b7fe640 1 -- 172.21.15.103:0/2446076979 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c0c4820 con 0x7f7d8c1578b0 2024-09-10T08:29:03.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.043+0000 7f7d8b7fe640 1 --2- 172.21.15.103:0/2446076979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d8c1578b0 0x7f7d8c1513f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0761c0 tx=0x7f7d7c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3729724fa77ab702 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:03.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.043+0000 7f7d8a7fc640 1 -- 172.21.15.103:0/2446076979 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c037070 con 0x7f7d8c1578b0 2024-09-10T08:29:03.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.043+0000 7f7d8a7fc640 1 -- 172.21.15.103:0/2446076979 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d7c02ae00 con 0x7f7d8c1578b0 2024-09-10T08:29:03.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.043+0000 7f7d8a7fc640 1 -- 172.21.15.103:0/2446076979 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c032660 con 0x7f7d8c1578b0 2024-09-10T08:29:03.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.044+0000 7f7d91f4b640 1 -- 172.21.15.103:0/2446076979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d8c1578b0 msgr2=0x7f7d8c1513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:03.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.044+0000 7f7d91f4b640 1 --2- 172.21.15.103:0/2446076979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d8c1578b0 0x7f7d8c1513f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0761c0 tx=0x7f7d7c02a0b0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.044+0000 7f7d91f4b640 1 -- 172.21.15.103:0/2446076979 shutdown_connections 2024-09-10T08:29:03.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.044+0000 7f7d91f4b640 1 --2- 172.21.15.103:0/2446076979 >> v2:172.21.15.154:3300/0 conn(0x7f7d8c157c90 0x7f7d8c0c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.044+0000 7f7d91f4b640 1 --2- 172.21.15.103:0/2446076979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d8c0c9860 0x7f7d8c151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.044+0000 7f7d91f4b640 1 --2- 172.21.15.103:0/2446076979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d8c1578b0 0x7f7d8c1513f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.044+0000 7f7d91f4b640 1 -- 172.21.15.103:0/2446076979 >> 172.21.15.103:0/2446076979 conn(0x7f7d8c0c6880 msgr2=0x7f7d8c0c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:03.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.044+0000 7f7d91f4b640 1 -- 172.21.15.103:0/2446076979 shutdown_connections 2024-09-10T08:29:03.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.044+0000 7f7d91f4b640 1 -- 172.21.15.103:0/2446076979 wait complete. 2024-09-10T08:29:03.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.045+0000 7f7d91f4b640 1 Processor -- start 2024-09-10T08:29:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.045+0000 7f7d91f4b640 1 -- start start 2024-09-10T08:29:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d91f4b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d8c0c9860 0x7f7d8c1df160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d91f4b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c1578b0 0x7f7d8c1507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d91f4b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d8c157c90 0x7f7d8c072f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d91f4b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c0afeb0 con 0x7f7d8c0c9860 2024-09-10T08:29:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d91f4b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c0afd30 con 0x7f7d8c1578b0 2024-09-10T08:29:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d91f4b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7d8c0c7550 con 0x7f7d8c157c90 2024-09-10T08:29:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d8b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d8c0c9860 0x7f7d8c1df160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d8b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d8c0c9860 0x7f7d8c1df160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50020/0 (socket says 172.21.15.103:50020) 2024-09-10T08:29:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d8b7fe640 1 -- 172.21.15.103:0/864858755 learned_addr learned my addr 172.21.15.103:0/864858755 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d8affd640 1 --2- 172.21.15.103:0/864858755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c1578b0 0x7f7d8c1507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d8bfff640 1 --2- 172.21.15.103:0/864858755 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d8c157c90 0x7f7d8c072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d8b7fe640 1 -- 172.21.15.103:0/864858755 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d8c157c90 msgr2=0x7f7d8c072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d8b7fe640 1 --2- 172.21.15.103:0/864858755 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d8c157c90 0x7f7d8c072f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d8b7fe640 1 -- 172.21.15.103:0/864858755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c1578b0 msgr2=0x7f7d8c1507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d8b7fe640 1 --2- 172.21.15.103:0/864858755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c1578b0 0x7f7d8c1507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d8b7fe640 1 -- 172.21.15.103:0/864858755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c1407c0 con 0x7f7d8c0c9860 2024-09-10T08:29:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d8affd640 1 --2- 172.21.15.103:0/864858755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c1578b0 0x7f7d8c1507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d8b7fe640 1 --2- 172.21.15.103:0/864858755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d8c0c9860 0x7f7d8c1df160 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c000c00 tx=0x7f7d7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d73fff640 1 -- 172.21.15.103:0/864858755 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c041030 con 0x7f7d8c0c9860 2024-09-10T08:29:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d73fff640 1 -- 172.21.15.103:0/864858755 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d7c03c670 con 0x7f7d8c0c9860 2024-09-10T08:29:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d73fff640 1 -- 172.21.15.103:0/864858755 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c037040 con 0x7f7d8c0c9860 2024-09-10T08:29:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d91f4b640 1 -- 172.21.15.103:0/864858755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d8c1dd8c0 con 0x7f7d8c0c9860 2024-09-10T08:29:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.046+0000 7f7d91f4b640 1 -- 172.21.15.103:0/864858755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d8c150ce0 con 0x7f7d8c0c9860 2024-09-10T08:29:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.048+0000 7f7d91f4b640 1 -- 172.21.15.103:0/864858755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d8c1dd6b0 con 0x7f7d8c0c9860 2024-09-10T08:29:03.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.048+0000 7f7d73fff640 1 -- 172.21.15.103:0/864858755 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d7c044070 con 0x7f7d8c0c9860 2024-09-10T08:29:03.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.048+0000 7f7d73fff640 1 --2- 172.21.15.103:0/864858755 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7d7806be60 0x7f7d7806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.048+0000 7f7d73fff640 1 -- 172.21.15.103:0/864858755 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f7d7c0ab420 con 0x7f7d8c0c9860 2024-09-10T08:29:03.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.048+0000 7f7d8affd640 1 --2- 172.21.15.103:0/864858755 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7d7806be60 0x7f7d7806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.049+0000 7f7d8affd640 1 --2- 172.21.15.103:0/864858755 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7d7806be60 0x7f7d7806e320 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0c4770 tx=0x7f7d80008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:03.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.053+0000 7f7d73fff640 1 -- 172.21.15.103:0/864858755 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7d7c04b070 con 0x7f7d8c0c9860 2024-09-10T08:29:03.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.251+0000 7f7d91f4b640 1 -- 172.21.15.103:0/864858755 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d8c1513f0 con 0x7f7d8c0c9860 2024-09-10T08:29:03.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.252+0000 7f7d73fff640 1 -- 172.21.15.103:0/864858755 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6536 (secure 0 0 0) 0x7f7d7c044e40 con 0x7f7d8c0c9860 2024-09-10T08:29:03.253 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:29:03.253 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":11,"btime":"2024-09-10T08:28:50:632324+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3378269214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3378269214},{"type":"v1","addr":"172.21.15.154:6833","nonce":3378269214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2141115327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2141115327},{"type":"v1","addr":"172.21.15.154:6835","nonce":2141115327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:34.885455+0000","modified":"2024-09-10T08:28:37.905202+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/3032037784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":3032037784},{"type":"v1","addr":"172.21.15.103:6837","nonce":3032037784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:46.949092+0000","modified":"2024-09-10T08:28:49.966725+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.103:6836/2250136134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2250136134},{"type":"v1","addr":"172.21.15.103:6836","nonce":2250136134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":2}]} 2024-09-10T08:29:03.253 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 11 2024-09-10T08:29:03.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.254+0000 7f7d91f4b640 1 -- 172.21.15.103:0/864858755 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7d7806be60 msgr2=0x7f7d7806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:03.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.254+0000 7f7d91f4b640 1 --2- 172.21.15.103:0/864858755 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7d7806be60 0x7f7d7806e320 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0c4770 tx=0x7f7d80008040 comp rx=0 tx=0).stop 2024-09-10T08:29:03.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.254+0000 7f7d91f4b640 1 -- 172.21.15.103:0/864858755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d8c0c9860 msgr2=0x7f7d8c1df160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:03.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.254+0000 7f7d91f4b640 1 --2- 172.21.15.103:0/864858755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d8c0c9860 0x7f7d8c1df160 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c000c00 tx=0x7f7d7c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.254+0000 7f7d91f4b640 1 -- 172.21.15.103:0/864858755 shutdown_connections 2024-09-10T08:29:03.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.254+0000 7f7d91f4b640 1 --2- 172.21.15.103:0/864858755 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7d7806be60 0x7f7d7806e320 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.254+0000 7f7d91f4b640 1 --2- 172.21.15.103:0/864858755 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d8c157c90 0x7f7d8c072f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.254+0000 7f7d91f4b640 1 --2- 172.21.15.103:0/864858755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c1578b0 0x7f7d8c1507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.254+0000 7f7d91f4b640 1 --2- 172.21.15.103:0/864858755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d8c0c9860 0x7f7d8c1df160 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.254+0000 7f7d91f4b640 1 -- 172.21.15.103:0/864858755 >> 172.21.15.103:0/864858755 conn(0x7f7d8c0c6880 msgr2=0x7f7d8c06ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:03.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.254+0000 7f7d91f4b640 1 -- 172.21.15.103:0/864858755 shutdown_connections 2024-09-10T08:29:03.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.254+0000 7f7d91f4b640 1 -- 172.21.15.103:0/864858755 wait complete. 2024-09-10T08:29:03.265 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:29:03.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.364+0000 7efd85fbe640 1 Processor -- start 2024-09-10T08:29:03.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.364+0000 7efd85fbe640 1 -- start start 2024-09-10T08:29:03.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.365+0000 7efd85fbe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd80153af0 0x7efd801563a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.365+0000 7efd85fbe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efd800afdd0 0x7efd800c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.365+0000 7efd85fbe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efd800af870 0x7efd800c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.365+0000 7efd85fbe640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7efd800c54e0 con 0x7efd800afdd0 2024-09-10T08:29:03.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.365+0000 7efd85fbe640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7efd800c74a0 con 0x7efd800af870 2024-09-10T08:29:03.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.365+0000 7efd85fbe640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7efd800c7740 con 0x7efd80153af0 2024-09-10T08:29:03.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.365+0000 7efd7effd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efd800afdd0 0x7efd800c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.365+0000 7efd7effd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efd800afdd0 0x7efd800c5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50036/0 (socket says 172.21.15.103:50036) 2024-09-10T08:29:03.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.365+0000 7efd7effd640 1 -- 172.21.15.103:0/3371187815 learned_addr learned my addr 172.21.15.103:0/3371187815 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:03.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.365+0000 7efd7ffff640 1 --2- 172.21.15.103:0/3371187815 >> v2:172.21.15.154:3300/0 conn(0x7efd800af870 0x7efd800c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.365+0000 7efd7effd640 1 -- 172.21.15.103:0/3371187815 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd80153af0 msgr2=0x7efd801563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:03.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.365+0000 7efd7f7fe640 1 --2- 172.21.15.103:0/3371187815 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd80153af0 0x7efd801563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.365+0000 7efd7effd640 1 --2- 172.21.15.103:0/3371187815 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd80153af0 0x7efd801563a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.365+0000 7efd7effd640 1 -- 172.21.15.103:0/3371187815 >> v2:172.21.15.154:3300/0 conn(0x7efd800af870 msgr2=0x7efd800c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:03.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.365+0000 7efd7effd640 1 --2- 172.21.15.103:0/3371187815 >> v2:172.21.15.154:3300/0 conn(0x7efd800af870 0x7efd800c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.365+0000 7efd7effd640 1 -- 172.21.15.103:0/3371187815 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8015a3c0 con 0x7efd800afdd0 2024-09-10T08:29:03.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.365+0000 7efd7ffff640 1 --2- 172.21.15.103:0/3371187815 >> v2:172.21.15.154:3300/0 conn(0x7efd800af870 0x7efd800c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:03.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.366+0000 7efd7effd640 1 --2- 172.21.15.103:0/3371187815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd800afdd0 0x7efd800c5900 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efd80072c20 tx=0x7efd7402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d47d052d65d62bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:03.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.366+0000 7efd7e7fc640 1 -- 172.21.15.103:0/3371187815 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd74037070 con 0x7efd800afdd0 2024-09-10T08:29:03.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.366+0000 7efd7e7fc640 1 -- 172.21.15.103:0/3371187815 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd74032440 con 0x7efd800afdd0 2024-09-10T08:29:03.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.366+0000 7efd7e7fc640 1 -- 172.21.15.103:0/3371187815 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd74032810 con 0x7efd800afdd0 2024-09-10T08:29:03.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.367+0000 7efd85fbe640 1 -- 172.21.15.103:0/3371187815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd800afdd0 msgr2=0x7efd800c5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:03.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.367+0000 7efd85fbe640 1 --2- 172.21.15.103:0/3371187815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd800afdd0 0x7efd800c5900 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efd80072c20 tx=0x7efd7402a140 comp rx=0 tx=0).stop 2024-09-10T08:29:03.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.367+0000 7efd85fbe640 1 -- 172.21.15.103:0/3371187815 shutdown_connections 2024-09-10T08:29:03.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.367+0000 7efd85fbe640 1 --2- 172.21.15.103:0/3371187815 >> v2:172.21.15.154:3300/0 conn(0x7efd800af870 0x7efd800c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.367+0000 7efd85fbe640 1 --2- 172.21.15.103:0/3371187815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd800afdd0 0x7efd800c5900 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.367+0000 7efd85fbe640 1 --2- 172.21.15.103:0/3371187815 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd80153af0 0x7efd801563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.367+0000 7efd85fbe640 1 -- 172.21.15.103:0/3371187815 >> 172.21.15.103:0/3371187815 conn(0x7efd800c6880 msgr2=0x7efd800c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:03.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.367+0000 7efd85fbe640 1 -- 172.21.15.103:0/3371187815 shutdown_connections 2024-09-10T08:29:03.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.367+0000 7efd85fbe640 1 -- 172.21.15.103:0/3371187815 wait complete. 2024-09-10T08:29:03.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.368+0000 7efd85fbe640 1 Processor -- start 2024-09-10T08:29:03.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.368+0000 7efd85fbe640 1 -- start start 2024-09-10T08:29:03.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.369+0000 7efd85fbe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd800af870 0x7efd8014f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.369+0000 7efd85fbe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd800afdd0 0x7efd80157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.369+0000 7efd85fbe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd80153af0 0x7efd80158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.369+0000 7efd85fbe640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efd80153ed0 con 0x7efd80153af0 2024-09-10T08:29:03.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.369+0000 7efd85fbe640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efd800c5e40 con 0x7efd800afdd0 2024-09-10T08:29:03.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.369+0000 7efd85fbe640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7efd80154050 con 0x7efd800af870 2024-09-10T08:29:03.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.369+0000 7efd7ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd80153af0 0x7efd80158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.369+0000 7efd7ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd80153af0 0x7efd80158130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50042/0 (socket says 172.21.15.103:50042) 2024-09-10T08:29:03.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.369+0000 7efd7ffff640 1 -- 172.21.15.103:0/1812063487 learned_addr learned my addr 172.21.15.103:0/1812063487 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:03.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.369+0000 7efd7effd640 1 --2- 172.21.15.103:0/1812063487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd800afdd0 0x7efd80157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.369+0000 7efd7f7fe640 1 --2- 172.21.15.103:0/1812063487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd800af870 0x7efd8014f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.369+0000 7efd7ffff640 1 -- 172.21.15.103:0/1812063487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd800af870 msgr2=0x7efd8014f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:03.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.369+0000 7efd7ffff640 1 --2- 172.21.15.103:0/1812063487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd800af870 0x7efd8014f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.369+0000 7efd7ffff640 1 -- 172.21.15.103:0/1812063487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd800afdd0 msgr2=0x7efd80157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:03.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.369+0000 7efd7ffff640 1 --2- 172.21.15.103:0/1812063487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd800afdd0 0x7efd80157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.369+0000 7efd7ffff640 1 -- 172.21.15.103:0/1812063487 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd801e2900 con 0x7efd80153af0 2024-09-10T08:29:03.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.369+0000 7efd7f7fe640 1 --2- 172.21.15.103:0/1812063487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd800af870 0x7efd8014f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:03.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.369+0000 7efd7ffff640 1 --2- 172.21.15.103:0/1812063487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd80153af0 0x7efd80158130 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efd7800cd10 tx=0x7efd7800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:03.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.370+0000 7efd67fff640 1 -- 172.21.15.103:0/1812063487 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7800f680 con 0x7efd80153af0 2024-09-10T08:29:03.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.370+0000 7efd67fff640 1 -- 172.21.15.103:0/1812063487 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd7800f840 con 0x7efd80153af0 2024-09-10T08:29:03.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.370+0000 7efd85fbe640 1 -- 172.21.15.103:0/1812063487 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd8014deb0 con 0x7efd80153af0 2024-09-10T08:29:03.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.370+0000 7efd67fff640 1 -- 172.21.15.103:0/1812063487 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7800fc30 con 0x7efd80153af0 2024-09-10T08:29:03.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.370+0000 7efd85fbe640 1 -- 172.21.15.103:0/1812063487 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd8014e470 con 0x7efd80153af0 2024-09-10T08:29:03.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.371+0000 7efd85fbe640 1 -- 172.21.15.103:0/1812063487 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd800c6c60 con 0x7efd80153af0 2024-09-10T08:29:03.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.371+0000 7efd67fff640 1 -- 172.21.15.103:0/1812063487 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd780213f0 con 0x7efd80153af0 2024-09-10T08:29:03.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.371+0000 7efd67fff640 1 --2- 172.21.15.103:0/1812063487 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efd6c06be30 0x7efd6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.372+0000 7efd7f7fe640 1 --2- 172.21.15.103:0/1812063487 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efd6c06be30 0x7efd6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.372+0000 7efd67fff640 1 -- 172.21.15.103:0/1812063487 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7efd7808be20 con 0x7efd80153af0 2024-09-10T08:29:03.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.372+0000 7efd7f7fe640 1 --2- 172.21.15.103:0/1812063487 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efd6c06be30 0x7efd6c06e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efd8014d340 tx=0x7efd70008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:03.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.376+0000 7efd67fff640 1 -- 172.21.15.103:0/1812063487 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efd800c6c60 con 0x7efd80153af0 2024-09-10T08:29:03.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.541+0000 7efd85fbe640 1 -- 172.21.15.103:0/1812063487 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd800c3e80 con 0x7efd80153af0 2024-09-10T08:29:03.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.542+0000 7efd67fff640 1 -- 172.21.15.103:0/1812063487 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20499 (secure 0 0 0) 0x7efd78014030 con 0x7efd80153af0 2024-09-10T08:29:03.542 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:29:03.542 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","created":"2024-09-10T08:28:12.654957+0000","modified":"2024-09-10T08:28:48.615871+0000","last_up_change":"2024-09-10T08:28:25.445753+0000","last_in_change":"2024-09-10T08:28:14.741133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:24.821696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-10T08:28:33.488154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-10T08:28:33.857868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-10T08:28:44.793084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-10T08:28:45.930823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1abe08f4-0348-435e-9f97-cec00e96992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6809","nonce":2707863099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6811","nonce":2707863099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6815","nonce":2707863099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6813","nonce":2707863099}]},"public_addr":"172.21.15.103:6809/2707863099","cluster_addr":"172.21.15.103:6811/2707863099","heartbeat_back_addr":"172.21.15.103:6815/2707863099","heartbeat_front_addr":"172.21.15.103:6813/2707863099","state":["exists","up"]},{"osd":1,"uuid":"df342e58-1026-4739-82f6-7a216707444c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6818","nonce":4029892782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6822","nonce":4029892782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6830","nonce":4029892782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6826","nonce":4029892782}]},"public_addr":"172.21.15.103:6818/4029892782","cluster_addr":"172.21.15.103:6822/4029892782","heartbeat_back_addr":"172.21.15.103:6830/4029892782","heartbeat_front_addr":"172.21.15.103:6826/4029892782","state":["exists","up"]},{"osd":2,"uuid":"f7aea2cf-208c-41ed-a0f6-8948d70b9a0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6819","nonce":428484432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6821","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6823","nonce":428484432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6829","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6831","nonce":428484432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6825","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6827","nonce":428484432}]},"public_addr":"172.21.15.103:6819/428484432","cluster_addr":"172.21.15.103:6823/428484432","heartbeat_back_addr":"172.21.15.103:6831/428484432","heartbeat_front_addr":"172.21.15.103:6827/428484432","state":["exists","up"]},{"osd":3,"uuid":"615ef8b0-12a5-4503-96d0-f7ec17dbc792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6801","nonce":3453676282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6803","nonce":3453676282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6807","nonce":3453676282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6805","nonce":3453676282}]},"public_addr":"172.21.15.103:6801/3453676282","cluster_addr":"172.21.15.103:6803/3453676282","heartbeat_back_addr":"172.21.15.103:6807/3453676282","heartbeat_front_addr":"172.21.15.103:6805/3453676282","state":["exists","up"]},{"osd":4,"uuid":"644c5e94-db18-4b83-b5cd-3762ae2647a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6809","nonce":1808157069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6811","nonce":1808157069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6815","nonce":1808157069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6813","nonce":1808157069}]},"public_addr":"172.21.15.154:6809/1808157069","cluster_addr":"172.21.15.154:6811/1808157069","heartbeat_back_addr":"172.21.15.154:6815/1808157069","heartbeat_front_addr":"172.21.15.154:6813/1808157069","state":["exists","up"]},{"osd":5,"uuid":"f40210bd-f4ca-442e-baac-729ced5a9f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6817","nonce":1048015779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6819","nonce":1048015779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6823","nonce":1048015779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6821","nonce":1048015779}]},"public_addr":"172.21.15.154:6817/1048015779","cluster_addr":"172.21.15.154:6819/1048015779","heartbeat_back_addr":"172.21.15.154:6823/1048015779","heartbeat_front_addr":"172.21.15.154:6821/1048015779","state":["exists","up"]},{"osd":6,"uuid":"eebac31e-aaef-47b0-90d7-4af08f36d7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6801","nonce":345273812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6803","nonce":345273812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6807","nonce":345273812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6805","nonce":345273812}]},"public_addr":"172.21.15.154:6801/345273812","cluster_addr":"172.21.15.154:6803/345273812","heartbeat_back_addr":"172.21.15.154:6807/345273812","heartbeat_front_addr":"172.21.15.154:6805/345273812","state":["exists","up"]},{"osd":7,"uuid":"58406c9a-036f-4618-bfb6-0beddbd71605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6825","nonce":3439481239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6827","nonce":3439481239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6831","nonce":3439481239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6829","nonce":3439481239}]},"public_addr":"172.21.15.154:6825/3439481239","cluster_addr":"172.21.15.154:6827/3439481239","heartbeat_back_addr":"172.21.15.154:6831/3439481239","heartbeat_front_addr":"172.21.15.154:6829/3439481239","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.032718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.126448+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.781158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.808718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.050591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.038245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.586989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.223326+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:29:03.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.544+0000 7efd85fbe640 1 -- 172.21.15.103:0/1812063487 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efd6c06be30 msgr2=0x7efd6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:03.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.544+0000 7efd85fbe640 1 --2- 172.21.15.103:0/1812063487 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efd6c06be30 0x7efd6c06e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efd8014d340 tx=0x7efd70008040 comp rx=0 tx=0).stop 2024-09-10T08:29:03.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.544+0000 7efd85fbe640 1 -- 172.21.15.103:0/1812063487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd80153af0 msgr2=0x7efd80158130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:03.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.544+0000 7efd85fbe640 1 --2- 172.21.15.103:0/1812063487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd80153af0 0x7efd80158130 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efd7800cd10 tx=0x7efd7800a650 comp rx=0 tx=0).stop 2024-09-10T08:29:03.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.544+0000 7efd85fbe640 1 -- 172.21.15.103:0/1812063487 shutdown_connections 2024-09-10T08:29:03.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.544+0000 7efd85fbe640 1 --2- 172.21.15.103:0/1812063487 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efd6c06be30 0x7efd6c06e2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.544+0000 7efd85fbe640 1 --2- 172.21.15.103:0/1812063487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd80153af0 0x7efd80158130 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.544+0000 7efd85fbe640 1 --2- 172.21.15.103:0/1812063487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd800afdd0 0x7efd80157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.544+0000 7efd85fbe640 1 --2- 172.21.15.103:0/1812063487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd800af870 0x7efd8014f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.544+0000 7efd85fbe640 1 -- 172.21.15.103:0/1812063487 >> 172.21.15.103:0/1812063487 conn(0x7efd800c6880 msgr2=0x7efd8006fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:03.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.545+0000 7efd85fbe640 1 -- 172.21.15.103:0/1812063487 shutdown_connections 2024-09-10T08:29:03.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.545+0000 7efd85fbe640 1 -- 172.21.15.103:0/1812063487 wait complete. 2024-09-10T08:29:03.556 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:29:03.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.658+0000 7f851940e640 1 Processor -- start 2024-09-10T08:29:03.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.658+0000 7f851940e640 1 -- start start 2024-09-10T08:29:03.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.659+0000 7f851940e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8514153910 0x7f85140c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.659+0000 7f851940e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8514153d60 con 0x7f85140c69c0 2024-09-10T08:29:03.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.659+0000 7f851940e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85140c5940 con 0x7f85141505f0 2024-09-10T08:29:03.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.659+0000 7f851940e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f85140c7860 con 0x7f8514153910 2024-09-10T08:29:03.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.659+0000 7f85137fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8514153910 0x7f85140c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.659+0000 7f850a7fc640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f85140c69c0 0x7f85140c42b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50218/0 (socket says 172.21.15.103:50218) 2024-09-10T08:29:03.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.659+0000 7f850a7fc640 1 -- 172.21.15.103:0/897405526 learned_addr learned my addr 172.21.15.103:0/897405526 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:29:03.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.659+0000 7f85137fe640 1 -- 172.21.15.103:0/897405526 >> v1:172.21.15.154:6789/0 conn(0x7f85141505f0 legacy=0x7f85140c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:03.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.659+0000 7f85137fe640 1 -- 172.21.15.103:0/897405526 >> v1:172.21.15.103:6789/0 conn(0x7f85140c69c0 legacy=0x7f85140c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:03.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.659+0000 7f85137fe640 1 -- 172.21.15.103:0/897405526 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85140c5c00 con 0x7f8514153910 2024-09-10T08:29:03.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.659+0000 7f85127fc640 1 -- 172.21.15.103:0/897405526 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2105086174 0 0) 0x7f8514153d60 con 0x7f85140c69c0 2024-09-10T08:29:03.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.660+0000 7f85137fe640 1 --2- 172.21.15.103:0/897405526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8514153910 0x7f85140c49c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f850c009d90 tx=0x7f850c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec04b58a2245dc1f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:03.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.660+0000 7f85127fc640 1 -- 172.21.15.103:0/897405526 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c007740 con 0x7f8514153910 2024-09-10T08:29:03.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.660+0000 7f85127fc640 1 -- 172.21.15.103:0/897405526 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f850c0078e0 con 0x7f8514153910 2024-09-10T08:29:03.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.660+0000 7f85127fc640 1 -- 172.21.15.103:0/897405526 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c007cb0 con 0x7f8514153910 2024-09-10T08:29:03.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.661+0000 7f851940e640 1 -- 172.21.15.103:0/897405526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8514153910 msgr2=0x7f85140c49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:03.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.661+0000 7f851940e640 1 --2- 172.21.15.103:0/897405526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8514153910 0x7f85140c49c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f850c009d90 tx=0x7f850c02a660 comp rx=0 tx=0).stop 2024-09-10T08:29:03.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.661+0000 7f851940e640 1 -- 172.21.15.103:0/897405526 shutdown_connections 2024-09-10T08:29:03.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.661+0000 7f851940e640 1 --2- 172.21.15.103:0/897405526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8514153910 0x7f85140c49c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.661+0000 7f851940e640 1 -- 172.21.15.103:0/897405526 >> 172.21.15.103:0/897405526 conn(0x7f85140c7a40 msgr2=0x7f85140c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:03.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.661+0000 7f851940e640 1 -- 172.21.15.103:0/897405526 shutdown_connections 2024-09-10T08:29:03.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.661+0000 7f851940e640 1 -- 172.21.15.103:0/897405526 wait complete. 2024-09-10T08:29:03.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.662+0000 7f851940e640 1 Processor -- start 2024-09-10T08:29:03.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.662+0000 7f851940e640 1 -- start start 2024-09-10T08:29:03.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f851940e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85141505f0 0x7f8514152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f851940e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8514153910 0x7f85141efb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f851940e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8514150e00 0x7f85141f00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f851940e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f85140c64a0 con 0x7f85141505f0 2024-09-10T08:29:03.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f851940e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f85140c61c0 con 0x7f8514150e00 2024-09-10T08:29:03.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f851940e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f85141509d0 con 0x7f8514153910 2024-09-10T08:29:03.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f8512ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85141505f0 0x7f8514152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f8512ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85141505f0 0x7f8514152730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50070/0 (socket says 172.21.15.103:50070) 2024-09-10T08:29:03.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f8512ffd640 1 -- 172.21.15.103:0/73784878 learned_addr learned my addr 172.21.15.103:0/73784878 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:03.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f85137fe640 1 --2- 172.21.15.103:0/73784878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8514150e00 0x7f85141f00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f850a7fc640 1 --2- 172.21.15.103:0/73784878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8514153910 0x7f85141efb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f8512ffd640 1 -- 172.21.15.103:0/73784878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8514153910 msgr2=0x7f85141efb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:03.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f8512ffd640 1 --2- 172.21.15.103:0/73784878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8514153910 0x7f85141efb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f8512ffd640 1 -- 172.21.15.103:0/73784878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8514150e00 msgr2=0x7f85141f00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:03.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f8512ffd640 1 --2- 172.21.15.103:0/73784878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8514150e00 0x7f85141f00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f8512ffd640 1 -- 172.21.15.103:0/73784878 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8514151e00 con 0x7f85141505f0 2024-09-10T08:29:03.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f85137fe640 1 --2- 172.21.15.103:0/73784878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8514150e00 0x7f85141f00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:03.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f850a7fc640 1 --2- 172.21.15.103:0/73784878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8514153910 0x7f85141efb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:03.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f8512ffd640 1 --2- 172.21.15.103:0/73784878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85141505f0 0x7f8514152730 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f850400c480 tx=0x7f850400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:03.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f850bfff640 1 -- 172.21.15.103:0/73784878 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85040052d0 con 0x7f85141505f0 2024-09-10T08:29:03.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f850bfff640 1 -- 172.21.15.103:0/73784878 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8504005470 con 0x7f85141505f0 2024-09-10T08:29:03.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f851940e640 1 -- 172.21.15.103:0/73784878 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85140ada50 con 0x7f85141505f0 2024-09-10T08:29:03.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f850bfff640 1 -- 172.21.15.103:0/73784878 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8504012870 con 0x7f85141505f0 2024-09-10T08:29:03.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.663+0000 7f851940e640 1 -- 172.21.15.103:0/73784878 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8514148c70 con 0x7f85141505f0 2024-09-10T08:29:03.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.664+0000 7f851940e640 1 -- 172.21.15.103:0/73784878 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85140c2440 con 0x7f85141505f0 2024-09-10T08:29:03.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.665+0000 7f850bfff640 1 -- 172.21.15.103:0/73784878 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8504012a10 con 0x7f85141505f0 2024-09-10T08:29:03.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.665+0000 7f850bfff640 1 --2- 172.21.15.103:0/73784878 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f84f406be60 0x7f84f406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.665+0000 7f850bfff640 1 -- 172.21.15.103:0/73784878 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f850408adc0 con 0x7f85141505f0 2024-09-10T08:29:03.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.665+0000 7f850a7fc640 1 --2- 172.21.15.103:0/73784878 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f84f406be60 0x7f84f406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.666+0000 7f850a7fc640 1 --2- 172.21.15.103:0/73784878 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f84f406be60 0x7f84f406e320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f85140adcb0 tx=0x7f84fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:03.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.670+0000 7f850bfff640 1 -- 172.21.15.103:0/73784878 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f85040594d0 con 0x7f85141505f0 2024-09-10T08:29:03.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.869+0000 7f851940e640 1 -- 172.21.15.103:0/73784878 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85140c4ee0 con 0x7f85141505f0 2024-09-10T08:29:03.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.870+0000 7f850bfff640 1 -- 172.21.15.103:0/73784878 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6536 (secure 0 0 0) 0x7f8504058dd0 con 0x7f85141505f0 2024-09-10T08:29:03.870 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:29:03.870 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":11,"btime":"2024-09-10T08:28:50:632324+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3378269214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3378269214},{"type":"v1","addr":"172.21.15.154:6833","nonce":3378269214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2141115327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2141115327},{"type":"v1","addr":"172.21.15.154:6835","nonce":2141115327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:34.885455+0000","modified":"2024-09-10T08:28:37.905202+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/3032037784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":3032037784},{"type":"v1","addr":"172.21.15.103:6837","nonce":3032037784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:46.949092+0000","modified":"2024-09-10T08:28:49.966725+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.103:6836/2250136134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2250136134},{"type":"v1","addr":"172.21.15.103:6836","nonce":2250136134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":2}]} 2024-09-10T08:29:03.870 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 11 2024-09-10T08:29:03.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.872+0000 7f851940e640 1 -- 172.21.15.103:0/73784878 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f84f406be60 msgr2=0x7f84f406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:03.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.872+0000 7f851940e640 1 --2- 172.21.15.103:0/73784878 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f84f406be60 0x7f84f406e320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f85140adcb0 tx=0x7f84fc009040 comp rx=0 tx=0).stop 2024-09-10T08:29:03.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.872+0000 7f851940e640 1 -- 172.21.15.103:0/73784878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85141505f0 msgr2=0x7f8514152730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:03.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.872+0000 7f851940e640 1 --2- 172.21.15.103:0/73784878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85141505f0 0x7f8514152730 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f850400c480 tx=0x7f850400c940 comp rx=0 tx=0).stop 2024-09-10T08:29:03.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.872+0000 7f851940e640 1 -- 172.21.15.103:0/73784878 shutdown_connections 2024-09-10T08:29:03.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.872+0000 7f851940e640 1 --2- 172.21.15.103:0/73784878 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f84f406be60 0x7f84f406e320 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.872+0000 7f851940e640 1 --2- 172.21.15.103:0/73784878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8514150e00 0x7f85141f00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.872+0000 7f851940e640 1 --2- 172.21.15.103:0/73784878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8514153910 0x7f85141efb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.872+0000 7f851940e640 1 --2- 172.21.15.103:0/73784878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85141505f0 0x7f8514152730 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.872+0000 7f851940e640 1 -- 172.21.15.103:0/73784878 >> 172.21.15.103:0/73784878 conn(0x7f85140c7a40 msgr2=0x7f851414cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:03.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.872+0000 7f851940e640 1 -- 172.21.15.103:0/73784878 shutdown_connections 2024-09-10T08:29:03.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:03.872+0000 7f851940e640 1 -- 172.21.15.103:0/73784878 wait complete. 2024-09-10T08:29:04.286 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:28:46.949092+0000', 'modified': '2024-09-10T08:28:49.966725+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'a', 'rank': 0, 'incarnation': 8, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.103:6836/2250136134', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6834', 'nonce': 2250136134}, {'type': 'v1', 'addr': '172.21.15.103:6836', 'nonce': 2250136134}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'b', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4281, 'qdb_cluster': [4281]} 2024-09-10T08:29:04.286 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:29:04.286 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T08:29:04.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.386+0000 7f59026e4640 1 Processor -- start 2024-09-10T08:29:04.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.386+0000 7f59026e4640 1 -- start start 2024-09-10T08:29:04.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.387+0000 7f59026e4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f58fc0733d0 0x7f58fc156840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:04.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.387+0000 7f59026e4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58fc06dd50 con 0x7f58fc073ae0 2024-09-10T08:29:04.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.387+0000 7f59026e4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58fc06e030 con 0x7f58fc06d850 2024-09-10T08:29:04.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.387+0000 7f59026e4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f58fc06e310 con 0x7f58fc0733d0 2024-09-10T08:29:04.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.387+0000 7f58fbfff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f58fc073ae0 0x7f58fc153380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50224/0 (socket says 172.21.15.103:50224) 2024-09-10T08:29:04.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.387+0000 7f58fbfff640 1 -- 172.21.15.103:0/2368769615 learned_addr learned my addr 172.21.15.103:0/2368769615 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:29:04.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.387+0000 7f58faffd640 1 -- 172.21.15.103:0/2368769615 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2766113046 0 0) 0x7f58fc06dd50 con 0x7f58fc073ae0 2024-09-10T08:29:04.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f58faffd640 1 -- 172.21.15.103:0/2368769615 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58e4003520 con 0x7f58fc073ae0 2024-09-10T08:29:04.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f58fb7fe640 1 --2- 172.21.15.103:0/2368769615 >> v2:172.21.15.154:3300/0 conn(0x7f58fc0733d0 0x7f58fc156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:04.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f58faffd640 1 -- 172.21.15.103:0/2368769615 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1388791043 0 0) 0x7f58e4003520 con 0x7f58fc073ae0 2024-09-10T08:29:04.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f58faffd640 1 -- 172.21.15.103:0/2368769615 >> v2:172.21.15.154:3300/0 conn(0x7f58fc0733d0 msgr2=0x7f58fc156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:04.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f58faffd640 1 --2- 172.21.15.103:0/2368769615 >> v2:172.21.15.154:3300/0 conn(0x7f58fc0733d0 0x7f58fc156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f58faffd640 1 -- 172.21.15.103:0/2368769615 >> v1:172.21.15.154:6789/0 conn(0x7f58fc06d850 legacy=0x7f58fc160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:04.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f58faffd640 1 -- 172.21.15.103:0/2368769615 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58fc06e5f0 con 0x7f58fc073ae0 2024-09-10T08:29:04.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f58faffd640 1 -- 172.21.15.103:0/2368769615 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f58ec001670 con 0x7f58fc073ae0 2024-09-10T08:29:04.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f58faffd640 1 -- 172.21.15.103:0/2368769615 >> v1:172.21.15.103:6789/0 conn(0x7f58fc073ae0 legacy=0x7f58fc153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:04.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f58faffd640 1 --2- 172.21.15.103:0/2368769615 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58e40039b0 0x7f58e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:04.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f58faffd640 1 --2- 172.21.15.103:0/2368769615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58e4004800 0x7f58e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:04.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f58faffd640 1 --2- 172.21.15.103:0/2368769615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58e40051c0 0x7f58e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:04.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f58faffd640 1 -- 172.21.15.103:0/2368769615 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc06e310 con 0x7f58e40051c0 2024-09-10T08:29:04.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f58faffd640 1 -- 172.21.15.103:0/2368769615 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f58e400c110 con 0x7f58e4004800 2024-09-10T08:29:04.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f58faffd640 1 -- 172.21.15.103:0/2368769615 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f58e400c310 con 0x7f58e40039b0 2024-09-10T08:29:04.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f5900c81640 1 --2- 172.21.15.103:0/2368769615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58e40051c0 0x7f58e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:04.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f58fb7fe640 1 --2- 172.21.15.103:0/2368769615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58e4004800 0x7f58e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:04.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f58fbfff640 1 --2- 172.21.15.103:0/2368769615 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58e40039b0 0x7f58e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:04.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f5900c81640 1 -- 172.21.15.103:0/2368769615 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58e40039b0 msgr2=0x7f58e4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:04.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f5900c81640 1 --2- 172.21.15.103:0/2368769615 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58e40039b0 0x7f58e4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f5900c81640 1 -- 172.21.15.103:0/2368769615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58e4004800 msgr2=0x7f58e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:04.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f5900c81640 1 --2- 172.21.15.103:0/2368769615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58e4004800 0x7f58e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.388+0000 7f5900c81640 1 -- 172.21.15.103:0/2368769615 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e4003520 con 0x7f58e40051c0 2024-09-10T08:29:04.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.389+0000 7f5900c81640 1 -- 172.21.15.103:0/2368769615 reap_dead start 2024-09-10T08:29:04.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.389+0000 7f5900c81640 1 --2- 172.21.15.103:0/2368769615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58e40051c0 0x7f58e400b9c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f58f4001e20 tx=0x7f58e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353c732d526b129 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:04.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.389+0000 7f58faffd640 1 -- 172.21.15.103:0/2368769615 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f4001a70 con 0x7f58e40051c0 2024-09-10T08:29:04.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.389+0000 7f58faffd640 1 -- 172.21.15.103:0/2368769615 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f402ae40 con 0x7f58e40051c0 2024-09-10T08:29:04.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.389+0000 7f58faffd640 1 -- 172.21.15.103:0/2368769615 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f4003bb0 con 0x7f58e40051c0 2024-09-10T08:29:04.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.390+0000 7f59026e4640 1 -- 172.21.15.103:0/2368769615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58e40051c0 msgr2=0x7f58e400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:04.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.390+0000 7f59026e4640 1 --2- 172.21.15.103:0/2368769615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58e40051c0 0x7f58e400b9c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f58f4001e20 tx=0x7f58e4005830 comp rx=0 tx=0).stop 2024-09-10T08:29:04.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.390+0000 7f59026e4640 1 -- 172.21.15.103:0/2368769615 shutdown_connections 2024-09-10T08:29:04.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.390+0000 7f59026e4640 1 --2- 172.21.15.103:0/2368769615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58e40051c0 0x7f58e400b9c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.390+0000 7f59026e4640 1 -- 172.21.15.103:0/2368769615 >> 172.21.15.103:0/2368769615 conn(0x7f58fc0c9d80 msgr2=0x7f58fc0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:04.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.390+0000 7f59026e4640 1 -- 172.21.15.103:0/2368769615 shutdown_connections 2024-09-10T08:29:04.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.390+0000 7f59026e4640 1 -- 172.21.15.103:0/2368769615 wait complete. 2024-09-10T08:29:04.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.391+0000 7f59026e4640 1 Processor -- start 2024-09-10T08:29:04.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.391+0000 7f59026e4640 1 -- start start 2024-09-10T08:29:04.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.392+0000 7f59026e4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58e40051c0 0x7f58fc14f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:04.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.392+0000 7f59026e4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58fc157600 0x7f58fc1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:04.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.392+0000 7f59026e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58fc14d890 0x7f58fc159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:04.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.392+0000 7f59026e4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc06edd0 con 0x7f58fc157600 2024-09-10T08:29:04.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.392+0000 7f59026e4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc06ec50 con 0x7f58fc14d890 2024-09-10T08:29:04.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.392+0000 7f59026e4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f58fc073ec0 con 0x7f58e40051c0 2024-09-10T08:29:04.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.392+0000 7f58fb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58fc157600 0x7f58fc1520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:04.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.392+0000 7f58fb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58fc157600 0x7f58fc1520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50096/0 (socket says 172.21.15.103:50096) 2024-09-10T08:29:04.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.392+0000 7f58fb7fe640 1 -- 172.21.15.103:0/1319087285 learned_addr learned my addr 172.21.15.103:0/1319087285 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:04.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.392+0000 7f58fbfff640 1 --2- 172.21.15.103:0/1319087285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58e40051c0 0x7f58fc14f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:04.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.392+0000 7f5900c81640 1 --2- 172.21.15.103:0/1319087285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58fc14d890 0x7f58fc159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:04.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.392+0000 7f58fb7fe640 1 -- 172.21.15.103:0/1319087285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58e40051c0 msgr2=0x7f58fc14f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:04.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.392+0000 7f58fb7fe640 1 --2- 172.21.15.103:0/1319087285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58e40051c0 0x7f58fc14f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.392+0000 7f58fb7fe640 1 -- 172.21.15.103:0/1319087285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58fc14d890 msgr2=0x7f58fc159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:04.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.392+0000 7f58fb7fe640 1 --2- 172.21.15.103:0/1319087285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58fc14d890 0x7f58fc159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.392+0000 7f58fb7fe640 1 -- 172.21.15.103:0/1319087285 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58fc14e340 con 0x7f58fc157600 2024-09-10T08:29:04.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.392+0000 7f58fb7fe640 1 --2- 172.21.15.103:0/1319087285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58fc157600 0x7f58fc1520d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f58f000b5c0 tx=0x7f58f000b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:04.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.392+0000 7f58f8ff9640 1 -- 172.21.15.103:0/1319087285 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f0018070 con 0x7f58fc157600 2024-09-10T08:29:04.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.392+0000 7f58f8ff9640 1 -- 172.21.15.103:0/1319087285 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f0014640 con 0x7f58fc157600 2024-09-10T08:29:04.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.392+0000 7f59026e4640 1 -- 172.21.15.103:0/1319087285 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58fc14e620 con 0x7f58fc157600 2024-09-10T08:29:04.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.392+0000 7f58f8ff9640 1 -- 172.21.15.103:0/1319087285 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f0014a10 con 0x7f58fc157600 2024-09-10T08:29:04.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.392+0000 7f59026e4640 1 -- 172.21.15.103:0/1319087285 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58fc1596e0 con 0x7f58fc157600 2024-09-10T08:29:04.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.394+0000 7f58f8ff9640 1 -- 172.21.15.103:0/1319087285 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f58f001b070 con 0x7f58fc157600 2024-09-10T08:29:04.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.394+0000 7f58f8ff9640 1 --2- 172.21.15.103:0/1319087285 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f58e806be30 0x7f58e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:04.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.394+0000 7f58fbfff640 1 --2- 172.21.15.103:0/1319087285 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f58e806be30 0x7f58e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:04.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.394+0000 7f58f8ff9640 1 -- 172.21.15.103:0/1319087285 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f58f008b480 con 0x7f58fc157600 2024-09-10T08:29:04.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.395+0000 7f58fbfff640 1 --2- 172.21.15.103:0/1319087285 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f58e806be30 0x7f58e806e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f58fc159090 tx=0x7f58ec0078f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:04.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.395+0000 7f5905485740 1 Processor -- start 2024-09-10T08:29:04.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.395+0000 7f5905485740 1 -- start start 2024-09-10T08:29:04.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.396+0000 7f5905485740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd70c08080 0x55fd70c06980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:04.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.396+0000 7f5905485740 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55fd70c42a60 0x55fd70c08460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:04.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.396+0000 7f5905485740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c41720 0x55fd70c04960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:04.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.396+0000 7f5905485740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55fd70b69520 con 0x55fd70c41720 2024-09-10T08:29:04.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.396+0000 7f5905485740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fd70b113e0 con 0x55fd70c08080 2024-09-10T08:29:04.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.396+0000 7f5905485740 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x55fd70b654e0 con 0x55fd70c42a60 2024-09-10T08:29:04.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.396+0000 7f5900c81640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c41720 0x55fd70c04960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:04.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.396+0000 7f5900c81640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c41720 0x55fd70c04960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50102/0 (socket says 172.21.15.103:50102) 2024-09-10T08:29:04.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.396+0000 7f5900c81640 1 -- 172.21.15.103:0/944750531 learned_addr learned my addr 172.21.15.103:0/944750531 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:04.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.396+0000 7f58fbfff640 1 --2- 172.21.15.103:0/944750531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd70c08080 0x55fd70c06980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:04.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.396+0000 7f58fb7fe640 1 --2- 172.21.15.103:0/944750531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55fd70c42a60 0x55fd70c08460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:04.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.396+0000 7f5900c81640 1 -- 172.21.15.103:0/944750531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55fd70c42a60 msgr2=0x55fd70c08460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:04.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.396+0000 7f5900c81640 1 --2- 172.21.15.103:0/944750531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55fd70c42a60 0x55fd70c08460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.396+0000 7f5900c81640 1 -- 172.21.15.103:0/944750531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd70c08080 msgr2=0x55fd70c06980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:04.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.396+0000 7f5900c81640 1 --2- 172.21.15.103:0/944750531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd70c08080 0x55fd70c06980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.396+0000 7f5900c81640 1 -- 172.21.15.103:0/944750531 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd70b2c2f0 con 0x55fd70c41720 2024-09-10T08:29:04.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.396+0000 7f5900c81640 1 --2- 172.21.15.103:0/944750531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c41720 0x55fd70c04960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f58f4005040 tx=0x7f58f402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31018f06f6a4a297 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:04.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.397+0000 7f58e1ffb640 1 -- 172.21.15.103:0/944750531 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f4003970 con 0x55fd70c41720 2024-09-10T08:29:04.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.397+0000 7f58e1ffb640 1 -- 172.21.15.103:0/944750531 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f4003b10 con 0x55fd70c41720 2024-09-10T08:29:04.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.397+0000 7f58e1ffb640 1 -- 172.21.15.103:0/944750531 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f40050d0 con 0x55fd70c41720 2024-09-10T08:29:04.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.397+0000 7f5905485740 1 -- 172.21.15.103:0/944750531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c41720 msgr2=0x55fd70c04960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:04.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.397+0000 7f5905485740 1 --2- 172.21.15.103:0/944750531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c41720 0x55fd70c04960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f58f4005040 tx=0x7f58f402c000 comp rx=0 tx=0).stop 2024-09-10T08:29:04.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.397+0000 7f5905485740 1 -- 172.21.15.103:0/944750531 shutdown_connections 2024-09-10T08:29:04.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.397+0000 7f5905485740 1 --2- 172.21.15.103:0/944750531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c41720 0x55fd70c04960 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.397+0000 7f5905485740 1 --2- 172.21.15.103:0/944750531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55fd70c42a60 0x55fd70c08460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.397+0000 7f5905485740 1 --2- 172.21.15.103:0/944750531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd70c08080 0x55fd70c06980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.397+0000 7f5905485740 1 -- 172.21.15.103:0/944750531 >> 172.21.15.103:0/944750531 conn(0x55fd70c03960 msgr2=0x55fd70c07130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:04.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.397+0000 7f5905485740 1 -- 172.21.15.103:0/944750531 shutdown_connections 2024-09-10T08:29:04.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.397+0000 7f5905485740 1 -- 172.21.15.103:0/944750531 wait complete. 2024-09-10T08:29:04.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.398+0000 7f5905485740 1 -- start start 2024-09-10T08:29:04.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.398+0000 7f5905485740 1 Processor -- start 2024-09-10T08:29:04.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.399+0000 7f5905485740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c41720 0x55fd70c1def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:04.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.399+0000 7f5905485740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd70c42a60 0x55fd70c45060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:04.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.399+0000 7f5905485740 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55fd70c455a0 0x55fd70c44210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:04.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.399+0000 7f5905485740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55fd70c089a0 con 0x55fd70c41720 2024-09-10T08:29:04.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.399+0000 7f5905485740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fd70af2450 con 0x55fd70c42a60 2024-09-10T08:29:04.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.399+0000 7f5905485740 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x55fd70c05bc0 con 0x55fd70c455a0 2024-09-10T08:29:04.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.399+0000 7f5905485740 10 client.0 _ll_register_callbacks cb 0x55fd7087bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:29:04.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.399+0000 7f58fbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c41720 0x55fd70c1def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:04.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.399+0000 7f58fbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c41720 0x55fd70c1def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50108/0 (socket says 172.21.15.103:50108) 2024-09-10T08:29:04.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.399+0000 7f58fbfff640 1 -- 172.21.15.103:0/1319797084 learned_addr learned my addr 172.21.15.103:0/1319797084 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:04.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.399+0000 7f58fb7fe640 1 --2- 172.21.15.103:0/1319797084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd70c42a60 0x55fd70c45060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:04.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.399+0000 7f5900c81640 1 --2- 172.21.15.103:0/1319797084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55fd70c455a0 0x55fd70c44210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:04.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.399+0000 7f58fbfff640 1 -- 172.21.15.103:0/1319797084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55fd70c455a0 msgr2=0x55fd70c44210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:04.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.399+0000 7f58fbfff640 1 --2- 172.21.15.103:0/1319797084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55fd70c455a0 0x55fd70c44210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.399+0000 7f58fbfff640 1 -- 172.21.15.103:0/1319797084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd70c42a60 msgr2=0x55fd70c45060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:04.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.399+0000 7f58fbfff640 1 --2- 172.21.15.103:0/1319797084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd70c42a60 0x55fd70c45060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.399+0000 7f58fbfff640 1 -- 172.21.15.103:0/1319797084 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd7087c2d0 con 0x55fd70c41720 2024-09-10T08:29:04.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.399+0000 7f58fbfff640 1 --2- 172.21.15.103:0/1319797084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c41720 0x55fd70c1def0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0159d0 tx=0x7f58fc06e200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3acb54fd0b44c7bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:04.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.399+0000 7f58daffd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T08:29:04.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.399+0000 7f58daffd640 1 -- 172.21.15.103:0/1319797084 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec022670 con 0x55fd70c41720 2024-09-10T08:29:04.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.399+0000 7f58daffd640 1 -- 172.21.15.103:0/1319797084 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f58ec022810 con 0x55fd70c41720 2024-09-10T08:29:04.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.399+0000 7f5905485740 1 -- 172.21.15.103:0/1319797084 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58f4003b10 con 0x55fd70c41720 2024-09-10T08:29:04.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.400+0000 7f58daffd640 1 -- 172.21.15.103:0/1319797084 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=11) ==== 24+0+0 (secure 0 0 0) 0x7f58ec030050 con 0x55fd70c41720 2024-09-10T08:29:04.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.400+0000 7f5905485740 10 client.4776 fetch_fsmap learned FSMap version 11 2024-09-10T08:29:04.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.400+0000 7f5905485740 1 -- 172.21.15.103:0/1319797084 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=11,monmap=2+}) -- 0x55fd709466b0 con 0x55fd70c41720 2024-09-10T08:29:04.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.400+0000 7f58daffd640 1 -- 172.21.15.103:0/1319797084 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f4003b10 con 0x55fd70c41720 2024-09-10T08:29:04.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.400+0000 7f58daffd640 1 -- 172.21.15.103:0/1319797084 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 11) ==== 4136+0+0 (secure 0 0 0) 0x7f58ec033020 con 0x55fd70c41720 2024-09-10T08:29:04.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.400+0000 7f5905485740 10 client.4776 fetch_fsmap finished waiting for FSMap version 11 2024-09-10T08:29:04.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.400+0000 7f5905485740 10 client.4776 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:29:04.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.400+0000 7f5905485740 20 client.4776 populate_metadata read hostname 'smithi103' 2024-09-10T08:29:04.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.400+0000 7f5905485740 1 --2- 172.21.15.103:0/1319797084 >> [v2:172.21.15.103:6834/2250136134,v1:172.21.15.103:6836/2250136134] conn(0x55fd70c563b0 0x55fd70c56790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:04.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.400+0000 7f5905485740 4 client.4776 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:29:04.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.400+0000 7f5905485740 1 -- 172.21.15.103:0/1319797084 --> [v2:172.21.15.103:6834/2250136134,v1:172.21.15.103:6836/2250136134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd70b76c50 con 0x55fd70c563b0 2024-09-10T08:29:04.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.400+0000 7f58fb7fe640 1 --2- 172.21.15.103:0/1319797084 >> [v2:172.21.15.103:6834/2250136134,v1:172.21.15.103:6836/2250136134] conn(0x55fd70c563b0 0x55fd70c56790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:04.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.400+0000 7f58daffd640 10 client.4776 ms_handle_connect on v2:172.21.15.103:6834/2250136134 2024-09-10T08:29:04.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.400+0000 7f58fb7fe640 1 --2- 172.21.15.103:0/1319797084 >> [v2:172.21.15.103:6834/2250136134,v1:172.21.15.103:6836/2250136134] conn(0x55fd70c563b0 0x55fd70c56790 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb5ebad803024e01 server_cookie=38cece963f7f7893 in_seq=0 out_seq=0 2024-09-10T08:29:04.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.401+0000 7f58daffd640 1 -- 172.21.15.103:0/1319797084 <== mds.0 v2:172.21.15.103:6834/2250136134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fd70b76c50 con 0x55fd70c563b0 2024-09-10T08:29:04.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.401+0000 7f58daffd640 10 client.4776 handle_command_reply: tid=0 2024-09-10T08:29:04.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.401+0000 7f5905485740 1 client.4776 shutdown 2024-09-10T08:29:04.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.401+0000 7f5905485740 1 -- 172.21.15.103:0/1319797084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c41720 msgr2=0x55fd70c1def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:04.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.401+0000 7f5905485740 1 --2- 172.21.15.103:0/1319797084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c41720 0x55fd70c1def0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0159d0 tx=0x7f58fc06e200 comp rx=0 tx=0).stop 2024-09-10T08:29:04.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.401+0000 7f5905485740 1 -- 172.21.15.103:0/1319797084 shutdown_connections 2024-09-10T08:29:04.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.401+0000 7f5905485740 1 --2- 172.21.15.103:0/1319797084 >> [v2:172.21.15.103:6834/2250136134,v1:172.21.15.103:6836/2250136134] conn(0x55fd70c563b0 0x55fd70c56790 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.401+0000 7f5905485740 1 --2- 172.21.15.103:0/1319797084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55fd70c455a0 0x55fd70c44210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.401+0000 7f5905485740 1 --2- 172.21.15.103:0/1319797084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd70c42a60 0x55fd70c45060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.401+0000 7f58daffd640 0 client.4776 ms_handle_reset on v2:172.21.15.103:6834/2250136134 2024-09-10T08:29:04.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.401+0000 7f5905485740 1 --2- 172.21.15.103:0/1319797084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c41720 0x55fd70c1def0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.401+0000 7f5905485740 1 -- 172.21.15.103:0/1319797084 >> 172.21.15.103:0/1319797084 conn(0x55fd70c08080 msgr2=0x55fd70c00ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:04.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.401+0000 7f5905485740 1 -- 172.21.15.103:0/1319797084 shutdown_connections 2024-09-10T08:29:04.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.401+0000 7f5905485740 1 -- 172.21.15.103:0/1319797084 wait complete. 2024-09-10T08:29:04.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.401+0000 7f5905485740 20 client.4776 trim_cache size 0 max 16384 2024-09-10T08:29:04.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.419+0000 7f5905485740 1 Processor -- start 2024-09-10T08:29:04.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.419+0000 7f5905485740 1 -- start start 2024-09-10T08:29:04.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.420+0000 7f5905485740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd70c41720 0x55fd70c52b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:04.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.420+0000 7f5905485740 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55fd70c42a60 0x55fd70c3fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:04.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.420+0000 7f5905485740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c455a0 0x55fd70c42e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:04.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.420+0000 7f5905485740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc1fc0b0 con 0x55fd70c455a0 2024-09-10T08:29:04.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.420+0000 7f5905485740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc1f9af0 con 0x55fd70c41720 2024-09-10T08:29:04.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.420+0000 7f5905485740 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f58fc1fa140 con 0x55fd70c42a60 2024-09-10T08:29:04.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.420+0000 7f5900c81640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c455a0 0x55fd70c42e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:04.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.420+0000 7f5900c81640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c455a0 0x55fd70c42e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50120/0 (socket says 172.21.15.103:50120) 2024-09-10T08:29:04.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.420+0000 7f5900c81640 1 -- 172.21.15.103:0/712604041 learned_addr learned my addr 172.21.15.103:0/712604041 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:04.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.420+0000 7f5900c81640 1 -- 172.21.15.103:0/712604041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55fd70c42a60 msgr2=0x55fd70c3fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:04.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.420+0000 7f5900c81640 1 --2- 172.21.15.103:0/712604041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55fd70c42a60 0x55fd70c3fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.420+0000 7f5900c81640 1 -- 172.21.15.103:0/712604041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd70c41720 msgr2=0x55fd70c52b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:04.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.420+0000 7f5900c81640 1 --2- 172.21.15.103:0/712604041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd70c41720 0x55fd70c52b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.420+0000 7f5900c81640 1 -- 172.21.15.103:0/712604041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd70c022f0 con 0x55fd70c455a0 2024-09-10T08:29:04.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.420+0000 7f5900c81640 1 --2- 172.21.15.103:0/712604041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c455a0 0x55fd70c42e40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f58f4000f80 tx=0x7f58f4009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28d0e37cb108f1f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:04.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.420+0000 7f58e17fa640 1 -- 172.21.15.103:0/712604041 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f4005070 con 0x55fd70c455a0 2024-09-10T08:29:04.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.420+0000 7f58e17fa640 1 -- 172.21.15.103:0/712604041 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f4044040 con 0x55fd70c455a0 2024-09-10T08:29:04.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.420+0000 7f58e17fa640 1 -- 172.21.15.103:0/712604041 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f4005430 con 0x55fd70c455a0 2024-09-10T08:29:04.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.421+0000 7f5905485740 1 -- 172.21.15.103:0/712604041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c455a0 msgr2=0x55fd70c42e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:04.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.421+0000 7f5905485740 1 --2- 172.21.15.103:0/712604041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c455a0 0x55fd70c42e40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f58f4000f80 tx=0x7f58f4009030 comp rx=0 tx=0).stop 2024-09-10T08:29:04.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.421+0000 7f5905485740 1 -- 172.21.15.103:0/712604041 shutdown_connections 2024-09-10T08:29:04.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.421+0000 7f5905485740 1 --2- 172.21.15.103:0/712604041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c455a0 0x55fd70c42e40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.421+0000 7f5905485740 1 --2- 172.21.15.103:0/712604041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55fd70c42a60 0x55fd70c3fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.421+0000 7f5905485740 1 --2- 172.21.15.103:0/712604041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd70c41720 0x55fd70c52b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.421+0000 7f5905485740 1 -- 172.21.15.103:0/712604041 >> 172.21.15.103:0/712604041 conn(0x55fd70c08080 msgr2=0x55fd70c44060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:04.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.421+0000 7f5905485740 1 -- 172.21.15.103:0/712604041 shutdown_connections 2024-09-10T08:29:04.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.421+0000 7f5905485740 1 -- 172.21.15.103:0/712604041 wait complete. 2024-09-10T08:29:04.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.421+0000 7f5905485740 1 -- start start 2024-09-10T08:29:04.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.422+0000 7f5905485740 1 Processor -- start 2024-09-10T08:29:04.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.422+0000 7f5905485740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c41720 0x55fd70c1f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:04.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.422+0000 7f5905485740 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55fd70c42a60 0x55fd70c1fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:04.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.422+0000 7f5905485740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd70c455a0 0x55fd70c43030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:04.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.422+0000 7f5905485740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55fd70c1e520 con 0x55fd70c41720 2024-09-10T08:29:04.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.422+0000 7f5905485740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fd70c44c70 con 0x55fd70c455a0 2024-09-10T08:29:04.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.422+0000 7f5905485740 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x55fd70c55e90 con 0x55fd70c42a60 2024-09-10T08:29:04.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.422+0000 7f5905485740 10 client.0 _ll_register_callbacks cb 0x7f58ec019040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:29:04.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.422+0000 7f58fbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c41720 0x55fd70c1f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:04.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.423+0000 7f58fbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c41720 0x55fd70c1f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50124/0 (socket says 172.21.15.103:50124) 2024-09-10T08:29:04.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.423+0000 7f58fbfff640 1 -- 172.21.15.103:0/2071561077 learned_addr learned my addr 172.21.15.103:0/2071561077 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:04.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.423+0000 7f58fb7fe640 1 --2- 172.21.15.103:0/2071561077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55fd70c42a60 0x55fd70c1fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:04.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.423+0000 7f5900c81640 1 --2- 172.21.15.103:0/2071561077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd70c455a0 0x55fd70c43030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:04.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.423+0000 7f58fbfff640 1 -- 172.21.15.103:0/2071561077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55fd70c42a60 msgr2=0x55fd70c1fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:04.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.423+0000 7f58fbfff640 1 --2- 172.21.15.103:0/2071561077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55fd70c42a60 0x55fd70c1fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.423+0000 7f58fbfff640 1 -- 172.21.15.103:0/2071561077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd70c455a0 msgr2=0x55fd70c43030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:04.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.423+0000 7f58fbfff640 1 --2- 172.21.15.103:0/2071561077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd70c455a0 0x55fd70c43030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.423+0000 7f58fbfff640 1 -- 172.21.15.103:0/2071561077 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd70c02a60 con 0x55fd70c41720 2024-09-10T08:29:04.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.423+0000 7f5900c81640 1 --2- 172.21.15.103:0/2071561077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd70c455a0 0x55fd70c43030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:04.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.423+0000 7f58fbfff640 1 --2- 172.21.15.103:0/2071561077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c41720 0x55fd70c1f4a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f58ec007490 tx=0x7f58ec007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680e530a68a41384 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:04.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.423+0000 7f58daffd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-10T08:29:04.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.423+0000 7f58daffd640 1 -- 172.21.15.103:0/2071561077 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec02b350 con 0x55fd70c41720 2024-09-10T08:29:04.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.423+0000 7f58daffd640 1 -- 172.21.15.103:0/2071561077 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f58ec038b30 con 0x55fd70c41720 2024-09-10T08:29:04.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.423+0000 7f5905485740 1 -- 172.21.15.103:0/2071561077 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58f4044040 con 0x55fd70c41720 2024-09-10T08:29:04.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.423+0000 7f58daffd640 1 -- 172.21.15.103:0/2071561077 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=11) ==== 24+0+0 (secure 0 0 0) 0x7f58ec038d30 con 0x55fd70c41720 2024-09-10T08:29:04.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.423+0000 7f5905485740 10 client.4782 fetch_fsmap learned FSMap version 11 2024-09-10T08:29:04.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.423+0000 7f5905485740 1 -- 172.21.15.103:0/2071561077 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=11,monmap=2+}) -- 0x55fd70cc1520 con 0x55fd70c41720 2024-09-10T08:29:04.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.423+0000 7f58daffd640 1 -- 172.21.15.103:0/2071561077 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f4044040 con 0x55fd70c41720 2024-09-10T08:29:04.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.423+0000 7f58daffd640 1 -- 172.21.15.103:0/2071561077 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 11) ==== 4136+0+0 (secure 0 0 0) 0x7f58ec033050 con 0x55fd70c41720 2024-09-10T08:29:04.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.423+0000 7f5905485740 10 client.4782 fetch_fsmap finished waiting for FSMap version 11 2024-09-10T08:29:04.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.424+0000 7f5905485740 10 client.4782 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:29:04.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.424+0000 7f5905485740 20 client.4782 populate_metadata read hostname 'smithi103' 2024-09-10T08:29:04.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.424+0000 7f5905485740 1 --2- 172.21.15.103:0/2071561077 >> [v2:172.21.15.103:6834/2250136134,v1:172.21.15.103:6836/2250136134] conn(0x55fd70c244d0 0x55fd70c248b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:04.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.424+0000 7f5905485740 4 client.4782 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:29:04.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.424+0000 7f5905485740 1 -- 172.21.15.103:0/2071561077 --> [v2:172.21.15.103:6834/2250136134,v1:172.21.15.103:6836/2250136134] -- command(tid 0: {"prefix": "status"}) -- 0x55fd70b70fa0 con 0x55fd70c244d0 2024-09-10T08:29:04.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.424+0000 7f58fb7fe640 1 --2- 172.21.15.103:0/2071561077 >> [v2:172.21.15.103:6834/2250136134,v1:172.21.15.103:6836/2250136134] conn(0x55fd70c244d0 0x55fd70c248b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:04.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.424+0000 7f58fb7fe640 1 -- 172.21.15.103:0/2071561077 >> [v2:172.21.15.103:6834/2250136134,v1:172.21.15.103:6836/2250136134] conn(0x55fd70c244d0 msgr2=0x55fd70c248b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-09-10T08:29:04.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.424+0000 7f58fb7fe640 1 -- 172.21.15.103:0/2071561077 >> [v2:172.21.15.103:6834/2250136134,v1:172.21.15.103:6836/2250136134] conn(0x55fd70c244d0 msgr2=0x55fd70c248b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:29:04.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.424+0000 7f58fb7fe640 1 --2- 172.21.15.103:0/2071561077 >> [v2:172.21.15.103:6834/2250136134,v1:172.21.15.103:6836/2250136134] conn(0x55fd70c244d0 0x55fd70c248b0 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:29:04.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.424+0000 7f58fb7fe640 1 --2- 172.21.15.103:0/2071561077 >> [v2:172.21.15.103:6834/2250136134,v1:172.21.15.103:6836/2250136134] conn(0x55fd70c244d0 0x55fd70c248b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:29:04.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.625+0000 7f58fb7fe640 1 --2- 172.21.15.103:0/2071561077 >> [v2:172.21.15.103:6834/2250136134,v1:172.21.15.103:6836/2250136134] conn(0x55fd70c244d0 0x55fd70c248b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:04.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.625+0000 7f58fb7fe640 1 --2- 172.21.15.103:0/2071561077 >> [v2:172.21.15.103:6834/2250136134,v1:172.21.15.103:6836/2250136134] conn(0x55fd70c244d0 0x55fd70c248b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7b80ac988bc6d8 server_cookie=737bb154ad813ea0 in_seq=0 out_seq=0 2024-09-10T08:29:04.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.625+0000 7f58daffd640 10 client.4782 ms_handle_connect on v2:172.21.15.103:6834/2250136134 2024-09-10T08:29:04.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.625+0000 7f58daffd640 1 -- 172.21.15.103:0/2071561077 <== mds.0 v2:172.21.15.103:6834/2250136134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55fd70b70fa0 con 0x55fd70c244d0 2024-09-10T08:29:04.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.625+0000 7f58daffd640 10 client.4782 handle_command_reply: tid=0 2024-09-10T08:29:04.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.625+0000 7f5905485740 1 client.4782 shutdown 2024-09-10T08:29:04.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.625+0000 7f5905485740 1 -- 172.21.15.103:0/2071561077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c41720 msgr2=0x55fd70c1f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:04.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.625+0000 7f5905485740 1 --2- 172.21.15.103:0/2071561077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c41720 0x55fd70c1f4a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f58ec007490 tx=0x7f58ec007e20 comp rx=0 tx=0).stop 2024-09-10T08:29:04.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.625+0000 7f5905485740 1 -- 172.21.15.103:0/2071561077 shutdown_connections 2024-09-10T08:29:04.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.625+0000 7f5905485740 1 --2- 172.21.15.103:0/2071561077 >> [v2:172.21.15.103:6834/2250136134,v1:172.21.15.103:6836/2250136134] conn(0x55fd70c244d0 0x55fd70c248b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.625+0000 7f5905485740 1 --2- 172.21.15.103:0/2071561077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fd70c455a0 0x55fd70c43030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.625+0000 7f58daffd640 0 client.4782 ms_handle_reset on v2:172.21.15.103:6834/2250136134 2024-09-10T08:29:04.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.625+0000 7f5905485740 1 --2- 172.21.15.103:0/2071561077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55fd70c42a60 0x55fd70c1fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.625+0000 7f5905485740 1 --2- 172.21.15.103:0/2071561077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fd70c41720 0x55fd70c1f4a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.625+0000 7f5905485740 1 -- 172.21.15.103:0/2071561077 >> 172.21.15.103:0/2071561077 conn(0x55fd70c08080 msgr2=0x55fd70c52b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:04.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.625+0000 7f5905485740 1 -- 172.21.15.103:0/2071561077 shutdown_connections 2024-09-10T08:29:04.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.625+0000 7f5905485740 1 -- 172.21.15.103:0/2071561077 wait complete. 2024-09-10T08:29:04.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.625+0000 7f5905485740 20 client.4782 trim_cache size 0 max 16384 2024-09-10T08:29:04.627 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:29:04.627 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:29:04.627 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-10T08:29:04.627 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4281, 2024-09-10T08:29:04.627 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-10T08:29:04.627 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-10T08:29:04.627 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "b", 2024-09-10T08:29:04.628 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 17.008643589999998, 2024-09-10T08:29:04.628 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 11, 2024-09-10T08:29:04.628 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 25, 2024-09-10T08:29:04.628 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 25, 2024-09-10T08:29:04.628 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 34.325010888999998 2024-09-10T08:29:04.628 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:29:04.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.626+0000 7f59026e4640 1 -- 172.21.15.103:0/1319087285 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f58e806be30 msgr2=0x7f58e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:04.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.626+0000 7f59026e4640 1 --2- 172.21.15.103:0/1319087285 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f58e806be30 0x7f58e806e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f58fc159090 tx=0x7f58ec0078f0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.626+0000 7f59026e4640 1 -- 172.21.15.103:0/1319087285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58fc157600 msgr2=0x7f58fc1520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:04.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.626+0000 7f59026e4640 1 --2- 172.21.15.103:0/1319087285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58fc157600 0x7f58fc1520d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f58f000b5c0 tx=0x7f58f000b9c0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.626+0000 7f59026e4640 1 -- 172.21.15.103:0/1319087285 shutdown_connections 2024-09-10T08:29:04.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.626+0000 7f59026e4640 1 --2- 172.21.15.103:0/1319087285 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f58e806be30 0x7f58e806e2f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.626+0000 7f59026e4640 1 --2- 172.21.15.103:0/1319087285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58fc14d890 0x7f58fc159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.626+0000 7f59026e4640 1 --2- 172.21.15.103:0/1319087285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58fc157600 0x7f58fc1520d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.626+0000 7f59026e4640 1 --2- 172.21.15.103:0/1319087285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58e40051c0 0x7f58fc14f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:04.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.626+0000 7f59026e4640 1 -- 172.21.15.103:0/1319087285 >> 172.21.15.103:0/1319087285 conn(0x7f58fc0c9d80 msgr2=0x7f58fc156740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:04.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.626+0000 7f59026e4640 1 -- 172.21.15.103:0/1319087285 shutdown_connections 2024-09-10T08:29:04.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:04.626+0000 7f59026e4640 1 -- 172.21.15.103:0/1319087285 wait complete. 2024-09-10T08:29:04.638 INFO:teuthology.run_tasks:Running task sequential... 2024-09-10T08:29:05.017 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-10T08:29:05.017 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-10T08:29:05.018 INFO:teuthology.task.print:Enabling mgr modules 2024-09-10T08:29:05.018 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-10T08:29:05.053 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-10T08:29:05.053 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-10T08:29:05.054 INFO:tasks.ceph_fuse:client.0 config is {'cephfs_name': 'a'} 2024-09-10T08:29:05.054 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T08:29:05.054 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:29:05.054 INFO:tasks.ceph_fuse:client.1 config is {'cephfs_name': 'b'} 2024-09-10T08:29:05.054 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T08:29:05.054 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T08:29:05.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:05.055 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-10T08:29:05.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:05.071 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link delete ceph-brx 2024-09-10T08:29:05.139 INFO:teuthology.orchestra.run.smithi103.stderr:Cannot find device "ceph-brx" 2024-09-10T08:29:05.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:29:05.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:05.141 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-09-10T08:29:05.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:05.161 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2024-09-10T08:29:05.233 INFO:teuthology.orchestra.run.smithi154.stderr:Cannot find device "ceph-brx" 2024-09-10T08:29:05.235 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:29:05.235 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-10T08:29:05.235 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T08:29:05.235 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:29:05.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.335+0000 7f2ac135f640 1 Processor -- start 2024-09-10T08:29:05.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.335+0000 7f2ac135f640 1 -- start start 2024-09-10T08:29:05.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.335+0000 7f2ac135f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2abc0ca390 0x7f2abc161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:05.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.335+0000 7f2ac135f640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2abc15a7c0 con 0x7f2abc06c650 2024-09-10T08:29:05.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.335+0000 7f2ac135f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2abc159a00 con 0x7f2abc150480 2024-09-10T08:29:05.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.335+0000 7f2ac135f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2abc06c240 con 0x7f2abc0ca390 2024-09-10T08:29:05.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.336+0000 7f2aba7fc640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2abc06c650 0x7f2abc0c9c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40062/0 (socket says 172.21.15.103:40062) 2024-09-10T08:29:05.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.336+0000 7f2aba7fc640 1 -- 172.21.15.103:0/3015823482 learned_addr learned my addr 172.21.15.103:0/3015823482 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:29:05.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.336+0000 7f2abb7fe640 1 --2- 172.21.15.103:0/3015823482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2abc0ca390 0x7f2abc161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:05.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.336+0000 7f2ab9ffb640 1 -- 172.21.15.103:0/3015823482 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2050275805 0 0) 0x7f2abc15a7c0 con 0x7f2abc06c650 2024-09-10T08:29:05.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.336+0000 7f2ab9ffb640 1 -- 172.21.15.103:0/3015823482 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2aa4003520 con 0x7f2abc06c650 2024-09-10T08:29:05.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.336+0000 7f2ab9ffb640 1 -- 172.21.15.103:0/3015823482 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2777989770 0 0) 0x7f2aa4003520 con 0x7f2abc06c650 2024-09-10T08:29:05.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.336+0000 7f2ab9ffb640 1 -- 172.21.15.103:0/3015823482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2abc0ca390 msgr2=0x7f2abc161c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:05.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.336+0000 7f2ab9ffb640 1 --2- 172.21.15.103:0/3015823482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2abc0ca390 0x7f2abc161c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:05.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.336+0000 7f2ab9ffb640 1 -- 172.21.15.103:0/3015823482 >> v1:172.21.15.154:6789/0 conn(0x7f2abc150480 legacy=0x7f2abc0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:05.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.336+0000 7f2ab9ffb640 1 -- 172.21.15.103:0/3015823482 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2abc159ce0 con 0x7f2abc06c650 2024-09-10T08:29:05.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.336+0000 7f2ab9ffb640 1 -- 172.21.15.103:0/3015823482 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f2ab0001670 con 0x7f2abc06c650 2024-09-10T08:29:05.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.336+0000 7f2ab9ffb640 1 -- 172.21.15.103:0/3015823482 >> v1:172.21.15.103:6789/0 conn(0x7f2abc06c650 legacy=0x7f2abc0c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:05.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.336+0000 7f2ab9ffb640 1 --2- 172.21.15.103:0/3015823482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aa40039e0 0x7f2aa4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:05.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.336+0000 7f2ab9ffb640 1 --2- 172.21.15.103:0/3015823482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa4004800 0x7f2aa4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:05.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.336+0000 7f2ab9ffb640 1 --2- 172.21.15.103:0/3015823482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2abc0ca390 0x7f2aa40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:05.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.336+0000 7f2ab9ffb640 1 -- 172.21.15.103:0/3015823482 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa400ba70 con 0x7f2aa4004800 2024-09-10T08:29:05.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.336+0000 7f2ab9ffb640 1 -- 172.21.15.103:0/3015823482 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa400bbf0 con 0x7f2aa40039e0 2024-09-10T08:29:05.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.336+0000 7f2ab9ffb640 1 -- 172.21.15.103:0/3015823482 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2aa400bdf0 con 0x7f2abc0ca390 2024-09-10T08:29:05.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.336+0000 7f2aba7fc640 1 --2- 172.21.15.103:0/3015823482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa4004800 0x7f2aa4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:05.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.336+0000 7f2abaffd640 1 --2- 172.21.15.103:0/3015823482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aa40039e0 0x7f2aa4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:05.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.336+0000 7f2abb7fe640 1 --2- 172.21.15.103:0/3015823482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2abc0ca390 0x7f2aa40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:05.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.337+0000 7f2aba7fc640 1 -- 172.21.15.103:0/3015823482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2abc0ca390 msgr2=0x7f2aa40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:05.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.337+0000 7f2aba7fc640 1 --2- 172.21.15.103:0/3015823482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2abc0ca390 0x7f2aa40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:05.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.337+0000 7f2aba7fc640 1 -- 172.21.15.103:0/3015823482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aa40039e0 msgr2=0x7f2aa4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:05.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.337+0000 7f2aba7fc640 1 --2- 172.21.15.103:0/3015823482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aa40039e0 0x7f2aa4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:05.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.337+0000 7f2aba7fc640 1 -- 172.21.15.103:0/3015823482 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa4003520 con 0x7f2aa4004800 2024-09-10T08:29:05.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.337+0000 7f2aba7fc640 1 --2- 172.21.15.103:0/3015823482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa4004800 0x7f2aa4004c80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0001eb0 tx=0x7f2aa4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bddfb8b05e42b99 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:05.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.337+0000 7f2ab9ffb640 1 -- 172.21.15.103:0/3015823482 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0007d30 con 0x7f2aa4004800 2024-09-10T08:29:05.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.337+0000 7f2ab9ffb640 1 -- 172.21.15.103:0/3015823482 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ab0005af0 con 0x7f2aa4004800 2024-09-10T08:29:05.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.337+0000 7f2ab9ffb640 1 -- 172.21.15.103:0/3015823482 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0007070 con 0x7f2aa4004800 2024-09-10T08:29:05.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.338+0000 7f2ac135f640 1 -- 172.21.15.103:0/3015823482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa4004800 msgr2=0x7f2aa4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:05.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.338+0000 7f2ac135f640 1 --2- 172.21.15.103:0/3015823482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2aa4004800 0x7f2aa4004c80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0001eb0 tx=0x7f2aa4005830 comp rx=0 tx=0).stop 2024-09-10T08:29:05.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.338+0000 7f2abb7fe640 1 -- 172.21.15.103:0/3015823482 reap_dead start 2024-09-10T08:29:05.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.338+0000 7f2ac135f640 1 -- 172.21.15.103:0/3015823482 shutdown_connections 2024-09-10T08:29:05.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.338+0000 7f2ac135f640 1 -- 172.21.15.103:0/3015823482 >> 172.21.15.103:0/3015823482 conn(0x7f2abc068030 msgr2=0x7f2abc073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:05.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.338+0000 7f2ac135f640 1 -- 172.21.15.103:0/3015823482 shutdown_connections 2024-09-10T08:29:05.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.338+0000 7f2ac135f640 1 -- 172.21.15.103:0/3015823482 wait complete. 2024-09-10T08:29:05.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.339+0000 7f2ac135f640 1 Processor -- start 2024-09-10T08:29:05.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.339+0000 7f2ac135f640 1 -- start start 2024-09-10T08:29:05.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.340+0000 7f2ac135f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aa4004800 0x7f2abc0afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:05.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.340+0000 7f2ac135f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2abc1521b0 0x7f2abc14e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:05.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.340+0000 7f2ac135f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2abc0b0290 0x7f2abc14ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:05.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.340+0000 7f2ac135f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2abc06d270 con 0x7f2abc0b0290 2024-09-10T08:29:05.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.340+0000 7f2ac135f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2abc15a330 con 0x7f2abc1521b0 2024-09-10T08:29:05.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.340+0000 7f2ac135f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2abc0c81a0 con 0x7f2aa4004800 2024-09-10T08:29:05.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.340+0000 7f2abb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2abc0b0290 0x7f2abc14ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:05.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.340+0000 7f2abb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2abc0b0290 0x7f2abc14ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60726/0 (socket says 172.21.15.103:60726) 2024-09-10T08:29:05.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.340+0000 7f2abb7fe640 1 -- 172.21.15.103:0/3147947240 learned_addr learned my addr 172.21.15.103:0/3147947240 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:05.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.340+0000 7f2abaffd640 1 --2- 172.21.15.103:0/3147947240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aa4004800 0x7f2abc0afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:05.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.340+0000 7f2aba7fc640 1 --2- 172.21.15.103:0/3147947240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2abc1521b0 0x7f2abc14e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:05.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.340+0000 7f2abb7fe640 1 -- 172.21.15.103:0/3147947240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aa4004800 msgr2=0x7f2abc0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:05.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.340+0000 7f2abb7fe640 1 --2- 172.21.15.103:0/3147947240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aa4004800 0x7f2abc0afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:05.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.340+0000 7f2abb7fe640 1 -- 172.21.15.103:0/3147947240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2abc1521b0 msgr2=0x7f2abc14e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:05.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.340+0000 7f2abb7fe640 1 --2- 172.21.15.103:0/3147947240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2abc1521b0 0x7f2abc14e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:05.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.340+0000 7f2abb7fe640 1 -- 172.21.15.103:0/3147947240 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2abc14f680 con 0x7f2abc0b0290 2024-09-10T08:29:05.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.340+0000 7f2abb7fe640 1 --2- 172.21.15.103:0/3147947240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2abc0b0290 0x7f2abc14ef20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2abc08e210 tx=0x7f2ab400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:05.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.340+0000 7f2aa37fe640 1 -- 172.21.15.103:0/3147947240 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4015430 con 0x7f2abc0b0290 2024-09-10T08:29:05.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.341+0000 7f2aa37fe640 1 -- 172.21.15.103:0/3147947240 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ab401d070 con 0x7f2abc0b0290 2024-09-10T08:29:05.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.341+0000 7f2aa37fe640 1 -- 172.21.15.103:0/3147947240 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4015810 con 0x7f2abc0b0290 2024-09-10T08:29:05.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.341+0000 7f2ac135f640 1 -- 172.21.15.103:0/3147947240 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2abc0b0940 con 0x7f2abc0b0290 2024-09-10T08:29:05.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.341+0000 7f2ac135f640 1 -- 172.21.15.103:0/3147947240 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2abc1e2650 con 0x7f2abc0b0290 2024-09-10T08:29:05.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.341+0000 7f2ac135f640 1 -- 172.21.15.103:0/3147947240 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2abc156270 con 0x7f2abc0b0290 2024-09-10T08:29:05.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.342+0000 7f2aa37fe640 1 -- 172.21.15.103:0/3147947240 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ab40159b0 con 0x7f2abc0b0290 2024-09-10T08:29:05.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.342+0000 7f2aa37fe640 1 --2- 172.21.15.103:0/3147947240 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2aa806be30 0x7f2aa806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:05.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.342+0000 7f2aa37fe640 1 -- 172.21.15.103:0/3147947240 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f2ab408ba50 con 0x7f2abc0b0290 2024-09-10T08:29:05.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.342+0000 7f2abaffd640 1 --2- 172.21.15.103:0/3147947240 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2aa806be30 0x7f2aa806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:05.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.343+0000 7f2abaffd640 1 --2- 172.21.15.103:0/3147947240 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2aa806be30 0x7f2aa806e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2aac001760 tx=0x7f2aac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:05.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.347+0000 7f2aa37fe640 1 -- 172.21.15.103:0/3147947240 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ab4010040 con 0x7f2abc0b0290 2024-09-10T08:29:05.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.546+0000 7f2ac135f640 1 -- 172.21.15.103:0/3147947240 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2abc06c430 con 0x7f2abc0b0290 2024-09-10T08:29:05.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.546+0000 7f2aa37fe640 1 -- 172.21.15.103:0/3147947240 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v11) ==== 53+0+116 (secure 0 0 0) 0x7f2ab4059a80 con 0x7f2abc0b0290 2024-09-10T08:29:05.546 INFO:teuthology.orchestra.run.smithi103.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-09-10T08:29:05.546 INFO:teuthology.orchestra.run.smithi103.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-09-10T08:29:05.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.548+0000 7f2ac135f640 1 -- 172.21.15.103:0/3147947240 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2aa806be30 msgr2=0x7f2aa806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:05.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.548+0000 7f2ac135f640 1 --2- 172.21.15.103:0/3147947240 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2aa806be30 0x7f2aa806e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2aac001760 tx=0x7f2aac009040 comp rx=0 tx=0).stop 2024-09-10T08:29:05.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.548+0000 7f2ac135f640 1 -- 172.21.15.103:0/3147947240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2abc0b0290 msgr2=0x7f2abc14ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:05.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.548+0000 7f2ac135f640 1 --2- 172.21.15.103:0/3147947240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2abc0b0290 0x7f2abc14ef20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2abc08e210 tx=0x7f2ab400f580 comp rx=0 tx=0).stop 2024-09-10T08:29:05.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.548+0000 7f2ac135f640 1 -- 172.21.15.103:0/3147947240 shutdown_connections 2024-09-10T08:29:05.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.548+0000 7f2ac135f640 1 --2- 172.21.15.103:0/3147947240 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2aa806be30 0x7f2aa806e2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:05.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.548+0000 7f2ac135f640 1 --2- 172.21.15.103:0/3147947240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2abc0b0290 0x7f2abc14ef20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:05.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.548+0000 7f2ac135f640 1 --2- 172.21.15.103:0/3147947240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2abc1521b0 0x7f2abc14e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:05.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.548+0000 7f2ac135f640 1 --2- 172.21.15.103:0/3147947240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aa4004800 0x7f2abc0afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:05.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.548+0000 7f2ac135f640 1 -- 172.21.15.103:0/3147947240 >> 172.21.15.103:0/3147947240 conn(0x7f2abc068030 msgr2=0x7f2abc075030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:05.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.548+0000 7f2ac135f640 1 -- 172.21.15.103:0/3147947240 shutdown_connections 2024-09-10T08:29:05.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05.548+0000 7f2ac135f640 1 -- 172.21.15.103:0/3147947240 wait complete. 2024-09-10T08:29:05.559 INFO:tasks.cephfs.mount:Mounting Ceph FS a; just confirmed its presence on cluster 2024-09-10T08:29:05.559 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:29:05.559 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-10T08:29:05.559 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T08:29:05.559 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:29:05.559 INFO:tasks.cephfs.mount:self.cephfs_name = a 2024-09-10T08:29:05.559 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T08:29:05.559 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:29:05.559 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:29:05.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:05.559 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-10T08:29:05.575 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:29:05.575 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:29:05.575 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:29:05.575 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:05.576 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-10T08:29:05.576 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:05.576 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:29:05.576 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:05.576 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-10T08:29:05.576 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:29:05.576 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:05.576 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-10T08:29:05.576 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:29:05.576 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:05.576 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:29:05.576 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:05.577 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T08:29:05.577 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42756sec preferred_lft 42756sec 2024-09-10T08:29:05.577 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-09-10T08:29:05.577 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:05.577 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T08:29:05.577 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:05.578 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T08:29:05.578 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add name ceph-brx type bridge 2024-09-10T08:29:05.578 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr flush dev ceph-brx 2024-09-10T08:29:05.578 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set ceph-brx up 2024-09-10T08:29:05.578 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T08:29:05.578 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T08:29:05.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:05.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:05.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:05.777 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:29:05.802 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-10T08:29:05.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:05.804 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-10T08:29:05.877 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-10T08:29:05.877 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:29:05.877 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T08:29:05.877 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T08:29:05.877 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:29:05.878 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:05.878 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T08:29:05.878 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T08:29:05.878 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T08:29:05.878 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T08:29:05.878 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T08:29:05.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:06.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:06.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:06.176 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-10T08:29:06.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:06.191 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list-id 2024-09-10T08:29:06.247 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:06.247 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T08:29:06.247 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:29:06.247 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T08:29:06.247 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T08:29:06.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:06.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:06.366 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T08:29:06.366 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:06.366 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T08:29:06.366 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T08:29:06.367 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T08:29:06.367 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T08:29:06.367 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T08:29:06.367 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T08:29:06.367 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T08:29:06.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:06.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:06.494 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:06.494 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-10T08:29:06.495 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-10T08:29:06.495 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T08:29:06.495 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-10T08:29:06.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:06.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:06.580 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'cephfs_name': 'a'} 2024-09-10T08:29:06.580 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:29:06.580 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T08:29:06.595 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:29:06.595 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:29:06.595 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:29:06.650 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-10T08:29:06.715 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T08:29:06.771 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-10T08:29:06.771 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-10T08:29:06.771 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-10T08:29:06.771 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-10T08:29:06.771 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-10T08:29:06.772 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-10T08:29:06.772 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-10T08:29:06.772 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-10T08:29:06.772 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-10T08:29:06.772 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-10T08:29:06.772 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-10T08:29:06.772 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-09-10T08:29:06.772 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T08:29:06.772 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-10T08:29:06.772 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-10T08:29:06.772 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-10T08:29:06.772 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-10T08:29:06.772 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-10T08:29:06.772 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-10T08:29:06.773 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T08:29:06.773 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T08:29:06.773 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T08:29:06.773 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T08:29:06.773 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-10T08:29:06.773 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-10T08:29:06.773 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T08:29:06.773 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T08:29:06.773 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T08:29:06.773 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T08:29:06.774 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-10T08:29:06.774 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:29:06.774 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:29:06.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:06.774 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-10T08:29:06.826 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T08:29:06.826 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_fs=a) 2024-09-10T08:29:06.869 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-10T08:29:06.893 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T08:29:06.949 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-10T08:29:06.949 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-10T08:29:06.949 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-10T08:29:06.949 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-10T08:29:06.949 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-10T08:29:06.949 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-10T08:29:06.949 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-10T08:29:06.949 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-10T08:29:06.950 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-10T08:29:06.950 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-10T08:29:06.950 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-10T08:29:06.950 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-09-10T08:29:06.950 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T08:29:06.950 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-10T08:29:06.950 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-10T08:29:06.950 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-10T08:29:06.950 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-10T08:29:06.950 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-10T08:29:06.950 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-10T08:29:06.950 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T08:29:06.950 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T08:29:06.950 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T08:29:06.950 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T08:29:06.951 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-10T08:29:06.951 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-10T08:29:06.951 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T08:29:06.951 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T08:29:06.951 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T08:29:06.951 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T08:29:06.951 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-10T08:29:06.951 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:29:06.951 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:29:06.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:06.951 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-10T08:29:06.961 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2024-09-10T08:29:06.961+0000 7fa27320f480 -1 init, newargv = 0x55b479a33be0 newargc=15 2024-09-10T08:29:06.961 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[45534]: starting ceph client 2024-09-10T08:29:06.966 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[45534]: starting fuse 2024-09-10T08:29:06.978 INFO:teuthology.orchestra.run.smithi103.stdout:41 2024-09-10T08:29:06.978 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-10T08:29:06.978 DEBUG:teuthology.orchestra.run.smithi103:> sudo stdin-killer -- python3 -c ' 2024-09-10T08:29:06.978 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2024-09-10T08:29:06.978 DEBUG:teuthology.orchestra.run.smithi103:> import re 2024-09-10T08:29:06.978 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-10T08:29:06.978 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2024-09-10T08:29:06.978 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T08:29:06.978 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2024-09-10T08:29:06.978 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T08:29:06.979 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2024-09-10T08:29:06.979 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T08:29:06.979 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T08:29:06.979 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2024-09-10T08:29:06.979 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2024-09-10T08:29:06.979 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2024-09-10T08:29:06.979 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2024-09-10T08:29:06.979 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T08:29:06.979 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2024-09-10T08:29:06.979 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T08:29:06.979 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T08:29:06.979 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T08:29:06.979 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2024-09-10T08:29:06.979 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2024-09-10T08:29:06.979 DEBUG:teuthology.orchestra.run.smithi103:> return f 2024-09-10T08:29:06.980 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T08:29:06.980 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-10T08:29:06.980 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.0")) 2024-09-10T08:29:06.980 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-10T08:29:07.096 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.45534.asok 2024-09-10T08:29:07.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:07.107 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45534.asok 2024-09-10T08:29:07.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:07.107 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45534.asok status 2024-09-10T08:29:07.242 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:29:07.242 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2024-09-10T08:29:07.242 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "1cf819b7212a6048e92fc78c4eff963344f6d56b", 2024-09-10T08:29:07.243 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)", 2024-09-10T08:29:07.243 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2024-09-10T08:29:07.243 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2024-09-10T08:29:07.243 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T08:29:07.243 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "45534", 2024-09-10T08:29:07.243 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2024-09-10T08:29:07.243 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:07.243 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2024-09-10T08:29:07.243 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2024-09-10T08:29:07.243 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4797, 2024-09-10T08:29:07.243 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2024-09-10T08:29:07.243 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2024-09-10T08:29:07.244 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2024-09-10T08:29:07.244 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4797 2024-09-10T08:29:07.244 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:07.244 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-10T08:29:07.244 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:29:07.244 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-10T08:29:07.244 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 140511079 2024-09-10T08:29:07.244 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:07.244 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:07.244 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-10T08:29:07.244 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:29:07.244 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-10T08:29:07.245 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 140511079 2024-09-10T08:29:07.245 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:07.245 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.4797 192.168.0.1:0/140511079", 2024-09-10T08:29:07.245 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/140511079", 2024-09-10T08:29:07.245 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2024-09-10T08:29:07.245 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 7, 2024-09-10T08:29:07.245 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 25, 2024-09-10T08:29:07.245 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2024-09-10T08:29:07.245 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2024-09-10T08:29:07.245 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "a" 2024-09-10T08:29:07.245 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:29:07.249 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T08:29:07.249 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:29:07.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.348+0000 7fcfcddfd640 1 Processor -- start 2024-09-10T08:29:07.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.348+0000 7fcfcddfd640 1 -- start start 2024-09-10T08:29:07.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.348+0000 7fcfcddfd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfc81500a0 0x7fcfc80c3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:07.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.349+0000 7fcfcddfd640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfc80ad5c0 con 0x7fcfc80c3e00 2024-09-10T08:29:07.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.349+0000 7fcfcddfd640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfc806ef50 con 0x7fcfc806e650 2024-09-10T08:29:07.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.349+0000 7fcfcddfd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc80ad860 con 0x7fcfc81500a0 2024-09-10T08:29:07.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.349+0000 7fcfc7fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fcfc80c3e00 0x7fcfc806dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40074/0 (socket says 172.21.15.103:40074) 2024-09-10T08:29:07.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.349+0000 7fcfc7fff640 1 -- 172.21.15.103:0/2924693294 learned_addr learned my addr 172.21.15.103:0/2924693294 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:29:07.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.349+0000 7fcfc77fe640 1 --2- 172.21.15.103:0/2924693294 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfc81500a0 0x7fcfc80c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:07.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.349+0000 7fcfc6ffd640 1 -- 172.21.15.103:0/2924693294 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3270872375 0 0) 0x7fcfc80ad5c0 con 0x7fcfc80c3e00 2024-09-10T08:29:07.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.349+0000 7fcfc6ffd640 1 -- 172.21.15.103:0/2924693294 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfb4003520 con 0x7fcfc80c3e00 2024-09-10T08:29:07.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.349+0000 7fcfc6ffd640 1 -- 172.21.15.103:0/2924693294 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3038646482 0 0) 0x7fcfb4003520 con 0x7fcfc80c3e00 2024-09-10T08:29:07.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.349+0000 7fcfc6ffd640 1 -- 172.21.15.103:0/2924693294 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfc81500a0 msgr2=0x7fcfc80c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:07.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.349+0000 7fcfc6ffd640 1 --2- 172.21.15.103:0/2924693294 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfc81500a0 0x7fcfc80c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:07.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.349+0000 7fcfc6ffd640 1 -- 172.21.15.103:0/2924693294 >> v1:172.21.15.154:6789/0 conn(0x7fcfc806e650 legacy=0x7fcfc8150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:07.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.349+0000 7fcfc6ffd640 1 -- 172.21.15.103:0/2924693294 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc806ec70 con 0x7fcfc80c3e00 2024-09-10T08:29:07.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.349+0000 7fcfc6ffd640 1 -- 172.21.15.103:0/2924693294 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7fcfc00019f0 con 0x7fcfc80c3e00 2024-09-10T08:29:07.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.349+0000 7fcfc6ffd640 1 -- 172.21.15.103:0/2924693294 >> v1:172.21.15.103:6789/0 conn(0x7fcfc80c3e00 legacy=0x7fcfc806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:07.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.349+0000 7fcfc6ffd640 1 --2- 172.21.15.103:0/2924693294 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfb40039e0 0x7fcfb4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:07.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.349+0000 7fcfc6ffd640 1 --2- 172.21.15.103:0/2924693294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb4004390 0x7fcfb4004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:07.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.349+0000 7fcfc6ffd640 1 --2- 172.21.15.103:0/2924693294 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfc81500a0 0x7fcfb4005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:07.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.349+0000 7fcfc6ffd640 1 -- 172.21.15.103:0/2924693294 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc80ad860 con 0x7fcfb40039e0 2024-09-10T08:29:07.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.349+0000 7fcfc6ffd640 1 -- 172.21.15.103:0/2924693294 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb400ba70 con 0x7fcfb4004390 2024-09-10T08:29:07.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.349+0000 7fcfc6ffd640 1 -- 172.21.15.103:0/2924693294 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcfb400bc70 con 0x7fcfc81500a0 2024-09-10T08:29:07.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.349+0000 7fcfc77fe640 1 --2- 172.21.15.103:0/2924693294 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfb40039e0 0x7fcfb4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.350+0000 7fcfbffff640 1 --2- 172.21.15.103:0/2924693294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb4004390 0x7fcfb4004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.350+0000 7fcfc7fff640 1 --2- 172.21.15.103:0/2924693294 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfc81500a0 0x7fcfb4005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.350+0000 7fcfc77fe640 1 -- 172.21.15.103:0/2924693294 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfc81500a0 msgr2=0x7fcfb4005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.350+0000 7fcfc77fe640 1 --2- 172.21.15.103:0/2924693294 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfc81500a0 0x7fcfb4005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.350+0000 7fcfc77fe640 1 -- 172.21.15.103:0/2924693294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb4004390 msgr2=0x7fcfb4004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.350+0000 7fcfc77fe640 1 --2- 172.21.15.103:0/2924693294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb4004390 0x7fcfb4004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.350+0000 7fcfc77fe640 1 -- 172.21.15.103:0/2924693294 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb4003520 con 0x7fcfb40039e0 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.350+0000 7fcfc7fff640 1 --2- 172.21.15.103:0/2924693294 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfc81500a0 0x7fcfb4005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.350+0000 7fcfc77fe640 1 --2- 172.21.15.103:0/2924693294 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfb40039e0 0x7fcfb4003dc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009ac0 tx=0x7fcfb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d44050ec45690d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.351+0000 7fcfc6ffd640 1 -- 172.21.15.103:0/2924693294 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8036070 con 0x7fcfb40039e0 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.351+0000 7fcfc6ffd640 1 -- 172.21.15.103:0/2924693294 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb8031400 con 0x7fcfb40039e0 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.351+0000 7fcfc6ffd640 1 -- 172.21.15.103:0/2924693294 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8009690 con 0x7fcfb40039e0 2024-09-10T08:29:07.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.351+0000 7fcfcddfd640 1 -- 172.21.15.103:0/2924693294 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfb40039e0 msgr2=0x7fcfb4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:07.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.351+0000 7fcfcddfd640 1 --2- 172.21.15.103:0/2924693294 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfb40039e0 0x7fcfb4003dc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009ac0 tx=0x7fcfb4005830 comp rx=0 tx=0).stop 2024-09-10T08:29:07.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.351+0000 7fcfc7fff640 1 -- 172.21.15.103:0/2924693294 reap_dead start 2024-09-10T08:29:07.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.351+0000 7fcfcddfd640 1 -- 172.21.15.103:0/2924693294 shutdown_connections 2024-09-10T08:29:07.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.351+0000 7fcfcddfd640 1 -- 172.21.15.103:0/2924693294 >> 172.21.15.103:0/2924693294 conn(0x7fcfc80c7a40 msgr2=0x7fcfc80c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:07.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.351+0000 7fcfcddfd640 1 -- 172.21.15.103:0/2924693294 shutdown_connections 2024-09-10T08:29:07.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.351+0000 7fcfcddfd640 1 -- 172.21.15.103:0/2924693294 wait complete. 2024-09-10T08:29:07.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.352+0000 7fcfcddfd640 1 Processor -- start 2024-09-10T08:29:07.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.352+0000 7fcfcddfd640 1 -- start start 2024-09-10T08:29:07.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.353+0000 7fcfcddfd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfb40039e0 0x7fcfc8070930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:07.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.353+0000 7fcfcddfd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfc80bd190 0x7fcfc80741a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:07.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.353+0000 7fcfcddfd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfc8073580 0x7fcfc814be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:07.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.353+0000 7fcfcddfd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc806e1c0 con 0x7fcfc80bd190 2024-09-10T08:29:07.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.353+0000 7fcfcddfd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc80adb10 con 0x7fcfc8073580 2024-09-10T08:29:07.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.353+0000 7fcfcddfd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc806e340 con 0x7fcfb40039e0 2024-09-10T08:29:07.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.353+0000 7fcfbffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfc80bd190 0x7fcfc80741a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:07.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.353+0000 7fcfbffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfc80bd190 0x7fcfc80741a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60744/0 (socket says 172.21.15.103:60744) 2024-09-10T08:29:07.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.353+0000 7fcfbffff640 1 -- 172.21.15.103:0/956243954 learned_addr learned my addr 172.21.15.103:0/956243954 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.353+0000 7fcfc7fff640 1 --2- 172.21.15.103:0/956243954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfc8073580 0x7fcfc814be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.353+0000 7fcfc77fe640 1 --2- 172.21.15.103:0/956243954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfb40039e0 0x7fcfc8070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.353+0000 7fcfbffff640 1 -- 172.21.15.103:0/956243954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfb40039e0 msgr2=0x7fcfc8070930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.353+0000 7fcfbffff640 1 --2- 172.21.15.103:0/956243954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfb40039e0 0x7fcfc8070930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.353+0000 7fcfbffff640 1 -- 172.21.15.103:0/956243954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfc8073580 msgr2=0x7fcfc814be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.353+0000 7fcfbffff640 1 --2- 172.21.15.103:0/956243954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfc8073580 0x7fcfc814be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.353+0000 7fcfbffff640 1 -- 172.21.15.103:0/956243954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc80727c0 con 0x7fcfc80bd190 2024-09-10T08:29:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.354+0000 7fcfbffff640 1 --2- 172.21.15.103:0/956243954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfc80bd190 0x7fcfc80741a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000f770 tx=0x7fcfb000fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.354+0000 7fcfc4ff9640 1 -- 172.21.15.103:0/956243954 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb00050d0 con 0x7fcfc80bd190 2024-09-10T08:29:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.354+0000 7fcfc4ff9640 1 -- 172.21.15.103:0/956243954 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb0018070 con 0x7fcfc80bd190 2024-09-10T08:29:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.354+0000 7fcfc4ff9640 1 -- 172.21.15.103:0/956243954 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb000d730 con 0x7fcfc80bd190 2024-09-10T08:29:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.354+0000 7fcfcddfd640 1 -- 172.21.15.103:0/956243954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc8072aa0 con 0x7fcfc80bd190 2024-09-10T08:29:07.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.354+0000 7fcfcddfd640 1 -- 172.21.15.103:0/956243954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc8073060 con 0x7fcfc80bd190 2024-09-10T08:29:07.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.355+0000 7fcfcddfd640 1 -- 172.21.15.103:0/956243954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfc8073260 con 0x7fcfc80bd190 2024-09-10T08:29:07.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.355+0000 7fcfc4ff9640 1 -- 172.21.15.103:0/956243954 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcfb000d8d0 con 0x7fcfc80bd190 2024-09-10T08:29:07.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.356+0000 7fcfc4ff9640 1 --2- 172.21.15.103:0/956243954 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcfa806be30 0x7fcfa806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:07.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.356+0000 7fcfc4ff9640 1 -- 172.21.15.103:0/956243954 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fcfb008af90 con 0x7fcfc80bd190 2024-09-10T08:29:07.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.356+0000 7fcfc77fe640 1 --2- 172.21.15.103:0/956243954 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcfa806be30 0x7fcfa806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:07.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.356+0000 7fcfc77fe640 1 --2- 172.21.15.103:0/956243954 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcfa806be30 0x7fcfa806e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8033000 tx=0x7fcfb8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:07.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.360+0000 7fcfc4ff9640 1 -- 172.21.15.103:0/956243954 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcfc8073260 con 0x7fcfc80bd190 2024-09-10T08:29:07.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.560+0000 7fcfcddfd640 1 -- 172.21.15.103:0/956243954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcfc8150480 con 0x7fcfc80bd190 2024-09-10T08:29:07.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.561+0000 7fcfc4ff9640 1 -- 172.21.15.103:0/956243954 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v11) ==== 53+0+116 (secure 0 0 0) 0x7fcfb00596a0 con 0x7fcfc80bd190 2024-09-10T08:29:07.560 INFO:teuthology.orchestra.run.smithi103.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-09-10T08:29:07.560 INFO:teuthology.orchestra.run.smithi103.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-09-10T08:29:07.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.563+0000 7fcfcddfd640 1 -- 172.21.15.103:0/956243954 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcfa806be30 msgr2=0x7fcfa806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:07.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.563+0000 7fcfcddfd640 1 --2- 172.21.15.103:0/956243954 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcfa806be30 0x7fcfa806e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8033000 tx=0x7fcfb8008030 comp rx=0 tx=0).stop 2024-09-10T08:29:07.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.563+0000 7fcfcddfd640 1 -- 172.21.15.103:0/956243954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfc80bd190 msgr2=0x7fcfc80741a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:07.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.563+0000 7fcfcddfd640 1 --2- 172.21.15.103:0/956243954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfc80bd190 0x7fcfc80741a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000f770 tx=0x7fcfb000fb70 comp rx=0 tx=0).stop 2024-09-10T08:29:07.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.563+0000 7fcfcddfd640 1 -- 172.21.15.103:0/956243954 shutdown_connections 2024-09-10T08:29:07.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.563+0000 7fcfcddfd640 1 --2- 172.21.15.103:0/956243954 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcfa806be30 0x7fcfa806e2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:07.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.563+0000 7fcfcddfd640 1 --2- 172.21.15.103:0/956243954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfc8073580 0x7fcfc814be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:07.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.563+0000 7fcfcddfd640 1 --2- 172.21.15.103:0/956243954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfc80bd190 0x7fcfc80741a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:07.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.563+0000 7fcfcddfd640 1 --2- 172.21.15.103:0/956243954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfb40039e0 0x7fcfc8070930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:07.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.563+0000 7fcfcddfd640 1 -- 172.21.15.103:0/956243954 >> 172.21.15.103:0/956243954 conn(0x7fcfc80c7a40 msgr2=0x7fcfc8151f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:07.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.563+0000 7fcfcddfd640 1 -- 172.21.15.103:0/956243954 shutdown_connections 2024-09-10T08:29:07.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:07.563+0000 7fcfcddfd640 1 -- 172.21.15.103:0/956243954 wait complete. 2024-09-10T08:29:07.573 INFO:tasks.cephfs.mount:Mounting Ceph FS b; just confirmed its presence on cluster 2024-09-10T08:29:07.573 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:29:07.573 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2024-09-10T08:29:07.573 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T08:29:07.573 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T08:29:07.574 INFO:tasks.cephfs.mount:self.cephfs_name = b 2024-09-10T08:29:07.574 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T08:29:07.574 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:29:07.574 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T08:29:07.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:07.574 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2024-09-10T08:29:07.592 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:29:07.592 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:29:07.592 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:29:07.593 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:07.593 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-09-10T08:29:07.593 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:07.593 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:29:07.593 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:07.593 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2024-09-10T08:29:07.593 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:29:07.594 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:07.594 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2024-09-10T08:29:07.594 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:29:07.594 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:07.594 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:29:07.594 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:07.594 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T08:29:07.594 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42732sec preferred_lft 42732sec 2024-09-10T08:29:07.594 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link noprefixroute 2024-09-10T08:29:07.594 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:07.594 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T08:29:07.595 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:07.595 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-09-10T08:29:07.595 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add name ceph-brx type bridge 2024-09-10T08:29:07.595 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip addr flush dev ceph-brx 2024-09-10T08:29:07.595 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set ceph-brx up 2024-09-10T08:29:07.595 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T08:29:07.595 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-09-10T08:29:07.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:29:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:07.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:29:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:07.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:07.805 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:29:07.829 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-09-10T08:29:07.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:07.831 DEBUG:teuthology.orchestra.run.smithi154:> route 2024-09-10T08:29:07.898 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2024-09-10T08:29:07.898 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:29:07.898 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T08:29:07.898 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T08:29:07.898 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:29:07.898 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:07.898 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-09-10T08:29:07.898 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T08:29:07.898 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T08:29:07.898 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T08:29:07.899 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-09-10T08:29:07.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:29:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:08.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:29:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:08.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:08.205 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-09-10T08:29:08.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:08.222 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list-id 2024-09-10T08:29:08.278 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:08.278 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-09-10T08:29:08.278 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T08:29:08.278 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-10T08:29:08.278 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-09-10T08:29:08.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:29:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:08.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:29:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:08.397 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-10T08:29:08.398 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:08.398 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-09-10T08:29:08.398 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-10T08:29:08.398 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T08:29:08.398 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-10T08:29:08.398 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-10T08:29:08.398 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-10T08:29:08.398 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-09-10T08:29:08.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:29:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:08.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:29:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:08.541 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:08.541 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-09-10T08:29:08.541 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2024-09-10T08:29:08.541 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T08:29:08.541 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-09-10T08:29:08.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:29:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:08.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:29:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:08.619 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {'cephfs_name': 'b'} 2024-09-10T08:29:08.619 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:29:08.619 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T08:29:08.634 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T08:29:08.635 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:29:08.635 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T08:29:08.690 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2024-09-10T08:29:08.757 DEBUG:teuthology.orchestra.run.smithi154:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T08:29:08.814 INFO:teuthology.orchestra.run.smithi154.stdout:/proc 2024-09-10T08:29:08.814 INFO:teuthology.orchestra.run.smithi154.stdout:/sys 2024-09-10T08:29:08.814 INFO:teuthology.orchestra.run.smithi154.stdout:/dev 2024-09-10T08:29:08.814 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/security 2024-09-10T08:29:08.814 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/shm 2024-09-10T08:29:08.814 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/pts 2024-09-10T08:29:08.814 INFO:teuthology.orchestra.run.smithi154.stdout:/run 2024-09-10T08:29:08.814 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/cgroup 2024-09-10T08:29:08.814 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/pstore 2024-09-10T08:29:08.815 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/bpf 2024-09-10T08:29:08.815 INFO:teuthology.orchestra.run.smithi154.stdout:/ 2024-09-10T08:29:08.815 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/selinux 2024-09-10T08:29:08.815 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T08:29:08.815 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/mqueue 2024-09-10T08:29:08.815 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/hugepages 2024-09-10T08:29:08.815 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/debug 2024-09-10T08:29:08.815 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/tracing 2024-09-10T08:29:08.815 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/fuse/connections 2024-09-10T08:29:08.815 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/config 2024-09-10T08:29:08.816 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T08:29:08.816 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T08:29:08.816 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T08:29:08.816 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T08:29:08.816 INFO:teuthology.orchestra.run.smithi154.stdout:/run/user/1000 2024-09-10T08:29:08.816 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph 2024-09-10T08:29:08.816 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T08:29:08.816 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T08:29:08.816 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T08:29:08.816 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T08:29:08.817 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns 2024-09-10T08:29:08.817 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T08:29:08.817 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T08:29:08.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:08.817 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2024-09-10T08:29:08.870 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T08:29:08.870 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1 --client_fs=b) 2024-09-10T08:29:08.912 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2024-09-10T08:29:08.936 DEBUG:teuthology.orchestra.run.smithi154:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T08:29:08.993 INFO:teuthology.orchestra.run.smithi154.stdout:/proc 2024-09-10T08:29:08.993 INFO:teuthology.orchestra.run.smithi154.stdout:/sys 2024-09-10T08:29:08.993 INFO:teuthology.orchestra.run.smithi154.stdout:/dev 2024-09-10T08:29:08.993 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/security 2024-09-10T08:29:08.993 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/shm 2024-09-10T08:29:08.993 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/pts 2024-09-10T08:29:08.993 INFO:teuthology.orchestra.run.smithi154.stdout:/run 2024-09-10T08:29:08.993 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/cgroup 2024-09-10T08:29:08.993 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/pstore 2024-09-10T08:29:08.993 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/bpf 2024-09-10T08:29:08.993 INFO:teuthology.orchestra.run.smithi154.stdout:/ 2024-09-10T08:29:08.994 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/selinux 2024-09-10T08:29:08.994 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T08:29:08.994 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/mqueue 2024-09-10T08:29:08.994 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/hugepages 2024-09-10T08:29:08.994 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/debug 2024-09-10T08:29:08.994 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/tracing 2024-09-10T08:29:08.994 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/fuse/connections 2024-09-10T08:29:08.994 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/config 2024-09-10T08:29:08.994 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T08:29:08.994 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T08:29:08.994 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T08:29:08.994 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T08:29:08.994 INFO:teuthology.orchestra.run.smithi154.stdout:/run/user/1000 2024-09-10T08:29:08.994 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph 2024-09-10T08:29:08.995 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T08:29:08.995 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T08:29:08.995 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T08:29:08.995 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T08:29:08.995 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns 2024-09-10T08:29:08.995 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T08:29:08.995 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T08:29:08.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:08.995 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2024-09-10T08:29:09.000 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi154.stderr:2024-09-10T08:29:09.000+0000 7f3804f23480 -1 init, newargv = 0x55f2f6be8a60 newargc=15 2024-09-10T08:29:09.000 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi154.stderr:ceph-fuse[42674]: starting ceph client 2024-09-10T08:29:09.006 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi154.stderr:ceph-fuse[42674]: starting fuse 2024-09-10T08:29:09.015 INFO:teuthology.orchestra.run.smithi154.stdout:42 2024-09-10T08:29:09.015 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-09-10T08:29:09.015 DEBUG:teuthology.orchestra.run.smithi154:> sudo stdin-killer -- python3 -c ' 2024-09-10T08:29:09.015 DEBUG:teuthology.orchestra.run.smithi154:> import glob 2024-09-10T08:29:09.015 DEBUG:teuthology.orchestra.run.smithi154:> import re 2024-09-10T08:29:09.015 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-09-10T08:29:09.015 DEBUG:teuthology.orchestra.run.smithi154:> import subprocess 2024-09-10T08:29:09.016 DEBUG:teuthology.orchestra.run.smithi154:> 2024-09-10T08:29:09.016 DEBUG:teuthology.orchestra.run.smithi154:> def _find_admin_socket(client_name): 2024-09-10T08:29:09.016 DEBUG:teuthology.orchestra.run.smithi154:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-10T08:29:09.016 DEBUG:teuthology.orchestra.run.smithi154:> files = glob.glob(asok_path) 2024-09-10T08:29:09.016 DEBUG:teuthology.orchestra.run.smithi154:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-10T08:29:09.016 DEBUG:teuthology.orchestra.run.smithi154:> 2024-09-10T08:29:09.016 DEBUG:teuthology.orchestra.run.smithi154:> # Given a non-glob path, it better be there 2024-09-10T08:29:09.016 DEBUG:teuthology.orchestra.run.smithi154:> if "*" not in asok_path: 2024-09-10T08:29:09.016 DEBUG:teuthology.orchestra.run.smithi154:> assert(len(files) == 1) 2024-09-10T08:29:09.016 DEBUG:teuthology.orchestra.run.smithi154:> return files[0] 2024-09-10T08:29:09.016 DEBUG:teuthology.orchestra.run.smithi154:> 2024-09-10T08:29:09.016 DEBUG:teuthology.orchestra.run.smithi154:> for f in files: 2024-09-10T08:29:09.016 DEBUG:teuthology.orchestra.run.smithi154:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T08:29:09.016 DEBUG:teuthology.orchestra.run.smithi154:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T08:29:09.016 DEBUG:teuthology.orchestra.run.smithi154:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T08:29:09.017 DEBUG:teuthology.orchestra.run.smithi154:> contents = proc_f.read() 2024-09-10T08:29:09.017 DEBUG:teuthology.orchestra.run.smithi154:> if mountpoint in contents: 2024-09-10T08:29:09.017 DEBUG:teuthology.orchestra.run.smithi154:> return f 2024-09-10T08:29:09.017 DEBUG:teuthology.orchestra.run.smithi154:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T08:29:09.017 DEBUG:teuthology.orchestra.run.smithi154:> 2024-09-10T08:29:09.017 DEBUG:teuthology.orchestra.run.smithi154:> print(_find_admin_socket("client.1")) 2024-09-10T08:29:09.017 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-09-10T08:29:09.133 INFO:teuthology.orchestra.run.smithi154.stdout:/var/run/ceph/ceph-client.1.42674.asok 2024-09-10T08:29:09.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T08:29:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:09.143 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.42674.asok 2024-09-10T08:29:09.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:09.144 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.42674.asok status 2024-09-10T08:29:09.280 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-10T08:29:09.280 INFO:teuthology.orchestra.run.smithi154.stdout: "metadata": { 2024-09-10T08:29:09.280 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_sha1": "1cf819b7212a6048e92fc78c4eff963344f6d56b", 2024-09-10T08:29:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)", 2024-09-10T08:29:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "entity_id": "1", 2024-09-10T08:29:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "hostname": "smithi154", 2024-09-10T08:29:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-10T08:29:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "pid": "42674", 2024-09-10T08:29:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "root": "/" 2024-09-10T08:29:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T08:29:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "dentry_count": 0, 2024-09-10T08:29:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "dentry_pinned_count": 0, 2024-09-10T08:29:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 4636, 2024-09-10T08:29:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "inst": { 2024-09-10T08:29:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "name": { 2024-09-10T08:29:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "client", 2024-09-10T08:29:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: "num": 4636 2024-09-10T08:29:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T08:29:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": { 2024-09-10T08:29:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2024-09-10T08:29:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "192.168.0.1:0", 2024-09-10T08:29:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 1716413109 2024-09-10T08:29:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T08:29:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T08:29:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": { 2024-09-10T08:29:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2024-09-10T08:29:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "192.168.0.1:0", 2024-09-10T08:29:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 1716413109 2024-09-10T08:29:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T08:29:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: "inst_str": "client.4636 192.168.0.1:0/1716413109", 2024-09-10T08:29:09.283 INFO:teuthology.orchestra.run.smithi154.stdout: "addr_str": "192.168.0.1:0/1716413109", 2024-09-10T08:29:09.283 INFO:teuthology.orchestra.run.smithi154.stdout: "inode_count": 1, 2024-09-10T08:29:09.283 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_epoch": 11, 2024-09-10T08:29:09.283 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_epoch": 25, 2024-09-10T08:29:09.283 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_epoch_barrier": 0, 2024-09-10T08:29:09.283 INFO:teuthology.orchestra.run.smithi154.stdout: "blocklisted": false, 2024-09-10T08:29:09.283 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "b" 2024-09-10T08:29:09.283 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-10T08:29:09.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:09.290 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2024-09-10T08:29:09.290 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T08:29:09.309 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2024-09-10T08:29:09.310 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T08:29:09.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:09.310 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:29:09.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:09.380 DEBUG:teuthology.orchestra.run.smithi154:> stat --file-system '--printf=%T 2024-09-10T08:29:09.380 DEBUG:teuthology.orchestra.run.smithi154:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-10T08:29:09.397 INFO:teuthology.orchestra.run.smithi154.stdout:fuseblk 2024-09-10T08:29:09.397 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-10T08:29:09.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:09.398 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T08:29:09.464 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-09-10T08:29:09.481 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-09-10T08:29:09.481 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:29:09.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.589+0000 7f3dc854b640 1 Processor -- start 2024-09-10T08:29:09.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.589+0000 7f3dc854b640 1 -- start start 2024-09-10T08:29:09.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.590+0000 7f3dc854b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3dc0153de0 0x7f3dc00ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.590+0000 7f3dc854b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3dc01598c0 0x7f3dc0159d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.590+0000 7f3dc854b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dc00cab80 con 0x7f3dc006bbe0 2024-09-10T08:29:09.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.590+0000 7f3dc854b640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f3dc00c9480 con 0x7f3dc01598c0 2024-09-10T08:29:09.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.590+0000 7f3dc854b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3dc00cb620 con 0x7f3dc0153de0 2024-09-10T08:29:09.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.590+0000 7f3dc6ae8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3dc01598c0 0x7f3dc0159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.590+0000 7f3dc5ae6640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3dc006bbe0 0x7f3dc006c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40088/0 (socket says 172.21.15.103:40088) 2024-09-10T08:29:09.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.590+0000 7f3dc5ae6640 1 -- 172.21.15.103:0/3662098862 learned_addr learned my addr 172.21.15.103:0/3662098862 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:29:09.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.590+0000 7f3dc62e7640 1 --2- 172.21.15.103:0/3662098862 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3dc0153de0 0x7f3dc00ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.590+0000 7f3dc6ae8640 1 -- 172.21.15.103:0/3662098862 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3dc0153de0 msgr2=0x7f3dc00ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:09.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.590+0000 7f3dc6ae8640 1 --2- 172.21.15.103:0/3662098862 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3dc0153de0 0x7f3dc00ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.590+0000 7f3dc6ae8640 1 -- 172.21.15.103:0/3662098862 >> v1:172.21.15.103:6789/0 conn(0x7f3dc006bbe0 legacy=0x7f3dc006c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:09.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.590+0000 7f3dc52e5640 1 -- 172.21.15.103:0/3662098862 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2531766807 0 0) 0x7f3db0001110 con 0x7f3dc006bbe0 2024-09-10T08:29:09.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.590+0000 7f3dc6ae8640 1 -- 172.21.15.103:0/3662098862 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc00c6b20 con 0x7f3dc01598c0 2024-09-10T08:29:09.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.591+0000 7f3dc6ae8640 1 --2- 172.21.15.103:0/3662098862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc01598c0 0x7f3dc0159d70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc009d90 tx=0x7f3dbc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc1bc951d831f05 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:09.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.591+0000 7f3dc52e5640 1 -- 172.21.15.103:0/3662098862 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc007740 con 0x7f3dc01598c0 2024-09-10T08:29:09.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.591+0000 7f3dc52e5640 1 -- 172.21.15.103:0/3662098862 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dbc0078e0 con 0x7f3dc01598c0 2024-09-10T08:29:09.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.591+0000 7f3dc52e5640 1 -- 172.21.15.103:0/3662098862 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc007cb0 con 0x7f3dc01598c0 2024-09-10T08:29:09.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.591+0000 7f3dc854b640 1 -- 172.21.15.103:0/3662098862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc01598c0 msgr2=0x7f3dc0159d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:09.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.591+0000 7f3dc854b640 1 --2- 172.21.15.103:0/3662098862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc01598c0 0x7f3dc0159d70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc009d90 tx=0x7f3dbc02a660 comp rx=0 tx=0).stop 2024-09-10T08:29:09.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.592+0000 7f3dc854b640 1 -- 172.21.15.103:0/3662098862 shutdown_connections 2024-09-10T08:29:09.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.592+0000 7f3dc854b640 1 --2- 172.21.15.103:0/3662098862 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc01598c0 0x7f3dc0159d70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.592+0000 7f3dc854b640 1 --2- 172.21.15.103:0/3662098862 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3dc0153de0 0x7f3dc00ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.592+0000 7f3dc854b640 1 -- 172.21.15.103:0/3662098862 >> 172.21.15.103:0/3662098862 conn(0x7f3dc00c8800 msgr2=0x7f3dc00c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:09.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.592+0000 7f3dc854b640 1 -- 172.21.15.103:0/3662098862 shutdown_connections 2024-09-10T08:29:09.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.592+0000 7f3dc854b640 1 -- 172.21.15.103:0/3662098862 wait complete. 2024-09-10T08:29:09.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.593+0000 7f3dc854b640 1 Processor -- start 2024-09-10T08:29:09.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.593+0000 7f3dc854b640 1 -- start start 2024-09-10T08:29:09.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.593+0000 7f3dc854b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dc006bbe0 0x7f3dc014dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.593+0000 7f3dc854b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc0153de0 0x7f3dc014e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.593+0000 7f3dc854b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3dc01598c0 0x7f3dc0143ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.593+0000 7f3dc854b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc00cbab0 con 0x7f3dc0153de0 2024-09-10T08:29:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.593+0000 7f3dc854b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc00c70e0 con 0x7f3dc006bbe0 2024-09-10T08:29:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.593+0000 7f3dc854b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3dc015a2b0 con 0x7f3dc01598c0 2024-09-10T08:29:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.594+0000 7f3dc5ae6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc0153de0 0x7f3dc014e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.594+0000 7f3dc5ae6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc0153de0 0x7f3dc014e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60774/0 (socket says 172.21.15.103:60774) 2024-09-10T08:29:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.594+0000 7f3dc5ae6640 1 -- 172.21.15.103:0/948950194 learned_addr learned my addr 172.21.15.103:0/948950194 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.594+0000 7f3dc6ae8640 1 --2- 172.21.15.103:0/948950194 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3dc01598c0 0x7f3dc0143ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.594+0000 7f3dc62e7640 1 --2- 172.21.15.103:0/948950194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dc006bbe0 0x7f3dc014dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.594+0000 7f3dc5ae6640 1 -- 172.21.15.103:0/948950194 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3dc01598c0 msgr2=0x7f3dc0143ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.594+0000 7f3dc5ae6640 1 --2- 172.21.15.103:0/948950194 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3dc01598c0 0x7f3dc0143ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.594+0000 7f3dc5ae6640 1 -- 172.21.15.103:0/948950194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dc006bbe0 msgr2=0x7f3dc014dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.594+0000 7f3dc5ae6640 1 --2- 172.21.15.103:0/948950194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dc006bbe0 0x7f3dc014dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.594+0000 7f3dc5ae6640 1 -- 172.21.15.103:0/948950194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc0157700 con 0x7f3dc0153de0 2024-09-10T08:29:09.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.594+0000 7f3dc5ae6640 1 --2- 172.21.15.103:0/948950194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc0153de0 0x7f3dc014e180 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3db000c780 tx=0x7f3db000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:09.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.594+0000 7f3db6ffd640 1 -- 172.21.15.103:0/948950194 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db0018070 con 0x7f3dc0153de0 2024-09-10T08:29:09.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.594+0000 7f3db6ffd640 1 -- 172.21.15.103:0/948950194 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3db00072d0 con 0x7f3dc0153de0 2024-09-10T08:29:09.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.594+0000 7f3dc854b640 1 -- 172.21.15.103:0/948950194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dc01579e0 con 0x7f3dc0153de0 2024-09-10T08:29:09.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.594+0000 7f3db6ffd640 1 -- 172.21.15.103:0/948950194 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db00047e0 con 0x7f3dc0153de0 2024-09-10T08:29:09.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.594+0000 7f3dc854b640 1 -- 172.21.15.103:0/948950194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dc0157fa0 con 0x7f3dc0153de0 2024-09-10T08:29:09.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.595+0000 7f3dc854b640 1 -- 172.21.15.103:0/948950194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dc00ca640 con 0x7f3dc0153de0 2024-09-10T08:29:09.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.596+0000 7f3db6ffd640 1 -- 172.21.15.103:0/948950194 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3db001b070 con 0x7f3dc0153de0 2024-09-10T08:29:09.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.596+0000 7f3db6ffd640 1 --2- 172.21.15.103:0/948950194 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3da406be30 0x7f3da406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.596+0000 7f3db6ffd640 1 -- 172.21.15.103:0/948950194 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f3db008a380 con 0x7f3dc0153de0 2024-09-10T08:29:09.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.596+0000 7f3dc62e7640 1 --2- 172.21.15.103:0/948950194 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3da406be30 0x7f3da406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.597+0000 7f3dc62e7640 1 --2- 172.21.15.103:0/948950194 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3da406be30 0x7f3da406e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3db8009b40 tx=0x7f3db8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:09.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.601+0000 7f3db6ffd640 1 -- 172.21.15.103:0/948950194 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3dc00cab80 con 0x7f3dc0153de0 2024-09-10T08:29:09.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.768+0000 7f3dc854b640 1 -- 172.21.15.103:0/948950194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3dc00c9600 con 0x7f3dc0153de0 2024-09-10T08:29:09.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.770+0000 7f3db6ffd640 1 -- 172.21.15.103:0/948950194 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20499 (secure 0 0 0) 0x7f3db0058440 con 0x7f3dc0153de0 2024-09-10T08:29:09.769 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:29:09.769 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","created":"2024-09-10T08:28:12.654957+0000","modified":"2024-09-10T08:28:48.615871+0000","last_up_change":"2024-09-10T08:28:25.445753+0000","last_in_change":"2024-09-10T08:28:14.741133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:24.821696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-10T08:28:33.488154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-10T08:28:33.857868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-10T08:28:44.793084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-10T08:28:45.930823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1abe08f4-0348-435e-9f97-cec00e96992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6809","nonce":2707863099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6811","nonce":2707863099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6815","nonce":2707863099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6813","nonce":2707863099}]},"public_addr":"172.21.15.103:6809/2707863099","cluster_addr":"172.21.15.103:6811/2707863099","heartbeat_back_addr":"172.21.15.103:6815/2707863099","heartbeat_front_addr":"172.21.15.103:6813/2707863099","state":["exists","up"]},{"osd":1,"uuid":"df342e58-1026-4739-82f6-7a216707444c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6818","nonce":4029892782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6822","nonce":4029892782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6830","nonce":4029892782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6826","nonce":4029892782}]},"public_addr":"172.21.15.103:6818/4029892782","cluster_addr":"172.21.15.103:6822/4029892782","heartbeat_back_addr":"172.21.15.103:6830/4029892782","heartbeat_front_addr":"172.21.15.103:6826/4029892782","state":["exists","up"]},{"osd":2,"uuid":"f7aea2cf-208c-41ed-a0f6-8948d70b9a0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6819","nonce":428484432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6821","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6823","nonce":428484432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6829","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6831","nonce":428484432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6825","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6827","nonce":428484432}]},"public_addr":"172.21.15.103:6819/428484432","cluster_addr":"172.21.15.103:6823/428484432","heartbeat_back_addr":"172.21.15.103:6831/428484432","heartbeat_front_addr":"172.21.15.103:6827/428484432","state":["exists","up"]},{"osd":3,"uuid":"615ef8b0-12a5-4503-96d0-f7ec17dbc792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6801","nonce":3453676282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6803","nonce":3453676282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6807","nonce":3453676282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6805","nonce":3453676282}]},"public_addr":"172.21.15.103:6801/3453676282","cluster_addr":"172.21.15.103:6803/3453676282","heartbeat_back_addr":"172.21.15.103:6807/3453676282","heartbeat_front_addr":"172.21.15.103:6805/3453676282","state":["exists","up"]},{"osd":4,"uuid":"644c5e94-db18-4b83-b5cd-3762ae2647a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6809","nonce":1808157069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6811","nonce":1808157069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6815","nonce":1808157069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6813","nonce":1808157069}]},"public_addr":"172.21.15.154:6809/1808157069","cluster_addr":"172.21.15.154:6811/1808157069","heartbeat_back_addr":"172.21.15.154:6815/1808157069","heartbeat_front_addr":"172.21.15.154:6813/1808157069","state":["exists","up"]},{"osd":5,"uuid":"f40210bd-f4ca-442e-baac-729ced5a9f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6817","nonce":1048015779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6819","nonce":1048015779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6823","nonce":1048015779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6821","nonce":1048015779}]},"public_addr":"172.21.15.154:6817/1048015779","cluster_addr":"172.21.15.154:6819/1048015779","heartbeat_back_addr":"172.21.15.154:6823/1048015779","heartbeat_front_addr":"172.21.15.154:6821/1048015779","state":["exists","up"]},{"osd":6,"uuid":"eebac31e-aaef-47b0-90d7-4af08f36d7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6801","nonce":345273812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6803","nonce":345273812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6807","nonce":345273812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6805","nonce":345273812}]},"public_addr":"172.21.15.154:6801/345273812","cluster_addr":"172.21.15.154:6803/345273812","heartbeat_back_addr":"172.21.15.154:6807/345273812","heartbeat_front_addr":"172.21.15.154:6805/345273812","state":["exists","up"]},{"osd":7,"uuid":"58406c9a-036f-4618-bfb6-0beddbd71605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6825","nonce":3439481239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6827","nonce":3439481239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6831","nonce":3439481239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6829","nonce":3439481239}]},"public_addr":"172.21.15.154:6825/3439481239","cluster_addr":"172.21.15.154:6827/3439481239","heartbeat_back_addr":"172.21.15.154:6831/3439481239","heartbeat_front_addr":"172.21.15.154:6829/3439481239","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.032718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.126448+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.781158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.808718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.050591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.038245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.586989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.223326+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:29:09.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.771+0000 7f3dc854b640 1 -- 172.21.15.103:0/948950194 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3da406be30 msgr2=0x7f3da406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:09.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.771+0000 7f3dc854b640 1 --2- 172.21.15.103:0/948950194 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3da406be30 0x7f3da406e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3db8009b40 tx=0x7f3db8009190 comp rx=0 tx=0).stop 2024-09-10T08:29:09.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.771+0000 7f3dc854b640 1 -- 172.21.15.103:0/948950194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc0153de0 msgr2=0x7f3dc014e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:09.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.771+0000 7f3dc854b640 1 --2- 172.21.15.103:0/948950194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc0153de0 0x7f3dc014e180 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3db000c780 tx=0x7f3db000cc40 comp rx=0 tx=0).stop 2024-09-10T08:29:09.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.772+0000 7f3dc854b640 1 -- 172.21.15.103:0/948950194 shutdown_connections 2024-09-10T08:29:09.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.772+0000 7f3dc854b640 1 --2- 172.21.15.103:0/948950194 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3da406be30 0x7f3da406e2f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.772+0000 7f3dc854b640 1 --2- 172.21.15.103:0/948950194 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3dc01598c0 0x7f3dc0143ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.772+0000 7f3dc854b640 1 --2- 172.21.15.103:0/948950194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc0153de0 0x7f3dc014e180 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.772+0000 7f3dc854b640 1 --2- 172.21.15.103:0/948950194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dc006bbe0 0x7f3dc014dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.772+0000 7f3dc854b640 1 -- 172.21.15.103:0/948950194 >> 172.21.15.103:0/948950194 conn(0x7f3dc00c8800 msgr2=0x7f3dc006c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:09.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.772+0000 7f3dc854b640 1 -- 172.21.15.103:0/948950194 shutdown_connections 2024-09-10T08:29:09.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.772+0000 7f3dc854b640 1 -- 172.21.15.103:0/948950194 wait complete. 2024-09-10T08:29:09.782 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T08:28:24.821696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-09-10T08:28:33.488154+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-09-10T08:28:33.857868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-09-10T08:28:44.793084+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-09-10T08:28:45.930823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T08:29:09.782 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T08:29:09.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.885+0000 7f981b70a640 1 Processor -- start 2024-09-10T08:29:09.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.885+0000 7f981b70a640 1 -- start start 2024-09-10T08:29:09.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.886+0000 7f981b70a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f98140c2d20 0x7f98140c31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.886+0000 7f981b70a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98140c2560 con 0x7f98140a6f60 2024-09-10T08:29:09.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.886+0000 7f981b70a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9814156cf0 con 0x7f98141506f0 2024-09-10T08:29:09.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.886+0000 7f981b70a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9814156fd0 con 0x7f98140c2d20 2024-09-10T08:29:09.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.886+0000 7f9818ca5640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f98140a6f60 0x7f98140c6a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40094/0 (socket says 172.21.15.103:40094) 2024-09-10T08:29:09.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.886+0000 7f9818ca5640 1 -- 172.21.15.103:0/261590680 learned_addr learned my addr 172.21.15.103:0/261590680 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:29:09.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.886+0000 7f9819ca7640 1 --2- 172.21.15.103:0/261590680 >> v2:172.21.15.154:3300/0 conn(0x7f98140c2d20 0x7f98140c31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.886+0000 7f980bfff640 1 -- 172.21.15.103:0/261590680 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4251324204 0 0) 0x7f98140c2560 con 0x7f98140a6f60 2024-09-10T08:29:09.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.886+0000 7f980bfff640 1 -- 172.21.15.103:0/261590680 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9800003520 con 0x7f98140a6f60 2024-09-10T08:29:09.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.886+0000 7f980bfff640 1 -- 172.21.15.103:0/261590680 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1130429841 0 0) 0x7f9800003520 con 0x7f98140a6f60 2024-09-10T08:29:09.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.886+0000 7f980bfff640 1 -- 172.21.15.103:0/261590680 >> v2:172.21.15.154:3300/0 conn(0x7f98140c2d20 msgr2=0x7f98140c31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:09.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.886+0000 7f980bfff640 1 --2- 172.21.15.103:0/261590680 >> v2:172.21.15.154:3300/0 conn(0x7f98140c2d20 0x7f98140c31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.886+0000 7f980bfff640 1 -- 172.21.15.103:0/261590680 >> v1:172.21.15.154:6789/0 conn(0x7f98141506f0 legacy=0x7f98141564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:09.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.886+0000 7f980bfff640 1 -- 172.21.15.103:0/261590680 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98141572b0 con 0x7f98140a6f60 2024-09-10T08:29:09.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.886+0000 7f980bfff640 1 -- 172.21.15.103:0/261590680 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f9804001670 con 0x7f98140a6f60 2024-09-10T08:29:09.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.886+0000 7f980bfff640 1 -- 172.21.15.103:0/261590680 >> v1:172.21.15.103:6789/0 conn(0x7f98140a6f60 legacy=0x7f98140c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:09.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.886+0000 7f980bfff640 1 --2- 172.21.15.103:0/261590680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98000039b0 0x7f9800003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.886+0000 7f980bfff640 1 --2- 172.21.15.103:0/261590680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9800004800 0x7f9800004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.886+0000 7f980bfff640 1 --2- 172.21.15.103:0/261590680 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98000052e0 0x7f980000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.886+0000 7f980bfff640 1 -- 172.21.15.103:0/261590680 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9814156fd0 con 0x7f98000039b0 2024-09-10T08:29:09.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.886+0000 7f980bfff640 1 -- 172.21.15.103:0/261590680 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f980000c1b0 con 0x7f9800004800 2024-09-10T08:29:09.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.887+0000 7f980bfff640 1 -- 172.21.15.103:0/261590680 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f980000c3b0 con 0x7f98000052e0 2024-09-10T08:29:09.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.887+0000 7f9819ca7640 1 --2- 172.21.15.103:0/261590680 >> v2:172.21.15.154:3300/0 conn(0x7f98140c2d20 0x7f98140c31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:29:09.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.887+0000 7f98194a6640 1 --2- 172.21.15.103:0/261590680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98000039b0 0x7f9800003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.887+0000 7f9818ca5640 1 --2- 172.21.15.103:0/261590680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9800004800 0x7f9800004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.887+0000 7f9819ca7640 1 --2- 172.21.15.103:0/261590680 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98000052e0 0x7f980000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.887+0000 7f98194a6640 1 -- 172.21.15.103:0/261590680 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98000052e0 msgr2=0x7f980000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:09.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.887+0000 7f98194a6640 1 --2- 172.21.15.103:0/261590680 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98000052e0 0x7f980000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.887+0000 7f98194a6640 1 -- 172.21.15.103:0/261590680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9800004800 msgr2=0x7f9800004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:09.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.887+0000 7f98194a6640 1 --2- 172.21.15.103:0/261590680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9800004800 0x7f9800004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.887+0000 7f98194a6640 1 -- 172.21.15.103:0/261590680 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9800003520 con 0x7f98000039b0 2024-09-10T08:29:09.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.887+0000 7f9818ca5640 1 --2- 172.21.15.103:0/261590680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9800004800 0x7f9800004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:09.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.887+0000 7f9819ca7640 1 -- 172.21.15.103:0/261590680 reap_dead start 2024-09-10T08:29:09.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.887+0000 7f98194a6640 1 --2- 172.21.15.103:0/261590680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98000039b0 0x7f9800003dd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9810001720 tx=0x7f9800005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b54d1400d98fca8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:09.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.888+0000 7f980bfff640 1 -- 172.21.15.103:0/261590680 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9810001370 con 0x7f98000039b0 2024-09-10T08:29:09.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.888+0000 7f980bfff640 1 -- 172.21.15.103:0/261590680 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98100052d0 con 0x7f98000039b0 2024-09-10T08:29:09.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.888+0000 7f980bfff640 1 -- 172.21.15.103:0/261590680 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981002ab90 con 0x7f98000039b0 2024-09-10T08:29:09.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.888+0000 7f981b70a640 1 -- 172.21.15.103:0/261590680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98000039b0 msgr2=0x7f9800003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:09.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.888+0000 7f981b70a640 1 --2- 172.21.15.103:0/261590680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98000039b0 0x7f9800003dd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9810001720 tx=0x7f9800005830 comp rx=0 tx=0).stop 2024-09-10T08:29:09.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.888+0000 7f981b70a640 1 -- 172.21.15.103:0/261590680 shutdown_connections 2024-09-10T08:29:09.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.888+0000 7f981b70a640 1 --2- 172.21.15.103:0/261590680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98000039b0 0x7f9800003dd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.888+0000 7f981b70a640 1 -- 172.21.15.103:0/261590680 >> 172.21.15.103:0/261590680 conn(0x7f981406c210 msgr2=0x7f98140c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:09.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.888+0000 7f981b70a640 1 -- 172.21.15.103:0/261590680 shutdown_connections 2024-09-10T08:29:09.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.888+0000 7f981b70a640 1 -- 172.21.15.103:0/261590680 wait complete. 2024-09-10T08:29:09.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.889+0000 7f981b70a640 1 Processor -- start 2024-09-10T08:29:09.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.889+0000 7f981b70a640 1 -- start start 2024-09-10T08:29:09.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.890+0000 7f981b70a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98000039b0 0x7f98140a7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.890+0000 7f981b70a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98140a9d50 0x7f98140ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.890+0000 7f981b70a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9814155810 0x7f9814155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.890+0000 7f981b70a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9814150ad0 con 0x7f98140a9d50 2024-09-10T08:29:09.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.890+0000 7f981b70a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f98140c3cd0 con 0x7f98000039b0 2024-09-10T08:29:09.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.890+0000 7f981b70a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f98141564a0 con 0x7f9814155810 2024-09-10T08:29:09.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.890+0000 7f9818ca5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98140a9d50 0x7f98140ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.890+0000 7f9818ca5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98140a9d50 0x7f98140ac920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60792/0 (socket says 172.21.15.103:60792) 2024-09-10T08:29:09.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.890+0000 7f9818ca5640 1 -- 172.21.15.103:0/542313937 learned_addr learned my addr 172.21.15.103:0/542313937 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:09.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.890+0000 7f98194a6640 1 --2- 172.21.15.103:0/542313937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98000039b0 0x7f98140a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.890+0000 7f9819ca7640 1 --2- 172.21.15.103:0/542313937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9814155810 0x7f9814155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.890+0000 7f9818ca5640 1 -- 172.21.15.103:0/542313937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9814155810 msgr2=0x7f9814155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:09.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.890+0000 7f9818ca5640 1 --2- 172.21.15.103:0/542313937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9814155810 0x7f9814155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.890+0000 7f9818ca5640 1 -- 172.21.15.103:0/542313937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98000039b0 msgr2=0x7f98140a7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:09.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.890+0000 7f9818ca5640 1 --2- 172.21.15.103:0/542313937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98000039b0 0x7f98140a7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.890+0000 7f9818ca5640 1 -- 172.21.15.103:0/542313937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98140c1d60 con 0x7f98140a9d50 2024-09-10T08:29:09.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.890+0000 7f9819ca7640 1 --2- 172.21.15.103:0/542313937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9814155810 0x7f9814155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:09.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.891+0000 7f9818ca5640 1 --2- 172.21.15.103:0/542313937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98140a9d50 0x7f98140ac920 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f980400e790 tx=0x7f980400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:09.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.891+0000 7f9809ffb640 1 -- 172.21.15.103:0/542313937 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980400c660 con 0x7f98140a9d50 2024-09-10T08:29:09.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.891+0000 7f9809ffb640 1 -- 172.21.15.103:0/542313937 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9804018070 con 0x7f98140a9d50 2024-09-10T08:29:09.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.891+0000 7f981b70a640 1 -- 172.21.15.103:0/542313937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98140a7ca0 con 0x7f98140a9d50 2024-09-10T08:29:09.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.891+0000 7f9809ffb640 1 -- 172.21.15.103:0/542313937 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980400ca00 con 0x7f98140a9d50 2024-09-10T08:29:09.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.891+0000 7f981b70a640 1 -- 172.21.15.103:0/542313937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98140ab770 con 0x7f98140a9d50 2024-09-10T08:29:09.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.892+0000 7f981b70a640 1 -- 172.21.15.103:0/542313937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98140ac610 con 0x7f98140a9d50 2024-09-10T08:29:09.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.892+0000 7f9809ffb640 1 -- 172.21.15.103:0/542313937 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f980400cba0 con 0x7f98140a9d50 2024-09-10T08:29:09.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.893+0000 7f9809ffb640 1 --2- 172.21.15.103:0/542313937 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f97f806be60 0x7f97f806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.893+0000 7f9809ffb640 1 -- 172.21.15.103:0/542313937 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f980408aa70 con 0x7f98140a9d50 2024-09-10T08:29:09.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.893+0000 7f98194a6640 1 --2- 172.21.15.103:0/542313937 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f97f806be60 0x7f97f806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.893+0000 7f98194a6640 1 --2- 172.21.15.103:0/542313937 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f97f806be60 0x7f97f806e320 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9810032000 tx=0x7f981002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:09.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:09.897+0000 7f9809ffb640 1 -- 172.21.15.103:0/542313937 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9804059180 con 0x7f98140a9d50 2024-09-10T08:29:10.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.066+0000 7f981b70a640 1 -- 172.21.15.103:0/542313937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9814156830 con 0x7f98140a9d50 2024-09-10T08:29:10.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.066+0000 7f9809ffb640 1 -- 172.21.15.103:0/542313937 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f9804058a80 con 0x7f98140a9d50 2024-09-10T08:29:10.066 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2024-09-10T08:29:10.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.068+0000 7f981b70a640 1 -- 172.21.15.103:0/542313937 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f97f806be60 msgr2=0x7f97f806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:10.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.068+0000 7f981b70a640 1 --2- 172.21.15.103:0/542313937 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f97f806be60 0x7f97f806e320 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9810032000 tx=0x7f981002e000 comp rx=0 tx=0).stop 2024-09-10T08:29:10.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.068+0000 7f981b70a640 1 -- 172.21.15.103:0/542313937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98140a9d50 msgr2=0x7f98140ac920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:10.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.068+0000 7f981b70a640 1 --2- 172.21.15.103:0/542313937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98140a9d50 0x7f98140ac920 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f980400e790 tx=0x7f980400ec50 comp rx=0 tx=0).stop 2024-09-10T08:29:10.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.068+0000 7f981b70a640 1 -- 172.21.15.103:0/542313937 shutdown_connections 2024-09-10T08:29:10.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.068+0000 7f981b70a640 1 --2- 172.21.15.103:0/542313937 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f97f806be60 0x7f97f806e320 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.068+0000 7f981b70a640 1 --2- 172.21.15.103:0/542313937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9814155810 0x7f9814155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.068+0000 7f981b70a640 1 --2- 172.21.15.103:0/542313937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98140a9d50 0x7f98140ac920 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.068+0000 7f981b70a640 1 --2- 172.21.15.103:0/542313937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98000039b0 0x7f98140a7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.068+0000 7f981b70a640 1 -- 172.21.15.103:0/542313937 >> 172.21.15.103:0/542313937 conn(0x7f981406c210 msgr2=0x7f98140c63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:10.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.068+0000 7f981b70a640 1 -- 172.21.15.103:0/542313937 shutdown_connections 2024-09-10T08:29:10.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.068+0000 7f981b70a640 1 -- 172.21.15.103:0/542313937 wait complete. 2024-09-10T08:29:10.079 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-09-10T08:29:10.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.182+0000 7fb8dde5e640 1 Processor -- start 2024-09-10T08:29:10.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.182+0000 7fb8dde5e640 1 -- start start 2024-09-10T08:29:10.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.183+0000 7fb8dde5e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8d80a92f0 0x7fb8d8071210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:10.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.183+0000 7fb8dde5e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb8d81580d0 0x7fb8d8154150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:10.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.183+0000 7fb8dde5e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8d81585d0 con 0x7fb8d80a8f10 2024-09-10T08:29:10.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.183+0000 7fb8dde5e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d80c4730 con 0x7fb8d81580d0 2024-09-10T08:29:10.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.183+0000 7fb8dde5e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d8074280 con 0x7fb8d80a92f0 2024-09-10T08:29:10.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.183+0000 7fb8d77fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb8d80a8f10 0x7fb8d80c6690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40108/0 (socket says 172.21.15.103:40108) 2024-09-10T08:29:10.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.183+0000 7fb8d77fe640 1 -- 172.21.15.103:0/672588210 learned_addr learned my addr 172.21.15.103:0/672588210 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:29:10.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.183+0000 7fb8d6ffd640 1 --2- 172.21.15.103:0/672588210 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8d80a92f0 0x7fb8d8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:10.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.183+0000 7fb8d7fff640 1 --2- 172.21.15.103:0/672588210 >> v2:172.21.15.154:3300/0 conn(0x7fb8d81580d0 0x7fb8d8154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:10.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.183+0000 7fb8d67fc640 1 -- 172.21.15.103:0/672588210 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1395679542 0 0) 0x7fb8c8001490 con 0x7fb8d80a8f10 2024-09-10T08:29:10.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.183+0000 7fb8d67fc640 1 -- 172.21.15.103:0/672588210 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8c0003520 con 0x7fb8d80a8f10 2024-09-10T08:29:10.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.183+0000 7fb8d67fc640 1 -- 172.21.15.103:0/672588210 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2273568074 0 0) 0x7fb8c0003520 con 0x7fb8d80a8f10 2024-09-10T08:29:10.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.183+0000 7fb8d6ffd640 1 -- 172.21.15.103:0/672588210 >> v2:172.21.15.154:3300/0 conn(0x7fb8d81580d0 msgr2=0x7fb8d8154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:10.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.183+0000 7fb8d6ffd640 1 --2- 172.21.15.103:0/672588210 >> v2:172.21.15.154:3300/0 conn(0x7fb8d81580d0 0x7fb8d8154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.183+0000 7fb8d6ffd640 1 -- 172.21.15.103:0/672588210 >> v1:172.21.15.103:6789/0 conn(0x7fb8d80a8f10 legacy=0x7fb8d80c6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:10.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.183+0000 7fb8d6ffd640 1 -- 172.21.15.103:0/672588210 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d8074560 con 0x7fb8d80a92f0 2024-09-10T08:29:10.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.183+0000 7fb8d7fff640 1 --2- 172.21.15.103:0/672588210 >> v2:172.21.15.154:3300/0 conn(0x7fb8d81580d0 0x7fb8d8154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:29:10.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.184+0000 7fb8d6ffd640 1 --2- 172.21.15.103:0/672588210 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8d80a92f0 0x7fb8d8071210 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0097a0 tx=0x7fb8cc02a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8ddcb1c4f0ec47f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:10.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.184+0000 7fb8d67fc640 1 -- 172.21.15.103:0/672588210 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc037070 con 0x7fb8d80a92f0 2024-09-10T08:29:10.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.184+0000 7fb8d67fc640 1 -- 172.21.15.103:0/672588210 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8cc02aa90 con 0x7fb8d80a92f0 2024-09-10T08:29:10.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.184+0000 7fb8d67fc640 1 -- 172.21.15.103:0/672588210 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8001bc0 con 0x7fb8d80a92f0 2024-09-10T08:29:10.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.185+0000 7fb8dde5e640 1 -- 172.21.15.103:0/672588210 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8d80a92f0 msgr2=0x7fb8d8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:10.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.185+0000 7fb8dde5e640 1 --2- 172.21.15.103:0/672588210 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8d80a92f0 0x7fb8d8071210 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0097a0 tx=0x7fb8cc02a000 comp rx=0 tx=0).stop 2024-09-10T08:29:10.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.185+0000 7fb8dde5e640 1 -- 172.21.15.103:0/672588210 shutdown_connections 2024-09-10T08:29:10.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.185+0000 7fb8dde5e640 1 --2- 172.21.15.103:0/672588210 >> v2:172.21.15.154:3300/0 conn(0x7fb8d81580d0 0x7fb8d8154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.185+0000 7fb8dde5e640 1 --2- 172.21.15.103:0/672588210 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8d80a92f0 0x7fb8d8071210 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.185+0000 7fb8dde5e640 1 -- 172.21.15.103:0/672588210 >> 172.21.15.103:0/672588210 conn(0x7fb8d80c9c00 msgr2=0x7fb8d80ca010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:10.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.185+0000 7fb8dde5e640 1 -- 172.21.15.103:0/672588210 shutdown_connections 2024-09-10T08:29:10.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.185+0000 7fb8dde5e640 1 -- 172.21.15.103:0/672588210 wait complete. 2024-09-10T08:29:10.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.186+0000 7fb8dde5e640 1 Processor -- start 2024-09-10T08:29:10.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.186+0000 7fb8dde5e640 1 -- start start 2024-09-10T08:29:10.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.187+0000 7fb8dde5e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8d80a8f10 0x7fb8d8153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:10.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.187+0000 7fb8dde5e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8d80a92f0 0x7fb8d81509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:10.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.187+0000 7fb8dde5e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8d81580d0 0x7fb8d8150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:10.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.187+0000 7fb8dde5e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d80c6f20 con 0x7fb8d80a8f10 2024-09-10T08:29:10.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.187+0000 7fb8dde5e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d80c6da0 con 0x7fb8d80a92f0 2024-09-10T08:29:10.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.187+0000 7fb8dde5e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d80c7cd0 con 0x7fb8d81580d0 2024-09-10T08:29:10.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.187+0000 7fb8d77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8d80a8f10 0x7fb8d8153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:10.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.187+0000 7fb8d77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8d80a8f10 0x7fb8d8153aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60802/0 (socket says 172.21.15.103:60802) 2024-09-10T08:29:10.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.187+0000 7fb8d77fe640 1 -- 172.21.15.103:0/1787551247 learned_addr learned my addr 172.21.15.103:0/1787551247 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:10.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.187+0000 7fb8d6ffd640 1 --2- 172.21.15.103:0/1787551247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8d80a92f0 0x7fb8d81509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:10.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.187+0000 7fb8d7fff640 1 --2- 172.21.15.103:0/1787551247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8d81580d0 0x7fb8d8150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:10.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.187+0000 7fb8d77fe640 1 -- 172.21.15.103:0/1787551247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8d81580d0 msgr2=0x7fb8d8150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:10.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.187+0000 7fb8d77fe640 1 --2- 172.21.15.103:0/1787551247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8d81580d0 0x7fb8d8150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.187+0000 7fb8d77fe640 1 -- 172.21.15.103:0/1787551247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8d80a92f0 msgr2=0x7fb8d81509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:10.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.187+0000 7fb8d77fe640 1 --2- 172.21.15.103:0/1787551247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8d80a92f0 0x7fb8d81509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.187+0000 7fb8d77fe640 1 -- 172.21.15.103:0/1787551247 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d81ed970 con 0x7fb8d80a8f10 2024-09-10T08:29:10.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.187+0000 7fb8d77fe640 1 --2- 172.21.15.103:0/1787551247 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8d80a8f10 0x7fb8d8153aa0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800cc50 tx=0x7fb8c800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:10.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.188+0000 7fb8bffff640 1 -- 172.21.15.103:0/1787551247 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8017070 con 0x7fb8d80a8f10 2024-09-10T08:29:10.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.188+0000 7fb8bffff640 1 -- 172.21.15.103:0/1787551247 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c8012400 con 0x7fb8d80a8f10 2024-09-10T08:29:10.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.188+0000 7fb8dde5e640 1 -- 172.21.15.103:0/1787551247 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d8151450 con 0x7fb8d80a8f10 2024-09-10T08:29:10.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.188+0000 7fb8bffff640 1 -- 172.21.15.103:0/1787551247 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c800ce60 con 0x7fb8d80a8f10 2024-09-10T08:29:10.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.188+0000 7fb8dde5e640 1 -- 172.21.15.103:0/1787551247 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d8153fe0 con 0x7fb8d80a8f10 2024-09-10T08:29:10.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.189+0000 7fb8dde5e640 1 -- 172.21.15.103:0/1787551247 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d81573b0 con 0x7fb8d80a8f10 2024-09-10T08:29:10.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.189+0000 7fb8bffff640 1 -- 172.21.15.103:0/1787551247 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb8c801a070 con 0x7fb8d80a8f10 2024-09-10T08:29:10.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.190+0000 7fb8bffff640 1 --2- 172.21.15.103:0/1787551247 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb8c406be30 0x7fb8c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:10.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.190+0000 7fb8bffff640 1 -- 172.21.15.103:0/1787551247 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fb8c808b0d0 con 0x7fb8d80a8f10 2024-09-10T08:29:10.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.190+0000 7fb8d6ffd640 1 --2- 172.21.15.103:0/1787551247 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb8c406be30 0x7fb8c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:10.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.190+0000 7fb8d6ffd640 1 --2- 172.21.15.103:0/1787551247 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb8c406be30 0x7fb8c406e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc034000 tx=0x7fb8cc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:10.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.194+0000 7fb8bffff640 1 -- 172.21.15.103:0/1787551247 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb8d81585d0 con 0x7fb8d80a8f10 2024-09-10T08:29:10.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.362+0000 7fb8dde5e640 1 -- 172.21.15.103:0/1787551247 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7fb8d80c4ba0 con 0x7fb8d80a8f10 2024-09-10T08:29:10.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.362+0000 7fb8bffff640 1 -- 172.21.15.103:0/1787551247 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v25) ==== 99+0+11 (secure 0 0 0) 0x7fb8c8059070 con 0x7fb8d80a8f10 2024-09-10T08:29:10.362 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 32 2024-09-10T08:29:10.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.364+0000 7fb8dde5e640 1 -- 172.21.15.103:0/1787551247 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb8c406be30 msgr2=0x7fb8c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:10.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.364+0000 7fb8dde5e640 1 --2- 172.21.15.103:0/1787551247 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb8c406be30 0x7fb8c406e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc034000 tx=0x7fb8cc02e000 comp rx=0 tx=0).stop 2024-09-10T08:29:10.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.364+0000 7fb8dde5e640 1 -- 172.21.15.103:0/1787551247 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8d80a8f10 msgr2=0x7fb8d8153aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:10.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.364+0000 7fb8dde5e640 1 --2- 172.21.15.103:0/1787551247 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8d80a8f10 0x7fb8d8153aa0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800cc50 tx=0x7fb8c800a430 comp rx=0 tx=0).stop 2024-09-10T08:29:10.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.364+0000 7fb8dde5e640 1 -- 172.21.15.103:0/1787551247 shutdown_connections 2024-09-10T08:29:10.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.364+0000 7fb8dde5e640 1 --2- 172.21.15.103:0/1787551247 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb8c406be30 0x7fb8c406e2f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.364+0000 7fb8dde5e640 1 --2- 172.21.15.103:0/1787551247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8d81580d0 0x7fb8d8150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.364+0000 7fb8dde5e640 1 --2- 172.21.15.103:0/1787551247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8d80a92f0 0x7fb8d81509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.364+0000 7fb8dde5e640 1 --2- 172.21.15.103:0/1787551247 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8d80a8f10 0x7fb8d8153aa0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.364+0000 7fb8dde5e640 1 -- 172.21.15.103:0/1787551247 >> 172.21.15.103:0/1787551247 conn(0x7fb8d80c9c00 msgr2=0x7fb8d80c9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:10.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.364+0000 7fb8dde5e640 1 -- 172.21.15.103:0/1787551247 shutdown_connections 2024-09-10T08:29:10.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.364+0000 7fb8dde5e640 1 -- 172.21.15.103:0/1787551247 wait complete. 2024-09-10T08:29:10.375 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-09-10T08:29:10.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.477+0000 7effbda04640 1 Processor -- start 2024-09-10T08:29:10.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.477+0000 7effbda04640 1 -- start start 2024-09-10T08:29:10.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.478+0000 7effbda04640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7effb806fbb0 0x7effb806e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:10.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.478+0000 7effbda04640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7effb806ff90 0x7effb806eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:10.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.478+0000 7effbda04640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb80c7180 con 0x7effb80c7f00 2024-09-10T08:29:10.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.478+0000 7effbda04640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7effb80c7a70 con 0x7effb806fbb0 2024-09-10T08:29:10.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.478+0000 7effbda04640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7effb8154ef0 con 0x7effb806ff90 2024-09-10T08:29:10.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.478+0000 7effb6ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7effb806fbb0 0x7effb806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:10.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.478+0000 7effb6ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7effb806fbb0 0x7effb806e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60808/0 (socket says 172.21.15.103:60808) 2024-09-10T08:29:10.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.478+0000 7effb6ffd640 1 -- 172.21.15.103:0/597129143 learned_addr learned my addr 172.21.15.103:0/597129143 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:10.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.478+0000 7effaffff640 1 --2- 172.21.15.103:0/597129143 >> v2:172.21.15.154:3300/0 conn(0x7effb806ff90 0x7effb806eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:10.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.478+0000 7effb6ffd640 1 -- 172.21.15.103:0/597129143 >> v2:172.21.15.154:3300/0 conn(0x7effb806ff90 msgr2=0x7effb806eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:10.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.478+0000 7effb6ffd640 1 --2- 172.21.15.103:0/597129143 >> v2:172.21.15.154:3300/0 conn(0x7effb806ff90 0x7effb806eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.478+0000 7effb6ffd640 1 -- 172.21.15.103:0/597129143 >> v1:172.21.15.154:6789/0 conn(0x7effb80c7f00 legacy=0x7effb8157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:10.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.478+0000 7effb6ffd640 1 -- 172.21.15.103:0/597129143 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb80c7420 con 0x7effb806fbb0 2024-09-10T08:29:10.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.478+0000 7effaffff640 1 --2- 172.21.15.103:0/597129143 >> v2:172.21.15.154:3300/0 conn(0x7effb806ff90 0x7effb806eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:10.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.479+0000 7effb6ffd640 1 --2- 172.21.15.103:0/597129143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effb806fbb0 0x7effb806e980 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7effb80c3570 tx=0x7effa802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4aba5c8af9f228 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:10.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.479+0000 7effb67fc640 1 -- 172.21.15.103:0/597129143 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa8037070 con 0x7effb806fbb0 2024-09-10T08:29:10.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.479+0000 7effb67fc640 1 -- 172.21.15.103:0/597129143 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa8032440 con 0x7effb806fbb0 2024-09-10T08:29:10.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.479+0000 7effb67fc640 1 -- 172.21.15.103:0/597129143 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa8032810 con 0x7effb806fbb0 2024-09-10T08:29:10.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.479+0000 7effbda04640 1 -- 172.21.15.103:0/597129143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effb806fbb0 msgr2=0x7effb806e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:10.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.479+0000 7effbda04640 1 --2- 172.21.15.103:0/597129143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effb806fbb0 0x7effb806e980 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7effb80c3570 tx=0x7effa802a1e0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.479+0000 7effbda04640 1 -- 172.21.15.103:0/597129143 shutdown_connections 2024-09-10T08:29:10.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.479+0000 7effbda04640 1 --2- 172.21.15.103:0/597129143 >> v2:172.21.15.154:3300/0 conn(0x7effb806ff90 0x7effb806eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.479+0000 7effbda04640 1 --2- 172.21.15.103:0/597129143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effb806fbb0 0x7effb806e980 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.479+0000 7effbda04640 1 -- 172.21.15.103:0/597129143 >> 172.21.15.103:0/597129143 conn(0x7effb80c9190 msgr2=0x7effb80aa800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:10.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.480+0000 7effbda04640 1 -- 172.21.15.103:0/597129143 shutdown_connections 2024-09-10T08:29:10.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.480+0000 7effbda04640 1 -- 172.21.15.103:0/597129143 wait complete. 2024-09-10T08:29:10.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.481+0000 7effbda04640 1 Processor -- start 2024-09-10T08:29:10.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.481+0000 7effbda04640 1 -- start start 2024-09-10T08:29:10.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.481+0000 7effbda04640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effb806fbb0 0x7effb81ecae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:10.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.481+0000 7effbda04640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effb806ff90 0x7effb814dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:10.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.481+0000 7effbda04640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effb80c7f00 0x7effb814e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:10.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.481+0000 7effbda04640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7effb80c6ee0 con 0x7effb80c7f00 2024-09-10T08:29:10.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.481+0000 7effbda04640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7effb80c6d60 con 0x7effb806ff90 2024-09-10T08:29:10.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.481+0000 7effbda04640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7effb8154b30 con 0x7effb806fbb0 2024-09-10T08:29:10.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.481+0000 7effb77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effb80c7f00 0x7effb814e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:10.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.481+0000 7effb77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effb80c7f00 0x7effb814e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60820/0 (socket says 172.21.15.103:60820) 2024-09-10T08:29:10.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.481+0000 7effb77fe640 1 -- 172.21.15.103:0/3721489838 learned_addr learned my addr 172.21.15.103:0/3721489838 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:10.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.481+0000 7effaffff640 1 --2- 172.21.15.103:0/3721489838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effb806ff90 0x7effb814dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:10.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.481+0000 7effb6ffd640 1 --2- 172.21.15.103:0/3721489838 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effb806fbb0 0x7effb81ecae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:10.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.482+0000 7effb77fe640 1 -- 172.21.15.103:0/3721489838 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effb806fbb0 msgr2=0x7effb81ecae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:10.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.482+0000 7effb77fe640 1 --2- 172.21.15.103:0/3721489838 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effb806fbb0 0x7effb81ecae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.482+0000 7effb77fe640 1 -- 172.21.15.103:0/3721489838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effb806ff90 msgr2=0x7effb814dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:10.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.482+0000 7effb77fe640 1 --2- 172.21.15.103:0/3721489838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effb806ff90 0x7effb814dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.482+0000 7effb77fe640 1 -- 172.21.15.103:0/3721489838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb80be560 con 0x7effb80c7f00 2024-09-10T08:29:10.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.482+0000 7effb77fe640 1 --2- 172.21.15.103:0/3721489838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effb80c7f00 0x7effb814e190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7effb000c730 tx=0x7effb000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:10.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.482+0000 7effb4ff9640 1 -- 172.21.15.103:0/3721489838 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb0003b70 con 0x7effb80c7f00 2024-09-10T08:29:10.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.482+0000 7effb4ff9640 1 -- 172.21.15.103:0/3721489838 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effb0003d10 con 0x7effb80c7f00 2024-09-10T08:29:10.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.482+0000 7effbda04640 1 -- 172.21.15.103:0/3721489838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb81ed4d0 con 0x7effb80c7f00 2024-09-10T08:29:10.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.482+0000 7effb4ff9640 1 -- 172.21.15.103:0/3721489838 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb000aa90 con 0x7effb80c7f00 2024-09-10T08:29:10.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.482+0000 7effbda04640 1 -- 172.21.15.103:0/3721489838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb8157ea0 con 0x7effb80c7f00 2024-09-10T08:29:10.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.483+0000 7effbda04640 1 -- 172.21.15.103:0/3721489838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb80c42a0 con 0x7effb80c7f00 2024-09-10T08:29:10.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.484+0000 7effb4ff9640 1 -- 172.21.15.103:0/3721489838 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7effb000ac30 con 0x7effb80c7f00 2024-09-10T08:29:10.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.484+0000 7effb4ff9640 1 --2- 172.21.15.103:0/3721489838 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7eff9806be30 0x7eff9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:10.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.484+0000 7effb4ff9640 1 -- 172.21.15.103:0/3721489838 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7effb008aed0 con 0x7effb80c7f00 2024-09-10T08:29:10.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.484+0000 7effb6ffd640 1 --2- 172.21.15.103:0/3721489838 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7eff9806be30 0x7eff9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:10.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.484+0000 7effb6ffd640 1 --2- 172.21.15.103:0/3721489838 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7eff9806be30 0x7eff9806e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7effa8034000 tx=0x7effa802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:10.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.488+0000 7effb4ff9640 1 -- 172.21.15.103:0/3721489838 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7effb0058f90 con 0x7effb80c7f00 2024-09-10T08:29:10.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.655+0000 7effbda04640 1 -- 172.21.15.103:0/3721489838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7effb8074630 con 0x7effb80c7f00 2024-09-10T08:29:10.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.655+0000 7effb4ff9640 1 -- 172.21.15.103:0/3721489838 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v25) ==== 95+0+11 (secure 0 0 0) 0x7effb005d290 con 0x7effb80c7f00 2024-09-10T08:29:10.655 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 64 2024-09-10T08:29:10.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.657+0000 7effbda04640 1 -- 172.21.15.103:0/3721489838 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7eff9806be30 msgr2=0x7eff9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:10.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.657+0000 7effbda04640 1 --2- 172.21.15.103:0/3721489838 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7eff9806be30 0x7eff9806e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7effa8034000 tx=0x7effa802e000 comp rx=0 tx=0).stop 2024-09-10T08:29:10.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.657+0000 7effbda04640 1 -- 172.21.15.103:0/3721489838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effb80c7f00 msgr2=0x7effb814e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:10.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.657+0000 7effbda04640 1 --2- 172.21.15.103:0/3721489838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effb80c7f00 0x7effb814e190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7effb000c730 tx=0x7effb000cbf0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.657+0000 7effbda04640 1 -- 172.21.15.103:0/3721489838 shutdown_connections 2024-09-10T08:29:10.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.657+0000 7effbda04640 1 --2- 172.21.15.103:0/3721489838 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7eff9806be30 0x7eff9806e2f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.657+0000 7effbda04640 1 --2- 172.21.15.103:0/3721489838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effb80c7f00 0x7effb814e190 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.657+0000 7effbda04640 1 --2- 172.21.15.103:0/3721489838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effb806ff90 0x7effb814dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.657+0000 7effbda04640 1 --2- 172.21.15.103:0/3721489838 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effb806fbb0 0x7effb81ecae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.657+0000 7effbda04640 1 -- 172.21.15.103:0/3721489838 >> 172.21.15.103:0/3721489838 conn(0x7effb80c9190 msgr2=0x7effb80c2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:10.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.657+0000 7effbda04640 1 -- 172.21.15.103:0/3721489838 shutdown_connections 2024-09-10T08:29:10.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.657+0000 7effbda04640 1 -- 172.21.15.103:0/3721489838 wait complete. 2024-09-10T08:29:10.667 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-09-10T08:29:10.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.770+0000 7f9021778640 1 Processor -- start 2024-09-10T08:29:10.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.770+0000 7f9021778640 1 -- start start 2024-09-10T08:29:10.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.771+0000 7f9021778640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f901c153a40 0x7f901c06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:10.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.771+0000 7f9021778640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f901c06cbe0 0x7f901c0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:10.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.771+0000 7f9021778640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f901c0c80f0 0x7f901c156310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:10.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.771+0000 7f9021778640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f901c159900 con 0x7f901c0c80f0 2024-09-10T08:29:10.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.771+0000 7f9021778640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f901c159be0 con 0x7f901c153a40 2024-09-10T08:29:10.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.771+0000 7f9021778640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f901c159ec0 con 0x7f901c06cbe0 2024-09-10T08:29:10.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.771+0000 7f901b7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f901c0c80f0 0x7f901c156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:10.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.771+0000 7f901b7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f901c0c80f0 0x7f901c156310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60834/0 (socket says 172.21.15.103:60834) 2024-09-10T08:29:10.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.771+0000 7f901b7fe640 1 -- 172.21.15.103:0/1372876501 learned_addr learned my addr 172.21.15.103:0/1372876501 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:10.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.772+0000 7f901affd640 1 --2- 172.21.15.103:0/1372876501 >> v2:172.21.15.154:3300/0 conn(0x7f901c153a40 0x7f901c06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:10.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.772+0000 7f901a7fc640 1 --2- 172.21.15.103:0/1372876501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f901c06cbe0 0x7f901c0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:10.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.772+0000 7f901b7fe640 1 -- 172.21.15.103:0/1372876501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f901c06cbe0 msgr2=0x7f901c0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:10.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.772+0000 7f901b7fe640 1 --2- 172.21.15.103:0/1372876501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f901c06cbe0 0x7f901c0c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.772+0000 7f901b7fe640 1 -- 172.21.15.103:0/1372876501 >> v2:172.21.15.154:3300/0 conn(0x7f901c153a40 msgr2=0x7f901c06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:10.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.772+0000 7f901b7fe640 1 --2- 172.21.15.103:0/1372876501 >> v2:172.21.15.154:3300/0 conn(0x7f901c153a40 0x7f901c06c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.772+0000 7f901b7fe640 1 -- 172.21.15.103:0/1372876501 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901c15a1a0 con 0x7f901c0c80f0 2024-09-10T08:29:10.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.772+0000 7f901a7fc640 1 --2- 172.21.15.103:0/1372876501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f901c06cbe0 0x7f901c0c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:10.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.772+0000 7f901b7fe640 1 --2- 172.21.15.103:0/1372876501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f901c0c80f0 0x7f901c156310 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f901c0c9930 tx=0x7f901402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1251c01b2119fd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:10.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.773+0000 7f9019ffb640 1 -- 172.21.15.103:0/1372876501 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014037070 con 0x7f901c0c80f0 2024-09-10T08:29:10.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.773+0000 7f9019ffb640 1 -- 172.21.15.103:0/1372876501 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9014032440 con 0x7f901c0c80f0 2024-09-10T08:29:10.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.773+0000 7f9019ffb640 1 -- 172.21.15.103:0/1372876501 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014032810 con 0x7f901c0c80f0 2024-09-10T08:29:10.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.773+0000 7f9021778640 1 -- 172.21.15.103:0/1372876501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f901c0c80f0 msgr2=0x7f901c156310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:10.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.773+0000 7f9021778640 1 --2- 172.21.15.103:0/1372876501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f901c0c80f0 0x7f901c156310 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f901c0c9930 tx=0x7f901402a1e0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.773+0000 7f9021778640 1 -- 172.21.15.103:0/1372876501 shutdown_connections 2024-09-10T08:29:10.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.773+0000 7f9021778640 1 --2- 172.21.15.103:0/1372876501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f901c0c80f0 0x7f901c156310 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.773+0000 7f9021778640 1 --2- 172.21.15.103:0/1372876501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f901c06cbe0 0x7f901c0c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.773+0000 7f9021778640 1 --2- 172.21.15.103:0/1372876501 >> v2:172.21.15.154:3300/0 conn(0x7f901c153a40 0x7f901c06c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.773+0000 7f9021778640 1 -- 172.21.15.103:0/1372876501 >> 172.21.15.103:0/1372876501 conn(0x7f901c073310 msgr2=0x7f901c0736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:10.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.773+0000 7f9021778640 1 -- 172.21.15.103:0/1372876501 shutdown_connections 2024-09-10T08:29:10.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.773+0000 7f9021778640 1 -- 172.21.15.103:0/1372876501 wait complete. 2024-09-10T08:29:10.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.774+0000 7f9021778640 1 Processor -- start 2024-09-10T08:29:10.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.774+0000 7f9021778640 1 -- start start 2024-09-10T08:29:10.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.775+0000 7f9021778640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f901c06cbe0 0x7f901c0c0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:10.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.775+0000 7f9021778640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f901c0c80f0 0x7f901c1eb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:10.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.775+0000 7f9021778640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f901c153a40 0x7f901c0af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:10.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.775+0000 7f9021778640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f901c153e20 con 0x7f901c06cbe0 2024-09-10T08:29:10.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.775+0000 7f9021778640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f901c0c9270 con 0x7f901c0c80f0 2024-09-10T08:29:10.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.775+0000 7f9021778640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f901c153fa0 con 0x7f901c153a40 2024-09-10T08:29:10.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.775+0000 7f901affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f901c06cbe0 0x7f901c0c0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:10.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.775+0000 7f901affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f901c06cbe0 0x7f901c0c0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60848/0 (socket says 172.21.15.103:60848) 2024-09-10T08:29:10.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.775+0000 7f901affd640 1 -- 172.21.15.103:0/3399160830 learned_addr learned my addr 172.21.15.103:0/3399160830 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:10.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.775+0000 7f901a7fc640 1 --2- 172.21.15.103:0/3399160830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f901c0c80f0 0x7f901c1eb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:10.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.775+0000 7f901b7fe640 1 --2- 172.21.15.103:0/3399160830 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f901c153a40 0x7f901c0af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:10.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.775+0000 7f901affd640 1 -- 172.21.15.103:0/3399160830 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f901c153a40 msgr2=0x7f901c0af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:10.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.775+0000 7f901affd640 1 --2- 172.21.15.103:0/3399160830 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f901c153a40 0x7f901c0af7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.775+0000 7f901affd640 1 -- 172.21.15.103:0/3399160830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f901c0c80f0 msgr2=0x7f901c1eb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:10.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.775+0000 7f901affd640 1 --2- 172.21.15.103:0/3399160830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f901c0c80f0 0x7f901c1eb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.775+0000 7f901affd640 1 -- 172.21.15.103:0/3399160830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901c1ec1f0 con 0x7f901c06cbe0 2024-09-10T08:29:10.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.776+0000 7f901affd640 1 --2- 172.21.15.103:0/3399160830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f901c06cbe0 0x7f901c0c0da0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f900c007ef0 tx=0x7f900c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:10.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.776+0000 7f90037fe640 1 -- 172.21.15.103:0/3399160830 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c014620 con 0x7f901c06cbe0 2024-09-10T08:29:10.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.776+0000 7f90037fe640 1 -- 172.21.15.103:0/3399160830 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f900c019070 con 0x7f901c06cbe0 2024-09-10T08:29:10.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.776+0000 7f9021778640 1 -- 172.21.15.103:0/3399160830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f901c154320 con 0x7f901c06cbe0 2024-09-10T08:29:10.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.776+0000 7f90037fe640 1 -- 172.21.15.103:0/3399160830 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c014a00 con 0x7f901c06cbe0 2024-09-10T08:29:10.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.776+0000 7f9021778640 1 -- 172.21.15.103:0/3399160830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f901c14dde0 con 0x7f901c06cbe0 2024-09-10T08:29:10.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.777+0000 7f9021778640 1 -- 172.21.15.103:0/3399160830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f901c0c7bb0 con 0x7f901c06cbe0 2024-09-10T08:29:10.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.777+0000 7f90037fe640 1 -- 172.21.15.103:0/3399160830 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f900c014ba0 con 0x7f901c06cbe0 2024-09-10T08:29:10.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.778+0000 7f90037fe640 1 --2- 172.21.15.103:0/3399160830 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f900806be30 0x7f900806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:10.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.778+0000 7f90037fe640 1 -- 172.21.15.103:0/3399160830 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f900c08b8f0 con 0x7f901c06cbe0 2024-09-10T08:29:10.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.778+0000 7f901a7fc640 1 --2- 172.21.15.103:0/3399160830 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f900806be30 0x7f900806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:10.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.778+0000 7f901a7fc640 1 --2- 172.21.15.103:0/3399160830 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f900806be30 0x7f900806e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f901c1576b0 tx=0x7f9010008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:10.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.782+0000 7f90037fe640 1 -- 172.21.15.103:0/3399160830 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f900c0599b0 con 0x7f901c06cbe0 2024-09-10T08:29:10.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.949+0000 7f9021778640 1 -- 172.21.15.103:0/3399160830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f901c0c9d60 con 0x7f901c06cbe0 2024-09-10T08:29:10.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.949+0000 7f90037fe640 1 -- 172.21.15.103:0/3399160830 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v25) ==== 99+0+11 (secure 0 0 0) 0x7f900c05dcb0 con 0x7f901c06cbe0 2024-09-10T08:29:10.949 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 32 2024-09-10T08:29:10.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.951+0000 7f9021778640 1 -- 172.21.15.103:0/3399160830 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f900806be30 msgr2=0x7f900806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:10.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.951+0000 7f9021778640 1 --2- 172.21.15.103:0/3399160830 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f900806be30 0x7f900806e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f901c1576b0 tx=0x7f9010008040 comp rx=0 tx=0).stop 2024-09-10T08:29:10.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.951+0000 7f9021778640 1 -- 172.21.15.103:0/3399160830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f901c06cbe0 msgr2=0x7f901c0c0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:10.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.951+0000 7f9021778640 1 --2- 172.21.15.103:0/3399160830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f901c06cbe0 0x7f901c0c0da0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f900c007ef0 tx=0x7f900c00e4b0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.951+0000 7f9021778640 1 -- 172.21.15.103:0/3399160830 shutdown_connections 2024-09-10T08:29:10.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.951+0000 7f9021778640 1 --2- 172.21.15.103:0/3399160830 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f900806be30 0x7f900806e2f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.951+0000 7f9021778640 1 --2- 172.21.15.103:0/3399160830 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f901c153a40 0x7f901c0af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.951+0000 7f9021778640 1 --2- 172.21.15.103:0/3399160830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f901c0c80f0 0x7f901c1eb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.951+0000 7f9021778640 1 --2- 172.21.15.103:0/3399160830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f901c06cbe0 0x7f901c0c0da0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:10.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.951+0000 7f9021778640 1 -- 172.21.15.103:0/3399160830 >> 172.21.15.103:0/3399160830 conn(0x7f901c073310 msgr2=0x7f901c0736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:10.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.952+0000 7f9021778640 1 -- 172.21.15.103:0/3399160830 shutdown_connections 2024-09-10T08:29:10.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:10.952+0000 7f9021778640 1 -- 172.21.15.103:0/3399160830 wait complete. 2024-09-10T08:29:10.962 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-09-10T08:29:11.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.065+0000 7fcbd1b31640 1 Processor -- start 2024-09-10T08:29:11.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.065+0000 7fcbd1b31640 1 -- start start 2024-09-10T08:29:11.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.065+0000 7fcbd1b31640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcbcc0a9460 0x7fcbcc06fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:11.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.065+0000 7fcbd1b31640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbcc0c48c0 0x7fcbcc0c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:11.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.065+0000 7fcbd1b31640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbcc0c8890 con 0x7fcbcc0c8080 2024-09-10T08:29:11.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.065+0000 7fcbd1b31640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fcbcc073d30 con 0x7fcbcc0a9460 2024-09-10T08:29:11.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.065+0000 7fcbd1b31640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcbcc073770 con 0x7fcbcc0c48c0 2024-09-10T08:29:11.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.066+0000 7fcbcbfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbcc0c48c0 0x7fcbcc0c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.066+0000 7fcbcaffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcbcc0a9460 0x7fcbcc06fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.066+0000 7fcbcaffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcbcc0a9460 0x7fcbcc06fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:43084/0 (socket says 172.21.15.103:43084) 2024-09-10T08:29:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.066+0000 7fcbcbfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbcc0c48c0 0x7fcbcc0c4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:39496/0 (socket says 172.21.15.103:39496) 2024-09-10T08:29:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.066+0000 7fcbcaffd640 1 -- 172.21.15.103:0/3648403755 learned_addr learned my addr 172.21.15.103:0/3648403755 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.066+0000 7fcbcb7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcbcc0c8080 0x7fcbcc06f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:54062/0 (socket says 172.21.15.103:54062) 2024-09-10T08:29:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.066+0000 7fcbcaffd640 1 -- 172.21.15.103:0/3648403755 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbcc0c48c0 msgr2=0x7fcbcc0c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.066+0000 7fcbcaffd640 1 --2- 172.21.15.103:0/3648403755 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbcc0c48c0 0x7fcbcc0c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.066+0000 7fcbcaffd640 1 -- 172.21.15.103:0/3648403755 >> v1:172.21.15.154:6789/0 conn(0x7fcbcc0c8080 legacy=0x7fcbcc06f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.066+0000 7fcbca7fc640 1 -- 172.21.15.103:0/3648403755 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2878532282 0 0) 0x7fcbcc0c8890 con 0x7fcbcc0c8080 2024-09-10T08:29:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.066+0000 7fcbcaffd640 1 -- 172.21.15.103:0/3648403755 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbcc073a50 con 0x7fcbcc0a9460 2024-09-10T08:29:11.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.067+0000 7fcbcaffd640 1 --2- 172.21.15.103:0/3648403755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbcc0a9460 0x7fcbcc06fbd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0009870 tx=0x7fcbc002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a8ad7dc5898ea2d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:11.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.067+0000 7fcbca7fc640 1 -- 172.21.15.103:0/3648403755 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0037070 con 0x7fcbcc0a9460 2024-09-10T08:29:11.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.067+0000 7fcbca7fc640 1 -- 172.21.15.103:0/3648403755 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbc0032440 con 0x7fcbcc0a9460 2024-09-10T08:29:11.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.067+0000 7fcbca7fc640 1 -- 172.21.15.103:0/3648403755 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0032810 con 0x7fcbcc0a9460 2024-09-10T08:29:11.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.068+0000 7fcbd1b31640 1 -- 172.21.15.103:0/3648403755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbcc0a9460 msgr2=0x7fcbcc06fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:11.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.068+0000 7fcbd1b31640 1 --2- 172.21.15.103:0/3648403755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbcc0a9460 0x7fcbcc06fbd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0009870 tx=0x7fcbc002a270 comp rx=0 tx=0).stop 2024-09-10T08:29:11.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.068+0000 7fcbd1b31640 1 -- 172.21.15.103:0/3648403755 shutdown_connections 2024-09-10T08:29:11.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.068+0000 7fcbd1b31640 1 --2- 172.21.15.103:0/3648403755 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbcc0c48c0 0x7fcbcc0c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.068+0000 7fcbd1b31640 1 --2- 172.21.15.103:0/3648403755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbcc0a9460 0x7fcbcc06fbd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.068+0000 7fcbd1b31640 1 -- 172.21.15.103:0/3648403755 >> 172.21.15.103:0/3648403755 conn(0x7fcbcc0aba20 msgr2=0x7fcbcc0abe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:11.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.068+0000 7fcbd1b31640 1 -- 172.21.15.103:0/3648403755 shutdown_connections 2024-09-10T08:29:11.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.068+0000 7fcbd1b31640 1 -- 172.21.15.103:0/3648403755 wait complete. 2024-09-10T08:29:11.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.069+0000 7fcbd1b31640 1 Processor -- start 2024-09-10T08:29:11.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.069+0000 7fcbd1b31640 1 -- start start 2024-09-10T08:29:11.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.070+0000 7fcbd1b31640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbcc0a9460 0x7fcbcc06e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:11.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.070+0000 7fcbd1b31640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbcc0c48c0 0x7fcbcc1ecbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:11.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.070+0000 7fcbd1b31640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbcc0c8080 0x7fcbcc0a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:11.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.070+0000 7fcbd1b31640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcbcc0ac7a0 con 0x7fcbcc0c48c0 2024-09-10T08:29:11.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.070+0000 7fcbd1b31640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcbcc070110 con 0x7fcbcc0c8080 2024-09-10T08:29:11.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.070+0000 7fcbd1b31640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcbcc074420 con 0x7fcbcc0a9460 2024-09-10T08:29:11.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.070+0000 7fcbcaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbcc0c48c0 0x7fcbcc1ecbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:11.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.070+0000 7fcbcaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbcc0c48c0 0x7fcbcc1ecbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60860/0 (socket says 172.21.15.103:60860) 2024-09-10T08:29:11.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.070+0000 7fcbcaffd640 1 -- 172.21.15.103:0/2128712225 learned_addr learned my addr 172.21.15.103:0/2128712225 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:11.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.070+0000 7fcbcbfff640 1 --2- 172.21.15.103:0/2128712225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbcc0c8080 0x7fcbcc0a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:11.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.070+0000 7fcbcb7fe640 1 --2- 172.21.15.103:0/2128712225 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbcc0a9460 0x7fcbcc06e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:11.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.070+0000 7fcbcaffd640 1 -- 172.21.15.103:0/2128712225 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbcc0a9460 msgr2=0x7fcbcc06e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:11.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.070+0000 7fcbcaffd640 1 --2- 172.21.15.103:0/2128712225 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbcc0a9460 0x7fcbcc06e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.070+0000 7fcbcaffd640 1 -- 172.21.15.103:0/2128712225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbcc0c8080 msgr2=0x7fcbcc0a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:11.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.070+0000 7fcbcaffd640 1 --2- 172.21.15.103:0/2128712225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbcc0c8080 0x7fcbcc0a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.070+0000 7fcbcaffd640 1 -- 172.21.15.103:0/2128712225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbcc06e570 con 0x7fcbcc0c48c0 2024-09-10T08:29:11.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.070+0000 7fcbcb7fe640 1 --2- 172.21.15.103:0/2128712225 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbcc0a9460 0x7fcbcc06e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:11.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.070+0000 7fcbcaffd640 1 --2- 172.21.15.103:0/2128712225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbcc0c48c0 0x7fcbcc1ecbb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0035040 tx=0x7fcbc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:11.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.071+0000 7fcbb3fff640 1 -- 172.21.15.103:0/2128712225 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0037040 con 0x7fcbcc0c48c0 2024-09-10T08:29:11.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.071+0000 7fcbb3fff640 1 -- 172.21.15.103:0/2128712225 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbc0004030 con 0x7fcbcc0c48c0 2024-09-10T08:29:11.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.071+0000 7fcbd1b31640 1 -- 172.21.15.103:0/2128712225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbcc1ed0f0 con 0x7fcbcc0c48c0 2024-09-10T08:29:11.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.071+0000 7fcbb3fff640 1 -- 172.21.15.103:0/2128712225 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0004420 con 0x7fcbcc0c48c0 2024-09-10T08:29:11.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.071+0000 7fcbd1b31640 1 -- 172.21.15.103:0/2128712225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbcc06d830 con 0x7fcbcc0c48c0 2024-09-10T08:29:11.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.072+0000 7fcbd1b31640 1 -- 172.21.15.103:0/2128712225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbcc0c8460 con 0x7fcbcc0c48c0 2024-09-10T08:29:11.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.072+0000 7fcbb3fff640 1 -- 172.21.15.103:0/2128712225 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcbc003a070 con 0x7fcbcc0c48c0 2024-09-10T08:29:11.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.073+0000 7fcbb3fff640 1 --2- 172.21.15.103:0/2128712225 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcbb806be30 0x7fcbb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:11.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.073+0000 7fcbb3fff640 1 -- 172.21.15.103:0/2128712225 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fcbc00ab630 con 0x7fcbcc0c48c0 2024-09-10T08:29:11.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.073+0000 7fcbcb7fe640 1 --2- 172.21.15.103:0/2128712225 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcbb806be30 0x7fcbb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:11.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.073+0000 7fcbcb7fe640 1 --2- 172.21.15.103:0/2128712225 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcbb806be30 0x7fcbb806e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc000f60 tx=0x7fcbbc007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:11.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.077+0000 7fcbb3fff640 1 -- 172.21.15.103:0/2128712225 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcbc0041020 con 0x7fcbcc0c48c0 2024-09-10T08:29:11.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.241+0000 7fcbd1b31640 1 -- 172.21.15.103:0/2128712225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7fcbcc0a07f0 con 0x7fcbcc0c48c0 2024-09-10T08:29:11.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.241+0000 7fcbb3fff640 1 -- 172.21.15.103:0/2128712225 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v25) ==== 95+0+11 (secure 0 0 0) 0x7fcbc00796f0 con 0x7fcbcc0c48c0 2024-09-10T08:29:11.241 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 64 2024-09-10T08:29:11.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.243+0000 7fcbd1b31640 1 -- 172.21.15.103:0/2128712225 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcbb806be30 msgr2=0x7fcbb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:11.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.243+0000 7fcbd1b31640 1 --2- 172.21.15.103:0/2128712225 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcbb806be30 0x7fcbb806e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc000f60 tx=0x7fcbbc007c10 comp rx=0 tx=0).stop 2024-09-10T08:29:11.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.243+0000 7fcbd1b31640 1 -- 172.21.15.103:0/2128712225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbcc0c48c0 msgr2=0x7fcbcc1ecbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:11.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.243+0000 7fcbd1b31640 1 --2- 172.21.15.103:0/2128712225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbcc0c48c0 0x7fcbcc1ecbb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0035040 tx=0x7fcbc00046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.243+0000 7fcbd1b31640 1 -- 172.21.15.103:0/2128712225 shutdown_connections 2024-09-10T08:29:11.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.243+0000 7fcbd1b31640 1 --2- 172.21.15.103:0/2128712225 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcbb806be30 0x7fcbb806e2f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.243+0000 7fcbd1b31640 1 --2- 172.21.15.103:0/2128712225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbcc0c8080 0x7fcbcc0a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.243+0000 7fcbd1b31640 1 --2- 172.21.15.103:0/2128712225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbcc0c48c0 0x7fcbcc1ecbb0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.243+0000 7fcbd1b31640 1 --2- 172.21.15.103:0/2128712225 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbcc0a9460 0x7fcbcc06e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.243+0000 7fcbd1b31640 1 -- 172.21.15.103:0/2128712225 >> 172.21.15.103:0/2128712225 conn(0x7fcbcc0aba20 msgr2=0x7fcbcc0ab1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:11.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.244+0000 7fcbd1b31640 1 -- 172.21.15.103:0/2128712225 shutdown_connections 2024-09-10T08:29:11.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.244+0000 7fcbd1b31640 1 -- 172.21.15.103:0/2128712225 wait complete. 2024-09-10T08:29:11.254 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-09-10T08:29:11.254 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:29:11.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.353+0000 7fbd3c942640 1 Processor -- start 2024-09-10T08:29:11.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.353+0000 7fbd3c942640 1 -- start start 2024-09-10T08:29:11.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.354+0000 7fbd3c942640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbd381505f0 0x7fbd38153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:11.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.354+0000 7fbd3c942640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd380c69c0 0x7fbd380c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:11.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.354+0000 7fbd3c942640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd380c5940 con 0x7fbd380c2980 2024-09-10T08:29:11.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.354+0000 7fbd3c942640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fbd380c7860 con 0x7fbd381505f0 2024-09-10T08:29:11.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.354+0000 7fbd3c942640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fbd380c5c00 con 0x7fbd380c69c0 2024-09-10T08:29:11.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.354+0000 7fbd3659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbd381505f0 0x7fbd38153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:11.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.354+0000 7fbd35d9b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd380c69c0 0x7fbd380c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:11.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.354+0000 7fbd35d9b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd380c69c0 0x7fbd380c2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:39528/0 (socket says 172.21.15.103:39528) 2024-09-10T08:29:11.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.354+0000 7fbd36d9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbd380c2980 0x7fbd380c42b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:54068/0 (socket says 172.21.15.103:54068) 2024-09-10T08:29:11.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.354+0000 7fbd35d9b640 1 -- 172.21.15.103:0/164080028 learned_addr learned my addr 172.21.15.103:0/164080028 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:11.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.354+0000 7fbd3659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbd381505f0 0x7fbd38153910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:43090/0 (socket says 172.21.15.103:43090) 2024-09-10T08:29:11.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.355+0000 7fbd3659c640 1 -- 172.21.15.103:0/164080028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd380c69c0 msgr2=0x7fbd380c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:11.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.355+0000 7fbd3659c640 1 --2- 172.21.15.103:0/164080028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd380c69c0 0x7fbd380c2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.355+0000 7fbd3659c640 1 -- 172.21.15.103:0/164080028 >> v1:172.21.15.154:6789/0 conn(0x7fbd380c2980 legacy=0x7fbd380c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:11.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.355+0000 7fbd3659c640 1 -- 172.21.15.103:0/164080028 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd380c5ee0 con 0x7fbd381505f0 2024-09-10T08:29:11.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.355+0000 7fbd3559a640 1 -- 172.21.15.103:0/164080028 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 139543502 0 0) 0x7fbd380c5940 con 0x7fbd380c2980 2024-09-10T08:29:11.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.355+0000 7fbd35d9b640 1 --2- 172.21.15.103:0/164080028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd380c69c0 0x7fbd380c2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:29:11.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.355+0000 7fbd3659c640 1 --2- 172.21.15.103:0/164080028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd381505f0 0x7fbd38153910 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbd280097a0 tx=0x7fbd2802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=383986bcb094669b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:11.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.356+0000 7fbd3559a640 1 -- 172.21.15.103:0/164080028 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd28037070 con 0x7fbd381505f0 2024-09-10T08:29:11.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.356+0000 7fbd3559a640 1 -- 172.21.15.103:0/164080028 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd2802ae50 con 0x7fbd381505f0 2024-09-10T08:29:11.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.356+0000 7fbd3559a640 1 -- 172.21.15.103:0/164080028 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd28032660 con 0x7fbd381505f0 2024-09-10T08:29:11.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.356+0000 7fbd3c942640 1 -- 172.21.15.103:0/164080028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd381505f0 msgr2=0x7fbd38153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:11.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.356+0000 7fbd3c942640 1 --2- 172.21.15.103:0/164080028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd381505f0 0x7fbd38153910 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbd280097a0 tx=0x7fbd2802a100 comp rx=0 tx=0).stop 2024-09-10T08:29:11.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.356+0000 7fbd3c942640 1 -- 172.21.15.103:0/164080028 shutdown_connections 2024-09-10T08:29:11.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.356+0000 7fbd3c942640 1 --2- 172.21.15.103:0/164080028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd380c69c0 0x7fbd380c2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.356+0000 7fbd3c942640 1 --2- 172.21.15.103:0/164080028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd381505f0 0x7fbd38153910 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.356+0000 7fbd3c942640 1 -- 172.21.15.103:0/164080028 >> 172.21.15.103:0/164080028 conn(0x7fbd380c7a40 msgr2=0x7fbd380c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:11.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.356+0000 7fbd3c942640 1 -- 172.21.15.103:0/164080028 shutdown_connections 2024-09-10T08:29:11.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.356+0000 7fbd3c942640 1 -- 172.21.15.103:0/164080028 wait complete. 2024-09-10T08:29:11.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.358+0000 7fbd3c942640 1 Processor -- start 2024-09-10T08:29:11.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.358+0000 7fbd3c942640 1 -- start start 2024-09-10T08:29:11.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.358+0000 7fbd3c942640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd380c2980 0x7fbd38141f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:11.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.358+0000 7fbd3c942640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd381505f0 0x7fbd3814ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:11.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.358+0000 7fbd3c942640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd3814e2d0 0x7fbd3814f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:11.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.358+0000 7fbd3c942640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbd381509d0 con 0x7fbd380c2980 2024-09-10T08:29:11.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.358+0000 7fbd3c942640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbd380c64a0 con 0x7fbd381505f0 2024-09-10T08:29:11.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.358+0000 7fbd3c942640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fbd38150b50 con 0x7fbd3814e2d0 2024-09-10T08:29:11.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.358+0000 7fbd3659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd380c2980 0x7fbd38141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:11.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.358+0000 7fbd3659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd380c2980 0x7fbd38141f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60870/0 (socket says 172.21.15.103:60870) 2024-09-10T08:29:11.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.358+0000 7fbd3659c640 1 -- 172.21.15.103:0/1288148505 learned_addr learned my addr 172.21.15.103:0/1288148505 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:11.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.358+0000 7fbd35d9b640 1 --2- 172.21.15.103:0/1288148505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd381505f0 0x7fbd3814ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:11.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.359+0000 7fbd36d9d640 1 --2- 172.21.15.103:0/1288148505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd3814e2d0 0x7fbd3814f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:11.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.359+0000 7fbd3659c640 1 -- 172.21.15.103:0/1288148505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd3814e2d0 msgr2=0x7fbd3814f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:11.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.359+0000 7fbd3659c640 1 --2- 172.21.15.103:0/1288148505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd3814e2d0 0x7fbd3814f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.359+0000 7fbd3659c640 1 -- 172.21.15.103:0/1288148505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd381505f0 msgr2=0x7fbd3814ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:11.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.359+0000 7fbd3659c640 1 --2- 172.21.15.103:0/1288148505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd381505f0 0x7fbd3814ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.359+0000 7fbd3659c640 1 -- 172.21.15.103:0/1288148505 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd380ac4b0 con 0x7fbd380c2980 2024-09-10T08:29:11.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.359+0000 7fbd35d9b640 1 --2- 172.21.15.103:0/1288148505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd381505f0 0x7fbd3814ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:11.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.359+0000 7fbd3659c640 1 --2- 172.21.15.103:0/1288148505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd380c2980 0x7fbd38141f00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbd280098c0 tx=0x7fbd280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:11.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.359+0000 7fbd26ffd640 1 -- 172.21.15.103:0/1288148505 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd28041030 con 0x7fbd380c2980 2024-09-10T08:29:11.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.359+0000 7fbd26ffd640 1 -- 172.21.15.103:0/1288148505 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd2802ac50 con 0x7fbd380c2980 2024-09-10T08:29:11.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.359+0000 7fbd26ffd640 1 -- 172.21.15.103:0/1288148505 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd28037040 con 0x7fbd380c2980 2024-09-10T08:29:11.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.359+0000 7fbd3c942640 1 -- 172.21.15.103:0/1288148505 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd380ac750 con 0x7fbd380c2980 2024-09-10T08:29:11.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.359+0000 7fbd3c942640 1 -- 172.21.15.103:0/1288148505 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd38142440 con 0x7fbd380c2980 2024-09-10T08:29:11.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.360+0000 7fbd3c942640 1 -- 172.21.15.103:0/1288148505 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd380ac920 con 0x7fbd380c2980 2024-09-10T08:29:11.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.361+0000 7fbd26ffd640 1 -- 172.21.15.103:0/1288148505 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbd28044070 con 0x7fbd380c2980 2024-09-10T08:29:11.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.361+0000 7fbd26ffd640 1 --2- 172.21.15.103:0/1288148505 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbd1806be30 0x7fbd1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:11.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.361+0000 7fbd26ffd640 1 -- 172.21.15.103:0/1288148505 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fbd2802ae00 con 0x7fbd380c2980 2024-09-10T08:29:11.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.361+0000 7fbd35d9b640 1 --2- 172.21.15.103:0/1288148505 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbd1806be30 0x7fbd1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:11.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.361+0000 7fbd35d9b640 1 --2- 172.21.15.103:0/1288148505 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbd1806be30 0x7fbd1806e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009630 tx=0x7fbd2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:11.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.365+0000 7fbd26ffd640 1 -- 172.21.15.103:0/1288148505 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbd380ac920 con 0x7fbd380c2980 2024-09-10T08:29:11.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.526+0000 7fbd3c942640 1 -- 172.21.15.103:0/1288148505 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbd380c2440 con 0x7fbd1806be30 2024-09-10T08:29:11.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.537+0000 7fbd26ffd640 1 -- 172.21.15.103:0/1288148505 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490301 (secure 0 0 0) 0x7fbd380c2440 con 0x7fbd1806be30 2024-09-10T08:29:11.541 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:29:11.545 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T08:29:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.541+0000 7fbd3c942640 1 -- 172.21.15.103:0/1288148505 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbd1806be30 msgr2=0x7fbd1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.541+0000 7fbd3c942640 1 --2- 172.21.15.103:0/1288148505 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbd1806be30 0x7fbd1806e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009630 tx=0x7fbd2c008040 comp rx=0 tx=0).stop 2024-09-10T08:29:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.541+0000 7fbd3c942640 1 -- 172.21.15.103:0/1288148505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd380c2980 msgr2=0x7fbd38141f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.541+0000 7fbd3c942640 1 --2- 172.21.15.103:0/1288148505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd380c2980 0x7fbd38141f00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbd280098c0 tx=0x7fbd280046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.541+0000 7fbd3c942640 1 -- 172.21.15.103:0/1288148505 shutdown_connections 2024-09-10T08:29:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.541+0000 7fbd3c942640 1 --2- 172.21.15.103:0/1288148505 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbd1806be30 0x7fbd1806e2f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.541+0000 7fbd3c942640 1 --2- 172.21.15.103:0/1288148505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd3814e2d0 0x7fbd3814f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.541+0000 7fbd3c942640 1 --2- 172.21.15.103:0/1288148505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd381505f0 0x7fbd3814ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.541+0000 7fbd3c942640 1 --2- 172.21.15.103:0/1288148505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd380c2980 0x7fbd38141f00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.541+0000 7fbd3c942640 1 -- 172.21.15.103:0/1288148505 >> 172.21.15.103:0/1288148505 conn(0x7fbd380c7a40 msgr2=0x7fbd380c4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.541+0000 7fbd3c942640 1 -- 172.21.15.103:0/1288148505 shutdown_connections 2024-09-10T08:29:11.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.541+0000 7fbd3c942640 1 -- 172.21.15.103:0/1288148505 wait complete. 2024-09-10T08:29:11.551 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-09-10T08:29:10.801988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595631,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219536,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755184,"statfs":{"total":773094113280,"available":772869308416,"internally_reserved":0,"allocated":3383296,"data_stored":1999411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":443,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003345"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619978+0000","last_change":"2024-09-10T08:28:47.627476+0000","last_active":"2024-09-10T08:28:48.619978+0000","last_peered":"2024-09-10T08:28:48.619978+0000","last_clean":"2024-09-10T08:28:48.619978+0000","last_became_active":"2024-09-10T08:28:47.627217+0000","last_became_peered":"2024-09-10T08:28:47.627217+0000","last_unstale":"2024-09-10T08:28:48.619978+0000","last_undegraded":"2024-09-10T08:28:48.619978+0000","last_fullsized":"2024-09-10T08:28:48.619978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:25.152836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632023+0000","last_change":"2024-09-10T08:28:34.564816+0000","last_active":"2024-09-10T08:28:48.632023+0000","last_peered":"2024-09-10T08:28:48.632023+0000","last_clean":"2024-09-10T08:28:48.632023+0000","last_became_active":"2024-09-10T08:28:34.564545+0000","last_became_peered":"2024-09-10T08:28:34.564545+0000","last_unstale":"2024-09-10T08:28:48.632023+0000","last_undegraded":"2024-09-10T08:28:48.632023+0000","last_fullsized":"2024-09-10T08:28:48.632023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:34.365104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622355+0000","last_change":"2024-09-10T08:28:35.575267+0000","last_active":"2024-09-10T08:28:48.622355+0000","last_peered":"2024-09-10T08:28:48.622355+0000","last_clean":"2024-09-10T08:28:48.622355+0000","last_became_active":"2024-09-10T08:28:35.575019+0000","last_became_peered":"2024-09-10T08:28:35.575019+0000","last_unstale":"2024-09-10T08:28:48.622355+0000","last_undegraded":"2024-09-10T08:28:48.622355+0000","last_fullsized":"2024-09-10T08:28:48.622355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:00.810645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621493+0000","last_change":"2024-09-10T08:28:46.620227+0000","last_active":"2024-09-10T08:28:48.621493+0000","last_peered":"2024-09-10T08:28:48.621493+0000","last_clean":"2024-09-10T08:28:48.621493+0000","last_became_active":"2024-09-10T08:28:46.619540+0000","last_became_peered":"2024-09-10T08:28:46.619540+0000","last_unstale":"2024-09-10T08:28:48.621493+0000","last_undegraded":"2024-09-10T08:28:48.621493+0000","last_fullsized":"2024-09-10T08:28:48.621493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:13.402155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633949+0000","last_change":"2024-09-10T08:28:47.633586+0000","last_active":"2024-09-10T08:28:48.633949+0000","last_peered":"2024-09-10T08:28:48.633949+0000","last_clean":"2024-09-10T08:28:48.633949+0000","last_became_active":"2024-09-10T08:28:47.633292+0000","last_became_peered":"2024-09-10T08:28:47.633292+0000","last_unstale":"2024-09-10T08:28:48.633949+0000","last_undegraded":"2024-09-10T08:28:48.633949+0000","last_fullsized":"2024-09-10T08:28:48.633949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:19.473028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622448+0000","last_change":"2024-09-10T08:28:34.561691+0000","last_active":"2024-09-10T08:28:48.622448+0000","last_peered":"2024-09-10T08:28:48.622448+0000","last_clean":"2024-09-10T08:28:48.622448+0000","last_became_active":"2024-09-10T08:28:34.561410+0000","last_became_peered":"2024-09-10T08:28:34.561410+0000","last_unstale":"2024-09-10T08:28:48.622448+0000","last_undegraded":"2024-09-10T08:28:48.622448+0000","last_fullsized":"2024-09-10T08:28:48.622448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.629982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631878+0000","last_change":"2024-09-10T08:28:35.579033+0000","last_active":"2024-09-10T08:28:48.631878+0000","last_peered":"2024-09-10T08:28:48.631878+0000","last_clean":"2024-09-10T08:28:48.631878+0000","last_became_active":"2024-09-10T08:28:35.578333+0000","last_became_peered":"2024-09-10T08:28:35.578333+0000","last_unstale":"2024-09-10T08:28:48.631878+0000","last_undegraded":"2024-09-10T08:28:48.631878+0000","last_fullsized":"2024-09-10T08:28:48.631878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:58.779491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619633+0000","last_change":"2024-09-10T08:28:46.617317+0000","last_active":"2024-09-10T08:28:48.619633+0000","last_peered":"2024-09-10T08:28:48.619633+0000","last_clean":"2024-09-10T08:28:48.619633+0000","last_became_active":"2024-09-10T08:28:46.616806+0000","last_became_peered":"2024-09-10T08:28:46.616806+0000","last_unstale":"2024-09-10T08:28:48.619633+0000","last_undegraded":"2024-09-10T08:28:48.619633+0000","last_fullsized":"2024-09-10T08:28:48.619633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:46.916848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354201+0000","last_change":"2024-09-10T08:28:47.633194+0000","last_active":"2024-09-10T08:28:49.354201+0000","last_peered":"2024-09-10T08:28:49.354201+0000","last_clean":"2024-09-10T08:28:49.354201+0000","last_became_active":"2024-09-10T08:28:47.632772+0000","last_became_peered":"2024-09-10T08:28:47.632772+0000","last_unstale":"2024-09-10T08:28:49.354201+0000","last_undegraded":"2024-09-10T08:28:49.354201+0000","last_fullsized":"2024-09-10T08:28:49.354201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:59.228438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354864+0000","last_change":"2024-09-10T08:28:34.571965+0000","last_active":"2024-09-10T08:28:49.354864+0000","last_peered":"2024-09-10T08:28:49.354864+0000","last_clean":"2024-09-10T08:28:49.354864+0000","last_became_active":"2024-09-10T08:28:34.571640+0000","last_became_peered":"2024-09-10T08:28:34.571640+0000","last_unstale":"2024-09-10T08:28:49.354864+0000","last_undegraded":"2024-09-10T08:28:49.354864+0000","last_fullsized":"2024-09-10T08:28:49.354864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:53.047030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621272+0000","last_change":"2024-09-10T08:28:35.562132+0000","last_active":"2024-09-10T08:28:48.621272+0000","last_peered":"2024-09-10T08:28:48.621272+0000","last_clean":"2024-09-10T08:28:48.621272+0000","last_became_active":"2024-09-10T08:28:35.561842+0000","last_became_peered":"2024-09-10T08:28:35.561842+0000","last_unstale":"2024-09-10T08:28:48.621272+0000","last_undegraded":"2024-09-10T08:28:48.621272+0000","last_fullsized":"2024-09-10T08:28:48.621272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:48.810258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620177+0000","last_change":"2024-09-10T08:28:46.621093+0000","last_active":"2024-09-10T08:28:48.620177+0000","last_peered":"2024-09-10T08:28:48.620177+0000","last_clean":"2024-09-10T08:28:48.620177+0000","last_became_active":"2024-09-10T08:28:46.620794+0000","last_became_peered":"2024-09-10T08:28:46.620794+0000","last_unstale":"2024-09-10T08:28:48.620177+0000","last_undegraded":"2024-09-10T08:28:48.620177+0000","last_fullsized":"2024-09-10T08:28:48.620177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:20.501262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620906+0000","last_change":"2024-09-10T08:28:47.627756+0000","last_active":"2024-09-10T08:28:48.620906+0000","last_peered":"2024-09-10T08:28:48.620906+0000","last_clean":"2024-09-10T08:28:48.620906+0000","last_became_active":"2024-09-10T08:28:47.627476+0000","last_became_peered":"2024-09-10T08:28:47.627476+0000","last_unstale":"2024-09-10T08:28:48.620906+0000","last_undegraded":"2024-09-10T08:28:48.620906+0000","last_fullsized":"2024-09-10T08:28:48.620906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:25.945793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354598+0000","last_change":"2024-09-10T08:28:34.566560+0000","last_active":"2024-09-10T08:28:49.354598+0000","last_peered":"2024-09-10T08:28:49.354598+0000","last_clean":"2024-09-10T08:28:49.354598+0000","last_became_active":"2024-09-10T08:28:34.566275+0000","last_became_peered":"2024-09-10T08:28:34.566275+0000","last_unstale":"2024-09-10T08:28:49.354598+0000","last_undegraded":"2024-09-10T08:28:49.354598+0000","last_fullsized":"2024-09-10T08:28:49.354598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:03.507683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621503+0000","last_change":"2024-09-10T08:28:35.560380+0000","last_active":"2024-09-10T08:28:48.621503+0000","last_peered":"2024-09-10T08:28:48.621503+0000","last_clean":"2024-09-10T08:28:48.621503+0000","last_became_active":"2024-09-10T08:28:35.560095+0000","last_became_peered":"2024-09-10T08:28:35.560095+0000","last_unstale":"2024-09-10T08:28:48.621503+0000","last_undegraded":"2024-09-10T08:28:48.621503+0000","last_fullsized":"2024-09-10T08:28:48.621503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:20.047446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621446+0000","last_change":"2024-09-10T08:28:46.620162+0000","last_active":"2024-09-10T08:28:48.621446+0000","last_peered":"2024-09-10T08:28:48.621446+0000","last_clean":"2024-09-10T08:28:48.621446+0000","last_became_active":"2024-09-10T08:28:46.619889+0000","last_became_peered":"2024-09-10T08:28:46.619889+0000","last_unstale":"2024-09-10T08:28:48.621446+0000","last_undegraded":"2024-09-10T08:28:48.621446+0000","last_fullsized":"2024-09-10T08:28:48.621446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:13.820143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634225+0000","last_change":"2024-09-10T08:28:47.631094+0000","last_active":"2024-09-10T08:28:48.634225+0000","last_peered":"2024-09-10T08:28:48.634225+0000","last_clean":"2024-09-10T08:28:48.634225+0000","last_became_active":"2024-09-10T08:28:47.630787+0000","last_became_peered":"2024-09-10T08:28:47.630787+0000","last_unstale":"2024-09-10T08:28:48.634225+0000","last_undegraded":"2024-09-10T08:28:48.634225+0000","last_fullsized":"2024-09-10T08:28:48.634225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:06.277094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421323+0000","last_change":"2024-09-10T08:28:35.572478+0000","last_active":"2024-09-10T08:28:49.421323+0000","last_peered":"2024-09-10T08:28:49.421323+0000","last_clean":"2024-09-10T08:28:49.421323+0000","last_became_active":"2024-09-10T08:28:35.572215+0000","last_became_peered":"2024-09-10T08:28:35.572215+0000","last_unstale":"2024-09-10T08:28:49.421323+0000","last_undegraded":"2024-09-10T08:28:49.421323+0000","last_fullsized":"2024-09-10T08:28:49.421323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:40.397318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354464+0000","last_change":"2024-09-10T08:28:34.569235+0000","last_active":"2024-09-10T08:28:49.354464+0000","last_peered":"2024-09-10T08:28:49.354464+0000","last_clean":"2024-09-10T08:28:49.354464+0000","last_became_active":"2024-09-10T08:28:34.568899+0000","last_became_peered":"2024-09-10T08:28:34.568899+0000","last_unstale":"2024-09-10T08:28:49.354464+0000","last_undegraded":"2024-09-10T08:28:49.354464+0000","last_fullsized":"2024-09-10T08:28:49.354464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:21.927656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620338+0000","last_change":"2024-09-10T08:28:46.618502+0000","last_active":"2024-09-10T08:28:48.620338+0000","last_peered":"2024-09-10T08:28:48.620338+0000","last_clean":"2024-09-10T08:28:48.620338+0000","last_became_active":"2024-09-10T08:28:46.616824+0000","last_became_peered":"2024-09-10T08:28:46.616824+0000","last_unstale":"2024-09-10T08:28:48.620338+0000","last_undegraded":"2024-09-10T08:28:48.620338+0000","last_fullsized":"2024-09-10T08:28:48.620338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:06.554102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299968+0000","last_change":"2024-09-10T08:28:47.627138+0000","last_active":"2024-09-10T08:28:49.299968+0000","last_peered":"2024-09-10T08:28:49.299968+0000","last_clean":"2024-09-10T08:28:49.299968+0000","last_became_active":"2024-09-10T08:28:47.626871+0000","last_became_peered":"2024-09-10T08:28:47.626871+0000","last_unstale":"2024-09-10T08:28:49.299968+0000","last_undegraded":"2024-09-10T08:28:49.299968+0000","last_fullsized":"2024-09-10T08:28:49.299968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:10.927283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621888+0000","last_change":"2024-09-10T08:28:35.577024+0000","last_active":"2024-09-10T08:28:48.621888+0000","last_peered":"2024-09-10T08:28:48.621888+0000","last_clean":"2024-09-10T08:28:48.621888+0000","last_became_active":"2024-09-10T08:28:35.576771+0000","last_became_peered":"2024-09-10T08:28:35.576771+0000","last_unstale":"2024-09-10T08:28:48.621888+0000","last_undegraded":"2024-09-10T08:28:48.621888+0000","last_fullsized":"2024-09-10T08:28:48.621888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:07.162941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634491+0000","last_change":"2024-09-10T08:28:34.561324+0000","last_active":"2024-09-10T08:28:48.634491+0000","last_peered":"2024-09-10T08:28:48.634491+0000","last_clean":"2024-09-10T08:28:48.634491+0000","last_became_active":"2024-09-10T08:28:34.560974+0000","last_became_peered":"2024-09-10T08:28:34.560974+0000","last_unstale":"2024-09-10T08:28:48.634491+0000","last_undegraded":"2024-09-10T08:28:48.634491+0000","last_fullsized":"2024-09-10T08:28:48.634491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:18.790965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621289+0000","last_change":"2024-09-10T08:28:46.620411+0000","last_active":"2024-09-10T08:28:48.621289+0000","last_peered":"2024-09-10T08:28:48.621289+0000","last_clean":"2024-09-10T08:28:48.621289+0000","last_became_active":"2024-09-10T08:28:46.619553+0000","last_became_peered":"2024-09-10T08:28:46.619553+0000","last_unstale":"2024-09-10T08:28:48.621289+0000","last_undegraded":"2024-09-10T08:28:48.621289+0000","last_fullsized":"2024-09-10T08:28:48.621289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:04.414048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620412+0000","last_change":"2024-09-10T08:28:47.628563+0000","last_active":"2024-09-10T08:28:48.620412+0000","last_peered":"2024-09-10T08:28:48.620412+0000","last_clean":"2024-09-10T08:28:48.620412+0000","last_became_active":"2024-09-10T08:28:47.628290+0000","last_became_peered":"2024-09-10T08:28:47.628290+0000","last_unstale":"2024-09-10T08:28:48.620412+0000","last_undegraded":"2024-09-10T08:28:48.620412+0000","last_fullsized":"2024-09-10T08:28:48.620412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:15.652718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621892+0000","last_change":"2024-09-10T08:28:35.572363+0000","last_active":"2024-09-10T08:28:48.621892+0000","last_peered":"2024-09-10T08:28:48.621892+0000","last_clean":"2024-09-10T08:28:48.621892+0000","last_became_active":"2024-09-10T08:28:35.572108+0000","last_became_peered":"2024-09-10T08:28:35.572108+0000","last_unstale":"2024-09-10T08:28:48.621892+0000","last_undegraded":"2024-09-10T08:28:48.621892+0000","last_fullsized":"2024-09-10T08:28:48.621892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:48.358634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634057+0000","last_change":"2024-09-10T08:28:34.564813+0000","last_active":"2024-09-10T08:28:48.634057+0000","last_peered":"2024-09-10T08:28:48.634057+0000","last_clean":"2024-09-10T08:28:48.634057+0000","last_became_active":"2024-09-10T08:28:34.564557+0000","last_became_peered":"2024-09-10T08:28:34.564557+0000","last_unstale":"2024-09-10T08:28:48.634057+0000","last_undegraded":"2024-09-10T08:28:48.634057+0000","last_fullsized":"2024-09-10T08:28:48.634057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:48.356069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634748+0000","last_change":"2024-09-10T08:28:46.625346+0000","last_active":"2024-09-10T08:28:48.634748+0000","last_peered":"2024-09-10T08:28:48.634748+0000","last_clean":"2024-09-10T08:28:48.634748+0000","last_became_active":"2024-09-10T08:28:46.625059+0000","last_became_peered":"2024-09-10T08:28:46.625059+0000","last_unstale":"2024-09-10T08:28:48.634748+0000","last_undegraded":"2024-09-10T08:28:48.634748+0000","last_fullsized":"2024-09-10T08:28:48.634748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:44.512285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621820+0000","last_change":"2024-09-10T08:28:47.621307+0000","last_active":"2024-09-10T08:28:48.621820+0000","last_peered":"2024-09-10T08:28:48.621820+0000","last_clean":"2024-09-10T08:28:48.621820+0000","last_became_active":"2024-09-10T08:28:47.621043+0000","last_became_peered":"2024-09-10T08:28:47.621043+0000","last_unstale":"2024-09-10T08:28:48.621820+0000","last_undegraded":"2024-09-10T08:28:48.621820+0000","last_fullsized":"2024-09-10T08:28:48.621820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:30.300108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620871+0000","last_change":"2024-09-10T08:28:35.569938+0000","last_active":"2024-09-10T08:28:48.620871+0000","last_peered":"2024-09-10T08:28:48.620871+0000","last_clean":"2024-09-10T08:28:48.620871+0000","last_became_active":"2024-09-10T08:28:35.569109+0000","last_became_peered":"2024-09-10T08:28:35.569109+0000","last_unstale":"2024-09-10T08:28:48.620871+0000","last_undegraded":"2024-09-10T08:28:48.620871+0000","last_fullsized":"2024-09-10T08:28:48.620871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:51.680564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354401+0000","last_change":"2024-09-10T08:28:34.571069+0000","last_active":"2024-09-10T08:28:49.354401+0000","last_peered":"2024-09-10T08:28:49.354401+0000","last_clean":"2024-09-10T08:28:49.354401+0000","last_became_active":"2024-09-10T08:28:34.570766+0000","last_became_peered":"2024-09-10T08:28:34.570766+0000","last_unstale":"2024-09-10T08:28:49.354401+0000","last_undegraded":"2024-09-10T08:28:49.354401+0000","last_fullsized":"2024-09-10T08:28:49.354401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:47.458195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620340+0000","last_change":"2024-09-10T08:28:46.616531+0000","last_active":"2024-09-10T08:28:48.620340+0000","last_peered":"2024-09-10T08:28:48.620340+0000","last_clean":"2024-09-10T08:28:48.620340+0000","last_became_active":"2024-09-10T08:28:46.616254+0000","last_became_peered":"2024-09-10T08:28:46.616254+0000","last_unstale":"2024-09-10T08:28:48.620340+0000","last_undegraded":"2024-09-10T08:28:48.620340+0000","last_fullsized":"2024-09-10T08:28:48.620340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:44.162368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621422+0000","last_change":"2024-09-10T08:28:47.628177+0000","last_active":"2024-09-10T08:28:48.621422+0000","last_peered":"2024-09-10T08:28:48.621422+0000","last_clean":"2024-09-10T08:28:48.621422+0000","last_became_active":"2024-09-10T08:28:47.627869+0000","last_became_peered":"2024-09-10T08:28:47.627869+0000","last_unstale":"2024-09-10T08:28:48.621422+0000","last_undegraded":"2024-09-10T08:28:48.621422+0000","last_fullsized":"2024-09-10T08:28:48.621422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:19.075558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632136+0000","last_change":"2024-09-10T08:28:35.575106+0000","last_active":"2024-09-10T08:28:48.632136+0000","last_peered":"2024-09-10T08:28:48.632136+0000","last_clean":"2024-09-10T08:28:48.632136+0000","last_became_active":"2024-09-10T08:28:35.574815+0000","last_became_peered":"2024-09-10T08:28:35.574815+0000","last_unstale":"2024-09-10T08:28:48.632136+0000","last_undegraded":"2024-09-10T08:28:48.632136+0000","last_fullsized":"2024-09-10T08:28:48.632136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:26.512181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421953+0000","last_change":"2024-09-10T08:28:34.564865+0000","last_active":"2024-09-10T08:28:49.421953+0000","last_peered":"2024-09-10T08:28:49.421953+0000","last_clean":"2024-09-10T08:28:49.421953+0000","last_became_active":"2024-09-10T08:28:34.564549+0000","last_became_peered":"2024-09-10T08:28:34.564549+0000","last_unstale":"2024-09-10T08:28:49.421953+0000","last_undegraded":"2024-09-10T08:28:49.421953+0000","last_fullsized":"2024-09-10T08:28:49.421953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:05.523637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620344+0000","last_change":"2024-09-10T08:28:46.622505+0000","last_active":"2024-09-10T08:28:48.620344+0000","last_peered":"2024-09-10T08:28:48.620344+0000","last_clean":"2024-09-10T08:28:48.620344+0000","last_became_active":"2024-09-10T08:28:46.621052+0000","last_became_peered":"2024-09-10T08:28:46.621052+0000","last_unstale":"2024-09-10T08:28:48.620344+0000","last_undegraded":"2024-09-10T08:28:48.620344+0000","last_fullsized":"2024-09-10T08:28:48.620344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:37.411404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620146+0000","last_change":"2024-09-10T08:28:47.624919+0000","last_active":"2024-09-10T08:28:48.620146+0000","last_peered":"2024-09-10T08:28:48.620146+0000","last_clean":"2024-09-10T08:28:48.620146+0000","last_became_active":"2024-09-10T08:28:47.624651+0000","last_became_peered":"2024-09-10T08:28:47.624651+0000","last_unstale":"2024-09-10T08:28:48.620146+0000","last_undegraded":"2024-09-10T08:28:48.620146+0000","last_fullsized":"2024-09-10T08:28:48.620146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:11.049160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622219+0000","last_change":"2024-09-10T08:28:35.574107+0000","last_active":"2024-09-10T08:28:48.622219+0000","last_peered":"2024-09-10T08:28:48.622219+0000","last_clean":"2024-09-10T08:28:48.622219+0000","last_became_active":"2024-09-10T08:28:35.573851+0000","last_became_peered":"2024-09-10T08:28:35.573851+0000","last_unstale":"2024-09-10T08:28:48.622219+0000","last_undegraded":"2024-09-10T08:28:48.622219+0000","last_fullsized":"2024-09-10T08:28:48.622219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:53.240223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634865+0000","last_change":"2024-09-10T08:28:34.563451+0000","last_active":"2024-09-10T08:28:48.634865+0000","last_peered":"2024-09-10T08:28:48.634865+0000","last_clean":"2024-09-10T08:28:48.634865+0000","last_became_active":"2024-09-10T08:28:34.563259+0000","last_became_peered":"2024-09-10T08:28:34.563259+0000","last_unstale":"2024-09-10T08:28:48.634865+0000","last_undegraded":"2024-09-10T08:28:48.634865+0000","last_fullsized":"2024-09-10T08:28:48.634865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:44.899351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621717+0000","last_change":"2024-09-10T08:28:46.623396+0000","last_active":"2024-09-10T08:28:48.621717+0000","last_peered":"2024-09-10T08:28:48.621717+0000","last_clean":"2024-09-10T08:28:48.621717+0000","last_became_active":"2024-09-10T08:28:46.623139+0000","last_became_peered":"2024-09-10T08:28:46.623139+0000","last_unstale":"2024-09-10T08:28:48.621717+0000","last_undegraded":"2024-09-10T08:28:48.621717+0000","last_fullsized":"2024-09-10T08:28:48.621717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:00.210413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421163+0000","last_change":"2024-09-10T08:28:47.634754+0000","last_active":"2024-09-10T08:28:49.421163+0000","last_peered":"2024-09-10T08:28:49.421163+0000","last_clean":"2024-09-10T08:28:49.421163+0000","last_became_active":"2024-09-10T08:28:47.634382+0000","last_became_peered":"2024-09-10T08:28:47.634382+0000","last_unstale":"2024-09-10T08:28:49.421163+0000","last_undegraded":"2024-09-10T08:28:49.421163+0000","last_fullsized":"2024-09-10T08:28:49.421163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:23.489596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634270+0000","last_change":"2024-09-10T08:28:35.567481+0000","last_active":"2024-09-10T08:28:48.634270+0000","last_peered":"2024-09-10T08:28:48.634270+0000","last_clean":"2024-09-10T08:28:48.634270+0000","last_became_active":"2024-09-10T08:28:35.567167+0000","last_became_peered":"2024-09-10T08:28:35.567167+0000","last_unstale":"2024-09-10T08:28:48.634270+0000","last_undegraded":"2024-09-10T08:28:48.634270+0000","last_fullsized":"2024-09-10T08:28:48.634270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:44.110012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355009+0000","last_change":"2024-09-10T08:28:34.571283+0000","last_active":"2024-09-10T08:28:49.355009+0000","last_peered":"2024-09-10T08:28:49.355009+0000","last_clean":"2024-09-10T08:28:49.355009+0000","last_became_active":"2024-09-10T08:28:34.570791+0000","last_became_peered":"2024-09-10T08:28:34.570791+0000","last_unstale":"2024-09-10T08:28:49.355009+0000","last_undegraded":"2024-09-10T08:28:49.355009+0000","last_fullsized":"2024-09-10T08:28:49.355009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:17.427597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631943+0000","last_change":"2024-09-10T08:28:46.630983+0000","last_active":"2024-09-10T08:28:48.631943+0000","last_peered":"2024-09-10T08:28:48.631943+0000","last_clean":"2024-09-10T08:28:48.631943+0000","last_became_active":"2024-09-10T08:28:46.630658+0000","last_became_peered":"2024-09-10T08:28:46.630658+0000","last_unstale":"2024-09-10T08:28:48.631943+0000","last_undegraded":"2024-09-10T08:28:48.631943+0000","last_fullsized":"2024-09-10T08:28:48.631943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:11.219022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632221+0000","last_change":"2024-09-10T08:28:47.625475+0000","last_active":"2024-09-10T08:28:48.632221+0000","last_peered":"2024-09-10T08:28:48.632221+0000","last_clean":"2024-09-10T08:28:48.632221+0000","last_became_active":"2024-09-10T08:28:47.625186+0000","last_became_peered":"2024-09-10T08:28:47.625186+0000","last_unstale":"2024-09-10T08:28:48.632221+0000","last_undegraded":"2024-09-10T08:28:48.632221+0000","last_fullsized":"2024-09-10T08:28:48.632221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:15.932769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621392+0000","last_change":"2024-09-10T08:28:35.576280+0000","last_active":"2024-09-10T08:28:48.621392+0000","last_peered":"2024-09-10T08:28:48.621392+0000","last_clean":"2024-09-10T08:28:48.621392+0000","last_became_active":"2024-09-10T08:28:35.576002+0000","last_became_peered":"2024-09-10T08:28:35.576002+0000","last_unstale":"2024-09-10T08:28:48.621392+0000","last_undegraded":"2024-09-10T08:28:48.621392+0000","last_fullsized":"2024-09-10T08:28:48.621392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:46.278441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634285+0000","last_change":"2024-09-10T08:28:34.555212+0000","last_active":"2024-09-10T08:28:48.634285+0000","last_peered":"2024-09-10T08:28:48.634285+0000","last_clean":"2024-09-10T08:28:48.634285+0000","last_became_active":"2024-09-10T08:28:34.554922+0000","last_became_peered":"2024-09-10T08:28:34.554922+0000","last_unstale":"2024-09-10T08:28:48.634285+0000","last_undegraded":"2024-09-10T08:28:48.634285+0000","last_fullsized":"2024-09-10T08:28:48.634285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634109+0000","last_change":"2024-09-10T08:28:46.624886+0000","last_active":"2024-09-10T08:28:48.634109+0000","last_peered":"2024-09-10T08:28:48.634109+0000","last_clean":"2024-09-10T08:28:48.634109+0000","last_became_active":"2024-09-10T08:28:46.624690+0000","last_became_peered":"2024-09-10T08:28:46.624690+0000","last_unstale":"2024-09-10T08:28:48.634109+0000","last_undegraded":"2024-09-10T08:28:48.634109+0000","last_fullsized":"2024-09-10T08:28:48.634109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:15.023379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631808+0000","last_change":"2024-09-10T08:28:47.634161+0000","last_active":"2024-09-10T08:28:48.631808+0000","last_peered":"2024-09-10T08:28:48.631808+0000","last_clean":"2024-09-10T08:28:48.631808+0000","last_became_active":"2024-09-10T08:28:47.633893+0000","last_became_peered":"2024-09-10T08:28:47.633893+0000","last_unstale":"2024-09-10T08:28:48.631808+0000","last_undegraded":"2024-09-10T08:28:48.631808+0000","last_fullsized":"2024-09-10T08:28:48.631808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:37.072370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620594+0000","last_change":"2024-09-10T08:28:35.577978+0000","last_active":"2024-09-10T08:28:48.620594+0000","last_peered":"2024-09-10T08:28:48.620594+0000","last_clean":"2024-09-10T08:28:48.620594+0000","last_became_active":"2024-09-10T08:28:35.577718+0000","last_became_peered":"2024-09-10T08:28:35.577718+0000","last_unstale":"2024-09-10T08:28:48.620594+0000","last_undegraded":"2024-09-10T08:28:48.620594+0000","last_fullsized":"2024-09-10T08:28:48.620594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:01:57.257817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621126+0000","last_change":"2024-09-10T08:28:34.553983+0000","last_active":"2024-09-10T08:28:48.621126+0000","last_peered":"2024-09-10T08:28:48.621126+0000","last_clean":"2024-09-10T08:28:48.621126+0000","last_became_active":"2024-09-10T08:28:34.553693+0000","last_became_peered":"2024-09-10T08:28:34.553693+0000","last_unstale":"2024-09-10T08:28:48.621126+0000","last_undegraded":"2024-09-10T08:28:48.621126+0000","last_fullsized":"2024-09-10T08:28:48.621126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:40.001685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634238+0000","last_change":"2024-09-10T08:28:46.620165+0000","last_active":"2024-09-10T08:28:48.634238+0000","last_peered":"2024-09-10T08:28:48.634238+0000","last_clean":"2024-09-10T08:28:48.634238+0000","last_became_active":"2024-09-10T08:28:46.619853+0000","last_became_peered":"2024-09-10T08:28:46.619853+0000","last_unstale":"2024-09-10T08:28:48.634238+0000","last_undegraded":"2024-09-10T08:28:48.634238+0000","last_fullsized":"2024-09-10T08:28:48.634238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:36.006532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.300010+0000","last_change":"2024-09-10T08:28:47.621588+0000","last_active":"2024-09-10T08:28:49.300010+0000","last_peered":"2024-09-10T08:28:49.300010+0000","last_clean":"2024-09-10T08:28:49.300010+0000","last_became_active":"2024-09-10T08:28:47.621122+0000","last_became_peered":"2024-09-10T08:28:47.621122+0000","last_unstale":"2024-09-10T08:28:49.300010+0000","last_undegraded":"2024-09-10T08:28:49.300010+0000","last_fullsized":"2024-09-10T08:28:49.300010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:11.250838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633943+0000","last_change":"2024-09-10T08:28:35.566745+0000","last_active":"2024-09-10T08:28:48.633943+0000","last_peered":"2024-09-10T08:28:48.633943+0000","last_clean":"2024-09-10T08:28:48.633943+0000","last_became_active":"2024-09-10T08:28:35.566444+0000","last_became_peered":"2024-09-10T08:28:35.566444+0000","last_unstale":"2024-09-10T08:28:48.633943+0000","last_undegraded":"2024-09-10T08:28:48.633943+0000","last_fullsized":"2024-09-10T08:28:48.633943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:52.735296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299738+0000","last_change":"2024-09-10T08:28:34.560745+0000","last_active":"2024-09-10T08:28:49.299738+0000","last_peered":"2024-09-10T08:28:49.299738+0000","last_clean":"2024-09-10T08:28:49.299738+0000","last_became_active":"2024-09-10T08:28:34.559911+0000","last_became_peered":"2024-09-10T08:28:34.559911+0000","last_unstale":"2024-09-10T08:28:49.299738+0000","last_undegraded":"2024-09-10T08:28:49.299738+0000","last_fullsized":"2024-09-10T08:28:49.299738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:00.234067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634838+0000","last_change":"2024-09-10T08:28:46.623886+0000","last_active":"2024-09-10T08:28:48.634838+0000","last_peered":"2024-09-10T08:28:48.634838+0000","last_clean":"2024-09-10T08:28:48.634838+0000","last_became_active":"2024-09-10T08:28:46.622790+0000","last_became_peered":"2024-09-10T08:28:46.622790+0000","last_unstale":"2024-09-10T08:28:48.634838+0000","last_undegraded":"2024-09-10T08:28:48.634838+0000","last_fullsized":"2024-09-10T08:28:48.634838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:06:32.333116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621918+0000","last_change":"2024-09-10T08:28:47.634500+0000","last_active":"2024-09-10T08:28:48.621918+0000","last_peered":"2024-09-10T08:28:48.621918+0000","last_clean":"2024-09-10T08:28:48.621918+0000","last_became_active":"2024-09-10T08:28:47.634219+0000","last_became_peered":"2024-09-10T08:28:47.634219+0000","last_unstale":"2024-09-10T08:28:48.621918+0000","last_undegraded":"2024-09-10T08:28:48.621918+0000","last_fullsized":"2024-09-10T08:28:48.621918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:59.689554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631587+0000","last_change":"2024-09-10T08:28:35.576360+0000","last_active":"2024-09-10T08:28:48.631587+0000","last_peered":"2024-09-10T08:28:48.631587+0000","last_clean":"2024-09-10T08:28:48.631587+0000","last_became_active":"2024-09-10T08:28:35.576096+0000","last_became_peered":"2024-09-10T08:28:35.576096+0000","last_unstale":"2024-09-10T08:28:48.631587+0000","last_undegraded":"2024-09-10T08:28:48.631587+0000","last_fullsized":"2024-09-10T08:28:48.631587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:34.159275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354630+0000","last_change":"2024-09-10T08:28:34.568477+0000","last_active":"2024-09-10T08:28:49.354630+0000","last_peered":"2024-09-10T08:28:49.354630+0000","last_clean":"2024-09-10T08:28:49.354630+0000","last_became_active":"2024-09-10T08:28:34.568249+0000","last_became_peered":"2024-09-10T08:28:34.568249+0000","last_unstale":"2024-09-10T08:28:49.354630+0000","last_undegraded":"2024-09-10T08:28:49.354630+0000","last_fullsized":"2024-09-10T08:28:49.354630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:08.640043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633193+0000","last_change":"2024-09-10T08:28:46.621567+0000","last_active":"2024-09-10T08:28:48.633193+0000","last_peered":"2024-09-10T08:28:48.633193+0000","last_clean":"2024-09-10T08:28:48.633193+0000","last_became_active":"2024-09-10T08:28:46.621272+0000","last_became_peered":"2024-09-10T08:28:46.621272+0000","last_unstale":"2024-09-10T08:28:48.633193+0000","last_undegraded":"2024-09-10T08:28:48.633193+0000","last_fullsized":"2024-09-10T08:28:48.633193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:37:34.936213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354521+0000","last_change":"2024-09-10T08:28:47.631621+0000","last_active":"2024-09-10T08:28:49.354521+0000","last_peered":"2024-09-10T08:28:49.354521+0000","last_clean":"2024-09-10T08:28:49.354521+0000","last_became_active":"2024-09-10T08:28:47.631337+0000","last_became_peered":"2024-09-10T08:28:47.631337+0000","last_unstale":"2024-09-10T08:28:49.354521+0000","last_undegraded":"2024-09-10T08:28:49.354521+0000","last_fullsized":"2024-09-10T08:28:49.354521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:04.196705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621993+0000","last_change":"2024-09-10T08:28:35.572658+0000","last_active":"2024-09-10T08:28:48.621993+0000","last_peered":"2024-09-10T08:28:48.621993+0000","last_clean":"2024-09-10T08:28:48.621993+0000","last_became_active":"2024-09-10T08:28:35.571611+0000","last_became_peered":"2024-09-10T08:28:35.571611+0000","last_unstale":"2024-09-10T08:28:48.621993+0000","last_undegraded":"2024-09-10T08:28:48.621993+0000","last_fullsized":"2024-09-10T08:28:48.621993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:42.726996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620845+0000","last_change":"2024-09-10T08:28:34.555587+0000","last_active":"2024-09-10T08:28:48.620845+0000","last_peered":"2024-09-10T08:28:48.620845+0000","last_clean":"2024-09-10T08:28:48.620845+0000","last_became_active":"2024-09-10T08:28:34.555269+0000","last_became_peered":"2024-09-10T08:28:34.555269+0000","last_unstale":"2024-09-10T08:28:48.620845+0000","last_undegraded":"2024-09-10T08:28:48.620845+0000","last_fullsized":"2024-09-10T08:28:48.620845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:19.499870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354756+0000","last_change":"2024-09-10T08:28:26.724394+0000","last_active":"2024-09-10T08:28:49.354756+0000","last_peered":"2024-09-10T08:28:49.354756+0000","last_clean":"2024-09-10T08:28:49.354756+0000","last_became_active":"2024-09-10T08:28:26.723452+0000","last_became_peered":"2024-09-10T08:28:26.723452+0000","last_unstale":"2024-09-10T08:28:49.354756+0000","last_undegraded":"2024-09-10T08:28:49.354756+0000","last_fullsized":"2024-09-10T08:28:49.354756+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_clean_scrub_stamp":"2024-09-10T08:28:25.445753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:00.811505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421307+0000","last_change":"2024-09-10T08:28:46.622048+0000","last_active":"2024-09-10T08:28:49.421307+0000","last_peered":"2024-09-10T08:28:49.421307+0000","last_clean":"2024-09-10T08:28:49.421307+0000","last_became_active":"2024-09-10T08:28:46.621770+0000","last_became_peered":"2024-09-10T08:28:46.621770+0000","last_unstale":"2024-09-10T08:28:49.421307+0000","last_undegraded":"2024-09-10T08:28:49.421307+0000","last_fullsized":"2024-09-10T08:28:49.421307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:51.430760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299891+0000","last_change":"2024-09-10T08:28:47.620746+0000","last_active":"2024-09-10T08:28:49.299891+0000","last_peered":"2024-09-10T08:28:49.299891+0000","last_clean":"2024-09-10T08:28:49.299891+0000","last_became_active":"2024-09-10T08:28:47.620492+0000","last_became_peered":"2024-09-10T08:28:47.620492+0000","last_unstale":"2024-09-10T08:28:49.299891+0000","last_undegraded":"2024-09-10T08:28:49.299891+0000","last_fullsized":"2024-09-10T08:28:49.299891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:40.117978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354858+0000","last_change":"2024-09-10T08:28:35.574532+0000","last_active":"2024-09-10T08:28:49.354858+0000","last_peered":"2024-09-10T08:28:49.354858+0000","last_clean":"2024-09-10T08:28:49.354858+0000","last_became_active":"2024-09-10T08:28:35.574215+0000","last_became_peered":"2024-09-10T08:28:35.574215+0000","last_unstale":"2024-09-10T08:28:49.354858+0000","last_undegraded":"2024-09-10T08:28:49.354858+0000","last_fullsized":"2024-09-10T08:28:49.354858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:28.455653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.300028+0000","last_change":"2024-09-10T08:28:34.559911+0000","last_active":"2024-09-10T08:28:49.300028+0000","last_peered":"2024-09-10T08:28:49.300028+0000","last_clean":"2024-09-10T08:28:49.300028+0000","last_became_active":"2024-09-10T08:28:34.559635+0000","last_became_peered":"2024-09-10T08:28:34.559635+0000","last_unstale":"2024-09-10T08:28:49.300028+0000","last_undegraded":"2024-09-10T08:28:49.300028+0000","last_fullsized":"2024-09-10T08:28:49.300028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:40.892609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421181+0000","last_change":"2024-09-10T08:28:46.620352+0000","last_active":"2024-09-10T08:28:49.421181+0000","last_peered":"2024-09-10T08:28:49.421181+0000","last_clean":"2024-09-10T08:28:49.421181+0000","last_became_active":"2024-09-10T08:28:46.620064+0000","last_became_peered":"2024-09-10T08:28:46.620064+0000","last_unstale":"2024-09-10T08:28:49.421181+0000","last_undegraded":"2024-09-10T08:28:49.421181+0000","last_fullsized":"2024-09-10T08:28:49.421181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:59.333579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299701+0000","last_change":"2024-09-10T08:28:47.620305+0000","last_active":"2024-09-10T08:28:49.299701+0000","last_peered":"2024-09-10T08:28:49.299701+0000","last_clean":"2024-09-10T08:28:49.299701+0000","last_became_active":"2024-09-10T08:28:47.620014+0000","last_became_peered":"2024-09-10T08:28:47.620014+0000","last_unstale":"2024-09-10T08:28:49.299701+0000","last_undegraded":"2024-09-10T08:28:49.299701+0000","last_fullsized":"2024-09-10T08:28:49.299701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:44.916136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621484+0000","last_change":"2024-09-10T08:28:35.577124+0000","last_active":"2024-09-10T08:28:48.621484+0000","last_peered":"2024-09-10T08:28:48.621484+0000","last_clean":"2024-09-10T08:28:48.621484+0000","last_became_active":"2024-09-10T08:28:35.576655+0000","last_became_peered":"2024-09-10T08:28:35.576655+0000","last_unstale":"2024-09-10T08:28:48.621484+0000","last_undegraded":"2024-09-10T08:28:48.621484+0000","last_fullsized":"2024-09-10T08:28:48.621484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:29.878600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634772+0000","last_change":"2024-09-10T08:28:34.560694+0000","last_active":"2024-09-10T08:28:48.634772+0000","last_peered":"2024-09-10T08:28:48.634772+0000","last_clean":"2024-09-10T08:28:48.634772+0000","last_became_active":"2024-09-10T08:28:34.560429+0000","last_became_peered":"2024-09-10T08:28:34.560429+0000","last_unstale":"2024-09-10T08:28:48.634772+0000","last_undegraded":"2024-09-10T08:28:48.634772+0000","last_fullsized":"2024-09-10T08:28:48.634772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:54.514467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631770+0000","last_change":"2024-09-10T08:28:46.622232+0000","last_active":"2024-09-10T08:28:48.631770+0000","last_peered":"2024-09-10T08:28:48.631770+0000","last_clean":"2024-09-10T08:28:48.631770+0000","last_became_active":"2024-09-10T08:28:46.621966+0000","last_became_peered":"2024-09-10T08:28:46.621966+0000","last_unstale":"2024-09-10T08:28:48.631770+0000","last_undegraded":"2024-09-10T08:28:48.631770+0000","last_fullsized":"2024-09-10T08:28:48.631770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:28.897045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354068+0000","last_change":"2024-09-10T08:28:47.630602+0000","last_active":"2024-09-10T08:28:49.354068+0000","last_peered":"2024-09-10T08:28:49.354068+0000","last_clean":"2024-09-10T08:28:49.354068+0000","last_became_active":"2024-09-10T08:28:47.630234+0000","last_became_peered":"2024-09-10T08:28:47.630234+0000","last_unstale":"2024-09-10T08:28:49.354068+0000","last_undegraded":"2024-09-10T08:28:49.354068+0000","last_fullsized":"2024-09-10T08:28:49.354068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:03.808098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355126+0000","last_change":"2024-09-10T08:28:35.577577+0000","last_active":"2024-09-10T08:28:49.355126+0000","last_peered":"2024-09-10T08:28:49.355126+0000","last_clean":"2024-09-10T08:28:49.355126+0000","last_became_active":"2024-09-10T08:28:35.576686+0000","last_became_peered":"2024-09-10T08:28:35.576686+0000","last_unstale":"2024-09-10T08:28:49.355126+0000","last_undegraded":"2024-09-10T08:28:49.355126+0000","last_fullsized":"2024-09-10T08:28:49.355126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:36.334494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.300074+0000","last_change":"2024-09-10T08:28:34.560313+0000","last_active":"2024-09-10T08:28:49.300074+0000","last_peered":"2024-09-10T08:28:49.300074+0000","last_clean":"2024-09-10T08:28:49.300074+0000","last_became_active":"2024-09-10T08:28:34.560035+0000","last_became_peered":"2024-09-10T08:28:34.560035+0000","last_unstale":"2024-09-10T08:28:49.300074+0000","last_undegraded":"2024-09-10T08:28:49.300074+0000","last_fullsized":"2024-09-10T08:28:49.300074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:56.945537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619792+0000","last_change":"2024-09-10T08:28:46.623371+0000","last_active":"2024-09-10T08:28:48.619792+0000","last_peered":"2024-09-10T08:28:48.619792+0000","last_clean":"2024-09-10T08:28:48.619792+0000","last_became_active":"2024-09-10T08:28:46.623092+0000","last_became_peered":"2024-09-10T08:28:46.623092+0000","last_unstale":"2024-09-10T08:28:48.619792+0000","last_undegraded":"2024-09-10T08:28:48.619792+0000","last_fullsized":"2024-09-10T08:28:48.619792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:36.359127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299671+0000","last_change":"2024-09-10T08:28:47.619805+0000","last_active":"2024-09-10T08:28:49.299671+0000","last_peered":"2024-09-10T08:28:49.299671+0000","last_clean":"2024-09-10T08:28:49.299671+0000","last_became_active":"2024-09-10T08:28:47.619452+0000","last_became_peered":"2024-09-10T08:28:47.619452+0000","last_unstale":"2024-09-10T08:28:49.299671+0000","last_undegraded":"2024-09-10T08:28:49.299671+0000","last_fullsized":"2024-09-10T08:28:49.299671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:20.052707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355004+0000","last_change":"2024-09-10T08:28:35.577476+0000","last_active":"2024-09-10T08:28:49.355004+0000","last_peered":"2024-09-10T08:28:49.355004+0000","last_clean":"2024-09-10T08:28:49.355004+0000","last_became_active":"2024-09-10T08:28:35.576786+0000","last_became_peered":"2024-09-10T08:28:35.576786+0000","last_unstale":"2024-09-10T08:28:49.355004+0000","last_undegraded":"2024-09-10T08:28:49.355004+0000","last_fullsized":"2024-09-10T08:28:49.355004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:46.914074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620800+0000","last_change":"2024-09-10T08:28:34.551102+0000","last_active":"2024-09-10T08:28:48.620800+0000","last_peered":"2024-09-10T08:28:48.620800+0000","last_clean":"2024-09-10T08:28:48.620800+0000","last_became_active":"2024-09-10T08:28:34.550773+0000","last_became_peered":"2024-09-10T08:28:34.550773+0000","last_unstale":"2024-09-10T08:28:48.620800+0000","last_undegraded":"2024-09-10T08:28:48.620800+0000","last_fullsized":"2024-09-10T08:28:48.620800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:35.393695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620218+0000","last_change":"2024-09-10T08:28:46.619639+0000","last_active":"2024-09-10T08:28:48.620218+0000","last_peered":"2024-09-10T08:28:48.620218+0000","last_clean":"2024-09-10T08:28:48.620218+0000","last_became_active":"2024-09-10T08:28:46.619330+0000","last_became_peered":"2024-09-10T08:28:46.619330+0000","last_unstale":"2024-09-10T08:28:48.620218+0000","last_undegraded":"2024-09-10T08:28:48.620218+0000","last_fullsized":"2024-09-10T08:28:48.620218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:10.371693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622150+0000","last_change":"2024-09-10T08:28:47.633627+0000","last_active":"2024-09-10T08:28:48.622150+0000","last_peered":"2024-09-10T08:28:48.622150+0000","last_clean":"2024-09-10T08:28:48.622150+0000","last_became_active":"2024-09-10T08:28:47.633362+0000","last_became_peered":"2024-09-10T08:28:47.633362+0000","last_unstale":"2024-09-10T08:28:48.622150+0000","last_undegraded":"2024-09-10T08:28:48.622150+0000","last_fullsized":"2024-09-10T08:28:48.622150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:19.473028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354525+0000","last_change":"2024-09-10T08:28:35.575307+0000","last_active":"2024-09-10T08:28:49.354525+0000","last_peered":"2024-09-10T08:28:49.354525+0000","last_clean":"2024-09-10T08:28:49.354525+0000","last_became_active":"2024-09-10T08:28:35.575038+0000","last_became_peered":"2024-09-10T08:28:35.575038+0000","last_unstale":"2024-09-10T08:28:49.354525+0000","last_undegraded":"2024-09-10T08:28:49.354525+0000","last_fullsized":"2024-09-10T08:28:49.354525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:36.478822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299678+0000","last_change":"2024-09-10T08:28:34.555542+0000","last_active":"2024-09-10T08:28:49.299678+0000","last_peered":"2024-09-10T08:28:49.299678+0000","last_clean":"2024-09-10T08:28:49.299678+0000","last_became_active":"2024-09-10T08:28:34.555179+0000","last_became_peered":"2024-09-10T08:28:34.555179+0000","last_unstale":"2024-09-10T08:28:49.299678+0000","last_undegraded":"2024-09-10T08:28:49.299678+0000","last_fullsized":"2024-09-10T08:28:49.299678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:53.313161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632119+0000","last_change":"2024-09-10T08:28:46.618615+0000","last_active":"2024-09-10T08:28:48.632119+0000","last_peered":"2024-09-10T08:28:48.632119+0000","last_clean":"2024-09-10T08:28:48.632119+0000","last_became_active":"2024-09-10T08:28:46.618318+0000","last_became_peered":"2024-09-10T08:28:46.618318+0000","last_unstale":"2024-09-10T08:28:48.632119+0000","last_undegraded":"2024-09-10T08:28:48.632119+0000","last_fullsized":"2024-09-10T08:28:48.632119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:44:08.185748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621616+0000","last_change":"2024-09-10T08:28:47.625025+0000","last_active":"2024-09-10T08:28:48.621616+0000","last_peered":"2024-09-10T08:28:48.621616+0000","last_clean":"2024-09-10T08:28:48.621616+0000","last_became_active":"2024-09-10T08:28:47.624230+0000","last_became_peered":"2024-09-10T08:28:47.624230+0000","last_unstale":"2024-09-10T08:28:48.621616+0000","last_undegraded":"2024-09-10T08:28:48.621616+0000","last_fullsized":"2024-09-10T08:28:48.621616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:25.530264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421027+0000","last_change":"2024-09-10T08:28:35.578892+0000","last_active":"2024-09-10T08:28:49.421027+0000","last_peered":"2024-09-10T08:28:49.421027+0000","last_clean":"2024-09-10T08:28:49.421027+0000","last_became_active":"2024-09-10T08:28:35.578299+0000","last_became_peered":"2024-09-10T08:28:35.578299+0000","last_unstale":"2024-09-10T08:28:49.421027+0000","last_undegraded":"2024-09-10T08:28:49.421027+0000","last_fullsized":"2024-09-10T08:28:49.421027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:27.485392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421503+0000","last_change":"2024-09-10T08:28:34.560444+0000","last_active":"2024-09-10T08:28:49.421503+0000","last_peered":"2024-09-10T08:28:49.421503+0000","last_clean":"2024-09-10T08:28:49.421503+0000","last_became_active":"2024-09-10T08:28:34.560188+0000","last_became_peered":"2024-09-10T08:28:34.560188+0000","last_unstale":"2024-09-10T08:28:49.421503+0000","last_undegraded":"2024-09-10T08:28:49.421503+0000","last_fullsized":"2024-09-10T08:28:49.421503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:15.727780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622124+0000","last_change":"2024-09-10T08:28:46.623483+0000","last_active":"2024-09-10T08:28:48.622124+0000","last_peered":"2024-09-10T08:28:48.622124+0000","last_clean":"2024-09-10T08:28:48.622124+0000","last_became_active":"2024-09-10T08:28:46.623211+0000","last_became_peered":"2024-09-10T08:28:46.623211+0000","last_unstale":"2024-09-10T08:28:48.622124+0000","last_undegraded":"2024-09-10T08:28:48.622124+0000","last_fullsized":"2024-09-10T08:28:48.622124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:24.611015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621121+0000","last_change":"2024-09-10T08:28:47.635185+0000","last_active":"2024-09-10T08:28:48.621121+0000","last_peered":"2024-09-10T08:28:48.621121+0000","last_clean":"2024-09-10T08:28:48.621121+0000","last_became_active":"2024-09-10T08:28:47.634782+0000","last_became_peered":"2024-09-10T08:28:47.634782+0000","last_unstale":"2024-09-10T08:28:48.621121+0000","last_undegraded":"2024-09-10T08:28:48.621121+0000","last_fullsized":"2024-09-10T08:28:48.621121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:05.512645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354247+0000","last_change":"2024-09-10T08:28:35.575788+0000","last_active":"2024-09-10T08:28:49.354247+0000","last_peered":"2024-09-10T08:28:49.354247+0000","last_clean":"2024-09-10T08:28:49.354247+0000","last_became_active":"2024-09-10T08:28:35.575333+0000","last_became_peered":"2024-09-10T08:28:35.575333+0000","last_unstale":"2024-09-10T08:28:49.354247+0000","last_undegraded":"2024-09-10T08:28:49.354247+0000","last_fullsized":"2024-09-10T08:28:49.354247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:39.756390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621367+0000","last_change":"2024-09-10T08:28:34.560699+0000","last_active":"2024-09-10T08:28:48.621367+0000","last_peered":"2024-09-10T08:28:48.621367+0000","last_clean":"2024-09-10T08:28:48.621367+0000","last_became_active":"2024-09-10T08:28:34.560376+0000","last_became_peered":"2024-09-10T08:28:34.560376+0000","last_unstale":"2024-09-10T08:28:48.621367+0000","last_undegraded":"2024-09-10T08:28:48.621367+0000","last_fullsized":"2024-09-10T08:28:48.621367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:09.981216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622076+0000","last_change":"2024-09-10T08:28:46.620745+0000","last_active":"2024-09-10T08:28:48.622076+0000","last_peered":"2024-09-10T08:28:48.622076+0000","last_clean":"2024-09-10T08:28:48.622076+0000","last_became_active":"2024-09-10T08:28:46.619030+0000","last_became_peered":"2024-09-10T08:28:46.619030+0000","last_unstale":"2024-09-10T08:28:48.622076+0000","last_undegraded":"2024-09-10T08:28:48.622076+0000","last_fullsized":"2024-09-10T08:28:48.622076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:07.653226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622129+0000","last_change":"2024-09-10T08:28:47.626648+0000","last_active":"2024-09-10T08:28:48.622129+0000","last_peered":"2024-09-10T08:28:48.622129+0000","last_clean":"2024-09-10T08:28:48.622129+0000","last_became_active":"2024-09-10T08:28:47.626330+0000","last_became_peered":"2024-09-10T08:28:47.626330+0000","last_unstale":"2024-09-10T08:28:48.622129+0000","last_undegraded":"2024-09-10T08:28:48.622129+0000","last_fullsized":"2024-09-10T08:28:48.622129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:02.346881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631691+0000","last_change":"2024-09-10T08:28:35.574810+0000","last_active":"2024-09-10T08:28:48.631691+0000","last_peered":"2024-09-10T08:28:48.631691+0000","last_clean":"2024-09-10T08:28:48.631691+0000","last_became_active":"2024-09-10T08:28:35.574567+0000","last_became_peered":"2024-09-10T08:28:35.574567+0000","last_unstale":"2024-09-10T08:28:48.631691+0000","last_undegraded":"2024-09-10T08:28:48.631691+0000","last_fullsized":"2024-09-10T08:28:48.631691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:29.315833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632297+0000","last_change":"2024-09-10T08:28:34.553556+0000","last_active":"2024-09-10T08:28:48.632297+0000","last_peered":"2024-09-10T08:28:48.632297+0000","last_clean":"2024-09-10T08:28:48.632297+0000","last_became_active":"2024-09-10T08:28:34.553275+0000","last_became_peered":"2024-09-10T08:28:34.553275+0000","last_unstale":"2024-09-10T08:28:48.632297+0000","last_undegraded":"2024-09-10T08:28:48.632297+0000","last_fullsized":"2024-09-10T08:28:48.632297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:45.957635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621256+0000","last_change":"2024-09-10T08:28:46.619760+0000","last_active":"2024-09-10T08:28:48.621256+0000","last_peered":"2024-09-10T08:28:48.621256+0000","last_clean":"2024-09-10T08:28:48.621256+0000","last_became_active":"2024-09-10T08:28:46.619165+0000","last_became_peered":"2024-09-10T08:28:46.619165+0000","last_unstale":"2024-09-10T08:28:48.621256+0000","last_undegraded":"2024-09-10T08:28:48.621256+0000","last_fullsized":"2024-09-10T08:28:48.621256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:27.691197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621842+0000","last_change":"2024-09-10T08:28:47.620135+0000","last_active":"2024-09-10T08:28:48.621842+0000","last_peered":"2024-09-10T08:28:48.621842+0000","last_clean":"2024-09-10T08:28:48.621842+0000","last_became_active":"2024-09-10T08:28:47.619661+0000","last_became_peered":"2024-09-10T08:28:47.619661+0000","last_unstale":"2024-09-10T08:28:48.621842+0000","last_undegraded":"2024-09-10T08:28:48.621842+0000","last_fullsized":"2024-09-10T08:28:48.621842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:34.815426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354721+0000","last_change":"2024-09-10T08:28:35.582473+0000","last_active":"2024-09-10T08:28:49.354721+0000","last_peered":"2024-09-10T08:28:49.354721+0000","last_clean":"2024-09-10T08:28:49.354721+0000","last_became_active":"2024-09-10T08:28:35.582205+0000","last_became_peered":"2024-09-10T08:28:35.582205+0000","last_unstale":"2024-09-10T08:28:49.354721+0000","last_undegraded":"2024-09-10T08:28:49.354721+0000","last_fullsized":"2024-09-10T08:28:49.354721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:11.200963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:29:06.966813+0000","last_change":"2024-09-10T08:28:34.559823+0000","last_active":"2024-09-10T08:29:06.966813+0000","last_peered":"2024-09-10T08:29:06.966813+0000","last_clean":"2024-09-10T08:29:06.966813+0000","last_became_active":"2024-09-10T08:28:34.559560+0000","last_became_peered":"2024-09-10T08:28:34.559560+0000","last_unstale":"2024-09-10T08:29:06.966813+0000","last_undegraded":"2024-09-10T08:29:06.966813+0000","last_fullsized":"2024-09-10T08:29:06.966813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:53.724382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633994+0000","last_change":"2024-09-10T08:28:46.628040+0000","last_active":"2024-09-10T08:28:48.633994+0000","last_peered":"2024-09-10T08:28:48.633994+0000","last_clean":"2024-09-10T08:28:48.633994+0000","last_became_active":"2024-09-10T08:28:46.627819+0000","last_became_peered":"2024-09-10T08:28:46.627819+0000","last_unstale":"2024-09-10T08:28:48.633994+0000","last_undegraded":"2024-09-10T08:28:48.633994+0000","last_fullsized":"2024-09-10T08:28:48.633994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:29.467540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634305+0000","last_change":"2024-09-10T08:28:47.628067+0000","last_active":"2024-09-10T08:28:48.634305+0000","last_peered":"2024-09-10T08:28:48.634305+0000","last_clean":"2024-09-10T08:28:48.634305+0000","last_became_active":"2024-09-10T08:28:47.627775+0000","last_became_peered":"2024-09-10T08:28:47.627775+0000","last_unstale":"2024-09-10T08:28:48.634305+0000","last_undegraded":"2024-09-10T08:28:48.634305+0000","last_fullsized":"2024-09-10T08:28:48.634305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:43.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621613+0000","last_change":"2024-09-10T08:28:35.571262+0000","last_active":"2024-09-10T08:28:48.621613+0000","last_peered":"2024-09-10T08:28:48.621613+0000","last_clean":"2024-09-10T08:28:48.621613+0000","last_became_active":"2024-09-10T08:28:35.570711+0000","last_became_peered":"2024-09-10T08:28:35.570711+0000","last_unstale":"2024-09-10T08:28:48.621613+0000","last_undegraded":"2024-09-10T08:28:48.621613+0000","last_fullsized":"2024-09-10T08:28:48.621613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:29.116422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634766+0000","last_change":"2024-09-10T08:28:34.557352+0000","last_active":"2024-09-10T08:28:48.634766+0000","last_peered":"2024-09-10T08:28:48.634766+0000","last_clean":"2024-09-10T08:28:48.634766+0000","last_became_active":"2024-09-10T08:28:34.557076+0000","last_became_peered":"2024-09-10T08:28:34.557076+0000","last_unstale":"2024-09-10T08:28:48.634766+0000","last_undegraded":"2024-09-10T08:28:48.634766+0000","last_fullsized":"2024-09-10T08:28:48.634766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:04.957739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620317+0000","last_change":"2024-09-10T08:28:46.615923+0000","last_active":"2024-09-10T08:28:48.620317+0000","last_peered":"2024-09-10T08:28:48.620317+0000","last_clean":"2024-09-10T08:28:48.620317+0000","last_became_active":"2024-09-10T08:28:46.615451+0000","last_became_peered":"2024-09-10T08:28:46.615451+0000","last_unstale":"2024-09-10T08:28:48.620317+0000","last_undegraded":"2024-09-10T08:28:48.620317+0000","last_fullsized":"2024-09-10T08:28:48.620317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:22.612001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421320+0000","last_change":"2024-09-10T08:28:47.623223+0000","last_active":"2024-09-10T08:28:49.421320+0000","last_peered":"2024-09-10T08:28:49.421320+0000","last_clean":"2024-09-10T08:28:49.421320+0000","last_became_active":"2024-09-10T08:28:47.622961+0000","last_became_peered":"2024-09-10T08:28:47.622961+0000","last_unstale":"2024-09-10T08:28:49.421320+0000","last_undegraded":"2024-09-10T08:28:49.421320+0000","last_fullsized":"2024-09-10T08:28:49.421320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:30.979580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631925+0000","last_change":"2024-09-10T08:28:35.577913+0000","last_active":"2024-09-10T08:28:48.631925+0000","last_peered":"2024-09-10T08:28:48.631925+0000","last_clean":"2024-09-10T08:28:48.631925+0000","last_became_active":"2024-09-10T08:28:35.577255+0000","last_became_peered":"2024-09-10T08:28:35.577255+0000","last_unstale":"2024-09-10T08:28:48.631925+0000","last_undegraded":"2024-09-10T08:28:48.631925+0000","last_fullsized":"2024-09-10T08:28:48.631925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:17.413525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621690+0000","last_change":"2024-09-10T08:28:34.564571+0000","last_active":"2024-09-10T08:28:48.621690+0000","last_peered":"2024-09-10T08:28:48.621690+0000","last_clean":"2024-09-10T08:28:48.621690+0000","last_became_active":"2024-09-10T08:28:34.564189+0000","last_became_peered":"2024-09-10T08:28:34.564189+0000","last_unstale":"2024-09-10T08:28:48.621690+0000","last_undegraded":"2024-09-10T08:28:48.621690+0000","last_fullsized":"2024-09-10T08:28:48.621690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:46.055510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621316+0000","last_change":"2024-09-10T08:28:46.618917+0000","last_active":"2024-09-10T08:28:48.621316+0000","last_peered":"2024-09-10T08:28:48.621316+0000","last_clean":"2024-09-10T08:28:48.621316+0000","last_became_active":"2024-09-10T08:28:46.618625+0000","last_became_peered":"2024-09-10T08:28:46.618625+0000","last_unstale":"2024-09-10T08:28:48.621316+0000","last_undegraded":"2024-09-10T08:28:48.621316+0000","last_fullsized":"2024-09-10T08:28:48.621316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:19.431857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354237+0000","last_change":"2024-09-10T08:28:47.630243+0000","last_active":"2024-09-10T08:28:49.354237+0000","last_peered":"2024-09-10T08:28:49.354237+0000","last_clean":"2024-09-10T08:28:49.354237+0000","last_became_active":"2024-09-10T08:28:47.629869+0000","last_became_peered":"2024-09-10T08:28:47.629869+0000","last_unstale":"2024-09-10T08:28:49.354237+0000","last_undegraded":"2024-09-10T08:28:49.354237+0000","last_fullsized":"2024-09-10T08:28:49.354237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:58.696156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621683+0000","last_change":"2024-09-10T08:28:35.572944+0000","last_active":"2024-09-10T08:28:48.621683+0000","last_peered":"2024-09-10T08:28:48.621683+0000","last_clean":"2024-09-10T08:28:48.621683+0000","last_became_active":"2024-09-10T08:28:35.572620+0000","last_became_peered":"2024-09-10T08:28:35.572620+0000","last_unstale":"2024-09-10T08:28:48.621683+0000","last_undegraded":"2024-09-10T08:28:48.621683+0000","last_fullsized":"2024-09-10T08:28:48.621683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:04.524048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421956+0000","last_change":"2024-09-10T08:28:34.562935+0000","last_active":"2024-09-10T08:28:49.421956+0000","last_peered":"2024-09-10T08:28:49.421956+0000","last_clean":"2024-09-10T08:28:49.421956+0000","last_became_active":"2024-09-10T08:28:34.562647+0000","last_became_peered":"2024-09-10T08:28:34.562647+0000","last_unstale":"2024-09-10T08:28:49.421956+0000","last_undegraded":"2024-09-10T08:28:49.421956+0000","last_fullsized":"2024-09-10T08:28:49.421956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:47.492281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621382+0000","last_change":"2024-09-10T08:28:46.621472+0000","last_active":"2024-09-10T08:28:48.621382+0000","last_peered":"2024-09-10T08:28:48.621382+0000","last_clean":"2024-09-10T08:28:48.621382+0000","last_became_active":"2024-09-10T08:28:46.621157+0000","last_became_peered":"2024-09-10T08:28:46.621157+0000","last_unstale":"2024-09-10T08:28:48.621382+0000","last_undegraded":"2024-09-10T08:28:48.621382+0000","last_fullsized":"2024-09-10T08:28:48.621382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:44.166068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421835+0000","last_change":"2024-09-10T08:28:47.627750+0000","last_active":"2024-09-10T08:28:49.421835+0000","last_peered":"2024-09-10T08:28:49.421835+0000","last_clean":"2024-09-10T08:28:49.421835+0000","last_became_active":"2024-09-10T08:28:47.627481+0000","last_became_peered":"2024-09-10T08:28:47.627481+0000","last_unstale":"2024-09-10T08:28:49.421835+0000","last_undegraded":"2024-09-10T08:28:49.421835+0000","last_fullsized":"2024-09-10T08:28:49.421835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:01.105133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631930+0000","last_change":"2024-09-10T08:28:46.620162+0000","last_active":"2024-09-10T08:28:48.631930+0000","last_peered":"2024-09-10T08:28:48.631930+0000","last_clean":"2024-09-10T08:28:48.631930+0000","last_became_active":"2024-09-10T08:28:46.619843+0000","last_became_peered":"2024-09-10T08:28:46.619843+0000","last_unstale":"2024-09-10T08:28:48.631930+0000","last_undegraded":"2024-09-10T08:28:48.631930+0000","last_fullsized":"2024-09-10T08:28:48.631930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:21.376123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633938+0000","last_change":"2024-09-10T08:28:35.572803+0000","last_active":"2024-09-10T08:28:48.633938+0000","last_peered":"2024-09-10T08:28:48.633938+0000","last_clean":"2024-09-10T08:28:48.633938+0000","last_became_active":"2024-09-10T08:28:35.572219+0000","last_became_peered":"2024-09-10T08:28:35.572219+0000","last_unstale":"2024-09-10T08:28:48.633938+0000","last_undegraded":"2024-09-10T08:28:48.633938+0000","last_fullsized":"2024-09-10T08:28:48.633938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:45.920218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620645+0000","last_change":"2024-09-10T08:28:34.554346+0000","last_active":"2024-09-10T08:28:48.620645+0000","last_peered":"2024-09-10T08:28:48.620645+0000","last_clean":"2024-09-10T08:28:48.620645+0000","last_became_active":"2024-09-10T08:28:34.553933+0000","last_became_peered":"2024-09-10T08:28:34.553933+0000","last_unstale":"2024-09-10T08:28:48.620645+0000","last_undegraded":"2024-09-10T08:28:48.620645+0000","last_fullsized":"2024-09-10T08:28:48.620645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:07.639671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631936+0000","last_change":"2024-09-10T08:28:47.629468+0000","last_active":"2024-09-10T08:28:48.631936+0000","last_peered":"2024-09-10T08:28:48.631936+0000","last_clean":"2024-09-10T08:28:48.631936+0000","last_became_active":"2024-09-10T08:28:47.629177+0000","last_became_peered":"2024-09-10T08:28:47.629177+0000","last_unstale":"2024-09-10T08:28:48.631936+0000","last_undegraded":"2024-09-10T08:28:48.631936+0000","last_fullsized":"2024-09-10T08:28:48.631936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:10.443235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421808+0000","last_change":"2024-09-10T08:28:46.630904+0000","last_active":"2024-09-10T08:28:49.421808+0000","last_peered":"2024-09-10T08:28:49.421808+0000","last_clean":"2024-09-10T08:28:49.421808+0000","last_became_active":"2024-09-10T08:28:46.630530+0000","last_became_peered":"2024-09-10T08:28:46.630530+0000","last_unstale":"2024-09-10T08:28:49.421808+0000","last_undegraded":"2024-09-10T08:28:49.421808+0000","last_fullsized":"2024-09-10T08:28:49.421808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:33.599739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621556+0000","last_change":"2024-09-10T08:28:35.580244+0000","last_active":"2024-09-10T08:28:48.621556+0000","last_peered":"2024-09-10T08:28:48.621556+0000","last_clean":"2024-09-10T08:28:48.621556+0000","last_became_active":"2024-09-10T08:28:35.579975+0000","last_became_peered":"2024-09-10T08:28:35.579975+0000","last_unstale":"2024-09-10T08:28:48.621556+0000","last_undegraded":"2024-09-10T08:28:48.621556+0000","last_fullsized":"2024-09-10T08:28:48.621556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:16.498045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621654+0000","last_change":"2024-09-10T08:28:34.564751+0000","last_active":"2024-09-10T08:28:48.621654+0000","last_peered":"2024-09-10T08:28:48.621654+0000","last_clean":"2024-09-10T08:28:48.621654+0000","last_became_active":"2024-09-10T08:28:34.564479+0000","last_became_peered":"2024-09-10T08:28:34.564479+0000","last_unstale":"2024-09-10T08:28:48.621654+0000","last_undegraded":"2024-09-10T08:28:48.621654+0000","last_fullsized":"2024-09-10T08:28:48.621654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:29.618224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634645+0000","last_change":"2024-09-10T08:28:47.627041+0000","last_active":"2024-09-10T08:28:48.634645+0000","last_peered":"2024-09-10T08:28:48.634645+0000","last_clean":"2024-09-10T08:28:48.634645+0000","last_became_active":"2024-09-10T08:28:47.626692+0000","last_became_peered":"2024-09-10T08:28:47.626692+0000","last_unstale":"2024-09-10T08:28:48.634645+0000","last_undegraded":"2024-09-10T08:28:48.634645+0000","last_fullsized":"2024-09-10T08:28:48.634645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:57.666849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421403+0000","last_change":"2024-09-10T08:28:34.561906+0000","last_active":"2024-09-10T08:28:49.421403+0000","last_peered":"2024-09-10T08:28:49.421403+0000","last_clean":"2024-09-10T08:28:49.421403+0000","last_became_active":"2024-09-10T08:28:34.561613+0000","last_became_peered":"2024-09-10T08:28:34.561613+0000","last_unstale":"2024-09-10T08:28:49.421403+0000","last_undegraded":"2024-09-10T08:28:49.421403+0000","last_fullsized":"2024-09-10T08:28:49.421403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:56.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632248+0000","last_change":"2024-09-10T08:28:35.576406+0000","last_active":"2024-09-10T08:28:48.632248+0000","last_peered":"2024-09-10T08:28:48.632248+0000","last_clean":"2024-09-10T08:28:48.632248+0000","last_became_active":"2024-09-10T08:28:35.576145+0000","last_became_peered":"2024-09-10T08:28:35.576145+0000","last_unstale":"2024-09-10T08:28:48.632248+0000","last_undegraded":"2024-09-10T08:28:48.632248+0000","last_fullsized":"2024-09-10T08:28:48.632248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:57.667098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299845+0000","last_change":"2024-09-10T08:28:46.622395+0000","last_active":"2024-09-10T08:28:49.299845+0000","last_peered":"2024-09-10T08:28:49.299845+0000","last_clean":"2024-09-10T08:28:49.299845+0000","last_became_active":"2024-09-10T08:28:46.621941+0000","last_became_peered":"2024-09-10T08:28:46.621941+0000","last_unstale":"2024-09-10T08:28:49.299845+0000","last_undegraded":"2024-09-10T08:28:49.299845+0000","last_fullsized":"2024-09-10T08:28:49.299845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:54.928969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621387+0000","last_change":"2024-09-10T08:28:47.626495+0000","last_active":"2024-09-10T08:28:48.621387+0000","last_peered":"2024-09-10T08:28:48.621387+0000","last_clean":"2024-09-10T08:28:48.621387+0000","last_became_active":"2024-09-10T08:28:47.625258+0000","last_became_peered":"2024-09-10T08:28:47.625258+0000","last_unstale":"2024-09-10T08:28:48.621387+0000","last_undegraded":"2024-09-10T08:28:48.621387+0000","last_fullsized":"2024-09-10T08:28:48.621387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:00.101586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622005+0000","last_change":"2024-09-10T08:28:34.566606+0000","last_active":"2024-09-10T08:28:48.622005+0000","last_peered":"2024-09-10T08:28:48.622005+0000","last_clean":"2024-09-10T08:28:48.622005+0000","last_became_active":"2024-09-10T08:28:34.566388+0000","last_became_peered":"2024-09-10T08:28:34.566388+0000","last_unstale":"2024-09-10T08:28:48.622005+0000","last_undegraded":"2024-09-10T08:28:48.622005+0000","last_fullsized":"2024-09-10T08:28:48.622005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:33.528801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621394+0000","last_change":"2024-09-10T08:28:35.559371+0000","last_active":"2024-09-10T08:28:48.621394+0000","last_peered":"2024-09-10T08:28:48.621394+0000","last_clean":"2024-09-10T08:28:48.621394+0000","last_became_active":"2024-09-10T08:28:35.559145+0000","last_became_peered":"2024-09-10T08:28:35.559145+0000","last_unstale":"2024-09-10T08:28:48.621394+0000","last_undegraded":"2024-09-10T08:28:48.621394+0000","last_fullsized":"2024-09-10T08:28:48.621394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:57.339318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621811+0000","last_change":"2024-09-10T08:28:46.620231+0000","last_active":"2024-09-10T08:28:48.621811+0000","last_peered":"2024-09-10T08:28:48.621811+0000","last_clean":"2024-09-10T08:28:48.621811+0000","last_became_active":"2024-09-10T08:28:46.619403+0000","last_became_peered":"2024-09-10T08:28:46.619403+0000","last_unstale":"2024-09-10T08:28:48.621811+0000","last_undegraded":"2024-09-10T08:28:48.621811+0000","last_fullsized":"2024-09-10T08:28:48.621811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:26.308749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622383+0000","last_change":"2024-09-10T08:28:47.627135+0000","last_active":"2024-09-10T08:28:48.622383+0000","last_peered":"2024-09-10T08:28:48.622383+0000","last_clean":"2024-09-10T08:28:48.622383+0000","last_became_active":"2024-09-10T08:28:47.626791+0000","last_became_peered":"2024-09-10T08:28:47.626791+0000","last_unstale":"2024-09-10T08:28:48.622383+0000","last_undegraded":"2024-09-10T08:28:48.622383+0000","last_fullsized":"2024-09-10T08:28:48.622383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:43.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.420972+0000","last_change":"2024-09-10T08:28:35.579106+0000","last_active":"2024-09-10T08:28:49.420972+0000","last_peered":"2024-09-10T08:28:49.420972+0000","last_clean":"2024-09-10T08:28:49.420972+0000","last_became_active":"2024-09-10T08:28:35.578631+0000","last_became_peered":"2024-09-10T08:28:35.578631+0000","last_unstale":"2024-09-10T08:28:49.420972+0000","last_undegraded":"2024-09-10T08:28:49.420972+0000","last_fullsized":"2024-09-10T08:28:49.420972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:31.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634751+0000","last_change":"2024-09-10T08:28:47.632052+0000","last_active":"2024-09-10T08:28:48.634751+0000","last_peered":"2024-09-10T08:28:48.634751+0000","last_clean":"2024-09-10T08:28:48.634751+0000","last_became_active":"2024-09-10T08:28:47.631578+0000","last_became_peered":"2024-09-10T08:28:47.631578+0000","last_unstale":"2024-09-10T08:28:48.634751+0000","last_undegraded":"2024-09-10T08:28:48.634751+0000","last_fullsized":"2024-09-10T08:28:48.634751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:24.570729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299570+0000","last_change":"2024-09-10T08:28:35.566780+0000","last_active":"2024-09-10T08:28:49.299570+0000","last_peered":"2024-09-10T08:28:49.299570+0000","last_clean":"2024-09-10T08:28:49.299570+0000","last_became_active":"2024-09-10T08:28:35.566529+0000","last_became_peered":"2024-09-10T08:28:35.566529+0000","last_unstale":"2024-09-10T08:28:49.299570+0000","last_undegraded":"2024-09-10T08:28:49.299570+0000","last_fullsized":"2024-09-10T08:28:49.299570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:09.481166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621043+0000","last_change":"2024-09-10T08:28:47.629148+0000","last_active":"2024-09-10T08:28:48.621043+0000","last_peered":"2024-09-10T08:28:48.621043+0000","last_clean":"2024-09-10T08:28:48.621043+0000","last_became_active":"2024-09-10T08:28:47.628741+0000","last_became_peered":"2024-09-10T08:28:47.628741+0000","last_unstale":"2024-09-10T08:28:48.621043+0000","last_undegraded":"2024-09-10T08:28:48.621043+0000","last_fullsized":"2024-09-10T08:28:48.621043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:48.950503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621017+0000","last_change":"2024-09-10T08:28:35.578735+0000","last_active":"2024-09-10T08:28:48.621017+0000","last_peered":"2024-09-10T08:28:48.621017+0000","last_clean":"2024-09-10T08:28:48.621017+0000","last_became_active":"2024-09-10T08:28:35.577995+0000","last_became_peered":"2024-09-10T08:28:35.577995+0000","last_unstale":"2024-09-10T08:28:48.621017+0000","last_undegraded":"2024-09-10T08:28:48.621017+0000","last_fullsized":"2024-09-10T08:28:48.621017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:11.033441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634650+0000","last_change":"2024-09-10T08:28:47.628639+0000","last_active":"2024-09-10T08:28:48.634650+0000","last_peered":"2024-09-10T08:28:48.634650+0000","last_clean":"2024-09-10T08:28:48.634650+0000","last_became_active":"2024-09-10T08:28:47.628317+0000","last_became_peered":"2024-09-10T08:28:47.628317+0000","last_unstale":"2024-09-10T08:28:48.634650+0000","last_undegraded":"2024-09-10T08:28:48.634650+0000","last_fullsized":"2024-09-10T08:28:48.634650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:50.314678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632190+0000","last_change":"2024-09-10T08:28:35.577852+0000","last_active":"2024-09-10T08:28:48.632190+0000","last_peered":"2024-09-10T08:28:48.632190+0000","last_clean":"2024-09-10T08:28:48.632190+0000","last_became_active":"2024-09-10T08:28:35.577571+0000","last_became_peered":"2024-09-10T08:28:35.577571+0000","last_unstale":"2024-09-10T08:28:48.632190+0000","last_undegraded":"2024-09-10T08:28:48.632190+0000","last_fullsized":"2024-09-10T08:28:48.632190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:22.713732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354207+0000","last_change":"2024-09-10T08:28:47.629931+0000","last_active":"2024-09-10T08:28:49.354207+0000","last_peered":"2024-09-10T08:28:49.354207+0000","last_clean":"2024-09-10T08:28:49.354207+0000","last_became_active":"2024-09-10T08:28:47.629634+0000","last_became_peered":"2024-09-10T08:28:47.629634+0000","last_unstale":"2024-09-10T08:28:49.354207+0000","last_undegraded":"2024-09-10T08:28:49.354207+0000","last_fullsized":"2024-09-10T08:28:49.354207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:57.964208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622194+0000","last_change":"2024-09-10T08:28:35.574676+0000","last_active":"2024-09-10T08:28:48.622194+0000","last_peered":"2024-09-10T08:28:48.622194+0000","last_clean":"2024-09-10T08:28:48.622194+0000","last_became_active":"2024-09-10T08:28:35.574437+0000","last_became_peered":"2024-09-10T08:28:35.574437+0000","last_unstale":"2024-09-10T08:28:48.622194+0000","last_undegraded":"2024-09-10T08:28:48.622194+0000","last_fullsized":"2024-09-10T08:28:48.622194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:45.422506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620118+0000","last_change":"2024-09-10T08:28:47.624178+0000","last_active":"2024-09-10T08:28:48.620118+0000","last_peered":"2024-09-10T08:28:48.620118+0000","last_clean":"2024-09-10T08:28:48.620118+0000","last_became_active":"2024-09-10T08:28:47.623671+0000","last_became_peered":"2024-09-10T08:28:47.623671+0000","last_unstale":"2024-09-10T08:28:48.620118+0000","last_undegraded":"2024-09-10T08:28:48.620118+0000","last_fullsized":"2024-09-10T08:28:48.620118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:48.613870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634693+0000","last_change":"2024-09-10T08:28:35.572550+0000","last_active":"2024-09-10T08:28:48.634693+0000","last_peered":"2024-09-10T08:28:48.634693+0000","last_clean":"2024-09-10T08:28:48.634693+0000","last_became_active":"2024-09-10T08:28:35.572184+0000","last_became_peered":"2024-09-10T08:28:35.572184+0000","last_unstale":"2024-09-10T08:28:48.634693+0000","last_undegraded":"2024-09-10T08:28:48.634693+0000","last_fullsized":"2024-09-10T08:28:48.634693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:08.490734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354228+0000","last_change":"2024-09-10T08:28:47.630214+0000","last_active":"2024-09-10T08:28:49.354228+0000","last_peered":"2024-09-10T08:28:49.354228+0000","last_clean":"2024-09-10T08:28:49.354228+0000","last_became_active":"2024-09-10T08:28:47.629512+0000","last_became_peered":"2024-09-10T08:28:47.629512+0000","last_unstale":"2024-09-10T08:28:49.354228+0000","last_undegraded":"2024-09-10T08:28:49.354228+0000","last_fullsized":"2024-09-10T08:28:49.354228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:35.692107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421683+0000","last_change":"2024-09-10T08:28:35.573217+0000","last_active":"2024-09-10T08:28:49.421683+0000","last_peered":"2024-09-10T08:28:49.421683+0000","last_clean":"2024-09-10T08:28:49.421683+0000","last_became_active":"2024-09-10T08:28:35.572955+0000","last_became_peered":"2024-09-10T08:28:35.572955+0000","last_unstale":"2024-09-10T08:28:49.421683+0000","last_undegraded":"2024-09-10T08:28:49.421683+0000","last_fullsized":"2024-09-10T08:28:49.421683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:24.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421176+0000","last_change":"2024-09-10T08:28:47.623365+0000","last_active":"2024-09-10T08:28:49.421176+0000","last_peered":"2024-09-10T08:28:49.421176+0000","last_clean":"2024-09-10T08:28:49.421176+0000","last_became_active":"2024-09-10T08:28:47.623082+0000","last_became_peered":"2024-09-10T08:28:47.623082+0000","last_unstale":"2024-09-10T08:28:49.421176+0000","last_undegraded":"2024-09-10T08:28:49.421176+0000","last_fullsized":"2024-09-10T08:28:49.421176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:20.558484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622192+0000","last_change":"2024-09-10T08:28:35.575902+0000","last_active":"2024-09-10T08:28:48.622192+0000","last_peered":"2024-09-10T08:28:48.622192+0000","last_clean":"2024-09-10T08:28:48.622192+0000","last_became_active":"2024-09-10T08:28:35.575614+0000","last_became_peered":"2024-09-10T08:28:35.575614+0000","last_unstale":"2024-09-10T08:28:48.622192+0000","last_undegraded":"2024-09-10T08:28:48.622192+0000","last_fullsized":"2024-09-10T08:28:48.622192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:11.277682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622312+0000","last_change":"2024-09-10T08:28:47.629795+0000","last_active":"2024-09-10T08:28:48.622312+0000","last_peered":"2024-09-10T08:28:48.622312+0000","last_clean":"2024-09-10T08:28:48.622312+0000","last_became_active":"2024-09-10T08:28:47.628861+0000","last_became_peered":"2024-09-10T08:28:47.628861+0000","last_unstale":"2024-09-10T08:28:48.622312+0000","last_undegraded":"2024-09-10T08:28:48.622312+0000","last_fullsized":"2024-09-10T08:28:48.622312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:06.277094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620538+0000","last_change":"2024-09-10T08:28:35.578285+0000","last_active":"2024-09-10T08:28:48.620538+0000","last_peered":"2024-09-10T08:28:48.620538+0000","last_clean":"2024-09-10T08:28:48.620538+0000","last_became_active":"2024-09-10T08:28:35.576805+0000","last_became_peered":"2024-09-10T08:28:35.576805+0000","last_unstale":"2024-09-10T08:28:48.620538+0000","last_undegraded":"2024-09-10T08:28:48.620538+0000","last_fullsized":"2024-09-10T08:28:48.620538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:46.203320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355252+0000","last_change":"2024-09-10T08:28:47.635713+0000","last_active":"2024-09-10T08:28:49.355252+0000","last_peered":"2024-09-10T08:28:49.355252+0000","last_clean":"2024-09-10T08:28:49.355252+0000","last_became_active":"2024-09-10T08:28:47.635381+0000","last_became_peered":"2024-09-10T08:28:47.635381+0000","last_unstale":"2024-09-10T08:28:49.355252+0000","last_undegraded":"2024-09-10T08:28:49.355252+0000","last_fullsized":"2024-09-10T08:28:49.355252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:39.419510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621520+0000","last_change":"2024-09-10T08:28:35.571566+0000","last_active":"2024-09-10T08:28:48.621520+0000","last_peered":"2024-09-10T08:28:48.621520+0000","last_clean":"2024-09-10T08:28:48.621520+0000","last_became_active":"2024-09-10T08:28:35.571285+0000","last_became_peered":"2024-09-10T08:28:35.571285+0000","last_unstale":"2024-09-10T08:28:48.621520+0000","last_undegraded":"2024-09-10T08:28:48.621520+0000","last_fullsized":"2024-09-10T08:28:48.621520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:23.587691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299893+0000","last_change":"2024-09-10T08:28:47.619863+0000","last_active":"2024-09-10T08:28:49.299893+0000","last_peered":"2024-09-10T08:28:49.299893+0000","last_clean":"2024-09-10T08:28:49.299893+0000","last_became_active":"2024-09-10T08:28:47.619525+0000","last_became_peered":"2024-09-10T08:28:47.619525+0000","last_unstale":"2024-09-10T08:28:49.299893+0000","last_undegraded":"2024-09-10T08:28:49.299893+0000","last_fullsized":"2024-09-10T08:28:49.299893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:49.591318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620937+0000","last_change":"2024-09-10T08:28:35.568044+0000","last_active":"2024-09-10T08:28:48.620937+0000","last_peered":"2024-09-10T08:28:48.620937+0000","last_clean":"2024-09-10T08:28:48.620937+0000","last_became_active":"2024-09-10T08:28:35.567744+0000","last_became_peered":"2024-09-10T08:28:35.567744+0000","last_unstale":"2024-09-10T08:28:48.620937+0000","last_undegraded":"2024-09-10T08:28:48.620937+0000","last_fullsized":"2024-09-10T08:28:48.620937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:19.081138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621697+0000","last_change":"2024-09-10T08:28:47.629417+0000","last_active":"2024-09-10T08:28:48.621697+0000","last_peered":"2024-09-10T08:28:48.621697+0000","last_clean":"2024-09-10T08:28:48.621697+0000","last_became_active":"2024-09-10T08:28:47.629095+0000","last_became_peered":"2024-09-10T08:28:47.629095+0000","last_unstale":"2024-09-10T08:28:48.621697+0000","last_undegraded":"2024-09-10T08:28:48.621697+0000","last_fullsized":"2024-09-10T08:28:48.621697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:05.606381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632075+0000","last_change":"2024-09-10T08:28:35.575802+0000","last_active":"2024-09-10T08:28:48.632075+0000","last_peered":"2024-09-10T08:28:48.632075+0000","last_clean":"2024-09-10T08:28:48.632075+0000","last_became_active":"2024-09-10T08:28:35.575388+0000","last_became_peered":"2024-09-10T08:28:35.575388+0000","last_unstale":"2024-09-10T08:28:48.632075+0000","last_undegraded":"2024-09-10T08:28:48.632075+0000","last_fullsized":"2024-09-10T08:28:48.632075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:01.424265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620142+0000","last_change":"2024-09-10T08:28:47.624305+0000","last_active":"2024-09-10T08:28:48.620142+0000","last_peered":"2024-09-10T08:28:48.620142+0000","last_clean":"2024-09-10T08:28:48.620142+0000","last_became_active":"2024-09-10T08:28:47.624026+0000","last_became_peered":"2024-09-10T08:28:47.624026+0000","last_unstale":"2024-09-10T08:28:48.620142+0000","last_undegraded":"2024-09-10T08:28:48.620142+0000","last_fullsized":"2024-09-10T08:28:48.620142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:01.194271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421368+0000","last_change":"2024-09-10T08:28:35.574499+0000","last_active":"2024-09-10T08:28:49.421368+0000","last_peered":"2024-09-10T08:28:49.421368+0000","last_clean":"2024-09-10T08:28:49.421368+0000","last_became_active":"2024-09-10T08:28:35.574249+0000","last_became_peered":"2024-09-10T08:28:35.574249+0000","last_unstale":"2024-09-10T08:28:49.421368+0000","last_undegraded":"2024-09-10T08:28:49.421368+0000","last_fullsized":"2024-09-10T08:28:49.421368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:55.952307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620349+0000","last_change":"2024-09-10T08:28:47.629525+0000","last_active":"2024-09-10T08:28:48.620349+0000","last_peered":"2024-09-10T08:28:48.620349+0000","last_clean":"2024-09-10T08:28:48.620349+0000","last_became_active":"2024-09-10T08:28:47.629259+0000","last_became_peered":"2024-09-10T08:28:47.629259+0000","last_unstale":"2024-09-10T08:28:48.620349+0000","last_undegraded":"2024-09-10T08:28:48.620349+0000","last_fullsized":"2024-09-10T08:28:48.620349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:11.864322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355002+0000","last_change":"2024-09-10T08:28:35.572709+0000","last_active":"2024-09-10T08:28:49.355002+0000","last_peered":"2024-09-10T08:28:49.355002+0000","last_clean":"2024-09-10T08:28:49.355002+0000","last_became_active":"2024-09-10T08:28:35.572392+0000","last_became_peered":"2024-09-10T08:28:35.572392+0000","last_unstale":"2024-09-10T08:28:49.355002+0000","last_undegraded":"2024-09-10T08:28:49.355002+0000","last_fullsized":"2024-09-10T08:28:49.355002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:42.636299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619769+0000","last_change":"2024-09-10T08:28:47.623285+0000","last_active":"2024-09-10T08:28:48.619769+0000","last_peered":"2024-09-10T08:28:48.619769+0000","last_clean":"2024-09-10T08:28:48.619769+0000","last_became_active":"2024-09-10T08:28:47.621776+0000","last_became_peered":"2024-09-10T08:28:47.621776+0000","last_unstale":"2024-09-10T08:28:48.619769+0000","last_undegraded":"2024-09-10T08:28:48.619769+0000","last_fullsized":"2024-09-10T08:28:48.619769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:32.543418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.300034+0000","last_change":"2024-09-10T08:28:35.574438+0000","last_active":"2024-09-10T08:28:49.300034+0000","last_peered":"2024-09-10T08:28:49.300034+0000","last_clean":"2024-09-10T08:28:49.300034+0000","last_became_active":"2024-09-10T08:28:35.574175+0000","last_became_peered":"2024-09-10T08:28:35.574175+0000","last_unstale":"2024-09-10T08:28:49.300034+0000","last_undegraded":"2024-09-10T08:28:49.300034+0000","last_fullsized":"2024-09-10T08:28:49.300034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:55.808543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631598+0000","last_change":"2024-09-10T08:28:47.629092+0000","last_active":"2024-09-10T08:28:48.631598+0000","last_peered":"2024-09-10T08:28:48.631598+0000","last_clean":"2024-09-10T08:28:48.631598+0000","last_became_active":"2024-09-10T08:28:47.628806+0000","last_became_peered":"2024-09-10T08:28:47.628806+0000","last_unstale":"2024-09-10T08:28:48.631598+0000","last_undegraded":"2024-09-10T08:28:48.631598+0000","last_fullsized":"2024-09-10T08:28:48.631598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:46.440290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622000+0000","last_change":"2024-09-10T08:28:35.567296+0000","last_active":"2024-09-10T08:28:48.622000+0000","last_peered":"2024-09-10T08:28:48.622000+0000","last_clean":"2024-09-10T08:28:48.622000+0000","last_became_active":"2024-09-10T08:28:35.567074+0000","last_became_peered":"2024-09-10T08:28:35.567074+0000","last_unstale":"2024-09-10T08:28:48.622000+0000","last_undegraded":"2024-09-10T08:28:48.622000+0000","last_fullsized":"2024-09-10T08:28:48.622000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:55.698345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634643+0000","last_change":"2024-09-10T08:28:47.631797+0000","last_active":"2024-09-10T08:28:48.634643+0000","last_peered":"2024-09-10T08:28:48.634643+0000","last_clean":"2024-09-10T08:28:48.634643+0000","last_became_active":"2024-09-10T08:28:47.631523+0000","last_became_peered":"2024-09-10T08:28:47.631523+0000","last_unstale":"2024-09-10T08:28:48.634643+0000","last_undegraded":"2024-09-10T08:28:48.634643+0000","last_fullsized":"2024-09-10T08:28:48.634643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:05.829116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619838+0000","last_change":"2024-09-10T08:28:35.570249+0000","last_active":"2024-09-10T08:28:48.619838+0000","last_peered":"2024-09-10T08:28:48.619838+0000","last_clean":"2024-09-10T08:28:48.619838+0000","last_became_active":"2024-09-10T08:28:35.569960+0000","last_became_peered":"2024-09-10T08:28:35.569960+0000","last_unstale":"2024-09-10T08:28:48.619838+0000","last_undegraded":"2024-09-10T08:28:48.619838+0000","last_fullsized":"2024-09-10T08:28:48.619838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:29.787554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620473+0000","last_change":"2024-09-10T08:28:47.633644+0000","last_active":"2024-09-10T08:28:48.620473+0000","last_peered":"2024-09-10T08:28:48.620473+0000","last_clean":"2024-09-10T08:28:48.620473+0000","last_became_active":"2024-09-10T08:28:47.633315+0000","last_became_peered":"2024-09-10T08:28:47.633315+0000","last_unstale":"2024-09-10T08:28:48.620473+0000","last_undegraded":"2024-09-10T08:28:48.620473+0000","last_fullsized":"2024-09-10T08:28:48.620473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:45:55.827386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634008+0000","last_change":"2024-09-10T08:28:35.560693+0000","last_active":"2024-09-10T08:28:48.634008+0000","last_peered":"2024-09-10T08:28:48.634008+0000","last_clean":"2024-09-10T08:28:48.634008+0000","last_became_active":"2024-09-10T08:28:35.560409+0000","last_became_peered":"2024-09-10T08:28:35.560409+0000","last_unstale":"2024-09-10T08:28:48.634008+0000","last_undegraded":"2024-09-10T08:28:48.634008+0000","last_fullsized":"2024-09-10T08:28:48.634008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:10.597654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621112+0000","last_change":"2024-09-10T08:28:47.622614+0000","last_active":"2024-09-10T08:28:48.621112+0000","last_peered":"2024-09-10T08:28:48.621112+0000","last_clean":"2024-09-10T08:28:48.621112+0000","last_became_active":"2024-09-10T08:28:47.622205+0000","last_became_peered":"2024-09-10T08:28:47.622205+0000","last_unstale":"2024-09-10T08:28:48.621112+0000","last_undegraded":"2024-09-10T08:28:48.621112+0000","last_fullsized":"2024-09-10T08:28:48.621112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:47.090782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631666+0000","last_change":"2024-09-10T08:28:35.574551+0000","last_active":"2024-09-10T08:28:48.631666+0000","last_peered":"2024-09-10T08:28:48.631666+0000","last_clean":"2024-09-10T08:28:48.631666+0000","last_became_active":"2024-09-10T08:28:35.574256+0000","last_became_peered":"2024-09-10T08:28:35.574256+0000","last_unstale":"2024-09-10T08:28:48.631666+0000","last_undegraded":"2024-09-10T08:28:48.631666+0000","last_fullsized":"2024-09-10T08:28:48.631666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:43.401552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354791+0000","last_change":"2024-09-10T08:28:47.633476+0000","last_active":"2024-09-10T08:28:49.354791+0000","last_peered":"2024-09-10T08:28:49.354791+0000","last_clean":"2024-09-10T08:28:49.354791+0000","last_became_active":"2024-09-10T08:28:47.633189+0000","last_became_peered":"2024-09-10T08:28:47.633189+0000","last_unstale":"2024-09-10T08:28:49.354791+0000","last_undegraded":"2024-09-10T08:28:49.354791+0000","last_fullsized":"2024-09-10T08:28:49.354791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:46.175490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621900+0000","last_change":"2024-09-10T08:28:35.573330+0000","last_active":"2024-09-10T08:28:48.621900+0000","last_peered":"2024-09-10T08:28:48.621900+0000","last_clean":"2024-09-10T08:28:48.621900+0000","last_became_active":"2024-09-10T08:28:35.572992+0000","last_became_peered":"2024-09-10T08:28:35.572992+0000","last_unstale":"2024-09-10T08:28:48.621900+0000","last_undegraded":"2024-09-10T08:28:48.621900+0000","last_fullsized":"2024-09-10T08:28:48.621900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:15.412219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621967+0000","last_change":"2024-09-10T08:28:47.630733+0000","last_active":"2024-09-10T08:28:48.621967+0000","last_peered":"2024-09-10T08:28:48.621967+0000","last_clean":"2024-09-10T08:28:48.621967+0000","last_became_active":"2024-09-10T08:28:47.630447+0000","last_became_peered":"2024-09-10T08:28:47.630447+0000","last_unstale":"2024-09-10T08:28:48.621967+0000","last_undegraded":"2024-09-10T08:28:48.621967+0000","last_fullsized":"2024-09-10T08:28:48.621967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:08.797818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621594+0000","last_change":"2024-09-10T08:28:35.566574+0000","last_active":"2024-09-10T08:28:48.621594+0000","last_peered":"2024-09-10T08:28:48.621594+0000","last_clean":"2024-09-10T08:28:48.621594+0000","last_became_active":"2024-09-10T08:28:35.566205+0000","last_became_peered":"2024-09-10T08:28:35.566205+0000","last_unstale":"2024-09-10T08:28:48.621594+0000","last_undegraded":"2024-09-10T08:28:48.621594+0000","last_fullsized":"2024-09-10T08:28:48.621594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:49.876773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299778+0000","last_change":"2024-09-10T08:28:47.628051+0000","last_active":"2024-09-10T08:28:49.299778+0000","last_peered":"2024-09-10T08:28:49.299778+0000","last_clean":"2024-09-10T08:28:49.299778+0000","last_became_active":"2024-09-10T08:28:47.627747+0000","last_became_peered":"2024-09-10T08:28:47.627747+0000","last_unstale":"2024-09-10T08:28:49.299778+0000","last_undegraded":"2024-09-10T08:28:49.299778+0000","last_fullsized":"2024-09-10T08:28:49.299778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:54.210449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421487+0000","last_change":"2024-09-10T08:28:35.565023+0000","last_active":"2024-09-10T08:28:49.421487+0000","last_peered":"2024-09-10T08:28:49.421487+0000","last_clean":"2024-09-10T08:28:49.421487+0000","last_became_active":"2024-09-10T08:28:35.564747+0000","last_became_peered":"2024-09-10T08:28:35.564747+0000","last_unstale":"2024-09-10T08:28:49.421487+0000","last_undegraded":"2024-09-10T08:28:49.421487+0000","last_fullsized":"2024-09-10T08:28:49.421487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:32.419621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354688+0000","last_change":"2024-09-10T08:28:47.631047+0000","last_active":"2024-09-10T08:28:49.354688+0000","last_peered":"2024-09-10T08:28:49.354688+0000","last_clean":"2024-09-10T08:28:49.354688+0000","last_became_active":"2024-09-10T08:28:47.630617+0000","last_became_peered":"2024-09-10T08:28:47.630617+0000","last_unstale":"2024-09-10T08:28:49.354688+0000","last_undegraded":"2024-09-10T08:28:49.354688+0000","last_fullsized":"2024-09-10T08:28:49.354688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:29.867640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421612+0000","last_change":"2024-09-10T08:28:35.570619+0000","last_active":"2024-09-10T08:28:49.421612+0000","last_peered":"2024-09-10T08:28:49.421612+0000","last_clean":"2024-09-10T08:28:49.421612+0000","last_became_active":"2024-09-10T08:28:35.570351+0000","last_became_peered":"2024-09-10T08:28:35.570351+0000","last_unstale":"2024-09-10T08:28:49.421612+0000","last_undegraded":"2024-09-10T08:28:49.421612+0000","last_fullsized":"2024-09-10T08:28:49.421612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:35.161279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620557+0000","last_change":"2024-09-10T08:28:47.626191+0000","last_active":"2024-09-10T08:28:48.620557+0000","last_peered":"2024-09-10T08:28:48.620557+0000","last_clean":"2024-09-10T08:28:48.620557+0000","last_became_active":"2024-09-10T08:28:47.625781+0000","last_became_peered":"2024-09-10T08:28:47.625781+0000","last_unstale":"2024-09-10T08:28:48.620557+0000","last_undegraded":"2024-09-10T08:28:48.620557+0000","last_fullsized":"2024-09-10T08:28:48.620557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:36:38.651973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355079+0000","last_change":"2024-09-10T08:28:35.577345+0000","last_active":"2024-09-10T08:28:49.355079+0000","last_peered":"2024-09-10T08:28:49.355079+0000","last_clean":"2024-09-10T08:28:49.355079+0000","last_became_active":"2024-09-10T08:28:35.576191+0000","last_became_peered":"2024-09-10T08:28:35.576191+0000","last_unstale":"2024-09-10T08:28:49.355079+0000","last_undegraded":"2024-09-10T08:28:49.355079+0000","last_fullsized":"2024-09-10T08:28:49.355079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:29.218797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622171+0000","last_change":"2024-09-10T08:28:47.623129+0000","last_active":"2024-09-10T08:28:48.622171+0000","last_peered":"2024-09-10T08:28:48.622171+0000","last_clean":"2024-09-10T08:28:48.622171+0000","last_became_active":"2024-09-10T08:28:47.622851+0000","last_became_peered":"2024-09-10T08:28:47.622851+0000","last_unstale":"2024-09-10T08:28:48.622171+0000","last_undegraded":"2024-09-10T08:28:48.622171+0000","last_fullsized":"2024-09-10T08:28:48.622171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:16.045213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621426+0000","last_change":"2024-09-10T08:28:35.575275+0000","last_active":"2024-09-10T08:28:48.621426+0000","last_peered":"2024-09-10T08:28:48.621426+0000","last_clean":"2024-09-10T08:28:48.621426+0000","last_became_active":"2024-09-10T08:28:35.575052+0000","last_became_peered":"2024-09-10T08:28:35.575052+0000","last_unstale":"2024-09-10T08:28:48.621426+0000","last_undegraded":"2024-09-10T08:28:48.621426+0000","last_fullsized":"2024-09-10T08:28:48.621426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:24.313017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421741+0000","last_change":"2024-09-10T08:28:47.628651+0000","last_active":"2024-09-10T08:28:49.421741+0000","last_peered":"2024-09-10T08:28:49.421741+0000","last_clean":"2024-09-10T08:28:49.421741+0000","last_became_active":"2024-09-10T08:28:47.628343+0000","last_became_peered":"2024-09-10T08:28:47.628343+0000","last_unstale":"2024-09-10T08:28:49.421741+0000","last_undegraded":"2024-09-10T08:28:49.421741+0000","last_fullsized":"2024-09-10T08:28:49.421741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:05.848341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354299+0000","last_change":"2024-09-10T08:28:35.578664+0000","last_active":"2024-09-10T08:28:49.354299+0000","last_peered":"2024-09-10T08:28:49.354299+0000","last_clean":"2024-09-10T08:28:49.354299+0000","last_became_active":"2024-09-10T08:28:35.578384+0000","last_became_peered":"2024-09-10T08:28:35.578384+0000","last_unstale":"2024-09-10T08:28:49.354299+0000","last_undegraded":"2024-09-10T08:28:49.354299+0000","last_fullsized":"2024-09-10T08:28:49.354299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:44.278718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634174+0000","last_change":"2024-09-10T08:28:47.627593+0000","last_active":"2024-09-10T08:28:48.634174+0000","last_peered":"2024-09-10T08:28:48.634174+0000","last_clean":"2024-09-10T08:28:48.634174+0000","last_became_active":"2024-09-10T08:28:47.627237+0000","last_became_peered":"2024-09-10T08:28:47.627237+0000","last_unstale":"2024-09-10T08:28:48.634174+0000","last_undegraded":"2024-09-10T08:28:48.634174+0000","last_fullsized":"2024-09-10T08:28:48.634174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:16.045213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620920+0000","last_change":"2024-09-10T08:28:35.578978+0000","last_active":"2024-09-10T08:28:48.620920+0000","last_peered":"2024-09-10T08:28:48.620920+0000","last_clean":"2024-09-10T08:28:48.620920+0000","last_became_active":"2024-09-10T08:28:35.578475+0000","last_became_peered":"2024-09-10T08:28:35.578475+0000","last_unstale":"2024-09-10T08:28:48.620920+0000","last_undegraded":"2024-09-10T08:28:48.620920+0000","last_fullsized":"2024-09-10T08:28:48.620920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:08.520314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621323+0000","last_change":"2024-09-10T08:28:47.634072+0000","last_active":"2024-09-10T08:28:48.621323+0000","last_peered":"2024-09-10T08:28:48.621323+0000","last_clean":"2024-09-10T08:28:48.621323+0000","last_became_active":"2024-09-10T08:28:47.633776+0000","last_became_peered":"2024-09-10T08:28:47.633776+0000","last_unstale":"2024-09-10T08:28:48.621323+0000","last_undegraded":"2024-09-10T08:28:48.621323+0000","last_fullsized":"2024-09-10T08:28:48.621323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:30.690202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354159+0000","last_change":"2024-09-10T08:28:35.572112+0000","last_active":"2024-09-10T08:28:49.354159+0000","last_peered":"2024-09-10T08:28:49.354159+0000","last_clean":"2024-09-10T08:28:49.354159+0000","last_became_active":"2024-09-10T08:28:35.571803+0000","last_became_peered":"2024-09-10T08:28:35.571803+0000","last_unstale":"2024-09-10T08:28:49.354159+0000","last_undegraded":"2024-09-10T08:28:49.354159+0000","last_fullsized":"2024-09-10T08:28:49.354159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:29.969987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621621+0000","last_change":"2024-09-10T08:28:47.620523+0000","last_active":"2024-09-10T08:28:48.621621+0000","last_peered":"2024-09-10T08:28:48.621621+0000","last_clean":"2024-09-10T08:28:48.621621+0000","last_became_active":"2024-09-10T08:28:47.620220+0000","last_became_peered":"2024-09-10T08:28:47.620220+0000","last_unstale":"2024-09-10T08:28:48.621621+0000","last_undegraded":"2024-09-10T08:28:48.621621+0000","last_fullsized":"2024-09-10T08:28:48.621621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:14.405210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621263+0000","last_change":"2024-09-10T08:28:35.578961+0000","last_active":"2024-09-10T08:28:48.621263+0000","last_peered":"2024-09-10T08:28:48.621263+0000","last_clean":"2024-09-10T08:28:48.621263+0000","last_became_active":"2024-09-10T08:28:35.578680+0000","last_became_peered":"2024-09-10T08:28:35.578680+0000","last_unstale":"2024-09-10T08:28:48.621263+0000","last_undegraded":"2024-09-10T08:28:48.621263+0000","last_fullsized":"2024-09-10T08:28:48.621263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:53.737412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299727+0000","last_change":"2024-09-10T08:28:47.624859+0000","last_active":"2024-09-10T08:28:49.299727+0000","last_peered":"2024-09-10T08:28:49.299727+0000","last_clean":"2024-09-10T08:28:49.299727+0000","last_became_active":"2024-09-10T08:28:47.624585+0000","last_became_peered":"2024-09-10T08:28:47.624585+0000","last_unstale":"2024-09-10T08:28:49.299727+0000","last_undegraded":"2024-09-10T08:28:49.299727+0000","last_fullsized":"2024-09-10T08:28:49.299727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:00.956870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631870+0000","last_change":"2024-09-10T08:28:35.573918+0000","last_active":"2024-09-10T08:28:48.631870+0000","last_peered":"2024-09-10T08:28:48.631870+0000","last_clean":"2024-09-10T08:28:48.631870+0000","last_became_active":"2024-09-10T08:28:35.573646+0000","last_became_peered":"2024-09-10T08:28:35.573646+0000","last_unstale":"2024-09-10T08:28:48.631870+0000","last_undegraded":"2024-09-10T08:28:48.631870+0000","last_fullsized":"2024-09-10T08:28:48.631870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:24.295630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354036+0000","last_change":"2024-09-10T08:28:47.631802+0000","last_active":"2024-09-10T08:28:49.354036+0000","last_peered":"2024-09-10T08:28:49.354036+0000","last_clean":"2024-09-10T08:28:49.354036+0000","last_became_active":"2024-09-10T08:28:47.631456+0000","last_became_peered":"2024-09-10T08:28:47.631456+0000","last_unstale":"2024-09-10T08:28:49.354036+0000","last_undegraded":"2024-09-10T08:28:49.354036+0000","last_fullsized":"2024-09-10T08:28:49.354036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:56.571659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634799+0000","last_change":"2024-09-10T08:28:35.578197+0000","last_active":"2024-09-10T08:28:48.634799+0000","last_peered":"2024-09-10T08:28:48.634799+0000","last_clean":"2024-09-10T08:28:48.634799+0000","last_became_active":"2024-09-10T08:28:35.577852+0000","last_became_peered":"2024-09-10T08:28:35.577852+0000","last_unstale":"2024-09-10T08:28:48.634799+0000","last_undegraded":"2024-09-10T08:28:48.634799+0000","last_fullsized":"2024-09-10T08:28:48.634799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:44.348299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354168+0000","last_change":"2024-09-10T08:28:47.629993+0000","last_active":"2024-09-10T08:28:49.354168+0000","last_peered":"2024-09-10T08:28:49.354168+0000","last_clean":"2024-09-10T08:28:49.354168+0000","last_became_active":"2024-09-10T08:28:47.629713+0000","last_became_peered":"2024-09-10T08:28:47.629713+0000","last_unstale":"2024-09-10T08:28:49.354168+0000","last_undegraded":"2024-09-10T08:28:49.354168+0000","last_fullsized":"2024-09-10T08:28:49.354168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:56.640722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355024+0000","last_change":"2024-09-10T08:28:35.571065+0000","last_active":"2024-09-10T08:28:49.355024+0000","last_peered":"2024-09-10T08:28:49.355024+0000","last_clean":"2024-09-10T08:28:49.355024+0000","last_became_active":"2024-09-10T08:28:35.570749+0000","last_became_peered":"2024-09-10T08:28:35.570749+0000","last_unstale":"2024-09-10T08:28:49.355024+0000","last_undegraded":"2024-09-10T08:28:49.355024+0000","last_fullsized":"2024-09-10T08:28:49.355024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:04.628661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2853,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":692114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":101836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":101304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":104320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":102868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":864256,"data_stored":692080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":103745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":262144,"data_stored":101144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:29:11.559 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:29:11.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.693+0000 7f79f127b640 1 Processor -- start 2024-09-10T08:29:11.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.693+0000 7f79f127b640 1 -- start start 2024-09-10T08:29:11.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.694+0000 7f79f127b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f79ec150480 0x7f79ec0c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:11.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.694+0000 7f79f127b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79ec06c650 0x7f79ec0c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:11.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.694+0000 7f79f127b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79ec15a7c0 con 0x7f79ec0c9c80 2024-09-10T08:29:11.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.694+0000 7f79f127b640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f79ec06c240 con 0x7f79ec150480 2024-09-10T08:29:11.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.694+0000 7f79f127b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f79ec15a330 con 0x7f79ec06c650 2024-09-10T08:29:11.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.694+0000 7f79eaffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f79ec150480 0x7f79ec0c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:11.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.694+0000 7f79eaffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f79ec150480 0x7f79ec0c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60872/0 (socket says 172.21.15.103:60872) 2024-09-10T08:29:11.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.694+0000 7f79eaffd640 1 -- 172.21.15.103:0/1147108847 learned_addr learned my addr 172.21.15.103:0/1147108847 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:11.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.694+0000 7f79e27fc640 1 --2- 172.21.15.103:0/1147108847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79ec06c650 0x7f79ec0c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:11.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.694+0000 7f79eaffd640 1 -- 172.21.15.103:0/1147108847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79ec06c650 msgr2=0x7f79ec0c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:11.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.694+0000 7f79eaffd640 1 --2- 172.21.15.103:0/1147108847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79ec06c650 0x7f79ec0c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.694+0000 7f79eaffd640 1 -- 172.21.15.103:0/1147108847 >> v1:172.21.15.154:6789/0 conn(0x7f79ec0c9c80 legacy=0x7f79ec0ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:11.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.694+0000 7f79eaffd640 1 -- 172.21.15.103:0/1147108847 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ec159a00 con 0x7f79ec150480 2024-09-10T08:29:11.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.695+0000 7f79eaffd640 1 --2- 172.21.15.103:0/1147108847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79ec150480 0x7f79ec0c7a90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009870 tx=0x7f79dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73eeb7e1ab1b4ad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:11.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.696+0000 7f79ea7fc640 1 -- 172.21.15.103:0/1147108847 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc037070 con 0x7f79ec150480 2024-09-10T08:29:11.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.696+0000 7f79ea7fc640 1 -- 172.21.15.103:0/1147108847 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79dc032440 con 0x7f79ec150480 2024-09-10T08:29:11.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.697+0000 7f79ea7fc640 1 -- 172.21.15.103:0/1147108847 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc032810 con 0x7f79ec150480 2024-09-10T08:29:11.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.697+0000 7f79f127b640 1 -- 172.21.15.103:0/1147108847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79ec150480 msgr2=0x7f79ec0c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:11.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.697+0000 7f79f127b640 1 --2- 172.21.15.103:0/1147108847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79ec150480 0x7f79ec0c7a90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009870 tx=0x7f79dc02a270 comp rx=0 tx=0).stop 2024-09-10T08:29:11.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.697+0000 7f79f127b640 1 -- 172.21.15.103:0/1147108847 shutdown_connections 2024-09-10T08:29:11.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.697+0000 7f79f127b640 1 --2- 172.21.15.103:0/1147108847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79ec06c650 0x7f79ec0c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.697+0000 7f79f127b640 1 --2- 172.21.15.103:0/1147108847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79ec150480 0x7f79ec0c7a90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.697+0000 7f79f127b640 1 -- 172.21.15.103:0/1147108847 >> 172.21.15.103:0/1147108847 conn(0x7f79ec068030 msgr2=0x7f79ec073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:11.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.697+0000 7f79f127b640 1 -- 172.21.15.103:0/1147108847 shutdown_connections 2024-09-10T08:29:11.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.697+0000 7f79f127b640 1 -- 172.21.15.103:0/1147108847 wait complete. 2024-09-10T08:29:11.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.698+0000 7f79f127b640 1 Processor -- start 2024-09-10T08:29:11.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.699+0000 7f79f127b640 1 -- start start 2024-09-10T08:29:11.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.699+0000 7f79f127b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ec06c650 0x7f79ec1e2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:11.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.699+0000 7f79f127b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79ec0c9c80 0x7f79ec14fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:11.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.699+0000 7f79f127b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79ec150480 0x7f79ec0ac420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:11.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.699+0000 7f79f127b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec06d270 con 0x7f79ec0c9c80 2024-09-10T08:29:11.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.699+0000 7f79f127b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f79ec159fc0 con 0x7f79ec06c650 2024-09-10T08:29:11.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.699+0000 7f79f127b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f79ec156270 con 0x7f79ec150480 2024-09-10T08:29:11.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.699+0000 7f79e27fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79ec0c9c80 0x7f79ec14fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:11.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.699+0000 7f79e27fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79ec0c9c80 0x7f79ec14fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60886/0 (socket says 172.21.15.103:60886) 2024-09-10T08:29:11.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.699+0000 7f79e27fc640 1 -- 172.21.15.103:0/3523958011 learned_addr learned my addr 172.21.15.103:0/3523958011 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:11.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.699+0000 7f79eaffd640 1 --2- 172.21.15.103:0/3523958011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ec06c650 0x7f79ec1e2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:11.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.700+0000 7f79eb7fe640 1 --2- 172.21.15.103:0/3523958011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79ec150480 0x7f79ec0ac420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:11.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.700+0000 7f79e27fc640 1 -- 172.21.15.103:0/3523958011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79ec150480 msgr2=0x7f79ec0ac420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:11.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.700+0000 7f79e27fc640 1 --2- 172.21.15.103:0/3523958011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79ec150480 0x7f79ec0ac420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.700+0000 7f79e27fc640 1 -- 172.21.15.103:0/3523958011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ec06c650 msgr2=0x7f79ec1e2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:11.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.700+0000 7f79e27fc640 1 --2- 172.21.15.103:0/3523958011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ec06c650 0x7f79ec1e2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.700+0000 7f79e27fc640 1 -- 172.21.15.103:0/3523958011 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ec152ad0 con 0x7f79ec0c9c80 2024-09-10T08:29:11.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.700+0000 7f79e27fc640 1 --2- 172.21.15.103:0/3523958011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79ec0c9c80 0x7f79ec14fba0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f79d400d5f0 tx=0x7f79d400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:11.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.700+0000 7f79e3fff640 1 -- 172.21.15.103:0/3523958011 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d40125f0 con 0x7f79ec0c9c80 2024-09-10T08:29:11.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.700+0000 7f79e3fff640 1 -- 172.21.15.103:0/3523958011 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d4019070 con 0x7f79ec0c9c80 2024-09-10T08:29:11.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.700+0000 7f79f127b640 1 -- 172.21.15.103:0/3523958011 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79ec152d70 con 0x7f79ec0c9c80 2024-09-10T08:29:11.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.700+0000 7f79e3fff640 1 -- 172.21.15.103:0/3523958011 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d40129d0 con 0x7f79ec0c9c80 2024-09-10T08:29:11.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.700+0000 7f79f127b640 1 -- 172.21.15.103:0/3523958011 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79ec153850 con 0x7f79ec0c9c80 2024-09-10T08:29:11.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.701+0000 7f79f127b640 1 -- 172.21.15.103:0/3523958011 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79ec153160 con 0x7f79ec0c9c80 2024-09-10T08:29:11.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.702+0000 7f79e3fff640 1 -- 172.21.15.103:0/3523958011 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f79d4012b70 con 0x7f79ec0c9c80 2024-09-10T08:29:11.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.702+0000 7f79e3fff640 1 --2- 172.21.15.103:0/3523958011 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f79cc06be60 0x7f79cc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:11.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.702+0000 7f79e3fff640 1 -- 172.21.15.103:0/3523958011 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f79d408b340 con 0x7f79ec0c9c80 2024-09-10T08:29:11.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.702+0000 7f79eaffd640 1 --2- 172.21.15.103:0/3523958011 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f79cc06be60 0x7f79cc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:11.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.702+0000 7f79eaffd640 1 --2- 172.21.15.103:0/3523958011 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f79cc06be60 0x7f79cc06e320 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f79dc034000 tx=0x7f79dc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:11.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.706+0000 7f79e3fff640 1 -- 172.21.15.103:0/3523958011 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f79d4059400 con 0x7f79ec0c9c80 2024-09-10T08:29:11.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.871+0000 7f79f127b640 1 -- 172.21.15.103:0/3523958011 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f79ec152f40 con 0x7f79cc06be60 2024-09-10T08:29:11.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.882+0000 7f79e3fff640 1 -- 172.21.15.103:0/3523958011 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490301 (secure 0 0 0) 0x7f79ec152f40 con 0x7f79cc06be60 2024-09-10T08:29:11.886 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:29:11.889 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T08:29:11.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.886+0000 7f79f127b640 1 -- 172.21.15.103:0/3523958011 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f79cc06be60 msgr2=0x7f79cc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:11.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.886+0000 7f79f127b640 1 --2- 172.21.15.103:0/3523958011 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f79cc06be60 0x7f79cc06e320 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f79dc034000 tx=0x7f79dc02e000 comp rx=0 tx=0).stop 2024-09-10T08:29:11.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.886+0000 7f79f127b640 1 -- 172.21.15.103:0/3523958011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79ec0c9c80 msgr2=0x7f79ec14fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:11.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.886+0000 7f79f127b640 1 --2- 172.21.15.103:0/3523958011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79ec0c9c80 0x7f79ec14fba0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f79d400d5f0 tx=0x7f79d400dab0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.886+0000 7f79f127b640 1 -- 172.21.15.103:0/3523958011 shutdown_connections 2024-09-10T08:29:11.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.886+0000 7f79f127b640 1 --2- 172.21.15.103:0/3523958011 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f79cc06be60 0x7f79cc06e320 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.886+0000 7f79f127b640 1 --2- 172.21.15.103:0/3523958011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79ec150480 0x7f79ec0ac420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.886+0000 7f79f127b640 1 --2- 172.21.15.103:0/3523958011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79ec0c9c80 0x7f79ec14fba0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.886+0000 7f79f127b640 1 --2- 172.21.15.103:0/3523958011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ec06c650 0x7f79ec1e2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:11.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.886+0000 7f79f127b640 1 -- 172.21.15.103:0/3523958011 >> 172.21.15.103:0/3523958011 conn(0x7f79ec068030 msgr2=0x7f79ec073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:11.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.886+0000 7f79f127b640 1 -- 172.21.15.103:0/3523958011 shutdown_connections 2024-09-10T08:29:11.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:11.886+0000 7f79f127b640 1 -- 172.21.15.103:0/3523958011 wait complete. 2024-09-10T08:29:11.896 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-09-10T08:29:10.801988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595631,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219536,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755184,"statfs":{"total":773094113280,"available":772869308416,"internally_reserved":0,"allocated":3383296,"data_stored":1999411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":443,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003345"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619978+0000","last_change":"2024-09-10T08:28:47.627476+0000","last_active":"2024-09-10T08:28:48.619978+0000","last_peered":"2024-09-10T08:28:48.619978+0000","last_clean":"2024-09-10T08:28:48.619978+0000","last_became_active":"2024-09-10T08:28:47.627217+0000","last_became_peered":"2024-09-10T08:28:47.627217+0000","last_unstale":"2024-09-10T08:28:48.619978+0000","last_undegraded":"2024-09-10T08:28:48.619978+0000","last_fullsized":"2024-09-10T08:28:48.619978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:25.152836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632023+0000","last_change":"2024-09-10T08:28:34.564816+0000","last_active":"2024-09-10T08:28:48.632023+0000","last_peered":"2024-09-10T08:28:48.632023+0000","last_clean":"2024-09-10T08:28:48.632023+0000","last_became_active":"2024-09-10T08:28:34.564545+0000","last_became_peered":"2024-09-10T08:28:34.564545+0000","last_unstale":"2024-09-10T08:28:48.632023+0000","last_undegraded":"2024-09-10T08:28:48.632023+0000","last_fullsized":"2024-09-10T08:28:48.632023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:34.365104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622355+0000","last_change":"2024-09-10T08:28:35.575267+0000","last_active":"2024-09-10T08:28:48.622355+0000","last_peered":"2024-09-10T08:28:48.622355+0000","last_clean":"2024-09-10T08:28:48.622355+0000","last_became_active":"2024-09-10T08:28:35.575019+0000","last_became_peered":"2024-09-10T08:28:35.575019+0000","last_unstale":"2024-09-10T08:28:48.622355+0000","last_undegraded":"2024-09-10T08:28:48.622355+0000","last_fullsized":"2024-09-10T08:28:48.622355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:00.810645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621493+0000","last_change":"2024-09-10T08:28:46.620227+0000","last_active":"2024-09-10T08:28:48.621493+0000","last_peered":"2024-09-10T08:28:48.621493+0000","last_clean":"2024-09-10T08:28:48.621493+0000","last_became_active":"2024-09-10T08:28:46.619540+0000","last_became_peered":"2024-09-10T08:28:46.619540+0000","last_unstale":"2024-09-10T08:28:48.621493+0000","last_undegraded":"2024-09-10T08:28:48.621493+0000","last_fullsized":"2024-09-10T08:28:48.621493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:13.402155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633949+0000","last_change":"2024-09-10T08:28:47.633586+0000","last_active":"2024-09-10T08:28:48.633949+0000","last_peered":"2024-09-10T08:28:48.633949+0000","last_clean":"2024-09-10T08:28:48.633949+0000","last_became_active":"2024-09-10T08:28:47.633292+0000","last_became_peered":"2024-09-10T08:28:47.633292+0000","last_unstale":"2024-09-10T08:28:48.633949+0000","last_undegraded":"2024-09-10T08:28:48.633949+0000","last_fullsized":"2024-09-10T08:28:48.633949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:19.473028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622448+0000","last_change":"2024-09-10T08:28:34.561691+0000","last_active":"2024-09-10T08:28:48.622448+0000","last_peered":"2024-09-10T08:28:48.622448+0000","last_clean":"2024-09-10T08:28:48.622448+0000","last_became_active":"2024-09-10T08:28:34.561410+0000","last_became_peered":"2024-09-10T08:28:34.561410+0000","last_unstale":"2024-09-10T08:28:48.622448+0000","last_undegraded":"2024-09-10T08:28:48.622448+0000","last_fullsized":"2024-09-10T08:28:48.622448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.629982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631878+0000","last_change":"2024-09-10T08:28:35.579033+0000","last_active":"2024-09-10T08:28:48.631878+0000","last_peered":"2024-09-10T08:28:48.631878+0000","last_clean":"2024-09-10T08:28:48.631878+0000","last_became_active":"2024-09-10T08:28:35.578333+0000","last_became_peered":"2024-09-10T08:28:35.578333+0000","last_unstale":"2024-09-10T08:28:48.631878+0000","last_undegraded":"2024-09-10T08:28:48.631878+0000","last_fullsized":"2024-09-10T08:28:48.631878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:58.779491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619633+0000","last_change":"2024-09-10T08:28:46.617317+0000","last_active":"2024-09-10T08:28:48.619633+0000","last_peered":"2024-09-10T08:28:48.619633+0000","last_clean":"2024-09-10T08:28:48.619633+0000","last_became_active":"2024-09-10T08:28:46.616806+0000","last_became_peered":"2024-09-10T08:28:46.616806+0000","last_unstale":"2024-09-10T08:28:48.619633+0000","last_undegraded":"2024-09-10T08:28:48.619633+0000","last_fullsized":"2024-09-10T08:28:48.619633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:46.916848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354201+0000","last_change":"2024-09-10T08:28:47.633194+0000","last_active":"2024-09-10T08:28:49.354201+0000","last_peered":"2024-09-10T08:28:49.354201+0000","last_clean":"2024-09-10T08:28:49.354201+0000","last_became_active":"2024-09-10T08:28:47.632772+0000","last_became_peered":"2024-09-10T08:28:47.632772+0000","last_unstale":"2024-09-10T08:28:49.354201+0000","last_undegraded":"2024-09-10T08:28:49.354201+0000","last_fullsized":"2024-09-10T08:28:49.354201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:59.228438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354864+0000","last_change":"2024-09-10T08:28:34.571965+0000","last_active":"2024-09-10T08:28:49.354864+0000","last_peered":"2024-09-10T08:28:49.354864+0000","last_clean":"2024-09-10T08:28:49.354864+0000","last_became_active":"2024-09-10T08:28:34.571640+0000","last_became_peered":"2024-09-10T08:28:34.571640+0000","last_unstale":"2024-09-10T08:28:49.354864+0000","last_undegraded":"2024-09-10T08:28:49.354864+0000","last_fullsized":"2024-09-10T08:28:49.354864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:53.047030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621272+0000","last_change":"2024-09-10T08:28:35.562132+0000","last_active":"2024-09-10T08:28:48.621272+0000","last_peered":"2024-09-10T08:28:48.621272+0000","last_clean":"2024-09-10T08:28:48.621272+0000","last_became_active":"2024-09-10T08:28:35.561842+0000","last_became_peered":"2024-09-10T08:28:35.561842+0000","last_unstale":"2024-09-10T08:28:48.621272+0000","last_undegraded":"2024-09-10T08:28:48.621272+0000","last_fullsized":"2024-09-10T08:28:48.621272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:48.810258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620177+0000","last_change":"2024-09-10T08:28:46.621093+0000","last_active":"2024-09-10T08:28:48.620177+0000","last_peered":"2024-09-10T08:28:48.620177+0000","last_clean":"2024-09-10T08:28:48.620177+0000","last_became_active":"2024-09-10T08:28:46.620794+0000","last_became_peered":"2024-09-10T08:28:46.620794+0000","last_unstale":"2024-09-10T08:28:48.620177+0000","last_undegraded":"2024-09-10T08:28:48.620177+0000","last_fullsized":"2024-09-10T08:28:48.620177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:20.501262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620906+0000","last_change":"2024-09-10T08:28:47.627756+0000","last_active":"2024-09-10T08:28:48.620906+0000","last_peered":"2024-09-10T08:28:48.620906+0000","last_clean":"2024-09-10T08:28:48.620906+0000","last_became_active":"2024-09-10T08:28:47.627476+0000","last_became_peered":"2024-09-10T08:28:47.627476+0000","last_unstale":"2024-09-10T08:28:48.620906+0000","last_undegraded":"2024-09-10T08:28:48.620906+0000","last_fullsized":"2024-09-10T08:28:48.620906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:25.945793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354598+0000","last_change":"2024-09-10T08:28:34.566560+0000","last_active":"2024-09-10T08:28:49.354598+0000","last_peered":"2024-09-10T08:28:49.354598+0000","last_clean":"2024-09-10T08:28:49.354598+0000","last_became_active":"2024-09-10T08:28:34.566275+0000","last_became_peered":"2024-09-10T08:28:34.566275+0000","last_unstale":"2024-09-10T08:28:49.354598+0000","last_undegraded":"2024-09-10T08:28:49.354598+0000","last_fullsized":"2024-09-10T08:28:49.354598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:03.507683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621503+0000","last_change":"2024-09-10T08:28:35.560380+0000","last_active":"2024-09-10T08:28:48.621503+0000","last_peered":"2024-09-10T08:28:48.621503+0000","last_clean":"2024-09-10T08:28:48.621503+0000","last_became_active":"2024-09-10T08:28:35.560095+0000","last_became_peered":"2024-09-10T08:28:35.560095+0000","last_unstale":"2024-09-10T08:28:48.621503+0000","last_undegraded":"2024-09-10T08:28:48.621503+0000","last_fullsized":"2024-09-10T08:28:48.621503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:20.047446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621446+0000","last_change":"2024-09-10T08:28:46.620162+0000","last_active":"2024-09-10T08:28:48.621446+0000","last_peered":"2024-09-10T08:28:48.621446+0000","last_clean":"2024-09-10T08:28:48.621446+0000","last_became_active":"2024-09-10T08:28:46.619889+0000","last_became_peered":"2024-09-10T08:28:46.619889+0000","last_unstale":"2024-09-10T08:28:48.621446+0000","last_undegraded":"2024-09-10T08:28:48.621446+0000","last_fullsized":"2024-09-10T08:28:48.621446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:13.820143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634225+0000","last_change":"2024-09-10T08:28:47.631094+0000","last_active":"2024-09-10T08:28:48.634225+0000","last_peered":"2024-09-10T08:28:48.634225+0000","last_clean":"2024-09-10T08:28:48.634225+0000","last_became_active":"2024-09-10T08:28:47.630787+0000","last_became_peered":"2024-09-10T08:28:47.630787+0000","last_unstale":"2024-09-10T08:28:48.634225+0000","last_undegraded":"2024-09-10T08:28:48.634225+0000","last_fullsized":"2024-09-10T08:28:48.634225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:06.277094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421323+0000","last_change":"2024-09-10T08:28:35.572478+0000","last_active":"2024-09-10T08:28:49.421323+0000","last_peered":"2024-09-10T08:28:49.421323+0000","last_clean":"2024-09-10T08:28:49.421323+0000","last_became_active":"2024-09-10T08:28:35.572215+0000","last_became_peered":"2024-09-10T08:28:35.572215+0000","last_unstale":"2024-09-10T08:28:49.421323+0000","last_undegraded":"2024-09-10T08:28:49.421323+0000","last_fullsized":"2024-09-10T08:28:49.421323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:40.397318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354464+0000","last_change":"2024-09-10T08:28:34.569235+0000","last_active":"2024-09-10T08:28:49.354464+0000","last_peered":"2024-09-10T08:28:49.354464+0000","last_clean":"2024-09-10T08:28:49.354464+0000","last_became_active":"2024-09-10T08:28:34.568899+0000","last_became_peered":"2024-09-10T08:28:34.568899+0000","last_unstale":"2024-09-10T08:28:49.354464+0000","last_undegraded":"2024-09-10T08:28:49.354464+0000","last_fullsized":"2024-09-10T08:28:49.354464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:21.927656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620338+0000","last_change":"2024-09-10T08:28:46.618502+0000","last_active":"2024-09-10T08:28:48.620338+0000","last_peered":"2024-09-10T08:28:48.620338+0000","last_clean":"2024-09-10T08:28:48.620338+0000","last_became_active":"2024-09-10T08:28:46.616824+0000","last_became_peered":"2024-09-10T08:28:46.616824+0000","last_unstale":"2024-09-10T08:28:48.620338+0000","last_undegraded":"2024-09-10T08:28:48.620338+0000","last_fullsized":"2024-09-10T08:28:48.620338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:06.554102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299968+0000","last_change":"2024-09-10T08:28:47.627138+0000","last_active":"2024-09-10T08:28:49.299968+0000","last_peered":"2024-09-10T08:28:49.299968+0000","last_clean":"2024-09-10T08:28:49.299968+0000","last_became_active":"2024-09-10T08:28:47.626871+0000","last_became_peered":"2024-09-10T08:28:47.626871+0000","last_unstale":"2024-09-10T08:28:49.299968+0000","last_undegraded":"2024-09-10T08:28:49.299968+0000","last_fullsized":"2024-09-10T08:28:49.299968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:10.927283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621888+0000","last_change":"2024-09-10T08:28:35.577024+0000","last_active":"2024-09-10T08:28:48.621888+0000","last_peered":"2024-09-10T08:28:48.621888+0000","last_clean":"2024-09-10T08:28:48.621888+0000","last_became_active":"2024-09-10T08:28:35.576771+0000","last_became_peered":"2024-09-10T08:28:35.576771+0000","last_unstale":"2024-09-10T08:28:48.621888+0000","last_undegraded":"2024-09-10T08:28:48.621888+0000","last_fullsized":"2024-09-10T08:28:48.621888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:07.162941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634491+0000","last_change":"2024-09-10T08:28:34.561324+0000","last_active":"2024-09-10T08:28:48.634491+0000","last_peered":"2024-09-10T08:28:48.634491+0000","last_clean":"2024-09-10T08:28:48.634491+0000","last_became_active":"2024-09-10T08:28:34.560974+0000","last_became_peered":"2024-09-10T08:28:34.560974+0000","last_unstale":"2024-09-10T08:28:48.634491+0000","last_undegraded":"2024-09-10T08:28:48.634491+0000","last_fullsized":"2024-09-10T08:28:48.634491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:18.790965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621289+0000","last_change":"2024-09-10T08:28:46.620411+0000","last_active":"2024-09-10T08:28:48.621289+0000","last_peered":"2024-09-10T08:28:48.621289+0000","last_clean":"2024-09-10T08:28:48.621289+0000","last_became_active":"2024-09-10T08:28:46.619553+0000","last_became_peered":"2024-09-10T08:28:46.619553+0000","last_unstale":"2024-09-10T08:28:48.621289+0000","last_undegraded":"2024-09-10T08:28:48.621289+0000","last_fullsized":"2024-09-10T08:28:48.621289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:04.414048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620412+0000","last_change":"2024-09-10T08:28:47.628563+0000","last_active":"2024-09-10T08:28:48.620412+0000","last_peered":"2024-09-10T08:28:48.620412+0000","last_clean":"2024-09-10T08:28:48.620412+0000","last_became_active":"2024-09-10T08:28:47.628290+0000","last_became_peered":"2024-09-10T08:28:47.628290+0000","last_unstale":"2024-09-10T08:28:48.620412+0000","last_undegraded":"2024-09-10T08:28:48.620412+0000","last_fullsized":"2024-09-10T08:28:48.620412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:15.652718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621892+0000","last_change":"2024-09-10T08:28:35.572363+0000","last_active":"2024-09-10T08:28:48.621892+0000","last_peered":"2024-09-10T08:28:48.621892+0000","last_clean":"2024-09-10T08:28:48.621892+0000","last_became_active":"2024-09-10T08:28:35.572108+0000","last_became_peered":"2024-09-10T08:28:35.572108+0000","last_unstale":"2024-09-10T08:28:48.621892+0000","last_undegraded":"2024-09-10T08:28:48.621892+0000","last_fullsized":"2024-09-10T08:28:48.621892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:48.358634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634057+0000","last_change":"2024-09-10T08:28:34.564813+0000","last_active":"2024-09-10T08:28:48.634057+0000","last_peered":"2024-09-10T08:28:48.634057+0000","last_clean":"2024-09-10T08:28:48.634057+0000","last_became_active":"2024-09-10T08:28:34.564557+0000","last_became_peered":"2024-09-10T08:28:34.564557+0000","last_unstale":"2024-09-10T08:28:48.634057+0000","last_undegraded":"2024-09-10T08:28:48.634057+0000","last_fullsized":"2024-09-10T08:28:48.634057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:48.356069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634748+0000","last_change":"2024-09-10T08:28:46.625346+0000","last_active":"2024-09-10T08:28:48.634748+0000","last_peered":"2024-09-10T08:28:48.634748+0000","last_clean":"2024-09-10T08:28:48.634748+0000","last_became_active":"2024-09-10T08:28:46.625059+0000","last_became_peered":"2024-09-10T08:28:46.625059+0000","last_unstale":"2024-09-10T08:28:48.634748+0000","last_undegraded":"2024-09-10T08:28:48.634748+0000","last_fullsized":"2024-09-10T08:28:48.634748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:44.512285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621820+0000","last_change":"2024-09-10T08:28:47.621307+0000","last_active":"2024-09-10T08:28:48.621820+0000","last_peered":"2024-09-10T08:28:48.621820+0000","last_clean":"2024-09-10T08:28:48.621820+0000","last_became_active":"2024-09-10T08:28:47.621043+0000","last_became_peered":"2024-09-10T08:28:47.621043+0000","last_unstale":"2024-09-10T08:28:48.621820+0000","last_undegraded":"2024-09-10T08:28:48.621820+0000","last_fullsized":"2024-09-10T08:28:48.621820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:30.300108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620871+0000","last_change":"2024-09-10T08:28:35.569938+0000","last_active":"2024-09-10T08:28:48.620871+0000","last_peered":"2024-09-10T08:28:48.620871+0000","last_clean":"2024-09-10T08:28:48.620871+0000","last_became_active":"2024-09-10T08:28:35.569109+0000","last_became_peered":"2024-09-10T08:28:35.569109+0000","last_unstale":"2024-09-10T08:28:48.620871+0000","last_undegraded":"2024-09-10T08:28:48.620871+0000","last_fullsized":"2024-09-10T08:28:48.620871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:51.680564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354401+0000","last_change":"2024-09-10T08:28:34.571069+0000","last_active":"2024-09-10T08:28:49.354401+0000","last_peered":"2024-09-10T08:28:49.354401+0000","last_clean":"2024-09-10T08:28:49.354401+0000","last_became_active":"2024-09-10T08:28:34.570766+0000","last_became_peered":"2024-09-10T08:28:34.570766+0000","last_unstale":"2024-09-10T08:28:49.354401+0000","last_undegraded":"2024-09-10T08:28:49.354401+0000","last_fullsized":"2024-09-10T08:28:49.354401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:47.458195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620340+0000","last_change":"2024-09-10T08:28:46.616531+0000","last_active":"2024-09-10T08:28:48.620340+0000","last_peered":"2024-09-10T08:28:48.620340+0000","last_clean":"2024-09-10T08:28:48.620340+0000","last_became_active":"2024-09-10T08:28:46.616254+0000","last_became_peered":"2024-09-10T08:28:46.616254+0000","last_unstale":"2024-09-10T08:28:48.620340+0000","last_undegraded":"2024-09-10T08:28:48.620340+0000","last_fullsized":"2024-09-10T08:28:48.620340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:44.162368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621422+0000","last_change":"2024-09-10T08:28:47.628177+0000","last_active":"2024-09-10T08:28:48.621422+0000","last_peered":"2024-09-10T08:28:48.621422+0000","last_clean":"2024-09-10T08:28:48.621422+0000","last_became_active":"2024-09-10T08:28:47.627869+0000","last_became_peered":"2024-09-10T08:28:47.627869+0000","last_unstale":"2024-09-10T08:28:48.621422+0000","last_undegraded":"2024-09-10T08:28:48.621422+0000","last_fullsized":"2024-09-10T08:28:48.621422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:19.075558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632136+0000","last_change":"2024-09-10T08:28:35.575106+0000","last_active":"2024-09-10T08:28:48.632136+0000","last_peered":"2024-09-10T08:28:48.632136+0000","last_clean":"2024-09-10T08:28:48.632136+0000","last_became_active":"2024-09-10T08:28:35.574815+0000","last_became_peered":"2024-09-10T08:28:35.574815+0000","last_unstale":"2024-09-10T08:28:48.632136+0000","last_undegraded":"2024-09-10T08:28:48.632136+0000","last_fullsized":"2024-09-10T08:28:48.632136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:26.512181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421953+0000","last_change":"2024-09-10T08:28:34.564865+0000","last_active":"2024-09-10T08:28:49.421953+0000","last_peered":"2024-09-10T08:28:49.421953+0000","last_clean":"2024-09-10T08:28:49.421953+0000","last_became_active":"2024-09-10T08:28:34.564549+0000","last_became_peered":"2024-09-10T08:28:34.564549+0000","last_unstale":"2024-09-10T08:28:49.421953+0000","last_undegraded":"2024-09-10T08:28:49.421953+0000","last_fullsized":"2024-09-10T08:28:49.421953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:05.523637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620344+0000","last_change":"2024-09-10T08:28:46.622505+0000","last_active":"2024-09-10T08:28:48.620344+0000","last_peered":"2024-09-10T08:28:48.620344+0000","last_clean":"2024-09-10T08:28:48.620344+0000","last_became_active":"2024-09-10T08:28:46.621052+0000","last_became_peered":"2024-09-10T08:28:46.621052+0000","last_unstale":"2024-09-10T08:28:48.620344+0000","last_undegraded":"2024-09-10T08:28:48.620344+0000","last_fullsized":"2024-09-10T08:28:48.620344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:37.411404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620146+0000","last_change":"2024-09-10T08:28:47.624919+0000","last_active":"2024-09-10T08:28:48.620146+0000","last_peered":"2024-09-10T08:28:48.620146+0000","last_clean":"2024-09-10T08:28:48.620146+0000","last_became_active":"2024-09-10T08:28:47.624651+0000","last_became_peered":"2024-09-10T08:28:47.624651+0000","last_unstale":"2024-09-10T08:28:48.620146+0000","last_undegraded":"2024-09-10T08:28:48.620146+0000","last_fullsized":"2024-09-10T08:28:48.620146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:11.049160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622219+0000","last_change":"2024-09-10T08:28:35.574107+0000","last_active":"2024-09-10T08:28:48.622219+0000","last_peered":"2024-09-10T08:28:48.622219+0000","last_clean":"2024-09-10T08:28:48.622219+0000","last_became_active":"2024-09-10T08:28:35.573851+0000","last_became_peered":"2024-09-10T08:28:35.573851+0000","last_unstale":"2024-09-10T08:28:48.622219+0000","last_undegraded":"2024-09-10T08:28:48.622219+0000","last_fullsized":"2024-09-10T08:28:48.622219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:53.240223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634865+0000","last_change":"2024-09-10T08:28:34.563451+0000","last_active":"2024-09-10T08:28:48.634865+0000","last_peered":"2024-09-10T08:28:48.634865+0000","last_clean":"2024-09-10T08:28:48.634865+0000","last_became_active":"2024-09-10T08:28:34.563259+0000","last_became_peered":"2024-09-10T08:28:34.563259+0000","last_unstale":"2024-09-10T08:28:48.634865+0000","last_undegraded":"2024-09-10T08:28:48.634865+0000","last_fullsized":"2024-09-10T08:28:48.634865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:44.899351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621717+0000","last_change":"2024-09-10T08:28:46.623396+0000","last_active":"2024-09-10T08:28:48.621717+0000","last_peered":"2024-09-10T08:28:48.621717+0000","last_clean":"2024-09-10T08:28:48.621717+0000","last_became_active":"2024-09-10T08:28:46.623139+0000","last_became_peered":"2024-09-10T08:28:46.623139+0000","last_unstale":"2024-09-10T08:28:48.621717+0000","last_undegraded":"2024-09-10T08:28:48.621717+0000","last_fullsized":"2024-09-10T08:28:48.621717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:00.210413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421163+0000","last_change":"2024-09-10T08:28:47.634754+0000","last_active":"2024-09-10T08:28:49.421163+0000","last_peered":"2024-09-10T08:28:49.421163+0000","last_clean":"2024-09-10T08:28:49.421163+0000","last_became_active":"2024-09-10T08:28:47.634382+0000","last_became_peered":"2024-09-10T08:28:47.634382+0000","last_unstale":"2024-09-10T08:28:49.421163+0000","last_undegraded":"2024-09-10T08:28:49.421163+0000","last_fullsized":"2024-09-10T08:28:49.421163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:23.489596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634270+0000","last_change":"2024-09-10T08:28:35.567481+0000","last_active":"2024-09-10T08:28:48.634270+0000","last_peered":"2024-09-10T08:28:48.634270+0000","last_clean":"2024-09-10T08:28:48.634270+0000","last_became_active":"2024-09-10T08:28:35.567167+0000","last_became_peered":"2024-09-10T08:28:35.567167+0000","last_unstale":"2024-09-10T08:28:48.634270+0000","last_undegraded":"2024-09-10T08:28:48.634270+0000","last_fullsized":"2024-09-10T08:28:48.634270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:44.110012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355009+0000","last_change":"2024-09-10T08:28:34.571283+0000","last_active":"2024-09-10T08:28:49.355009+0000","last_peered":"2024-09-10T08:28:49.355009+0000","last_clean":"2024-09-10T08:28:49.355009+0000","last_became_active":"2024-09-10T08:28:34.570791+0000","last_became_peered":"2024-09-10T08:28:34.570791+0000","last_unstale":"2024-09-10T08:28:49.355009+0000","last_undegraded":"2024-09-10T08:28:49.355009+0000","last_fullsized":"2024-09-10T08:28:49.355009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:17.427597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631943+0000","last_change":"2024-09-10T08:28:46.630983+0000","last_active":"2024-09-10T08:28:48.631943+0000","last_peered":"2024-09-10T08:28:48.631943+0000","last_clean":"2024-09-10T08:28:48.631943+0000","last_became_active":"2024-09-10T08:28:46.630658+0000","last_became_peered":"2024-09-10T08:28:46.630658+0000","last_unstale":"2024-09-10T08:28:48.631943+0000","last_undegraded":"2024-09-10T08:28:48.631943+0000","last_fullsized":"2024-09-10T08:28:48.631943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:11.219022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632221+0000","last_change":"2024-09-10T08:28:47.625475+0000","last_active":"2024-09-10T08:28:48.632221+0000","last_peered":"2024-09-10T08:28:48.632221+0000","last_clean":"2024-09-10T08:28:48.632221+0000","last_became_active":"2024-09-10T08:28:47.625186+0000","last_became_peered":"2024-09-10T08:28:47.625186+0000","last_unstale":"2024-09-10T08:28:48.632221+0000","last_undegraded":"2024-09-10T08:28:48.632221+0000","last_fullsized":"2024-09-10T08:28:48.632221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:15.932769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621392+0000","last_change":"2024-09-10T08:28:35.576280+0000","last_active":"2024-09-10T08:28:48.621392+0000","last_peered":"2024-09-10T08:28:48.621392+0000","last_clean":"2024-09-10T08:28:48.621392+0000","last_became_active":"2024-09-10T08:28:35.576002+0000","last_became_peered":"2024-09-10T08:28:35.576002+0000","last_unstale":"2024-09-10T08:28:48.621392+0000","last_undegraded":"2024-09-10T08:28:48.621392+0000","last_fullsized":"2024-09-10T08:28:48.621392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:46.278441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634285+0000","last_change":"2024-09-10T08:28:34.555212+0000","last_active":"2024-09-10T08:28:48.634285+0000","last_peered":"2024-09-10T08:28:48.634285+0000","last_clean":"2024-09-10T08:28:48.634285+0000","last_became_active":"2024-09-10T08:28:34.554922+0000","last_became_peered":"2024-09-10T08:28:34.554922+0000","last_unstale":"2024-09-10T08:28:48.634285+0000","last_undegraded":"2024-09-10T08:28:48.634285+0000","last_fullsized":"2024-09-10T08:28:48.634285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634109+0000","last_change":"2024-09-10T08:28:46.624886+0000","last_active":"2024-09-10T08:28:48.634109+0000","last_peered":"2024-09-10T08:28:48.634109+0000","last_clean":"2024-09-10T08:28:48.634109+0000","last_became_active":"2024-09-10T08:28:46.624690+0000","last_became_peered":"2024-09-10T08:28:46.624690+0000","last_unstale":"2024-09-10T08:28:48.634109+0000","last_undegraded":"2024-09-10T08:28:48.634109+0000","last_fullsized":"2024-09-10T08:28:48.634109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:15.023379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631808+0000","last_change":"2024-09-10T08:28:47.634161+0000","last_active":"2024-09-10T08:28:48.631808+0000","last_peered":"2024-09-10T08:28:48.631808+0000","last_clean":"2024-09-10T08:28:48.631808+0000","last_became_active":"2024-09-10T08:28:47.633893+0000","last_became_peered":"2024-09-10T08:28:47.633893+0000","last_unstale":"2024-09-10T08:28:48.631808+0000","last_undegraded":"2024-09-10T08:28:48.631808+0000","last_fullsized":"2024-09-10T08:28:48.631808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:37.072370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620594+0000","last_change":"2024-09-10T08:28:35.577978+0000","last_active":"2024-09-10T08:28:48.620594+0000","last_peered":"2024-09-10T08:28:48.620594+0000","last_clean":"2024-09-10T08:28:48.620594+0000","last_became_active":"2024-09-10T08:28:35.577718+0000","last_became_peered":"2024-09-10T08:28:35.577718+0000","last_unstale":"2024-09-10T08:28:48.620594+0000","last_undegraded":"2024-09-10T08:28:48.620594+0000","last_fullsized":"2024-09-10T08:28:48.620594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:01:57.257817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621126+0000","last_change":"2024-09-10T08:28:34.553983+0000","last_active":"2024-09-10T08:28:48.621126+0000","last_peered":"2024-09-10T08:28:48.621126+0000","last_clean":"2024-09-10T08:28:48.621126+0000","last_became_active":"2024-09-10T08:28:34.553693+0000","last_became_peered":"2024-09-10T08:28:34.553693+0000","last_unstale":"2024-09-10T08:28:48.621126+0000","last_undegraded":"2024-09-10T08:28:48.621126+0000","last_fullsized":"2024-09-10T08:28:48.621126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:40.001685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634238+0000","last_change":"2024-09-10T08:28:46.620165+0000","last_active":"2024-09-10T08:28:48.634238+0000","last_peered":"2024-09-10T08:28:48.634238+0000","last_clean":"2024-09-10T08:28:48.634238+0000","last_became_active":"2024-09-10T08:28:46.619853+0000","last_became_peered":"2024-09-10T08:28:46.619853+0000","last_unstale":"2024-09-10T08:28:48.634238+0000","last_undegraded":"2024-09-10T08:28:48.634238+0000","last_fullsized":"2024-09-10T08:28:48.634238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:36.006532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.300010+0000","last_change":"2024-09-10T08:28:47.621588+0000","last_active":"2024-09-10T08:28:49.300010+0000","last_peered":"2024-09-10T08:28:49.300010+0000","last_clean":"2024-09-10T08:28:49.300010+0000","last_became_active":"2024-09-10T08:28:47.621122+0000","last_became_peered":"2024-09-10T08:28:47.621122+0000","last_unstale":"2024-09-10T08:28:49.300010+0000","last_undegraded":"2024-09-10T08:28:49.300010+0000","last_fullsized":"2024-09-10T08:28:49.300010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:11.250838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633943+0000","last_change":"2024-09-10T08:28:35.566745+0000","last_active":"2024-09-10T08:28:48.633943+0000","last_peered":"2024-09-10T08:28:48.633943+0000","last_clean":"2024-09-10T08:28:48.633943+0000","last_became_active":"2024-09-10T08:28:35.566444+0000","last_became_peered":"2024-09-10T08:28:35.566444+0000","last_unstale":"2024-09-10T08:28:48.633943+0000","last_undegraded":"2024-09-10T08:28:48.633943+0000","last_fullsized":"2024-09-10T08:28:48.633943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:52.735296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299738+0000","last_change":"2024-09-10T08:28:34.560745+0000","last_active":"2024-09-10T08:28:49.299738+0000","last_peered":"2024-09-10T08:28:49.299738+0000","last_clean":"2024-09-10T08:28:49.299738+0000","last_became_active":"2024-09-10T08:28:34.559911+0000","last_became_peered":"2024-09-10T08:28:34.559911+0000","last_unstale":"2024-09-10T08:28:49.299738+0000","last_undegraded":"2024-09-10T08:28:49.299738+0000","last_fullsized":"2024-09-10T08:28:49.299738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:00.234067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634838+0000","last_change":"2024-09-10T08:28:46.623886+0000","last_active":"2024-09-10T08:28:48.634838+0000","last_peered":"2024-09-10T08:28:48.634838+0000","last_clean":"2024-09-10T08:28:48.634838+0000","last_became_active":"2024-09-10T08:28:46.622790+0000","last_became_peered":"2024-09-10T08:28:46.622790+0000","last_unstale":"2024-09-10T08:28:48.634838+0000","last_undegraded":"2024-09-10T08:28:48.634838+0000","last_fullsized":"2024-09-10T08:28:48.634838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:06:32.333116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621918+0000","last_change":"2024-09-10T08:28:47.634500+0000","last_active":"2024-09-10T08:28:48.621918+0000","last_peered":"2024-09-10T08:28:48.621918+0000","last_clean":"2024-09-10T08:28:48.621918+0000","last_became_active":"2024-09-10T08:28:47.634219+0000","last_became_peered":"2024-09-10T08:28:47.634219+0000","last_unstale":"2024-09-10T08:28:48.621918+0000","last_undegraded":"2024-09-10T08:28:48.621918+0000","last_fullsized":"2024-09-10T08:28:48.621918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:59.689554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631587+0000","last_change":"2024-09-10T08:28:35.576360+0000","last_active":"2024-09-10T08:28:48.631587+0000","last_peered":"2024-09-10T08:28:48.631587+0000","last_clean":"2024-09-10T08:28:48.631587+0000","last_became_active":"2024-09-10T08:28:35.576096+0000","last_became_peered":"2024-09-10T08:28:35.576096+0000","last_unstale":"2024-09-10T08:28:48.631587+0000","last_undegraded":"2024-09-10T08:28:48.631587+0000","last_fullsized":"2024-09-10T08:28:48.631587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:34.159275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354630+0000","last_change":"2024-09-10T08:28:34.568477+0000","last_active":"2024-09-10T08:28:49.354630+0000","last_peered":"2024-09-10T08:28:49.354630+0000","last_clean":"2024-09-10T08:28:49.354630+0000","last_became_active":"2024-09-10T08:28:34.568249+0000","last_became_peered":"2024-09-10T08:28:34.568249+0000","last_unstale":"2024-09-10T08:28:49.354630+0000","last_undegraded":"2024-09-10T08:28:49.354630+0000","last_fullsized":"2024-09-10T08:28:49.354630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:08.640043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633193+0000","last_change":"2024-09-10T08:28:46.621567+0000","last_active":"2024-09-10T08:28:48.633193+0000","last_peered":"2024-09-10T08:28:48.633193+0000","last_clean":"2024-09-10T08:28:48.633193+0000","last_became_active":"2024-09-10T08:28:46.621272+0000","last_became_peered":"2024-09-10T08:28:46.621272+0000","last_unstale":"2024-09-10T08:28:48.633193+0000","last_undegraded":"2024-09-10T08:28:48.633193+0000","last_fullsized":"2024-09-10T08:28:48.633193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:37:34.936213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354521+0000","last_change":"2024-09-10T08:28:47.631621+0000","last_active":"2024-09-10T08:28:49.354521+0000","last_peered":"2024-09-10T08:28:49.354521+0000","last_clean":"2024-09-10T08:28:49.354521+0000","last_became_active":"2024-09-10T08:28:47.631337+0000","last_became_peered":"2024-09-10T08:28:47.631337+0000","last_unstale":"2024-09-10T08:28:49.354521+0000","last_undegraded":"2024-09-10T08:28:49.354521+0000","last_fullsized":"2024-09-10T08:28:49.354521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:04.196705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621993+0000","last_change":"2024-09-10T08:28:35.572658+0000","last_active":"2024-09-10T08:28:48.621993+0000","last_peered":"2024-09-10T08:28:48.621993+0000","last_clean":"2024-09-10T08:28:48.621993+0000","last_became_active":"2024-09-10T08:28:35.571611+0000","last_became_peered":"2024-09-10T08:28:35.571611+0000","last_unstale":"2024-09-10T08:28:48.621993+0000","last_undegraded":"2024-09-10T08:28:48.621993+0000","last_fullsized":"2024-09-10T08:28:48.621993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:42.726996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620845+0000","last_change":"2024-09-10T08:28:34.555587+0000","last_active":"2024-09-10T08:28:48.620845+0000","last_peered":"2024-09-10T08:28:48.620845+0000","last_clean":"2024-09-10T08:28:48.620845+0000","last_became_active":"2024-09-10T08:28:34.555269+0000","last_became_peered":"2024-09-10T08:28:34.555269+0000","last_unstale":"2024-09-10T08:28:48.620845+0000","last_undegraded":"2024-09-10T08:28:48.620845+0000","last_fullsized":"2024-09-10T08:28:48.620845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:19.499870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354756+0000","last_change":"2024-09-10T08:28:26.724394+0000","last_active":"2024-09-10T08:28:49.354756+0000","last_peered":"2024-09-10T08:28:49.354756+0000","last_clean":"2024-09-10T08:28:49.354756+0000","last_became_active":"2024-09-10T08:28:26.723452+0000","last_became_peered":"2024-09-10T08:28:26.723452+0000","last_unstale":"2024-09-10T08:28:49.354756+0000","last_undegraded":"2024-09-10T08:28:49.354756+0000","last_fullsized":"2024-09-10T08:28:49.354756+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_clean_scrub_stamp":"2024-09-10T08:28:25.445753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:00.811505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421307+0000","last_change":"2024-09-10T08:28:46.622048+0000","last_active":"2024-09-10T08:28:49.421307+0000","last_peered":"2024-09-10T08:28:49.421307+0000","last_clean":"2024-09-10T08:28:49.421307+0000","last_became_active":"2024-09-10T08:28:46.621770+0000","last_became_peered":"2024-09-10T08:28:46.621770+0000","last_unstale":"2024-09-10T08:28:49.421307+0000","last_undegraded":"2024-09-10T08:28:49.421307+0000","last_fullsized":"2024-09-10T08:28:49.421307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:51.430760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299891+0000","last_change":"2024-09-10T08:28:47.620746+0000","last_active":"2024-09-10T08:28:49.299891+0000","last_peered":"2024-09-10T08:28:49.299891+0000","last_clean":"2024-09-10T08:28:49.299891+0000","last_became_active":"2024-09-10T08:28:47.620492+0000","last_became_peered":"2024-09-10T08:28:47.620492+0000","last_unstale":"2024-09-10T08:28:49.299891+0000","last_undegraded":"2024-09-10T08:28:49.299891+0000","last_fullsized":"2024-09-10T08:28:49.299891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:40.117978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354858+0000","last_change":"2024-09-10T08:28:35.574532+0000","last_active":"2024-09-10T08:28:49.354858+0000","last_peered":"2024-09-10T08:28:49.354858+0000","last_clean":"2024-09-10T08:28:49.354858+0000","last_became_active":"2024-09-10T08:28:35.574215+0000","last_became_peered":"2024-09-10T08:28:35.574215+0000","last_unstale":"2024-09-10T08:28:49.354858+0000","last_undegraded":"2024-09-10T08:28:49.354858+0000","last_fullsized":"2024-09-10T08:28:49.354858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:28.455653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.300028+0000","last_change":"2024-09-10T08:28:34.559911+0000","last_active":"2024-09-10T08:28:49.300028+0000","last_peered":"2024-09-10T08:28:49.300028+0000","last_clean":"2024-09-10T08:28:49.300028+0000","last_became_active":"2024-09-10T08:28:34.559635+0000","last_became_peered":"2024-09-10T08:28:34.559635+0000","last_unstale":"2024-09-10T08:28:49.300028+0000","last_undegraded":"2024-09-10T08:28:49.300028+0000","last_fullsized":"2024-09-10T08:28:49.300028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:40.892609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421181+0000","last_change":"2024-09-10T08:28:46.620352+0000","last_active":"2024-09-10T08:28:49.421181+0000","last_peered":"2024-09-10T08:28:49.421181+0000","last_clean":"2024-09-10T08:28:49.421181+0000","last_became_active":"2024-09-10T08:28:46.620064+0000","last_became_peered":"2024-09-10T08:28:46.620064+0000","last_unstale":"2024-09-10T08:28:49.421181+0000","last_undegraded":"2024-09-10T08:28:49.421181+0000","last_fullsized":"2024-09-10T08:28:49.421181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:59.333579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299701+0000","last_change":"2024-09-10T08:28:47.620305+0000","last_active":"2024-09-10T08:28:49.299701+0000","last_peered":"2024-09-10T08:28:49.299701+0000","last_clean":"2024-09-10T08:28:49.299701+0000","last_became_active":"2024-09-10T08:28:47.620014+0000","last_became_peered":"2024-09-10T08:28:47.620014+0000","last_unstale":"2024-09-10T08:28:49.299701+0000","last_undegraded":"2024-09-10T08:28:49.299701+0000","last_fullsized":"2024-09-10T08:28:49.299701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:44.916136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621484+0000","last_change":"2024-09-10T08:28:35.577124+0000","last_active":"2024-09-10T08:28:48.621484+0000","last_peered":"2024-09-10T08:28:48.621484+0000","last_clean":"2024-09-10T08:28:48.621484+0000","last_became_active":"2024-09-10T08:28:35.576655+0000","last_became_peered":"2024-09-10T08:28:35.576655+0000","last_unstale":"2024-09-10T08:28:48.621484+0000","last_undegraded":"2024-09-10T08:28:48.621484+0000","last_fullsized":"2024-09-10T08:28:48.621484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:29.878600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634772+0000","last_change":"2024-09-10T08:28:34.560694+0000","last_active":"2024-09-10T08:28:48.634772+0000","last_peered":"2024-09-10T08:28:48.634772+0000","last_clean":"2024-09-10T08:28:48.634772+0000","last_became_active":"2024-09-10T08:28:34.560429+0000","last_became_peered":"2024-09-10T08:28:34.560429+0000","last_unstale":"2024-09-10T08:28:48.634772+0000","last_undegraded":"2024-09-10T08:28:48.634772+0000","last_fullsized":"2024-09-10T08:28:48.634772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:54.514467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631770+0000","last_change":"2024-09-10T08:28:46.622232+0000","last_active":"2024-09-10T08:28:48.631770+0000","last_peered":"2024-09-10T08:28:48.631770+0000","last_clean":"2024-09-10T08:28:48.631770+0000","last_became_active":"2024-09-10T08:28:46.621966+0000","last_became_peered":"2024-09-10T08:28:46.621966+0000","last_unstale":"2024-09-10T08:28:48.631770+0000","last_undegraded":"2024-09-10T08:28:48.631770+0000","last_fullsized":"2024-09-10T08:28:48.631770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:28.897045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354068+0000","last_change":"2024-09-10T08:28:47.630602+0000","last_active":"2024-09-10T08:28:49.354068+0000","last_peered":"2024-09-10T08:28:49.354068+0000","last_clean":"2024-09-10T08:28:49.354068+0000","last_became_active":"2024-09-10T08:28:47.630234+0000","last_became_peered":"2024-09-10T08:28:47.630234+0000","last_unstale":"2024-09-10T08:28:49.354068+0000","last_undegraded":"2024-09-10T08:28:49.354068+0000","last_fullsized":"2024-09-10T08:28:49.354068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:03.808098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355126+0000","last_change":"2024-09-10T08:28:35.577577+0000","last_active":"2024-09-10T08:28:49.355126+0000","last_peered":"2024-09-10T08:28:49.355126+0000","last_clean":"2024-09-10T08:28:49.355126+0000","last_became_active":"2024-09-10T08:28:35.576686+0000","last_became_peered":"2024-09-10T08:28:35.576686+0000","last_unstale":"2024-09-10T08:28:49.355126+0000","last_undegraded":"2024-09-10T08:28:49.355126+0000","last_fullsized":"2024-09-10T08:28:49.355126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:36.334494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.300074+0000","last_change":"2024-09-10T08:28:34.560313+0000","last_active":"2024-09-10T08:28:49.300074+0000","last_peered":"2024-09-10T08:28:49.300074+0000","last_clean":"2024-09-10T08:28:49.300074+0000","last_became_active":"2024-09-10T08:28:34.560035+0000","last_became_peered":"2024-09-10T08:28:34.560035+0000","last_unstale":"2024-09-10T08:28:49.300074+0000","last_undegraded":"2024-09-10T08:28:49.300074+0000","last_fullsized":"2024-09-10T08:28:49.300074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:56.945537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619792+0000","last_change":"2024-09-10T08:28:46.623371+0000","last_active":"2024-09-10T08:28:48.619792+0000","last_peered":"2024-09-10T08:28:48.619792+0000","last_clean":"2024-09-10T08:28:48.619792+0000","last_became_active":"2024-09-10T08:28:46.623092+0000","last_became_peered":"2024-09-10T08:28:46.623092+0000","last_unstale":"2024-09-10T08:28:48.619792+0000","last_undegraded":"2024-09-10T08:28:48.619792+0000","last_fullsized":"2024-09-10T08:28:48.619792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:36.359127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299671+0000","last_change":"2024-09-10T08:28:47.619805+0000","last_active":"2024-09-10T08:28:49.299671+0000","last_peered":"2024-09-10T08:28:49.299671+0000","last_clean":"2024-09-10T08:28:49.299671+0000","last_became_active":"2024-09-10T08:28:47.619452+0000","last_became_peered":"2024-09-10T08:28:47.619452+0000","last_unstale":"2024-09-10T08:28:49.299671+0000","last_undegraded":"2024-09-10T08:28:49.299671+0000","last_fullsized":"2024-09-10T08:28:49.299671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:20.052707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355004+0000","last_change":"2024-09-10T08:28:35.577476+0000","last_active":"2024-09-10T08:28:49.355004+0000","last_peered":"2024-09-10T08:28:49.355004+0000","last_clean":"2024-09-10T08:28:49.355004+0000","last_became_active":"2024-09-10T08:28:35.576786+0000","last_became_peered":"2024-09-10T08:28:35.576786+0000","last_unstale":"2024-09-10T08:28:49.355004+0000","last_undegraded":"2024-09-10T08:28:49.355004+0000","last_fullsized":"2024-09-10T08:28:49.355004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:46.914074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620800+0000","last_change":"2024-09-10T08:28:34.551102+0000","last_active":"2024-09-10T08:28:48.620800+0000","last_peered":"2024-09-10T08:28:48.620800+0000","last_clean":"2024-09-10T08:28:48.620800+0000","last_became_active":"2024-09-10T08:28:34.550773+0000","last_became_peered":"2024-09-10T08:28:34.550773+0000","last_unstale":"2024-09-10T08:28:48.620800+0000","last_undegraded":"2024-09-10T08:28:48.620800+0000","last_fullsized":"2024-09-10T08:28:48.620800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:35.393695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620218+0000","last_change":"2024-09-10T08:28:46.619639+0000","last_active":"2024-09-10T08:28:48.620218+0000","last_peered":"2024-09-10T08:28:48.620218+0000","last_clean":"2024-09-10T08:28:48.620218+0000","last_became_active":"2024-09-10T08:28:46.619330+0000","last_became_peered":"2024-09-10T08:28:46.619330+0000","last_unstale":"2024-09-10T08:28:48.620218+0000","last_undegraded":"2024-09-10T08:28:48.620218+0000","last_fullsized":"2024-09-10T08:28:48.620218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:10.371693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622150+0000","last_change":"2024-09-10T08:28:47.633627+0000","last_active":"2024-09-10T08:28:48.622150+0000","last_peered":"2024-09-10T08:28:48.622150+0000","last_clean":"2024-09-10T08:28:48.622150+0000","last_became_active":"2024-09-10T08:28:47.633362+0000","last_became_peered":"2024-09-10T08:28:47.633362+0000","last_unstale":"2024-09-10T08:28:48.622150+0000","last_undegraded":"2024-09-10T08:28:48.622150+0000","last_fullsized":"2024-09-10T08:28:48.622150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:19.473028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354525+0000","last_change":"2024-09-10T08:28:35.575307+0000","last_active":"2024-09-10T08:28:49.354525+0000","last_peered":"2024-09-10T08:28:49.354525+0000","last_clean":"2024-09-10T08:28:49.354525+0000","last_became_active":"2024-09-10T08:28:35.575038+0000","last_became_peered":"2024-09-10T08:28:35.575038+0000","last_unstale":"2024-09-10T08:28:49.354525+0000","last_undegraded":"2024-09-10T08:28:49.354525+0000","last_fullsized":"2024-09-10T08:28:49.354525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:36.478822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299678+0000","last_change":"2024-09-10T08:28:34.555542+0000","last_active":"2024-09-10T08:28:49.299678+0000","last_peered":"2024-09-10T08:28:49.299678+0000","last_clean":"2024-09-10T08:28:49.299678+0000","last_became_active":"2024-09-10T08:28:34.555179+0000","last_became_peered":"2024-09-10T08:28:34.555179+0000","last_unstale":"2024-09-10T08:28:49.299678+0000","last_undegraded":"2024-09-10T08:28:49.299678+0000","last_fullsized":"2024-09-10T08:28:49.299678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:53.313161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632119+0000","last_change":"2024-09-10T08:28:46.618615+0000","last_active":"2024-09-10T08:28:48.632119+0000","last_peered":"2024-09-10T08:28:48.632119+0000","last_clean":"2024-09-10T08:28:48.632119+0000","last_became_active":"2024-09-10T08:28:46.618318+0000","last_became_peered":"2024-09-10T08:28:46.618318+0000","last_unstale":"2024-09-10T08:28:48.632119+0000","last_undegraded":"2024-09-10T08:28:48.632119+0000","last_fullsized":"2024-09-10T08:28:48.632119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:44:08.185748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621616+0000","last_change":"2024-09-10T08:28:47.625025+0000","last_active":"2024-09-10T08:28:48.621616+0000","last_peered":"2024-09-10T08:28:48.621616+0000","last_clean":"2024-09-10T08:28:48.621616+0000","last_became_active":"2024-09-10T08:28:47.624230+0000","last_became_peered":"2024-09-10T08:28:47.624230+0000","last_unstale":"2024-09-10T08:28:48.621616+0000","last_undegraded":"2024-09-10T08:28:48.621616+0000","last_fullsized":"2024-09-10T08:28:48.621616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:25.530264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421027+0000","last_change":"2024-09-10T08:28:35.578892+0000","last_active":"2024-09-10T08:28:49.421027+0000","last_peered":"2024-09-10T08:28:49.421027+0000","last_clean":"2024-09-10T08:28:49.421027+0000","last_became_active":"2024-09-10T08:28:35.578299+0000","last_became_peered":"2024-09-10T08:28:35.578299+0000","last_unstale":"2024-09-10T08:28:49.421027+0000","last_undegraded":"2024-09-10T08:28:49.421027+0000","last_fullsized":"2024-09-10T08:28:49.421027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:27.485392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421503+0000","last_change":"2024-09-10T08:28:34.560444+0000","last_active":"2024-09-10T08:28:49.421503+0000","last_peered":"2024-09-10T08:28:49.421503+0000","last_clean":"2024-09-10T08:28:49.421503+0000","last_became_active":"2024-09-10T08:28:34.560188+0000","last_became_peered":"2024-09-10T08:28:34.560188+0000","last_unstale":"2024-09-10T08:28:49.421503+0000","last_undegraded":"2024-09-10T08:28:49.421503+0000","last_fullsized":"2024-09-10T08:28:49.421503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:15.727780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622124+0000","last_change":"2024-09-10T08:28:46.623483+0000","last_active":"2024-09-10T08:28:48.622124+0000","last_peered":"2024-09-10T08:28:48.622124+0000","last_clean":"2024-09-10T08:28:48.622124+0000","last_became_active":"2024-09-10T08:28:46.623211+0000","last_became_peered":"2024-09-10T08:28:46.623211+0000","last_unstale":"2024-09-10T08:28:48.622124+0000","last_undegraded":"2024-09-10T08:28:48.622124+0000","last_fullsized":"2024-09-10T08:28:48.622124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:24.611015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621121+0000","last_change":"2024-09-10T08:28:47.635185+0000","last_active":"2024-09-10T08:28:48.621121+0000","last_peered":"2024-09-10T08:28:48.621121+0000","last_clean":"2024-09-10T08:28:48.621121+0000","last_became_active":"2024-09-10T08:28:47.634782+0000","last_became_peered":"2024-09-10T08:28:47.634782+0000","last_unstale":"2024-09-10T08:28:48.621121+0000","last_undegraded":"2024-09-10T08:28:48.621121+0000","last_fullsized":"2024-09-10T08:28:48.621121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:05.512645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354247+0000","last_change":"2024-09-10T08:28:35.575788+0000","last_active":"2024-09-10T08:28:49.354247+0000","last_peered":"2024-09-10T08:28:49.354247+0000","last_clean":"2024-09-10T08:28:49.354247+0000","last_became_active":"2024-09-10T08:28:35.575333+0000","last_became_peered":"2024-09-10T08:28:35.575333+0000","last_unstale":"2024-09-10T08:28:49.354247+0000","last_undegraded":"2024-09-10T08:28:49.354247+0000","last_fullsized":"2024-09-10T08:28:49.354247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:39.756390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621367+0000","last_change":"2024-09-10T08:28:34.560699+0000","last_active":"2024-09-10T08:28:48.621367+0000","last_peered":"2024-09-10T08:28:48.621367+0000","last_clean":"2024-09-10T08:28:48.621367+0000","last_became_active":"2024-09-10T08:28:34.560376+0000","last_became_peered":"2024-09-10T08:28:34.560376+0000","last_unstale":"2024-09-10T08:28:48.621367+0000","last_undegraded":"2024-09-10T08:28:48.621367+0000","last_fullsized":"2024-09-10T08:28:48.621367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:09.981216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622076+0000","last_change":"2024-09-10T08:28:46.620745+0000","last_active":"2024-09-10T08:28:48.622076+0000","last_peered":"2024-09-10T08:28:48.622076+0000","last_clean":"2024-09-10T08:28:48.622076+0000","last_became_active":"2024-09-10T08:28:46.619030+0000","last_became_peered":"2024-09-10T08:28:46.619030+0000","last_unstale":"2024-09-10T08:28:48.622076+0000","last_undegraded":"2024-09-10T08:28:48.622076+0000","last_fullsized":"2024-09-10T08:28:48.622076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:07.653226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622129+0000","last_change":"2024-09-10T08:28:47.626648+0000","last_active":"2024-09-10T08:28:48.622129+0000","last_peered":"2024-09-10T08:28:48.622129+0000","last_clean":"2024-09-10T08:28:48.622129+0000","last_became_active":"2024-09-10T08:28:47.626330+0000","last_became_peered":"2024-09-10T08:28:47.626330+0000","last_unstale":"2024-09-10T08:28:48.622129+0000","last_undegraded":"2024-09-10T08:28:48.622129+0000","last_fullsized":"2024-09-10T08:28:48.622129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:02.346881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631691+0000","last_change":"2024-09-10T08:28:35.574810+0000","last_active":"2024-09-10T08:28:48.631691+0000","last_peered":"2024-09-10T08:28:48.631691+0000","last_clean":"2024-09-10T08:28:48.631691+0000","last_became_active":"2024-09-10T08:28:35.574567+0000","last_became_peered":"2024-09-10T08:28:35.574567+0000","last_unstale":"2024-09-10T08:28:48.631691+0000","last_undegraded":"2024-09-10T08:28:48.631691+0000","last_fullsized":"2024-09-10T08:28:48.631691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:29.315833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632297+0000","last_change":"2024-09-10T08:28:34.553556+0000","last_active":"2024-09-10T08:28:48.632297+0000","last_peered":"2024-09-10T08:28:48.632297+0000","last_clean":"2024-09-10T08:28:48.632297+0000","last_became_active":"2024-09-10T08:28:34.553275+0000","last_became_peered":"2024-09-10T08:28:34.553275+0000","last_unstale":"2024-09-10T08:28:48.632297+0000","last_undegraded":"2024-09-10T08:28:48.632297+0000","last_fullsized":"2024-09-10T08:28:48.632297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:45.957635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621256+0000","last_change":"2024-09-10T08:28:46.619760+0000","last_active":"2024-09-10T08:28:48.621256+0000","last_peered":"2024-09-10T08:28:48.621256+0000","last_clean":"2024-09-10T08:28:48.621256+0000","last_became_active":"2024-09-10T08:28:46.619165+0000","last_became_peered":"2024-09-10T08:28:46.619165+0000","last_unstale":"2024-09-10T08:28:48.621256+0000","last_undegraded":"2024-09-10T08:28:48.621256+0000","last_fullsized":"2024-09-10T08:28:48.621256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:27.691197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621842+0000","last_change":"2024-09-10T08:28:47.620135+0000","last_active":"2024-09-10T08:28:48.621842+0000","last_peered":"2024-09-10T08:28:48.621842+0000","last_clean":"2024-09-10T08:28:48.621842+0000","last_became_active":"2024-09-10T08:28:47.619661+0000","last_became_peered":"2024-09-10T08:28:47.619661+0000","last_unstale":"2024-09-10T08:28:48.621842+0000","last_undegraded":"2024-09-10T08:28:48.621842+0000","last_fullsized":"2024-09-10T08:28:48.621842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:34.815426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354721+0000","last_change":"2024-09-10T08:28:35.582473+0000","last_active":"2024-09-10T08:28:49.354721+0000","last_peered":"2024-09-10T08:28:49.354721+0000","last_clean":"2024-09-10T08:28:49.354721+0000","last_became_active":"2024-09-10T08:28:35.582205+0000","last_became_peered":"2024-09-10T08:28:35.582205+0000","last_unstale":"2024-09-10T08:28:49.354721+0000","last_undegraded":"2024-09-10T08:28:49.354721+0000","last_fullsized":"2024-09-10T08:28:49.354721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:11.200963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:29:06.966813+0000","last_change":"2024-09-10T08:28:34.559823+0000","last_active":"2024-09-10T08:29:06.966813+0000","last_peered":"2024-09-10T08:29:06.966813+0000","last_clean":"2024-09-10T08:29:06.966813+0000","last_became_active":"2024-09-10T08:28:34.559560+0000","last_became_peered":"2024-09-10T08:28:34.559560+0000","last_unstale":"2024-09-10T08:29:06.966813+0000","last_undegraded":"2024-09-10T08:29:06.966813+0000","last_fullsized":"2024-09-10T08:29:06.966813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:53.724382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633994+0000","last_change":"2024-09-10T08:28:46.628040+0000","last_active":"2024-09-10T08:28:48.633994+0000","last_peered":"2024-09-10T08:28:48.633994+0000","last_clean":"2024-09-10T08:28:48.633994+0000","last_became_active":"2024-09-10T08:28:46.627819+0000","last_became_peered":"2024-09-10T08:28:46.627819+0000","last_unstale":"2024-09-10T08:28:48.633994+0000","last_undegraded":"2024-09-10T08:28:48.633994+0000","last_fullsized":"2024-09-10T08:28:48.633994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:29.467540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634305+0000","last_change":"2024-09-10T08:28:47.628067+0000","last_active":"2024-09-10T08:28:48.634305+0000","last_peered":"2024-09-10T08:28:48.634305+0000","last_clean":"2024-09-10T08:28:48.634305+0000","last_became_active":"2024-09-10T08:28:47.627775+0000","last_became_peered":"2024-09-10T08:28:47.627775+0000","last_unstale":"2024-09-10T08:28:48.634305+0000","last_undegraded":"2024-09-10T08:28:48.634305+0000","last_fullsized":"2024-09-10T08:28:48.634305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:43.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621613+0000","last_change":"2024-09-10T08:28:35.571262+0000","last_active":"2024-09-10T08:28:48.621613+0000","last_peered":"2024-09-10T08:28:48.621613+0000","last_clean":"2024-09-10T08:28:48.621613+0000","last_became_active":"2024-09-10T08:28:35.570711+0000","last_became_peered":"2024-09-10T08:28:35.570711+0000","last_unstale":"2024-09-10T08:28:48.621613+0000","last_undegraded":"2024-09-10T08:28:48.621613+0000","last_fullsized":"2024-09-10T08:28:48.621613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:29.116422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634766+0000","last_change":"2024-09-10T08:28:34.557352+0000","last_active":"2024-09-10T08:28:48.634766+0000","last_peered":"2024-09-10T08:28:48.634766+0000","last_clean":"2024-09-10T08:28:48.634766+0000","last_became_active":"2024-09-10T08:28:34.557076+0000","last_became_peered":"2024-09-10T08:28:34.557076+0000","last_unstale":"2024-09-10T08:28:48.634766+0000","last_undegraded":"2024-09-10T08:28:48.634766+0000","last_fullsized":"2024-09-10T08:28:48.634766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:04.957739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620317+0000","last_change":"2024-09-10T08:28:46.615923+0000","last_active":"2024-09-10T08:28:48.620317+0000","last_peered":"2024-09-10T08:28:48.620317+0000","last_clean":"2024-09-10T08:28:48.620317+0000","last_became_active":"2024-09-10T08:28:46.615451+0000","last_became_peered":"2024-09-10T08:28:46.615451+0000","last_unstale":"2024-09-10T08:28:48.620317+0000","last_undegraded":"2024-09-10T08:28:48.620317+0000","last_fullsized":"2024-09-10T08:28:48.620317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:22.612001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421320+0000","last_change":"2024-09-10T08:28:47.623223+0000","last_active":"2024-09-10T08:28:49.421320+0000","last_peered":"2024-09-10T08:28:49.421320+0000","last_clean":"2024-09-10T08:28:49.421320+0000","last_became_active":"2024-09-10T08:28:47.622961+0000","last_became_peered":"2024-09-10T08:28:47.622961+0000","last_unstale":"2024-09-10T08:28:49.421320+0000","last_undegraded":"2024-09-10T08:28:49.421320+0000","last_fullsized":"2024-09-10T08:28:49.421320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:30.979580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631925+0000","last_change":"2024-09-10T08:28:35.577913+0000","last_active":"2024-09-10T08:28:48.631925+0000","last_peered":"2024-09-10T08:28:48.631925+0000","last_clean":"2024-09-10T08:28:48.631925+0000","last_became_active":"2024-09-10T08:28:35.577255+0000","last_became_peered":"2024-09-10T08:28:35.577255+0000","last_unstale":"2024-09-10T08:28:48.631925+0000","last_undegraded":"2024-09-10T08:28:48.631925+0000","last_fullsized":"2024-09-10T08:28:48.631925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:17.413525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621690+0000","last_change":"2024-09-10T08:28:34.564571+0000","last_active":"2024-09-10T08:28:48.621690+0000","last_peered":"2024-09-10T08:28:48.621690+0000","last_clean":"2024-09-10T08:28:48.621690+0000","last_became_active":"2024-09-10T08:28:34.564189+0000","last_became_peered":"2024-09-10T08:28:34.564189+0000","last_unstale":"2024-09-10T08:28:48.621690+0000","last_undegraded":"2024-09-10T08:28:48.621690+0000","last_fullsized":"2024-09-10T08:28:48.621690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:46.055510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621316+0000","last_change":"2024-09-10T08:28:46.618917+0000","last_active":"2024-09-10T08:28:48.621316+0000","last_peered":"2024-09-10T08:28:48.621316+0000","last_clean":"2024-09-10T08:28:48.621316+0000","last_became_active":"2024-09-10T08:28:46.618625+0000","last_became_peered":"2024-09-10T08:28:46.618625+0000","last_unstale":"2024-09-10T08:28:48.621316+0000","last_undegraded":"2024-09-10T08:28:48.621316+0000","last_fullsized":"2024-09-10T08:28:48.621316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:19.431857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354237+0000","last_change":"2024-09-10T08:28:47.630243+0000","last_active":"2024-09-10T08:28:49.354237+0000","last_peered":"2024-09-10T08:28:49.354237+0000","last_clean":"2024-09-10T08:28:49.354237+0000","last_became_active":"2024-09-10T08:28:47.629869+0000","last_became_peered":"2024-09-10T08:28:47.629869+0000","last_unstale":"2024-09-10T08:28:49.354237+0000","last_undegraded":"2024-09-10T08:28:49.354237+0000","last_fullsized":"2024-09-10T08:28:49.354237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:58.696156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621683+0000","last_change":"2024-09-10T08:28:35.572944+0000","last_active":"2024-09-10T08:28:48.621683+0000","last_peered":"2024-09-10T08:28:48.621683+0000","last_clean":"2024-09-10T08:28:48.621683+0000","last_became_active":"2024-09-10T08:28:35.572620+0000","last_became_peered":"2024-09-10T08:28:35.572620+0000","last_unstale":"2024-09-10T08:28:48.621683+0000","last_undegraded":"2024-09-10T08:28:48.621683+0000","last_fullsized":"2024-09-10T08:28:48.621683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:04.524048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421956+0000","last_change":"2024-09-10T08:28:34.562935+0000","last_active":"2024-09-10T08:28:49.421956+0000","last_peered":"2024-09-10T08:28:49.421956+0000","last_clean":"2024-09-10T08:28:49.421956+0000","last_became_active":"2024-09-10T08:28:34.562647+0000","last_became_peered":"2024-09-10T08:28:34.562647+0000","last_unstale":"2024-09-10T08:28:49.421956+0000","last_undegraded":"2024-09-10T08:28:49.421956+0000","last_fullsized":"2024-09-10T08:28:49.421956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:47.492281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621382+0000","last_change":"2024-09-10T08:28:46.621472+0000","last_active":"2024-09-10T08:28:48.621382+0000","last_peered":"2024-09-10T08:28:48.621382+0000","last_clean":"2024-09-10T08:28:48.621382+0000","last_became_active":"2024-09-10T08:28:46.621157+0000","last_became_peered":"2024-09-10T08:28:46.621157+0000","last_unstale":"2024-09-10T08:28:48.621382+0000","last_undegraded":"2024-09-10T08:28:48.621382+0000","last_fullsized":"2024-09-10T08:28:48.621382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:44.166068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421835+0000","last_change":"2024-09-10T08:28:47.627750+0000","last_active":"2024-09-10T08:28:49.421835+0000","last_peered":"2024-09-10T08:28:49.421835+0000","last_clean":"2024-09-10T08:28:49.421835+0000","last_became_active":"2024-09-10T08:28:47.627481+0000","last_became_peered":"2024-09-10T08:28:47.627481+0000","last_unstale":"2024-09-10T08:28:49.421835+0000","last_undegraded":"2024-09-10T08:28:49.421835+0000","last_fullsized":"2024-09-10T08:28:49.421835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:01.105133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631930+0000","last_change":"2024-09-10T08:28:46.620162+0000","last_active":"2024-09-10T08:28:48.631930+0000","last_peered":"2024-09-10T08:28:48.631930+0000","last_clean":"2024-09-10T08:28:48.631930+0000","last_became_active":"2024-09-10T08:28:46.619843+0000","last_became_peered":"2024-09-10T08:28:46.619843+0000","last_unstale":"2024-09-10T08:28:48.631930+0000","last_undegraded":"2024-09-10T08:28:48.631930+0000","last_fullsized":"2024-09-10T08:28:48.631930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:21.376123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.633938+0000","last_change":"2024-09-10T08:28:35.572803+0000","last_active":"2024-09-10T08:28:48.633938+0000","last_peered":"2024-09-10T08:28:48.633938+0000","last_clean":"2024-09-10T08:28:48.633938+0000","last_became_active":"2024-09-10T08:28:35.572219+0000","last_became_peered":"2024-09-10T08:28:35.572219+0000","last_unstale":"2024-09-10T08:28:48.633938+0000","last_undegraded":"2024-09-10T08:28:48.633938+0000","last_fullsized":"2024-09-10T08:28:48.633938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:45.920218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620645+0000","last_change":"2024-09-10T08:28:34.554346+0000","last_active":"2024-09-10T08:28:48.620645+0000","last_peered":"2024-09-10T08:28:48.620645+0000","last_clean":"2024-09-10T08:28:48.620645+0000","last_became_active":"2024-09-10T08:28:34.553933+0000","last_became_peered":"2024-09-10T08:28:34.553933+0000","last_unstale":"2024-09-10T08:28:48.620645+0000","last_undegraded":"2024-09-10T08:28:48.620645+0000","last_fullsized":"2024-09-10T08:28:48.620645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:07.639671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631936+0000","last_change":"2024-09-10T08:28:47.629468+0000","last_active":"2024-09-10T08:28:48.631936+0000","last_peered":"2024-09-10T08:28:48.631936+0000","last_clean":"2024-09-10T08:28:48.631936+0000","last_became_active":"2024-09-10T08:28:47.629177+0000","last_became_peered":"2024-09-10T08:28:47.629177+0000","last_unstale":"2024-09-10T08:28:48.631936+0000","last_undegraded":"2024-09-10T08:28:48.631936+0000","last_fullsized":"2024-09-10T08:28:48.631936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:10.443235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421808+0000","last_change":"2024-09-10T08:28:46.630904+0000","last_active":"2024-09-10T08:28:49.421808+0000","last_peered":"2024-09-10T08:28:49.421808+0000","last_clean":"2024-09-10T08:28:49.421808+0000","last_became_active":"2024-09-10T08:28:46.630530+0000","last_became_peered":"2024-09-10T08:28:46.630530+0000","last_unstale":"2024-09-10T08:28:49.421808+0000","last_undegraded":"2024-09-10T08:28:49.421808+0000","last_fullsized":"2024-09-10T08:28:49.421808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:33.599739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621556+0000","last_change":"2024-09-10T08:28:35.580244+0000","last_active":"2024-09-10T08:28:48.621556+0000","last_peered":"2024-09-10T08:28:48.621556+0000","last_clean":"2024-09-10T08:28:48.621556+0000","last_became_active":"2024-09-10T08:28:35.579975+0000","last_became_peered":"2024-09-10T08:28:35.579975+0000","last_unstale":"2024-09-10T08:28:48.621556+0000","last_undegraded":"2024-09-10T08:28:48.621556+0000","last_fullsized":"2024-09-10T08:28:48.621556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:16.498045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621654+0000","last_change":"2024-09-10T08:28:34.564751+0000","last_active":"2024-09-10T08:28:48.621654+0000","last_peered":"2024-09-10T08:28:48.621654+0000","last_clean":"2024-09-10T08:28:48.621654+0000","last_became_active":"2024-09-10T08:28:34.564479+0000","last_became_peered":"2024-09-10T08:28:34.564479+0000","last_unstale":"2024-09-10T08:28:48.621654+0000","last_undegraded":"2024-09-10T08:28:48.621654+0000","last_fullsized":"2024-09-10T08:28:48.621654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:29.618224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634645+0000","last_change":"2024-09-10T08:28:47.627041+0000","last_active":"2024-09-10T08:28:48.634645+0000","last_peered":"2024-09-10T08:28:48.634645+0000","last_clean":"2024-09-10T08:28:48.634645+0000","last_became_active":"2024-09-10T08:28:47.626692+0000","last_became_peered":"2024-09-10T08:28:47.626692+0000","last_unstale":"2024-09-10T08:28:48.634645+0000","last_undegraded":"2024-09-10T08:28:48.634645+0000","last_fullsized":"2024-09-10T08:28:48.634645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:57.666849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421403+0000","last_change":"2024-09-10T08:28:34.561906+0000","last_active":"2024-09-10T08:28:49.421403+0000","last_peered":"2024-09-10T08:28:49.421403+0000","last_clean":"2024-09-10T08:28:49.421403+0000","last_became_active":"2024-09-10T08:28:34.561613+0000","last_became_peered":"2024-09-10T08:28:34.561613+0000","last_unstale":"2024-09-10T08:28:49.421403+0000","last_undegraded":"2024-09-10T08:28:49.421403+0000","last_fullsized":"2024-09-10T08:28:49.421403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:56.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632248+0000","last_change":"2024-09-10T08:28:35.576406+0000","last_active":"2024-09-10T08:28:48.632248+0000","last_peered":"2024-09-10T08:28:48.632248+0000","last_clean":"2024-09-10T08:28:48.632248+0000","last_became_active":"2024-09-10T08:28:35.576145+0000","last_became_peered":"2024-09-10T08:28:35.576145+0000","last_unstale":"2024-09-10T08:28:48.632248+0000","last_undegraded":"2024-09-10T08:28:48.632248+0000","last_fullsized":"2024-09-10T08:28:48.632248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:57.667098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299845+0000","last_change":"2024-09-10T08:28:46.622395+0000","last_active":"2024-09-10T08:28:49.299845+0000","last_peered":"2024-09-10T08:28:49.299845+0000","last_clean":"2024-09-10T08:28:49.299845+0000","last_became_active":"2024-09-10T08:28:46.621941+0000","last_became_peered":"2024-09-10T08:28:46.621941+0000","last_unstale":"2024-09-10T08:28:49.299845+0000","last_undegraded":"2024-09-10T08:28:49.299845+0000","last_fullsized":"2024-09-10T08:28:49.299845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:54.928969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621387+0000","last_change":"2024-09-10T08:28:47.626495+0000","last_active":"2024-09-10T08:28:48.621387+0000","last_peered":"2024-09-10T08:28:48.621387+0000","last_clean":"2024-09-10T08:28:48.621387+0000","last_became_active":"2024-09-10T08:28:47.625258+0000","last_became_peered":"2024-09-10T08:28:47.625258+0000","last_unstale":"2024-09-10T08:28:48.621387+0000","last_undegraded":"2024-09-10T08:28:48.621387+0000","last_fullsized":"2024-09-10T08:28:48.621387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:00.101586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622005+0000","last_change":"2024-09-10T08:28:34.566606+0000","last_active":"2024-09-10T08:28:48.622005+0000","last_peered":"2024-09-10T08:28:48.622005+0000","last_clean":"2024-09-10T08:28:48.622005+0000","last_became_active":"2024-09-10T08:28:34.566388+0000","last_became_peered":"2024-09-10T08:28:34.566388+0000","last_unstale":"2024-09-10T08:28:48.622005+0000","last_undegraded":"2024-09-10T08:28:48.622005+0000","last_fullsized":"2024-09-10T08:28:48.622005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:33.528801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621394+0000","last_change":"2024-09-10T08:28:35.559371+0000","last_active":"2024-09-10T08:28:48.621394+0000","last_peered":"2024-09-10T08:28:48.621394+0000","last_clean":"2024-09-10T08:28:48.621394+0000","last_became_active":"2024-09-10T08:28:35.559145+0000","last_became_peered":"2024-09-10T08:28:35.559145+0000","last_unstale":"2024-09-10T08:28:48.621394+0000","last_undegraded":"2024-09-10T08:28:48.621394+0000","last_fullsized":"2024-09-10T08:28:48.621394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:57.339318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621811+0000","last_change":"2024-09-10T08:28:46.620231+0000","last_active":"2024-09-10T08:28:48.621811+0000","last_peered":"2024-09-10T08:28:48.621811+0000","last_clean":"2024-09-10T08:28:48.621811+0000","last_became_active":"2024-09-10T08:28:46.619403+0000","last_became_peered":"2024-09-10T08:28:46.619403+0000","last_unstale":"2024-09-10T08:28:48.621811+0000","last_undegraded":"2024-09-10T08:28:48.621811+0000","last_fullsized":"2024-09-10T08:28:48.621811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:26.308749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622383+0000","last_change":"2024-09-10T08:28:47.627135+0000","last_active":"2024-09-10T08:28:48.622383+0000","last_peered":"2024-09-10T08:28:48.622383+0000","last_clean":"2024-09-10T08:28:48.622383+0000","last_became_active":"2024-09-10T08:28:47.626791+0000","last_became_peered":"2024-09-10T08:28:47.626791+0000","last_unstale":"2024-09-10T08:28:48.622383+0000","last_undegraded":"2024-09-10T08:28:48.622383+0000","last_fullsized":"2024-09-10T08:28:48.622383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:43.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.420972+0000","last_change":"2024-09-10T08:28:35.579106+0000","last_active":"2024-09-10T08:28:49.420972+0000","last_peered":"2024-09-10T08:28:49.420972+0000","last_clean":"2024-09-10T08:28:49.420972+0000","last_became_active":"2024-09-10T08:28:35.578631+0000","last_became_peered":"2024-09-10T08:28:35.578631+0000","last_unstale":"2024-09-10T08:28:49.420972+0000","last_undegraded":"2024-09-10T08:28:49.420972+0000","last_fullsized":"2024-09-10T08:28:49.420972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:31.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634751+0000","last_change":"2024-09-10T08:28:47.632052+0000","last_active":"2024-09-10T08:28:48.634751+0000","last_peered":"2024-09-10T08:28:48.634751+0000","last_clean":"2024-09-10T08:28:48.634751+0000","last_became_active":"2024-09-10T08:28:47.631578+0000","last_became_peered":"2024-09-10T08:28:47.631578+0000","last_unstale":"2024-09-10T08:28:48.634751+0000","last_undegraded":"2024-09-10T08:28:48.634751+0000","last_fullsized":"2024-09-10T08:28:48.634751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:24.570729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299570+0000","last_change":"2024-09-10T08:28:35.566780+0000","last_active":"2024-09-10T08:28:49.299570+0000","last_peered":"2024-09-10T08:28:49.299570+0000","last_clean":"2024-09-10T08:28:49.299570+0000","last_became_active":"2024-09-10T08:28:35.566529+0000","last_became_peered":"2024-09-10T08:28:35.566529+0000","last_unstale":"2024-09-10T08:28:49.299570+0000","last_undegraded":"2024-09-10T08:28:49.299570+0000","last_fullsized":"2024-09-10T08:28:49.299570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:09.481166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621043+0000","last_change":"2024-09-10T08:28:47.629148+0000","last_active":"2024-09-10T08:28:48.621043+0000","last_peered":"2024-09-10T08:28:48.621043+0000","last_clean":"2024-09-10T08:28:48.621043+0000","last_became_active":"2024-09-10T08:28:47.628741+0000","last_became_peered":"2024-09-10T08:28:47.628741+0000","last_unstale":"2024-09-10T08:28:48.621043+0000","last_undegraded":"2024-09-10T08:28:48.621043+0000","last_fullsized":"2024-09-10T08:28:48.621043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:48.950503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621017+0000","last_change":"2024-09-10T08:28:35.578735+0000","last_active":"2024-09-10T08:28:48.621017+0000","last_peered":"2024-09-10T08:28:48.621017+0000","last_clean":"2024-09-10T08:28:48.621017+0000","last_became_active":"2024-09-10T08:28:35.577995+0000","last_became_peered":"2024-09-10T08:28:35.577995+0000","last_unstale":"2024-09-10T08:28:48.621017+0000","last_undegraded":"2024-09-10T08:28:48.621017+0000","last_fullsized":"2024-09-10T08:28:48.621017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:11.033441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634650+0000","last_change":"2024-09-10T08:28:47.628639+0000","last_active":"2024-09-10T08:28:48.634650+0000","last_peered":"2024-09-10T08:28:48.634650+0000","last_clean":"2024-09-10T08:28:48.634650+0000","last_became_active":"2024-09-10T08:28:47.628317+0000","last_became_peered":"2024-09-10T08:28:47.628317+0000","last_unstale":"2024-09-10T08:28:48.634650+0000","last_undegraded":"2024-09-10T08:28:48.634650+0000","last_fullsized":"2024-09-10T08:28:48.634650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:50.314678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632190+0000","last_change":"2024-09-10T08:28:35.577852+0000","last_active":"2024-09-10T08:28:48.632190+0000","last_peered":"2024-09-10T08:28:48.632190+0000","last_clean":"2024-09-10T08:28:48.632190+0000","last_became_active":"2024-09-10T08:28:35.577571+0000","last_became_peered":"2024-09-10T08:28:35.577571+0000","last_unstale":"2024-09-10T08:28:48.632190+0000","last_undegraded":"2024-09-10T08:28:48.632190+0000","last_fullsized":"2024-09-10T08:28:48.632190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:22.713732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354207+0000","last_change":"2024-09-10T08:28:47.629931+0000","last_active":"2024-09-10T08:28:49.354207+0000","last_peered":"2024-09-10T08:28:49.354207+0000","last_clean":"2024-09-10T08:28:49.354207+0000","last_became_active":"2024-09-10T08:28:47.629634+0000","last_became_peered":"2024-09-10T08:28:47.629634+0000","last_unstale":"2024-09-10T08:28:49.354207+0000","last_undegraded":"2024-09-10T08:28:49.354207+0000","last_fullsized":"2024-09-10T08:28:49.354207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:57.964208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622194+0000","last_change":"2024-09-10T08:28:35.574676+0000","last_active":"2024-09-10T08:28:48.622194+0000","last_peered":"2024-09-10T08:28:48.622194+0000","last_clean":"2024-09-10T08:28:48.622194+0000","last_became_active":"2024-09-10T08:28:35.574437+0000","last_became_peered":"2024-09-10T08:28:35.574437+0000","last_unstale":"2024-09-10T08:28:48.622194+0000","last_undegraded":"2024-09-10T08:28:48.622194+0000","last_fullsized":"2024-09-10T08:28:48.622194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:45.422506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620118+0000","last_change":"2024-09-10T08:28:47.624178+0000","last_active":"2024-09-10T08:28:48.620118+0000","last_peered":"2024-09-10T08:28:48.620118+0000","last_clean":"2024-09-10T08:28:48.620118+0000","last_became_active":"2024-09-10T08:28:47.623671+0000","last_became_peered":"2024-09-10T08:28:47.623671+0000","last_unstale":"2024-09-10T08:28:48.620118+0000","last_undegraded":"2024-09-10T08:28:48.620118+0000","last_fullsized":"2024-09-10T08:28:48.620118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:48.613870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634693+0000","last_change":"2024-09-10T08:28:35.572550+0000","last_active":"2024-09-10T08:28:48.634693+0000","last_peered":"2024-09-10T08:28:48.634693+0000","last_clean":"2024-09-10T08:28:48.634693+0000","last_became_active":"2024-09-10T08:28:35.572184+0000","last_became_peered":"2024-09-10T08:28:35.572184+0000","last_unstale":"2024-09-10T08:28:48.634693+0000","last_undegraded":"2024-09-10T08:28:48.634693+0000","last_fullsized":"2024-09-10T08:28:48.634693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:08.490734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354228+0000","last_change":"2024-09-10T08:28:47.630214+0000","last_active":"2024-09-10T08:28:49.354228+0000","last_peered":"2024-09-10T08:28:49.354228+0000","last_clean":"2024-09-10T08:28:49.354228+0000","last_became_active":"2024-09-10T08:28:47.629512+0000","last_became_peered":"2024-09-10T08:28:47.629512+0000","last_unstale":"2024-09-10T08:28:49.354228+0000","last_undegraded":"2024-09-10T08:28:49.354228+0000","last_fullsized":"2024-09-10T08:28:49.354228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:35.692107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421683+0000","last_change":"2024-09-10T08:28:35.573217+0000","last_active":"2024-09-10T08:28:49.421683+0000","last_peered":"2024-09-10T08:28:49.421683+0000","last_clean":"2024-09-10T08:28:49.421683+0000","last_became_active":"2024-09-10T08:28:35.572955+0000","last_became_peered":"2024-09-10T08:28:35.572955+0000","last_unstale":"2024-09-10T08:28:49.421683+0000","last_undegraded":"2024-09-10T08:28:49.421683+0000","last_fullsized":"2024-09-10T08:28:49.421683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:24.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421176+0000","last_change":"2024-09-10T08:28:47.623365+0000","last_active":"2024-09-10T08:28:49.421176+0000","last_peered":"2024-09-10T08:28:49.421176+0000","last_clean":"2024-09-10T08:28:49.421176+0000","last_became_active":"2024-09-10T08:28:47.623082+0000","last_became_peered":"2024-09-10T08:28:47.623082+0000","last_unstale":"2024-09-10T08:28:49.421176+0000","last_undegraded":"2024-09-10T08:28:49.421176+0000","last_fullsized":"2024-09-10T08:28:49.421176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:20.558484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622192+0000","last_change":"2024-09-10T08:28:35.575902+0000","last_active":"2024-09-10T08:28:48.622192+0000","last_peered":"2024-09-10T08:28:48.622192+0000","last_clean":"2024-09-10T08:28:48.622192+0000","last_became_active":"2024-09-10T08:28:35.575614+0000","last_became_peered":"2024-09-10T08:28:35.575614+0000","last_unstale":"2024-09-10T08:28:48.622192+0000","last_undegraded":"2024-09-10T08:28:48.622192+0000","last_fullsized":"2024-09-10T08:28:48.622192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:11.277682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622312+0000","last_change":"2024-09-10T08:28:47.629795+0000","last_active":"2024-09-10T08:28:48.622312+0000","last_peered":"2024-09-10T08:28:48.622312+0000","last_clean":"2024-09-10T08:28:48.622312+0000","last_became_active":"2024-09-10T08:28:47.628861+0000","last_became_peered":"2024-09-10T08:28:47.628861+0000","last_unstale":"2024-09-10T08:28:48.622312+0000","last_undegraded":"2024-09-10T08:28:48.622312+0000","last_fullsized":"2024-09-10T08:28:48.622312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:06.277094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620538+0000","last_change":"2024-09-10T08:28:35.578285+0000","last_active":"2024-09-10T08:28:48.620538+0000","last_peered":"2024-09-10T08:28:48.620538+0000","last_clean":"2024-09-10T08:28:48.620538+0000","last_became_active":"2024-09-10T08:28:35.576805+0000","last_became_peered":"2024-09-10T08:28:35.576805+0000","last_unstale":"2024-09-10T08:28:48.620538+0000","last_undegraded":"2024-09-10T08:28:48.620538+0000","last_fullsized":"2024-09-10T08:28:48.620538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:46.203320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355252+0000","last_change":"2024-09-10T08:28:47.635713+0000","last_active":"2024-09-10T08:28:49.355252+0000","last_peered":"2024-09-10T08:28:49.355252+0000","last_clean":"2024-09-10T08:28:49.355252+0000","last_became_active":"2024-09-10T08:28:47.635381+0000","last_became_peered":"2024-09-10T08:28:47.635381+0000","last_unstale":"2024-09-10T08:28:49.355252+0000","last_undegraded":"2024-09-10T08:28:49.355252+0000","last_fullsized":"2024-09-10T08:28:49.355252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:39.419510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621520+0000","last_change":"2024-09-10T08:28:35.571566+0000","last_active":"2024-09-10T08:28:48.621520+0000","last_peered":"2024-09-10T08:28:48.621520+0000","last_clean":"2024-09-10T08:28:48.621520+0000","last_became_active":"2024-09-10T08:28:35.571285+0000","last_became_peered":"2024-09-10T08:28:35.571285+0000","last_unstale":"2024-09-10T08:28:48.621520+0000","last_undegraded":"2024-09-10T08:28:48.621520+0000","last_fullsized":"2024-09-10T08:28:48.621520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:23.587691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299893+0000","last_change":"2024-09-10T08:28:47.619863+0000","last_active":"2024-09-10T08:28:49.299893+0000","last_peered":"2024-09-10T08:28:49.299893+0000","last_clean":"2024-09-10T08:28:49.299893+0000","last_became_active":"2024-09-10T08:28:47.619525+0000","last_became_peered":"2024-09-10T08:28:47.619525+0000","last_unstale":"2024-09-10T08:28:49.299893+0000","last_undegraded":"2024-09-10T08:28:49.299893+0000","last_fullsized":"2024-09-10T08:28:49.299893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:49.591318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620937+0000","last_change":"2024-09-10T08:28:35.568044+0000","last_active":"2024-09-10T08:28:48.620937+0000","last_peered":"2024-09-10T08:28:48.620937+0000","last_clean":"2024-09-10T08:28:48.620937+0000","last_became_active":"2024-09-10T08:28:35.567744+0000","last_became_peered":"2024-09-10T08:28:35.567744+0000","last_unstale":"2024-09-10T08:28:48.620937+0000","last_undegraded":"2024-09-10T08:28:48.620937+0000","last_fullsized":"2024-09-10T08:28:48.620937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:19.081138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621697+0000","last_change":"2024-09-10T08:28:47.629417+0000","last_active":"2024-09-10T08:28:48.621697+0000","last_peered":"2024-09-10T08:28:48.621697+0000","last_clean":"2024-09-10T08:28:48.621697+0000","last_became_active":"2024-09-10T08:28:47.629095+0000","last_became_peered":"2024-09-10T08:28:47.629095+0000","last_unstale":"2024-09-10T08:28:48.621697+0000","last_undegraded":"2024-09-10T08:28:48.621697+0000","last_fullsized":"2024-09-10T08:28:48.621697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:05.606381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.632075+0000","last_change":"2024-09-10T08:28:35.575802+0000","last_active":"2024-09-10T08:28:48.632075+0000","last_peered":"2024-09-10T08:28:48.632075+0000","last_clean":"2024-09-10T08:28:48.632075+0000","last_became_active":"2024-09-10T08:28:35.575388+0000","last_became_peered":"2024-09-10T08:28:35.575388+0000","last_unstale":"2024-09-10T08:28:48.632075+0000","last_undegraded":"2024-09-10T08:28:48.632075+0000","last_fullsized":"2024-09-10T08:28:48.632075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:01.424265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620142+0000","last_change":"2024-09-10T08:28:47.624305+0000","last_active":"2024-09-10T08:28:48.620142+0000","last_peered":"2024-09-10T08:28:48.620142+0000","last_clean":"2024-09-10T08:28:48.620142+0000","last_became_active":"2024-09-10T08:28:47.624026+0000","last_became_peered":"2024-09-10T08:28:47.624026+0000","last_unstale":"2024-09-10T08:28:48.620142+0000","last_undegraded":"2024-09-10T08:28:48.620142+0000","last_fullsized":"2024-09-10T08:28:48.620142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:01.194271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421368+0000","last_change":"2024-09-10T08:28:35.574499+0000","last_active":"2024-09-10T08:28:49.421368+0000","last_peered":"2024-09-10T08:28:49.421368+0000","last_clean":"2024-09-10T08:28:49.421368+0000","last_became_active":"2024-09-10T08:28:35.574249+0000","last_became_peered":"2024-09-10T08:28:35.574249+0000","last_unstale":"2024-09-10T08:28:49.421368+0000","last_undegraded":"2024-09-10T08:28:49.421368+0000","last_fullsized":"2024-09-10T08:28:49.421368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:55.952307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620349+0000","last_change":"2024-09-10T08:28:47.629525+0000","last_active":"2024-09-10T08:28:48.620349+0000","last_peered":"2024-09-10T08:28:48.620349+0000","last_clean":"2024-09-10T08:28:48.620349+0000","last_became_active":"2024-09-10T08:28:47.629259+0000","last_became_peered":"2024-09-10T08:28:47.629259+0000","last_unstale":"2024-09-10T08:28:48.620349+0000","last_undegraded":"2024-09-10T08:28:48.620349+0000","last_fullsized":"2024-09-10T08:28:48.620349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:11.864322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355002+0000","last_change":"2024-09-10T08:28:35.572709+0000","last_active":"2024-09-10T08:28:49.355002+0000","last_peered":"2024-09-10T08:28:49.355002+0000","last_clean":"2024-09-10T08:28:49.355002+0000","last_became_active":"2024-09-10T08:28:35.572392+0000","last_became_peered":"2024-09-10T08:28:35.572392+0000","last_unstale":"2024-09-10T08:28:49.355002+0000","last_undegraded":"2024-09-10T08:28:49.355002+0000","last_fullsized":"2024-09-10T08:28:49.355002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:42.636299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619769+0000","last_change":"2024-09-10T08:28:47.623285+0000","last_active":"2024-09-10T08:28:48.619769+0000","last_peered":"2024-09-10T08:28:48.619769+0000","last_clean":"2024-09-10T08:28:48.619769+0000","last_became_active":"2024-09-10T08:28:47.621776+0000","last_became_peered":"2024-09-10T08:28:47.621776+0000","last_unstale":"2024-09-10T08:28:48.619769+0000","last_undegraded":"2024-09-10T08:28:48.619769+0000","last_fullsized":"2024-09-10T08:28:48.619769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:32.543418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.300034+0000","last_change":"2024-09-10T08:28:35.574438+0000","last_active":"2024-09-10T08:28:49.300034+0000","last_peered":"2024-09-10T08:28:49.300034+0000","last_clean":"2024-09-10T08:28:49.300034+0000","last_became_active":"2024-09-10T08:28:35.574175+0000","last_became_peered":"2024-09-10T08:28:35.574175+0000","last_unstale":"2024-09-10T08:28:49.300034+0000","last_undegraded":"2024-09-10T08:28:49.300034+0000","last_fullsized":"2024-09-10T08:28:49.300034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:55.808543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631598+0000","last_change":"2024-09-10T08:28:47.629092+0000","last_active":"2024-09-10T08:28:48.631598+0000","last_peered":"2024-09-10T08:28:48.631598+0000","last_clean":"2024-09-10T08:28:48.631598+0000","last_became_active":"2024-09-10T08:28:47.628806+0000","last_became_peered":"2024-09-10T08:28:47.628806+0000","last_unstale":"2024-09-10T08:28:48.631598+0000","last_undegraded":"2024-09-10T08:28:48.631598+0000","last_fullsized":"2024-09-10T08:28:48.631598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:46.440290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622000+0000","last_change":"2024-09-10T08:28:35.567296+0000","last_active":"2024-09-10T08:28:48.622000+0000","last_peered":"2024-09-10T08:28:48.622000+0000","last_clean":"2024-09-10T08:28:48.622000+0000","last_became_active":"2024-09-10T08:28:35.567074+0000","last_became_peered":"2024-09-10T08:28:35.567074+0000","last_unstale":"2024-09-10T08:28:48.622000+0000","last_undegraded":"2024-09-10T08:28:48.622000+0000","last_fullsized":"2024-09-10T08:28:48.622000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:55.698345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634643+0000","last_change":"2024-09-10T08:28:47.631797+0000","last_active":"2024-09-10T08:28:48.634643+0000","last_peered":"2024-09-10T08:28:48.634643+0000","last_clean":"2024-09-10T08:28:48.634643+0000","last_became_active":"2024-09-10T08:28:47.631523+0000","last_became_peered":"2024-09-10T08:28:47.631523+0000","last_unstale":"2024-09-10T08:28:48.634643+0000","last_undegraded":"2024-09-10T08:28:48.634643+0000","last_fullsized":"2024-09-10T08:28:48.634643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:05.829116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.619838+0000","last_change":"2024-09-10T08:28:35.570249+0000","last_active":"2024-09-10T08:28:48.619838+0000","last_peered":"2024-09-10T08:28:48.619838+0000","last_clean":"2024-09-10T08:28:48.619838+0000","last_became_active":"2024-09-10T08:28:35.569960+0000","last_became_peered":"2024-09-10T08:28:35.569960+0000","last_unstale":"2024-09-10T08:28:48.619838+0000","last_undegraded":"2024-09-10T08:28:48.619838+0000","last_fullsized":"2024-09-10T08:28:48.619838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:29.787554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620473+0000","last_change":"2024-09-10T08:28:47.633644+0000","last_active":"2024-09-10T08:28:48.620473+0000","last_peered":"2024-09-10T08:28:48.620473+0000","last_clean":"2024-09-10T08:28:48.620473+0000","last_became_active":"2024-09-10T08:28:47.633315+0000","last_became_peered":"2024-09-10T08:28:47.633315+0000","last_unstale":"2024-09-10T08:28:48.620473+0000","last_undegraded":"2024-09-10T08:28:48.620473+0000","last_fullsized":"2024-09-10T08:28:48.620473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:45:55.827386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634008+0000","last_change":"2024-09-10T08:28:35.560693+0000","last_active":"2024-09-10T08:28:48.634008+0000","last_peered":"2024-09-10T08:28:48.634008+0000","last_clean":"2024-09-10T08:28:48.634008+0000","last_became_active":"2024-09-10T08:28:35.560409+0000","last_became_peered":"2024-09-10T08:28:35.560409+0000","last_unstale":"2024-09-10T08:28:48.634008+0000","last_undegraded":"2024-09-10T08:28:48.634008+0000","last_fullsized":"2024-09-10T08:28:48.634008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:10.597654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621112+0000","last_change":"2024-09-10T08:28:47.622614+0000","last_active":"2024-09-10T08:28:48.621112+0000","last_peered":"2024-09-10T08:28:48.621112+0000","last_clean":"2024-09-10T08:28:48.621112+0000","last_became_active":"2024-09-10T08:28:47.622205+0000","last_became_peered":"2024-09-10T08:28:47.622205+0000","last_unstale":"2024-09-10T08:28:48.621112+0000","last_undegraded":"2024-09-10T08:28:48.621112+0000","last_fullsized":"2024-09-10T08:28:48.621112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:47.090782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631666+0000","last_change":"2024-09-10T08:28:35.574551+0000","last_active":"2024-09-10T08:28:48.631666+0000","last_peered":"2024-09-10T08:28:48.631666+0000","last_clean":"2024-09-10T08:28:48.631666+0000","last_became_active":"2024-09-10T08:28:35.574256+0000","last_became_peered":"2024-09-10T08:28:35.574256+0000","last_unstale":"2024-09-10T08:28:48.631666+0000","last_undegraded":"2024-09-10T08:28:48.631666+0000","last_fullsized":"2024-09-10T08:28:48.631666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:43.401552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354791+0000","last_change":"2024-09-10T08:28:47.633476+0000","last_active":"2024-09-10T08:28:49.354791+0000","last_peered":"2024-09-10T08:28:49.354791+0000","last_clean":"2024-09-10T08:28:49.354791+0000","last_became_active":"2024-09-10T08:28:47.633189+0000","last_became_peered":"2024-09-10T08:28:47.633189+0000","last_unstale":"2024-09-10T08:28:49.354791+0000","last_undegraded":"2024-09-10T08:28:49.354791+0000","last_fullsized":"2024-09-10T08:28:49.354791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:46.175490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621900+0000","last_change":"2024-09-10T08:28:35.573330+0000","last_active":"2024-09-10T08:28:48.621900+0000","last_peered":"2024-09-10T08:28:48.621900+0000","last_clean":"2024-09-10T08:28:48.621900+0000","last_became_active":"2024-09-10T08:28:35.572992+0000","last_became_peered":"2024-09-10T08:28:35.572992+0000","last_unstale":"2024-09-10T08:28:48.621900+0000","last_undegraded":"2024-09-10T08:28:48.621900+0000","last_fullsized":"2024-09-10T08:28:48.621900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:15.412219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621967+0000","last_change":"2024-09-10T08:28:47.630733+0000","last_active":"2024-09-10T08:28:48.621967+0000","last_peered":"2024-09-10T08:28:48.621967+0000","last_clean":"2024-09-10T08:28:48.621967+0000","last_became_active":"2024-09-10T08:28:47.630447+0000","last_became_peered":"2024-09-10T08:28:47.630447+0000","last_unstale":"2024-09-10T08:28:48.621967+0000","last_undegraded":"2024-09-10T08:28:48.621967+0000","last_fullsized":"2024-09-10T08:28:48.621967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:08.797818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621594+0000","last_change":"2024-09-10T08:28:35.566574+0000","last_active":"2024-09-10T08:28:48.621594+0000","last_peered":"2024-09-10T08:28:48.621594+0000","last_clean":"2024-09-10T08:28:48.621594+0000","last_became_active":"2024-09-10T08:28:35.566205+0000","last_became_peered":"2024-09-10T08:28:35.566205+0000","last_unstale":"2024-09-10T08:28:48.621594+0000","last_undegraded":"2024-09-10T08:28:48.621594+0000","last_fullsized":"2024-09-10T08:28:48.621594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:49.876773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299778+0000","last_change":"2024-09-10T08:28:47.628051+0000","last_active":"2024-09-10T08:28:49.299778+0000","last_peered":"2024-09-10T08:28:49.299778+0000","last_clean":"2024-09-10T08:28:49.299778+0000","last_became_active":"2024-09-10T08:28:47.627747+0000","last_became_peered":"2024-09-10T08:28:47.627747+0000","last_unstale":"2024-09-10T08:28:49.299778+0000","last_undegraded":"2024-09-10T08:28:49.299778+0000","last_fullsized":"2024-09-10T08:28:49.299778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:54.210449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421487+0000","last_change":"2024-09-10T08:28:35.565023+0000","last_active":"2024-09-10T08:28:49.421487+0000","last_peered":"2024-09-10T08:28:49.421487+0000","last_clean":"2024-09-10T08:28:49.421487+0000","last_became_active":"2024-09-10T08:28:35.564747+0000","last_became_peered":"2024-09-10T08:28:35.564747+0000","last_unstale":"2024-09-10T08:28:49.421487+0000","last_undegraded":"2024-09-10T08:28:49.421487+0000","last_fullsized":"2024-09-10T08:28:49.421487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:32.419621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354688+0000","last_change":"2024-09-10T08:28:47.631047+0000","last_active":"2024-09-10T08:28:49.354688+0000","last_peered":"2024-09-10T08:28:49.354688+0000","last_clean":"2024-09-10T08:28:49.354688+0000","last_became_active":"2024-09-10T08:28:47.630617+0000","last_became_peered":"2024-09-10T08:28:47.630617+0000","last_unstale":"2024-09-10T08:28:49.354688+0000","last_undegraded":"2024-09-10T08:28:49.354688+0000","last_fullsized":"2024-09-10T08:28:49.354688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:29.867640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421612+0000","last_change":"2024-09-10T08:28:35.570619+0000","last_active":"2024-09-10T08:28:49.421612+0000","last_peered":"2024-09-10T08:28:49.421612+0000","last_clean":"2024-09-10T08:28:49.421612+0000","last_became_active":"2024-09-10T08:28:35.570351+0000","last_became_peered":"2024-09-10T08:28:35.570351+0000","last_unstale":"2024-09-10T08:28:49.421612+0000","last_undegraded":"2024-09-10T08:28:49.421612+0000","last_fullsized":"2024-09-10T08:28:49.421612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:35.161279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620557+0000","last_change":"2024-09-10T08:28:47.626191+0000","last_active":"2024-09-10T08:28:48.620557+0000","last_peered":"2024-09-10T08:28:48.620557+0000","last_clean":"2024-09-10T08:28:48.620557+0000","last_became_active":"2024-09-10T08:28:47.625781+0000","last_became_peered":"2024-09-10T08:28:47.625781+0000","last_unstale":"2024-09-10T08:28:48.620557+0000","last_undegraded":"2024-09-10T08:28:48.620557+0000","last_fullsized":"2024-09-10T08:28:48.620557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:36:38.651973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355079+0000","last_change":"2024-09-10T08:28:35.577345+0000","last_active":"2024-09-10T08:28:49.355079+0000","last_peered":"2024-09-10T08:28:49.355079+0000","last_clean":"2024-09-10T08:28:49.355079+0000","last_became_active":"2024-09-10T08:28:35.576191+0000","last_became_peered":"2024-09-10T08:28:35.576191+0000","last_unstale":"2024-09-10T08:28:49.355079+0000","last_undegraded":"2024-09-10T08:28:49.355079+0000","last_fullsized":"2024-09-10T08:28:49.355079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:29.218797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.622171+0000","last_change":"2024-09-10T08:28:47.623129+0000","last_active":"2024-09-10T08:28:48.622171+0000","last_peered":"2024-09-10T08:28:48.622171+0000","last_clean":"2024-09-10T08:28:48.622171+0000","last_became_active":"2024-09-10T08:28:47.622851+0000","last_became_peered":"2024-09-10T08:28:47.622851+0000","last_unstale":"2024-09-10T08:28:48.622171+0000","last_undegraded":"2024-09-10T08:28:48.622171+0000","last_fullsized":"2024-09-10T08:28:48.622171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:16.045213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621426+0000","last_change":"2024-09-10T08:28:35.575275+0000","last_active":"2024-09-10T08:28:48.621426+0000","last_peered":"2024-09-10T08:28:48.621426+0000","last_clean":"2024-09-10T08:28:48.621426+0000","last_became_active":"2024-09-10T08:28:35.575052+0000","last_became_peered":"2024-09-10T08:28:35.575052+0000","last_unstale":"2024-09-10T08:28:48.621426+0000","last_undegraded":"2024-09-10T08:28:48.621426+0000","last_fullsized":"2024-09-10T08:28:48.621426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:24.313017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.421741+0000","last_change":"2024-09-10T08:28:47.628651+0000","last_active":"2024-09-10T08:28:49.421741+0000","last_peered":"2024-09-10T08:28:49.421741+0000","last_clean":"2024-09-10T08:28:49.421741+0000","last_became_active":"2024-09-10T08:28:47.628343+0000","last_became_peered":"2024-09-10T08:28:47.628343+0000","last_unstale":"2024-09-10T08:28:49.421741+0000","last_undegraded":"2024-09-10T08:28:49.421741+0000","last_fullsized":"2024-09-10T08:28:49.421741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:05.848341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354299+0000","last_change":"2024-09-10T08:28:35.578664+0000","last_active":"2024-09-10T08:28:49.354299+0000","last_peered":"2024-09-10T08:28:49.354299+0000","last_clean":"2024-09-10T08:28:49.354299+0000","last_became_active":"2024-09-10T08:28:35.578384+0000","last_became_peered":"2024-09-10T08:28:35.578384+0000","last_unstale":"2024-09-10T08:28:49.354299+0000","last_undegraded":"2024-09-10T08:28:49.354299+0000","last_fullsized":"2024-09-10T08:28:49.354299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:44.278718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634174+0000","last_change":"2024-09-10T08:28:47.627593+0000","last_active":"2024-09-10T08:28:48.634174+0000","last_peered":"2024-09-10T08:28:48.634174+0000","last_clean":"2024-09-10T08:28:48.634174+0000","last_became_active":"2024-09-10T08:28:47.627237+0000","last_became_peered":"2024-09-10T08:28:47.627237+0000","last_unstale":"2024-09-10T08:28:48.634174+0000","last_undegraded":"2024-09-10T08:28:48.634174+0000","last_fullsized":"2024-09-10T08:28:48.634174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:16.045213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.620920+0000","last_change":"2024-09-10T08:28:35.578978+0000","last_active":"2024-09-10T08:28:48.620920+0000","last_peered":"2024-09-10T08:28:48.620920+0000","last_clean":"2024-09-10T08:28:48.620920+0000","last_became_active":"2024-09-10T08:28:35.578475+0000","last_became_peered":"2024-09-10T08:28:35.578475+0000","last_unstale":"2024-09-10T08:28:48.620920+0000","last_undegraded":"2024-09-10T08:28:48.620920+0000","last_fullsized":"2024-09-10T08:28:48.620920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:08.520314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621323+0000","last_change":"2024-09-10T08:28:47.634072+0000","last_active":"2024-09-10T08:28:48.621323+0000","last_peered":"2024-09-10T08:28:48.621323+0000","last_clean":"2024-09-10T08:28:48.621323+0000","last_became_active":"2024-09-10T08:28:47.633776+0000","last_became_peered":"2024-09-10T08:28:47.633776+0000","last_unstale":"2024-09-10T08:28:48.621323+0000","last_undegraded":"2024-09-10T08:28:48.621323+0000","last_fullsized":"2024-09-10T08:28:48.621323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:30.690202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354159+0000","last_change":"2024-09-10T08:28:35.572112+0000","last_active":"2024-09-10T08:28:49.354159+0000","last_peered":"2024-09-10T08:28:49.354159+0000","last_clean":"2024-09-10T08:28:49.354159+0000","last_became_active":"2024-09-10T08:28:35.571803+0000","last_became_peered":"2024-09-10T08:28:35.571803+0000","last_unstale":"2024-09-10T08:28:49.354159+0000","last_undegraded":"2024-09-10T08:28:49.354159+0000","last_fullsized":"2024-09-10T08:28:49.354159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:29.969987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621621+0000","last_change":"2024-09-10T08:28:47.620523+0000","last_active":"2024-09-10T08:28:48.621621+0000","last_peered":"2024-09-10T08:28:48.621621+0000","last_clean":"2024-09-10T08:28:48.621621+0000","last_became_active":"2024-09-10T08:28:47.620220+0000","last_became_peered":"2024-09-10T08:28:47.620220+0000","last_unstale":"2024-09-10T08:28:48.621621+0000","last_undegraded":"2024-09-10T08:28:48.621621+0000","last_fullsized":"2024-09-10T08:28:48.621621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:14.405210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.621263+0000","last_change":"2024-09-10T08:28:35.578961+0000","last_active":"2024-09-10T08:28:48.621263+0000","last_peered":"2024-09-10T08:28:48.621263+0000","last_clean":"2024-09-10T08:28:48.621263+0000","last_became_active":"2024-09-10T08:28:35.578680+0000","last_became_peered":"2024-09-10T08:28:35.578680+0000","last_unstale":"2024-09-10T08:28:48.621263+0000","last_undegraded":"2024-09-10T08:28:48.621263+0000","last_fullsized":"2024-09-10T08:28:48.621263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:53.737412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.299727+0000","last_change":"2024-09-10T08:28:47.624859+0000","last_active":"2024-09-10T08:28:49.299727+0000","last_peered":"2024-09-10T08:28:49.299727+0000","last_clean":"2024-09-10T08:28:49.299727+0000","last_became_active":"2024-09-10T08:28:47.624585+0000","last_became_peered":"2024-09-10T08:28:47.624585+0000","last_unstale":"2024-09-10T08:28:49.299727+0000","last_undegraded":"2024-09-10T08:28:49.299727+0000","last_fullsized":"2024-09-10T08:28:49.299727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:00.956870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.631870+0000","last_change":"2024-09-10T08:28:35.573918+0000","last_active":"2024-09-10T08:28:48.631870+0000","last_peered":"2024-09-10T08:28:48.631870+0000","last_clean":"2024-09-10T08:28:48.631870+0000","last_became_active":"2024-09-10T08:28:35.573646+0000","last_became_peered":"2024-09-10T08:28:35.573646+0000","last_unstale":"2024-09-10T08:28:48.631870+0000","last_undegraded":"2024-09-10T08:28:48.631870+0000","last_fullsized":"2024-09-10T08:28:48.631870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:24.295630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354036+0000","last_change":"2024-09-10T08:28:47.631802+0000","last_active":"2024-09-10T08:28:49.354036+0000","last_peered":"2024-09-10T08:28:49.354036+0000","last_clean":"2024-09-10T08:28:49.354036+0000","last_became_active":"2024-09-10T08:28:47.631456+0000","last_became_peered":"2024-09-10T08:28:47.631456+0000","last_unstale":"2024-09-10T08:28:49.354036+0000","last_undegraded":"2024-09-10T08:28:49.354036+0000","last_fullsized":"2024-09-10T08:28:49.354036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:56.571659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:48.634799+0000","last_change":"2024-09-10T08:28:35.578197+0000","last_active":"2024-09-10T08:28:48.634799+0000","last_peered":"2024-09-10T08:28:48.634799+0000","last_clean":"2024-09-10T08:28:48.634799+0000","last_became_active":"2024-09-10T08:28:35.577852+0000","last_became_peered":"2024-09-10T08:28:35.577852+0000","last_unstale":"2024-09-10T08:28:48.634799+0000","last_undegraded":"2024-09-10T08:28:48.634799+0000","last_fullsized":"2024-09-10T08:28:48.634799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:44.348299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.354168+0000","last_change":"2024-09-10T08:28:47.629993+0000","last_active":"2024-09-10T08:28:49.354168+0000","last_peered":"2024-09-10T08:28:49.354168+0000","last_clean":"2024-09-10T08:28:49.354168+0000","last_became_active":"2024-09-10T08:28:47.629713+0000","last_became_peered":"2024-09-10T08:28:47.629713+0000","last_unstale":"2024-09-10T08:28:49.354168+0000","last_undegraded":"2024-09-10T08:28:49.354168+0000","last_fullsized":"2024-09-10T08:28:49.354168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:56.640722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-10T08:28:49.355024+0000","last_change":"2024-09-10T08:28:35.571065+0000","last_active":"2024-09-10T08:28:49.355024+0000","last_peered":"2024-09-10T08:28:49.355024+0000","last_clean":"2024-09-10T08:28:49.355024+0000","last_became_active":"2024-09-10T08:28:35.570749+0000","last_became_peered":"2024-09-10T08:28:35.570749+0000","last_unstale":"2024-09-10T08:28:49.355024+0000","last_undegraded":"2024-09-10T08:28:49.355024+0000","last_fullsized":"2024-09-10T08:28:49.355024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:04.628661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2853,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":692114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":101836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":101304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":104320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":102868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":864256,"data_stored":692080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":103745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":262144,"data_stored":101144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:29:11.903 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-09-10T08:29:11.904 DEBUG:tasks.mon_thrash:Yielding 2024-09-10T08:29:11.904 INFO:teuthology.run_tasks:Running task workunit... 2024-09-10T08:29:11.916 INFO:tasks.workunit:Pulling workunits from ref 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T08:29:11.916 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-10T08:29:11.916 INFO:tasks.workunit:timeout=3h 2024-09-10T08:29:11.917 INFO:tasks.workunit:cleanup=True 2024-09-10T08:29:11.917 DEBUG:teuthology.orchestra.run.smithi103:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-10T08:29:11.917 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:29:11.958 INFO:teuthology.orchestra.run.smithi103.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-10T08:29:11.958 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-10T08:29:11.958 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-09-10T08:29:11.958 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:29:11.958 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-10T08:29:11.958 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-10T08:29:11.958 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-10 08:28:35.565934831 +0000 2024-09-10T08:29:11.958 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-10 08:29:09.379413760 +0000 2024-09-10T08:29:11.958 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2024-09-10T08:29:11.958 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-10T08:29:11.959 DEBUG:teuthology.orchestra.run.smithi103:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-10T08:29:12.028 DEBUG:teuthology.orchestra.run.smithi154:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-10T08:29:12.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.041+0000 7fab5ab49640 1 Processor -- start 2024-09-10T08:29:12.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.041+0000 7fab5ab49640 1 -- start start 2024-09-10T08:29:12.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.041+0000 7fab5ab49640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fab54150480 0x7fab540c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.041+0000 7fab5ab49640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab540ca390 0x7fab540c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.041+0000 7fab5ab49640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab5415a7c0 con 0x7fab5406c650 2024-09-10T08:29:12.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.041+0000 7fab5ab49640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fab5406c240 con 0x7fab54150480 2024-09-10T08:29:12.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.041+0000 7fab5ab49640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fab5415a330 con 0x7fab540ca390 2024-09-10T08:29:12.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.042+0000 7fab53fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fab5406c650 0x7fab540c9c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40118/0 (socket says 172.21.15.103:40118) 2024-09-10T08:29:12.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.042+0000 7fab53fff640 1 -- 172.21.15.103:0/2352395698 learned_addr learned my addr 172.21.15.103:0/2352395698 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:29:12.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.042+0000 7fab588e5640 1 --2- 172.21.15.103:0/2352395698 >> v2:172.21.15.154:3300/0 conn(0x7fab54150480 0x7fab540c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.042+0000 7fab590e6640 1 --2- 172.21.15.103:0/2352395698 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab540ca390 0x7fab540c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.042+0000 7fab537fe640 1 -- 172.21.15.103:0/2352395698 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1767928994 0 0) 0x7fab5415a7c0 con 0x7fab5406c650 2024-09-10T08:29:12.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.042+0000 7fab537fe640 1 -- 172.21.15.103:0/2352395698 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab44003520 con 0x7fab5406c650 2024-09-10T08:29:12.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.042+0000 7fab590e6640 1 -- 172.21.15.103:0/2352395698 >> v2:172.21.15.154:3300/0 conn(0x7fab54150480 msgr2=0x7fab540c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:12.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.042+0000 7fab590e6640 1 --2- 172.21.15.103:0/2352395698 >> v2:172.21.15.154:3300/0 conn(0x7fab54150480 0x7fab540c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.042+0000 7fab590e6640 1 -- 172.21.15.103:0/2352395698 >> v1:172.21.15.103:6789/0 conn(0x7fab5406c650 legacy=0x7fab540c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.042+0000 7fab537fe640 1 -- 172.21.15.103:0/2352395698 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1643943908 0 0) 0x7fab44003520 con 0x7fab5406c650 2024-09-10T08:29:12.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.042+0000 7fab590e6640 1 -- 172.21.15.103:0/2352395698 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab54159a00 con 0x7fab540ca390 2024-09-10T08:29:12.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.042+0000 7fab588e5640 1 --2- 172.21.15.103:0/2352395698 >> v2:172.21.15.154:3300/0 conn(0x7fab54150480 0x7fab540c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:29:12.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.043+0000 7fab590e6640 1 --2- 172.21.15.103:0/2352395698 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab540ca390 0x7fab540c7fd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009d90 tx=0x7fab4c02a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c06b77379d153268 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:12.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.043+0000 7fab537fe640 1 -- 172.21.15.103:0/2352395698 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab40001670 con 0x7fab540ca390 2024-09-10T08:29:12.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.043+0000 7fab537fe640 1 -- 172.21.15.103:0/2352395698 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab4c007540 con 0x7fab540ca390 2024-09-10T08:29:12.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.043+0000 7fab537fe640 1 -- 172.21.15.103:0/2352395698 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c0078f0 con 0x7fab540ca390 2024-09-10T08:29:12.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.043+0000 7fab5ab49640 1 -- 172.21.15.103:0/2352395698 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab540ca390 msgr2=0x7fab540c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.043+0000 7fab5ab49640 1 --2- 172.21.15.103:0/2352395698 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab540ca390 0x7fab540c7fd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009d90 tx=0x7fab4c02a5f0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.043+0000 7fab5ab49640 1 -- 172.21.15.103:0/2352395698 shutdown_connections 2024-09-10T08:29:12.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.043+0000 7fab5ab49640 1 --2- 172.21.15.103:0/2352395698 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab540ca390 0x7fab540c7fd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.043+0000 7fab5ab49640 1 --2- 172.21.15.103:0/2352395698 >> v2:172.21.15.154:3300/0 conn(0x7fab54150480 0x7fab540c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.043+0000 7fab5ab49640 1 -- 172.21.15.103:0/2352395698 >> 172.21.15.103:0/2352395698 conn(0x7fab54068030 msgr2=0x7fab54073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:12.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.044+0000 7fab5ab49640 1 -- 172.21.15.103:0/2352395698 shutdown_connections 2024-09-10T08:29:12.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.044+0000 7fab5ab49640 1 -- 172.21.15.103:0/2352395698 wait complete. 2024-09-10T08:29:12.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.045+0000 7fab5ab49640 1 Processor -- start 2024-09-10T08:29:12.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.045+0000 7fab5ab49640 1 -- start start 2024-09-10T08:29:12.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.045+0000 7fab5ab49640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab5406c650 0x7fab5414a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.045+0000 7fab5ab49640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab540ca390 0x7fab540cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.045+0000 7fab5ab49640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab54150480 0x7fab5414aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.045+0000 7fab5ab49640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fab5406d270 con 0x7fab54150480 2024-09-10T08:29:12.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.045+0000 7fab5ab49640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fab54159fc0 con 0x7fab5406c650 2024-09-10T08:29:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.045+0000 7fab5ab49640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fab54156270 con 0x7fab540ca390 2024-09-10T08:29:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.046+0000 7fab590e6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab54150480 0x7fab5414aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.046+0000 7fab590e6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab54150480 0x7fab5414aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60900/0 (socket says 172.21.15.103:60900) 2024-09-10T08:29:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.046+0000 7fab590e6640 1 -- 172.21.15.103:0/2256326959 learned_addr learned my addr 172.21.15.103:0/2256326959 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.046+0000 7fab53fff640 1 --2- 172.21.15.103:0/2256326959 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab540ca390 0x7fab540cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.046+0000 7fab588e5640 1 --2- 172.21.15.103:0/2256326959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab5406c650 0x7fab5414a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.046+0000 7fab590e6640 1 -- 172.21.15.103:0/2256326959 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab540ca390 msgr2=0x7fab540cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.046+0000 7fab590e6640 1 --2- 172.21.15.103:0/2256326959 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab540ca390 0x7fab540cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.046+0000 7fab590e6640 1 -- 172.21.15.103:0/2256326959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab5406c650 msgr2=0x7fab5414a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.046+0000 7fab590e6640 1 --2- 172.21.15.103:0/2256326959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab5406c650 0x7fab5414a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.046+0000 7fab590e6640 1 -- 172.21.15.103:0/2256326959 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab541efdd0 con 0x7fab54150480 2024-09-10T08:29:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.046+0000 7fab590e6640 1 --2- 172.21.15.103:0/2256326959 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab54150480 0x7fab5414aa80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009eb0 tx=0x7fab4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:12.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.046+0000 7fab517fa640 1 -- 172.21.15.103:0/2256326959 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c03f070 con 0x7fab54150480 2024-09-10T08:29:12.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.046+0000 7fab517fa640 1 -- 172.21.15.103:0/2256326959 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab4c031c40 con 0x7fab54150480 2024-09-10T08:29:12.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.046+0000 7fab5ab49640 1 -- 172.21.15.103:0/2256326959 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab541f0070 con 0x7fab54150480 2024-09-10T08:29:12.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.046+0000 7fab517fa640 1 -- 172.21.15.103:0/2256326959 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c009450 con 0x7fab54150480 2024-09-10T08:29:12.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.046+0000 7fab5ab49640 1 -- 172.21.15.103:0/2256326959 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab540cbe10 con 0x7fab54150480 2024-09-10T08:29:12.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.047+0000 7fab5ab49640 1 -- 172.21.15.103:0/2256326959 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab540c9c80 con 0x7fab54150480 2024-09-10T08:29:12.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.048+0000 7fab517fa640 1 -- 172.21.15.103:0/2256326959 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fab4c043410 con 0x7fab54150480 2024-09-10T08:29:12.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.048+0000 7fab517fa640 1 --2- 172.21.15.103:0/2256326959 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fab3806be30 0x7fab3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.048+0000 7fab517fa640 1 -- 172.21.15.103:0/2256326959 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fab4c0ac2e0 con 0x7fab54150480 2024-09-10T08:29:12.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.048+0000 7fab588e5640 1 --2- 172.21.15.103:0/2256326959 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fab3806be30 0x7fab3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.049+0000 7fab588e5640 1 --2- 172.21.15.103:0/2256326959 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fab3806be30 0x7fab3806e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fab48009560 tx=0x7fab48009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:12.051 INFO:teuthology.orchestra.run.smithi154.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-10T08:29:12.051 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-10T08:29:12.051 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 2ah/42d Inode: 1 Links: 2 2024-09-10T08:29:12.051 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:29:12.051 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-10T08:29:12.051 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-10T08:29:12.051 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-10 08:28:47.618769187 +0000 2024-09-10T08:29:12.051 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-10 08:29:09.462612325 +0000 2024-09-10T08:29:12.052 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-09-10T08:29:12.052 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-10T08:29:12.052 DEBUG:teuthology.orchestra.run.smithi154:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-10T08:29:12.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.053+0000 7fab517fa640 1 -- 172.21.15.103:0/2256326959 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fab4c07a3a0 con 0x7fab54150480 2024-09-10T08:29:12.128 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T08:29:12.128 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T08:29:12.144 INFO:tasks.workunit.client.0.smithi103.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-10T08:29:12.186 INFO:tasks.workunit.client.1.smithi154.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-10T08:29:12.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.259+0000 7fab5ab49640 1 -- 172.21.15.103:0/2256326959 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab54073520 con 0x7fab54150480 2024-09-10T08:29:12.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.260+0000 7fab517fa640 1 -- 172.21.15.103:0/2256326959 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6536 (secure 0 0 0) 0x7fab4c07e6a0 con 0x7fab54150480 2024-09-10T08:29:12.260 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:29:12.260 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":11,"btime":"2024-09-10T08:28:50:632324+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3378269214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3378269214},{"type":"v1","addr":"172.21.15.154:6833","nonce":3378269214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2141115327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2141115327},{"type":"v1","addr":"172.21.15.154:6835","nonce":2141115327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:34.885455+0000","modified":"2024-09-10T08:28:37.905202+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/3032037784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":3032037784},{"type":"v1","addr":"172.21.15.103:6837","nonce":3032037784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:46.949092+0000","modified":"2024-09-10T08:28:49.966725+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.103:6836/2250136134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2250136134},{"type":"v1","addr":"172.21.15.103:6836","nonce":2250136134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":2}]} 2024-09-10T08:29:12.260 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 11 2024-09-10T08:29:12.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.262+0000 7fab5ab49640 1 -- 172.21.15.103:0/2256326959 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fab3806be30 msgr2=0x7fab3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.262+0000 7fab5ab49640 1 --2- 172.21.15.103:0/2256326959 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fab3806be30 0x7fab3806e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fab48009560 tx=0x7fab48009190 comp rx=0 tx=0).stop 2024-09-10T08:29:12.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.262+0000 7fab5ab49640 1 -- 172.21.15.103:0/2256326959 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab54150480 msgr2=0x7fab5414aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.262+0000 7fab5ab49640 1 --2- 172.21.15.103:0/2256326959 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab54150480 0x7fab5414aa80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009eb0 tx=0x7fab4c004a40 comp rx=0 tx=0).stop 2024-09-10T08:29:12.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.262+0000 7fab5ab49640 1 -- 172.21.15.103:0/2256326959 shutdown_connections 2024-09-10T08:29:12.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.262+0000 7fab5ab49640 1 --2- 172.21.15.103:0/2256326959 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fab3806be30 0x7fab3806e2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.262+0000 7fab5ab49640 1 --2- 172.21.15.103:0/2256326959 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab54150480 0x7fab5414aa80 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.262+0000 7fab5ab49640 1 --2- 172.21.15.103:0/2256326959 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab540ca390 0x7fab540cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.262+0000 7fab5ab49640 1 --2- 172.21.15.103:0/2256326959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab5406c650 0x7fab5414a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.262+0000 7fab5ab49640 1 -- 172.21.15.103:0/2256326959 >> 172.21.15.103:0/2256326959 conn(0x7fab54068030 msgr2=0x7fab540c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:12.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.262+0000 7fab5ab49640 1 -- 172.21.15.103:0/2256326959 shutdown_connections 2024-09-10T08:29:12.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.262+0000 7fab5ab49640 1 -- 172.21.15.103:0/2256326959 wait complete. 2024-09-10T08:29:12.273 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-09-10T08:29:12.273 INFO:tasks.mon_thrash.mon_thrasher:seed: 1725956951, revive delay: 20.0, thrash delay: 10.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2024-09-10T08:29:12.274 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:29:12.274 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:29:12.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.412+0000 7f4334ad9640 1 Processor -- start 2024-09-10T08:29:12.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.412+0000 7f4334ad9640 1 -- start start 2024-09-10T08:29:12.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.413+0000 7f4334ad9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f43300af180 0x7f43300c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.413+0000 7f4334ad9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4330073660 0x7f43300c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.413+0000 7f4334ad9640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4330154370 con 0x7f43300c6340 2024-09-10T08:29:12.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.413+0000 7f4334ad9640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f4330154650 con 0x7f43300af180 2024-09-10T08:29:12.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.413+0000 7f4334ad9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4330154930 con 0x7f4330073660 2024-09-10T08:29:12.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.413+0000 7f432e59c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f43300af180 0x7f43300c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.413+0000 7f432ed9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f43300c6340 0x7f43300c5060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40122/0 (socket says 172.21.15.103:40122) 2024-09-10T08:29:12.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.413+0000 7f432ed9d640 1 -- 172.21.15.103:0/4101005958 learned_addr learned my addr 172.21.15.103:0/4101005958 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:29:12.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.413+0000 7f432e59c640 1 -- 172.21.15.103:0/4101005958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4330073660 msgr2=0x7f43300c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:12.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.413+0000 7f432e59c640 1 --2- 172.21.15.103:0/4101005958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4330073660 0x7f43300c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.413+0000 7f432e59c640 1 -- 172.21.15.103:0/4101005958 >> v1:172.21.15.103:6789/0 conn(0x7f43300c6340 legacy=0x7f43300c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.413+0000 7f432d59a640 1 -- 172.21.15.103:0/4101005958 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1893714942 0 0) 0x7f4330154370 con 0x7f43300c6340 2024-09-10T08:29:12.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.413+0000 7f432e59c640 1 -- 172.21.15.103:0/4101005958 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4330154c10 con 0x7f43300af180 2024-09-10T08:29:12.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.414+0000 7f432e59c640 1 --2- 172.21.15.103:0/4101005958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43300af180 0x7f43300c5e00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f43200097a0 tx=0x7f432002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf40f886280085e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:12.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.414+0000 7f432d59a640 1 -- 172.21.15.103:0/4101005958 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4320037070 con 0x7f43300af180 2024-09-10T08:29:12.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.414+0000 7f432d59a640 1 -- 172.21.15.103:0/4101005958 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4320032440 con 0x7f43300af180 2024-09-10T08:29:12.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.414+0000 7f432d59a640 1 -- 172.21.15.103:0/4101005958 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432002ae60 con 0x7f43300af180 2024-09-10T08:29:12.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.415+0000 7f4334ad9640 1 -- 172.21.15.103:0/4101005958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43300af180 msgr2=0x7f43300c5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.415+0000 7f4334ad9640 1 --2- 172.21.15.103:0/4101005958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43300af180 0x7f43300c5e00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f43200097a0 tx=0x7f432002a110 comp rx=0 tx=0).stop 2024-09-10T08:29:12.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.415+0000 7f4334ad9640 1 -- 172.21.15.103:0/4101005958 shutdown_connections 2024-09-10T08:29:12.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.415+0000 7f4334ad9640 1 --2- 172.21.15.103:0/4101005958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4330073660 0x7f43300c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.415+0000 7f4334ad9640 1 --2- 172.21.15.103:0/4101005958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43300af180 0x7f43300c5e00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.415+0000 7f4334ad9640 1 -- 172.21.15.103:0/4101005958 >> 172.21.15.103:0/4101005958 conn(0x7f43300c9d80 msgr2=0x7f43300ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:12.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.415+0000 7f4334ad9640 1 -- 172.21.15.103:0/4101005958 shutdown_connections 2024-09-10T08:29:12.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.415+0000 7f4334ad9640 1 -- 172.21.15.103:0/4101005958 wait complete. 2024-09-10T08:29:12.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.416+0000 7f4334ad9640 1 Processor -- start 2024-09-10T08:29:12.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.416+0000 7f4334ad9640 1 -- start start 2024-09-10T08:29:12.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.417+0000 7f4334ad9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4330073660 0x7f43300ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.417+0000 7f4334ad9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43300af180 0x7f43301ddd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.417+0000 7f4334ad9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43300c6340 0x7f43301ed510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.417+0000 7f4334ad9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f43300af6e0 con 0x7f4330073660 2024-09-10T08:29:12.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.417+0000 7f4334ad9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f43300af560 con 0x7f43300af180 2024-09-10T08:29:12.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.417+0000 7f4334ad9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4330153f60 con 0x7f43300c6340 2024-09-10T08:29:12.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.417+0000 7f432e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4330073660 0x7f43300ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.417+0000 7f432e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4330073660 0x7f43300ae2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60914/0 (socket says 172.21.15.103:60914) 2024-09-10T08:29:12.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.417+0000 7f432e59c640 1 -- 172.21.15.103:0/2520068469 learned_addr learned my addr 172.21.15.103:0/2520068469 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:12.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.417+0000 7f432ed9d640 1 --2- 172.21.15.103:0/2520068469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43300c6340 0x7f43301ed510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.417+0000 7f432dd9b640 1 --2- 172.21.15.103:0/2520068469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43300af180 0x7f43301ddd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.417+0000 7f432e59c640 1 -- 172.21.15.103:0/2520068469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43300c6340 msgr2=0x7f43301ed510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.417+0000 7f432e59c640 1 --2- 172.21.15.103:0/2520068469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43300c6340 0x7f43301ed510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.417+0000 7f432e59c640 1 -- 172.21.15.103:0/2520068469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43300af180 msgr2=0x7f43301ddd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.417+0000 7f432e59c640 1 --2- 172.21.15.103:0/2520068469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43300af180 0x7f43301ddd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.417+0000 7f432e59c640 1 -- 172.21.15.103:0/2520068469 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43300c95d0 con 0x7f4330073660 2024-09-10T08:29:12.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.417+0000 7f432e59c640 1 --2- 172.21.15.103:0/2520068469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4330073660 0x7f43300ae2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f43200097a0 tx=0x7f43200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:12.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.418+0000 7f431effd640 1 -- 172.21.15.103:0/2520068469 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4320041070 con 0x7f4330073660 2024-09-10T08:29:12.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.418+0000 7f431effd640 1 -- 172.21.15.103:0/2520068469 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f432003c870 con 0x7f4330073660 2024-09-10T08:29:12.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.418+0000 7f431effd640 1 -- 172.21.15.103:0/2520068469 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4320037040 con 0x7f4330073660 2024-09-10T08:29:12.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.418+0000 7f4334ad9640 1 -- 172.21.15.103:0/2520068469 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43300c98b0 con 0x7f4330073660 2024-09-10T08:29:12.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.418+0000 7f4334ad9640 1 -- 172.21.15.103:0/2520068469 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4330149db0 con 0x7f4330073660 2024-09-10T08:29:12.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.419+0000 7f4334ad9640 1 -- 172.21.15.103:0/2520068469 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4330153750 con 0x7f4330073660 2024-09-10T08:29:12.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.419+0000 7f431effd640 1 -- 172.21.15.103:0/2520068469 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4320044070 con 0x7f4330073660 2024-09-10T08:29:12.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.419+0000 7f431effd640 1 --2- 172.21.15.103:0/2520068469 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f431006be60 0x7f431006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.419+0000 7f431effd640 1 -- 172.21.15.103:0/2520068469 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f43200abdc0 con 0x7f4330073660 2024-09-10T08:29:12.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.420+0000 7f432dd9b640 1 --2- 172.21.15.103:0/2520068469 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f431006be60 0x7f431006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.420+0000 7f432dd9b640 1 --2- 172.21.15.103:0/2520068469 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f431006be60 0x7f431006e320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4330153ce0 tx=0x7f4324008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:12.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.424+0000 7f431effd640 1 -- 172.21.15.103:0/2520068469 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4330153750 con 0x7f4330073660 2024-09-10T08:29:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.653+0000 7f4334ad9640 1 -- 172.21.15.103:0/2520068469 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f43300afaa0 con 0x7f4330073660 2024-09-10T08:29:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.654+0000 7f431effd640 1 -- 172.21.15.103:0/2520068469 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f432007a5f0 con 0x7f4330073660 2024-09-10T08:29:12.653 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":60,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:29:12.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.656+0000 7f4334ad9640 1 -- 172.21.15.103:0/2520068469 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f431006be60 msgr2=0x7f431006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.656+0000 7f4334ad9640 1 --2- 172.21.15.103:0/2520068469 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f431006be60 0x7f431006e320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4330153ce0 tx=0x7f4324008040 comp rx=0 tx=0).stop 2024-09-10T08:29:12.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.656+0000 7f4334ad9640 1 -- 172.21.15.103:0/2520068469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4330073660 msgr2=0x7f43300ae2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.656+0000 7f4334ad9640 1 --2- 172.21.15.103:0/2520068469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4330073660 0x7f43300ae2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f43200097a0 tx=0x7f43200046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.656+0000 7f4334ad9640 1 -- 172.21.15.103:0/2520068469 shutdown_connections 2024-09-10T08:29:12.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.656+0000 7f4334ad9640 1 --2- 172.21.15.103:0/2520068469 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f431006be60 0x7f431006e320 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.656+0000 7f4334ad9640 1 --2- 172.21.15.103:0/2520068469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43300c6340 0x7f43301ed510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.656+0000 7f4334ad9640 1 --2- 172.21.15.103:0/2520068469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43300af180 0x7f43301ddd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.656+0000 7f4334ad9640 1 --2- 172.21.15.103:0/2520068469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4330073660 0x7f43300ae2f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.656+0000 7f4334ad9640 1 -- 172.21.15.103:0/2520068469 >> 172.21.15.103:0/2520068469 conn(0x7f43300c9d80 msgr2=0x7f43300ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:12.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.656+0000 7f4334ad9640 1 -- 172.21.15.103:0/2520068469 shutdown_connections 2024-09-10T08:29:12.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.656+0000 7f4334ad9640 1 -- 172.21.15.103:0/2520068469 wait complete. 2024-09-10T08:29:12.667 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:29:12.667 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-10T08:29:12.667 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:29:12.667 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:29:12.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.767+0000 7f62849c6640 1 Processor -- start 2024-09-10T08:29:12.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.767+0000 7f62849c6640 1 -- start start 2024-09-10T08:29:12.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.768+0000 7f62849c6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6280150480 0x7f62800c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.768+0000 7f62849c6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f62800ca390 0x7f62800c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.768+0000 7f62849c6640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f628015a7c0 con 0x7f628006c650 2024-09-10T08:29:12.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.768+0000 7f62849c6640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f628006c240 con 0x7f62800ca390 2024-09-10T08:29:12.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.768+0000 7f62849c6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f628015a330 con 0x7f6280150480 2024-09-10T08:29:12.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.768+0000 7f6275d9b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f628006c650 0x7f62800c9c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40132/0 (socket says 172.21.15.103:40132) 2024-09-10T08:29:12.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.768+0000 7f627ed9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f62800ca390 0x7f62800c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.768+0000 7f6275d9b640 1 -- 172.21.15.103:0/1209952049 learned_addr learned my addr 172.21.15.103:0/1209952049 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:29:12.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.768+0000 7f627e59c640 1 --2- 172.21.15.103:0/1209952049 >> v2:172.21.15.154:3300/0 conn(0x7f6280150480 0x7f62800c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.768+0000 7f627ed9d640 1 -- 172.21.15.103:0/1209952049 >> v2:172.21.15.154:3300/0 conn(0x7f6280150480 msgr2=0x7f62800c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:12.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.768+0000 7f627ed9d640 1 --2- 172.21.15.103:0/1209952049 >> v2:172.21.15.154:3300/0 conn(0x7f6280150480 0x7f62800c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.768+0000 7f627ed9d640 1 -- 172.21.15.103:0/1209952049 >> v1:172.21.15.103:6789/0 conn(0x7f628006c650 legacy=0x7f62800c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.768+0000 7f627ed9d640 1 -- 172.21.15.103:0/1209952049 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6280159a00 con 0x7f62800ca390 2024-09-10T08:29:12.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.769+0000 7f627ed9d640 1 --2- 172.21.15.103:0/1209952049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62800ca390 0x7f62800c7fd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f62800ccac0 tx=0x7f627802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf1537fdb80161f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:12.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.769+0000 7f627dd9b640 1 -- 172.21.15.103:0/1209952049 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278007740 con 0x7f62800ca390 2024-09-10T08:29:12.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.769+0000 7f627dd9b640 1 -- 172.21.15.103:0/1209952049 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62780078e0 con 0x7f62800ca390 2024-09-10T08:29:12.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.769+0000 7f627dd9b640 1 -- 172.21.15.103:0/1209952049 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278007cb0 con 0x7f62800ca390 2024-09-10T08:29:12.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.770+0000 7f62849c6640 1 -- 172.21.15.103:0/1209952049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62800ca390 msgr2=0x7f62800c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.770+0000 7f62849c6640 1 --2- 172.21.15.103:0/1209952049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62800ca390 0x7f62800c7fd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f62800ccac0 tx=0x7f627802a680 comp rx=0 tx=0).stop 2024-09-10T08:29:12.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.770+0000 7f62849c6640 1 -- 172.21.15.103:0/1209952049 shutdown_connections 2024-09-10T08:29:12.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.770+0000 7f62849c6640 1 --2- 172.21.15.103:0/1209952049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62800ca390 0x7f62800c7fd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.770+0000 7f62849c6640 1 --2- 172.21.15.103:0/1209952049 >> v2:172.21.15.154:3300/0 conn(0x7f6280150480 0x7f62800c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.770+0000 7f62849c6640 1 -- 172.21.15.103:0/1209952049 >> 172.21.15.103:0/1209952049 conn(0x7f6280068030 msgr2=0x7f6280073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:12.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.770+0000 7f62849c6640 1 -- 172.21.15.103:0/1209952049 shutdown_connections 2024-09-10T08:29:12.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.770+0000 7f62849c6640 1 -- 172.21.15.103:0/1209952049 wait complete. 2024-09-10T08:29:12.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.771+0000 7f62849c6640 1 Processor -- start 2024-09-10T08:29:12.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.771+0000 7f62849c6640 1 -- start start 2024-09-10T08:29:12.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f62849c6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f628006c650 0x7f6280152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f62849c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62800ca390 0x7f62801e2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f62849c6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6280150480 0x7f62801ec6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f62849c6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f628006d270 con 0x7f628006c650 2024-09-10T08:29:12.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f62849c6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6280159fc0 con 0x7f62800ca390 2024-09-10T08:29:12.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f62849c6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6280156270 con 0x7f6280150480 2024-09-10T08:29:12.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f627e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f628006c650 0x7f6280152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f627e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f628006c650 0x7f6280152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60938/0 (socket says 172.21.15.103:60938) 2024-09-10T08:29:12.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f627e59c640 1 -- 172.21.15.103:0/3298424022 learned_addr learned my addr 172.21.15.103:0/3298424022 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:12.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f627ed9d640 1 --2- 172.21.15.103:0/3298424022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6280150480 0x7f62801ec6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f6275d9b640 1 --2- 172.21.15.103:0/3298424022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62800ca390 0x7f62801e2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f627e59c640 1 -- 172.21.15.103:0/3298424022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6280150480 msgr2=0x7f62801ec6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f627e59c640 1 --2- 172.21.15.103:0/3298424022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6280150480 0x7f62801ec6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f627e59c640 1 -- 172.21.15.103:0/3298424022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62800ca390 msgr2=0x7f62801e2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f627e59c640 1 --2- 172.21.15.103:0/3298424022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62800ca390 0x7f62801e2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f627e59c640 1 -- 172.21.15.103:0/3298424022 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62801eff20 con 0x7f628006c650 2024-09-10T08:29:12.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f627ed9d640 1 --2- 172.21.15.103:0/3298424022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6280150480 0x7f62801ec6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:12.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f6275d9b640 1 --2- 172.21.15.103:0/3298424022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62800ca390 0x7f62801e2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:12.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f627e59c640 1 --2- 172.21.15.103:0/3298424022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f628006c650 0x7f6280152bb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f627000d830 tx=0x7f627000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:12.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f62777fe640 1 -- 172.21.15.103:0/3298424022 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627000b6c0 con 0x7f628006c650 2024-09-10T08:29:12.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f62777fe640 1 -- 172.21.15.103:0/3298424022 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6270019070 con 0x7f628006c650 2024-09-10T08:29:12.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f62849c6640 1 -- 172.21.15.103:0/3298424022 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62801ebf00 con 0x7f628006c650 2024-09-10T08:29:12.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.772+0000 7f62777fe640 1 -- 172.21.15.103:0/3298424022 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627000ba80 con 0x7f628006c650 2024-09-10T08:29:12.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.773+0000 7f62849c6640 1 -- 172.21.15.103:0/3298424022 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6280155110 con 0x7f628006c650 2024-09-10T08:29:12.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.773+0000 7f62849c6640 1 --2- 172.21.15.103:0/3298424022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62801ecc20 0x7f62800afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.773+0000 7f62849c6640 1 -- 172.21.15.103:0/3298424022 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6280156b80 con 0x7f62801ecc20 2024-09-10T08:29:12.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.773+0000 7f6275d9b640 1 --2- 172.21.15.103:0/3298424022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62801ecc20 0x7f62800afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.774+0000 7f6275d9b640 1 -- 172.21.15.103:0/3298424022 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f62800c9c80 con 0x7f62801ecc20 2024-09-10T08:29:12.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.774+0000 7f6275d9b640 1 --2- 172.21.15.103:0/3298424022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62801ecc20 0x7f62800afb30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f62801e1f90 tx=0x7f626800d880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:12.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.774+0000 7f62777fe640 1 -- 172.21.15.103:0/3298424022 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6268005ce0 con 0x7f62801ecc20 2024-09-10T08:29:12.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.774+0000 7f62777fe640 1 -- 172.21.15.103:0/3298424022 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f627001e460 con 0x7f628006c650 2024-09-10T08:29:12.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.774+0000 7f62777fe640 1 --2- 172.21.15.103:0/3298424022 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f626006bd30 0x7f626006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.775+0000 7f62777fe640 1 -- 172.21.15.103:0/3298424022 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f627008b7e0 con 0x7f628006c650 2024-09-10T08:29:12.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.775+0000 7f627ed9d640 1 --2- 172.21.15.103:0/3298424022 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f626006bd30 0x7f626006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.775+0000 7f62777fe640 1 -- 172.21.15.103:0/3298424022 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6268005020 con 0x7f62801ecc20 2024-09-10T08:29:12.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.775+0000 7f62777fe640 1 -- 172.21.15.103:0/3298424022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62801ecc20 msgr2=0x7f62800afb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.775+0000 7f62777fe640 1 --2- 172.21.15.103:0/3298424022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62801ecc20 0x7f62800afb30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f62801e1f90 tx=0x7f626800d880 comp rx=0 tx=0).stop 2024-09-10T08:29:12.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.775+0000 7f62777fe640 1 -- 172.21.15.103:0/3298424022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62801ecc20 msgr2=0x7f62800afb30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:29:12.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.775+0000 7f62777fe640 1 --2- 172.21.15.103:0/3298424022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62801ecc20 0x7f62800afb30 secure :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f62801e1f90 tx=0x7f626800d880 comp rx=0 tx=0).stop 2024-09-10T08:29:12.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.775+0000 7f627ed9d640 1 --2- 172.21.15.103:0/3298424022 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f626006bd30 0x7f626006e1f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6278034000 tx=0x7f6278033040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:12.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.781+0000 7f62849c6640 1 --2- 172.21.15.103:0/3298424022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62800b0070 0x7f62800b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.781+0000 7f62849c6640 1 -- 172.21.15.103:0/3298424022 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f62800b09c0 con 0x7f62800b0070 2024-09-10T08:29:12.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.781+0000 7f6275d9b640 1 --2- 172.21.15.103:0/3298424022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62800b0070 0x7f62800b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.781+0000 7f6275d9b640 1 -- 172.21.15.103:0/3298424022 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f628006c430 con 0x7f62800b0070 2024-09-10T08:29:12.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.781+0000 7f6275d9b640 1 --2- 172.21.15.103:0/3298424022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62800b0070 0x7f62800b0480 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f62801e1f90 tx=0x7f6268000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:12.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.781+0000 7f62777fe640 1 -- 172.21.15.103:0/3298424022 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6268004cc0 con 0x7f62800b0070 2024-09-10T08:29:12.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.782+0000 7f62777fe640 1 -- 172.21.15.103:0/3298424022 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f6268004cc0 con 0x7f62800b0070 2024-09-10T08:29:12.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.782+0000 7f62777fe640 1 -- 172.21.15.103:0/3298424022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62800b0070 msgr2=0x7f62800b0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.782+0000 7f62777fe640 1 --2- 172.21.15.103:0/3298424022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62800b0070 0x7f62800b0480 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f62801e1f90 tx=0x7f6268000ed0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.782+0000 7f62777fe640 1 -- 172.21.15.103:0/3298424022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62800b0070 msgr2=0x7f62800b0480 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:29:12.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.782+0000 7f62777fe640 1 --2- 172.21.15.103:0/3298424022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62800b0070 0x7f62800b0480 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.782 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:29:12.782 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:29:12.782 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:29:12.782 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:29:12.782 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 4, 2024-09-10T08:29:12.782 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 60343, 2024-09-10T08:29:12.783 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:29:12.783 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:29:12.783 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:29:12.783 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:29:12.783 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:12.783 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 60, 2024-09-10T08:29:12.783 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:29:12.783 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:29:12.783 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:29:12.783 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:29:12.783 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:29:12.783 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:29:12.783 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:29:12.784 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:29:12.784 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:29:12.784 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:29:12.784 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:29:12.784 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:29:12.784 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:29:12.784 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:29:12.784 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:12.784 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:29:12.784 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:29:12.784 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:29:12.784 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:29:12.785 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:29:12.785 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:29:12.785 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:29:12.785 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:29:12.785 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:29:12.785 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:29:12.785 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:29:12.785 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:29:12.785 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:29:12.785 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:12.785 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.785 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:29:12.785 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:29:12.785 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:29:12.786 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:29:12.786 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:29:12.786 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:29:12.786 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:29:12.786 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:29:12.786 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:29:12.786 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:29:12.786 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:29:12.786 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:29:12.786 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:29:12.786 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:29:12.786 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:29:12.786 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:29:12.787 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:29:12.787 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:29:12.787 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:29:12.787 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:29:12.787 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:29:12.787 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:29:12.787 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:29:12.787 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:29:12.787 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:29:12.787 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:29:12.787 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:29:12.787 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:29:12.787 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:12.787 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:29:12.788 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.788 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:29:12.788 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.788 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:29:12.788 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:29:12.788 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:29:12.788 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:29:12.788 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.788 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:29:12.788 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:29:12.788 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:12.788 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.789 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.789 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:29:12.789 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:29:12.789 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:12.789 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:12.789 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:12.789 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.789 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:29:12.789 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:29:12.789 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:29:12.789 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:29:12.789 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:29:12.789 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.789 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.790 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:29:12.790 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:29:12.790 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:29:12.790 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:29:12.790 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.790 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:29:12.790 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:29:12.790 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:12.790 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.790 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.790 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:29:12.790 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:29:12.790 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:12.790 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:12.791 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:12.791 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.791 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:29:12.791 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:29:12.791 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:29:12.791 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:29:12.791 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:29:12.791 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.791 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.791 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:29:12.791 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:29:12.791 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:29:12.791 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:29:12.791 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.792 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:29:12.792 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:29:12.792 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:12.792 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.792 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.792 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:29:12.792 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:29:12.792 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:12.792 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:12.792 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:12.792 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.792 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:29:12.793 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:29:12.793 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:29:12.793 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:29:12.793 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:29:12.793 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:12.793 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:12.793 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.793 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:29:12.793 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:29:12.793 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.793 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:12.793 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:12.793 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:29:12.793 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:12.794 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:12.794 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:29:12.794 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.794 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:12.794 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:12.794 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:29:12.794 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:12.794 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:12.794 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:29:12.794 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.794 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:12.794 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:12.794 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:29:12.794 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:12.795 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:12.795 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:29:12.795 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.795 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:12.795 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:12.795 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-10T08:29:12.795 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:12.795 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:12.795 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:29:12.795 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.795 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:12.795 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:12.795 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:29:12.796 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:12.796 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:12.796 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.796 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:29:12.796 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:29:12.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.782+0000 7f62849c6640 1 -- 172.21.15.103:0/3298424022 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f626006bd30 msgr2=0x7f626006e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.782+0000 7f62849c6640 1 --2- 172.21.15.103:0/3298424022 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f626006bd30 0x7f626006e1f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6278034000 tx=0x7f6278033040 comp rx=0 tx=0).stop 2024-09-10T08:29:12.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.782+0000 7f62849c6640 1 -- 172.21.15.103:0/3298424022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f628006c650 msgr2=0x7f6280152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.782+0000 7f62849c6640 1 --2- 172.21.15.103:0/3298424022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f628006c650 0x7f6280152bb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f627000d830 tx=0x7f627000dcf0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.782+0000 7f627ed9d640 1 -- 172.21.15.103:0/3298424022 reap_dead start 2024-09-10T08:29:12.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.782+0000 7f627ed9d640 1 -- 172.21.15.103:0/3298424022 reap_dead start 2024-09-10T08:29:12.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.782+0000 7f62849c6640 1 -- 172.21.15.103:0/3298424022 shutdown_connections 2024-09-10T08:29:12.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.782+0000 7f62849c6640 1 -- 172.21.15.103:0/3298424022 >> 172.21.15.103:0/3298424022 conn(0x7f6280068030 msgr2=0x7f62801e2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:12.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.782+0000 7f62849c6640 1 -- 172.21.15.103:0/3298424022 shutdown_connections 2024-09-10T08:29:12.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.782+0000 7f62849c6640 1 -- 172.21.15.103:0/3298424022 wait complete. 2024-09-10T08:29:12.798 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:29:12.798 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:29:12.798 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:29:12.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.898+0000 7f1836277640 1 Processor -- start 2024-09-10T08:29:12.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.898+0000 7f1836277640 1 -- start start 2024-09-10T08:29:12.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.899+0000 7f1836277640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f18301505f0 0x7f1830153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.899+0000 7f1836277640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f18300c69c0 0x7f18300c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.899+0000 7f1836277640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18300c5940 con 0x7f18300c2980 2024-09-10T08:29:12.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.899+0000 7f1836277640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f18300c7860 con 0x7f18301505f0 2024-09-10T08:29:12.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.899+0000 7f1836277640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f18300c5c00 con 0x7f18300c69c0 2024-09-10T08:29:12.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.899+0000 7f182ffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f18301505f0 0x7f1830153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.899+0000 7f182ffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f18301505f0 0x7f1830153910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60964/0 (socket says 172.21.15.103:60964) 2024-09-10T08:29:12.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.899+0000 7f182ffff640 1 -- 172.21.15.103:0/442858049 learned_addr learned my addr 172.21.15.103:0/442858049 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:12.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.899+0000 7f182f7fe640 1 --2- 172.21.15.103:0/442858049 >> v2:172.21.15.154:3300/0 conn(0x7f18300c69c0 0x7f18300c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.899+0000 7f182ffff640 1 -- 172.21.15.103:0/442858049 >> v2:172.21.15.154:3300/0 conn(0x7f18300c69c0 msgr2=0x7f18300c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:12.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.899+0000 7f182ffff640 1 --2- 172.21.15.103:0/442858049 >> v2:172.21.15.154:3300/0 conn(0x7f18300c69c0 0x7f18300c2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.899+0000 7f182ffff640 1 -- 172.21.15.103:0/442858049 >> v1:172.21.15.154:6789/0 conn(0x7f18300c2980 legacy=0x7f18300c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:12.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.899+0000 7f182ffff640 1 -- 172.21.15.103:0/442858049 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18300c5ee0 con 0x7f18301505f0 2024-09-10T08:29:12.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.900+0000 7f182ffff640 1 --2- 172.21.15.103:0/442858049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18301505f0 0x7f1830153910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f18300c5580 tx=0x7f182002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e558083557a93bb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:12.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.900+0000 7f182effd640 1 -- 172.21.15.103:0/442858049 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1820037070 con 0x7f18301505f0 2024-09-10T08:29:12.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.900+0000 7f182effd640 1 -- 172.21.15.103:0/442858049 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1820032440 con 0x7f18301505f0 2024-09-10T08:29:12.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.900+0000 7f182effd640 1 -- 172.21.15.103:0/442858049 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1820032810 con 0x7f18301505f0 2024-09-10T08:29:12.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.900+0000 7f1836277640 1 -- 172.21.15.103:0/442858049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18301505f0 msgr2=0x7f1830153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.900+0000 7f1836277640 1 --2- 172.21.15.103:0/442858049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18301505f0 0x7f1830153910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f18300c5580 tx=0x7f182002a1a0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.900+0000 7f1836277640 1 -- 172.21.15.103:0/442858049 shutdown_connections 2024-09-10T08:29:12.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.900+0000 7f1836277640 1 --2- 172.21.15.103:0/442858049 >> v2:172.21.15.154:3300/0 conn(0x7f18300c69c0 0x7f18300c2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.900+0000 7f1836277640 1 --2- 172.21.15.103:0/442858049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18301505f0 0x7f1830153910 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.900+0000 7f1836277640 1 -- 172.21.15.103:0/442858049 >> 172.21.15.103:0/442858049 conn(0x7f18300c7a40 msgr2=0x7f18300c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:12.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.900+0000 7f1836277640 1 -- 172.21.15.103:0/442858049 shutdown_connections 2024-09-10T08:29:12.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.901+0000 7f1836277640 1 -- 172.21.15.103:0/442858049 wait complete. 2024-09-10T08:29:12.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.902+0000 7f1836277640 1 Processor -- start 2024-09-10T08:29:12.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.902+0000 7f1836277640 1 -- start start 2024-09-10T08:29:12.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.902+0000 7f1836277640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18300c2980 0x7f1830148620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.902+0000 7f1836277640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18301505f0 0x7f1830146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.902+0000 7f1836277640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18301de340 0x7f18301466d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.902+0000 7f1836277640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f18301509d0 con 0x7f18301505f0 2024-09-10T08:29:12.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.902+0000 7f1836277640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f18300c64a0 con 0x7f18301de340 2024-09-10T08:29:12.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.902+0000 7f1836277640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1830150b50 con 0x7f18300c2980 2024-09-10T08:29:12.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.903+0000 7f182f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18301505f0 0x7f1830146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.903+0000 7f182f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18301505f0 0x7f1830146190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60970/0 (socket says 172.21.15.103:60970) 2024-09-10T08:29:12.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.903+0000 7f182f7fe640 1 -- 172.21.15.103:0/574831727 learned_addr learned my addr 172.21.15.103:0/574831727 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:12.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.903+0000 7f182ffff640 1 --2- 172.21.15.103:0/574831727 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18300c2980 0x7f1830148620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.903+0000 7f1834814640 1 --2- 172.21.15.103:0/574831727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18301de340 0x7f18301466d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.903+0000 7f182f7fe640 1 -- 172.21.15.103:0/574831727 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18300c2980 msgr2=0x7f1830148620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.903+0000 7f182f7fe640 1 --2- 172.21.15.103:0/574831727 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18300c2980 0x7f1830148620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.903+0000 7f182f7fe640 1 -- 172.21.15.103:0/574831727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18301de340 msgr2=0x7f18301466d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.903+0000 7f182f7fe640 1 --2- 172.21.15.103:0/574831727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18301de340 0x7f18301466d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.903+0000 7f182f7fe640 1 -- 172.21.15.103:0/574831727 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18301ea090 con 0x7f18301505f0 2024-09-10T08:29:12.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.903+0000 7f1834814640 1 --2- 172.21.15.103:0/574831727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18301de340 0x7f18301466d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:12.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.903+0000 7f182f7fe640 1 --2- 172.21.15.103:0/574831727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18301505f0 0x7f1830146190 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f182400d800 tx=0x7f182400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:12.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.903+0000 7f182cff9640 1 -- 172.21.15.103:0/574831727 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182400b6c0 con 0x7f18301505f0 2024-09-10T08:29:12.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.903+0000 7f182cff9640 1 -- 172.21.15.103:0/574831727 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1824019070 con 0x7f18301505f0 2024-09-10T08:29:12.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.903+0000 7f182cff9640 1 -- 172.21.15.103:0/574831727 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182400ba80 con 0x7f18301505f0 2024-09-10T08:29:12.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.903+0000 7f1836277640 1 -- 172.21.15.103:0/574831727 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18301ea370 con 0x7f18301505f0 2024-09-10T08:29:12.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.903+0000 7f1836277640 1 -- 172.21.15.103:0/574831727 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18301ea930 con 0x7f18301505f0 2024-09-10T08:29:12.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.904+0000 7f1836277640 1 --2- 172.21.15.103:0/574831727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18301e02b0 0x7f18300abe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.904+0000 7f1836277640 1 -- 172.21.15.103:0/574831727 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f18301eae50 con 0x7f18301e02b0 2024-09-10T08:29:12.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.904+0000 7f182ffff640 1 --2- 172.21.15.103:0/574831727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18301e02b0 0x7f18300abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.905+0000 7f182cff9640 1 -- 172.21.15.103:0/574831727 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f182400bc20 con 0x7f18301505f0 2024-09-10T08:29:12.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.905+0000 7f182ffff640 1 -- 172.21.15.103:0/574831727 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f18300c2440 con 0x7f18301e02b0 2024-09-10T08:29:12.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.905+0000 7f182ffff640 1 --2- 172.21.15.103:0/574831727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18301e02b0 0x7f18300abe80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f18300ab190 tx=0x7f18200046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:12.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.905+0000 7f182cff9640 1 --2- 172.21.15.103:0/574831727 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f181c06be30 0x7f181c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.905+0000 7f182cff9640 1 -- 172.21.15.103:0/574831727 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f182408b530 con 0x7f18301505f0 2024-09-10T08:29:12.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.905+0000 7f1834814640 1 --2- 172.21.15.103:0/574831727 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f181c06be30 0x7f181c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.905+0000 7f182cff9640 1 -- 172.21.15.103:0/574831727 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1820037040 con 0x7f18301e02b0 2024-09-10T08:29:12.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.906+0000 7f182cff9640 1 -- 172.21.15.103:0/574831727 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f182003c850 con 0x7f18301e02b0 2024-09-10T08:29:12.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.906+0000 7f182cff9640 1 -- 172.21.15.103:0/574831727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18301e02b0 msgr2=0x7f18300abe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.906+0000 7f182cff9640 1 --2- 172.21.15.103:0/574831727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18301e02b0 0x7f18300abe80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f18300ab190 tx=0x7f18200046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.906+0000 7f182cff9640 1 -- 172.21.15.103:0/574831727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18301e02b0 msgr2=0x7f18300abe80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:29:12.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.906+0000 7f182cff9640 1 --2- 172.21.15.103:0/574831727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18301e02b0 0x7f18300abe80 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f18300ab190 tx=0x7f18200046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.906+0000 7f1834814640 1 --2- 172.21.15.103:0/574831727 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f181c06be30 0x7f181c06e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1828004530 tx=0x7f1828009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:12.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.912+0000 7f1836277640 1 --2- 172.21.15.103:0/574831727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18300c69c0 0x7f18300ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:12.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.912+0000 7f1836277640 1 -- 172.21.15.103:0/574831727 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f18300c7e20 con 0x7f18300c69c0 2024-09-10T08:29:12.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.912+0000 7f182ffff640 1 --2- 172.21.15.103:0/574831727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18300c69c0 0x7f18300ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:12.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.912+0000 7f182ffff640 1 -- 172.21.15.103:0/574831727 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f18300c33c0 con 0x7f18300c69c0 2024-09-10T08:29:12.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.912+0000 7f182ffff640 1 --2- 172.21.15.103:0/574831727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18300c69c0 0x7f18300ac3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1820000c00 tx=0x7f1820008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:12.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.913+0000 7f182cff9640 1 -- 172.21.15.103:0/574831727 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1820037030 con 0x7f18300c69c0 2024-09-10T08:29:12.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.913+0000 7f182cff9640 1 -- 172.21.15.103:0/574831727 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4719 (secure 0 0 0) 0x7f1820048c00 con 0x7f18300c69c0 2024-09-10T08:29:12.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.913+0000 7f182cff9640 1 -- 172.21.15.103:0/574831727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18300c69c0 msgr2=0x7f18300ac3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.913+0000 7f182cff9640 1 --2- 172.21.15.103:0/574831727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18300c69c0 0x7f18300ac3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1820000c00 tx=0x7f1820008030 comp rx=0 tx=0).stop 2024-09-10T08:29:12.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.913+0000 7f182cff9640 1 -- 172.21.15.103:0/574831727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18300c69c0 msgr2=0x7f18300ac3c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:29:12.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.913+0000 7f182cff9640 1 --2- 172.21.15.103:0/574831727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18300c69c0 0x7f18300ac3c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.913 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:29:12.913 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:29:12.913 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:29:12.913 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:29:12.913 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 4, 2024-09-10T08:29:12.914 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 60472, 2024-09-10T08:29:12.914 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:29:12.914 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:29:12.914 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:29:12.914 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:29:12.914 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:12.914 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 60, 2024-09-10T08:29:12.914 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:29:12.914 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:29:12.914 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:29:12.914 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:29:12.914 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:29:12.914 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:29:12.914 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:29:12.915 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:29:12.915 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:29:12.915 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:29:12.915 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:29:12.915 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:29:12.915 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:29:12.915 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:29:12.915 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:12.915 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:29:12.915 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:29:12.915 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:29:12.915 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:29:12.915 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:29:12.915 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:29:12.916 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:29:12.916 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:29:12.916 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:29:12.916 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:29:12.916 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:29:12.916 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:29:12.916 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:29:12.916 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:12.916 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.916 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:29:12.916 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:29:12.916 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:29:12.916 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:29:12.916 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:29:12.917 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:29:12.917 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:29:12.917 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:29:12.917 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:29:12.917 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:29:12.917 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:29:12.917 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:29:12.917 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:29:12.917 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:29:12.917 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:29:12.917 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:29:12.917 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:29:12.918 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:29:12.918 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:29:12.918 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:29:12.918 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:29:12.918 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:29:12.918 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:29:12.918 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:29:12.918 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:29:12.918 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:29:12.918 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:29:12.918 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:29:12.918 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:12.918 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:29:12.919 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.919 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:29:12.919 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.919 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:29:12.919 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:29:12.919 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:29:12.919 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:29:12.919 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.919 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:29:12.919 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:29:12.919 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:12.919 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.919 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.919 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:29:12.919 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:29:12.920 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:12.920 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:12.920 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:12.920 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.920 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:29:12.920 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:29:12.920 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:29:12.920 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:29:12.920 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:29:12.920 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.920 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.920 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:29:12.920 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:29:12.920 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:29:12.921 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:29:12.921 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.921 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:29:12.921 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:29:12.921 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:12.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.921 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.921 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:29:12.921 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:29:12.921 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:12.921 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:12.921 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:12.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.921 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:29:12.922 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:29:12.922 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:29:12.922 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:29:12.922 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:29:12.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.922 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.922 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:29:12.922 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:29:12.922 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:29:12.922 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:29:12.922 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.922 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:29:12.922 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:29:12.922 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:12.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.923 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.923 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:29:12.923 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:29:12.923 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:12.923 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:12.923 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:12.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.923 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:29:12.923 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:29:12.923 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:29:12.923 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:29:12.923 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:29:12.924 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:12.924 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:12.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.924 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:29:12.924 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:29:12.924 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.924 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:12.924 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:12.924 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:29:12.924 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:12.924 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:12.924 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:29:12.924 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.924 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:12.925 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:12.925 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:29:12.925 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:12.925 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:12.925 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:29:12.925 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:12.925 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:12.925 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:12.925 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:29:12.925 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:12.925 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:12.925 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:12.926 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:29:12.926 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:29:12.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.913+0000 7f1836277640 1 -- 172.21.15.103:0/574831727 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f181c06be30 msgr2=0x7f181c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.913+0000 7f1836277640 1 --2- 172.21.15.103:0/574831727 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f181c06be30 0x7f181c06e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1828004530 tx=0x7f1828009040 comp rx=0 tx=0).stop 2024-09-10T08:29:12.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.913+0000 7f1836277640 1 -- 172.21.15.103:0/574831727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18301505f0 msgr2=0x7f1830146190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:12.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.913+0000 7f1836277640 1 --2- 172.21.15.103:0/574831727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18301505f0 0x7f1830146190 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f182400d800 tx=0x7f182400dcc0 comp rx=0 tx=0).stop 2024-09-10T08:29:12.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.913+0000 7f1834814640 1 -- 172.21.15.103:0/574831727 reap_dead start 2024-09-10T08:29:12.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.913+0000 7f1834814640 1 -- 172.21.15.103:0/574831727 reap_dead start 2024-09-10T08:29:12.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.913+0000 7f1836277640 1 -- 172.21.15.103:0/574831727 shutdown_connections 2024-09-10T08:29:12.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.913+0000 7f1836277640 1 -- 172.21.15.103:0/574831727 >> 172.21.15.103:0/574831727 conn(0x7f18300c7a40 msgr2=0x7f1830153010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:12.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.913+0000 7f1836277640 1 -- 172.21.15.103:0/574831727 shutdown_connections 2024-09-10T08:29:12.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:12.913+0000 7f1836277640 1 -- 172.21.15.103:0/574831727 wait complete. 2024-09-10T08:29:12.928 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:29:12.928 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:29:12.928 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:29:13.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.028+0000 7f18ad178640 1 Processor -- start 2024-09-10T08:29:13.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.028+0000 7f18ad178640 1 -- start start 2024-09-10T08:29:13.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.029+0000 7f18ad178640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f18a8151840 0x7f18a80ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:13.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.029+0000 7f18ad178640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f18a80ad340 0x7f18a80c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.029+0000 7f18ad178640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a80c3830 0x7f18a80c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.029+0000 7f18ad178640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f18a81550f0 con 0x7f18a8151840 2024-09-10T08:29:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.029+0000 7f18ad178640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f18a8154330 con 0x7f18a80ad340 2024-09-10T08:29:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.029+0000 7f18ad178640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f18a8154610 con 0x7f18a80c3830 2024-09-10T08:29:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.029+0000 7f18a6d9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f18a8151840 0x7f18a80ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.029+0000 7f18a6d9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f18a8151840 0x7f18a80ace00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60972/0 (socket says 172.21.15.103:60972) 2024-09-10T08:29:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.029+0000 7f18a6d9d640 1 -- 172.21.15.103:0/344058921 learned_addr learned my addr 172.21.15.103:0/344058921 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.029+0000 7f18a759e640 1 --2- 172.21.15.103:0/344058921 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a80c3830 0x7f18a80c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.029+0000 7f189e59c640 1 --2- 172.21.15.103:0/344058921 >> v2:172.21.15.154:3300/0 conn(0x7f18a80ad340 0x7f18a80c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.029+0000 7f18a6d9d640 1 -- 172.21.15.103:0/344058921 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a80c3830 msgr2=0x7f18a80c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.029+0000 7f18a6d9d640 1 --2- 172.21.15.103:0/344058921 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a80c3830 0x7f18a80c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.029+0000 7f18a6d9d640 1 -- 172.21.15.103:0/344058921 >> v2:172.21.15.154:3300/0 conn(0x7f18a80ad340 msgr2=0x7f18a80c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:13.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.029+0000 7f18a6d9d640 1 --2- 172.21.15.103:0/344058921 >> v2:172.21.15.154:3300/0 conn(0x7f18a80ad340 0x7f18a80c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:13.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.029+0000 7f18a6d9d640 1 -- 172.21.15.103:0/344058921 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a81548f0 con 0x7f18a8151840 2024-09-10T08:29:13.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.030+0000 7f18a6d9d640 1 --2- 172.21.15.103:0/344058921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18a8151840 0x7f18a80ace00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f18a80adb80 tx=0x7f189802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9755bbaf1dd5345c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:13.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.030+0000 7f18a659c640 1 -- 172.21.15.103:0/344058921 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1898037070 con 0x7f18a8151840 2024-09-10T08:29:13.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.030+0000 7f18a659c640 1 -- 172.21.15.103:0/344058921 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1898032440 con 0x7f18a8151840 2024-09-10T08:29:13.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.030+0000 7f18a659c640 1 -- 172.21.15.103:0/344058921 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1898032810 con 0x7f18a8151840 2024-09-10T08:29:13.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.031+0000 7f18ad178640 1 -- 172.21.15.103:0/344058921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18a8151840 msgr2=0x7f18a80ace00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:13.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.031+0000 7f18ad178640 1 --2- 172.21.15.103:0/344058921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18a8151840 0x7f18a80ace00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f18a80adb80 tx=0x7f189802a1e0 comp rx=0 tx=0).stop 2024-09-10T08:29:13.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.031+0000 7f18ad178640 1 -- 172.21.15.103:0/344058921 shutdown_connections 2024-09-10T08:29:13.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.031+0000 7f18ad178640 1 --2- 172.21.15.103:0/344058921 >> v2:172.21.15.154:3300/0 conn(0x7f18a80ad340 0x7f18a80c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:13.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.031+0000 7f18ad178640 1 --2- 172.21.15.103:0/344058921 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a80c3830 0x7f18a80c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:13.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.031+0000 7f18ad178640 1 --2- 172.21.15.103:0/344058921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18a8151840 0x7f18a80ace00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:13.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.031+0000 7f18ad178640 1 -- 172.21.15.103:0/344058921 >> 172.21.15.103:0/344058921 conn(0x7f18a80c7a40 msgr2=0x7f18a80c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:13.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.031+0000 7f18ad178640 1 -- 172.21.15.103:0/344058921 shutdown_connections 2024-09-10T08:29:13.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.031+0000 7f18ad178640 1 -- 172.21.15.103:0/344058921 wait complete. 2024-09-10T08:29:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.032+0000 7f18ad178640 1 Processor -- start 2024-09-10T08:29:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.032+0000 7f18ad178640 1 -- start start 2024-09-10T08:29:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.033+0000 7f18ad178640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a80ad340 0x7f18a8152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.033+0000 7f18ad178640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18a80c3830 0x7f18a81497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.033+0000 7f18ad178640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18a8151840 0x7f18a8149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.033+0000 7f18ad178640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f18a806e030 con 0x7f18a8151840 2024-09-10T08:29:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.033+0000 7f18ad178640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f18a806dda0 con 0x7f18a80c3830 2024-09-10T08:29:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.033+0000 7f18ad178640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f18a806e1b0 con 0x7f18a80ad340 2024-09-10T08:29:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.033+0000 7f18a759e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18a8151840 0x7f18a8149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.033+0000 7f18a759e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18a8151840 0x7f18a8149d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60986/0 (socket says 172.21.15.103:60986) 2024-09-10T08:29:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.033+0000 7f18a759e640 1 -- 172.21.15.103:0/2840366135 learned_addr learned my addr 172.21.15.103:0/2840366135 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.033+0000 7f18a6d9d640 1 --2- 172.21.15.103:0/2840366135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a80ad340 0x7f18a8152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:13.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.033+0000 7f189e59c640 1 --2- 172.21.15.103:0/2840366135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18a80c3830 0x7f18a81497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.033+0000 7f18a759e640 1 -- 172.21.15.103:0/2840366135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a80ad340 msgr2=0x7f18a8152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.033+0000 7f18a759e640 1 --2- 172.21.15.103:0/2840366135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a80ad340 0x7f18a8152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.033+0000 7f18a759e640 1 -- 172.21.15.103:0/2840366135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18a80c3830 msgr2=0x7f18a81497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.033+0000 7f18a759e640 1 --2- 172.21.15.103:0/2840366135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18a80c3830 0x7f18a81497c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.033+0000 7f18a759e640 1 -- 172.21.15.103:0/2840366135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a80ab9c0 con 0x7f18a8151840 2024-09-10T08:29:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.033+0000 7f18a759e640 1 --2- 172.21.15.103:0/2840366135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18a8151840 0x7f18a8149d00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f18a000efc0 tx=0x7f18a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.034+0000 7f189ffff640 1 -- 172.21.15.103:0/2840366135 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a0018020 con 0x7f18a8151840 2024-09-10T08:29:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.034+0000 7f189ffff640 1 -- 172.21.15.103:0/2840366135 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18a0014480 con 0x7f18a8151840 2024-09-10T08:29:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.034+0000 7f189ffff640 1 -- 172.21.15.103:0/2840366135 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a0014870 con 0x7f18a8151840 2024-09-10T08:29:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.034+0000 7f18ad178640 1 -- 172.21.15.103:0/2840366135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a80aad90 con 0x7f18a8151840 2024-09-10T08:29:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.034+0000 7f18ad178640 1 -- 172.21.15.103:0/2840366135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a80abc60 con 0x7f18a8151840 2024-09-10T08:29:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.034+0000 7f18ad178640 1 --2- 172.21.15.103:0/2840366135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a80aca00 0x7f18a81ebea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:13.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.034+0000 7f18ad178640 1 -- 172.21.15.103:0/2840366135 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f18a80ac040 con 0x7f18a80aca00 2024-09-10T08:29:13.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.035+0000 7f18a6d9d640 1 --2- 172.21.15.103:0/2840366135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a80aca00 0x7f18a81ebea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:13.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.035+0000 7f18a6d9d640 1 -- 172.21.15.103:0/2840366135 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f18a8151c20 con 0x7f18a80aca00 2024-09-10T08:29:13.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.035+0000 7f189ffff640 1 -- 172.21.15.103:0/2840366135 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f18a0005d10 con 0x7f18a8151840 2024-09-10T08:29:13.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.035+0000 7f18a6d9d640 1 --2- 172.21.15.103:0/2840366135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a80aca00 0x7f18a81ebea0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f18a80c8810 tx=0x7f18980046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:13.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.036+0000 7f189ffff640 1 --2- 172.21.15.103:0/2840366135 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f188806be30 0x7f188806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:13.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.036+0000 7f189ffff640 1 -- 172.21.15.103:0/2840366135 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f18a008bab0 con 0x7f18a8151840 2024-09-10T08:29:13.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.036+0000 7f189e59c640 1 --2- 172.21.15.103:0/2840366135 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f188806be30 0x7f188806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:13.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.036+0000 7f189ffff640 1 -- 172.21.15.103:0/2840366135 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1898037040 con 0x7f18a80aca00 2024-09-10T08:29:13.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.036+0000 7f189ffff640 1 -- 172.21.15.103:0/2840366135 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f189803c640 con 0x7f18a80aca00 2024-09-10T08:29:13.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.036+0000 7f189ffff640 1 -- 172.21.15.103:0/2840366135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a80aca00 msgr2=0x7f18a81ebea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:13.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.036+0000 7f189ffff640 1 --2- 172.21.15.103:0/2840366135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a80aca00 0x7f18a81ebea0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f18a80c8810 tx=0x7f18980046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:13.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.036+0000 7f189ffff640 1 -- 172.21.15.103:0/2840366135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a80aca00 msgr2=0x7f18a81ebea0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:29:13.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.036+0000 7f189ffff640 1 --2- 172.21.15.103:0/2840366135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a80aca00 0x7f18a81ebea0 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f18a80c8810 tx=0x7f18980046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:13.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.036+0000 7f189e59c640 1 --2- 172.21.15.103:0/2840366135 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f188806be30 0x7f188806e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f18a8158070 tx=0x7f1890009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:13.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.042+0000 7f18ad178640 1 --2- 172.21.15.103:0/2840366135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a8152a90 0x7f18a81ec3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:13.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.042+0000 7f18ad178640 1 -- 172.21.15.103:0/2840366135 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f18a814a620 con 0x7f18a8152a90 2024-09-10T08:29:13.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.042+0000 7f18a6d9d640 1 --2- 172.21.15.103:0/2840366135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a8152a90 0x7f18a81ec3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:13.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.042+0000 7f18a6d9d640 1 -- 172.21.15.103:0/2840366135 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f18a8157c30 con 0x7f18a8152a90 2024-09-10T08:29:13.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.043+0000 7f18a6d9d640 1 --2- 172.21.15.103:0/2840366135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a8152a90 0x7f18a81ec3e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f189802a220 tx=0x7f1898008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:13.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.043+0000 7f189ffff640 1 -- 172.21.15.103:0/2840366135 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1898037040 con 0x7f18a8152a90 2024-09-10T08:29:13.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.043+0000 7f189ffff640 1 -- 172.21.15.103:0/2840366135 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5053 (secure 0 0 0) 0x7f18980489f0 con 0x7f18a8152a90 2024-09-10T08:29:13.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.043+0000 7f189ffff640 1 -- 172.21.15.103:0/2840366135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a8152a90 msgr2=0x7f18a81ec3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:13.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.043+0000 7f189ffff640 1 --2- 172.21.15.103:0/2840366135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a8152a90 0x7f18a81ec3e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f189802a220 tx=0x7f1898008030 comp rx=0 tx=0).stop 2024-09-10T08:29:13.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.043+0000 7f189ffff640 1 -- 172.21.15.103:0/2840366135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a8152a90 msgr2=0x7f18a81ec3e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:29:13.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.043+0000 7f189ffff640 1 --2- 172.21.15.103:0/2840366135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18a8152a90 0x7f18a81ec3e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:13.043 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:29:13.043 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:29:13.043 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:29:13.043 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:29:13.044 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 4, 2024-09-10T08:29:13.044 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 60602, 2024-09-10T08:29:13.044 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:29:13.044 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:29:13.044 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:29:13.044 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:29:13.044 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:13.044 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 60, 2024-09-10T08:29:13.044 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:29:13.044 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:29:13.044 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:29:13.044 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:29:13.045 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:29:13.045 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:29:13.045 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:29:13.045 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:29:13.045 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:29:13.045 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:29:13.045 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:29:13.045 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:29:13.045 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:29:13.045 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:29:13.045 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:13.045 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:29:13.045 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:29:13.046 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:29:13.046 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:29:13.046 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:29:13.046 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:29:13.046 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:29:13.046 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:29:13.046 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:29:13.046 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:29:13.046 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:29:13.046 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:29:13.046 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:29:13.046 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:13.046 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:13.046 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:29:13.046 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:29:13.046 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:29:13.047 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:29:13.047 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:29:13.047 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:29:13.047 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:29:13.047 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:29:13.047 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:29:13.047 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:29:13.047 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:29:13.047 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:29:13.047 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:29:13.047 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:29:13.047 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:29:13.047 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:29:13.047 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:29:13.048 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:29:13.048 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:29:13.048 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:29:13.048 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:29:13.048 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:29:13.048 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:29:13.048 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:29:13.048 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:29:13.048 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:29:13.048 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:29:13.048 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:29:13.048 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:13.048 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:29:13.049 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:13.049 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:29:13.049 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:13.049 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:29:13.049 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:29:13.049 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:29:13.049 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:29:13.049 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:13.049 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:29:13.049 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:29:13.049 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:13.049 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:13.049 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:13.050 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:29:13.050 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:29:13.050 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:13.050 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:13.050 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:13.050 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:13.050 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:29:13.050 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:29:13.050 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:29:13.050 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:29:13.050 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:29:13.050 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:13.050 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:13.051 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:29:13.051 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:29:13.051 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:29:13.051 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:29:13.051 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:13.051 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:29:13.051 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:29:13.051 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:13.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:13.051 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:13.051 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:29:13.051 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:29:13.051 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:13.051 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:13.052 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:13.052 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:13.052 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:29:13.052 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:29:13.052 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:29:13.052 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:29:13.052 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:29:13.052 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:13.052 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:13.052 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:29:13.052 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:29:13.052 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:29:13.053 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:29:13.053 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:13.053 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:29:13.053 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:29:13.053 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:13.053 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:13.053 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:13.053 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:29:13.053 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:29:13.053 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:13.053 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:13.053 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:13.053 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:13.054 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:29:13.054 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:29:13.054 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:29:13.054 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:29:13.054 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:29:13.054 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:13.054 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:13.054 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:13.054 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:29:13.054 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:29:13.054 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:13.054 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:13.054 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:13.054 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:29:13.055 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:13.055 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:13.055 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:29:13.055 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:13.055 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:13.055 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:13.055 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:29:13.055 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:13.055 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:13.055 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:29:13.055 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:13.055 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:13.055 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:13.055 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:29:13.056 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:13.056 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:13.056 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:29:13.056 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:13.056 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:13.056 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:13.056 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:29:13.056 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:13.056 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:13.056 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:29:13.056 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:13.056 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:13.056 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:13.057 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:29:13.057 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:13.057 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:13.057 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:13.057 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:29:13.057 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:29:13.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.043+0000 7f18ad178640 1 -- 172.21.15.103:0/2840366135 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f188806be30 msgr2=0x7f188806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:13.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.043+0000 7f18ad178640 1 --2- 172.21.15.103:0/2840366135 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f188806be30 0x7f188806e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f18a8158070 tx=0x7f1890009190 comp rx=0 tx=0).stop 2024-09-10T08:29:13.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.043+0000 7f18ad178640 1 -- 172.21.15.103:0/2840366135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18a8151840 msgr2=0x7f18a8149d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:13.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.043+0000 7f18a759e640 1 -- 172.21.15.103:0/2840366135 reap_dead start 2024-09-10T08:29:13.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.043+0000 7f18ad178640 1 --2- 172.21.15.103:0/2840366135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18a8151840 0x7f18a8149d00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f18a000efc0 tx=0x7f18a000c490 comp rx=0 tx=0).stop 2024-09-10T08:29:13.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.043+0000 7f18ad178640 1 -- 172.21.15.103:0/2840366135 shutdown_connections 2024-09-10T08:29:13.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.043+0000 7f18ad178640 1 --2- 172.21.15.103:0/2840366135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18a8151840 0x7f18a8149d00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:13.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.043+0000 7f18ad178640 1 -- 172.21.15.103:0/2840366135 >> 172.21.15.103:0/2840366135 conn(0x7f18a80c7a40 msgr2=0x7f18a8150b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:13.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.044+0000 7f18ad178640 1 -- 172.21.15.103:0/2840366135 shutdown_connections 2024-09-10T08:29:13.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:13.044+0000 7f18ad178640 1 -- 172.21.15.103:0/2840366135 wait complete. 2024-09-10T08:29:13.059 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:29:13.060 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-09-10T08:29:13.060 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2024-09-10T08:29:13.060 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-10T08:29:13.060 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-10T08:29:13.060 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T08:29:13.060 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:29:13.072 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T08:29:13.072 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-09-10T08:29:13.073 INFO:tasks.ceph.mon.c:Sent signal 19 2024-09-10T08:29:13.073 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-10T08:29:28.074 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-09-10T08:29:28.075 INFO:tasks.ceph.mon.c:Sent signal 18 2024-09-10T08:29:28.075 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-10T08:29:28.075 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:29:28.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.184+0000 7fc877847640 1 Processor -- start 2024-09-10T08:29:28.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.184+0000 7fc877847640 1 -- start start 2024-09-10T08:29:28.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.185+0000 7fc877847640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc870151840 0x7fc8700ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:28.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.185+0000 7fc877847640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 0x7fc8700c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:28.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.185+0000 7fc877847640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc870154330 con 0x7fc8700c3830 2024-09-10T08:29:28.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.185+0000 7fc877847640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc8701550f0 con 0x7fc870151840 2024-09-10T08:29:28.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.185+0000 7fc877847640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc870154610 con 0x7fc8700ad340 2024-09-10T08:29:28.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.185+0000 7fc8755e3640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7fc870151840 msgr2=0x7fc8700ace00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:29:28.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.185+0000 7fc8755e3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc870151840 0x7fc8700ace00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:29:28.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.185+0000 7fc875de4640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7fc8700c3830 legacy=0x7fc8700c44d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:29:28.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.185+0000 7fc874de2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 0x7fc8700c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:28.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.185+0000 7fc874de2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 0x7fc8700c32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:60296/0 (socket says 172.21.15.103:60296) 2024-09-10T08:29:28.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.185+0000 7fc874de2640 1 -- 172.21.15.103:0/741642292 learned_addr learned my addr 172.21.15.103:0/741642292 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:28.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.185+0000 7fc874de2640 1 -- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 msgr2=0x7fc8700c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:29:28.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.185+0000 7fc874de2640 1 -- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 msgr2=0x7fc8700c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:29:28.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.185+0000 7fc874de2640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 0x7fc8700c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:29:28.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.185+0000 7fc874de2640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 0x7fc8700c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:29:28.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.386+0000 7fc875de4640 1 -- 172.21.15.103:0/741642292 >> v1:172.21.15.154:6789/0 conn(0x7fc8700c3830 legacy=0x7fc8700c44d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:29:28.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.386+0000 7fc8755e3640 1 -- 172.21.15.103:0/741642292 >> v2:172.21.15.154:3300/0 conn(0x7fc870151840 msgr2=0x7fc8700ace00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:29:28.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.386+0000 7fc8755e3640 1 --2- 172.21.15.103:0/741642292 >> v2:172.21.15.154:3300/0 conn(0x7fc870151840 0x7fc8700ace00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:29:28.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.386+0000 7fc874de2640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 0x7fc8700c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:28.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.386+0000 7fc874de2640 1 -- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 msgr2=0x7fc8700c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:29:28.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.386+0000 7fc874de2640 1 -- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 msgr2=0x7fc8700c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:29:28.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.386+0000 7fc874de2640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 0x7fc8700c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:29:28.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.386+0000 7fc874de2640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 0x7fc8700c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:29:28.684 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:29:28.687 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:29:28.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.787+0000 7fc8755e3640 1 -- 172.21.15.103:0/741642292 >> v2:172.21.15.154:3300/0 conn(0x7fc870151840 msgr2=0x7fc8700ace00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:29:28.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.787+0000 7fc875de4640 1 -- 172.21.15.103:0/741642292 >> v1:172.21.15.154:6789/0 conn(0x7fc8700c3830 legacy=0x7fc8700c44d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:29:28.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.787+0000 7fc8755e3640 1 --2- 172.21.15.103:0/741642292 >> v2:172.21.15.154:3300/0 conn(0x7fc870151840 0x7fc8700ace00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:29:28.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.787+0000 7fc874de2640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 0x7fc8700c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:28.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.787+0000 7fc874de2640 1 -- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 msgr2=0x7fc8700c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:29:28.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.787+0000 7fc874de2640 1 -- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 msgr2=0x7fc8700c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:29:28.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.787+0000 7fc874de2640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 0x7fc8700c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:29:28.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:28.787+0000 7fc874de2640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 0x7fc8700c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:29:29.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:29.588+0000 7fc875de4640 1 -- 172.21.15.103:0/741642292 >> v1:172.21.15.154:6789/0 conn(0x7fc8700c3830 legacy=0x7fc8700c44d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:29:29.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:29.588+0000 7fc8755e3640 1 -- 172.21.15.103:0/741642292 >> v2:172.21.15.154:3300/0 conn(0x7fc870151840 msgr2=0x7fc8700ace00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:29:29.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:29.588+0000 7fc8755e3640 1 --2- 172.21.15.103:0/741642292 >> v2:172.21.15.154:3300/0 conn(0x7fc870151840 0x7fc8700ace00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:29:29.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:29.588+0000 7fc874de2640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 0x7fc8700c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:29.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:29.588+0000 7fc874de2640 1 -- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 msgr2=0x7fc8700c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:29:29.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:29.588+0000 7fc874de2640 1 -- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 msgr2=0x7fc8700c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:29:29.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:29.588+0000 7fc874de2640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 0x7fc8700c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:29:29.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:29.588+0000 7fc874de2640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 0x7fc8700c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:29:31.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.185+0000 7fc866ffd640 1 -- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 msgr2=0x7fc8700c32f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:29:31.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.185+0000 7fc866ffd640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8700ad340 0x7fc8700c32f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:31.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.185+0000 7fc866ffd640 1 -- 172.21.15.103:0/741642292 >> v2:172.21.15.154:3300/0 conn(0x7fc870151840 msgr2=0x7fc8700ace00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:29:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.185+0000 7fc866ffd640 1 --2- 172.21.15.103:0/741642292 >> v2:172.21.15.154:3300/0 conn(0x7fc870151840 0x7fc8700ace00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.185+0000 7fc866ffd640 1 -- 172.21.15.103:0/741642292 >> v1:172.21.15.154:6789/0 conn(0x7fc8700c3830 legacy=0x7fc8700c44d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:29:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.185+0000 7fc866ffd640 1 --2- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 0x7fc854005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.185+0000 7fc866ffd640 1 -- 172.21.15.103:0/741642292 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8701548f0 con 0x7fc854006170 2024-09-10T08:29:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.185+0000 7fc866ffd640 1 -- 172.21.15.103:0/741642292 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fc870154610 con 0x7fc8540036a0 2024-09-10T08:29:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.185+0000 7fc8755e3640 1 --2- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 0x7fc854005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.185+0000 7fc8755e3640 1 -- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 msgr2=0x7fc854005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:29:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.185+0000 7fc8755e3640 1 -- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 msgr2=0x7fc854005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:29:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.185+0000 7fc8755e3640 1 --2- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 0x7fc854005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:29:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.185+0000 7fc8755e3640 1 --2- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 0x7fc854005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:29:31.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.386+0000 7fc8755e3640 1 --2- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 0x7fc854005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:31.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.386+0000 7fc8755e3640 1 -- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 msgr2=0x7fc854005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:29:31.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.386+0000 7fc8755e3640 1 -- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 msgr2=0x7fc854005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:29:31.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.386+0000 7fc8755e3640 1 --2- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 0x7fc854005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:29:31.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.386+0000 7fc8755e3640 1 --2- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 0x7fc854005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:29:31.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.787+0000 7fc8755e3640 1 --2- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 0x7fc854005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:31.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.787+0000 7fc8755e3640 1 -- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 msgr2=0x7fc854005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:29:31.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.787+0000 7fc8755e3640 1 -- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 msgr2=0x7fc854005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:29:31.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.787+0000 7fc8755e3640 1 --2- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 0x7fc854005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:29:31.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:31.787+0000 7fc8755e3640 1 --2- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 0x7fc854005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:29:32.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:32.588+0000 7fc8755e3640 1 --2- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 0x7fc854005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:32.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:32.588+0000 7fc8755e3640 1 -- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 msgr2=0x7fc854005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:29:32.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:32.588+0000 7fc8755e3640 1 -- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 msgr2=0x7fc854005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:29:32.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:32.588+0000 7fc8755e3640 1 --2- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 0x7fc854005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:29:32.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:32.588+0000 7fc8755e3640 1 --2- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 0x7fc854005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:29:33.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.090+0000 7fc867fff640 1 -- 172.21.15.103:0/741642292 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2358603289 0 0) 0x7fc8701548f0 con 0x7fc854006170 2024-09-10T08:29:33.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.090+0000 7fc867fff640 1 -- 172.21.15.103:0/741642292 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc85c003520 con 0x7fc854006170 2024-09-10T08:29:33.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.092+0000 7fc867fff640 1 -- 172.21.15.103:0/741642292 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3887750234 0 0) 0x7fc85c003520 con 0x7fc854006170 2024-09-10T08:29:33.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.092+0000 7fc867fff640 1 -- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 msgr2=0x7fc854005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:29:33.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.092+0000 7fc867fff640 1 --2- 172.21.15.103:0/741642292 >> v2:172.21.15.103:3300/0 conn(0x7fc8540036a0 0x7fc854005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.092+0000 7fc867fff640 1 -- 172.21.15.103:0/741642292 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc870154330 con 0x7fc854006170 2024-09-10T08:29:33.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.092+0000 7fc867fff640 1 -- 172.21.15.103:0/741642292 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7fc86000f040 con 0x7fc854006170 2024-09-10T08:29:33.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.092+0000 7fc867fff640 1 -- 172.21.15.103:0/741642292 >> v1:172.21.15.103:6789/0 conn(0x7fc854006170 legacy=0x7fc854008630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.092+0000 7fc875de4640 1 -- 172.21.15.103:0/741642292 reap_dead start 2024-09-10T08:29:33.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.092+0000 7fc867fff640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc85c0039b0 0x7fc85c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.092+0000 7fc867fff640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc85c004800 0x7fc85c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.092+0000 7fc867fff640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc85c005210 0x7fc85c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.092+0000 7fc867fff640 1 -- 172.21.15.103:0/741642292 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc870154610 con 0x7fc85c005210 2024-09-10T08:29:33.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.092+0000 7fc867fff640 1 -- 172.21.15.103:0/741642292 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c00c140 con 0x7fc85c0039b0 2024-09-10T08:29:33.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.092+0000 7fc867fff640 1 -- 172.21.15.103:0/741642292 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc85c00c340 con 0x7fc85c004800 2024-09-10T08:29:33.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.092+0000 7fc8755e3640 1 -- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc85c0039b0 msgr2=0x7fc85c003db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:29:33.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.092+0000 7fc8755e3640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc85c0039b0 0x7fc85c003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:29:33.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.092+0000 7fc875de4640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc85c005210 0x7fc85c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.092+0000 7fc874de2640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc85c004800 0x7fc85c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.092+0000 7fc875de4640 1 -- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc85c004800 msgr2=0x7fc85c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:33.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.092+0000 7fc875de4640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc85c004800 0x7fc85c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.092+0000 7fc875de4640 1 -- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc85c0039b0 msgr2=0x7fc85c003db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:29:33.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.092+0000 7fc875de4640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc85c0039b0 0x7fc85c003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.092+0000 7fc875de4640 1 -- 172.21.15.103:0/741642292 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc85c003520 con 0x7fc85c005210 2024-09-10T08:29:33.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.093+0000 7fc875de4640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc85c005210 0x7fc85c00b9c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc8700c2a40 tx=0x7fc85c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b12e4d59e911c4a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:33.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.094+0000 7fc867fff640 1 -- 172.21.15.103:0/741642292 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc868008050 con 0x7fc85c005210 2024-09-10T08:29:33.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.094+0000 7fc867fff640 1 -- 172.21.15.103:0/741642292 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc868003d80 con 0x7fc85c005210 2024-09-10T08:29:33.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.094+0000 7fc867fff640 1 -- 172.21.15.103:0/741642292 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc868009910 con 0x7fc85c005210 2024-09-10T08:29:33.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.095+0000 7fc877847640 1 -- 172.21.15.103:0/741642292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc85c005210 msgr2=0x7fc85c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.095+0000 7fc877847640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc85c005210 0x7fc85c00b9c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc8700c2a40 tx=0x7fc85c005830 comp rx=0 tx=0).stop 2024-09-10T08:29:33.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.095+0000 7fc877847640 1 -- 172.21.15.103:0/741642292 shutdown_connections 2024-09-10T08:29:33.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.095+0000 7fc877847640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc85c005210 0x7fc85c00b9c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.095+0000 7fc877847640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc85c004800 0x7fc85c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.095+0000 7fc877847640 1 --2- 172.21.15.103:0/741642292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc85c0039b0 0x7fc85c003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.095+0000 7fc877847640 1 -- 172.21.15.103:0/741642292 >> 172.21.15.103:0/741642292 conn(0x7fc8700c7a40 msgr2=0x7fc8700c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:33.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.095+0000 7fc877847640 1 -- 172.21.15.103:0/741642292 shutdown_connections 2024-09-10T08:29:33.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.095+0000 7fc877847640 1 -- 172.21.15.103:0/741642292 wait complete. 2024-09-10T08:29:33.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.096+0000 7fc877847640 1 Processor -- start 2024-09-10T08:29:33.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.096+0000 7fc877847640 1 -- start start 2024-09-10T08:29:33.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.097+0000 7fc877847640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc85c0039b0 0x7fc870071730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.097+0000 7fc877847640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc85c004800 0x7fc8701ed150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.097+0000 7fc877847640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc85c005210 0x7fc8700a9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.097+0000 7fc877847640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc87006e030 con 0x7fc85c0039b0 2024-09-10T08:29:33.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.097+0000 7fc877847640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc87006dda0 con 0x7fc85c005210 2024-09-10T08:29:33.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.097+0000 7fc877847640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc87006e1b0 con 0x7fc85c004800 2024-09-10T08:29:33.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.097+0000 7fc8755e3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc85c0039b0 0x7fc870071730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.097+0000 7fc875de4640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc85c005210 msgr2=0x7fc8700a9340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:29:33.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.097+0000 7fc875de4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc85c005210 0x7fc8700a9340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:29:33.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.097+0000 7fc8755e3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc85c0039b0 0x7fc870071730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33134/0 (socket says 172.21.15.103:33134) 2024-09-10T08:29:33.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.097+0000 7fc8755e3640 1 -- 172.21.15.103:0/1526615337 learned_addr learned my addr 172.21.15.103:0/1526615337 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:33.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.097+0000 7fc874de2640 1 --2- 172.21.15.103:0/1526615337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc85c004800 0x7fc8701ed150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.098+0000 7fc874de2640 1 -- 172.21.15.103:0/1526615337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc85c005210 msgr2=0x7fc8700a9340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:29:33.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.098+0000 7fc874de2640 1 --2- 172.21.15.103:0/1526615337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc85c005210 0x7fc8700a9340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.098+0000 7fc874de2640 1 -- 172.21.15.103:0/1526615337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc85c0039b0 msgr2=0x7fc870071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.098+0000 7fc874de2640 1 --2- 172.21.15.103:0/1526615337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc85c0039b0 0x7fc870071730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.098+0000 7fc874de2640 1 -- 172.21.15.103:0/1526615337 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8700a8030 con 0x7fc85c004800 2024-09-10T08:29:33.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.098+0000 7fc8755e3640 1 --2- 172.21.15.103:0/1526615337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc85c0039b0 0x7fc870071730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:29:33.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.098+0000 7fc874de2640 1 --2- 172.21.15.103:0/1526615337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc85c004800 0x7fc8701ed150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc860015680 tx=0x7fc860015b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:33.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.098+0000 7fc865ffb640 1 -- 172.21.15.103:0/1526615337 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc860013a60 con 0x7fc85c004800 2024-09-10T08:29:33.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.098+0000 7fc865ffb640 1 -- 172.21.15.103:0/1526615337 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc860013c20 con 0x7fc85c004800 2024-09-10T08:29:33.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.098+0000 7fc877847640 1 -- 172.21.15.103:0/1526615337 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8700aa100 con 0x7fc85c004800 2024-09-10T08:29:33.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.098+0000 7fc865ffb640 1 -- 172.21.15.103:0/1526615337 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc860020480 con 0x7fc85c004800 2024-09-10T08:29:33.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.098+0000 7fc877847640 1 -- 172.21.15.103:0/1526615337 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8700a7b10 con 0x7fc85c004800 2024-09-10T08:29:33.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.099+0000 7fc877847640 1 -- 172.21.15.103:0/1526615337 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8700c2830 con 0x7fc85c004800 2024-09-10T08:29:33.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.099+0000 7fc865ffb640 1 -- 172.21.15.103:0/1526615337 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc860020620 con 0x7fc85c004800 2024-09-10T08:29:33.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.100+0000 7fc865ffb640 1 --2- 172.21.15.103:0/1526615337 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc85406c3a0 0x7fc85406e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.100+0000 7fc865ffb640 1 -- 172.21.15.103:0/1526615337 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fc86008c1e0 con 0x7fc85c004800 2024-09-10T08:29:33.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.100+0000 7fc8755e3640 1 --2- 172.21.15.103:0/1526615337 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc85406c3a0 0x7fc85406e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.100+0000 7fc8755e3640 1 --2- 172.21.15.103:0/1526615337 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc85406c3a0 0x7fc85406e860 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc86c007fd0 tx=0x7fc86c005040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:33.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.105+0000 7fc865ffb640 1 -- 172.21.15.103:0/1526615337 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc8700c2830 con 0x7fc85c004800 2024-09-10T08:29:33.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.348+0000 7fc877847640 1 -- 172.21.15.103:0/1526615337 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc870151c20 con 0x7fc85c004800 2024-09-10T08:29:33.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.348+0000 7fc865ffb640 1 -- 172.21.15.103:0/1526615337 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1561 (secure 0 0 0) 0x7fc86005a970 con 0x7fc85c004800 2024-09-10T08:29:33.349 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":6,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:29:33.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.350+0000 7fc877847640 1 -- 172.21.15.103:0/1526615337 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc85406c3a0 msgr2=0x7fc85406e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.350+0000 7fc877847640 1 --2- 172.21.15.103:0/1526615337 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc85406c3a0 0x7fc85406e860 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc86c007fd0 tx=0x7fc86c005040 comp rx=0 tx=0).stop 2024-09-10T08:29:33.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.350+0000 7fc877847640 1 -- 172.21.15.103:0/1526615337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc85c004800 msgr2=0x7fc8701ed150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.350+0000 7fc877847640 1 --2- 172.21.15.103:0/1526615337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc85c004800 0x7fc8701ed150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc860015680 tx=0x7fc860015b40 comp rx=0 tx=0).stop 2024-09-10T08:29:33.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.350+0000 7fc877847640 1 -- 172.21.15.103:0/1526615337 shutdown_connections 2024-09-10T08:29:33.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.350+0000 7fc877847640 1 --2- 172.21.15.103:0/1526615337 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc85406c3a0 0x7fc85406e860 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.350+0000 7fc877847640 1 --2- 172.21.15.103:0/1526615337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc85c005210 0x7fc8700a9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.350+0000 7fc877847640 1 --2- 172.21.15.103:0/1526615337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc85c004800 0x7fc8701ed150 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.350+0000 7fc877847640 1 --2- 172.21.15.103:0/1526615337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc85c0039b0 0x7fc870071730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.350+0000 7fc877847640 1 -- 172.21.15.103:0/1526615337 >> 172.21.15.103:0/1526615337 conn(0x7fc8700c7a40 msgr2=0x7fc8700c6060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:33.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.351+0000 7fc877847640 1 -- 172.21.15.103:0/1526615337 shutdown_connections 2024-09-10T08:29:33.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.351+0000 7fc877847640 1 -- 172.21.15.103:0/1526615337 wait complete. 2024-09-10T08:29:33.362 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-10T08:29:33.363 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-10T08:29:33.363 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:29:33.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.510+0000 7f432d2f8640 1 Processor -- start 2024-09-10T08:29:33.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.510+0000 7f432d2f8640 1 -- start start 2024-09-10T08:29:33.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.510+0000 7f432d2f8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43280ca390 0x7f4328161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.510+0000 7f432d2f8640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f432815a7c0 con 0x7f4328150480 2024-09-10T08:29:33.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.510+0000 7f432d2f8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4328159a00 con 0x7f432806c650 2024-09-10T08:29:33.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.510+0000 7f432d2f8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f432806c240 con 0x7f43280ca390 2024-09-10T08:29:33.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.511+0000 7f43267fc640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f432806c650 legacy=0x7f43280c9c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:29:33.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.511+0000 7f4326ffd640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4328150480 0x7f43280c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:38308/0 (socket says 172.21.15.103:38308) 2024-09-10T08:29:33.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.511+0000 7f4326ffd640 1 -- 172.21.15.103:0/2223533956 learned_addr learned my addr 172.21.15.103:0/2223533956 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:29:33.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.511+0000 7f43277fe640 1 --2- 172.21.15.103:0/2223533956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43280ca390 0x7f4328161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.511+0000 7f4325ffb640 1 -- 172.21.15.103:0/2223533956 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1900188552 0 0) 0x7f432815a7c0 con 0x7f4328150480 2024-09-10T08:29:33.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.511+0000 7f4325ffb640 1 -- 172.21.15.103:0/2223533956 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4310003520 con 0x7f4328150480 2024-09-10T08:29:33.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.511+0000 7f43277fe640 1 -- 172.21.15.103:0/2223533956 >> v1:172.21.15.154:6789/0 conn(0x7f432806c650 legacy=0x7f43280c9c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:29:33.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.511+0000 7f43277fe640 1 -- 172.21.15.103:0/2223533956 >> v1:172.21.15.103:6789/0 conn(0x7f4328150480 legacy=0x7f43280c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.511+0000 7f43277fe640 1 -- 172.21.15.103:0/2223533956 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4328159ce0 con 0x7f43280ca390 2024-09-10T08:29:33.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.512+0000 7f43277fe640 1 --2- 172.21.15.103:0/2223533956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43280ca390 0x7f4328161c00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4320009dc0 tx=0x7f432002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86a0956c96e40c80 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:33.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.512+0000 7f4325ffb640 1 -- 172.21.15.103:0/2223533956 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432002ae60 con 0x7f43280ca390 2024-09-10T08:29:33.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.512+0000 7f4325ffb640 1 -- 172.21.15.103:0/2223533956 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4320007740 con 0x7f43280ca390 2024-09-10T08:29:33.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.512+0000 7f4325ffb640 1 -- 172.21.15.103:0/2223533956 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4320007b10 con 0x7f43280ca390 2024-09-10T08:29:33.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.512+0000 7f432d2f8640 1 -- 172.21.15.103:0/2223533956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43280ca390 msgr2=0x7f4328161c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.512+0000 7f432d2f8640 1 --2- 172.21.15.103:0/2223533956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43280ca390 0x7f4328161c00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4320009dc0 tx=0x7f432002a680 comp rx=0 tx=0).stop 2024-09-10T08:29:33.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.513+0000 7f432d2f8640 1 -- 172.21.15.103:0/2223533956 shutdown_connections 2024-09-10T08:29:33.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.513+0000 7f432d2f8640 1 --2- 172.21.15.103:0/2223533956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43280ca390 0x7f4328161c00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.513+0000 7f432d2f8640 1 -- 172.21.15.103:0/2223533956 >> 172.21.15.103:0/2223533956 conn(0x7f4328068030 msgr2=0x7f4328073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:33.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.513+0000 7f432d2f8640 1 -- 172.21.15.103:0/2223533956 shutdown_connections 2024-09-10T08:29:33.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.513+0000 7f432d2f8640 1 -- 172.21.15.103:0/2223533956 wait complete. 2024-09-10T08:29:33.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.514+0000 7f432d2f8640 1 Processor -- start 2024-09-10T08:29:33.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.514+0000 7f432d2f8640 1 -- start start 2024-09-10T08:29:33.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f432d2f8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f432806c650 0x7f43281ec0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f432d2f8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43280ca390 0x7f43281e34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f432d2f8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4328150480 0x7f43281508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f432d2f8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f432806d270 con 0x7f4328150480 2024-09-10T08:29:33.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f432d2f8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f432815a330 con 0x7f432806c650 2024-09-10T08:29:33.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f432d2f8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f43280c81a0 con 0x7f43280ca390 2024-09-10T08:29:33.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f4326ffd640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f432806c650 msgr2=0x7f43281ec0e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:29:33.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f4326ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f432806c650 0x7f43281ec0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:29:33.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f43277fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4328150480 0x7f43281508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f43267fc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43280ca390 0x7f43281e34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f43277fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4328150480 0x7f43281508f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33148/0 (socket says 172.21.15.103:33148) 2024-09-10T08:29:33.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f43267fc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43280ca390 0x7f43281e34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:60366/0 (socket says 172.21.15.103:60366) 2024-09-10T08:29:33.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f43277fe640 1 -- 172.21.15.103:0/4178443936 learned_addr learned my addr 172.21.15.103:0/4178443936 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:33.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f43267fc640 1 -- 172.21.15.103:0/4178443936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f432806c650 msgr2=0x7f43281ec0e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:29:33.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f43267fc640 1 --2- 172.21.15.103:0/4178443936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f432806c650 0x7f43281ec0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f43267fc640 1 -- 172.21.15.103:0/4178443936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4328150480 msgr2=0x7f43281508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f43267fc640 1 --2- 172.21.15.103:0/4178443936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4328150480 0x7f43281508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f43267fc640 1 -- 172.21.15.103:0/4178443936 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43281f0010 con 0x7f43280ca390 2024-09-10T08:29:33.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f43267fc640 1 --2- 172.21.15.103:0/4178443936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43280ca390 0x7f43281e34e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f431c003930 tx=0x7f431c00b9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:33.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f430f7fe640 1 -- 172.21.15.103:0/4178443936 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c003dc0 con 0x7f43280ca390 2024-09-10T08:29:33.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f430f7fe640 1 -- 172.21.15.103:0/4178443936 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f431c015070 con 0x7f43280ca390 2024-09-10T08:29:33.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f430f7fe640 1 -- 172.21.15.103:0/4178443936 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c005290 con 0x7f43280ca390 2024-09-10T08:29:33.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.515+0000 7f432d2f8640 1 -- 172.21.15.103:0/4178443936 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43281f02b0 con 0x7f43280ca390 2024-09-10T08:29:33.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.516+0000 7f432d2f8640 1 -- 172.21.15.103:0/4178443936 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f43281e3a20 con 0x7f43280ca390 2024-09-10T08:29:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.517+0000 7f432d2f8640 1 --2- 172.21.15.103:0/4178443936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4328151250 0x7f43280afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.517+0000 7f432d2f8640 1 -- 172.21.15.103:0/4178443936 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f432806c430 con 0x7f4328151250 2024-09-10T08:29:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.517+0000 7f4326ffd640 1 --2- 172.21.15.103:0/4178443936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4328151250 0x7f43280afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.517+0000 7f4326ffd640 1 -- 172.21.15.103:0/4178443936 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f43280734f0 con 0x7f4328151250 2024-09-10T08:29:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.517+0000 7f4326ffd640 1 --2- 172.21.15.103:0/4178443936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4328151250 0x7f43280afb30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f43281e2a00 tx=0x7f431800c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.517+0000 7f430f7fe640 1 -- 172.21.15.103:0/4178443936 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f431c00f070 con 0x7f43280ca390 2024-09-10T08:29:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.518+0000 7f430f7fe640 1 --2- 172.21.15.103:0/4178443936 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f431406bde0 0x7f431406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.518+0000 7f430f7fe640 1 -- 172.21.15.103:0/4178443936 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f431c08a8d0 con 0x7f43280ca390 2024-09-10T08:29:33.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.518+0000 7f43277fe640 1 --2- 172.21.15.103:0/4178443936 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f431406bde0 0x7f431406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.518+0000 7f430f7fe640 1 -- 172.21.15.103:0/4178443936 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4318017070 con 0x7f4328151250 2024-09-10T08:29:33.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.518+0000 7f430f7fe640 1 -- 172.21.15.103:0/4178443936 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4318005da0 con 0x7f4328151250 2024-09-10T08:29:33.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.518+0000 7f430f7fe640 1 -- 172.21.15.103:0/4178443936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4328151250 msgr2=0x7f43280afb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.518+0000 7f430f7fe640 1 --2- 172.21.15.103:0/4178443936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4328151250 0x7f43280afb30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f43281e2a00 tx=0x7f431800c7a0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.518+0000 7f430f7fe640 1 -- 172.21.15.103:0/4178443936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4328151250 msgr2=0x7f43280afb30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:29:33.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.518+0000 7f430f7fe640 1 --2- 172.21.15.103:0/4178443936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4328151250 0x7f43280afb30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.518+0000 7f43277fe640 1 --2- 172.21.15.103:0/4178443936 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f431406bde0 0x7f431406e2a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4320009bd0 tx=0x7f432002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:33.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.525+0000 7f432d2f8640 1 --2- 172.21.15.103:0/4178443936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43280b0070 0x7f43280b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.525+0000 7f432d2f8640 1 -- 172.21.15.103:0/4178443936 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f43280b0990 con 0x7f43280b0070 2024-09-10T08:29:33.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.525+0000 7f4326ffd640 1 --2- 172.21.15.103:0/4178443936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43280b0070 0x7f43280b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.525+0000 7f4326ffd640 1 -- 172.21.15.103:0/4178443936 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f43281e2380 con 0x7f43280b0070 2024-09-10T08:29:33.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.525+0000 7f4326ffd640 1 --2- 172.21.15.103:0/4178443936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43280b0070 0x7f43280b0450 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4318000c00 tx=0x7f4318000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:33.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.526+0000 7f430f7fe640 1 -- 172.21.15.103:0/4178443936 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4318017040 con 0x7f43280b0070 2024-09-10T08:29:33.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.526+0000 7f430f7fe640 1 -- 172.21.15.103:0/4178443936 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5043 (secure 0 0 0) 0x7f4318023630 con 0x7f43280b0070 2024-09-10T08:29:33.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.526+0000 7f430f7fe640 1 -- 172.21.15.103:0/4178443936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43280b0070 msgr2=0x7f43280b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.526+0000 7f430f7fe640 1 --2- 172.21.15.103:0/4178443936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43280b0070 0x7f43280b0450 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4318000c00 tx=0x7f4318000ed0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.526+0000 7f430f7fe640 1 -- 172.21.15.103:0/4178443936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43280b0070 msgr2=0x7f43280b0450 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:29:33.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.526+0000 7f430f7fe640 1 --2- 172.21.15.103:0/4178443936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43280b0070 0x7f43280b0450 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.527 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:29:33.527 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:29:33.527 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:29:33.527 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:29:33.527 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 6, 2024-09-10T08:29:33.527 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 81089, 2024-09-10T08:29:33.528 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:29:33.528 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:29:33.528 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:29:33.528 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:33.528 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:29:33.528 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:29:33.528 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:29:33.528 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:29:33.528 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:29:33.528 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:29:33.528 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:29:33.528 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:29:33.528 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:29:33.529 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:29:33.529 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:29:33.529 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:29:33.529 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:29:33.529 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:29:33.529 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:29:33.529 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:33.529 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:29:33.529 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:29:33.529 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:29:33.529 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:29:33.529 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:29:33.529 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:29:33.529 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:29:33.529 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:29:33.530 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:29:33.530 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:29:33.530 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:29:33.530 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:29:33.530 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:29:33.530 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:33.530 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.530 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:29:33.530 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:29:33.530 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:29:33.530 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:29:33.530 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:29:33.530 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:29:33.530 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:29:33.531 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:29:33.531 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:29:33.531 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:29:33.531 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:29:33.531 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:29:33.531 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:29:33.531 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:29:33.531 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:29:33.531 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:29:33.531 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:29:33.531 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:29:33.531 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:29:33.531 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:29:33.531 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:29:33.532 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:29:33.532 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:29:33.532 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:29:33.532 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:29:33.532 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:29:33.532 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:29:33.532 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:29:33.532 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:33.532 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:29:33.532 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.532 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:29:33.532 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.532 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:29:33.532 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:29:33.532 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:29:33.533 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:29:33.533 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.533 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:29:33.533 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:29:33.533 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:33.533 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.533 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.533 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:29:33.533 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:29:33.533 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:33.533 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:33.533 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:33.533 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.533 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:29:33.534 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:29:33.534 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:29:33.534 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:29:33.534 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:29:33.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.534 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.534 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:29:33.534 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:29:33.534 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:29:33.534 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:29:33.534 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.534 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:29:33.534 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:29:33.534 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:33.535 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.535 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.535 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:29:33.535 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:29:33.535 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:33.535 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:33.535 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:33.535 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.535 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:29:33.535 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:29:33.535 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:29:33.535 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:29:33.535 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:29:33.535 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.536 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.536 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:29:33.536 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:29:33.536 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:29:33.536 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:29:33.536 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.536 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:29:33.536 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:29:33.536 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:33.536 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.536 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.536 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:29:33.536 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:29:33.536 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:33.537 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:33.537 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:33.537 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.537 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:29:33.537 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:29:33.537 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:29:33.537 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:29:33.537 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:29:33.537 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:33.537 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:33.537 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.537 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:29:33.537 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:29:33.537 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.537 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:33.538 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:33.538 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:29:33.538 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:33.538 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:33.538 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:29:33.538 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.538 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:33.538 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:33.538 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:29:33.538 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:33.538 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:33.538 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:29:33.538 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.538 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:33.538 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:33.539 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-10T08:29:33.539 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:33.539 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:33.539 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:29:33.539 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.539 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:33.539 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:33.539 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:29:33.539 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:33.539 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:33.539 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:29:33.539 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.539 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:33.539 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:33.539 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:29:33.540 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:33.540 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:33.540 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.540 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:29:33.540 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:29:33.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.526+0000 7f432d2f8640 1 -- 172.21.15.103:0/4178443936 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f431406bde0 msgr2=0x7f431406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.526+0000 7f432d2f8640 1 --2- 172.21.15.103:0/4178443936 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f431406bde0 0x7f431406e2a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4320009bd0 tx=0x7f432002f000 comp rx=0 tx=0).stop 2024-09-10T08:29:33.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.526+0000 7f432d2f8640 1 -- 172.21.15.103:0/4178443936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43280ca390 msgr2=0x7f43281e34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.526+0000 7f432d2f8640 1 --2- 172.21.15.103:0/4178443936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43280ca390 0x7f43281e34e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f431c003930 tx=0x7f431c00b9b0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.526+0000 7f43277fe640 1 -- 172.21.15.103:0/4178443936 reap_dead start 2024-09-10T08:29:33.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.526+0000 7f43277fe640 1 -- 172.21.15.103:0/4178443936 reap_dead start 2024-09-10T08:29:33.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.526+0000 7f432d2f8640 1 -- 172.21.15.103:0/4178443936 shutdown_connections 2024-09-10T08:29:33.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.526+0000 7f432d2f8640 1 -- 172.21.15.103:0/4178443936 >> 172.21.15.103:0/4178443936 conn(0x7f4328068030 msgr2=0x7f43280ca770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:33.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.526+0000 7f432d2f8640 1 -- 172.21.15.103:0/4178443936 shutdown_connections 2024-09-10T08:29:33.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.526+0000 7f432d2f8640 1 -- 172.21.15.103:0/4178443936 wait complete. 2024-09-10T08:29:33.542 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:29:33.542 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-10T08:29:33.542 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:29:33.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.643+0000 7f40d1178640 1 Processor -- start 2024-09-10T08:29:33.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.643+0000 7f40d1178640 1 -- start start 2024-09-10T08:29:33.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.644+0000 7f40d1178640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f40cc0afa80 0x7f40cc06e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.644+0000 7f40d1178640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40cc15aeb0 con 0x7f40cc157d50 2024-09-10T08:29:33.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.644+0000 7f40d1178640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40cc15b190 con 0x7f40cc06e710 2024-09-10T08:29:33.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.644+0000 7f40d1178640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f40cc06ef00 con 0x7f40cc0afa80 2024-09-10T08:29:33.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.644+0000 7f40cb59e640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f40cc06e710 legacy=0x7f40cc06f670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:29:33.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.644+0000 7f40ca59c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f40cc0afa80 0x7f40cc06e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.644+0000 7f40cad9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f40cc157d50 0x7f40cc15a610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:38320/0 (socket says 172.21.15.103:38320) 2024-09-10T08:29:33.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.644+0000 7f40cad9d640 1 -- 172.21.15.103:0/629600429 learned_addr learned my addr 172.21.15.103:0/629600429 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:29:33.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.645+0000 7f40ca59c640 1 -- 172.21.15.103:0/629600429 >> v1:172.21.15.154:6789/0 conn(0x7f40cc06e710 legacy=0x7f40cc06f670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:29:33.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.645+0000 7f40ca59c640 1 -- 172.21.15.103:0/629600429 >> v1:172.21.15.103:6789/0 conn(0x7f40cc157d50 legacy=0x7f40cc15a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.645+0000 7f40c9d9b640 1 -- 172.21.15.103:0/629600429 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 427006611 0 0) 0x7f40cc15aeb0 con 0x7f40cc157d50 2024-09-10T08:29:33.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.645+0000 7f40ca59c640 1 -- 172.21.15.103:0/629600429 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40cc15b470 con 0x7f40cc0afa80 2024-09-10T08:29:33.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.646+0000 7f40ca59c640 1 --2- 172.21.15.103:0/629600429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40cc0afa80 0x7f40cc06e1d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f40c00097a0 tx=0x7f40c002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d86a2edee4b117f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:33.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.646+0000 7f40c9d9b640 1 -- 172.21.15.103:0/629600429 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c0037070 con 0x7f40cc0afa80 2024-09-10T08:29:33.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.646+0000 7f40c9d9b640 1 -- 172.21.15.103:0/629600429 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c0032440 con 0x7f40cc0afa80 2024-09-10T08:29:33.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.646+0000 7f40c9d9b640 1 -- 172.21.15.103:0/629600429 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c0032810 con 0x7f40cc0afa80 2024-09-10T08:29:33.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.646+0000 7f40d1178640 1 -- 172.21.15.103:0/629600429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40cc0afa80 msgr2=0x7f40cc06e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.646+0000 7f40d1178640 1 --2- 172.21.15.103:0/629600429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40cc0afa80 0x7f40cc06e1d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f40c00097a0 tx=0x7f40c002a1e0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.646+0000 7f40d1178640 1 -- 172.21.15.103:0/629600429 shutdown_connections 2024-09-10T08:29:33.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.646+0000 7f40d1178640 1 --2- 172.21.15.103:0/629600429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40cc0afa80 0x7f40cc06e1d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.646+0000 7f40d1178640 1 -- 172.21.15.103:0/629600429 >> 172.21.15.103:0/629600429 conn(0x7f40cc0c9d80 msgr2=0x7f40cc0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:33.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.646+0000 7f40d1178640 1 -- 172.21.15.103:0/629600429 shutdown_connections 2024-09-10T08:29:33.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.646+0000 7f40d1178640 1 -- 172.21.15.103:0/629600429 wait complete. 2024-09-10T08:29:33.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.648+0000 7f40d1178640 1 Processor -- start 2024-09-10T08:29:33.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.648+0000 7f40d1178640 1 -- start start 2024-09-10T08:29:33.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.649+0000 7f40d1178640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40cc06e710 0x7f40cc153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.649+0000 7f40d1178640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40cc0afa80 0x7f40cc154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.649+0000 7f40d1178640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc157d50 0x7f40cc14b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.649+0000 7f40d1178640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f40cc06fd80 con 0x7f40cc0afa80 2024-09-10T08:29:33.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.649+0000 7f40d1178640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f40cc06f1e0 con 0x7f40cc06e710 2024-09-10T08:29:33.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.649+0000 7f40d1178640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f40cc06ff00 con 0x7f40cc157d50 2024-09-10T08:29:33.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.649+0000 7f40cad9d640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40cc06e710 msgr2=0x7f40cc153fb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:29:33.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.649+0000 7f40cad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40cc06e710 0x7f40cc153fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:29:33.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.649+0000 7f40ca59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40cc0afa80 0x7f40cc154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.649+0000 7f40ca59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40cc0afa80 0x7f40cc154c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33190/0 (socket says 172.21.15.103:33190) 2024-09-10T08:29:33.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.649+0000 7f40ca59c640 1 -- 172.21.15.103:0/447166746 learned_addr learned my addr 172.21.15.103:0/447166746 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:29:33.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.649+0000 7f40cb59e640 1 --2- 172.21.15.103:0/447166746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc157d50 0x7f40cc14b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.649+0000 7f40ca59c640 1 -- 172.21.15.103:0/447166746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc157d50 msgr2=0x7f40cc14b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.649+0000 7f40ca59c640 1 --2- 172.21.15.103:0/447166746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc157d50 0x7f40cc14b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.649+0000 7f40ca59c640 1 -- 172.21.15.103:0/447166746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40cc06e710 msgr2=0x7f40cc153fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:29:33.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.649+0000 7f40ca59c640 1 --2- 172.21.15.103:0/447166746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40cc06e710 0x7f40cc153fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.649+0000 7f40ca59c640 1 -- 172.21.15.103:0/447166746 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40cc15a360 con 0x7f40cc0afa80 2024-09-10T08:29:33.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.649+0000 7f40ca59c640 1 --2- 172.21.15.103:0/447166746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40cc0afa80 0x7f40cc154c10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f40c00098c0 tx=0x7f40c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:33.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.649+0000 7f40b37fe640 1 -- 172.21.15.103:0/447166746 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c0041070 con 0x7f40cc0afa80 2024-09-10T08:29:33.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.649+0000 7f40b37fe640 1 -- 172.21.15.103:0/447166746 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c003c870 con 0x7f40cc0afa80 2024-09-10T08:29:33.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.649+0000 7f40d1178640 1 -- 172.21.15.103:0/447166746 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40cc1534d0 con 0x7f40cc0afa80 2024-09-10T08:29:33.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.650+0000 7f40b37fe640 1 -- 172.21.15.103:0/447166746 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c0037040 con 0x7f40cc0afa80 2024-09-10T08:29:33.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.650+0000 7f40d1178640 1 -- 172.21.15.103:0/447166746 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40cc155150 con 0x7f40cc0afa80 2024-09-10T08:29:33.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.650+0000 7f40d1178640 1 --2- 172.21.15.103:0/447166746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc14b730 0x7f40cc0c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.650+0000 7f40d1178640 1 -- 172.21.15.103:0/447166746 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f40cc159980 con 0x7f40cc14b730 2024-09-10T08:29:33.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.651+0000 7f40cad9d640 1 --2- 172.21.15.103:0/447166746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc14b730 0x7f40cc0c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.651+0000 7f40cad9d640 1 -- 172.21.15.103:0/447166746 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f40cc070310 con 0x7f40cc14b730 2024-09-10T08:29:33.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.651+0000 7f40cad9d640 1 --2- 172.21.15.103:0/447166746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc14b730 0x7f40cc0c4c10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f40bc004870 tx=0x7f40bc00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:33.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.651+0000 7f40b37fe640 1 -- 172.21.15.103:0/447166746 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc004cb0 con 0x7f40cc14b730 2024-09-10T08:29:33.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.652+0000 7f40b37fe640 1 -- 172.21.15.103:0/447166746 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f40c0044070 con 0x7f40cc0afa80 2024-09-10T08:29:33.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.652+0000 7f40b37fe640 1 --2- 172.21.15.103:0/447166746 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f40b806bd60 0x7f40b806e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.652+0000 7f40b37fe640 1 -- 172.21.15.103:0/447166746 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f40bc004e50 con 0x7f40cc14b730 2024-09-10T08:29:33.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.652+0000 7f40cb59e640 1 --2- 172.21.15.103:0/447166746 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f40b806bd60 0x7f40b806e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.652+0000 7f40b37fe640 1 -- 172.21.15.103:0/447166746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc14b730 msgr2=0x7f40cc0c4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.652+0000 7f40b37fe640 1 --2- 172.21.15.103:0/447166746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc14b730 0x7f40cc0c4c10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f40bc004870 tx=0x7f40bc00c830 comp rx=0 tx=0).stop 2024-09-10T08:29:33.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.652+0000 7f40b37fe640 1 -- 172.21.15.103:0/447166746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc14b730 msgr2=0x7f40cc0c4c10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:29:33.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.652+0000 7f40b37fe640 1 --2- 172.21.15.103:0/447166746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc14b730 0x7f40cc0c4c10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.652+0000 7f40b37fe640 1 -- 172.21.15.103:0/447166746 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f40c00ab8d0 con 0x7f40cc0afa80 2024-09-10T08:29:33.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.652+0000 7f40cb59e640 1 --2- 172.21.15.103:0/447166746 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f40b806bd60 0x7f40b806e220 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f40c4003bc0 tx=0x7f40c400d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:33.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.658+0000 7f40d1178640 1 --2- 172.21.15.103:0/447166746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc153840 0x7f40cc0c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.658+0000 7f40d1178640 1 -- 172.21.15.103:0/447166746 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f40cc0af860 con 0x7f40cc153840 2024-09-10T08:29:33.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.658+0000 7f40cad9d640 1 --2- 172.21.15.103:0/447166746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc153840 0x7f40cc0c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.659+0000 7f40cad9d640 1 -- 172.21.15.103:0/447166746 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f40cc14bb10 con 0x7f40cc153840 2024-09-10T08:29:33.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.659+0000 7f40cad9d640 1 --2- 172.21.15.103:0/447166746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc153840 0x7f40cc0c5150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f40bc013000 tx=0x7f40bc00f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:33.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.659+0000 7f40b37fe640 1 -- 172.21.15.103:0/447166746 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc01b3e0 con 0x7f40cc153840 2024-09-10T08:29:33.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.659+0000 7f40b37fe640 1 -- 172.21.15.103:0/447166746 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5041 (secure 0 0 0) 0x7f40bc019040 con 0x7f40cc153840 2024-09-10T08:29:33.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.659+0000 7f40b37fe640 1 -- 172.21.15.103:0/447166746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc153840 msgr2=0x7f40cc0c5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.659+0000 7f40b37fe640 1 --2- 172.21.15.103:0/447166746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc153840 0x7f40cc0c5150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f40bc013000 tx=0x7f40bc00f000 comp rx=0 tx=0).stop 2024-09-10T08:29:33.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.659+0000 7f40b37fe640 1 -- 172.21.15.103:0/447166746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc153840 msgr2=0x7f40cc0c5150 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:29:33.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.659+0000 7f40b37fe640 1 --2- 172.21.15.103:0/447166746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc153840 0x7f40cc0c5150 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f40bc013000 tx=0x7f40bc00f000 comp rx=0 tx=0).stop 2024-09-10T08:29:33.660 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:29:33.661 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:29:33.661 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:29:33.661 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:29:33.661 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 6, 2024-09-10T08:29:33.661 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 81220, 2024-09-10T08:29:33.661 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:29:33.661 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:29:33.661 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:29:33.661 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:33.661 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:29:33.661 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:29:33.661 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:29:33.662 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:29:33.662 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:29:33.662 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:29:33.662 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:29:33.662 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:29:33.662 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:29:33.662 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:29:33.662 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:29:33.662 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:29:33.662 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:29:33.662 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:29:33.662 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:29:33.662 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:33.663 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:29:33.663 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:29:33.663 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:29:33.663 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:29:33.663 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:29:33.663 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:29:33.663 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:29:33.663 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:29:33.663 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:29:33.663 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:29:33.663 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:29:33.663 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:29:33.663 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:29:33.664 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:33.664 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.664 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:29:33.664 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:29:33.664 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:29:33.664 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:29:33.664 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:29:33.664 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:29:33.664 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:29:33.664 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:29:33.664 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:29:33.664 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:29:33.664 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:29:33.665 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:29:33.665 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:29:33.665 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:29:33.665 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:29:33.665 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:29:33.665 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:29:33.665 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:29:33.665 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:29:33.665 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:29:33.665 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:29:33.665 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:29:33.665 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:29:33.665 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:29:33.666 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:29:33.666 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:29:33.666 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:29:33.666 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:29:33.666 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:33.666 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:29:33.666 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.666 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:29:33.666 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.666 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:29:33.666 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:29:33.666 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:29:33.666 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:29:33.666 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.667 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:29:33.667 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:29:33.667 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:33.667 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.667 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.667 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:29:33.667 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:29:33.667 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:33.667 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:33.667 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:33.667 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.667 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:29:33.667 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:29:33.668 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:29:33.668 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:29:33.668 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:29:33.668 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.668 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.668 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:29:33.668 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:29:33.668 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:29:33.668 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:29:33.668 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.668 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:29:33.668 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:29:33.669 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:33.669 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.669 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.669 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:29:33.669 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:29:33.669 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:33.669 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:33.669 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:33.669 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.669 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:29:33.669 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:29:33.669 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:29:33.669 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:29:33.670 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:29:33.670 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.670 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.670 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:29:33.670 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:29:33.670 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:29:33.670 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:29:33.670 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.670 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:29:33.670 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:29:33.670 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:33.670 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.670 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.670 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:29:33.670 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:29:33.671 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:29:33.671 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:33.671 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:33.671 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.671 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:29:33.671 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:29:33.671 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:29:33.671 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:29:33.671 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:29:33.671 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:33.671 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:33.671 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.671 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:29:33.671 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:29:33.672 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.672 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:33.672 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:33.672 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:29:33.672 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:33.672 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:33.672 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:29:33.672 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.672 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:33.672 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:33.672 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:29:33.672 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:33.672 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:33.672 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:29:33.673 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.673 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:33.673 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:33.673 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:29:33.673 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:33.673 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:33.673 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:29:33.673 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.673 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:33.673 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:33.673 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:29:33.673 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:33.673 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:29:33.673 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:29:33.674 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:29:33.674 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:29:33.674 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:29:33.674 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:29:33.674 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:29:33.674 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:29:33.674 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:29:33.674 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:29:33.674 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:29:33.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.660+0000 7f40d1178640 1 -- 172.21.15.103:0/447166746 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f40b806bd60 msgr2=0x7f40b806e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.660+0000 7f40d1178640 1 --2- 172.21.15.103:0/447166746 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f40b806bd60 0x7f40b806e220 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f40c4003bc0 tx=0x7f40c400d040 comp rx=0 tx=0).stop 2024-09-10T08:29:33.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.660+0000 7f40d1178640 1 -- 172.21.15.103:0/447166746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40cc0afa80 msgr2=0x7f40cc154c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.660+0000 7f40d1178640 1 --2- 172.21.15.103:0/447166746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40cc0afa80 0x7f40cc154c10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f40c00098c0 tx=0x7f40c00046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.660+0000 7f40cb59e640 1 -- 172.21.15.103:0/447166746 reap_dead start 2024-09-10T08:29:33.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.660+0000 7f40cb59e640 1 -- 172.21.15.103:0/447166746 reap_dead start 2024-09-10T08:29:33.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.660+0000 7f40d1178640 1 -- 172.21.15.103:0/447166746 shutdown_connections 2024-09-10T08:29:33.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.660+0000 7f40d1178640 1 -- 172.21.15.103:0/447166746 >> 172.21.15.103:0/447166746 conn(0x7f40cc0c9d80 msgr2=0x7f40cc06f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:33.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.660+0000 7f40d1178640 1 -- 172.21.15.103:0/447166746 shutdown_connections 2024-09-10T08:29:33.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:29:33.660+0000 7f40d1178640 1 -- 172.21.15.103:0/447166746 wait complete. 2024-09-10T08:29:33.676 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:29:33.676 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-10T08:29:53.677 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-10T08:29:53.678 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-10T08:29:53.678 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T08:29:53.678 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T08:29:53.681 INFO:tasks.ceph.mon.b:Started 2024-09-10T08:29:53.682 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-09-10T08:29:53.682 INFO:tasks.ceph.mon.c:Sent signal 19 2024-09-10T08:29:53.682 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-10T08:29:58.808 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:29:58.813 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:30:08.683 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-09-10T08:30:08.683 INFO:tasks.ceph.mon.c:Sent signal 18 2024-09-10T08:30:08.684 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:30:08.684 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:30:08.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.791+0000 7f9f3d865640 1 Processor -- start 2024-09-10T08:30:08.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.791+0000 7f9f3d865640 1 -- start start 2024-09-10T08:30:08.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.792+0000 7f9f3d865640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9f380c69c0 0x7f9f38153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:08.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.792+0000 7f9f3d865640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380c42b0 0x7f9f380c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:08.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.792+0000 7f9f3d865640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f380c5940 con 0x7f9f381505f0 2024-09-10T08:30:08.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.792+0000 7f9f3d865640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9f380c7860 con 0x7f9f380c69c0 2024-09-10T08:30:08.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.792+0000 7f9f3d865640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9f380c5c00 con 0x7f9f380c42b0 2024-09-10T08:30:08.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.792+0000 7f9f377fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380c42b0 0x7f9f380c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:08.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.792+0000 7f9f367fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9f380c69c0 0x7f9f38153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:08.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.792+0000 7f9f377fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380c42b0 0x7f9f380c46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:42018/0 (socket says 172.21.15.103:42018) 2024-09-10T08:30:08.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.792+0000 7f9f377fe640 1 -- 172.21.15.103:0/3136180318 learned_addr learned my addr 172.21.15.103:0/3136180318 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:08.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.793+0000 7f9f367fc640 1 -- 172.21.15.103:0/3136180318 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380c42b0 msgr2=0x7f9f380c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:08.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.793+0000 7f9f367fc640 1 --2- 172.21.15.103:0/3136180318 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380c42b0 0x7f9f380c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:08.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.793+0000 7f9f367fc640 1 -- 172.21.15.103:0/3136180318 >> v1:172.21.15.154:6789/0 conn(0x7f9f381505f0 legacy=0x7f9f380c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:08.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.793+0000 7f9f367fc640 1 -- 172.21.15.103:0/3136180318 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f380c5ee0 con 0x7f9f380c69c0 2024-09-10T08:30:08.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.793+0000 7f9f377fe640 1 --2- 172.21.15.103:0/3136180318 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380c42b0 0x7f9f380c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:30:08.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.794+0000 7f9f367fc640 1 --2- 172.21.15.103:0/3136180318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f380c69c0 0x7f9f38153910 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0097a0 tx=0x7f9f2c02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1feead405da6788d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:08.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.794+0000 7f9f35ffb640 1 -- 172.21.15.103:0/3136180318 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c037070 con 0x7f9f380c69c0 2024-09-10T08:30:08.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.794+0000 7f9f35ffb640 1 -- 172.21.15.103:0/3136180318 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f2c02ae50 con 0x7f9f380c69c0 2024-09-10T08:30:08.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.794+0000 7f9f35ffb640 1 -- 172.21.15.103:0/3136180318 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c032660 con 0x7f9f380c69c0 2024-09-10T08:30:08.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.794+0000 7f9f3d865640 1 -- 172.21.15.103:0/3136180318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f380c69c0 msgr2=0x7f9f38153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:08.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.794+0000 7f9f3d865640 1 --2- 172.21.15.103:0/3136180318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f380c69c0 0x7f9f38153910 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0097a0 tx=0x7f9f2c02a100 comp rx=0 tx=0).stop 2024-09-10T08:30:08.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.795+0000 7f9f3d865640 1 -- 172.21.15.103:0/3136180318 shutdown_connections 2024-09-10T08:30:08.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.795+0000 7f9f3d865640 1 --2- 172.21.15.103:0/3136180318 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380c42b0 0x7f9f380c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:08.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.795+0000 7f9f3d865640 1 --2- 172.21.15.103:0/3136180318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f380c69c0 0x7f9f38153910 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:08.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.795+0000 7f9f3d865640 1 -- 172.21.15.103:0/3136180318 >> 172.21.15.103:0/3136180318 conn(0x7f9f380c7a40 msgr2=0x7f9f380c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:08.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.795+0000 7f9f3d865640 1 -- 172.21.15.103:0/3136180318 shutdown_connections 2024-09-10T08:30:08.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.795+0000 7f9f3d865640 1 -- 172.21.15.103:0/3136180318 wait complete. 2024-09-10T08:30:08.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.796+0000 7f9f3d865640 1 Processor -- start 2024-09-10T08:30:08.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.796+0000 7f9f3d865640 1 -- start start 2024-09-10T08:30:08.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.797+0000 7f9f3d865640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f380c42b0 0x7f9f38143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:08.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.797+0000 7f9f3d865640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f381505f0 0x7f9f380ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:08.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.797+0000 7f9f3d865640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380acdc0 0x7f9f3814ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:08.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.797+0000 7f9f3d865640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9f381509d0 con 0x7f9f381505f0 2024-09-10T08:30:08.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.797+0000 7f9f3d865640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9f380c64a0 con 0x7f9f380c42b0 2024-09-10T08:30:08.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.797+0000 7f9f3d865640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9f38150b50 con 0x7f9f380acdc0 2024-09-10T08:30:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.797+0000 7f9f36ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f380c42b0 0x7f9f38143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.797+0000 7f9f377fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380acdc0 0x7f9f3814ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.797+0000 7f9f36ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f380c42b0 0x7f9f38143cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:51972/0 (socket says 172.21.15.103:51972) 2024-09-10T08:30:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.797+0000 7f9f36ffd640 1 -- 172.21.15.103:0/2267248391 learned_addr learned my addr 172.21.15.103:0/2267248391 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.797+0000 7f9f367fc640 1 --2- 172.21.15.103:0/2267248391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f381505f0 0x7f9f380ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.797+0000 7f9f36ffd640 1 -- 172.21.15.103:0/2267248391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380acdc0 msgr2=0x7f9f3814ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.797+0000 7f9f36ffd640 1 --2- 172.21.15.103:0/2267248391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380acdc0 0x7f9f3814ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.797+0000 7f9f36ffd640 1 -- 172.21.15.103:0/2267248391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f381505f0 msgr2=0x7f9f380ac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.797+0000 7f9f36ffd640 1 --2- 172.21.15.103:0/2267248391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f381505f0 0x7f9f380ac880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.797+0000 7f9f36ffd640 1 -- 172.21.15.103:0/2267248391 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3814e650 con 0x7f9f380c42b0 2024-09-10T08:30:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.797+0000 7f9f377fe640 1 --2- 172.21.15.103:0/2267248391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380acdc0 0x7f9f3814ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:30:08.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.798+0000 7f9f36ffd640 1 --2- 172.21.15.103:0/2267248391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f380c42b0 0x7f9f38143cc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9f2800c430 tx=0x7f9f2800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:08.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.798+0000 7f9f1ffff640 1 -- 172.21.15.103:0/2267248391 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f280052d0 con 0x7f9f380c42b0 2024-09-10T08:30:08.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.798+0000 7f9f1ffff640 1 -- 172.21.15.103:0/2267248391 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f28005490 con 0x7f9f380c42b0 2024-09-10T08:30:08.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.798+0000 7f9f3d865640 1 -- 172.21.15.103:0/2267248391 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f38146190 con 0x7f9f380c42b0 2024-09-10T08:30:08.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.798+0000 7f9f1ffff640 1 -- 172.21.15.103:0/2267248391 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f28007260 con 0x7f9f380c42b0 2024-09-10T08:30:08.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.798+0000 7f9f3d865640 1 -- 172.21.15.103:0/2267248391 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f3814d1b0 con 0x7f9f380c42b0 2024-09-10T08:30:08.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.799+0000 7f9f3d865640 1 -- 172.21.15.103:0/2267248391 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f38153910 con 0x7f9f380c42b0 2024-09-10T08:30:08.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.799+0000 7f9f1ffff640 1 -- 172.21.15.103:0/2267248391 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f28007400 con 0x7f9f380c42b0 2024-09-10T08:30:08.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.800+0000 7f9f1ffff640 1 --2- 172.21.15.103:0/2267248391 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9f2406be30 0x7f9f2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:08.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.800+0000 7f9f1ffff640 1 -- 172.21.15.103:0/2267248391 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f9f2808a6f0 con 0x7f9f380c42b0 2024-09-10T08:30:08.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.800+0000 7f9f367fc640 1 --2- 172.21.15.103:0/2267248391 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9f2406be30 0x7f9f2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:08.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.801+0000 7f9f367fc640 1 --2- 172.21.15.103:0/2267248391 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9f2406be30 0x7f9f2406e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c034000 tx=0x7f9f2c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:08.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:08.805+0000 7f9f1ffff640 1 -- 172.21.15.103:0/2267248391 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9f280586b0 con 0x7f9f380c42b0 2024-09-10T08:30:09.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.043+0000 7f9f3d865640 1 -- 172.21.15.103:0/2267248391 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9f3814d380 con 0x7f9f380c42b0 2024-09-10T08:30:09.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.043+0000 7f9f1ffff640 1 -- 172.21.15.103:0/2267248391 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f9f2805c9b0 con 0x7f9f380c42b0 2024-09-10T08:30:09.043 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:30:09.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.045+0000 7f9f3d865640 1 -- 172.21.15.103:0/2267248391 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9f2406be30 msgr2=0x7f9f2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.045+0000 7f9f3d865640 1 --2- 172.21.15.103:0/2267248391 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9f2406be30 0x7f9f2406e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c034000 tx=0x7f9f2c02e000 comp rx=0 tx=0).stop 2024-09-10T08:30:09.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.045+0000 7f9f3d865640 1 -- 172.21.15.103:0/2267248391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f380c42b0 msgr2=0x7f9f38143cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.045+0000 7f9f3d865640 1 --2- 172.21.15.103:0/2267248391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f380c42b0 0x7f9f38143cc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9f2800c430 tx=0x7f9f2800c8f0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.045+0000 7f9f3d865640 1 -- 172.21.15.103:0/2267248391 shutdown_connections 2024-09-10T08:30:09.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.045+0000 7f9f3d865640 1 --2- 172.21.15.103:0/2267248391 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9f2406be30 0x7f9f2406e2f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.045+0000 7f9f3d865640 1 --2- 172.21.15.103:0/2267248391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380acdc0 0x7f9f3814ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.045+0000 7f9f3d865640 1 --2- 172.21.15.103:0/2267248391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f381505f0 0x7f9f380ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.045+0000 7f9f3d865640 1 --2- 172.21.15.103:0/2267248391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f380c42b0 0x7f9f38143cc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.045+0000 7f9f3d865640 1 -- 172.21.15.103:0/2267248391 >> 172.21.15.103:0/2267248391 conn(0x7f9f380c7a40 msgr2=0x7f9f380c49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:09.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.046+0000 7f9f3d865640 1 -- 172.21.15.103:0/2267248391 shutdown_connections 2024-09-10T08:30:09.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.046+0000 7f9f3d865640 1 -- 172.21.15.103:0/2267248391 wait complete. 2024-09-10T08:30:09.056 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:30:09.056 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:30:09.056 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:30:09.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.159+0000 7fada3882640 1 Processor -- start 2024-09-10T08:30:09.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.160+0000 7fada3882640 1 -- start start 2024-09-10T08:30:09.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.160+0000 7fada3882640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9c154ac0 0x7fad9c0708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.160+0000 7fada3882640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad9c154ff0 con 0x7fad9c151780 2024-09-10T08:30:09.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.160+0000 7fada3882640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad9c06f5f0 con 0x7fad9c0703b0 2024-09-10T08:30:09.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.160+0000 7fada3882640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fad9c06f8d0 con 0x7fad9c154ac0 2024-09-10T08:30:09.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.161+0000 7fada161e640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fad9c151780 0x7fad9c155560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33198/0 (socket says 172.21.15.103:33198) 2024-09-10T08:30:09.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.161+0000 7fada161e640 1 -- 172.21.15.103:0/3369343854 learned_addr learned my addr 172.21.15.103:0/3369343854 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:30:09.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.161+0000 7fada0e1d640 1 --2- 172.21.15.103:0/3369343854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9c154ac0 0x7fad9c0708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.161+0000 7fad93fff640 1 -- 172.21.15.103:0/3369343854 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 257818206 0 0) 0x7fad9c154ff0 con 0x7fad9c151780 2024-09-10T08:30:09.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.161+0000 7fad93fff640 1 -- 172.21.15.103:0/3369343854 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad88003520 con 0x7fad9c151780 2024-09-10T08:30:09.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.161+0000 7fada0e1d640 1 -- 172.21.15.103:0/3369343854 >> v1:172.21.15.154:6789/0 conn(0x7fad9c0703b0 legacy=0x7fad9c15e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.161+0000 7fada0e1d640 1 -- 172.21.15.103:0/3369343854 >> v1:172.21.15.103:6789/0 conn(0x7fad9c151780 legacy=0x7fad9c155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.161+0000 7fada0e1d640 1 -- 172.21.15.103:0/3369343854 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9c06fbb0 con 0x7fad9c154ac0 2024-09-10T08:30:09.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.162+0000 7fada0e1d640 1 --2- 172.21.15.103:0/3369343854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9c154ac0 0x7fad9c0708a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0097d0 tx=0x7fad8c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2367bdd1d21fbaac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.210+0000 7fad93fff640 1 -- 172.21.15.103:0/3369343854 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c037070 con 0x7fad9c154ac0 2024-09-10T08:30:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.210+0000 7fad93fff640 1 -- 172.21.15.103:0/3369343854 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad8c02ae50 con 0x7fad9c154ac0 2024-09-10T08:30:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.210+0000 7fad93fff640 1 -- 172.21.15.103:0/3369343854 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c032660 con 0x7fad9c154ac0 2024-09-10T08:30:09.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.211+0000 7fada3882640 1 -- 172.21.15.103:0/3369343854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9c154ac0 msgr2=0x7fad9c0708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.211+0000 7fada3882640 1 --2- 172.21.15.103:0/3369343854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9c154ac0 0x7fad9c0708a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0097d0 tx=0x7fad8c02a100 comp rx=0 tx=0).stop 2024-09-10T08:30:09.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.211+0000 7fada3882640 1 -- 172.21.15.103:0/3369343854 shutdown_connections 2024-09-10T08:30:09.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.211+0000 7fada3882640 1 --2- 172.21.15.103:0/3369343854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9c154ac0 0x7fad9c0708a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.211+0000 7fada3882640 1 -- 172.21.15.103:0/3369343854 >> 172.21.15.103:0/3369343854 conn(0x7fad9c0c6980 msgr2=0x7fad9c0c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:09.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.211+0000 7fada3882640 1 -- 172.21.15.103:0/3369343854 shutdown_connections 2024-09-10T08:30:09.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.211+0000 7fada3882640 1 -- 172.21.15.103:0/3369343854 wait complete. 2024-09-10T08:30:09.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.212+0000 7fada3882640 1 Processor -- start 2024-09-10T08:30:09.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.212+0000 7fada3882640 1 -- start start 2024-09-10T08:30:09.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.213+0000 7fada3882640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9c0703b0 0x7fad9c0c3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.213+0000 7fada3882640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad9c151780 0x7fad9c1499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.213+0000 7fada3882640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad9c154ac0 0x7fad9c149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.213+0000 7fada3882640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c155c70 con 0x7fad9c151780 2024-09-10T08:30:09.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.213+0000 7fada3882640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c073f30 con 0x7fad9c154ac0 2024-09-10T08:30:09.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.213+0000 7fada3882640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fad9c14afa0 con 0x7fad9c0703b0 2024-09-10T08:30:09.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.213+0000 7fada0e1d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad9c151780 0x7fad9c1499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.213+0000 7fada0e1d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad9c151780 0x7fad9c1499e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54312/0 (socket says 172.21.15.103:54312) 2024-09-10T08:30:09.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.213+0000 7fada0e1d640 1 -- 172.21.15.103:0/114772609 learned_addr learned my addr 172.21.15.103:0/114772609 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:09.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.213+0000 7fada161e640 1 --2- 172.21.15.103:0/114772609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9c0703b0 0x7fad9c0c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.213+0000 7fada1e1f640 1 --2- 172.21.15.103:0/114772609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad9c154ac0 0x7fad9c149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.214+0000 7fada0e1d640 1 -- 172.21.15.103:0/114772609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9c0703b0 msgr2=0x7fad9c0c3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.214+0000 7fada0e1d640 1 --2- 172.21.15.103:0/114772609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9c0703b0 0x7fad9c0c3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.214+0000 7fada0e1d640 1 -- 172.21.15.103:0/114772609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad9c154ac0 msgr2=0x7fad9c149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.214+0000 7fada0e1d640 1 --2- 172.21.15.103:0/114772609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad9c154ac0 0x7fad9c149f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.214+0000 7fada0e1d640 1 -- 172.21.15.103:0/114772609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9c14ccb0 con 0x7fad9c151780 2024-09-10T08:30:09.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.214+0000 7fada0e1d640 1 --2- 172.21.15.103:0/114772609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad9c151780 0x7fad9c1499e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0098f0 tx=0x7fad8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:09.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.214+0000 7fad91ffb640 1 -- 172.21.15.103:0/114772609 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c042020 con 0x7fad9c151780 2024-09-10T08:30:09.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.214+0000 7fad91ffb640 1 -- 172.21.15.103:0/114772609 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad8c03d6b0 con 0x7fad9c151780 2024-09-10T08:30:09.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.214+0000 7fada3882640 1 -- 172.21.15.103:0/114772609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad9c14b1f0 con 0x7fad9c151780 2024-09-10T08:30:09.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.214+0000 7fad91ffb640 1 -- 172.21.15.103:0/114772609 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c037040 con 0x7fad9c151780 2024-09-10T08:30:09.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.214+0000 7fada3882640 1 -- 172.21.15.103:0/114772609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad9c0c3a60 con 0x7fad9c151780 2024-09-10T08:30:09.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.215+0000 7fada3882640 1 --2- 172.21.15.103:0/114772609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad9c14a500 0x7fad9c0ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.215+0000 7fada3882640 1 -- 172.21.15.103:0/114772609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c155df0 con 0x7fad9c14a500 2024-09-10T08:30:09.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.216+0000 7fada161e640 1 --2- 172.21.15.103:0/114772609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad9c14a500 0x7fad9c0ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.216+0000 7fada161e640 1 -- 172.21.15.103:0/114772609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad9c0af630 con 0x7fad9c14a500 2024-09-10T08:30:09.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.216+0000 7fad91ffb640 1 -- 172.21.15.103:0/114772609 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad8c045020 con 0x7fad9c151780 2024-09-10T08:30:09.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.216+0000 7fada161e640 1 --2- 172.21.15.103:0/114772609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad9c14a500 0x7fad9c0ad9f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fad98000f60 tx=0x7fad9800fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:09.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.216+0000 7fad91ffb640 1 --2- 172.21.15.103:0/114772609 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fad8006be30 0x7fad8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.216+0000 7fad91ffb640 1 -- 172.21.15.103:0/114772609 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fad8c0ab840 con 0x7fad9c151780 2024-09-10T08:30:09.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.217+0000 7fada1e1f640 1 --2- 172.21.15.103:0/114772609 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fad8006be30 0x7fad8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.217+0000 7fad91ffb640 1 -- 172.21.15.103:0/114772609 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad980058b0 con 0x7fad9c14a500 2024-09-10T08:30:09.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.217+0000 7fad91ffb640 1 -- 172.21.15.103:0/114772609 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fad98018070 con 0x7fad9c14a500 2024-09-10T08:30:09.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.217+0000 7fad91ffb640 1 -- 172.21.15.103:0/114772609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad9c14a500 msgr2=0x7fad9c0ad9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.217+0000 7fad91ffb640 1 --2- 172.21.15.103:0/114772609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad9c14a500 0x7fad9c0ad9f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fad98000f60 tx=0x7fad9800fc00 comp rx=0 tx=0).stop 2024-09-10T08:30:09.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.217+0000 7fad91ffb640 1 -- 172.21.15.103:0/114772609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad9c14a500 msgr2=0x7fad9c0ad9f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:30:09.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.217+0000 7fad91ffb640 1 --2- 172.21.15.103:0/114772609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad9c14a500 0x7fad9c0ad9f0 secure :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fad98000f60 tx=0x7fad9800fc00 comp rx=0 tx=0).stop 2024-09-10T08:30:09.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.217+0000 7fada1e1f640 1 --2- 172.21.15.103:0/114772609 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fad8006be30 0x7fad8006e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fad940012e0 tx=0x7fad94009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:09.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.223+0000 7fada3882640 1 --2- 172.21.15.103:0/114772609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad9c14d2c0 0x7fad9c1574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.223+0000 7fada3882640 1 -- 172.21.15.103:0/114772609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c073ca0 con 0x7fad9c14d2c0 2024-09-10T08:30:09.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.223+0000 7fada161e640 1 --2- 172.21.15.103:0/114772609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad9c14d2c0 0x7fad9c1574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.223+0000 7fada161e640 1 -- 172.21.15.103:0/114772609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fad9c06ef00 con 0x7fad9c14d2c0 2024-09-10T08:30:09.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.223+0000 7fada161e640 1 --2- 172.21.15.103:0/114772609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad9c14d2c0 0x7fad9c1574e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fad98000f60 tx=0x7fad980010a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:09.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.224+0000 7fad91ffb640 1 -- 172.21.15.103:0/114772609 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9801d7c0 con 0x7fad9c14d2c0 2024-09-10T08:30:09.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.224+0000 7fad91ffb640 1 -- 172.21.15.103:0/114772609 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5056 (secure 0 0 0) 0x7fad9801d7c0 con 0x7fad9c14d2c0 2024-09-10T08:30:09.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.224+0000 7fad91ffb640 1 -- 172.21.15.103:0/114772609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad9c14d2c0 msgr2=0x7fad9c1574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.224+0000 7fad91ffb640 1 --2- 172.21.15.103:0/114772609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad9c14d2c0 0x7fad9c1574e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fad98000f60 tx=0x7fad980010a0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.224+0000 7fad91ffb640 1 -- 172.21.15.103:0/114772609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad9c14d2c0 msgr2=0x7fad9c1574e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:30:09.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.224+0000 7fad91ffb640 1 --2- 172.21.15.103:0/114772609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad9c14d2c0 0x7fad9c1574e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.224 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:30:09.224 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:30:09.224 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:30:09.224 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:30:09.224 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 10, 2024-09-10T08:30:09.225 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 116786, 2024-09-10T08:30:09.225 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:30:09.225 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:30:09.225 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:30:09.225 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:30:09.225 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:09.225 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:30:09.225 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:30:09.225 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:30:09.225 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:30:09.225 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:09.225 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:09.225 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:09.225 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:09.226 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:09.226 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:09.226 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:09.226 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:09.226 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:09.226 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:09.226 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:09.226 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:09.226 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:30:09.226 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:30:09.226 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:09.226 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:09.226 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:09.227 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:09.227 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:09.227 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:09.227 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:09.227 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:09.227 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:09.227 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:09.227 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:09.227 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:09.227 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.227 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:30:09.227 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:30:09.227 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:30:09.228 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:30:09.228 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:30:09.228 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:30:09.228 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:30:09.228 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:30:09.228 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:30:09.228 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:30:09.228 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:30:09.228 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:30:09.228 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:30:09.228 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:30:09.228 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:30:09.228 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:30:09.229 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:30:09.229 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:09.229 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:09.229 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:09.229 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:09.229 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:09.229 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:09.229 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:09.229 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:09.229 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:09.229 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:09.229 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:09.229 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:09.230 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:30:09.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.230 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:30:09.230 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.230 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:30:09.230 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:30:09.230 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:09.230 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:09.230 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.230 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:09.230 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:30:09.230 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:09.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.231 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.231 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:09.231 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:30:09.231 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:09.231 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.231 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:09.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.231 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:30:09.231 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:30:09.231 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:09.231 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:09.231 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:09.232 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.232 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.232 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:30:09.232 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:30:09.232 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:09.232 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:09.232 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.232 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:09.232 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:30:09.232 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:09.232 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.232 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.233 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:09.233 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:30:09.233 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:09.233 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.233 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:09.233 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.233 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:30:09.233 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:30:09.233 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:09.233 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:09.233 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:09.233 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.233 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.234 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:30:09.234 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:30:09.234 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:09.234 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:09.234 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.234 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:09.234 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:30:09.234 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:09.234 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.234 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.234 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:09.234 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:30:09.235 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:09.235 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.235 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:09.235 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.235 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:30:09.235 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:30:09.235 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:09.235 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:09.235 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:09.235 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.235 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:09.235 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.235 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:30:09.236 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:30:09.236 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.236 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:09.236 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:09.236 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:30:09.236 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.236 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:09.236 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:30:09.236 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.236 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:09.236 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:09.236 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:30:09.236 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.236 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:09.237 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:30:09.237 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.237 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:09.237 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:09.237 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-10T08:30:09.237 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.237 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:09.237 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:30:09.237 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.237 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:09.237 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:09.237 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-10T08:30:09.238 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.238 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:09.238 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:30:09.238 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.238 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:09.238 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:09.238 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:30:09.238 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.238 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:09.238 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.238 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:30:09.238 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:30:09.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.224+0000 7fada3882640 1 -- 172.21.15.103:0/114772609 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fad8006be30 msgr2=0x7fad8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.224+0000 7fada3882640 1 --2- 172.21.15.103:0/114772609 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fad8006be30 0x7fad8006e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fad940012e0 tx=0x7fad94009040 comp rx=0 tx=0).stop 2024-09-10T08:30:09.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.224+0000 7fada3882640 1 -- 172.21.15.103:0/114772609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad9c151780 msgr2=0x7fad9c1499e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.224+0000 7fada3882640 1 --2- 172.21.15.103:0/114772609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad9c151780 0x7fad9c1499e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0098f0 tx=0x7fad8c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.224+0000 7fada1e1f640 1 -- 172.21.15.103:0/114772609 reap_dead start 2024-09-10T08:30:09.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.224+0000 7fada1e1f640 1 -- 172.21.15.103:0/114772609 reap_dead start 2024-09-10T08:30:09.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.224+0000 7fada3882640 1 -- 172.21.15.103:0/114772609 shutdown_connections 2024-09-10T08:30:09.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.224+0000 7fada3882640 1 -- 172.21.15.103:0/114772609 >> 172.21.15.103:0/114772609 conn(0x7fad9c0c6980 msgr2=0x7fad9c156d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:09.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.224+0000 7fada3882640 1 -- 172.21.15.103:0/114772609 shutdown_connections 2024-09-10T08:30:09.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.224+0000 7fada3882640 1 -- 172.21.15.103:0/114772609 wait complete. 2024-09-10T08:30:09.241 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:30:09.241 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:30:09.241 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:30:09.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.341+0000 7ff1f3c53640 1 Processor -- start 2024-09-10T08:30:09.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.342+0000 7ff1f3c53640 1 -- start start 2024-09-10T08:30:09.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.342+0000 7ff1f3c53640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff1ec0c3cb0 0x7ff1ec0c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.342+0000 7ff1f3c53640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec159e00 0x7ff1ec15a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.342+0000 7ff1f3c53640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1ec0c34f0 con 0x7ff1ec074230 2024-09-10T08:30:09.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.342+0000 7ff1f3c53640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff1ec0bed90 con 0x7ff1ec0c3cb0 2024-09-10T08:30:09.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.342+0000 7ff1f3c53640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff1ec0c3820 con 0x7ff1ec159e00 2024-09-10T08:30:09.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.342+0000 7ff1f19ef640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff1ec074230 0x7ff1ec0c54b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33212/0 (socket says 172.21.15.103:33212) 2024-09-10T08:30:09.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f19ef640 1 -- 172.21.15.103:0/1329289529 learned_addr learned my addr 172.21.15.103:0/1329289529 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:30:09.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f11ee640 1 --2- 172.21.15.103:0/1329289529 >> v2:172.21.15.154:3300/0 conn(0x7ff1ec0c3cb0 0x7ff1ec0c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f21f0640 1 --2- 172.21.15.103:0/1329289529 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec159e00 0x7ff1ec15a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f09ed640 1 -- 172.21.15.103:0/1329289529 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1488837725 0 0) 0x7ff1ec0c34f0 con 0x7ff1ec074230 2024-09-10T08:30:09.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f09ed640 1 -- 172.21.15.103:0/1329289529 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1d8003520 con 0x7ff1ec074230 2024-09-10T08:30:09.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f09ed640 1 -- 172.21.15.103:0/1329289529 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1014444052 0 0) 0x7ff1d8003520 con 0x7ff1ec074230 2024-09-10T08:30:09.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f09ed640 1 -- 172.21.15.103:0/1329289529 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec159e00 msgr2=0x7ff1ec15a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:09.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f09ed640 1 --2- 172.21.15.103:0/1329289529 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec159e00 0x7ff1ec15a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f09ed640 1 -- 172.21.15.103:0/1329289529 >> v2:172.21.15.154:3300/0 conn(0x7ff1ec0c3cb0 msgr2=0x7ff1ec0c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:09.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f09ed640 1 --2- 172.21.15.103:0/1329289529 >> v2:172.21.15.154:3300/0 conn(0x7ff1ec0c3cb0 0x7ff1ec0c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f09ed640 1 -- 172.21.15.103:0/1329289529 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1ec0befe0 con 0x7ff1ec074230 2024-09-10T08:30:09.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f09ed640 1 -- 172.21.15.103:0/1329289529 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7ff1dc001690 con 0x7ff1ec074230 2024-09-10T08:30:09.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f09ed640 1 -- 172.21.15.103:0/1329289529 >> v1:172.21.15.103:6789/0 conn(0x7ff1ec074230 legacy=0x7ff1ec0c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f09ed640 1 --2- 172.21.15.103:0/1329289529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1d80039b0 0x7ff1d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f09ed640 1 --2- 172.21.15.103:0/1329289529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d8004800 0x7ff1d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f09ed640 1 --2- 172.21.15.103:0/1329289529 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec159e00 0x7ff1d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f09ed640 1 -- 172.21.15.103:0/1329289529 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ec0bed90 con 0x7ff1d8004800 2024-09-10T08:30:09.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f09ed640 1 -- 172.21.15.103:0/1329289529 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ec0c3820 con 0x7ff1d80039b0 2024-09-10T08:30:09.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f09ed640 1 -- 172.21.15.103:0/1329289529 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d800b9f0 con 0x7ff1ec159e00 2024-09-10T08:30:09.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f11ee640 1 --2- 172.21.15.103:0/1329289529 >> v2:172.21.15.154:3300/0 conn(0x7ff1ec0c3cb0 0x7ff1ec0c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:30:09.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f19ef640 1 --2- 172.21.15.103:0/1329289529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1d80039b0 0x7ff1d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f11ee640 1 --2- 172.21.15.103:0/1329289529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d8004800 0x7ff1d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.343+0000 7ff1f21f0640 1 --2- 172.21.15.103:0/1329289529 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec159e00 0x7ff1d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.344+0000 7ff1f19ef640 1 -- 172.21.15.103:0/1329289529 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec159e00 msgr2=0x7ff1d80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:09.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.344+0000 7ff1f19ef640 1 --2- 172.21.15.103:0/1329289529 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec159e00 0x7ff1d80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.344+0000 7ff1f19ef640 1 -- 172.21.15.103:0/1329289529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d8004800 msgr2=0x7ff1d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:09.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.344+0000 7ff1f19ef640 1 --2- 172.21.15.103:0/1329289529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d8004800 0x7ff1d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.344+0000 7ff1f19ef640 1 -- 172.21.15.103:0/1329289529 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d8003520 con 0x7ff1d80039b0 2024-09-10T08:30:09.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.344+0000 7ff1f11ee640 1 --2- 172.21.15.103:0/1329289529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d8004800 0x7ff1d8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:30:09.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.344+0000 7ff1f19ef640 1 --2- 172.21.15.103:0/1329289529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1d80039b0 0x7ff1d8003dd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc007fd0 tx=0x7ff1d8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=749070289b26e504 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:09.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.344+0000 7ff1f09ed640 1 -- 172.21.15.103:0/1329289529 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc007d50 con 0x7ff1d80039b0 2024-09-10T08:30:09.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.345+0000 7ff1f09ed640 1 -- 172.21.15.103:0/1329289529 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1dc005af0 con 0x7ff1d80039b0 2024-09-10T08:30:09.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.345+0000 7ff1f09ed640 1 -- 172.21.15.103:0/1329289529 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc007070 con 0x7ff1d80039b0 2024-09-10T08:30:09.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.345+0000 7ff1f3c53640 1 -- 172.21.15.103:0/1329289529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1d80039b0 msgr2=0x7ff1d8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.345+0000 7ff1f3c53640 1 --2- 172.21.15.103:0/1329289529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1d80039b0 0x7ff1d8003dd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc007fd0 tx=0x7ff1d8005830 comp rx=0 tx=0).stop 2024-09-10T08:30:09.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.345+0000 7ff1f21f0640 1 -- 172.21.15.103:0/1329289529 reap_dead start 2024-09-10T08:30:09.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.345+0000 7ff1f3c53640 1 -- 172.21.15.103:0/1329289529 shutdown_connections 2024-09-10T08:30:09.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.345+0000 7ff1f3c53640 1 -- 172.21.15.103:0/1329289529 >> 172.21.15.103:0/1329289529 conn(0x7ff1ec0c8a50 msgr2=0x7ff1ec0c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:09.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.345+0000 7ff1f3c53640 1 -- 172.21.15.103:0/1329289529 shutdown_connections 2024-09-10T08:30:09.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.345+0000 7ff1f3c53640 1 -- 172.21.15.103:0/1329289529 wait complete. 2024-09-10T08:30:09.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.346+0000 7ff1f3c53640 1 Processor -- start 2024-09-10T08:30:09.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.346+0000 7ff1f3c53640 1 -- start start 2024-09-10T08:30:09.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.347+0000 7ff1f3c53640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d80039b0 0x7ff1ec0c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.347+0000 7ff1f3c53640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec1543b0 0x7ff1ec0ac270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.347+0000 7ff1f3c53640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec0ac7b0 0x7ff1ec1eefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.347+0000 7ff1f3c53640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ec0c4660 con 0x7ff1d80039b0 2024-09-10T08:30:09.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.347+0000 7ff1f3c53640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ec0bf5a0 con 0x7ff1ec0ac7b0 2024-09-10T08:30:09.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.347+0000 7ff1f3c53640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff1ec0c47e0 con 0x7ff1ec1543b0 2024-09-10T08:30:09.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.347+0000 7ff1f19ef640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d80039b0 0x7ff1ec0c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.347+0000 7ff1f19ef640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d80039b0 0x7ff1ec0c25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54364/0 (socket says 172.21.15.103:54364) 2024-09-10T08:30:09.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.347+0000 7ff1f19ef640 1 -- 172.21.15.103:0/680531198 learned_addr learned my addr 172.21.15.103:0/680531198 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:09.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.347+0000 7ff1f21f0640 1 --2- 172.21.15.103:0/680531198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec0ac7b0 0x7ff1ec1eefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.347+0000 7ff1f11ee640 1 --2- 172.21.15.103:0/680531198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec1543b0 0x7ff1ec0ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.348+0000 7ff1f19ef640 1 -- 172.21.15.103:0/680531198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec1543b0 msgr2=0x7ff1ec0ac270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.348+0000 7ff1f19ef640 1 --2- 172.21.15.103:0/680531198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1ec1543b0 0x7ff1ec0ac270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.348+0000 7ff1f19ef640 1 -- 172.21.15.103:0/680531198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec0ac7b0 msgr2=0x7ff1ec1eefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.348+0000 7ff1f19ef640 1 --2- 172.21.15.103:0/680531198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec0ac7b0 0x7ff1ec1eefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.348+0000 7ff1f19ef640 1 -- 172.21.15.103:0/680531198 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1ec0c0910 con 0x7ff1d80039b0 2024-09-10T08:30:09.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.348+0000 7ff1f19ef640 1 --2- 172.21.15.103:0/680531198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d80039b0 0x7ff1ec0c25b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00c300 tx=0x7ff1ec0bf1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:09.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.348+0000 7ff1e27fc640 1 -- 172.21.15.103:0/680531198 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc042020 con 0x7ff1d80039b0 2024-09-10T08:30:09.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.348+0000 7ff1e27fc640 1 -- 172.21.15.103:0/680531198 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1dc004bf0 con 0x7ff1d80039b0 2024-09-10T08:30:09.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.348+0000 7ff1e27fc640 1 -- 172.21.15.103:0/680531198 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc007070 con 0x7ff1d80039b0 2024-09-10T08:30:09.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.348+0000 7ff1f3c53640 1 -- 172.21.15.103:0/680531198 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1ec0accd0 con 0x7ff1d80039b0 2024-09-10T08:30:09.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.348+0000 7ff1f3c53640 1 -- 172.21.15.103:0/680531198 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1ec0c0130 con 0x7ff1d80039b0 2024-09-10T08:30:09.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.349+0000 7ff1f3c53640 1 --2- 172.21.15.103:0/680531198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec1ef520 0x7ff1ec1eba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.349+0000 7ff1f3c53640 1 -- 172.21.15.103:0/680531198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ec069a00 con 0x7ff1ec1ef520 2024-09-10T08:30:09.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.349+0000 7ff1f11ee640 1 --2- 172.21.15.103:0/680531198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec1ef520 0x7ff1ec1eba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.350+0000 7ff1f11ee640 1 -- 172.21.15.103:0/680531198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1ec074610 con 0x7ff1ec1ef520 2024-09-10T08:30:09.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.350+0000 7ff1f11ee640 1 --2- 172.21.15.103:0/680531198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec1ef520 0x7ff1ec1eba70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec1e98b0 tx=0x7ff1e8012700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:09.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.350+0000 7ff1e27fc640 1 -- 172.21.15.103:0/680531198 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8004030 con 0x7ff1ec1ef520 2024-09-10T08:30:09.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.350+0000 7ff1e27fc640 1 -- 172.21.15.103:0/680531198 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1dc045020 con 0x7ff1d80039b0 2024-09-10T08:30:09.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.350+0000 7ff1e27fc640 1 --2- 172.21.15.103:0/680531198 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff1d006bd60 0x7ff1d006e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.351+0000 7ff1e27fc640 1 -- 172.21.15.103:0/680531198 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7ff1dc0ab870 con 0x7ff1d80039b0 2024-09-10T08:30:09.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.351+0000 7ff1f21f0640 1 --2- 172.21.15.103:0/680531198 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff1d006bd60 0x7ff1d006e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.351+0000 7ff1e27fc640 1 -- 172.21.15.103:0/680531198 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff1e80041d0 con 0x7ff1ec1ef520 2024-09-10T08:30:09.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.351+0000 7ff1e27fc640 1 -- 172.21.15.103:0/680531198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec1ef520 msgr2=0x7ff1ec1eba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.351+0000 7ff1e27fc640 1 --2- 172.21.15.103:0/680531198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec1ef520 0x7ff1ec1eba70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec1e98b0 tx=0x7ff1e8012700 comp rx=0 tx=0).stop 2024-09-10T08:30:09.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.351+0000 7ff1e27fc640 1 -- 172.21.15.103:0/680531198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec1ef520 msgr2=0x7ff1ec1eba70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:30:09.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.351+0000 7ff1e27fc640 1 --2- 172.21.15.103:0/680531198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec1ef520 0x7ff1ec1eba70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.351+0000 7ff1f21f0640 1 --2- 172.21.15.103:0/680531198 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff1d006bd60 0x7ff1d006e220 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec0c6b40 tx=0x7ff1e400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:09.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.357+0000 7ff1f3c53640 1 --2- 172.21.15.103:0/680531198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec1ebfb0 0x7ff1ec1ec400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.357+0000 7ff1f3c53640 1 -- 172.21.15.103:0/680531198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ec1ec940 con 0x7ff1ec1ebfb0 2024-09-10T08:30:09.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.357+0000 7ff1f11ee640 1 --2- 172.21.15.103:0/680531198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec1ebfb0 0x7ff1ec1ec400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.357+0000 7ff1f11ee640 1 -- 172.21.15.103:0/680531198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff1ec0a8df0 con 0x7ff1ec1ebfb0 2024-09-10T08:30:09.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.358+0000 7ff1f11ee640 1 --2- 172.21.15.103:0/680531198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec1ebfb0 0x7ff1ec1ec400 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec075d70 tx=0x7ff1e8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:09.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.358+0000 7ff1e27fc640 1 -- 172.21.15.103:0/680531198 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8003820 con 0x7ff1ec1ebfb0 2024-09-10T08:30:09.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.358+0000 7ff1e27fc640 1 -- 172.21.15.103:0/680531198 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4552 (secure 0 0 0) 0x7ff1e8003820 con 0x7ff1ec1ebfb0 2024-09-10T08:30:09.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.358+0000 7ff1e27fc640 1 -- 172.21.15.103:0/680531198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec1ebfb0 msgr2=0x7ff1ec1ec400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.358+0000 7ff1e27fc640 1 --2- 172.21.15.103:0/680531198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec1ebfb0 0x7ff1ec1ec400 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec075d70 tx=0x7ff1e8004730 comp rx=0 tx=0).stop 2024-09-10T08:30:09.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.358+0000 7ff1e27fc640 1 -- 172.21.15.103:0/680531198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec1ebfb0 msgr2=0x7ff1ec1ec400 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:30:09.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.358+0000 7ff1e27fc640 1 --2- 172.21.15.103:0/680531198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1ec1ebfb0 0x7ff1ec1ec400 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec075d70 tx=0x7ff1e8004730 comp rx=0 tx=0).stop 2024-09-10T08:30:09.358 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:30:09.358 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:30:09.358 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:30:09.358 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:30:09.358 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 10, 2024-09-10T08:30:09.359 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 15585, 2024-09-10T08:30:09.359 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:30:09.359 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:30:09.359 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:30:09.359 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:30:09.359 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:09.359 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:30:09.359 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:30:09.359 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:30:09.359 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:30:09.359 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:09.359 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:09.359 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:09.359 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:09.360 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:09.360 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:09.360 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:09.360 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:09.360 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:09.360 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:09.360 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:09.360 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:09.360 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:30:09.360 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:30:09.360 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:09.360 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:09.360 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:09.361 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:09.361 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:09.361 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:09.361 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:09.361 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:09.361 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:09.361 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:09.361 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:09.361 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:09.361 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.361 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:30:09.361 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:30:09.362 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:30:09.362 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:30:09.362 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:30:09.362 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:30:09.362 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:30:09.362 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:30:09.362 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:30:09.362 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:30:09.362 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:30:09.362 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:30:09.362 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:30:09.362 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:30:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:30:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:30:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:30:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:30:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:30:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:30:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:30:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:30:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:30:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:30:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:30:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:30:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:30:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:30:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:30:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:30:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:30:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:30:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:30:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:30:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:30:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:30:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:30:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:30:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:30:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:30:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:30:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:30:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:30:09.371 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:30:09.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.358+0000 7ff1f3c53640 1 -- 172.21.15.103:0/680531198 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff1d006bd60 msgr2=0x7ff1d006e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.358+0000 7ff1f3c53640 1 --2- 172.21.15.103:0/680531198 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff1d006bd60 0x7ff1d006e220 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec0c6b40 tx=0x7ff1e400b040 comp rx=0 tx=0).stop 2024-09-10T08:30:09.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.358+0000 7ff1f3c53640 1 -- 172.21.15.103:0/680531198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d80039b0 msgr2=0x7ff1ec0c25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.358+0000 7ff1f3c53640 1 --2- 172.21.15.103:0/680531198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1d80039b0 0x7ff1ec0c25b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00c300 tx=0x7ff1ec0bf1b0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.358+0000 7ff1f21f0640 1 -- 172.21.15.103:0/680531198 reap_dead start 2024-09-10T08:30:09.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.358+0000 7ff1f21f0640 1 -- 172.21.15.103:0/680531198 reap_dead start 2024-09-10T08:30:09.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.358+0000 7ff1f3c53640 1 -- 172.21.15.103:0/680531198 shutdown_connections 2024-09-10T08:30:09.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.358+0000 7ff1f3c53640 1 -- 172.21.15.103:0/680531198 >> 172.21.15.103:0/680531198 conn(0x7ff1ec0c8a50 msgr2=0x7ff1ec072cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:09.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.358+0000 7ff1f3c53640 1 -- 172.21.15.103:0/680531198 shutdown_connections 2024-09-10T08:30:09.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.358+0000 7ff1f3c53640 1 -- 172.21.15.103:0/680531198 wait complete. 2024-09-10T08:30:09.373 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:30:09.373 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:30:09.373 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:30:09.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.474+0000 7f5359a82640 1 Processor -- start 2024-09-10T08:30:09.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.474+0000 7f5359a82640 1 -- start start 2024-09-10T08:30:09.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.474+0000 7f5359a82640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540c81e0 0x7f53541585d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.474+0000 7f5359a82640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53540c34e0 con 0x7f53540c3f00 2024-09-10T08:30:09.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.474+0000 7f5359a82640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53540c5690 con 0x7f53540a8360 2024-09-10T08:30:09.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.474+0000 7f5359a82640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f53540c5970 con 0x7f53540c81e0 2024-09-10T08:30:09.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.475+0000 7f53537fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f53540c3f00 0x7f53540ac5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33220/0 (socket says 172.21.15.103:33220) 2024-09-10T08:30:09.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.475+0000 7f53537fe640 1 -- 172.21.15.103:0/2200596192 learned_addr learned my addr 172.21.15.103:0/2200596192 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:30:09.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.475+0000 7f5353fff640 1 --2- 172.21.15.103:0/2200596192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540c81e0 0x7f53541585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.475+0000 7f5352ffd640 1 -- 172.21.15.103:0/2200596192 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1405367760 0 0) 0x7f5344001110 con 0x7f53540c3f00 2024-09-10T08:30:09.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.475+0000 7f5352ffd640 1 -- 172.21.15.103:0/2200596192 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5340003520 con 0x7f53540c3f00 2024-09-10T08:30:09.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.475+0000 7f5352ffd640 1 -- 172.21.15.103:0/2200596192 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 629610811 0 0) 0x7f53540c5690 con 0x7f53540a8360 2024-09-10T08:30:09.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.475+0000 7f5352ffd640 1 -- 172.21.15.103:0/2200596192 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5344001110 con 0x7f53540a8360 2024-09-10T08:30:09.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.475+0000 7f5353fff640 1 -- 172.21.15.103:0/2200596192 >> v1:172.21.15.154:6789/0 conn(0x7f53540a8360 legacy=0x7f5354157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.475+0000 7f5353fff640 1 -- 172.21.15.103:0/2200596192 >> v1:172.21.15.103:6789/0 conn(0x7f53540c3f00 legacy=0x7f53540ac5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.475+0000 7f5353fff640 1 -- 172.21.15.103:0/2200596192 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53540c5c50 con 0x7f53540c81e0 2024-09-10T08:30:09.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.476+0000 7f5353fff640 1 --2- 172.21.15.103:0/2200596192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540c81e0 0x7f53541585d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f534c009dc0 tx=0x7f534c02a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dac0d03066487065 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:09.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.476+0000 7f5352ffd640 1 -- 172.21.15.103:0/2200596192 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534c02ae60 con 0x7f53540c81e0 2024-09-10T08:30:09.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.476+0000 7f5352ffd640 1 -- 172.21.15.103:0/2200596192 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f534c007740 con 0x7f53540c81e0 2024-09-10T08:30:09.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.476+0000 7f5352ffd640 1 -- 172.21.15.103:0/2200596192 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534c007af0 con 0x7f53540c81e0 2024-09-10T08:30:09.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.477+0000 7f5359a82640 1 -- 172.21.15.103:0/2200596192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540c81e0 msgr2=0x7f53541585d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.477+0000 7f5359a82640 1 --2- 172.21.15.103:0/2200596192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540c81e0 0x7f53541585d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f534c009dc0 tx=0x7f534c02a640 comp rx=0 tx=0).stop 2024-09-10T08:30:09.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.477+0000 7f5359a82640 1 -- 172.21.15.103:0/2200596192 shutdown_connections 2024-09-10T08:30:09.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.477+0000 7f5359a82640 1 --2- 172.21.15.103:0/2200596192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540c81e0 0x7f53541585d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.477+0000 7f5359a82640 1 -- 172.21.15.103:0/2200596192 >> 172.21.15.103:0/2200596192 conn(0x7f53540c8a50 msgr2=0x7f53540c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:09.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.477+0000 7f5359a82640 1 -- 172.21.15.103:0/2200596192 shutdown_connections 2024-09-10T08:30:09.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.477+0000 7f5359a82640 1 -- 172.21.15.103:0/2200596192 wait complete. 2024-09-10T08:30:09.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.478+0000 7f5359a82640 1 Processor -- start 2024-09-10T08:30:09.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.478+0000 7f5359a82640 1 -- start start 2024-09-10T08:30:09.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.479+0000 7f5359a82640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53540a8360 0x7f535409ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.479+0000 7f5359a82640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540c3f00 0x7f53540a7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.479+0000 7f5359a82640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53540aa230 0x7f53540aa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.479+0000 7f5359a82640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f53540ade40 con 0x7f53540a8360 2024-09-10T08:30:09.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.479+0000 7f5359a82640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53540c6a70 con 0x7f53540aa230 2024-09-10T08:30:09.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.479+0000 7f5359a82640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f53540adfc0 con 0x7f53540c3f00 2024-09-10T08:30:09.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.479+0000 7f53537fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53540a8360 0x7f535409ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.479+0000 7f53537fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53540a8360 0x7f535409ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54366/0 (socket says 172.21.15.103:54366) 2024-09-10T08:30:09.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.479+0000 7f53537fe640 1 -- 172.21.15.103:0/3315515354 learned_addr learned my addr 172.21.15.103:0/3315515354 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:09.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.479+0000 7f5353fff640 1 --2- 172.21.15.103:0/3315515354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53540aa230 0x7f53540aa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.479+0000 7f534bfff640 1 --2- 172.21.15.103:0/3315515354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540c3f00 0x7f53540a7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.479+0000 7f53537fe640 1 -- 172.21.15.103:0/3315515354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540c3f00 msgr2=0x7f53540a7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.479+0000 7f53537fe640 1 --2- 172.21.15.103:0/3315515354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540c3f00 0x7f53540a7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.479+0000 7f53537fe640 1 -- 172.21.15.103:0/3315515354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53540aa230 msgr2=0x7f53540aa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.479+0000 7f53537fe640 1 --2- 172.21.15.103:0/3315515354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53540aa230 0x7f53540aa6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.479+0000 7f53537fe640 1 -- 172.21.15.103:0/3315515354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535409e0c0 con 0x7f53540a8360 2024-09-10T08:30:09.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.479+0000 7f53537fe640 1 --2- 172.21.15.103:0/3315515354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53540a8360 0x7f535409ca00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f534400c680 tx=0x7f534400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:09.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.480+0000 7f5350ff9640 1 -- 172.21.15.103:0/3315515354 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344017070 con 0x7f53540a8360 2024-09-10T08:30:09.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.480+0000 7f5350ff9640 1 -- 172.21.15.103:0/3315515354 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5344005ab0 con 0x7f53540a8360 2024-09-10T08:30:09.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.480+0000 7f5359a82640 1 -- 172.21.15.103:0/3315515354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53541e9660 con 0x7f53540a8360 2024-09-10T08:30:09.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.480+0000 7f5350ff9640 1 -- 172.21.15.103:0/3315515354 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344007070 con 0x7f53540a8360 2024-09-10T08:30:09.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.480+0000 7f5359a82640 1 -- 172.21.15.103:0/3315515354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53541e9c20 con 0x7f53540a8360 2024-09-10T08:30:09.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.480+0000 7f5359a82640 1 --2- 172.21.15.103:0/3315515354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540c81e0 0x7f53540a6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.480+0000 7f5359a82640 1 -- 172.21.15.103:0/3315515354 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5354075c80 con 0x7f53540c81e0 2024-09-10T08:30:09.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.481+0000 7f534bfff640 1 --2- 172.21.15.103:0/3315515354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540c81e0 0x7f53540a6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.481+0000 7f534bfff640 1 -- 172.21.15.103:0/3315515354 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53540c42e0 con 0x7f53540c81e0 2024-09-10T08:30:09.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.481+0000 7f534bfff640 1 --2- 172.21.15.103:0/3315515354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540c81e0 0x7f53540a6a90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f533c00f490 tx=0x7f533c00f950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:09.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.481+0000 7f5350ff9640 1 -- 172.21.15.103:0/3315515354 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c0052e0 con 0x7f53540c81e0 2024-09-10T08:30:09.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.481+0000 7f5350ff9640 1 -- 172.21.15.103:0/3315515354 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f534401a070 con 0x7f53540a8360 2024-09-10T08:30:09.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.482+0000 7f5350ff9640 1 --2- 172.21.15.103:0/3315515354 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f533406bd30 0x7f533406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.482+0000 7f5350ff9640 1 -- 172.21.15.103:0/3315515354 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f534408a6b0 con 0x7f53540a8360 2024-09-10T08:30:09.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.482+0000 7f5353fff640 1 --2- 172.21.15.103:0/3315515354 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f533406bd30 0x7f533406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.482+0000 7f5350ff9640 1 -- 172.21.15.103:0/3315515354 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f533c018070 con 0x7f53540c81e0 2024-09-10T08:30:09.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.482+0000 7f5350ff9640 1 -- 172.21.15.103:0/3315515354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540c81e0 msgr2=0x7f53540a6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.482+0000 7f5350ff9640 1 --2- 172.21.15.103:0/3315515354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540c81e0 0x7f53540a6a90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f533c00f490 tx=0x7f533c00f950 comp rx=0 tx=0).stop 2024-09-10T08:30:09.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.482+0000 7f5350ff9640 1 -- 172.21.15.103:0/3315515354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540c81e0 msgr2=0x7f53540a6a90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:30:09.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.482+0000 7f5350ff9640 1 --2- 172.21.15.103:0/3315515354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540c81e0 0x7f53540a6a90 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f533c00f490 tx=0x7f533c00f950 comp rx=0 tx=0).stop 2024-09-10T08:30:09.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.482+0000 7f5353fff640 1 --2- 172.21.15.103:0/3315515354 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f533406bd30 0x7f533406e1f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f534c034000 tx=0x7f534c02f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:09.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.488+0000 7f5359a82640 1 --2- 172.21.15.103:0/3315515354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540a6fd0 0x7f53541ecac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.488+0000 7f5359a82640 1 -- 172.21.15.103:0/3315515354 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f53540a80d0 con 0x7f53540a6fd0 2024-09-10T08:30:09.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.488+0000 7f534bfff640 1 --2- 172.21.15.103:0/3315515354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540a6fd0 0x7f53541ecac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.489+0000 7f534bfff640 1 -- 172.21.15.103:0/3315515354 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f53541549e0 con 0x7f53540a6fd0 2024-09-10T08:30:09.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.489+0000 7f534bfff640 1 --2- 172.21.15.103:0/3315515354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540a6fd0 0x7f53541ecac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f533c017000 tx=0x7f533c000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:09.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.489+0000 7f5350ff9640 1 -- 172.21.15.103:0/3315515354 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c003ad0 con 0x7f53540a6fd0 2024-09-10T08:30:09.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.489+0000 7f5350ff9640 1 -- 172.21.15.103:0/3315515354 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7f533c003ad0 con 0x7f53540a6fd0 2024-09-10T08:30:09.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.489+0000 7f5350ff9640 1 -- 172.21.15.103:0/3315515354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540a6fd0 msgr2=0x7f53541ecac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.489+0000 7f5350ff9640 1 --2- 172.21.15.103:0/3315515354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540a6fd0 0x7f53541ecac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f533c017000 tx=0x7f533c000ed0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.489+0000 7f5350ff9640 1 -- 172.21.15.103:0/3315515354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540a6fd0 msgr2=0x7f53541ecac0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:30:09.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.489+0000 7f5350ff9640 1 --2- 172.21.15.103:0/3315515354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53540a6fd0 0x7f53541ecac0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.490 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:30:09.490 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:30:09.490 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:30:09.490 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:30:09.490 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 10, 2024-09-10T08:30:09.490 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 117049, 2024-09-10T08:30:09.490 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:30:09.491 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:30:09.491 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:30:09.491 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:30:09.491 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:09.491 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:30:09.491 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:30:09.491 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:30:09.491 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:30:09.491 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:09.491 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:09.491 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:09.491 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:09.491 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:09.492 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:09.492 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:09.492 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:09.492 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:09.492 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:09.492 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:09.492 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:09.492 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:30:09.492 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:30:09.492 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:09.492 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:09.492 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:09.492 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:09.492 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:09.493 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:09.493 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:09.493 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:09.493 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:09.493 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:09.493 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:09.493 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:09.493 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.493 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:30:09.493 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:30:09.493 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:30:09.493 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:30:09.494 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:30:09.494 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:30:09.494 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:30:09.494 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:30:09.494 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:30:09.494 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:30:09.494 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:30:09.494 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:30:09.494 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:30:09.494 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:30:09.494 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:30:09.494 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:30:09.494 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:30:09.494 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:09.495 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:09.495 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:09.495 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:09.495 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:09.495 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:09.495 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:09.495 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:09.495 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:09.495 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:09.495 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:09.495 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:09.495 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:30:09.495 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.496 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:30:09.496 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.496 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:30:09.496 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:30:09.496 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:09.496 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:09.496 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.496 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:09.496 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:30:09.496 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:09.496 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.496 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.497 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:09.497 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:30:09.497 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:09.497 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.497 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:09.497 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.497 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:30:09.497 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:30:09.497 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:09.497 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:09.497 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:09.497 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.498 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.498 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:30:09.498 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:30:09.498 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:09.498 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:09.498 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.498 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:09.498 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:30:09.498 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:09.498 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.498 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.498 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:09.498 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:30:09.499 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:09.499 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.499 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:09.499 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.499 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:30:09.499 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:30:09.499 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:09.499 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:09.499 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:09.499 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.499 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.499 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:30:09.500 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:30:09.500 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:09.500 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:09.500 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.500 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:09.500 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:30:09.500 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:09.500 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.500 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.500 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:09.501 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:30:09.501 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:09.501 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.501 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:09.501 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.501 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:30:09.501 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:30:09.501 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:09.501 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:09.501 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:09.501 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.502 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:09.502 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.502 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:30:09.502 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:30:09.502 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.502 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:09.502 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:09.502 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:30:09.502 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.502 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:09.502 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:30:09.502 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.502 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:09.503 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:09.503 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:30:09.503 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.503 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:09.503 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:30:09.503 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.503 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:09.503 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:09.503 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:30:09.503 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.503 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:09.503 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:30:09.503 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.503 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:09.504 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:09.504 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:30:09.504 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.504 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:09.504 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:30:09.504 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:09.504 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:09.504 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:09.504 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:30:09.504 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:09.504 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:09.504 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:09.505 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:30:09.505 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:30:09.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.490+0000 7f5359a82640 1 -- 172.21.15.103:0/3315515354 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f533406bd30 msgr2=0x7f533406e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.490+0000 7f5359a82640 1 --2- 172.21.15.103:0/3315515354 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f533406bd30 0x7f533406e1f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f534c034000 tx=0x7f534c02f000 comp rx=0 tx=0).stop 2024-09-10T08:30:09.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.490+0000 7f5359a82640 1 -- 172.21.15.103:0/3315515354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53540a8360 msgr2=0x7f535409ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.490+0000 7f5359a82640 1 --2- 172.21.15.103:0/3315515354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53540a8360 0x7f535409ca00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f534400c680 tx=0x7f534400cb40 comp rx=0 tx=0).stop 2024-09-10T08:30:09.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.490+0000 7f5353fff640 1 -- 172.21.15.103:0/3315515354 reap_dead start 2024-09-10T08:30:09.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.490+0000 7f5353fff640 1 -- 172.21.15.103:0/3315515354 reap_dead start 2024-09-10T08:30:09.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.490+0000 7f5359a82640 1 -- 172.21.15.103:0/3315515354 shutdown_connections 2024-09-10T08:30:09.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.490+0000 7f5359a82640 1 -- 172.21.15.103:0/3315515354 >> 172.21.15.103:0/3315515354 conn(0x7f53540c8a50 msgr2=0x7f5354156410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:09.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.490+0000 7f5359a82640 1 -- 172.21.15.103:0/3315515354 shutdown_connections 2024-09-10T08:30:09.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.490+0000 7f5359a82640 1 -- 172.21.15.103:0/3315515354 wait complete. 2024-09-10T08:30:09.507 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:30:09.507 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-10T08:30:09.507 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-10T08:30:09.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.608+0000 7efec77c4640 1 Processor -- start 2024-09-10T08:30:09.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.608+0000 7efec77c4640 1 -- start start 2024-09-10T08:30:09.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.609+0000 7efec77c4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efec015a1d0 0x7efec0072b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.609+0000 7efec77c4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efec006fa40 con 0x7efec006dbc0 2024-09-10T08:30:09.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.609+0000 7efec77c4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efec006fce0 con 0x7efec00730d0 2024-09-10T08:30:09.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.609+0000 7efec77c4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7efec006e6b0 con 0x7efec015a1d0 2024-09-10T08:30:09.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.609+0000 7efec5560640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7efec006dbc0 0x7efec006dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33226/0 (socket says 172.21.15.103:33226) 2024-09-10T08:30:09.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.609+0000 7efec5560640 1 -- 172.21.15.103:0/2968898020 learned_addr learned my addr 172.21.15.103:0/2968898020 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:30:09.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.609+0000 7efec4d5f640 1 --2- 172.21.15.103:0/2968898020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efec015a1d0 0x7efec0072b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.609+0000 7efeb7fff640 1 -- 172.21.15.103:0/2968898020 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 327505867 0 0) 0x7efec006fa40 con 0x7efec006dbc0 2024-09-10T08:30:09.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.609+0000 7efeb7fff640 1 -- 172.21.15.103:0/2968898020 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efeac003520 con 0x7efec006dbc0 2024-09-10T08:30:09.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.609+0000 7efeb7fff640 1 -- 172.21.15.103:0/2968898020 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1394186489 0 0) 0x7efec006fce0 con 0x7efec00730d0 2024-09-10T08:30:09.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.609+0000 7efeb7fff640 1 -- 172.21.15.103:0/2968898020 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efec006fa40 con 0x7efec00730d0 2024-09-10T08:30:09.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.609+0000 7efec4d5f640 1 -- 172.21.15.103:0/2968898020 >> v1:172.21.15.154:6789/0 conn(0x7efec00730d0 legacy=0x7efec014ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.609+0000 7efec4d5f640 1 -- 172.21.15.103:0/2968898020 >> v1:172.21.15.103:6789/0 conn(0x7efec006dbc0 legacy=0x7efec006dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.609+0000 7efeb7fff640 1 -- 172.21.15.103:0/2968898020 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 634625660 0 0) 0x7efeac003520 con 0x7efec006dbc0 2024-09-10T08:30:09.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.609+0000 7efec4d5f640 1 -- 172.21.15.103:0/2968898020 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec006ffc0 con 0x7efec015a1d0 2024-09-10T08:30:09.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.610+0000 7efec4d5f640 1 --2- 172.21.15.103:0/2968898020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efec015a1d0 0x7efec0072b90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efeb00097d0 tx=0x7efeb002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff2966a3f1816f46 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:09.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.610+0000 7efeb7fff640 1 -- 172.21.15.103:0/2968898020 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0037070 con 0x7efec015a1d0 2024-09-10T08:30:09.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.610+0000 7efeb7fff640 1 -- 172.21.15.103:0/2968898020 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb002ab90 con 0x7efec015a1d0 2024-09-10T08:30:09.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.610+0000 7efeb7fff640 1 -- 172.21.15.103:0/2968898020 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc001690 con 0x7efec015a1d0 2024-09-10T08:30:09.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.611+0000 7efec77c4640 1 -- 172.21.15.103:0/2968898020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efec015a1d0 msgr2=0x7efec0072b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.611+0000 7efec77c4640 1 --2- 172.21.15.103:0/2968898020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efec015a1d0 0x7efec0072b90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efeb00097d0 tx=0x7efeb002a100 comp rx=0 tx=0).stop 2024-09-10T08:30:09.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.611+0000 7efec77c4640 1 -- 172.21.15.103:0/2968898020 shutdown_connections 2024-09-10T08:30:09.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.611+0000 7efec77c4640 1 --2- 172.21.15.103:0/2968898020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efec015a1d0 0x7efec0072b90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.611+0000 7efec77c4640 1 -- 172.21.15.103:0/2968898020 >> 172.21.15.103:0/2968898020 conn(0x7efec00c9ad0 msgr2=0x7efec00c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:09.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.611+0000 7efec77c4640 1 -- 172.21.15.103:0/2968898020 shutdown_connections 2024-09-10T08:30:09.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.611+0000 7efec77c4640 1 -- 172.21.15.103:0/2968898020 wait complete. 2024-09-10T08:30:09.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.612+0000 7efec77c4640 1 Processor -- start 2024-09-10T08:30:09.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.612+0000 7efec77c4640 1 -- start start 2024-09-10T08:30:09.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.613+0000 7efec77c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efec006dbc0 0x7efec01dff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.613+0000 7efec77c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec00730d0 0x7efec01524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.613+0000 7efec77c4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efec015a1d0 0x7efec01eef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.613+0000 7efec77c4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efec0071350 con 0x7efec006dbc0 2024-09-10T08:30:09.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.613+0000 7efec77c4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efec015a6b0 con 0x7efec00730d0 2024-09-10T08:30:09.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.613+0000 7efec77c4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7efec00714d0 con 0x7efec015a1d0 2024-09-10T08:30:09.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.613+0000 7efec5560640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efec006dbc0 0x7efec01dff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.613+0000 7efec5560640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efec006dbc0 0x7efec01dff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54378/0 (socket says 172.21.15.103:54378) 2024-09-10T08:30:09.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.613+0000 7efec5560640 1 -- 172.21.15.103:0/1502122370 learned_addr learned my addr 172.21.15.103:0/1502122370 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:09.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.613+0000 7efec4d5f640 1 --2- 172.21.15.103:0/1502122370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec00730d0 0x7efec01524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.613+0000 7efec5d61640 1 --2- 172.21.15.103:0/1502122370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efec015a1d0 0x7efec01eef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.613+0000 7efec5560640 1 -- 172.21.15.103:0/1502122370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efec015a1d0 msgr2=0x7efec01eef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.613+0000 7efec5560640 1 --2- 172.21.15.103:0/1502122370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efec015a1d0 0x7efec01eef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.613+0000 7efec5560640 1 -- 172.21.15.103:0/1502122370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec00730d0 msgr2=0x7efec01524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.613+0000 7efec5560640 1 --2- 172.21.15.103:0/1502122370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec00730d0 0x7efec01524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.613+0000 7efec5560640 1 -- 172.21.15.103:0/1502122370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec01e0460 con 0x7efec006dbc0 2024-09-10T08:30:09.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.613+0000 7efec5560640 1 --2- 172.21.15.103:0/1502122370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efec006dbc0 0x7efec01dff20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efebc00c520 tx=0x7efebc00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:09.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.614+0000 7efeb5ffb640 1 -- 172.21.15.103:0/1502122370 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc018070 con 0x7efec006dbc0 2024-09-10T08:30:09.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.614+0000 7efeb5ffb640 1 -- 172.21.15.103:0/1502122370 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efebc007500 con 0x7efec006dbc0 2024-09-10T08:30:09.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.614+0000 7efec77c4640 1 -- 172.21.15.103:0/1502122370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec01efa00 con 0x7efec006dbc0 2024-09-10T08:30:09.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.614+0000 7efeb5ffb640 1 -- 172.21.15.103:0/1502122370 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc004a20 con 0x7efec006dbc0 2024-09-10T08:30:09.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.614+0000 7efec77c4640 1 -- 172.21.15.103:0/1502122370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec01e14e0 con 0x7efec006dbc0 2024-09-10T08:30:09.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.615+0000 7efec77c4640 1 -- 172.21.15.103:0/1502122370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec00707c0 con 0x7efec006dbc0 2024-09-10T08:30:09.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.615+0000 7efeb5ffb640 1 -- 172.21.15.103:0/1502122370 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efebc01b070 con 0x7efec006dbc0 2024-09-10T08:30:09.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.616+0000 7efeb5ffb640 1 --2- 172.21.15.103:0/1502122370 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efea406be30 0x7efea406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:09.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.616+0000 7efeb5ffb640 1 -- 172.21.15.103:0/1502122370 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7efebc08a440 con 0x7efec006dbc0 2024-09-10T08:30:09.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.616+0000 7efec4d5f640 1 --2- 172.21.15.103:0/1502122370 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efea406be30 0x7efea406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:09.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.616+0000 7efec4d5f640 1 --2- 172.21.15.103:0/1502122370 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efea406be30 0x7efea406e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efeb0034000 tx=0x7efeb002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:09.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.620+0000 7efeb5ffb640 1 -- 172.21.15.103:0/1502122370 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efebc058490 con 0x7efec006dbc0 2024-09-10T08:30:09.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.854+0000 7efec77c4640 1 -- 172.21.15.103:0/1502122370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7efec01e3650 con 0x7efec006dbc0 2024-09-10T08:30:09.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.854+0000 7efeb5ffb640 1 -- 172.21.15.103:0/1502122370 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7efebc05c790 con 0x7efec006dbc0 2024-09-10T08:30:09.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.857+0000 7efec77c4640 1 -- 172.21.15.103:0/1502122370 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efea406be30 msgr2=0x7efea406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.857+0000 7efec77c4640 1 --2- 172.21.15.103:0/1502122370 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efea406be30 0x7efea406e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efeb0034000 tx=0x7efeb002e000 comp rx=0 tx=0).stop 2024-09-10T08:30:09.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.857+0000 7efec77c4640 1 -- 172.21.15.103:0/1502122370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efec006dbc0 msgr2=0x7efec01dff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.857+0000 7efec77c4640 1 --2- 172.21.15.103:0/1502122370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efec006dbc0 0x7efec01dff20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efebc00c520 tx=0x7efebc00c9e0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.857+0000 7efec77c4640 1 -- 172.21.15.103:0/1502122370 shutdown_connections 2024-09-10T08:30:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.857+0000 7efec77c4640 1 --2- 172.21.15.103:0/1502122370 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efea406be30 0x7efea406e2f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.857+0000 7efec77c4640 1 --2- 172.21.15.103:0/1502122370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efec015a1d0 0x7efec01eef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.857+0000 7efec77c4640 1 --2- 172.21.15.103:0/1502122370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec00730d0 0x7efec01524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.857+0000 7efec77c4640 1 --2- 172.21.15.103:0/1502122370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efec006dbc0 0x7efec01dff20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.857+0000 7efec77c4640 1 -- 172.21.15.103:0/1502122370 >> 172.21.15.103:0/1502122370 conn(0x7efec00c9ad0 msgr2=0x7efec00c78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.857+0000 7efec77c4640 1 -- 172.21.15.103:0/1502122370 shutdown_connections 2024-09-10T08:30:09.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:09.857+0000 7efec77c4640 1 -- 172.21.15.103:0/1502122370 wait complete. 2024-09-10T08:30:09.868 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-10T08:30:10.253 INFO:tasks.workunit.client.0.smithi103.stderr:Updating files: 97% (12350/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-10T08:30:10.770 INFO:tasks.workunit.client.0.smithi103.stderr:Note: switching to '1cf819b7212a6048e92fc78c4eff963344f6d56b'. 2024-09-10T08:30:10.770 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-10T08:30:10.770 INFO:tasks.workunit.client.0.smithi103.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T08:30:10.771 INFO:tasks.workunit.client.0.smithi103.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T08:30:10.771 INFO:tasks.workunit.client.0.smithi103.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T08:30:10.771 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-10T08:30:10.771 INFO:tasks.workunit.client.0.smithi103.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T08:30:10.771 INFO:tasks.workunit.client.0.smithi103.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T08:30:10.771 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-10T08:30:10.771 INFO:tasks.workunit.client.0.smithi103.stderr: git switch -c 2024-09-10T08:30:10.771 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-10T08:30:10.771 INFO:tasks.workunit.client.0.smithi103.stderr:Or undo this operation with: 2024-09-10T08:30:10.771 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-10T08:30:10.771 INFO:tasks.workunit.client.0.smithi103.stderr: git switch - 2024-09-10T08:30:10.771 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-10T08:30:10.772 INFO:tasks.workunit.client.0.smithi103.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T08:30:10.772 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-10T08:30:10.772 INFO:tasks.workunit.client.0.smithi103.stderr:HEAD is now at 1cf819b7212 Merge PR #59672 into wip-rishabh-testing-20240909.165402-squid 2024-09-10T08:30:10.775 DEBUG:teuthology.orchestra.run.smithi103:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-10T08:30:10.909 INFO:tasks.workunit.client.0.smithi103.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T08:30:10.911 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T08:30:10.912 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T08:30:11.179 INFO:tasks.workunit.client.1.smithi154.stderr:Updating files: 95% (12086/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-10T08:30:11.562 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T08:30:11.577 INFO:tasks.workunit.client.1.smithi154.stderr:Note: switching to '1cf819b7212a6048e92fc78c4eff963344f6d56b'. 2024-09-10T08:30:11.577 INFO:tasks.workunit.client.1.smithi154.stderr: 2024-09-10T08:30:11.577 INFO:tasks.workunit.client.1.smithi154.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T08:30:11.577 INFO:tasks.workunit.client.1.smithi154.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T08:30:11.577 INFO:tasks.workunit.client.1.smithi154.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T08:30:11.577 INFO:tasks.workunit.client.1.smithi154.stderr: 2024-09-10T08:30:11.577 INFO:tasks.workunit.client.1.smithi154.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T08:30:11.577 INFO:tasks.workunit.client.1.smithi154.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T08:30:11.578 INFO:tasks.workunit.client.1.smithi154.stderr: 2024-09-10T08:30:11.578 INFO:tasks.workunit.client.1.smithi154.stderr: git switch -c 2024-09-10T08:30:11.578 INFO:tasks.workunit.client.1.smithi154.stderr: 2024-09-10T08:30:11.578 INFO:tasks.workunit.client.1.smithi154.stderr:Or undo this operation with: 2024-09-10T08:30:11.578 INFO:tasks.workunit.client.1.smithi154.stderr: 2024-09-10T08:30:11.578 INFO:tasks.workunit.client.1.smithi154.stderr: git switch - 2024-09-10T08:30:11.578 INFO:tasks.workunit.client.1.smithi154.stderr: 2024-09-10T08:30:11.578 INFO:tasks.workunit.client.1.smithi154.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T08:30:11.578 INFO:tasks.workunit.client.1.smithi154.stderr: 2024-09-10T08:30:11.578 INFO:tasks.workunit.client.1.smithi154.stderr:HEAD is now at 1cf819b7212 Merge PR #59672 into wip-rishabh-testing-20240909.165402-squid 2024-09-10T08:30:11.582 DEBUG:teuthology.orchestra.run.smithi154:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-10T08:30:11.610 INFO:tasks.workunit.client.1.smithi154.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T08:30:11.612 INFO:tasks.workunit.client.1.smithi154.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-10T08:30:11.612 INFO:tasks.workunit.client.1.smithi154.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T08:30:11.639 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T08:30:11.679 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T08:30:11.680 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T08:30:11.680 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T08:30:11.720 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T08:30:11.724 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:30:11.724 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-10T08:30:11.740 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-09-10T08:30:11.741 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-09-10T08:30:11.741 DEBUG:teuthology.orchestra.run.smithi103:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1cf819b7212a6048e92fc78c4eff963344f6d56b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-10T08:30:11.805 INFO:tasks.workunit.client.0.smithi103.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-10T08:30:11.806 INFO:tasks.workunit.client.0.smithi103.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-09-10T08:30:11.806 INFO:tasks.workunit.client.0.smithi103.stderr:+ trap -- retry EXIT 2024-09-10T08:30:11.806 INFO:tasks.workunit.client.0.smithi103.stderr:+ rm -rf ffsb 2024-09-10T08:30:11.807 INFO:tasks.workunit.client.0.smithi103.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-09-10T08:30:11.811 INFO:tasks.workunit.client.0.smithi103.stderr:Cloning into 'ffsb'... 2024-09-10T08:30:12.208 INFO:tasks.workunit.client.1.smithi154.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T08:30:12.269 INFO:tasks.workunit.client.1.smithi154.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T08:30:12.309 INFO:tasks.workunit.client.1.smithi154.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-10T08:30:12.310 INFO:tasks.workunit.client.1.smithi154.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-10T08:30:12.310 INFO:tasks.workunit.client.1.smithi154.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T08:30:12.349 INFO:tasks.workunit.client.1.smithi154.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-10T08:30:12.352 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:30:12.352 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-10T08:30:12.408 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.1... 2024-09-10T08:30:12.409 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-09-10T08:30:12.409 DEBUG:teuthology.orchestra.run.smithi154:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1cf819b7212a6048e92fc78c4eff963344f6d56b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/ffsb.sh 2024-09-10T08:30:12.475 INFO:tasks.workunit.client.1.smithi154.stderr:++ dirname /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/ffsb.sh 2024-09-10T08:30:12.476 INFO:tasks.workunit.client.1.smithi154.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.1/qa/workunits/suites 2024-09-10T08:30:12.476 INFO:tasks.workunit.client.1.smithi154.stderr:+ trap -- retry EXIT 2024-09-10T08:30:12.476 INFO:tasks.workunit.client.1.smithi154.stderr:+ rm -rf ffsb 2024-09-10T08:30:12.477 INFO:tasks.workunit.client.1.smithi154.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-09-10T08:30:12.481 INFO:tasks.workunit.client.1.smithi154.stderr:Cloning into 'ffsb'... 2024-09-10T08:30:17.643 INFO:tasks.workunit.client.0.smithi103.stderr:Updating files: 35% (21/59) Updating files: 37% (22/59) Updating files: 38% (23/59) Updating files: 40% (24/59) Updating files: 42% (25/59) Updating files: 44% (26/59) Updating files: 45% (27/59) Updating files: 47% (28/59) Updating files: 49% (29/59) Updating files: 50% (30/59) Updating files: 52% (31/59) Updating files: 54% (32/59) Updating files: 55% (33/59) Updating files: 57% (34/59) Updating files: 59% (35/59) Updating files: 61% (36/59) Updating files: 62% (37/59) Updating files: 64% (38/59) Updating files: 66% (39/59) Updating files: 67% (40/59) Updating files: 69% (41/59) Updating files: 71% (42/59) Updating files: 72% (43/59) Updating files: 74% (44/59) Updating files: 76% (45/59) Updating files: 77% (46/59) Updating files: 79% (47/59) Updating files: 81% (48/59) Updating files: 83% (49/59) Updating files: 84% (50/59) Updating files: 86% (51/59) Updating files: 88% (52/59) Updating files: 89% (53/59) Updating files: 91% (54/59) Updating files: 93% (55/59) Updating files: 94% (56/59) Updating files: 96% (57/59) Updating files: 98% (58/59) Updating files: 100% (59/59) Updating files: 100% (59/59), done. 2024-09-10T08:30:17.692 INFO:tasks.workunit.client.0.smithi103.stderr:+ trap - EXIT 2024-09-10T08:30:17.692 INFO:tasks.workunit.client.0.smithi103.stderr:+ cd ffsb 2024-09-10T08:30:17.693 INFO:tasks.workunit.client.0.smithi103.stderr:+ ./configure 2024-09-10T08:30:17.832 INFO:tasks.workunit.client.0.smithi103.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-10T08:30:18.172 INFO:tasks.workunit.client.1.smithi154.stderr:+ trap - EXIT 2024-09-10T08:30:18.172 INFO:tasks.workunit.client.1.smithi154.stderr:+ cd ffsb 2024-09-10T08:30:18.173 INFO:tasks.workunit.client.1.smithi154.stderr:+ ./configure 2024-09-10T08:30:18.841 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether build environment is sane... yes 2024-09-10T08:30:18.855 INFO:tasks.workunit.client.0.smithi103.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-10T08:30:18.856 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gawk... gawk 2024-09-10T08:30:18.878 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether make sets $(MAKE)... yes 2024-09-10T08:30:18.964 INFO:tasks.workunit.client.1.smithi154.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-10T08:30:18.988 INFO:tasks.workunit.client.0.smithi103.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-10T08:30:18.988 INFO:tasks.workunit.client.0.smithi103.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-10T08:30:19.268 INFO:tasks.workunit.client.0.smithi103.stdout:checking for style of include used by make... GNU 2024-09-10T08:30:19.273 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gcc... gcc 2024-09-10T08:30:19.356 INFO:tasks.workunit.client.0.smithi103.stdout:checking for C compiler default output file name... a.out 2024-09-10T08:30:19.358 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether the C compiler works... yes 2024-09-10T08:30:19.361 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether we are cross compiling... no 2024-09-10T08:30:19.409 INFO:tasks.workunit.client.0.smithi103.stdout:checking for suffix of executables... 2024-09-10T08:30:19.449 INFO:tasks.workunit.client.0.smithi103.stdout:checking for suffix of object files... o 2024-09-10T08:30:19.487 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether we are using the GNU C compiler... yes 2024-09-10T08:30:19.527 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether gcc accepts -g... yes 2024-09-10T08:30:19.594 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-10T08:30:19.869 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:30:19.869 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:30:19.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.967+0000 7fbdfc152640 1 Processor -- start 2024-09-10T08:30:19.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.968+0000 7fbdfc152640 1 -- start start 2024-09-10T08:30:19.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.968+0000 7fbdfc152640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbdf40c69c0 0x7fbdf4153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:19.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.968+0000 7fbdfc152640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbdf40c42b0 0x7fbdf40c4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:19.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.968+0000 7fbdfc152640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdf40c5940 con 0x7fbdf41505f0 2024-09-10T08:30:19.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.968+0000 7fbdfc152640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fbdf40c7860 con 0x7fbdf40c42b0 2024-09-10T08:30:19.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.968+0000 7fbdfc152640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fbdf40c5c00 con 0x7fbdf40c69c0 2024-09-10T08:30:19.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.969+0000 7fbdfa6ef640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbdf40c42b0 0x7fbdf40c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:19.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.969+0000 7fbdfa6ef640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbdf40c42b0 0x7fbdf40c4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46914/0 (socket says 172.21.15.103:46914) 2024-09-10T08:30:19.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.969+0000 7fbdfa6ef640 1 -- 172.21.15.103:0/2086049062 learned_addr learned my addr 172.21.15.103:0/2086049062 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:19.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.969+0000 7fbdf96ed640 1 --2- 172.21.15.103:0/2086049062 >> v2:172.21.15.154:3300/0 conn(0x7fbdf40c69c0 0x7fbdf4153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:19.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.969+0000 7fbdfa6ef640 1 -- 172.21.15.103:0/2086049062 >> v2:172.21.15.154:3300/0 conn(0x7fbdf40c69c0 msgr2=0x7fbdf4153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:19.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.969+0000 7fbdfa6ef640 1 --2- 172.21.15.103:0/2086049062 >> v2:172.21.15.154:3300/0 conn(0x7fbdf40c69c0 0x7fbdf4153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:19.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.969+0000 7fbdfa6ef640 1 -- 172.21.15.103:0/2086049062 >> v1:172.21.15.103:6789/0 conn(0x7fbdf41505f0 legacy=0x7fbdf40c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:19.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.969+0000 7fbdfa6ef640 1 -- 172.21.15.103:0/2086049062 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf40c5ee0 con 0x7fbdf40c42b0 2024-09-10T08:30:19.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.969+0000 7fbdf8eec640 1 -- 172.21.15.103:0/2086049062 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 922493961 0 0) 0x7fbdf40c5940 con 0x7fbdf41505f0 2024-09-10T08:30:19.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.970+0000 7fbdfa6ef640 1 --2- 172.21.15.103:0/2086049062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdf40c42b0 0x7fbdf40c4700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40c5580 tx=0x7fbdec02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca2f15b889bd10b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:19.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.970+0000 7fbdf8eec640 1 -- 172.21.15.103:0/2086049062 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec036070 con 0x7fbdf40c42b0 2024-09-10T08:30:19.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.970+0000 7fbdf8eec640 1 -- 172.21.15.103:0/2086049062 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdec031600 con 0x7fbdf40c42b0 2024-09-10T08:30:19.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.970+0000 7fbdf8eec640 1 -- 172.21.15.103:0/2086049062 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec0319d0 con 0x7fbdf40c42b0 2024-09-10T08:30:19.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.970+0000 7fbdfc152640 1 -- 172.21.15.103:0/2086049062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdf40c42b0 msgr2=0x7fbdf40c4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:19.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.970+0000 7fbdfc152640 1 --2- 172.21.15.103:0/2086049062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdf40c42b0 0x7fbdf40c4700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40c5580 tx=0x7fbdec02a6a0 comp rx=0 tx=0).stop 2024-09-10T08:30:19.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.970+0000 7fbdfc152640 1 -- 172.21.15.103:0/2086049062 shutdown_connections 2024-09-10T08:30:19.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.970+0000 7fbdfc152640 1 --2- 172.21.15.103:0/2086049062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdf40c42b0 0x7fbdf40c4700 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:19.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.970+0000 7fbdfc152640 1 --2- 172.21.15.103:0/2086049062 >> v2:172.21.15.154:3300/0 conn(0x7fbdf40c69c0 0x7fbdf4153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:19.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.970+0000 7fbdfc152640 1 -- 172.21.15.103:0/2086049062 >> 172.21.15.103:0/2086049062 conn(0x7fbdf40c7a40 msgr2=0x7fbdf40c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:19.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.971+0000 7fbdfc152640 1 -- 172.21.15.103:0/2086049062 shutdown_connections 2024-09-10T08:30:19.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.971+0000 7fbdfc152640 1 -- 172.21.15.103:0/2086049062 wait complete. 2024-09-10T08:30:19.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.972+0000 7fbdfc152640 1 Processor -- start 2024-09-10T08:30:19.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.972+0000 7fbdfc152640 1 -- start start 2024-09-10T08:30:19.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.973+0000 7fbdfc152640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf40c42b0 0x7fbdf40ace10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:19.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.973+0000 7fbdfc152640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdf41505f0 0x7fbdf4151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:19.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.973+0000 7fbdfc152640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbdf40718c0 0x7fbdf4151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:19.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.973+0000 7fbdfc152640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf41509d0 con 0x7fbdf41505f0 2024-09-10T08:30:19.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.973+0000 7fbdfc152640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf40c64a0 con 0x7fbdf40c42b0 2024-09-10T08:30:19.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.973+0000 7fbdfc152640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fbdf4150b50 con 0x7fbdf40718c0 2024-09-10T08:30:19.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.973+0000 7fbdf96ed640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdf41505f0 0x7fbdf4151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:19.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.973+0000 7fbdf96ed640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdf41505f0 0x7fbdf4151030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46924/0 (socket says 172.21.15.103:46924) 2024-09-10T08:30:19.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.973+0000 7fbdf9eee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf40c42b0 0x7fbdf40ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:19.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.973+0000 7fbdf96ed640 1 -- 172.21.15.103:0/524224554 learned_addr learned my addr 172.21.15.103:0/524224554 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:19.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.973+0000 7fbdfa6ef640 1 --2- 172.21.15.103:0/524224554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbdf40718c0 0x7fbdf4151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:19.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.973+0000 7fbdf96ed640 1 -- 172.21.15.103:0/524224554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbdf40718c0 msgr2=0x7fbdf4151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:19.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.973+0000 7fbdf96ed640 1 --2- 172.21.15.103:0/524224554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbdf40718c0 0x7fbdf4151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:19.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.973+0000 7fbdf96ed640 1 -- 172.21.15.103:0/524224554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf40c42b0 msgr2=0x7fbdf40ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:19.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.973+0000 7fbdf96ed640 1 --2- 172.21.15.103:0/524224554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf40c42b0 0x7fbdf40ace10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:19.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.973+0000 7fbdf96ed640 1 -- 172.21.15.103:0/524224554 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf4070930 con 0x7fbdf41505f0 2024-09-10T08:30:19.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.974+0000 7fbdf96ed640 1 --2- 172.21.15.103:0/524224554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdf41505f0 0x7fbdf4151030 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbde400e9b0 tx=0x7fbde400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:19.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.974+0000 7fbdea7fc640 1 -- 172.21.15.103:0/524224554 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde4017070 con 0x7fbdf41505f0 2024-09-10T08:30:19.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.974+0000 7fbdea7fc640 1 -- 172.21.15.103:0/524224554 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbde400c9a0 con 0x7fbdf41505f0 2024-09-10T08:30:19.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.974+0000 7fbdfc152640 1 -- 172.21.15.103:0/524224554 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdf4070bf0 con 0x7fbdf41505f0 2024-09-10T08:30:19.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.974+0000 7fbdea7fc640 1 -- 172.21.15.103:0/524224554 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde400cd90 con 0x7fbdf41505f0 2024-09-10T08:30:19.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.974+0000 7fbdfc152640 1 -- 172.21.15.103:0/524224554 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdf41edaf0 con 0x7fbdf41505f0 2024-09-10T08:30:19.978 INFO:tasks.workunit.client.1.smithi154.stdout:checking whether build environment is sane... yes 2024-09-10T08:30:19.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.975+0000 7fbdfc152640 1 -- 172.21.15.103:0/524224554 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdf4153910 con 0x7fbdf41505f0 2024-09-10T08:30:19.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.975+0000 7fbdea7fc640 1 -- 172.21.15.103:0/524224554 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbde401a070 con 0x7fbdf41505f0 2024-09-10T08:30:19.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.976+0000 7fbdea7fc640 1 --2- 172.21.15.103:0/524224554 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbdd806be60 0x7fbdd806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:19.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.976+0000 7fbdea7fc640 1 -- 172.21.15.103:0/524224554 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fbde408b440 con 0x7fbdf41505f0 2024-09-10T08:30:19.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.976+0000 7fbdf9eee640 1 --2- 172.21.15.103:0/524224554 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbdd806be60 0x7fbdd806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:19.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.976+0000 7fbdf9eee640 1 --2- 172.21.15.103:0/524224554 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbdd806be60 0x7fbdd806e320 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0000f60 tx=0x7fbdf0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:19.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:19.980+0000 7fbdea7fc640 1 -- 172.21.15.103:0/524224554 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbde4059490 con 0x7fbdf41505f0 2024-09-10T08:30:20.200 INFO:tasks.workunit.client.1.smithi154.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-10T08:30:20.201 INFO:tasks.workunit.client.1.smithi154.stdout:checking for gawk... gawk 2024-09-10T08:30:20.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.215+0000 7fbdfc152640 1 -- 172.21.15.103:0/524224554 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbdf414c660 con 0x7fbdf41505f0 2024-09-10T08:30:20.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.215+0000 7fbdea7fc640 1 -- 172.21.15.103:0/524224554 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fbde405d790 con 0x7fbdf41505f0 2024-09-10T08:30:20.216 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:30:20.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.217+0000 7fbdfc152640 1 -- 172.21.15.103:0/524224554 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbdd806be60 msgr2=0x7fbdd806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.217+0000 7fbdfc152640 1 --2- 172.21.15.103:0/524224554 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbdd806be60 0x7fbdd806e320 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0000f60 tx=0x7fbdf0009040 comp rx=0 tx=0).stop 2024-09-10T08:30:20.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.217+0000 7fbdfc152640 1 -- 172.21.15.103:0/524224554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdf41505f0 msgr2=0x7fbdf4151030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.217+0000 7fbdfc152640 1 --2- 172.21.15.103:0/524224554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdf41505f0 0x7fbdf4151030 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbde400e9b0 tx=0x7fbde400ee70 comp rx=0 tx=0).stop 2024-09-10T08:30:20.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.217+0000 7fbdfc152640 1 -- 172.21.15.103:0/524224554 shutdown_connections 2024-09-10T08:30:20.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.217+0000 7fbdfc152640 1 --2- 172.21.15.103:0/524224554 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbdd806be60 0x7fbdd806e320 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.217+0000 7fbdfc152640 1 --2- 172.21.15.103:0/524224554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbdf40718c0 0x7fbdf4151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.217+0000 7fbdfc152640 1 --2- 172.21.15.103:0/524224554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdf41505f0 0x7fbdf4151030 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.217+0000 7fbdfc152640 1 --2- 172.21.15.103:0/524224554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf40c42b0 0x7fbdf40ace10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.217+0000 7fbdfc152640 1 -- 172.21.15.103:0/524224554 >> 172.21.15.103:0/524224554 conn(0x7fbdf40c7a40 msgr2=0x7fbdf414c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:20.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.217+0000 7fbdfc152640 1 -- 172.21.15.103:0/524224554 shutdown_connections 2024-09-10T08:30:20.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.217+0000 7fbdfc152640 1 -- 172.21.15.103:0/524224554 wait complete. 2024-09-10T08:30:20.220 INFO:tasks.workunit.client.1.smithi154.stdout:checking whether make sets $(MAKE)... yes 2024-09-10T08:30:20.229 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:30:20.229 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-10T08:30:20.229 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:30:20.229 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:30:20.260 INFO:tasks.workunit.client.1.smithi154.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-10T08:30:20.260 INFO:tasks.workunit.client.1.smithi154.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-10T08:30:20.276 INFO:tasks.workunit.client.1.smithi154.stdout:checking for style of include used by make... GNU 2024-09-10T08:30:20.281 INFO:tasks.workunit.client.1.smithi154.stdout:checking for gcc... gcc 2024-09-10T08:30:20.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.338+0000 7fd26b8e6640 1 Processor -- start 2024-09-10T08:30:20.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.338+0000 7fd26b8e6640 1 -- start start 2024-09-10T08:30:20.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.339+0000 7fd26b8e6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2640c32f0 0x7fd2640c3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.339+0000 7fd26b8e6640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd264154330 con 0x7fd26415c9b0 2024-09-10T08:30:20.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.339+0000 7fd26b8e6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd264154610 con 0x7fd264151840 2024-09-10T08:30:20.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.339+0000 7fd26b8e6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd2641550f0 con 0x7fd2640c32f0 2024-09-10T08:30:20.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.339+0000 7fd269e83640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd26415c9b0 0x7fd26415eda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39112/0 (socket says 172.21.15.103:39112) 2024-09-10T08:30:20.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.339+0000 7fd269e83640 1 -- 172.21.15.103:0/425080716 learned_addr learned my addr 172.21.15.103:0/425080716 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:30:20.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.339+0000 7fd268e81640 1 --2- 172.21.15.103:0/425080716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2640c32f0 0x7fd2640c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.339+0000 7fd25bfff640 1 -- 172.21.15.103:0/425080716 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2270328100 0 0) 0x7fd264154330 con 0x7fd26415c9b0 2024-09-10T08:30:20.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.339+0000 7fd25bfff640 1 -- 172.21.15.103:0/425080716 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd250003520 con 0x7fd26415c9b0 2024-09-10T08:30:20.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.339+0000 7fd25bfff640 1 -- 172.21.15.103:0/425080716 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1561353926 0 0) 0x7fd264154610 con 0x7fd264151840 2024-09-10T08:30:20.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.339+0000 7fd25bfff640 1 -- 172.21.15.103:0/425080716 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd264154330 con 0x7fd264151840 2024-09-10T08:30:20.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.339+0000 7fd25bfff640 1 -- 172.21.15.103:0/425080716 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 504647008 0 0) 0x7fd250003520 con 0x7fd26415c9b0 2024-09-10T08:30:20.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.339+0000 7fd268e81640 1 -- 172.21.15.103:0/425080716 >> v1:172.21.15.154:6789/0 conn(0x7fd264151840 legacy=0x7fd2640ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.339+0000 7fd268e81640 1 -- 172.21.15.103:0/425080716 >> v1:172.21.15.103:6789/0 conn(0x7fd26415c9b0 legacy=0x7fd26415eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.339+0000 7fd268e81640 1 -- 172.21.15.103:0/425080716 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2641548f0 con 0x7fd2640c32f0 2024-09-10T08:30:20.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.340+0000 7fd268e81640 1 --2- 172.21.15.103:0/425080716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2640c32f0 0x7fd2640c3740 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd254009750 tx=0x7fd25402a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea3734b5f3f220fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:20.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.340+0000 7fd25bfff640 1 -- 172.21.15.103:0/425080716 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd254037070 con 0x7fd2640c32f0 2024-09-10T08:30:20.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.340+0000 7fd25bfff640 1 -- 172.21.15.103:0/425080716 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd25402abd0 con 0x7fd2640c32f0 2024-09-10T08:30:20.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.340+0000 7fd25bfff640 1 -- 172.21.15.103:0/425080716 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c001a10 con 0x7fd2640c32f0 2024-09-10T08:30:20.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.341+0000 7fd26b8e6640 1 -- 172.21.15.103:0/425080716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2640c32f0 msgr2=0x7fd2640c3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.341+0000 7fd26b8e6640 1 --2- 172.21.15.103:0/425080716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2640c32f0 0x7fd2640c3740 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd254009750 tx=0x7fd25402a140 comp rx=0 tx=0).stop 2024-09-10T08:30:20.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.341+0000 7fd26b8e6640 1 -- 172.21.15.103:0/425080716 shutdown_connections 2024-09-10T08:30:20.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.341+0000 7fd26b8e6640 1 --2- 172.21.15.103:0/425080716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2640c32f0 0x7fd2640c3740 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.341+0000 7fd26b8e6640 1 -- 172.21.15.103:0/425080716 >> 172.21.15.103:0/425080716 conn(0x7fd2640c7a40 msgr2=0x7fd2640c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:20.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.341+0000 7fd26b8e6640 1 -- 172.21.15.103:0/425080716 shutdown_connections 2024-09-10T08:30:20.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.341+0000 7fd26b8e6640 1 -- 172.21.15.103:0/425080716 wait complete. 2024-09-10T08:30:20.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.342+0000 7fd26b8e6640 1 Processor -- start 2024-09-10T08:30:20.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.342+0000 7fd26b8e6640 1 -- start start 2024-09-10T08:30:20.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.343+0000 7fd26b8e6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2640c32f0 0x7fd264074240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.343+0000 7fd26b8e6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd264151840 0x7fd2640c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.343+0000 7fd26b8e6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd26415c9b0 0x7fd2641ea1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.343+0000 7fd26b8e6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd2640ad510 con 0x7fd2640c32f0 2024-09-10T08:30:20.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.343+0000 7fd26b8e6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd26406dda0 con 0x7fd26415c9b0 2024-09-10T08:30:20.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.343+0000 7fd26b8e6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd2640ad690 con 0x7fd264151840 2024-09-10T08:30:20.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.343+0000 7fd269682640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2640c32f0 0x7fd264074240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.343+0000 7fd269682640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2640c32f0 0x7fd264074240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46932/0 (socket says 172.21.15.103:46932) 2024-09-10T08:30:20.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.343+0000 7fd269682640 1 -- 172.21.15.103:0/1667069280 learned_addr learned my addr 172.21.15.103:0/1667069280 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:20.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.343+0000 7fd269e83640 1 --2- 172.21.15.103:0/1667069280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd26415c9b0 0x7fd2641ea1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.343+0000 7fd268e81640 1 --2- 172.21.15.103:0/1667069280 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd264151840 0x7fd2640c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.343+0000 7fd269682640 1 -- 172.21.15.103:0/1667069280 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd264151840 msgr2=0x7fd2640c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.343+0000 7fd269682640 1 --2- 172.21.15.103:0/1667069280 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd264151840 0x7fd2640c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.343+0000 7fd269682640 1 -- 172.21.15.103:0/1667069280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd26415c9b0 msgr2=0x7fd2641ea1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.343+0000 7fd269682640 1 --2- 172.21.15.103:0/1667069280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd26415c9b0 0x7fd2641ea1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.343+0000 7fd269682640 1 -- 172.21.15.103:0/1667069280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2640716d0 con 0x7fd2640c32f0 2024-09-10T08:30:20.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.343+0000 7fd269682640 1 --2- 172.21.15.103:0/1667069280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2640c32f0 0x7fd264074240 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd26000c7f0 tx=0x7fd26000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:20.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.343+0000 7fd259ffb640 1 -- 172.21.15.103:0/1667069280 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd260017070 con 0x7fd2640c32f0 2024-09-10T08:30:20.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.343+0000 7fd259ffb640 1 -- 172.21.15.103:0/1667069280 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd26000a640 con 0x7fd2640c32f0 2024-09-10T08:30:20.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.343+0000 7fd259ffb640 1 -- 172.21.15.103:0/1667069280 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26000aa30 con 0x7fd2640c32f0 2024-09-10T08:30:20.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.343+0000 7fd26b8e6640 1 -- 172.21.15.103:0/1667069280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2640709d0 con 0x7fd2640c32f0 2024-09-10T08:30:20.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.344+0000 7fd26b8e6640 1 -- 172.21.15.103:0/1667069280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2641ee030 con 0x7fd2640c32f0 2024-09-10T08:30:20.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.344+0000 7fd26b8e6640 1 --2- 172.21.15.103:0/1667069280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2641e9d30 0x7fd2641ea700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.345+0000 7fd26b8e6640 1 -- 172.21.15.103:0/1667069280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd26406e030 con 0x7fd2641e9d30 2024-09-10T08:30:20.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.345+0000 7fd268e81640 1 --2- 172.21.15.103:0/1667069280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2641e9d30 0x7fd2641ea700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.345+0000 7fd268e81640 1 -- 172.21.15.103:0/1667069280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2640c8640 con 0x7fd2641e9d30 2024-09-10T08:30:20.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.345+0000 7fd268e81640 1 --2- 172.21.15.103:0/1667069280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2641e9d30 0x7fd2641ea700 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd264068bd0 tx=0x7fd2540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:20.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.345+0000 7fd259ffb640 1 -- 172.21.15.103:0/1667069280 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd26001a070 con 0x7fd2640c32f0 2024-09-10T08:30:20.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.346+0000 7fd259ffb640 1 --2- 172.21.15.103:0/1667069280 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd24806be30 0x7fd24806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.346+0000 7fd269e83640 1 --2- 172.21.15.103:0/1667069280 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd24806be30 0x7fd24806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.346+0000 7fd259ffb640 1 -- 172.21.15.103:0/1667069280 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fd26008a8d0 con 0x7fd2640c32f0 2024-09-10T08:30:20.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.346+0000 7fd259ffb640 1 -- 172.21.15.103:0/1667069280 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd254037040 con 0x7fd2641e9d30 2024-09-10T08:30:20.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.346+0000 7fd259ffb640 1 -- 172.21.15.103:0/1667069280 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd254003810 con 0x7fd2641e9d30 2024-09-10T08:30:20.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.346+0000 7fd259ffb640 1 -- 172.21.15.103:0/1667069280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2641e9d30 msgr2=0x7fd2641ea700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.346+0000 7fd259ffb640 1 --2- 172.21.15.103:0/1667069280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2641e9d30 0x7fd2641ea700 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd264068bd0 tx=0x7fd2540046c0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.346+0000 7fd259ffb640 1 -- 172.21.15.103:0/1667069280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2641e9d30 msgr2=0x7fd2641ea700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:30:20.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.346+0000 7fd259ffb640 1 --2- 172.21.15.103:0/1667069280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2641e9d30 0x7fd2641ea700 secure :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd264068bd0 tx=0x7fd2540046c0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.346+0000 7fd269e83640 1 --2- 172.21.15.103:0/1667069280 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd24806be30 0x7fd24806e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd2640adba0 tx=0x7fd25c001250 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:20.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.352+0000 7fd26b8e6640 1 --2- 172.21.15.103:0/1667069280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2641597d0 0x7fd264159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.352+0000 7fd26b8e6640 1 -- 172.21.15.103:0/1667069280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd264157660 con 0x7fd2641597d0 2024-09-10T08:30:20.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.352+0000 7fd268e81640 1 --2- 172.21.15.103:0/1667069280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2641597d0 0x7fd264159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.352+0000 7fd268e81640 1 -- 172.21.15.103:0/1667069280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd2641eac40 con 0x7fd2641597d0 2024-09-10T08:30:20.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.352+0000 7fd268e81640 1 --2- 172.21.15.103:0/1667069280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2641597d0 0x7fd264159bb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd25402a180 tx=0x7fd254008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:20.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.353+0000 7fd259ffb640 1 -- 172.21.15.103:0/1667069280 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd254037040 con 0x7fd2641597d0 2024-09-10T08:30:20.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.353+0000 7fd259ffb640 1 -- 172.21.15.103:0/1667069280 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5057 (secure 0 0 0) 0x7fd254032b80 con 0x7fd2641597d0 2024-09-10T08:30:20.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.353+0000 7fd259ffb640 1 -- 172.21.15.103:0/1667069280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2641597d0 msgr2=0x7fd264159bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.353+0000 7fd259ffb640 1 --2- 172.21.15.103:0/1667069280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2641597d0 0x7fd264159bb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd25402a180 tx=0x7fd254008030 comp rx=0 tx=0).stop 2024-09-10T08:30:20.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.353+0000 7fd259ffb640 1 -- 172.21.15.103:0/1667069280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2641597d0 msgr2=0x7fd264159bb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:30:20.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.353+0000 7fd259ffb640 1 --2- 172.21.15.103:0/1667069280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2641597d0 0x7fd264159bb0 secure :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd25402a180 tx=0x7fd254008030 comp rx=0 tx=0).stop 2024-09-10T08:30:20.354 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:30:20.354 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:30:20.354 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:30:20.354 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:30:20.355 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 10, 2024-09-10T08:30:20.355 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 127916, 2024-09-10T08:30:20.355 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:30:20.355 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:30:20.355 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:30:20.355 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:30:20.355 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:20.355 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 11, 2024-09-10T08:30:20.355 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:30:20.355 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:30:20.356 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:30:20.356 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:20.356 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:20.356 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:20.356 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:20.356 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:20.356 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:20.356 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:20.356 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:20.356 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:20.356 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:20.356 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:20.356 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:20.356 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:30:20.356 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:30:20.357 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:20.357 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:20.357 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:20.357 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:20.357 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:20.357 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:20.357 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:20.357 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:20.357 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:20.357 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:20.357 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:20.357 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:20.357 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.357 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:30:20.358 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:30:20.358 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:30:20.358 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:30:20.358 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:30:20.358 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:30:20.358 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:30:20.358 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:30:20.358 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:30:20.358 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:30:20.358 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:30:20.358 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:30:20.358 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:30:20.358 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:30:20.358 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:30:20.358 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:30:20.359 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:30:20.359 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:20.359 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:20.359 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:20.359 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:20.359 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:20.359 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:20.359 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:20.359 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:20.359 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:20.359 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:20.359 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:20.359 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:20.359 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:30:20.359 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.360 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:30:20.360 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.360 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:30:20.360 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:30:20.360 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:20.360 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:20.360 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.360 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:20.360 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:30:20.360 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:20.360 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.360 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.360 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:20.360 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:30:20.361 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:20.361 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.361 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:20.361 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.361 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:30:20.361 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:30:20.361 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:20.361 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:20.361 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:20.361 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.361 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.361 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:30:20.361 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:30:20.361 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:20.361 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:20.362 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.362 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:20.362 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:30:20.362 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:20.362 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.362 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.362 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:20.362 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:30:20.362 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:20.362 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.362 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:20.362 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.362 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:30:20.362 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:30:20.363 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:20.363 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:20.363 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:20.363 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.363 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.363 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:30:20.363 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:30:20.363 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:20.363 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:20.363 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.363 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:20.363 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:30:20.363 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:20.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.364 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.364 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:20.364 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:30:20.364 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:20.364 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.364 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:20.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.364 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:30:20.364 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:30:20.364 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:20.364 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:20.364 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:20.364 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.364 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:20.365 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.365 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:30:20.365 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:30:20.365 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.365 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:20.365 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:20.365 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:30:20.365 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.365 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:20.365 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:30:20.365 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.365 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:20.366 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:20.366 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:30:20.366 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.366 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:20.366 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:30:20.366 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.366 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:20.366 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:20.366 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-10T08:30:20.366 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.366 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:20.366 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:30:20.366 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.366 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:20.367 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:20.367 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-10T08:30:20.367 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.367 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:20.367 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:30:20.367 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.367 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:20.367 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:20.367 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:30:20.367 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.367 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:20.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.367 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:30:20.367 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:30:20.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.353+0000 7fd26b8e6640 1 -- 172.21.15.103:0/1667069280 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd24806be30 msgr2=0x7fd24806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.353+0000 7fd26b8e6640 1 --2- 172.21.15.103:0/1667069280 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd24806be30 0x7fd24806e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd2640adba0 tx=0x7fd25c001250 comp rx=0 tx=0).stop 2024-09-10T08:30:20.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.353+0000 7fd26b8e6640 1 -- 172.21.15.103:0/1667069280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2640c32f0 msgr2=0x7fd264074240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.353+0000 7fd26b8e6640 1 --2- 172.21.15.103:0/1667069280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2640c32f0 0x7fd264074240 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd26000c7f0 tx=0x7fd26000ccb0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.353+0000 7fd269e83640 1 -- 172.21.15.103:0/1667069280 reap_dead start 2024-09-10T08:30:20.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.353+0000 7fd269e83640 1 -- 172.21.15.103:0/1667069280 reap_dead start 2024-09-10T08:30:20.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.353+0000 7fd26b8e6640 1 -- 172.21.15.103:0/1667069280 shutdown_connections 2024-09-10T08:30:20.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.353+0000 7fd26b8e6640 1 -- 172.21.15.103:0/1667069280 >> 172.21.15.103:0/1667069280 conn(0x7fd2640c7a40 msgr2=0x7fd264155970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:20.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.353+0000 7fd26b8e6640 1 -- 172.21.15.103:0/1667069280 shutdown_connections 2024-09-10T08:30:20.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.353+0000 7fd26b8e6640 1 -- 172.21.15.103:0/1667069280 wait complete. 2024-09-10T08:30:20.370 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:30:20.370 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:30:20.370 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:30:20.372 INFO:tasks.workunit.client.1.smithi154.stdout:checking for C compiler default output file name... a.out 2024-09-10T08:30:20.372 INFO:tasks.workunit.client.1.smithi154.stdout:checking whether the C compiler works... yes 2024-09-10T08:30:20.372 INFO:tasks.workunit.client.1.smithi154.stdout:checking whether we are cross compiling... no 2024-09-10T08:30:20.420 INFO:tasks.workunit.client.1.smithi154.stdout:checking for suffix of executables... 2024-09-10T08:30:20.465 INFO:tasks.workunit.client.1.smithi154.stdout:checking for suffix of object files... o 2024-09-10T08:30:20.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.495+0000 7fad0eba6640 1 Processor -- start 2024-09-10T08:30:20.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.495+0000 7fad0eba6640 1 -- start start 2024-09-10T08:30:20.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.496+0000 7fad0eba6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad080c3cb0 0x7fad080c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.496+0000 7fad0eba6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fad08159e00 0x7fad0815a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.496+0000 7fad0eba6640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad080c34f0 con 0x7fad08074230 2024-09-10T08:30:20.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.496+0000 7fad0eba6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fad080bed90 con 0x7fad08159e00 2024-09-10T08:30:20.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.496+0000 7fad0eba6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fad080c3820 con 0x7fad080c3cb0 2024-09-10T08:30:20.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.496+0000 7fad0c942640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fad08074230 0x7fad080c54b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39118/0 (socket says 172.21.15.103:39118) 2024-09-10T08:30:20.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.496+0000 7fad0c942640 1 -- 172.21.15.103:0/2520992764 learned_addr learned my addr 172.21.15.103:0/2520992764 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:30:20.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.496+0000 7fad0d143640 1 --2- 172.21.15.103:0/2520992764 >> v2:172.21.15.154:3300/0 conn(0x7fad08159e00 0x7fad0815a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.497+0000 7fad07fff640 1 --2- 172.21.15.103:0/2520992764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad080c3cb0 0x7fad080c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.497+0000 7fad077fe640 1 -- 172.21.15.103:0/2520992764 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2180221973 0 0) 0x7fad080c34f0 con 0x7fad08074230 2024-09-10T08:30:20.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.497+0000 7fad077fe640 1 -- 172.21.15.103:0/2520992764 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facf8003520 con 0x7fad08074230 2024-09-10T08:30:20.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.497+0000 7fad0d143640 1 -- 172.21.15.103:0/2520992764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad080c3cb0 msgr2=0x7fad080c40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:20.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.497+0000 7fad0d143640 1 --2- 172.21.15.103:0/2520992764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad080c3cb0 0x7fad080c40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.497+0000 7fad0d143640 1 -- 172.21.15.103:0/2520992764 >> v1:172.21.15.103:6789/0 conn(0x7fad08074230 legacy=0x7fad080c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.497+0000 7fad0d143640 1 -- 172.21.15.103:0/2520992764 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad080befe0 con 0x7fad08159e00 2024-09-10T08:30:20.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.497+0000 7fad07fff640 1 --2- 172.21.15.103:0/2520992764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad080c3cb0 0x7fad080c40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:30:20.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.498+0000 7fad0d143640 1 --2- 172.21.15.103:0/2520992764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad08159e00 0x7fad0815a230 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fad00009d90 tx=0x7fad0002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6465c5d319e5a48 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:20.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.498+0000 7fad077fe640 1 -- 172.21.15.103:0/2520992764 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad00031600 con 0x7fad08159e00 2024-09-10T08:30:20.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.498+0000 7fad077fe640 1 -- 172.21.15.103:0/2520992764 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad000317a0 con 0x7fad08159e00 2024-09-10T08:30:20.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.498+0000 7fad077fe640 1 -- 172.21.15.103:0/2520992764 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad00031b70 con 0x7fad08159e00 2024-09-10T08:30:20.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.499+0000 7fad0eba6640 1 -- 172.21.15.103:0/2520992764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad08159e00 msgr2=0x7fad0815a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.499+0000 7fad0eba6640 1 --2- 172.21.15.103:0/2520992764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad08159e00 0x7fad0815a230 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fad00009d90 tx=0x7fad0002a5d0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.499+0000 7fad0eba6640 1 -- 172.21.15.103:0/2520992764 shutdown_connections 2024-09-10T08:30:20.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.499+0000 7fad0eba6640 1 --2- 172.21.15.103:0/2520992764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad08159e00 0x7fad0815a230 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.499+0000 7fad0eba6640 1 --2- 172.21.15.103:0/2520992764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad080c3cb0 0x7fad080c40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.499+0000 7fad0eba6640 1 -- 172.21.15.103:0/2520992764 >> 172.21.15.103:0/2520992764 conn(0x7fad080c8a50 msgr2=0x7fad080c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:20.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.499+0000 7fad0eba6640 1 -- 172.21.15.103:0/2520992764 shutdown_connections 2024-09-10T08:30:20.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.499+0000 7fad0eba6640 1 -- 172.21.15.103:0/2520992764 wait complete. 2024-09-10T08:30:20.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.500+0000 7fad0eba6640 1 Processor -- start 2024-09-10T08:30:20.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.500+0000 7fad0eba6640 1 -- start start 2024-09-10T08:30:20.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.502+0000 7fad0eba6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad08074230 0x7fad081ec270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.502+0000 7fad0eba6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad080c3cb0 0x7fad080c2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.502+0000 7fad0eba6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad08159e00 0x7fad080ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.502+0000 7fad0eba6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fad080c5bc0 con 0x7fad080c3cb0 2024-09-10T08:30:20.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.502+0000 7fad0eba6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fad080bf5a0 con 0x7fad08159e00 2024-09-10T08:30:20.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.502+0000 7fad0eba6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fad080c5d40 con 0x7fad08074230 2024-09-10T08:30:20.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.502+0000 7fad0c942640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad08074230 0x7fad081ec270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.502+0000 7fad0c942640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad08074230 0x7fad081ec270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:48650/0 (socket says 172.21.15.103:48650) 2024-09-10T08:30:20.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.502+0000 7fad0c942640 1 -- 172.21.15.103:0/820142948 learned_addr learned my addr 172.21.15.103:0/820142948 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:20.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.502+0000 7fad0d143640 1 --2- 172.21.15.103:0/820142948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad08159e00 0x7fad080ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.502+0000 7fad07fff640 1 --2- 172.21.15.103:0/820142948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad080c3cb0 0x7fad080c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.502+0000 7fad0c942640 1 -- 172.21.15.103:0/820142948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad08159e00 msgr2=0x7fad080ac670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.502+0000 7fad0c942640 1 --2- 172.21.15.103:0/820142948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad08159e00 0x7fad080ac670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.502+0000 7fad0c942640 1 -- 172.21.15.103:0/820142948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad080c3cb0 msgr2=0x7fad080c2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.502+0000 7fad0c942640 1 --2- 172.21.15.103:0/820142948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad080c3cb0 0x7fad080c2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.502+0000 7fad0c942640 1 -- 172.21.15.103:0/820142948 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad080ad640 con 0x7fad08074230 2024-09-10T08:30:20.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.502+0000 7fad0c942640 1 --2- 172.21.15.103:0/820142948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad08074230 0x7fad081ec270 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7facfc001be0 tx=0x7facfc00a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:20.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.503+0000 7fad057fa640 1 -- 172.21.15.103:0/820142948 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc00ad40 con 0x7fad08074230 2024-09-10T08:30:20.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.503+0000 7fad057fa640 1 -- 172.21.15.103:0/820142948 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facfc005870 con 0x7fad08074230 2024-09-10T08:30:20.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.503+0000 7fad057fa640 1 -- 172.21.15.103:0/820142948 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc005ca0 con 0x7fad08074230 2024-09-10T08:30:20.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.503+0000 7fad0eba6640 1 -- 172.21.15.103:0/820142948 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad080c1d70 con 0x7fad08074230 2024-09-10T08:30:20.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.503+0000 7fad0eba6640 1 -- 172.21.15.103:0/820142948 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fad080bfef0 con 0x7fad08074230 2024-09-10T08:30:20.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.504+0000 7fad0eba6640 1 --2- 172.21.15.103:0/820142948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad080acbb0 0x7fad080c09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.504+0000 7fad0eba6640 1 -- 172.21.15.103:0/820142948 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fad08069a00 con 0x7fad080acbb0 2024-09-10T08:30:20.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.504+0000 7fad07fff640 1 --2- 172.21.15.103:0/820142948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad080acbb0 0x7fad080c09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.507 INFO:tasks.workunit.client.1.smithi154.stdout:checking whether we are using the GNU C compiler... yes 2024-09-10T08:30:20.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.504+0000 7fad07fff640 1 -- 172.21.15.103:0/820142948 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad08074610 con 0x7fad080acbb0 2024-09-10T08:30:20.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.505+0000 7fad07fff640 1 --2- 172.21.15.103:0/820142948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad080acbb0 0x7fad080c09b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fad080c87d0 tx=0x7facf4011d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:20.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.505+0000 7fad057fa640 1 -- 172.21.15.103:0/820142948 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7facfc007070 con 0x7fad08074230 2024-09-10T08:30:20.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.505+0000 7fad057fa640 1 --2- 172.21.15.103:0/820142948 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7facec06be30 0x7facec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.505+0000 7fad057fa640 1 -- 172.21.15.103:0/820142948 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7facfc0930b0 con 0x7fad08074230 2024-09-10T08:30:20.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.505+0000 7fad0d143640 1 --2- 172.21.15.103:0/820142948 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7facec06be30 0x7facec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.506+0000 7fad057fa640 1 -- 172.21.15.103:0/820142948 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf400fb60 con 0x7fad080acbb0 2024-09-10T08:30:20.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.506+0000 7fad057fa640 1 -- 172.21.15.103:0/820142948 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7facf400fd00 con 0x7fad080acbb0 2024-09-10T08:30:20.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.506+0000 7fad057fa640 1 -- 172.21.15.103:0/820142948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad080acbb0 msgr2=0x7fad080c09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.506+0000 7fad057fa640 1 --2- 172.21.15.103:0/820142948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad080acbb0 0x7fad080c09b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fad080c87d0 tx=0x7facf4011d40 comp rx=0 tx=0).stop 2024-09-10T08:30:20.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.506+0000 7fad057fa640 1 -- 172.21.15.103:0/820142948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad080acbb0 msgr2=0x7fad080c09b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:30:20.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.506+0000 7fad057fa640 1 --2- 172.21.15.103:0/820142948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad080acbb0 0x7fad080c09b0 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fad080c87d0 tx=0x7facf4011d40 comp rx=0 tx=0).stop 2024-09-10T08:30:20.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.506+0000 7fad0d143640 1 --2- 172.21.15.103:0/820142948 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7facec06be30 0x7facec06e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fad00034000 tx=0x7fad0002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:20.513 INFO:tasks.workunit.client.0.smithi103.stdout:checking dependency style of gcc... gcc3 2024-09-10T08:30:20.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.514+0000 7fad0eba6640 1 --2- 172.21.15.103:0/820142948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad080c0ef0 0x7fad080c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.514+0000 7fad0eba6640 1 -- 172.21.15.103:0/820142948 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fad080c6e30 con 0x7fad080c0ef0 2024-09-10T08:30:20.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.514+0000 7fad07fff640 1 --2- 172.21.15.103:0/820142948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad080c0ef0 0x7fad080c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.514+0000 7fad07fff640 1 -- 172.21.15.103:0/820142948 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fad080c2cd0 con 0x7fad080c0ef0 2024-09-10T08:30:20.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.515+0000 7fad07fff640 1 --2- 172.21.15.103:0/820142948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad080c0ef0 0x7fad080c12d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7facf401c000 tx=0x7facf40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:20.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.515+0000 7fad057fa640 1 -- 172.21.15.103:0/820142948 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf400fb60 con 0x7fad080c0ef0 2024-09-10T08:30:20.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.515+0000 7fad057fa640 1 -- 172.21.15.103:0/820142948 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7facf4022e50 con 0x7fad080c0ef0 2024-09-10T08:30:20.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.515+0000 7fad057fa640 1 -- 172.21.15.103:0/820142948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad080c0ef0 msgr2=0x7fad080c12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.515+0000 7fad057fa640 1 --2- 172.21.15.103:0/820142948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad080c0ef0 0x7fad080c12d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7facf401c000 tx=0x7facf40046c0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.515+0000 7fad057fa640 1 -- 172.21.15.103:0/820142948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad080c0ef0 msgr2=0x7fad080c12d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:30:20.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.515+0000 7fad057fa640 1 --2- 172.21.15.103:0/820142948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad080c0ef0 0x7fad080c12d0 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7facf401c000 tx=0x7facf40046c0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.516 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:30:20.517 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:30:20.517 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:30:20.517 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:30:20.517 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 10, 2024-09-10T08:30:20.517 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 26743, 2024-09-10T08:30:20.517 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:30:20.517 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:30:20.517 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:30:20.517 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:30:20.517 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:20.518 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 11, 2024-09-10T08:30:20.518 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:30:20.518 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:30:20.518 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:30:20.518 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:20.518 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:20.518 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:20.518 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:20.518 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:20.518 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:20.518 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:20.518 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:20.519 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:20.519 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:20.519 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:20.519 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:20.519 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:30:20.519 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:30:20.519 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:20.519 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:20.519 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:20.519 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:20.519 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:20.519 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:20.519 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:20.520 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:20.520 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:20.520 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:20.520 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:20.520 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:20.520 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.520 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:30:20.520 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:30:20.520 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:30:20.520 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:30:20.520 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:30:20.520 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:30:20.520 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:30:20.521 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:30:20.521 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:30:20.521 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:30:20.521 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:30:20.521 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:30:20.521 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:30:20.521 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:30:20.521 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:30:20.521 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:30:20.521 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:30:20.521 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:20.521 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:20.521 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:20.521 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:20.522 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:20.522 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:20.522 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:20.522 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:20.522 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:20.522 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:20.522 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:20.522 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:20.522 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:30:20.522 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.522 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:30:20.522 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.522 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:30:20.522 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:30:20.523 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:20.523 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:20.523 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.523 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:20.523 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:30:20.523 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:20.523 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.523 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.523 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:20.523 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:30:20.523 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:20.523 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.523 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:20.524 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.524 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:30:20.524 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:30:20.524 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:20.524 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:20.524 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:20.524 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.524 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.524 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:30:20.524 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:30:20.524 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:20.524 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:20.524 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.524 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:20.525 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:30:20.525 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:20.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.525 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.525 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:20.525 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:30:20.525 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:20.525 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.525 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:20.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.525 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:30:20.525 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:30:20.525 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:20.526 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:20.526 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:20.526 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.526 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.526 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:30:20.526 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:30:20.526 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:20.526 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:20.527 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.527 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:20.528 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:30:20.528 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:20.528 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.528 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.528 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:20.528 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:30:20.528 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:20.528 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.528 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:20.528 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.528 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:30:20.529 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:30:20.529 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:20.529 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:20.529 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:20.529 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.529 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:20.529 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.529 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:30:20.529 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:30:20.529 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.529 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:20.529 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:20.529 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:30:20.530 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.530 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:20.530 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:30:20.530 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.530 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:20.530 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:20.530 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:30:20.530 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.530 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:20.530 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.530 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:30:20.530 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:30:20.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.515+0000 7fad0eba6640 1 -- 172.21.15.103:0/820142948 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7facec06be30 msgr2=0x7facec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.515+0000 7fad0eba6640 1 --2- 172.21.15.103:0/820142948 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7facec06be30 0x7facec06e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fad00034000 tx=0x7fad0002f000 comp rx=0 tx=0).stop 2024-09-10T08:30:20.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.515+0000 7fad0eba6640 1 -- 172.21.15.103:0/820142948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad08074230 msgr2=0x7fad081ec270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.515+0000 7fad0eba6640 1 --2- 172.21.15.103:0/820142948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad08074230 0x7fad081ec270 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7facfc001be0 tx=0x7facfc00a430 comp rx=0 tx=0).stop 2024-09-10T08:30:20.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.515+0000 7fad0d143640 1 -- 172.21.15.103:0/820142948 reap_dead start 2024-09-10T08:30:20.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.515+0000 7fad0d143640 1 -- 172.21.15.103:0/820142948 reap_dead start 2024-09-10T08:30:20.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.516+0000 7fad0eba6640 1 -- 172.21.15.103:0/820142948 shutdown_connections 2024-09-10T08:30:20.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.516+0000 7fad0eba6640 1 -- 172.21.15.103:0/820142948 >> 172.21.15.103:0/820142948 conn(0x7fad080c8a50 msgr2=0x7fad08159180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:20.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.516+0000 7fad0eba6640 1 -- 172.21.15.103:0/820142948 shutdown_connections 2024-09-10T08:30:20.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.516+0000 7fad0eba6640 1 -- 172.21.15.103:0/820142948 wait complete. 2024-09-10T08:30:20.533 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:30:20.533 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:30:20.533 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:30:20.548 INFO:tasks.workunit.client.1.smithi154.stdout:checking whether gcc accepts -g... yes 2024-09-10T08:30:20.593 INFO:tasks.workunit.client.0.smithi103.stdout:checking how to run the C preprocessor... gcc -E 2024-09-10T08:30:20.626 INFO:tasks.workunit.client.1.smithi154.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-10T08:30:20.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.654+0000 7f48b5f3b640 1 Processor -- start 2024-09-10T08:30:20.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.654+0000 7f48b5f3b640 1 -- start start 2024-09-10T08:30:20.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.655+0000 7f48b5f3b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b00c4680 0x7f48b0156a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.655+0000 7f48b5f3b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f48b0156fc0 0x7f48b0157410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.655+0000 7f48b5f3b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48b0070590 con 0x7f48b00acc30 2024-09-10T08:30:20.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.655+0000 7f48b5f3b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f48b00c4ea0 con 0x7f48b0156fc0 2024-09-10T08:30:20.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.655+0000 7f48b5f3b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f48b00c4a60 con 0x7f48b00c4680 2024-09-10T08:30:20.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.655+0000 7f48af7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f48b00acc30 0x7f48b00c3f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39120/0 (socket says 172.21.15.103:39120) 2024-09-10T08:30:20.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.655+0000 7f48af7fe640 1 -- 172.21.15.103:0/2951409440 learned_addr learned my addr 172.21.15.103:0/2951409440 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:30:20.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.655+0000 7f48affff640 1 --2- 172.21.15.103:0/2951409440 >> v2:172.21.15.154:3300/0 conn(0x7f48b0156fc0 0x7f48b0157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.655+0000 7f48aeffd640 1 --2- 172.21.15.103:0/2951409440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b00c4680 0x7f48b0156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.655+0000 7f48ae7fc640 1 -- 172.21.15.103:0/2951409440 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3477211311 0 0) 0x7f48b0070590 con 0x7f48b00acc30 2024-09-10T08:30:20.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.655+0000 7f48affff640 1 -- 172.21.15.103:0/2951409440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b00c4680 msgr2=0x7f48b0156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:20.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.655+0000 7f48affff640 1 --2- 172.21.15.103:0/2951409440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b00c4680 0x7f48b0156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.655+0000 7f48affff640 1 -- 172.21.15.103:0/2951409440 >> v1:172.21.15.103:6789/0 conn(0x7f48b00acc30 legacy=0x7f48b00c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.655+0000 7f48affff640 1 -- 172.21.15.103:0/2951409440 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b00a8220 con 0x7f48b0156fc0 2024-09-10T08:30:20.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.655+0000 7f48aeffd640 1 --2- 172.21.15.103:0/2951409440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b00c4680 0x7f48b0156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:30:20.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.656+0000 7f48affff640 1 --2- 172.21.15.103:0/2951409440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b0156fc0 0x7f48b0157410 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f48a8009d90 tx=0x7f48a802a540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d7205a4bbda2516 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:20.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.657+0000 7f48ae7fc640 1 -- 172.21.15.103:0/2951409440 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a8007740 con 0x7f48b0156fc0 2024-09-10T08:30:20.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.657+0000 7f48ae7fc640 1 -- 172.21.15.103:0/2951409440 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48a80078e0 con 0x7f48b0156fc0 2024-09-10T08:30:20.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.657+0000 7f48ae7fc640 1 -- 172.21.15.103:0/2951409440 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a8007cb0 con 0x7f48b0156fc0 2024-09-10T08:30:20.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.657+0000 7f48b5f3b640 1 -- 172.21.15.103:0/2951409440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b0156fc0 msgr2=0x7f48b0157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.657+0000 7f48b5f3b640 1 --2- 172.21.15.103:0/2951409440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b0156fc0 0x7f48b0157410 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f48a8009d90 tx=0x7f48a802a540 comp rx=0 tx=0).stop 2024-09-10T08:30:20.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.658+0000 7f48b5f3b640 1 -- 172.21.15.103:0/2951409440 shutdown_connections 2024-09-10T08:30:20.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.658+0000 7f48b5f3b640 1 --2- 172.21.15.103:0/2951409440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b0156fc0 0x7f48b0157410 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.658+0000 7f48b5f3b640 1 --2- 172.21.15.103:0/2951409440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b00c4680 0x7f48b0156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.658+0000 7f48b5f3b640 1 -- 172.21.15.103:0/2951409440 >> 172.21.15.103:0/2951409440 conn(0x7f48b00c5660 msgr2=0x7f48b00c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:20.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.658+0000 7f48b5f3b640 1 -- 172.21.15.103:0/2951409440 shutdown_connections 2024-09-10T08:30:20.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.658+0000 7f48b5f3b640 1 -- 172.21.15.103:0/2951409440 wait complete. 2024-09-10T08:30:20.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.659+0000 7f48b5f3b640 1 Processor -- start 2024-09-10T08:30:20.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.659+0000 7f48b5f3b640 1 -- start start 2024-09-10T08:30:20.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.660+0000 7f48b5f3b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b00acc30 0x7f48b00c2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.660+0000 7f48b5f3b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48b00c4680 0x7f48b006dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.660+0000 7f48b5f3b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b0156fc0 0x7f48b006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.660+0000 7f48b5f3b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f48b00702b0 con 0x7f48b00c4680 2024-09-10T08:30:20.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.660+0000 7f48b5f3b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f48b006ffd0 con 0x7f48b0156fc0 2024-09-10T08:30:20.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.660+0000 7f48b5f3b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f48b00c5330 con 0x7f48b00acc30 2024-09-10T08:30:20.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.660+0000 7f48aeffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48b00c4680 0x7f48b006dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.660+0000 7f48affff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b0156fc0 0x7f48b006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.660+0000 7f48af7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b00acc30 0x7f48b00c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.660+0000 7f48aeffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48b00c4680 0x7f48b006dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46964/0 (socket says 172.21.15.103:46964) 2024-09-10T08:30:20.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.660+0000 7f48aeffd640 1 -- 172.21.15.103:0/2806826968 learned_addr learned my addr 172.21.15.103:0/2806826968 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:20.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.660+0000 7f48aeffd640 1 -- 172.21.15.103:0/2806826968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b00acc30 msgr2=0x7f48b00c2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.660+0000 7f48aeffd640 1 --2- 172.21.15.103:0/2806826968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b00acc30 0x7f48b00c2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.660+0000 7f48aeffd640 1 -- 172.21.15.103:0/2806826968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b0156fc0 msgr2=0x7f48b006e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.660+0000 7f48aeffd640 1 --2- 172.21.15.103:0/2806826968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b0156fc0 0x7f48b006e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.660+0000 7f48aeffd640 1 -- 172.21.15.103:0/2806826968 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b00a8010 con 0x7f48b00c4680 2024-09-10T08:30:20.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.660+0000 7f48aeffd640 1 --2- 172.21.15.103:0/2806826968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48b00c4680 0x7f48b006dd60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f48a400e960 tx=0x7f48a400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:20.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.660+0000 7f4897fff640 1 -- 172.21.15.103:0/2806826968 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a4017070 con 0x7f48b00c4680 2024-09-10T08:30:20.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.660+0000 7f4897fff640 1 -- 172.21.15.103:0/2806826968 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48a400ca00 con 0x7f48b00c4680 2024-09-10T08:30:20.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.660+0000 7f48b5f3b640 1 -- 172.21.15.103:0/2806826968 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48b006bec0 con 0x7f48b00c4680 2024-09-10T08:30:20.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.661+0000 7f4897fff640 1 -- 172.21.15.103:0/2806826968 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a400cdd0 con 0x7f48b00c4680 2024-09-10T08:30:20.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.661+0000 7f48b5f3b640 1 -- 172.21.15.103:0/2806826968 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48b01ec130 con 0x7f48b00c4680 2024-09-10T08:30:20.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.661+0000 7f48b5f3b640 1 --2- 172.21.15.103:0/2806826968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b00a78a0 0x7f48b01eebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.662+0000 7f48b5f3b640 1 -- 172.21.15.103:0/2806826968 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f48b00a7c80 con 0x7f48b00a78a0 2024-09-10T08:30:20.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.662+0000 7f48af7fe640 1 --2- 172.21.15.103:0/2806826968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b00a78a0 0x7f48b01eebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.665 INFO:tasks.workunit.client.0.smithi103.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-10T08:30:20.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.662+0000 7f48af7fe640 1 -- 172.21.15.103:0/2806826968 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48b00c63f0 con 0x7f48b00a78a0 2024-09-10T08:30:20.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.662+0000 7f48af7fe640 1 --2- 172.21.15.103:0/2806826968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b00a78a0 0x7f48b01eebe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f48b01efd00 tx=0x7f48a000fc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.662+0000 7f4897fff640 1 -- 172.21.15.103:0/2806826968 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48a401a070 con 0x7f48b00c4680 2024-09-10T08:30:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.663+0000 7f4897fff640 1 --2- 172.21.15.103:0/2806826968 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f489c06be30 0x7f489c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.663+0000 7f48affff640 1 --2- 172.21.15.103:0/2806826968 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f489c06be30 0x7f489c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.663+0000 7f4897fff640 1 -- 172.21.15.103:0/2806826968 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f48a408b060 con 0x7f48b00c4680 2024-09-10T08:30:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.663+0000 7f4897fff640 1 -- 172.21.15.103:0/2806826968 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a00058b0 con 0x7f48b00a78a0 2024-09-10T08:30:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.663+0000 7f4897fff640 1 -- 172.21.15.103:0/2806826968 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f48a0018070 con 0x7f48b00a78a0 2024-09-10T08:30:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.663+0000 7f4897fff640 1 -- 172.21.15.103:0/2806826968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b00a78a0 msgr2=0x7f48b01eebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.663+0000 7f4897fff640 1 --2- 172.21.15.103:0/2806826968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b00a78a0 0x7f48b01eebe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f48b01efd00 tx=0x7f48a000fc00 comp rx=0 tx=0).stop 2024-09-10T08:30:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.663+0000 7f4897fff640 1 -- 172.21.15.103:0/2806826968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b00a78a0 msgr2=0x7f48b01eebe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:30:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.663+0000 7f4897fff640 1 --2- 172.21.15.103:0/2806826968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b00a78a0 0x7f48b01eebe0 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f48b01efd00 tx=0x7f48a000fc00 comp rx=0 tx=0).stop 2024-09-10T08:30:20.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.663+0000 7f48affff640 1 --2- 172.21.15.103:0/2806826968 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f489c06be30 0x7f489c06e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f48a8034000 tx=0x7f48a802f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:20.668 INFO:tasks.workunit.client.0.smithi103.stdout:checking for egrep... /usr/bin/grep -E 2024-09-10T08:30:20.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.670+0000 7f48b5f3b640 1 --2- 172.21.15.103:0/2806826968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b01ec330 0x7f48b01ef120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.670+0000 7f48b5f3b640 1 -- 172.21.15.103:0/2806826968 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f48b01ef660 con 0x7f48b01ec330 2024-09-10T08:30:20.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.671+0000 7f48af7fe640 1 --2- 172.21.15.103:0/2806826968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b01ec330 0x7f48b01ef120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.671+0000 7f48af7fe640 1 -- 172.21.15.103:0/2806826968 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f48b0074610 con 0x7f48b01ec330 2024-09-10T08:30:20.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.671+0000 7f48af7fe640 1 --2- 172.21.15.103:0/2806826968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b01ec330 0x7f48b01ef120 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f48a0000f60 tx=0x7f48a00057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:20.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.671+0000 7f4897fff640 1 -- 172.21.15.103:0/2806826968 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a001d7c0 con 0x7f48b01ec330 2024-09-10T08:30:20.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.672+0000 7f4897fff640 1 -- 172.21.15.103:0/2806826968 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f48a001d7c0 con 0x7f48b01ec330 2024-09-10T08:30:20.673 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:30:20.673 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:30:20.673 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:30:20.673 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:30:20.673 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 10, 2024-09-10T08:30:20.673 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 128232, 2024-09-10T08:30:20.673 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:30:20.673 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:30:20.673 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:30:20.673 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:30:20.673 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:20.673 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 11, 2024-09-10T08:30:20.674 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:30:20.674 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:30:20.674 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:30:20.674 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:20.674 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:20.674 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:20.674 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:20.674 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:20.674 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:20.674 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:20.674 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:20.674 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:20.674 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:20.675 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:20.675 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:20.675 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:30:20.675 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:30:20.675 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:20.675 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:20.675 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:20.675 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:20.675 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:20.675 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:20.675 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:20.675 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:20.675 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:20.675 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:20.676 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:20.676 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:20.676 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.676 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:30:20.676 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:30:20.676 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:30:20.676 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:30:20.676 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:30:20.676 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:30:20.676 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:30:20.676 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:30:20.676 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:30:20.676 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:30:20.677 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:30:20.677 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:30:20.677 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:30:20.677 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:30:20.677 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:30:20.677 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:30:20.677 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:30:20.677 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:20.677 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:20.677 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:20.677 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:20.677 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:20.677 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:20.678 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:20.678 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:20.678 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:20.678 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:20.678 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:20.678 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:20.678 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:30:20.678 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.678 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:30:20.678 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.678 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:30:20.678 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:30:20.679 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:20.679 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:20.679 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.679 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:20.679 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:30:20.679 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:20.679 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.679 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.679 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:20.679 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:30:20.679 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:20.679 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.679 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:20.679 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.680 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:30:20.680 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:30:20.680 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:20.680 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:20.680 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:20.680 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.680 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.680 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:30:20.680 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:30:20.680 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:20.680 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:20.680 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.680 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:20.680 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:30:20.681 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:20.681 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.681 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.681 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:20.681 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:30:20.681 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:20.681 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.681 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:20.681 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.681 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:30:20.681 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:30:20.681 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:20.681 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:20.681 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:20.682 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.682 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.682 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:30:20.682 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:30:20.682 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:20.682 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:20.682 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.682 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:20.682 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:30:20.682 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:20.682 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.682 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.683 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:20.683 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:30:20.683 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:20.683 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.683 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:20.683 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.683 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:30:20.683 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:30:20.683 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:20.683 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:20.683 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:20.683 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.683 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:20.684 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.684 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:30:20.684 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:30:20.684 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.684 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:20.684 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:20.684 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:30:20.684 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.684 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:20.684 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:30:20.684 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.684 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:20.685 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:20.685 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:30:20.685 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.685 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:20.685 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:30:20.685 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.685 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:20.685 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:20.685 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:30:20.685 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.685 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:20.685 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:30:20.685 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.685 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:20.686 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:20.686 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:30:20.686 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.686 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:20.686 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:30:20.686 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:20.686 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:20.686 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:20.686 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:30:20.686 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:20.686 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:20.686 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:20.686 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:30:20.687 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:30:20.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.672+0000 7f4897fff640 1 -- 172.21.15.103:0/2806826968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b01ec330 msgr2=0x7f48b01ef120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.672+0000 7f4897fff640 1 --2- 172.21.15.103:0/2806826968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b01ec330 0x7f48b01ef120 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f48a0000f60 tx=0x7f48a00057f0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.672+0000 7f4897fff640 1 -- 172.21.15.103:0/2806826968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b01ec330 msgr2=0x7f48b01ef120 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:30:20.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.672+0000 7f4897fff640 1 --2- 172.21.15.103:0/2806826968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48b01ec330 0x7f48b01ef120 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.672+0000 7f48b5f3b640 1 -- 172.21.15.103:0/2806826968 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f489c06be30 msgr2=0x7f489c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.672+0000 7f48b5f3b640 1 --2- 172.21.15.103:0/2806826968 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f489c06be30 0x7f489c06e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f48a8034000 tx=0x7f48a802f000 comp rx=0 tx=0).stop 2024-09-10T08:30:20.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.672+0000 7f48affff640 1 -- 172.21.15.103:0/2806826968 reap_dead start 2024-09-10T08:30:20.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.673+0000 7f48b5f3b640 1 -- 172.21.15.103:0/2806826968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48b00c4680 msgr2=0x7f48b006dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.673+0000 7f48b5f3b640 1 --2- 172.21.15.103:0/2806826968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48b00c4680 0x7f48b006dd60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f48a400e960 tx=0x7f48a400ee20 comp rx=0 tx=0).stop 2024-09-10T08:30:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.673+0000 7f48b5f3b640 1 -- 172.21.15.103:0/2806826968 shutdown_connections 2024-09-10T08:30:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.673+0000 7f48b5f3b640 1 --2- 172.21.15.103:0/2806826968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48b00c4680 0x7f48b006dd60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.673+0000 7f48b5f3b640 1 -- 172.21.15.103:0/2806826968 >> 172.21.15.103:0/2806826968 conn(0x7f48b00c5660 msgr2=0x7f48b00aa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.673+0000 7f48b5f3b640 1 -- 172.21.15.103:0/2806826968 shutdown_connections 2024-09-10T08:30:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.673+0000 7f48b5f3b640 1 -- 172.21.15.103:0/2806826968 wait complete. 2024-09-10T08:30:20.689 INFO:tasks.workunit.client.0.smithi103.stdout:checking for AIX... no 2024-09-10T08:30:20.690 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:30:20.690 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-09-10T08:30:20.691 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-10T08:30:20.691 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-10T08:30:20.691 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-10T08:30:20.691 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T08:30:20.691 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:30:20.704 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T08:30:20.704 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-10T08:30:20.704 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:30:20.705 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gcc... (cached) gcc 2024-09-10T08:30:20.718 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-10T08:30:20.719 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-10T08:30:20.720 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-10T08:30:20.720 INFO:tasks.workunit.client.0.smithi103.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-10T08:30:20.784 INFO:tasks.workunit.client.1.smithi154.stdout:checking dependency style of gcc... gcc3 2024-09-10T08:30:20.805 INFO:tasks.workunit.client.0.smithi103.stdout:checking for main in -lm... yes 2024-09-10T08:30:20.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.825+0000 7f4cf9f8d640 1 Processor -- start 2024-09-10T08:30:20.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.826+0000 7f4cf9f8d640 1 -- start start 2024-09-10T08:30:20.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.827+0000 7f4cf9f8d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4cf40c7a90 0x7f4cf40c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.827+0000 7f4cf9f8d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf40a7cc0 con 0x7f4cf40c3cf0 2024-09-10T08:30:20.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.827+0000 7f4cf9f8d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf40a7f60 con 0x7f4cf40aeb10 2024-09-10T08:30:20.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.827+0000 7f4cf9f8d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4cf40c3580 con 0x7f4cf40c7a90 2024-09-10T08:30:20.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.827+0000 7f4cf3fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4cf40c3cf0 0x7f4cf40c4140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39130/0 (socket says 172.21.15.103:39130) 2024-09-10T08:30:20.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.827+0000 7f4cf3fff640 1 -- 172.21.15.103:0/2087438300 learned_addr learned my addr 172.21.15.103:0/2087438300 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:30:20.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.827+0000 7f4cf2ffd640 1 --2- 172.21.15.103:0/2087438300 >> v2:172.21.15.154:3300/0 conn(0x7f4cf40c7a90 0x7f4cf40c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.827+0000 7f4cf27fc640 1 -- 172.21.15.103:0/2087438300 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 146762919 0 0) 0x7f4cf40a7cc0 con 0x7f4cf40c3cf0 2024-09-10T08:30:20.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.827+0000 7f4cf27fc640 1 -- 172.21.15.103:0/2087438300 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cdc003520 con 0x7f4cf40c3cf0 2024-09-10T08:30:20.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.827+0000 7f4cf2ffd640 1 -- 172.21.15.103:0/2087438300 >> v1:172.21.15.154:6789/0 conn(0x7f4cf40aeb10 legacy=0x7f4cf4156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.827+0000 7f4cf27fc640 1 -- 172.21.15.103:0/2087438300 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1803516759 0 0) 0x7f4cf40a7f60 con 0x7f4cf40aeb10 2024-09-10T08:30:20.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.827+0000 7f4cf2ffd640 1 -- 172.21.15.103:0/2087438300 >> v1:172.21.15.103:6789/0 conn(0x7f4cf40c3cf0 legacy=0x7f4cf40c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.827+0000 7f4cf2ffd640 1 -- 172.21.15.103:0/2087438300 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf40a8240 con 0x7f4cf40c7a90 2024-09-10T08:30:20.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.828+0000 7f4cf2ffd640 1 --2- 172.21.15.103:0/2087438300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cf40c7a90 0x7f4cf40c7ef0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80097a0 tx=0x7f4ce802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21a66324ded4fbdd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:20.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.828+0000 7f4cf27fc640 1 -- 172.21.15.103:0/2087438300 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8037070 con 0x7f4cf40c7a90 2024-09-10T08:30:20.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.829+0000 7f4cf27fc640 1 -- 172.21.15.103:0/2087438300 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce8032440 con 0x7f4cf40c7a90 2024-09-10T08:30:20.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.829+0000 7f4cf27fc640 1 -- 172.21.15.103:0/2087438300 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce802ae60 con 0x7f4cf40c7a90 2024-09-10T08:30:20.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.829+0000 7f4cf9f8d640 1 -- 172.21.15.103:0/2087438300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cf40c7a90 msgr2=0x7f4cf40c7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.829+0000 7f4cf9f8d640 1 --2- 172.21.15.103:0/2087438300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cf40c7a90 0x7f4cf40c7ef0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80097a0 tx=0x7f4ce802a110 comp rx=0 tx=0).stop 2024-09-10T08:30:20.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.829+0000 7f4cf9f8d640 1 -- 172.21.15.103:0/2087438300 shutdown_connections 2024-09-10T08:30:20.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.829+0000 7f4cf9f8d640 1 --2- 172.21.15.103:0/2087438300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cf40c7a90 0x7f4cf40c7ef0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.829+0000 7f4cf9f8d640 1 -- 172.21.15.103:0/2087438300 >> 172.21.15.103:0/2087438300 conn(0x7f4cf40c5680 msgr2=0x7f4cf40c5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:20.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.829+0000 7f4cf9f8d640 1 -- 172.21.15.103:0/2087438300 shutdown_connections 2024-09-10T08:30:20.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.830+0000 7f4cf9f8d640 1 -- 172.21.15.103:0/2087438300 wait complete. 2024-09-10T08:30:20.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.831+0000 7f4cf9f8d640 1 Processor -- start 2024-09-10T08:30:20.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.831+0000 7f4cf9f8d640 1 -- start start 2024-09-10T08:30:20.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.832+0000 7f4cf9f8d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cf40aeb10 0x7f4cf40be340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.832+0000 7f4cf9f8d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cf40c3cf0 0x7f4cf40be880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.832+0000 7f4cf37fe640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cf40aeb10 msgr2=0x7f4cf40be340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:30:20.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.832+0000 7f4cf37fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cf40aeb10 0x7f4cf40be340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:30:20.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.832+0000 7f4cf9f8d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cf40c7a90 0x7f4cf41523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.832+0000 7f4cf2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cf40c3cf0 0x7f4cf40be880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.832+0000 7f4cf2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cf40c3cf0 0x7f4cf40be880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46970/0 (socket says 172.21.15.103:46970) 2024-09-10T08:30:20.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.833+0000 7f4cf2ffd640 1 -- 172.21.15.103:0/1407198626 learned_addr learned my addr 172.21.15.103:0/1407198626 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:20.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.833+0000 7f4cf9f8d640 1 -- 172.21.15.103:0/1407198626 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf40c5240 con 0x7f4cf40c3cf0 2024-09-10T08:30:20.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.833+0000 7f4cf9f8d640 1 -- 172.21.15.103:0/1407198626 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf40c3860 con 0x7f4cf40c7a90 2024-09-10T08:30:20.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.833+0000 7f4cf9f8d640 1 -- 172.21.15.103:0/1407198626 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf40c53c0 con 0x7f4cf40aeb10 2024-09-10T08:30:20.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.833+0000 7f4cf3fff640 1 --2- 172.21.15.103:0/1407198626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cf40c7a90 0x7f4cf41523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.833+0000 7f4cf2ffd640 1 -- 172.21.15.103:0/1407198626 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cf40aeb10 msgr2=0x7f4cf40be340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:30:20.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.833+0000 7f4cf2ffd640 1 --2- 172.21.15.103:0/1407198626 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cf40aeb10 0x7f4cf40be340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.833+0000 7f4cf2ffd640 1 -- 172.21.15.103:0/1407198626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cf40c7a90 msgr2=0x7f4cf41523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:20.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.833+0000 7f4cf2ffd640 1 --2- 172.21.15.103:0/1407198626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cf40c7a90 0x7f4cf41523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:20.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.833+0000 7f4cf2ffd640 1 -- 172.21.15.103:0/1407198626 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf40bedc0 con 0x7f4cf40c3cf0 2024-09-10T08:30:20.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.833+0000 7f4cf2ffd640 1 --2- 172.21.15.103:0/1407198626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cf40c3cf0 0x7f4cf40be880 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8035040 tx=0x7f4ce80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:20.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.833+0000 7f4cdbfff640 1 -- 172.21.15.103:0/1407198626 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8041020 con 0x7f4cf40c3cf0 2024-09-10T08:30:20.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.833+0000 7f4cdbfff640 1 -- 172.21.15.103:0/1407198626 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce803d6e0 con 0x7f4cf40c3cf0 2024-09-10T08:30:20.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.834+0000 7f4cdbfff640 1 -- 172.21.15.103:0/1407198626 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8037040 con 0x7f4cf40c3cf0 2024-09-10T08:30:20.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.834+0000 7f4cf9f8d640 1 -- 172.21.15.103:0/1407198626 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf41e1ec0 con 0x7f4cf40c3cf0 2024-09-10T08:30:20.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.834+0000 7f4cf9f8d640 1 -- 172.21.15.103:0/1407198626 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf41eccf0 con 0x7f4cf40c3cf0 2024-09-10T08:30:20.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.835+0000 7f4cf9f8d640 1 -- 172.21.15.103:0/1407198626 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cf40c7ef0 con 0x7f4cf40c3cf0 2024-09-10T08:30:20.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.836+0000 7f4cdbfff640 1 -- 172.21.15.103:0/1407198626 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ce8044020 con 0x7f4cf40c3cf0 2024-09-10T08:30:20.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.836+0000 7f4cdbfff640 1 --2- 172.21.15.103:0/1407198626 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4ce006bde0 0x7f4ce006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:20.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.837+0000 7f4cdbfff640 1 -- 172.21.15.103:0/1407198626 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f4ce80ab8c0 con 0x7f4cf40c3cf0 2024-09-10T08:30:20.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.837+0000 7f4cf37fe640 1 --2- 172.21.15.103:0/1407198626 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4ce006bde0 0x7f4ce006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:20.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.837+0000 7f4cf37fe640 1 --2- 172.21.15.103:0/1407198626 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4ce006bde0 0x7f4ce006e2a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4cf41557b0 tx=0x7f4ce4007a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:20.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:20.842+0000 7f4cdbfff640 1 -- 172.21.15.103:0/1407198626 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ce804b030 con 0x7f4cf40c3cf0 2024-09-10T08:30:20.856 INFO:tasks.workunit.client.1.smithi154.stdout:checking how to run the C preprocessor... gcc -E 2024-09-10T08:30:20.891 INFO:tasks.workunit.client.0.smithi103.stdout:checking for main in -lpthread... yes 2024-09-10T08:30:20.915 INFO:tasks.workunit.client.1.smithi154.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-10T08:30:20.916 INFO:tasks.workunit.client.1.smithi154.stdout:checking for egrep... /usr/bin/grep -E 2024-09-10T08:30:20.929 INFO:tasks.workunit.client.1.smithi154.stdout:checking for AIX... no 2024-09-10T08:30:20.965 INFO:tasks.workunit.client.1.smithi154.stdout:checking for gcc... (cached) gcc 2024-09-10T08:30:20.977 INFO:tasks.workunit.client.1.smithi154.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-10T08:30:20.977 INFO:tasks.workunit.client.1.smithi154.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-10T08:30:20.978 INFO:tasks.workunit.client.1.smithi154.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-10T08:30:20.979 INFO:tasks.workunit.client.1.smithi154.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-10T08:30:21.060 INFO:tasks.workunit.client.1.smithi154.stdout:checking for main in -lm... yes 2024-09-10T08:30:21.131 INFO:tasks.workunit.client.0.smithi103.stdout:checking for ANSI C header files... yes 2024-09-10T08:30:21.136 INFO:tasks.workunit.client.1.smithi154.stdout:checking for main in -lpthread... yes 2024-09-10T08:30:21.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:21.156+0000 7f4cf9f8d640 1 -- 172.21.15.103:0/1407198626 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4cf40704b0 con 0x7f4cf40c3cf0 2024-09-10T08:30:21.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:21.157+0000 7f4cdbfff640 1 -- 172.21.15.103:0/1407198626 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f4ce8079f60 con 0x7f4cf40c3cf0 2024-09-10T08:30:21.157 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:30:21.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:21.159+0000 7f4cf9f8d640 1 -- 172.21.15.103:0/1407198626 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4ce006bde0 msgr2=0x7f4ce006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:21.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:21.159+0000 7f4cf9f8d640 1 --2- 172.21.15.103:0/1407198626 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4ce006bde0 0x7f4ce006e2a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4cf41557b0 tx=0x7f4ce4007a30 comp rx=0 tx=0).stop 2024-09-10T08:30:21.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:21.159+0000 7f4cf9f8d640 1 -- 172.21.15.103:0/1407198626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cf40c3cf0 msgr2=0x7f4cf40be880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:21.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:21.159+0000 7f4cf9f8d640 1 --2- 172.21.15.103:0/1407198626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cf40c3cf0 0x7f4cf40be880 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8035040 tx=0x7f4ce80046c0 comp rx=0 tx=0).stop 2024-09-10T08:30:21.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:21.159+0000 7f4cf9f8d640 1 -- 172.21.15.103:0/1407198626 shutdown_connections 2024-09-10T08:30:21.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:21.159+0000 7f4cf9f8d640 1 --2- 172.21.15.103:0/1407198626 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4ce006bde0 0x7f4ce006e2a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:21.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:21.159+0000 7f4cf9f8d640 1 --2- 172.21.15.103:0/1407198626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cf40c7a90 0x7f4cf41523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:21.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:21.159+0000 7f4cf9f8d640 1 --2- 172.21.15.103:0/1407198626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cf40c3cf0 0x7f4cf40be880 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:21.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:21.159+0000 7f4cf9f8d640 1 --2- 172.21.15.103:0/1407198626 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cf40aeb10 0x7f4cf40be340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:21.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:21.159+0000 7f4cf9f8d640 1 -- 172.21.15.103:0/1407198626 >> 172.21.15.103:0/1407198626 conn(0x7f4cf40c5680 msgr2=0x7f4cf4156a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:21.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:21.159+0000 7f4cf9f8d640 1 -- 172.21.15.103:0/1407198626 shutdown_connections 2024-09-10T08:30:21.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:21.159+0000 7f4cf9f8d640 1 -- 172.21.15.103:0/1407198626 wait complete. 2024-09-10T08:30:21.202 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-10T08:30:21.344 INFO:tasks.workunit.client.1.smithi154.stdout:checking for ANSI C header files... yes 2024-09-10T08:30:21.423 INFO:tasks.workunit.client.1.smithi154.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-10T08:30:21.477 INFO:tasks.workunit.client.1.smithi154.stdout:checking for sys/types.h... yes 2024-09-10T08:30:21.537 INFO:tasks.workunit.client.1.smithi154.stdout:checking for sys/stat.h... yes 2024-09-10T08:30:21.597 INFO:tasks.workunit.client.1.smithi154.stdout:checking for stdlib.h... yes 2024-09-10T08:30:21.661 INFO:tasks.workunit.client.1.smithi154.stdout:checking for string.h... yes 2024-09-10T08:30:21.733 INFO:tasks.workunit.client.1.smithi154.stdout:checking for memory.h... yes 2024-09-10T08:30:21.797 INFO:tasks.workunit.client.1.smithi154.stdout:checking for strings.h... yes 2024-09-10T08:30:21.859 INFO:tasks.workunit.client.1.smithi154.stdout:checking for inttypes.h... yes 2024-09-10T08:30:22.565 INFO:tasks.workunit.client.1.smithi154.stdout:checking for stdint.h... yes 2024-09-10T08:30:22.645 INFO:tasks.workunit.client.1.smithi154.stdout:checking for unistd.h... yes 2024-09-10T08:30:22.727 INFO:tasks.workunit.client.1.smithi154.stdout:checking pthread.h usability... yes 2024-09-10T08:30:22.756 INFO:tasks.workunit.client.1.smithi154.stdout:checking pthread.h presence... yes 2024-09-10T08:30:22.756 INFO:tasks.workunit.client.1.smithi154.stdout:checking for pthread.h... yes 2024-09-10T08:30:22.825 INFO:tasks.workunit.client.1.smithi154.stdout:checking fcntl.h usability... yes 2024-09-10T08:30:22.843 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/types.h... yes 2024-09-10T08:30:22.854 INFO:tasks.workunit.client.1.smithi154.stdout:checking fcntl.h presence... yes 2024-09-10T08:30:22.854 INFO:tasks.workunit.client.1.smithi154.stdout:checking for fcntl.h... yes 2024-09-10T08:30:22.927 INFO:tasks.workunit.client.1.smithi154.stdout:checking limits.h usability... yes 2024-09-10T08:30:22.953 INFO:tasks.workunit.client.1.smithi154.stdout:checking limits.h presence... yes 2024-09-10T08:30:22.954 INFO:tasks.workunit.client.1.smithi154.stdout:checking for limits.h... yes 2024-09-10T08:30:22.973 INFO:tasks.workunit.client.1.smithi154.stdout:checking for stdint.h... (cached) yes 2024-09-10T08:30:23.048 INFO:tasks.workunit.client.1.smithi154.stdout:checking sys/time.h usability... yes 2024-09-10T08:30:23.074 INFO:tasks.workunit.client.1.smithi154.stdout:checking sys/time.h presence... yes 2024-09-10T08:30:23.075 INFO:tasks.workunit.client.1.smithi154.stdout:checking for sys/time.h... yes 2024-09-10T08:30:23.102 INFO:tasks.workunit.client.1.smithi154.stdout:checking for unistd.h... (cached) yes 2024-09-10T08:30:23.166 INFO:tasks.workunit.client.1.smithi154.stdout:checking sys/vfs.h usability... yes 2024-09-10T08:30:23.192 INFO:tasks.workunit.client.1.smithi154.stdout:checking sys/vfs.h presence... yes 2024-09-10T08:30:23.193 INFO:tasks.workunit.client.1.smithi154.stdout:checking for sys/vfs.h... yes 2024-09-10T08:30:23.255 INFO:tasks.workunit.client.1.smithi154.stdout:checking sys/limits.h usability... no 2024-09-10T08:30:23.285 INFO:tasks.workunit.client.1.smithi154.stdout:checking sys/limits.h presence... no 2024-09-10T08:30:23.285 INFO:tasks.workunit.client.1.smithi154.stdout:checking for sys/limits.h... no 2024-09-10T08:30:23.330 INFO:tasks.workunit.client.1.smithi154.stdout:checking for an ANSI C-conforming const... yes 2024-09-10T08:30:23.374 INFO:tasks.workunit.client.1.smithi154.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-10T08:30:23.377 INFO:tasks.workunit.client.1.smithi154.stdout:checking for function prototypes... yes 2024-09-10T08:30:23.418 INFO:tasks.workunit.client.1.smithi154.stdout:checking whether setvbuf arguments are reversed... no 2024-09-10T08:30:23.497 INFO:tasks.workunit.client.1.smithi154.stdout:checking for system... yes 2024-09-10T08:30:23.580 INFO:tasks.workunit.client.1.smithi154.stdout:checking for gettimeofday... yes 2024-09-10T08:30:23.905 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/stat.h... yes 2024-09-10T08:30:23.920 INFO:tasks.workunit.client.1.smithi154.stdout:checking for mkdir... yes 2024-09-10T08:30:23.974 INFO:tasks.workunit.client.0.smithi103.stdout:checking for stdlib.h... yes 2024-09-10T08:30:24.036 INFO:tasks.workunit.client.0.smithi103.stdout:checking for string.h... yes 2024-09-10T08:30:24.098 INFO:tasks.workunit.client.0.smithi103.stdout:checking for memory.h... yes 2024-09-10T08:30:24.163 INFO:tasks.workunit.client.0.smithi103.stdout:checking for strings.h... yes 2024-09-10T08:30:24.171 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:30:24.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.273+0000 7f3a2c65c640 1 Processor -- start 2024-09-10T08:30:24.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.273+0000 7f3a2c65c640 1 -- start start 2024-09-10T08:30:24.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.274+0000 7f3a2c65c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a240af180 0x7f3a240c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:24.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.274+0000 7f3a2c65c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3a24073660 0x7f3a240c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:24.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.274+0000 7f3a2c65c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3a240c6340 0x7f3a240c5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:24.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.274+0000 7f3a2c65c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f3a24154370 con 0x7f3a240c6340 2024-09-10T08:30:24.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.274+0000 7f3a2c65c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3a24154650 con 0x7f3a24073660 2024-09-10T08:30:24.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.274+0000 7f3a2c65c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3a24154930 con 0x7f3a240af180 2024-09-10T08:30:24.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.274+0000 7f3a2abf9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3a240c6340 0x7f3a240c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:24.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.274+0000 7f3a2abf9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3a240c6340 0x7f3a240c5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46980/0 (socket says 172.21.15.103:46980) 2024-09-10T08:30:24.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.274+0000 7f3a2abf9640 1 -- 172.21.15.103:0/3088544608 learned_addr learned my addr 172.21.15.103:0/3088544608 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:24.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.274+0000 7f3a2a3f8640 1 -- 172.21.15.103:0/3088544608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a240af180 msgr2=0x7f3a240c5e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:30:24.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.274+0000 7f3a2a3f8640 1 --2- 172.21.15.103:0/3088544608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a240af180 0x7f3a240c5e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:30:24.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.274+0000 7f3a29bf7640 1 --2- 172.21.15.103:0/3088544608 >> v2:172.21.15.154:3300/0 conn(0x7f3a24073660 0x7f3a240c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:24.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.274+0000 7f3a2abf9640 1 -- 172.21.15.103:0/3088544608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a240af180 msgr2=0x7f3a240c5e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:30:24.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.274+0000 7f3a2abf9640 1 --2- 172.21.15.103:0/3088544608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a240af180 0x7f3a240c5e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:24.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.274+0000 7f3a2abf9640 1 -- 172.21.15.103:0/3088544608 >> v2:172.21.15.154:3300/0 conn(0x7f3a24073660 msgr2=0x7f3a240c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:24.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.274+0000 7f3a2abf9640 1 --2- 172.21.15.103:0/3088544608 >> v2:172.21.15.154:3300/0 conn(0x7f3a24073660 0x7f3a240c4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:24.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.274+0000 7f3a2abf9640 1 -- 172.21.15.103:0/3088544608 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a24154c10 con 0x7f3a240c6340 2024-09-10T08:30:24.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.275+0000 7f3a2abf9640 1 --2- 172.21.15.103:0/3088544608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a240c6340 0x7f3a240c5060 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3a240caaf0 tx=0x7f3a2002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c417ce24df9d39 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:24.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.275+0000 7f3a293f6640 1 -- 172.21.15.103:0/3088544608 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a20036070 con 0x7f3a240c6340 2024-09-10T08:30:24.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.275+0000 7f3a293f6640 1 -- 172.21.15.103:0/3088544608 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a2002ae50 con 0x7f3a240c6340 2024-09-10T08:30:24.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.275+0000 7f3a293f6640 1 -- 172.21.15.103:0/3088544608 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a20031820 con 0x7f3a240c6340 2024-09-10T08:30:24.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.276+0000 7f3a2c65c640 1 -- 172.21.15.103:0/3088544608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a240c6340 msgr2=0x7f3a240c5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:24.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.276+0000 7f3a2c65c640 1 --2- 172.21.15.103:0/3088544608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a240c6340 0x7f3a240c5060 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3a240caaf0 tx=0x7f3a2002a630 comp rx=0 tx=0).stop 2024-09-10T08:30:24.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.276+0000 7f3a2c65c640 1 -- 172.21.15.103:0/3088544608 shutdown_connections 2024-09-10T08:30:24.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.276+0000 7f3a2c65c640 1 --2- 172.21.15.103:0/3088544608 >> v2:172.21.15.154:3300/0 conn(0x7f3a24073660 0x7f3a240c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:24.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.276+0000 7f3a2c65c640 1 --2- 172.21.15.103:0/3088544608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a240c6340 0x7f3a240c5060 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:24.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.276+0000 7f3a2c65c640 1 --2- 172.21.15.103:0/3088544608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a240af180 0x7f3a240c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:24.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.276+0000 7f3a2c65c640 1 -- 172.21.15.103:0/3088544608 >> 172.21.15.103:0/3088544608 conn(0x7f3a240c9d80 msgr2=0x7f3a240ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:24.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.276+0000 7f3a2c65c640 1 -- 172.21.15.103:0/3088544608 shutdown_connections 2024-09-10T08:30:24.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.276+0000 7f3a2c65c640 1 -- 172.21.15.103:0/3088544608 wait complete. 2024-09-10T08:30:24.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.277+0000 7f3a2c65c640 1 Processor -- start 2024-09-10T08:30:24.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.277+0000 7f3a2c65c640 1 -- start start 2024-09-10T08:30:24.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a2c65c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a24073660 0x7f3a241ecba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:24.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a2c65c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a240af180 0x7f3a241dfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:24.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a2c65c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a240c6340 0x7f3a240c0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:24.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a2c65c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3a241540e0 con 0x7f3a24073660 2024-09-10T08:30:24.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a2c65c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3a24153f60 con 0x7f3a240c6340 2024-09-10T08:30:24.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a2c65c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3a240c55a0 con 0x7f3a240af180 2024-09-10T08:30:24.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a2a3f8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a24073660 0x7f3a241ecba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:24.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a2a3f8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a24073660 0x7f3a241ecba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46992/0 (socket says 172.21.15.103:46992) 2024-09-10T08:30:24.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a2a3f8640 1 -- 172.21.15.103:0/660335695 learned_addr learned my addr 172.21.15.103:0/660335695 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:24.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a29bf7640 1 -- 172.21.15.103:0/660335695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a240af180 msgr2=0x7f3a241dfa00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:30:24.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a29bf7640 1 --2- 172.21.15.103:0/660335695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a240af180 0x7f3a241dfa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:30:24.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a2abf9640 1 --2- 172.21.15.103:0/660335695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a240c6340 0x7f3a240c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:24.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a2a3f8640 1 -- 172.21.15.103:0/660335695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a240af180 msgr2=0x7f3a241dfa00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:30:24.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a2a3f8640 1 --2- 172.21.15.103:0/660335695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a240af180 0x7f3a241dfa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:24.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a2a3f8640 1 -- 172.21.15.103:0/660335695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a240c6340 msgr2=0x7f3a240c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:24.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a2a3f8640 1 --2- 172.21.15.103:0/660335695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a240c6340 0x7f3a240c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:24.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a2a3f8640 1 -- 172.21.15.103:0/660335695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a241ed0e0 con 0x7f3a24073660 2024-09-10T08:30:24.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a2abf9640 1 --2- 172.21.15.103:0/660335695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a240c6340 0x7f3a240c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:30:24.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a2a3f8640 1 --2- 172.21.15.103:0/660335695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a24073660 0x7f3a241ecba0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00b550 tx=0x7f3a1c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:24.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a1affd640 1 -- 172.21.15.103:0/660335695 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c013020 con 0x7f3a24073660 2024-09-10T08:30:24.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a1affd640 1 -- 172.21.15.103:0/660335695 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a1c003de0 con 0x7f3a24073660 2024-09-10T08:30:24.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a2c65c640 1 -- 172.21.15.103:0/660335695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a240befb0 con 0x7f3a24073660 2024-09-10T08:30:24.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a1affd640 1 -- 172.21.15.103:0/660335695 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c0052b0 con 0x7f3a24073660 2024-09-10T08:30:24.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.278+0000 7f3a2c65c640 1 -- 172.21.15.103:0/660335695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a24156a60 con 0x7f3a24073660 2024-09-10T08:30:24.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.279+0000 7f3a2c65c640 1 -- 172.21.15.103:0/660335695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a24156d70 con 0x7f3a24073660 2024-09-10T08:30:24.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.280+0000 7f3a1affd640 1 -- 172.21.15.103:0/660335695 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3a1c016020 con 0x7f3a24073660 2024-09-10T08:30:24.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.280+0000 7f3a1affd640 1 --2- 172.21.15.103:0/660335695 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3a0806bde0 0x7f3a0806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:24.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.280+0000 7f3a1affd640 1 -- 172.21.15.103:0/660335695 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f3a1c08aea0 con 0x7f3a24073660 2024-09-10T08:30:24.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.280+0000 7f3a29bf7640 1 --2- 172.21.15.103:0/660335695 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3a0806bde0 0x7f3a0806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:24.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.281+0000 7f3a29bf7640 1 --2- 172.21.15.103:0/660335695 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3a0806bde0 0x7f3a0806e2a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3a2406fca0 tx=0x7f3a140092e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:24.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.285+0000 7f3a1affd640 1 -- 172.21.15.103:0/660335695 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3a1c01d020 con 0x7f3a24073660 2024-09-10T08:30:24.425 INFO:tasks.workunit.client.0.smithi103.stdout:checking for inttypes.h... yes 2024-09-10T08:30:24.456 INFO:tasks.workunit.client.1.smithi154.stdout:checking for strerror... yes 2024-09-10T08:30:24.493 INFO:tasks.workunit.client.0.smithi103.stdout:checking for stdint.h... yes 2024-09-10T08:30:24.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.539+0000 7f3a2c65c640 1 -- 172.21.15.103:0/660335695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3a240c77a0 con 0x7f3a24073660 2024-09-10T08:30:24.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.540+0000 7f3a1affd640 1 -- 172.21.15.103:0/660335695 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f3a1c059540 con 0x7f3a24073660 2024-09-10T08:30:24.541 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:30:24.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.542+0000 7f3a2c65c640 1 -- 172.21.15.103:0/660335695 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3a0806bde0 msgr2=0x7f3a0806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:24.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.542+0000 7f3a2c65c640 1 --2- 172.21.15.103:0/660335695 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3a0806bde0 0x7f3a0806e2a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3a2406fca0 tx=0x7f3a140092e0 comp rx=0 tx=0).stop 2024-09-10T08:30:24.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.542+0000 7f3a2c65c640 1 -- 172.21.15.103:0/660335695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a24073660 msgr2=0x7f3a241ecba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:24.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.542+0000 7f3a2c65c640 1 --2- 172.21.15.103:0/660335695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a24073660 0x7f3a241ecba0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00b550 tx=0x7f3a1c00ba10 comp rx=0 tx=0).stop 2024-09-10T08:30:24.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.543+0000 7f3a2c65c640 1 -- 172.21.15.103:0/660335695 shutdown_connections 2024-09-10T08:30:24.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.543+0000 7f3a2c65c640 1 --2- 172.21.15.103:0/660335695 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3a0806bde0 0x7f3a0806e2a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:24.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.543+0000 7f3a2c65c640 1 --2- 172.21.15.103:0/660335695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a240c6340 0x7f3a240c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:24.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.543+0000 7f3a2c65c640 1 --2- 172.21.15.103:0/660335695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a240af180 0x7f3a241dfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:24.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.543+0000 7f3a2c65c640 1 --2- 172.21.15.103:0/660335695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a24073660 0x7f3a241ecba0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:24.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.543+0000 7f3a2c65c640 1 -- 172.21.15.103:0/660335695 >> 172.21.15.103:0/660335695 conn(0x7f3a240c9d80 msgr2=0x7f3a24150500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:24.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.543+0000 7f3a2c65c640 1 -- 172.21.15.103:0/660335695 shutdown_connections 2024-09-10T08:30:24.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:24.543+0000 7f3a2c65c640 1 -- 172.21.15.103:0/660335695 wait complete. 2024-09-10T08:30:24.545 INFO:tasks.workunit.client.1.smithi154.stdout:checking for open64... yes 2024-09-10T08:30:24.567 INFO:tasks.workunit.client.0.smithi103.stdout:checking for unistd.h... yes 2024-09-10T08:30:24.633 INFO:tasks.workunit.client.1.smithi154.stdout:checking for stat64... yes 2024-09-10T08:30:24.648 INFO:tasks.workunit.client.0.smithi103.stdout:checking pthread.h usability... yes 2024-09-10T08:30:24.679 INFO:tasks.workunit.client.0.smithi103.stdout:checking pthread.h presence... yes 2024-09-10T08:30:24.680 INFO:tasks.workunit.client.0.smithi103.stdout:checking for pthread.h... yes 2024-09-10T08:30:24.723 INFO:tasks.workunit.client.1.smithi154.stdout:checking for fseeko64... yes 2024-09-10T08:30:24.754 INFO:tasks.workunit.client.0.smithi103.stdout:checking fcntl.h usability... yes 2024-09-10T08:30:24.780 INFO:tasks.workunit.client.0.smithi103.stdout:checking fcntl.h presence... yes 2024-09-10T08:30:24.781 INFO:tasks.workunit.client.0.smithi103.stdout:checking for fcntl.h... yes 2024-09-10T08:30:24.815 INFO:tasks.workunit.client.1.smithi154.stdout:checking for lrand48_r... yes 2024-09-10T08:30:24.851 INFO:tasks.workunit.client.0.smithi103.stdout:checking limits.h usability... yes 2024-09-10T08:30:24.877 INFO:tasks.workunit.client.0.smithi103.stdout:checking limits.h presence... yes 2024-09-10T08:30:24.878 INFO:tasks.workunit.client.0.smithi103.stdout:checking for limits.h... yes 2024-09-10T08:30:24.900 INFO:tasks.workunit.client.0.smithi103.stdout:checking for stdint.h... (cached) yes 2024-09-10T08:30:24.901 INFO:tasks.workunit.client.1.smithi154.stdout:checking for srand48_r... yes 2024-09-10T08:30:24.930 INFO:tasks.workunit.client.1.smithi154.stdout:configure: creating ./config.status 2024-09-10T08:30:24.961 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/time.h usability... yes 2024-09-10T08:30:24.991 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/time.h presence... yes 2024-09-10T08:30:24.992 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/time.h... yes 2024-09-10T08:30:25.057 INFO:tasks.workunit.client.1.smithi154.stdout:config.status: creating Makefile 2024-09-10T08:30:25.074 INFO:tasks.workunit.client.1.smithi154.stdout:config.status: creating config.h 2024-09-10T08:30:25.099 INFO:tasks.workunit.client.1.smithi154.stdout:config.status: executing depfiles commands 2024-09-10T08:30:25.170 INFO:tasks.workunit.client.1.smithi154.stdout:config.status: executing default commands 2024-09-10T08:30:25.328 INFO:tasks.workunit.client.0.smithi103.stdout:checking for unistd.h... (cached) yes 2024-09-10T08:30:25.395 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/vfs.h usability... yes 2024-09-10T08:30:25.420 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/vfs.h presence... yes 2024-09-10T08:30:25.421 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/vfs.h... yes 2024-09-10T08:30:25.903 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/limits.h usability... no 2024-09-10T08:30:25.934 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/limits.h presence... no 2024-09-10T08:30:25.935 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/limits.h... no 2024-09-10T08:30:25.980 INFO:tasks.workunit.client.0.smithi103.stdout:checking for an ANSI C-conforming const... yes 2024-09-10T08:30:26.023 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-10T08:30:26.025 INFO:tasks.workunit.client.0.smithi103.stdout:checking for function prototypes... yes 2024-09-10T08:30:26.068 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether setvbuf arguments are reversed... no 2024-09-10T08:30:26.146 INFO:tasks.workunit.client.0.smithi103.stdout:checking for system... yes 2024-09-10T08:30:26.228 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gettimeofday... yes 2024-09-10T08:30:26.311 INFO:tasks.workunit.client.0.smithi103.stdout:checking for mkdir... yes 2024-09-10T08:30:26.392 INFO:tasks.workunit.client.0.smithi103.stdout:checking for strerror... yes 2024-09-10T08:30:26.476 INFO:tasks.workunit.client.0.smithi103.stdout:checking for open64... yes 2024-09-10T08:30:26.557 INFO:tasks.workunit.client.0.smithi103.stdout:checking for stat64... yes 2024-09-10T08:30:26.647 INFO:tasks.workunit.client.0.smithi103.stdout:checking for fseeko64... yes 2024-09-10T08:30:26.752 INFO:tasks.workunit.client.0.smithi103.stdout:checking for lrand48_r... yes 2024-09-10T08:30:26.834 INFO:tasks.workunit.client.0.smithi103.stdout:checking for srand48_r... yes 2024-09-10T08:30:26.861 INFO:tasks.workunit.client.0.smithi103.stdout:configure: creating ./config.status 2024-09-10T08:30:26.993 INFO:tasks.workunit.client.0.smithi103.stdout:config.status: creating Makefile 2024-09-10T08:30:27.012 INFO:tasks.workunit.client.0.smithi103.stdout:config.status: creating config.h 2024-09-10T08:30:27.037 INFO:tasks.workunit.client.0.smithi103.stdout:config.status: executing depfiles commands 2024-09-10T08:30:27.106 INFO:tasks.workunit.client.0.smithi103.stdout:config.status: executing default commands 2024-09-10T08:30:27.558 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:30:27.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.662+0000 7fca7ff31640 1 Processor -- start 2024-09-10T08:30:27.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.663+0000 7fca7ff31640 1 -- start start 2024-09-10T08:30:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.663+0000 7fca7ff31640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fca780c8b10 0x7fca7815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.663+0000 7fca7ff31640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fca7806cd80 0x7fca781534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.663+0000 7fca7ff31640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca78153a10 0x7fca78156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.663+0000 7fca7ff31640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fca780c7070 con 0x7fca7806cd80 2024-09-10T08:30:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.663+0000 7fca7ff31640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fca7806d210 con 0x7fca780c8b10 2024-09-10T08:30:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.663+0000 7fca7ff31640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fca780c69b0 con 0x7fca78153a10 2024-09-10T08:30:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.664+0000 7fca7d4cc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fca7806cd80 0x7fca781534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.664+0000 7fca7e4ce640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca78153a10 msgr2=0x7fca78156660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:30:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.664+0000 7fca7d4cc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fca7806cd80 0x7fca781534d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35386/0 (socket says 172.21.15.103:35386) 2024-09-10T08:30:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.664+0000 7fca7d4cc640 1 -- 172.21.15.103:0/1227966577 learned_addr learned my addr 172.21.15.103:0/1227966577 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.664+0000 7fca7e4ce640 1 --2- 172.21.15.103:0/1227966577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca78153a10 0x7fca78156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:30:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.664+0000 7fca7dccd640 1 --2- 172.21.15.103:0/1227966577 >> v2:172.21.15.154:3300/0 conn(0x7fca780c8b10 0x7fca7815a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.664+0000 7fca7d4cc640 1 -- 172.21.15.103:0/1227966577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca78153a10 msgr2=0x7fca78156660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:30:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.664+0000 7fca7d4cc640 1 --2- 172.21.15.103:0/1227966577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca78153a10 0x7fca78156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.664+0000 7fca7d4cc640 1 -- 172.21.15.103:0/1227966577 >> v2:172.21.15.154:3300/0 conn(0x7fca780c8b10 msgr2=0x7fca7815a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.664+0000 7fca7d4cc640 1 --2- 172.21.15.103:0/1227966577 >> v2:172.21.15.154:3300/0 conn(0x7fca780c8b10 0x7fca7815a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.664+0000 7fca7d4cc640 1 -- 172.21.15.103:0/1227966577 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca780c6c90 con 0x7fca7806cd80 2024-09-10T08:30:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.665+0000 7fca7d4cc640 1 --2- 172.21.15.103:0/1227966577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca7806cd80 0x7fca781534d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fca780ae760 tx=0x7fca6c02a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49182de080a242b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.665+0000 7fca7cccb640 1 -- 172.21.15.103:0/1227966577 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c037070 con 0x7fca7806cd80 2024-09-10T08:30:27.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.665+0000 7fca7cccb640 1 -- 172.21.15.103:0/1227966577 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca6c032440 con 0x7fca7806cd80 2024-09-10T08:30:27.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.665+0000 7fca7cccb640 1 -- 172.21.15.103:0/1227966577 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c032810 con 0x7fca7806cd80 2024-09-10T08:30:27.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.665+0000 7fca7ff31640 1 -- 172.21.15.103:0/1227966577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca7806cd80 msgr2=0x7fca781534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:27.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.665+0000 7fca7ff31640 1 --2- 172.21.15.103:0/1227966577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca7806cd80 0x7fca781534d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fca780ae760 tx=0x7fca6c02a160 comp rx=0 tx=0).stop 2024-09-10T08:30:27.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.665+0000 7fca7ff31640 1 -- 172.21.15.103:0/1227966577 shutdown_connections 2024-09-10T08:30:27.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.665+0000 7fca7ff31640 1 --2- 172.21.15.103:0/1227966577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca78153a10 0x7fca78156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:27.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.665+0000 7fca7ff31640 1 --2- 172.21.15.103:0/1227966577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca7806cd80 0x7fca781534d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:27.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.665+0000 7fca7ff31640 1 --2- 172.21.15.103:0/1227966577 >> v2:172.21.15.154:3300/0 conn(0x7fca780c8b10 0x7fca7815a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:27.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.665+0000 7fca7ff31640 1 -- 172.21.15.103:0/1227966577 >> 172.21.15.103:0/1227966577 conn(0x7fca780adb80 msgr2=0x7fca780adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:27.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.665+0000 7fca7ff31640 1 -- 172.21.15.103:0/1227966577 shutdown_connections 2024-09-10T08:30:27.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.665+0000 7fca7ff31640 1 -- 172.21.15.103:0/1227966577 wait complete. 2024-09-10T08:30:27.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.666+0000 7fca7ff31640 1 Processor -- start 2024-09-10T08:30:27.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.666+0000 7fca7ff31640 1 -- start start 2024-09-10T08:30:27.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.667+0000 7fca7ff31640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca780c8b10 0x7fca781e1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:27.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.667+0000 7fca7ff31640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca78153a10 0x7fca78148000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:27.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.667+0000 7fca7ff31640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca78148540 0x7fca7814b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:27.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.667+0000 7fca7ff31640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fca78154020 con 0x7fca78148540 2024-09-10T08:30:27.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.667+0000 7fca7ff31640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca78153ea0 con 0x7fca78153a10 2024-09-10T08:30:27.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.667+0000 7fca7ff31640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fca780c8ef0 con 0x7fca780c8b10 2024-09-10T08:30:27.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.667+0000 7fca7dccd640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca780c8b10 msgr2=0x7fca781e1520 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:30:27.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.667+0000 7fca7dccd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca780c8b10 0x7fca781e1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:30:27.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.667+0000 7fca7e4ce640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca78148540 0x7fca7814b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:27.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.667+0000 7fca7e4ce640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca78148540 0x7fca7814b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35394/0 (socket says 172.21.15.103:35394) 2024-09-10T08:30:27.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.667+0000 7fca7e4ce640 1 -- 172.21.15.103:0/3859529140 learned_addr learned my addr 172.21.15.103:0/3859529140 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:27.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.667+0000 7fca7d4cc640 1 --2- 172.21.15.103:0/3859529140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca78153a10 0x7fca78148000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:27.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.668+0000 7fca7e4ce640 1 -- 172.21.15.103:0/3859529140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca780c8b10 msgr2=0x7fca781e1520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:30:27.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.668+0000 7fca7e4ce640 1 --2- 172.21.15.103:0/3859529140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca780c8b10 0x7fca781e1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:27.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.668+0000 7fca7e4ce640 1 -- 172.21.15.103:0/3859529140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca78153a10 msgr2=0x7fca78148000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:27.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.668+0000 7fca7e4ce640 1 --2- 172.21.15.103:0/3859529140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca78153a10 0x7fca78148000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:27.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.668+0000 7fca7e4ce640 1 -- 172.21.15.103:0/3859529140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca781e21f0 con 0x7fca78148540 2024-09-10T08:30:27.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.668+0000 7fca7e4ce640 1 --2- 172.21.15.103:0/3859529140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca78148540 0x7fca7814b0b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fca6800be50 tx=0x7fca6800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:27.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.668+0000 7fca767fc640 1 -- 172.21.15.103:0/3859529140 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca68016430 con 0x7fca78148540 2024-09-10T08:30:27.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.668+0000 7fca767fc640 1 -- 172.21.15.103:0/3859529140 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca68010030 con 0x7fca78148540 2024-09-10T08:30:27.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.668+0000 7fca767fc640 1 -- 172.21.15.103:0/3859529140 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca68016850 con 0x7fca78148540 2024-09-10T08:30:27.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.668+0000 7fca7ff31640 1 -- 172.21.15.103:0/3859529140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca781e04f0 con 0x7fca78148540 2024-09-10T08:30:27.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.668+0000 7fca7ff31640 1 -- 172.21.15.103:0/3859529140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca7814cf40 con 0x7fca78148540 2024-09-10T08:30:27.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.669+0000 7fca7ff31640 1 -- 172.21.15.103:0/3859529140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca781e23c0 con 0x7fca78148540 2024-09-10T08:30:27.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.669+0000 7fca767fc640 1 -- 172.21.15.103:0/3859529140 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca680153e0 con 0x7fca78148540 2024-09-10T08:30:27.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.670+0000 7fca767fc640 1 --2- 172.21.15.103:0/3859529140 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca6406be10 0x7fca6406e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:27.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.670+0000 7fca767fc640 1 -- 172.21.15.103:0/3859529140 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fca6808b570 con 0x7fca78148540 2024-09-10T08:30:27.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.670+0000 7fca7dccd640 1 --2- 172.21.15.103:0/3859529140 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca6406be10 0x7fca6406e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:27.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.670+0000 7fca7dccd640 1 --2- 172.21.15.103:0/3859529140 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca6406be10 0x7fca6406e2d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fca70006fd0 tx=0x7fca70008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:27.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.674+0000 7fca767fc640 1 -- 172.21.15.103:0/3859529140 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca680595c0 con 0x7fca78148540 2024-09-10T08:30:27.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.910+0000 7fca7ff31640 1 -- 172.21.15.103:0/3859529140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fca781534d0 con 0x7fca78148540 2024-09-10T08:30:27.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.910+0000 7fca767fc640 1 -- 172.21.15.103:0/3859529140 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fca6805d8c0 con 0x7fca78148540 2024-09-10T08:30:27.911 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:30:27.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.912+0000 7fca7ff31640 1 -- 172.21.15.103:0/3859529140 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca6406be10 msgr2=0x7fca6406e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:27.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.912+0000 7fca7ff31640 1 --2- 172.21.15.103:0/3859529140 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca6406be10 0x7fca6406e2d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fca70006fd0 tx=0x7fca70008040 comp rx=0 tx=0).stop 2024-09-10T08:30:27.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.912+0000 7fca7ff31640 1 -- 172.21.15.103:0/3859529140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca78148540 msgr2=0x7fca7814b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:27.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.912+0000 7fca7ff31640 1 --2- 172.21.15.103:0/3859529140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca78148540 0x7fca7814b0b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fca6800be50 tx=0x7fca6800be80 comp rx=0 tx=0).stop 2024-09-10T08:30:27.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.913+0000 7fca7ff31640 1 -- 172.21.15.103:0/3859529140 shutdown_connections 2024-09-10T08:30:27.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.913+0000 7fca7ff31640 1 --2- 172.21.15.103:0/3859529140 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca6406be10 0x7fca6406e2d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:27.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.913+0000 7fca7ff31640 1 --2- 172.21.15.103:0/3859529140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca78148540 0x7fca7814b0b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:27.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.913+0000 7fca7ff31640 1 --2- 172.21.15.103:0/3859529140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca78153a10 0x7fca78148000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:27.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.913+0000 7fca7ff31640 1 --2- 172.21.15.103:0/3859529140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca780c8b10 0x7fca781e1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:27.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.913+0000 7fca7ff31640 1 -- 172.21.15.103:0/3859529140 >> 172.21.15.103:0/3859529140 conn(0x7fca780adb80 msgr2=0x7fca78156db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:27.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.913+0000 7fca7ff31640 1 -- 172.21.15.103:0/3859529140 shutdown_connections 2024-09-10T08:30:27.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:27.913+0000 7fca7ff31640 1 -- 172.21.15.103:0/3859529140 wait complete. 2024-09-10T08:30:28.938 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:30:28.941 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:30:30.924 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:30:31.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.034+0000 7f7fa3531640 1 Processor -- start 2024-09-10T08:30:31.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.034+0000 7f7fa3531640 1 -- start start 2024-09-10T08:30:31.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.035+0000 7f7fa3531640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f9c0c8b10 0x7f7f9c15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:31.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.035+0000 7f7fa3531640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 0x7f7f9c156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:31.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.035+0000 7f7fa3531640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f9c0c7070 con 0x7f7f9c06cd80 2024-09-10T08:30:31.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.035+0000 7f7fa3531640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f7f9c06d210 con 0x7f7f9c153be0 2024-09-10T08:30:31.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.035+0000 7f7fa3531640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7f9c0c69b0 con 0x7f7f9c0c8b10 2024-09-10T08:30:31.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.035+0000 7f7fa12cd640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f9c0c8b10 msgr2=0x7f7f9c15a4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:30:31.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.035+0000 7f7fa12cd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f9c0c8b10 0x7f7f9c15a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:30:31.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.035+0000 7f7fa1ace640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 0x7f7f9c156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:31.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.035+0000 7f7fa1ace640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 0x7f7f9c156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35398/0 (socket says 172.21.15.103:35398) 2024-09-10T08:30:31.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.035+0000 7f7fa1ace640 1 -- 172.21.15.103:0/2631692459 learned_addr learned my addr 172.21.15.103:0/2631692459 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:31.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.035+0000 7f7fa1ace640 1 -- 172.21.15.103:0/2631692459 >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 msgr2=0x7f7f9c156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:30:31.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.035+0000 7f7fa1ace640 1 -- 172.21.15.103:0/2631692459 >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 msgr2=0x7f7f9c156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:30:31.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.035+0000 7f7fa1ace640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 0x7f7f9c156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:30:31.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.035+0000 7f7fa1ace640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 0x7f7f9c156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:30:31.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.236+0000 7f7fa12cd640 1 -- 172.21.15.103:0/2631692459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f9c0c8b10 msgr2=0x7f7f9c15a4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:30:31.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.236+0000 7f7fa12cd640 1 --2- 172.21.15.103:0/2631692459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f9c0c8b10 0x7f7f9c15a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:30:31.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.236+0000 7f7fa1ace640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 0x7f7f9c156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:31.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.236+0000 7f7fa1ace640 1 -- 172.21.15.103:0/2631692459 >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 msgr2=0x7f7f9c156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:30:31.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.236+0000 7f7fa1ace640 1 -- 172.21.15.103:0/2631692459 >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 msgr2=0x7f7f9c156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:30:31.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.236+0000 7f7fa1ace640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 0x7f7f9c156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:30:31.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.236+0000 7f7fa1ace640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 0x7f7f9c156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:30:31.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.637+0000 7f7fa12cd640 1 -- 172.21.15.103:0/2631692459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f9c0c8b10 msgr2=0x7f7f9c15a4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:30:31.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.637+0000 7f7fa12cd640 1 --2- 172.21.15.103:0/2631692459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f9c0c8b10 0x7f7f9c15a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:30:31.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.637+0000 7f7fa1ace640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 0x7f7f9c156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:31.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.637+0000 7f7fa1ace640 1 -- 172.21.15.103:0/2631692459 >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 msgr2=0x7f7f9c156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:30:31.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.637+0000 7f7fa1ace640 1 -- 172.21.15.103:0/2631692459 >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 msgr2=0x7f7f9c156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:30:31.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.637+0000 7f7fa1ace640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 0x7f7f9c156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:30:31.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:31.637+0000 7f7fa1ace640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 0x7f7f9c156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:30:32.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:32.438+0000 7f7fa12cd640 1 -- 172.21.15.103:0/2631692459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f9c0c8b10 msgr2=0x7f7f9c15a4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:30:32.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:32.438+0000 7f7fa12cd640 1 --2- 172.21.15.103:0/2631692459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f9c0c8b10 0x7f7f9c15a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:30:32.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:32.438+0000 7f7fa1ace640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 0x7f7f9c156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:32.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:32.438+0000 7f7fa1ace640 1 -- 172.21.15.103:0/2631692459 >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 msgr2=0x7f7f9c156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:30:32.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:32.438+0000 7f7fa1ace640 1 -- 172.21.15.103:0/2631692459 >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 msgr2=0x7f7f9c156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:30:32.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:32.438+0000 7f7fa1ace640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 0x7f7f9c156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:30:32.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:32.438+0000 7f7fa1ace640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 0x7f7f9c156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:30:34.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.035+0000 7f7f92ffd640 1 -- 172.21.15.103:0/2631692459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f9c0c8b10 msgr2=0x7f7f9c15a4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:30:34.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.035+0000 7f7f92ffd640 1 --2- 172.21.15.103:0/2631692459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f9c0c8b10 0x7f7f9c15a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:34.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.035+0000 7f7f92ffd640 1 -- 172.21.15.103:0/2631692459 >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 msgr2=0x7f7f9c156660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:30:34.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.035+0000 7f7f92ffd640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.103:3300/0 conn(0x7f7f9c153be0 0x7f7f9c156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:34.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.035+0000 7f7f92ffd640 1 -- 172.21.15.103:0/2631692459 >> v1:172.21.15.154:6789/0 conn(0x7f7f9c06cd80 legacy=0x7f7f9c1534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:34.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.035+0000 7f7f92ffd640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.154:3300/0 conn(0x7f7f800036c0 0x7f7f80005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:34.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.035+0000 7f7f92ffd640 1 -- 172.21.15.103:0/2631692459 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f9c0c6c90 con 0x7f7f80006190 2024-09-10T08:30:34.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.035+0000 7f7f92ffd640 1 -- 172.21.15.103:0/2631692459 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f7f9c06d210 con 0x7f7f800036c0 2024-09-10T08:30:34.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.035+0000 7f7fa12cd640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.154:3300/0 conn(0x7f7f800036c0 0x7f7f80005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:34.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.036+0000 7f7fa12cd640 1 -- 172.21.15.103:0/2631692459 >> v2:172.21.15.154:3300/0 conn(0x7f7f800036c0 msgr2=0x7f7f80005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:30:34.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.036+0000 7f7fa12cd640 1 -- 172.21.15.103:0/2631692459 >> v2:172.21.15.154:3300/0 conn(0x7f7f800036c0 msgr2=0x7f7f80005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:30:34.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.036+0000 7f7fa12cd640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.154:3300/0 conn(0x7f7f800036c0 0x7f7f80005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:30:34.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.036+0000 7f7fa12cd640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.154:3300/0 conn(0x7f7f800036c0 0x7f7f80005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:30:34.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.237+0000 7f7fa12cd640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.154:3300/0 conn(0x7f7f800036c0 0x7f7f80005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:34.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.237+0000 7f7fa12cd640 1 -- 172.21.15.103:0/2631692459 >> v2:172.21.15.154:3300/0 conn(0x7f7f800036c0 msgr2=0x7f7f80005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:30:34.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.237+0000 7f7fa12cd640 1 -- 172.21.15.103:0/2631692459 >> v2:172.21.15.154:3300/0 conn(0x7f7f800036c0 msgr2=0x7f7f80005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:30:34.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.237+0000 7f7fa12cd640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.154:3300/0 conn(0x7f7f800036c0 0x7f7f80005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:30:34.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.237+0000 7f7fa12cd640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.154:3300/0 conn(0x7f7f800036c0 0x7f7f80005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:30:34.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.638+0000 7f7fa12cd640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.154:3300/0 conn(0x7f7f800036c0 0x7f7f80005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:34.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.638+0000 7f7fa12cd640 1 -- 172.21.15.103:0/2631692459 >> v2:172.21.15.154:3300/0 conn(0x7f7f800036c0 msgr2=0x7f7f80005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:30:34.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.638+0000 7f7fa12cd640 1 -- 172.21.15.103:0/2631692459 >> v2:172.21.15.154:3300/0 conn(0x7f7f800036c0 msgr2=0x7f7f80005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:30:34.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.638+0000 7f7fa12cd640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.154:3300/0 conn(0x7f7f800036c0 0x7f7f80005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:30:34.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:34.638+0000 7f7fa12cd640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.154:3300/0 conn(0x7f7f800036c0 0x7f7f80005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:30:35.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.189+0000 7f7f93fff640 1 -- 172.21.15.103:0/2631692459 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1362896701 0 0) 0x7f7f9c0c6c90 con 0x7f7f80006190 2024-09-10T08:30:35.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.189+0000 7f7f93fff640 1 -- 172.21.15.103:0/2631692459 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f88003520 con 0x7f7f80006190 2024-09-10T08:30:35.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.190+0000 7f7f93fff640 1 -- 172.21.15.103:0/2631692459 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3063785045 0 0) 0x7f7f88003520 con 0x7f7f80006190 2024-09-10T08:30:35.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.190+0000 7f7f93fff640 1 -- 172.21.15.103:0/2631692459 >> v2:172.21.15.154:3300/0 conn(0x7f7f800036c0 msgr2=0x7f7f80005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:30:35.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.190+0000 7f7f93fff640 1 --2- 172.21.15.103:0/2631692459 >> v2:172.21.15.154:3300/0 conn(0x7f7f800036c0 0x7f7f80005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.190+0000 7f7f93fff640 1 -- 172.21.15.103:0/2631692459 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8000b000 con 0x7f7f80006190 2024-09-10T08:30:35.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.190+0000 7f7f93fff640 1 -- 172.21.15.103:0/2631692459 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f7f8c0016b0 con 0x7f7f80006190 2024-09-10T08:30:35.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.190+0000 7f7f93fff640 1 -- 172.21.15.103:0/2631692459 >> v1:172.21.15.103:6789/0 conn(0x7f7f80006190 legacy=0x7f7f80008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:35.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.190+0000 7f7fa1ace640 1 -- 172.21.15.103:0/2631692459 reap_dead start 2024-09-10T08:30:35.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.190+0000 7f7f93fff640 1 --2- 172.21.15.103:0/2631692459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f880039b0 0x7f7f88003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:35.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.190+0000 7f7f93fff640 1 --2- 172.21.15.103:0/2631692459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f88004800 0x7f7f88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:35.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.190+0000 7f7f93fff640 1 --2- 172.21.15.103:0/2631692459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f88005210 0x7f7f8800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:35.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.190+0000 7f7f93fff640 1 -- 172.21.15.103:0/2631692459 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c06d210 con 0x7f7f88004800 2024-09-10T08:30:35.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.190+0000 7f7f93fff640 1 -- 172.21.15.103:0/2631692459 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8800c140 con 0x7f7f880039b0 2024-09-10T08:30:35.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.190+0000 7f7f93fff640 1 -- 172.21.15.103:0/2631692459 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7f8800c340 con 0x7f7f88005210 2024-09-10T08:30:35.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.190+0000 7f7fa1ace640 1 -- 172.21.15.103:0/2631692459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f88005210 msgr2=0x7f7f8800b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:30:35.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.190+0000 7f7fa1ace640 1 --2- 172.21.15.103:0/2631692459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f88005210 0x7f7f8800b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:30:35.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.190+0000 7f7fa12cd640 1 --2- 172.21.15.103:0/2631692459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f880039b0 0x7f7f88003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:35.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.190+0000 7f7fa0acc640 1 --2- 172.21.15.103:0/2631692459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f88004800 0x7f7f88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:35.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.191+0000 7f7fa0acc640 1 -- 172.21.15.103:0/2631692459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f88005210 msgr2=0x7f7f8800b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:30:35.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.191+0000 7f7fa0acc640 1 --2- 172.21.15.103:0/2631692459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f88005210 0x7f7f8800b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.191+0000 7f7fa0acc640 1 -- 172.21.15.103:0/2631692459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f880039b0 msgr2=0x7f7f88003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:35.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.191+0000 7f7fa0acc640 1 --2- 172.21.15.103:0/2631692459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f880039b0 0x7f7f88003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.191+0000 7f7fa0acc640 1 -- 172.21.15.103:0/2631692459 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f88003520 con 0x7f7f88004800 2024-09-10T08:30:35.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.191+0000 7f7fa12cd640 1 --2- 172.21.15.103:0/2631692459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f880039b0 0x7f7f88003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:30:35.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.192+0000 7f7fa0acc640 1 --2- 172.21.15.103:0/2631692459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f88004800 0x7f7f88004c80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c08e070 tx=0x7f7f88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4af1f9677cece2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:35.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.194+0000 7f7f93fff640 1 -- 172.21.15.103:0/2631692459 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c007ab0 con 0x7f7f88004800 2024-09-10T08:30:35.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.194+0000 7f7f93fff640 1 -- 172.21.15.103:0/2631692459 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f8c031620 con 0x7f7f88004800 2024-09-10T08:30:35.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.194+0000 7f7f93fff640 1 -- 172.21.15.103:0/2631692459 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c031a10 con 0x7f7f88004800 2024-09-10T08:30:35.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.195+0000 7f7fa3531640 1 -- 172.21.15.103:0/2631692459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f88004800 msgr2=0x7f7f88004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:35.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.195+0000 7f7fa3531640 1 --2- 172.21.15.103:0/2631692459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f88004800 0x7f7f88004c80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c08e070 tx=0x7f7f88005830 comp rx=0 tx=0).stop 2024-09-10T08:30:35.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.195+0000 7f7fa3531640 1 -- 172.21.15.103:0/2631692459 shutdown_connections 2024-09-10T08:30:35.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.195+0000 7f7fa3531640 1 --2- 172.21.15.103:0/2631692459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f88005210 0x7f7f8800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.195+0000 7f7fa3531640 1 --2- 172.21.15.103:0/2631692459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f88004800 0x7f7f88004c80 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.195+0000 7f7fa3531640 1 --2- 172.21.15.103:0/2631692459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f880039b0 0x7f7f88003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.195+0000 7f7fa3531640 1 -- 172.21.15.103:0/2631692459 >> 172.21.15.103:0/2631692459 conn(0x7f7f9c0adb80 msgr2=0x7f7f9c0adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:35.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.196+0000 7f7fa3531640 1 -- 172.21.15.103:0/2631692459 shutdown_connections 2024-09-10T08:30:35.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.196+0000 7f7fa3531640 1 -- 172.21.15.103:0/2631692459 wait complete. 2024-09-10T08:30:35.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.197+0000 7f7fa3531640 1 Processor -- start 2024-09-10T08:30:35.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.197+0000 7f7fa3531640 1 -- start start 2024-09-10T08:30:35.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.198+0000 7f7fa3531640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f880039b0 0x7f7f9c154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:35.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.198+0000 7f7fa3531640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f88004800 0x7f7f9c14e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:35.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.198+0000 7f7fa3531640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f88005210 0x7f7f9c0b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:35.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.198+0000 7f7fa3531640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c0c9070 con 0x7f7f880039b0 2024-09-10T08:30:35.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.198+0000 7f7fa3531640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c0c8ef0 con 0x7f7f88004800 2024-09-10T08:30:35.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.198+0000 7f7fa3531640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7f9c15a4a0 con 0x7f7f88005210 2024-09-10T08:30:35.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.198+0000 7f7fa1ace640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f88005210 msgr2=0x7f7f9c0b0fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:30:35.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.198+0000 7f7fa1ace640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f88005210 0x7f7f9c0b0fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:30:35.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.198+0000 7f7fa12cd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f880039b0 0x7f7f9c154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.198+0000 7f7fa12cd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f880039b0 0x7f7f9c154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49910/0 (socket says 172.21.15.103:49910) 2024-09-10T08:30:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.198+0000 7f7fa12cd640 1 -- 172.21.15.103:0/288016868 learned_addr learned my addr 172.21.15.103:0/288016868 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.198+0000 7f7fa0acc640 1 --2- 172.21.15.103:0/288016868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f88004800 0x7f7f9c14e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.199+0000 7f7fa12cd640 1 -- 172.21.15.103:0/288016868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f88005210 msgr2=0x7f7f9c0b0fe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:30:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.199+0000 7f7fa12cd640 1 --2- 172.21.15.103:0/288016868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f88005210 0x7f7f9c0b0fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.199+0000 7f7fa12cd640 1 -- 172.21.15.103:0/288016868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f88004800 msgr2=0x7f7f9c14e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.199+0000 7f7fa12cd640 1 --2- 172.21.15.103:0/288016868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f88004800 0x7f7f9c14e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.199+0000 7f7fa12cd640 1 -- 172.21.15.103:0/288016868 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f9c14ebc0 con 0x7f7f880039b0 2024-09-10T08:30:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.199+0000 7f7fa0acc640 1 --2- 172.21.15.103:0/288016868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f88004800 0x7f7f9c14e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:30:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.199+0000 7f7fa12cd640 1 --2- 172.21.15.103:0/288016868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f880039b0 0x7f7f9c154d10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009ac0 tx=0x7f7f98009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:35.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.199+0000 7f7f91ffb640 1 -- 172.21.15.103:0/288016868 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9801c070 con 0x7f7f880039b0 2024-09-10T08:30:35.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.199+0000 7f7f91ffb640 1 -- 172.21.15.103:0/288016868 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f9800b650 con 0x7f7f880039b0 2024-09-10T08:30:35.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.199+0000 7f7fa3531640 1 -- 172.21.15.103:0/288016868 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f9c14eea0 con 0x7f7f880039b0 2024-09-10T08:30:35.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.199+0000 7f7f91ffb640 1 -- 172.21.15.103:0/288016868 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9800ba00 con 0x7f7f880039b0 2024-09-10T08:30:35.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.200+0000 7f7fa3531640 1 -- 172.21.15.103:0/288016868 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f9c14dc30 con 0x7f7f880039b0 2024-09-10T08:30:35.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.201+0000 7f7fa3531640 1 -- 172.21.15.103:0/288016868 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f9c0c69b0 con 0x7f7f880039b0 2024-09-10T08:30:35.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.201+0000 7f7f91ffb640 1 -- 172.21.15.103:0/288016868 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f9801f070 con 0x7f7f880039b0 2024-09-10T08:30:35.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.202+0000 7f7f91ffb640 1 --2- 172.21.15.103:0/288016868 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7f8006c680 0x7f7f8006eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:35.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.202+0000 7f7f91ffb640 1 -- 172.21.15.103:0/288016868 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f7f9808ba70 con 0x7f7f880039b0 2024-09-10T08:30:35.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.202+0000 7f7fa0acc640 1 --2- 172.21.15.103:0/288016868 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7f8006c680 0x7f7f8006eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:35.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.203+0000 7f7fa0acc640 1 --2- 172.21.15.103:0/288016868 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7f8006c680 0x7f7f8006eb40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c034000 tx=0x7f7f8c02f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:35.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.209+0000 7f7f91ffb640 1 -- 172.21.15.103:0/288016868 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7f98059ac0 con 0x7f7f880039b0 2024-09-10T08:30:35.248 INFO:tasks.workunit.client.1.smithi154.stderr:+ make 2024-09-10T08:30:35.398 INFO:tasks.workunit.client.1.smithi154.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run aclocal-1.10 2024-09-10T08:30:35.405 INFO:tasks.workunit.client.1.smithi154.stderr:/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-09-10T08:30:35.406 INFO:tasks.workunit.client.1.smithi154.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-09-10T08:30:35.406 INFO:tasks.workunit.client.1.smithi154.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-09-10T08:30:35.406 INFO:tasks.workunit.client.1.smithi154.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-09-10T08:30:35.406 INFO:tasks.workunit.client.1.smithi154.stderr: any GNU archive site. 2024-09-10T08:30:35.411 INFO:tasks.workunit.client.1.smithi154.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run automake-1.10 --gnu 2024-09-10T08:30:35.415 INFO:tasks.workunit.client.1.smithi154.stderr:/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-09-10T08:30:35.417 INFO:tasks.workunit.client.1.smithi154.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-09-10T08:30:35.417 INFO:tasks.workunit.client.1.smithi154.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-09-10T08:30:35.417 INFO:tasks.workunit.client.1.smithi154.stderr: You might want to install the `Automake' and `Perl' packages. 2024-09-10T08:30:35.417 INFO:tasks.workunit.client.1.smithi154.stderr: Grab them from any GNU archive site. 2024-09-10T08:30:35.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.450+0000 7f7fa3531640 1 -- 172.21.15.103:0/288016868 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7f9c0b2160 con 0x7f7f880039b0 2024-09-10T08:30:35.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.450+0000 7f7f91ffb640 1 -- 172.21.15.103:0/288016868 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7f7f9805ddc0 con 0x7f7f880039b0 2024-09-10T08:30:35.451 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":14,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:30:35.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.452+0000 7f7fa3531640 1 -- 172.21.15.103:0/288016868 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7f8006c680 msgr2=0x7f7f8006eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:35.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.452+0000 7f7fa3531640 1 --2- 172.21.15.103:0/288016868 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7f8006c680 0x7f7f8006eb40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c034000 tx=0x7f7f8c02f000 comp rx=0 tx=0).stop 2024-09-10T08:30:35.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.452+0000 7f7fa3531640 1 -- 172.21.15.103:0/288016868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f880039b0 msgr2=0x7f7f9c154d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:35.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.452+0000 7f7fa3531640 1 --2- 172.21.15.103:0/288016868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f880039b0 0x7f7f9c154d10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009ac0 tx=0x7f7f98009f90 comp rx=0 tx=0).stop 2024-09-10T08:30:35.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.452+0000 7f7fa3531640 1 -- 172.21.15.103:0/288016868 shutdown_connections 2024-09-10T08:30:35.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.452+0000 7f7fa3531640 1 --2- 172.21.15.103:0/288016868 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7f8006c680 0x7f7f8006eb40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.452+0000 7f7fa3531640 1 --2- 172.21.15.103:0/288016868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f88005210 0x7f7f9c0b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.452+0000 7f7fa3531640 1 --2- 172.21.15.103:0/288016868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f88004800 0x7f7f9c14e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.452+0000 7f7fa3531640 1 --2- 172.21.15.103:0/288016868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f880039b0 0x7f7f9c154d10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.452+0000 7f7fa3531640 1 -- 172.21.15.103:0/288016868 >> 172.21.15.103:0/288016868 conn(0x7f7f9c0adb80 msgr2=0x7f7f9c156db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:35.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.452+0000 7f7fa3531640 1 -- 172.21.15.103:0/288016868 shutdown_connections 2024-09-10T08:30:35.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.452+0000 7f7fa3531640 1 -- 172.21.15.103:0/288016868 wait complete. 2024-09-10T08:30:35.464 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-10T08:30:35.464 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-10T08:30:35.464 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:30:35.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.563+0000 7ff54c4d0640 1 Processor -- start 2024-09-10T08:30:35.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.563+0000 7ff54c4d0640 1 -- start start 2024-09-10T08:30:35.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.564+0000 7ff54c4d0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff544151840 0x7ff5440ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:35.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.564+0000 7ff54c4d0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5440c3a00 0x7ff54415e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:35.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.564+0000 7ff54c4d0640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5440c3e50 con 0x7ff5440ad340 2024-09-10T08:30:35.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.564+0000 7ff54c4d0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff5441550f0 con 0x7ff5440c3a00 2024-09-10T08:30:35.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.564+0000 7ff54c4d0640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff544154330 con 0x7ff544151840 2024-09-10T08:30:35.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.564+0000 7ff54a26c640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff544151840 msgr2=0x7ff5440ace00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:30:35.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.564+0000 7ff54a26c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff544151840 0x7ff5440ace00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:30:35.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.564+0000 7ff54aa6d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5440c3a00 0x7ff54415e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:35.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.564+0000 7ff54aa6d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5440c3a00 0x7ff54415e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:41644/0 (socket says 172.21.15.103:41644) 2024-09-10T08:30:35.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.564+0000 7ff54aa6d640 1 -- 172.21.15.103:0/1858082933 learned_addr learned my addr 172.21.15.103:0/1858082933 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:35.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.564+0000 7ff54aa6d640 1 -- 172.21.15.103:0/1858082933 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff544151840 msgr2=0x7ff5440ace00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:30:35.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.564+0000 7ff54aa6d640 1 --2- 172.21.15.103:0/1858082933 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff544151840 0x7ff5440ace00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.564+0000 7ff54aa6d640 1 -- 172.21.15.103:0/1858082933 >> v1:172.21.15.154:6789/0 conn(0x7ff5440ad340 legacy=0x7ff5440c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:35.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.564+0000 7ff54aa6d640 1 -- 172.21.15.103:0/1858082933 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff544154610 con 0x7ff5440c3a00 2024-09-10T08:30:35.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.564+0000 7ff54926a640 1 -- 172.21.15.103:0/1858082933 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1766335889 0 0) 0x7ff5440c3e50 con 0x7ff5440ad340 2024-09-10T08:30:35.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.565+0000 7ff54aa6d640 1 --2- 172.21.15.103:0/1858082933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5440c3a00 0x7ff54415e9c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009e50 tx=0x7ff53c02a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4133594a1f89f6de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:35.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.565+0000 7ff54926a640 1 -- 172.21.15.103:0/1858082933 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c036070 con 0x7ff5440c3a00 2024-09-10T08:30:35.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.565+0000 7ff54926a640 1 -- 172.21.15.103:0/1858082933 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff53c031600 con 0x7ff5440c3a00 2024-09-10T08:30:35.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.565+0000 7ff54926a640 1 -- 172.21.15.103:0/1858082933 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c0319d0 con 0x7ff5440c3a00 2024-09-10T08:30:35.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.566+0000 7ff54c4d0640 1 -- 172.21.15.103:0/1858082933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5440c3a00 msgr2=0x7ff54415e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:35.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.566+0000 7ff54c4d0640 1 --2- 172.21.15.103:0/1858082933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5440c3a00 0x7ff54415e9c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009e50 tx=0x7ff53c02a730 comp rx=0 tx=0).stop 2024-09-10T08:30:35.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.566+0000 7ff54c4d0640 1 -- 172.21.15.103:0/1858082933 shutdown_connections 2024-09-10T08:30:35.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.566+0000 7ff54c4d0640 1 --2- 172.21.15.103:0/1858082933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5440c3a00 0x7ff54415e9c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.566+0000 7ff54c4d0640 1 --2- 172.21.15.103:0/1858082933 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff544151840 0x7ff5440ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.566+0000 7ff54c4d0640 1 -- 172.21.15.103:0/1858082933 >> 172.21.15.103:0/1858082933 conn(0x7ff5440c7a40 msgr2=0x7ff5440c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:35.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.566+0000 7ff54c4d0640 1 -- 172.21.15.103:0/1858082933 shutdown_connections 2024-09-10T08:30:35.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.566+0000 7ff54c4d0640 1 -- 172.21.15.103:0/1858082933 wait complete. 2024-09-10T08:30:35.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.567+0000 7ff54c4d0640 1 Processor -- start 2024-09-10T08:30:35.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.567+0000 7ff54c4d0640 1 -- start start 2024-09-10T08:30:35.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.568+0000 7ff54c4d0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5440ad340 0x7ff544156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:35.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.568+0000 7ff54c4d0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5440c3a00 0x7ff54414ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:35.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.568+0000 7ff54c4d0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff544151840 0x7ff54414d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:35.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.568+0000 7ff54c4d0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff54406dda0 con 0x7ff5440c3a00 2024-09-10T08:30:35.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.568+0000 7ff54c4d0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff544154bd0 con 0x7ff5440ad340 2024-09-10T08:30:35.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.568+0000 7ff54c4d0640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff54406e030 con 0x7ff544151840 2024-09-10T08:30:35.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.568+0000 7ff549a6b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5440c3a00 0x7ff54414ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:35.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.568+0000 7ff54aa6d640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff544151840 msgr2=0x7ff54414d210 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:30:35.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.568+0000 7ff54aa6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff544151840 0x7ff54414d210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:30:35.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.568+0000 7ff549a6b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5440c3a00 0x7ff54414ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49914/0 (socket says 172.21.15.103:49914) 2024-09-10T08:30:35.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.568+0000 7ff549a6b640 1 -- 172.21.15.103:0/3599360468 learned_addr learned my addr 172.21.15.103:0/3599360468 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:35.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.568+0000 7ff54a26c640 1 --2- 172.21.15.103:0/3599360468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5440ad340 0x7ff544156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:35.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.568+0000 7ff549a6b640 1 -- 172.21.15.103:0/3599360468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff544151840 msgr2=0x7ff54414d210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:30:35.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.568+0000 7ff549a6b640 1 --2- 172.21.15.103:0/3599360468 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff544151840 0x7ff54414d210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.568+0000 7ff549a6b640 1 -- 172.21.15.103:0/3599360468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5440ad340 msgr2=0x7ff544156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:35.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.568+0000 7ff549a6b640 1 --2- 172.21.15.103:0/3599360468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5440ad340 0x7ff544156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.568+0000 7ff549a6b640 1 -- 172.21.15.103:0/3599360468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5440a8180 con 0x7ff5440c3a00 2024-09-10T08:30:35.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.568+0000 7ff549a6b640 1 --2- 172.21.15.103:0/3599360468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5440c3a00 0x7ff54414ccd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff54000c4b0 tx=0x7ff54000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:35.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.569+0000 7ff53affd640 1 -- 172.21.15.103:0/3599360468 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540017070 con 0x7ff5440c3a00 2024-09-10T08:30:35.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.569+0000 7ff53affd640 1 -- 172.21.15.103:0/3599360468 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff540005480 con 0x7ff5440c3a00 2024-09-10T08:30:35.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.569+0000 7ff54c4d0640 1 -- 172.21.15.103:0/3599360468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5441ebe90 con 0x7ff5440c3a00 2024-09-10T08:30:35.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.569+0000 7ff53affd640 1 -- 172.21.15.103:0/3599360468 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540003830 con 0x7ff5440c3a00 2024-09-10T08:30:35.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.569+0000 7ff54c4d0640 1 -- 172.21.15.103:0/3599360468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5441ec450 con 0x7ff5440c3a00 2024-09-10T08:30:35.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.569+0000 7ff54c4d0640 1 --2- 172.21.15.103:0/3599360468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5441df460 0x7ff5441ec690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:35.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.569+0000 7ff54c4d0640 1 -- 172.21.15.103:0/3599360468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff544151c20 con 0x7ff5441df460 2024-09-10T08:30:35.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.570+0000 7ff54a26c640 1 --2- 172.21.15.103:0/3599360468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5441df460 0x7ff5441ec690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:35.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.570+0000 7ff54a26c640 1 -- 172.21.15.103:0/3599360468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5441533c0 con 0x7ff5441df460 2024-09-10T08:30:35.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.570+0000 7ff54a26c640 1 --2- 172.21.15.103:0/3599360468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5441df460 0x7ff5441ec690 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff534003930 tx=0x7ff534009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:35.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.570+0000 7ff53affd640 1 -- 172.21.15.103:0/3599360468 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff534016070 con 0x7ff5441df460 2024-09-10T08:30:35.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.570+0000 7ff53affd640 1 -- 172.21.15.103:0/3599360468 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff54001a070 con 0x7ff5440c3a00 2024-09-10T08:30:35.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.571+0000 7ff53affd640 1 --2- 172.21.15.103:0/3599360468 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff52806bd30 0x7ff52806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:35.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.571+0000 7ff53affd640 1 -- 172.21.15.103:0/3599360468 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7ff54008a3f0 con 0x7ff5440c3a00 2024-09-10T08:30:35.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.571+0000 7ff54aa6d640 1 --2- 172.21.15.103:0/3599360468 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff52806bd30 0x7ff52806e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:35.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.571+0000 7ff53affd640 1 -- 172.21.15.103:0/3599360468 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff534012600 con 0x7ff5441df460 2024-09-10T08:30:35.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.571+0000 7ff53affd640 1 -- 172.21.15.103:0/3599360468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5441df460 msgr2=0x7ff5441ec690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:35.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.571+0000 7ff53affd640 1 --2- 172.21.15.103:0/3599360468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5441df460 0x7ff5441ec690 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff534003930 tx=0x7ff534009b00 comp rx=0 tx=0).stop 2024-09-10T08:30:35.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.571+0000 7ff53affd640 1 -- 172.21.15.103:0/3599360468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5441df460 msgr2=0x7ff5441ec690 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:30:35.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.571+0000 7ff53affd640 1 --2- 172.21.15.103:0/3599360468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5441df460 0x7ff5441ec690 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.571+0000 7ff54aa6d640 1 --2- 172.21.15.103:0/3599360468 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff52806bd30 0x7ff52806e1f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff53c033000 tx=0x7ff53c009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:35.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.579+0000 7ff54c4d0640 1 --2- 172.21.15.103:0/3599360468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5441ef380 0x7ff5441ef760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:35.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.579+0000 7ff54c4d0640 1 -- 172.21.15.103:0/3599360468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff54406e830 con 0x7ff5441ef380 2024-09-10T08:30:35.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.579+0000 7ff54a26c640 1 --2- 172.21.15.103:0/3599360468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5441ef380 0x7ff5441ef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:35.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.580+0000 7ff54a26c640 1 -- 172.21.15.103:0/3599360468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff544156580 con 0x7ff5441ef380 2024-09-10T08:30:35.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.580+0000 7ff54a26c640 1 --2- 172.21.15.103:0/3599360468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5441ef380 0x7ff5441ef760 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff534003930 tx=0x7ff5340059d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:35.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.580+0000 7ff53affd640 1 -- 172.21.15.103:0/3599360468 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff534026620 con 0x7ff5441ef380 2024-09-10T08:30:35.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.580+0000 7ff53affd640 1 -- 172.21.15.103:0/3599360468 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5045 (secure 0 0 0) 0x7ff53400e420 con 0x7ff5441ef380 2024-09-10T08:30:35.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.580+0000 7ff53affd640 1 -- 172.21.15.103:0/3599360468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5441ef380 msgr2=0x7ff5441ef760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:35.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.580+0000 7ff53affd640 1 --2- 172.21.15.103:0/3599360468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5441ef380 0x7ff5441ef760 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff534003930 tx=0x7ff5340059d0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.580+0000 7ff53affd640 1 -- 172.21.15.103:0/3599360468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5441ef380 msgr2=0x7ff5441ef760 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:30:35.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.580+0000 7ff53affd640 1 --2- 172.21.15.103:0/3599360468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5441ef380 0x7ff5441ef760 secure :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff534003930 tx=0x7ff5340059d0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.581 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:30:35.582 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:30:35.582 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:30:35.582 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:30:35.582 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 14, 2024-09-10T08:30:35.582 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 143143, 2024-09-10T08:30:35.582 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:30:35.582 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:30:35.582 INFO:teuthology.orchestra.run.smithi103.stdout: 1 2024-09-10T08:30:35.582 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:35.582 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:30:35.583 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:30:35.583 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:30:35.583 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:30:35.583 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:35.583 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:35.583 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:35.583 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:35.583 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:35.583 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:35.583 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:35.583 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:35.583 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:35.583 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:35.583 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:35.584 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:35.584 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:30:35.584 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:30:35.584 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:35.584 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:35.584 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:35.584 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:35.584 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:35.584 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:35.584 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:35.584 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:35.584 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:35.585 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:35.585 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:35.585 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:35.585 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.585 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:30:35.585 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:30:35.585 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:30:35.585 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:30:35.585 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:30:35.585 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:30:35.585 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:30:35.585 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:30:35.585 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:30:35.585 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:30:35.586 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:30:35.586 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:30:35.586 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:30:35.586 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:30:35.586 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:30:35.586 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:30:35.586 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:30:35.586 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:35.586 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:35.586 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:35.586 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:35.586 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:35.586 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:35.587 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:35.587 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:35.587 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:35.587 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:35.587 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:35.587 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:35.587 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:30:35.587 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.587 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:30:35.587 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.587 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:30:35.588 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:30:35.588 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:35.588 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:35.588 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.588 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:35.588 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:30:35.588 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:35.588 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.588 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.588 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:35.588 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:30:35.588 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:35.589 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:35.589 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:35.589 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.589 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:30:35.589 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:30:35.589 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:35.589 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:35.589 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:35.589 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.589 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.589 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:30:35.589 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:30:35.589 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:35.590 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:35.590 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.590 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:35.590 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:30:35.590 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:35.590 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.590 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.590 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:35.590 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:30:35.590 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:35.590 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:35.590 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:35.590 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.591 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:30:35.591 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:30:35.591 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:35.591 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:35.591 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:35.591 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.591 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.591 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:30:35.591 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:30:35.591 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:35.592 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:35.592 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.592 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:35.592 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:30:35.592 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:35.592 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.592 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.592 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:35.592 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:30:35.592 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:35.592 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:35.593 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:35.593 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.593 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:30:35.593 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:30:35.593 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:35.593 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:35.593 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:35.593 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:35.593 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:35.593 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.593 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:30:35.593 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:30:35.593 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.594 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:35.594 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:35.594 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:30:35.594 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:35.594 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:35.594 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:30:35.594 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.594 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:35.594 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:35.594 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:30:35.594 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:35.594 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:35.594 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:30:35.595 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.595 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:35.595 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:35.595 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-10T08:30:35.595 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:35.595 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:35.595 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:30:35.595 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.595 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:35.595 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:35.595 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-10T08:30:35.595 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:35.596 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:35.596 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:30:35.596 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.596 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:35.596 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:35.596 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:30:35.596 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:35.596 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:35.596 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.596 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:30:35.596 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:30:35.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.580+0000 7ff54c4d0640 1 -- 172.21.15.103:0/3599360468 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff52806bd30 msgr2=0x7ff52806e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:35.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.580+0000 7ff54c4d0640 1 --2- 172.21.15.103:0/3599360468 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff52806bd30 0x7ff52806e1f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff53c033000 tx=0x7ff53c009000 comp rx=0 tx=0).stop 2024-09-10T08:30:35.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.580+0000 7ff54c4d0640 1 -- 172.21.15.103:0/3599360468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5440c3a00 msgr2=0x7ff54414ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:35.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.580+0000 7ff54c4d0640 1 --2- 172.21.15.103:0/3599360468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5440c3a00 0x7ff54414ccd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff54000c4b0 tx=0x7ff54000c970 comp rx=0 tx=0).stop 2024-09-10T08:30:35.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.580+0000 7ff54aa6d640 1 -- 172.21.15.103:0/3599360468 reap_dead start 2024-09-10T08:30:35.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.581+0000 7ff54aa6d640 1 -- 172.21.15.103:0/3599360468 reap_dead start 2024-09-10T08:30:35.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.581+0000 7ff54c4d0640 1 -- 172.21.15.103:0/3599360468 shutdown_connections 2024-09-10T08:30:35.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.581+0000 7ff54c4d0640 1 -- 172.21.15.103:0/3599360468 >> 172.21.15.103:0/3599360468 conn(0x7ff5440c7a40 msgr2=0x7ff544150030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:35.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.581+0000 7ff54c4d0640 1 -- 172.21.15.103:0/3599360468 shutdown_connections 2024-09-10T08:30:35.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.581+0000 7ff54c4d0640 1 -- 172.21.15.103:0/3599360468 wait complete. 2024-09-10T08:30:35.599 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:30:35.599 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-10T08:30:35.599 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:30:35.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.710+0000 7f87e2e37640 1 Processor -- start 2024-09-10T08:30:35.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.710+0000 7f87e2e37640 1 -- start start 2024-09-10T08:30:35.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.711+0000 7f87e2e37640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f87dc0ca390 0x7f87dc161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:35.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.711+0000 7f87e2e37640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87dc15a7c0 con 0x7f87dc06c650 2024-09-10T08:30:35.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.711+0000 7f87e2e37640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87dc159a00 con 0x7f87dc150480 2024-09-10T08:30:35.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.711+0000 7f87e2e37640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f87dc06c240 con 0x7f87dc0ca390 2024-09-10T08:30:35.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.711+0000 7f87dbfff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f87dc06c650 0x7f87dc0c9c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33598/0 (socket says 172.21.15.103:33598) 2024-09-10T08:30:35.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.711+0000 7f87dbfff640 1 -- 172.21.15.103:0/3518570645 learned_addr learned my addr 172.21.15.103:0/3518570645 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:30:35.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.712+0000 7f87e13d4640 1 --2- 172.21.15.103:0/3518570645 >> v2:172.21.15.154:3300/0 conn(0x7f87dc0ca390 0x7f87dc161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:35.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.712+0000 7f87db7fe640 1 -- 172.21.15.103:0/3518570645 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863233654 0 0) 0x7f87dc15a7c0 con 0x7f87dc06c650 2024-09-10T08:30:35.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.712+0000 7f87db7fe640 1 -- 172.21.15.103:0/3518570645 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87cc003520 con 0x7f87dc06c650 2024-09-10T08:30:35.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.712+0000 7f87e13d4640 1 -- 172.21.15.103:0/3518570645 >> v1:172.21.15.154:6789/0 conn(0x7f87dc150480 legacy=0x7f87dc0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:35.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.712+0000 7f87db7fe640 1 -- 172.21.15.103:0/3518570645 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1647540395 0 0) 0x7f87dc159a00 con 0x7f87dc150480 2024-09-10T08:30:35.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.712+0000 7f87e13d4640 1 -- 172.21.15.103:0/3518570645 >> v1:172.21.15.103:6789/0 conn(0x7f87dc06c650 legacy=0x7f87dc0c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:35.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.712+0000 7f87e13d4640 1 -- 172.21.15.103:0/3518570645 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87dc159ce0 con 0x7f87dc0ca390 2024-09-10T08:30:35.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.713+0000 7f87e13d4640 1 --2- 172.21.15.103:0/3518570645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc0ca390 0x7f87dc161c00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009d90 tx=0x7f87d402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4fb03f543988c4c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:35.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.713+0000 7f87db7fe640 1 -- 172.21.15.103:0/3518570645 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d4007740 con 0x7f87dc0ca390 2024-09-10T08:30:35.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.713+0000 7f87db7fe640 1 -- 172.21.15.103:0/3518570645 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87d40078e0 con 0x7f87dc0ca390 2024-09-10T08:30:35.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.713+0000 7f87db7fe640 1 -- 172.21.15.103:0/3518570645 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d4007c90 con 0x7f87dc0ca390 2024-09-10T08:30:35.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.714+0000 7f87e2e37640 1 -- 172.21.15.103:0/3518570645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc0ca390 msgr2=0x7f87dc161c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:35.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.714+0000 7f87e2e37640 1 --2- 172.21.15.103:0/3518570645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc0ca390 0x7f87dc161c00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009d90 tx=0x7f87d402a6f0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.714+0000 7f87e2e37640 1 -- 172.21.15.103:0/3518570645 shutdown_connections 2024-09-10T08:30:35.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.714+0000 7f87e2e37640 1 --2- 172.21.15.103:0/3518570645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc0ca390 0x7f87dc161c00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.714+0000 7f87e2e37640 1 -- 172.21.15.103:0/3518570645 >> 172.21.15.103:0/3518570645 conn(0x7f87dc068030 msgr2=0x7f87dc073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:35.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.714+0000 7f87e2e37640 1 -- 172.21.15.103:0/3518570645 shutdown_connections 2024-09-10T08:30:35.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.714+0000 7f87e2e37640 1 -- 172.21.15.103:0/3518570645 wait complete. 2024-09-10T08:30:35.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.715+0000 7f87e2e37640 1 Processor -- start 2024-09-10T08:30:35.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.715+0000 7f87e2e37640 1 -- start start 2024-09-10T08:30:35.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.716+0000 7f87e2e37640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87dc06c650 0x7f87dc1517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:35.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.716+0000 7f87e2e37640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87dc0ca390 0x7f87dc1ef2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:35.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.716+0000 7f87e2e37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc150480 0x7f87dc1ef810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:35.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.716+0000 7f87e2e37640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f87dc06d270 con 0x7f87dc06c650 2024-09-10T08:30:35.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.716+0000 7f87e2e37640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f87dc15a330 con 0x7f87dc150480 2024-09-10T08:30:35.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.716+0000 7f87e2e37640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f87dc0c81a0 con 0x7f87dc0ca390 2024-09-10T08:30:35.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.716+0000 7f87dbfff640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87dc0ca390 msgr2=0x7f87dc1ef2d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:30:35.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.716+0000 7f87dbfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87dc0ca390 0x7f87dc1ef2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:30:35.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.716+0000 7f87e0bd3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87dc06c650 0x7f87dc1517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:35.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.716+0000 7f87e0bd3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87dc06c650 0x7f87dc1517c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49946/0 (socket says 172.21.15.103:49946) 2024-09-10T08:30:35.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.716+0000 7f87e0bd3640 1 -- 172.21.15.103:0/3991720253 learned_addr learned my addr 172.21.15.103:0/3991720253 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:35.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.716+0000 7f87e13d4640 1 --2- 172.21.15.103:0/3991720253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc150480 0x7f87dc1ef810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:35.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.717+0000 7f87e0bd3640 1 -- 172.21.15.103:0/3991720253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87dc0ca390 msgr2=0x7f87dc1ef2d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:30:35.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.717+0000 7f87e0bd3640 1 --2- 172.21.15.103:0/3991720253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87dc0ca390 0x7f87dc1ef2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.717+0000 7f87e0bd3640 1 -- 172.21.15.103:0/3991720253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc150480 msgr2=0x7f87dc1ef810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:35.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.717+0000 7f87e0bd3640 1 --2- 172.21.15.103:0/3991720253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc150480 0x7f87dc1ef810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.717+0000 7f87e0bd3640 1 -- 172.21.15.103:0/3991720253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87dc0b0dd0 con 0x7f87dc06c650 2024-09-10T08:30:35.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.717+0000 7f87e0bd3640 1 --2- 172.21.15.103:0/3991720253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87dc06c650 0x7f87dc1517c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f87d000c410 tx=0x7f87d000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:35.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.717+0000 7f87d97fa640 1 -- 172.21.15.103:0/3991720253 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d0017070 con 0x7f87dc06c650 2024-09-10T08:30:35.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.717+0000 7f87d97fa640 1 -- 172.21.15.103:0/3991720253 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87d00035f0 con 0x7f87dc06c650 2024-09-10T08:30:35.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.717+0000 7f87d97fa640 1 -- 172.21.15.103:0/3991720253 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d00039e0 con 0x7f87dc06c650 2024-09-10T08:30:35.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.717+0000 7f87e2e37640 1 -- 172.21.15.103:0/3991720253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87dc150a00 con 0x7f87dc06c650 2024-09-10T08:30:35.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.717+0000 7f87e2e37640 1 -- 172.21.15.103:0/3991720253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87dc150fc0 con 0x7f87dc06c650 2024-09-10T08:30:35.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.718+0000 7f87e2e37640 1 --2- 172.21.15.103:0/3991720253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc0c0c80 0x7f87dc151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:35.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.718+0000 7f87e2e37640 1 -- 172.21.15.103:0/3991720253 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f87dc0c38e0 con 0x7f87dc0c0c80 2024-09-10T08:30:35.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.718+0000 7f87dbfff640 1 --2- 172.21.15.103:0/3991720253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc0c0c80 0x7f87dc151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:35.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.718+0000 7f87d97fa640 1 -- 172.21.15.103:0/3991720253 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f87d001a070 con 0x7f87dc06c650 2024-09-10T08:30:35.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.719+0000 7f87dbfff640 1 -- 172.21.15.103:0/3991720253 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f87dc156270 con 0x7f87dc0c0c80 2024-09-10T08:30:35.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.719+0000 7f87dbfff640 1 --2- 172.21.15.103:0/3991720253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc0c0c80 0x7f87dc151190 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f87dc0ab8b0 tx=0x7f87c800c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:35.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.719+0000 7f87d97fa640 1 --2- 172.21.15.103:0/3991720253 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f87c006bde0 0x7f87c006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:35.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.719+0000 7f87d97fa640 1 -- 172.21.15.103:0/3991720253 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f87d008a4c0 con 0x7f87dc06c650 2024-09-10T08:30:35.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.719+0000 7f87e13d4640 1 --2- 172.21.15.103:0/3991720253 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f87c006bde0 0x7f87c006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:35.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.719+0000 7f87d97fa640 1 -- 172.21.15.103:0/3991720253 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c8017070 con 0x7f87dc0c0c80 2024-09-10T08:30:35.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.719+0000 7f87d97fa640 1 -- 172.21.15.103:0/3991720253 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f87c8005ce0 con 0x7f87dc0c0c80 2024-09-10T08:30:35.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.719+0000 7f87d97fa640 1 -- 172.21.15.103:0/3991720253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc0c0c80 msgr2=0x7f87dc151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:35.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.719+0000 7f87d97fa640 1 --2- 172.21.15.103:0/3991720253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc0c0c80 0x7f87dc151190 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f87dc0ab8b0 tx=0x7f87c800c8e0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.719+0000 7f87d97fa640 1 -- 172.21.15.103:0/3991720253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc0c0c80 msgr2=0x7f87dc151190 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:30:35.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.719+0000 7f87d97fa640 1 --2- 172.21.15.103:0/3991720253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc0c0c80 0x7f87dc151190 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.719+0000 7f87e13d4640 1 --2- 172.21.15.103:0/3991720253 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f87c006bde0 0x7f87c006e2a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f87d4034000 tx=0x7f87d402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:35.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.727+0000 7f87e2e37640 1 --2- 172.21.15.103:0/3991720253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc151d00 0x7f87dc14f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:35.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.727+0000 7f87e2e37640 1 -- 172.21.15.103:0/3991720253 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f87dc06c430 con 0x7f87dc151d00 2024-09-10T08:30:35.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.727+0000 7f87dbfff640 1 --2- 172.21.15.103:0/3991720253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc151d00 0x7f87dc14f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:35.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.727+0000 7f87dbfff640 1 -- 172.21.15.103:0/3991720253 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f87dc0caaf0 con 0x7f87dc151d00 2024-09-10T08:30:35.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.728+0000 7f87dbfff640 1 --2- 172.21.15.103:0/3991720253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc151d00 0x7f87dc14f550 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f87c80011e0 tx=0x7f87c8000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:35.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.728+0000 7f87d97fa640 1 -- 172.21.15.103:0/3991720253 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c8017070 con 0x7f87dc151d00 2024-09-10T08:30:35.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.728+0000 7f87d97fa640 1 -- 172.21.15.103:0/3991720253 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4708 (secure 0 0 0) 0x7f87c8018040 con 0x7f87dc151d00 2024-09-10T08:30:35.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.728+0000 7f87d97fa640 1 -- 172.21.15.103:0/3991720253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc151d00 msgr2=0x7f87dc14f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:35.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.728+0000 7f87d97fa640 1 --2- 172.21.15.103:0/3991720253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc151d00 0x7f87dc14f550 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f87c80011e0 tx=0x7f87c8000ed0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.728+0000 7f87d97fa640 1 -- 172.21.15.103:0/3991720253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc151d00 msgr2=0x7f87dc14f550 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:30:35.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.728+0000 7f87d97fa640 1 --2- 172.21.15.103:0/3991720253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc151d00 0x7f87dc14f550 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.729 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:30:35.730 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:30:35.730 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:30:35.730 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:30:35.730 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 14, 2024-09-10T08:30:35.730 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 41956, 2024-09-10T08:30:35.730 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:30:35.730 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:30:35.730 INFO:teuthology.orchestra.run.smithi103.stdout: 1 2024-09-10T08:30:35.730 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:35.730 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:30:35.730 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:30:35.730 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:30:35.730 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:30:35.731 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:35.731 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:35.731 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:35.731 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:35.731 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:35.731 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:35.731 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:35.731 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:35.731 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:35.731 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:35.731 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:35.731 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:35.731 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:30:35.731 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:30:35.732 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:35.732 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:35.732 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:35.732 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:35.732 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:35.732 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:35.732 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:35.732 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:35.732 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:35.732 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:35.732 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:35.732 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:35.732 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.733 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:30:35.733 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:30:35.733 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:30:35.733 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:30:35.733 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:30:35.733 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:30:35.733 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:30:35.733 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:30:35.733 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:30:35.733 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:30:35.733 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:30:35.733 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:30:35.733 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:30:35.734 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:30:35.734 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:30:35.734 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:30:35.734 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:30:35.734 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:35.734 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:35.734 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:35.734 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:35.734 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:35.734 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:35.734 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:35.734 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:35.734 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:35.734 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:35.735 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:35.735 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:35.735 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:30:35.735 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.735 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:30:35.735 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.735 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:30:35.735 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:30:35.735 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:35.735 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:35.735 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.735 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:35.735 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:30:35.736 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:35.736 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.736 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.736 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:35.736 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:30:35.736 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:35.736 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:35.736 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:35.736 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.736 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:30:35.736 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:30:35.736 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:35.737 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:35.737 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:35.737 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.737 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.737 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:30:35.737 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:30:35.737 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:35.737 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:35.737 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.737 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:35.737 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:30:35.737 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:35.737 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.737 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.738 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:35.738 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:30:35.738 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:35.738 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:35.738 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:35.738 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.738 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:30:35.738 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:30:35.738 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:35.738 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:35.738 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:35.738 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.738 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.739 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:30:35.739 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:30:35.739 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:35.739 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:35.739 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.739 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:35.739 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:30:35.739 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:35.739 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.739 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.739 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:35.739 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:30:35.739 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:35.740 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:35.740 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:35.740 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.740 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:30:35.740 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:30:35.740 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:35.740 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:35.740 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:35.740 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:35.740 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:35.740 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.740 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:30:35.740 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:30:35.741 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.741 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:35.741 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:35.741 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:30:35.741 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:35.741 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:35.741 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:30:35.741 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.741 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:35.741 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:35.741 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:30:35.741 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:35.741 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:35.742 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:30:35.742 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:35.742 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:35.742 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:35.742 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:30:35.742 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:35.742 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:35.742 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:35.742 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:30:35.742 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:30:35.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.728+0000 7f87e2e37640 1 -- 172.21.15.103:0/3991720253 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f87c006bde0 msgr2=0x7f87c006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:35.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.728+0000 7f87e2e37640 1 --2- 172.21.15.103:0/3991720253 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f87c006bde0 0x7f87c006e2a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f87d4034000 tx=0x7f87d402f000 comp rx=0 tx=0).stop 2024-09-10T08:30:35.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.728+0000 7f87e2e37640 1 -- 172.21.15.103:0/3991720253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87dc06c650 msgr2=0x7f87dc1517c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:35.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.728+0000 7f87e2e37640 1 --2- 172.21.15.103:0/3991720253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87dc06c650 0x7f87dc1517c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f87d000c410 tx=0x7f87d000c8d0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.728+0000 7f87e13d4640 1 -- 172.21.15.103:0/3991720253 reap_dead start 2024-09-10T08:30:35.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.729+0000 7f87e2e37640 1 -- 172.21.15.103:0/3991720253 shutdown_connections 2024-09-10T08:30:35.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.729+0000 7f87e2e37640 1 --2- 172.21.15.103:0/3991720253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87dc06c650 0x7f87dc1517c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:35.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.729+0000 7f87e2e37640 1 -- 172.21.15.103:0/3991720253 >> 172.21.15.103:0/3991720253 conn(0x7f87dc068030 msgr2=0x7f87dc0c9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:35.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.729+0000 7f87e2e37640 1 -- 172.21.15.103:0/3991720253 shutdown_connections 2024-09-10T08:30:35.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:35.729+0000 7f87e2e37640 1 -- 172.21.15.103:0/3991720253 wait complete. 2024-09-10T08:30:35.745 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:30:35.745 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-10T08:30:35.745 INFO:tasks.workunit.client.1.smithi154.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run autoconf 2024-09-10T08:30:36.045 INFO:tasks.workunit.client.1.smithi154.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-09-10T08:30:36.045 INFO:tasks.workunit.client.1.smithi154.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-09-10T08:30:36.045 INFO:tasks.workunit.client.1.smithi154.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-09-10T08:30:36.045 INFO:tasks.workunit.client.1.smithi154.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-09-10T08:30:36.174 INFO:tasks.workunit.client.1.smithi154.stdout:/bin/sh ./config.status --recheck 2024-09-10T08:30:36.182 INFO:tasks.workunit.client.0.smithi103.stderr:+ make 2024-09-10T08:30:36.238 INFO:tasks.workunit.client.1.smithi154.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-09-10T08:30:36.334 INFO:tasks.workunit.client.0.smithi103.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-09-10T08:30:36.342 INFO:tasks.workunit.client.0.smithi103.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-09-10T08:30:36.343 INFO:tasks.workunit.client.0.smithi103.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-09-10T08:30:36.343 INFO:tasks.workunit.client.0.smithi103.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-09-10T08:30:36.343 INFO:tasks.workunit.client.0.smithi103.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-09-10T08:30:36.343 INFO:tasks.workunit.client.0.smithi103.stderr: any GNU archive site. 2024-09-10T08:30:36.348 INFO:tasks.workunit.client.0.smithi103.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-09-10T08:30:36.352 INFO:tasks.workunit.client.0.smithi103.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-09-10T08:30:36.353 INFO:tasks.workunit.client.0.smithi103.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-09-10T08:30:36.354 INFO:tasks.workunit.client.0.smithi103.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-09-10T08:30:36.354 INFO:tasks.workunit.client.0.smithi103.stderr: You might want to install the `Automake' and `Perl' packages. 2024-09-10T08:30:36.354 INFO:tasks.workunit.client.0.smithi103.stderr: Grab them from any GNU archive site. 2024-09-10T08:30:36.380 INFO:tasks.workunit.client.1.smithi154.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-10T08:30:37.389 INFO:tasks.workunit.client.1.smithi154.stdout:checking whether build environment is sane... yes 2024-09-10T08:30:37.397 INFO:tasks.workunit.client.1.smithi154.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-10T08:30:37.398 INFO:tasks.workunit.client.1.smithi154.stdout:checking for gawk... gawk 2024-09-10T08:30:37.418 INFO:tasks.workunit.client.1.smithi154.stdout:checking whether make sets $(MAKE)... yes 2024-09-10T08:30:37.459 INFO:tasks.workunit.client.1.smithi154.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-10T08:30:37.459 INFO:tasks.workunit.client.1.smithi154.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-10T08:30:37.477 INFO:tasks.workunit.client.1.smithi154.stdout:checking for style of include used by make... GNU 2024-09-10T08:30:37.482 INFO:tasks.workunit.client.1.smithi154.stdout:checking for gcc... gcc 2024-09-10T08:30:37.594 INFO:tasks.workunit.client.1.smithi154.stdout:checking whether the C compiler works... yes 2024-09-10T08:30:37.594 INFO:tasks.workunit.client.1.smithi154.stdout:checking for C compiler default output file name... a.out 2024-09-10T08:30:37.646 INFO:tasks.workunit.client.1.smithi154.stdout:checking for suffix of executables... 2024-09-10T08:30:37.698 INFO:tasks.workunit.client.1.smithi154.stdout:checking whether we are cross compiling... no 2024-09-10T08:30:37.742 INFO:tasks.workunit.client.1.smithi154.stdout:checking for suffix of object files... o 2024-09-10T08:30:37.772 INFO:tasks.workunit.client.1.smithi154.stdout:checking whether we are using the GNU C compiler... yes 2024-09-10T08:30:37.803 INFO:tasks.workunit.client.1.smithi154.stdout:checking whether gcc accepts -g... yes 2024-09-10T08:30:37.852 INFO:tasks.workunit.client.1.smithi154.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-10T08:30:37.986 INFO:tasks.workunit.client.1.smithi154.stdout:checking dependency style of gcc... gcc3 2024-09-10T08:30:38.055 INFO:tasks.workunit.client.1.smithi154.stdout:checking how to run the C preprocessor... gcc -E 2024-09-10T08:30:38.115 INFO:tasks.workunit.client.1.smithi154.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-10T08:30:38.117 INFO:tasks.workunit.client.1.smithi154.stdout:checking for egrep... /usr/bin/grep -E 2024-09-10T08:30:38.275 INFO:tasks.workunit.client.1.smithi154.stdout:checking for ANSI C header files... yes 2024-09-10T08:30:38.318 INFO:tasks.workunit.client.1.smithi154.stdout:checking for sys/types.h... yes 2024-09-10T08:30:38.380 INFO:tasks.workunit.client.1.smithi154.stdout:checking for sys/stat.h... yes 2024-09-10T08:30:38.429 INFO:tasks.workunit.client.1.smithi154.stdout:checking for stdlib.h... yes 2024-09-10T08:30:38.480 INFO:tasks.workunit.client.1.smithi154.stdout:checking for string.h... yes 2024-09-10T08:30:38.518 INFO:tasks.workunit.client.0.smithi103.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-09-10T08:30:38.534 INFO:tasks.workunit.client.1.smithi154.stdout:checking for memory.h... yes 2024-09-10T08:30:38.588 INFO:tasks.workunit.client.1.smithi154.stdout:checking for strings.h... yes 2024-09-10T08:30:38.644 INFO:tasks.workunit.client.1.smithi154.stdout:checking for inttypes.h... yes 2024-09-10T08:30:38.697 INFO:tasks.workunit.client.1.smithi154.stdout:checking for stdint.h... yes 2024-09-10T08:30:38.753 INFO:tasks.workunit.client.1.smithi154.stdout:checking for unistd.h... yes 2024-09-10T08:30:38.811 INFO:tasks.workunit.client.1.smithi154.stdout:checking minix/config.h usability... no 2024-09-10T08:30:38.849 INFO:tasks.workunit.client.1.smithi154.stdout:checking minix/config.h presence... no 2024-09-10T08:30:38.849 INFO:tasks.workunit.client.1.smithi154.stdout:checking for minix/config.h... no 2024-09-10T08:30:38.890 INFO:tasks.workunit.client.0.smithi103.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-09-10T08:30:38.891 INFO:tasks.workunit.client.0.smithi103.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-09-10T08:30:38.891 INFO:tasks.workunit.client.0.smithi103.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-09-10T08:30:38.891 INFO:tasks.workunit.client.0.smithi103.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-09-10T08:30:38.892 INFO:tasks.workunit.client.1.smithi154.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-09-10T08:30:38.905 INFO:tasks.workunit.client.1.smithi154.stdout:checking for gcc... (cached) gcc 2024-09-10T08:30:39.034 INFO:tasks.workunit.client.0.smithi103.stdout:/bin/sh ./config.status --recheck 2024-09-10T08:30:39.480 INFO:tasks.workunit.client.1.smithi154.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-10T08:30:39.480 INFO:tasks.workunit.client.1.smithi154.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-10T08:30:39.480 INFO:tasks.workunit.client.1.smithi154.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-10T08:30:39.481 INFO:tasks.workunit.client.1.smithi154.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-10T08:30:39.545 INFO:tasks.workunit.client.1.smithi154.stdout:checking for main in -lm... yes 2024-09-10T08:30:39.610 INFO:tasks.workunit.client.1.smithi154.stdout:checking for main in -lpthread... yes 2024-09-10T08:30:39.614 INFO:tasks.workunit.client.1.smithi154.stdout:checking for ANSI C header files... (cached) yes 2024-09-10T08:30:39.707 INFO:tasks.workunit.client.0.smithi103.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-09-10T08:30:39.844 INFO:tasks.workunit.client.0.smithi103.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-10T08:30:40.607 INFO:tasks.workunit.client.1.smithi154.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-10T08:30:40.662 INFO:tasks.workunit.client.1.smithi154.stdout:checking pthread.h usability... yes 2024-09-10T08:30:40.688 INFO:tasks.workunit.client.1.smithi154.stdout:checking pthread.h presence... yes 2024-09-10T08:30:40.688 INFO:tasks.workunit.client.1.smithi154.stdout:checking for pthread.h... yes 2024-09-10T08:30:40.753 INFO:tasks.workunit.client.1.smithi154.stdout:checking fcntl.h usability... yes 2024-09-10T08:30:40.775 INFO:tasks.workunit.client.1.smithi154.stdout:checking fcntl.h presence... yes 2024-09-10T08:30:40.775 INFO:tasks.workunit.client.1.smithi154.stdout:checking for fcntl.h... yes 2024-09-10T08:30:40.834 INFO:tasks.workunit.client.1.smithi154.stdout:checking limits.h usability... yes 2024-09-10T08:30:40.852 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether build environment is sane... yes 2024-09-10T08:30:40.856 INFO:tasks.workunit.client.1.smithi154.stdout:checking limits.h presence... yes 2024-09-10T08:30:40.856 INFO:tasks.workunit.client.1.smithi154.stdout:checking for limits.h... yes 2024-09-10T08:30:40.861 INFO:tasks.workunit.client.0.smithi103.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-10T08:30:40.862 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gawk... gawk 2024-09-10T08:30:40.879 INFO:tasks.workunit.client.1.smithi154.stdout:checking for stdint.h... (cached) yes 2024-09-10T08:30:40.880 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether make sets $(MAKE)... yes 2024-09-10T08:30:40.921 INFO:tasks.workunit.client.0.smithi103.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-10T08:30:40.921 INFO:tasks.workunit.client.0.smithi103.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-10T08:30:40.930 INFO:tasks.workunit.client.1.smithi154.stdout:checking sys/time.h usability... yes 2024-09-10T08:30:40.940 INFO:tasks.workunit.client.0.smithi103.stdout:checking for style of include used by make... GNU 2024-09-10T08:30:40.945 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gcc... gcc 2024-09-10T08:30:40.951 INFO:tasks.workunit.client.1.smithi154.stdout:checking sys/time.h presence... yes 2024-09-10T08:30:40.951 INFO:tasks.workunit.client.1.smithi154.stdout:checking for sys/time.h... yes 2024-09-10T08:30:40.972 INFO:tasks.workunit.client.1.smithi154.stdout:checking for unistd.h... (cached) yes 2024-09-10T08:30:41.066 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether the C compiler works... yes 2024-09-10T08:30:41.066 INFO:tasks.workunit.client.0.smithi103.stdout:checking for C compiler default output file name... a.out 2024-09-10T08:30:41.066 INFO:tasks.workunit.client.1.smithi154.stdout:checking sys/vfs.h usability... yes 2024-09-10T08:30:41.066 INFO:tasks.workunit.client.1.smithi154.stdout:checking sys/vfs.h presence... yes 2024-09-10T08:30:41.066 INFO:tasks.workunit.client.1.smithi154.stdout:checking for sys/vfs.h... yes 2024-09-10T08:30:41.117 INFO:tasks.workunit.client.1.smithi154.stdout:checking sys/limits.h usability... no 2024-09-10T08:30:41.118 INFO:tasks.workunit.client.0.smithi103.stdout:checking for suffix of executables... 2024-09-10T08:30:41.155 INFO:tasks.workunit.client.1.smithi154.stdout:checking sys/limits.h presence... no 2024-09-10T08:30:41.155 INFO:tasks.workunit.client.1.smithi154.stdout:checking for sys/limits.h... no 2024-09-10T08:30:41.174 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether we are cross compiling... no 2024-09-10T08:30:41.188 INFO:tasks.workunit.client.1.smithi154.stdout:checking for an ANSI C-conforming const... yes 2024-09-10T08:30:41.223 INFO:tasks.workunit.client.1.smithi154.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-10T08:30:41.300 INFO:tasks.workunit.client.1.smithi154.stdout:checking for system... yes 2024-09-10T08:30:41.304 INFO:tasks.workunit.client.0.smithi103.stdout:checking for suffix of object files... o 2024-09-10T08:30:41.334 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether we are using the GNU C compiler... yes 2024-09-10T08:30:41.365 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether gcc accepts -g... yes 2024-09-10T08:30:41.377 INFO:tasks.workunit.client.1.smithi154.stdout:checking for gettimeofday... yes 2024-09-10T08:30:41.418 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-10T08:30:41.556 INFO:tasks.workunit.client.0.smithi103.stdout:checking dependency style of gcc... gcc3 2024-09-10T08:30:41.612 INFO:tasks.workunit.client.0.smithi103.stdout:checking how to run the C preprocessor... gcc -E 2024-09-10T08:30:41.677 INFO:tasks.workunit.client.0.smithi103.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-10T08:30:41.679 INFO:tasks.workunit.client.0.smithi103.stdout:checking for egrep... /usr/bin/grep -E 2024-09-10T08:30:42.240 INFO:tasks.workunit.client.1.smithi154.stdout:checking for mkdir... yes 2024-09-10T08:30:42.321 INFO:tasks.workunit.client.1.smithi154.stdout:checking for strerror... yes 2024-09-10T08:30:42.488 INFO:tasks.workunit.client.0.smithi103.stdout:checking for ANSI C header files... yes 2024-09-10T08:30:42.536 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/types.h... yes 2024-09-10T08:30:42.592 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/stat.h... yes 2024-09-10T08:30:42.651 INFO:tasks.workunit.client.0.smithi103.stdout:checking for stdlib.h... yes 2024-09-10T08:30:42.706 INFO:tasks.workunit.client.0.smithi103.stdout:checking for string.h... yes 2024-09-10T08:30:42.771 INFO:tasks.workunit.client.0.smithi103.stdout:checking for memory.h... yes 2024-09-10T08:30:42.885 INFO:tasks.workunit.client.0.smithi103.stdout:checking for strings.h... yes 2024-09-10T08:30:43.017 INFO:tasks.workunit.client.0.smithi103.stdout:checking for inttypes.h... yes 2024-09-10T08:30:43.102 INFO:tasks.workunit.client.0.smithi103.stdout:checking for stdint.h... yes 2024-09-10T08:30:43.197 INFO:tasks.workunit.client.0.smithi103.stdout:checking for unistd.h... yes 2024-09-10T08:30:43.281 INFO:tasks.workunit.client.0.smithi103.stdout:checking minix/config.h usability... no 2024-09-10T08:30:43.318 INFO:tasks.workunit.client.0.smithi103.stdout:checking minix/config.h presence... no 2024-09-10T08:30:43.318 INFO:tasks.workunit.client.0.smithi103.stdout:checking for minix/config.h... no 2024-09-10T08:30:43.334 INFO:tasks.workunit.client.1.smithi154.stdout:checking for open64... yes 2024-09-10T08:30:43.381 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-09-10T08:30:43.391 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gcc... (cached) gcc 2024-09-10T08:30:43.439 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-10T08:30:43.439 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-10T08:30:43.439 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-10T08:30:43.439 INFO:tasks.workunit.client.0.smithi103.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-10T08:30:43.513 INFO:tasks.workunit.client.0.smithi103.stdout:checking for main in -lm... yes 2024-09-10T08:30:43.535 INFO:tasks.workunit.client.1.smithi154.stdout:checking for stat64... yes 2024-09-10T08:30:43.607 INFO:tasks.workunit.client.0.smithi103.stdout:checking for main in -lpthread... yes 2024-09-10T08:30:43.612 INFO:tasks.workunit.client.0.smithi103.stdout:checking for ANSI C header files... (cached) yes 2024-09-10T08:30:43.615 INFO:tasks.workunit.client.1.smithi154.stdout:checking for fseeko64... yes 2024-09-10T08:30:43.673 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-10T08:30:43.700 INFO:tasks.workunit.client.1.smithi154.stdout:checking for lrand48_r... yes 2024-09-10T08:30:43.736 INFO:tasks.workunit.client.0.smithi103.stdout:checking pthread.h usability... yes 2024-09-10T08:30:43.759 INFO:tasks.workunit.client.0.smithi103.stdout:checking pthread.h presence... yes 2024-09-10T08:30:43.760 INFO:tasks.workunit.client.0.smithi103.stdout:checking for pthread.h... yes 2024-09-10T08:30:43.780 INFO:tasks.workunit.client.1.smithi154.stdout:checking for srand48_r... yes 2024-09-10T08:30:43.808 INFO:tasks.workunit.client.1.smithi154.stdout:configure: creating ./config.status 2024-09-10T08:30:43.825 INFO:tasks.workunit.client.0.smithi103.stdout:checking fcntl.h usability... yes 2024-09-10T08:30:43.849 INFO:tasks.workunit.client.0.smithi103.stdout:checking fcntl.h presence... yes 2024-09-10T08:30:43.849 INFO:tasks.workunit.client.0.smithi103.stdout:checking for fcntl.h... yes 2024-09-10T08:30:43.932 INFO:tasks.workunit.client.0.smithi103.stdout:checking limits.h usability... yes 2024-09-10T08:30:43.952 INFO:tasks.workunit.client.0.smithi103.stdout:checking limits.h presence... yes 2024-09-10T08:30:43.952 INFO:tasks.workunit.client.0.smithi103.stdout:checking for limits.h... yes 2024-09-10T08:30:43.972 INFO:tasks.workunit.client.0.smithi103.stdout:checking for stdint.h... (cached) yes 2024-09-10T08:30:44.257 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/time.h usability... yes 2024-09-10T08:30:44.270 INFO:tasks.workunit.client.1.smithi154.stdout: /bin/sh ./config.status 2024-09-10T08:30:44.278 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/time.h presence... yes 2024-09-10T08:30:44.278 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/time.h... yes 2024-09-10T08:30:44.299 INFO:tasks.workunit.client.0.smithi103.stdout:checking for unistd.h... (cached) yes 2024-09-10T08:30:44.332 INFO:tasks.workunit.client.1.smithi154.stdout:config.status: creating Makefile 2024-09-10T08:30:44.349 INFO:tasks.workunit.client.1.smithi154.stdout:config.status: creating config.h 2024-09-10T08:30:44.352 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/vfs.h usability... yes 2024-09-10T08:30:44.374 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/vfs.h presence... yes 2024-09-10T08:30:44.374 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/vfs.h... yes 2024-09-10T08:30:44.376 INFO:tasks.workunit.client.1.smithi154.stdout:config.status: executing depfiles commands 2024-09-10T08:30:44.395 INFO:tasks.workunit.client.1.smithi154.stdout:config.status: executing default commands 2024-09-10T08:30:44.443 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/limits.h usability... no 2024-09-10T08:30:44.481 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/limits.h presence... no 2024-09-10T08:30:44.481 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/limits.h... no 2024-09-10T08:30:44.513 INFO:tasks.workunit.client.0.smithi103.stdout:checking for an ANSI C-conforming const... yes 2024-09-10T08:30:44.547 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-10T08:30:44.625 INFO:tasks.workunit.client.0.smithi103.stdout:checking for system... yes 2024-09-10T08:30:44.685 INFO:tasks.workunit.client.1.smithi154.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run autoheader 2024-09-10T08:30:44.704 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gettimeofday... yes 2024-09-10T08:30:44.873 INFO:tasks.workunit.client.1.smithi154.stdout:rm -f stamp-h1 2024-09-10T08:30:44.876 INFO:tasks.workunit.client.1.smithi154.stdout:touch config.h.in 2024-09-10T08:30:44.878 INFO:tasks.workunit.client.1.smithi154.stdout:cd . && /bin/sh ./config.status config.h 2024-09-10T08:30:44.928 INFO:tasks.workunit.client.1.smithi154.stdout:config.status: creating config.h 2024-09-10T08:30:44.963 INFO:tasks.workunit.client.1.smithi154.stdout:make all-am 2024-09-10T08:30:44.986 INFO:tasks.workunit.client.1.smithi154.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb' 2024-09-10T08:30:44.986 INFO:tasks.workunit.client.1.smithi154.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-09-10T08:30:45.349 INFO:tasks.workunit.client.1.smithi154.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-09-10T08:30:45.354 INFO:tasks.workunit.client.1.smithi154.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-09-10T08:30:45.500 INFO:tasks.workunit.client.1.smithi154.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-09-10T08:30:45.505 INFO:tasks.workunit.client.1.smithi154.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-09-10T08:30:45.506 INFO:tasks.workunit.client.0.smithi103.stdout:checking for mkdir... yes 2024-09-10T08:30:45.581 INFO:tasks.workunit.client.0.smithi103.stdout:checking for strerror... yes 2024-09-10T08:30:45.625 INFO:tasks.workunit.client.1.smithi154.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-09-10T08:30:45.632 INFO:tasks.workunit.client.1.smithi154.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-09-10T08:30:45.666 INFO:tasks.workunit.client.0.smithi103.stdout:checking for open64... yes 2024-09-10T08:30:45.744 INFO:tasks.workunit.client.0.smithi103.stdout:checking for stat64... yes 2024-09-10T08:30:45.747 INFO:tasks.workunit.client.1.smithi154.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-09-10T08:30:45.751 INFO:tasks.workunit.client.1.smithi154.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-09-10T08:30:45.822 INFO:tasks.workunit.client.0.smithi103.stdout:checking for fseeko64... yes 2024-09-10T08:30:45.897 INFO:tasks.workunit.client.0.smithi103.stdout:checking for lrand48_r... yes 2024-09-10T08:30:45.923 INFO:tasks.workunit.client.1.smithi154.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-09-10T08:30:45.928 INFO:tasks.workunit.client.1.smithi154.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-09-10T08:30:45.974 INFO:tasks.workunit.client.0.smithi103.stdout:checking for srand48_r... yes 2024-09-10T08:30:45.997 INFO:tasks.workunit.client.1.smithi154.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-09-10T08:30:46.003 INFO:tasks.workunit.client.0.smithi103.stdout:configure: creating ./config.status 2024-09-10T08:30:46.003 INFO:tasks.workunit.client.1.smithi154.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-09-10T08:30:46.056 INFO:tasks.workunit.client.1.smithi154.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-09-10T08:30:46.061 INFO:tasks.workunit.client.1.smithi154.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-09-10T08:30:46.260 INFO:tasks.workunit.client.1.smithi154.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-09-10T08:30:46.265 INFO:tasks.workunit.client.1.smithi154.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-09-10T08:30:46.429 INFO:tasks.workunit.client.0.smithi103.stdout: /bin/sh ./config.status 2024-09-10T08:30:46.476 INFO:tasks.workunit.client.1.smithi154.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-09-10T08:30:46.482 INFO:tasks.workunit.client.1.smithi154.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-09-10T08:30:46.489 INFO:tasks.workunit.client.0.smithi103.stdout:config.status: creating Makefile 2024-09-10T08:30:46.505 INFO:tasks.workunit.client.0.smithi103.stdout:config.status: creating config.h 2024-09-10T08:30:46.533 INFO:tasks.workunit.client.0.smithi103.stdout:config.status: executing depfiles commands 2024-09-10T08:30:46.551 INFO:tasks.workunit.client.0.smithi103.stdout:config.status: executing default commands 2024-09-10T08:30:46.635 INFO:tasks.workunit.client.1.smithi154.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-09-10T08:30:46.641 INFO:tasks.workunit.client.1.smithi154.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-09-10T08:30:46.812 INFO:tasks.workunit.client.1.smithi154.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-09-10T08:30:46.817 INFO:tasks.workunit.client.1.smithi154.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-09-10T08:30:46.899 INFO:tasks.workunit.client.1.smithi154.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-09-10T08:30:46.904 INFO:tasks.workunit.client.1.smithi154.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-09-10T08:30:46.989 INFO:tasks.workunit.client.0.smithi103.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-09-10T08:30:46.997 INFO:tasks.workunit.client.1.smithi154.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-09-10T08:30:47.001 INFO:tasks.workunit.client.1.smithi154.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-09-10T08:30:47.128 INFO:tasks.workunit.client.1.smithi154.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-09-10T08:30:47.133 INFO:tasks.workunit.client.1.smithi154.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-09-10T08:30:47.156 INFO:tasks.workunit.client.0.smithi103.stdout:rm -f stamp-h1 2024-09-10T08:30:47.158 INFO:tasks.workunit.client.0.smithi103.stdout:touch config.h.in 2024-09-10T08:30:47.161 INFO:tasks.workunit.client.0.smithi103.stdout:cd . && /bin/sh ./config.status config.h 2024-09-10T08:30:47.175 INFO:tasks.workunit.client.1.smithi154.stderr:In file included from parser.h:22, 2024-09-10T08:30:47.175 INFO:tasks.workunit.client.1.smithi154.stderr: from parser.c:25: 2024-09-10T08:30:47.175 INFO:tasks.workunit.client.1.smithi154.stderr:parser.c: In function ‘init_filesys’: 2024-09-10T08:30:47.177 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T08:30:47.177 INFO:tasks.workunit.client.1.smithi154.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T08:30:47.177 INFO:tasks.workunit.client.1.smithi154.stderr: | ^ 2024-09-10T08:30:47.177 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T08:30:47.177 INFO:tasks.workunit.client.1.smithi154.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T08:30:47.177 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~ 2024-09-10T08:30:47.177 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T08:30:47.177 INFO:tasks.workunit.client.1.smithi154.stderr: 36 | container_of(ptr, type, member) 2024-09-10T08:30:47.178 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~~~ 2024-09-10T08:30:47.178 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-10T08:30:47.178 INFO:tasks.workunit.client.1.smithi154.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-10T08:30:47.178 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~ 2024-09-10T08:30:47.178 INFO:tasks.workunit.client.1.smithi154.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T08:30:47.178 INFO:tasks.workunit.client.1.smithi154.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-10T08:30:47.178 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T08:30:47.178 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T08:30:47.178 INFO:tasks.workunit.client.1.smithi154.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T08:30:47.178 INFO:tasks.workunit.client.1.smithi154.stderr: | ^ 2024-09-10T08:30:47.178 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T08:30:47.178 INFO:tasks.workunit.client.1.smithi154.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T08:30:47.179 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~ 2024-09-10T08:30:47.179 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T08:30:47.179 INFO:tasks.workunit.client.1.smithi154.stderr: 36 | container_of(ptr, type, member) 2024-09-10T08:30:47.179 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~~~ 2024-09-10T08:30:47.179 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-10T08:30:47.179 INFO:tasks.workunit.client.1.smithi154.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-10T08:30:47.179 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~ 2024-09-10T08:30:47.179 INFO:tasks.workunit.client.1.smithi154.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T08:30:47.179 INFO:tasks.workunit.client.1.smithi154.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-10T08:30:47.179 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T08:30:47.179 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T08:30:47.179 INFO:tasks.workunit.client.1.smithi154.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T08:30:47.179 INFO:tasks.workunit.client.1.smithi154.stderr: | ^ 2024-09-10T08:30:47.179 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T08:30:47.180 INFO:tasks.workunit.client.1.smithi154.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T08:30:47.180 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~ 2024-09-10T08:30:47.180 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T08:30:47.180 INFO:tasks.workunit.client.1.smithi154.stderr: 36 | container_of(ptr, type, member) 2024-09-10T08:30:47.180 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~~~ 2024-09-10T08:30:47.180 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-10T08:30:47.180 INFO:tasks.workunit.client.1.smithi154.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-10T08:30:47.180 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~ 2024-09-10T08:30:47.180 INFO:tasks.workunit.client.1.smithi154.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T08:30:47.180 INFO:tasks.workunit.client.1.smithi154.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-10T08:30:47.180 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T08:30:47.180 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T08:30:47.181 INFO:tasks.workunit.client.1.smithi154.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T08:30:47.181 INFO:tasks.workunit.client.1.smithi154.stderr: | ^ 2024-09-10T08:30:47.181 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T08:30:47.181 INFO:tasks.workunit.client.1.smithi154.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T08:30:47.181 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~ 2024-09-10T08:30:47.181 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T08:30:47.181 INFO:tasks.workunit.client.1.smithi154.stderr: 36 | container_of(ptr, type, member) 2024-09-10T08:30:47.181 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~~~ 2024-09-10T08:30:47.181 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-10T08:30:47.181 INFO:tasks.workunit.client.1.smithi154.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-10T08:30:47.181 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~ 2024-09-10T08:30:47.181 INFO:tasks.workunit.client.1.smithi154.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T08:30:47.181 INFO:tasks.workunit.client.1.smithi154.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-10T08:30:47.182 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T08:30:47.182 INFO:tasks.workunit.client.1.smithi154.stderr:parser.c: In function ‘init_tg_stats’: 2024-09-10T08:30:47.182 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T08:30:47.182 INFO:tasks.workunit.client.1.smithi154.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T08:30:47.182 INFO:tasks.workunit.client.1.smithi154.stderr: | ^ 2024-09-10T08:30:47.182 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T08:30:47.182 INFO:tasks.workunit.client.1.smithi154.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T08:30:47.182 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~ 2024-09-10T08:30:47.182 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T08:30:47.182 INFO:tasks.workunit.client.1.smithi154.stderr: 36 | container_of(ptr, type, member) 2024-09-10T08:30:47.182 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~~~ 2024-09-10T08:30:47.182 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-10T08:30:47.182 INFO:tasks.workunit.client.1.smithi154.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-10T08:30:47.182 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~ 2024-09-10T08:30:47.183 INFO:tasks.workunit.client.1.smithi154.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T08:30:47.183 INFO:tasks.workunit.client.1.smithi154.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-10T08:30:47.183 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T08:30:47.183 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T08:30:47.183 INFO:tasks.workunit.client.1.smithi154.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T08:30:47.183 INFO:tasks.workunit.client.1.smithi154.stderr: | ^ 2024-09-10T08:30:47.183 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T08:30:47.183 INFO:tasks.workunit.client.1.smithi154.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T08:30:47.183 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~ 2024-09-10T08:30:47.183 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T08:30:47.183 INFO:tasks.workunit.client.1.smithi154.stderr: 36 | container_of(ptr, type, member) 2024-09-10T08:30:47.183 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~~~ 2024-09-10T08:30:47.183 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-10T08:30:47.184 INFO:tasks.workunit.client.1.smithi154.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-10T08:30:47.184 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~ 2024-09-10T08:30:47.184 INFO:tasks.workunit.client.1.smithi154.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T08:30:47.184 INFO:tasks.workunit.client.1.smithi154.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-10T08:30:47.184 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T08:30:47.184 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T08:30:47.184 INFO:tasks.workunit.client.1.smithi154.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T08:30:47.184 INFO:tasks.workunit.client.1.smithi154.stderr: | ^ 2024-09-10T08:30:47.184 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T08:30:47.184 INFO:tasks.workunit.client.1.smithi154.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T08:30:47.184 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~ 2024-09-10T08:30:47.184 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T08:30:47.184 INFO:tasks.workunit.client.1.smithi154.stderr: 36 | container_of(ptr, type, member) 2024-09-10T08:30:47.184 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~~~ 2024-09-10T08:30:47.185 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-10T08:30:47.185 INFO:tasks.workunit.client.1.smithi154.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-10T08:30:47.185 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~ 2024-09-10T08:30:47.185 INFO:tasks.workunit.client.1.smithi154.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T08:30:47.185 INFO:tasks.workunit.client.1.smithi154.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-10T08:30:47.185 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T08:30:47.185 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T08:30:47.185 INFO:tasks.workunit.client.1.smithi154.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T08:30:47.185 INFO:tasks.workunit.client.1.smithi154.stderr: | ^ 2024-09-10T08:30:47.185 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T08:30:47.185 INFO:tasks.workunit.client.1.smithi154.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T08:30:47.185 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~ 2024-09-10T08:30:47.185 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T08:30:47.186 INFO:tasks.workunit.client.1.smithi154.stderr: 36 | container_of(ptr, type, member) 2024-09-10T08:30:47.186 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~~~ 2024-09-10T08:30:47.186 INFO:tasks.workunit.client.1.smithi154.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-10T08:30:47.186 INFO:tasks.workunit.client.1.smithi154.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-10T08:30:47.186 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~ 2024-09-10T08:30:47.186 INFO:tasks.workunit.client.1.smithi154.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T08:30:47.186 INFO:tasks.workunit.client.1.smithi154.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-10T08:30:47.186 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T08:30:47.211 INFO:tasks.workunit.client.0.smithi103.stdout:config.status: creating config.h 2024-09-10T08:30:47.223 INFO:tasks.workunit.client.1.smithi154.stderr:parser.c: In function ‘get_optstr’: 2024-09-10T08:30:47.223 INFO:tasks.workunit.client.1.smithi154.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-09-10T08:30:47.224 INFO:tasks.workunit.client.1.smithi154.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-09-10T08:30:47.224 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T08:30:47.224 INFO:tasks.workunit.client.1.smithi154.stderr:parser.c:200:14: note: source object declared here 2024-09-10T08:30:47.224 INFO:tasks.workunit.client.1.smithi154.stderr: 200 | char temp[BUFSIZE]; 2024-09-10T08:30:47.224 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~ 2024-09-10T08:30:47.230 INFO:tasks.workunit.client.1.smithi154.stderr:parser.c: In function ‘size64_convert’: 2024-09-10T08:30:47.230 INFO:tasks.workunit.client.1.smithi154.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-09-10T08:30:47.231 INFO:tasks.workunit.client.1.smithi154.stderr: 119 | memcpy(unit, "\0", 3); 2024-09-10T08:30:47.231 INFO:tasks.workunit.client.1.smithi154.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-09-10T08:30:47.244 INFO:tasks.workunit.client.0.smithi103.stdout:make all-am 2024-09-10T08:30:47.268 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-10T08:30:47.269 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-09-10T08:30:47.471 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-09-10T08:30:47.476 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-09-10T08:30:47.517 INFO:tasks.workunit.client.1.smithi154.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-09-10T08:30:47.522 INFO:tasks.workunit.client.1.smithi154.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-09-10T08:30:47.577 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-09-10T08:30:47.582 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-09-10T08:30:47.598 INFO:tasks.workunit.client.1.smithi154.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-09-10T08:30:47.602 INFO:tasks.workunit.client.1.smithi154.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-09-10T08:30:47.698 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-09-10T08:30:47.704 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-09-10T08:30:47.711 INFO:tasks.workunit.client.1.smithi154.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-09-10T08:30:47.716 INFO:tasks.workunit.client.1.smithi154.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-09-10T08:30:47.754 INFO:tasks.workunit.client.1.smithi154.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-09-10T08:30:47.760 INFO:tasks.workunit.client.1.smithi154.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-09-10T08:30:47.854 INFO:tasks.workunit.client.1.smithi154.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb' 2024-09-10T08:30:47.855 INFO:tasks.workunit.client.1.smithi154.stderr:+ cd .. 2024-09-10T08:30:47.856 INFO:tasks.workunit.client.1.smithi154.stderr:+ mkdir tmp 2024-09-10T08:30:47.858 INFO:tasks.workunit.client.1.smithi154.stderr:+ cd tmp 2024-09-10T08:30:47.859 INFO:tasks.workunit.client.1.smithi154.stderr:+ for f in $mydir/*.ffsb 2024-09-10T08:30:47.859 INFO:tasks.workunit.client.1.smithi154.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/random_write.32.ffsb 2024-09-10T08:30:47.860 INFO:tasks.workunit.client.1.smithi154.stdout:FFSB version 6.0-RC2 started 2024-09-10T08:30:47.860 INFO:tasks.workunit.client.1.smithi154.stdout: 2024-09-10T08:30:47.863 INFO:tasks.workunit.client.1.smithi154.stdout:benchmark time = 300 2024-09-10T08:30:47.863 INFO:tasks.workunit.client.1.smithi154.stdout:ThreadGroup 0 2024-09-10T08:30:47.863 INFO:tasks.workunit.client.1.smithi154.stdout:================ 2024-09-10T08:30:47.863 INFO:tasks.workunit.client.1.smithi154.stdout: num_threads = 32 2024-09-10T08:30:47.864 INFO:tasks.workunit.client.1.smithi154.stdout: 2024-09-10T08:30:47.864 INFO:tasks.workunit.client.1.smithi154.stdout: read_random = off 2024-09-10T08:30:47.864 INFO:tasks.workunit.client.1.smithi154.stdout: read_size = 0 (0B) 2024-09-10T08:30:47.864 INFO:tasks.workunit.client.1.smithi154.stdout: read_blocksize = 0 (0B) 2024-09-10T08:30:47.864 INFO:tasks.workunit.client.1.smithi154.stdout: read_skip = off 2024-09-10T08:30:47.864 INFO:tasks.workunit.client.1.smithi154.stdout: read_skipsize = 0 (0B) 2024-09-10T08:30:47.864 INFO:tasks.workunit.client.1.smithi154.stdout: 2024-09-10T08:30:47.864 INFO:tasks.workunit.client.1.smithi154.stdout: write_random = on 2024-09-10T08:30:47.864 INFO:tasks.workunit.client.1.smithi154.stdout: write_size = 5242880 (5MB) 2024-09-10T08:30:47.864 INFO:tasks.workunit.client.1.smithi154.stdout: fsync_file = 0 2024-09-10T08:30:47.864 INFO:tasks.workunit.client.1.smithi154.stdout: write_blocksize = 4096 (4KB) 2024-09-10T08:30:47.864 INFO:tasks.workunit.client.1.smithi154.stdout: wait time = 0 2024-09-10T08:30:47.864 INFO:tasks.workunit.client.1.smithi154.stdout: 2024-09-10T08:30:47.864 INFO:tasks.workunit.client.1.smithi154.stdout: op weights 2024-09-10T08:30:47.865 INFO:tasks.workunit.client.1.smithi154.stdout: read = 0 (0.00%) 2024-09-10T08:30:47.865 INFO:tasks.workunit.client.1.smithi154.stdout: readall = 0 (0.00%) 2024-09-10T08:30:47.865 INFO:tasks.workunit.client.1.smithi154.stdout: write = 1 (100.00%) 2024-09-10T08:30:47.865 INFO:tasks.workunit.client.1.smithi154.stdout: create = 0 (0.00%) 2024-09-10T08:30:47.865 INFO:tasks.workunit.client.1.smithi154.stdout: append = 0 (0.00%) 2024-09-10T08:30:47.865 INFO:tasks.workunit.client.1.smithi154.stdout: delete = 0 (0.00%) 2024-09-10T08:30:47.865 INFO:tasks.workunit.client.1.smithi154.stdout: metaop = 0 (0.00%) 2024-09-10T08:30:47.865 INFO:tasks.workunit.client.1.smithi154.stdout: createdir = 0 (0.00%) 2024-09-10T08:30:47.865 INFO:tasks.workunit.client.1.smithi154.stdout: stat = 0 (0.00%) 2024-09-10T08:30:47.865 INFO:tasks.workunit.client.1.smithi154.stdout: writeall = 0 (0.00%) 2024-09-10T08:30:47.865 INFO:tasks.workunit.client.1.smithi154.stdout: writeall_fsync = 0 (0.00%) 2024-09-10T08:30:47.865 INFO:tasks.workunit.client.1.smithi154.stdout: open_close = 0 (0.00%) 2024-09-10T08:30:47.865 INFO:tasks.workunit.client.1.smithi154.stdout: write_fsync = 0 (0.00%) 2024-09-10T08:30:47.865 INFO:tasks.workunit.client.1.smithi154.stdout: create_fsync = 0 (0.00%) 2024-09-10T08:30:47.866 INFO:tasks.workunit.client.1.smithi154.stdout: append_fsync = 0 (0.00%) 2024-09-10T08:30:47.866 INFO:tasks.workunit.client.1.smithi154.stdout: 2024-09-10T08:30:47.866 INFO:tasks.workunit.client.1.smithi154.stdout:FileSystem . 2024-09-10T08:30:47.866 INFO:tasks.workunit.client.1.smithi154.stdout:========== 2024-09-10T08:30:47.866 INFO:tasks.workunit.client.1.smithi154.stdout: num_dirs = 0 2024-09-10T08:30:47.866 INFO:tasks.workunit.client.1.smithi154.stdout: starting files = 128 2024-09-10T08:30:47.866 INFO:tasks.workunit.client.1.smithi154.stdout: 2024-09-10T08:30:47.866 INFO:tasks.workunit.client.1.smithi154.stdout: min file size = 104857600 (100MB) 2024-09-10T08:30:47.866 INFO:tasks.workunit.client.1.smithi154.stdout: max file size = 104857600 (100MB) 2024-09-10T08:30:47.866 INFO:tasks.workunit.client.1.smithi154.stdout: directio = off 2024-09-10T08:30:47.866 INFO:tasks.workunit.client.1.smithi154.stdout: alignedio = on 2024-09-10T08:30:47.866 INFO:tasks.workunit.client.1.smithi154.stdout: bufferedio = off 2024-09-10T08:30:47.866 INFO:tasks.workunit.client.1.smithi154.stdout: 2024-09-10T08:30:47.866 INFO:tasks.workunit.client.1.smithi154.stdout: aging is off 2024-09-10T08:30:47.866 INFO:tasks.workunit.client.1.smithi154.stdout: current utilization = 0.00% 2024-09-10T08:30:47.867 INFO:tasks.workunit.client.1.smithi154.stdout: 2024-09-10T08:30:47.867 INFO:tasks.workunit.client.1.smithi154.stdout:checking existing fs: . 2024-09-10T08:30:47.867 INFO:tasks.workunit.client.1.smithi154.stdout:recreating new fileset 2024-09-10T08:30:47.867 INFO:tasks.workunit.client.1.smithi154.stderr:opendir: No such file or directory 2024-09-10T08:30:47.920 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-09-10T08:30:47.925 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-09-10T08:30:48.075 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-09-10T08:30:48.079 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-09-10T08:30:48.149 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-09-10T08:30:48.154 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-09-10T08:30:48.218 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-09-10T08:30:48.222 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-09-10T08:30:48.284 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-09-10T08:30:48.289 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-09-10T08:30:48.504 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-09-10T08:30:48.509 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-09-10T08:30:48.655 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-09-10T08:30:48.660 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-09-10T08:30:48.940 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-09-10T08:30:48.945 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-09-10T08:30:49.156 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-09-10T08:30:49.160 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-09-10T08:30:49.308 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-09-10T08:30:49.313 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-09-10T08:30:49.442 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-09-10T08:30:49.447 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-09-10T08:30:49.489 INFO:tasks.workunit.client.0.smithi103.stderr:In file included from parser.h:22, 2024-09-10T08:30:49.489 INFO:tasks.workunit.client.0.smithi103.stderr: from parser.c:25: 2024-09-10T08:30:49.489 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c: In function ‘init_filesys’: 2024-09-10T08:30:49.491 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T08:30:49.491 INFO:tasks.workunit.client.0.smithi103.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T08:30:49.491 INFO:tasks.workunit.client.0.smithi103.stderr: | ^ 2024-09-10T08:30:49.491 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T08:30:49.491 INFO:tasks.workunit.client.0.smithi103.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T08:30:49.491 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~ 2024-09-10T08:30:49.491 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T08:30:49.491 INFO:tasks.workunit.client.0.smithi103.stderr: 36 | container_of(ptr, type, member) 2024-09-10T08:30:49.491 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~ 2024-09-10T08:30:49.492 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-10T08:30:49.492 INFO:tasks.workunit.client.0.smithi103.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-10T08:30:49.492 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~ 2024-09-10T08:30:49.492 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T08:30:49.492 INFO:tasks.workunit.client.0.smithi103.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-10T08:30:49.492 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T08:30:49.492 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T08:30:49.492 INFO:tasks.workunit.client.0.smithi103.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T08:30:49.492 INFO:tasks.workunit.client.0.smithi103.stderr: | ^ 2024-09-10T08:30:49.493 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T08:30:49.493 INFO:tasks.workunit.client.0.smithi103.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T08:30:49.493 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~ 2024-09-10T08:30:49.493 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T08:30:49.493 INFO:tasks.workunit.client.0.smithi103.stderr: 36 | container_of(ptr, type, member) 2024-09-10T08:30:49.493 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~ 2024-09-10T08:30:49.493 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-10T08:30:49.493 INFO:tasks.workunit.client.0.smithi103.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-10T08:30:49.493 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~ 2024-09-10T08:30:49.493 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T08:30:49.494 INFO:tasks.workunit.client.0.smithi103.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-10T08:30:49.494 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T08:30:49.494 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T08:30:49.494 INFO:tasks.workunit.client.0.smithi103.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T08:30:49.494 INFO:tasks.workunit.client.0.smithi103.stderr: | ^ 2024-09-10T08:30:49.494 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T08:30:49.494 INFO:tasks.workunit.client.0.smithi103.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T08:30:49.494 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~ 2024-09-10T08:30:49.494 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T08:30:49.494 INFO:tasks.workunit.client.0.smithi103.stderr: 36 | container_of(ptr, type, member) 2024-09-10T08:30:49.494 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~ 2024-09-10T08:30:49.494 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-10T08:30:49.494 INFO:tasks.workunit.client.0.smithi103.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-10T08:30:49.494 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~ 2024-09-10T08:30:49.495 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T08:30:49.495 INFO:tasks.workunit.client.0.smithi103.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-10T08:30:49.495 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T08:30:49.495 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T08:30:49.495 INFO:tasks.workunit.client.0.smithi103.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T08:30:49.495 INFO:tasks.workunit.client.0.smithi103.stderr: | ^ 2024-09-10T08:30:49.495 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T08:30:49.495 INFO:tasks.workunit.client.0.smithi103.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T08:30:49.495 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~ 2024-09-10T08:30:49.495 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T08:30:49.495 INFO:tasks.workunit.client.0.smithi103.stderr: 36 | container_of(ptr, type, member) 2024-09-10T08:30:49.495 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~ 2024-09-10T08:30:49.496 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-10T08:30:49.496 INFO:tasks.workunit.client.0.smithi103.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-10T08:30:49.496 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~ 2024-09-10T08:30:49.496 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T08:30:49.496 INFO:tasks.workunit.client.0.smithi103.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-10T08:30:49.496 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T08:30:49.496 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c: In function ‘init_tg_stats’: 2024-09-10T08:30:49.496 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T08:30:49.496 INFO:tasks.workunit.client.0.smithi103.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T08:30:49.496 INFO:tasks.workunit.client.0.smithi103.stderr: | ^ 2024-09-10T08:30:49.496 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T08:30:49.497 INFO:tasks.workunit.client.0.smithi103.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T08:30:49.497 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~ 2024-09-10T08:30:49.497 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T08:30:49.497 INFO:tasks.workunit.client.0.smithi103.stderr: 36 | container_of(ptr, type, member) 2024-09-10T08:30:49.497 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~ 2024-09-10T08:30:49.497 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-10T08:30:49.497 INFO:tasks.workunit.client.0.smithi103.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-10T08:30:49.497 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~ 2024-09-10T08:30:49.497 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T08:30:49.497 INFO:tasks.workunit.client.0.smithi103.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-10T08:30:49.497 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T08:30:49.497 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T08:30:49.498 INFO:tasks.workunit.client.0.smithi103.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T08:30:49.498 INFO:tasks.workunit.client.0.smithi103.stderr: | ^ 2024-09-10T08:30:49.498 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T08:30:49.498 INFO:tasks.workunit.client.0.smithi103.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T08:30:49.498 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~ 2024-09-10T08:30:49.498 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T08:30:49.498 INFO:tasks.workunit.client.0.smithi103.stderr: 36 | container_of(ptr, type, member) 2024-09-10T08:30:49.498 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~ 2024-09-10T08:30:49.498 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-10T08:30:49.498 INFO:tasks.workunit.client.0.smithi103.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-10T08:30:49.498 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~ 2024-09-10T08:30:49.499 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T08:30:49.499 INFO:tasks.workunit.client.0.smithi103.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-10T08:30:49.499 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T08:30:49.499 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T08:30:49.499 INFO:tasks.workunit.client.0.smithi103.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T08:30:49.499 INFO:tasks.workunit.client.0.smithi103.stderr: | ^ 2024-09-10T08:30:49.499 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T08:30:49.499 INFO:tasks.workunit.client.0.smithi103.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T08:30:49.499 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~ 2024-09-10T08:30:49.499 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T08:30:49.499 INFO:tasks.workunit.client.0.smithi103.stderr: 36 | container_of(ptr, type, member) 2024-09-10T08:30:49.499 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~ 2024-09-10T08:30:49.500 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-10T08:30:49.500 INFO:tasks.workunit.client.0.smithi103.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-10T08:30:49.500 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~ 2024-09-10T08:30:49.500 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T08:30:49.500 INFO:tasks.workunit.client.0.smithi103.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-10T08:30:49.500 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T08:30:49.500 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-10T08:30:49.500 INFO:tasks.workunit.client.0.smithi103.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-10T08:30:49.500 INFO:tasks.workunit.client.0.smithi103.stderr: | ^ 2024-09-10T08:30:49.501 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-10T08:30:49.501 INFO:tasks.workunit.client.0.smithi103.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-10T08:30:49.501 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~ 2024-09-10T08:30:49.501 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-10T08:30:49.501 INFO:tasks.workunit.client.0.smithi103.stderr: 36 | container_of(ptr, type, member) 2024-09-10T08:30:49.501 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~ 2024-09-10T08:30:49.501 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-10T08:30:49.501 INFO:tasks.workunit.client.0.smithi103.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-10T08:30:49.501 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~ 2024-09-10T08:30:49.501 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-10T08:30:49.501 INFO:tasks.workunit.client.0.smithi103.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-10T08:30:49.501 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T08:30:49.537 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c: In function ‘get_optstr’: 2024-09-10T08:30:49.538 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-09-10T08:30:49.538 INFO:tasks.workunit.client.0.smithi103.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-09-10T08:30:49.538 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-10T08:30:49.538 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c:200:14: note: source object declared here 2024-09-10T08:30:49.538 INFO:tasks.workunit.client.0.smithi103.stderr: 200 | char temp[BUFSIZE]; 2024-09-10T08:30:49.538 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~ 2024-09-10T08:30:49.544 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c: In function ‘size64_convert’: 2024-09-10T08:30:49.544 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-09-10T08:30:49.544 INFO:tasks.workunit.client.0.smithi103.stderr: 119 | memcpy(unit, "\0", 3); 2024-09-10T08:30:49.544 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-09-10T08:30:50.036 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-09-10T08:30:50.143 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-09-10T08:30:50.292 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-09-10T08:30:50.297 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-09-10T08:30:50.459 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-09-10T08:30:50.464 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-09-10T08:30:50.568 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-09-10T08:30:50.576 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-09-10T08:30:50.678 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-10T08:30:50.679 INFO:tasks.workunit.client.0.smithi103.stderr:+ cd .. 2024-09-10T08:30:50.680 INFO:tasks.workunit.client.0.smithi103.stderr:+ mkdir tmp 2024-09-10T08:30:50.682 INFO:tasks.workunit.client.0.smithi103.stderr:+ cd tmp 2024-09-10T08:30:50.683 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in $mydir/*.ffsb 2024-09-10T08:30:50.683 INFO:tasks.workunit.client.0.smithi103.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-09-10T08:30:50.684 INFO:tasks.workunit.client.0.smithi103.stdout:FFSB version 6.0-RC2 started 2024-09-10T08:30:50.684 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-10T08:30:50.687 INFO:tasks.workunit.client.0.smithi103.stdout:benchmark time = 300 2024-09-10T08:30:50.687 INFO:tasks.workunit.client.0.smithi103.stdout:ThreadGroup 0 2024-09-10T08:30:50.687 INFO:tasks.workunit.client.0.smithi103.stdout:================ 2024-09-10T08:30:50.687 INFO:tasks.workunit.client.0.smithi103.stdout: num_threads = 32 2024-09-10T08:30:50.687 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-10T08:30:50.687 INFO:tasks.workunit.client.0.smithi103.stdout: read_random = off 2024-09-10T08:30:50.688 INFO:tasks.workunit.client.0.smithi103.stdout: read_size = 0 (0B) 2024-09-10T08:30:50.688 INFO:tasks.workunit.client.0.smithi103.stdout: read_blocksize = 0 (0B) 2024-09-10T08:30:50.688 INFO:tasks.workunit.client.0.smithi103.stdout: read_skip = off 2024-09-10T08:30:50.688 INFO:tasks.workunit.client.0.smithi103.stdout: read_skipsize = 0 (0B) 2024-09-10T08:30:50.688 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-10T08:30:50.688 INFO:tasks.workunit.client.0.smithi103.stdout: write_random = on 2024-09-10T08:30:50.688 INFO:tasks.workunit.client.0.smithi103.stdout: write_size = 5242880 (5MB) 2024-09-10T08:30:50.688 INFO:tasks.workunit.client.0.smithi103.stdout: fsync_file = 0 2024-09-10T08:30:50.688 INFO:tasks.workunit.client.0.smithi103.stdout: write_blocksize = 4096 (4KB) 2024-09-10T08:30:50.688 INFO:tasks.workunit.client.0.smithi103.stdout: wait time = 0 2024-09-10T08:30:50.688 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-10T08:30:50.688 INFO:tasks.workunit.client.0.smithi103.stdout: op weights 2024-09-10T08:30:50.688 INFO:tasks.workunit.client.0.smithi103.stdout: read = 0 (0.00%) 2024-09-10T08:30:50.689 INFO:tasks.workunit.client.0.smithi103.stdout: readall = 0 (0.00%) 2024-09-10T08:30:50.689 INFO:tasks.workunit.client.0.smithi103.stdout: write = 1 (100.00%) 2024-09-10T08:30:50.689 INFO:tasks.workunit.client.0.smithi103.stdout: create = 0 (0.00%) 2024-09-10T08:30:50.689 INFO:tasks.workunit.client.0.smithi103.stdout: append = 0 (0.00%) 2024-09-10T08:30:50.689 INFO:tasks.workunit.client.0.smithi103.stdout: delete = 0 (0.00%) 2024-09-10T08:30:50.689 INFO:tasks.workunit.client.0.smithi103.stdout: metaop = 0 (0.00%) 2024-09-10T08:30:50.689 INFO:tasks.workunit.client.0.smithi103.stdout: createdir = 0 (0.00%) 2024-09-10T08:30:50.689 INFO:tasks.workunit.client.0.smithi103.stdout: stat = 0 (0.00%) 2024-09-10T08:30:50.689 INFO:tasks.workunit.client.0.smithi103.stdout: writeall = 0 (0.00%) 2024-09-10T08:30:50.689 INFO:tasks.workunit.client.0.smithi103.stdout: writeall_fsync = 0 (0.00%) 2024-09-10T08:30:50.689 INFO:tasks.workunit.client.0.smithi103.stdout: open_close = 0 (0.00%) 2024-09-10T08:30:50.689 INFO:tasks.workunit.client.0.smithi103.stdout: write_fsync = 0 (0.00%) 2024-09-10T08:30:50.689 INFO:tasks.workunit.client.0.smithi103.stdout: create_fsync = 0 (0.00%) 2024-09-10T08:30:50.690 INFO:tasks.workunit.client.0.smithi103.stdout: append_fsync = 0 (0.00%) 2024-09-10T08:30:50.690 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-10T08:30:50.690 INFO:tasks.workunit.client.0.smithi103.stdout:FileSystem . 2024-09-10T08:30:50.690 INFO:tasks.workunit.client.0.smithi103.stdout:========== 2024-09-10T08:30:50.690 INFO:tasks.workunit.client.0.smithi103.stdout: num_dirs = 0 2024-09-10T08:30:50.690 INFO:tasks.workunit.client.0.smithi103.stdout: starting files = 128 2024-09-10T08:30:50.690 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-10T08:30:50.690 INFO:tasks.workunit.client.0.smithi103.stdout: min file size = 104857600 (100MB) 2024-09-10T08:30:50.690 INFO:tasks.workunit.client.0.smithi103.stdout: max file size = 104857600 (100MB) 2024-09-10T08:30:50.690 INFO:tasks.workunit.client.0.smithi103.stdout: directio = off 2024-09-10T08:30:50.690 INFO:tasks.workunit.client.0.smithi103.stdout: alignedio = on 2024-09-10T08:30:50.690 INFO:tasks.workunit.client.0.smithi103.stdout: bufferedio = off 2024-09-10T08:30:50.690 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-10T08:30:50.690 INFO:tasks.workunit.client.0.smithi103.stdout: aging is off 2024-09-10T08:30:50.691 INFO:tasks.workunit.client.0.smithi103.stdout: current utilization = 0.00% 2024-09-10T08:30:50.691 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-10T08:30:50.691 INFO:tasks.workunit.client.0.smithi103.stdout:checking existing fs: . 2024-09-10T08:30:50.691 INFO:tasks.workunit.client.0.smithi103.stdout:recreating new fileset 2024-09-10T08:30:50.691 INFO:tasks.workunit.client.0.smithi103.stderr:opendir: No such file or directory 2024-09-10T08:30:55.746 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-10T08:30:55.746 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-10T08:30:55.746 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T08:30:55.747 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T08:30:55.749 INFO:tasks.ceph.mon.c:Started 2024-09-10T08:30:55.750 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:30:55.750 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:30:55.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.861+0000 7fa69228c640 1 Processor -- start 2024-09-10T08:30:55.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.861+0000 7fa69228c640 1 -- start start 2024-09-10T08:30:55.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.862+0000 7fa69228c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa68c153be0 0x7fa68c15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:55.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.862+0000 7fa69228c640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa68c0c7070 con 0x7fa68c0c8b10 2024-09-10T08:30:55.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.862+0000 7fa69228c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa68c06d210 con 0x7fa68c06cd80 2024-09-10T08:30:55.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.862+0000 7fa69228c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa68c0c69b0 con 0x7fa68c153be0 2024-09-10T08:30:55.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.862+0000 7fa690829640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa68c153be0 0x7fa68c15a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:55.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.862+0000 7fa68bfff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa68c0c8b10 0x7fa68c1534d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51470/0 (socket says 172.21.15.103:51470) 2024-09-10T08:30:55.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.862+0000 7fa690829640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa68c153be0 0x7fa68c15a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39978/0 (socket says 172.21.15.103:39978) 2024-09-10T08:30:55.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.862+0000 7fa68bfff640 1 -- 172.21.15.103:0/2763588538 learned_addr learned my addr 172.21.15.103:0/2763588538 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:30:55.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.863+0000 7fa690829640 1 -- 172.21.15.103:0/2763588538 >> v1:172.21.15.154:6789/0 conn(0x7fa68c06cd80 legacy=0x7fa68c156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:55.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.863+0000 7fa690829640 1 -- 172.21.15.103:0/2763588538 >> v1:172.21.15.103:6789/0 conn(0x7fa68c0c8b10 legacy=0x7fa68c1534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:55.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.863+0000 7fa690829640 1 -- 172.21.15.103:0/2763588538 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68c0c6c90 con 0x7fa68c153be0 2024-09-10T08:30:55.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.864+0000 7fa690829640 1 --2- 172.21.15.103:0/2763588538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa68c153be0 0x7fa68c15a4a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa684009d90 tx=0x7fa68402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96802a1f169f421 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:55.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.864+0000 7fa68b7fe640 1 -- 172.21.15.103:0/2763588538 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa684007740 con 0x7fa68c153be0 2024-09-10T08:30:55.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.864+0000 7fa68b7fe640 1 -- 172.21.15.103:0/2763588538 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6840078e0 con 0x7fa68c153be0 2024-09-10T08:30:55.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.864+0000 7fa68b7fe640 1 -- 172.21.15.103:0/2763588538 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa684007cb0 con 0x7fa68c153be0 2024-09-10T08:30:55.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.865+0000 7fa69228c640 1 -- 172.21.15.103:0/2763588538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa68c153be0 msgr2=0x7fa68c15a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:55.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.865+0000 7fa69228c640 1 --2- 172.21.15.103:0/2763588538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa68c153be0 0x7fa68c15a4a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa684009d90 tx=0x7fa68402a660 comp rx=0 tx=0).stop 2024-09-10T08:30:55.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.865+0000 7fa69228c640 1 -- 172.21.15.103:0/2763588538 shutdown_connections 2024-09-10T08:30:55.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.865+0000 7fa69228c640 1 --2- 172.21.15.103:0/2763588538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa68c153be0 0x7fa68c15a4a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:55.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.865+0000 7fa69228c640 1 -- 172.21.15.103:0/2763588538 >> 172.21.15.103:0/2763588538 conn(0x7fa68c0adb80 msgr2=0x7fa68c0adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:55.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.865+0000 7fa69228c640 1 -- 172.21.15.103:0/2763588538 shutdown_connections 2024-09-10T08:30:55.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.865+0000 7fa69228c640 1 -- 172.21.15.103:0/2763588538 wait complete. 2024-09-10T08:30:55.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.866+0000 7fa69228c640 1 Processor -- start 2024-09-10T08:30:55.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.866+0000 7fa69228c640 1 -- start start 2024-09-10T08:30:55.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.867+0000 7fa69228c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa68c0c8b10 0x7fa68c1e1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:55.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.867+0000 7fa69228c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa68c153be0 0x7fa68c147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:55.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.867+0000 7fa69228c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa68c14c380 0x7fa68c1efae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:55.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.867+0000 7fa69228c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa68c0c9070 con 0x7fa68c153be0 2024-09-10T08:30:55.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.867+0000 7fa69228c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa68c0c8ef0 con 0x7fa68c14c380 2024-09-10T08:30:55.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.867+0000 7fa69228c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa68c156d70 con 0x7fa68c0c8b10 2024-09-10T08:30:55.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.867+0000 7fa683fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa68c153be0 0x7fa68c147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:55.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.867+0000 7fa683fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa68c153be0 0x7fa68c147f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39980/0 (socket says 172.21.15.103:39980) 2024-09-10T08:30:55.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.867+0000 7fa683fff640 1 -- 172.21.15.103:0/865811422 learned_addr learned my addr 172.21.15.103:0/865811422 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:55.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.868+0000 7fa68bfff640 1 --2- 172.21.15.103:0/865811422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa68c0c8b10 0x7fa68c1e1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:55.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.868+0000 7fa690829640 1 --2- 172.21.15.103:0/865811422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa68c14c380 0x7fa68c1efae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:55.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.868+0000 7fa68bfff640 1 -- 172.21.15.103:0/865811422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa68c0c8b10 msgr2=0x7fa68c1e1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-10T08:30:55.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.868+0000 7fa68bfff640 1 -- 172.21.15.103:0/865811422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa68c0c8b10 msgr2=0x7fa68c1e1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:30:55.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.868+0000 7fa68bfff640 1 --2- 172.21.15.103:0/865811422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa68c0c8b10 0x7fa68c1e1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:30:55.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.868+0000 7fa68bfff640 1 --2- 172.21.15.103:0/865811422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa68c0c8b10 0x7fa68c1e1b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:30:55.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.868+0000 7fa683fff640 1 -- 172.21.15.103:0/865811422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa68c0c8b10 msgr2=0x7fa68c1e1b00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:30:55.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.868+0000 7fa683fff640 1 --2- 172.21.15.103:0/865811422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa68c0c8b10 0x7fa68c1e1b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:55.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.868+0000 7fa683fff640 1 -- 172.21.15.103:0/865811422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa68c14c380 msgr2=0x7fa68c1efae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:55.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.868+0000 7fa683fff640 1 --2- 172.21.15.103:0/865811422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa68c14c380 0x7fa68c1efae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:55.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.868+0000 7fa683fff640 1 -- 172.21.15.103:0/865811422 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68c1dfd20 con 0x7fa68c153be0 2024-09-10T08:30:55.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.868+0000 7fa683fff640 1 --2- 172.21.15.103:0/865811422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa68c153be0 0x7fa68c147f70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa67400c400 tx=0x7fa67400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:55.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.868+0000 7fa6897fa640 1 -- 172.21.15.103:0/865811422 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6740052d0 con 0x7fa68c153be0 2024-09-10T08:30:55.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.868+0000 7fa6897fa640 1 -- 172.21.15.103:0/865811422 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa674005490 con 0x7fa68c153be0 2024-09-10T08:30:55.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.868+0000 7fa69228c640 1 -- 172.21.15.103:0/865811422 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa68c1e2540 con 0x7fa68c153be0 2024-09-10T08:30:55.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.868+0000 7fa6897fa640 1 -- 172.21.15.103:0/865811422 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa674007260 con 0x7fa68c153be0 2024-09-10T08:30:55.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.868+0000 7fa69228c640 1 -- 172.21.15.103:0/865811422 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa68c1ef5c0 con 0x7fa68c153be0 2024-09-10T08:30:55.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.869+0000 7fa69228c640 1 -- 172.21.15.103:0/865811422 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa68c1ef7c0 con 0x7fa68c153be0 2024-09-10T08:30:55.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.870+0000 7fa6897fa640 1 -- 172.21.15.103:0/865811422 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa674007400 con 0x7fa68c153be0 2024-09-10T08:30:55.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.871+0000 7fa6897fa640 1 --2- 172.21.15.103:0/865811422 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa66c06be60 0x7fa66c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:55.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.871+0000 7fa6897fa640 1 -- 172.21.15.103:0/865811422 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fa67408a620 con 0x7fa68c153be0 2024-09-10T08:30:55.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.871+0000 7fa68bfff640 1 --2- 172.21.15.103:0/865811422 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa66c06be60 0x7fa66c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:55.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.871+0000 7fa68bfff640 1 --2- 172.21.15.103:0/865811422 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa66c06be60 0x7fa66c06e320 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa67c005880 tx=0x7fa67c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:55.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:55.875+0000 7fa6897fa640 1 -- 172.21.15.103:0/865811422 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa68c1ef7c0 con 0x7fa68c153be0 2024-09-10T08:30:56.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.178+0000 7fa69228c640 1 -- 172.21.15.103:0/865811422 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa68c1570d0 con 0x7fa68c153be0 2024-09-10T08:30:56.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.178+0000 7fa6897fa640 1 -- 172.21.15.103:0/865811422 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7fa6740585f0 con 0x7fa68c153be0 2024-09-10T08:30:56.178 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":16,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:30:56.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.180+0000 7fa69228c640 1 -- 172.21.15.103:0/865811422 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa66c06be60 msgr2=0x7fa66c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:56.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.180+0000 7fa69228c640 1 --2- 172.21.15.103:0/865811422 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa66c06be60 0x7fa66c06e320 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa67c005880 tx=0x7fa67c009040 comp rx=0 tx=0).stop 2024-09-10T08:30:56.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.180+0000 7fa69228c640 1 -- 172.21.15.103:0/865811422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa68c153be0 msgr2=0x7fa68c147f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:56.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.180+0000 7fa69228c640 1 --2- 172.21.15.103:0/865811422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa68c153be0 0x7fa68c147f70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa67400c400 tx=0x7fa67400c8c0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.180+0000 7fa69228c640 1 -- 172.21.15.103:0/865811422 shutdown_connections 2024-09-10T08:30:56.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.180+0000 7fa69228c640 1 --2- 172.21.15.103:0/865811422 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa66c06be60 0x7fa66c06e320 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.180+0000 7fa69228c640 1 --2- 172.21.15.103:0/865811422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa68c14c380 0x7fa68c1efae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.180+0000 7fa69228c640 1 --2- 172.21.15.103:0/865811422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa68c153be0 0x7fa68c147f70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.180+0000 7fa69228c640 1 --2- 172.21.15.103:0/865811422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa68c0c8b10 0x7fa68c1e1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.180+0000 7fa69228c640 1 -- 172.21.15.103:0/865811422 >> 172.21.15.103:0/865811422 conn(0x7fa68c0adb80 msgr2=0x7fa68c154170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:56.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.180+0000 7fa69228c640 1 -- 172.21.15.103:0/865811422 shutdown_connections 2024-09-10T08:30:56.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.180+0000 7fa69228c640 1 -- 172.21.15.103:0/865811422 wait complete. 2024-09-10T08:30:56.192 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:30:56.192 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:30:56.192 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:30:56.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.304+0000 7f95cdbc0640 1 Processor -- start 2024-09-10T08:30:56.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.304+0000 7f95cdbc0640 1 -- start start 2024-09-10T08:30:56.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.305+0000 7f95cdbc0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c8150480 0x7f95c80c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:56.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.305+0000 7f95cdbc0640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f95c806c650 0x7f95c80c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:56.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.305+0000 7f95cdbc0640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95c815a7c0 con 0x7f95c80c9c80 2024-09-10T08:30:56.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.305+0000 7f95cdbc0640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f95c806c240 con 0x7f95c806c650 2024-09-10T08:30:56.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.305+0000 7f95cdbc0640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f95c815a330 con 0x7f95c8150480 2024-09-10T08:30:56.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.305+0000 7f95c6ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f95c806c650 0x7f95c80c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.305+0000 7f95c6ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f95c806c650 0x7f95c80c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39986/0 (socket says 172.21.15.103:39986) 2024-09-10T08:30:56.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.305+0000 7f95c6ffd640 1 -- 172.21.15.103:0/3264437047 learned_addr learned my addr 172.21.15.103:0/3264437047 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:56.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.305+0000 7f95c77fe640 1 --2- 172.21.15.103:0/3264437047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c8150480 0x7f95c80c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.306+0000 7f95c77fe640 1 -- 172.21.15.103:0/3264437047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c8150480 msgr2=0x7f95c80c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:30:56.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.306+0000 7f95c77fe640 1 -- 172.21.15.103:0/3264437047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c8150480 msgr2=0x7f95c80c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:30:56.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.306+0000 7f95c77fe640 1 --2- 172.21.15.103:0/3264437047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c8150480 0x7f95c80c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:30:56.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.306+0000 7f95c77fe640 1 --2- 172.21.15.103:0/3264437047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c8150480 0x7f95c80c7a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:30:56.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.306+0000 7f95c6ffd640 1 -- 172.21.15.103:0/3264437047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c8150480 msgr2=0x7f95c80c7a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:30:56.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.306+0000 7f95c6ffd640 1 --2- 172.21.15.103:0/3264437047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c8150480 0x7f95c80c7a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.306+0000 7f95c6ffd640 1 -- 172.21.15.103:0/3264437047 >> v1:172.21.15.154:6789/0 conn(0x7f95c80c9c80 legacy=0x7f95c80ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:56.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.306+0000 7f95c6ffd640 1 -- 172.21.15.103:0/3264437047 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c8159a00 con 0x7f95c806c650 2024-09-10T08:30:56.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.306+0000 7f95c67fc640 1 -- 172.21.15.103:0/3264437047 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2718648899 0 0) 0x7f95c815a7c0 con 0x7f95c80c9c80 2024-09-10T08:30:56.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.306+0000 7f95c6ffd640 1 --2- 172.21.15.103:0/3264437047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c806c650 0x7f95c80c7fd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009870 tx=0x7f95bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0d01152153c600 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:56.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.307+0000 7f95c67fc640 1 -- 172.21.15.103:0/3264437047 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc037070 con 0x7f95c806c650 2024-09-10T08:30:56.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.307+0000 7f95c67fc640 1 -- 172.21.15.103:0/3264437047 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95bc032440 con 0x7f95c806c650 2024-09-10T08:30:56.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.307+0000 7f95c67fc640 1 -- 172.21.15.103:0/3264437047 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc032810 con 0x7f95c806c650 2024-09-10T08:30:56.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.307+0000 7f95cdbc0640 1 -- 172.21.15.103:0/3264437047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c806c650 msgr2=0x7f95c80c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:56.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.307+0000 7f95cdbc0640 1 --2- 172.21.15.103:0/3264437047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c806c650 0x7f95c80c7fd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009870 tx=0x7f95bc02a270 comp rx=0 tx=0).stop 2024-09-10T08:30:56.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.307+0000 7f95cdbc0640 1 -- 172.21.15.103:0/3264437047 shutdown_connections 2024-09-10T08:30:56.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.307+0000 7f95cdbc0640 1 --2- 172.21.15.103:0/3264437047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c806c650 0x7f95c80c7fd0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.307+0000 7f95cdbc0640 1 --2- 172.21.15.103:0/3264437047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c8150480 0x7f95c80c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.307+0000 7f95cdbc0640 1 -- 172.21.15.103:0/3264437047 >> 172.21.15.103:0/3264437047 conn(0x7f95c8068030 msgr2=0x7f95c8073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:56.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.307+0000 7f95cdbc0640 1 -- 172.21.15.103:0/3264437047 shutdown_connections 2024-09-10T08:30:56.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.307+0000 7f95cdbc0640 1 -- 172.21.15.103:0/3264437047 wait complete. 2024-09-10T08:30:56.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.309+0000 7f95cdbc0640 1 Processor -- start 2024-09-10T08:30:56.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.309+0000 7f95cdbc0640 1 -- start start 2024-09-10T08:30:56.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.309+0000 7f95cdbc0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c806c650 0x7f95c8153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:56.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.309+0000 7f95cdbc0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c80c9c80 0x7f95c80afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:56.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.309+0000 7f95cdbc0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c8150480 0x7f95c81ebeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:56.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.309+0000 7f95cdbc0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f95c806d270 con 0x7f95c806c650 2024-09-10T08:30:56.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.309+0000 7f95cdbc0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f95c8159fc0 con 0x7f95c8150480 2024-09-10T08:30:56.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.309+0000 7f95cdbc0640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f95c8156270 con 0x7f95c80c9c80 2024-09-10T08:30:56.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.310+0000 7f95c77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c806c650 0x7f95c8153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.310+0000 7f95c77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c806c650 0x7f95c8153910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39996/0 (socket says 172.21.15.103:39996) 2024-09-10T08:30:56.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.310+0000 7f95c77fe640 1 -- 172.21.15.103:0/2898583222 learned_addr learned my addr 172.21.15.103:0/2898583222 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:56.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.310+0000 7f95c6ffd640 1 --2- 172.21.15.103:0/2898583222 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c80c9c80 0x7f95c80afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.310+0000 7f95c7fff640 1 --2- 172.21.15.103:0/2898583222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c8150480 0x7f95c81ebeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.310+0000 7f95c6ffd640 1 -- 172.21.15.103:0/2898583222 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c80c9c80 msgr2=0x7f95c80afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-10T08:30:56.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.310+0000 7f95c6ffd640 1 -- 172.21.15.103:0/2898583222 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c80c9c80 msgr2=0x7f95c80afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:30:56.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.310+0000 7f95c6ffd640 1 --2- 172.21.15.103:0/2898583222 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c80c9c80 0x7f95c80afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:30:56.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.310+0000 7f95c6ffd640 1 --2- 172.21.15.103:0/2898583222 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c80c9c80 0x7f95c80afda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:30:56.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.310+0000 7f95c77fe640 1 -- 172.21.15.103:0/2898583222 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c80c9c80 msgr2=0x7f95c80afda0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:30:56.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.310+0000 7f95c77fe640 1 --2- 172.21.15.103:0/2898583222 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95c80c9c80 0x7f95c80afda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.310+0000 7f95c77fe640 1 -- 172.21.15.103:0/2898583222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c8150480 msgr2=0x7f95c81ebeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:56.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.310+0000 7f95c77fe640 1 --2- 172.21.15.103:0/2898583222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c8150480 0x7f95c81ebeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.310+0000 7f95c77fe640 1 -- 172.21.15.103:0/2898583222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c814fde0 con 0x7f95c806c650 2024-09-10T08:30:56.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.310+0000 7f95c77fe640 1 --2- 172.21.15.103:0/2898583222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c806c650 0x7f95c8153910 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f95b800d800 tx=0x7f95b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:56.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.310+0000 7f95affff640 1 -- 172.21.15.103:0/2898583222 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b800b6c0 con 0x7f95c806c650 2024-09-10T08:30:56.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.310+0000 7f95affff640 1 -- 172.21.15.103:0/2898583222 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95b8019070 con 0x7f95c806c650 2024-09-10T08:30:56.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.310+0000 7f95cdbc0640 1 -- 172.21.15.103:0/2898583222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c81ef5c0 con 0x7f95c806c650 2024-09-10T08:30:56.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.310+0000 7f95affff640 1 -- 172.21.15.103:0/2898583222 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b800bac0 con 0x7f95c806c650 2024-09-10T08:30:56.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.310+0000 7f95cdbc0640 1 -- 172.21.15.103:0/2898583222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c81efb80 con 0x7f95c806c650 2024-09-10T08:30:56.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.311+0000 7f95cdbc0640 1 --2- 172.21.15.103:0/2898583222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c81f00a0 0x7f95c81ec3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:56.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.311+0000 7f95cdbc0640 1 -- 172.21.15.103:0/2898583222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f95c81ef420 con 0x7f95c81f00a0 2024-09-10T08:30:56.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.311+0000 7f95c6ffd640 1 --2- 172.21.15.103:0/2898583222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c81f00a0 0x7f95c81ec3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.312+0000 7f95c6ffd640 1 -- 172.21.15.103:0/2898583222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f95c80ca130 con 0x7f95c81f00a0 2024-09-10T08:30:56.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.312+0000 7f95c6ffd640 1 --2- 172.21.15.103:0/2898583222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c81f00a0 0x7f95c81ec3f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f95c80c62d0 tx=0x7f95bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:56.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.312+0000 7f95affff640 1 -- 172.21.15.103:0/2898583222 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f95b800bc60 con 0x7f95c806c650 2024-09-10T08:30:56.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.312+0000 7f95affff640 1 --2- 172.21.15.103:0/2898583222 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f95b406be30 0x7f95b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:56.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.312+0000 7f95affff640 1 -- 172.21.15.103:0/2898583222 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f95b808b2e0 con 0x7f95c806c650 2024-09-10T08:30:56.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.313+0000 7f95c7fff640 1 --2- 172.21.15.103:0/2898583222 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f95b406be30 0x7f95b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.313+0000 7f95affff640 1 -- 172.21.15.103:0/2898583222 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc042070 con 0x7f95c81f00a0 2024-09-10T08:30:56.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.313+0000 7f95affff640 1 -- 172.21.15.103:0/2898583222 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f95bc009490 con 0x7f95c81f00a0 2024-09-10T08:30:56.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.313+0000 7f95affff640 1 -- 172.21.15.103:0/2898583222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c81f00a0 msgr2=0x7f95c81ec3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:56.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.313+0000 7f95affff640 1 --2- 172.21.15.103:0/2898583222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c81f00a0 0x7f95c81ec3f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f95c80c62d0 tx=0x7f95bc0046c0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.313+0000 7f95affff640 1 -- 172.21.15.103:0/2898583222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c81f00a0 msgr2=0x7f95c81ec3f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:30:56.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.313+0000 7f95affff640 1 --2- 172.21.15.103:0/2898583222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c81f00a0 0x7f95c81ec3f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.313+0000 7f95c7fff640 1 --2- 172.21.15.103:0/2898583222 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f95b406be30 0x7f95b406e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f95c00012e0 tx=0x7f95c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:56.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.320+0000 7f95cdbc0640 1 --2- 172.21.15.103:0/2898583222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c814ee30 0x7f95c814f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:56.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.320+0000 7f95cdbc0640 1 -- 172.21.15.103:0/2898583222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f95c80ac250 con 0x7f95c814ee30 2024-09-10T08:30:56.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.320+0000 7f95c6ffd640 1 --2- 172.21.15.103:0/2898583222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c814ee30 0x7f95c814f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.321+0000 7f95c6ffd640 1 -- 172.21.15.103:0/2898583222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f95c80abf70 con 0x7f95c814ee30 2024-09-10T08:30:56.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.321+0000 7f95c6ffd640 1 --2- 172.21.15.103:0/2898583222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c814ee30 0x7f95c814f230 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f95bc000c00 tx=0x7f95bc009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:56.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.321+0000 7f95affff640 1 -- 172.21.15.103:0/2898583222 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc054020 con 0x7f95c814ee30 2024-09-10T08:30:56.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.321+0000 7f95affff640 1 -- 172.21.15.103:0/2898583222 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5056 (secure 0 0 0) 0x7f95bc03de50 con 0x7f95c814ee30 2024-09-10T08:30:56.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.321+0000 7f95affff640 1 -- 172.21.15.103:0/2898583222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c814ee30 msgr2=0x7f95c814f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:56.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.321+0000 7f95affff640 1 --2- 172.21.15.103:0/2898583222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c814ee30 0x7f95c814f230 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f95bc000c00 tx=0x7f95bc009240 comp rx=0 tx=0).stop 2024-09-10T08:30:56.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.321+0000 7f95affff640 1 -- 172.21.15.103:0/2898583222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c814ee30 msgr2=0x7f95c814f230 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:30:56.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.321+0000 7f95affff640 1 --2- 172.21.15.103:0/2898583222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c814ee30 0x7f95c814f230 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.322 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:30:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:30:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:30:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:30:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 16, 2024-09-10T08:30:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 163883, 2024-09-10T08:30:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:30:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:30:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:30:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:30:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:30:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:30:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:30:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:30:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:30:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:30:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:30:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:30:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:30:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:30:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:30:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:30:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:30:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:30:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:30:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:30:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:30:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:30:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:30:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:30:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:30:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:30:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:30:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:30:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:30:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:30:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:30:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:30:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:30:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:30:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:30:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:30:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:30:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:30:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:30:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:30:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:30:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:30:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:30:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:30:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:30:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:30:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:30:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:30:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:30:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:30:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:30:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:30:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:30:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-10T08:30:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:30:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-10T08:30:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:30:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:30:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:56.337 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:56.337 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.337 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:30:56.337 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:30:56.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.322+0000 7f95cdbc0640 1 -- 172.21.15.103:0/2898583222 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f95b406be30 msgr2=0x7f95b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:56.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.322+0000 7f95cdbc0640 1 --2- 172.21.15.103:0/2898583222 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f95b406be30 0x7f95b406e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f95c00012e0 tx=0x7f95c0009040 comp rx=0 tx=0).stop 2024-09-10T08:30:56.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.322+0000 7f95cdbc0640 1 -- 172.21.15.103:0/2898583222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c806c650 msgr2=0x7f95c8153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:56.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.322+0000 7f95cdbc0640 1 --2- 172.21.15.103:0/2898583222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95c806c650 0x7f95c8153910 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f95b800d800 tx=0x7f95b800dcc0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.322+0000 7f95c7fff640 1 -- 172.21.15.103:0/2898583222 reap_dead start 2024-09-10T08:30:56.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.322+0000 7f95c7fff640 1 -- 172.21.15.103:0/2898583222 reap_dead start 2024-09-10T08:30:56.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.322+0000 7f95cdbc0640 1 -- 172.21.15.103:0/2898583222 shutdown_connections 2024-09-10T08:30:56.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.322+0000 7f95cdbc0640 1 -- 172.21.15.103:0/2898583222 >> 172.21.15.103:0/2898583222 conn(0x7f95c8068030 msgr2=0x7f95c8154b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:56.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.322+0000 7f95cdbc0640 1 -- 172.21.15.103:0/2898583222 shutdown_connections 2024-09-10T08:30:56.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.322+0000 7f95cdbc0640 1 -- 172.21.15.103:0/2898583222 wait complete. 2024-09-10T08:30:56.340 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:30:56.340 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:30:56.340 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:30:56.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.456+0000 7ff81958d640 1 Processor -- start 2024-09-10T08:30:56.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.456+0000 7ff81958d640 1 -- start start 2024-09-10T08:30:56.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.457+0000 7ff81958d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff8140c44e0 0x7ff81406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:56.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.457+0000 7ff81958d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff814156640 con 0x7ff81406f9b0 2024-09-10T08:30:56.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.457+0000 7ff81958d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8141568e0 con 0x7ff814150720 2024-09-10T08:30:56.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.457+0000 7ff81958d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff814157210 con 0x7ff8140c44e0 2024-09-10T08:30:56.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.457+0000 7ff8137fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff81406f9b0 0x7ff8140c30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51482/0 (socket says 172.21.15.103:51482) 2024-09-10T08:30:56.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.457+0000 7ff8137fe640 1 -- 172.21.15.103:0/4096589618 learned_addr learned my addr 172.21.15.103:0/4096589618 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:30:56.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.457+0000 7ff80a7fc640 1 --2- 172.21.15.103:0/4096589618 >> v2:172.21.15.154:3300/0 conn(0x7ff8140c44e0 0x7ff81406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.458+0000 7ff8127fc640 1 -- 172.21.15.103:0/4096589618 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4220428677 0 0) 0x7ff8141568e0 con 0x7ff814150720 2024-09-10T08:30:56.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.458+0000 7ff8127fc640 1 -- 172.21.15.103:0/4096589618 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff800003520 con 0x7ff814150720 2024-09-10T08:30:56.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.458+0000 7ff8127fc640 1 -- 172.21.15.103:0/4096589618 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1943060525 0 0) 0x7ff814156640 con 0x7ff81406f9b0 2024-09-10T08:30:56.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.458+0000 7ff8127fc640 1 -- 172.21.15.103:0/4096589618 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8141568e0 con 0x7ff81406f9b0 2024-09-10T08:30:56.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.458+0000 7ff80a7fc640 1 -- 172.21.15.103:0/4096589618 >> v1:172.21.15.154:6789/0 conn(0x7ff814150720 legacy=0x7ff8140adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:56.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.458+0000 7ff80a7fc640 1 -- 172.21.15.103:0/4096589618 >> v1:172.21.15.103:6789/0 conn(0x7ff81406f9b0 legacy=0x7ff8140c30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:56.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.458+0000 7ff80a7fc640 1 -- 172.21.15.103:0/4096589618 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff814156bc0 con 0x7ff8140c44e0 2024-09-10T08:30:56.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.458+0000 7ff80a7fc640 1 --2- 172.21.15.103:0/4096589618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8140c44e0 0x7ff81406f470 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc0097a0 tx=0x7ff7fc02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c53cd851264b5538 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:56.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.459+0000 7ff8127fc640 1 -- 172.21.15.103:0/4096589618 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc037070 con 0x7ff8140c44e0 2024-09-10T08:30:56.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.459+0000 7ff8127fc640 1 -- 172.21.15.103:0/4096589618 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7fc032440 con 0x7ff8140c44e0 2024-09-10T08:30:56.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.459+0000 7ff8127fc640 1 -- 172.21.15.103:0/4096589618 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc02ae60 con 0x7ff8140c44e0 2024-09-10T08:30:56.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.459+0000 7ff81958d640 1 -- 172.21.15.103:0/4096589618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8140c44e0 msgr2=0x7ff81406f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:56.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.459+0000 7ff81958d640 1 --2- 172.21.15.103:0/4096589618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8140c44e0 0x7ff81406f470 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc0097a0 tx=0x7ff7fc02a110 comp rx=0 tx=0).stop 2024-09-10T08:30:56.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.459+0000 7ff81958d640 1 -- 172.21.15.103:0/4096589618 shutdown_connections 2024-09-10T08:30:56.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.459+0000 7ff81958d640 1 --2- 172.21.15.103:0/4096589618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8140c44e0 0x7ff81406f470 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.459+0000 7ff81958d640 1 -- 172.21.15.103:0/4096589618 >> 172.21.15.103:0/4096589618 conn(0x7ff8140c8410 msgr2=0x7ff8140c87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:56.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.459+0000 7ff81958d640 1 -- 172.21.15.103:0/4096589618 shutdown_connections 2024-09-10T08:30:56.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.459+0000 7ff81958d640 1 -- 172.21.15.103:0/4096589618 wait complete. 2024-09-10T08:30:56.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.461+0000 7ff81958d640 1 Processor -- start 2024-09-10T08:30:56.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.461+0000 7ff81958d640 1 -- start start 2024-09-10T08:30:56.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.462+0000 7ff81958d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81406f9b0 0x7ff8141dfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:56.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.462+0000 7ff81958d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8140c44e0 0x7ff8140733a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:56.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.462+0000 7ff81958d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff814150720 0x7ff8140738e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:56.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.462+0000 7ff81958d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff8140c37b0 con 0x7ff81406f9b0 2024-09-10T08:30:56.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.462+0000 7ff81958d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff814150b00 con 0x7ff814150720 2024-09-10T08:30:56.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.462+0000 7ff81958d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff8140c3930 con 0x7ff8140c44e0 2024-09-10T08:30:56.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.462+0000 7ff812ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81406f9b0 0x7ff8141dfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.462+0000 7ff812ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81406f9b0 0x7ff8141dfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40024/0 (socket says 172.21.15.103:40024) 2024-09-10T08:30:56.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.462+0000 7ff812ffd640 1 -- 172.21.15.103:0/257768778 learned_addr learned my addr 172.21.15.103:0/257768778 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:56.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.462+0000 7ff80a7fc640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8140c44e0 0x7ff8140733a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.462+0000 7ff8137fe640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff814150720 0x7ff8140738e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.462+0000 7ff80a7fc640 1 -- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8140c44e0 msgr2=0x7ff8140733a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-10T08:30:56.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.462+0000 7ff80a7fc640 1 -- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8140c44e0 msgr2=0x7ff8140733a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:30:56.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.462+0000 7ff80a7fc640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8140c44e0 0x7ff8140733a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:30:56.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.462+0000 7ff80a7fc640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8140c44e0 0x7ff8140733a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:30:56.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.462+0000 7ff812ffd640 1 -- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8140c44e0 msgr2=0x7ff8140733a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:30:56.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.462+0000 7ff812ffd640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8140c44e0 0x7ff8140733a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.462+0000 7ff812ffd640 1 -- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff814150720 msgr2=0x7ff8140738e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:56.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.462+0000 7ff812ffd640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff814150720 0x7ff8140738e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.462+0000 7ff812ffd640 1 -- 172.21.15.103:0/257768778 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8141deb30 con 0x7ff81406f9b0 2024-09-10T08:30:56.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.462+0000 7ff812ffd640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81406f9b0 0x7ff8141dfa80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff80400c390 tx=0x7ff80400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:56.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.462+0000 7ff80bfff640 1 -- 172.21.15.103:0/257768778 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff804017070 con 0x7ff81406f9b0 2024-09-10T08:30:56.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.463+0000 7ff80bfff640 1 -- 172.21.15.103:0/257768778 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8040052f0 con 0x7ff81406f9b0 2024-09-10T08:30:56.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.463+0000 7ff81958d640 1 -- 172.21.15.103:0/257768778 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8141dee10 con 0x7ff81406f9b0 2024-09-10T08:30:56.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.463+0000 7ff80bfff640 1 -- 172.21.15.103:0/257768778 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff804003830 con 0x7ff81406f9b0 2024-09-10T08:30:56.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.463+0000 7ff81958d640 1 -- 172.21.15.103:0/257768778 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff814072e80 con 0x7ff81406f9b0 2024-09-10T08:30:56.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.463+0000 7ff81958d640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff814073e20 0x7ff8141ebda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:56.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.463+0000 7ff81958d640 1 -- 172.21.15.103:0/257768778 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff8140730c0 con 0x7ff814073e20 2024-09-10T08:30:56.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.464+0000 7ff80a7fc640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff814073e20 0x7ff8141ebda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.464+0000 7ff80a7fc640 1 -- 172.21.15.103:0/257768778 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff8141df200 con 0x7ff814073e20 2024-09-10T08:30:56.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.464+0000 7ff80a7fc640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff814073e20 0x7ff8141ebda0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff8140ab260 tx=0x7ff7fc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:56.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.464+0000 7ff80bfff640 1 -- 172.21.15.103:0/257768778 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff80401a070 con 0x7ff81406f9b0 2024-09-10T08:30:56.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.465+0000 7ff80bfff640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff7f406be30 0x7ff7f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:56.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.465+0000 7ff8137fe640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff7f406be30 0x7ff7f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.465+0000 7ff80bfff640 1 -- 172.21.15.103:0/257768778 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc037040 con 0x7ff814073e20 2024-09-10T08:30:56.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.465+0000 7ff80bfff640 1 -- 172.21.15.103:0/257768778 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7ff80408a510 con 0x7ff81406f9b0 2024-09-10T08:30:56.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.465+0000 7ff80bfff640 1 -- 172.21.15.103:0/257768778 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff7fc03c660 con 0x7ff814073e20 2024-09-10T08:30:56.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.465+0000 7ff80bfff640 1 -- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff814073e20 msgr2=0x7ff8141ebda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:56.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.465+0000 7ff80bfff640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff814073e20 0x7ff8141ebda0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff8140ab260 tx=0x7ff7fc0046c0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.465+0000 7ff80bfff640 1 -- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff814073e20 msgr2=0x7ff8141ebda0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:30:56.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.465+0000 7ff80bfff640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff814073e20 0x7ff8141ebda0 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff8140ab260 tx=0x7ff7fc0046c0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.465+0000 7ff8137fe640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff7f406be30 0x7ff7f406e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff8140be5b0 tx=0x7ff80c001a10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:56.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.473+0000 7ff81958d640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8141dd520 0x7ff8141ec2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:56.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.473+0000 7ff81958d640 1 -- 172.21.15.103:0/257768778 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff8140c3ca0 con 0x7ff8141dd520 2024-09-10T08:30:56.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.473+0000 7ff80a7fc640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8141dd520 0x7ff8141ec2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.473+0000 7ff80a7fc640 1 -- 172.21.15.103:0/257768778 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff8141dffc0 con 0x7ff8141dd520 2024-09-10T08:30:56.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.474+0000 7ff80a7fc640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8141dd520 0x7ff8141ec2e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff8141544b0 tx=0x7ff7fc008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:56.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.474+0000 7ff80bfff640 1 -- 172.21.15.103:0/257768778 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc037070 con 0x7ff8141dd520 2024-09-10T08:30:56.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.474+0000 7ff80bfff640 1 -- 172.21.15.103:0/257768778 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4719 (secure 0 0 0) 0x7ff7fc0093c0 con 0x7ff8141dd520 2024-09-10T08:30:56.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.474+0000 7ff80bfff640 1 -- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8141dd520 msgr2=0x7ff8141ec2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:56.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.474+0000 7ff80bfff640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8141dd520 0x7ff8141ec2e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff8141544b0 tx=0x7ff7fc008030 comp rx=0 tx=0).stop 2024-09-10T08:30:56.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.474+0000 7ff80bfff640 1 -- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8141dd520 msgr2=0x7ff8141ec2e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:30:56.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.474+0000 7ff80bfff640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8141dd520 0x7ff8141ec2e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.474 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:30:56.474 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:30:56.474 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:30:56.474 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:30:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 16, 2024-09-10T08:30:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 62701, 2024-09-10T08:30:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:30:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:30:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:30:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:30:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:30:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:30:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:30:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:30:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:30:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:30:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:30:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:30:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:30:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:30:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:30:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:30:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:30:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:30:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:30:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:30:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:30:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:30:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:30:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:30:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:30:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:30:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:30:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:30:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:30:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:30:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:30:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:30:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:30:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:30:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:30:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:30:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:30:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:30:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:30:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:30:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:30:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:30:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:30:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:30:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:30:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:30:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:30:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:30:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:30:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:30:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:30:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:30:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:30:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:30:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:30:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:30:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:30:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:30:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:30:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:30:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:30:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:30:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:30:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:30:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:30:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:30:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:30:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:30:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:30:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:30:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:30:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:30:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:30:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:30:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:30:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:30:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:30:56.487 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:30:56.487 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:30:56.487 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:30:56.487 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:30:56.487 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:30:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.474+0000 7ff81958d640 1 -- 172.21.15.103:0/257768778 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff7f406be30 msgr2=0x7ff7f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.474+0000 7ff81958d640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff7f406be30 0x7ff7f406e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff8140be5b0 tx=0x7ff80c001a10 comp rx=0 tx=0).stop 2024-09-10T08:30:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.474+0000 7ff81958d640 1 -- 172.21.15.103:0/257768778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81406f9b0 msgr2=0x7ff8141dfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.474+0000 7ff81958d640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81406f9b0 0x7ff8141dfa80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff80400c390 tx=0x7ff80400c850 comp rx=0 tx=0).stop 2024-09-10T08:30:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.474+0000 7ff8137fe640 1 -- 172.21.15.103:0/257768778 reap_dead start 2024-09-10T08:30:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.474+0000 7ff81958d640 1 -- 172.21.15.103:0/257768778 shutdown_connections 2024-09-10T08:30:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.474+0000 7ff81958d640 1 --2- 172.21.15.103:0/257768778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81406f9b0 0x7ff8141dfa80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.474+0000 7ff81958d640 1 -- 172.21.15.103:0/257768778 >> 172.21.15.103:0/257768778 conn(0x7ff8140c8410 msgr2=0x7ff814152db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.475+0000 7ff81958d640 1 -- 172.21.15.103:0/257768778 shutdown_connections 2024-09-10T08:30:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.475+0000 7ff81958d640 1 -- 172.21.15.103:0/257768778 wait complete. 2024-09-10T08:30:56.489 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:30:56.489 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:30:56.489 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:30:56.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.599+0000 7f5060077640 1 Processor -- start 2024-09-10T08:30:56.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.599+0000 7f5060077640 1 -- start start 2024-09-10T08:30:56.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.600+0000 7f5060077640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50580c4680 0x7f5058156a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:56.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.600+0000 7f5060077640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5058156fc0 0x7f5058157410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:56.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.600+0000 7f5060077640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5058070590 con 0x7f50580acc30 2024-09-10T08:30:56.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.600+0000 7f5060077640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f50580c4ea0 con 0x7f5058156fc0 2024-09-10T08:30:56.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.600+0000 7f5060077640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f50580c4a60 con 0x7f50580c4680 2024-09-10T08:30:56.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.600+0000 7f505e614640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5058156fc0 0x7f5058157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.600+0000 7f505d612640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50580c4680 0x7f5058156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.600+0000 7f505de13640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f50580acc30 0x7f50580c3f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:39244/0 (socket says 172.21.15.103:39244) 2024-09-10T08:30:56.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.600+0000 7f505e614640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5058156fc0 0x7f5058157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:57228/0 (socket says 172.21.15.103:57228) 2024-09-10T08:30:56.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.600+0000 7f505de13640 1 -- 172.21.15.103:0/1900330431 learned_addr learned my addr 172.21.15.103:0/1900330431 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:30:56.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.600+0000 7f505d612640 1 -- 172.21.15.103:0/1900330431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50580c4680 msgr2=0x7f5058156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:30:56.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.600+0000 7f505d612640 1 -- 172.21.15.103:0/1900330431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50580c4680 msgr2=0x7f5058156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:30:56.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.600+0000 7f505d612640 1 --2- 172.21.15.103:0/1900330431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50580c4680 0x7f5058156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:30:56.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.600+0000 7f505d612640 1 --2- 172.21.15.103:0/1900330431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50580c4680 0x7f5058156a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:30:56.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.601+0000 7f505e614640 1 -- 172.21.15.103:0/1900330431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50580c4680 msgr2=0x7f5058156a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:30:56.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.601+0000 7f505e614640 1 --2- 172.21.15.103:0/1900330431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50580c4680 0x7f5058156a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.601+0000 7f505e614640 1 -- 172.21.15.103:0/1900330431 >> v1:172.21.15.154:6789/0 conn(0x7f50580acc30 legacy=0x7f50580c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:56.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.601+0000 7f505e614640 1 -- 172.21.15.103:0/1900330431 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50580a8220 con 0x7f5058156fc0 2024-09-10T08:30:56.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.601+0000 7f505ce11640 1 -- 172.21.15.103:0/1900330431 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2530567952 0 0) 0x7f5058070590 con 0x7f50580acc30 2024-09-10T08:30:56.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.601+0000 7f505e614640 1 --2- 172.21.15.103:0/1900330431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5058156fc0 0x7f5058157410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5050009d90 tx=0x7f505002a530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9b668fbe676081e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:56.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.602+0000 7f505ce11640 1 -- 172.21.15.103:0/1900330431 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5050007740 con 0x7f5058156fc0 2024-09-10T08:30:56.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.602+0000 7f505ce11640 1 -- 172.21.15.103:0/1900330431 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50500078e0 con 0x7f5058156fc0 2024-09-10T08:30:56.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.602+0000 7f505ce11640 1 -- 172.21.15.103:0/1900330431 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5050007cb0 con 0x7f5058156fc0 2024-09-10T08:30:56.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.602+0000 7f5060077640 1 -- 172.21.15.103:0/1900330431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5058156fc0 msgr2=0x7f5058157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:56.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.602+0000 7f5060077640 1 --2- 172.21.15.103:0/1900330431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5058156fc0 0x7f5058157410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5050009d90 tx=0x7f505002a530 comp rx=0 tx=0).stop 2024-09-10T08:30:56.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.602+0000 7f5060077640 1 -- 172.21.15.103:0/1900330431 shutdown_connections 2024-09-10T08:30:56.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.602+0000 7f5060077640 1 --2- 172.21.15.103:0/1900330431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5058156fc0 0x7f5058157410 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.602+0000 7f5060077640 1 --2- 172.21.15.103:0/1900330431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50580c4680 0x7f5058156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.602+0000 7f5060077640 1 -- 172.21.15.103:0/1900330431 >> 172.21.15.103:0/1900330431 conn(0x7f50580c5660 msgr2=0x7f50580c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:56.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.602+0000 7f5060077640 1 -- 172.21.15.103:0/1900330431 shutdown_connections 2024-09-10T08:30:56.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.602+0000 7f5060077640 1 -- 172.21.15.103:0/1900330431 wait complete. 2024-09-10T08:30:56.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.604+0000 7f5060077640 1 Processor -- start 2024-09-10T08:30:56.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.604+0000 7f5060077640 1 -- start start 2024-09-10T08:30:56.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.605+0000 7f5060077640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50580acc30 0x7f505809ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:56.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.605+0000 7f5060077640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50580c4680 0x7f505806ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:56.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.605+0000 7f5060077640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5058156fc0 0x7f50580c2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:56.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.605+0000 7f5060077640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f50580702b0 con 0x7f50580acc30 2024-09-10T08:30:56.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.605+0000 7f5060077640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f505806ffd0 con 0x7f50580c4680 2024-09-10T08:30:56.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.605+0000 7f5060077640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f50580c5330 con 0x7f5058156fc0 2024-09-10T08:30:56.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.605+0000 7f505de13640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50580acc30 0x7f505809ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.605+0000 7f505de13640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50580acc30 0x7f505809ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40036/0 (socket says 172.21.15.103:40036) 2024-09-10T08:30:56.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.605+0000 7f505de13640 1 -- 172.21.15.103:0/2847489003 learned_addr learned my addr 172.21.15.103:0/2847489003 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:30:56.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.605+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50580c4680 0x7f505806ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.605+0000 7f505e614640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5058156fc0 0x7f50580c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.605+0000 7f505e614640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5058156fc0 msgr2=0x7f50580c2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-10T08:30:56.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.605+0000 7f505e614640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5058156fc0 msgr2=0x7f50580c2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:30:56.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.605+0000 7f505e614640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5058156fc0 0x7f50580c2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:30:56.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.605+0000 7f505e614640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5058156fc0 0x7f50580c2200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:30:56.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.605+0000 7f505de13640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5058156fc0 msgr2=0x7f50580c2200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:30:56.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.605+0000 7f505de13640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5058156fc0 0x7f50580c2200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.605+0000 7f505de13640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50580c4680 msgr2=0x7f505806ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:56.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.605+0000 7f505de13640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50580c4680 0x7f505806ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:56.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.605+0000 7f505de13640 1 -- 172.21.15.103:0/2847489003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505806d230 con 0x7f50580acc30 2024-09-10T08:30:56.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.605+0000 7f505de13640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50580acc30 0x7f505809ffe0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f505400c400 tx=0x7f505400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:56.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.605+0000 7f504e7fc640 1 -- 172.21.15.103:0/2847489003 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5054017070 con 0x7f50580acc30 2024-09-10T08:30:56.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.606+0000 7f5060077640 1 -- 172.21.15.103:0/2847489003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f505809d320 con 0x7f50580acc30 2024-09-10T08:30:56.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.606+0000 7f504e7fc640 1 -- 172.21.15.103:0/2847489003 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5054005ce0 con 0x7f50580acc30 2024-09-10T08:30:56.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.606+0000 7f504e7fc640 1 -- 172.21.15.103:0/2847489003 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5054007310 con 0x7f50580acc30 2024-09-10T08:30:56.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.606+0000 7f5060077640 1 -- 172.21.15.103:0/2847489003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f505809dd20 con 0x7f50580acc30 2024-09-10T08:30:56.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.607+0000 7f5060077640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 0x7f505809e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:56.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.607+0000 7f5060077640 1 -- 172.21.15.103:0/2847489003 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f505809d0d0 con 0x7f505809ca00 2024-09-10T08:30:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.607+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 0x7f505809e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.607+0000 7f505d612640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 msgr2=0x7f505809e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-09-10T08:30:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.607+0000 7f505d612640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 msgr2=0x7f505809e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:30:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.607+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 0x7f505809e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:30:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.607+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 0x7f505809e240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:30:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.607+0000 7f504e7fc640 1 -- 172.21.15.103:0/2847489003 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f505401a070 con 0x7f50580acc30 2024-09-10T08:30:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.608+0000 7f504e7fc640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f503c06be60 0x7f503c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.608+0000 7f505e614640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f503c06be60 0x7f503c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.608+0000 7f504e7fc640 1 -- 172.21.15.103:0/2847489003 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f505408a600 con 0x7f50580acc30 2024-09-10T08:30:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.608+0000 7f505e614640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f503c06be60 0x7f503c06e320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5050034000 tx=0x7f5050033040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:56.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.808+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 0x7f505809e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:56.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.808+0000 7f505d612640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 msgr2=0x7f505809e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-10T08:30:56.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.808+0000 7f505d612640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 msgr2=0x7f505809e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:30:56.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.808+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 0x7f505809e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:30:56.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:56.808+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 0x7f505809e240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:30:57.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:57.209+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 0x7f505809e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:57.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:57.209+0000 7f505d612640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 msgr2=0x7f505809e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-10T08:30:57.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:57.209+0000 7f505d612640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 msgr2=0x7f505809e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:30:57.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:57.209+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 0x7f505809e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:30:57.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:57.209+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 0x7f505809e240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:30:58.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:58.010+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 0x7f505809e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:58.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:58.010+0000 7f505d612640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 msgr2=0x7f505809e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-10T08:30:58.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:58.010+0000 7f505d612640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 msgr2=0x7f505809e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:30:58.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:58.010+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 0x7f505809e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:30:58.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:58.010+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 0x7f505809e240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:30:59.063 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:30:59.066 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:30:59.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:59.612+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 0x7f505809e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:59.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:59.612+0000 7f505d612640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 msgr2=0x7f505809e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-10T08:30:59.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:59.612+0000 7f505d612640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 msgr2=0x7f505809e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:30:59.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:59.612+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 0x7f505809e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:30:59.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:30:59.612+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 0x7f505809e240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-10T08:31:00.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:00.605+0000 7f504d7fa640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 msgr2=0x7f505809e240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:31:00.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:00.605+0000 7f504d7fa640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 0x7f505809e240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:00.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:00.605+0000 7f504d7fa640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5034003540 0x7f50340059d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:00.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:00.605+0000 7f504d7fa640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 msgr2=0x7f505809e240 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:31:00.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:00.605+0000 7f504d7fa640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f505809ca00 0x7f505809e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:00.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:00.605+0000 7f504d7fa640 1 -- 172.21.15.103:0/2847489003 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f505809d0d0 con 0x7f5034003540 2024-09-10T08:31:00.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:00.605+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5034003540 0x7f50340059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:00.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:00.605+0000 7f505d612640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5034003540 msgr2=0x7f50340059d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-10T08:31:00.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:00.605+0000 7f505d612640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5034003540 msgr2=0x7f50340059d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:31:00.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:00.605+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5034003540 0x7f50340059d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:31:00.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:00.605+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5034003540 0x7f50340059d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:31:00.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:00.806+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5034003540 0x7f50340059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:00.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:00.806+0000 7f505d612640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5034003540 msgr2=0x7f50340059d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-10T08:31:00.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:00.806+0000 7f505d612640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5034003540 msgr2=0x7f50340059d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:31:00.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:00.806+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5034003540 0x7f50340059d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:31:00.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:00.806+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5034003540 0x7f50340059d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:31:01.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.207+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5034003540 0x7f50340059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:01.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.207+0000 7f505d612640 1 -- 172.21.15.103:0/2847489003 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f50340060b0 con 0x7f5034003540 2024-09-10T08:31:01.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.207+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5034003540 0x7f50340059d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5058157970 tx=0x7f5048017ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:01.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.208+0000 7f504e7fc640 1 -- 172.21.15.103:0/2847489003 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048016de0 con 0x7f5034003540 2024-09-10T08:31:01.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.208+0000 7f504e7fc640 1 -- 172.21.15.103:0/2847489003 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5048016de0 con 0x7f5034003540 2024-09-10T08:31:01.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.208+0000 7f504e7fc640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5034003540 msgr2=0x7f50340059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:01.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.208+0000 7f504e7fc640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5034003540 0x7f50340059d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5058157970 tx=0x7f5048017ee0 comp rx=0 tx=0).stop 2024-09-10T08:31:01.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.208+0000 7f504e7fc640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5034003540 msgr2=0x7f50340059d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:31:01.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.208+0000 7f504e7fc640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5034003540 0x7f50340059d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:01.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.216+0000 7f5060077640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5058152fc0 0x7f50581533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:01.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.216+0000 7f5060077640 1 -- 172.21.15.103:0/2847489003 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f50580c63f0 con 0x7f5058152fc0 2024-09-10T08:31:01.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.216+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5058152fc0 0x7f50581533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:01.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.217+0000 7f505d612640 1 -- 172.21.15.103:0/2847489003 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5058072510 con 0x7f5058152fc0 2024-09-10T08:31:01.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.217+0000 7f505d612640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5058152fc0 0x7f50581533d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f50580a90a0 tx=0x7f5048004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:01.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.217+0000 7f504e7fc640 1 -- 172.21.15.103:0/2847489003 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048026050 con 0x7f5058152fc0 2024-09-10T08:31:01.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.217+0000 7f504e7fc640 1 -- 172.21.15.103:0/2847489003 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4551 (secure 0 0 0) 0x7f5048027040 con 0x7f5058152fc0 2024-09-10T08:31:01.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.217+0000 7f504e7fc640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5058152fc0 msgr2=0x7f50581533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:01.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.217+0000 7f504e7fc640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5058152fc0 0x7f50581533d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f50580a90a0 tx=0x7f5048004730 comp rx=0 tx=0).stop 2024-09-10T08:31:01.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.217+0000 7f504e7fc640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5058152fc0 msgr2=0x7f50581533d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:31:01.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.217+0000 7f504e7fc640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5058152fc0 0x7f50581533d0 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f50580a90a0 tx=0x7f5048004730 comp rx=0 tx=0).stop 2024-09-10T08:31:01.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.217+0000 7f505e614640 1 -- 172.21.15.103:0/2847489003 reap_dead start 2024-09-10T08:31:01.218 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:31:01.218 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:31:01.218 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:31:01.218 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:31:01.218 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 16, 2024-09-10T08:31:01.218 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 5375, 2024-09-10T08:31:01.219 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:31:01.219 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:31:01.219 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:31:01.219 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:31:01.219 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:01.219 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 5, 2024-09-10T08:31:01.219 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:31:01.219 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:31:01.219 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:31:01.219 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:01.219 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:01.219 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:01.220 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:01.220 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:01.220 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:01.220 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:01.220 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:01.220 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:01.220 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:01.220 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:01.220 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:01.220 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:31:01.221 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:31:01.221 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:01.221 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:01.221 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:01.221 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:01.221 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:01.221 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:01.221 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:01.221 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:01.222 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:01.222 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:01.222 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:01.222 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:01.222 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:01.222 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:31:01.222 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:31:01.222 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:31:01.222 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:31:01.222 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:31:01.222 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:31:01.222 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:31:01.223 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:31:01.223 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:31:01.223 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:31:01.223 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:31:01.223 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:31:01.223 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:31:01.223 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:31:01.223 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:31:01.223 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:31:01.223 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:31:01.223 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:01.223 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:01.223 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:01.223 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:01.224 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:01.224 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:01.224 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:01.224 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:01.224 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:01.224 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:01.224 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:01.224 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:01.224 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:31:01.224 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:01.224 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:31:01.224 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:01.225 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:31:01.225 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:31:01.225 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:01.225 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:01.225 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:01.225 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:01.225 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:31:01.225 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:01.225 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:01.225 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:01.225 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:01.225 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:31:01.225 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:01.226 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:01.226 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:01.226 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:01.226 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:31:01.226 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:31:01.226 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:01.226 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:01.226 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:01.226 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:01.226 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:01.226 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:31:01.226 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:31:01.226 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:01.227 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:01.227 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:01.227 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:01.227 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:31:01.227 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:01.227 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:01.227 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:01.227 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:01.227 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:31:01.227 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:01.227 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:01.227 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:01.227 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:01.228 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:31:01.228 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:31:01.228 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:01.228 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:01.228 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:01.228 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:01.228 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:01.228 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:31:01.228 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:31:01.228 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:01.228 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:01.228 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:01.229 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:01.229 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:31:01.229 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:01.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:01.229 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:01.229 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:01.229 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:31:01.229 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:01.229 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:01.229 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:01.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:01.230 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:31:01.230 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:31:01.230 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:01.230 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:01.230 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:01.230 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:01.230 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:01.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:01.230 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:31:01.230 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:31:01.231 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:01.231 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:01.231 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:01.231 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:31:01.231 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:01.231 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:01.231 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:31:01.231 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:01.231 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:01.231 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:01.232 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:31:01.232 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:01.232 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:01.232 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:01.232 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:31:01.232 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:31:01.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.218+0000 7f5060077640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f503c06be60 msgr2=0x7f503c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:01.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.218+0000 7f5060077640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f503c06be60 0x7f503c06e320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5050034000 tx=0x7f5050033040 comp rx=0 tx=0).stop 2024-09-10T08:31:01.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.218+0000 7f5060077640 1 -- 172.21.15.103:0/2847489003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50580acc30 msgr2=0x7f505809ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:01.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.218+0000 7f5060077640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50580acc30 0x7f505809ffe0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f505400c400 tx=0x7f505400c8c0 comp rx=0 tx=0).stop 2024-09-10T08:31:01.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.218+0000 7f5060077640 1 -- 172.21.15.103:0/2847489003 shutdown_connections 2024-09-10T08:31:01.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.218+0000 7f5060077640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f503c06be60 0x7f503c06e320 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:01.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.218+0000 7f5060077640 1 --2- 172.21.15.103:0/2847489003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50580acc30 0x7f505809ffe0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:01.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.218+0000 7f5060077640 1 -- 172.21.15.103:0/2847489003 >> 172.21.15.103:0/2847489003 conn(0x7f50580c5660 msgr2=0x7f50580c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:01.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.218+0000 7f5060077640 1 -- 172.21.15.103:0/2847489003 shutdown_connections 2024-09-10T08:31:01.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.218+0000 7f5060077640 1 -- 172.21.15.103:0/2847489003 wait complete. 2024-09-10T08:31:01.235 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:31:01.235 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-10T08:31:01.235 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-10T08:31:01.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.348+0000 7f482cad2640 1 Processor -- start 2024-09-10T08:31:01.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.348+0000 7f482cad2640 1 -- start start 2024-09-10T08:31:01.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.349+0000 7f482cad2640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f482806c650 0x7f48280c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:01.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.349+0000 7f482cad2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48280ca1c0 0x7f4828160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:01.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.349+0000 7f482cad2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f482815a7c0 con 0x7f4828150480 2024-09-10T08:31:01.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.349+0000 7f482cad2640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f482806c240 con 0x7f482806c650 2024-09-10T08:31:01.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.349+0000 7f482cad2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f482815a330 con 0x7f48280ca1c0 2024-09-10T08:31:01.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.349+0000 7f4825d9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f482806c650 0x7f48280c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:01.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.349+0000 7f4825d9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f482806c650 0x7f48280c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40048/0 (socket says 172.21.15.103:40048) 2024-09-10T08:31:01.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.349+0000 7f4825d9b640 1 -- 172.21.15.103:0/531660189 learned_addr learned my addr 172.21.15.103:0/531660189 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:01.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.349+0000 7f4826d9d640 1 --2- 172.21.15.103:0/531660189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48280ca1c0 0x7f4828160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:01.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.349+0000 7f4825d9b640 1 -- 172.21.15.103:0/531660189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48280ca1c0 msgr2=0x7f4828160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:01.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.349+0000 7f4825d9b640 1 --2- 172.21.15.103:0/531660189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48280ca1c0 0x7f4828160bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:01.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.349+0000 7f4825d9b640 1 -- 172.21.15.103:0/531660189 >> v1:172.21.15.154:6789/0 conn(0x7f4828150480 legacy=0x7f48280c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:01.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.349+0000 7f4825d9b640 1 -- 172.21.15.103:0/531660189 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4828159a00 con 0x7f482806c650 2024-09-10T08:31:01.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.350+0000 7f4825d9b640 1 --2- 172.21.15.103:0/531660189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f482806c650 0x7f48280c9c80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f481c009870 tx=0x7f481c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241e4fb2f38c4b17 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:01.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.350+0000 7f482559a640 1 -- 172.21.15.103:0/531660189 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481c037070 con 0x7f482806c650 2024-09-10T08:31:01.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.350+0000 7f482559a640 1 -- 172.21.15.103:0/531660189 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f481c032440 con 0x7f482806c650 2024-09-10T08:31:01.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.350+0000 7f482559a640 1 -- 172.21.15.103:0/531660189 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481c032810 con 0x7f482806c650 2024-09-10T08:31:01.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.351+0000 7f482cad2640 1 -- 172.21.15.103:0/531660189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f482806c650 msgr2=0x7f48280c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:01.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.351+0000 7f482cad2640 1 --2- 172.21.15.103:0/531660189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f482806c650 0x7f48280c9c80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f481c009870 tx=0x7f481c02a270 comp rx=0 tx=0).stop 2024-09-10T08:31:01.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.351+0000 7f482cad2640 1 -- 172.21.15.103:0/531660189 shutdown_connections 2024-09-10T08:31:01.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.351+0000 7f482cad2640 1 --2- 172.21.15.103:0/531660189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48280ca1c0 0x7f4828160bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:01.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.351+0000 7f482cad2640 1 --2- 172.21.15.103:0/531660189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f482806c650 0x7f48280c9c80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:01.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.351+0000 7f482cad2640 1 -- 172.21.15.103:0/531660189 >> 172.21.15.103:0/531660189 conn(0x7f4828068030 msgr2=0x7f4828073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:01.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.351+0000 7f482cad2640 1 -- 172.21.15.103:0/531660189 shutdown_connections 2024-09-10T08:31:01.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.351+0000 7f482cad2640 1 -- 172.21.15.103:0/531660189 wait complete. 2024-09-10T08:31:01.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.352+0000 7f482cad2640 1 Processor -- start 2024-09-10T08:31:01.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.353+0000 7f482cad2640 1 -- start start 2024-09-10T08:31:01.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.353+0000 7f482cad2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f482806c650 0x7f4828158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:01.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.353+0000 7f482cad2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48280ca1c0 0x7f48280b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:01.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.353+0000 7f482cad2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4828150480 0x7f4828149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:01.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.354+0000 7f482cad2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f48280ca630 con 0x7f48280ca1c0 2024-09-10T08:31:01.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.354+0000 7f482cad2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4828159fc0 con 0x7f4828150480 2024-09-10T08:31:01.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.354+0000 7f482cad2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f482806d270 con 0x7f482806c650 2024-09-10T08:31:01.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.354+0000 7f4825d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48280ca1c0 0x7f48280b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:01.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.354+0000 7f4825d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48280ca1c0 0x7f48280b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40062/0 (socket says 172.21.15.103:40062) 2024-09-10T08:31:01.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.354+0000 7f482659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f482806c650 0x7f4828158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:01.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.354+0000 7f4825d9b640 1 -- 172.21.15.103:0/1925018558 learned_addr learned my addr 172.21.15.103:0/1925018558 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:01.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.354+0000 7f4826d9d640 1 --2- 172.21.15.103:0/1925018558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4828150480 0x7f4828149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:01.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.354+0000 7f4825d9b640 1 -- 172.21.15.103:0/1925018558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f482806c650 msgr2=0x7f4828158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:01.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.354+0000 7f4825d9b640 1 --2- 172.21.15.103:0/1925018558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f482806c650 0x7f4828158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:01.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.354+0000 7f4825d9b640 1 -- 172.21.15.103:0/1925018558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4828150480 msgr2=0x7f4828149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:01.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.354+0000 7f4825d9b640 1 --2- 172.21.15.103:0/1925018558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4828150480 0x7f4828149790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:01.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.354+0000 7f4825d9b640 1 -- 172.21.15.103:0/1925018558 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48280afa40 con 0x7f48280ca1c0 2024-09-10T08:31:01.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.354+0000 7f4825d9b640 1 --2- 172.21.15.103:0/1925018558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48280ca1c0 0x7f48280b00e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f481c000c00 tx=0x7f481c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:01.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.355+0000 7f4816ffd640 1 -- 172.21.15.103:0/1925018558 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481c037040 con 0x7f48280ca1c0 2024-09-10T08:31:01.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.355+0000 7f4816ffd640 1 -- 172.21.15.103:0/1925018558 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f481c042070 con 0x7f48280ca1c0 2024-09-10T08:31:01.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.355+0000 7f482cad2640 1 -- 172.21.15.103:0/1925018558 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48280aec80 con 0x7f48280ca1c0 2024-09-10T08:31:01.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.355+0000 7f4816ffd640 1 -- 172.21.15.103:0/1925018558 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481c030880 con 0x7f48280ca1c0 2024-09-10T08:31:01.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.355+0000 7f482cad2640 1 -- 172.21.15.103:0/1925018558 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48280af240 con 0x7f48280ca1c0 2024-09-10T08:31:01.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.356+0000 7f4816ffd640 1 -- 172.21.15.103:0/1925018558 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f481c030a20 con 0x7f48280ca1c0 2024-09-10T08:31:01.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.356+0000 7f482cad2640 1 -- 172.21.15.103:0/1925018558 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4828156270 con 0x7f48280ca1c0 2024-09-10T08:31:01.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.357+0000 7f4816ffd640 1 --2- 172.21.15.103:0/1925018558 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f480806be80 0x7f480806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:01.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.357+0000 7f4816ffd640 1 -- 172.21.15.103:0/1925018558 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f481c0ab7b0 con 0x7f48280ca1c0 2024-09-10T08:31:01.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.357+0000 7f482659c640 1 --2- 172.21.15.103:0/1925018558 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f480806be80 0x7f480806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:01.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.357+0000 7f482659c640 1 --2- 172.21.15.103:0/1925018558 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f480806be80 0x7f480806e340 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4818001780 tx=0x7f4818009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:01.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.363+0000 7f4816ffd640 1 -- 172.21.15.103:0/1925018558 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f481c079850 con 0x7f48280ca1c0 2024-09-10T08:31:01.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.646+0000 7f482cad2640 1 -- 172.21.15.103:0/1925018558 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f482806c430 con 0x7f48280ca1c0 2024-09-10T08:31:01.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.646+0000 7f4816ffd640 1 -- 172.21.15.103:0/1925018558 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f481c07db50 con 0x7f48280ca1c0 2024-09-10T08:31:01.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.649+0000 7f482cad2640 1 -- 172.21.15.103:0/1925018558 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f480806be80 msgr2=0x7f480806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:01.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.649+0000 7f482cad2640 1 --2- 172.21.15.103:0/1925018558 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f480806be80 0x7f480806e340 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4818001780 tx=0x7f4818009040 comp rx=0 tx=0).stop 2024-09-10T08:31:01.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.649+0000 7f482cad2640 1 -- 172.21.15.103:0/1925018558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48280ca1c0 msgr2=0x7f48280b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:01.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.649+0000 7f482cad2640 1 --2- 172.21.15.103:0/1925018558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48280ca1c0 0x7f48280b00e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f481c000c00 tx=0x7f481c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:01.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.649+0000 7f482cad2640 1 -- 172.21.15.103:0/1925018558 shutdown_connections 2024-09-10T08:31:01.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.649+0000 7f482cad2640 1 --2- 172.21.15.103:0/1925018558 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f480806be80 0x7f480806e340 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:01.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.649+0000 7f482cad2640 1 --2- 172.21.15.103:0/1925018558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4828150480 0x7f4828149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:01.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.649+0000 7f482cad2640 1 --2- 172.21.15.103:0/1925018558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48280ca1c0 0x7f48280b00e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:01.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.649+0000 7f482cad2640 1 --2- 172.21.15.103:0/1925018558 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f482806c650 0x7f4828158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:01.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.649+0000 7f482cad2640 1 -- 172.21.15.103:0/1925018558 >> 172.21.15.103:0/1925018558 conn(0x7f4828068030 msgr2=0x7f48281557a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:01.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.649+0000 7f482cad2640 1 -- 172.21.15.103:0/1925018558 shutdown_connections 2024-09-10T08:31:01.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:01.649+0000 7f482cad2640 1 -- 172.21.15.103:0/1925018558 wait complete. 2024-09-10T08:31:01.661 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-10T08:31:11.661 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:31:11.662 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:31:11.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.769+0000 7f7101ed0640 1 Processor -- start 2024-09-10T08:31:11.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.769+0000 7f7101ed0640 1 -- start start 2024-09-10T08:31:11.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.770+0000 7f7101ed0640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70fc0aeb10 0x7f70fc156c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:11.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.770+0000 7f7101ed0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70fc0c7ef0 0x7f70fc0c4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:11.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.770+0000 7f7101ed0640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70fc0a7cc0 con 0x7f70fc0c7a90 2024-09-10T08:31:11.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.770+0000 7f7101ed0640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f70fc0c3580 con 0x7f70fc0aeb10 2024-09-10T08:31:11.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.770+0000 7f7101ed0640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f70fc0c3860 con 0x7f70fc0c7ef0 2024-09-10T08:31:11.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.770+0000 7f70fb7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70fc0aeb10 0x7f70fc156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:11.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.770+0000 7f70fb7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70fc0aeb10 0x7f70fc156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40334/0 (socket says 172.21.15.103:40334) 2024-09-10T08:31:11.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.770+0000 7f70fb7fe640 1 -- 172.21.15.103:0/2404256603 learned_addr learned my addr 172.21.15.103:0/2404256603 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:11.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.770+0000 7f70fbfff640 1 --2- 172.21.15.103:0/2404256603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70fc0c7ef0 0x7f70fc0c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:11.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.770+0000 7f70fb7fe640 1 -- 172.21.15.103:0/2404256603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70fc0c7ef0 msgr2=0x7f70fc0c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:11.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.770+0000 7f70fb7fe640 1 --2- 172.21.15.103:0/2404256603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70fc0c7ef0 0x7f70fc0c4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:11.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.770+0000 7f70fb7fe640 1 -- 172.21.15.103:0/2404256603 >> v1:172.21.15.103:6789/0 conn(0x7f70fc0c7a90 legacy=0x7f70fc0c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:11.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.770+0000 7f70fb7fe640 1 -- 172.21.15.103:0/2404256603 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70fc157160 con 0x7f70fc0aeb10 2024-09-10T08:31:11.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.770+0000 7f70fbfff640 1 --2- 172.21.15.103:0/2404256603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70fc0c7ef0 0x7f70fc0c4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:11.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.771+0000 7f70fb7fe640 1 --2- 172.21.15.103:0/2404256603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70fc0aeb10 0x7f70fc156c20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0c3700 tx=0x7f70ec02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f94af8936d0897b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:11.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.771+0000 7f70fa7fc640 1 -- 172.21.15.103:0/2404256603 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec037070 con 0x7f70fc0aeb10 2024-09-10T08:31:11.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.771+0000 7f70fa7fc640 1 -- 172.21.15.103:0/2404256603 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70ec032440 con 0x7f70fc0aeb10 2024-09-10T08:31:11.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.771+0000 7f70fa7fc640 1 -- 172.21.15.103:0/2404256603 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec032810 con 0x7f70fc0aeb10 2024-09-10T08:31:11.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.772+0000 7f7101ed0640 1 -- 172.21.15.103:0/2404256603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70fc0aeb10 msgr2=0x7f70fc156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:11.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.772+0000 7f7101ed0640 1 --2- 172.21.15.103:0/2404256603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70fc0aeb10 0x7f70fc156c20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0c3700 tx=0x7f70ec02a130 comp rx=0 tx=0).stop 2024-09-10T08:31:11.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.772+0000 7f7101ed0640 1 -- 172.21.15.103:0/2404256603 shutdown_connections 2024-09-10T08:31:11.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.772+0000 7f7101ed0640 1 --2- 172.21.15.103:0/2404256603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70fc0c7ef0 0x7f70fc0c4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:11.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.772+0000 7f7101ed0640 1 --2- 172.21.15.103:0/2404256603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70fc0aeb10 0x7f70fc156c20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:11.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.772+0000 7f7101ed0640 1 -- 172.21.15.103:0/2404256603 >> 172.21.15.103:0/2404256603 conn(0x7f70fc0c5680 msgr2=0x7f70fc0c5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:11.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.772+0000 7f7101ed0640 1 -- 172.21.15.103:0/2404256603 shutdown_connections 2024-09-10T08:31:11.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.772+0000 7f7101ed0640 1 -- 172.21.15.103:0/2404256603 wait complete. 2024-09-10T08:31:11.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.773+0000 7f7101ed0640 1 Processor -- start 2024-09-10T08:31:11.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.774+0000 7f7101ed0640 1 -- start start 2024-09-10T08:31:11.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.774+0000 7f7101ed0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70fc0aeb10 0x7f70fc1ec840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:11.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.774+0000 7f7101ed0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70fc0c7a90 0x7f70fc1e2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:11.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.774+0000 7f7101ed0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70fc0c7ef0 0x7f70fc1dfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:11.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.774+0000 7f7101ed0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f70fc0a8520 con 0x7f70fc0aeb10 2024-09-10T08:31:11.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.775+0000 7f7101ed0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70fc0a8240 con 0x7f70fc0c7a90 2024-09-10T08:31:11.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.775+0000 7f7101ed0640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f70fc0c4940 con 0x7f70fc0c7ef0 2024-09-10T08:31:11.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.775+0000 7f70fb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70fc0aeb10 0x7f70fc1ec840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:11.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.775+0000 7f70fb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70fc0aeb10 0x7f70fc1ec840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40340/0 (socket says 172.21.15.103:40340) 2024-09-10T08:31:11.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.775+0000 7f70fb7fe640 1 -- 172.21.15.103:0/3143078314 learned_addr learned my addr 172.21.15.103:0/3143078314 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:11.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.775+0000 7f70fbfff640 1 --2- 172.21.15.103:0/3143078314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70fc0c7ef0 0x7f70fc1dfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:11.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.775+0000 7f70fb7fe640 1 -- 172.21.15.103:0/3143078314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70fc0c7ef0 msgr2=0x7f70fc1dfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:11.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.775+0000 7f70fb7fe640 1 --2- 172.21.15.103:0/3143078314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70fc0c7ef0 0x7f70fc1dfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:11.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.775+0000 7f70fb7fe640 1 -- 172.21.15.103:0/3143078314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70fc0c7a90 msgr2=0x7f70fc1e2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:11.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.775+0000 7f70fb7fe640 1 --2- 172.21.15.103:0/3143078314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70fc0c7a90 0x7f70fc1e2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:11.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.775+0000 7f70fb7fe640 1 -- 172.21.15.103:0/3143078314 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70fc15a1f0 con 0x7f70fc0aeb10 2024-09-10T08:31:11.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.775+0000 7f70fbfff640 1 --2- 172.21.15.103:0/3143078314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70fc0c7ef0 0x7f70fc1dfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:11.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.776+0000 7f70fb7fe640 1 --2- 172.21.15.103:0/3143078314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70fc0aeb10 0x7f70fc1ec840 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f70ec02a170 tx=0x7f70ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:11.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.776+0000 7f70e3fff640 1 -- 172.21.15.103:0/3143078314 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec041020 con 0x7f70fc0aeb10 2024-09-10T08:31:11.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.776+0000 7f7101ed0640 1 -- 172.21.15.103:0/3143078314 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70fc1ecd80 con 0x7f70fc0aeb10 2024-09-10T08:31:11.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.776+0000 7f70e3fff640 1 -- 172.21.15.103:0/3143078314 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70ec0306c0 con 0x7f70fc0aeb10 2024-09-10T08:31:11.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.776+0000 7f70e3fff640 1 -- 172.21.15.103:0/3143078314 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec037040 con 0x7f70fc0aeb10 2024-09-10T08:31:11.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.776+0000 7f7101ed0640 1 -- 172.21.15.103:0/3143078314 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70fc1e3500 con 0x7f70fc0aeb10 2024-09-10T08:31:11.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.777+0000 7f7101ed0640 1 -- 172.21.15.103:0/3143078314 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70fc0c5240 con 0x7f70fc0aeb10 2024-09-10T08:31:11.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.778+0000 7f70e3fff640 1 -- 172.21.15.103:0/3143078314 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f70ec044020 con 0x7f70fc0aeb10 2024-09-10T08:31:11.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.779+0000 7f70e3fff640 1 --2- 172.21.15.103:0/3143078314 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f70e806be30 0x7f70e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:11.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.779+0000 7f70e3fff640 1 -- 172.21.15.103:0/3143078314 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f70ec0aba10 con 0x7f70fc0aeb10 2024-09-10T08:31:11.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.779+0000 7f70faffd640 1 --2- 172.21.15.103:0/3143078314 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f70e806be30 0x7f70e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:11.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.780+0000 7f70faffd640 1 --2- 172.21.15.103:0/3143078314 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f70e806be30 0x7f70e806e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f70f0000f60 tx=0x7f70f00079d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:11.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:11.787+0000 7f70e3fff640 1 -- 172.21.15.103:0/3143078314 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f70ec04b030 con 0x7f70fc0aeb10 2024-09-10T08:31:12.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.065+0000 7f7101ed0640 1 -- 172.21.15.103:0/3143078314 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f70fc0704b0 con 0x7f70fc0aeb10 2024-09-10T08:31:12.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.066+0000 7f70e3fff640 1 -- 172.21.15.103:0/3143078314 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f70ec07a0b0 con 0x7f70fc0aeb10 2024-09-10T08:31:12.066 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":16,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:31:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.068+0000 7f7101ed0640 1 -- 172.21.15.103:0/3143078314 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f70e806be30 msgr2=0x7f70e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.068+0000 7f7101ed0640 1 --2- 172.21.15.103:0/3143078314 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f70e806be30 0x7f70e806e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f70f0000f60 tx=0x7f70f00079d0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.068+0000 7f7101ed0640 1 -- 172.21.15.103:0/3143078314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70fc0aeb10 msgr2=0x7f70fc1ec840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.068+0000 7f7101ed0640 1 --2- 172.21.15.103:0/3143078314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70fc0aeb10 0x7f70fc1ec840 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f70ec02a170 tx=0x7f70ec0046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.068+0000 7f7101ed0640 1 -- 172.21.15.103:0/3143078314 shutdown_connections 2024-09-10T08:31:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.068+0000 7f7101ed0640 1 --2- 172.21.15.103:0/3143078314 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f70e806be30 0x7f70e806e2f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.068+0000 7f7101ed0640 1 --2- 172.21.15.103:0/3143078314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70fc0c7ef0 0x7f70fc1dfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.068+0000 7f7101ed0640 1 --2- 172.21.15.103:0/3143078314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70fc0c7a90 0x7f70fc1e2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.068+0000 7f7101ed0640 1 --2- 172.21.15.103:0/3143078314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70fc0aeb10 0x7f70fc1ec840 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.068+0000 7f7101ed0640 1 -- 172.21.15.103:0/3143078314 >> 172.21.15.103:0/3143078314 conn(0x7f70fc0c5680 msgr2=0x7f70fc0a9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.068+0000 7f7101ed0640 1 -- 172.21.15.103:0/3143078314 shutdown_connections 2024-09-10T08:31:12.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.068+0000 7f7101ed0640 1 -- 172.21.15.103:0/3143078314 wait complete. 2024-09-10T08:31:12.080 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:31:12.080 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-10T08:31:12.081 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:31:12.081 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:31:12.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.196+0000 7fca67cac640 1 Processor -- start 2024-09-10T08:31:12.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.197+0000 7fca67cac640 1 -- start start 2024-09-10T08:31:12.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.197+0000 7fca67cac640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fca600733d0 0x7fca60156840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.197+0000 7fca67cac640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca6006dd50 con 0x7fca60073ae0 2024-09-10T08:31:12.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.198+0000 7fca67cac640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca6006e030 con 0x7fca6006d850 2024-09-10T08:31:12.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.198+0000 7fca67cac640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fca6006e310 con 0x7fca600733d0 2024-09-10T08:31:12.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.198+0000 7fca65a48640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fca60073ae0 0x7fca60153380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:34478/0 (socket says 172.21.15.103:34478) 2024-09-10T08:31:12.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.198+0000 7fca65a48640 1 -- 172.21.15.103:0/3297715111 learned_addr learned my addr 172.21.15.103:0/3297715111 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:31:12.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.198+0000 7fca65247640 1 --2- 172.21.15.103:0/3297715111 >> v2:172.21.15.154:3300/0 conn(0x7fca600733d0 0x7fca60156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.198+0000 7fca64a46640 1 -- 172.21.15.103:0/3297715111 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 592398351 0 0) 0x7fca6006dd50 con 0x7fca60073ae0 2024-09-10T08:31:12.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.198+0000 7fca64a46640 1 -- 172.21.15.103:0/3297715111 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca4c003520 con 0x7fca60073ae0 2024-09-10T08:31:12.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.198+0000 7fca65247640 1 -- 172.21.15.103:0/3297715111 >> v1:172.21.15.154:6789/0 conn(0x7fca6006d850 legacy=0x7fca60160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.198+0000 7fca64a46640 1 -- 172.21.15.103:0/3297715111 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1593245451 0 0) 0x7fca6006e030 con 0x7fca6006d850 2024-09-10T08:31:12.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.198+0000 7fca65247640 1 -- 172.21.15.103:0/3297715111 >> v1:172.21.15.103:6789/0 conn(0x7fca60073ae0 legacy=0x7fca60153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.198+0000 7fca65247640 1 -- 172.21.15.103:0/3297715111 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca6006e5f0 con 0x7fca600733d0 2024-09-10T08:31:12.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.199+0000 7fca65247640 1 --2- 172.21.15.103:0/3297715111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca600733d0 0x7fca60156840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fca500097a0 tx=0x7fca5002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5b2aa2392b8727 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:12.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.199+0000 7fca64a46640 1 -- 172.21.15.103:0/3297715111 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca50037070 con 0x7fca600733d0 2024-09-10T08:31:12.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.199+0000 7fca64a46640 1 -- 172.21.15.103:0/3297715111 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca50032440 con 0x7fca600733d0 2024-09-10T08:31:12.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.199+0000 7fca64a46640 1 -- 172.21.15.103:0/3297715111 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca50032810 con 0x7fca600733d0 2024-09-10T08:31:12.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.200+0000 7fca67cac640 1 -- 172.21.15.103:0/3297715111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca600733d0 msgr2=0x7fca60156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.200+0000 7fca67cac640 1 --2- 172.21.15.103:0/3297715111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca600733d0 0x7fca60156840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fca500097a0 tx=0x7fca5002a230 comp rx=0 tx=0).stop 2024-09-10T08:31:12.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.200+0000 7fca67cac640 1 -- 172.21.15.103:0/3297715111 shutdown_connections 2024-09-10T08:31:12.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.200+0000 7fca67cac640 1 --2- 172.21.15.103:0/3297715111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca600733d0 0x7fca60156840 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.200+0000 7fca67cac640 1 -- 172.21.15.103:0/3297715111 >> 172.21.15.103:0/3297715111 conn(0x7fca600c9d80 msgr2=0x7fca600ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:12.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.200+0000 7fca67cac640 1 -- 172.21.15.103:0/3297715111 shutdown_connections 2024-09-10T08:31:12.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.200+0000 7fca67cac640 1 -- 172.21.15.103:0/3297715111 wait complete. 2024-09-10T08:31:12.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.201+0000 7fca67cac640 1 Processor -- start 2024-09-10T08:31:12.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.201+0000 7fca67cac640 1 -- start start 2024-09-10T08:31:12.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.202+0000 7fca67cac640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca6006d850 0x7fca601523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.202+0000 7fca67cac640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca600733d0 0x7fca60147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.202+0000 7fca67cac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca60073ae0 0x7fca60148020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.202+0000 7fca67cac640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fca6006edd0 con 0x7fca600733d0 2024-09-10T08:31:12.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.202+0000 7fca67cac640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca6006ec50 con 0x7fca60073ae0 2024-09-10T08:31:12.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.202+0000 7fca67cac640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fca60153a90 con 0x7fca6006d850 2024-09-10T08:31:12.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.202+0000 7fca65247640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca600733d0 0x7fca60147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.202+0000 7fca65247640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca600733d0 0x7fca60147ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40346/0 (socket says 172.21.15.103:40346) 2024-09-10T08:31:12.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.202+0000 7fca65247640 1 -- 172.21.15.103:0/1287191752 learned_addr learned my addr 172.21.15.103:0/1287191752 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:12.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.202+0000 7fca65a48640 1 --2- 172.21.15.103:0/1287191752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca6006d850 0x7fca601523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.202+0000 7fca66249640 1 --2- 172.21.15.103:0/1287191752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca60073ae0 0x7fca60148020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.202+0000 7fca65247640 1 -- 172.21.15.103:0/1287191752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca6006d850 msgr2=0x7fca601523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.202+0000 7fca65247640 1 --2- 172.21.15.103:0/1287191752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca6006d850 0x7fca601523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.202+0000 7fca65247640 1 -- 172.21.15.103:0/1287191752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca60073ae0 msgr2=0x7fca60148020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.202+0000 7fca65247640 1 --2- 172.21.15.103:0/1287191752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca60073ae0 0x7fca60148020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.202+0000 7fca65247640 1 -- 172.21.15.103:0/1287191752 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca601eb770 con 0x7fca600733d0 2024-09-10T08:31:12.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.203+0000 7fca65247640 1 --2- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca600733d0 0x7fca60147ae0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fca50035040 tx=0x7fca500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:12.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.203+0000 7fca567fc640 1 -- 172.21.15.103:0/1287191752 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca50041020 con 0x7fca600733d0 2024-09-10T08:31:12.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.203+0000 7fca567fc640 1 -- 172.21.15.103:0/1287191752 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca5003d6e0 con 0x7fca600733d0 2024-09-10T08:31:12.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.203+0000 7fca567fc640 1 -- 172.21.15.103:0/1287191752 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca50037040 con 0x7fca600733d0 2024-09-10T08:31:12.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.203+0000 7fca67cac640 1 -- 172.21.15.103:0/1287191752 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca601eba50 con 0x7fca600733d0 2024-09-10T08:31:12.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.203+0000 7fca67cac640 1 -- 172.21.15.103:0/1287191752 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca60152930 con 0x7fca600733d0 2024-09-10T08:31:12.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.204+0000 7fca67cac640 1 --2- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca601ec0a0 0x7fca60150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.204+0000 7fca67cac640 1 -- 172.21.15.103:0/1287191752 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fca6014dc50 con 0x7fca601ec0a0 2024-09-10T08:31:12.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.204+0000 7fca65a48640 1 --2- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca601ec0a0 0x7fca60150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.204+0000 7fca65a48640 1 -- 172.21.15.103:0/1287191752 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca60073ec0 con 0x7fca601ec0a0 2024-09-10T08:31:12.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.204+0000 7fca65a48640 1 --2- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca601ec0a0 0x7fca60150e10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fca5c000f60 tx=0x7fca5c00f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:12.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.204+0000 7fca567fc640 1 -- 172.21.15.103:0/1287191752 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca50044020 con 0x7fca600733d0 2024-09-10T08:31:12.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.205+0000 7fca567fc640 1 --2- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca4406be30 0x7fca4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.205+0000 7fca567fc640 1 -- 172.21.15.103:0/1287191752 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fca500ab8a0 con 0x7fca600733d0 2024-09-10T08:31:12.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.205+0000 7fca66249640 1 --2- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca4406be30 0x7fca4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.205+0000 7fca567fc640 1 -- 172.21.15.103:0/1287191752 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5c005ac0 con 0x7fca601ec0a0 2024-09-10T08:31:12.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.205+0000 7fca567fc640 1 -- 172.21.15.103:0/1287191752 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fca5c018070 con 0x7fca601ec0a0 2024-09-10T08:31:12.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.205+0000 7fca567fc640 1 -- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca601ec0a0 msgr2=0x7fca60150e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.205+0000 7fca567fc640 1 --2- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca601ec0a0 0x7fca60150e10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fca5c000f60 tx=0x7fca5c00f9d0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.205+0000 7fca567fc640 1 -- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca601ec0a0 msgr2=0x7fca60150e10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:31:12.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.205+0000 7fca567fc640 1 --2- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca601ec0a0 0x7fca60150e10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.205+0000 7fca66249640 1 --2- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca4406be30 0x7fca4406e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fca580012e0 tx=0x7fca58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:12.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.212+0000 7fca67cac640 1 --2- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca60146180 0x7fca60151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.212+0000 7fca67cac640 1 -- 172.21.15.103:0/1287191752 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fca601508b0 con 0x7fca60146180 2024-09-10T08:31:12.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.212+0000 7fca65a48640 1 --2- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca60146180 0x7fca60151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.212+0000 7fca65a48640 1 -- 172.21.15.103:0/1287191752 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fca601e8fd0 con 0x7fca60146180 2024-09-10T08:31:12.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.212+0000 7fca65a48640 1 --2- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca60146180 0x7fca60151350 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fca5c000f60 tx=0x7fca5c0010a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:12.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.212+0000 7fca567fc640 1 -- 172.21.15.103:0/1287191752 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5c01dc50 con 0x7fca60146180 2024-09-10T08:31:12.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.213+0000 7fca567fc640 1 -- 172.21.15.103:0/1287191752 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5057 (secure 0 0 0) 0x7fca5c01dc50 con 0x7fca60146180 2024-09-10T08:31:12.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.213+0000 7fca567fc640 1 -- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca60146180 msgr2=0x7fca60151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.213+0000 7fca567fc640 1 --2- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca60146180 0x7fca60151350 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fca5c000f60 tx=0x7fca5c0010a0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.213+0000 7fca567fc640 1 -- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca60146180 msgr2=0x7fca60151350 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:31:12.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.213+0000 7fca567fc640 1 --2- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca60146180 0x7fca60151350 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.214 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:31:12.214 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:31:12.214 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:31:12.214 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:31:12.215 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 16, 2024-09-10T08:31:12.215 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 179775, 2024-09-10T08:31:12.215 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:31:12.215 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:31:12.215 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:31:12.215 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:31:12.215 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:12.215 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 16, 2024-09-10T08:31:12.215 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:31:12.215 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:31:12.215 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:31:12.215 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:12.215 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:12.215 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:12.216 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:12.216 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:12.216 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:12.216 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:12.216 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:12.216 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:12.216 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:12.216 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:12.216 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:12.216 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:31:12.216 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:31:12.216 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:12.216 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:12.217 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:12.217 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:12.217 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:12.217 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:12.217 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:12.217 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:12.217 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:12.217 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:12.217 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:12.217 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:12.217 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.217 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:31:12.217 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:31:12.218 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:31:12.218 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:31:12.218 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:31:12.218 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:31:12.218 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:31:12.218 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:31:12.218 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:31:12.218 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:31:12.218 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:31:12.218 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:31:12.218 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:31:12.218 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:31:12.218 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:31:12.218 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:31:12.219 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:31:12.219 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:12.219 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:12.219 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:12.219 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:12.219 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:12.219 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:12.219 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:12.219 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:12.219 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:12.219 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:12.219 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:12.219 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:12.220 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:31:12.220 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.220 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:31:12.220 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.220 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:31:12.220 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:31:12.220 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:12.220 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:12.220 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.220 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:12.220 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:31:12.220 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:12.221 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.221 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.221 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:12.221 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:31:12.221 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:12.221 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:12.221 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:12.221 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.221 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:31:12.221 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:31:12.221 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:12.221 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:12.221 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:12.222 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.222 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.222 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:31:12.222 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:31:12.222 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:12.222 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:12.222 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.222 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:12.222 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:31:12.222 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:12.222 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.222 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.222 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:12.223 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:31:12.223 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:12.223 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:12.223 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:12.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.223 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:31:12.223 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:31:12.223 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:12.223 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:12.223 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:12.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.223 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.223 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:31:12.223 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:31:12.224 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:12.224 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:12.224 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.224 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:12.224 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:31:12.224 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:12.224 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.224 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.224 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:12.224 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:31:12.224 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:12.224 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:12.224 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:12.224 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.224 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:31:12.225 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:31:12.225 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:12.225 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:12.225 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:12.225 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:12.225 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:12.225 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.225 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:31:12.225 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:31:12.225 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.225 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:12.225 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:12.225 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:31:12.226 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:12.226 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:12.226 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:31:12.226 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.226 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:12.226 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:12.226 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:31:12.226 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:12.226 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:12.226 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:31:12.226 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.226 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:12.226 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:12.227 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-10T08:31:12.227 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:12.227 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:12.227 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:31:12.227 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.227 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:12.227 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:12.227 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-10T08:31:12.227 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:12.227 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:12.227 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:31:12.227 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.227 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:12.227 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:12.228 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:31:12.228 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:12.228 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:12.228 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.228 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:31:12.228 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:31:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.213+0000 7fca67cac640 1 -- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca4406be30 msgr2=0x7fca4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.213+0000 7fca67cac640 1 --2- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca4406be30 0x7fca4406e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fca580012e0 tx=0x7fca58009040 comp rx=0 tx=0).stop 2024-09-10T08:31:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.213+0000 7fca67cac640 1 -- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca600733d0 msgr2=0x7fca60147ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.213+0000 7fca67cac640 1 --2- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca600733d0 0x7fca60147ae0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fca50035040 tx=0x7fca500046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.213+0000 7fca66249640 1 -- 172.21.15.103:0/1287191752 reap_dead start 2024-09-10T08:31:12.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.213+0000 7fca67cac640 1 -- 172.21.15.103:0/1287191752 shutdown_connections 2024-09-10T08:31:12.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.213+0000 7fca67cac640 1 --2- 172.21.15.103:0/1287191752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca600733d0 0x7fca60147ae0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.213+0000 7fca67cac640 1 -- 172.21.15.103:0/1287191752 >> 172.21.15.103:0/1287191752 conn(0x7fca600c9d80 msgr2=0x7fca600c5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:12.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.213+0000 7fca67cac640 1 -- 172.21.15.103:0/1287191752 shutdown_connections 2024-09-10T08:31:12.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.213+0000 7fca67cac640 1 -- 172.21.15.103:0/1287191752 wait complete. 2024-09-10T08:31:12.230 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:31:12.230 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:31:12.231 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:31:12.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.344+0000 7ff5771b7640 1 Processor -- start 2024-09-10T08:31:12.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.344+0000 7ff5771b7640 1 -- start start 2024-09-10T08:31:12.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.345+0000 7ff5771b7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5700aa870 0x7ff57006e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.345+0000 7ff5771b7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57006e910 0x7ff57006ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.345+0000 7ff5771b7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff570158610 con 0x7ff57014e720 2024-09-10T08:31:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.345+0000 7ff5771b7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff5700a9cd0 con 0x7ff5700aa870 2024-09-10T08:31:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.345+0000 7ff5771b7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff5700a7f70 con 0x7ff57006e910 2024-09-10T08:31:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.345+0000 7ff56ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5700aa870 0x7ff57006e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.345+0000 7ff575754640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57006e910 0x7ff57006ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.346+0000 7ff56ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5700aa870 0x7ff57006e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:55432/0 (socket says 172.21.15.103:55432) 2024-09-10T08:31:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.346+0000 7ff575754640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57006e910 0x7ff57006ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:36002/0 (socket says 172.21.15.103:36002) 2024-09-10T08:31:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.346+0000 7ff574f53640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff57014e720 0x7ff5700aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:35802/0 (socket says 172.21.15.103:35802) 2024-09-10T08:31:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.346+0000 7ff56ffff640 1 -- 172.21.15.103:0/4220146246 learned_addr learned my addr 172.21.15.103:0/4220146246 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.346+0000 7ff575754640 1 -- 172.21.15.103:0/4220146246 >> v2:172.21.15.154:3300/0 conn(0x7ff5700aa870 msgr2=0x7ff57006e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.346+0000 7ff575754640 1 --2- 172.21.15.103:0/4220146246 >> v2:172.21.15.154:3300/0 conn(0x7ff5700aa870 0x7ff57006e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.346+0000 7ff575754640 1 -- 172.21.15.103:0/4220146246 >> v1:172.21.15.154:6789/0 conn(0x7ff57014e720 legacy=0x7ff5700aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.346+0000 7ff575754640 1 -- 172.21.15.103:0/4220146246 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5700a8250 con 0x7ff57006e910 2024-09-10T08:31:12.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.346+0000 7ff56ffff640 1 --2- 172.21.15.103:0/4220146246 >> v2:172.21.15.154:3300/0 conn(0x7ff5700aa870 0x7ff57006e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:31:12.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.347+0000 7ff575754640 1 --2- 172.21.15.103:0/4220146246 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57006e910 0x7ff57006ed70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff568009d90 tx=0x7ff56802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=974824b5a5a97ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:12.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.347+0000 7ff56f7fe640 1 -- 172.21.15.103:0/4220146246 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff568031600 con 0x7ff57006e910 2024-09-10T08:31:12.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.347+0000 7ff56f7fe640 1 -- 172.21.15.103:0/4220146246 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5680317a0 con 0x7ff57006e910 2024-09-10T08:31:12.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.347+0000 7ff56f7fe640 1 -- 172.21.15.103:0/4220146246 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff568031b70 con 0x7ff57006e910 2024-09-10T08:31:12.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.347+0000 7ff5771b7640 1 -- 172.21.15.103:0/4220146246 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57006e910 msgr2=0x7ff57006ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.347+0000 7ff5771b7640 1 --2- 172.21.15.103:0/4220146246 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57006e910 0x7ff57006ed70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff568009d90 tx=0x7ff56802a5d0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.347+0000 7ff5771b7640 1 -- 172.21.15.103:0/4220146246 shutdown_connections 2024-09-10T08:31:12.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.347+0000 7ff5771b7640 1 --2- 172.21.15.103:0/4220146246 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57006e910 0x7ff57006ed70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.347+0000 7ff5771b7640 1 --2- 172.21.15.103:0/4220146246 >> v2:172.21.15.154:3300/0 conn(0x7ff5700aa870 0x7ff57006e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.347+0000 7ff5771b7640 1 -- 172.21.15.103:0/4220146246 >> 172.21.15.103:0/4220146246 conn(0x7ff5700c8430 msgr2=0x7ff5700c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:12.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.347+0000 7ff5771b7640 1 -- 172.21.15.103:0/4220146246 shutdown_connections 2024-09-10T08:31:12.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.347+0000 7ff5771b7640 1 -- 172.21.15.103:0/4220146246 wait complete. 2024-09-10T08:31:12.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.349+0000 7ff5771b7640 1 Processor -- start 2024-09-10T08:31:12.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.349+0000 7ff5771b7640 1 -- start start 2024-09-10T08:31:12.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.349+0000 7ff5771b7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57006e910 0x7ff5701eb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.349+0000 7ff5771b7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5700aa870 0x7ff5701eb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.349+0000 7ff5771b7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff57014e720 0x7ff5701ed710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.349+0000 7ff5771b7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff570067fe0 con 0x7ff57014e720 2024-09-10T08:31:12.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.349+0000 7ff5771b7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff570067e60 con 0x7ff5700aa870 2024-09-10T08:31:12.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.349+0000 7ff5771b7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff5700aac90 con 0x7ff57006e910 2024-09-10T08:31:12.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.350+0000 7ff574f53640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57006e910 0x7ff5701eb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.350+0000 7ff575754640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff57014e720 0x7ff5701ed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.350+0000 7ff56ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5700aa870 0x7ff5701eb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.350+0000 7ff575754640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff57014e720 0x7ff5701ed710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40376/0 (socket says 172.21.15.103:40376) 2024-09-10T08:31:12.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.350+0000 7ff575754640 1 -- 172.21.15.103:0/1256084928 learned_addr learned my addr 172.21.15.103:0/1256084928 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:12.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.350+0000 7ff56ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5700aa870 0x7ff5701eb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:55438/0 (socket says 172.21.15.103:55438) 2024-09-10T08:31:12.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.350+0000 7ff574f53640 1 --2- 172.21.15.103:0/1256084928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57006e910 0x7ff5701eb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:36006/0 (socket says 172.21.15.103:36006) 2024-09-10T08:31:12.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.350+0000 7ff575754640 1 -- 172.21.15.103:0/1256084928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57006e910 msgr2=0x7ff5701eb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.350+0000 7ff575754640 1 --2- 172.21.15.103:0/1256084928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57006e910 0x7ff5701eb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.350+0000 7ff575754640 1 -- 172.21.15.103:0/1256084928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5700aa870 msgr2=0x7ff5701eb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.350+0000 7ff575754640 1 --2- 172.21.15.103:0/1256084928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5700aa870 0x7ff5701eb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.350+0000 7ff575754640 1 -- 172.21.15.103:0/1256084928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff570074740 con 0x7ff57014e720 2024-09-10T08:31:12.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.350+0000 7ff575754640 1 --2- 172.21.15.103:0/1256084928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff57014e720 0x7ff5701ed710 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff568009eb0 tx=0x7ff568004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:12.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.350+0000 7ff56d7fa640 1 -- 172.21.15.103:0/1256084928 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff568040070 con 0x7ff57014e720 2024-09-10T08:31:12.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.350+0000 7ff56d7fa640 1 -- 172.21.15.103:0/1256084928 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff568030b60 con 0x7ff57014e720 2024-09-10T08:31:12.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.351+0000 7ff56d7fa640 1 -- 172.21.15.103:0/1256084928 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff568009450 con 0x7ff57014e720 2024-09-10T08:31:12.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.351+0000 7ff5771b7640 1 -- 172.21.15.103:0/1256084928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5701df580 con 0x7ff57014e720 2024-09-10T08:31:12.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.351+0000 7ff5771b7640 1 -- 172.21.15.103:0/1256084928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5701dfb40 con 0x7ff57014e720 2024-09-10T08:31:12.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.352+0000 7ff5771b7640 1 --2- 172.21.15.103:0/1256084928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5701dfd10 0x7ff5701edc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.352+0000 7ff5771b7640 1 -- 172.21.15.103:0/1256084928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff5701581e0 con 0x7ff5701dfd10 2024-09-10T08:31:12.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.352+0000 7ff574f53640 1 --2- 172.21.15.103:0/1256084928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5701dfd10 0x7ff5701edc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.352+0000 7ff574f53640 1 -- 172.21.15.103:0/1256084928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5700696d0 con 0x7ff5701dfd10 2024-09-10T08:31:12.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.352+0000 7ff574f53640 1 --2- 172.21.15.103:0/1256084928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5701dfd10 0x7ff5701edc50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff564007fd0 tx=0x7ff564001880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:12.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.352+0000 7ff56d7fa640 1 -- 172.21.15.103:0/1256084928 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff564011580 con 0x7ff5701dfd10 2024-09-10T08:31:12.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.353+0000 7ff56d7fa640 1 -- 172.21.15.103:0/1256084928 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff568039040 con 0x7ff57014e720 2024-09-10T08:31:12.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.353+0000 7ff56d7fa640 1 --2- 172.21.15.103:0/1256084928 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff55406bd30 0x7ff55406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.353+0000 7ff56d7fa640 1 -- 172.21.15.103:0/1256084928 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7ff5680ac710 con 0x7ff57014e720 2024-09-10T08:31:12.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.353+0000 7ff56ffff640 1 --2- 172.21.15.103:0/1256084928 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff55406bd30 0x7ff55406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.353+0000 7ff56d7fa640 1 -- 172.21.15.103:0/1256084928 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff564011720 con 0x7ff5701dfd10 2024-09-10T08:31:12.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.353+0000 7ff56d7fa640 1 -- 172.21.15.103:0/1256084928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5701dfd10 msgr2=0x7ff5701edc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.353+0000 7ff56d7fa640 1 --2- 172.21.15.103:0/1256084928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5701dfd10 0x7ff5701edc50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff564007fd0 tx=0x7ff564001880 comp rx=0 tx=0).stop 2024-09-10T08:31:12.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.353+0000 7ff56d7fa640 1 -- 172.21.15.103:0/1256084928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5701dfd10 msgr2=0x7ff5701edc50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:31:12.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.353+0000 7ff56d7fa640 1 --2- 172.21.15.103:0/1256084928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5701dfd10 0x7ff5701edc50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.354+0000 7ff56ffff640 1 --2- 172.21.15.103:0/1256084928 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff55406bd30 0x7ff55406e1f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff570148590 tx=0x7ff55c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:12.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.360+0000 7ff5771b7640 1 --2- 172.21.15.103:0/1256084928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5701e9f30 0x7ff5701ea310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.360+0000 7ff5771b7640 1 -- 172.21.15.103:0/1256084928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff5700c5cc0 con 0x7ff5701e9f30 2024-09-10T08:31:12.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.360+0000 7ff574f53640 1 --2- 172.21.15.103:0/1256084928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5701e9f30 0x7ff5701ea310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.360+0000 7ff574f53640 1 -- 172.21.15.103:0/1256084928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff570155950 con 0x7ff5701e9f30 2024-09-10T08:31:12.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.360+0000 7ff574f53640 1 --2- 172.21.15.103:0/1256084928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5701e9f30 0x7ff5701ea310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff564007fd0 tx=0x7ff564000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:12.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.360+0000 7ff56d7fa640 1 -- 172.21.15.103:0/1256084928 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff564011e60 con 0x7ff5701e9f30 2024-09-10T08:31:12.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.361+0000 7ff56d7fa640 1 -- 172.21.15.103:0/1256084928 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4720 (secure 0 0 0) 0x7ff56401e320 con 0x7ff5701e9f30 2024-09-10T08:31:12.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.361+0000 7ff56d7fa640 1 -- 172.21.15.103:0/1256084928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5701e9f30 msgr2=0x7ff5701ea310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.361+0000 7ff56d7fa640 1 --2- 172.21.15.103:0/1256084928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5701e9f30 0x7ff5701ea310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff564007fd0 tx=0x7ff564000ed0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.361+0000 7ff56d7fa640 1 -- 172.21.15.103:0/1256084928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5701e9f30 msgr2=0x7ff5701ea310 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:31:12.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.361+0000 7ff56d7fa640 1 --2- 172.21.15.103:0/1256084928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5701e9f30 0x7ff5701ea310 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.362 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:31:12.362 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:31:12.362 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:31:12.362 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:31:12.362 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 16, 2024-09-10T08:31:12.362 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 78589, 2024-09-10T08:31:12.363 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:31:12.363 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:31:12.363 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:31:12.363 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:31:12.363 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:12.363 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 16, 2024-09-10T08:31:12.363 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:31:12.363 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:31:12.363 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:31:12.363 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:12.363 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:12.363 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:12.363 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:12.363 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:12.364 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:12.364 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:12.364 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:12.364 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:12.364 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:12.364 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:12.364 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:12.364 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:31:12.364 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:31:12.364 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:12.364 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:12.364 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:12.364 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:12.364 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:12.365 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:12.365 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:12.365 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:12.365 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:12.365 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:12.365 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:12.365 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:12.365 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.365 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:31:12.365 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:31:12.365 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:31:12.365 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:31:12.365 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:31:12.366 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:31:12.366 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:31:12.366 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:31:12.366 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:31:12.366 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:31:12.366 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:31:12.366 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:31:12.366 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:31:12.366 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:31:12.366 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:31:12.366 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:31:12.366 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:31:12.366 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:12.366 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:12.367 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:12.367 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:12.367 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:12.367 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:12.367 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:12.367 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:12.367 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:12.367 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:12.367 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:12.367 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:12.367 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:31:12.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.367 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:31:12.367 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.367 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:31:12.368 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:31:12.368 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:12.368 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:12.368 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.368 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:12.368 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:31:12.368 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:12.368 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.368 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.368 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:12.368 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:31:12.368 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:12.368 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:12.369 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:12.369 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.369 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:31:12.369 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:31:12.369 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:12.369 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:12.369 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:12.369 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.369 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.369 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:31:12.369 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:31:12.369 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:12.369 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:12.370 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.370 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:12.370 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:31:12.370 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:12.370 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.370 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.370 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:12.370 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:31:12.370 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:12.370 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:12.370 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:12.370 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.370 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:31:12.371 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:31:12.371 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:12.371 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:12.371 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:12.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.371 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.371 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:31:12.371 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:31:12.371 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:12.371 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:12.371 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.371 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:12.371 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:31:12.371 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:12.372 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.372 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.372 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:12.372 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:31:12.372 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:12.372 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:12.372 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:12.372 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.372 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:31:12.372 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:31:12.372 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:12.372 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:12.372 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:12.373 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:12.373 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:12.373 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.373 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:31:12.373 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:31:12.373 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.373 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:12.373 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:12.373 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:31:12.373 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:12.373 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:12.373 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:31:12.373 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.374 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:12.374 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:12.374 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:31:12.374 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:12.374 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:12.374 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:31:12.374 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.374 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:12.374 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:12.374 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:31:12.374 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:12.374 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:12.374 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.374 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:31:12.375 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:31:12.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.361+0000 7ff5771b7640 1 -- 172.21.15.103:0/1256084928 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff55406bd30 msgr2=0x7ff55406e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.361+0000 7ff5771b7640 1 --2- 172.21.15.103:0/1256084928 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff55406bd30 0x7ff55406e1f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff570148590 tx=0x7ff55c009240 comp rx=0 tx=0).stop 2024-09-10T08:31:12.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.361+0000 7ff5771b7640 1 -- 172.21.15.103:0/1256084928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff57014e720 msgr2=0x7ff5701ed710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.361+0000 7ff5771b7640 1 --2- 172.21.15.103:0/1256084928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff57014e720 0x7ff5701ed710 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff568009eb0 tx=0x7ff568004a40 comp rx=0 tx=0).stop 2024-09-10T08:31:12.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.361+0000 7ff575754640 1 -- 172.21.15.103:0/1256084928 reap_dead start 2024-09-10T08:31:12.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.361+0000 7ff575754640 1 -- 172.21.15.103:0/1256084928 reap_dead start 2024-09-10T08:31:12.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.361+0000 7ff5771b7640 1 -- 172.21.15.103:0/1256084928 shutdown_connections 2024-09-10T08:31:12.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.361+0000 7ff5771b7640 1 -- 172.21.15.103:0/1256084928 >> 172.21.15.103:0/1256084928 conn(0x7ff5700c8430 msgr2=0x7ff5700c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:12.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.361+0000 7ff5771b7640 1 -- 172.21.15.103:0/1256084928 shutdown_connections 2024-09-10T08:31:12.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.361+0000 7ff5771b7640 1 -- 172.21.15.103:0/1256084928 wait complete. 2024-09-10T08:31:12.377 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:31:12.377 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:31:12.377 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:31:12.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.492+0000 7f21a8711640 1 Processor -- start 2024-09-10T08:31:12.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.492+0000 7f21a8711640 1 -- start start 2024-09-10T08:31:12.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.493+0000 7f21a8711640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f21a0073ae0 0x7f21a0153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.494+0000 7f21a8711640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21a006dd50 con 0x7f21a0156f50 2024-09-10T08:31:12.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.494+0000 7f21a8711640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21a006e030 con 0x7f21a00733d0 2024-09-10T08:31:12.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.494+0000 7f21a8711640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f21a006e310 con 0x7f21a0073ae0 2024-09-10T08:31:12.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.494+0000 7f21a6cae640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f21a0156f50 0x7f21a0160b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:34482/0 (socket says 172.21.15.103:34482) 2024-09-10T08:31:12.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.494+0000 7f21a6cae640 1 -- 172.21.15.103:0/547086117 learned_addr learned my addr 172.21.15.103:0/547086117 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:31:12.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.494+0000 7f21a64ad640 1 --2- 172.21.15.103:0/547086117 >> v2:172.21.15.154:3300/0 conn(0x7f21a0073ae0 0x7f21a0153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.494+0000 7f21a54ab640 1 -- 172.21.15.103:0/547086117 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1396165365 0 0) 0x7f21a006dd50 con 0x7f21a0156f50 2024-09-10T08:31:12.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.494+0000 7f21a54ab640 1 -- 172.21.15.103:0/547086117 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f218c003520 con 0x7f21a0156f50 2024-09-10T08:31:12.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.494+0000 7f21a54ab640 1 -- 172.21.15.103:0/547086117 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3965701446 0 0) 0x7f21a006e030 con 0x7f21a00733d0 2024-09-10T08:31:12.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.494+0000 7f21a54ab640 1 -- 172.21.15.103:0/547086117 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21a006dd50 con 0x7f21a00733d0 2024-09-10T08:31:12.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.494+0000 7f21a64ad640 1 -- 172.21.15.103:0/547086117 >> v1:172.21.15.154:6789/0 conn(0x7f21a00733d0 legacy=0x7f21a0156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.494+0000 7f21a64ad640 1 -- 172.21.15.103:0/547086117 >> v1:172.21.15.103:6789/0 conn(0x7f21a0156f50 legacy=0x7f21a0160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.494+0000 7f21a64ad640 1 -- 172.21.15.103:0/547086117 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a006e5f0 con 0x7f21a0073ae0 2024-09-10T08:31:12.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.495+0000 7f21a64ad640 1 --2- 172.21.15.103:0/547086117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21a0073ae0 0x7f21a0153380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f219c0097a0 tx=0x7f219c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf52cc884c9c5e1c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:12.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.495+0000 7f21a54ab640 1 -- 172.21.15.103:0/547086117 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c037070 con 0x7f21a0073ae0 2024-09-10T08:31:12.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.495+0000 7f21a54ab640 1 -- 172.21.15.103:0/547086117 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f219c032440 con 0x7f21a0073ae0 2024-09-10T08:31:12.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.495+0000 7f21a54ab640 1 -- 172.21.15.103:0/547086117 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c0327f0 con 0x7f21a0073ae0 2024-09-10T08:31:12.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.496+0000 7f21a8711640 1 -- 172.21.15.103:0/547086117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21a0073ae0 msgr2=0x7f21a0153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.496+0000 7f21a8711640 1 --2- 172.21.15.103:0/547086117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21a0073ae0 0x7f21a0153380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f219c0097a0 tx=0x7f219c02a230 comp rx=0 tx=0).stop 2024-09-10T08:31:12.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.496+0000 7f21a8711640 1 -- 172.21.15.103:0/547086117 shutdown_connections 2024-09-10T08:31:12.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.496+0000 7f21a8711640 1 --2- 172.21.15.103:0/547086117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21a0073ae0 0x7f21a0153380 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.496+0000 7f21a8711640 1 -- 172.21.15.103:0/547086117 >> 172.21.15.103:0/547086117 conn(0x7f21a00c9d80 msgr2=0x7f21a00ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:12.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.496+0000 7f21a8711640 1 -- 172.21.15.103:0/547086117 shutdown_connections 2024-09-10T08:31:12.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.496+0000 7f21a8711640 1 -- 172.21.15.103:0/547086117 wait complete. 2024-09-10T08:31:12.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.497+0000 7f21a8711640 1 Processor -- start 2024-09-10T08:31:12.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.497+0000 7f21a8711640 1 -- start start 2024-09-10T08:31:12.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.498+0000 7f21a8711640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21a00733d0 0x7f21a0147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.498+0000 7f21a8711640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21a0073ae0 0x7f21a014bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.498+0000 7f21a8711640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21a0156f50 0x7f21a014b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.498+0000 7f21a8711640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f21a006edd0 con 0x7f21a0073ae0 2024-09-10T08:31:12.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.498+0000 7f21a8711640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21a006ec50 con 0x7f21a0156f50 2024-09-10T08:31:12.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.498+0000 7f21a8711640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f21a0073ec0 con 0x7f21a00733d0 2024-09-10T08:31:12.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.498+0000 7f21a5cac640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21a0073ae0 0x7f21a014bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.498+0000 7f21a5cac640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21a0073ae0 0x7f21a014bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40378/0 (socket says 172.21.15.103:40378) 2024-09-10T08:31:12.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.498+0000 7f21a5cac640 1 -- 172.21.15.103:0/3038640809 learned_addr learned my addr 172.21.15.103:0/3038640809 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:12.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.498+0000 7f21a6cae640 1 --2- 172.21.15.103:0/3038640809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21a0156f50 0x7f21a014b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.498+0000 7f21a64ad640 1 --2- 172.21.15.103:0/3038640809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21a00733d0 0x7f21a0147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.498+0000 7f21a5cac640 1 -- 172.21.15.103:0/3038640809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21a00733d0 msgr2=0x7f21a0147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.498+0000 7f21a5cac640 1 --2- 172.21.15.103:0/3038640809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21a00733d0 0x7f21a0147670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.498+0000 7f21a5cac640 1 -- 172.21.15.103:0/3038640809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21a0156f50 msgr2=0x7f21a014b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.498+0000 7f21a5cac640 1 --2- 172.21.15.103:0/3038640809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21a0156f50 0x7f21a014b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.498+0000 7f21a5cac640 1 -- 172.21.15.103:0/3038640809 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a014c6e0 con 0x7f21a0073ae0 2024-09-10T08:31:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.498+0000 7f21a5cac640 1 --2- 172.21.15.103:0/3038640809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21a0073ae0 0x7f21a014bd50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f219000c450 tx=0x7f219000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.499+0000 7f2196ffd640 1 -- 172.21.15.103:0/3038640809 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21900052d0 con 0x7f21a0073ae0 2024-09-10T08:31:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.499+0000 7f2196ffd640 1 -- 172.21.15.103:0/3038640809 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2190005470 con 0x7f21a0073ae0 2024-09-10T08:31:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.499+0000 7f2196ffd640 1 -- 172.21.15.103:0/3038640809 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2190012870 con 0x7f21a0073ae0 2024-09-10T08:31:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.499+0000 7f21a8711640 1 -- 172.21.15.103:0/3038640809 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a014c9c0 con 0x7f21a0073ae0 2024-09-10T08:31:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.499+0000 7f21a8711640 1 -- 172.21.15.103:0/3038640809 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21a014c290 con 0x7f21a0073ae0 2024-09-10T08:31:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.500+0000 7f21a8711640 1 --2- 172.21.15.103:0/3038640809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21a0158a80 0x7f21a0158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.500+0000 7f21a8711640 1 -- 172.21.15.103:0/3038640809 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f21a00695d0 con 0x7f21a0158a80 2024-09-10T08:31:12.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.500+0000 7f21a64ad640 1 --2- 172.21.15.103:0/3038640809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21a0158a80 0x7f21a0158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.500+0000 7f21a64ad640 1 -- 172.21.15.103:0/3038640809 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f21a0050060 con 0x7f21a0158a80 2024-09-10T08:31:12.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.500+0000 7f21a64ad640 1 --2- 172.21.15.103:0/3038640809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21a0158a80 0x7f21a0158e60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f21a00b0110 tx=0x7f219c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:12.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.500+0000 7f2196ffd640 1 -- 172.21.15.103:0/3038640809 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2190012a10 con 0x7f21a0073ae0 2024-09-10T08:31:12.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.501+0000 7f2196ffd640 1 --2- 172.21.15.103:0/3038640809 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f218406be30 0x7f218406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.501+0000 7f21a6cae640 1 --2- 172.21.15.103:0/3038640809 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f218406be30 0x7f218406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.501+0000 7f2196ffd640 1 -- 172.21.15.103:0/3038640809 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f219008aca0 con 0x7f21a0073ae0 2024-09-10T08:31:12.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.501+0000 7f2196ffd640 1 -- 172.21.15.103:0/3038640809 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c037040 con 0x7f21a0158a80 2024-09-10T08:31:12.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.501+0000 7f2196ffd640 1 -- 172.21.15.103:0/3038640809 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f219c03c640 con 0x7f21a0158a80 2024-09-10T08:31:12.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.501+0000 7f2196ffd640 1 -- 172.21.15.103:0/3038640809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21a0158a80 msgr2=0x7f21a0158e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.501+0000 7f2196ffd640 1 --2- 172.21.15.103:0/3038640809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21a0158a80 0x7f21a0158e60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f21a00b0110 tx=0x7f219c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.501+0000 7f2196ffd640 1 -- 172.21.15.103:0/3038640809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21a0158a80 msgr2=0x7f21a0158e60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:31:12.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.501+0000 7f2196ffd640 1 --2- 172.21.15.103:0/3038640809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21a0158a80 0x7f21a0158e60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.502+0000 7f21a6cae640 1 --2- 172.21.15.103:0/3038640809 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f218406be30 0x7f218406e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f21980012e0 tx=0x7f2198001970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:12.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.508+0000 7f21a8711640 1 --2- 172.21.15.103:0/3038640809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21a0140f30 0x7f21a0141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.509+0000 7f21a8711640 1 -- 172.21.15.103:0/3038640809 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f21a014af20 con 0x7f21a0140f30 2024-09-10T08:31:12.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.509+0000 7f21a64ad640 1 --2- 172.21.15.103:0/3038640809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21a0140f30 0x7f21a0141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.509+0000 7f21a64ad640 1 -- 172.21.15.103:0/3038640809 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f21a0151fb0 con 0x7f21a0140f30 2024-09-10T08:31:12.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.509+0000 7f21a64ad640 1 --2- 172.21.15.103:0/3038640809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21a0140f30 0x7f21a0141310 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f219c0097a0 tx=0x7f219c008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:12.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.509+0000 7f2196ffd640 1 -- 172.21.15.103:0/3038640809 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c037070 con 0x7f21a0140f30 2024-09-10T08:31:12.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.510+0000 7f2196ffd640 1 -- 172.21.15.103:0/3038640809 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f219c0093c0 con 0x7f21a0140f30 2024-09-10T08:31:12.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.510+0000 7f2196ffd640 1 -- 172.21.15.103:0/3038640809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21a0140f30 msgr2=0x7f21a0141310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.510+0000 7f2196ffd640 1 --2- 172.21.15.103:0/3038640809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21a0140f30 0x7f21a0141310 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f219c0097a0 tx=0x7f219c008030 comp rx=0 tx=0).stop 2024-09-10T08:31:12.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.510+0000 7f2196ffd640 1 -- 172.21.15.103:0/3038640809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21a0140f30 msgr2=0x7f21a0141310 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:31:12.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.510+0000 7f2196ffd640 1 --2- 172.21.15.103:0/3038640809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21a0140f30 0x7f21a0141310 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f219c0097a0 tx=0x7f219c008030 comp rx=0 tx=0).stop 2024-09-10T08:31:12.511 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:31:12.511 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:31:12.511 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:31:12.512 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:31:12.512 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 16, 2024-09-10T08:31:12.512 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 16670, 2024-09-10T08:31:12.512 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:31:12.513 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:31:12.513 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:31:12.513 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:31:12.513 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:12.513 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 16, 2024-09-10T08:31:12.513 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:31:12.514 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:31:12.514 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:31:12.514 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:12.514 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:12.514 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:12.514 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:12.515 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:12.515 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:12.515 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:12.515 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:12.515 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:12.515 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:12.516 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:12.516 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:12.516 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:31:12.516 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:31:12.516 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:12.516 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:12.516 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:12.517 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:12.517 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:12.517 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:12.517 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:12.517 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:12.518 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:12.518 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:12.518 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:12.518 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:12.518 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.518 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:31:12.519 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:31:12.519 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:31:12.519 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:31:12.519 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:31:12.519 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:31:12.519 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:31:12.520 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:31:12.520 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:31:12.520 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:31:12.520 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:31:12.520 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:31:12.520 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:31:12.521 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:31:12.521 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:31:12.521 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:31:12.521 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:31:12.522 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:12.522 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:12.522 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:12.522 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:12.523 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:12.523 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:12.523 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:12.524 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:12.524 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:12.524 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:12.524 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:12.524 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:12.525 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:31:12.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.525 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:31:12.525 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.525 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:31:12.525 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:31:12.526 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:12.526 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:12.526 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.526 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:12.526 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:31:12.526 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:12.527 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.527 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.527 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:12.527 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:31:12.527 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:12.527 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:12.528 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:12.528 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.528 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:31:12.528 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:31:12.528 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:12.529 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:12.529 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:12.529 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.529 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.529 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:31:12.529 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:31:12.530 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:12.530 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:12.530 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.530 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:12.530 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:31:12.530 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:12.531 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.531 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.531 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:12.531 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:31:12.531 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:12.531 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:12.532 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:12.532 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.532 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:31:12.532 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:31:12.532 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:12.533 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:12.533 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:12.533 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.533 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.533 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:31:12.534 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:31:12.534 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:12.534 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:12.534 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.534 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:12.534 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:31:12.535 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:12.535 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.535 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.535 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:12.535 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:31:12.536 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:12.536 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:12.536 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:12.536 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.536 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:31:12.536 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:31:12.537 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:12.537 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:12.537 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:12.537 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:12.537 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:12.538 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.538 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:31:12.538 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:31:12.538 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.538 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:12.538 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:12.538 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:31:12.538 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:12.539 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:12.539 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:31:12.539 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:12.539 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:12.539 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:12.539 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:31:12.540 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:12.540 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:12.540 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:12.540 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:31:12.540 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:31:12.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.510+0000 7f21a8711640 1 -- 172.21.15.103:0/3038640809 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f218406be30 msgr2=0x7f218406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.510+0000 7f21a8711640 1 --2- 172.21.15.103:0/3038640809 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f218406be30 0x7f218406e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f21980012e0 tx=0x7f2198001970 comp rx=0 tx=0).stop 2024-09-10T08:31:12.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.510+0000 7f21a8711640 1 -- 172.21.15.103:0/3038640809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21a0073ae0 msgr2=0x7f21a014bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.510+0000 7f21a8711640 1 --2- 172.21.15.103:0/3038640809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21a0073ae0 0x7f21a014bd50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f219000c450 tx=0x7f219000c910 comp rx=0 tx=0).stop 2024-09-10T08:31:12.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.510+0000 7f21a6cae640 1 -- 172.21.15.103:0/3038640809 reap_dead start 2024-09-10T08:31:12.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.510+0000 7f21a6cae640 1 -- 172.21.15.103:0/3038640809 reap_dead start 2024-09-10T08:31:12.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.510+0000 7f21a8711640 1 -- 172.21.15.103:0/3038640809 shutdown_connections 2024-09-10T08:31:12.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.510+0000 7f21a8711640 1 -- 172.21.15.103:0/3038640809 >> 172.21.15.103:0/3038640809 conn(0x7f21a00c9d80 msgr2=0x7f21a0156840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:12.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.510+0000 7f21a8711640 1 -- 172.21.15.103:0/3038640809 shutdown_connections 2024-09-10T08:31:12.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.510+0000 7f21a8711640 1 -- 172.21.15.103:0/3038640809 wait complete. 2024-09-10T08:31:12.543 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:31:12.543 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-10T08:31:12.543 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-10T08:31:12.543 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-10T08:31:12.544 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-10T08:31:12.544 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T08:31:12.544 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:31:12.558 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T08:31:12.559 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-10T08:31:12.559 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:31:12.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.705+0000 7f02574af640 1 Processor -- start 2024-09-10T08:31:12.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.705+0000 7f02574af640 1 -- start start 2024-09-10T08:31:12.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.706+0000 7f02574af640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02500ca220 0x7f02500c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.706+0000 7f02574af640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f02500a9230 0x7f0250072b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.706+0000 7f02574af640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0250070800 con 0x7f0250154b80 2024-09-10T08:31:12.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.706+0000 7f02574af640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f02500c99b0 con 0x7f02500a9230 2024-09-10T08:31:12.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.706+0000 7f02574af640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f0250073070 con 0x7f02500ca220 2024-09-10T08:31:12.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.706+0000 7f0255a4c640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7f0250154b80 legacy=0x7f0250151610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:31:12.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.706+0000 7f0254a4a640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7f02500a9230 msgr2=0x7f0250072b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:31:12.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.706+0000 7f0254a4a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f02500a9230 0x7f0250072b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:31:12.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.706+0000 7f025524b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02500ca220 0x7f02500c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.707+0000 7f025524b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02500ca220 0x7f02500c3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:55558/0 (socket says 172.21.15.103:55558) 2024-09-10T08:31:12.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.707+0000 7f025524b640 1 -- 172.21.15.103:0/4005026729 learned_addr learned my addr 172.21.15.103:0/4005026729 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:12.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.707+0000 7f025524b640 1 -- 172.21.15.103:0/4005026729 >> v2:172.21.15.103:3300/0 conn(0x7f02500a9230 msgr2=0x7f0250072b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:31:12.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.707+0000 7f025524b640 1 --2- 172.21.15.103:0/4005026729 >> v2:172.21.15.103:3300/0 conn(0x7f02500a9230 0x7f0250072b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.707+0000 7f025524b640 1 -- 172.21.15.103:0/4005026729 >> v1:172.21.15.103:6789/0 conn(0x7f0250154b80 legacy=0x7f0250151610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:31:12.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.707+0000 7f025524b640 1 -- 172.21.15.103:0/4005026729 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02500c93f0 con 0x7f02500ca220 2024-09-10T08:31:12.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.708+0000 7f025524b640 1 --2- 172.21.15.103:0/4005026729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02500ca220 0x7f02500c3f10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f025006c5c0 tx=0x7f024c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a240952ff30521d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:12.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.708+0000 7f0247fff640 1 -- 172.21.15.103:0/4005026729 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c037070 con 0x7f02500ca220 2024-09-10T08:31:12.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.708+0000 7f0247fff640 1 -- 172.21.15.103:0/4005026729 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f024c032440 con 0x7f02500ca220 2024-09-10T08:31:12.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.708+0000 7f0247fff640 1 -- 172.21.15.103:0/4005026729 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c032810 con 0x7f02500ca220 2024-09-10T08:31:12.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.709+0000 7f02574af640 1 -- 172.21.15.103:0/4005026729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02500ca220 msgr2=0x7f02500c3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.709+0000 7f02574af640 1 --2- 172.21.15.103:0/4005026729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02500ca220 0x7f02500c3f10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f025006c5c0 tx=0x7f024c02a1c0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.709+0000 7f02574af640 1 -- 172.21.15.103:0/4005026729 shutdown_connections 2024-09-10T08:31:12.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.709+0000 7f02574af640 1 --2- 172.21.15.103:0/4005026729 >> v2:172.21.15.103:3300/0 conn(0x7f02500a9230 0x7f0250072b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.709+0000 7f02574af640 1 --2- 172.21.15.103:0/4005026729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02500ca220 0x7f02500c3f10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.709+0000 7f02574af640 1 -- 172.21.15.103:0/4005026729 >> 172.21.15.103:0/4005026729 conn(0x7f0250067b30 msgr2=0x7f0250067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:12.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.710+0000 7f02574af640 1 -- 172.21.15.103:0/4005026729 shutdown_connections 2024-09-10T08:31:12.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.710+0000 7f02574af640 1 -- 172.21.15.103:0/4005026729 wait complete. 2024-09-10T08:31:12.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.711+0000 7f02574af640 1 Processor -- start 2024-09-10T08:31:12.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.711+0000 7f02574af640 1 -- start start 2024-09-10T08:31:12.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.712+0000 7f02574af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02500a9230 0x7f02500acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.712+0000 7f02574af640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02500ca220 0x7f025006d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.712+0000 7f02574af640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0250154b80 0x7f02500ab990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.712+0000 7f02574af640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0250154660 con 0x7f02500ca220 2024-09-10T08:31:12.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.712+0000 7f02574af640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0250154380 con 0x7f02500a9230 2024-09-10T08:31:12.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.712+0000 7f02574af640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0250155010 con 0x7f0250154b80 2024-09-10T08:31:12.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.712+0000 7f0254a4a640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02500ca220 msgr2=0x7f025006d950 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:31:12.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.712+0000 7f0254a4a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02500ca220 0x7f025006d950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:31:12.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.712+0000 7f025524b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02500a9230 0x7f02500acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.712+0000 7f025524b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02500a9230 0x7f02500acb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:55574/0 (socket says 172.21.15.103:55574) 2024-09-10T08:31:12.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.712+0000 7f025524b640 1 -- 172.21.15.103:0/1977665908 learned_addr learned my addr 172.21.15.103:0/1977665908 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:12.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.712+0000 7f0255a4c640 1 --2- 172.21.15.103:0/1977665908 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0250154b80 0x7f02500ab990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.712+0000 7f025524b640 1 -- 172.21.15.103:0/1977665908 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0250154b80 msgr2=0x7f02500ab990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:12.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.712+0000 7f025524b640 1 --2- 172.21.15.103:0/1977665908 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0250154b80 0x7f02500ab990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.712+0000 7f025524b640 1 -- 172.21.15.103:0/1977665908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02500ca220 msgr2=0x7f025006d950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:31:12.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.712+0000 7f025524b640 1 --2- 172.21.15.103:0/1977665908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02500ca220 0x7f025006d950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:12.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.712+0000 7f025524b640 1 -- 172.21.15.103:0/1977665908 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02500c3ea0 con 0x7f02500a9230 2024-09-10T08:31:12.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.713+0000 7f025524b640 1 --2- 172.21.15.103:0/1977665908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02500a9230 0x7f02500acb10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f024c000c00 tx=0x7f024c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:12.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.713+0000 7f0245ffb640 1 -- 172.21.15.103:0/1977665908 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c041070 con 0x7f02500a9230 2024-09-10T08:31:12.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.713+0000 7f0245ffb640 1 -- 172.21.15.103:0/1977665908 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f024c03c870 con 0x7f02500a9230 2024-09-10T08:31:12.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.713+0000 7f0245ffb640 1 -- 172.21.15.103:0/1977665908 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c037040 con 0x7f02500a9230 2024-09-10T08:31:12.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.713+0000 7f02574af640 1 -- 172.21.15.103:0/1977665908 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02501ef200 con 0x7f02500a9230 2024-09-10T08:31:12.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.713+0000 7f02574af640 1 -- 172.21.15.103:0/1977665908 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02500c4180 con 0x7f02500a9230 2024-09-10T08:31:12.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.714+0000 7f02574af640 1 -- 172.21.15.103:0/1977665908 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02500ca600 con 0x7f02500a9230 2024-09-10T08:31:12.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.715+0000 7f0245ffb640 1 -- 172.21.15.103:0/1977665908 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f024c044070 con 0x7f02500a9230 2024-09-10T08:31:12.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.715+0000 7f0245ffb640 1 --2- 172.21.15.103:0/1977665908 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f023406bde0 0x7f023406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:12.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.715+0000 7f0245ffb640 1 -- 172.21.15.103:0/1977665908 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f024c0abec0 con 0x7f02500a9230 2024-09-10T08:31:12.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.715+0000 7f0254a4a640 1 --2- 172.21.15.103:0/1977665908 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f023406bde0 0x7f023406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:12.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.716+0000 7f0254a4a640 1 --2- 172.21.15.103:0/1977665908 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f023406bde0 0x7f023406e2a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f025006d700 tx=0x7f0240006d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:12.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:12.722+0000 7f0245ffb640 1 -- 172.21.15.103:0/1977665908 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f024c079fd0 con 0x7f02500a9230 2024-09-10T08:31:13.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:13.008+0000 7f02574af640 1 -- 172.21.15.103:0/1977665908 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f025006d730 con 0x7f02500a9230 2024-09-10T08:31:13.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:13.010+0000 7f0245ffb640 1 -- 172.21.15.103:0/1977665908 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f024c07e2d0 con 0x7f02500a9230 2024-09-10T08:31:13.010 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":16,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:31:13.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:13.012+0000 7f02574af640 1 -- 172.21.15.103:0/1977665908 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f023406bde0 msgr2=0x7f023406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:13.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:13.012+0000 7f02574af640 1 --2- 172.21.15.103:0/1977665908 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f023406bde0 0x7f023406e2a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f025006d700 tx=0x7f0240006d30 comp rx=0 tx=0).stop 2024-09-10T08:31:13.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:13.012+0000 7f02574af640 1 -- 172.21.15.103:0/1977665908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02500a9230 msgr2=0x7f02500acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:13.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:13.012+0000 7f02574af640 1 --2- 172.21.15.103:0/1977665908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02500a9230 0x7f02500acb10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f024c000c00 tx=0x7f024c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:13.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:13.012+0000 7f02574af640 1 -- 172.21.15.103:0/1977665908 shutdown_connections 2024-09-10T08:31:13.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:13.012+0000 7f02574af640 1 --2- 172.21.15.103:0/1977665908 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f023406bde0 0x7f023406e2a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:13.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:13.012+0000 7f02574af640 1 --2- 172.21.15.103:0/1977665908 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0250154b80 0x7f02500ab990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:13.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:13.012+0000 7f02574af640 1 --2- 172.21.15.103:0/1977665908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02500ca220 0x7f025006d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:13.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:13.012+0000 7f02574af640 1 --2- 172.21.15.103:0/1977665908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02500a9230 0x7f02500acb10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:13.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:13.012+0000 7f02574af640 1 -- 172.21.15.103:0/1977665908 >> 172.21.15.103:0/1977665908 conn(0x7f0250067b30 msgr2=0x7f02500a9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:13.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:13.012+0000 7f02574af640 1 -- 172.21.15.103:0/1977665908 shutdown_connections 2024-09-10T08:31:13.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:13.012+0000 7f02574af640 1 -- 172.21.15.103:0/1977665908 wait complete. 2024-09-10T08:31:16.026 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:31:16.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.134+0000 7f34846d7640 1 Processor -- start 2024-09-10T08:31:16.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.134+0000 7f34846d7640 1 -- start start 2024-09-10T08:31:16.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.135+0000 7f34846d7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f347c067d20 0x7f347c0c3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:16.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.135+0000 7f34846d7640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f347c153d70 con 0x7f347c0abc50 2024-09-10T08:31:16.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.135+0000 7f34846d7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f347c154010 con 0x7f347c150b70 2024-09-10T08:31:16.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.135+0000 7f34846d7640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f347c0a82c0 con 0x7f347c067d20 2024-09-10T08:31:16.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.135+0000 7f3481c72640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7f347c067d20 msgr2=0x7f347c0c3350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:31:16.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.135+0000 7f3482c74640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7f347c0abc50 legacy=0x7f347c0c3890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:31:16.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.135+0000 7f3481c72640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f347c067d20 0x7f347c0c3350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:31:16.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.135+0000 7f3482473640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f347c150b70 0x7f347c0ac1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:57614/0 (socket says 172.21.15.103:57614) 2024-09-10T08:31:16.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.135+0000 7f3482473640 1 -- 172.21.15.103:0/3747649396 learned_addr learned my addr 172.21.15.103:0/3747649396 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:31:16.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.136+0000 7f3481471640 1 -- 172.21.15.103:0/3747649396 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3325188068 0 0) 0x7f347c154010 con 0x7f347c150b70 2024-09-10T08:31:16.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.136+0000 7f3481471640 1 -- 172.21.15.103:0/3747649396 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3468003520 con 0x7f347c150b70 2024-09-10T08:31:16.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.136+0000 7f3481471640 1 -- 172.21.15.103:0/3747649396 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3013447764 0 0) 0x7f3468003520 con 0x7f347c150b70 2024-09-10T08:31:16.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.136+0000 7f3481471640 1 -- 172.21.15.103:0/3747649396 >> v2:172.21.15.103:3300/0 conn(0x7f347c067d20 msgr2=0x7f347c0c3350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:31:16.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.136+0000 7f3481471640 1 --2- 172.21.15.103:0/3747649396 >> v2:172.21.15.103:3300/0 conn(0x7f347c067d20 0x7f347c0c3350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:16.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.136+0000 7f3481471640 1 -- 172.21.15.103:0/3747649396 >> v1:172.21.15.103:6789/0 conn(0x7f347c0abc50 legacy=0x7f347c0c3890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:31:16.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.136+0000 7f3481471640 1 -- 172.21.15.103:0/3747649396 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347c0ab610 con 0x7f347c150b70 2024-09-10T08:31:16.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.136+0000 7f3481471640 1 -- 172.21.15.103:0/3747649396 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f3478001670 con 0x7f347c150b70 2024-09-10T08:31:16.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.136+0000 7f3481471640 1 -- 172.21.15.103:0/3747649396 >> v1:172.21.15.154:6789/0 conn(0x7f347c150b70 legacy=0x7f347c0ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:16.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.136+0000 7f3481471640 1 --2- 172.21.15.103:0/3747649396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34680039b0 0x7f3468003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:16.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.136+0000 7f3481471640 1 --2- 172.21.15.103:0/3747649396 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3468004800 0x7f3468004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:16.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.136+0000 7f3481471640 1 --2- 172.21.15.103:0/3747649396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3468005370 0x7f346800b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:16.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.136+0000 7f3481471640 1 -- 172.21.15.103:0/3747649396 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f347c0a82c0 con 0x7f3468005370 2024-09-10T08:31:16.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.136+0000 7f3481471640 1 -- 172.21.15.103:0/3747649396 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f346800c2c0 con 0x7f34680039b0 2024-09-10T08:31:16.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.136+0000 7f3481471640 1 -- 172.21.15.103:0/3747649396 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f346800c4c0 con 0x7f3468004800 2024-09-10T08:31:16.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.136+0000 7f3482c74640 1 -- 172.21.15.103:0/3747649396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3468005370 msgr2=0x7f346800b9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:31:16.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.136+0000 7f3482c74640 1 --2- 172.21.15.103:0/3747649396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3468005370 0x7f346800b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:31:16.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.136+0000 7f3482473640 1 --2- 172.21.15.103:0/3747649396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34680039b0 0x7f3468003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:16.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.136+0000 7f3481c72640 1 --2- 172.21.15.103:0/3747649396 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3468004800 0x7f3468004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:16.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.137+0000 7f3482473640 1 -- 172.21.15.103:0/3747649396 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3468004800 msgr2=0x7f3468004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:16.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.137+0000 7f3482473640 1 --2- 172.21.15.103:0/3747649396 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3468004800 0x7f3468004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:16.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.137+0000 7f3482473640 1 -- 172.21.15.103:0/3747649396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3468005370 msgr2=0x7f346800b9e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:31:16.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.137+0000 7f3482473640 1 --2- 172.21.15.103:0/3747649396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3468005370 0x7f346800b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:16.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.137+0000 7f3482473640 1 -- 172.21.15.103:0/3747649396 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3468003520 con 0x7f34680039b0 2024-09-10T08:31:16.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.137+0000 7f3482c74640 1 -- 172.21.15.103:0/3747649396 reap_dead start 2024-09-10T08:31:16.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.137+0000 7f3482473640 1 --2- 172.21.15.103:0/3747649396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34680039b0 0x7f3468003db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3478007cb0 tx=0x7f3468005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27e106efad993bef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:16.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.138+0000 7f3481471640 1 -- 172.21.15.103:0/3747649396 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3478007cf0 con 0x7f34680039b0 2024-09-10T08:31:16.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.138+0000 7f3481471640 1 -- 172.21.15.103:0/3747649396 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3478036070 con 0x7f34680039b0 2024-09-10T08:31:16.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.138+0000 7f3481471640 1 -- 172.21.15.103:0/3747649396 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3478005d30 con 0x7f34680039b0 2024-09-10T08:31:16.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.138+0000 7f34846d7640 1 -- 172.21.15.103:0/3747649396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34680039b0 msgr2=0x7f3468003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:16.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.138+0000 7f34846d7640 1 --2- 172.21.15.103:0/3747649396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34680039b0 0x7f3468003db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3478007cb0 tx=0x7f3468005830 comp rx=0 tx=0).stop 2024-09-10T08:31:16.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.138+0000 7f34846d7640 1 -- 172.21.15.103:0/3747649396 shutdown_connections 2024-09-10T08:31:16.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.138+0000 7f34846d7640 1 --2- 172.21.15.103:0/3747649396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34680039b0 0x7f3468003db0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:16.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.138+0000 7f34846d7640 1 -- 172.21.15.103:0/3747649396 >> 172.21.15.103:0/3747649396 conn(0x7f347c0c8430 msgr2=0x7f347c0c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:16.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.138+0000 7f34846d7640 1 -- 172.21.15.103:0/3747649396 shutdown_connections 2024-09-10T08:31:16.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.138+0000 7f34846d7640 1 -- 172.21.15.103:0/3747649396 wait complete. 2024-09-10T08:31:16.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.140+0000 7f34846d7640 1 Processor -- start 2024-09-10T08:31:16.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.140+0000 7f34846d7640 1 -- start start 2024-09-10T08:31:16.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.141+0000 7f34846d7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34680039b0 0x7f347c14d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:16.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.141+0000 7f34846d7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f347c073d10 0x7f347c14c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:16.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.141+0000 7f34846d7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f347c14cd70 0x7f347c1eb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:16.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.141+0000 7f34846d7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f347c0c2e30 con 0x7f34680039b0 2024-09-10T08:31:16.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.141+0000 7f34846d7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f347c1542f0 con 0x7f347c14cd70 2024-09-10T08:31:16.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.141+0000 7f34846d7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f347c150f50 con 0x7f347c073d10 2024-09-10T08:31:16.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.141+0000 7f3482473640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34680039b0 msgr2=0x7f347c14d7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:31:16.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.141+0000 7f3482473640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34680039b0 0x7f347c14d7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:31:16.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.141+0000 7f3482c74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f347c14cd70 0x7f347c1eb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:16.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.141+0000 7f3481c72640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f347c073d10 0x7f347c14c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:16.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.141+0000 7f3482c74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f347c14cd70 0x7f347c1eb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:51798/0 (socket says 172.21.15.103:51798) 2024-09-10T08:31:16.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.141+0000 7f3481c72640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f347c073d10 0x7f347c14c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:42560/0 (socket says 172.21.15.103:42560) 2024-09-10T08:31:16.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.141+0000 7f3482c74640 1 -- 172.21.15.103:0/106009278 learned_addr learned my addr 172.21.15.103:0/106009278 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:16.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.141+0000 7f3481c72640 1 -- 172.21.15.103:0/106009278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f347c14cd70 msgr2=0x7f347c1eb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:16.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.141+0000 7f3481c72640 1 --2- 172.21.15.103:0/106009278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f347c14cd70 0x7f347c1eb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:16.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.141+0000 7f3481c72640 1 -- 172.21.15.103:0/106009278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34680039b0 msgr2=0x7f347c14d7f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:31:16.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.141+0000 7f3481c72640 1 --2- 172.21.15.103:0/106009278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34680039b0 0x7f347c14d7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:16.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.141+0000 7f3481c72640 1 -- 172.21.15.103:0/106009278 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347c14d510 con 0x7f347c073d10 2024-09-10T08:31:16.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.142+0000 7f3481c72640 1 --2- 172.21.15.103:0/106009278 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f347c073d10 0x7f347c14c830 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f346c009490 tx=0x7f346c009950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:16.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.142+0000 7f3472ffd640 1 -- 172.21.15.103:0/106009278 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c016070 con 0x7f347c073d10 2024-09-10T08:31:16.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.142+0000 7f3472ffd640 1 -- 172.21.15.103:0/106009278 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f346c012600 con 0x7f347c073d10 2024-09-10T08:31:16.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.142+0000 7f34846d7640 1 -- 172.21.15.103:0/106009278 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f347c0aa280 con 0x7f347c073d10 2024-09-10T08:31:16.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.142+0000 7f3472ffd640 1 -- 172.21.15.103:0/106009278 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c0129f0 con 0x7f347c073d10 2024-09-10T08:31:16.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.142+0000 7f34846d7640 1 -- 172.21.15.103:0/106009278 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f347c0aa840 con 0x7f347c073d10 2024-09-10T08:31:16.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.143+0000 7f34846d7640 1 -- 172.21.15.103:0/106009278 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f347c0ac1a0 con 0x7f347c073d10 2024-09-10T08:31:16.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.144+0000 7f3472ffd640 1 -- 172.21.15.103:0/106009278 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f346c019070 con 0x7f347c073d10 2024-09-10T08:31:16.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.144+0000 7f3472ffd640 1 --2- 172.21.15.103:0/106009278 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f346006bde0 0x7f346006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:16.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.144+0000 7f3472ffd640 1 -- 172.21.15.103:0/106009278 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f346c08ae10 con 0x7f347c073d10 2024-09-10T08:31:16.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.144+0000 7f3482473640 1 --2- 172.21.15.103:0/106009278 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f346006bde0 0x7f346006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:16.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.145+0000 7f3482473640 1 --2- 172.21.15.103:0/106009278 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f346006bde0 0x7f346006e2a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3478035000 tx=0x7f3478009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:16.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.150+0000 7f3472ffd640 1 -- 172.21.15.103:0/106009278 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f346c058e40 con 0x7f347c073d10 2024-09-10T08:31:16.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.453+0000 7f34846d7640 1 -- 172.21.15.103:0/106009278 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f347c067b00 con 0x7f347c073d10 2024-09-10T08:31:16.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.454+0000 7f3472ffd640 1 -- 172.21.15.103:0/106009278 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f346c05d140 con 0x7f347c073d10 2024-09-10T08:31:16.454 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":16,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:31:16.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.456+0000 7f34846d7640 1 -- 172.21.15.103:0/106009278 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f346006bde0 msgr2=0x7f346006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:16.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.456+0000 7f34846d7640 1 --2- 172.21.15.103:0/106009278 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f346006bde0 0x7f346006e2a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3478035000 tx=0x7f3478009030 comp rx=0 tx=0).stop 2024-09-10T08:31:16.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.456+0000 7f34846d7640 1 -- 172.21.15.103:0/106009278 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f347c073d10 msgr2=0x7f347c14c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:16.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.456+0000 7f34846d7640 1 --2- 172.21.15.103:0/106009278 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f347c073d10 0x7f347c14c830 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f346c009490 tx=0x7f346c009950 comp rx=0 tx=0).stop 2024-09-10T08:31:16.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.456+0000 7f34846d7640 1 -- 172.21.15.103:0/106009278 shutdown_connections 2024-09-10T08:31:16.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.456+0000 7f34846d7640 1 --2- 172.21.15.103:0/106009278 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f346006bde0 0x7f346006e2a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:16.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.456+0000 7f34846d7640 1 --2- 172.21.15.103:0/106009278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f347c14cd70 0x7f347c1eb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:16.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.456+0000 7f34846d7640 1 --2- 172.21.15.103:0/106009278 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f347c073d10 0x7f347c14c830 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:16.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.456+0000 7f34846d7640 1 --2- 172.21.15.103:0/106009278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34680039b0 0x7f347c14d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:16.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.456+0000 7f34846d7640 1 -- 172.21.15.103:0/106009278 >> 172.21.15.103:0/106009278 conn(0x7f347c0c8430 msgr2=0x7f347c0c4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:16.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.456+0000 7f34846d7640 1 -- 172.21.15.103:0/106009278 shutdown_connections 2024-09-10T08:31:16.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:16.456+0000 7f34846d7640 1 -- 172.21.15.103:0/106009278 wait complete. 2024-09-10T08:31:19.469 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:31:19.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:19.577+0000 7fe751df6640 1 Processor -- start 2024-09-10T08:31:19.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:19.577+0000 7fe751df6640 1 -- start start 2024-09-10T08:31:19.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:19.578+0000 7fe751df6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe74c0c8b10 0x7fe74c15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:19.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:19.578+0000 7fe751df6640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe74c0c7070 con 0x7fe74c153be0 2024-09-10T08:31:19.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:19.578+0000 7fe751df6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe74c06d210 con 0x7fe74c06cd80 2024-09-10T08:31:19.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:19.578+0000 7fe751df6640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fe74c0c69b0 con 0x7fe74c0c8b10 2024-09-10T08:31:19.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:19.578+0000 7fe74b7fe640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7fe74c0c8b10 msgr2=0x7fe74c15a4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:31:19.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:19.578+0000 7fe74bfff640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7fe74c153be0 legacy=0x7fe74c156660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:31:19.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:19.578+0000 7fe74b7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe74c0c8b10 0x7fe74c15a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:31:19.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:19.578+0000 7fe74affd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe74c06cd80 0x7fe74c1534d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:57624/0 (socket says 172.21.15.103:57624) 2024-09-10T08:31:19.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:19.578+0000 7fe74affd640 1 -- 172.21.15.103:0/3115568720 learned_addr learned my addr 172.21.15.103:0/3115568720 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:31:19.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:19.779+0000 7fe74b7fe640 1 -- 172.21.15.103:0/3115568720 >> v2:172.21.15.103:3300/0 conn(0x7fe74c0c8b10 msgr2=0x7fe74c15a4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:31:19.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:19.779+0000 7fe74bfff640 1 -- 172.21.15.103:0/3115568720 >> v1:172.21.15.103:6789/0 conn(0x7fe74c153be0 legacy=0x7fe74c156660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:31:19.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:19.779+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.103:3300/0 conn(0x7fe74c0c8b10 0x7fe74c15a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:31:20.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:20.180+0000 7fe74bfff640 1 -- 172.21.15.103:0/3115568720 >> v1:172.21.15.103:6789/0 conn(0x7fe74c153be0 legacy=0x7fe74c156660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:31:20.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:20.180+0000 7fe74b7fe640 1 -- 172.21.15.103:0/3115568720 >> v2:172.21.15.103:3300/0 conn(0x7fe74c0c8b10 msgr2=0x7fe74c15a4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:31:20.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:20.180+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.103:3300/0 conn(0x7fe74c0c8b10 0x7fe74c15a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:31:20.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:20.981+0000 7fe74b7fe640 1 -- 172.21.15.103:0/3115568720 >> v2:172.21.15.103:3300/0 conn(0x7fe74c0c8b10 msgr2=0x7fe74c15a4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:31:20.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:20.981+0000 7fe74bfff640 1 -- 172.21.15.103:0/3115568720 >> v1:172.21.15.103:6789/0 conn(0x7fe74c153be0 legacy=0x7fe74c156660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:31:20.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:20.981+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.103:3300/0 conn(0x7fe74c0c8b10 0x7fe74c15a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:31:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.578+0000 7fe7497fa640 1 -- 172.21.15.103:0/3115568720 >> v2:172.21.15.103:3300/0 conn(0x7fe74c0c8b10 msgr2=0x7fe74c15a4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:31:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.578+0000 7fe7497fa640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.103:3300/0 conn(0x7fe74c0c8b10 0x7fe74c15a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.578+0000 7fe7497fa640 1 -- 172.21.15.103:0/3115568720 >> v1:172.21.15.154:6789/0 conn(0x7fe74c06cd80 legacy=0x7fe74c1534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.578+0000 7fe7497fa640 1 -- 172.21.15.103:0/3115568720 >> v1:172.21.15.103:6789/0 conn(0x7fe74c153be0 legacy=0x7fe74c156660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:31:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.578+0000 7fe7497fa640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 0x7fe738005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.578+0000 7fe7497fa640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 0x7fe7380085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:22.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.578+0000 7fe7497fa640 1 -- 172.21.15.103:0/3115568720 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe74c0c69b0 con 0x7fe7380036c0 2024-09-10T08:31:22.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.578+0000 7fe7497fa640 1 -- 172.21.15.103:0/3115568720 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe738008d00 con 0x7fe738006110 2024-09-10T08:31:22.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.578+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 0x7fe738005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:22.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.578+0000 7fe74affd640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 0x7fe7380085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:22.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.578+0000 7fe74b7fe640 1 -- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 msgr2=0x7fe738005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:31:22.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.578+0000 7fe74b7fe640 1 -- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 msgr2=0x7fe738005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:31:22.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.578+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 0x7fe738005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:31:22.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.578+0000 7fe74affd640 1 -- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 msgr2=0x7fe7380085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:31:22.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.578+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 0x7fe738005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:31:22.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.578+0000 7fe74affd640 1 -- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 msgr2=0x7fe7380085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:31:22.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.578+0000 7fe74affd640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 0x7fe7380085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:31:22.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.578+0000 7fe74affd640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 0x7fe7380085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:31:22.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.779+0000 7fe74affd640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 0x7fe7380085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:22.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.779+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 0x7fe738005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:22.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.779+0000 7fe74affd640 1 -- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 msgr2=0x7fe7380085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:31:22.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.779+0000 7fe74b7fe640 1 -- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 msgr2=0x7fe738005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:31:22.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.779+0000 7fe74b7fe640 1 -- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 msgr2=0x7fe738005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:31:22.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.779+0000 7fe74affd640 1 -- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 msgr2=0x7fe7380085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:31:22.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.779+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 0x7fe738005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:31:22.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.779+0000 7fe74affd640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 0x7fe7380085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:31:22.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.779+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 0x7fe738005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:31:22.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:22.779+0000 7fe74affd640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 0x7fe7380085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:31:23.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:23.180+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 0x7fe738005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:23.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:23.180+0000 7fe74affd640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 0x7fe7380085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:23.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:23.180+0000 7fe74affd640 1 -- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 msgr2=0x7fe7380085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:31:23.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:23.180+0000 7fe74affd640 1 -- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 msgr2=0x7fe7380085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:31:23.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:23.180+0000 7fe74b7fe640 1 -- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 msgr2=0x7fe738005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:31:23.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:23.180+0000 7fe74b7fe640 1 -- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 msgr2=0x7fe738005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:31:23.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:23.180+0000 7fe74affd640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 0x7fe7380085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:31:23.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:23.180+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 0x7fe738005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:31:23.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:23.180+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 0x7fe738005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:31:23.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:23.180+0000 7fe74affd640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 0x7fe7380085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:31:23.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:23.981+0000 7fe74affd640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 0x7fe7380085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:23.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:23.981+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 0x7fe738005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:23.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:23.981+0000 7fe74affd640 1 -- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 msgr2=0x7fe7380085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:31:23.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:23.981+0000 7fe74affd640 1 -- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 msgr2=0x7fe7380085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:31:23.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:23.981+0000 7fe74affd640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 0x7fe7380085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:31:23.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:23.981+0000 7fe74b7fe640 1 -- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 msgr2=0x7fe738005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:31:23.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:23.981+0000 7fe74b7fe640 1 -- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 msgr2=0x7fe738005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:31:23.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:23.981+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 0x7fe738005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:31:23.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:23.981+0000 7fe74affd640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 0x7fe7380085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:31:23.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:23.981+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 0x7fe738005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:31:25.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.578+0000 7fe7497fa640 1 -- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 msgr2=0x7fe7380085d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:31:25.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.578+0000 7fe7497fa640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006110 0x7fe7380085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:25.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.578+0000 7fe7497fa640 1 -- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 msgr2=0x7fe738005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:31:25.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.578+0000 7fe7497fa640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.154:3300/0 conn(0x7fe7380036c0 0x7fe738005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:25.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.578+0000 7fe74bfff640 1 -- 172.21.15.103:0/3115568720 reap_dead start 2024-09-10T08:31:25.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.578+0000 7fe7497fa640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.103:3300/0 conn(0x7fe738003b10 0x7fe7380065a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:25.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.578+0000 7fe7497fa640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 0x7fe738006f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:25.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.578+0000 7fe7497fa640 1 -- 172.21.15.103:0/3115568720 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe74c0c6c90 con 0x7fe738007460 2024-09-10T08:31:25.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.578+0000 7fe7497fa640 1 -- 172.21.15.103:0/3115568720 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fe74c0c69b0 con 0x7fe738003b10 2024-09-10T08:31:25.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.578+0000 7fe7497fa640 1 -- 172.21.15.103:0/3115568720 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe738008d00 con 0x7fe738006ae0 2024-09-10T08:31:25.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.578+0000 7fe74b7fe640 1 -- 172.21.15.103:0/3115568720 >> v2:172.21.15.103:3300/0 conn(0x7fe738003b10 msgr2=0x7fe7380065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:31:25.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.578+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.103:3300/0 conn(0x7fe738003b10 0x7fe7380065a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:31:25.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.578+0000 7fe74affd640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 0x7fe738006f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:25.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.579+0000 7fe74affd640 1 -- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 msgr2=0x7fe738006f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:31:25.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.579+0000 7fe74affd640 1 -- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 msgr2=0x7fe738006f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:31:25.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.579+0000 7fe74affd640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 0x7fe738006f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:31:25.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.579+0000 7fe74affd640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 0x7fe738006f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:31:25.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.779+0000 7fe74b7fe640 1 -- 172.21.15.103:0/3115568720 >> v2:172.21.15.103:3300/0 conn(0x7fe738003b10 msgr2=0x7fe7380065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:31:25.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.779+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.103:3300/0 conn(0x7fe738003b10 0x7fe7380065a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:31:25.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.780+0000 7fe74affd640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 0x7fe738006f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:25.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.780+0000 7fe74affd640 1 -- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 msgr2=0x7fe738006f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:31:25.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.780+0000 7fe74affd640 1 -- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 msgr2=0x7fe738006f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:31:25.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.780+0000 7fe74affd640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 0x7fe738006f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:31:25.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:25.780+0000 7fe74affd640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 0x7fe738006f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:31:26.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.180+0000 7fe74b7fe640 1 -- 172.21.15.103:0/3115568720 >> v2:172.21.15.103:3300/0 conn(0x7fe738003b10 msgr2=0x7fe7380065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:31:26.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.180+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.103:3300/0 conn(0x7fe738003b10 0x7fe7380065a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:31:26.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.181+0000 7fe74affd640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 0x7fe738006f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:26.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.181+0000 7fe74affd640 1 -- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 msgr2=0x7fe738006f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:31:26.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.181+0000 7fe74affd640 1 -- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 msgr2=0x7fe738006f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:31:26.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.181+0000 7fe74affd640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 0x7fe738006f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:31:26.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.181+0000 7fe74affd640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 0x7fe738006f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:31:26.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.873+0000 7fe74a7fc640 1 -- 172.21.15.103:0/3115568720 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 593499362 0 0) 0x7fe74c0c6c90 con 0x7fe738007460 2024-09-10T08:31:26.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.873+0000 7fe74a7fc640 1 -- 172.21.15.103:0/3115568720 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe734003520 con 0x7fe738007460 2024-09-10T08:31:26.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.877+0000 7fe74a7fc640 1 -- 172.21.15.103:0/3115568720 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1321432956 0 0) 0x7fe734003520 con 0x7fe738007460 2024-09-10T08:31:26.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.877+0000 7fe74a7fc640 1 -- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 msgr2=0x7fe738006f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:31:26.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.877+0000 7fe74a7fc640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 0x7fe738006f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:26.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.877+0000 7fe74a7fc640 1 -- 172.21.15.103:0/3115568720 >> v2:172.21.15.103:3300/0 conn(0x7fe738003b10 msgr2=0x7fe7380065a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:31:26.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.877+0000 7fe74a7fc640 1 --2- 172.21.15.103:0/3115568720 >> v2:172.21.15.103:3300/0 conn(0x7fe738003b10 0x7fe7380065a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:26.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.877+0000 7fe74a7fc640 1 -- 172.21.15.103:0/3115568720 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe74c0c7070 con 0x7fe738007460 2024-09-10T08:31:26.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.877+0000 7fe74a7fc640 1 -- 172.21.15.103:0/3115568720 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7fe744004200 con 0x7fe738007460 2024-09-10T08:31:26.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.877+0000 7fe74a7fc640 1 -- 172.21.15.103:0/3115568720 >> v1:172.21.15.154:6789/0 conn(0x7fe738007460 legacy=0x7fe738007910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:26.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.877+0000 7fe74a7fc640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 0x7fe7340039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:26.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.877+0000 7fe74a7fc640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe734003fe0 0x7fe734004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:26.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.877+0000 7fe74a7fc640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe734004d40 0x7fe7340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:26.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.877+0000 7fe74a7fc640 1 -- 172.21.15.103:0/3115568720 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe74c0c69b0 con 0x7fe734004d40 2024-09-10T08:31:26.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.877+0000 7fe74a7fc640 1 -- 172.21.15.103:0/3115568720 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe738008d00 con 0x7fe734003fe0 2024-09-10T08:31:26.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.877+0000 7fe74a7fc640 1 -- 172.21.15.103:0/3115568720 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe73400bca0 con 0x7fe738006ae0 2024-09-10T08:31:26.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.877+0000 7fe74bfff640 1 -- 172.21.15.103:0/3115568720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe734004d40 msgr2=0x7fe7340051c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:31:26.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.877+0000 7fe74bfff640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe734004d40 0x7fe7340051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:31:26.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.878+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 0x7fe7340039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:26.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.878+0000 7fe74affd640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe734003fe0 0x7fe734004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:26.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.878+0000 7fe74b7fe640 1 -- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe734003fe0 msgr2=0x7fe734004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:26.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.878+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe734003fe0 0x7fe734004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:26.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.878+0000 7fe74b7fe640 1 -- 172.21.15.103:0/3115568720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe734004d40 msgr2=0x7fe7340051c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:31:26.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.878+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe734004d40 0x7fe7340051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:26.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.878+0000 7fe74b7fe640 1 -- 172.21.15.103:0/3115568720 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe734003520 con 0x7fe738006ae0 2024-09-10T08:31:26.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.879+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 0x7fe7340039b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009f50 tx=0x7fe734005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f41f5a2c9c4d26d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:26.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.880+0000 7fe74a7fc640 1 -- 172.21.15.103:0/3115568720 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73c009b50 con 0x7fe738006ae0 2024-09-10T08:31:26.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.880+0000 7fe74a7fc640 1 -- 172.21.15.103:0/3115568720 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe73c032620 con 0x7fe738006ae0 2024-09-10T08:31:26.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.880+0000 7fe74a7fc640 1 -- 172.21.15.103:0/3115568720 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73c032a10 con 0x7fe738006ae0 2024-09-10T08:31:26.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.881+0000 7fe751df6640 1 -- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 msgr2=0x7fe7340039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:26.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.881+0000 7fe751df6640 1 --2- 172.21.15.103:0/3115568720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe738006ae0 0x7fe7340039b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009f50 tx=0x7fe734005830 comp rx=0 tx=0).stop 2024-09-10T08:31:26.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.881+0000 7fe74bfff640 1 -- 172.21.15.103:0/3115568720 reap_dead start 2024-09-10T08:31:26.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.881+0000 7fe751df6640 1 -- 172.21.15.103:0/3115568720 shutdown_connections 2024-09-10T08:31:26.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.881+0000 7fe751df6640 1 -- 172.21.15.103:0/3115568720 >> 172.21.15.103:0/3115568720 conn(0x7fe74c0adb80 msgr2=0x7fe74c0adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:26.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.881+0000 7fe751df6640 1 -- 172.21.15.103:0/3115568720 shutdown_connections 2024-09-10T08:31:26.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.881+0000 7fe751df6640 1 -- 172.21.15.103:0/3115568720 wait complete. 2024-09-10T08:31:26.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.882+0000 7fe751df6640 1 Processor -- start 2024-09-10T08:31:26.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.883+0000 7fe751df6640 1 -- start start 2024-09-10T08:31:26.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.883+0000 7fe751df6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74c0accb0 0x7fe74c158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:26.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.883+0000 7fe751df6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe74c1591f0 0x7fe74c1ebfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:26.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.883+0000 7fe751df6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe74c1ec510 0x7fe74c157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:26.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.883+0000 7fe751df6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe74c0c9070 con 0x7fe74c0accb0 2024-09-10T08:31:26.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.883+0000 7fe751df6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe74c0c8ef0 con 0x7fe74c1591f0 2024-09-10T08:31:26.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.883+0000 7fe751df6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe74c15a4a0 con 0x7fe74c1ec510 2024-09-10T08:31:26.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.883+0000 7fe74b7fe640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74c0accb0 msgr2=0x7fe74c158cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:31:26.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.883+0000 7fe74b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74c0accb0 0x7fe74c158cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:31:26.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.883+0000 7fe74affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe74c1591f0 0x7fe74c1ebfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:26.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.883+0000 7fe74bfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe74c1ec510 0x7fe74c157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:26.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.883+0000 7fe74affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe74c1591f0 0x7fe74c1ebfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:49746/0 (socket says 172.21.15.103:49746) 2024-09-10T08:31:26.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.883+0000 7fe74affd640 1 -- 172.21.15.103:0/396658964 learned_addr learned my addr 172.21.15.103:0/396658964 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:26.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.884+0000 7fe74affd640 1 -- 172.21.15.103:0/396658964 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe74c1ec510 msgr2=0x7fe74c157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:26.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.884+0000 7fe74affd640 1 --2- 172.21.15.103:0/396658964 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe74c1ec510 0x7fe74c157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:26.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.884+0000 7fe74affd640 1 -- 172.21.15.103:0/396658964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74c0accb0 msgr2=0x7fe74c158cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:31:26.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.884+0000 7fe74affd640 1 --2- 172.21.15.103:0/396658964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74c0accb0 0x7fe74c158cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:26.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.884+0000 7fe74affd640 1 -- 172.21.15.103:0/396658964 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe74c1ef520 con 0x7fe74c1591f0 2024-09-10T08:31:26.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.884+0000 7fe74bfff640 1 --2- 172.21.15.103:0/396658964 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe74c1ec510 0x7fe74c157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:31:26.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.884+0000 7fe74affd640 1 --2- 172.21.15.103:0/396658964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe74c1591f0 0x7fe74c1ebfd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe740007890 tx=0x7fe7400078c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:26.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.884+0000 7fe733fff640 1 -- 172.21.15.103:0/396658964 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe740004ab0 con 0x7fe74c1591f0 2024-09-10T08:31:26.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.884+0000 7fe733fff640 1 -- 172.21.15.103:0/396658964 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe740004c50 con 0x7fe74c1591f0 2024-09-10T08:31:26.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.884+0000 7fe751df6640 1 -- 172.21.15.103:0/396658964 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe74c1ef800 con 0x7fe74c1591f0 2024-09-10T08:31:26.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.884+0000 7fe733fff640 1 -- 172.21.15.103:0/396658964 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe740004e00 con 0x7fe74c1591f0 2024-09-10T08:31:26.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.884+0000 7fe751df6640 1 -- 172.21.15.103:0/396658964 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe74c1efdc0 con 0x7fe74c1591f0 2024-09-10T08:31:26.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.885+0000 7fe751df6640 1 -- 172.21.15.103:0/396658964 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe74c15a830 con 0x7fe74c1591f0 2024-09-10T08:31:26.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.886+0000 7fe733fff640 1 -- 172.21.15.103:0/396658964 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe740004fa0 con 0x7fe74c1591f0 2024-09-10T08:31:26.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.887+0000 7fe733fff640 1 --2- 172.21.15.103:0/396658964 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe73806d740 0x7fe73806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:26.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.887+0000 7fe733fff640 1 -- 172.21.15.103:0/396658964 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fe74008c210 con 0x7fe74c1591f0 2024-09-10T08:31:26.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.887+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/396658964 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe73806d740 0x7fe73806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:26.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.887+0000 7fe74b7fe640 1 --2- 172.21.15.103:0/396658964 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe73806d740 0x7fe73806fc00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe73c035000 tx=0x7fe73c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:26.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:26.891+0000 7fe733fff640 1 -- 172.21.15.103:0/396658964 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe74005a8b0 con 0x7fe74c1591f0 2024-09-10T08:31:27.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.170+0000 7fe751df6640 1 -- 172.21.15.103:0/396658964 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe74c0c9d90 con 0x7fe74c1591f0 2024-09-10T08:31:27.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.170+0000 7fe733fff640 1 -- 172.21.15.103:0/396658964 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7fe74005a1b0 con 0x7fe74c1591f0 2024-09-10T08:31:27.171 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":18,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:31:27.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.172+0000 7fe751df6640 1 -- 172.21.15.103:0/396658964 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe73806d740 msgr2=0x7fe73806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:27.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.172+0000 7fe751df6640 1 --2- 172.21.15.103:0/396658964 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe73806d740 0x7fe73806fc00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe73c035000 tx=0x7fe73c030000 comp rx=0 tx=0).stop 2024-09-10T08:31:27.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.172+0000 7fe751df6640 1 -- 172.21.15.103:0/396658964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe74c1591f0 msgr2=0x7fe74c1ebfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:27.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.172+0000 7fe751df6640 1 --2- 172.21.15.103:0/396658964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe74c1591f0 0x7fe74c1ebfd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe740007890 tx=0x7fe7400078c0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.172+0000 7fe751df6640 1 -- 172.21.15.103:0/396658964 shutdown_connections 2024-09-10T08:31:27.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.172+0000 7fe751df6640 1 --2- 172.21.15.103:0/396658964 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe73806d740 0x7fe73806fc00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.172+0000 7fe751df6640 1 --2- 172.21.15.103:0/396658964 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe74c1ec510 0x7fe74c157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.172+0000 7fe751df6640 1 --2- 172.21.15.103:0/396658964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe74c1591f0 0x7fe74c1ebfd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.172+0000 7fe751df6640 1 --2- 172.21.15.103:0/396658964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74c0accb0 0x7fe74c158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.172+0000 7fe751df6640 1 -- 172.21.15.103:0/396658964 >> 172.21.15.103:0/396658964 conn(0x7fe74c0adb80 msgr2=0x7fe74c1559d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:27.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.172+0000 7fe751df6640 1 -- 172.21.15.103:0/396658964 shutdown_connections 2024-09-10T08:31:27.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.172+0000 7fe751df6640 1 -- 172.21.15.103:0/396658964 wait complete. 2024-09-10T08:31:27.187 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-10T08:31:27.188 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-10T08:31:27.188 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:31:27.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.299+0000 7ff526566640 1 Processor -- start 2024-09-10T08:31:27.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.299+0000 7ff526566640 1 -- start start 2024-09-10T08:31:27.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.299+0000 7ff526566640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5200c5940 0x7ff520166490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:27.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.299+0000 7ff526566640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff52008d440 0x7ff52008d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:27.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.299+0000 7ff526566640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff520166a70 con 0x7ff5200c26b0 2024-09-10T08:31:27.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.299+0000 7ff526566640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff52008de10 con 0x7ff52008d440 2024-09-10T08:31:27.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.299+0000 7ff526566640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff5201630c0 con 0x7ff5200c5940 2024-09-10T08:31:27.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.300+0000 7ff524b03640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff52008d440 0x7ff52008d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:27.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.300+0000 7ff51f7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5200c5940 0x7ff520166490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:27.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.300+0000 7ff524b03640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff52008d440 0x7ff52008d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:49750/0 (socket says 172.21.15.103:49750) 2024-09-10T08:31:27.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.300+0000 7ff51f7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5200c5940 0x7ff520166490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:57900/0 (socket says 172.21.15.103:57900) 2024-09-10T08:31:27.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.300+0000 7ff524b03640 1 -- 172.21.15.103:0/1113829764 learned_addr learned my addr 172.21.15.103:0/1113829764 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:27.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.300+0000 7ff51effd640 1 -- 172.21.15.103:0/1113829764 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2570175872 0 0) 0x7ff520166a70 con 0x7ff5200c26b0 2024-09-10T08:31:27.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.328+0000 7ff51effd640 1 -- 172.21.15.103:0/1113829764 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff508003500 con 0x7ff5200c26b0 2024-09-10T08:31:27.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.328+0000 7ff524b03640 1 -- 172.21.15.103:0/1113829764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5200c5940 msgr2=0x7ff520166490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:27.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.328+0000 7ff524b03640 1 --2- 172.21.15.103:0/1113829764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5200c5940 0x7ff520166490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.328+0000 7ff524b03640 1 -- 172.21.15.103:0/1113829764 >> v1:172.21.15.154:6789/0 conn(0x7ff5200c26b0 legacy=0x7ff520163550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:27.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.328+0000 7ff524b03640 1 -- 172.21.15.103:0/1113829764 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff520166d50 con 0x7ff52008d440 2024-09-10T08:31:27.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.329+0000 7ff524b03640 1 --2- 172.21.15.103:0/1113829764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff52008d440 0x7ff52008d8d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff5180076c0 tx=0x7ff51800a850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea943c06a9947022 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:27.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.329+0000 7ff51effd640 1 -- 172.21.15.103:0/1113829764 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff518003990 con 0x7ff52008d440 2024-09-10T08:31:27.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.329+0000 7ff51effd640 1 -- 172.21.15.103:0/1113829764 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff518003b30 con 0x7ff52008d440 2024-09-10T08:31:27.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.329+0000 7ff51effd640 1 -- 172.21.15.103:0/1113829764 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff518004030 con 0x7ff52008d440 2024-09-10T08:31:27.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.330+0000 7ff526566640 1 -- 172.21.15.103:0/1113829764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff52008d440 msgr2=0x7ff52008d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:27.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.330+0000 7ff526566640 1 --2- 172.21.15.103:0/1113829764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff52008d440 0x7ff52008d8d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff5180076c0 tx=0x7ff51800a850 comp rx=0 tx=0).stop 2024-09-10T08:31:27.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.330+0000 7ff526566640 1 -- 172.21.15.103:0/1113829764 shutdown_connections 2024-09-10T08:31:27.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.330+0000 7ff526566640 1 --2- 172.21.15.103:0/1113829764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff52008d440 0x7ff52008d8d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.330+0000 7ff526566640 1 --2- 172.21.15.103:0/1113829764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5200c5940 0x7ff520166490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.330+0000 7ff526566640 1 -- 172.21.15.103:0/1113829764 >> 172.21.15.103:0/1113829764 conn(0x7ff5200c7a40 msgr2=0x7ff5200c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:27.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.330+0000 7ff526566640 1 -- 172.21.15.103:0/1113829764 shutdown_connections 2024-09-10T08:31:27.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.330+0000 7ff526566640 1 -- 172.21.15.103:0/1113829764 wait complete. 2024-09-10T08:31:27.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.331+0000 7ff526566640 1 Processor -- start 2024-09-10T08:31:27.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.332+0000 7ff526566640 1 -- start start 2024-09-10T08:31:27.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.332+0000 7ff526566640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff52008d440 0x7ff520073010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:27.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.332+0000 7ff526566640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5200c26b0 0x7ff5201f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:27.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.332+0000 7ff526566640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5200c5940 0x7ff5201f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:27.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.332+0000 7ff526566640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff52006f2e0 con 0x7ff5200c26b0 2024-09-10T08:31:27.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.332+0000 7ff526566640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff520167310 con 0x7ff52008d440 2024-09-10T08:31:27.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.332+0000 7ff526566640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff52006f460 con 0x7ff5200c5940 2024-09-10T08:31:27.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.332+0000 7ff51f7fe640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5200c26b0 msgr2=0x7ff5201f5760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:31:27.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.332+0000 7ff51f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5200c26b0 0x7ff5201f5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:31:27.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.333+0000 7ff51ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff52008d440 0x7ff520073010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:27.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.333+0000 7ff524b03640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5200c5940 0x7ff5201f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:27.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.333+0000 7ff51ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff52008d440 0x7ff520073010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:49764/0 (socket says 172.21.15.103:49764) 2024-09-10T08:31:27.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.333+0000 7ff51ffff640 1 -- 172.21.15.103:0/1878551348 learned_addr learned my addr 172.21.15.103:0/1878551348 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:27.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.333+0000 7ff51ffff640 1 -- 172.21.15.103:0/1878551348 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5200c5940 msgr2=0x7ff5201f5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:27.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.333+0000 7ff51ffff640 1 --2- 172.21.15.103:0/1878551348 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5200c5940 0x7ff5201f5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.333+0000 7ff51ffff640 1 -- 172.21.15.103:0/1878551348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5200c26b0 msgr2=0x7ff5201f5760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:31:27.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.333+0000 7ff51ffff640 1 --2- 172.21.15.103:0/1878551348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5200c26b0 0x7ff5201f5760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.333+0000 7ff51ffff640 1 -- 172.21.15.103:0/1878551348 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5201f8eb0 con 0x7ff52008d440 2024-09-10T08:31:27.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.333+0000 7ff51ffff640 1 --2- 172.21.15.103:0/1878551348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff52008d440 0x7ff520073010 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff51000c500 tx=0x7ff51000c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:27.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.333+0000 7ff51cff9640 1 -- 172.21.15.103:0/1878551348 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5100052d0 con 0x7ff52008d440 2024-09-10T08:31:27.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.333+0000 7ff51cff9640 1 -- 172.21.15.103:0/1878551348 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff510005490 con 0x7ff52008d440 2024-09-10T08:31:27.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.333+0000 7ff526566640 1 -- 172.21.15.103:0/1878551348 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5201f9190 con 0x7ff52008d440 2024-09-10T08:31:27.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.333+0000 7ff51cff9640 1 -- 172.21.15.103:0/1878551348 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff510012870 con 0x7ff52008d440 2024-09-10T08:31:27.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.333+0000 7ff526566640 1 -- 172.21.15.103:0/1878551348 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5201644d0 con 0x7ff52008d440 2024-09-10T08:31:27.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.334+0000 7ff526566640 1 --2- 172.21.15.103:0/1878551348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5200709f0 0x7ff5200a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:27.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.334+0000 7ff526566640 1 -- 172.21.15.103:0/1878551348 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff5200a8690 con 0x7ff5200709f0 2024-09-10T08:31:27.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.334+0000 7ff51f7fe640 1 --2- 172.21.15.103:0/1878551348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5200709f0 0x7ff5200a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:27.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.335+0000 7ff51f7fe640 1 -- 172.21.15.103:0/1878551348 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5200c62f0 con 0x7ff5200709f0 2024-09-10T08:31:27.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.335+0000 7ff51f7fe640 1 --2- 172.21.15.103:0/1878551348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5200709f0 0x7ff5200a8ff0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff5200c1ee0 tx=0x7ff51400ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:27.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.335+0000 7ff51cff9640 1 -- 172.21.15.103:0/1878551348 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff510012a10 con 0x7ff52008d440 2024-09-10T08:31:27.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.335+0000 7ff51cff9640 1 --2- 172.21.15.103:0/1878551348 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff50c06bde0 0x7ff50c06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:27.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.336+0000 7ff51cff9640 1 -- 172.21.15.103:0/1878551348 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff514017070 con 0x7ff5200709f0 2024-09-10T08:31:27.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.336+0000 7ff524b03640 1 --2- 172.21.15.103:0/1878551348 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff50c06bde0 0x7ff50c06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:27.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.336+0000 7ff51cff9640 1 -- 172.21.15.103:0/1878551348 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7ff51008ae50 con 0x7ff52008d440 2024-09-10T08:31:27.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.336+0000 7ff51cff9640 1 -- 172.21.15.103:0/1878551348 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff51400ee50 con 0x7ff5200709f0 2024-09-10T08:31:27.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.336+0000 7ff51cff9640 1 -- 172.21.15.103:0/1878551348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5200709f0 msgr2=0x7ff5200a8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:27.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.336+0000 7ff51cff9640 1 --2- 172.21.15.103:0/1878551348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5200709f0 0x7ff5200a8ff0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff5200c1ee0 tx=0x7ff51400ec00 comp rx=0 tx=0).stop 2024-09-10T08:31:27.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.336+0000 7ff51cff9640 1 -- 172.21.15.103:0/1878551348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5200709f0 msgr2=0x7ff5200a8ff0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:31:27.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.336+0000 7ff51cff9640 1 --2- 172.21.15.103:0/1878551348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5200709f0 0x7ff5200a8ff0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff5200c1ee0 tx=0x7ff51400ec00 comp rx=0 tx=0).stop 2024-09-10T08:31:27.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.336+0000 7ff524b03640 1 --2- 172.21.15.103:0/1878551348 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff50c06bde0 0x7ff50c06e2a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff5200aa8b0 tx=0x7ff51802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:27.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.343+0000 7ff526566640 1 --2- 172.21.15.103:0/1878551348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5200a9530 0x7ff5200a9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:27.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.343+0000 7ff526566640 1 -- 172.21.15.103:0/1878551348 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff5200699d0 con 0x7ff5200a9530 2024-09-10T08:31:27.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.343+0000 7ff51f7fe640 1 --2- 172.21.15.103:0/1878551348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5200a9530 0x7ff5200a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:27.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.343+0000 7ff51f7fe640 1 -- 172.21.15.103:0/1878551348 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff5201f9360 con 0x7ff5200a9530 2024-09-10T08:31:27.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.344+0000 7ff51f7fe640 1 --2- 172.21.15.103:0/1878551348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5200a9530 0x7ff5200a9910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff514018000 tx=0x7ff514004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:27.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.344+0000 7ff51cff9640 1 -- 172.21.15.103:0/1878551348 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff514017030 con 0x7ff5200a9530 2024-09-10T08:31:27.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.344+0000 7ff51cff9640 1 -- 172.21.15.103:0/1878551348 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4877 (secure 0 0 0) 0x7ff514005c60 con 0x7ff5200a9530 2024-09-10T08:31:27.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.344+0000 7ff51cff9640 1 -- 172.21.15.103:0/1878551348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5200a9530 msgr2=0x7ff5200a9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:27.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.344+0000 7ff51cff9640 1 --2- 172.21.15.103:0/1878551348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5200a9530 0x7ff5200a9910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff514018000 tx=0x7ff514004730 comp rx=0 tx=0).stop 2024-09-10T08:31:27.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.344+0000 7ff51cff9640 1 -- 172.21.15.103:0/1878551348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5200a9530 msgr2=0x7ff5200a9910 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:31:27.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.344+0000 7ff51cff9640 1 --2- 172.21.15.103:0/1878551348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5200a9530 0x7ff5200a9910 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.346 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:31:27.347 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:31:27.347 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:31:27.347 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:31:27.347 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 18, 2024-09-10T08:31:27.347 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 93572, 2024-09-10T08:31:27.347 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:31:27.347 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:31:27.347 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:31:27.347 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:27.347 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:31:27.347 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:31:27.347 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:31:27.348 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:31:27.348 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:27.348 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:27.348 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:27.348 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:27.348 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:27.348 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:27.348 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:27.348 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:27.348 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:27.348 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:27.348 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:27.348 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:27.349 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:31:27.349 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:31:27.349 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:27.349 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:27.349 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:27.349 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:27.350 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:27.350 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:27.350 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:27.350 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:27.350 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:27.350 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:27.350 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:27.350 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:27.350 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.351 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:31:27.351 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:31:27.351 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:31:27.351 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:31:27.352 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:31:27.352 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:31:27.352 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:31:27.352 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:31:27.353 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:31:27.353 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:31:27.353 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:31:27.353 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:31:27.353 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:31:27.353 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:31:27.353 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:31:27.354 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:31:27.354 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:31:27.354 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:27.354 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:27.354 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:27.354 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:27.354 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:27.355 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:27.355 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:27.355 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:27.355 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:27.355 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:27.355 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:27.355 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:27.355 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:31:27.356 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.356 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:31:27.356 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.356 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:31:27.356 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:31:27.356 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:27.356 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:27.357 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.357 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:27.357 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:31:27.357 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:27.357 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.357 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.357 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:27.357 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:31:27.357 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:27.357 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:27.358 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:27.358 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.358 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:31:27.358 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:31:27.358 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:27.358 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:27.358 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:27.358 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.358 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.358 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:31:27.358 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:31:27.359 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:27.359 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:27.359 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.359 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:27.359 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:31:27.359 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:27.359 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.359 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.359 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:27.359 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:31:27.359 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:27.359 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:27.359 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:27.359 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.360 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:31:27.360 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:31:27.360 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:27.360 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:27.360 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:27.360 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.360 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.360 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:31:27.360 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:31:27.361 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:27.361 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:27.361 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.361 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:27.361 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:31:27.361 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:27.361 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.361 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.361 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:27.361 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:31:27.361 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:27.361 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:27.362 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:27.362 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.362 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:31:27.362 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:31:27.362 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:27.362 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:27.362 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:27.362 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:27.362 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:27.362 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.362 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:31:27.362 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:31:27.362 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.363 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:27.363 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:27.363 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:31:27.363 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:27.363 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:27.363 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:31:27.363 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.363 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:27.363 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:27.363 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:31:27.363 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:27.364 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:27.364 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:31:27.364 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.364 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:27.364 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:27.364 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:31:27.364 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:27.364 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:27.364 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:31:27.364 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.364 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:27.365 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:27.365 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:31:27.365 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:27.365 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:27.365 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.365 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:31:27.365 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:31:27.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.344+0000 7ff526566640 1 -- 172.21.15.103:0/1878551348 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff50c06bde0 msgr2=0x7ff50c06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:27.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.344+0000 7ff526566640 1 --2- 172.21.15.103:0/1878551348 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff50c06bde0 0x7ff50c06e2a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff5200aa8b0 tx=0x7ff51802e000 comp rx=0 tx=0).stop 2024-09-10T08:31:27.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.344+0000 7ff526566640 1 -- 172.21.15.103:0/1878551348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff52008d440 msgr2=0x7ff520073010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:27.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.344+0000 7ff526566640 1 --2- 172.21.15.103:0/1878551348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff52008d440 0x7ff520073010 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff51000c500 tx=0x7ff51000c9c0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.344+0000 7ff524b03640 1 -- 172.21.15.103:0/1878551348 reap_dead start 2024-09-10T08:31:27.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.344+0000 7ff524b03640 1 -- 172.21.15.103:0/1878551348 reap_dead start 2024-09-10T08:31:27.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.344+0000 7ff526566640 1 -- 172.21.15.103:0/1878551348 shutdown_connections 2024-09-10T08:31:27.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.344+0000 7ff526566640 1 -- 172.21.15.103:0/1878551348 >> 172.21.15.103:0/1878551348 conn(0x7ff5200c7a40 msgr2=0x7ff5200c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:27.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.344+0000 7ff526566640 1 -- 172.21.15.103:0/1878551348 shutdown_connections 2024-09-10T08:31:27.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.344+0000 7ff526566640 1 -- 172.21.15.103:0/1878551348 wait complete. 2024-09-10T08:31:27.368 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:31:27.368 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-10T08:31:27.369 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:31:27.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.482+0000 7fe7c4f68640 1 Processor -- start 2024-09-10T08:31:27.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.482+0000 7fe7c4f68640 1 -- start start 2024-09-10T08:31:27.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.484+0000 7fe7c4f68640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe7c00acc30 0x7fe7c00c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:27.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.484+0000 7fe7c4f68640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe7c00c44b0 0x7fe7c00c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:27.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.484+0000 7fe7c4f68640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7c0070590 con 0x7fe7c00c7fb0 2024-09-10T08:31:27.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.484+0000 7fe7c4f68640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fe7c00c4ea0 con 0x7fe7c00acc30 2024-09-10T08:31:27.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.484+0000 7fe7c4f68640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe7c00a8220 con 0x7fe7c00c44b0 2024-09-10T08:31:27.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.484+0000 7fe7be59c640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7fe7c00acc30 msgr2=0x7fe7c00c3f70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:31:27.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.484+0000 7fe7be59c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe7c00acc30 0x7fe7c00c3f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:31:27.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.484+0000 7fe7bdd9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe7c00c44b0 0x7fe7c00c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:27.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.484+0000 7fe7bed9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe7c00c7fb0 0x7fe7c0156a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:46838/0 (socket says 172.21.15.103:46838) 2024-09-10T08:31:27.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.484+0000 7fe7bdd9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe7c00c44b0 0x7fe7c00c7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:49792/0 (socket says 172.21.15.103:49792) 2024-09-10T08:31:27.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.484+0000 7fe7bed9d640 1 -- 172.21.15.103:0/3953813383 learned_addr learned my addr 172.21.15.103:0/3953813383 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:31:27.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.484+0000 7fe7bdd9b640 1 -- 172.21.15.103:0/3953813383 >> v2:172.21.15.103:3300/0 conn(0x7fe7c00acc30 msgr2=0x7fe7c00c3f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:31:27.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.484+0000 7fe7bdd9b640 1 --2- 172.21.15.103:0/3953813383 >> v2:172.21.15.103:3300/0 conn(0x7fe7c00acc30 0x7fe7c00c3f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.484+0000 7fe7bdd9b640 1 -- 172.21.15.103:0/3953813383 >> v1:172.21.15.154:6789/0 conn(0x7fe7c00c7fb0 legacy=0x7fe7c0156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:27.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.484+0000 7fe7bdd9b640 1 -- 172.21.15.103:0/3953813383 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c00a84f0 con 0x7fe7c00c44b0 2024-09-10T08:31:27.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.485+0000 7fe7bdd9b640 1 --2- 172.21.15.103:0/3953813383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c00c44b0 0x7fe7c00c7a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00c4c60 tx=0x7fe7b402a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7df062c66a09ea4e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:27.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.485+0000 7fe7bd59a640 1 -- 172.21.15.103:0/3953813383 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4037070 con 0x7fe7c00c44b0 2024-09-10T08:31:27.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.485+0000 7fe7bd59a640 1 -- 172.21.15.103:0/3953813383 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b402adf0 con 0x7fe7c00c44b0 2024-09-10T08:31:27.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.485+0000 7fe7bd59a640 1 -- 172.21.15.103:0/3953813383 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4032660 con 0x7fe7c00c44b0 2024-09-10T08:31:27.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.486+0000 7fe7c4f68640 1 -- 172.21.15.103:0/3953813383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c00c44b0 msgr2=0x7fe7c00c7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:27.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.486+0000 7fe7c4f68640 1 --2- 172.21.15.103:0/3953813383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c00c44b0 0x7fe7c00c7a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00c4c60 tx=0x7fe7b402a0a0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.486+0000 7fe7c4f68640 1 -- 172.21.15.103:0/3953813383 shutdown_connections 2024-09-10T08:31:27.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.486+0000 7fe7c4f68640 1 --2- 172.21.15.103:0/3953813383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c00c44b0 0x7fe7c00c7a70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.486+0000 7fe7c4f68640 1 --2- 172.21.15.103:0/3953813383 >> v2:172.21.15.103:3300/0 conn(0x7fe7c00acc30 0x7fe7c00c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.486+0000 7fe7c4f68640 1 -- 172.21.15.103:0/3953813383 >> 172.21.15.103:0/3953813383 conn(0x7fe7c00c5660 msgr2=0x7fe7c00c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:27.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.486+0000 7fe7c4f68640 1 -- 172.21.15.103:0/3953813383 shutdown_connections 2024-09-10T08:31:27.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.486+0000 7fe7c4f68640 1 -- 172.21.15.103:0/3953813383 wait complete. 2024-09-10T08:31:27.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.487+0000 7fe7c4f68640 1 Processor -- start 2024-09-10T08:31:27.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.488+0000 7fe7c4f68640 1 -- start start 2024-09-10T08:31:27.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.488+0000 7fe7c4f68640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7c00acc30 0x7fe7c006eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:27.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.488+0000 7fe7c4f68640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c00c44b0 0x7fe7c01e7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:27.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.488+0000 7fe7c4f68640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7c00c7fb0 0x7fe7c01542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:27.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.488+0000 7fe7c4f68640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c00c5330 con 0x7fe7c00c7fb0 2024-09-10T08:31:27.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.488+0000 7fe7c4f68640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c00702b0 con 0x7fe7c00c44b0 2024-09-10T08:31:27.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.488+0000 7fe7c4f68640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe7c00c63f0 con 0x7fe7c00acc30 2024-09-10T08:31:27.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.488+0000 7fe7bed9d640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7c00c7fb0 msgr2=0x7fe7c01542f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:31:27.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.488+0000 7fe7bed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7c00c7fb0 0x7fe7c01542f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:31:27.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.488+0000 7fe7bdd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c00c44b0 0x7fe7c01e7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:27.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.488+0000 7fe7be59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7c00acc30 0x7fe7c006eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:27.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.488+0000 7fe7bdd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c00c44b0 0x7fe7c01e7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:49794/0 (socket says 172.21.15.103:49794) 2024-09-10T08:31:27.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.488+0000 7fe7bdd9b640 1 -- 172.21.15.103:0/1775259193 learned_addr learned my addr 172.21.15.103:0/1775259193 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:27.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.489+0000 7fe7bdd9b640 1 -- 172.21.15.103:0/1775259193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7c00acc30 msgr2=0x7fe7c006eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:27.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.489+0000 7fe7bdd9b640 1 --2- 172.21.15.103:0/1775259193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7c00acc30 0x7fe7c006eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.489+0000 7fe7bdd9b640 1 -- 172.21.15.103:0/1775259193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7c00c7fb0 msgr2=0x7fe7c01542f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:31:27.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.489+0000 7fe7bdd9b640 1 --2- 172.21.15.103:0/1775259193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7c00c7fb0 0x7fe7c01542f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.489+0000 7fe7bdd9b640 1 -- 172.21.15.103:0/1775259193 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c01e7a80 con 0x7fe7c00c44b0 2024-09-10T08:31:27.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.489+0000 7fe7be59c640 1 --2- 172.21.15.103:0/1775259193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7c00acc30 0x7fe7c006eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:31:27.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.489+0000 7fe7bdd9b640 1 --2- 172.21.15.103:0/1775259193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c00c44b0 0x7fe7c01e7380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4035040 tx=0x7fe7b40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:27.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.489+0000 7fe7aeffd640 1 -- 172.21.15.103:0/1775259193 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4042070 con 0x7fe7c00c44b0 2024-09-10T08:31:27.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.489+0000 7fe7aeffd640 1 -- 172.21.15.103:0/1775259193 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b403e670 con 0x7fe7c00c44b0 2024-09-10T08:31:27.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.489+0000 7fe7aeffd640 1 -- 172.21.15.103:0/1775259193 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4037040 con 0x7fe7c00c44b0 2024-09-10T08:31:27.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.489+0000 7fe7c4f68640 1 -- 172.21.15.103:0/1775259193 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7c01e7d60 con 0x7fe7c00c44b0 2024-09-10T08:31:27.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.489+0000 7fe7c4f68640 1 -- 172.21.15.103:0/1775259193 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7c01eaa20 con 0x7fe7c00c44b0 2024-09-10T08:31:27.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.490+0000 7fe7c4f68640 1 --2- 172.21.15.103:0/1775259193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7c014e450 0x7fe7c01eaf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:27.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.490+0000 7fe7c4f68640 1 -- 172.21.15.103:0/1775259193 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe7c00c7310 con 0x7fe7c014e450 2024-09-10T08:31:27.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.490+0000 7fe7be59c640 1 --2- 172.21.15.103:0/1775259193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7c014e450 0x7fe7c01eaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:27.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.491+0000 7fe7be59c640 1 -- 172.21.15.103:0/1775259193 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe7c00abc10 con 0x7fe7c014e450 2024-09-10T08:31:27.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.491+0000 7fe7be59c640 1 --2- 172.21.15.103:0/1775259193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7c014e450 0x7fe7c01eaf40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000b590 tx=0x7fe7b000ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:27.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.491+0000 7fe7aeffd640 1 -- 172.21.15.103:0/1775259193 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe7b403a040 con 0x7fe7c00c44b0 2024-09-10T08:31:27.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.491+0000 7fe7aeffd640 1 --2- 172.21.15.103:0/1775259193 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe7a006bde0 0x7fe7a006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:27.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.492+0000 7fe7aeffd640 1 -- 172.21.15.103:0/1775259193 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fe7b40ab4e0 con 0x7fe7c00c44b0 2024-09-10T08:31:27.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.492+0000 7fe7bed9d640 1 --2- 172.21.15.103:0/1775259193 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe7a006bde0 0x7fe7a006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:27.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.492+0000 7fe7aeffd640 1 -- 172.21.15.103:0/1775259193 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b000e8b0 con 0x7fe7c014e450 2024-09-10T08:31:27.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.492+0000 7fe7aeffd640 1 -- 172.21.15.103:0/1775259193 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe7b000ea50 con 0x7fe7c014e450 2024-09-10T08:31:27.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.492+0000 7fe7aeffd640 1 -- 172.21.15.103:0/1775259193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7c014e450 msgr2=0x7fe7c01eaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:27.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.492+0000 7fe7aeffd640 1 --2- 172.21.15.103:0/1775259193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7c014e450 0x7fe7c01eaf40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000b590 tx=0x7fe7b000ba50 comp rx=0 tx=0).stop 2024-09-10T08:31:27.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.492+0000 7fe7aeffd640 1 -- 172.21.15.103:0/1775259193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7c014e450 msgr2=0x7fe7c01eaf40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:31:27.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.492+0000 7fe7aeffd640 1 --2- 172.21.15.103:0/1775259193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7c014e450 0x7fe7c01eaf40 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000b590 tx=0x7fe7b000ba50 comp rx=0 tx=0).stop 2024-09-10T08:31:27.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.492+0000 7fe7bed9d640 1 --2- 172.21.15.103:0/1775259193 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe7a006bde0 0x7fe7a006e2a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8004b90 tx=0x7fe7b80016e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:27.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.498+0000 7fe7c4f68640 1 --2- 172.21.15.103:0/1775259193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7c01eb480 0x7fe7c014cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:27.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.498+0000 7fe7c4f68640 1 -- 172.21.15.103:0/1775259193 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe7c00742a0 con 0x7fe7c01eb480 2024-09-10T08:31:27.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.498+0000 7fe7be59c640 1 --2- 172.21.15.103:0/1775259193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7c01eb480 0x7fe7c014cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:27.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.498+0000 7fe7be59c640 1 -- 172.21.15.103:0/1775259193 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe7c01eac60 con 0x7fe7c01eb480 2024-09-10T08:31:27.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.499+0000 7fe7be59c640 1 --2- 172.21.15.103:0/1775259193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7c01eb480 0x7fe7c014cd30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe7b001a000 tx=0x7fe7b0009de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:27.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.499+0000 7fe7aeffd640 1 -- 172.21.15.103:0/1775259193 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0020b00 con 0x7fe7c01eb480 2024-09-10T08:31:27.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.499+0000 7fe7aeffd640 1 -- 172.21.15.103:0/1775259193 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5042 (secure 0 0 0) 0x7fe7b0009e50 con 0x7fe7c01eb480 2024-09-10T08:31:27.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.499+0000 7fe7aeffd640 1 -- 172.21.15.103:0/1775259193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7c01eb480 msgr2=0x7fe7c014cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:27.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.499+0000 7fe7aeffd640 1 --2- 172.21.15.103:0/1775259193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7c01eb480 0x7fe7c014cd30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe7b001a000 tx=0x7fe7b0009de0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.499+0000 7fe7aeffd640 1 -- 172.21.15.103:0/1775259193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7c01eb480 msgr2=0x7fe7c014cd30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:31:27.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.499+0000 7fe7aeffd640 1 --2- 172.21.15.103:0/1775259193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7c01eb480 0x7fe7c014cd30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.501 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:31:27.501 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:31:27.501 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:31:27.501 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:31:27.501 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 18, 2024-09-10T08:31:27.501 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 31659, 2024-09-10T08:31:27.501 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:31:27.501 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:31:27.501 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:31:27.501 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:27.502 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:31:27.502 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:31:27.502 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:31:27.502 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:31:27.502 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:27.502 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:27.502 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:27.502 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:27.502 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:27.502 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:27.502 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:27.502 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:27.503 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:27.503 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:27.503 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:27.503 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:27.503 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:31:27.503 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:31:27.503 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:27.503 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:27.503 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:27.503 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:27.503 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:27.503 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:27.504 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:27.504 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:27.504 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:27.504 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:27.504 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:27.504 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:27.504 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.504 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:31:27.504 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:31:27.504 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:31:27.504 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:31:27.504 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:31:27.504 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:31:27.505 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:31:27.505 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:31:27.505 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:31:27.505 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:31:27.505 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:31:27.505 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:31:27.505 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:31:27.505 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:31:27.505 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:31:27.505 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:31:27.505 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:31:27.505 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:27.505 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:27.506 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:27.506 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:27.506 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:27.506 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:27.506 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:27.506 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:27.506 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:27.506 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:27.506 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:27.506 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:27.506 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:31:27.506 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.506 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:31:27.506 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.507 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:31:27.507 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:31:27.507 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:27.507 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:27.507 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.507 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:27.507 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:31:27.507 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:27.507 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.507 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.507 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:27.507 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:31:27.507 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:27.508 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:27.508 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:27.508 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.508 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:31:27.508 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:31:27.508 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:27.508 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:27.508 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:27.508 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.508 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.508 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:31:27.508 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:31:27.508 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:27.509 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:27.509 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.509 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:27.509 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:31:27.509 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:27.509 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.509 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.509 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:27.509 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:31:27.509 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:27.509 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:27.510 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:27.510 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.510 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:31:27.510 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:31:27.510 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:27.510 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:27.510 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:27.510 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.510 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.510 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:31:27.510 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:31:27.511 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:27.511 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:27.511 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.511 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:27.511 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:31:27.511 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:27.511 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.511 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.511 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:27.511 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:31:27.511 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:27.512 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:27.512 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:27.512 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.512 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:31:27.512 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:31:27.512 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:27.512 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:27.512 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:27.512 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:27.512 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:27.512 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.512 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:31:27.513 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:31:27.513 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.513 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:27.513 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:27.513 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:31:27.513 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:27.513 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:27.513 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:31:27.513 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.513 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:27.513 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:27.514 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:31:27.514 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:27.514 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:27.514 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:31:27.514 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.514 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:27.514 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:27.514 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:31:27.514 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:27.514 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:27.514 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:31:27.514 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.514 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:27.515 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:27.515 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:31:27.515 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:27.515 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:27.515 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:31:27.515 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:27.515 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:27.515 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:27.515 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:31:27.515 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:27.515 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:27.515 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:27.515 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:31:27.516 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:31:27.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.499+0000 7fe7c4f68640 1 -- 172.21.15.103:0/1775259193 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe7a006bde0 msgr2=0x7fe7a006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:27.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.499+0000 7fe7c4f68640 1 --2- 172.21.15.103:0/1775259193 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe7a006bde0 0x7fe7a006e2a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8004b90 tx=0x7fe7b80016e0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.499+0000 7fe7c4f68640 1 -- 172.21.15.103:0/1775259193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c00c44b0 msgr2=0x7fe7c01e7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:27.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.499+0000 7fe7c4f68640 1 --2- 172.21.15.103:0/1775259193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c00c44b0 0x7fe7c01e7380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4035040 tx=0x7fe7b40046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.499+0000 7fe7bed9d640 1 -- 172.21.15.103:0/1775259193 reap_dead start 2024-09-10T08:31:27.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.499+0000 7fe7c4f68640 1 -- 172.21.15.103:0/1775259193 shutdown_connections 2024-09-10T08:31:27.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.499+0000 7fe7c4f68640 1 --2- 172.21.15.103:0/1775259193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c00c44b0 0x7fe7c01e7380 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.499+0000 7fe7c4f68640 1 -- 172.21.15.103:0/1775259193 >> 172.21.15.103:0/1775259193 conn(0x7fe7c00c5660 msgr2=0x7fe7c00a8980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:27.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.499+0000 7fe7c4f68640 1 -- 172.21.15.103:0/1775259193 shutdown_connections 2024-09-10T08:31:27.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:27.499+0000 7fe7c4f68640 1 -- 172.21.15.103:0/1775259193 wait complete. 2024-09-10T08:31:27.518 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:31:27.518 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-10T08:31:29.300 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:31:29.303 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:31:47.518 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-10T08:31:47.519 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-10T08:31:47.519 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T08:31:47.519 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T08:31:47.523 INFO:tasks.ceph.mon.a:Started 2024-09-10T08:31:47.523 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:31:47.523 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:31:47.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.640+0000 7f061fe77640 1 Processor -- start 2024-09-10T08:31:47.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.640+0000 7f061fe77640 1 -- start start 2024-09-10T08:31:47.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.641+0000 7f061fe77640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f06180c8b10 0x7f061815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:47.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.641+0000 7f061fe77640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f061806cd80 0x7f06181534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:47.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.641+0000 7f061dc13640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f06180c8b10 0x7f061815a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:47.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.641+0000 7f061dc13640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f06180c8b10 0x7f061815a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54578/0 (socket says 172.21.15.103:54578) 2024-09-10T08:31:47.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.641+0000 7f061dc13640 1 -- 172.21.15.103:0/2418928599 learned_addr learned my addr 172.21.15.103:0/2418928599 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:47.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.641+0000 7f061fe77640 1 -- 172.21.15.103:0/2418928599 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06180c7070 con 0x7f0618153a10 2024-09-10T08:31:47.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.641+0000 7f061fe77640 1 -- 172.21.15.103:0/2418928599 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f061806d210 con 0x7f06180c8b10 2024-09-10T08:31:47.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.641+0000 7f061fe77640 1 -- 172.21.15.103:0/2418928599 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f06180c69b0 con 0x7f061806cd80 2024-09-10T08:31:47.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.641+0000 7f061dc13640 1 -- 172.21.15.103:0/2418928599 >> v2:172.21.15.103:3300/0 conn(0x7f06180c8b10 msgr2=0x7f061815a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:31:47.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.641+0000 7f061dc13640 1 -- 172.21.15.103:0/2418928599 >> v2:172.21.15.103:3300/0 conn(0x7f06180c8b10 msgr2=0x7f061815a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:31:47.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.641+0000 7f061dc13640 1 --2- 172.21.15.103:0/2418928599 >> v2:172.21.15.103:3300/0 conn(0x7f06180c8b10 0x7f061815a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:31:47.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.641+0000 7f061dc13640 1 --2- 172.21.15.103:0/2418928599 >> v2:172.21.15.103:3300/0 conn(0x7f06180c8b10 0x7f061815a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:31:47.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.641+0000 7f061d412640 1 --2- 172.21.15.103:0/2418928599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f061806cd80 0x7f06181534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:47.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.642+0000 7f061cc11640 1 -- 172.21.15.103:0/2418928599 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3780112639 0 0) 0x7f06180c7070 con 0x7f0618153a10 2024-09-10T08:31:47.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.642+0000 7f061cc11640 1 -- 172.21.15.103:0/2418928599 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0604003520 con 0x7f0618153a10 2024-09-10T08:31:47.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.642+0000 7f061d412640 1 -- 172.21.15.103:0/2418928599 >> v2:172.21.15.103:3300/0 conn(0x7f06180c8b10 msgr2=0x7f061815a4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:31:47.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.642+0000 7f061d412640 1 --2- 172.21.15.103:0/2418928599 >> v2:172.21.15.103:3300/0 conn(0x7f06180c8b10 0x7f061815a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:47.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.642+0000 7f061d412640 1 -- 172.21.15.103:0/2418928599 >> v1:172.21.15.154:6789/0 conn(0x7f0618153a10 legacy=0x7f0618156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:47.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.642+0000 7f061d412640 1 -- 172.21.15.103:0/2418928599 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06180c6c90 con 0x7f061806cd80 2024-09-10T08:31:47.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.642+0000 7f061d412640 1 --2- 172.21.15.103:0/2418928599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f061806cd80 0x7f06181534d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f06080097a0 tx=0x7f060802a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bbde36cd045f99f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:47.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.643+0000 7f061cc11640 1 -- 172.21.15.103:0/2418928599 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0608037070 con 0x7f061806cd80 2024-09-10T08:31:47.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.643+0000 7f061cc11640 1 -- 172.21.15.103:0/2418928599 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f060802adb0 con 0x7f061806cd80 2024-09-10T08:31:47.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.643+0000 7f061cc11640 1 -- 172.21.15.103:0/2418928599 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0608032660 con 0x7f061806cd80 2024-09-10T08:31:47.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.643+0000 7f061fe77640 1 -- 172.21.15.103:0/2418928599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f061806cd80 msgr2=0x7f06181534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:47.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.643+0000 7f061fe77640 1 --2- 172.21.15.103:0/2418928599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f061806cd80 0x7f06181534d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f06080097a0 tx=0x7f060802a0a0 comp rx=0 tx=0).stop 2024-09-10T08:31:47.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.643+0000 7f061fe77640 1 -- 172.21.15.103:0/2418928599 shutdown_connections 2024-09-10T08:31:47.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.643+0000 7f061fe77640 1 --2- 172.21.15.103:0/2418928599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f061806cd80 0x7f06181534d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:47.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.643+0000 7f061fe77640 1 --2- 172.21.15.103:0/2418928599 >> v2:172.21.15.103:3300/0 conn(0x7f06180c8b10 0x7f061815a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:47.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.643+0000 7f061fe77640 1 -- 172.21.15.103:0/2418928599 >> 172.21.15.103:0/2418928599 conn(0x7f06180adb80 msgr2=0x7f06180adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:47.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.644+0000 7f061fe77640 1 -- 172.21.15.103:0/2418928599 shutdown_connections 2024-09-10T08:31:47.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.644+0000 7f061fe77640 1 -- 172.21.15.103:0/2418928599 wait complete. 2024-09-10T08:31:47.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.645+0000 7f061fe77640 1 Processor -- start 2024-09-10T08:31:47.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.645+0000 7f061fe77640 1 -- start start 2024-09-10T08:31:47.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.646+0000 7f061fe77640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06180c8b10 0x7f0618149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:47.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.646+0000 7f061fe77640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0618153a10 0x7f061814c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:47.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.646+0000 7f061fe77640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0618148d40 0x7f06181491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:47.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.646+0000 7f061dc13640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06180c8b10 0x7f0618149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:47.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.646+0000 7f061dc13640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06180c8b10 0x7f0618149c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:39216/0 (socket says 172.21.15.103:39216) 2024-09-10T08:31:47.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.646+0000 7f061dc13640 1 -- 172.21.15.103:0/744986707 learned_addr learned my addr 172.21.15.103:0/744986707 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:47.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.646+0000 7f061fe77640 1 -- 172.21.15.103:0/744986707 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0618154020 con 0x7f0618153a10 2024-09-10T08:31:47.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.646+0000 7f061fe77640 1 -- 172.21.15.103:0/744986707 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0618153ea0 con 0x7f0618148d40 2024-09-10T08:31:47.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.646+0000 7f061fe77640 1 -- 172.21.15.103:0/744986707 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f06180c8ef0 con 0x7f06180c8b10 2024-09-10T08:31:47.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.646+0000 7f061d412640 1 --2- 172.21.15.103:0/744986707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0618153a10 0x7f061814c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:47.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.646+0000 7f061d412640 1 -- 172.21.15.103:0/744986707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0618153a10 msgr2=0x7f061814c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-10T08:31:47.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.646+0000 7f061d412640 1 -- 172.21.15.103:0/744986707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0618153a10 msgr2=0x7f061814c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:31:47.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.646+0000 7f061d412640 1 --2- 172.21.15.103:0/744986707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0618153a10 0x7f061814c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:31:47.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.646+0000 7f061d412640 1 --2- 172.21.15.103:0/744986707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0618153a10 0x7f061814c310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:31:47.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.646+0000 7f061e414640 1 --2- 172.21.15.103:0/744986707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0618148d40 0x7f06181491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:47.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.646+0000 7f061dc13640 1 -- 172.21.15.103:0/744986707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0618148d40 msgr2=0x7f06181491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:47.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.646+0000 7f061dc13640 1 --2- 172.21.15.103:0/744986707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0618148d40 0x7f06181491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:47.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.646+0000 7f061dc13640 1 -- 172.21.15.103:0/744986707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0618153a10 msgr2=0x7f061814c310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:31:47.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.646+0000 7f061dc13640 1 --2- 172.21.15.103:0/744986707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0618153a10 0x7f061814c310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:47.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.646+0000 7f061dc13640 1 -- 172.21.15.103:0/744986707 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0618150a40 con 0x7f06180c8b10 2024-09-10T08:31:47.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.646+0000 7f061e414640 1 --2- 172.21.15.103:0/744986707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0618148d40 0x7f06181491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:47.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.646+0000 7f061dc13640 1 --2- 172.21.15.103:0/744986707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06180c8b10 0x7f0618149c90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f061400e810 tx=0x7f061400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:47.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.647+0000 7f060e7fc640 1 -- 172.21.15.103:0/744986707 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0614017070 con 0x7f06180c8b10 2024-09-10T08:31:47.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.647+0000 7f060e7fc640 1 -- 172.21.15.103:0/744986707 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0614004020 con 0x7f06180c8b10 2024-09-10T08:31:47.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.647+0000 7f060e7fc640 1 -- 172.21.15.103:0/744986707 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061400f040 con 0x7f06180c8b10 2024-09-10T08:31:47.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.647+0000 7f061fe77640 1 -- 172.21.15.103:0/744986707 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0618149710 con 0x7f06180c8b10 2024-09-10T08:31:47.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.647+0000 7f061fe77640 1 -- 172.21.15.103:0/744986707 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f061814f170 con 0x7f06180c8b10 2024-09-10T08:31:47.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.648+0000 7f061fe77640 1 -- 172.21.15.103:0/744986707 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06181534d0 con 0x7f06180c8b10 2024-09-10T08:31:47.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.648+0000 7f060e7fc640 1 -- 172.21.15.103:0/744986707 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f061400c6d0 con 0x7f06180c8b10 2024-09-10T08:31:47.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.649+0000 7f060e7fc640 1 --2- 172.21.15.103:0/744986707 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f05fc06be30 0x7f05fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:47.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.649+0000 7f061d412640 1 --2- 172.21.15.103:0/744986707 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f05fc06be30 0x7f05fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:47.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.649+0000 7f060e7fc640 1 -- 172.21.15.103:0/744986707 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f061408ae30 con 0x7f06180c8b10 2024-09-10T08:31:47.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.649+0000 7f061d412640 1 --2- 172.21.15.103:0/744986707 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f05fc06be30 0x7f05fc06e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0608034000 tx=0x7f060802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:47.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.654+0000 7f060e7fc640 1 -- 172.21.15.103:0/744986707 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0618149710 con 0x7f06180c8b10 2024-09-10T08:31:47.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.988+0000 7f061fe77640 1 -- 172.21.15.103:0/744986707 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f06180b2160 con 0x7f06180c8b10 2024-09-10T08:31:47.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.988+0000 7f060e7fc640 1 -- 172.21.15.103:0/744986707 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f0614059430 con 0x7f06180c8b10 2024-09-10T08:31:47.988 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":18,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:31:47.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.991+0000 7f061fe77640 1 -- 172.21.15.103:0/744986707 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f05fc06be30 msgr2=0x7f05fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:47.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.991+0000 7f061fe77640 1 --2- 172.21.15.103:0/744986707 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f05fc06be30 0x7f05fc06e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0608034000 tx=0x7f060802e000 comp rx=0 tx=0).stop 2024-09-10T08:31:47.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.991+0000 7f061fe77640 1 -- 172.21.15.103:0/744986707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06180c8b10 msgr2=0x7f0618149c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:47.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.991+0000 7f061fe77640 1 --2- 172.21.15.103:0/744986707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06180c8b10 0x7f0618149c90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f061400e810 tx=0x7f061400ecd0 comp rx=0 tx=0).stop 2024-09-10T08:31:47.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.991+0000 7f061fe77640 1 -- 172.21.15.103:0/744986707 shutdown_connections 2024-09-10T08:31:47.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.991+0000 7f061fe77640 1 --2- 172.21.15.103:0/744986707 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f05fc06be30 0x7f05fc06e2f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:47.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.991+0000 7f061fe77640 1 --2- 172.21.15.103:0/744986707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0618148d40 0x7f06181491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:47.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.991+0000 7f061fe77640 1 --2- 172.21.15.103:0/744986707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0618153a10 0x7f061814c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:47.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.991+0000 7f061fe77640 1 --2- 172.21.15.103:0/744986707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06180c8b10 0x7f0618149c90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:47.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.991+0000 7f061fe77640 1 -- 172.21.15.103:0/744986707 >> 172.21.15.103:0/744986707 conn(0x7f06180adb80 msgr2=0x7f06180ca1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:47.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.991+0000 7f061fe77640 1 -- 172.21.15.103:0/744986707 shutdown_connections 2024-09-10T08:31:47.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:47.991+0000 7f061fe77640 1 -- 172.21.15.103:0/744986707 wait complete. 2024-09-10T08:31:51.002 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:31:51.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.118+0000 7fdc7d6c9640 1 Processor -- start 2024-09-10T08:31:51.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.118+0000 7fdc7d6c9640 1 -- start start 2024-09-10T08:31:51.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.119+0000 7fdc7d6c9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdc780c8b10 0x7fdc7815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.119+0000 7fdc7d6c9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc7806cd80 0x7fdc781534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.119+0000 7fdc7d6c9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc780c7070 con 0x7fdc78153a10 2024-09-10T08:31:51.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.119+0000 7fdc7d6c9640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fdc7806d210 con 0x7fdc780c8b10 2024-09-10T08:31:51.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.119+0000 7fdc7d6c9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fdc780c69b0 con 0x7fdc7806cd80 2024-09-10T08:31:51.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.119+0000 7fdc76ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdc780c8b10 0x7fdc7815a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.119+0000 7fdc76ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdc780c8b10 0x7fdc7815a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54598/0 (socket says 172.21.15.103:54598) 2024-09-10T08:31:51.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.119+0000 7fdc76ffd640 1 -- 172.21.15.103:0/892458281 learned_addr learned my addr 172.21.15.103:0/892458281 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:51.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.119+0000 7fdc6ffff640 1 --2- 172.21.15.103:0/892458281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc7806cd80 0x7fdc781534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.119+0000 7fdc76ffd640 1 -- 172.21.15.103:0/892458281 >> v2:172.21.15.103:3300/0 conn(0x7fdc780c8b10 msgr2=0x7fdc7815a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:31:51.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.119+0000 7fdc76ffd640 1 -- 172.21.15.103:0/892458281 >> v2:172.21.15.103:3300/0 conn(0x7fdc780c8b10 msgr2=0x7fdc7815a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:31:51.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.119+0000 7fdc76ffd640 1 --2- 172.21.15.103:0/892458281 >> v2:172.21.15.103:3300/0 conn(0x7fdc780c8b10 0x7fdc7815a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:31:51.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.119+0000 7fdc76ffd640 1 --2- 172.21.15.103:0/892458281 >> v2:172.21.15.103:3300/0 conn(0x7fdc780c8b10 0x7fdc7815a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:31:51.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.119+0000 7fdc767fc640 1 -- 172.21.15.103:0/892458281 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3990159954 0 0) 0x7fdc780c7070 con 0x7fdc78153a10 2024-09-10T08:31:51.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.119+0000 7fdc767fc640 1 -- 172.21.15.103:0/892458281 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc64003520 con 0x7fdc78153a10 2024-09-10T08:31:51.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.119+0000 7fdc6ffff640 1 -- 172.21.15.103:0/892458281 >> v2:172.21.15.103:3300/0 conn(0x7fdc780c8b10 msgr2=0x7fdc7815a4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:31:51.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.119+0000 7fdc6ffff640 1 --2- 172.21.15.103:0/892458281 >> v2:172.21.15.103:3300/0 conn(0x7fdc780c8b10 0x7fdc7815a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.119+0000 7fdc6ffff640 1 -- 172.21.15.103:0/892458281 >> v1:172.21.15.154:6789/0 conn(0x7fdc78153a10 legacy=0x7fdc78156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.119+0000 7fdc6ffff640 1 -- 172.21.15.103:0/892458281 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc780c6c90 con 0x7fdc7806cd80 2024-09-10T08:31:51.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.120+0000 7fdc6ffff640 1 --2- 172.21.15.103:0/892458281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc7806cd80 0x7fdc781534d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdc600097a0 tx=0x7fdc6002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93f84cded51eb8c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.120+0000 7fdc767fc640 1 -- 172.21.15.103:0/892458281 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc60037070 con 0x7fdc7806cd80 2024-09-10T08:31:51.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.120+0000 7fdc767fc640 1 -- 172.21.15.103:0/892458281 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc6002ae50 con 0x7fdc7806cd80 2024-09-10T08:31:51.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.120+0000 7fdc767fc640 1 -- 172.21.15.103:0/892458281 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc60032660 con 0x7fdc7806cd80 2024-09-10T08:31:51.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.121+0000 7fdc7d6c9640 1 -- 172.21.15.103:0/892458281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc7806cd80 msgr2=0x7fdc781534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.121+0000 7fdc7d6c9640 1 --2- 172.21.15.103:0/892458281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc7806cd80 0x7fdc781534d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdc600097a0 tx=0x7fdc6002a100 comp rx=0 tx=0).stop 2024-09-10T08:31:51.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.121+0000 7fdc7d6c9640 1 -- 172.21.15.103:0/892458281 shutdown_connections 2024-09-10T08:31:51.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.121+0000 7fdc7d6c9640 1 --2- 172.21.15.103:0/892458281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc7806cd80 0x7fdc781534d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.121+0000 7fdc7d6c9640 1 --2- 172.21.15.103:0/892458281 >> v2:172.21.15.103:3300/0 conn(0x7fdc780c8b10 0x7fdc7815a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.121+0000 7fdc7d6c9640 1 -- 172.21.15.103:0/892458281 >> 172.21.15.103:0/892458281 conn(0x7fdc780adb80 msgr2=0x7fdc780adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:51.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.121+0000 7fdc7d6c9640 1 -- 172.21.15.103:0/892458281 shutdown_connections 2024-09-10T08:31:51.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.121+0000 7fdc7d6c9640 1 -- 172.21.15.103:0/892458281 wait complete. 2024-09-10T08:31:51.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.122+0000 7fdc7d6c9640 1 Processor -- start 2024-09-10T08:31:51.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.122+0000 7fdc7d6c9640 1 -- start start 2024-09-10T08:31:51.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.123+0000 7fdc7d6c9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc780c8b10 0x7fdc781eba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.123+0000 7fdc7d6c9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc78153a10 0x7fdc781e0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.123+0000 7fdc7d6c9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc781e08c0 0x7fdc7814fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.123+0000 7fdc7d6c9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdc78154020 con 0x7fdc780c8b10 2024-09-10T08:31:51.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.123+0000 7fdc7d6c9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdc78153ea0 con 0x7fdc78153a10 2024-09-10T08:31:51.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.123+0000 7fdc7d6c9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fdc780c8ef0 con 0x7fdc781e08c0 2024-09-10T08:31:51.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.123+0000 7fdc76ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc780c8b10 0x7fdc781eba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.123+0000 7fdc76ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc780c8b10 0x7fdc781eba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54610/0 (socket says 172.21.15.103:54610) 2024-09-10T08:31:51.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.123+0000 7fdc76ffd640 1 -- 172.21.15.103:0/343989530 learned_addr learned my addr 172.21.15.103:0/343989530 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:51.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.123+0000 7fdc777fe640 1 --2- 172.21.15.103:0/343989530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc781e08c0 0x7fdc7814fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.123+0000 7fdc76ffd640 1 -- 172.21.15.103:0/343989530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc780c8b10 msgr2=0x7fdc781eba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-10T08:31:51.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.123+0000 7fdc76ffd640 1 -- 172.21.15.103:0/343989530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc780c8b10 msgr2=0x7fdc781eba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:31:51.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.123+0000 7fdc76ffd640 1 --2- 172.21.15.103:0/343989530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc780c8b10 0x7fdc781eba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:31:51.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.123+0000 7fdc76ffd640 1 --2- 172.21.15.103:0/343989530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc780c8b10 0x7fdc781eba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:31:51.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.123+0000 7fdc6ffff640 1 --2- 172.21.15.103:0/343989530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc78153a10 0x7fdc781e0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.123+0000 7fdc6ffff640 1 -- 172.21.15.103:0/343989530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc781e08c0 msgr2=0x7fdc7814fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.123+0000 7fdc6ffff640 1 --2- 172.21.15.103:0/343989530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc781e08c0 0x7fdc7814fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.123+0000 7fdc6ffff640 1 -- 172.21.15.103:0/343989530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc780c8b10 msgr2=0x7fdc781eba20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:31:51.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.123+0000 7fdc6ffff640 1 --2- 172.21.15.103:0/343989530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc780c8b10 0x7fdc781eba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.123+0000 7fdc6ffff640 1 -- 172.21.15.103:0/343989530 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc781e2280 con 0x7fdc78153a10 2024-09-10T08:31:51.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.123+0000 7fdc777fe640 1 --2- 172.21.15.103:0/343989530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc781e08c0 0x7fdc7814fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:31:51.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.124+0000 7fdc6ffff640 1 --2- 172.21.15.103:0/343989530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc78153a10 0x7fdc781e0380 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdc60031000 tx=0x7fdc600046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.124+0000 7fdc6f7fe640 1 -- 172.21.15.103:0/343989530 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc60041070 con 0x7fdc78153a10 2024-09-10T08:31:51.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.124+0000 7fdc6f7fe640 1 -- 172.21.15.103:0/343989530 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc60032e20 con 0x7fdc78153a10 2024-09-10T08:31:51.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.124+0000 7fdc7d6c9640 1 -- 172.21.15.103:0/343989530 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc781e0d70 con 0x7fdc78153a10 2024-09-10T08:31:51.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.124+0000 7fdc6f7fe640 1 -- 172.21.15.103:0/343989530 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc60037040 con 0x7fdc78153a10 2024-09-10T08:31:51.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.124+0000 7fdc7d6c9640 1 -- 172.21.15.103:0/343989530 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc78150920 con 0x7fdc78153a10 2024-09-10T08:31:51.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.125+0000 7fdc7d6c9640 1 -- 172.21.15.103:0/343989530 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc781534d0 con 0x7fdc78153a10 2024-09-10T08:31:51.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.126+0000 7fdc6f7fe640 1 -- 172.21.15.103:0/343989530 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc6003a070 con 0x7fdc78153a10 2024-09-10T08:31:51.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.126+0000 7fdc6f7fe640 1 --2- 172.21.15.103:0/343989530 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc5806be60 0x7fdc5806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.126+0000 7fdc6f7fe640 1 -- 172.21.15.103:0/343989530 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fdc600ab2d0 con 0x7fdc78153a10 2024-09-10T08:31:51.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.126+0000 7fdc76ffd640 1 --2- 172.21.15.103:0/343989530 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc5806be60 0x7fdc5806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.126+0000 7fdc76ffd640 1 --2- 172.21.15.103:0/343989530 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc5806be60 0x7fdc5806e320 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdc7814c6e0 tx=0x7fdc68008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.131+0000 7fdc6f7fe640 1 -- 172.21.15.103:0/343989530 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc60079300 con 0x7fdc78153a10 2024-09-10T08:31:51.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.460+0000 7fdc7d6c9640 1 -- 172.21.15.103:0/343989530 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdc780c9d90 con 0x7fdc78153a10 2024-09-10T08:31:51.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.460+0000 7fdc6f7fe640 1 -- 172.21.15.103:0/343989530 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7fdc600ab0d0 con 0x7fdc78153a10 2024-09-10T08:31:51.460 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":18,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:31:51.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.463+0000 7fdc7d6c9640 1 -- 172.21.15.103:0/343989530 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc5806be60 msgr2=0x7fdc5806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.463+0000 7fdc7d6c9640 1 --2- 172.21.15.103:0/343989530 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc5806be60 0x7fdc5806e320 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdc7814c6e0 tx=0x7fdc68008040 comp rx=0 tx=0).stop 2024-09-10T08:31:51.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.463+0000 7fdc7d6c9640 1 -- 172.21.15.103:0/343989530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc78153a10 msgr2=0x7fdc781e0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.463+0000 7fdc7d6c9640 1 --2- 172.21.15.103:0/343989530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc78153a10 0x7fdc781e0380 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdc60031000 tx=0x7fdc600046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.463+0000 7fdc7d6c9640 1 -- 172.21.15.103:0/343989530 shutdown_connections 2024-09-10T08:31:51.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.463+0000 7fdc7d6c9640 1 --2- 172.21.15.103:0/343989530 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc5806be60 0x7fdc5806e320 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.463+0000 7fdc7d6c9640 1 --2- 172.21.15.103:0/343989530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc781e08c0 0x7fdc7814fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.463+0000 7fdc7d6c9640 1 --2- 172.21.15.103:0/343989530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc78153a10 0x7fdc781e0380 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.463+0000 7fdc7d6c9640 1 --2- 172.21.15.103:0/343989530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc780c8b10 0x7fdc781eba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.463+0000 7fdc7d6c9640 1 -- 172.21.15.103:0/343989530 >> 172.21.15.103:0/343989530 conn(0x7fdc780adb80 msgr2=0x7fdc780ca1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:51.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.463+0000 7fdc7d6c9640 1 -- 172.21.15.103:0/343989530 shutdown_connections 2024-09-10T08:31:51.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:51.463+0000 7fdc7d6c9640 1 -- 172.21.15.103:0/343989530 wait complete. 2024-09-10T08:31:54.474 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:31:54.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.585+0000 7fd03f8ae640 1 Processor -- start 2024-09-10T08:31:54.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.586+0000 7fd03f8ae640 1 -- start start 2024-09-10T08:31:54.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.586+0000 7fd03f8ae640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd0380ca170 0x7fd0380a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:54.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.586+0000 7fd03f8ae640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd0380c88f0 0x7fd0380c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:54.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.586+0000 7fd03f8ae640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd038158ea0 0x7fd038159350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:54.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.586+0000 7fd03f8ae640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fd038073920 con 0x7fd0380c88f0 2024-09-10T08:31:54.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.586+0000 7fd03f8ae640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd038073420 con 0x7fd0380ca170 2024-09-10T08:31:54.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.586+0000 7fd03f8ae640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd038072bd0 con 0x7fd038158ea0 2024-09-10T08:31:54.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.587+0000 7fd03ce49640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd0380c88f0 0x7fd0380c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:54.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.587+0000 7fd03ce49640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd0380c88f0 0x7fd0380c3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54626/0 (socket says 172.21.15.103:54626) 2024-09-10T08:31:54.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.587+0000 7fd03ce49640 1 -- 172.21.15.103:0/513565539 learned_addr learned my addr 172.21.15.103:0/513565539 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:54.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.587+0000 7fd03de4b640 1 --2- 172.21.15.103:0/513565539 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd038158ea0 0x7fd038159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:54.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.587+0000 7fd03d64a640 1 --2- 172.21.15.103:0/513565539 >> v2:172.21.15.154:3300/0 conn(0x7fd0380ca170 0x7fd0380a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:54.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.587+0000 7fd03ce49640 1 -- 172.21.15.103:0/513565539 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd038158ea0 msgr2=0x7fd038159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:54.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.587+0000 7fd03ce49640 1 --2- 172.21.15.103:0/513565539 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd038158ea0 0x7fd038159350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:54.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.587+0000 7fd03ce49640 1 -- 172.21.15.103:0/513565539 >> v2:172.21.15.154:3300/0 conn(0x7fd0380ca170 msgr2=0x7fd0380a92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:54.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.587+0000 7fd03ce49640 1 --2- 172.21.15.103:0/513565539 >> v2:172.21.15.154:3300/0 conn(0x7fd0380ca170 0x7fd0380a92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:54.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.587+0000 7fd03ce49640 1 -- 172.21.15.103:0/513565539 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd038072eb0 con 0x7fd0380c88f0 2024-09-10T08:31:54.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.588+0000 7fd03ce49640 1 --2- 172.21.15.103:0/513565539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0380c88f0 0x7fd0380c3be0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd0380688e0 tx=0x7fd02802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c09bff7800d596bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:54.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.588+0000 7fd02ffff640 1 -- 172.21.15.103:0/513565539 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028037070 con 0x7fd0380c88f0 2024-09-10T08:31:54.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.588+0000 7fd02ffff640 1 -- 172.21.15.103:0/513565539 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd028032440 con 0x7fd0380c88f0 2024-09-10T08:31:54.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.588+0000 7fd02ffff640 1 -- 172.21.15.103:0/513565539 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028032810 con 0x7fd0380c88f0 2024-09-10T08:31:54.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.589+0000 7fd03f8ae640 1 -- 172.21.15.103:0/513565539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0380c88f0 msgr2=0x7fd0380c3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:54.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.589+0000 7fd03f8ae640 1 --2- 172.21.15.103:0/513565539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0380c88f0 0x7fd0380c3be0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd0380688e0 tx=0x7fd02802a140 comp rx=0 tx=0).stop 2024-09-10T08:31:54.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.589+0000 7fd03f8ae640 1 -- 172.21.15.103:0/513565539 shutdown_connections 2024-09-10T08:31:54.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.589+0000 7fd03f8ae640 1 --2- 172.21.15.103:0/513565539 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd038158ea0 0x7fd038159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:54.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.589+0000 7fd03f8ae640 1 --2- 172.21.15.103:0/513565539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0380c88f0 0x7fd0380c3be0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:54.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.589+0000 7fd03f8ae640 1 --2- 172.21.15.103:0/513565539 >> v2:172.21.15.154:3300/0 conn(0x7fd0380ca170 0x7fd0380a92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:54.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.589+0000 7fd03f8ae640 1 -- 172.21.15.103:0/513565539 >> 172.21.15.103:0/513565539 conn(0x7fd038067b30 msgr2=0x7fd038067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:54.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.589+0000 7fd03f8ae640 1 -- 172.21.15.103:0/513565539 shutdown_connections 2024-09-10T08:31:54.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.589+0000 7fd03f8ae640 1 -- 172.21.15.103:0/513565539 wait complete. 2024-09-10T08:31:54.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.590+0000 7fd03f8ae640 1 Processor -- start 2024-09-10T08:31:54.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.590+0000 7fd03f8ae640 1 -- start start 2024-09-10T08:31:54.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.591+0000 7fd03f8ae640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0380c88f0 0x7fd0381ef1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:54.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.591+0000 7fd03f8ae640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0380ca170 0x7fd038153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:54.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.591+0000 7fd03f8ae640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd038158ea0 0x7fd0381543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:54.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.591+0000 7fd03f8ae640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd0380705a0 con 0x7fd0380ca170 2024-09-10T08:31:54.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.591+0000 7fd03f8ae640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd038070960 con 0x7fd038158ea0 2024-09-10T08:31:54.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.591+0000 7fd03f8ae640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd038070720 con 0x7fd0380c88f0 2024-09-10T08:31:54.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.591+0000 7fd03ce49640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0380ca170 0x7fd038153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:54.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.591+0000 7fd03d64a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0380c88f0 0x7fd0381ef1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:54.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.591+0000 7fd03ce49640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0380ca170 0x7fd038153ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54630/0 (socket says 172.21.15.103:54630) 2024-09-10T08:31:54.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.591+0000 7fd03d64a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0380c88f0 0x7fd0381ef1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:39290/0 (socket says 172.21.15.103:39290) 2024-09-10T08:31:54.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.591+0000 7fd03ce49640 1 -- 172.21.15.103:0/1640490687 learned_addr learned my addr 172.21.15.103:0/1640490687 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:54.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.591+0000 7fd03de4b640 1 --2- 172.21.15.103:0/1640490687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd038158ea0 0x7fd0381543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:54.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.592+0000 7fd03ce49640 1 -- 172.21.15.103:0/1640490687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0380c88f0 msgr2=0x7fd0381ef1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:54.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.592+0000 7fd03ce49640 1 --2- 172.21.15.103:0/1640490687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0380c88f0 0x7fd0381ef1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:54.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.592+0000 7fd03ce49640 1 -- 172.21.15.103:0/1640490687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd038158ea0 msgr2=0x7fd0381543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:54.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.592+0000 7fd03ce49640 1 --2- 172.21.15.103:0/1640490687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd038158ea0 0x7fd0381543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:54.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.592+0000 7fd03ce49640 1 -- 172.21.15.103:0/1640490687 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0381efa70 con 0x7fd0380ca170 2024-09-10T08:31:54.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.592+0000 7fd03ce49640 1 --2- 172.21.15.103:0/1640490687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0380ca170 0x7fd038153ea0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd02802a180 tx=0x7fd0280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:54.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.592+0000 7fd02dffb640 1 -- 172.21.15.103:0/1640490687 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028041020 con 0x7fd0380ca170 2024-09-10T08:31:54.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.592+0000 7fd02dffb640 1 -- 172.21.15.103:0/1640490687 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd02803d620 con 0x7fd0380ca170 2024-09-10T08:31:54.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.592+0000 7fd03f8ae640 1 -- 172.21.15.103:0/1640490687 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0381efd50 con 0x7fd0380ca170 2024-09-10T08:31:54.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.592+0000 7fd02dffb640 1 -- 172.21.15.103:0/1640490687 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028037040 con 0x7fd0380ca170 2024-09-10T08:31:54.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.592+0000 7fd03f8ae640 1 -- 172.21.15.103:0/1640490687 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0380a8a40 con 0x7fd0380ca170 2024-09-10T08:31:54.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.593+0000 7fd03f8ae640 1 -- 172.21.15.103:0/1640490687 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0380ca550 con 0x7fd0380ca170 2024-09-10T08:31:54.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.594+0000 7fd02dffb640 1 -- 172.21.15.103:0/1640490687 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd028044020 con 0x7fd0380ca170 2024-09-10T08:31:54.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.594+0000 7fd02dffb640 1 --2- 172.21.15.103:0/1640490687 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd01c06be30 0x7fd01c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:54.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.594+0000 7fd02dffb640 1 -- 172.21.15.103:0/1640490687 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fd0280ab6d0 con 0x7fd0380ca170 2024-09-10T08:31:54.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.594+0000 7fd03d64a640 1 --2- 172.21.15.103:0/1640490687 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd01c06be30 0x7fd01c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:54.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.595+0000 7fd03d64a640 1 --2- 172.21.15.103:0/1640490687 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd01c06be30 0x7fd01c06e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd0380ad680 tx=0x7fd034009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:54.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.601+0000 7fd02dffb640 1 -- 172.21.15.103:0/1640490687 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd02804b030 con 0x7fd0380ca170 2024-09-10T08:31:54.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.873+0000 7fd03f8ae640 1 -- 172.21.15.103:0/1640490687 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd038075030 con 0x7fd0380ca170 2024-09-10T08:31:54.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.873+0000 7fd02dffb640 1 -- 172.21.15.103:0/1640490687 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7fd028079720 con 0x7fd0380ca170 2024-09-10T08:31:54.873 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:31:54.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.876+0000 7fd03f8ae640 1 -- 172.21.15.103:0/1640490687 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd01c06be30 msgr2=0x7fd01c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:54.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.876+0000 7fd03f8ae640 1 --2- 172.21.15.103:0/1640490687 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd01c06be30 0x7fd01c06e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd0380ad680 tx=0x7fd034009190 comp rx=0 tx=0).stop 2024-09-10T08:31:54.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.876+0000 7fd03f8ae640 1 -- 172.21.15.103:0/1640490687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0380ca170 msgr2=0x7fd038153ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:54.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.876+0000 7fd03f8ae640 1 --2- 172.21.15.103:0/1640490687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0380ca170 0x7fd038153ea0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd02802a180 tx=0x7fd0280046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:54.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.876+0000 7fd03f8ae640 1 -- 172.21.15.103:0/1640490687 shutdown_connections 2024-09-10T08:31:54.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.876+0000 7fd03f8ae640 1 --2- 172.21.15.103:0/1640490687 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd01c06be30 0x7fd01c06e2f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:54.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.876+0000 7fd03f8ae640 1 --2- 172.21.15.103:0/1640490687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd038158ea0 0x7fd0381543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:54.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.876+0000 7fd03f8ae640 1 --2- 172.21.15.103:0/1640490687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0380ca170 0x7fd038153ea0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:54.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.876+0000 7fd03f8ae640 1 --2- 172.21.15.103:0/1640490687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0380c88f0 0x7fd0381ef1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:54.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.876+0000 7fd03f8ae640 1 -- 172.21.15.103:0/1640490687 >> 172.21.15.103:0/1640490687 conn(0x7fd038067b30 msgr2=0x7fd0380c3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:54.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.876+0000 7fd03f8ae640 1 -- 172.21.15.103:0/1640490687 shutdown_connections 2024-09-10T08:31:54.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:54.876+0000 7fd03f8ae640 1 -- 172.21.15.103:0/1640490687 wait complete. 2024-09-10T08:31:54.887 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:31:54.888 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:31:54.888 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:31:55.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.017+0000 7fa2aaa3c640 1 Processor -- start 2024-09-10T08:31:55.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.017+0000 7fa2aaa3c640 1 -- start start 2024-09-10T08:31:55.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.017+0000 7fa2aaa3c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa2a406c650 0x7fa2a40c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.017+0000 7fa2aaa3c640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a415a7c0 con 0x7fa2a4150480 2024-09-10T08:31:55.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.017+0000 7fa2aaa3c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a4159a00 con 0x7fa2a40ca1c0 2024-09-10T08:31:55.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.018+0000 7fa2aaa3c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fa2a406c240 con 0x7fa2a406c650 2024-09-10T08:31:55.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.018+0000 7fa2a3fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa2a4150480 0x7fa2a40c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48872/0 (socket says 172.21.15.103:48872) 2024-09-10T08:31:55.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.018+0000 7fa2a3fff640 1 -- 172.21.15.103:0/1179518272 learned_addr learned my addr 172.21.15.103:0/1179518272 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:31:55.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.018+0000 7fa2a37fe640 1 --2- 172.21.15.103:0/1179518272 >> v2:172.21.15.154:3300/0 conn(0x7fa2a406c650 0x7fa2a40c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.018+0000 7fa2a2ffd640 1 -- 172.21.15.103:0/1179518272 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1402058346 0 0) 0x7fa2a415a7c0 con 0x7fa2a4150480 2024-09-10T08:31:55.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.018+0000 7fa2a2ffd640 1 -- 172.21.15.103:0/1179518272 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa28c003520 con 0x7fa2a4150480 2024-09-10T08:31:55.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.018+0000 7fa2a37fe640 1 -- 172.21.15.103:0/1179518272 >> v1:172.21.15.154:6789/0 conn(0x7fa2a40ca1c0 legacy=0x7fa2a4160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.018+0000 7fa2a37fe640 1 -- 172.21.15.103:0/1179518272 >> v1:172.21.15.103:6789/0 conn(0x7fa2a4150480 legacy=0x7fa2a40c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.018+0000 7fa2a37fe640 1 -- 172.21.15.103:0/1179518272 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a4159ce0 con 0x7fa2a406c650 2024-09-10T08:31:55.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.019+0000 7fa2a37fe640 1 --2- 172.21.15.103:0/1179518272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2a406c650 0x7fa2a40c9c80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa2980097a0 tx=0x7fa29802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f31a9bce636f80b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:55.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.019+0000 7fa2a2ffd640 1 -- 172.21.15.103:0/1179518272 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa298037070 con 0x7fa2a406c650 2024-09-10T08:31:55.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.019+0000 7fa2a2ffd640 1 -- 172.21.15.103:0/1179518272 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa298032440 con 0x7fa2a406c650 2024-09-10T08:31:55.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.019+0000 7fa2a2ffd640 1 -- 172.21.15.103:0/1179518272 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2980327f0 con 0x7fa2a406c650 2024-09-10T08:31:55.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.020+0000 7fa2aaa3c640 1 -- 172.21.15.103:0/1179518272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2a406c650 msgr2=0x7fa2a40c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.020+0000 7fa2aaa3c640 1 --2- 172.21.15.103:0/1179518272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2a406c650 0x7fa2a40c9c80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa2980097a0 tx=0x7fa29802a230 comp rx=0 tx=0).stop 2024-09-10T08:31:55.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.020+0000 7fa2aaa3c640 1 -- 172.21.15.103:0/1179518272 shutdown_connections 2024-09-10T08:31:55.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.020+0000 7fa2aaa3c640 1 --2- 172.21.15.103:0/1179518272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2a406c650 0x7fa2a40c9c80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.020+0000 7fa2aaa3c640 1 -- 172.21.15.103:0/1179518272 >> 172.21.15.103:0/1179518272 conn(0x7fa2a4068030 msgr2=0x7fa2a4073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:55.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.020+0000 7fa2aaa3c640 1 -- 172.21.15.103:0/1179518272 shutdown_connections 2024-09-10T08:31:55.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.020+0000 7fa2aaa3c640 1 -- 172.21.15.103:0/1179518272 wait complete. 2024-09-10T08:31:55.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.021+0000 7fa2aaa3c640 1 Processor -- start 2024-09-10T08:31:55.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.021+0000 7fa2aaa3c640 1 -- start start 2024-09-10T08:31:55.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.022+0000 7fa2aaa3c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2a406c650 0x7fa2a4150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.022+0000 7fa2aaa3c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a40ca1c0 0x7fa2a414f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.022+0000 7fa2aaa3c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2a4150480 0x7fa2a414fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.022+0000 7fa2aaa3c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a406d270 con 0x7fa2a40ca1c0 2024-09-10T08:31:55.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.022+0000 7fa2aaa3c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a415a330 con 0x7fa2a4150480 2024-09-10T08:31:55.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.022+0000 7fa2aaa3c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa2a40ca5f0 con 0x7fa2a406c650 2024-09-10T08:31:55.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.022+0000 7fa2a37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a40ca1c0 0x7fa2a414f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.022+0000 7fa2a37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a40ca1c0 0x7fa2a414f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54636/0 (socket says 172.21.15.103:54636) 2024-09-10T08:31:55.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.022+0000 7fa2a37fe640 1 -- 172.21.15.103:0/796747204 learned_addr learned my addr 172.21.15.103:0/796747204 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:55.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.022+0000 7fa2a3fff640 1 --2- 172.21.15.103:0/796747204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2a406c650 0x7fa2a4150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.022+0000 7fa2a8fd9640 1 --2- 172.21.15.103:0/796747204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2a4150480 0x7fa2a414fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.022+0000 7fa2a37fe640 1 -- 172.21.15.103:0/796747204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2a406c650 msgr2=0x7fa2a4150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.022+0000 7fa2a37fe640 1 --2- 172.21.15.103:0/796747204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2a406c650 0x7fa2a4150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.022+0000 7fa2a37fe640 1 -- 172.21.15.103:0/796747204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2a4150480 msgr2=0x7fa2a414fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.022+0000 7fa2a37fe640 1 --2- 172.21.15.103:0/796747204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2a4150480 0x7fa2a414fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.022+0000 7fa2a37fe640 1 -- 172.21.15.103:0/796747204 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a41ebb90 con 0x7fa2a40ca1c0 2024-09-10T08:31:55.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.022+0000 7fa2a37fe640 1 --2- 172.21.15.103:0/796747204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a40ca1c0 0x7fa2a414f730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa2980097a0 tx=0x7fa2980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:55.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.023+0000 7fa2a0ff9640 1 -- 172.21.15.103:0/796747204 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa298037050 con 0x7fa2a40ca1c0 2024-09-10T08:31:55.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.023+0000 7fa2a0ff9640 1 -- 172.21.15.103:0/796747204 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa298038040 con 0x7fa2a40ca1c0 2024-09-10T08:31:55.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.023+0000 7fa2aaa3c640 1 -- 172.21.15.103:0/796747204 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a41ebe70 con 0x7fa2a40ca1c0 2024-09-10T08:31:55.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.023+0000 7fa2a0ff9640 1 -- 172.21.15.103:0/796747204 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa298004470 con 0x7fa2a40ca1c0 2024-09-10T08:31:55.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.023+0000 7fa2aaa3c640 1 -- 172.21.15.103:0/796747204 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a41ec430 con 0x7fa2a40ca1c0 2024-09-10T08:31:55.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.024+0000 7fa2aaa3c640 1 --2- 172.21.15.103:0/796747204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a40b0bd0 0x7fa2a41ef020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.024+0000 7fa2aaa3c640 1 -- 172.21.15.103:0/796747204 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a41ec7a0 con 0x7fa2a40b0bd0 2024-09-10T08:31:55.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.024+0000 7fa2a3fff640 1 --2- 172.21.15.103:0/796747204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a40b0bd0 0x7fa2a41ef020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.024+0000 7fa2a3fff640 1 -- 172.21.15.103:0/796747204 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2a4156270 con 0x7fa2a40b0bd0 2024-09-10T08:31:55.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.024+0000 7fa2a3fff640 1 --2- 172.21.15.103:0/796747204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a40b0bd0 0x7fa2a41ef020 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa294000f60 tx=0x7fa294001990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:55.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.024+0000 7fa2a0ff9640 1 -- 172.21.15.103:0/796747204 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa29803c6d0 con 0x7fa2a40ca1c0 2024-09-10T08:31:55.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.025+0000 7fa2a0ff9640 1 --2- 172.21.15.103:0/796747204 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa29006be30 0x7fa29006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.025+0000 7fa2a0ff9640 1 -- 172.21.15.103:0/796747204 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294017020 con 0x7fa2a40b0bd0 2024-09-10T08:31:55.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.025+0000 7fa2a8fd9640 1 --2- 172.21.15.103:0/796747204 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa29006be30 0x7fa29006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.025+0000 7fa2a0ff9640 1 -- 172.21.15.103:0/796747204 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fa2980abb20 con 0x7fa2a40ca1c0 2024-09-10T08:31:55.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.025+0000 7fa2a0ff9640 1 -- 172.21.15.103:0/796747204 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa294013600 con 0x7fa2a40b0bd0 2024-09-10T08:31:55.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.025+0000 7fa2a0ff9640 1 -- 172.21.15.103:0/796747204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a40b0bd0 msgr2=0x7fa2a41ef020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.025+0000 7fa2a0ff9640 1 --2- 172.21.15.103:0/796747204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a40b0bd0 0x7fa2a41ef020 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa294000f60 tx=0x7fa294001990 comp rx=0 tx=0).stop 2024-09-10T08:31:55.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.025+0000 7fa2a0ff9640 1 -- 172.21.15.103:0/796747204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a40b0bd0 msgr2=0x7fa2a41ef020 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:31:55.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.025+0000 7fa2a0ff9640 1 --2- 172.21.15.103:0/796747204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a40b0bd0 0x7fa2a41ef020 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.026+0000 7fa2a8fd9640 1 --2- 172.21.15.103:0/796747204 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa29006be30 0x7fa29006e2f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4075250 tx=0x7fa29c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:55.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.032+0000 7fa2aaa3c640 1 --2- 172.21.15.103:0/796747204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a41ef560 0x7fa2a41ef940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.032+0000 7fa2aaa3c640 1 -- 172.21.15.103:0/796747204 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a41eed60 con 0x7fa2a41ef560 2024-09-10T08:31:55.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.032+0000 7fa2a3fff640 1 --2- 172.21.15.103:0/796747204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a41ef560 0x7fa2a41ef940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.032+0000 7fa2a3fff640 1 -- 172.21.15.103:0/796747204 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa2a406c430 con 0x7fa2a41ef560 2024-09-10T08:31:55.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.033+0000 7fa2a3fff640 1 --2- 172.21.15.103:0/796747204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a41ef560 0x7fa2a41ef940 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa294018000 tx=0x7fa294001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:55.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.033+0000 7fa2a0ff9640 1 -- 172.21.15.103:0/796747204 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294017050 con 0x7fa2a41ef560 2024-09-10T08:31:55.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.033+0000 7fa2a0ff9640 1 -- 172.21.15.103:0/796747204 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7fa2940137b0 con 0x7fa2a41ef560 2024-09-10T08:31:55.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.033+0000 7fa2a0ff9640 1 -- 172.21.15.103:0/796747204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a41ef560 msgr2=0x7fa2a41ef940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.033+0000 7fa2a0ff9640 1 --2- 172.21.15.103:0/796747204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a41ef560 0x7fa2a41ef940 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa294018000 tx=0x7fa294001150 comp rx=0 tx=0).stop 2024-09-10T08:31:55.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.033+0000 7fa2a0ff9640 1 -- 172.21.15.103:0/796747204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a41ef560 msgr2=0x7fa2a41ef940 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:31:55.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.033+0000 7fa2a0ff9640 1 --2- 172.21.15.103:0/796747204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a41ef560 0x7fa2a41ef940 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.033 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:31:55.033 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:31:55.034 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:31:55.034 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:31:55.034 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 22, 2024-09-10T08:31:55.034 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 7413, 2024-09-10T08:31:55.034 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:31:55.034 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:31:55.034 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:31:55.034 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:31:55.034 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:55.034 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 1, 2024-09-10T08:31:55.034 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:31:55.034 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:31:55.035 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:31:55.035 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:55.035 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:55.035 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:55.035 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:55.035 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:55.035 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:55.035 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:55.035 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:55.035 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:55.035 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:55.035 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:55.035 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:55.036 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:31:55.036 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:31:55.036 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:55.036 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:55.036 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:55.036 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:55.036 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:55.036 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:55.036 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:55.036 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:55.036 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:55.036 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:55.037 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:55.037 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:55.037 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.037 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:31:55.037 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:31:55.037 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:31:55.037 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:31:55.037 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:31:55.037 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:31:55.037 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:31:55.037 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:31:55.037 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:31:55.037 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:31:55.037 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:31:55.038 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:31:55.038 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:31:55.038 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:31:55.038 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:31:55.038 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:31:55.038 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:31:55.038 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:55.038 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:55.038 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:55.038 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:55.038 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:55.038 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:55.038 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:55.039 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:55.039 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:55.039 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:55.039 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:55.039 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:55.039 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:31:55.039 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.039 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:31:55.039 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.039 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:31:55.039 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:31:55.039 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:55.039 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:55.039 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.040 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:55.040 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:31:55.040 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:55.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.040 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.040 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:55.040 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:31:55.040 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:55.040 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.040 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:55.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.040 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:31:55.040 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:31:55.041 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:55.041 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:55.041 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:55.041 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.041 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.041 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:31:55.041 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:31:55.041 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:55.041 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:55.041 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.041 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:55.041 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:31:55.041 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:55.041 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.042 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.042 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:55.042 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:31:55.042 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:55.042 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.042 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:55.042 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.042 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:31:55.042 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:31:55.042 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:55.042 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:55.042 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:55.042 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.042 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.043 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:31:55.043 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:31:55.043 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:55.043 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:55.043 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.043 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:55.043 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:31:55.043 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:55.043 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.043 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.043 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:55.043 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:31:55.043 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:55.043 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.044 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:55.044 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.044 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:31:55.044 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:31:55.044 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:55.044 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:55.044 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:55.044 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.044 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:55.044 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.044 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:31:55.044 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:31:55.044 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.045 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:55.045 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:55.045 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:31:55.045 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.045 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:55.045 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:31:55.045 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.045 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:55.045 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:55.045 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:31:55.045 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.045 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:55.045 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.046 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:31:55.046 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:31:55.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.033+0000 7fa2aaa3c640 1 -- 172.21.15.103:0/796747204 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa29006be30 msgr2=0x7fa29006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.033+0000 7fa2aaa3c640 1 --2- 172.21.15.103:0/796747204 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa29006be30 0x7fa29006e2f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4075250 tx=0x7fa29c009040 comp rx=0 tx=0).stop 2024-09-10T08:31:55.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.033+0000 7fa2aaa3c640 1 -- 172.21.15.103:0/796747204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a40ca1c0 msgr2=0x7fa2a414f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.033+0000 7fa2aaa3c640 1 --2- 172.21.15.103:0/796747204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a40ca1c0 0x7fa2a414f730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa2980097a0 tx=0x7fa2980046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.033+0000 7fa2a8fd9640 1 -- 172.21.15.103:0/796747204 reap_dead start 2024-09-10T08:31:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.033+0000 7fa2a8fd9640 1 -- 172.21.15.103:0/796747204 reap_dead start 2024-09-10T08:31:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.033+0000 7fa2aaa3c640 1 -- 172.21.15.103:0/796747204 shutdown_connections 2024-09-10T08:31:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.033+0000 7fa2aaa3c640 1 -- 172.21.15.103:0/796747204 >> 172.21.15.103:0/796747204 conn(0x7fa2a4068030 msgr2=0x7fa2a40cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.034+0000 7fa2aaa3c640 1 -- 172.21.15.103:0/796747204 shutdown_connections 2024-09-10T08:31:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.034+0000 7fa2aaa3c640 1 -- 172.21.15.103:0/796747204 wait complete. 2024-09-10T08:31:55.048 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:31:55.048 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:31:55.049 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:31:55.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.161+0000 7fcd6dd11640 1 Processor -- start 2024-09-10T08:31:55.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.161+0000 7fcd6dd11640 1 -- start start 2024-09-10T08:31:55.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.162+0000 7fcd6dd11640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcd68154ac0 0x7fcd680708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.162+0000 7fcd6dd11640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd680703b0 0x7fcd6815e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.162+0000 7fcd6dd11640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd68154ff0 con 0x7fcd68151780 2024-09-10T08:31:55.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.162+0000 7fcd6dd11640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fcd6806f5f0 con 0x7fcd68154ac0 2024-09-10T08:31:55.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.162+0000 7fcd6dd11640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fcd6806f8d0 con 0x7fcd680703b0 2024-09-10T08:31:55.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.162+0000 7fcd66ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcd68154ac0 0x7fcd680708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.162+0000 7fcd677fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fcd68151780 0x7fcd68155560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46786/0 (socket says 172.21.15.103:46786) 2024-09-10T08:31:55.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.162+0000 7fcd677fe640 1 -- 172.21.15.103:0/3459756480 learned_addr learned my addr 172.21.15.103:0/3459756480 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:31:55.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.162+0000 7fcd67fff640 1 --2- 172.21.15.103:0/3459756480 >> v2:172.21.15.154:3300/0 conn(0x7fcd680703b0 0x7fcd6815e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.162+0000 7fcd66ffd640 1 -- 172.21.15.103:0/3459756480 >> v2:172.21.15.154:3300/0 conn(0x7fcd680703b0 msgr2=0x7fcd6815e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:55.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.162+0000 7fcd66ffd640 1 --2- 172.21.15.103:0/3459756480 >> v2:172.21.15.154:3300/0 conn(0x7fcd680703b0 0x7fcd6815e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.162+0000 7fcd66ffd640 1 -- 172.21.15.103:0/3459756480 >> v1:172.21.15.103:6789/0 conn(0x7fcd68151780 legacy=0x7fcd68155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.162+0000 7fcd66ffd640 1 -- 172.21.15.103:0/3459756480 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd6806fbb0 con 0x7fcd68154ac0 2024-09-10T08:31:55.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.162+0000 7fcd667fc640 1 -- 172.21.15.103:0/3459756480 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4278764513 0 0) 0x7fcd68154ff0 con 0x7fcd68151780 2024-09-10T08:31:55.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.163+0000 7fcd66ffd640 1 --2- 172.21.15.103:0/3459756480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd68154ac0 0x7fcd680708a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcd680c6930 tx=0x7fcd5c02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e2b99ec2898248 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:55.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.163+0000 7fcd667fc640 1 -- 172.21.15.103:0/3459756480 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c037070 con 0x7fcd68154ac0 2024-09-10T08:31:55.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.163+0000 7fcd667fc640 1 -- 172.21.15.103:0/3459756480 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd5c02add0 con 0x7fcd68154ac0 2024-09-10T08:31:55.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.163+0000 7fcd667fc640 1 -- 172.21.15.103:0/3459756480 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c032660 con 0x7fcd68154ac0 2024-09-10T08:31:55.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.164+0000 7fcd6dd11640 1 -- 172.21.15.103:0/3459756480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd68154ac0 msgr2=0x7fcd680708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.164+0000 7fcd6dd11640 1 --2- 172.21.15.103:0/3459756480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd68154ac0 0x7fcd680708a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcd680c6930 tx=0x7fcd5c02a080 comp rx=0 tx=0).stop 2024-09-10T08:31:55.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.164+0000 7fcd6dd11640 1 -- 172.21.15.103:0/3459756480 shutdown_connections 2024-09-10T08:31:55.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.164+0000 7fcd6dd11640 1 --2- 172.21.15.103:0/3459756480 >> v2:172.21.15.154:3300/0 conn(0x7fcd680703b0 0x7fcd6815e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.164+0000 7fcd6dd11640 1 --2- 172.21.15.103:0/3459756480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd68154ac0 0x7fcd680708a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.164+0000 7fcd6dd11640 1 -- 172.21.15.103:0/3459756480 >> 172.21.15.103:0/3459756480 conn(0x7fcd680c6980 msgr2=0x7fcd680c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:55.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.164+0000 7fcd6dd11640 1 -- 172.21.15.103:0/3459756480 shutdown_connections 2024-09-10T08:31:55.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.164+0000 7fcd6dd11640 1 -- 172.21.15.103:0/3459756480 wait complete. 2024-09-10T08:31:55.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.165+0000 7fcd6dd11640 1 Processor -- start 2024-09-10T08:31:55.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.165+0000 7fcd6dd11640 1 -- start start 2024-09-10T08:31:55.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.166+0000 7fcd6dd11640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd680703b0 0x7fcd681464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.166+0000 7fcd6dd11640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd68151780 0x7fcd681ed570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.166+0000 7fcd6dd11640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd68154ac0 0x7fcd681e0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.166+0000 7fcd6dd11640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcd68155c70 con 0x7fcd680703b0 2024-09-10T08:31:55.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.166+0000 7fcd6dd11640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd68073f30 con 0x7fcd68154ac0 2024-09-10T08:31:55.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.166+0000 7fcd6dd11640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcd680ae060 con 0x7fcd68151780 2024-09-10T08:31:55.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.166+0000 7fcd677fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd680703b0 0x7fcd681464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.166+0000 7fcd677fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd680703b0 0x7fcd681464a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55760/0 (socket says 172.21.15.103:55760) 2024-09-10T08:31:55.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.166+0000 7fcd677fe640 1 -- 172.21.15.103:0/3644427667 learned_addr learned my addr 172.21.15.103:0/3644427667 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:55.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.166+0000 7fcd677fe640 1 -- 172.21.15.103:0/3644427667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd68151780 msgr2=0x7fcd681ed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.166+0000 7fcd677fe640 1 --2- 172.21.15.103:0/3644427667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd68151780 0x7fcd681ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.166+0000 7fcd677fe640 1 -- 172.21.15.103:0/3644427667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd68154ac0 msgr2=0x7fcd681e0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.166+0000 7fcd677fe640 1 --2- 172.21.15.103:0/3644427667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd68154ac0 0x7fcd681e0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.166+0000 7fcd677fe640 1 -- 172.21.15.103:0/3644427667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd681edab0 con 0x7fcd680703b0 2024-09-10T08:31:55.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.166+0000 7fcd677fe640 1 --2- 172.21.15.103:0/3644427667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd680703b0 0x7fcd681464a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800c4d0 tx=0x7fcd5800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:55.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.167+0000 7fcd4ffff640 1 -- 172.21.15.103:0/3644427667 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd58018070 con 0x7fcd680703b0 2024-09-10T08:31:55.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.167+0000 7fcd4ffff640 1 -- 172.21.15.103:0/3644427667 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd580074e0 con 0x7fcd680703b0 2024-09-10T08:31:55.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.167+0000 7fcd6dd11640 1 -- 172.21.15.103:0/3644427667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd6814c740 con 0x7fcd680703b0 2024-09-10T08:31:55.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.167+0000 7fcd4ffff640 1 -- 172.21.15.103:0/3644427667 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd58004a20 con 0x7fcd680703b0 2024-09-10T08:31:55.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.167+0000 7fcd6dd11640 1 -- 172.21.15.103:0/3644427667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd6814d1e0 con 0x7fcd680703b0 2024-09-10T08:31:55.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.168+0000 7fcd6dd11640 1 --2- 172.21.15.103:0/3644427667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6814c1d0 0x7fcd680ac710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.168+0000 7fcd6dd11640 1 -- 172.21.15.103:0/3644427667 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd68156f70 con 0x7fcd6814c1d0 2024-09-10T08:31:55.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.168+0000 7fcd66ffd640 1 --2- 172.21.15.103:0/3644427667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6814c1d0 0x7fcd680ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.168+0000 7fcd4ffff640 1 -- 172.21.15.103:0/3644427667 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd5801b070 con 0x7fcd680703b0 2024-09-10T08:31:55.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.168+0000 7fcd66ffd640 1 -- 172.21.15.103:0/3644427667 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcd681dddb0 con 0x7fcd6814c1d0 2024-09-10T08:31:55.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.169+0000 7fcd66ffd640 1 --2- 172.21.15.103:0/3644427667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6814c1d0 0x7fcd680ac710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcd680767b0 tx=0x7fcd5c032950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:55.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.169+0000 7fcd4ffff640 1 --2- 172.21.15.103:0/3644427667 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcd5406be30 0x7fcd5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.169+0000 7fcd4ffff640 1 -- 172.21.15.103:0/3644427667 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fcd5808a520 con 0x7fcd680703b0 2024-09-10T08:31:55.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.169+0000 7fcd67fff640 1 --2- 172.21.15.103:0/3644427667 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcd5406be30 0x7fcd5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.169+0000 7fcd4ffff640 1 -- 172.21.15.103:0/3644427667 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c042020 con 0x7fcd6814c1d0 2024-09-10T08:31:55.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.169+0000 7fcd67fff640 1 --2- 172.21.15.103:0/3644427667 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcd5406be30 0x7fcd5406e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcd6000e190 tx=0x7fcd6000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:55.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.169+0000 7fcd4ffff640 1 -- 172.21.15.103:0/3644427667 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fcd5c038040 con 0x7fcd6814c1d0 2024-09-10T08:31:55.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.169+0000 7fcd4ffff640 1 -- 172.21.15.103:0/3644427667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6814c1d0 msgr2=0x7fcd680ac710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.169+0000 7fcd4ffff640 1 --2- 172.21.15.103:0/3644427667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6814c1d0 0x7fcd680ac710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcd680767b0 tx=0x7fcd5c032950 comp rx=0 tx=0).stop 2024-09-10T08:31:55.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.169+0000 7fcd4ffff640 1 -- 172.21.15.103:0/3644427667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6814c1d0 msgr2=0x7fcd680ac710 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:31:55.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.169+0000 7fcd4ffff640 1 --2- 172.21.15.103:0/3644427667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6814c1d0 0x7fcd680ac710 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.176+0000 7fcd6dd11640 1 --2- 172.21.15.103:0/3644427667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd681e0e50 0x7fcd680acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.176+0000 7fcd6dd11640 1 -- 172.21.15.103:0/3644427667 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd680af630 con 0x7fcd681e0e50 2024-09-10T08:31:55.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.176+0000 7fcd66ffd640 1 --2- 172.21.15.103:0/3644427667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd681e0e50 0x7fcd680acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.177+0000 7fcd66ffd640 1 -- 172.21.15.103:0/3644427667 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcd68153560 con 0x7fcd681e0e50 2024-09-10T08:31:55.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.177+0000 7fcd66ffd640 1 --2- 172.21.15.103:0/3644427667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd681e0e50 0x7fcd680acc50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c000c00 tx=0x7fcd5c008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:55.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.177+0000 7fcd4ffff640 1 -- 172.21.15.103:0/3644427667 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c042030 con 0x7fcd681e0e50 2024-09-10T08:31:55.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.177+0000 7fcd4ffff640 1 -- 172.21.15.103:0/3644427667 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4887 (secure 0 0 0) 0x7fcd5c0093c0 con 0x7fcd681e0e50 2024-09-10T08:31:55.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.177+0000 7fcd4ffff640 1 -- 172.21.15.103:0/3644427667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd681e0e50 msgr2=0x7fcd680acc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.177+0000 7fcd4ffff640 1 --2- 172.21.15.103:0/3644427667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd681e0e50 0x7fcd680acc50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c000c00 tx=0x7fcd5c008030 comp rx=0 tx=0).stop 2024-09-10T08:31:55.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.177+0000 7fcd4ffff640 1 -- 172.21.15.103:0/3644427667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd681e0e50 msgr2=0x7fcd680acc50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:31:55.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.177+0000 7fcd4ffff640 1 --2- 172.21.15.103:0/3644427667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd681e0e50 0x7fcd680acc50 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c000c00 tx=0x7fcd5c008030 comp rx=0 tx=0).stop 2024-09-10T08:31:55.177 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:31:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:31:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:31:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:31:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 22, 2024-09-10T08:31:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 121405, 2024-09-10T08:31:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:31:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:31:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:31:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:31:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 1, 2024-09-10T08:31:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:31:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:31:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:31:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:31:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:31:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:31:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:31:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:31:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:31:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:31:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:31:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:31:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:31:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:31:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:31:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:31:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:31:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:31:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:31:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:31:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:31:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:31:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:31:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:31:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:31:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:31:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:31:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:31:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:31:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:31:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:31:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:31:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:31:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:31:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:31:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:31:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:31:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:31:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:31:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:31:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:31:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:31:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:31:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:31:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:31:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:31:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:31:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:31:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:31:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:31:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:31:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:31:55.191 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:31:55.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.178+0000 7fcd6dd11640 1 -- 172.21.15.103:0/3644427667 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcd5406be30 msgr2=0x7fcd5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.178+0000 7fcd6dd11640 1 --2- 172.21.15.103:0/3644427667 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcd5406be30 0x7fcd5406e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcd6000e190 tx=0x7fcd6000b040 comp rx=0 tx=0).stop 2024-09-10T08:31:55.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.178+0000 7fcd6dd11640 1 -- 172.21.15.103:0/3644427667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd680703b0 msgr2=0x7fcd681464a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.178+0000 7fcd6dd11640 1 --2- 172.21.15.103:0/3644427667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd680703b0 0x7fcd681464a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800c4d0 tx=0x7fcd5800c990 comp rx=0 tx=0).stop 2024-09-10T08:31:55.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.178+0000 7fcd67fff640 1 -- 172.21.15.103:0/3644427667 reap_dead start 2024-09-10T08:31:55.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.178+0000 7fcd6dd11640 1 -- 172.21.15.103:0/3644427667 shutdown_connections 2024-09-10T08:31:55.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.178+0000 7fcd6dd11640 1 --2- 172.21.15.103:0/3644427667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd680703b0 0x7fcd681464a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.178+0000 7fcd6dd11640 1 -- 172.21.15.103:0/3644427667 >> 172.21.15.103:0/3644427667 conn(0x7fcd680c6980 msgr2=0x7fcd68152560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:55.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.178+0000 7fcd6dd11640 1 -- 172.21.15.103:0/3644427667 shutdown_connections 2024-09-10T08:31:55.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.178+0000 7fcd6dd11640 1 -- 172.21.15.103:0/3644427667 wait complete. 2024-09-10T08:31:55.193 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:31:55.193 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:31:55.194 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:31:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.315+0000 7f47a4e96640 1 Processor -- start 2024-09-10T08:31:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.315+0000 7f47a4e96640 1 -- start start 2024-09-10T08:31:55.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.316+0000 7f47a4e96640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f47a00ad6a0 0x7f47a0159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.316+0000 7f47a4e96640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47a00c2f60 con 0x7f47a00c5130 2024-09-10T08:31:55.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.316+0000 7f47a4e96640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47a00c3240 con 0x7f47a0153fd0 2024-09-10T08:31:55.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.316+0000 7f47a4e96640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f47a00c1f80 con 0x7f47a00ad6a0 2024-09-10T08:31:55.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.317+0000 7f479e59c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f47a00c5130 0x7f47a01538c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46792/0 (socket says 172.21.15.103:46792) 2024-09-10T08:31:55.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.317+0000 7f479e59c640 1 -- 172.21.15.103:0/1314918811 learned_addr learned my addr 172.21.15.103:0/1314918811 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:31:55.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.317+0000 7f479dd9b640 1 --2- 172.21.15.103:0/1314918811 >> v2:172.21.15.154:3300/0 conn(0x7f47a00ad6a0 0x7f47a0159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.317+0000 7f479d59a640 1 -- 172.21.15.103:0/1314918811 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1386104095 0 0) 0x7f47a00c2f60 con 0x7f47a00c5130 2024-09-10T08:31:55.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.317+0000 7f479d59a640 1 -- 172.21.15.103:0/1314918811 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4788003520 con 0x7f47a00c5130 2024-09-10T08:31:55.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.317+0000 7f479dd9b640 1 -- 172.21.15.103:0/1314918811 >> v1:172.21.15.154:6789/0 conn(0x7f47a0153fd0 legacy=0x7f47a015a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.317+0000 7f479dd9b640 1 -- 172.21.15.103:0/1314918811 >> v1:172.21.15.103:6789/0 conn(0x7f47a00c5130 legacy=0x7f47a01538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.317+0000 7f479dd9b640 1 -- 172.21.15.103:0/1314918811 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a00c1c10 con 0x7f47a00ad6a0 2024-09-10T08:31:55.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.318+0000 7f479dd9b640 1 --2- 172.21.15.103:0/1314918811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47a00ad6a0 0x7f47a0159c60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f47940097a0 tx=0x7f479402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e7a65c03173ae88 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:55.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.318+0000 7f479d59a640 1 -- 172.21.15.103:0/1314918811 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4794037070 con 0x7f47a00ad6a0 2024-09-10T08:31:55.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.318+0000 7f479d59a640 1 -- 172.21.15.103:0/1314918811 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4794032440 con 0x7f47a00ad6a0 2024-09-10T08:31:55.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.318+0000 7f479d59a640 1 -- 172.21.15.103:0/1314918811 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f479402ae60 con 0x7f47a00ad6a0 2024-09-10T08:31:55.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.319+0000 7f47a4e96640 1 -- 172.21.15.103:0/1314918811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47a00ad6a0 msgr2=0x7f47a0159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.319+0000 7f47a4e96640 1 --2- 172.21.15.103:0/1314918811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47a00ad6a0 0x7f47a0159c60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f47940097a0 tx=0x7f479402a110 comp rx=0 tx=0).stop 2024-09-10T08:31:55.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.319+0000 7f47a4e96640 1 -- 172.21.15.103:0/1314918811 shutdown_connections 2024-09-10T08:31:55.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.319+0000 7f47a4e96640 1 --2- 172.21.15.103:0/1314918811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47a00ad6a0 0x7f47a0159c60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.319+0000 7f47a4e96640 1 -- 172.21.15.103:0/1314918811 >> 172.21.15.103:0/1314918811 conn(0x7f47a00c8430 msgr2=0x7f47a00c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:55.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.319+0000 7f47a4e96640 1 -- 172.21.15.103:0/1314918811 shutdown_connections 2024-09-10T08:31:55.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.319+0000 7f47a4e96640 1 -- 172.21.15.103:0/1314918811 wait complete. 2024-09-10T08:31:55.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.320+0000 7f47a4e96640 1 Processor -- start 2024-09-10T08:31:55.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.320+0000 7f47a4e96640 1 -- start start 2024-09-10T08:31:55.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.321+0000 7f47a4e96640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47a00ad6a0 0x7f47a01ef9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.321+0000 7f47a4e96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47a00c5130 0x7f47a01ec460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.321+0000 7f47a4e96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47a0153fd0 0x7f47a00a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.321+0000 7f47a4e96640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f47a00c4250 con 0x7f47a00ad6a0 2024-09-10T08:31:55.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.321+0000 7f47a4e96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f47a00c40d0 con 0x7f47a0153fd0 2024-09-10T08:31:55.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.321+0000 7f47a4e96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f47a00c5510 con 0x7f47a00c5130 2024-09-10T08:31:55.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.321+0000 7f479e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47a00ad6a0 0x7f47a01ef9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.321+0000 7f479e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47a00ad6a0 0x7f47a01ef9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55770/0 (socket says 172.21.15.103:55770) 2024-09-10T08:31:55.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.321+0000 7f479e59c640 1 -- 172.21.15.103:0/49597889 learned_addr learned my addr 172.21.15.103:0/49597889 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:55.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.321+0000 7f479dd9b640 1 --2- 172.21.15.103:0/49597889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47a00c5130 0x7f47a01ec460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.321+0000 7f479ed9d640 1 --2- 172.21.15.103:0/49597889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47a0153fd0 0x7f47a00a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.322+0000 7f479e59c640 1 -- 172.21.15.103:0/49597889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47a00c5130 msgr2=0x7f47a01ec460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.322+0000 7f479e59c640 1 --2- 172.21.15.103:0/49597889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47a00c5130 0x7f47a01ec460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.322+0000 7f479e59c640 1 -- 172.21.15.103:0/49597889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47a0153fd0 msgr2=0x7f47a00a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.322+0000 7f479e59c640 1 --2- 172.21.15.103:0/49597889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47a0153fd0 0x7f47a00a84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.322+0000 7f479e59c640 1 -- 172.21.15.103:0/49597889 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a01ec9a0 con 0x7f47a00ad6a0 2024-09-10T08:31:55.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.322+0000 7f479e59c640 1 --2- 172.21.15.103:0/49597889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47a00ad6a0 0x7f47a01ef9a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f479000c440 tx=0x7f479000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:55.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.322+0000 7f478effd640 1 -- 172.21.15.103:0/49597889 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4790017070 con 0x7f47a00ad6a0 2024-09-10T08:31:55.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.322+0000 7f478effd640 1 -- 172.21.15.103:0/49597889 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4790005ce0 con 0x7f47a00ad6a0 2024-09-10T08:31:55.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.322+0000 7f47a4e96640 1 -- 172.21.15.103:0/49597889 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47a00a8a10 con 0x7f47a00ad6a0 2024-09-10T08:31:55.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.322+0000 7f478effd640 1 -- 172.21.15.103:0/49597889 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47900072b0 con 0x7f47a00ad6a0 2024-09-10T08:31:55.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.322+0000 7f47a4e96640 1 -- 172.21.15.103:0/49597889 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47a0157cc0 con 0x7f47a00ad6a0 2024-09-10T08:31:55.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.323+0000 7f47a4e96640 1 --2- 172.21.15.103:0/49597889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47a01eba50 0x7f47a01ebe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.323+0000 7f47a4e96640 1 -- 172.21.15.103:0/49597889 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f47a01efee0 con 0x7f47a01eba50 2024-09-10T08:31:55.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.323+0000 7f479dd9b640 1 --2- 172.21.15.103:0/49597889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47a01eba50 0x7f47a01ebe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.324+0000 7f479dd9b640 1 -- 172.21.15.103:0/49597889 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f47a0067950 con 0x7f47a01eba50 2024-09-10T08:31:55.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.324+0000 7f478effd640 1 -- 172.21.15.103:0/49597889 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f479001a070 con 0x7f47a00ad6a0 2024-09-10T08:31:55.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.324+0000 7f479dd9b640 1 --2- 172.21.15.103:0/49597889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47a01eba50 0x7f47a01ebe30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f47a0075f00 tx=0x7f47940046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:55.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.324+0000 7f478effd640 1 --2- 172.21.15.103:0/49597889 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f478006be30 0x7f478006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.324+0000 7f478effd640 1 -- 172.21.15.103:0/49597889 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f479008a450 con 0x7f47a00ad6a0 2024-09-10T08:31:55.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.325+0000 7f479ed9d640 1 --2- 172.21.15.103:0/49597889 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f478006be30 0x7f478006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.325+0000 7f478effd640 1 -- 172.21.15.103:0/49597889 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4794043070 con 0x7f47a01eba50 2024-09-10T08:31:55.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.325+0000 7f478effd640 1 -- 172.21.15.103:0/49597889 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4794032e40 con 0x7f47a01eba50 2024-09-10T08:31:55.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.325+0000 7f478effd640 1 -- 172.21.15.103:0/49597889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47a01eba50 msgr2=0x7f47a01ebe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.325+0000 7f478effd640 1 --2- 172.21.15.103:0/49597889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47a01eba50 0x7f47a01ebe30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f47a0075f00 tx=0x7f47940046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.325+0000 7f478effd640 1 -- 172.21.15.103:0/49597889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47a01eba50 msgr2=0x7f47a01ebe30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:31:55.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.325+0000 7f478effd640 1 --2- 172.21.15.103:0/49597889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47a01eba50 0x7f47a01ebe30 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f47a0075f00 tx=0x7f47940046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.325+0000 7f479ed9d640 1 --2- 172.21.15.103:0/49597889 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f478006be30 0x7f478006e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f47980012e0 tx=0x7f4798009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:55.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.333+0000 7f47a4e96640 1 --2- 172.21.15.103:0/49597889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47a0156c50 0x7f47a0157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.334+0000 7f47a4e96640 1 -- 172.21.15.103:0/49597889 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f47a00c2490 con 0x7f47a0156c50 2024-09-10T08:31:55.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.334+0000 7f479dd9b640 1 --2- 172.21.15.103:0/49597889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47a0156c50 0x7f47a0157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.334+0000 7f479dd9b640 1 -- 172.21.15.103:0/49597889 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f47a0076430 con 0x7f47a0156c50 2024-09-10T08:31:55.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.334+0000 7f479dd9b640 1 --2- 172.21.15.103:0/49597889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47a0156c50 0x7f47a0157070 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f47a0158290 tx=0x7f4794009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:55.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.335+0000 7f478effd640 1 -- 172.21.15.103:0/49597889 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4794037040 con 0x7f47a0156c50 2024-09-10T08:31:55.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.335+0000 7f478effd640 1 -- 172.21.15.103:0/49597889 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5053 (secure 0 0 0) 0x7f4794047d90 con 0x7f47a0156c50 2024-09-10T08:31:55.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.335+0000 7f478effd640 1 -- 172.21.15.103:0/49597889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47a0156c50 msgr2=0x7f47a0157070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.335 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:31:55.335 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:31:55.335 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:31:55.335 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:31:55.336 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 22, 2024-09-10T08:31:55.336 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 59494, 2024-09-10T08:31:55.336 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:31:55.336 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:31:55.336 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:31:55.336 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:31:55.336 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:55.336 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 1, 2024-09-10T08:31:55.336 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:31:55.336 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:31:55.336 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:31:55.336 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:55.337 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:55.337 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:55.337 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:55.337 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:55.337 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:55.337 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:55.337 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:55.337 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:55.337 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:55.337 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:55.337 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:55.337 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:31:55.337 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:31:55.337 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:55.338 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:55.338 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:55.338 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:55.338 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:55.338 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:55.338 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:55.338 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:55.338 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:55.338 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:55.338 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:55.338 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:55.338 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.338 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:31:55.339 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:31:55.339 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:31:55.339 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:31:55.339 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:31:55.339 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:31:55.339 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:31:55.339 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:31:55.339 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:31:55.339 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:31:55.339 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:31:55.339 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:31:55.339 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:31:55.339 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:31:55.339 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:31:55.340 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:31:55.340 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:31:55.340 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:31:55.340 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:31:55.340 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:31:55.340 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:31:55.340 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:31:55.340 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:31:55.340 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:31:55.340 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:31:55.340 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:31:55.340 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:31:55.340 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:31:55.341 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:55.341 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:31:55.341 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.341 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:31:55.341 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.341 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:31:55.341 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:31:55.341 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:55.341 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:55.341 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.341 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:55.341 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:31:55.341 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:55.342 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.342 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.342 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:55.342 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:31:55.342 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:55.342 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.342 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:55.342 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.342 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:31:55.342 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:31:55.342 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:55.342 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:55.342 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:55.342 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.343 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.343 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:31:55.343 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:31:55.343 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:55.343 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:55.343 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.343 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:55.343 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:31:55.343 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:55.343 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.343 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.343 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:55.343 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:31:55.344 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:55.344 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.344 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:55.344 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.344 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:31:55.344 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:31:55.344 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:55.344 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:55.344 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:55.344 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.344 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.344 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:31:55.344 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:31:55.345 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:31:55.345 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:31:55.345 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.345 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:31:55.345 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:31:55.345 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:55.345 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.345 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.345 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:31:55.345 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:31:55.345 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:31:55.345 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.346 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:55.346 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.346 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:31:55.346 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:31:55.346 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:31:55.346 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:31:55.346 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:31:55.346 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.346 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:55.346 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.346 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:31:55.347 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:31:55.347 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.347 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:55.347 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:55.347 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:31:55.347 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.347 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:55.347 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:31:55.347 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.347 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:55.347 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:55.347 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:31:55.347 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.348 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:55.348 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:31:55.348 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.348 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:55.348 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:55.348 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:31:55.348 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.348 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:55.348 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:31:55.348 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.348 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:55.348 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:55.348 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:31:55.349 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.349 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:31:55.349 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:31:55.349 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:31:55.349 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:31:55.349 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:31:55.349 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:31:55.349 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:31:55.349 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:31:55.349 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:31:55.349 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:31:55.349 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:31:55.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.335+0000 7f478effd640 1 --2- 172.21.15.103:0/49597889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47a0156c50 0x7f47a0157070 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f47a0158290 tx=0x7f4794009190 comp rx=0 tx=0).stop 2024-09-10T08:31:55.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.335+0000 7f478effd640 1 -- 172.21.15.103:0/49597889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47a0156c50 msgr2=0x7f47a0157070 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:31:55.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.335+0000 7f478effd640 1 --2- 172.21.15.103:0/49597889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47a0156c50 0x7f47a0157070 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f47a0158290 tx=0x7f4794009190 comp rx=0 tx=0).stop 2024-09-10T08:31:55.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.336+0000 7f47a4e96640 1 -- 172.21.15.103:0/49597889 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f478006be30 msgr2=0x7f478006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.336+0000 7f47a4e96640 1 --2- 172.21.15.103:0/49597889 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f478006be30 0x7f478006e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f47980012e0 tx=0x7f4798009040 comp rx=0 tx=0).stop 2024-09-10T08:31:55.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.336+0000 7f47a4e96640 1 -- 172.21.15.103:0/49597889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47a00ad6a0 msgr2=0x7f47a01ef9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.336+0000 7f47a4e96640 1 --2- 172.21.15.103:0/49597889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47a00ad6a0 0x7f47a01ef9a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f479000c440 tx=0x7f479000c900 comp rx=0 tx=0).stop 2024-09-10T08:31:55.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.336+0000 7f479ed9d640 1 -- 172.21.15.103:0/49597889 reap_dead start 2024-09-10T08:31:55.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.336+0000 7f479ed9d640 1 -- 172.21.15.103:0/49597889 reap_dead start 2024-09-10T08:31:55.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.336+0000 7f47a4e96640 1 -- 172.21.15.103:0/49597889 shutdown_connections 2024-09-10T08:31:55.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.336+0000 7f47a4e96640 1 -- 172.21.15.103:0/49597889 >> 172.21.15.103:0/49597889 conn(0x7f47a00c8430 msgr2=0x7f47a00c7780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:55.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.336+0000 7f47a4e96640 1 -- 172.21.15.103:0/49597889 shutdown_connections 2024-09-10T08:31:55.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.336+0000 7f47a4e96640 1 -- 172.21.15.103:0/49597889 wait complete. 2024-09-10T08:31:55.352 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:31:55.352 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-10T08:31:55.352 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-10T08:31:55.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.468+0000 7ff2e9359640 1 Processor -- start 2024-09-10T08:31:55.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.468+0000 7ff2e9359640 1 -- start start 2024-09-10T08:31:55.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.469+0000 7ff2e9359640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff2e40c4ac0 0x7ff2e4153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.469+0000 7ff2e9359640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2e406efa0 con 0x7ff2e40afc60 2024-09-10T08:31:55.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.469+0000 7ff2e9359640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2e406f280 con 0x7ff2e4072ec0 2024-09-10T08:31:55.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.469+0000 7ff2e9359640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff2e406f560 con 0x7ff2e40c4ac0 2024-09-10T08:31:55.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.469+0000 7ff2e37fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff2e40afc60 0x7ff2e4151380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46802/0 (socket says 172.21.15.103:46802) 2024-09-10T08:31:55.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.469+0000 7ff2e37fe640 1 -- 172.21.15.103:0/1293415203 learned_addr learned my addr 172.21.15.103:0/1293415203 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:31:55.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.469+0000 7ff2e27fc640 1 --2- 172.21.15.103:0/1293415203 >> v2:172.21.15.154:3300/0 conn(0x7ff2e40c4ac0 0x7ff2e4153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.469+0000 7ff2e1ffb640 1 -- 172.21.15.103:0/1293415203 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3323681234 0 0) 0x7ff2e406efa0 con 0x7ff2e40afc60 2024-09-10T08:31:55.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.469+0000 7ff2e1ffb640 1 -- 172.21.15.103:0/1293415203 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2cc003520 con 0x7ff2e40afc60 2024-09-10T08:31:55.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.469+0000 7ff2e27fc640 1 -- 172.21.15.103:0/1293415203 >> v1:172.21.15.154:6789/0 conn(0x7ff2e4072ec0 legacy=0x7ff2e4070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.469+0000 7ff2e27fc640 1 -- 172.21.15.103:0/1293415203 >> v1:172.21.15.103:6789/0 conn(0x7ff2e40afc60 legacy=0x7ff2e4151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.469+0000 7ff2e27fc640 1 -- 172.21.15.103:0/1293415203 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e406f840 con 0x7ff2e40c4ac0 2024-09-10T08:31:55.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.470+0000 7ff2e27fc640 1 --2- 172.21.15.103:0/1293415203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2e40c4ac0 0x7ff2e4153ff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80097a0 tx=0x7ff2d802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a16a84e82ae24c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:55.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.470+0000 7ff2e1ffb640 1 -- 172.21.15.103:0/1293415203 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8037070 con 0x7ff2e40c4ac0 2024-09-10T08:31:55.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.470+0000 7ff2e1ffb640 1 -- 172.21.15.103:0/1293415203 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d8032440 con 0x7ff2e40c4ac0 2024-09-10T08:31:55.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.470+0000 7ff2e1ffb640 1 -- 172.21.15.103:0/1293415203 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d802ae60 con 0x7ff2e40c4ac0 2024-09-10T08:31:55.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.471+0000 7ff2e9359640 1 -- 172.21.15.103:0/1293415203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2e40c4ac0 msgr2=0x7ff2e4153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.471+0000 7ff2e9359640 1 --2- 172.21.15.103:0/1293415203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2e40c4ac0 0x7ff2e4153ff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80097a0 tx=0x7ff2d802a110 comp rx=0 tx=0).stop 2024-09-10T08:31:55.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.471+0000 7ff2e9359640 1 -- 172.21.15.103:0/1293415203 shutdown_connections 2024-09-10T08:31:55.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.471+0000 7ff2e9359640 1 --2- 172.21.15.103:0/1293415203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2e40c4ac0 0x7ff2e4153ff0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.471+0000 7ff2e9359640 1 -- 172.21.15.103:0/1293415203 >> 172.21.15.103:0/1293415203 conn(0x7ff2e40c9d80 msgr2=0x7ff2e40ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:55.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.471+0000 7ff2e9359640 1 -- 172.21.15.103:0/1293415203 shutdown_connections 2024-09-10T08:31:55.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.471+0000 7ff2e9359640 1 -- 172.21.15.103:0/1293415203 wait complete. 2024-09-10T08:31:55.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.472+0000 7ff2e9359640 1 Processor -- start 2024-09-10T08:31:55.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.472+0000 7ff2e9359640 1 -- start start 2024-09-10T08:31:55.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.473+0000 7ff2e9359640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2e4072ec0 0x7ff2e406e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.473+0000 7ff2e9359640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2e40afc60 0x7ff2e4153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.473+0000 7ff2e9359640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2e40c4ac0 0x7ff2e41eb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.473+0000 7ff2e9359640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e4070750 con 0x7ff2e40c4ac0 2024-09-10T08:31:55.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.473+0000 7ff2e9359640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e40c47f0 con 0x7ff2e4072ec0 2024-09-10T08:31:55.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.473+0000 7ff2e9359640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff2e40708d0 con 0x7ff2e40afc60 2024-09-10T08:31:55.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.473+0000 7ff2e37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2e40c4ac0 0x7ff2e41eb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.473+0000 7ff2e37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2e40c4ac0 0x7ff2e41eb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55786/0 (socket says 172.21.15.103:55786) 2024-09-10T08:31:55.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.473+0000 7ff2e37fe640 1 -- 172.21.15.103:0/3302188802 learned_addr learned my addr 172.21.15.103:0/3302188802 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:31:55.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.473+0000 7ff2e2ffd640 1 --2- 172.21.15.103:0/3302188802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2e4072ec0 0x7ff2e406e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.473+0000 7ff2e27fc640 1 --2- 172.21.15.103:0/3302188802 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2e40afc60 0x7ff2e4153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.474+0000 7ff2e37fe640 1 -- 172.21.15.103:0/3302188802 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2e40afc60 msgr2=0x7ff2e4153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.474+0000 7ff2e37fe640 1 --2- 172.21.15.103:0/3302188802 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2e40afc60 0x7ff2e4153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.474+0000 7ff2e37fe640 1 -- 172.21.15.103:0/3302188802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2e4072ec0 msgr2=0x7ff2e406e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.474+0000 7ff2e37fe640 1 --2- 172.21.15.103:0/3302188802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2e4072ec0 0x7ff2e406e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.474+0000 7ff2e37fe640 1 -- 172.21.15.103:0/3302188802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e406d7a0 con 0x7ff2e40c4ac0 2024-09-10T08:31:55.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.474+0000 7ff2e37fe640 1 --2- 172.21.15.103:0/3302188802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2e40c4ac0 0x7ff2e41eb650 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00cb70 tx=0x7ff2dc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:55.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.474+0000 7ff2cb7fe640 1 -- 172.21.15.103:0/3302188802 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc017070 con 0x7ff2e40c4ac0 2024-09-10T08:31:55.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.474+0000 7ff2cb7fe640 1 -- 172.21.15.103:0/3302188802 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2dc00ace0 con 0x7ff2e40c4ac0 2024-09-10T08:31:55.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.474+0000 7ff2e9359640 1 -- 172.21.15.103:0/3302188802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2e414e400 con 0x7ff2e40c4ac0 2024-09-10T08:31:55.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.474+0000 7ff2cb7fe640 1 -- 172.21.15.103:0/3302188802 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc012620 con 0x7ff2e40c4ac0 2024-09-10T08:31:55.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.474+0000 7ff2e9359640 1 -- 172.21.15.103:0/3302188802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2e406e920 con 0x7ff2e40c4ac0 2024-09-10T08:31:55.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.475+0000 7ff2e9359640 1 -- 172.21.15.103:0/3302188802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2e40732a0 con 0x7ff2e40c4ac0 2024-09-10T08:31:55.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.475+0000 7ff2cb7fe640 1 -- 172.21.15.103:0/3302188802 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff2dc01a070 con 0x7ff2e40c4ac0 2024-09-10T08:31:55.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.476+0000 7ff2cb7fe640 1 --2- 172.21.15.103:0/3302188802 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff2d006be30 0x7ff2d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:55.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.476+0000 7ff2cb7fe640 1 -- 172.21.15.103:0/3302188802 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7ff2dc08aef0 con 0x7ff2e40c4ac0 2024-09-10T08:31:55.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.476+0000 7ff2e2ffd640 1 --2- 172.21.15.103:0/3302188802 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff2d006be30 0x7ff2d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:55.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.476+0000 7ff2e2ffd640 1 --2- 172.21.15.103:0/3302188802 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff2d006be30 0x7ff2d006e2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4001780 tx=0x7ff2d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:55.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.481+0000 7ff2cb7fe640 1 -- 172.21.15.103:0/3302188802 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff2dc058f40 con 0x7ff2e40c4ac0 2024-09-10T08:31:55.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.775+0000 7ff2e9359640 1 -- 172.21.15.103:0/3302188802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7ff2e4150230 con 0x7ff2e40c4ac0 2024-09-10T08:31:55.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.776+0000 7ff2cb7fe640 1 -- 172.21.15.103:0/3302188802 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7ff2dc05d240 con 0x7ff2e40c4ac0 2024-09-10T08:31:55.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.779+0000 7ff2e9359640 1 -- 172.21.15.103:0/3302188802 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff2d006be30 msgr2=0x7ff2d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.779+0000 7ff2e9359640 1 --2- 172.21.15.103:0/3302188802 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff2d006be30 0x7ff2d006e2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4001780 tx=0x7ff2d4009040 comp rx=0 tx=0).stop 2024-09-10T08:31:55.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.779+0000 7ff2e9359640 1 -- 172.21.15.103:0/3302188802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2e40c4ac0 msgr2=0x7ff2e41eb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:55.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.779+0000 7ff2e9359640 1 --2- 172.21.15.103:0/3302188802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2e40c4ac0 0x7ff2e41eb650 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00cb70 tx=0x7ff2dc00a430 comp rx=0 tx=0).stop 2024-09-10T08:31:55.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.779+0000 7ff2e9359640 1 -- 172.21.15.103:0/3302188802 shutdown_connections 2024-09-10T08:31:55.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.779+0000 7ff2e9359640 1 --2- 172.21.15.103:0/3302188802 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff2d006be30 0x7ff2d006e2f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.779+0000 7ff2e9359640 1 --2- 172.21.15.103:0/3302188802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2e40c4ac0 0x7ff2e41eb650 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.779+0000 7ff2e9359640 1 --2- 172.21.15.103:0/3302188802 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2e40afc60 0x7ff2e4153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.779+0000 7ff2e9359640 1 --2- 172.21.15.103:0/3302188802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2e4072ec0 0x7ff2e406e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:55.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.779+0000 7ff2e9359640 1 -- 172.21.15.103:0/3302188802 >> 172.21.15.103:0/3302188802 conn(0x7ff2e40c9d80 msgr2=0x7ff2e40c4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:55.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.779+0000 7ff2e9359640 1 -- 172.21.15.103:0/3302188802 shutdown_connections 2024-09-10T08:31:55.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:31:55.779+0000 7ff2e9359640 1 -- 172.21.15.103:0/3302188802 wait complete. 2024-09-10T08:31:55.790 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-10T08:31:59.616 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:31:59.618 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:32:05.790 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:32:05.791 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:32:05.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.901+0000 7fad119a6640 1 Processor -- start 2024-09-10T08:32:05.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.901+0000 7fad119a6640 1 -- start start 2024-09-10T08:32:05.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.902+0000 7fad119a6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fad0c06cd80 0x7fad0c153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:05.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.902+0000 7fad119a6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad0c15a4a0 0x7fad0c156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:05.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.902+0000 7fad119a6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad0c0c7070 con 0x7fad0c0c8b10 2024-09-10T08:32:05.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.902+0000 7fad119a6640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fad0c06d210 con 0x7fad0c06cd80 2024-09-10T08:32:05.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.902+0000 7fad119a6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fad0c0c69b0 con 0x7fad0c15a4a0 2024-09-10T08:32:05.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.902+0000 7fad0a7fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fad0c06cd80 0x7fad0c153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:05.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.902+0000 7fad0a7fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fad0c06cd80 0x7fad0c153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40766/0 (socket says 172.21.15.103:40766) 2024-09-10T08:32:05.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.902+0000 7fad0a7fc640 1 -- 172.21.15.103:0/3579199086 learned_addr learned my addr 172.21.15.103:0/3579199086 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:32:05.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.902+0000 7fad0b7fe640 1 --2- 172.21.15.103:0/3579199086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad0c15a4a0 0x7fad0c156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:05.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.903+0000 7fad0a7fc640 1 -- 172.21.15.103:0/3579199086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad0c15a4a0 msgr2=0x7fad0c156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:05.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.903+0000 7fad0a7fc640 1 --2- 172.21.15.103:0/3579199086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad0c15a4a0 0x7fad0c156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:05.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.903+0000 7fad0a7fc640 1 -- 172.21.15.103:0/3579199086 >> v1:172.21.15.154:6789/0 conn(0x7fad0c0c8b10 legacy=0x7fad0c1534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:05.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.903+0000 7fad0a7fc640 1 -- 172.21.15.103:0/3579199086 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0c0c6c90 con 0x7fad0c06cd80 2024-09-10T08:32:05.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.903+0000 7fad09ffb640 1 -- 172.21.15.103:0/3579199086 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2781315930 0 0) 0x7fad0c0c7070 con 0x7fad0c0c8b10 2024-09-10T08:32:05.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.903+0000 7fad0a7fc640 1 --2- 172.21.15.103:0/3579199086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad0c06cd80 0x7fad0c153be0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fad00009870 tx=0x7fad0002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913cf4ca2ce480e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:05.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.904+0000 7fad09ffb640 1 -- 172.21.15.103:0/3579199086 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad00037070 con 0x7fad0c06cd80 2024-09-10T08:32:05.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.904+0000 7fad09ffb640 1 -- 172.21.15.103:0/3579199086 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad00032440 con 0x7fad0c06cd80 2024-09-10T08:32:05.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.904+0000 7fad09ffb640 1 -- 172.21.15.103:0/3579199086 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad00032810 con 0x7fad0c06cd80 2024-09-10T08:32:05.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.904+0000 7fad119a6640 1 -- 172.21.15.103:0/3579199086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad0c06cd80 msgr2=0x7fad0c153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:05.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.904+0000 7fad119a6640 1 --2- 172.21.15.103:0/3579199086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad0c06cd80 0x7fad0c153be0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fad00009870 tx=0x7fad0002a1c0 comp rx=0 tx=0).stop 2024-09-10T08:32:05.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.904+0000 7fad119a6640 1 -- 172.21.15.103:0/3579199086 shutdown_connections 2024-09-10T08:32:05.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.904+0000 7fad119a6640 1 --2- 172.21.15.103:0/3579199086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad0c15a4a0 0x7fad0c156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:05.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.904+0000 7fad119a6640 1 --2- 172.21.15.103:0/3579199086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad0c06cd80 0x7fad0c153be0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:05.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.904+0000 7fad119a6640 1 -- 172.21.15.103:0/3579199086 >> 172.21.15.103:0/3579199086 conn(0x7fad0c0adb80 msgr2=0x7fad0c0adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:05.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.904+0000 7fad119a6640 1 -- 172.21.15.103:0/3579199086 shutdown_connections 2024-09-10T08:32:05.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.904+0000 7fad119a6640 1 -- 172.21.15.103:0/3579199086 wait complete. 2024-09-10T08:32:05.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.906+0000 7fad119a6640 1 Processor -- start 2024-09-10T08:32:05.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.906+0000 7fad119a6640 1 -- start start 2024-09-10T08:32:05.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.907+0000 7fad119a6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0c0c8b10 0x7fad0c1ebff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:05.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.907+0000 7fad119a6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad0c15a4a0 0x7fad0c158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:05.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.907+0000 7fad119a6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad0c14e420 0x7fad0c14e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:05.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.907+0000 7fad119a6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c0c9070 con 0x7fad0c14e420 2024-09-10T08:32:05.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.907+0000 7fad119a6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c0c8ef0 con 0x7fad0c0c8b10 2024-09-10T08:32:05.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.907+0000 7fad119a6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fad0c156ba0 con 0x7fad0c15a4a0 2024-09-10T08:32:05.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.907+0000 7fad0b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad0c14e420 0x7fad0c14e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:05.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.907+0000 7fad0affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0c0c8b10 0x7fad0c1ebff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:05.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.907+0000 7fad0a7fc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad0c15a4a0 0x7fad0c158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:05.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.907+0000 7fad0b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad0c14e420 0x7fad0c14e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40770/0 (socket says 172.21.15.103:40770) 2024-09-10T08:32:05.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.907+0000 7fad0b7fe640 1 -- 172.21.15.103:0/570242587 learned_addr learned my addr 172.21.15.103:0/570242587 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:32:05.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.907+0000 7fad0b7fe640 1 -- 172.21.15.103:0/570242587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad0c15a4a0 msgr2=0x7fad0c158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:05.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.907+0000 7fad0b7fe640 1 --2- 172.21.15.103:0/570242587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad0c15a4a0 0x7fad0c158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:05.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.907+0000 7fad0b7fe640 1 -- 172.21.15.103:0/570242587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0c0c8b10 msgr2=0x7fad0c1ebff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:05.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.907+0000 7fad0b7fe640 1 --2- 172.21.15.103:0/570242587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0c0c8b10 0x7fad0c1ebff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:05.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.907+0000 7fad0b7fe640 1 -- 172.21.15.103:0/570242587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0c1ec530 con 0x7fad0c14e420 2024-09-10T08:32:05.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.908+0000 7fad0b7fe640 1 --2- 172.21.15.103:0/570242587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad0c14e420 0x7fad0c14e8b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fad04009d30 tx=0x7fad0400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:05.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.908+0000 7facf3fff640 1 -- 172.21.15.103:0/570242587 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad04018020 con 0x7fad0c14e420 2024-09-10T08:32:05.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.908+0000 7facf3fff640 1 -- 172.21.15.103:0/570242587 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad04014480 con 0x7fad0c14e420 2024-09-10T08:32:05.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.908+0000 7fad119a6640 1 -- 172.21.15.103:0/570242587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad0c14f2a0 con 0x7fad0c14e420 2024-09-10T08:32:05.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.908+0000 7facf3fff640 1 -- 172.21.15.103:0/570242587 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad04014870 con 0x7fad0c14e420 2024-09-10T08:32:05.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.908+0000 7fad119a6640 1 -- 172.21.15.103:0/570242587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad0c14f860 con 0x7fad0c14e420 2024-09-10T08:32:05.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.909+0000 7fad119a6640 1 -- 172.21.15.103:0/570242587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad0c156fe0 con 0x7fad0c14e420 2024-09-10T08:32:05.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.910+0000 7facf3fff640 1 -- 172.21.15.103:0/570242587 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad04005d10 con 0x7fad0c14e420 2024-09-10T08:32:05.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.910+0000 7facf3fff640 1 --2- 172.21.15.103:0/570242587 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7facf806be60 0x7facf806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:05.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.910+0000 7facf3fff640 1 -- 172.21.15.103:0/570242587 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fad0408b9f0 con 0x7fad0c14e420 2024-09-10T08:32:05.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.910+0000 7fad0affd640 1 --2- 172.21.15.103:0/570242587 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7facf806be60 0x7facf806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:05.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.911+0000 7fad0affd640 1 --2- 172.21.15.103:0/570242587 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7facf806be60 0x7facf806e320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7facfc000f60 tx=0x7facfc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:05.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:05.915+0000 7facf3fff640 1 -- 172.21.15.103:0/570242587 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fad04022070 con 0x7fad0c14e420 2024-09-10T08:32:06.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.183+0000 7fad119a6640 1 -- 172.21.15.103:0/570242587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fad0c0c9d90 con 0x7fad0c14e420 2024-09-10T08:32:06.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.184+0000 7facf3fff640 1 -- 172.21.15.103:0/570242587 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fad0c1ec530 con 0x7fad0c14e420 2024-09-10T08:32:06.185 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:32:06.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.186+0000 7fad119a6640 1 -- 172.21.15.103:0/570242587 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7facf806be60 msgr2=0x7facf806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.186+0000 7fad119a6640 1 --2- 172.21.15.103:0/570242587 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7facf806be60 0x7facf806e320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7facfc000f60 tx=0x7facfc009040 comp rx=0 tx=0).stop 2024-09-10T08:32:06.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.186+0000 7fad119a6640 1 -- 172.21.15.103:0/570242587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad0c14e420 msgr2=0x7fad0c14e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.186+0000 7fad119a6640 1 --2- 172.21.15.103:0/570242587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad0c14e420 0x7fad0c14e8b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fad04009d30 tx=0x7fad0400c490 comp rx=0 tx=0).stop 2024-09-10T08:32:06.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.186+0000 7fad119a6640 1 -- 172.21.15.103:0/570242587 shutdown_connections 2024-09-10T08:32:06.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.186+0000 7fad119a6640 1 --2- 172.21.15.103:0/570242587 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7facf806be60 0x7facf806e320 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.186+0000 7fad119a6640 1 --2- 172.21.15.103:0/570242587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad0c14e420 0x7fad0c14e8b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.186+0000 7fad119a6640 1 --2- 172.21.15.103:0/570242587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad0c15a4a0 0x7fad0c158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.186+0000 7fad119a6640 1 --2- 172.21.15.103:0/570242587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0c0c8b10 0x7fad0c1ebff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.186+0000 7fad119a6640 1 -- 172.21.15.103:0/570242587 >> 172.21.15.103:0/570242587 conn(0x7fad0c0adb80 msgr2=0x7fad0c155010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:06.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.186+0000 7fad119a6640 1 -- 172.21.15.103:0/570242587 shutdown_connections 2024-09-10T08:32:06.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.186+0000 7fad119a6640 1 -- 172.21.15.103:0/570242587 wait complete. 2024-09-10T08:32:06.197 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:32:06.197 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-10T08:32:06.197 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:32:06.198 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:32:06.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.307+0000 7f632c96d640 1 Processor -- start 2024-09-10T08:32:06.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.307+0000 7f632c96d640 1 -- start start 2024-09-10T08:32:06.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.308+0000 7f632c96d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f63280a6c10 0x7f63280c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.308+0000 7f632c96d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f63280c5940 0x7f632806e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.308+0000 7f632c96d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f632815a970 con 0x7f63280c6010 2024-09-10T08:32:06.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.308+0000 7f632c96d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f632815ac50 con 0x7f63280c5940 2024-09-10T08:32:06.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.308+0000 7f632c96d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f632815af30 con 0x7f63280a6c10 2024-09-10T08:32:06.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.308+0000 7f6326d9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f63280c5940 0x7f632806e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.308+0000 7f6326d9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f63280c5940 0x7f632806e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40784/0 (socket says 172.21.15.103:40784) 2024-09-10T08:32:06.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.308+0000 7f6326d9d640 1 -- 172.21.15.103:0/931622209 learned_addr learned my addr 172.21.15.103:0/931622209 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:32:06.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.308+0000 7f632659c640 1 --2- 172.21.15.103:0/931622209 >> v2:172.21.15.154:3300/0 conn(0x7f63280a6c10 0x7f63280c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.308+0000 7f6326d9d640 1 -- 172.21.15.103:0/931622209 >> v2:172.21.15.154:3300/0 conn(0x7f63280a6c10 msgr2=0x7f63280c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.308+0000 7f6326d9d640 1 --2- 172.21.15.103:0/931622209 >> v2:172.21.15.154:3300/0 conn(0x7f63280a6c10 0x7f63280c2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.308+0000 7f6326d9d640 1 -- 172.21.15.103:0/931622209 >> v1:172.21.15.103:6789/0 conn(0x7f63280c6010 legacy=0x7f632806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.308+0000 7f6326d9d640 1 -- 172.21.15.103:0/931622209 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632815b210 con 0x7f63280c5940 2024-09-10T08:32:06.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.309+0000 7f6326d9d640 1 --2- 172.21.15.103:0/931622209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63280c5940 0x7f632806e1c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f63280c5510 tx=0x7f632002a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f999d805e00fcc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.309+0000 7f632559a640 1 -- 172.21.15.103:0/931622209 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6320036070 con 0x7f63280c5940 2024-09-10T08:32:06.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.309+0000 7f632559a640 1 -- 172.21.15.103:0/931622209 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6320031600 con 0x7f63280c5940 2024-09-10T08:32:06.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.309+0000 7f632559a640 1 -- 172.21.15.103:0/931622209 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63200319d0 con 0x7f63280c5940 2024-09-10T08:32:06.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.310+0000 7f632c96d640 1 -- 172.21.15.103:0/931622209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63280c5940 msgr2=0x7f632806e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.310+0000 7f632c96d640 1 --2- 172.21.15.103:0/931622209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63280c5940 0x7f632806e1c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f63280c5510 tx=0x7f632002a5b0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.310+0000 7f632c96d640 1 -- 172.21.15.103:0/931622209 shutdown_connections 2024-09-10T08:32:06.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.310+0000 7f632c96d640 1 --2- 172.21.15.103:0/931622209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63280c5940 0x7f632806e1c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.310+0000 7f632c96d640 1 --2- 172.21.15.103:0/931622209 >> v2:172.21.15.154:3300/0 conn(0x7f63280a6c10 0x7f63280c2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.310+0000 7f632c96d640 1 -- 172.21.15.103:0/931622209 >> 172.21.15.103:0/931622209 conn(0x7f63280c7a40 msgr2=0x7f63280c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:06.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.310+0000 7f632c96d640 1 -- 172.21.15.103:0/931622209 shutdown_connections 2024-09-10T08:32:06.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.310+0000 7f632c96d640 1 -- 172.21.15.103:0/931622209 wait complete. 2024-09-10T08:32:06.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.312+0000 7f632c96d640 1 Processor -- start 2024-09-10T08:32:06.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.312+0000 7f632c96d640 1 -- start start 2024-09-10T08:32:06.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.313+0000 7f632c96d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63280a6c10 0x7f63281e6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.313+0000 7f632c96d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63280c5940 0x7f6328159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.313+0000 7f632c96d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63280c6010 0x7f63281e4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.313+0000 7f632c96d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f63280a73a0 con 0x7f63280c5940 2024-09-10T08:32:06.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.313+0000 7f632c96d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f632815a620 con 0x7f63280c6010 2024-09-10T08:32:06.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.313+0000 7f6325d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63280c5940 0x7f6328159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.313+0000 7f632c96d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f63280a7520 con 0x7f63280a6c10 2024-09-10T08:32:06.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.313+0000 7f6325d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63280c5940 0x7f6328159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40796/0 (socket says 172.21.15.103:40796) 2024-09-10T08:32:06.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.313+0000 7f6325d9b640 1 -- 172.21.15.103:0/145997312 learned_addr learned my addr 172.21.15.103:0/145997312 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:32:06.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.313+0000 7f632659c640 1 --2- 172.21.15.103:0/145997312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63280a6c10 0x7f63281e6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.313+0000 7f6326d9d640 1 --2- 172.21.15.103:0/145997312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63280c6010 0x7f63281e4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.313+0000 7f6325d9b640 1 -- 172.21.15.103:0/145997312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63280a6c10 msgr2=0x7f63281e6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.313+0000 7f6325d9b640 1 --2- 172.21.15.103:0/145997312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63280a6c10 0x7f63281e6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.313+0000 7f6325d9b640 1 -- 172.21.15.103:0/145997312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63280c6010 msgr2=0x7f63281e4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.313+0000 7f6325d9b640 1 --2- 172.21.15.103:0/145997312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63280c6010 0x7f63281e4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.313+0000 7f6325d9b640 1 -- 172.21.15.103:0/145997312 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63281e6bb0 con 0x7f63280c5940 2024-09-10T08:32:06.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.313+0000 7f6326d9d640 1 --2- 172.21.15.103:0/145997312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63280c6010 0x7f63281e4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:06.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.313+0000 7f6325d9b640 1 --2- 172.21.15.103:0/145997312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63280c5940 0x7f6328159610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f631c00c780 tx=0x7f631c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.313+0000 7f6316ffd640 1 -- 172.21.15.103:0/145997312 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c017070 con 0x7f63280c5940 2024-09-10T08:32:06.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.313+0000 7f6316ffd640 1 -- 172.21.15.103:0/145997312 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f631c005290 con 0x7f63280c5940 2024-09-10T08:32:06.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.313+0000 7f632c96d640 1 -- 172.21.15.103:0/145997312 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6328150ec0 con 0x7f63280c5940 2024-09-10T08:32:06.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.313+0000 7f6316ffd640 1 -- 172.21.15.103:0/145997312 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c003830 con 0x7f63280c5940 2024-09-10T08:32:06.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.314+0000 7f632c96d640 1 -- 172.21.15.103:0/145997312 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63281e45c0 con 0x7f63280c5940 2024-09-10T08:32:06.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.314+0000 7f632c96d640 1 --2- 172.21.15.103:0/145997312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63281e6570 0x7f63281e5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.314+0000 7f632c96d640 1 -- 172.21.15.103:0/145997312 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f63281e4ae0 con 0x7f63281e6570 2024-09-10T08:32:06.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.314+0000 7f632659c640 1 --2- 172.21.15.103:0/145997312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63281e6570 0x7f63281e5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.315+0000 7f632659c640 1 -- 172.21.15.103:0/145997312 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6328150c70 con 0x7f63281e6570 2024-09-10T08:32:06.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.315+0000 7f632659c640 1 --2- 172.21.15.103:0/145997312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63281e6570 0x7f63281e5300 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f63180118b0 tx=0x7f6318011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.315+0000 7f6316ffd640 1 -- 172.21.15.103:0/145997312 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6318019070 con 0x7f63281e6570 2024-09-10T08:32:06.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.315+0000 7f6316ffd640 1 -- 172.21.15.103:0/145997312 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f631c01a070 con 0x7f63280c5940 2024-09-10T08:32:06.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.316+0000 7f6316ffd640 1 --2- 172.21.15.103:0/145997312 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f630806bd30 0x7f630806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.316+0000 7f6316ffd640 1 -- 172.21.15.103:0/145997312 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f631c08a5a0 con 0x7f63280c5940 2024-09-10T08:32:06.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.316+0000 7f6326d9d640 1 --2- 172.21.15.103:0/145997312 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f630806bd30 0x7f630806e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.316+0000 7f6316ffd640 1 -- 172.21.15.103:0/145997312 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6318004300 con 0x7f63281e6570 2024-09-10T08:32:06.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.316+0000 7f6316ffd640 1 -- 172.21.15.103:0/145997312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63281e6570 msgr2=0x7f63281e5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.316+0000 7f6316ffd640 1 --2- 172.21.15.103:0/145997312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63281e6570 0x7f63281e5300 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f63180118b0 tx=0x7f6318011d70 comp rx=0 tx=0).stop 2024-09-10T08:32:06.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.316+0000 7f6316ffd640 1 -- 172.21.15.103:0/145997312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63281e6570 msgr2=0x7f63281e5300 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:32:06.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.316+0000 7f6316ffd640 1 --2- 172.21.15.103:0/145997312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63281e6570 0x7f63281e5300 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.316+0000 7f6326d9d640 1 --2- 172.21.15.103:0/145997312 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f630806bd30 0x7f630806e1f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6320033000 tx=0x7f6320009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.323+0000 7f632c96d640 1 --2- 172.21.15.103:0/145997312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63281e5840 0x7f632814f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.323+0000 7f632c96d640 1 -- 172.21.15.103:0/145997312 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f63280c2440 con 0x7f63281e5840 2024-09-10T08:32:06.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.323+0000 7f632659c640 1 --2- 172.21.15.103:0/145997312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63281e5840 0x7f632814f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.323+0000 7f632659c640 1 -- 172.21.15.103:0/145997312 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f63280c8690 con 0x7f63281e5840 2024-09-10T08:32:06.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.323+0000 7f632659c640 1 --2- 172.21.15.103:0/145997312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63281e5840 0x7f632814f220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f63180118b0 tx=0x7f63180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.323+0000 7f6316ffd640 1 -- 172.21.15.103:0/145997312 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631801e670 con 0x7f63281e5840 2024-09-10T08:32:06.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.324+0000 7f6316ffd640 1 -- 172.21.15.103:0/145997312 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4555 (secure 0 0 0) 0x7f63180283a0 con 0x7f63281e5840 2024-09-10T08:32:06.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.324+0000 7f6316ffd640 1 -- 172.21.15.103:0/145997312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63281e5840 msgr2=0x7f632814f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.324+0000 7f6316ffd640 1 --2- 172.21.15.103:0/145997312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63281e5840 0x7f632814f220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f63180118b0 tx=0x7f63180046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.324+0000 7f6316ffd640 1 -- 172.21.15.103:0/145997312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63281e5840 msgr2=0x7f632814f220 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:32:06.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.324+0000 7f6316ffd640 1 --2- 172.21.15.103:0/145997312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63281e5840 0x7f632814f220 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f63180118b0 tx=0x7f63180046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.325 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:32:06.325 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:32:06.325 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:32:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:32:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 22, 2024-09-10T08:32:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 18704, 2024-09-10T08:32:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:32:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:32:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:32:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:32:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 12, 2024-09-10T08:32:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:32:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:32:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:32:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:32:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:32:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:32:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:32:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:32:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:32:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:32:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:32:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:32:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:32:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:32:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:32:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:32:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:32:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:32:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:32:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:32:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:32:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:32:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:32:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:32:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:32:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:32:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:32:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:32:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:32:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:32:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:32:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:32:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:32:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:32:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:32:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:32:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:32:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:32:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:32:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:32:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:32:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:32:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:32:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:32:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:32:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:32:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:32:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:32:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:32:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:32:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:32:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:32:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:32:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:32:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:32:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:32:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:32:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:32:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:32:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:32:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:32:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:32:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:32:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:32:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:32:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:32:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:32:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:32:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:32:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:32:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:32:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:32:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:32:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:32:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:32:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:32:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:32:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:32:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:32:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:32:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:32:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:32:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:32:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:32:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:32:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:32:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:32:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:32:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:32:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:32:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:32:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:32:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:32:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:32:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:32:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:32:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:32:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:32:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:32:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:32:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:32:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:32:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:32:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:32:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:32:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:32:06.338 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:32:06.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.324+0000 7f632c96d640 1 -- 172.21.15.103:0/145997312 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f630806bd30 msgr2=0x7f630806e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.324+0000 7f632c96d640 1 --2- 172.21.15.103:0/145997312 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f630806bd30 0x7f630806e1f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6320033000 tx=0x7f6320009000 comp rx=0 tx=0).stop 2024-09-10T08:32:06.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.324+0000 7f632c96d640 1 -- 172.21.15.103:0/145997312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63280c5940 msgr2=0x7f6328159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.324+0000 7f632c96d640 1 --2- 172.21.15.103:0/145997312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63280c5940 0x7f6328159610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f631c00c780 tx=0x7f631c00cc40 comp rx=0 tx=0).stop 2024-09-10T08:32:06.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.324+0000 7f6326d9d640 1 -- 172.21.15.103:0/145997312 reap_dead start 2024-09-10T08:32:06.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.324+0000 7f6326d9d640 1 -- 172.21.15.103:0/145997312 reap_dead start 2024-09-10T08:32:06.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.324+0000 7f632c96d640 1 -- 172.21.15.103:0/145997312 shutdown_connections 2024-09-10T08:32:06.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.324+0000 7f632c96d640 1 -- 172.21.15.103:0/145997312 >> 172.21.15.103:0/145997312 conn(0x7f63280c7a40 msgr2=0x7f63280a8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:06.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.324+0000 7f632c96d640 1 -- 172.21.15.103:0/145997312 shutdown_connections 2024-09-10T08:32:06.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.324+0000 7f632c96d640 1 -- 172.21.15.103:0/145997312 wait complete. 2024-09-10T08:32:06.341 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:32:06.341 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:32:06.341 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:32:06.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.454+0000 7fdd586ba640 1 Processor -- start 2024-09-10T08:32:06.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.454+0000 7fdd586ba640 1 -- start start 2024-09-10T08:32:06.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.455+0000 7fdd586ba640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdd50150480 0x7fdd500c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.455+0000 7fdd586ba640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdd5006c650 0x7fdd500c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.455+0000 7fdd586ba640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd5015a7c0 con 0x7fdd500c9c80 2024-09-10T08:32:06.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.455+0000 7fdd586ba640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fdd5006c240 con 0x7fdd50150480 2024-09-10T08:32:06.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.455+0000 7fdd586ba640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fdd5015a330 con 0x7fdd5006c650 2024-09-10T08:32:06.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.455+0000 7fdd56456640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdd50150480 0x7fdd500c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.455+0000 7fdd56456640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdd50150480 0x7fdd500c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40828/0 (socket says 172.21.15.103:40828) 2024-09-10T08:32:06.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.455+0000 7fdd56456640 1 -- 172.21.15.103:0/3006302884 learned_addr learned my addr 172.21.15.103:0/3006302884 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:32:06.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.455+0000 7fdd55c55640 1 --2- 172.21.15.103:0/3006302884 >> v2:172.21.15.154:3300/0 conn(0x7fdd5006c650 0x7fdd500c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.456+0000 7fdd56456640 1 -- 172.21.15.103:0/3006302884 >> v2:172.21.15.154:3300/0 conn(0x7fdd5006c650 msgr2=0x7fdd500c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.456+0000 7fdd56456640 1 --2- 172.21.15.103:0/3006302884 >> v2:172.21.15.154:3300/0 conn(0x7fdd5006c650 0x7fdd500c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.456+0000 7fdd56456640 1 -- 172.21.15.103:0/3006302884 >> v1:172.21.15.154:6789/0 conn(0x7fdd500c9c80 legacy=0x7fdd500ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.456+0000 7fdd56456640 1 -- 172.21.15.103:0/3006302884 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd50159a00 con 0x7fdd50150480 2024-09-10T08:32:06.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.456+0000 7fdd56456640 1 --2- 172.21.15.103:0/3006302884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd50150480 0x7fdd500c7a90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdd500c6110 tx=0x7fdd4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684ec52c75ac779a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.456+0000 7fdd55454640 1 -- 172.21.15.103:0/3006302884 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c037070 con 0x7fdd50150480 2024-09-10T08:32:06.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.457+0000 7fdd55454640 1 -- 172.21.15.103:0/3006302884 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd4c032440 con 0x7fdd50150480 2024-09-10T08:32:06.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.457+0000 7fdd55454640 1 -- 172.21.15.103:0/3006302884 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c032810 con 0x7fdd50150480 2024-09-10T08:32:06.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.457+0000 7fdd586ba640 1 -- 172.21.15.103:0/3006302884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd50150480 msgr2=0x7fdd500c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.457+0000 7fdd586ba640 1 --2- 172.21.15.103:0/3006302884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd50150480 0x7fdd500c7a90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdd500c6110 tx=0x7fdd4c02a270 comp rx=0 tx=0).stop 2024-09-10T08:32:06.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.457+0000 7fdd586ba640 1 -- 172.21.15.103:0/3006302884 shutdown_connections 2024-09-10T08:32:06.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.457+0000 7fdd586ba640 1 --2- 172.21.15.103:0/3006302884 >> v2:172.21.15.154:3300/0 conn(0x7fdd5006c650 0x7fdd500c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.457+0000 7fdd586ba640 1 --2- 172.21.15.103:0/3006302884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd50150480 0x7fdd500c7a90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.457+0000 7fdd586ba640 1 -- 172.21.15.103:0/3006302884 >> 172.21.15.103:0/3006302884 conn(0x7fdd50068030 msgr2=0x7fdd50073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:06.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.457+0000 7fdd586ba640 1 -- 172.21.15.103:0/3006302884 shutdown_connections 2024-09-10T08:32:06.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.457+0000 7fdd586ba640 1 -- 172.21.15.103:0/3006302884 wait complete. 2024-09-10T08:32:06.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.459+0000 7fdd586ba640 1 Processor -- start 2024-09-10T08:32:06.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.459+0000 7fdd586ba640 1 -- start start 2024-09-10T08:32:06.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.460+0000 7fdd586ba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd5006c650 0x7fdd50151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.460+0000 7fdd586ba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd500c9c80 0x7fdd50150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.460+0000 7fdd586ba640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd50150480 0x7fdd501529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.460+0000 7fdd586ba640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5006d270 con 0x7fdd5006c650 2024-09-10T08:32:06.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.460+0000 7fdd586ba640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdd50159fc0 con 0x7fdd500c9c80 2024-09-10T08:32:06.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.460+0000 7fdd586ba640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fdd50156270 con 0x7fdd50150480 2024-09-10T08:32:06.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.460+0000 7fdd56456640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd5006c650 0x7fdd50151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.460+0000 7fdd56456640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd5006c650 0x7fdd50151fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40842/0 (socket says 172.21.15.103:40842) 2024-09-10T08:32:06.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.460+0000 7fdd56456640 1 -- 172.21.15.103:0/2653935508 learned_addr learned my addr 172.21.15.103:0/2653935508 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:32:06.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.460+0000 7fdd55c55640 1 --2- 172.21.15.103:0/2653935508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd500c9c80 0x7fdd50150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.460+0000 7fdd56c57640 1 --2- 172.21.15.103:0/2653935508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd50150480 0x7fdd501529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.460+0000 7fdd56456640 1 -- 172.21.15.103:0/2653935508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd50150480 msgr2=0x7fdd501529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.460+0000 7fdd56456640 1 --2- 172.21.15.103:0/2653935508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd50150480 0x7fdd501529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.460+0000 7fdd56456640 1 -- 172.21.15.103:0/2653935508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd500c9c80 msgr2=0x7fdd50150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.460+0000 7fdd56456640 1 --2- 172.21.15.103:0/2653935508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd500c9c80 0x7fdd50150ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.460+0000 7fdd56456640 1 -- 172.21.15.103:0/2653935508 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd501ec0c0 con 0x7fdd5006c650 2024-09-10T08:32:06.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.461+0000 7fdd56456640 1 --2- 172.21.15.103:0/2653935508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd5006c650 0x7fdd50151fe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c02a2b0 tx=0x7fdd4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.461+0000 7fdd46ffd640 1 -- 172.21.15.103:0/2653935508 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c037040 con 0x7fdd5006c650 2024-09-10T08:32:06.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.461+0000 7fdd46ffd640 1 -- 172.21.15.103:0/2653935508 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd4c042070 con 0x7fdd5006c650 2024-09-10T08:32:06.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.461+0000 7fdd586ba640 1 -- 172.21.15.103:0/2653935508 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd501ec3a0 con 0x7fdd5006c650 2024-09-10T08:32:06.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.461+0000 7fdd46ffd640 1 -- 172.21.15.103:0/2653935508 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c030880 con 0x7fdd5006c650 2024-09-10T08:32:06.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.461+0000 7fdd586ba640 1 -- 172.21.15.103:0/2653935508 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd501ec960 con 0x7fdd5006c650 2024-09-10T08:32:06.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.462+0000 7fdd586ba640 1 --2- 172.21.15.103:0/2653935508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd50152f30 0x7fdd50153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.462+0000 7fdd586ba640 1 -- 172.21.15.103:0/2653935508 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdd500ca0f0 con 0x7fdd50152f30 2024-09-10T08:32:06.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.462+0000 7fdd55c55640 1 --2- 172.21.15.103:0/2653935508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd50152f30 0x7fdd50153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.462+0000 7fdd55c55640 1 -- 172.21.15.103:0/2653935508 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd5006c430 con 0x7fdd50152f30 2024-09-10T08:32:06.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.462+0000 7fdd46ffd640 1 -- 172.21.15.103:0/2653935508 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd4c030a20 con 0x7fdd5006c650 2024-09-10T08:32:06.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.462+0000 7fdd55c55640 1 --2- 172.21.15.103:0/2653935508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd50152f30 0x7fdd50153330 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdd500b13c0 tx=0x7fdd40011cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.463+0000 7fdd46ffd640 1 --2- 172.21.15.103:0/2653935508 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdd3406be60 0x7fdd3406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.463+0000 7fdd46ffd640 1 -- 172.21.15.103:0/2653935508 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fdd4c0ab890 con 0x7fdd5006c650 2024-09-10T08:32:06.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.463+0000 7fdd56c57640 1 --2- 172.21.15.103:0/2653935508 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdd3406be60 0x7fdd3406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.463+0000 7fdd46ffd640 1 -- 172.21.15.103:0/2653935508 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd40019070 con 0x7fdd50152f30 2024-09-10T08:32:06.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.463+0000 7fdd46ffd640 1 -- 172.21.15.103:0/2653935508 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fdd40004240 con 0x7fdd50152f30 2024-09-10T08:32:06.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.463+0000 7fdd46ffd640 1 -- 172.21.15.103:0/2653935508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd50152f30 msgr2=0x7fdd50153330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.463+0000 7fdd46ffd640 1 --2- 172.21.15.103:0/2653935508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd50152f30 0x7fdd50153330 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdd500b13c0 tx=0x7fdd40011cf0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.463+0000 7fdd46ffd640 1 -- 172.21.15.103:0/2653935508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd50152f30 msgr2=0x7fdd50153330 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:32:06.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.463+0000 7fdd46ffd640 1 --2- 172.21.15.103:0/2653935508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd50152f30 0x7fdd50153330 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.463+0000 7fdd56c57640 1 --2- 172.21.15.103:0/2653935508 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdd3406be60 0x7fdd3406e320 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdd48001df0 tx=0x7fdd48009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.470+0000 7fdd586ba640 1 --2- 172.21.15.103:0/2653935508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd501ef490 0x7fdd501ef8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.470+0000 7fdd586ba640 1 -- 172.21.15.103:0/2653935508 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdd500ca9c0 con 0x7fdd501ef490 2024-09-10T08:32:06.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.470+0000 7fdd55c55640 1 --2- 172.21.15.103:0/2653935508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd501ef490 0x7fdd501ef8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.470+0000 7fdd55c55640 1 -- 172.21.15.103:0/2653935508 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdd50151220 con 0x7fdd501ef490 2024-09-10T08:32:06.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.471+0000 7fdd55c55640 1 --2- 172.21.15.103:0/2653935508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd501ef490 0x7fdd501ef8c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdd500b13c0 tx=0x7fdd400046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.471+0000 7fdd46ffd640 1 -- 172.21.15.103:0/2653935508 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd40019040 con 0x7fdd501ef490 2024-09-10T08:32:06.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.471+0000 7fdd46ffd640 1 -- 172.21.15.103:0/2653935508 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4888 (secure 0 0 0) 0x7fdd40003da0 con 0x7fdd501ef490 2024-09-10T08:32:06.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.471+0000 7fdd46ffd640 1 -- 172.21.15.103:0/2653935508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd501ef490 msgr2=0x7fdd501ef8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.471+0000 7fdd46ffd640 1 --2- 172.21.15.103:0/2653935508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd501ef490 0x7fdd501ef8c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdd500b13c0 tx=0x7fdd400046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.471+0000 7fdd46ffd640 1 -- 172.21.15.103:0/2653935508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd501ef490 msgr2=0x7fdd501ef8c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:32:06.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.471+0000 7fdd46ffd640 1 --2- 172.21.15.103:0/2653935508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd501ef490 0x7fdd501ef8c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.472 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:32:06.473 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:32:06.473 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:32:06.473 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:32:06.473 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 22, 2024-09-10T08:32:06.473 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 132699, 2024-09-10T08:32:06.473 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:32:06.473 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:32:06.473 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:32:06.473 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:32:06.473 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:06.473 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 12, 2024-09-10T08:32:06.473 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:32:06.474 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:32:06.474 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:32:06.474 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:32:06.474 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:32:06.474 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:32:06.474 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:32:06.474 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:32:06.474 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:32:06.474 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:32:06.474 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:32:06.474 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:32:06.474 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:32:06.475 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:32:06.475 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:06.475 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:32:06.475 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:32:06.475 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:32:06.475 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:32:06.475 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:32:06.475 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:32:06.475 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:32:06.475 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:32:06.475 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:32:06.475 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:32:06.475 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:32:06.476 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:32:06.476 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:32:06.476 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:06.476 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.476 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:32:06.476 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:32:06.476 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:32:06.476 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:32:06.476 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:32:06.476 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:32:06.476 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:32:06.476 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:32:06.476 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:32:06.477 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:32:06.477 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:32:06.477 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:32:06.477 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:32:06.477 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:32:06.477 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:32:06.477 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:32:06.477 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:32:06.477 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:32:06.477 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:32:06.477 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:32:06.477 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:32:06.477 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:32:06.478 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:32:06.478 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:32:06.478 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:32:06.478 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:32:06.478 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:32:06.478 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:32:06.478 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:06.478 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:32:06.478 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.478 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:32:06.478 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.478 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:32:06.478 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:32:06.478 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:32:06.479 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:32:06.479 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.479 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:32:06.479 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:32:06.479 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:06.479 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.479 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.479 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:32:06.479 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:32:06.479 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:06.479 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.479 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:06.479 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.480 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:32:06.480 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:32:06.480 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:32:06.480 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:32:06.480 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:32:06.480 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.480 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.480 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:32:06.480 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:32:06.480 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:32:06.480 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:32:06.480 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.480 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:32:06.481 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:32:06.481 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:06.481 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.481 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.481 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:32:06.481 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:32:06.481 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:06.481 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.481 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:06.481 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.481 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:32:06.481 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:32:06.481 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:32:06.482 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:32:06.482 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:32:06.482 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.482 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.482 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:32:06.482 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:32:06.482 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:32:06.482 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:32:06.482 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.482 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:32:06.482 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:32:06.482 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:06.482 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.482 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.483 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:32:06.483 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:32:06.483 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:06.483 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.483 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:06.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.483 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:32:06.483 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:32:06.483 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:32:06.483 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:32:06.483 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:32:06.483 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.483 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:06.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.484 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:32:06.484 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:32:06.484 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.484 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:32:06.484 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:32:06.484 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:32:06.484 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.484 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:06.484 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:32:06.484 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.484 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:32:06.484 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:32:06.484 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:32:06.485 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.485 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:06.485 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:32:06.485 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.485 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:32:06.485 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:32:06.485 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:32:06.485 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.485 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:06.485 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:32:06.485 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.485 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:32:06.485 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:32:06.486 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:32:06.486 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.486 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:06.486 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.486 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:32:06.486 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:32:06.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.471+0000 7fdd586ba640 1 -- 172.21.15.103:0/2653935508 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdd3406be60 msgr2=0x7fdd3406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.471+0000 7fdd586ba640 1 --2- 172.21.15.103:0/2653935508 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdd3406be60 0x7fdd3406e320 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdd48001df0 tx=0x7fdd48009040 comp rx=0 tx=0).stop 2024-09-10T08:32:06.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.471+0000 7fdd586ba640 1 -- 172.21.15.103:0/2653935508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd5006c650 msgr2=0x7fdd50151fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.471+0000 7fdd586ba640 1 --2- 172.21.15.103:0/2653935508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd5006c650 0x7fdd50151fe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c02a2b0 tx=0x7fdd4c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.471+0000 7fdd56c57640 1 -- 172.21.15.103:0/2653935508 reap_dead start 2024-09-10T08:32:06.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.471+0000 7fdd56c57640 1 -- 172.21.15.103:0/2653935508 reap_dead start 2024-09-10T08:32:06.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.471+0000 7fdd586ba640 1 -- 172.21.15.103:0/2653935508 shutdown_connections 2024-09-10T08:32:06.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.471+0000 7fdd586ba640 1 -- 172.21.15.103:0/2653935508 >> 172.21.15.103:0/2653935508 conn(0x7fdd50068030 msgr2=0x7fdd501540e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:06.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.472+0000 7fdd586ba640 1 -- 172.21.15.103:0/2653935508 shutdown_connections 2024-09-10T08:32:06.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.472+0000 7fdd586ba640 1 -- 172.21.15.103:0/2653935508 wait complete. 2024-09-10T08:32:06.488 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:32:06.488 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:32:06.488 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:32:06.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.598+0000 7f4a4f9df640 1 Processor -- start 2024-09-10T08:32:06.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.598+0000 7f4a4f9df640 1 -- start start 2024-09-10T08:32:06.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.599+0000 7f4a4f9df640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4a480ca390 0x7f4a48161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.599+0000 7f4a4f9df640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a4815a7c0 con 0x7f4a48150480 2024-09-10T08:32:06.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.599+0000 7f4a4f9df640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a48159a00 con 0x7f4a4806c650 2024-09-10T08:32:06.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.599+0000 7f4a4f9df640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4a4806c240 con 0x7f4a480ca390 2024-09-10T08:32:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.599+0000 7f4a4d77b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4a48150480 0x7f4a480c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40230/0 (socket says 172.21.15.103:40230) 2024-09-10T08:32:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.599+0000 7f4a4d77b640 1 -- 172.21.15.103:0/3337959169 learned_addr learned my addr 172.21.15.103:0/3337959169 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:32:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.599+0000 7f4a4df7c640 1 --2- 172.21.15.103:0/3337959169 >> v2:172.21.15.154:3300/0 conn(0x7f4a480ca390 0x7f4a48161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.600+0000 7f4a3ffff640 1 -- 172.21.15.103:0/3337959169 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2335968269 0 0) 0x7f4a4815a7c0 con 0x7f4a48150480 2024-09-10T08:32:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.600+0000 7f4a3ffff640 1 -- 172.21.15.103:0/3337959169 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a34003520 con 0x7f4a48150480 2024-09-10T08:32:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.600+0000 7f4a4df7c640 1 -- 172.21.15.103:0/3337959169 >> v1:172.21.15.154:6789/0 conn(0x7f4a4806c650 legacy=0x7f4a480c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.600+0000 7f4a4df7c640 1 -- 172.21.15.103:0/3337959169 >> v1:172.21.15.103:6789/0 conn(0x7f4a48150480 legacy=0x7f4a480c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.600+0000 7f4a3ffff640 1 -- 172.21.15.103:0/3337959169 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1540931122 0 0) 0x7f4a34003520 con 0x7f4a48150480 2024-09-10T08:32:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.600+0000 7f4a4df7c640 1 -- 172.21.15.103:0/3337959169 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a48159ce0 con 0x7f4a480ca390 2024-09-10T08:32:06.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.601+0000 7f4a4df7c640 1 --2- 172.21.15.103:0/3337959169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a480ca390 0x7f4a48161c00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4a40009d90 tx=0x7f4a4002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cb86b65ec4605a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.601+0000 7f4a3ffff640 1 -- 172.21.15.103:0/3337959169 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a44001670 con 0x7f4a480ca390 2024-09-10T08:32:06.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.601+0000 7f4a3ffff640 1 -- 172.21.15.103:0/3337959169 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a40007540 con 0x7f4a480ca390 2024-09-10T08:32:06.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.601+0000 7f4a3ffff640 1 -- 172.21.15.103:0/3337959169 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a40007910 con 0x7f4a480ca390 2024-09-10T08:32:06.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.602+0000 7f4a4f9df640 1 -- 172.21.15.103:0/3337959169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a480ca390 msgr2=0x7f4a48161c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.602+0000 7f4a4f9df640 1 --2- 172.21.15.103:0/3337959169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a480ca390 0x7f4a48161c00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4a40009d90 tx=0x7f4a4002a680 comp rx=0 tx=0).stop 2024-09-10T08:32:06.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.602+0000 7f4a4f9df640 1 -- 172.21.15.103:0/3337959169 shutdown_connections 2024-09-10T08:32:06.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.602+0000 7f4a4f9df640 1 --2- 172.21.15.103:0/3337959169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a480ca390 0x7f4a48161c00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.602+0000 7f4a4f9df640 1 -- 172.21.15.103:0/3337959169 >> 172.21.15.103:0/3337959169 conn(0x7f4a48068030 msgr2=0x7f4a48073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:06.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.602+0000 7f4a4f9df640 1 -- 172.21.15.103:0/3337959169 shutdown_connections 2024-09-10T08:32:06.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.602+0000 7f4a4f9df640 1 -- 172.21.15.103:0/3337959169 wait complete. 2024-09-10T08:32:06.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.603+0000 7f4a4f9df640 1 Processor -- start 2024-09-10T08:32:06.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.603+0000 7f4a4f9df640 1 -- start start 2024-09-10T08:32:06.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.604+0000 7f4a4f9df640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a4806c650 0x7f4a481e0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.604+0000 7f4a4f9df640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a480ca390 0x7f4a48158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.604+0000 7f4a4f9df640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a48150480 0x7f4a4814e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.604+0000 7f4a4f9df640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4806d270 con 0x7f4a48150480 2024-09-10T08:32:06.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.604+0000 7f4a4f9df640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4815a330 con 0x7f4a480ca390 2024-09-10T08:32:06.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.604+0000 7f4a4f9df640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4a480c81a0 con 0x7f4a4806c650 2024-09-10T08:32:06.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.604+0000 7f4a4df7c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a48150480 0x7f4a4814e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.604+0000 7f4a4df7c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a48150480 0x7f4a4814e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40846/0 (socket says 172.21.15.103:40846) 2024-09-10T08:32:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.604+0000 7f4a4df7c640 1 -- 172.21.15.103:0/165083764 learned_addr learned my addr 172.21.15.103:0/165083764 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:32:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.605+0000 7f4a4cf7a640 1 --2- 172.21.15.103:0/165083764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a480ca390 0x7f4a48158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.605+0000 7f4a4d77b640 1 --2- 172.21.15.103:0/165083764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a4806c650 0x7f4a481e0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.605+0000 7f4a4df7c640 1 -- 172.21.15.103:0/165083764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a4806c650 msgr2=0x7f4a481e0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.605+0000 7f4a4df7c640 1 --2- 172.21.15.103:0/165083764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a4806c650 0x7f4a481e0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.605+0000 7f4a4df7c640 1 -- 172.21.15.103:0/165083764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a480ca390 msgr2=0x7f4a48158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.605+0000 7f4a4df7c640 1 --2- 172.21.15.103:0/165083764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a480ca390 0x7f4a48158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.605+0000 7f4a4df7c640 1 -- 172.21.15.103:0/165083764 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a481e0380 con 0x7f4a48150480 2024-09-10T08:32:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.605+0000 7f4a4d77b640 1 --2- 172.21.15.103:0/165083764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a4806c650 0x7f4a481e0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.605+0000 7f4a4df7c640 1 --2- 172.21.15.103:0/165083764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a48150480 0x7f4a4814e8e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4a40009eb0 tx=0x7f4a40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.605+0000 7f4a3dffb640 1 -- 172.21.15.103:0/165083764 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a40040070 con 0x7f4a48150480 2024-09-10T08:32:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.605+0000 7f4a3dffb640 1 -- 172.21.15.103:0/165083764 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a40031bc0 con 0x7f4a48150480 2024-09-10T08:32:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.605+0000 7f4a4f9df640 1 -- 172.21.15.103:0/165083764 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a481e0660 con 0x7f4a48150480 2024-09-10T08:32:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.605+0000 7f4a3dffb640 1 -- 172.21.15.103:0/165083764 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a40009450 con 0x7f4a48150480 2024-09-10T08:32:06.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.606+0000 7f4a4f9df640 1 -- 172.21.15.103:0/165083764 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a481e1460 con 0x7f4a48150480 2024-09-10T08:32:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.607+0000 7f4a4f9df640 1 --2- 172.21.15.103:0/165083764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a481e1660 0x7f4a481ef0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.607+0000 7f4a4f9df640 1 -- 172.21.15.103:0/165083764 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4a48156270 con 0x7f4a481e1660 2024-09-10T08:32:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.607+0000 7f4a4d77b640 1 --2- 172.21.15.103:0/165083764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a481e1660 0x7f4a481ef0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.607+0000 7f4a3dffb640 1 -- 172.21.15.103:0/165083764 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a40039040 con 0x7f4a48150480 2024-09-10T08:32:06.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.607+0000 7f4a4d77b640 1 -- 172.21.15.103:0/165083764 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4a4806c430 con 0x7f4a481e1660 2024-09-10T08:32:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.607+0000 7f4a4d77b640 1 --2- 172.21.15.103:0/165083764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a481e1660 0x7f4a481ef0b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4a44005880 tx=0x7f4a4400eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.608+0000 7f4a3dffb640 1 --2- 172.21.15.103:0/165083764 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4a2c06beb0 0x7f4a2c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.608+0000 7f4a3dffb640 1 -- 172.21.15.103:0/165083764 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f4a400ac4e0 con 0x7f4a48150480 2024-09-10T08:32:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.608+0000 7f4a4cf7a640 1 --2- 172.21.15.103:0/165083764 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4a2c06beb0 0x7f4a2c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.608+0000 7f4a3dffb640 1 -- 172.21.15.103:0/165083764 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a440058d0 con 0x7f4a481e1660 2024-09-10T08:32:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.608+0000 7f4a3dffb640 1 -- 172.21.15.103:0/165083764 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4a44018070 con 0x7f4a481e1660 2024-09-10T08:32:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.608+0000 7f4a3dffb640 1 -- 172.21.15.103:0/165083764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a481e1660 msgr2=0x7f4a481ef0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.608+0000 7f4a3dffb640 1 --2- 172.21.15.103:0/165083764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a481e1660 0x7f4a481ef0b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4a44005880 tx=0x7f4a4400eb20 comp rx=0 tx=0).stop 2024-09-10T08:32:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.608+0000 7f4a3dffb640 1 -- 172.21.15.103:0/165083764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a481e1660 msgr2=0x7f4a481ef0b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:32:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.608+0000 7f4a3dffb640 1 --2- 172.21.15.103:0/165083764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a481e1660 0x7f4a481ef0b0 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4a44005880 tx=0x7f4a4400eb20 comp rx=0 tx=0).stop 2024-09-10T08:32:06.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.608+0000 7f4a4cf7a640 1 --2- 172.21.15.103:0/165083764 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4a2c06beb0 0x7f4a2c06e370 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4a481599a0 tx=0x7f4a38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.616+0000 7f4a4f9df640 1 --2- 172.21.15.103:0/165083764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a4814ee20 0x7f4a481ef5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.616+0000 7f4a4f9df640 1 -- 172.21.15.103:0/165083764 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4a481528e0 con 0x7f4a4814ee20 2024-09-10T08:32:06.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.616+0000 7f4a4d77b640 1 --2- 172.21.15.103:0/165083764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a4814ee20 0x7f4a481ef5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.617+0000 7f4a4d77b640 1 -- 172.21.15.103:0/165083764 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4a48158e60 con 0x7f4a4814ee20 2024-09-10T08:32:06.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.617+0000 7f4a4d77b640 1 --2- 172.21.15.103:0/165083764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a4814ee20 0x7f4a481ef5f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4a44017000 tx=0x7f4a440057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.617+0000 7f4a3dffb640 1 -- 172.21.15.103:0/165083764 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a440073f0 con 0x7f4a4814ee20 2024-09-10T08:32:06.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.617+0000 7f4a3dffb640 1 -- 172.21.15.103:0/165083764 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7f4a440073f0 con 0x7f4a4814ee20 2024-09-10T08:32:06.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.617+0000 7f4a3dffb640 1 -- 172.21.15.103:0/165083764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a4814ee20 msgr2=0x7f4a481ef5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.617+0000 7f4a3dffb640 1 --2- 172.21.15.103:0/165083764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a4814ee20 0x7f4a481ef5f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4a44017000 tx=0x7f4a440057f0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.617+0000 7f4a3dffb640 1 -- 172.21.15.103:0/165083764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a4814ee20 msgr2=0x7f4a481ef5f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:32:06.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.617+0000 7f4a3dffb640 1 --2- 172.21.15.103:0/165083764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a4814ee20 0x7f4a481ef5f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.619 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:32:06.619 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:32:06.619 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:32:06.619 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:32:06.619 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 22, 2024-09-10T08:32:06.619 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 70778, 2024-09-10T08:32:06.619 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:32:06.619 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:32:06.619 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:32:06.620 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:32:06.620 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:06.620 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 12, 2024-09-10T08:32:06.620 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:32:06.620 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:32:06.620 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:32:06.620 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:32:06.620 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:32:06.620 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:32:06.620 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:32:06.620 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:32:06.621 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:32:06.621 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:32:06.621 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:32:06.621 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:32:06.621 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:32:06.621 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:32:06.621 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:06.621 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:32:06.621 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:32:06.621 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:32:06.621 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:32:06.621 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:32:06.622 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:32:06.622 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:32:06.622 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:32:06.622 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:32:06.622 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:32:06.622 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:32:06.622 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:32:06.622 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:32:06.623 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:06.623 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.623 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:32:06.623 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:32:06.623 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:32:06.623 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:32:06.623 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:32:06.623 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:32:06.623 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:32:06.623 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:32:06.623 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:32:06.624 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:32:06.624 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:32:06.624 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:32:06.624 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:32:06.624 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:32:06.624 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:32:06.624 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:32:06.625 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:32:06.625 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:32:06.625 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:32:06.625 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:32:06.625 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:32:06.625 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:32:06.625 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:32:06.625 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:32:06.626 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:32:06.626 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:32:06.626 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:32:06.626 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:32:06.626 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:06.626 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:32:06.626 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.626 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:32:06.626 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.627 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:32:06.627 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:32:06.627 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:32:06.627 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:32:06.627 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.627 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:32:06.627 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:32:06.627 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:06.627 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.627 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.628 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:32:06.628 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:32:06.628 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:06.628 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.628 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:06.628 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.628 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:32:06.628 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:32:06.628 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:32:06.629 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:32:06.629 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:32:06.629 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.629 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.629 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:32:06.629 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:32:06.629 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:32:06.629 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:32:06.630 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.630 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:32:06.630 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:32:06.630 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:06.630 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.630 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.630 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:32:06.630 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:32:06.630 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:06.630 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.630 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:06.631 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.631 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:32:06.631 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:32:06.631 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:32:06.631 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:32:06.631 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:32:06.631 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.631 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.631 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:32:06.632 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:32:06.632 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:32:06.632 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:32:06.632 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.632 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:32:06.632 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:32:06.632 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:06.632 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.632 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.633 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:32:06.633 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:32:06.633 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:06.633 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.633 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:06.633 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.633 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:32:06.633 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:32:06.633 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:32:06.633 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:32:06.633 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:32:06.633 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.633 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:06.634 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.634 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:32:06.634 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:32:06.634 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.634 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:32:06.634 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:32:06.634 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:32:06.634 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.634 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:06.634 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:32:06.635 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.635 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:32:06.635 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:32:06.635 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:32:06.635 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.635 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:06.635 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:32:06.635 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.635 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:32:06.635 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:32:06.636 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:32:06.636 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.636 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:06.636 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:32:06.636 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.636 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:32:06.636 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:32:06.636 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:32:06.636 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.636 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:06.636 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:32:06.636 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:06.636 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:32:06.637 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:32:06.637 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:32:06.637 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:06.637 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:06.637 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:06.637 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:32:06.637 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:32:06.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.618+0000 7f4a4f9df640 1 -- 172.21.15.103:0/165083764 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4a2c06beb0 msgr2=0x7f4a2c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.618+0000 7f4a4f9df640 1 --2- 172.21.15.103:0/165083764 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4a2c06beb0 0x7f4a2c06e370 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4a481599a0 tx=0x7f4a38009040 comp rx=0 tx=0).stop 2024-09-10T08:32:06.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.618+0000 7f4a4f9df640 1 -- 172.21.15.103:0/165083764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a48150480 msgr2=0x7f4a4814e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.618+0000 7f4a4f9df640 1 --2- 172.21.15.103:0/165083764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a48150480 0x7f4a4814e8e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4a40009eb0 tx=0x7f4a40004a40 comp rx=0 tx=0).stop 2024-09-10T08:32:06.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.618+0000 7f4a4df7c640 1 -- 172.21.15.103:0/165083764 reap_dead start 2024-09-10T08:32:06.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.618+0000 7f4a4df7c640 1 -- 172.21.15.103:0/165083764 reap_dead start 2024-09-10T08:32:06.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.618+0000 7f4a4f9df640 1 -- 172.21.15.103:0/165083764 shutdown_connections 2024-09-10T08:32:06.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.618+0000 7f4a4f9df640 1 -- 172.21.15.103:0/165083764 >> 172.21.15.103:0/165083764 conn(0x7f4a48068030 msgr2=0x7f4a480ca8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:06.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.618+0000 7f4a4f9df640 1 -- 172.21.15.103:0/165083764 shutdown_connections 2024-09-10T08:32:06.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:06.618+0000 7f4a4f9df640 1 -- 172.21.15.103:0/165083764 wait complete. 2024-09-10T08:32:06.640 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:32:06.640 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-09-10T08:32:06.640 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2024-09-10T08:32:06.640 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-10T08:32:06.640 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-10T08:32:06.641 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T08:32:06.641 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:32:06.655 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T08:32:06.656 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-09-10T08:32:06.656 INFO:tasks.ceph.mon.a:Sent signal 19 2024-09-10T08:32:06.656 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-10T08:32:21.657 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-09-10T08:32:21.658 INFO:tasks.ceph.mon.a:Sent signal 18 2024-09-10T08:32:21.658 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-10T08:32:21.658 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:32:21.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.767+0000 7f239cb86640 1 Processor -- start 2024-09-10T08:32:21.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.768+0000 7f239cb86640 1 -- start start 2024-09-10T08:32:21.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.768+0000 7f239cb86640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 0x7f23980c3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:21.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.768+0000 7f239cb86640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 0x7f239806dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:21.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.768+0000 7f239cb86640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23980ad5c0 con 0x7f239806e650 2024-09-10T08:32:21.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.768+0000 7f239cb86640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f239806ef50 con 0x7f23981500a0 2024-09-10T08:32:21.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.768+0000 7f239cb86640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f23980ad860 con 0x7f23980c3e00 2024-09-10T08:32:21.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.769+0000 7f239659c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 0x7f23980c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:21.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.769+0000 7f2395d9b640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f239806e650 legacy=0x7f2398150930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:32:21.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.769+0000 7f239659c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 0x7f23980c3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52018/0 (socket says 172.21.15.103:52018) 2024-09-10T08:32:21.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.769+0000 7f239659c640 1 -- 172.21.15.103:0/3117180876 learned_addr learned my addr 172.21.15.103:0/3117180876 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:32:21.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.769+0000 7f239659c640 1 -- 172.21.15.103:0/3117180876 >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 msgr2=0x7f23980c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:32:21.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.769+0000 7f239659c640 1 -- 172.21.15.103:0/3117180876 >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 msgr2=0x7f23980c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:32:21.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.769+0000 7f239659c640 1 --2- 172.21.15.103:0/3117180876 >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 0x7f23980c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:32:21.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.769+0000 7f239659c640 1 --2- 172.21.15.103:0/3117180876 >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 0x7f23980c3000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:32:21.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.769+0000 7f2396d9d640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 0x7f239806dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:21.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.769+0000 7f2396d9d640 1 -- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 msgr2=0x7f239806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:32:21.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.769+0000 7f2396d9d640 1 -- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 msgr2=0x7f239806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:32:21.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.769+0000 7f2396d9d640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 0x7f239806dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:32:21.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.769+0000 7f2396d9d640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 0x7f239806dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:32:21.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.970+0000 7f239659c640 1 --2- 172.21.15.103:0/3117180876 >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 0x7f23980c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:21.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.970+0000 7f2395d9b640 1 -- 172.21.15.103:0/3117180876 >> v1:172.21.15.154:6789/0 conn(0x7f239806e650 legacy=0x7f2398150930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:32:21.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.970+0000 7f239659c640 1 -- 172.21.15.103:0/3117180876 >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 msgr2=0x7f23980c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:32:21.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.970+0000 7f239659c640 1 -- 172.21.15.103:0/3117180876 >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 msgr2=0x7f23980c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:32:21.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.970+0000 7f239659c640 1 --2- 172.21.15.103:0/3117180876 >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 0x7f23980c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:32:21.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.970+0000 7f239659c640 1 --2- 172.21.15.103:0/3117180876 >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 0x7f23980c3000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:32:21.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.970+0000 7f2396d9d640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 0x7f239806dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:21.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.970+0000 7f2396d9d640 1 -- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 msgr2=0x7f239806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:32:21.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.970+0000 7f2396d9d640 1 -- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 msgr2=0x7f239806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:32:21.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.970+0000 7f2396d9d640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 0x7f239806dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:32:21.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:21.970+0000 7f2396d9d640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 0x7f239806dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:32:22.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:22.371+0000 7f2395d9b640 1 -- 172.21.15.103:0/3117180876 >> v1:172.21.15.154:6789/0 conn(0x7f239806e650 legacy=0x7f2398150930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:32:22.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:22.371+0000 7f239659c640 1 --2- 172.21.15.103:0/3117180876 >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 0x7f23980c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:22.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:22.371+0000 7f239659c640 1 -- 172.21.15.103:0/3117180876 >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 msgr2=0x7f23980c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:32:22.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:22.371+0000 7f239659c640 1 -- 172.21.15.103:0/3117180876 >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 msgr2=0x7f23980c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:32:22.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:22.371+0000 7f239659c640 1 --2- 172.21.15.103:0/3117180876 >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 0x7f23980c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:32:22.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:22.371+0000 7f239659c640 1 --2- 172.21.15.103:0/3117180876 >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 0x7f23980c3000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:32:22.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:22.371+0000 7f2396d9d640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 0x7f239806dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:22.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:22.371+0000 7f2396d9d640 1 -- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 msgr2=0x7f239806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:32:22.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:22.371+0000 7f2396d9d640 1 -- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 msgr2=0x7f239806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:32:22.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:22.371+0000 7f2396d9d640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 0x7f239806dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:32:22.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:22.371+0000 7f2396d9d640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 0x7f239806dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:32:23.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:23.172+0000 7f2395d9b640 1 -- 172.21.15.103:0/3117180876 >> v1:172.21.15.154:6789/0 conn(0x7f239806e650 legacy=0x7f2398150930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:32:23.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:23.172+0000 7f239659c640 1 --2- 172.21.15.103:0/3117180876 >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 0x7f23980c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:23.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:23.172+0000 7f239659c640 1 -- 172.21.15.103:0/3117180876 >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 msgr2=0x7f23980c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:32:23.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:23.172+0000 7f239659c640 1 -- 172.21.15.103:0/3117180876 >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 msgr2=0x7f23980c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:32:23.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:23.172+0000 7f239659c640 1 --2- 172.21.15.103:0/3117180876 >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 0x7f23980c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:32:23.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:23.172+0000 7f239659c640 1 --2- 172.21.15.103:0/3117180876 >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 0x7f23980c3000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:32:23.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:23.172+0000 7f2396d9d640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 0x7f239806dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:23.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:23.172+0000 7f2396d9d640 1 -- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 msgr2=0x7f239806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:32:23.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:23.172+0000 7f2396d9d640 1 -- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 msgr2=0x7f239806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:32:23.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:23.172+0000 7f2396d9d640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 0x7f239806dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:32:23.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:23.172+0000 7f2396d9d640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 0x7f239806dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:32:24.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:24.769+0000 7f238ffff640 1 -- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 msgr2=0x7f239806dab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:32:24.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:24.769+0000 7f238ffff640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23980c3e00 0x7f239806dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:24.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:24.769+0000 7f238ffff640 1 -- 172.21.15.103:0/3117180876 >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 msgr2=0x7f23980c3000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:32:24.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:24.769+0000 7f238ffff640 1 --2- 172.21.15.103:0/3117180876 >> v2:172.21.15.103:3300/0 conn(0x7f23981500a0 0x7f23980c3000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:24.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:24.769+0000 7f238ffff640 1 -- 172.21.15.103:0/3117180876 >> v1:172.21.15.154:6789/0 conn(0x7f239806e650 legacy=0x7f2398150930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:32:24.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:24.769+0000 7f238ffff640 1 --2- 172.21.15.103:0/3117180876 >> v2:172.21.15.154:3300/0 conn(0x7f2378007350 0x7f23780097f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:24.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:24.769+0000 7f238ffff640 1 -- 172.21.15.103:0/3117180876 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f239806ec70 con 0x7f23780036a0 2024-09-10T08:32:24.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:24.769+0000 7f238ffff640 1 -- 172.21.15.103:0/3117180876 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f239806ef50 con 0x7f2378007350 2024-09-10T08:32:24.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:24.769+0000 7f2395d9b640 1 -- 172.21.15.103:0/3117180876 >> v2:172.21.15.154:3300/0 conn(0x7f2378007350 msgr2=0x7f23780097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:32:24.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:24.769+0000 7f2395d9b640 1 --2- 172.21.15.103:0/3117180876 >> v2:172.21.15.154:3300/0 conn(0x7f2378007350 0x7f23780097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:32:24.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:24.970+0000 7f2395d9b640 1 -- 172.21.15.103:0/3117180876 >> v2:172.21.15.154:3300/0 conn(0x7f2378007350 msgr2=0x7f23780097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:32:24.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:24.970+0000 7f2395d9b640 1 --2- 172.21.15.103:0/3117180876 >> v2:172.21.15.154:3300/0 conn(0x7f2378007350 0x7f23780097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:32:25.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:25.371+0000 7f2395d9b640 1 -- 172.21.15.103:0/3117180876 >> v2:172.21.15.154:3300/0 conn(0x7f2378007350 msgr2=0x7f23780097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:32:25.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:25.371+0000 7f2395d9b640 1 --2- 172.21.15.103:0/3117180876 >> v2:172.21.15.154:3300/0 conn(0x7f2378007350 0x7f23780097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:32:26.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.172+0000 7f2395d9b640 1 -- 172.21.15.103:0/3117180876 >> v2:172.21.15.154:3300/0 conn(0x7f2378007350 msgr2=0x7f23780097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:32:26.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.172+0000 7f2395d9b640 1 --2- 172.21.15.103:0/3117180876 >> v2:172.21.15.154:3300/0 conn(0x7f2378007350 0x7f23780097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:32:26.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.673+0000 7f239559a640 1 -- 172.21.15.103:0/3117180876 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3608934285 0 0) 0x7f239806ec70 con 0x7f23780036a0 2024-09-10T08:32:26.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.673+0000 7f239559a640 1 -- 172.21.15.103:0/3117180876 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2384003520 con 0x7f23780036a0 2024-09-10T08:32:26.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.677+0000 7f239559a640 1 -- 172.21.15.103:0/3117180876 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 187407983 0 0) 0x7f2384003520 con 0x7f23780036a0 2024-09-10T08:32:26.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.677+0000 7f239559a640 1 -- 172.21.15.103:0/3117180876 >> v2:172.21.15.154:3300/0 conn(0x7f2378007350 msgr2=0x7f23780097f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:32:26.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.677+0000 7f239559a640 1 --2- 172.21.15.103:0/3117180876 >> v2:172.21.15.154:3300/0 conn(0x7f2378007350 0x7f23780097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:26.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.677+0000 7f239559a640 1 -- 172.21.15.103:0/3117180876 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23980ad5c0 con 0x7f23780036a0 2024-09-10T08:32:26.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.677+0000 7f239559a640 1 -- 172.21.15.103:0/3117180876 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f238800f040 con 0x7f23780036a0 2024-09-10T08:32:26.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.677+0000 7f239559a640 1 -- 172.21.15.103:0/3117180876 >> v1:172.21.15.103:6789/0 conn(0x7f23780036a0 legacy=0x7f2378005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:26.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.677+0000 7f2396d9d640 1 -- 172.21.15.103:0/3117180876 reap_dead start 2024-09-10T08:32:26.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.677+0000 7f239559a640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23840039b0 0x7f2384003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:26.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.677+0000 7f239559a640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2384004800 0x7f2384004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:26.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.677+0000 7f239559a640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23840052e0 0x7f238400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:26.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.677+0000 7f239559a640 1 -- 172.21.15.103:0/3117180876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f239806ef50 con 0x7f2384004800 2024-09-10T08:32:26.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.677+0000 7f239559a640 1 -- 172.21.15.103:0/3117180876 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f238400c230 con 0x7f23840039b0 2024-09-10T08:32:26.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.677+0000 7f239559a640 1 -- 172.21.15.103:0/3117180876 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f238400c430 con 0x7f23840052e0 2024-09-10T08:32:26.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.677+0000 7f239659c640 1 -- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23840039b0 msgr2=0x7f2384003db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:32:26.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.677+0000 7f239659c640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23840039b0 0x7f2384003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:32:26.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.677+0000 7f2395d9b640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2384004800 0x7f2384004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:26.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.677+0000 7f2396d9d640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23840052e0 0x7f238400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:26.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.677+0000 7f2395d9b640 1 -- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23840052e0 msgr2=0x7f238400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:26.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.677+0000 7f2395d9b640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23840052e0 0x7f238400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:26.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.677+0000 7f2395d9b640 1 -- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23840039b0 msgr2=0x7f2384003db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:32:26.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.677+0000 7f2395d9b640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23840039b0 0x7f2384003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:26.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.677+0000 7f2395d9b640 1 -- 172.21.15.103:0/3117180876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2384003520 con 0x7f2384004800 2024-09-10T08:32:26.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.679+0000 7f2395d9b640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2384004800 0x7f2384004c80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2380003930 tx=0x7f2384005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24cc59ebb516299e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:26.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.680+0000 7f239559a640 1 -- 172.21.15.103:0/3117180876 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2380036070 con 0x7f2384004800 2024-09-10T08:32:26.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.680+0000 7f239559a640 1 -- 172.21.15.103:0/3117180876 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2380031640 con 0x7f2384004800 2024-09-10T08:32:26.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.680+0000 7f239559a640 1 -- 172.21.15.103:0/3117180876 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2380008050 con 0x7f2384004800 2024-09-10T08:32:26.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.681+0000 7f239cb86640 1 -- 172.21.15.103:0/3117180876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2384004800 msgr2=0x7f2384004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:26.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.681+0000 7f239cb86640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2384004800 0x7f2384004c80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2380003930 tx=0x7f2384005830 comp rx=0 tx=0).stop 2024-09-10T08:32:26.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.681+0000 7f239cb86640 1 -- 172.21.15.103:0/3117180876 shutdown_connections 2024-09-10T08:32:26.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.681+0000 7f239cb86640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23840052e0 0x7f238400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:26.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.681+0000 7f239cb86640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2384004800 0x7f2384004c80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:26.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.681+0000 7f239cb86640 1 --2- 172.21.15.103:0/3117180876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23840039b0 0x7f2384003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:26.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.681+0000 7f239cb86640 1 -- 172.21.15.103:0/3117180876 >> 172.21.15.103:0/3117180876 conn(0x7f23980c7a40 msgr2=0x7f23980c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:26.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.681+0000 7f239cb86640 1 -- 172.21.15.103:0/3117180876 shutdown_connections 2024-09-10T08:32:26.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.681+0000 7f239cb86640 1 -- 172.21.15.103:0/3117180876 wait complete. 2024-09-10T08:32:26.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.683+0000 7f239cb86640 1 Processor -- start 2024-09-10T08:32:26.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.683+0000 7f239cb86640 1 -- start start 2024-09-10T08:32:26.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.683+0000 7f239cb86640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23840039b0 0x7f2398145ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:26.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.683+0000 7f239cb86640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2384004800 0x7f2398147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:26.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.683+0000 7f239cb86640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23840052e0 0x7f23981480c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:26.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.683+0000 7f239cb86640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2398150480 con 0x7f23840039b0 2024-09-10T08:32:26.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.683+0000 7f239cb86640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f23980adb10 con 0x7f2384004800 2024-09-10T08:32:26.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.683+0000 7f239cb86640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2398150600 con 0x7f23840052e0 2024-09-10T08:32:26.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.684+0000 7f2395d9b640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2384004800 msgr2=0x7f2398147b80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:32:26.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.684+0000 7f2395d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2384004800 0x7f2398147b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:32:26.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.684+0000 7f239659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23840039b0 0x7f2398145ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:26.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.684+0000 7f239659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23840039b0 0x7f2398145ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40166/0 (socket says 172.21.15.103:40166) 2024-09-10T08:32:26.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.684+0000 7f239659c640 1 -- 172.21.15.103:0/4044484705 learned_addr learned my addr 172.21.15.103:0/4044484705 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:32:26.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.684+0000 7f2396d9d640 1 --2- 172.21.15.103:0/4044484705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23840052e0 0x7f23981480c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:26.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.684+0000 7f239659c640 1 -- 172.21.15.103:0/4044484705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23840052e0 msgr2=0x7f23981480c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:26.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.684+0000 7f239659c640 1 --2- 172.21.15.103:0/4044484705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23840052e0 0x7f23981480c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:26.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.684+0000 7f239659c640 1 -- 172.21.15.103:0/4044484705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2384004800 msgr2=0x7f2398147b80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:32:26.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.684+0000 7f239659c640 1 --2- 172.21.15.103:0/4044484705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2384004800 0x7f2398147b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:26.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.684+0000 7f239659c640 1 -- 172.21.15.103:0/4044484705 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23980a85e0 con 0x7f23840039b0 2024-09-10T08:32:26.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.684+0000 7f239659c640 1 --2- 172.21.15.103:0/4044484705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23840039b0 0x7f2398145ee0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2388013950 tx=0x7f2388013e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:26.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.684+0000 7f238effd640 1 -- 172.21.15.103:0/4044484705 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238801b070 con 0x7f23840039b0 2024-09-10T08:32:26.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.684+0000 7f238effd640 1 -- 172.21.15.103:0/4044484705 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23880119f0 con 0x7f23840039b0 2024-09-10T08:32:26.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.684+0000 7f238effd640 1 -- 172.21.15.103:0/4044484705 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388011dc0 con 0x7f23840039b0 2024-09-10T08:32:26.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.684+0000 7f239cb86640 1 -- 172.21.15.103:0/4044484705 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23980a88a0 con 0x7f23840039b0 2024-09-10T08:32:26.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.685+0000 7f239cb86640 1 -- 172.21.15.103:0/4044484705 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2398146420 con 0x7f23840039b0 2024-09-10T08:32:26.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.686+0000 7f239cb86640 1 -- 172.21.15.103:0/4044484705 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23981ed730 con 0x7f23840039b0 2024-09-10T08:32:26.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.686+0000 7f238effd640 1 -- 172.21.15.103:0/4044484705 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2388016460 con 0x7f23840039b0 2024-09-10T08:32:26.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.687+0000 7f238effd640 1 --2- 172.21.15.103:0/4044484705 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f237806c390 0x7f237806e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:26.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.687+0000 7f238effd640 1 -- 172.21.15.103:0/4044484705 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f238808ba30 con 0x7f23840039b0 2024-09-10T08:32:26.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.687+0000 7f2395d9b640 1 --2- 172.21.15.103:0/4044484705 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f237806c390 0x7f237806e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:26.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.687+0000 7f2395d9b640 1 --2- 172.21.15.103:0/4044484705 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f237806c390 0x7f237806e850 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2380033000 tx=0x7f238002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:26.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.691+0000 7f238effd640 1 -- 172.21.15.103:0/4044484705 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f23880599f0 con 0x7f23840039b0 2024-09-10T08:32:26.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.924+0000 7f239cb86640 1 -- 172.21.15.103:0/4044484705 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f23980c2130 con 0x7f23840039b0 2024-09-10T08:32:26.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.924+0000 7f238effd640 1 -- 172.21.15.103:0/4044484705 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7f238805dcf0 con 0x7f23840039b0 2024-09-10T08:32:26.925 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":26,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:32:26.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.926+0000 7f239cb86640 1 -- 172.21.15.103:0/4044484705 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f237806c390 msgr2=0x7f237806e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:26.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.926+0000 7f239cb86640 1 --2- 172.21.15.103:0/4044484705 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f237806c390 0x7f237806e850 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2380033000 tx=0x7f238002f000 comp rx=0 tx=0).stop 2024-09-10T08:32:26.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.926+0000 7f239cb86640 1 -- 172.21.15.103:0/4044484705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23840039b0 msgr2=0x7f2398145ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:26.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.926+0000 7f239cb86640 1 --2- 172.21.15.103:0/4044484705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23840039b0 0x7f2398145ee0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2388013950 tx=0x7f2388013e10 comp rx=0 tx=0).stop 2024-09-10T08:32:26.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.926+0000 7f239cb86640 1 -- 172.21.15.103:0/4044484705 shutdown_connections 2024-09-10T08:32:26.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.926+0000 7f239cb86640 1 --2- 172.21.15.103:0/4044484705 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f237806c390 0x7f237806e850 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:26.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.926+0000 7f239cb86640 1 --2- 172.21.15.103:0/4044484705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23840052e0 0x7f23981480c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:26.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.926+0000 7f239cb86640 1 --2- 172.21.15.103:0/4044484705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2384004800 0x7f2398147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:26.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.926+0000 7f239cb86640 1 --2- 172.21.15.103:0/4044484705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23840039b0 0x7f2398145ee0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:26.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.926+0000 7f239cb86640 1 -- 172.21.15.103:0/4044484705 >> 172.21.15.103:0/4044484705 conn(0x7f23980c7a40 msgr2=0x7f23980c6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:26.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.926+0000 7f239cb86640 1 -- 172.21.15.103:0/4044484705 shutdown_connections 2024-09-10T08:32:26.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:26.926+0000 7f239cb86640 1 -- 172.21.15.103:0/4044484705 wait complete. 2024-09-10T08:32:26.937 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-10T08:32:26.937 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-10T08:32:26.938 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:32:27.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.036+0000 7fdeeccc0640 1 Processor -- start 2024-09-10T08:32:27.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.036+0000 7fdeeccc0640 1 -- start start 2024-09-10T08:32:27.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.037+0000 7fdeeccc0640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdee8150480 0x7fdee80c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:27.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.037+0000 7fdeeccc0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdee80ca390 0x7fdee80c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:27.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.037+0000 7fdeeccc0640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee815a7c0 con 0x7fdee806c650 2024-09-10T08:32:27.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.037+0000 7fdeeccc0640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fdee806c240 con 0x7fdee8150480 2024-09-10T08:32:27.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.037+0000 7fdeeccc0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fdee815a330 con 0x7fdee80ca390 2024-09-10T08:32:27.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.037+0000 7fdee659c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdee8150480 0x7fdee80c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:27.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.037+0000 7fdee6d9d640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7fdee80ca390 msgr2=0x7fdee80c7fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:32:27.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.037+0000 7fdeddd9b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdee806c650 0x7fdee80c9c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46876/0 (socket says 172.21.15.103:46876) 2024-09-10T08:32:27.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.037+0000 7fdee659c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdee8150480 0x7fdee80c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40170/0 (socket says 172.21.15.103:40170) 2024-09-10T08:32:27.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.037+0000 7fdeddd9b640 1 -- 172.21.15.103:0/3055963796 learned_addr learned my addr 172.21.15.103:0/3055963796 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:32:27.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.037+0000 7fdee6d9d640 1 --2- 172.21.15.103:0/3055963796 >> v2:172.21.15.154:3300/0 conn(0x7fdee80ca390 0x7fdee80c7fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:32:27.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.038+0000 7fdee659c640 1 -- 172.21.15.103:0/3055963796 >> v2:172.21.15.154:3300/0 conn(0x7fdee80ca390 msgr2=0x7fdee80c7fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:32:27.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.038+0000 7fdee659c640 1 --2- 172.21.15.103:0/3055963796 >> v2:172.21.15.154:3300/0 conn(0x7fdee80ca390 0x7fdee80c7fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.038+0000 7fdee659c640 1 -- 172.21.15.103:0/3055963796 >> v1:172.21.15.103:6789/0 conn(0x7fdee806c650 legacy=0x7fdee80c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:27.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.038+0000 7fdee5d9b640 1 -- 172.21.15.103:0/3055963796 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 568528719 0 0) 0x7fdee815a7c0 con 0x7fdee806c650 2024-09-10T08:32:27.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.038+0000 7fdee659c640 1 -- 172.21.15.103:0/3055963796 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee8159a00 con 0x7fdee8150480 2024-09-10T08:32:27.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.038+0000 7fdee659c640 1 --2- 172.21.15.103:0/3055963796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee8150480 0x7fdee80c7a90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdee806bc70 tx=0x7fded802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99303de3f79ff895 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:27.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.038+0000 7fdee5d9b640 1 -- 172.21.15.103:0/3055963796 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded8037070 con 0x7fdee8150480 2024-09-10T08:32:27.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.038+0000 7fdee5d9b640 1 -- 172.21.15.103:0/3055963796 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded8032440 con 0x7fdee8150480 2024-09-10T08:32:27.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.038+0000 7fdee5d9b640 1 -- 172.21.15.103:0/3055963796 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded8032810 con 0x7fdee8150480 2024-09-10T08:32:27.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.039+0000 7fdeeccc0640 1 -- 172.21.15.103:0/3055963796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee8150480 msgr2=0x7fdee80c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:27.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.039+0000 7fdeeccc0640 1 --2- 172.21.15.103:0/3055963796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee8150480 0x7fdee80c7a90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdee806bc70 tx=0x7fded802a1c0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.039+0000 7fdeeccc0640 1 -- 172.21.15.103:0/3055963796 shutdown_connections 2024-09-10T08:32:27.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.039+0000 7fdeeccc0640 1 --2- 172.21.15.103:0/3055963796 >> v2:172.21.15.154:3300/0 conn(0x7fdee80ca390 0x7fdee80c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.039+0000 7fdeeccc0640 1 --2- 172.21.15.103:0/3055963796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee8150480 0x7fdee80c7a90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.039+0000 7fdeeccc0640 1 -- 172.21.15.103:0/3055963796 >> 172.21.15.103:0/3055963796 conn(0x7fdee8068030 msgr2=0x7fdee8073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:27.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.039+0000 7fdeeccc0640 1 -- 172.21.15.103:0/3055963796 shutdown_connections 2024-09-10T08:32:27.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.039+0000 7fdeeccc0640 1 -- 172.21.15.103:0/3055963796 wait complete. 2024-09-10T08:32:27.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.040+0000 7fdeeccc0640 1 Processor -- start 2024-09-10T08:32:27.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.040+0000 7fdeeccc0640 1 -- start start 2024-09-10T08:32:27.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.041+0000 7fdeeccc0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee806c650 0x7fdee81f01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:27.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.041+0000 7fdeeccc0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee80ca390 0x7fdee81e2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:27.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.041+0000 7fdeeccc0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee8150480 0x7fdee81ec810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:27.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.041+0000 7fdeeccc0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdee806d270 con 0x7fdee8150480 2024-09-10T08:32:27.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.041+0000 7fdeeccc0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdee8159fc0 con 0x7fdee80ca390 2024-09-10T08:32:27.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.041+0000 7fdeeccc0640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fdee8156270 con 0x7fdee806c650 2024-09-10T08:32:27.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.041+0000 7fdee6d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee8150480 0x7fdee81ec810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:27.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.041+0000 7fdeddd9b640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee80ca390 msgr2=0x7fdee81e2df0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:32:27.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.041+0000 7fdeddd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee80ca390 0x7fdee81e2df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:32:27.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.041+0000 7fdee6d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee8150480 0x7fdee81ec810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40180/0 (socket says 172.21.15.103:40180) 2024-09-10T08:32:27.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.041+0000 7fdee6d9d640 1 -- 172.21.15.103:0/390253939 learned_addr learned my addr 172.21.15.103:0/390253939 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:32:27.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.041+0000 7fdee659c640 1 --2- 172.21.15.103:0/390253939 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee806c650 0x7fdee81f01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:27.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.042+0000 7fdee6d9d640 1 -- 172.21.15.103:0/390253939 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee806c650 msgr2=0x7fdee81f01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:27.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.042+0000 7fdee6d9d640 1 --2- 172.21.15.103:0/390253939 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee806c650 0x7fdee81f01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.042+0000 7fdee6d9d640 1 -- 172.21.15.103:0/390253939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee80ca390 msgr2=0x7fdee81e2df0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:32:27.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.042+0000 7fdee6d9d640 1 --2- 172.21.15.103:0/390253939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee80ca390 0x7fdee81e2df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.042+0000 7fdee6d9d640 1 -- 172.21.15.103:0/390253939 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee81532a0 con 0x7fdee8150480 2024-09-10T08:32:27.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.042+0000 7fdee659c640 1 --2- 172.21.15.103:0/390253939 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee806c650 0x7fdee81f01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:27.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.042+0000 7fdee6d9d640 1 --2- 172.21.15.103:0/390253939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee8150480 0x7fdee81ec810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdee000be50 tx=0x7fdee000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:27.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.042+0000 7fdedf7fe640 1 -- 172.21.15.103:0/390253939 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0016430 con 0x7fdee8150480 2024-09-10T08:32:27.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.042+0000 7fdedf7fe640 1 -- 172.21.15.103:0/390253939 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee0010030 con 0x7fdee8150480 2024-09-10T08:32:27.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.042+0000 7fdeeccc0640 1 -- 172.21.15.103:0/390253939 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee8153580 con 0x7fdee8150480 2024-09-10T08:32:27.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.042+0000 7fdedf7fe640 1 -- 172.21.15.103:0/390253939 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0016810 con 0x7fdee8150480 2024-09-10T08:32:27.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.042+0000 7fdeeccc0640 1 -- 172.21.15.103:0/390253939 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee8153b40 con 0x7fdee8150480 2024-09-10T08:32:27.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.043+0000 7fdeeccc0640 1 --2- 172.21.15.103:0/390253939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee81ec280 0x7fdee81ecd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:27.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.043+0000 7fdeeccc0640 1 -- 172.21.15.103:0/390253939 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdee81f06f0 con 0x7fdee81ec280 2024-09-10T08:32:27.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.043+0000 7fdee659c640 1 --2- 172.21.15.103:0/390253939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee81ec280 0x7fdee81ecd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:27.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.043+0000 7fdee659c640 1 -- 172.21.15.103:0/390253939 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdee80c63d0 con 0x7fdee81ec280 2024-09-10T08:32:27.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.043+0000 7fdee659c640 1 --2- 172.21.15.103:0/390253939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee81ec280 0x7fdee81ecd50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdee80c6110 tx=0x7fded80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:27.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.043+0000 7fdedf7fe640 1 -- 172.21.15.103:0/390253939 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdee00153e0 con 0x7fdee8150480 2024-09-10T08:32:27.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.044+0000 7fdedf7fe640 1 --2- 172.21.15.103:0/390253939 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdec806bde0 0x7fdec806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:27.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.044+0000 7fdedf7fe640 1 -- 172.21.15.103:0/390253939 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fdee008b720 con 0x7fdee8150480 2024-09-10T08:32:27.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.044+0000 7fdeddd9b640 1 --2- 172.21.15.103:0/390253939 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdec806bde0 0x7fdec806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:27.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.044+0000 7fdedf7fe640 1 -- 172.21.15.103:0/390253939 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded8041030 con 0x7fdee81ec280 2024-09-10T08:32:27.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.044+0000 7fdedf7fe640 1 -- 172.21.15.103:0/390253939 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fded80093e0 con 0x7fdee81ec280 2024-09-10T08:32:27.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.044+0000 7fdedf7fe640 1 -- 172.21.15.103:0/390253939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee81ec280 msgr2=0x7fdee81ecd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:27.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.044+0000 7fdedf7fe640 1 --2- 172.21.15.103:0/390253939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee81ec280 0x7fdee81ecd50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdee80c6110 tx=0x7fded80046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.044+0000 7fdedf7fe640 1 -- 172.21.15.103:0/390253939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee81ec280 msgr2=0x7fdee81ecd50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:32:27.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.044+0000 7fdedf7fe640 1 --2- 172.21.15.103:0/390253939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee81ec280 0x7fdee81ecd50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.044+0000 7fdeddd9b640 1 --2- 172.21.15.103:0/390253939 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdec806bde0 0x7fdec806e2a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fded0007fd0 tx=0x7fded0007ac0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:27.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.050+0000 7fdeeccc0640 1 --2- 172.21.15.103:0/390253939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee8150d20 0x7fdee8151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:27.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.050+0000 7fdeeccc0640 1 -- 172.21.15.103:0/390253939 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdee80c67a0 con 0x7fdee8150d20 2024-09-10T08:32:27.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.050+0000 7fdee659c640 1 --2- 172.21.15.103:0/390253939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee8150d20 0x7fdee8151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:27.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.050+0000 7fdee659c640 1 -- 172.21.15.103:0/390253939 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdee80c7040 con 0x7fdee8150d20 2024-09-10T08:32:27.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.051+0000 7fdee659c640 1 --2- 172.21.15.103:0/390253939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee8150d20 0x7fdee8151130 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fded802a200 tx=0x7fded8008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:27.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.051+0000 7fdedf7fe640 1 -- 172.21.15.103:0/390253939 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded8041040 con 0x7fdee8150d20 2024-09-10T08:32:27.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.051+0000 7fdedf7fe640 1 -- 172.21.15.103:0/390253939 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7fded8003e50 con 0x7fdee8150d20 2024-09-10T08:32:27.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.051+0000 7fdedf7fe640 1 -- 172.21.15.103:0/390253939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee8150d20 msgr2=0x7fdee8151130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:27.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.051+0000 7fdedf7fe640 1 --2- 172.21.15.103:0/390253939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee8150d20 0x7fdee8151130 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fded802a200 tx=0x7fded8008030 comp rx=0 tx=0).stop 2024-09-10T08:32:27.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.051+0000 7fdedf7fe640 1 -- 172.21.15.103:0/390253939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee8150d20 msgr2=0x7fdee8151130 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:32:27.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.051+0000 7fdedf7fe640 1 --2- 172.21.15.103:0/390253939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee8150d20 0x7fdee8151130 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.052 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:32:27.052 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:32:27.053 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:32:27.053 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:32:27.053 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 26, 2024-09-10T08:32:27.053 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 39432, 2024-09-10T08:32:27.053 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:32:27.053 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:32:27.053 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:32:27.053 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:27.053 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:32:27.053 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:32:27.053 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:32:27.053 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:32:27.053 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:32:27.053 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:32:27.053 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:32:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:32:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:32:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:32:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:32:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:32:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:32:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:32:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:32:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:32:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:32:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:32:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:32:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:32:27.054 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:32:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:32:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:32:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:32:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:32:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:32:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:32:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:32:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:32:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:32:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:32:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:32:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:32:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:32:27.055 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:32:27.056 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:32:27.056 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:32:27.056 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:32:27.056 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:32:27.056 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:32:27.056 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:32:27.056 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:32:27.056 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:32:27.056 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:32:27.056 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:32:27.056 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:32:27.056 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:32:27.056 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:32:27.057 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:32:27.057 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:32:27.057 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:32:27.057 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:32:27.057 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:32:27.057 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:32:27.057 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:32:27.057 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:32:27.057 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:27.057 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:32:27.057 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.057 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:32:27.057 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.057 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:32:27.057 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:32:27.058 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:32:27.058 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:32:27.058 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.058 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:32:27.058 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:32:27.058 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:27.058 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.058 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.058 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:32:27.058 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:32:27.058 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:27.058 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:27.058 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:27.058 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.058 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:32:27.058 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:32:27.059 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:32:27.059 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:32:27.059 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:32:27.059 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.059 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.059 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:32:27.059 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:32:27.059 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:32:27.059 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:32:27.059 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.059 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:32:27.059 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:32:27.059 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:27.059 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.060 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.060 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:32:27.060 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:32:27.060 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:27.060 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:27.060 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:27.060 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.060 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:32:27.060 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:32:27.060 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:32:27.060 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:32:27.060 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:32:27.060 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.060 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.060 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:32:27.061 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:32:27.061 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:32:27.061 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:32:27.061 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.061 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:32:27.061 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:32:27.061 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:27.061 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.061 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.061 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:32:27.061 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:32:27.061 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:27.061 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:32:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:32:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:32:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:32:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:32:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:32:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:32:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:32:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:32:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:32:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:32:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:32:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:32:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:32:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:32:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:32:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:32:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:32:27.063 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:27.064 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:27.064 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.064 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:32:27.064 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:32:27.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.051+0000 7fdeeccc0640 1 -- 172.21.15.103:0/390253939 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdec806bde0 msgr2=0x7fdec806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:27.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.051+0000 7fdeeccc0640 1 --2- 172.21.15.103:0/390253939 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdec806bde0 0x7fdec806e2a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fded0007fd0 tx=0x7fded0007ac0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.051+0000 7fdeeccc0640 1 -- 172.21.15.103:0/390253939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee8150480 msgr2=0x7fdee81ec810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:27.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.051+0000 7fdeeccc0640 1 --2- 172.21.15.103:0/390253939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee8150480 0x7fdee81ec810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdee000be50 tx=0x7fdee000be80 comp rx=0 tx=0).stop 2024-09-10T08:32:27.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.051+0000 7fdee6d9d640 1 -- 172.21.15.103:0/390253939 reap_dead start 2024-09-10T08:32:27.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.051+0000 7fdee6d9d640 1 -- 172.21.15.103:0/390253939 reap_dead start 2024-09-10T08:32:27.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.051+0000 7fdeeccc0640 1 -- 172.21.15.103:0/390253939 shutdown_connections 2024-09-10T08:32:27.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.051+0000 7fdeeccc0640 1 -- 172.21.15.103:0/390253939 >> 172.21.15.103:0/390253939 conn(0x7fdee8068030 msgr2=0x7fdee8154c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:27.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.051+0000 7fdeeccc0640 1 -- 172.21.15.103:0/390253939 shutdown_connections 2024-09-10T08:32:27.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.051+0000 7fdeeccc0640 1 -- 172.21.15.103:0/390253939 wait complete. 2024-09-10T08:32:27.066 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:32:27.066 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-10T08:32:27.066 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:32:27.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.166+0000 7f7cdb842640 1 Processor -- start 2024-09-10T08:32:27.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.166+0000 7f7cdb842640 1 -- start start 2024-09-10T08:32:27.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.167+0000 7f7cdb842640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7cd4153b10 0x7f7cd40a9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:27.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.167+0000 7f7cdb842640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd40a7de0 0x7f7cd415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:27.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.167+0000 7f7cdb842640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd4156dd0 con 0x7f7cd4074590 2024-09-10T08:32:27.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.167+0000 7f7cdb842640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f7cd4157350 con 0x7f7cd4153b10 2024-09-10T08:32:27.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.167+0000 7f7cdb842640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd4159e50 con 0x7f7cd40a7de0 2024-09-10T08:32:27.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.167+0000 7f7cd9ddf640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f7cd4074590 legacy=0x7f7cd406cf40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:32:27.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.167+0000 7f7cd95de640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7f7cd4153b10 msgr2=0x7f7cd40a9700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:32:27.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.167+0000 7f7cd95de640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7cd4153b10 0x7f7cd40a9700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:32:27.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.167+0000 7f7cd8ddd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd40a7de0 0x7f7cd415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:27.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.167+0000 7f7cd8ddd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd40a7de0 0x7f7cd415a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:35796/0 (socket says 172.21.15.103:35796) 2024-09-10T08:32:27.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.167+0000 7f7cd8ddd640 1 -- 172.21.15.103:0/3462018417 learned_addr learned my addr 172.21.15.103:0/3462018417 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:32:27.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.167+0000 7f7cd8ddd640 1 -- 172.21.15.103:0/3462018417 >> v2:172.21.15.154:3300/0 conn(0x7f7cd4153b10 msgr2=0x7f7cd40a9700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:32:27.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.167+0000 7f7cd8ddd640 1 --2- 172.21.15.103:0/3462018417 >> v2:172.21.15.154:3300/0 conn(0x7f7cd4153b10 0x7f7cd40a9700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.167+0000 7f7cd8ddd640 1 -- 172.21.15.103:0/3462018417 >> v1:172.21.15.154:6789/0 conn(0x7f7cd4074590 legacy=0x7f7cd406cf40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:32:27.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.167+0000 7f7cd8ddd640 1 -- 172.21.15.103:0/3462018417 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd4157070 con 0x7f7cd40a7de0 2024-09-10T08:32:27.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.168+0000 7f7cd8ddd640 1 --2- 172.21.15.103:0/3462018417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd40a7de0 0x7f7cd415a2e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40098a0 tx=0x7f7cc402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d31811d4d6188f97 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:27.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.168+0000 7f7ccbfff640 1 -- 172.21.15.103:0/3462018417 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4037070 con 0x7f7cd40a7de0 2024-09-10T08:32:27.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.168+0000 7f7ccbfff640 1 -- 172.21.15.103:0/3462018417 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cc4032440 con 0x7f7cd40a7de0 2024-09-10T08:32:27.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.168+0000 7f7ccbfff640 1 -- 172.21.15.103:0/3462018417 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4032810 con 0x7f7cd40a7de0 2024-09-10T08:32:27.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.169+0000 7f7cdb842640 1 -- 172.21.15.103:0/3462018417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd40a7de0 msgr2=0x7f7cd415a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:27.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.169+0000 7f7cdb842640 1 --2- 172.21.15.103:0/3462018417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd40a7de0 0x7f7cd415a2e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40098a0 tx=0x7f7cc402a1c0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.169+0000 7f7cdb842640 1 -- 172.21.15.103:0/3462018417 shutdown_connections 2024-09-10T08:32:27.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.169+0000 7f7cdb842640 1 --2- 172.21.15.103:0/3462018417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd40a7de0 0x7f7cd415a2e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.169+0000 7f7cdb842640 1 --2- 172.21.15.103:0/3462018417 >> v2:172.21.15.154:3300/0 conn(0x7f7cd4153b10 0x7f7cd40a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.169+0000 7f7cdb842640 1 -- 172.21.15.103:0/3462018417 >> 172.21.15.103:0/3462018417 conn(0x7f7cd40c4fa0 msgr2=0x7f7cd40c5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:27.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.169+0000 7f7cdb842640 1 -- 172.21.15.103:0/3462018417 shutdown_connections 2024-09-10T08:32:27.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.169+0000 7f7cdb842640 1 -- 172.21.15.103:0/3462018417 wait complete. 2024-09-10T08:32:27.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.170+0000 7f7cdb842640 1 Processor -- start 2024-09-10T08:32:27.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.170+0000 7f7cdb842640 1 -- start start 2024-09-10T08:32:27.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.171+0000 7f7cdb842640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd4074590 0x7f7cd414cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:27.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.171+0000 7f7cdb842640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd40a7de0 0x7f7cd40c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:27.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.171+0000 7f7cdb842640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cd4153b10 0x7f7cd40c4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:27.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.171+0000 7f7cdb842640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd415a820 con 0x7f7cd4153b10 2024-09-10T08:32:27.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.171+0000 7f7cdb842640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd40a9c40 con 0x7f7cd4074590 2024-09-10T08:32:27.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.171+0000 7f7cdb842640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd4153ef0 con 0x7f7cd40a7de0 2024-09-10T08:32:27.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.171+0000 7f7cd95de640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd4074590 msgr2=0x7f7cd414cda0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:32:27.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.171+0000 7f7cd95de640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd4074590 0x7f7cd414cda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:32:27.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.171+0000 7f7cd9ddf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cd4153b10 0x7f7cd40c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:27.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.171+0000 7f7cd9ddf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cd4153b10 0x7f7cd40c4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40214/0 (socket says 172.21.15.103:40214) 2024-09-10T08:32:27.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.171+0000 7f7cd9ddf640 1 -- 172.21.15.103:0/286016140 learned_addr learned my addr 172.21.15.103:0/286016140 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:32:27.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.171+0000 7f7cd8ddd640 1 --2- 172.21.15.103:0/286016140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd40a7de0 0x7f7cd40c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:27.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.171+0000 7f7cd9ddf640 1 -- 172.21.15.103:0/286016140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd40a7de0 msgr2=0x7f7cd40c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:27.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.171+0000 7f7cd9ddf640 1 --2- 172.21.15.103:0/286016140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd40a7de0 0x7f7cd40c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.171+0000 7f7cd9ddf640 1 -- 172.21.15.103:0/286016140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd4074590 msgr2=0x7f7cd414cda0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:32:27.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.171+0000 7f7cd9ddf640 1 --2- 172.21.15.103:0/286016140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cd4074590 0x7f7cd414cda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.171+0000 7f7cd9ddf640 1 -- 172.21.15.103:0/286016140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd40c7820 con 0x7f7cd4153b10 2024-09-10T08:32:27.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.171+0000 7f7cd9ddf640 1 --2- 172.21.15.103:0/286016140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cd4153b10 0x7f7cd40c4550 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00b9c0 tx=0x7f7ccc00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:27.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.172+0000 7f7cc9ffb640 1 -- 172.21.15.103:0/286016140 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc00cb20 con 0x7f7cd4153b10 2024-09-10T08:32:27.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.172+0000 7f7cc9ffb640 1 -- 172.21.15.103:0/286016140 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ccc010070 con 0x7f7cd4153b10 2024-09-10T08:32:27.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.172+0000 7f7cdb842640 1 -- 172.21.15.103:0/286016140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd40c6f10 con 0x7f7cd4153b10 2024-09-10T08:32:27.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.172+0000 7f7cc9ffb640 1 -- 172.21.15.103:0/286016140 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc015470 con 0x7f7cd4153b10 2024-09-10T08:32:27.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.172+0000 7f7cdb842640 1 -- 172.21.15.103:0/286016140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cd40c71d0 con 0x7f7cd4153b10 2024-09-10T08:32:27.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.173+0000 7f7cdb842640 1 --2- 172.21.15.103:0/286016140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd4158100 0x7f7cd414aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:27.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.173+0000 7f7cdb842640 1 -- 172.21.15.103:0/286016140 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd406db80 con 0x7f7cd4158100 2024-09-10T08:32:27.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.173+0000 7f7cd95de640 1 --2- 172.21.15.103:0/286016140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd4158100 0x7f7cd414aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:27.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.173+0000 7f7cc9ffb640 1 -- 172.21.15.103:0/286016140 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ccc01e3f0 con 0x7f7cd4153b10 2024-09-10T08:32:27.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.173+0000 7f7cd95de640 1 -- 172.21.15.103:0/286016140 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7cd40ae830 con 0x7f7cd4158100 2024-09-10T08:32:27.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.173+0000 7f7cd95de640 1 --2- 172.21.15.103:0/286016140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd4158100 0x7f7cd414aa30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7cd000b450 tx=0x7f7cd000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:27.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.173+0000 7f7cc9ffb640 1 --2- 172.21.15.103:0/286016140 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7cb806bde0 0x7f7cb806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:27.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.174+0000 7f7cc9ffb640 1 -- 172.21.15.103:0/286016140 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f7ccc08b370 con 0x7f7cd4153b10 2024-09-10T08:32:27.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.174+0000 7f7cd8ddd640 1 --2- 172.21.15.103:0/286016140 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7cb806bde0 0x7f7cb806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:27.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.174+0000 7f7cc9ffb640 1 -- 172.21.15.103:0/286016140 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0003d40 con 0x7f7cd4158100 2024-09-10T08:32:27.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.174+0000 7f7cc9ffb640 1 -- 172.21.15.103:0/286016140 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7cd0015070 con 0x7f7cd4158100 2024-09-10T08:32:27.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.174+0000 7f7cc9ffb640 1 -- 172.21.15.103:0/286016140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd4158100 msgr2=0x7f7cd414aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:27.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.174+0000 7f7cc9ffb640 1 --2- 172.21.15.103:0/286016140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd4158100 0x7f7cd414aa30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7cd000b450 tx=0x7f7cd000b910 comp rx=0 tx=0).stop 2024-09-10T08:32:27.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.174+0000 7f7cc9ffb640 1 -- 172.21.15.103:0/286016140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd4158100 msgr2=0x7f7cd414aa30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:32:27.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.174+0000 7f7cc9ffb640 1 --2- 172.21.15.103:0/286016140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd4158100 0x7f7cd414aa30 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7cd000b450 tx=0x7f7cd000b910 comp rx=0 tx=0).stop 2024-09-10T08:32:27.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.174+0000 7f7cd8ddd640 1 --2- 172.21.15.103:0/286016140 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7cb806bde0 0x7f7cb806e2a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4034000 tx=0x7f7cc402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:27.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.180+0000 7f7cdb842640 1 --2- 172.21.15.103:0/286016140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd4157a00 0x7f7cd414af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:27.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.180+0000 7f7cdb842640 1 -- 172.21.15.103:0/286016140 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd414b4b0 con 0x7f7cd4157a00 2024-09-10T08:32:27.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.180+0000 7f7cd95de640 1 --2- 172.21.15.103:0/286016140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd4157a00 0x7f7cd414af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:27.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.181+0000 7f7cd95de640 1 -- 172.21.15.103:0/286016140 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7cd40aae70 con 0x7f7cd4157a00 2024-09-10T08:32:27.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.181+0000 7f7cd95de640 1 --2- 172.21.15.103:0/286016140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd4157a00 0x7f7cd414af70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0000c00 tx=0x7f7cd0005990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:27.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.181+0000 7f7cc9ffb640 1 -- 172.21.15.103:0/286016140 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd001ae00 con 0x7f7cd4157a00 2024-09-10T08:32:27.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.181+0000 7f7cc9ffb640 1 -- 172.21.15.103:0/286016140 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5042 (secure 0 0 0) 0x7f7cd0010400 con 0x7f7cd4157a00 2024-09-10T08:32:27.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.181+0000 7f7cc9ffb640 1 -- 172.21.15.103:0/286016140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd4157a00 msgr2=0x7f7cd414af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:27.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.181+0000 7f7cc9ffb640 1 --2- 172.21.15.103:0/286016140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd4157a00 0x7f7cd414af70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0000c00 tx=0x7f7cd0005990 comp rx=0 tx=0).stop 2024-09-10T08:32:27.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.181+0000 7f7cc9ffb640 1 -- 172.21.15.103:0/286016140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd4157a00 msgr2=0x7f7cd414af70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:32:27.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.181+0000 7f7cc9ffb640 1 --2- 172.21.15.103:0/286016140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cd4157a00 0x7f7cd414af70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.184 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:32:27.184 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:32:27.184 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:32:27.185 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:32:27.185 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 26, 2024-09-10T08:32:27.185 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 91341, 2024-09-10T08:32:27.185 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:32:27.185 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:32:27.185 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:32:27.186 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:27.186 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:32:27.186 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:32:27.186 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:32:27.186 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:32:27.187 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:32:27.187 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:32:27.187 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:32:27.187 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:32:27.187 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:32:27.188 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:32:27.188 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:32:27.188 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:32:27.188 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:32:27.188 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:32:27.188 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:32:27.189 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:27.189 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:32:27.189 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:32:27.189 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:32:27.189 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:32:27.189 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:32:27.189 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:32:27.189 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:32:27.190 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:32:27.190 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:32:27.190 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:32:27.190 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:32:27.190 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:32:27.190 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:32:27.190 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:27.191 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.191 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:32:27.191 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:32:27.191 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:32:27.191 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:32:27.191 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:32:27.191 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:32:27.191 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:32:27.192 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:32:27.192 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:32:27.192 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:32:27.192 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:32:27.192 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:32:27.192 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:32:27.193 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:32:27.193 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:32:27.193 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:32:27.193 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:32:27.193 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:32:27.193 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:32:27.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:32:27.194 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:32:27.194 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:32:27.194 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:32:27.194 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:32:27.194 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:32:27.194 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:32:27.194 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:32:27.194 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:32:27.194 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:27.194 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:32:27.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.194 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:32:27.195 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.195 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:32:27.195 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:32:27.195 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:32:27.195 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:32:27.195 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.195 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:32:27.195 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:32:27.195 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:27.195 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.195 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.195 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:32:27.195 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:32:27.196 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:27.196 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:27.196 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:27.196 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.196 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:32:27.196 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:32:27.196 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:32:27.196 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:32:27.196 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:32:27.196 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.196 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.196 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:32:27.196 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:32:27.197 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:32:27.197 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:32:27.197 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.197 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:32:27.197 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:32:27.197 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:27.197 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.197 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.197 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:32:27.197 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:32:27.197 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:27.198 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:27.198 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:27.198 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.198 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:32:27.198 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:32:27.198 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:32:27.198 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:32:27.198 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:32:27.198 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.198 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.198 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:32:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:32:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:32:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:32:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:32:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:32:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:32:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:32:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:32:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:27.199 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:27.200 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.200 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:32:27.200 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:32:27.200 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:32:27.200 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:32:27.200 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:32:27.200 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:27.200 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:27.200 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.200 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:32:27.200 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:32:27.200 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.201 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:32:27.201 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:32:27.201 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:32:27.201 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:27.201 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:27.201 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:32:27.201 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.201 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:32:27.201 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:32:27.201 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:32:27.201 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:27.201 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:27.201 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:32:27.201 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.202 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:32:27.202 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:32:27.202 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 8 2024-09-10T08:32:27.202 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:27.202 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:27.202 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:32:27.202 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.202 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:32:27.202 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:32:27.203 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:32:27.203 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:27.203 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:32:27.203 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:32:27.203 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:32:27.203 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:32:27.203 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:32:27.203 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:32:27.203 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:32:27.203 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:32:27.203 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:32:27.203 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:32:27.203 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:32:27.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.182+0000 7f7cdb842640 1 -- 172.21.15.103:0/286016140 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7cb806bde0 msgr2=0x7f7cb806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:27.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.182+0000 7f7cdb842640 1 --2- 172.21.15.103:0/286016140 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7cb806bde0 0x7f7cb806e2a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4034000 tx=0x7f7cc402e000 comp rx=0 tx=0).stop 2024-09-10T08:32:27.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.182+0000 7f7cdb842640 1 -- 172.21.15.103:0/286016140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cd4153b10 msgr2=0x7f7cd40c4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:27.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.182+0000 7f7cdb842640 1 --2- 172.21.15.103:0/286016140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cd4153b10 0x7f7cd40c4550 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00b9c0 tx=0x7f7ccc00be80 comp rx=0 tx=0).stop 2024-09-10T08:32:27.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.182+0000 7f7cd9ddf640 1 -- 172.21.15.103:0/286016140 reap_dead start 2024-09-10T08:32:27.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.182+0000 7f7cdb842640 1 -- 172.21.15.103:0/286016140 shutdown_connections 2024-09-10T08:32:27.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.182+0000 7f7cdb842640 1 --2- 172.21.15.103:0/286016140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cd4153b10 0x7f7cd40c4550 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.182+0000 7f7cdb842640 1 -- 172.21.15.103:0/286016140 >> 172.21.15.103:0/286016140 conn(0x7f7cd40c4fa0 msgr2=0x7f7cd406cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:27.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.182+0000 7f7cdb842640 1 -- 172.21.15.103:0/286016140 shutdown_connections 2024-09-10T08:32:27.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:32:27.182+0000 7f7cdb842640 1 -- 172.21.15.103:0/286016140 wait complete. 2024-09-10T08:32:27.207 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:32:27.207 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-10T08:32:29.708 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:32:29.711 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:32:47.207 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-10T08:32:47.208 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-10T08:32:47.208 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T08:32:47.208 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T08:32:47.211 INFO:tasks.ceph.mon.b:Started 2024-09-10T08:32:47.211 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-09-10T08:32:47.211 INFO:tasks.ceph.mon.a:Sent signal 19 2024-09-10T08:32:47.211 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-10T08:32:59.832 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:32:59.834 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:33:02.213 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-09-10T08:33:02.213 INFO:tasks.ceph.mon.a:Sent signal 18 2024-09-10T08:33:02.213 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:33:02.213 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:33:02.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.322+0000 7fb94b99f640 1 Processor -- start 2024-09-10T08:33:02.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.322+0000 7fb94b99f640 1 -- start start 2024-09-10T08:33:02.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.323+0000 7fb94b99f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb9440c8b10 0x7fb94415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.323+0000 7fb94b99f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb94406cd80 0x7fb9441534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.323+0000 7fb94b99f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9440c7070 con 0x7fb944153a10 2024-09-10T08:33:02.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.323+0000 7fb94b99f640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fb94406d210 con 0x7fb9440c8b10 2024-09-10T08:33:02.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.323+0000 7fb94b99f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb9440c69b0 con 0x7fb94406cd80 2024-09-10T08:33:02.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.323+0000 7fb94973b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb9440c8b10 0x7fb94415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.323+0000 7fb94973b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb9440c8b10 0x7fb94415a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43666/0 (socket says 172.21.15.103:43666) 2024-09-10T08:33:02.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.323+0000 7fb94973b640 1 -- 172.21.15.103:0/1797695438 learned_addr learned my addr 172.21.15.103:0/1797695438 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:02.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.324+0000 7fb948f3a640 1 --2- 172.21.15.103:0/1797695438 >> v2:172.21.15.154:3300/0 conn(0x7fb94406cd80 0x7fb9441534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.324+0000 7fb94973b640 1 -- 172.21.15.103:0/1797695438 >> v2:172.21.15.154:3300/0 conn(0x7fb94406cd80 msgr2=0x7fb9441534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:02.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.324+0000 7fb94973b640 1 --2- 172.21.15.103:0/1797695438 >> v2:172.21.15.154:3300/0 conn(0x7fb94406cd80 0x7fb9441534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.324+0000 7fb94973b640 1 -- 172.21.15.103:0/1797695438 >> v1:172.21.15.154:6789/0 conn(0x7fb944153a10 legacy=0x7fb944156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:02.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.324+0000 7fb94973b640 1 -- 172.21.15.103:0/1797695438 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9440c6c90 con 0x7fb9440c8b10 2024-09-10T08:33:02.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.324+0000 7fb94973b640 1 --2- 172.21.15.103:0/1797695438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9440c8b10 0x7fb94415a4a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb94406ec00 tx=0x7fb94002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fbcbc4720fc5c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:02.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.325+0000 7fb93bfff640 1 -- 172.21.15.103:0/1797695438 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb940037070 con 0x7fb9440c8b10 2024-09-10T08:33:02.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.325+0000 7fb93bfff640 1 -- 172.21.15.103:0/1797695438 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb940032440 con 0x7fb9440c8b10 2024-09-10T08:33:02.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.325+0000 7fb93bfff640 1 -- 172.21.15.103:0/1797695438 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb940032810 con 0x7fb9440c8b10 2024-09-10T08:33:02.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.325+0000 7fb94b99f640 1 -- 172.21.15.103:0/1797695438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9440c8b10 msgr2=0x7fb94415a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.325+0000 7fb94b99f640 1 --2- 172.21.15.103:0/1797695438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9440c8b10 0x7fb94415a4a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb94406ec00 tx=0x7fb94002a1a0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.325+0000 7fb94b99f640 1 -- 172.21.15.103:0/1797695438 shutdown_connections 2024-09-10T08:33:02.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.325+0000 7fb94b99f640 1 --2- 172.21.15.103:0/1797695438 >> v2:172.21.15.154:3300/0 conn(0x7fb94406cd80 0x7fb9441534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.325+0000 7fb94b99f640 1 --2- 172.21.15.103:0/1797695438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9440c8b10 0x7fb94415a4a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.325+0000 7fb94b99f640 1 -- 172.21.15.103:0/1797695438 >> 172.21.15.103:0/1797695438 conn(0x7fb9440adb80 msgr2=0x7fb9440adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:02.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.325+0000 7fb94b99f640 1 -- 172.21.15.103:0/1797695438 shutdown_connections 2024-09-10T08:33:02.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.325+0000 7fb94b99f640 1 -- 172.21.15.103:0/1797695438 wait complete. 2024-09-10T08:33:02.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.327+0000 7fb94b99f640 1 Processor -- start 2024-09-10T08:33:02.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.327+0000 7fb94b99f640 1 -- start start 2024-09-10T08:33:02.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.327+0000 7fb94b99f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9440c8b10 0x7fb9441593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.327+0000 7fb94b99f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb944153a10 0x7fb944151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.327+0000 7fb94b99f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9441ed750 0x7fb9441edc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.327+0000 7fb94b99f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb944154020 con 0x7fb9441ed750 2024-09-10T08:33:02.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.327+0000 7fb94b99f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb944153ea0 con 0x7fb944153a10 2024-09-10T08:33:02.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.327+0000 7fb94b99f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb9440c8ef0 con 0x7fb9440c8b10 2024-09-10T08:33:02.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.327+0000 7fb949f3c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9441ed750 0x7fb9441edc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.328+0000 7fb949f3c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9441ed750 0x7fb9441edc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43676/0 (socket says 172.21.15.103:43676) 2024-09-10T08:33:02.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.328+0000 7fb949f3c640 1 -- 172.21.15.103:0/32461598 learned_addr learned my addr 172.21.15.103:0/32461598 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:02.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.328+0000 7fb94973b640 1 --2- 172.21.15.103:0/32461598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9440c8b10 0x7fb9441593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.328+0000 7fb948f3a640 1 --2- 172.21.15.103:0/32461598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb944153a10 0x7fb944151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.328+0000 7fb949f3c640 1 -- 172.21.15.103:0/32461598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9440c8b10 msgr2=0x7fb9441593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.328+0000 7fb949f3c640 1 --2- 172.21.15.103:0/32461598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9440c8b10 0x7fb9441593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.328+0000 7fb949f3c640 1 -- 172.21.15.103:0/32461598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb944153a10 msgr2=0x7fb944151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.328+0000 7fb949f3c640 1 --2- 172.21.15.103:0/32461598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb944153a10 0x7fb944151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.328+0000 7fb949f3c640 1 -- 172.21.15.103:0/32461598 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9441580d0 con 0x7fb9441ed750 2024-09-10T08:33:02.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.328+0000 7fb94973b640 1 --2- 172.21.15.103:0/32461598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9440c8b10 0x7fb9441593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:02.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.328+0000 7fb949f3c640 1 --2- 172.21.15.103:0/32461598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9441ed750 0x7fb9441edc00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00b970 tx=0x7fb93c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:02.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.328+0000 7fb939ffb640 1 -- 172.21.15.103:0/32461598 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c019070 con 0x7fb9441ed750 2024-09-10T08:33:02.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.328+0000 7fb939ffb640 1 -- 172.21.15.103:0/32461598 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb93c00cb40 con 0x7fb9441ed750 2024-09-10T08:33:02.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.328+0000 7fb94b99f640 1 -- 172.21.15.103:0/32461598 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9441583b0 con 0x7fb9441ed750 2024-09-10T08:33:02.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.328+0000 7fb939ffb640 1 -- 172.21.15.103:0/32461598 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c014440 con 0x7fb9441ed750 2024-09-10T08:33:02.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.329+0000 7fb94b99f640 1 -- 172.21.15.103:0/32461598 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9441521f0 con 0x7fb9441ed750 2024-09-10T08:33:02.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.330+0000 7fb94b99f640 1 -- 172.21.15.103:0/32461598 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9441534d0 con 0x7fb9441ed750 2024-09-10T08:33:02.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.330+0000 7fb939ffb640 1 -- 172.21.15.103:0/32461598 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb93c01c070 con 0x7fb9441ed750 2024-09-10T08:33:02.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.331+0000 7fb939ffb640 1 --2- 172.21.15.103:0/32461598 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb92806be30 0x7fb92806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.331+0000 7fb939ffb640 1 -- 172.21.15.103:0/32461598 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fb93c08add0 con 0x7fb9441ed750 2024-09-10T08:33:02.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.331+0000 7fb94973b640 1 --2- 172.21.15.103:0/32461598 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb92806be30 0x7fb92806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.332+0000 7fb94973b640 1 --2- 172.21.15.103:0/32461598 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb92806be30 0x7fb92806e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb940034000 tx=0x7fb94002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:02.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.338+0000 7fb939ffb640 1 -- 172.21.15.103:0/32461598 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb93c059470 con 0x7fb9441ed750 2024-09-10T08:33:02.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.645+0000 7fb94b99f640 1 -- 172.21.15.103:0/32461598 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb9440c9d90 con 0x7fb9441ed750 2024-09-10T08:33:02.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.645+0000 7fb939ffb640 1 -- 172.21.15.103:0/32461598 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7fb93c058d70 con 0x7fb9441ed750 2024-09-10T08:33:02.646 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:33:02.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.647+0000 7fb94b99f640 1 -- 172.21.15.103:0/32461598 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb92806be30 msgr2=0x7fb92806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.647+0000 7fb94b99f640 1 --2- 172.21.15.103:0/32461598 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb92806be30 0x7fb92806e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb940034000 tx=0x7fb94002e000 comp rx=0 tx=0).stop 2024-09-10T08:33:02.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.647+0000 7fb94b99f640 1 -- 172.21.15.103:0/32461598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9441ed750 msgr2=0x7fb9441edc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.647+0000 7fb94b99f640 1 --2- 172.21.15.103:0/32461598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9441ed750 0x7fb9441edc00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00b970 tx=0x7fb93c00be30 comp rx=0 tx=0).stop 2024-09-10T08:33:02.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.647+0000 7fb94b99f640 1 -- 172.21.15.103:0/32461598 shutdown_connections 2024-09-10T08:33:02.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.647+0000 7fb94b99f640 1 --2- 172.21.15.103:0/32461598 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb92806be30 0x7fb92806e2f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.647+0000 7fb94b99f640 1 --2- 172.21.15.103:0/32461598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9441ed750 0x7fb9441edc00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.647+0000 7fb94b99f640 1 --2- 172.21.15.103:0/32461598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb944153a10 0x7fb944151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.647+0000 7fb94b99f640 1 --2- 172.21.15.103:0/32461598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9440c8b10 0x7fb9441593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.647+0000 7fb94b99f640 1 -- 172.21.15.103:0/32461598 >> 172.21.15.103:0/32461598 conn(0x7fb9440adb80 msgr2=0x7fb94406bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:02.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.648+0000 7fb94b99f640 1 -- 172.21.15.103:0/32461598 shutdown_connections 2024-09-10T08:33:02.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.648+0000 7fb94b99f640 1 -- 172.21.15.103:0/32461598 wait complete. 2024-09-10T08:33:02.659 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:33:02.659 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:33:02.659 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:33:02.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.773+0000 7f3f5c131640 1 Processor -- start 2024-09-10T08:33:02.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.773+0000 7f3f5c131640 1 -- start start 2024-09-10T08:33:02.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.774+0000 7f3f5c131640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3f54150480 0x7f3f540c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.774+0000 7f3f5c131640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f540ca390 0x7f3f540c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.774+0000 7f3f5c131640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f5415a7c0 con 0x7f3f5406c650 2024-09-10T08:33:02.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.774+0000 7f3f5c131640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3f5406c240 con 0x7f3f54150480 2024-09-10T08:33:02.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.774+0000 7f3f5c131640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3f5415a330 con 0x7f3f540ca390 2024-09-10T08:33:02.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.774+0000 7f3f596cc640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3f5406c650 0x7f3f540c9c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46662/0 (socket says 172.21.15.103:46662) 2024-09-10T08:33:02.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.774+0000 7f3f596cc640 1 -- 172.21.15.103:0/358615153 learned_addr learned my addr 172.21.15.103:0/358615153 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:33:02.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.774+0000 7f3f5a6ce640 1 --2- 172.21.15.103:0/358615153 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f540ca390 0x7f3f540c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.774+0000 7f3f59ecd640 1 --2- 172.21.15.103:0/358615153 >> v2:172.21.15.154:3300/0 conn(0x7f3f54150480 0x7f3f540c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.775+0000 7f3f58ecb640 1 -- 172.21.15.103:0/358615153 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2391874736 0 0) 0x7f3f5415a7c0 con 0x7f3f5406c650 2024-09-10T08:33:02.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.775+0000 7f3f58ecb640 1 -- 172.21.15.103:0/358615153 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f40003520 con 0x7f3f5406c650 2024-09-10T08:33:02.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.775+0000 7f3f58ecb640 1 -- 172.21.15.103:0/358615153 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2867430889 0 0) 0x7f3f40003520 con 0x7f3f5406c650 2024-09-10T08:33:02.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.775+0000 7f3f5a6ce640 1 -- 172.21.15.103:0/358615153 >> v2:172.21.15.154:3300/0 conn(0x7f3f54150480 msgr2=0x7f3f540c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:02.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.775+0000 7f3f5a6ce640 1 --2- 172.21.15.103:0/358615153 >> v2:172.21.15.154:3300/0 conn(0x7f3f54150480 0x7f3f540c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.775+0000 7f3f5a6ce640 1 -- 172.21.15.103:0/358615153 >> v1:172.21.15.103:6789/0 conn(0x7f3f5406c650 legacy=0x7f3f540c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.775+0000 7f3f5a6ce640 1 -- 172.21.15.103:0/358615153 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f54159a00 con 0x7f3f540ca390 2024-09-10T08:33:02.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.775+0000 7f3f59ecd640 1 --2- 172.21.15.103:0/358615153 >> v2:172.21.15.154:3300/0 conn(0x7f3f54150480 0x7f3f540c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:33:02.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.776+0000 7f3f5a6ce640 1 --2- 172.21.15.103:0/358615153 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f540ca390 0x7f3f540c7fd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c009d90 tx=0x7f3f4c02a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f60e51fd741c3a4e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:02.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.776+0000 7f3f58ecb640 1 -- 172.21.15.103:0/358615153 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f44001670 con 0x7f3f540ca390 2024-09-10T08:33:02.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.776+0000 7f3f58ecb640 1 -- 172.21.15.103:0/358615153 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f4c007540 con 0x7f3f540ca390 2024-09-10T08:33:02.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.776+0000 7f3f58ecb640 1 -- 172.21.15.103:0/358615153 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c007910 con 0x7f3f540ca390 2024-09-10T08:33:02.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.777+0000 7f3f5c131640 1 -- 172.21.15.103:0/358615153 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f540ca390 msgr2=0x7f3f540c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.777+0000 7f3f5c131640 1 --2- 172.21.15.103:0/358615153 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f540ca390 0x7f3f540c7fd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c009d90 tx=0x7f3f4c02a5f0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.777+0000 7f3f5c131640 1 -- 172.21.15.103:0/358615153 shutdown_connections 2024-09-10T08:33:02.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.777+0000 7f3f5c131640 1 --2- 172.21.15.103:0/358615153 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f540ca390 0x7f3f540c7fd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.777+0000 7f3f5c131640 1 --2- 172.21.15.103:0/358615153 >> v2:172.21.15.154:3300/0 conn(0x7f3f54150480 0x7f3f540c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.777+0000 7f3f5c131640 1 -- 172.21.15.103:0/358615153 >> 172.21.15.103:0/358615153 conn(0x7f3f54068030 msgr2=0x7f3f54073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:02.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.777+0000 7f3f5c131640 1 -- 172.21.15.103:0/358615153 shutdown_connections 2024-09-10T08:33:02.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.777+0000 7f3f5c131640 1 -- 172.21.15.103:0/358615153 wait complete. 2024-09-10T08:33:02.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.778+0000 7f3f5c131640 1 Processor -- start 2024-09-10T08:33:02.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.778+0000 7f3f5c131640 1 -- start start 2024-09-10T08:33:02.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.779+0000 7f3f5c131640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f5406c650 0x7f3f54157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.779+0000 7f3f5c131640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f540ca390 0x7f3f54158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.779+0000 7f3f5c131640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f54150480 0x7f3f541e03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.779+0000 7f3f5c131640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5406d270 con 0x7f3f5406c650 2024-09-10T08:33:02.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.779+0000 7f3f5c131640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3f54159fc0 con 0x7f3f540ca390 2024-09-10T08:33:02.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.779+0000 7f3f5c131640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3f54156270 con 0x7f3f54150480 2024-09-10T08:33:02.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.779+0000 7f3f59ecd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f5406c650 0x7f3f54157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.779+0000 7f3f59ecd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f5406c650 0x7f3f54157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43692/0 (socket says 172.21.15.103:43692) 2024-09-10T08:33:02.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.779+0000 7f3f59ecd640 1 -- 172.21.15.103:0/3587442128 learned_addr learned my addr 172.21.15.103:0/3587442128 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:02.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.779+0000 7f3f596cc640 1 --2- 172.21.15.103:0/3587442128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f540ca390 0x7f3f54158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.779+0000 7f3f5a6ce640 1 --2- 172.21.15.103:0/3587442128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f54150480 0x7f3f541e03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.779+0000 7f3f59ecd640 1 -- 172.21.15.103:0/3587442128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f54150480 msgr2=0x7f3f541e03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.779+0000 7f3f59ecd640 1 --2- 172.21.15.103:0/3587442128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f54150480 0x7f3f541e03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.779+0000 7f3f59ecd640 1 -- 172.21.15.103:0/3587442128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f540ca390 msgr2=0x7f3f54158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.779+0000 7f3f59ecd640 1 --2- 172.21.15.103:0/3587442128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f540ca390 0x7f3f54158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.779+0000 7f3f59ecd640 1 -- 172.21.15.103:0/3587442128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f541df970 con 0x7f3f5406c650 2024-09-10T08:33:02.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.779+0000 7f3f59ecd640 1 --2- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f5406c650 0x7f3f54157f10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3f5000ec10 tx=0x7f3f5000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:02.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.779+0000 7f3f4a7fc640 1 -- 172.21.15.103:0/3587442128 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f50017070 con 0x7f3f5406c650 2024-09-10T08:33:02.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.780+0000 7f3f4a7fc640 1 -- 172.21.15.103:0/3587442128 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f5000cc30 con 0x7f3f5406c650 2024-09-10T08:33:02.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.780+0000 7f3f5c131640 1 -- 172.21.15.103:0/3587442128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f541ece30 con 0x7f3f5406c650 2024-09-10T08:33:02.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.780+0000 7f3f4a7fc640 1 -- 172.21.15.103:0/3587442128 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f50013470 con 0x7f3f5406c650 2024-09-10T08:33:02.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.780+0000 7f3f5c131640 1 -- 172.21.15.103:0/3587442128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f5414e6e0 con 0x7f3f5406c650 2024-09-10T08:33:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.781+0000 7f3f5c131640 1 --2- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f541e08f0 0x7f3f541494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.781+0000 7f3f5c131640 1 -- 172.21.15.103:0/3587442128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3f540c9c80 con 0x7f3f541e08f0 2024-09-10T08:33:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.781+0000 7f3f596cc640 1 --2- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f541e08f0 0x7f3f541494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.781+0000 7f3f596cc640 1 -- 172.21.15.103:0/3587442128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f5406c430 con 0x7f3f541e08f0 2024-09-10T08:33:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.781+0000 7f3f4a7fc640 1 -- 172.21.15.103:0/3587442128 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f5001a070 con 0x7f3f5406c650 2024-09-10T08:33:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.781+0000 7f3f596cc640 1 --2- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f541e08f0 0x7f3f541494f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3f541556c0 tx=0x7f3f4400fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.782+0000 7f3f4a7fc640 1 --2- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3f3806be30 0x7f3f3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.782+0000 7f3f4a7fc640 1 -- 172.21.15.103:0/3587442128 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f3f5008b170 con 0x7f3f5406c650 2024-09-10T08:33:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.782+0000 7f3f5a6ce640 1 --2- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3f3806be30 0x7f3f3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.782+0000 7f3f4a7fc640 1 -- 172.21.15.103:0/3587442128 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f44017020 con 0x7f3f541e08f0 2024-09-10T08:33:02.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.782+0000 7f3f4a7fc640 1 -- 172.21.15.103:0/3587442128 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3f4400d770 con 0x7f3f541e08f0 2024-09-10T08:33:02.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.782+0000 7f3f4a7fc640 1 -- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f541e08f0 msgr2=0x7f3f541494f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.782+0000 7f3f4a7fc640 1 --2- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f541e08f0 0x7f3f541494f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3f541556c0 tx=0x7f3f4400fc00 comp rx=0 tx=0).stop 2024-09-10T08:33:02.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.782+0000 7f3f4a7fc640 1 -- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f541e08f0 msgr2=0x7f3f541494f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:33:02.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.782+0000 7f3f4a7fc640 1 --2- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f541e08f0 0x7f3f541494f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.782+0000 7f3f5a6ce640 1 --2- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3f3806be30 0x7f3f3806e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c034000 tx=0x7f3f4c02f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:02.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.789+0000 7f3f5c131640 1 --2- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f54149a30 0x7f3f541ef780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.789+0000 7f3f5c131640 1 -- 172.21.15.103:0/3587442128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3f54155410 con 0x7f3f54149a30 2024-09-10T08:33:02.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.789+0000 7f3f596cc640 1 --2- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f54149a30 0x7f3f541ef780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.790+0000 7f3f596cc640 1 -- 172.21.15.103:0/3587442128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3f54073770 con 0x7f3f54149a30 2024-09-10T08:33:02.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.790+0000 7f3f596cc640 1 --2- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f54149a30 0x7f3f541ef780 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3f541556c0 tx=0x7f3f44001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:02.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.790+0000 7f3f4a7fc640 1 -- 172.21.15.103:0/3587442128 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4401ee60 con 0x7f3f54149a30 2024-09-10T08:33:02.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.790+0000 7f3f4a7fc640 1 -- 172.21.15.103:0/3587442128 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4721 (secure 0 0 0) 0x7f3f44013a80 con 0x7f3f54149a30 2024-09-10T08:33:02.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.790+0000 7f3f4a7fc640 1 -- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f54149a30 msgr2=0x7f3f541ef780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.790+0000 7f3f4a7fc640 1 --2- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f54149a30 0x7f3f541ef780 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3f541556c0 tx=0x7f3f44001e70 comp rx=0 tx=0).stop 2024-09-10T08:33:02.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.790+0000 7f3f4a7fc640 1 -- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f54149a30 msgr2=0x7f3f541ef780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:33:02.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.790+0000 7f3f4a7fc640 1 --2- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f54149a30 0x7f3f541ef780 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.792 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:33:02.792 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:33:02.792 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:33:02.792 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:33:02.792 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 34, 2024-09-10T08:33:02.792 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 75171, 2024-09-10T08:33:02.792 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:33:02.793 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:33:02.793 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:33:02.793 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:33:02.793 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:02.793 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:33:02.793 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:33:02.793 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:33:02.793 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:33:02.793 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:02.793 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:02.793 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:02.793 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:02.794 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:02.794 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:02.794 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:02.794 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:02.794 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:02.794 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:02.794 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:02.794 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:02.794 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:33:02.794 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:33:02.794 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:02.794 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:02.794 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:02.795 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:02.795 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:02.795 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:02.795 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:02.795 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:02.795 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:02.795 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:02.795 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:02.795 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:02.795 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.795 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:33:02.796 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:33:02.796 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:33:02.796 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:33:02.796 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:33:02.796 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:33:02.796 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:33:02.796 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:33:02.796 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:33:02.796 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:33:02.796 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:33:02.796 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:33:02.796 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:33:02.797 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:33:02.797 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:33:02.797 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:33:02.797 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:33:02.797 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:02.797 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:02.797 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:02.797 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:02.797 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:02.797 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:02.797 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:02.797 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:02.797 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:02.797 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:02.798 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:02.798 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:02.798 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:33:02.798 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.798 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:33:02.798 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.798 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:33:02.798 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:33:02.798 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:02.798 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:02.798 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.798 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:02.798 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:33:02.799 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:02.799 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.799 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.799 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:02.799 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:33:02.799 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:02.799 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:02.799 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:02.799 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.799 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:33:02.799 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:33:02.800 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:02.800 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:02.800 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:02.800 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.800 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.800 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:33:02.800 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:33:02.800 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:02.800 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:02.801 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.801 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:02.801 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:33:02.801 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:02.801 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.801 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.801 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:02.801 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:33:02.801 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:02.801 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:02.801 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:02.801 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.802 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:33:02.802 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:33:02.802 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:02.802 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:02.802 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:02.802 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.802 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.802 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:33:02.802 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:33:02.802 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:02.802 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:02.802 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.802 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:02.802 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:33:02.803 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:02.803 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.803 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.803 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:02.803 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:33:02.803 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:02.803 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:02.803 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:02.803 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.803 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:33:02.803 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:33:02.803 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:02.803 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:02.804 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:02.804 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:02.804 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:02.804 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.804 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:33:02.804 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:33:02.804 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.804 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:02.804 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:02.805 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:33:02.805 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:02.805 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:02.805 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:33:02.805 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.805 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:02.805 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:02.805 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:33:02.805 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:02.805 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:02.805 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:33:02.805 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.806 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:02.806 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:02.806 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:33:02.806 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:02.806 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:02.806 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.806 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:33:02.806 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:33:02.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.790+0000 7f3f5c131640 1 -- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3f3806be30 msgr2=0x7f3f3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.790+0000 7f3f5c131640 1 --2- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3f3806be30 0x7f3f3806e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c034000 tx=0x7f3f4c02f000 comp rx=0 tx=0).stop 2024-09-10T08:33:02.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.791+0000 7f3f5c131640 1 -- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f5406c650 msgr2=0x7f3f54157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.791+0000 7f3f5c131640 1 --2- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f5406c650 0x7f3f54157f10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3f5000ec10 tx=0x7f3f5000c520 comp rx=0 tx=0).stop 2024-09-10T08:33:02.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.791+0000 7f3f5a6ce640 1 -- 172.21.15.103:0/3587442128 reap_dead start 2024-09-10T08:33:02.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.791+0000 7f3f5c131640 1 -- 172.21.15.103:0/3587442128 shutdown_connections 2024-09-10T08:33:02.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.791+0000 7f3f5c131640 1 --2- 172.21.15.103:0/3587442128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f5406c650 0x7f3f54157f10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.791+0000 7f3f5c131640 1 -- 172.21.15.103:0/3587442128 >> 172.21.15.103:0/3587442128 conn(0x7f3f54068030 msgr2=0x7f3f540abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:02.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.791+0000 7f3f5c131640 1 -- 172.21.15.103:0/3587442128 shutdown_connections 2024-09-10T08:33:02.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.791+0000 7f3f5c131640 1 -- 172.21.15.103:0/3587442128 wait complete. 2024-09-10T08:33:02.809 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:33:02.809 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:33:02.809 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:33:02.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.919+0000 7fd0330f8640 1 Processor -- start 2024-09-10T08:33:02.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.919+0000 7fd0330f8640 1 -- start start 2024-09-10T08:33:02.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.919+0000 7fd0330f8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd02c0ad350 0x7fd02c0adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.919+0000 7fd0330f8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd02c1563c0 0x7fd02c15a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.920+0000 7fd0330f8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd02c0ae5d0 con 0x7fd02c15a5e0 2024-09-10T08:33:02.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.920+0000 7fd0330f8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fd02c156820 con 0x7fd02c1563c0 2024-09-10T08:33:02.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.920+0000 7fd0330f8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd02c159930 con 0x7fd02c0ad350 2024-09-10T08:33:02.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.920+0000 7fd02bfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd02c1563c0 0x7fd02c15a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.920+0000 7fd02bfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd02c1563c0 0x7fd02c15a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43720/0 (socket says 172.21.15.103:43720) 2024-09-10T08:33:02.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.920+0000 7fd02bfff640 1 -- 172.21.15.103:0/3768883860 learned_addr learned my addr 172.21.15.103:0/3768883860 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:02.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.920+0000 7fd030e94640 1 --2- 172.21.15.103:0/3768883860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd02c0ad350 0x7fd02c0adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.920+0000 7fd02bfff640 1 -- 172.21.15.103:0/3768883860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd02c0ad350 msgr2=0x7fd02c0adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:02.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.920+0000 7fd02bfff640 1 --2- 172.21.15.103:0/3768883860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd02c0ad350 0x7fd02c0adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.920+0000 7fd02bfff640 1 -- 172.21.15.103:0/3768883860 >> v1:172.21.15.154:6789/0 conn(0x7fd02c15a5e0 legacy=0x7fd02c0c4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.920+0000 7fd02bfff640 1 -- 172.21.15.103:0/3768883860 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd02c0adc40 con 0x7fd02c1563c0 2024-09-10T08:33:02.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.921+0000 7fd02bfff640 1 --2- 172.21.15.103:0/3768883860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd02c1563c0 0x7fd02c15a0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd018009870 tx=0x7fd01802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9936f8776d670b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:02.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.921+0000 7fd02b7fe640 1 -- 172.21.15.103:0/3768883860 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd018037070 con 0x7fd02c1563c0 2024-09-10T08:33:02.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.921+0000 7fd02b7fe640 1 -- 172.21.15.103:0/3768883860 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd018032440 con 0x7fd02c1563c0 2024-09-10T08:33:02.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.921+0000 7fd02b7fe640 1 -- 172.21.15.103:0/3768883860 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd018032810 con 0x7fd02c1563c0 2024-09-10T08:33:02.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.922+0000 7fd0330f8640 1 -- 172.21.15.103:0/3768883860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd02c1563c0 msgr2=0x7fd02c15a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.922+0000 7fd0330f8640 1 --2- 172.21.15.103:0/3768883860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd02c1563c0 0x7fd02c15a0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd018009870 tx=0x7fd01802a1c0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.922+0000 7fd0330f8640 1 -- 172.21.15.103:0/3768883860 shutdown_connections 2024-09-10T08:33:02.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.922+0000 7fd0330f8640 1 --2- 172.21.15.103:0/3768883860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd02c1563c0 0x7fd02c15a0a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.922+0000 7fd0330f8640 1 --2- 172.21.15.103:0/3768883860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd02c0ad350 0x7fd02c0adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.922+0000 7fd0330f8640 1 -- 172.21.15.103:0/3768883860 >> 172.21.15.103:0/3768883860 conn(0x7fd02c0c8410 msgr2=0x7fd02c0c87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:02.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.922+0000 7fd0330f8640 1 -- 172.21.15.103:0/3768883860 shutdown_connections 2024-09-10T08:33:02.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.922+0000 7fd0330f8640 1 -- 172.21.15.103:0/3768883860 wait complete. 2024-09-10T08:33:02.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.923+0000 7fd0330f8640 1 Processor -- start 2024-09-10T08:33:02.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.923+0000 7fd0330f8640 1 -- start start 2024-09-10T08:33:02.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.924+0000 7fd0330f8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02c0ad350 0x7fd02c0c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.924+0000 7fd0330f8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd02c1563c0 0x7fd02c14a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.924+0000 7fd0330f8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd02c14aa90 0x7fd02c14eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.924+0000 7fd0330f8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c06fbe0 con 0x7fd02c14aa90 2024-09-10T08:33:02.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.924+0000 7fd0330f8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c159b80 con 0x7fd02c0ad350 2024-09-10T08:33:02.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.924+0000 7fd0330f8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd02c0ab4c0 con 0x7fd02c1563c0 2024-09-10T08:33:02.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.924+0000 7fd031695640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd02c14aa90 0x7fd02c14eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.924+0000 7fd031695640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd02c14aa90 0x7fd02c14eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43724/0 (socket says 172.21.15.103:43724) 2024-09-10T08:33:02.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.924+0000 7fd031695640 1 -- 172.21.15.103:0/2280033314 learned_addr learned my addr 172.21.15.103:0/2280033314 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:02.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.925+0000 7fd02bfff640 1 --2- 172.21.15.103:0/2280033314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd02c1563c0 0x7fd02c14a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.925+0000 7fd030e94640 1 --2- 172.21.15.103:0/2280033314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02c0ad350 0x7fd02c0c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.925+0000 7fd031695640 1 -- 172.21.15.103:0/2280033314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd02c1563c0 msgr2=0x7fd02c14a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.925+0000 7fd031695640 1 --2- 172.21.15.103:0/2280033314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd02c1563c0 0x7fd02c14a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.925+0000 7fd031695640 1 -- 172.21.15.103:0/2280033314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02c0ad350 msgr2=0x7fd02c0c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.925+0000 7fd031695640 1 --2- 172.21.15.103:0/2280033314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02c0ad350 0x7fd02c0c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.925+0000 7fd031695640 1 -- 172.21.15.103:0/2280033314 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd02c0c6150 con 0x7fd02c14aa90 2024-09-10T08:33:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.925+0000 7fd031695640 1 --2- 172.21.15.103:0/2280033314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd02c14aa90 0x7fd02c14eae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd02400c6b0 tx=0x7fd02400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.925+0000 7fd0297fa640 1 -- 172.21.15.103:0/2280033314 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd024003b70 con 0x7fd02c14aa90 2024-09-10T08:33:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.925+0000 7fd0297fa640 1 -- 172.21.15.103:0/2280033314 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd024003d30 con 0x7fd02c14aa90 2024-09-10T08:33:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.925+0000 7fd0297fa640 1 -- 172.21.15.103:0/2280033314 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd024005310 con 0x7fd02c14aa90 2024-09-10T08:33:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.925+0000 7fd0330f8640 1 -- 172.21.15.103:0/2280033314 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd02c158970 con 0x7fd02c14aa90 2024-09-10T08:33:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.925+0000 7fd0330f8640 1 -- 172.21.15.103:0/2280033314 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd02c0c7360 con 0x7fd02c14aa90 2024-09-10T08:33:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.926+0000 7fd0330f8640 1 --2- 172.21.15.103:0/2280033314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02c15a5e0 0x7fd02c14f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.926+0000 7fd0330f8640 1 -- 172.21.15.103:0/2280033314 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c159770 con 0x7fd02c15a5e0 2024-09-10T08:33:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.927+0000 7fd030e94640 1 --2- 172.21.15.103:0/2280033314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02c15a5e0 0x7fd02c14f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.927+0000 7fd0297fa640 1 -- 172.21.15.103:0/2280033314 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd0240054b0 con 0x7fd02c14aa90 2024-09-10T08:33:02.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.927+0000 7fd030e94640 1 -- 172.21.15.103:0/2280033314 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd02c158790 con 0x7fd02c15a5e0 2024-09-10T08:33:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.927+0000 7fd0297fa640 1 --2- 172.21.15.103:0/2280033314 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd01006be30 0x7fd01006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.927+0000 7fd0297fa640 1 -- 172.21.15.103:0/2280033314 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fd02408ae80 con 0x7fd02c14aa90 2024-09-10T08:33:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.927+0000 7fd02bfff640 1 --2- 172.21.15.103:0/2280033314 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd01006be30 0x7fd01006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.927+0000 7fd030e94640 1 --2- 172.21.15.103:0/2280033314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02c15a5e0 0x7fd02c14f020 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd0200118e0 tx=0x7fd020011da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.927+0000 7fd0297fa640 1 -- 172.21.15.103:0/2280033314 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd020019070 con 0x7fd02c15a5e0 2024-09-10T08:33:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.928+0000 7fd02bfff640 1 --2- 172.21.15.103:0/2280033314 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd01006be30 0x7fd01006e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd018034000 tx=0x7fd01802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.928+0000 7fd0297fa640 1 -- 172.21.15.103:0/2280033314 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd020004300 con 0x7fd02c15a5e0 2024-09-10T08:33:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.928+0000 7fd0297fa640 1 -- 172.21.15.103:0/2280033314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02c15a5e0 msgr2=0x7fd02c14f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.928+0000 7fd0297fa640 1 --2- 172.21.15.103:0/2280033314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02c15a5e0 0x7fd02c14f020 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd0200118e0 tx=0x7fd020011da0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.928+0000 7fd0297fa640 1 -- 172.21.15.103:0/2280033314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02c15a5e0 msgr2=0x7fd02c14f020 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:33:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.928+0000 7fd0297fa640 1 --2- 172.21.15.103:0/2280033314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02c15a5e0 0x7fd02c14f020 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.934+0000 7fd0330f8640 1 --2- 172.21.15.103:0/2280033314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02c14f560 0x7fd02c1ef2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.934+0000 7fd0330f8640 1 -- 172.21.15.103:0/2280033314 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c15aa20 con 0x7fd02c14f560 2024-09-10T08:33:02.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.934+0000 7fd030e94640 1 --2- 172.21.15.103:0/2280033314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02c14f560 0x7fd02c1ef2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.934+0000 7fd030e94640 1 -- 172.21.15.103:0/2280033314 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd02c0ad730 con 0x7fd02c14f560 2024-09-10T08:33:02.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.935+0000 7fd030e94640 1 --2- 172.21.15.103:0/2280033314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02c14f560 0x7fd02c1ef2b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd0200118e0 tx=0x7fd0200046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:02.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.935+0000 7fd0297fa640 1 -- 172.21.15.103:0/2280033314 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd020019040 con 0x7fd02c14f560 2024-09-10T08:33:02.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.935+0000 7fd0297fa640 1 -- 172.21.15.103:0/2280033314 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4552 (secure 0 0 0) 0x7fd02000fe40 con 0x7fd02c14f560 2024-09-10T08:33:02.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.935+0000 7fd0297fa640 1 -- 172.21.15.103:0/2280033314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02c14f560 msgr2=0x7fd02c1ef2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.935+0000 7fd0297fa640 1 --2- 172.21.15.103:0/2280033314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02c14f560 0x7fd02c1ef2b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd0200118e0 tx=0x7fd0200046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.935+0000 7fd0297fa640 1 -- 172.21.15.103:0/2280033314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02c14f560 msgr2=0x7fd02c1ef2b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:33:02.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.935+0000 7fd0297fa640 1 --2- 172.21.15.103:0/2280033314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd02c14f560 0x7fd02c1ef2b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.937 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:33:02.937 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:33:02.937 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:33:02.937 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:33:02.937 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 34, 2024-09-10T08:33:02.937 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 15627, 2024-09-10T08:33:02.938 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:33:02.938 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:33:02.938 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:33:02.938 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:33:02.938 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:02.938 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:33:02.938 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:33:02.938 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:33:02.939 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:33:02.939 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:02.939 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:02.939 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:02.939 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:02.940 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:02.940 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:02.940 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:02.940 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:02.940 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:02.940 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:02.940 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:02.940 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:02.940 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:33:02.941 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:33:02.941 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:02.941 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:02.941 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:02.941 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:02.941 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:02.941 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:02.941 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:02.941 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:02.941 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:02.941 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:02.941 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:02.941 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:02.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.942 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:33:02.942 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:33:02.942 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:33:02.942 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:33:02.942 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:33:02.942 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:33:02.942 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:33:02.942 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:33:02.942 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:33:02.942 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:33:02.942 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:33:02.942 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:33:02.942 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:33:02.943 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:33:02.943 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:33:02.943 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:33:02.943 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:33:02.943 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:02.943 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:02.943 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:02.943 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:02.943 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:02.943 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:02.943 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:02.943 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:02.943 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:02.943 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:02.944 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:02.944 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:02.944 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:33:02.944 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.944 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:33:02.944 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.944 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:33:02.944 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:33:02.944 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:02.944 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:02.944 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.944 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:02.944 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:33:02.945 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:02.945 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.945 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.945 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:02.945 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:33:02.945 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:02.945 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:02.945 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:02.945 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.945 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:33:02.945 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:33:02.945 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:02.946 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:02.946 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:02.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.946 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:33:02.946 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:33:02.946 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:02.946 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:02.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.946 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:02.946 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:33:02.946 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:02.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.947 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:02.947 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:33:02.947 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:02.947 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:02.947 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:02.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.947 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:33:02.947 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:33:02.947 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:02.947 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:02.947 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:02.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.948 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.948 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:33:02.948 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:33:02.948 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:02.948 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:02.948 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.948 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:02.948 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:33:02.948 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:02.948 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.948 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.948 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:02.948 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:33:02.948 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:02.949 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:02.949 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:02.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.949 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:33:02.949 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:33:02.949 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:02.949 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:02.949 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:02.949 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:02.949 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:02.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.949 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:33:02.949 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:33:02.950 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.950 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:02.950 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:02.950 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:33:02.950 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:02.950 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:02.950 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:33:02.950 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:02.950 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:02.951 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:02.951 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:33:02.951 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:02.951 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:02.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:02.951 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:33:02.951 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:33:02.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.935+0000 7fd0330f8640 1 -- 172.21.15.103:0/2280033314 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd01006be30 msgr2=0x7fd01006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.935+0000 7fd0330f8640 1 --2- 172.21.15.103:0/2280033314 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd01006be30 0x7fd01006e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd018034000 tx=0x7fd01802e000 comp rx=0 tx=0).stop 2024-09-10T08:33:02.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.935+0000 7fd0330f8640 1 -- 172.21.15.103:0/2280033314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd02c14aa90 msgr2=0x7fd02c14eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.935+0000 7fd0330f8640 1 --2- 172.21.15.103:0/2280033314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd02c14aa90 0x7fd02c14eae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd02400c6b0 tx=0x7fd02400cb70 comp rx=0 tx=0).stop 2024-09-10T08:33:02.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.935+0000 7fd031695640 1 -- 172.21.15.103:0/2280033314 reap_dead start 2024-09-10T08:33:02.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.935+0000 7fd031695640 1 -- 172.21.15.103:0/2280033314 reap_dead start 2024-09-10T08:33:02.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.936+0000 7fd0330f8640 1 -- 172.21.15.103:0/2280033314 shutdown_connections 2024-09-10T08:33:02.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.936+0000 7fd0330f8640 1 -- 172.21.15.103:0/2280033314 >> 172.21.15.103:0/2280033314 conn(0x7fd02c0c8410 msgr2=0x7fd02c0c4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:02.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.936+0000 7fd0330f8640 1 -- 172.21.15.103:0/2280033314 shutdown_connections 2024-09-10T08:33:02.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:02.936+0000 7fd0330f8640 1 -- 172.21.15.103:0/2280033314 wait complete. 2024-09-10T08:33:02.953 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:33:02.953 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:33:02.954 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:33:03.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.065+0000 7f0c3e2a4640 1 Processor -- start 2024-09-10T08:33:03.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.065+0000 7f0c3e2a4640 1 -- start start 2024-09-10T08:33:03.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.066+0000 7f0c3e2a4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0c380c35f0 0x7f0c38158a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.066+0000 7f0c3e2a4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0c380ad510 0x7f0c38158f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.066+0000 7f0c3e2a4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c380c5430 con 0x7f0c380c58f0 2024-09-10T08:33:03.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.066+0000 7f0c3e2a4640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f0c380a8780 con 0x7f0c380ad510 2024-09-10T08:33:03.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.066+0000 7f0c3e2a4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f0c380c5150 con 0x7f0c380c35f0 2024-09-10T08:33:03.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.066+0000 7f0c3c841640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0c380ad510 0x7f0c38158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.066+0000 7f0c37fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0c380c58f0 0x7f0c38159ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46666/0 (socket says 172.21.15.103:46666) 2024-09-10T08:33:03.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.066+0000 7f0c37fff640 1 -- 172.21.15.103:0/2839779339 learned_addr learned my addr 172.21.15.103:0/2839779339 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:33:03.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.066+0000 7f0c377fe640 1 --2- 172.21.15.103:0/2839779339 >> v2:172.21.15.154:3300/0 conn(0x7f0c380c35f0 0x7f0c38158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.066+0000 7f0c3c841640 1 -- 172.21.15.103:0/2839779339 >> v2:172.21.15.154:3300/0 conn(0x7f0c380c35f0 msgr2=0x7f0c38158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:03.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.066+0000 7f0c3c841640 1 --2- 172.21.15.103:0/2839779339 >> v2:172.21.15.154:3300/0 conn(0x7f0c380c35f0 0x7f0c38158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.066+0000 7f0c3c841640 1 -- 172.21.15.103:0/2839779339 >> v1:172.21.15.103:6789/0 conn(0x7f0c380c58f0 legacy=0x7f0c38159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.066+0000 7f0c3c841640 1 -- 172.21.15.103:0/2839779339 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c380c24b0 con 0x7f0c380ad510 2024-09-10T08:33:03.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.066+0000 7f0c36ffd640 1 -- 172.21.15.103:0/2839779339 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2130268206 0 0) 0x7f0c380c5430 con 0x7f0c380c58f0 2024-09-10T08:33:03.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.067+0000 7f0c3c841640 1 --2- 172.21.15.103:0/2839779339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c380ad510 0x7f0c38158f90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0c380c9800 tx=0x7f0c3002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f498d112672cb3e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:03.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.068+0000 7f0c36ffd640 1 -- 172.21.15.103:0/2839779339 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c30007740 con 0x7f0c380ad510 2024-09-10T08:33:03.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.068+0000 7f0c36ffd640 1 -- 172.21.15.103:0/2839779339 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c300078e0 con 0x7f0c380ad510 2024-09-10T08:33:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.068+0000 7f0c36ffd640 1 -- 172.21.15.103:0/2839779339 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c30007cb0 con 0x7f0c380ad510 2024-09-10T08:33:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.068+0000 7f0c3e2a4640 1 -- 172.21.15.103:0/2839779339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c380ad510 msgr2=0x7f0c38158f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.068+0000 7f0c3e2a4640 1 --2- 172.21.15.103:0/2839779339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c380ad510 0x7f0c38158f90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0c380c9800 tx=0x7f0c3002a680 comp rx=0 tx=0).stop 2024-09-10T08:33:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.068+0000 7f0c3e2a4640 1 -- 172.21.15.103:0/2839779339 shutdown_connections 2024-09-10T08:33:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.068+0000 7f0c3e2a4640 1 --2- 172.21.15.103:0/2839779339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c380ad510 0x7f0c38158f90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.068+0000 7f0c3e2a4640 1 --2- 172.21.15.103:0/2839779339 >> v2:172.21.15.154:3300/0 conn(0x7f0c380c35f0 0x7f0c38158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.068+0000 7f0c3e2a4640 1 -- 172.21.15.103:0/2839779339 >> 172.21.15.103:0/2839779339 conn(0x7f0c380c8bf0 msgr2=0x7f0c380c8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.068+0000 7f0c3e2a4640 1 -- 172.21.15.103:0/2839779339 shutdown_connections 2024-09-10T08:33:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.068+0000 7f0c3e2a4640 1 -- 172.21.15.103:0/2839779339 wait complete. 2024-09-10T08:33:03.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.069+0000 7f0c3e2a4640 1 Processor -- start 2024-09-10T08:33:03.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.070+0000 7f0c3e2a4640 1 -- start start 2024-09-10T08:33:03.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.070+0000 7f0c3e2a4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c380ad510 0x7f0c380abc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.070+0000 7f0c3e2a4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c380c35f0 0x7f0c380a7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.070+0000 7f0c3e2a4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c380c58f0 0x7f0c38154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.070+0000 7f0c3e2a4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0c380c4d20 con 0x7f0c380ad510 2024-09-10T08:33:03.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.070+0000 7f0c3e2a4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0c380c2f90 con 0x7f0c380c35f0 2024-09-10T08:33:03.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.070+0000 7f0c3e2a4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0c380c4ea0 con 0x7f0c380c58f0 2024-09-10T08:33:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.071+0000 7f0c37fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c380ad510 0x7f0c380abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.071+0000 7f0c37fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c380ad510 0x7f0c380abc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43742/0 (socket says 172.21.15.103:43742) 2024-09-10T08:33:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.071+0000 7f0c37fff640 1 -- 172.21.15.103:0/2354146616 learned_addr learned my addr 172.21.15.103:0/2354146616 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.071+0000 7f0c377fe640 1 --2- 172.21.15.103:0/2354146616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c380c35f0 0x7f0c380a7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.071+0000 7f0c3c841640 1 --2- 172.21.15.103:0/2354146616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c380c58f0 0x7f0c38154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.071+0000 7f0c37fff640 1 -- 172.21.15.103:0/2354146616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c380c58f0 msgr2=0x7f0c38154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.071+0000 7f0c37fff640 1 --2- 172.21.15.103:0/2354146616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c380c58f0 0x7f0c38154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.071+0000 7f0c37fff640 1 -- 172.21.15.103:0/2354146616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c380c35f0 msgr2=0x7f0c380a7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.071+0000 7f0c37fff640 1 --2- 172.21.15.103:0/2354146616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c380c35f0 0x7f0c380a7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.071+0000 7f0c37fff640 1 -- 172.21.15.103:0/2354146616 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c381eefb0 con 0x7f0c380ad510 2024-09-10T08:33:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.071+0000 7f0c3c841640 1 --2- 172.21.15.103:0/2354146616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c380c58f0 0x7f0c38154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.071+0000 7f0c37fff640 1 --2- 172.21.15.103:0/2354146616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c380ad510 0x7f0c380abc40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c2800c430 tx=0x7f0c2800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.071+0000 7f0c34ff9640 1 -- 172.21.15.103:0/2354146616 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c280074e0 con 0x7f0c380ad510 2024-09-10T08:33:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.071+0000 7f0c34ff9640 1 -- 172.21.15.103:0/2354146616 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c280047e0 con 0x7f0c380ad510 2024-09-10T08:33:03.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.071+0000 7f0c3e2a4640 1 -- 172.21.15.103:0/2354146616 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c381ef290 con 0x7f0c380ad510 2024-09-10T08:33:03.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.071+0000 7f0c34ff9640 1 -- 172.21.15.103:0/2354146616 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c28004bd0 con 0x7f0c380ad510 2024-09-10T08:33:03.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.071+0000 7f0c3e2a4640 1 -- 172.21.15.103:0/2354146616 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c381ef850 con 0x7f0c380ad510 2024-09-10T08:33:03.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.072+0000 7f0c3e2a4640 1 --2- 172.21.15.103:0/2354146616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c38154640 0x7f0c38152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.072+0000 7f0c3e2a4640 1 -- 172.21.15.103:0/2354146616 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0c381efb80 con 0x7f0c38154640 2024-09-10T08:33:03.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.073+0000 7f0c377fe640 1 --2- 172.21.15.103:0/2354146616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c38154640 0x7f0c38152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.073+0000 7f0c377fe640 1 -- 172.21.15.103:0/2354146616 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0c380c5cd0 con 0x7f0c38154640 2024-09-10T08:33:03.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.073+0000 7f0c377fe640 1 --2- 172.21.15.103:0/2354146616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c38154640 0x7f0c38152fb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0c3815aaf0 tx=0x7f0c2c010c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:03.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.073+0000 7f0c34ff9640 1 -- 172.21.15.103:0/2354146616 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c28011070 con 0x7f0c380ad510 2024-09-10T08:33:03.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.073+0000 7f0c34ff9640 1 --2- 172.21.15.103:0/2354146616 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0c2406be30 0x7f0c2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.074+0000 7f0c34ff9640 1 -- 172.21.15.103:0/2354146616 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f0c2808add0 con 0x7f0c380ad510 2024-09-10T08:33:03.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.074+0000 7f0c3c841640 1 --2- 172.21.15.103:0/2354146616 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0c2406be30 0x7f0c2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.074+0000 7f0c34ff9640 1 -- 172.21.15.103:0/2354146616 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c018020 con 0x7f0c38154640 2024-09-10T08:33:03.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.074+0000 7f0c34ff9640 1 -- 172.21.15.103:0/2354146616 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0c2c010e60 con 0x7f0c38154640 2024-09-10T08:33:03.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.074+0000 7f0c34ff9640 1 -- 172.21.15.103:0/2354146616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c38154640 msgr2=0x7f0c38152fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.074+0000 7f0c34ff9640 1 --2- 172.21.15.103:0/2354146616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c38154640 0x7f0c38152fb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0c3815aaf0 tx=0x7f0c2c010c10 comp rx=0 tx=0).stop 2024-09-10T08:33:03.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.074+0000 7f0c34ff9640 1 -- 172.21.15.103:0/2354146616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c38154640 msgr2=0x7f0c38152fb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:33:03.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.074+0000 7f0c34ff9640 1 --2- 172.21.15.103:0/2354146616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c38154640 0x7f0c38152fb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.074+0000 7f0c3c841640 1 --2- 172.21.15.103:0/2354146616 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0c2406be30 0x7f0c2406e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0c30034000 tx=0x7f0c3002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:03.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.080+0000 7f0c3e2a4640 1 --2- 172.21.15.103:0/2354146616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c38154a20 0x7f0c381534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.080+0000 7f0c3e2a4640 1 -- 172.21.15.103:0/2354146616 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0c380a8450 con 0x7f0c38154a20 2024-09-10T08:33:03.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.080+0000 7f0c377fe640 1 --2- 172.21.15.103:0/2354146616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c38154a20 0x7f0c381534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.081+0000 7f0c377fe640 1 -- 172.21.15.103:0/2354146616 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0c380c6b90 con 0x7f0c38154a20 2024-09-10T08:33:03.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.081+0000 7f0c377fe640 1 --2- 172.21.15.103:0/2354146616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c38154a20 0x7f0c381534f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c016000 tx=0x7f0c2c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:03.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.081+0000 7f0c34ff9640 1 -- 172.21.15.103:0/2354146616 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c018030 con 0x7f0c38154a20 2024-09-10T08:33:03.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.081+0000 7f0c34ff9640 1 -- 172.21.15.103:0/2354146616 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7f0c2c00ecd0 con 0x7f0c38154a20 2024-09-10T08:33:03.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.081+0000 7f0c34ff9640 1 -- 172.21.15.103:0/2354146616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c38154a20 msgr2=0x7f0c381534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.081+0000 7f0c34ff9640 1 --2- 172.21.15.103:0/2354146616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c38154a20 0x7f0c381534f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c016000 tx=0x7f0c2c004730 comp rx=0 tx=0).stop 2024-09-10T08:33:03.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.081+0000 7f0c34ff9640 1 -- 172.21.15.103:0/2354146616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c38154a20 msgr2=0x7f0c381534f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:33:03.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.081+0000 7f0c34ff9640 1 --2- 172.21.15.103:0/2354146616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c38154a20 0x7f0c381534f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.083 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:33:03.083 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:33:03.083 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:33:03.083 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:33:03.083 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 34, 2024-09-10T08:33:03.083 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 127241, 2024-09-10T08:33:03.083 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:33:03.083 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:33:03.083 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:33:03.083 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:33:03.083 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:03.083 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:33:03.084 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:33:03.084 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:33:03.084 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:33:03.084 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:03.084 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:03.084 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:03.084 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:03.084 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:03.084 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:03.084 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:03.084 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:03.084 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:03.084 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:03.084 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:03.085 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:03.085 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:33:03.085 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:33:03.085 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:03.085 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:03.085 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:03.085 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:03.085 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:03.085 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:03.085 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:03.085 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:03.085 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:03.085 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:03.086 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:03.086 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:03.086 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:03.086 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:33:03.086 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:33:03.086 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:33:03.086 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:33:03.086 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:33:03.086 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:33:03.086 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:33:03.086 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:33:03.086 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:33:03.086 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:33:03.086 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:33:03.087 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:33:03.087 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:33:03.087 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:33:03.087 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:33:03.087 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:33:03.087 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:33:03.087 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:03.087 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:03.087 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:03.087 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:03.087 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:03.087 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:03.087 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:03.087 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:03.088 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:03.088 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:03.088 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:03.088 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:03.088 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:33:03.088 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:03.088 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:33:03.088 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:03.088 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:33:03.088 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:33:03.088 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:03.088 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:03.088 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:03.089 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:03.089 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:33:03.089 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:03.089 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:03.089 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:03.089 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:03.089 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:33:03.089 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:03.089 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:03.089 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:03.089 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:03.089 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:33:03.089 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:33:03.089 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:03.090 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:03.090 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:03.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:03.090 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:03.090 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:33:03.090 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:33:03.090 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:03.090 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:03.090 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:03.090 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:03.090 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:33:03.090 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:03.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:03.090 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:03.090 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:03.091 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:33:03.091 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:03.091 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:03.091 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:03.091 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:03.091 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:33:03.091 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:33:03.091 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:03.091 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:03.091 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:03.091 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:03.091 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:03.091 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:33:03.091 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:33:03.091 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:03.092 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:03.092 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:03.092 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:03.092 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:33:03.092 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:03.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:03.092 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:03.092 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:03.092 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:33:03.092 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:03.092 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:03.092 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:03.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:03.093 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:33:03.093 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:33:03.093 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:03.093 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:03.093 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:03.093 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:03.093 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:03.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:03.093 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:33:03.093 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:33:03.093 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:03.093 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:03.093 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:03.093 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:33:03.094 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:03.094 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:03.094 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:33:03.094 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:03.094 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:03.094 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:03.094 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:33:03.094 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:03.094 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:03.094 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:33:03.094 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:03.094 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:03.094 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:03.094 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 8 2024-09-10T08:33:03.094 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:03.095 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:03.095 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:33:03.095 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:03.095 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:03.095 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:03.095 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:33:03.095 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:03.095 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:03.095 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:33:03.095 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:03.095 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:03.095 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:03.095 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:33:03.095 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:03.095 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:03.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:03.096 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:33:03.096 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:33:03.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.082+0000 7f0c3e2a4640 1 -- 172.21.15.103:0/2354146616 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0c2406be30 msgr2=0x7f0c2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.082+0000 7f0c3e2a4640 1 --2- 172.21.15.103:0/2354146616 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0c2406be30 0x7f0c2406e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0c30034000 tx=0x7f0c3002f000 comp rx=0 tx=0).stop 2024-09-10T08:33:03.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.082+0000 7f0c3e2a4640 1 -- 172.21.15.103:0/2354146616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c380ad510 msgr2=0x7f0c380abc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.082+0000 7f0c3e2a4640 1 --2- 172.21.15.103:0/2354146616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c380ad510 0x7f0c380abc40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c2800c430 tx=0x7f0c2800c8f0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.082+0000 7f0c3c841640 1 -- 172.21.15.103:0/2354146616 reap_dead start 2024-09-10T08:33:03.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.082+0000 7f0c3c841640 1 -- 172.21.15.103:0/2354146616 reap_dead start 2024-09-10T08:33:03.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.082+0000 7f0c3e2a4640 1 -- 172.21.15.103:0/2354146616 shutdown_connections 2024-09-10T08:33:03.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.082+0000 7f0c3e2a4640 1 -- 172.21.15.103:0/2354146616 >> 172.21.15.103:0/2354146616 conn(0x7f0c380c8bf0 msgr2=0x7f0c380c77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:03.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.082+0000 7f0c3e2a4640 1 -- 172.21.15.103:0/2354146616 shutdown_connections 2024-09-10T08:33:03.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.082+0000 7f0c3e2a4640 1 -- 172.21.15.103:0/2354146616 wait complete. 2024-09-10T08:33:03.098 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:33:03.098 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-10T08:33:03.098 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-10T08:33:03.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.207+0000 7f8f9ce77640 1 Processor -- start 2024-09-10T08:33:03.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.207+0000 7f8f9ce77640 1 -- start start 2024-09-10T08:33:03.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.208+0000 7f8f9ce77640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f9806c650 0x7f8f980c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.208+0000 7f8f9ce77640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f9815a7c0 con 0x7f8f980ca1c0 2024-09-10T08:33:03.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.208+0000 7f8f9ce77640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f98159a00 con 0x7f8f98150480 2024-09-10T08:33:03.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.208+0000 7f8f9ce77640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8f9806c240 con 0x7f8f9806c650 2024-09-10T08:33:03.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.208+0000 7f8f96d9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8f980ca1c0 0x7f8f98160bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46676/0 (socket says 172.21.15.103:46676) 2024-09-10T08:33:03.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.208+0000 7f8f96d9d640 1 -- 172.21.15.103:0/1249958314 learned_addr learned my addr 172.21.15.103:0/1249958314 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:33:03.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.209+0000 7f8f95d9b640 1 --2- 172.21.15.103:0/1249958314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f9806c650 0x7f8f980c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.209+0000 7f8f9559a640 1 -- 172.21.15.103:0/1249958314 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 369301455 0 0) 0x7f8f9815a7c0 con 0x7f8f980ca1c0 2024-09-10T08:33:03.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.209+0000 7f8f9559a640 1 -- 172.21.15.103:0/1249958314 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f80003520 con 0x7f8f980ca1c0 2024-09-10T08:33:03.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.209+0000 7f8f9559a640 1 -- 172.21.15.103:0/1249958314 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3821150916 0 0) 0x7f8f98159a00 con 0x7f8f98150480 2024-09-10T08:33:03.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.209+0000 7f8f9559a640 1 -- 172.21.15.103:0/1249958314 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f9815a7c0 con 0x7f8f98150480 2024-09-10T08:33:03.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.209+0000 7f8f9559a640 1 -- 172.21.15.103:0/1249958314 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 228097138 0 0) 0x7f8f80003520 con 0x7f8f980ca1c0 2024-09-10T08:33:03.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.209+0000 7f8f95d9b640 1 -- 172.21.15.103:0/1249958314 >> v1:172.21.15.154:6789/0 conn(0x7f8f98150480 legacy=0x7f8f980c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.209+0000 7f8f95d9b640 1 -- 172.21.15.103:0/1249958314 >> v1:172.21.15.103:6789/0 conn(0x7f8f980ca1c0 legacy=0x7f8f98160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.209+0000 7f8f95d9b640 1 -- 172.21.15.103:0/1249958314 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f98159ce0 con 0x7f8f9806c650 2024-09-10T08:33:03.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.210+0000 7f8f95d9b640 1 --2- 172.21.15.103:0/1249958314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f9806c650 0x7f8f980c9c80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c0097d0 tx=0x7f8f8c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54e0723f635c380 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:03.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.210+0000 7f8f9559a640 1 -- 172.21.15.103:0/1249958314 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c037070 con 0x7f8f9806c650 2024-09-10T08:33:03.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.210+0000 7f8f9559a640 1 -- 172.21.15.103:0/1249958314 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f8c02ac30 con 0x7f8f9806c650 2024-09-10T08:33:03.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.210+0000 7f8f9559a640 1 -- 172.21.15.103:0/1249958314 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f900019f0 con 0x7f8f9806c650 2024-09-10T08:33:03.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.211+0000 7f8f9ce77640 1 -- 172.21.15.103:0/1249958314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f9806c650 msgr2=0x7f8f980c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.211+0000 7f8f9ce77640 1 --2- 172.21.15.103:0/1249958314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f9806c650 0x7f8f980c9c80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c0097d0 tx=0x7f8f8c02a1a0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.211+0000 7f8f9ce77640 1 -- 172.21.15.103:0/1249958314 shutdown_connections 2024-09-10T08:33:03.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.211+0000 7f8f9ce77640 1 --2- 172.21.15.103:0/1249958314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f9806c650 0x7f8f980c9c80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.211+0000 7f8f9ce77640 1 -- 172.21.15.103:0/1249958314 >> 172.21.15.103:0/1249958314 conn(0x7f8f98068030 msgr2=0x7f8f98073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:03.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.211+0000 7f8f9ce77640 1 -- 172.21.15.103:0/1249958314 shutdown_connections 2024-09-10T08:33:03.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.211+0000 7f8f9ce77640 1 -- 172.21.15.103:0/1249958314 wait complete. 2024-09-10T08:33:03.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.212+0000 7f8f9ce77640 1 Processor -- start 2024-09-10T08:33:03.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.212+0000 7f8f9ce77640 1 -- start start 2024-09-10T08:33:03.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.213+0000 7f8f9ce77640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f9806c650 0x7f8f981e3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.213+0000 7f8f9ce77640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f980ca1c0 0x7f8f981496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.213+0000 7f8f9ce77640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f98150480 0x7f8f98149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.213+0000 7f8f9ce77640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8f980ca670 con 0x7f8f980ca1c0 2024-09-10T08:33:03.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.213+0000 7f8f9ce77640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9815a330 con 0x7f8f98150480 2024-09-10T08:33:03.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.213+0000 7f8f9ce77640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8f9806d270 con 0x7f8f9806c650 2024-09-10T08:33:03.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.213+0000 7f8f95d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f980ca1c0 0x7f8f981496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.213+0000 7f8f95d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f980ca1c0 0x7f8f981496d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43752/0 (socket says 172.21.15.103:43752) 2024-09-10T08:33:03.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.213+0000 7f8f95d9b640 1 -- 172.21.15.103:0/2151469381 learned_addr learned my addr 172.21.15.103:0/2151469381 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:03.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.213+0000 7f8f96d9d640 1 --2- 172.21.15.103:0/2151469381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f98150480 0x7f8f98149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.213+0000 7f8f9659c640 1 --2- 172.21.15.103:0/2151469381 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f9806c650 0x7f8f981e3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.213+0000 7f8f95d9b640 1 -- 172.21.15.103:0/2151469381 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f9806c650 msgr2=0x7f8f981e3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.213+0000 7f8f95d9b640 1 --2- 172.21.15.103:0/2151469381 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f9806c650 0x7f8f981e3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.213+0000 7f8f95d9b640 1 -- 172.21.15.103:0/2151469381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f98150480 msgr2=0x7f8f98149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.213+0000 7f8f95d9b640 1 --2- 172.21.15.103:0/2151469381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f98150480 0x7f8f98149c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.213+0000 7f8f95d9b640 1 -- 172.21.15.103:0/2151469381 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f980b1230 con 0x7f8f980ca1c0 2024-09-10T08:33:03.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.214+0000 7f8f95d9b640 1 --2- 172.21.15.103:0/2151469381 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f980ca1c0 0x7f8f981496d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c035040 tx=0x7f8f8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:03.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.214+0000 7f8f86ffd640 1 -- 172.21.15.103:0/2151469381 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c037050 con 0x7f8f980ca1c0 2024-09-10T08:33:03.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.214+0000 7f8f86ffd640 1 -- 172.21.15.103:0/2151469381 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f8c043070 con 0x7f8f980ca1c0 2024-09-10T08:33:03.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.214+0000 7f8f9ce77640 1 -- 172.21.15.103:0/2151469381 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f98154db0 con 0x7f8f980ca1c0 2024-09-10T08:33:03.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.214+0000 7f8f86ffd640 1 -- 172.21.15.103:0/2151469381 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c006e10 con 0x7f8f980ca1c0 2024-09-10T08:33:03.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.214+0000 7f8f9ce77640 1 -- 172.21.15.103:0/2151469381 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f981562a0 con 0x7f8f980ca1c0 2024-09-10T08:33:03.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.215+0000 7f8f9ce77640 1 -- 172.21.15.103:0/2151469381 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f980697e0 con 0x7f8f980ca1c0 2024-09-10T08:33:03.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.215+0000 7f8f86ffd640 1 -- 172.21.15.103:0/2151469381 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f8c03ca10 con 0x7f8f980ca1c0 2024-09-10T08:33:03.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.216+0000 7f8f86ffd640 1 --2- 172.21.15.103:0/2151469381 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8f7806be60 0x7f8f7806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.216+0000 7f8f86ffd640 1 -- 172.21.15.103:0/2151469381 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f8f8c0abb50 con 0x7f8f980ca1c0 2024-09-10T08:33:03.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.216+0000 7f8f9659c640 1 --2- 172.21.15.103:0/2151469381 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8f7806be60 0x7f8f7806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.217+0000 7f8f9659c640 1 --2- 172.21.15.103:0/2151469381 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8f7806be60 0x7f8f7806e320 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8f880011e0 tx=0x7f8f88009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:03.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.222+0000 7f8f86ffd640 1 -- 172.21.15.103:0/2151469381 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8f980697e0 con 0x7f8f980ca1c0 2024-09-10T08:33:03.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.504+0000 7f8f9ce77640 1 -- 172.21.15.103:0/2151469381 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f8f98159a00 con 0x7f8f980ca1c0 2024-09-10T08:33:03.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.505+0000 7f8f86ffd640 1 -- 172.21.15.103:0/2151469381 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f8f8c07a310 con 0x7f8f980ca1c0 2024-09-10T08:33:03.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.508+0000 7f8f9ce77640 1 -- 172.21.15.103:0/2151469381 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8f7806be60 msgr2=0x7f8f7806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.508+0000 7f8f9ce77640 1 --2- 172.21.15.103:0/2151469381 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8f7806be60 0x7f8f7806e320 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8f880011e0 tx=0x7f8f88009040 comp rx=0 tx=0).stop 2024-09-10T08:33:03.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.508+0000 7f8f9ce77640 1 -- 172.21.15.103:0/2151469381 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f980ca1c0 msgr2=0x7f8f981496d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.508+0000 7f8f9ce77640 1 --2- 172.21.15.103:0/2151469381 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f980ca1c0 0x7f8f981496d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c035040 tx=0x7f8f8c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.508+0000 7f8f9ce77640 1 -- 172.21.15.103:0/2151469381 shutdown_connections 2024-09-10T08:33:03.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.508+0000 7f8f9ce77640 1 --2- 172.21.15.103:0/2151469381 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8f7806be60 0x7f8f7806e320 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.508+0000 7f8f9ce77640 1 --2- 172.21.15.103:0/2151469381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f98150480 0x7f8f98149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.508+0000 7f8f9ce77640 1 --2- 172.21.15.103:0/2151469381 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f980ca1c0 0x7f8f981496d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.508+0000 7f8f9ce77640 1 --2- 172.21.15.103:0/2151469381 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f9806c650 0x7f8f981e3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.508+0000 7f8f9ce77640 1 -- 172.21.15.103:0/2151469381 >> 172.21.15.103:0/2151469381 conn(0x7f8f98068030 msgr2=0x7f8f980cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:03.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.508+0000 7f8f9ce77640 1 -- 172.21.15.103:0/2151469381 shutdown_connections 2024-09-10T08:33:03.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:03.508+0000 7f8f9ce77640 1 -- 172.21.15.103:0/2151469381 wait complete. 2024-09-10T08:33:03.521 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-10T08:33:13.522 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:33:13.522 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:33:13.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.628+0000 7f0406077640 1 Processor -- start 2024-09-10T08:33:13.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.628+0000 7f0406077640 1 -- start start 2024-09-10T08:33:13.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.628+0000 7f0406077640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f040006cd80 0x7f0400153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:13.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.628+0000 7f0406077640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f040015a4a0 0x7f0400156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:13.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.628+0000 7f0406077640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04000c7070 con 0x7f04000c8b10 2024-09-10T08:33:13.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.628+0000 7f0406077640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f040006d210 con 0x7f040015a4a0 2024-09-10T08:33:13.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.628+0000 7f0406077640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f04000c69b0 con 0x7f040006cd80 2024-09-10T08:33:13.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.629+0000 7f03feffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f040006cd80 0x7f0400153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:13.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.629+0000 7f03fffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f040015a4a0 0x7f0400156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:13.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.629+0000 7f03fffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f040015a4a0 0x7f0400156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:33540/0 (socket says 172.21.15.103:33540) 2024-09-10T08:33:13.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.629+0000 7f03feffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f040006cd80 0x7f0400153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:55368/0 (socket says 172.21.15.103:55368) 2024-09-10T08:33:13.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.629+0000 7f03fffff640 1 -- 172.21.15.103:0/753440397 learned_addr learned my addr 172.21.15.103:0/753440397 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:13.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.629+0000 7f03fffff640 1 -- 172.21.15.103:0/753440397 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f040006cd80 msgr2=0x7f0400153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:13.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.629+0000 7f03fffff640 1 --2- 172.21.15.103:0/753440397 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f040006cd80 0x7f0400153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:13.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.629+0000 7f03fffff640 1 -- 172.21.15.103:0/753440397 >> v1:172.21.15.154:6789/0 conn(0x7f04000c8b10 legacy=0x7f04001534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:13.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.630+0000 7f03fe7fc640 1 -- 172.21.15.103:0/753440397 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2202235326 0 0) 0x7f04000c7070 con 0x7f04000c8b10 2024-09-10T08:33:13.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.630+0000 7f03fffff640 1 -- 172.21.15.103:0/753440397 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04000c6c90 con 0x7f040015a4a0 2024-09-10T08:33:13.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.630+0000 7f03feffd640 1 --2- 172.21.15.103:0/753440397 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f040006cd80 0x7f0400153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:33:13.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.630+0000 7f03fffff640 1 --2- 172.21.15.103:0/753440397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f040015a4a0 0x7f0400156660 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009e50 tx=0x7f03f802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ceb11b166011bc82 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:13.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.631+0000 7f03fe7fc640 1 -- 172.21.15.103:0/753440397 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f8036070 con 0x7f040015a4a0 2024-09-10T08:33:13.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.631+0000 7f03fe7fc640 1 -- 172.21.15.103:0/753440397 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f8031600 con 0x7f040015a4a0 2024-09-10T08:33:13.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.631+0000 7f03fe7fc640 1 -- 172.21.15.103:0/753440397 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f80319d0 con 0x7f040015a4a0 2024-09-10T08:33:13.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.631+0000 7f0406077640 1 -- 172.21.15.103:0/753440397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f040015a4a0 msgr2=0x7f0400156660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:13.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.631+0000 7f0406077640 1 --2- 172.21.15.103:0/753440397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f040015a4a0 0x7f0400156660 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009e50 tx=0x7f03f802a680 comp rx=0 tx=0).stop 2024-09-10T08:33:13.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.632+0000 7f0406077640 1 -- 172.21.15.103:0/753440397 shutdown_connections 2024-09-10T08:33:13.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.632+0000 7f0406077640 1 --2- 172.21.15.103:0/753440397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f040015a4a0 0x7f0400156660 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:13.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.632+0000 7f0406077640 1 --2- 172.21.15.103:0/753440397 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f040006cd80 0x7f0400153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:13.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.632+0000 7f0406077640 1 -- 172.21.15.103:0/753440397 >> 172.21.15.103:0/753440397 conn(0x7f04000adb80 msgr2=0x7f04000adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:13.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.632+0000 7f0406077640 1 -- 172.21.15.103:0/753440397 shutdown_connections 2024-09-10T08:33:13.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.632+0000 7f0406077640 1 -- 172.21.15.103:0/753440397 wait complete. 2024-09-10T08:33:13.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.633+0000 7f0406077640 1 Processor -- start 2024-09-10T08:33:13.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.633+0000 7f0406077640 1 -- start start 2024-09-10T08:33:13.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.634+0000 7f0406077640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04000c8b10 0x7f04000b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:13.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.634+0000 7f0406077640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f040015a4a0 0x7f04001501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:13.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.634+0000 7f0406077640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04000cc390 0x7f04000afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:13.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.634+0000 7f0406077640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f04000c9070 con 0x7f04000c8b10 2024-09-10T08:33:13.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.634+0000 7f0406077640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f04000c8ef0 con 0x7f04000cc390 2024-09-10T08:33:13.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.634+0000 7f0406077640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0400156ba0 con 0x7f040015a4a0 2024-09-10T08:33:13.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.634+0000 7f03ff7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04000c8b10 0x7f04000b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:13.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.634+0000 7f03feffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f040015a4a0 0x7f04001501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:13.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.634+0000 7f03feffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f040015a4a0 0x7f04001501e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:55374/0 (socket says 172.21.15.103:55374) 2024-09-10T08:33:13.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.634+0000 7f03ff7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04000c8b10 0x7f04000b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38734/0 (socket says 172.21.15.103:38734) 2024-09-10T08:33:13.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.634+0000 7f03feffd640 1 -- 172.21.15.103:0/1152652533 learned_addr learned my addr 172.21.15.103:0/1152652533 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:13.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.635+0000 7f03fffff640 1 --2- 172.21.15.103:0/1152652533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04000cc390 0x7f04000afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:13.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.635+0000 7f03feffd640 1 -- 172.21.15.103:0/1152652533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04000cc390 msgr2=0x7f04000afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:13.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.635+0000 7f03feffd640 1 --2- 172.21.15.103:0/1152652533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04000cc390 0x7f04000afc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:13.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.635+0000 7f03feffd640 1 -- 172.21.15.103:0/1152652533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04000c8b10 msgr2=0x7f04000b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:13.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.635+0000 7f03feffd640 1 --2- 172.21.15.103:0/1152652533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04000c8b10 0x7f04000b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:13.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.635+0000 7f03feffd640 1 -- 172.21.15.103:0/1152652533 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040014c6f0 con 0x7f040015a4a0 2024-09-10T08:33:13.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.635+0000 7f03feffd640 1 --2- 172.21.15.103:0/1152652533 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f040015a4a0 0x7f04001501e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f03f400e9b0 tx=0x7f03f400ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:13.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.635+0000 7f03e7fff640 1 -- 172.21.15.103:0/1152652533 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f4017070 con 0x7f040015a4a0 2024-09-10T08:33:13.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.635+0000 7f03e7fff640 1 -- 172.21.15.103:0/1152652533 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f400ca00 con 0x7f040015a4a0 2024-09-10T08:33:13.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.635+0000 7f03e7fff640 1 -- 172.21.15.103:0/1152652533 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f400cdf0 con 0x7f040015a4a0 2024-09-10T08:33:13.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.635+0000 7f0406077640 1 -- 172.21.15.103:0/1152652533 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04000b1af0 con 0x7f040015a4a0 2024-09-10T08:33:13.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.636+0000 7f0406077640 1 -- 172.21.15.103:0/1152652533 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0400150720 con 0x7f040015a4a0 2024-09-10T08:33:13.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.637+0000 7f0406077640 1 -- 172.21.15.103:0/1152652533 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0400157030 con 0x7f040015a4a0 2024-09-10T08:33:13.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.637+0000 7f03e7fff640 1 -- 172.21.15.103:0/1152652533 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f03f401a070 con 0x7f040015a4a0 2024-09-10T08:33:13.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.638+0000 7f03e7fff640 1 --2- 172.21.15.103:0/1152652533 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f03ec06be30 0x7f03ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:13.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.638+0000 7f03e7fff640 1 -- 172.21.15.103:0/1152652533 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f03f408b060 con 0x7f040015a4a0 2024-09-10T08:33:13.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.638+0000 7f03ff7fe640 1 --2- 172.21.15.103:0/1152652533 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f03ec06be30 0x7f03ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:13.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.638+0000 7f03ff7fe640 1 --2- 172.21.15.103:0/1152652533 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f03ec06be30 0x7f03ec06e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f03f0000f60 tx=0x7f03f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:13.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.642+0000 7f03e7fff640 1 -- 172.21.15.103:0/1152652533 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f03f40590b0 con 0x7f040015a4a0 2024-09-10T08:33:13.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.950+0000 7f0406077640 1 -- 172.21.15.103:0/1152652533 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f04000c9d90 con 0x7f040015a4a0 2024-09-10T08:33:13.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.951+0000 7f03e7fff640 1 -- 172.21.15.103:0/1152652533 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f03f405d3b0 con 0x7f040015a4a0 2024-09-10T08:33:13.952 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:33:13.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.954+0000 7f0406077640 1 -- 172.21.15.103:0/1152652533 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f03ec06be30 msgr2=0x7f03ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:13.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.954+0000 7f0406077640 1 --2- 172.21.15.103:0/1152652533 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f03ec06be30 0x7f03ec06e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f03f0000f60 tx=0x7f03f0009040 comp rx=0 tx=0).stop 2024-09-10T08:33:13.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.954+0000 7f0406077640 1 -- 172.21.15.103:0/1152652533 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f040015a4a0 msgr2=0x7f04001501e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:13.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.954+0000 7f0406077640 1 --2- 172.21.15.103:0/1152652533 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f040015a4a0 0x7f04001501e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f03f400e9b0 tx=0x7f03f400ee70 comp rx=0 tx=0).stop 2024-09-10T08:33:13.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.954+0000 7f0406077640 1 -- 172.21.15.103:0/1152652533 shutdown_connections 2024-09-10T08:33:13.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.954+0000 7f0406077640 1 --2- 172.21.15.103:0/1152652533 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f03ec06be30 0x7f03ec06e2f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:13.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.954+0000 7f0406077640 1 --2- 172.21.15.103:0/1152652533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04000cc390 0x7f04000afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:13.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.954+0000 7f0406077640 1 --2- 172.21.15.103:0/1152652533 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f040015a4a0 0x7f04001501e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:13.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.954+0000 7f0406077640 1 --2- 172.21.15.103:0/1152652533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04000c8b10 0x7f04000b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:13.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.954+0000 7f0406077640 1 -- 172.21.15.103:0/1152652533 >> 172.21.15.103:0/1152652533 conn(0x7f04000adb80 msgr2=0x7f04001541c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:13.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.954+0000 7f0406077640 1 -- 172.21.15.103:0/1152652533 shutdown_connections 2024-09-10T08:33:13.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:13.954+0000 7f0406077640 1 -- 172.21.15.103:0/1152652533 wait complete. 2024-09-10T08:33:13.965 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:33:13.965 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-10T08:33:13.965 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:33:13.966 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:33:14.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.071+0000 7f979e2d0640 1 Processor -- start 2024-09-10T08:33:14.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.071+0000 7f979e2d0640 1 -- start start 2024-09-10T08:33:14.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.072+0000 7f979e2d0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f979806c650 0x7f97980c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.072+0000 7f979e2d0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f97980ca1c0 0x7f9798160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.072+0000 7f979e2d0640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f979815a7c0 con 0x7f9798150480 2024-09-10T08:33:14.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.072+0000 7f979e2d0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f979806c240 con 0x7f97980ca1c0 2024-09-10T08:33:14.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.072+0000 7f979e2d0640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f979815a330 con 0x7f979806c650 2024-09-10T08:33:14.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.072+0000 7f9797fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9798150480 0x7f97980c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45168/0 (socket says 172.21.15.103:45168) 2024-09-10T08:33:14.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.072+0000 7f9797fff640 1 -- 172.21.15.103:0/708046507 learned_addr learned my addr 172.21.15.103:0/708046507 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:33:14.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.072+0000 7f979c86d640 1 --2- 172.21.15.103:0/708046507 >> v2:172.21.15.154:3300/0 conn(0x7f97980ca1c0 0x7f9798160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.072+0000 7f978ffff640 1 --2- 172.21.15.103:0/708046507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f979806c650 0x7f97980c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.073+0000 7f97977fe640 1 -- 172.21.15.103:0/708046507 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 602235966 0 0) 0x7f979815a7c0 con 0x7f9798150480 2024-09-10T08:33:14.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.073+0000 7f97977fe640 1 -- 172.21.15.103:0/708046507 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9784003520 con 0x7f9798150480 2024-09-10T08:33:14.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.073+0000 7f979c86d640 1 -- 172.21.15.103:0/708046507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f979806c650 msgr2=0x7f97980c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:14.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.073+0000 7f979c86d640 1 --2- 172.21.15.103:0/708046507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f979806c650 0x7f97980c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.073+0000 7f979c86d640 1 -- 172.21.15.103:0/708046507 >> v1:172.21.15.103:6789/0 conn(0x7f9798150480 legacy=0x7f97980c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.073+0000 7f979c86d640 1 -- 172.21.15.103:0/708046507 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9798159a00 con 0x7f97980ca1c0 2024-09-10T08:33:14.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.073+0000 7f978ffff640 1 --2- 172.21.15.103:0/708046507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f979806c650 0x7f97980c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:33:14.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.074+0000 7f979c86d640 1 --2- 172.21.15.103:0/708046507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97980ca1c0 0x7f9798160bf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9790009d90 tx=0x7f979002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31df4aa82dc04304 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:14.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.074+0000 7f97977fe640 1 -- 172.21.15.103:0/708046507 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9790007740 con 0x7f97980ca1c0 2024-09-10T08:33:14.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.074+0000 7f97977fe640 1 -- 172.21.15.103:0/708046507 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97900078e0 con 0x7f97980ca1c0 2024-09-10T08:33:14.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.074+0000 7f97977fe640 1 -- 172.21.15.103:0/708046507 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9790007c90 con 0x7f97980ca1c0 2024-09-10T08:33:14.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.074+0000 7f979e2d0640 1 -- 172.21.15.103:0/708046507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97980ca1c0 msgr2=0x7f9798160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.074+0000 7f979e2d0640 1 --2- 172.21.15.103:0/708046507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97980ca1c0 0x7f9798160bf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9790009d90 tx=0x7f979002a660 comp rx=0 tx=0).stop 2024-09-10T08:33:14.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.074+0000 7f979e2d0640 1 -- 172.21.15.103:0/708046507 shutdown_connections 2024-09-10T08:33:14.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.074+0000 7f979e2d0640 1 --2- 172.21.15.103:0/708046507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97980ca1c0 0x7f9798160bf0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.074+0000 7f979e2d0640 1 --2- 172.21.15.103:0/708046507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f979806c650 0x7f97980c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.074+0000 7f979e2d0640 1 -- 172.21.15.103:0/708046507 >> 172.21.15.103:0/708046507 conn(0x7f9798068030 msgr2=0x7f9798073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:14.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.074+0000 7f979e2d0640 1 -- 172.21.15.103:0/708046507 shutdown_connections 2024-09-10T08:33:14.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.075+0000 7f979e2d0640 1 -- 172.21.15.103:0/708046507 wait complete. 2024-09-10T08:33:14.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.076+0000 7f979e2d0640 1 Processor -- start 2024-09-10T08:33:14.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.076+0000 7f979e2d0640 1 -- start start 2024-09-10T08:33:14.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.076+0000 7f979e2d0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979806c650 0x7f97980ae410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.076+0000 7f979e2d0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97980ca1c0 0x7f97981554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.076+0000 7f979e2d0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9798150480 0x7f97981ef0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.076+0000 7f979e2d0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f97980ca670 con 0x7f97980ca1c0 2024-09-10T08:33:14.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.076+0000 7f979e2d0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9798159fc0 con 0x7f979806c650 2024-09-10T08:33:14.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.076+0000 7f979e2d0640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f979806d270 con 0x7f9798150480 2024-09-10T08:33:14.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.077+0000 7f978ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97980ca1c0 0x7f97981554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.077+0000 7f978ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97980ca1c0 0x7f97981554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38748/0 (socket says 172.21.15.103:38748) 2024-09-10T08:33:14.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.077+0000 7f978ffff640 1 -- 172.21.15.103:0/3258099738 learned_addr learned my addr 172.21.15.103:0/3258099738 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:14.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.077+0000 7f978ffff640 1 -- 172.21.15.103:0/3258099738 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9798150480 msgr2=0x7f97981ef0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.077+0000 7f978ffff640 1 --2- 172.21.15.103:0/3258099738 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9798150480 0x7f97981ef0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.077+0000 7f9797fff640 1 --2- 172.21.15.103:0/3258099738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979806c650 0x7f97980ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.077+0000 7f978ffff640 1 -- 172.21.15.103:0/3258099738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979806c650 msgr2=0x7f97980ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.077+0000 7f978ffff640 1 --2- 172.21.15.103:0/3258099738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979806c650 0x7f97980ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.077+0000 7f978ffff640 1 -- 172.21.15.103:0/3258099738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97981e2420 con 0x7f97980ca1c0 2024-09-10T08:33:14.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.077+0000 7f9797fff640 1 --2- 172.21.15.103:0/3258099738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979806c650 0x7f97980ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:14.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.077+0000 7f978ffff640 1 --2- 172.21.15.103:0/3258099738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97980ca1c0 0x7f97981554d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f978000e940 tx=0x7f978000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:14.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.077+0000 7f97957fa640 1 -- 172.21.15.103:0/3258099738 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9780017070 con 0x7f97980ca1c0 2024-09-10T08:33:14.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.077+0000 7f97957fa640 1 -- 172.21.15.103:0/3258099738 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f978000ca00 con 0x7f97980ca1c0 2024-09-10T08:33:14.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.077+0000 7f979e2d0640 1 -- 172.21.15.103:0/3258099738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97980adc10 con 0x7f97980ca1c0 2024-09-10T08:33:14.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.077+0000 7f97957fa640 1 -- 172.21.15.103:0/3258099738 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978000cdd0 con 0x7f97980ca1c0 2024-09-10T08:33:14.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.078+0000 7f979e2d0640 1 -- 172.21.15.103:0/3258099738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97981df9a0 con 0x7f97980ca1c0 2024-09-10T08:33:14.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.078+0000 7f979e2d0640 1 --2- 172.21.15.103:0/3258099738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97980ac260 0x7f979814ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.078+0000 7f979e2d0640 1 -- 172.21.15.103:0/3258099738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f97980ada50 con 0x7f97980ac260 2024-09-10T08:33:14.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.079+0000 7f9797fff640 1 --2- 172.21.15.103:0/3258099738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97980ac260 0x7f979814ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.079+0000 7f9797fff640 1 -- 172.21.15.103:0/3258099738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9798156270 con 0x7f97980ac260 2024-09-10T08:33:14.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.079+0000 7f9797fff640 1 --2- 172.21.15.103:0/3258099738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97980ac260 0x7f979814ad10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f97880010e0 tx=0x7f978800db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:14.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.080+0000 7f97957fa640 1 -- 172.21.15.103:0/3258099738 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f978001a070 con 0x7f97980ca1c0 2024-09-10T08:33:14.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.080+0000 7f97957fa640 1 --2- 172.21.15.103:0/3258099738 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f977806be30 0x7f977806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.080+0000 7f979c86d640 1 --2- 172.21.15.103:0/3258099738 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f977806be30 0x7f977806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.080+0000 7f97957fa640 1 -- 172.21.15.103:0/3258099738 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9788005ad0 con 0x7f97980ac260 2024-09-10T08:33:14.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.080+0000 7f97957fa640 1 -- 172.21.15.103:0/3258099738 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f978008b3c0 con 0x7f97980ca1c0 2024-09-10T08:33:14.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.080+0000 7f97957fa640 1 -- 172.21.15.103:0/3258099738 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9788017070 con 0x7f97980ac260 2024-09-10T08:33:14.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.080+0000 7f97957fa640 1 -- 172.21.15.103:0/3258099738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97980ac260 msgr2=0x7f979814ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.080+0000 7f97957fa640 1 --2- 172.21.15.103:0/3258099738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97980ac260 0x7f979814ad10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f97880010e0 tx=0x7f978800db80 comp rx=0 tx=0).stop 2024-09-10T08:33:14.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.080+0000 7f97957fa640 1 -- 172.21.15.103:0/3258099738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97980ac260 msgr2=0x7f979814ad10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:33:14.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.080+0000 7f97957fa640 1 --2- 172.21.15.103:0/3258099738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97980ac260 0x7f979814ad10 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f97880010e0 tx=0x7f978800db80 comp rx=0 tx=0).stop 2024-09-10T08:33:14.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.081+0000 7f979c86d640 1 --2- 172.21.15.103:0/3258099738 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f977806be30 0x7f977806e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9790034000 tx=0x7f979002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:14.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.087+0000 7f979e2d0640 1 --2- 172.21.15.103:0/3258099738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f979814b250 0x7f979814b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.087+0000 7f979e2d0640 1 -- 172.21.15.103:0/3258099738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f979806c430 con 0x7f979814b250 2024-09-10T08:33:14.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.087+0000 7f9797fff640 1 --2- 172.21.15.103:0/3258099738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f979814b250 0x7f979814b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.088+0000 7f9797fff640 1 -- 172.21.15.103:0/3258099738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9798073710 con 0x7f979814b250 2024-09-10T08:33:14.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.088+0000 7f9797fff640 1 --2- 172.21.15.103:0/3258099738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f979814b250 0x7f979814b630 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9788007fd0 tx=0x7f9788000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:14.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.088+0000 7f97957fa640 1 -- 172.21.15.103:0/3258099738 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9788007070 con 0x7f979814b250 2024-09-10T08:33:14.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.088+0000 7f97957fa640 1 -- 172.21.15.103:0/3258099738 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4722 (secure 0 0 0) 0x7f9788007070 con 0x7f979814b250 2024-09-10T08:33:14.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.088+0000 7f97957fa640 1 -- 172.21.15.103:0/3258099738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f979814b250 msgr2=0x7f979814b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.088+0000 7f97957fa640 1 --2- 172.21.15.103:0/3258099738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f979814b250 0x7f979814b630 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9788007fd0 tx=0x7f9788000ed0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.088+0000 7f97957fa640 1 -- 172.21.15.103:0/3258099738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f979814b250 msgr2=0x7f979814b630 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:33:14.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.088+0000 7f97957fa640 1 --2- 172.21.15.103:0/3258099738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f979814b250 0x7f979814b630 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.090 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:33:14.090 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:33:14.090 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:33:14.090 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:33:14.090 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 34, 2024-09-10T08:33:14.090 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 86469, 2024-09-10T08:33:14.090 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:33:14.090 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:33:14.090 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:33:14.090 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:33:14.091 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:14.091 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 11, 2024-09-10T08:33:14.091 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:33:14.091 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:33:14.091 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:33:14.091 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:14.091 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:14.091 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:14.091 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:14.091 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:14.091 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:14.091 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:14.091 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:14.092 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:14.092 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:14.092 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:14.092 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:14.092 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:33:14.092 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:33:14.092 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:14.092 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:14.092 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:14.092 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:14.092 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:14.092 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:14.092 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:14.093 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:14.093 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:14.093 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:14.093 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:14.093 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:14.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.093 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:33:14.093 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:33:14.093 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:33:14.093 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:33:14.093 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:33:14.093 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:33:14.093 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:33:14.094 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:33:14.094 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:33:14.094 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:33:14.094 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:33:14.094 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:33:14.094 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:33:14.094 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:33:14.094 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:33:14.094 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:33:14.094 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:33:14.094 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:14.094 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:14.094 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:14.094 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:14.095 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:14.095 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:14.095 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:14.095 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:14.095 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:14.095 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:14.095 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:14.095 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:14.095 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:33:14.095 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.095 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:33:14.095 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.095 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:33:14.095 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:33:14.096 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:14.096 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:14.096 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.096 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:14.096 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:33:14.096 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:14.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.096 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.096 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:14.096 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:33:14.096 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:14.096 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.097 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:14.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.097 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:33:14.097 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:33:14.097 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:14.097 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:14.097 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:14.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.097 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.097 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:33:14.097 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:33:14.097 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:14.097 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:14.098 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.098 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:14.098 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:33:14.098 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:14.098 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.098 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.098 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:14.098 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:33:14.098 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:14.098 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.098 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:14.098 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.098 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:33:14.098 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:33:14.099 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:14.099 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:14.099 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:14.099 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.099 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.099 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:33:14.099 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:33:14.099 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:14.099 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:14.099 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.099 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:14.099 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:33:14.099 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:14.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.100 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.100 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:14.100 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:33:14.100 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:14.100 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.100 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:14.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.100 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:33:14.100 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:33:14.100 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:14.100 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:14.100 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:14.100 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.101 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:14.101 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.101 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:33:14.101 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:33:14.102 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.102 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:14.102 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:14.102 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:33:14.102 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.102 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:14.102 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:33:14.102 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.103 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:14.103 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:14.103 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:33:14.103 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.103 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:14.103 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:33:14.103 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.103 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:14.103 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:14.103 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:33:14.103 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.103 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:14.103 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.103 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:33:14.104 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:33:14.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.089+0000 7f979e2d0640 1 -- 172.21.15.103:0/3258099738 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f977806be30 msgr2=0x7f977806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.089+0000 7f979e2d0640 1 --2- 172.21.15.103:0/3258099738 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f977806be30 0x7f977806e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9790034000 tx=0x7f979002e000 comp rx=0 tx=0).stop 2024-09-10T08:33:14.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.089+0000 7f979e2d0640 1 -- 172.21.15.103:0/3258099738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97980ca1c0 msgr2=0x7f97981554d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.089+0000 7f979e2d0640 1 --2- 172.21.15.103:0/3258099738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97980ca1c0 0x7f97981554d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f978000e940 tx=0x7f978000ee00 comp rx=0 tx=0).stop 2024-09-10T08:33:14.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.089+0000 7f979c86d640 1 -- 172.21.15.103:0/3258099738 reap_dead start 2024-09-10T08:33:14.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.089+0000 7f979c86d640 1 -- 172.21.15.103:0/3258099738 reap_dead start 2024-09-10T08:33:14.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.089+0000 7f979e2d0640 1 -- 172.21.15.103:0/3258099738 shutdown_connections 2024-09-10T08:33:14.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.089+0000 7f979e2d0640 1 -- 172.21.15.103:0/3258099738 >> 172.21.15.103:0/3258099738 conn(0x7f9798068030 msgr2=0x7f97980cbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:14.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.089+0000 7f979e2d0640 1 -- 172.21.15.103:0/3258099738 shutdown_connections 2024-09-10T08:33:14.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.089+0000 7f979e2d0640 1 -- 172.21.15.103:0/3258099738 wait complete. 2024-09-10T08:33:14.106 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:33:14.106 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:33:14.106 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:33:14.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.216+0000 7fd9ba865640 1 Processor -- start 2024-09-10T08:33:14.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.216+0000 7fd9ba865640 1 -- start start 2024-09-10T08:33:14.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.216+0000 7fd9ba865640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9b406c650 0x7fd9b40c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.217+0000 7fd9ba865640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9b415a7c0 con 0x7fd9b40ca1c0 2024-09-10T08:33:14.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.217+0000 7fd9ba865640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9b4159a00 con 0x7fd9b4150480 2024-09-10T08:33:14.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.217+0000 7fd9ba865640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd9b406c240 con 0x7fd9b406c650 2024-09-10T08:33:14.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.217+0000 7fd9b37fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9b406c650 0x7fd9b40c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.217+0000 7fd9b3fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd9b4150480 0x7fd9b40c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:37482/0 (socket says 172.21.15.103:37482) 2024-09-10T08:33:14.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.217+0000 7fd9b3fff640 1 -- 172.21.15.103:0/2161595903 learned_addr learned my addr 172.21.15.103:0/2161595903 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:33:14.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.217+0000 7fd9b2ffd640 1 -- 172.21.15.103:0/2161595903 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3954358374 0 0) 0x7fd9b415a7c0 con 0x7fd9b40ca1c0 2024-09-10T08:33:14.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.217+0000 7fd9b2ffd640 1 -- 172.21.15.103:0/2161595903 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd99c003520 con 0x7fd9b40ca1c0 2024-09-10T08:33:14.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.217+0000 7fd9b37fe640 1 -- 172.21.15.103:0/2161595903 >> v1:172.21.15.154:6789/0 conn(0x7fd9b4150480 legacy=0x7fd9b40c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.217+0000 7fd9b37fe640 1 -- 172.21.15.103:0/2161595903 >> v1:172.21.15.103:6789/0 conn(0x7fd9b40ca1c0 legacy=0x7fd9b4160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.217+0000 7fd9b2ffd640 1 -- 172.21.15.103:0/2161595903 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1567706797 0 0) 0x7fd9b4159a00 con 0x7fd9b4150480 2024-09-10T08:33:14.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.217+0000 7fd9b37fe640 1 -- 172.21.15.103:0/2161595903 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b4159ce0 con 0x7fd9b406c650 2024-09-10T08:33:14.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.219+0000 7fd9b37fe640 1 --2- 172.21.15.103:0/2161595903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b406c650 0x7fd9b40c9c80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd9a80097a0 tx=0x7fd9a802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82aefbca516f77fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:14.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.219+0000 7fd9b2ffd640 1 -- 172.21.15.103:0/2161595903 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8037070 con 0x7fd9b406c650 2024-09-10T08:33:14.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.219+0000 7fd9b2ffd640 1 -- 172.21.15.103:0/2161595903 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a8032440 con 0x7fd9b406c650 2024-09-10T08:33:14.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.219+0000 7fd9b2ffd640 1 -- 172.21.15.103:0/2161595903 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8032810 con 0x7fd9b406c650 2024-09-10T08:33:14.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.220+0000 7fd9ba865640 1 -- 172.21.15.103:0/2161595903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b406c650 msgr2=0x7fd9b40c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.220+0000 7fd9ba865640 1 --2- 172.21.15.103:0/2161595903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b406c650 0x7fd9b40c9c80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd9a80097a0 tx=0x7fd9a802a230 comp rx=0 tx=0).stop 2024-09-10T08:33:14.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.220+0000 7fd9ba865640 1 -- 172.21.15.103:0/2161595903 shutdown_connections 2024-09-10T08:33:14.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.220+0000 7fd9ba865640 1 --2- 172.21.15.103:0/2161595903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b406c650 0x7fd9b40c9c80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.220+0000 7fd9ba865640 1 -- 172.21.15.103:0/2161595903 >> 172.21.15.103:0/2161595903 conn(0x7fd9b4068030 msgr2=0x7fd9b4073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:14.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.220+0000 7fd9ba865640 1 -- 172.21.15.103:0/2161595903 shutdown_connections 2024-09-10T08:33:14.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.220+0000 7fd9ba865640 1 -- 172.21.15.103:0/2161595903 wait complete. 2024-09-10T08:33:14.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.221+0000 7fd9ba865640 1 Processor -- start 2024-09-10T08:33:14.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.221+0000 7fd9ba865640 1 -- start start 2024-09-10T08:33:14.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.222+0000 7fd9ba865640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b406c650 0x7fd9b4159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.222+0000 7fd9ba865640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9b40ca1c0 0x7fd9b41eefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.222+0000 7fd9ba865640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9b4150480 0x7fd9b41ef500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.222+0000 7fd9ba865640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b406d270 con 0x7fd9b40ca1c0 2024-09-10T08:33:14.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.222+0000 7fd9ba865640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b415a330 con 0x7fd9b406c650 2024-09-10T08:33:14.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.222+0000 7fd9ba865640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd9b40ca5f0 con 0x7fd9b4150480 2024-09-10T08:33:14.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.222+0000 7fd9b37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9b40ca1c0 0x7fd9b41eefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.222+0000 7fd9b37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9b40ca1c0 0x7fd9b41eefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38778/0 (socket says 172.21.15.103:38778) 2024-09-10T08:33:14.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.222+0000 7fd9b37fe640 1 -- 172.21.15.103:0/446991979 learned_addr learned my addr 172.21.15.103:0/446991979 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:14.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.223+0000 7fd9b3fff640 1 --2- 172.21.15.103:0/446991979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b406c650 0x7fd9b4159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.223+0000 7fd9b37fe640 1 -- 172.21.15.103:0/446991979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9b4150480 msgr2=0x7fd9b41ef500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:33:14.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.223+0000 7fd9b37fe640 1 --2- 172.21.15.103:0/446991979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9b4150480 0x7fd9b41ef500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.223+0000 7fd9b37fe640 1 -- 172.21.15.103:0/446991979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b406c650 msgr2=0x7fd9b4159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.223+0000 7fd9b37fe640 1 --2- 172.21.15.103:0/446991979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b406c650 0x7fd9b4159090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.223+0000 7fd9b37fe640 1 -- 172.21.15.103:0/446991979 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b4146530 con 0x7fd9b40ca1c0 2024-09-10T08:33:14.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.223+0000 7fd9b3fff640 1 --2- 172.21.15.103:0/446991979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b406c650 0x7fd9b4159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:14.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.223+0000 7fd9b37fe640 1 --2- 172.21.15.103:0/446991979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9b40ca1c0 0x7fd9b41eefc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8035040 tx=0x7fd9a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:14.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.223+0000 7fd9b0ff9640 1 -- 172.21.15.103:0/446991979 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8041020 con 0x7fd9b40ca1c0 2024-09-10T08:33:14.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.223+0000 7fd9b0ff9640 1 -- 172.21.15.103:0/446991979 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a803d6e0 con 0x7fd9b40ca1c0 2024-09-10T08:33:14.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.223+0000 7fd9b0ff9640 1 -- 172.21.15.103:0/446991979 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8037040 con 0x7fd9b40ca1c0 2024-09-10T08:33:14.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.223+0000 7fd9ba865640 1 -- 172.21.15.103:0/446991979 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9b4146810 con 0x7fd9b40ca1c0 2024-09-10T08:33:14.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.223+0000 7fd9ba865640 1 -- 172.21.15.103:0/446991979 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9b4155070 con 0x7fd9b40ca1c0 2024-09-10T08:33:14.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.224+0000 7fd9ba865640 1 --2- 172.21.15.103:0/446991979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b40c5ee0 0x7fd9b40ab880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.224+0000 7fd9ba865640 1 -- 172.21.15.103:0/446991979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b4156270 con 0x7fd9b40c5ee0 2024-09-10T08:33:14.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.225+0000 7fd9b3fff640 1 --2- 172.21.15.103:0/446991979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b40c5ee0 0x7fd9b40ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.225+0000 7fd9b0ff9640 1 -- 172.21.15.103:0/446991979 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd9a8044020 con 0x7fd9b40ca1c0 2024-09-10T08:33:14.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.226+0000 7fd9b0ff9640 1 --2- 172.21.15.103:0/446991979 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd9a006be30 0x7fd9a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.226+0000 7fd9b0ff9640 1 -- 172.21.15.103:0/446991979 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fd9a80ab940 con 0x7fd9b40ca1c0 2024-09-10T08:33:14.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.226+0000 7fd9b3fff640 1 -- 172.21.15.103:0/446991979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9b406c430 con 0x7fd9b40c5ee0 2024-09-10T08:33:14.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.226+0000 7fd9b8e02640 1 --2- 172.21.15.103:0/446991979 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd9a006be30 0x7fd9a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.226+0000 7fd9b8e02640 1 --2- 172.21.15.103:0/446991979 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd9a006be30 0x7fd9a006e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac001b50 tx=0x7fd9ac007c20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:14.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.226+0000 7fd9b3fff640 1 --2- 172.21.15.103:0/446991979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b40c5ee0 0x7fd9b40ab880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4000c00 tx=0x7fd9a400d950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:14.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.227+0000 7fd9b0ff9640 1 -- 172.21.15.103:0/446991979 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4018070 con 0x7fd9b40c5ee0 2024-09-10T08:33:14.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.227+0000 7fd9b0ff9640 1 -- 172.21.15.103:0/446991979 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd9a4007560 con 0x7fd9b40c5ee0 2024-09-10T08:33:14.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.227+0000 7fd9b0ff9640 1 -- 172.21.15.103:0/446991979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b40c5ee0 msgr2=0x7fd9b40ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.227+0000 7fd9b0ff9640 1 --2- 172.21.15.103:0/446991979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b40c5ee0 0x7fd9b40ab880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4000c00 tx=0x7fd9a400d950 comp rx=0 tx=0).stop 2024-09-10T08:33:14.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.227+0000 7fd9b0ff9640 1 -- 172.21.15.103:0/446991979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b40c5ee0 msgr2=0x7fd9b40ab880 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:33:14.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.227+0000 7fd9b0ff9640 1 --2- 172.21.15.103:0/446991979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b40c5ee0 0x7fd9b40ab880 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.236+0000 7fd9ba865640 1 --2- 172.21.15.103:0/446991979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b414d4d0 0x7fd9b40abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.236+0000 7fd9ba865640 1 -- 172.21.15.103:0/446991979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b40cb310 con 0x7fd9b414d4d0 2024-09-10T08:33:14.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.237+0000 7fd9b3fff640 1 --2- 172.21.15.103:0/446991979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b414d4d0 0x7fd9b40abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.237+0000 7fd9b3fff640 1 -- 172.21.15.103:0/446991979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd9b41595d0 con 0x7fd9b414d4d0 2024-09-10T08:33:14.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.237+0000 7fd9b3fff640 1 --2- 172.21.15.103:0/446991979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b414d4d0 0x7fd9b40abdc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4015000 tx=0x7fd9a4000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:14.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.238+0000 7fd9b0ff9640 1 -- 172.21.15.103:0/446991979 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4018050 con 0x7fd9b414d4d0 2024-09-10T08:33:14.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.238+0000 7fd9b0ff9640 1 -- 172.21.15.103:0/446991979 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4720 (secure 0 0 0) 0x7fd9a4019040 con 0x7fd9b414d4d0 2024-09-10T08:33:14.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.238+0000 7fd9b0ff9640 1 -- 172.21.15.103:0/446991979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b414d4d0 msgr2=0x7fd9b40abdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.238+0000 7fd9b0ff9640 1 --2- 172.21.15.103:0/446991979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b414d4d0 0x7fd9b40abdc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4015000 tx=0x7fd9a4000ed0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.238+0000 7fd9b0ff9640 1 -- 172.21.15.103:0/446991979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b414d4d0 msgr2=0x7fd9b40abdc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:33:14.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.238+0000 7fd9b0ff9640 1 --2- 172.21.15.103:0/446991979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b414d4d0 0x7fd9b40abdc0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.239 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:33:14.239 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:33:14.239 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:33:14.240 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:33:14.240 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 34, 2024-09-10T08:33:14.240 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 26930, 2024-09-10T08:33:14.240 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:33:14.240 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:33:14.240 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:33:14.240 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:33:14.240 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:14.240 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 12, 2024-09-10T08:33:14.240 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:33:14.240 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:33:14.240 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:33:14.240 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:14.241 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:14.241 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:14.241 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:14.241 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:14.241 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:14.241 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:14.241 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:14.241 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:14.241 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:14.241 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:14.241 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:14.241 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:33:14.241 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:33:14.242 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:14.242 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:14.242 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:14.242 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:14.242 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:14.242 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:14.242 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:14.242 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:14.242 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:14.242 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:14.242 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:14.242 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:14.242 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.242 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:33:14.243 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:33:14.243 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:33:14.243 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:33:14.243 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:33:14.243 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:33:14.243 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:33:14.243 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:33:14.243 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:33:14.243 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:33:14.243 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:33:14.243 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:33:14.243 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:33:14.244 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:33:14.244 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:33:14.244 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:33:14.244 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:33:14.244 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:14.244 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:14.244 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:14.244 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:14.244 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:14.244 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:14.244 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:14.244 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:14.244 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:14.245 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:14.245 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:14.245 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:14.245 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:33:14.245 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.245 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:33:14.245 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.245 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:33:14.245 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:33:14.246 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:14.246 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:14.246 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.246 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:14.246 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:33:14.246 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:14.246 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.246 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.246 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:14.246 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:33:14.246 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:14.246 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.246 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:14.247 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.247 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:33:14.247 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:33:14.247 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:14.247 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:14.247 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:14.247 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.247 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.247 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:33:14.247 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:33:14.247 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:14.247 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:14.247 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.247 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:14.248 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:33:14.248 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:14.248 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.248 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.248 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:14.248 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:33:14.248 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:14.248 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.248 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:14.248 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.248 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:33:14.248 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:33:14.248 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:14.249 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:14.249 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:14.249 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.249 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.249 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:33:14.249 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:33:14.249 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:14.249 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:14.249 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.249 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:14.249 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:33:14.249 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:14.249 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.250 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.250 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:14.250 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:33:14.250 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:14.250 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.250 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:14.250 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.250 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:33:14.250 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:33:14.250 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:14.250 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:14.250 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:14.250 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.251 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:14.251 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.251 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:33:14.251 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:33:14.251 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.251 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:14.251 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:14.251 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:33:14.251 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.251 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:14.251 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:33:14.251 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.251 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:14.252 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:14.252 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:33:14.252 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.252 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:14.252 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:33:14.252 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.252 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:14.252 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:14.252 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:33:14.252 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.252 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:14.252 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.252 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:33:14.253 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:33:14.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.238+0000 7fd9ba865640 1 -- 172.21.15.103:0/446991979 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd9a006be30 msgr2=0x7fd9a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.238+0000 7fd9ba865640 1 --2- 172.21.15.103:0/446991979 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd9a006be30 0x7fd9a006e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac001b50 tx=0x7fd9ac007c20 comp rx=0 tx=0).stop 2024-09-10T08:33:14.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.238+0000 7fd9ba865640 1 -- 172.21.15.103:0/446991979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9b40ca1c0 msgr2=0x7fd9b41eefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.238+0000 7fd9ba865640 1 --2- 172.21.15.103:0/446991979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9b40ca1c0 0x7fd9b41eefc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8035040 tx=0x7fd9a80046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.238+0000 7fd9b8e02640 1 -- 172.21.15.103:0/446991979 reap_dead start 2024-09-10T08:33:14.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.238+0000 7fd9b8e02640 1 -- 172.21.15.103:0/446991979 reap_dead start 2024-09-10T08:33:14.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.238+0000 7fd9ba865640 1 -- 172.21.15.103:0/446991979 shutdown_connections 2024-09-10T08:33:14.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.238+0000 7fd9ba865640 1 -- 172.21.15.103:0/446991979 >> 172.21.15.103:0/446991979 conn(0x7fd9b4068030 msgr2=0x7fd9b41552c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:14.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.238+0000 7fd9ba865640 1 -- 172.21.15.103:0/446991979 shutdown_connections 2024-09-10T08:33:14.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.238+0000 7fd9ba865640 1 -- 172.21.15.103:0/446991979 wait complete. 2024-09-10T08:33:14.255 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:33:14.255 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:33:14.255 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:33:14.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.365+0000 7f2c4a36d640 1 Processor -- start 2024-09-10T08:33:14.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.365+0000 7f2c4a36d640 1 -- start start 2024-09-10T08:33:14.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.365+0000 7f2c4a36d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2c44150480 0x7f2c440c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.365+0000 7f2c4a36d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c440ca390 0x7f2c440c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.365+0000 7f2c4a36d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c4415a7c0 con 0x7f2c4406c650 2024-09-10T08:33:14.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.365+0000 7f2c4a36d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f2c4406c240 con 0x7f2c44150480 2024-09-10T08:33:14.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.365+0000 7f2c4a36d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2c4415a330 con 0x7f2c440ca390 2024-09-10T08:33:14.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.366+0000 7f2c43fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2c44150480 0x7f2c440c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.366+0000 7f2c437fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2c4406c650 0x7f2c440c9c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45190/0 (socket says 172.21.15.103:45190) 2024-09-10T08:33:14.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.366+0000 7f2c437fe640 1 -- 172.21.15.103:0/445277064 learned_addr learned my addr 172.21.15.103:0/445277064 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:33:14.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.366+0000 7f2c4890a640 1 --2- 172.21.15.103:0/445277064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c440ca390 0x7f2c440c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.366+0000 7f2c43fff640 1 -- 172.21.15.103:0/445277064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c440ca390 msgr2=0x7f2c440c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:14.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.366+0000 7f2c43fff640 1 --2- 172.21.15.103:0/445277064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c440ca390 0x7f2c440c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.366+0000 7f2c43fff640 1 -- 172.21.15.103:0/445277064 >> v1:172.21.15.103:6789/0 conn(0x7f2c4406c650 legacy=0x7f2c440c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.366+0000 7f2c42ffd640 1 -- 172.21.15.103:0/445277064 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3620465893 0 0) 0x7f2c4415a7c0 con 0x7f2c4406c650 2024-09-10T08:33:14.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.366+0000 7f2c43fff640 1 -- 172.21.15.103:0/445277064 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c44159a00 con 0x7f2c44150480 2024-09-10T08:33:14.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.367+0000 7f2c43fff640 1 --2- 172.21.15.103:0/445277064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c44150480 0x7f2c440c7a90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2c340097a0 tx=0x7f2c3402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71182c7e8fc35451 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:14.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.367+0000 7f2c42ffd640 1 -- 172.21.15.103:0/445277064 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34037070 con 0x7f2c44150480 2024-09-10T08:33:14.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.367+0000 7f2c42ffd640 1 -- 172.21.15.103:0/445277064 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c34032440 con 0x7f2c44150480 2024-09-10T08:33:14.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.367+0000 7f2c42ffd640 1 -- 172.21.15.103:0/445277064 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34032810 con 0x7f2c44150480 2024-09-10T08:33:14.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.367+0000 7f2c4a36d640 1 -- 172.21.15.103:0/445277064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c44150480 msgr2=0x7f2c440c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.367+0000 7f2c4a36d640 1 --2- 172.21.15.103:0/445277064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c44150480 0x7f2c440c7a90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2c340097a0 tx=0x7f2c3402a180 comp rx=0 tx=0).stop 2024-09-10T08:33:14.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.368+0000 7f2c4a36d640 1 -- 172.21.15.103:0/445277064 shutdown_connections 2024-09-10T08:33:14.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.368+0000 7f2c4a36d640 1 --2- 172.21.15.103:0/445277064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c440ca390 0x7f2c440c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.368+0000 7f2c4a36d640 1 --2- 172.21.15.103:0/445277064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c44150480 0x7f2c440c7a90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.368+0000 7f2c4a36d640 1 -- 172.21.15.103:0/445277064 >> 172.21.15.103:0/445277064 conn(0x7f2c44068030 msgr2=0x7f2c44073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:14.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.368+0000 7f2c4a36d640 1 -- 172.21.15.103:0/445277064 shutdown_connections 2024-09-10T08:33:14.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.368+0000 7f2c4a36d640 1 -- 172.21.15.103:0/445277064 wait complete. 2024-09-10T08:33:14.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.369+0000 7f2c4a36d640 1 Processor -- start 2024-09-10T08:33:14.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.369+0000 7f2c4a36d640 1 -- start start 2024-09-10T08:33:14.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.370+0000 7f2c4a36d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c4406c650 0x7f2c440aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.370+0000 7f2c4a36d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c440ca390 0x7f2c440acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.370+0000 7f2c4a36d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c44150480 0x7f2c44148ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.370+0000 7f2c4a36d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4406d270 con 0x7f2c440ca390 2024-09-10T08:33:14.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.370+0000 7f2c4a36d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2c44159fc0 con 0x7f2c44150480 2024-09-10T08:33:14.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.370+0000 7f2c4a36d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2c44156270 con 0x7f2c4406c650 2024-09-10T08:33:14.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.370+0000 7f2c437fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c440ca390 0x7f2c440acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.370+0000 7f2c437fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c440ca390 0x7f2c440acde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38804/0 (socket says 172.21.15.103:38804) 2024-09-10T08:33:14.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.370+0000 7f2c437fe640 1 -- 172.21.15.103:0/3407861663 learned_addr learned my addr 172.21.15.103:0/3407861663 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:14.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.370+0000 7f2c43fff640 1 --2- 172.21.15.103:0/3407861663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c4406c650 0x7f2c440aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.370+0000 7f2c4890a640 1 --2- 172.21.15.103:0/3407861663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c44150480 0x7f2c44148ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.370+0000 7f2c437fe640 1 -- 172.21.15.103:0/3407861663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c4406c650 msgr2=0x7f2c440aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.370+0000 7f2c437fe640 1 --2- 172.21.15.103:0/3407861663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c4406c650 0x7f2c440aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.370+0000 7f2c437fe640 1 -- 172.21.15.103:0/3407861663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c44150480 msgr2=0x7f2c44148ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.370+0000 7f2c437fe640 1 --2- 172.21.15.103:0/3407861663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c44150480 0x7f2c44148ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.370+0000 7f2c437fe640 1 -- 172.21.15.103:0/3407861663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c44149e00 con 0x7f2c440ca390 2024-09-10T08:33:14.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.370+0000 7f2c437fe640 1 --2- 172.21.15.103:0/3407861663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c440ca390 0x7f2c440acde0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800c430 tx=0x7f2c3800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:14.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.371+0000 7f2c40ff9640 1 -- 172.21.15.103:0/3407861663 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c380074e0 con 0x7f2c440ca390 2024-09-10T08:33:14.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.371+0000 7f2c40ff9640 1 -- 172.21.15.103:0/3407861663 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c380047e0 con 0x7f2c440ca390 2024-09-10T08:33:14.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.371+0000 7f2c40ff9640 1 -- 172.21.15.103:0/3407861663 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c38004bd0 con 0x7f2c440ca390 2024-09-10T08:33:14.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.371+0000 7f2c4a36d640 1 -- 172.21.15.103:0/3407861663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c440b0b50 con 0x7f2c440ca390 2024-09-10T08:33:14.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.371+0000 7f2c4a36d640 1 -- 172.21.15.103:0/3407861663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c440b0870 con 0x7f2c440ca390 2024-09-10T08:33:14.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.372+0000 7f2c4a36d640 1 --2- 172.21.15.103:0/3407861663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c44149530 0x7f2c4414ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.372+0000 7f2c4a36d640 1 -- 172.21.15.103:0/3407861663 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2c440aff80 con 0x7f2c44149530 2024-09-10T08:33:14.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.372+0000 7f2c43fff640 1 --2- 172.21.15.103:0/3407861663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c44149530 0x7f2c4414ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.372+0000 7f2c43fff640 1 -- 172.21.15.103:0/3407861663 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2c440c67a0 con 0x7f2c44149530 2024-09-10T08:33:14.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.372+0000 7f2c40ff9640 1 -- 172.21.15.103:0/3407861663 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2c38011070 con 0x7f2c440ca390 2024-09-10T08:33:14.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.373+0000 7f2c43fff640 1 --2- 172.21.15.103:0/3407861663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c44149530 0x7f2c4414ad10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2c440c6110 tx=0x7f2c340046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:14.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.373+0000 7f2c40ff9640 1 --2- 172.21.15.103:0/3407861663 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2c3006be60 0x7f2c3006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.373+0000 7f2c40ff9640 1 -- 172.21.15.103:0/3407861663 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f2c3808ac30 con 0x7f2c440ca390 2024-09-10T08:33:14.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.373+0000 7f2c4890a640 1 --2- 172.21.15.103:0/3407861663 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2c3006be60 0x7f2c3006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.373+0000 7f2c40ff9640 1 -- 172.21.15.103:0/3407861663 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34041030 con 0x7f2c44149530 2024-09-10T08:33:14.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.373+0000 7f2c40ff9640 1 -- 172.21.15.103:0/3407861663 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2c34038040 con 0x7f2c44149530 2024-09-10T08:33:14.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.373+0000 7f2c40ff9640 1 -- 172.21.15.103:0/3407861663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c44149530 msgr2=0x7f2c4414ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.373+0000 7f2c40ff9640 1 --2- 172.21.15.103:0/3407861663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c44149530 0x7f2c4414ad10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2c440c6110 tx=0x7f2c340046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.373+0000 7f2c40ff9640 1 -- 172.21.15.103:0/3407861663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c44149530 msgr2=0x7f2c4414ad10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:33:14.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.373+0000 7f2c40ff9640 1 --2- 172.21.15.103:0/3407861663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c44149530 0x7f2c4414ad10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.373+0000 7f2c4890a640 1 --2- 172.21.15.103:0/3407861663 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2c3006be60 0x7f2c3006e320 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c011340 tx=0x7f2c3c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:14.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.380+0000 7f2c4a36d640 1 --2- 172.21.15.103:0/3407861663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c44149910 0x7f2c4414b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.380+0000 7f2c4a36d640 1 -- 172.21.15.103:0/3407861663 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2c440c7040 con 0x7f2c44149910 2024-09-10T08:33:14.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.380+0000 7f2c43fff640 1 --2- 172.21.15.103:0/3407861663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c44149910 0x7f2c4414b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.380+0000 7f2c43fff640 1 -- 172.21.15.103:0/3407861663 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2c440c9c80 con 0x7f2c44149910 2024-09-10T08:33:14.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.381+0000 7f2c43fff640 1 --2- 172.21.15.103:0/3407861663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c44149910 0x7f2c4414b250 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2c3402a1c0 tx=0x7f2c34008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:14.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.381+0000 7f2c40ff9640 1 -- 172.21.15.103:0/3407861663 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34041050 con 0x7f2c44149910 2024-09-10T08:33:14.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.381+0000 7f2c40ff9640 1 -- 172.21.15.103:0/3407861663 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f2c340093c0 con 0x7f2c44149910 2024-09-10T08:33:14.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.381+0000 7f2c40ff9640 1 -- 172.21.15.103:0/3407861663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c44149910 msgr2=0x7f2c4414b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.381+0000 7f2c40ff9640 1 --2- 172.21.15.103:0/3407861663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c44149910 0x7f2c4414b250 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2c3402a1c0 tx=0x7f2c34008030 comp rx=0 tx=0).stop 2024-09-10T08:33:14.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.381+0000 7f2c40ff9640 1 -- 172.21.15.103:0/3407861663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c44149910 msgr2=0x7f2c4414b250 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:33:14.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.381+0000 7f2c40ff9640 1 --2- 172.21.15.103:0/3407861663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c44149910 0x7f2c4414b250 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2c3402a1c0 tx=0x7f2c34008030 comp rx=0 tx=0).stop 2024-09-10T08:33:14.391 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:33:14.391 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:33:14.391 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:33:14.391 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:33:14.392 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 34, 2024-09-10T08:33:14.392 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 138541, 2024-09-10T08:33:14.392 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:33:14.392 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:33:14.392 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:33:14.393 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:33:14.393 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:14.393 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 12, 2024-09-10T08:33:14.393 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:33:14.393 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:33:14.393 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:33:14.393 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:14.394 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:14.394 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:14.394 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:14.394 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:14.394 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:14.395 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:14.395 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:14.395 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:14.395 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:14.395 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:14.395 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:14.396 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:33:14.396 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:33:14.396 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:14.396 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:14.396 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:14.396 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:14.397 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:14.397 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:14.397 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:14.397 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:14.397 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:14.397 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:14.397 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:14.397 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:14.397 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.397 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:33:14.397 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:33:14.397 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:33:14.398 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:33:14.398 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:33:14.398 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:33:14.398 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:33:14.398 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:33:14.398 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:33:14.398 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:33:14.398 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:33:14.398 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:33:14.398 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:33:14.398 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:33:14.399 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:33:14.399 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:33:14.399 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:33:14.399 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:14.399 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:14.399 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:14.399 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:14.399 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:14.399 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:14.399 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:14.399 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:14.399 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:14.399 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:14.399 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:14.400 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:14.400 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:33:14.400 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.400 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:33:14.400 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.400 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:33:14.400 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:33:14.400 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:14.400 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:14.400 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.400 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:14.400 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:33:14.400 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:14.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.401 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.401 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:14.401 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:33:14.401 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:14.401 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.401 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:14.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.401 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:33:14.401 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:33:14.401 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:14.402 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:14.402 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:14.402 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.402 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.402 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:33:14.402 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:33:14.402 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:14.402 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:14.402 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.402 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:14.403 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:33:14.403 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:14.403 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.403 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.403 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:14.403 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:33:14.403 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:14.403 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.403 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:14.404 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.404 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:33:14.404 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:33:14.404 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:14.404 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:14.404 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:14.404 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.404 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.404 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:33:14.404 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:33:14.404 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:14.404 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:14.405 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.405 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:14.405 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:33:14.405 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:14.405 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.405 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.405 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:14.405 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:33:14.405 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:14.405 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.405 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:14.405 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.406 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:33:14.406 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:33:14.406 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:14.406 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:14.406 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:14.406 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.406 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:14.406 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.406 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:33:14.406 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:33:14.406 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.406 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:14.406 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:14.407 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:33:14.407 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.407 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:14.407 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:33:14.407 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.407 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:14.407 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:14.407 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:33:14.407 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.407 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:14.407 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:33:14.407 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.407 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:14.407 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:14.407 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-10T08:33:14.408 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.408 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:14.408 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:33:14.408 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.408 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:14.408 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:14.408 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:33:14.408 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.408 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:14.408 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:33:14.408 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:14.408 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:14.408 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:14.408 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:33:14.409 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:14.409 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:14.409 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:14.409 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:33:14.409 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:33:14.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.381+0000 7f2c4a36d640 1 -- 172.21.15.103:0/3407861663 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2c3006be60 msgr2=0x7f2c3006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.381+0000 7f2c4a36d640 1 --2- 172.21.15.103:0/3407861663 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2c3006be60 0x7f2c3006e320 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c011340 tx=0x7f2c3c00b040 comp rx=0 tx=0).stop 2024-09-10T08:33:14.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.381+0000 7f2c4a36d640 1 -- 172.21.15.103:0/3407861663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c440ca390 msgr2=0x7f2c440acde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.381+0000 7f2c4a36d640 1 --2- 172.21.15.103:0/3407861663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c440ca390 0x7f2c440acde0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800c430 tx=0x7f2c3800c8f0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.381+0000 7f2c4890a640 1 -- 172.21.15.103:0/3407861663 reap_dead start 2024-09-10T08:33:14.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.381+0000 7f2c4890a640 1 -- 172.21.15.103:0/3407861663 reap_dead start 2024-09-10T08:33:14.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.382+0000 7f2c4a36d640 1 -- 172.21.15.103:0/3407861663 shutdown_connections 2024-09-10T08:33:14.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.382+0000 7f2c4a36d640 1 -- 172.21.15.103:0/3407861663 >> 172.21.15.103:0/3407861663 conn(0x7f2c44068030 msgr2=0x7f2c440cbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:14.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.382+0000 7f2c4a36d640 1 -- 172.21.15.103:0/3407861663 shutdown_connections 2024-09-10T08:33:14.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.382+0000 7f2c4a36d640 1 -- 172.21.15.103:0/3407861663 wait complete. 2024-09-10T08:33:14.411 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:33:14.412 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-10T08:33:14.412 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-10T08:33:14.412 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-10T08:33:14.412 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-10T08:33:14.412 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T08:33:14.412 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:33:14.424 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T08:33:14.424 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-10T08:33:14.424 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:33:14.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.570+0000 7ff7a97b7640 1 Processor -- start 2024-09-10T08:33:14.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.570+0000 7ff7a97b7640 1 -- start start 2024-09-10T08:33:14.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.571+0000 7ff7a97b7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff7a4154ac0 0x7ff7a40708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.571+0000 7ff7a97b7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7a40703b0 0x7ff7a415e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.571+0000 7ff7a97b7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7a4154ff0 con 0x7ff7a4151780 2024-09-10T08:33:14.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.571+0000 7ff7a97b7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff7a406f5f0 con 0x7ff7a4154ac0 2024-09-10T08:33:14.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.571+0000 7ff7a97b7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff7a406f8d0 con 0x7ff7a40703b0 2024-09-10T08:33:14.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.572+0000 7ff79bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff7a4154ac0 0x7ff7a40708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.572+0000 7ff7a37fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7a40703b0 0x7ff7a415e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.572+0000 7ff79bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff7a4154ac0 0x7ff7a40708a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:33650/0 (socket says 172.21.15.103:33650) 2024-09-10T08:33:14.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.572+0000 7ff79bfff640 1 -- 172.21.15.103:0/2195476616 learned_addr learned my addr 172.21.15.103:0/2195476616 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:14.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.572+0000 7ff79bfff640 1 -- 172.21.15.103:0/2195476616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7a40703b0 msgr2=0x7ff7a415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:14.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.572+0000 7ff79bfff640 1 --2- 172.21.15.103:0/2195476616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7a40703b0 0x7ff7a415e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.572+0000 7ff79bfff640 1 -- 172.21.15.103:0/2195476616 >> v1:172.21.15.154:6789/0 conn(0x7ff7a4151780 legacy=0x7ff7a4155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.572+0000 7ff79bfff640 1 -- 172.21.15.103:0/2195476616 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a406fbb0 con 0x7ff7a4154ac0 2024-09-10T08:33:14.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.573+0000 7ff79bfff640 1 --2- 172.21.15.103:0/2195476616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7a4154ac0 0x7ff7a40708a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009870 tx=0x7ff78c02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c02f993d692fd841 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:14.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.573+0000 7ff7a27fc640 1 -- 172.21.15.103:0/2195476616 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c037070 con 0x7ff7a4154ac0 2024-09-10T08:33:14.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.573+0000 7ff7a27fc640 1 -- 172.21.15.103:0/2195476616 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff78c032440 con 0x7ff7a4154ac0 2024-09-10T08:33:14.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.573+0000 7ff7a27fc640 1 -- 172.21.15.103:0/2195476616 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c032810 con 0x7ff7a4154ac0 2024-09-10T08:33:14.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.574+0000 7ff7a97b7640 1 -- 172.21.15.103:0/2195476616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7a4154ac0 msgr2=0x7ff7a40708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.574+0000 7ff7a97b7640 1 --2- 172.21.15.103:0/2195476616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7a4154ac0 0x7ff7a40708a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009870 tx=0x7ff78c02a130 comp rx=0 tx=0).stop 2024-09-10T08:33:14.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.574+0000 7ff7a97b7640 1 -- 172.21.15.103:0/2195476616 shutdown_connections 2024-09-10T08:33:14.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.574+0000 7ff7a97b7640 1 --2- 172.21.15.103:0/2195476616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7a40703b0 0x7ff7a415e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.574+0000 7ff7a97b7640 1 --2- 172.21.15.103:0/2195476616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7a4154ac0 0x7ff7a40708a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.574+0000 7ff7a97b7640 1 -- 172.21.15.103:0/2195476616 >> 172.21.15.103:0/2195476616 conn(0x7ff7a40c6980 msgr2=0x7ff7a40c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:14.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.574+0000 7ff7a97b7640 1 -- 172.21.15.103:0/2195476616 shutdown_connections 2024-09-10T08:33:14.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.574+0000 7ff7a97b7640 1 -- 172.21.15.103:0/2195476616 wait complete. 2024-09-10T08:33:14.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.575+0000 7ff7a97b7640 1 Processor -- start 2024-09-10T08:33:14.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.575+0000 7ff7a97b7640 1 -- start start 2024-09-10T08:33:14.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.576+0000 7ff7a97b7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7a40703b0 0x7ff7a40ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.576+0000 7ff7a97b7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7a4151780 0x7ff7a414bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.576+0000 7ff7a97b7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a4154ac0 0x7ff7a414c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.576+0000 7ff7a97b7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a4155c70 con 0x7ff7a4154ac0 2024-09-10T08:33:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.576+0000 7ff7a97b7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a4073f30 con 0x7ff7a4151780 2024-09-10T08:33:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.576+0000 7ff7a97b7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff7a40c90c0 con 0x7ff7a40703b0 2024-09-10T08:33:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.576+0000 7ff7a37fe640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a4154ac0 msgr2=0x7ff7a414c0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:33:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.576+0000 7ff7a37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a4154ac0 0x7ff7a414c0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:33:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.576+0000 7ff7a2ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7a40703b0 0x7ff7a40ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.576+0000 7ff79bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7a4151780 0x7ff7a414bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.576+0000 7ff7a2ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7a40703b0 0x7ff7a40ad3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:55494/0 (socket says 172.21.15.103:55494) 2024-09-10T08:33:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.576+0000 7ff7a2ffd640 1 -- 172.21.15.103:0/1058028039 learned_addr learned my addr 172.21.15.103:0/1058028039 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.577+0000 7ff79bfff640 1 -- 172.21.15.103:0/1058028039 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7a40703b0 msgr2=0x7ff7a40ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.577+0000 7ff79bfff640 1 --2- 172.21.15.103:0/1058028039 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7a40703b0 0x7ff7a40ad3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.577+0000 7ff79bfff640 1 -- 172.21.15.103:0/1058028039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a4154ac0 msgr2=0x7ff7a414c0f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:33:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.577+0000 7ff79bfff640 1 --2- 172.21.15.103:0/1058028039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a4154ac0 0x7ff7a414c0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.577+0000 7ff79bfff640 1 -- 172.21.15.103:0/1058028039 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a40c93a0 con 0x7ff7a4151780 2024-09-10T08:33:14.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.577+0000 7ff7a2ffd640 1 --2- 172.21.15.103:0/1058028039 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7a40703b0 0x7ff7a40ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:33:14.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.577+0000 7ff79bfff640 1 --2- 172.21.15.103:0/1058028039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7a4151780 0x7ff7a414bbb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4069330 tx=0x7ff78c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:14.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.577+0000 7ff79b7fe640 1 -- 172.21.15.103:0/1058028039 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c041020 con 0x7ff7a4151780 2024-09-10T08:33:14.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.577+0000 7ff79b7fe640 1 -- 172.21.15.103:0/1058028039 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff78c030660 con 0x7ff7a4151780 2024-09-10T08:33:14.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.577+0000 7ff79b7fe640 1 -- 172.21.15.103:0/1058028039 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c037040 con 0x7ff7a4151780 2024-09-10T08:33:14.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.577+0000 7ff7a97b7640 1 -- 172.21.15.103:0/1058028039 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7a40c9680 con 0x7ff7a4151780 2024-09-10T08:33:14.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.577+0000 7ff7a97b7640 1 -- 172.21.15.103:0/1058028039 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7a414d720 con 0x7ff7a4151780 2024-09-10T08:33:14.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.578+0000 7ff7a97b7640 1 -- 172.21.15.103:0/1058028039 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7a40af630 con 0x7ff7a4151780 2024-09-10T08:33:14.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.579+0000 7ff79b7fe640 1 -- 172.21.15.103:0/1058028039 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff78c044020 con 0x7ff7a4151780 2024-09-10T08:33:14.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.579+0000 7ff79b7fe640 1 --2- 172.21.15.103:0/1058028039 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff78406bde0 0x7ff78406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.579+0000 7ff79b7fe640 1 -- 172.21.15.103:0/1058028039 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7ff78c0ab7d0 con 0x7ff7a4151780 2024-09-10T08:33:14.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.579+0000 7ff7a2ffd640 1 --2- 172.21.15.103:0/1058028039 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff78406bde0 0x7ff78406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.580+0000 7ff7a2ffd640 1 --2- 172.21.15.103:0/1058028039 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff78406bde0 0x7ff78406e2a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff7a41e1900 tx=0x7ff794009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:14.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.584+0000 7ff79b7fe640 1 -- 172.21.15.103:0/1058028039 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff78c04b030 con 0x7ff7a4151780 2024-09-10T08:33:14.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.883+0000 7ff7a97b7640 1 -- 172.21.15.103:0/1058028039 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff7a4073ca0 con 0x7ff7a4151780 2024-09-10T08:33:14.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.883+0000 7ff79b7fe640 1 -- 172.21.15.103:0/1058028039 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7ff78c079dd0 con 0x7ff7a4151780 2024-09-10T08:33:14.885 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:33:14.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.886+0000 7ff7a97b7640 1 -- 172.21.15.103:0/1058028039 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff78406bde0 msgr2=0x7ff78406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.886+0000 7ff7a97b7640 1 --2- 172.21.15.103:0/1058028039 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff78406bde0 0x7ff78406e2a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff7a41e1900 tx=0x7ff794009040 comp rx=0 tx=0).stop 2024-09-10T08:33:14.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.886+0000 7ff7a97b7640 1 -- 172.21.15.103:0/1058028039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7a4151780 msgr2=0x7ff7a414bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.886+0000 7ff7a97b7640 1 --2- 172.21.15.103:0/1058028039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7a4151780 0x7ff7a414bbb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4069330 tx=0x7ff78c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.886+0000 7ff7a97b7640 1 -- 172.21.15.103:0/1058028039 shutdown_connections 2024-09-10T08:33:14.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.886+0000 7ff7a97b7640 1 --2- 172.21.15.103:0/1058028039 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff78406bde0 0x7ff78406e2a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.886+0000 7ff7a97b7640 1 --2- 172.21.15.103:0/1058028039 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a4154ac0 0x7ff7a414c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.886+0000 7ff7a97b7640 1 --2- 172.21.15.103:0/1058028039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7a4151780 0x7ff7a414bbb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.886+0000 7ff7a97b7640 1 --2- 172.21.15.103:0/1058028039 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7a40703b0 0x7ff7a40ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.886+0000 7ff7a97b7640 1 -- 172.21.15.103:0/1058028039 >> 172.21.15.103:0/1058028039 conn(0x7ff7a40c6980 msgr2=0x7ff7a4150240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:14.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.886+0000 7ff7a97b7640 1 -- 172.21.15.103:0/1058028039 shutdown_connections 2024-09-10T08:33:14.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:14.886+0000 7ff7a97b7640 1 -- 172.21.15.103:0/1058028039 wait complete. 2024-09-10T08:33:17.899 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:33:18.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.004+0000 7fcb6ee8d640 1 Processor -- start 2024-09-10T08:33:18.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.004+0000 7fcb6ee8d640 1 -- start start 2024-09-10T08:33:18.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.004+0000 7fcb6ee8d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb680c8b10 0x7fcb6815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:18.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.004+0000 7fcb6ee8d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb68153be0 0x7fcb68156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:18.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.004+0000 7fcb6ee8d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb680c7070 con 0x7fcb6806cd80 2024-09-10T08:33:18.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.004+0000 7fcb6ee8d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fcb6806d210 con 0x7fcb680c8b10 2024-09-10T08:33:18.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.004+0000 7fcb6ee8d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcb680c69b0 con 0x7fcb68153be0 2024-09-10T08:33:18.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.005+0000 7fcb67fff640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7fcb6806cd80 legacy=0x7fcb681534d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:33:18.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.005+0000 7fcb6cc29640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb680c8b10 0x7fcb6815a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:18.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.005+0000 7fcb6d42a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb68153be0 0x7fcb68156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:18.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.005+0000 7fcb6cc29640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb680c8b10 0x7fcb6815a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:57478/0 (socket says 172.21.15.103:57478) 2024-09-10T08:33:18.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.005+0000 7fcb6cc29640 1 -- 172.21.15.103:0/3451763732 learned_addr learned my addr 172.21.15.103:0/3451763732 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:18.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.005+0000 7fcb6d42a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb68153be0 0x7fcb68156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:55606/0 (socket says 172.21.15.103:55606) 2024-09-10T08:33:18.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.005+0000 7fcb6cc29640 1 -- 172.21.15.103:0/3451763732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb68153be0 msgr2=0x7fcb68156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:18.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.005+0000 7fcb6cc29640 1 --2- 172.21.15.103:0/3451763732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb68153be0 0x7fcb68156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:18.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.005+0000 7fcb6cc29640 1 -- 172.21.15.103:0/3451763732 >> v1:172.21.15.103:6789/0 conn(0x7fcb6806cd80 legacy=0x7fcb681534d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:33:18.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.005+0000 7fcb6cc29640 1 -- 172.21.15.103:0/3451763732 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb680c6c90 con 0x7fcb680c8b10 2024-09-10T08:33:18.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.005+0000 7fcb6d42a640 1 --2- 172.21.15.103:0/3451763732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb68153be0 0x7fcb68156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:33:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.006+0000 7fcb6cc29640 1 --2- 172.21.15.103:0/3451763732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb680c8b10 0x7fcb6815a4a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009870 tx=0x7fcb5c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8931a75b91008b38 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.006+0000 7fcb677fe640 1 -- 172.21.15.103:0/3451763732 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c037070 con 0x7fcb680c8b10 2024-09-10T08:33:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.006+0000 7fcb677fe640 1 -- 172.21.15.103:0/3451763732 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb5c032440 con 0x7fcb680c8b10 2024-09-10T08:33:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.006+0000 7fcb677fe640 1 -- 172.21.15.103:0/3451763732 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c032810 con 0x7fcb680c8b10 2024-09-10T08:33:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.007+0000 7fcb6ee8d640 1 -- 172.21.15.103:0/3451763732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb680c8b10 msgr2=0x7fcb6815a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.007+0000 7fcb6ee8d640 1 --2- 172.21.15.103:0/3451763732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb680c8b10 0x7fcb6815a4a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009870 tx=0x7fcb5c02a180 comp rx=0 tx=0).stop 2024-09-10T08:33:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.007+0000 7fcb6ee8d640 1 -- 172.21.15.103:0/3451763732 shutdown_connections 2024-09-10T08:33:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.007+0000 7fcb6ee8d640 1 --2- 172.21.15.103:0/3451763732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb68153be0 0x7fcb68156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.007+0000 7fcb6ee8d640 1 --2- 172.21.15.103:0/3451763732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb680c8b10 0x7fcb6815a4a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.007+0000 7fcb6ee8d640 1 -- 172.21.15.103:0/3451763732 >> 172.21.15.103:0/3451763732 conn(0x7fcb680adb80 msgr2=0x7fcb680adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.007+0000 7fcb6ee8d640 1 -- 172.21.15.103:0/3451763732 shutdown_connections 2024-09-10T08:33:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.007+0000 7fcb6ee8d640 1 -- 172.21.15.103:0/3451763732 wait complete. 2024-09-10T08:33:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.008+0000 7fcb6ee8d640 1 Processor -- start 2024-09-10T08:33:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.008+0000 7fcb6ee8d640 1 -- start start 2024-09-10T08:33:18.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.009+0000 7fcb6ee8d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb680c8b10 0x7fcb680aca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:18.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.009+0000 7fcb6ee8d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb68153be0 0x7fcb681e1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:18.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.009+0000 7fcb6ee8d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb680c6050 0x7fcb681e1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:18.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.009+0000 7fcb6ee8d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcb680c9070 con 0x7fcb68153be0 2024-09-10T08:33:18.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.010+0000 7fcb6ee8d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcb680c8ef0 con 0x7fcb680c8b10 2024-09-10T08:33:18.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.010+0000 7fcb6ee8d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcb68156ba0 con 0x7fcb680c6050 2024-09-10T08:33:18.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.010+0000 7fcb67fff640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb68153be0 msgr2=0x7fcb681e1900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:33:18.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.010+0000 7fcb67fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb68153be0 0x7fcb681e1900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:33:18.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.010+0000 7fcb6d42a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb680c6050 0x7fcb681e1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:18.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.010+0000 7fcb6cc29640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb680c8b10 0x7fcb680aca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:18.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.010+0000 7fcb6d42a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb680c6050 0x7fcb681e1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:55620/0 (socket says 172.21.15.103:55620) 2024-09-10T08:33:18.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.010+0000 7fcb6d42a640 1 -- 172.21.15.103:0/1127236706 learned_addr learned my addr 172.21.15.103:0/1127236706 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:18.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.011+0000 7fcb6cc29640 1 -- 172.21.15.103:0/1127236706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb680c6050 msgr2=0x7fcb681e1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:18.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.011+0000 7fcb6cc29640 1 --2- 172.21.15.103:0/1127236706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb680c6050 0x7fcb681e1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:18.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.011+0000 7fcb6cc29640 1 -- 172.21.15.103:0/1127236706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb68153be0 msgr2=0x7fcb681e1900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:33:18.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.011+0000 7fcb6cc29640 1 --2- 172.21.15.103:0/1127236706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb68153be0 0x7fcb681e1900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:18.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.011+0000 7fcb6cc29640 1 -- 172.21.15.103:0/1127236706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb681ecbd0 con 0x7fcb680c8b10 2024-09-10T08:33:18.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.011+0000 7fcb6cc29640 1 --2- 172.21.15.103:0/1127236706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb680c8b10 0x7fcb680aca70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c031000 tx=0x7fcb5c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:18.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.011+0000 7fcb657fa640 1 -- 172.21.15.103:0/1127236706 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c041020 con 0x7fcb680c8b10 2024-09-10T08:33:18.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.011+0000 7fcb657fa640 1 -- 172.21.15.103:0/1127236706 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb5c030640 con 0x7fcb680c8b10 2024-09-10T08:33:18.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.011+0000 7fcb657fa640 1 -- 172.21.15.103:0/1127236706 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c037040 con 0x7fcb680c8b10 2024-09-10T08:33:18.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.011+0000 7fcb6ee8d640 1 -- 172.21.15.103:0/1127236706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb681ece90 con 0x7fcb680c8b10 2024-09-10T08:33:18.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.011+0000 7fcb6ee8d640 1 -- 172.21.15.103:0/1127236706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb680abe70 con 0x7fcb680c8b10 2024-09-10T08:33:18.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.012+0000 7fcb6ee8d640 1 -- 172.21.15.103:0/1127236706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb68157030 con 0x7fcb680c8b10 2024-09-10T08:33:18.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.013+0000 7fcb657fa640 1 -- 172.21.15.103:0/1127236706 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb5c044020 con 0x7fcb680c8b10 2024-09-10T08:33:18.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.013+0000 7fcb657fa640 1 --2- 172.21.15.103:0/1127236706 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb4c06be10 0x7fcb4c06e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:18.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.013+0000 7fcb657fa640 1 -- 172.21.15.103:0/1127236706 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fcb5c0ab6f0 con 0x7fcb680c8b10 2024-09-10T08:33:18.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.013+0000 7fcb67fff640 1 --2- 172.21.15.103:0/1127236706 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb4c06be10 0x7fcb4c06e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:18.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.014+0000 7fcb67fff640 1 --2- 172.21.15.103:0/1127236706 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb4c06be10 0x7fcb4c06e2d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcb680b2280 tx=0x7fcb54006d20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:18.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.019+0000 7fcb657fa640 1 -- 172.21.15.103:0/1127236706 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb5c04b030 con 0x7fcb680c8b10 2024-09-10T08:33:18.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.312+0000 7fcb6ee8d640 1 -- 172.21.15.103:0/1127236706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcb68150b10 con 0x7fcb680c8b10 2024-09-10T08:33:18.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.312+0000 7fcb657fa640 1 -- 172.21.15.103:0/1127236706 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fcb5c079d90 con 0x7fcb680c8b10 2024-09-10T08:33:18.313 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:33:18.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.314+0000 7fcb6ee8d640 1 -- 172.21.15.103:0/1127236706 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb4c06be10 msgr2=0x7fcb4c06e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:18.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.314+0000 7fcb6ee8d640 1 --2- 172.21.15.103:0/1127236706 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb4c06be10 0x7fcb4c06e2d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcb680b2280 tx=0x7fcb54006d20 comp rx=0 tx=0).stop 2024-09-10T08:33:18.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.314+0000 7fcb6ee8d640 1 -- 172.21.15.103:0/1127236706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb680c8b10 msgr2=0x7fcb680aca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:18.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.314+0000 7fcb6ee8d640 1 --2- 172.21.15.103:0/1127236706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb680c8b10 0x7fcb680aca70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c031000 tx=0x7fcb5c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:18.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.314+0000 7fcb6ee8d640 1 -- 172.21.15.103:0/1127236706 shutdown_connections 2024-09-10T08:33:18.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.314+0000 7fcb6ee8d640 1 --2- 172.21.15.103:0/1127236706 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb4c06be10 0x7fcb4c06e2d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:18.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.314+0000 7fcb6ee8d640 1 --2- 172.21.15.103:0/1127236706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb680c6050 0x7fcb681e1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:18.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.314+0000 7fcb6ee8d640 1 --2- 172.21.15.103:0/1127236706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb68153be0 0x7fcb681e1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:18.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.314+0000 7fcb6ee8d640 1 --2- 172.21.15.103:0/1127236706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb680c8b10 0x7fcb680aca70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:18.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.314+0000 7fcb6ee8d640 1 -- 172.21.15.103:0/1127236706 >> 172.21.15.103:0/1127236706 conn(0x7fcb680adb80 msgr2=0x7fcb681541c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:18.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.314+0000 7fcb6ee8d640 1 -- 172.21.15.103:0/1127236706 shutdown_connections 2024-09-10T08:33:18.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:18.314+0000 7fcb6ee8d640 1 -- 172.21.15.103:0/1127236706 wait complete. 2024-09-10T08:33:21.327 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:33:21.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.430+0000 7fb23d4a5640 1 Processor -- start 2024-09-10T08:33:21.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.431+0000 7fb23d4a5640 1 -- start start 2024-09-10T08:33:21.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.431+0000 7fb23d4a5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb238150480 0x7fb2380c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:21.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.431+0000 7fb23d4a5640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb23806c650 0x7fb2380c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:21.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.431+0000 7fb23d4a5640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb23815a7c0 con 0x7fb2380c9c80 2024-09-10T08:33:21.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.431+0000 7fb23d4a5640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fb23806c240 con 0x7fb23806c650 2024-09-10T08:33:21.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.431+0000 7fb23d4a5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb23815a330 con 0x7fb238150480 2024-09-10T08:33:21.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.431+0000 7fb2377fe640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7fb2380c9c80 legacy=0x7fb2380ca0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:33:21.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.431+0000 7fb2367fc640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7fb23806c650 msgr2=0x7fb2380c7fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:33:21.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.431+0000 7fb2367fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb23806c650 0x7fb2380c7fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:33:21.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.432+0000 7fb236ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb238150480 0x7fb2380c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:21.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.432+0000 7fb236ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb238150480 0x7fb2380c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:57500/0 (socket says 172.21.15.103:57500) 2024-09-10T08:33:21.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.432+0000 7fb236ffd640 1 -- 172.21.15.103:0/3612613817 learned_addr learned my addr 172.21.15.103:0/3612613817 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:21.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.432+0000 7fb236ffd640 1 -- 172.21.15.103:0/3612613817 >> v2:172.21.15.103:3300/0 conn(0x7fb23806c650 msgr2=0x7fb2380c7fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:33:21.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.432+0000 7fb236ffd640 1 --2- 172.21.15.103:0/3612613817 >> v2:172.21.15.103:3300/0 conn(0x7fb23806c650 0x7fb2380c7fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.432+0000 7fb236ffd640 1 -- 172.21.15.103:0/3612613817 >> v1:172.21.15.103:6789/0 conn(0x7fb2380c9c80 legacy=0x7fb2380ca0f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:33:21.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.432+0000 7fb236ffd640 1 -- 172.21.15.103:0/3612613817 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb238159a00 con 0x7fb238150480 2024-09-10T08:33:21.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.433+0000 7fb236ffd640 1 --2- 172.21.15.103:0/3612613817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb238150480 0x7fb2380c7a90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb2380ccac0 tx=0x7fb22802a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c55170463601a11f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:21.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.433+0000 7fb235ffb640 1 -- 172.21.15.103:0/3612613817 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb228037070 con 0x7fb238150480 2024-09-10T08:33:21.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.433+0000 7fb235ffb640 1 -- 172.21.15.103:0/3612613817 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb228032440 con 0x7fb238150480 2024-09-10T08:33:21.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.433+0000 7fb235ffb640 1 -- 172.21.15.103:0/3612613817 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb228032810 con 0x7fb238150480 2024-09-10T08:33:21.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.433+0000 7fb23d4a5640 1 -- 172.21.15.103:0/3612613817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb238150480 msgr2=0x7fb2380c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:21.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.433+0000 7fb23d4a5640 1 --2- 172.21.15.103:0/3612613817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb238150480 0x7fb2380c7a90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb2380ccac0 tx=0x7fb22802a250 comp rx=0 tx=0).stop 2024-09-10T08:33:21.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.433+0000 7fb23d4a5640 1 -- 172.21.15.103:0/3612613817 shutdown_connections 2024-09-10T08:33:21.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.433+0000 7fb23d4a5640 1 --2- 172.21.15.103:0/3612613817 >> v2:172.21.15.103:3300/0 conn(0x7fb23806c650 0x7fb2380c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.433+0000 7fb23d4a5640 1 --2- 172.21.15.103:0/3612613817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb238150480 0x7fb2380c7a90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.433+0000 7fb23d4a5640 1 -- 172.21.15.103:0/3612613817 >> 172.21.15.103:0/3612613817 conn(0x7fb238068030 msgr2=0x7fb238073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:21.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.433+0000 7fb23d4a5640 1 -- 172.21.15.103:0/3612613817 shutdown_connections 2024-09-10T08:33:21.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.433+0000 7fb23d4a5640 1 -- 172.21.15.103:0/3612613817 wait complete. 2024-09-10T08:33:21.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.435+0000 7fb23d4a5640 1 Processor -- start 2024-09-10T08:33:21.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.435+0000 7fb23d4a5640 1 -- start start 2024-09-10T08:33:21.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.435+0000 7fb23d4a5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb23806c650 0x7fb238152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:21.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.435+0000 7fb23d4a5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2380c9c80 0x7fb238158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:21.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.435+0000 7fb23d4a5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb238150480 0x7fb2380c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:21.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.435+0000 7fb23d4a5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb23806d270 con 0x7fb2380c9c80 2024-09-10T08:33:21.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.435+0000 7fb23d4a5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb238159fc0 con 0x7fb238150480 2024-09-10T08:33:21.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.435+0000 7fb23d4a5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb238156270 con 0x7fb23806c650 2024-09-10T08:33:21.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.435+0000 7fb2367fc640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2380c9c80 msgr2=0x7fb238158e30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:33:21.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.435+0000 7fb2367fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2380c9c80 0x7fb238158e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:33:21.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.435+0000 7fb236ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb23806c650 0x7fb238152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:21.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.436+0000 7fb236ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb23806c650 0x7fb238152460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:55626/0 (socket says 172.21.15.103:55626) 2024-09-10T08:33:21.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.436+0000 7fb2377fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb238150480 0x7fb2380c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:21.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.436+0000 7fb236ffd640 1 -- 172.21.15.103:0/2444035084 learned_addr learned my addr 172.21.15.103:0/2444035084 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:21.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.436+0000 7fb2377fe640 1 -- 172.21.15.103:0/2444035084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb23806c650 msgr2=0x7fb238152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:21.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.436+0000 7fb2377fe640 1 --2- 172.21.15.103:0/2444035084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb23806c650 0x7fb238152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.436+0000 7fb2377fe640 1 -- 172.21.15.103:0/2444035084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2380c9c80 msgr2=0x7fb238158e30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:33:21.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.436+0000 7fb2377fe640 1 --2- 172.21.15.103:0/2444035084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2380c9c80 0x7fb238158e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.436+0000 7fb2377fe640 1 -- 172.21.15.103:0/2444035084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2380c5840 con 0x7fb238150480 2024-09-10T08:33:21.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.436+0000 7fb236ffd640 1 --2- 172.21.15.103:0/2444035084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb23806c650 0x7fb238152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:33:21.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.436+0000 7fb2377fe640 1 --2- 172.21.15.103:0/2444035084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb238150480 0x7fb2380c4aa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb230003d00 tx=0x7fb230009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:21.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.436+0000 7fb21f7fe640 1 -- 172.21.15.103:0/2444035084 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23000cdf0 con 0x7fb238150480 2024-09-10T08:33:21.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.436+0000 7fb21f7fe640 1 -- 172.21.15.103:0/2444035084 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb230010030 con 0x7fb238150480 2024-09-10T08:33:21.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.436+0000 7fb23d4a5640 1 -- 172.21.15.103:0/2444035084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2381529a0 con 0x7fb238150480 2024-09-10T08:33:21.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.436+0000 7fb21f7fe640 1 -- 172.21.15.103:0/2444035084 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230016670 con 0x7fb238150480 2024-09-10T08:33:21.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.436+0000 7fb23d4a5640 1 -- 172.21.15.103:0/2444035084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2380c5dc0 con 0x7fb238150480 2024-09-10T08:33:21.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.437+0000 7fb23d4a5640 1 -- 172.21.15.103:0/2444035084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2380697e0 con 0x7fb238150480 2024-09-10T08:33:21.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.438+0000 7fb21f7fe640 1 -- 172.21.15.103:0/2444035084 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb2300153e0 con 0x7fb238150480 2024-09-10T08:33:21.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.438+0000 7fb21f7fe640 1 --2- 172.21.15.103:0/2444035084 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb22406bde0 0x7fb22406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:21.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.438+0000 7fb21f7fe640 1 -- 172.21.15.103:0/2444035084 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fb23008b4b0 con 0x7fb238150480 2024-09-10T08:33:21.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.438+0000 7fb236ffd640 1 --2- 172.21.15.103:0/2444035084 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb22406bde0 0x7fb22406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:21.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.439+0000 7fb236ffd640 1 --2- 172.21.15.103:0/2444035084 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb22406bde0 0x7fb22406e2a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb2280090b0 tx=0x7fb22802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:21.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.443+0000 7fb21f7fe640 1 -- 172.21.15.103:0/2444035084 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb2380697e0 con 0x7fb238150480 2024-09-10T08:33:21.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.676+0000 7fb23d4a5640 1 -- 172.21.15.103:0/2444035084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb238154f90 con 0x7fb238150480 2024-09-10T08:33:21.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.676+0000 7fb21f7fe640 1 -- 172.21.15.103:0/2444035084 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fb238154f90 con 0x7fb238150480 2024-09-10T08:33:21.676 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:33:21.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.678+0000 7fb23d4a5640 1 -- 172.21.15.103:0/2444035084 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb22406bde0 msgr2=0x7fb22406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:21.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.678+0000 7fb23d4a5640 1 --2- 172.21.15.103:0/2444035084 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb22406bde0 0x7fb22406e2a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb2280090b0 tx=0x7fb22802e000 comp rx=0 tx=0).stop 2024-09-10T08:33:21.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.678+0000 7fb23d4a5640 1 -- 172.21.15.103:0/2444035084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb238150480 msgr2=0x7fb2380c4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:21.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.678+0000 7fb23d4a5640 1 --2- 172.21.15.103:0/2444035084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb238150480 0x7fb2380c4aa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb230003d00 tx=0x7fb230009ed0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.678+0000 7fb23d4a5640 1 -- 172.21.15.103:0/2444035084 shutdown_connections 2024-09-10T08:33:21.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.678+0000 7fb23d4a5640 1 --2- 172.21.15.103:0/2444035084 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb22406bde0 0x7fb22406e2a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.678+0000 7fb23d4a5640 1 --2- 172.21.15.103:0/2444035084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb238150480 0x7fb2380c4aa0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.678+0000 7fb23d4a5640 1 --2- 172.21.15.103:0/2444035084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2380c9c80 0x7fb238158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.678+0000 7fb23d4a5640 1 --2- 172.21.15.103:0/2444035084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb23806c650 0x7fb238152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.678+0000 7fb23d4a5640 1 -- 172.21.15.103:0/2444035084 >> 172.21.15.103:0/2444035084 conn(0x7fb238068030 msgr2=0x7fb2380ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:21.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.678+0000 7fb23d4a5640 1 -- 172.21.15.103:0/2444035084 shutdown_connections 2024-09-10T08:33:21.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:21.678+0000 7fb23d4a5640 1 -- 172.21.15.103:0/2444035084 wait complete. 2024-09-10T08:33:24.690 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:33:24.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:24.801+0000 7fa91d103640 1 Processor -- start 2024-09-10T08:33:24.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:24.801+0000 7fa91d103640 1 -- start start 2024-09-10T08:33:24.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:24.802+0000 7fa91d103640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa918150480 0x7fa9180c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:24.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:24.802+0000 7fa91d103640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 0x7fa9180c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:24.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:24.802+0000 7fa91d103640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa91815a7c0 con 0x7fa91806c650 2024-09-10T08:33:24.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:24.802+0000 7fa91d103640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa91806c240 con 0x7fa918150480 2024-09-10T08:33:24.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:24.802+0000 7fa91d103640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa91815a330 con 0x7fa9180ca390 2024-09-10T08:33:24.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:24.802+0000 7fa91659c640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7fa91806c650 legacy=0x7fa9180c9c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:33:24.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:24.802+0000 7fa916d9d640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7fa918150480 msgr2=0x7fa9180c7a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:33:24.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:24.803+0000 7fa916d9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa918150480 0x7fa9180c7a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:33:24.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:24.803+0000 7fa91759e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 0x7fa9180c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:24.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:24.803+0000 7fa91759e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 0x7fa9180c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:55628/0 (socket says 172.21.15.103:55628) 2024-09-10T08:33:24.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:24.803+0000 7fa91759e640 1 -- 172.21.15.103:0/1419646090 learned_addr learned my addr 172.21.15.103:0/1419646090 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:24.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:24.803+0000 7fa91759e640 1 -- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 msgr2=0x7fa9180c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:33:24.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:24.803+0000 7fa91759e640 1 -- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 msgr2=0x7fa9180c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:33:24.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:24.803+0000 7fa91759e640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 0x7fa9180c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:33:24.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:24.803+0000 7fa91759e640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 0x7fa9180c7fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:33:25.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:25.004+0000 7fa916d9d640 1 -- 172.21.15.103:0/1419646090 >> v2:172.21.15.103:3300/0 conn(0x7fa918150480 msgr2=0x7fa9180c7a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:33:25.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:25.004+0000 7fa91659c640 1 -- 172.21.15.103:0/1419646090 >> v1:172.21.15.103:6789/0 conn(0x7fa91806c650 legacy=0x7fa9180c9c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:33:25.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:25.004+0000 7fa916d9d640 1 --2- 172.21.15.103:0/1419646090 >> v2:172.21.15.103:3300/0 conn(0x7fa918150480 0x7fa9180c7a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:33:25.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:25.004+0000 7fa91759e640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 0x7fa9180c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:25.004+0000 7fa91759e640 1 -- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 msgr2=0x7fa9180c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:33:25.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:25.004+0000 7fa91759e640 1 -- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 msgr2=0x7fa9180c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:33:25.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:25.004+0000 7fa91759e640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 0x7fa9180c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:33:25.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:25.004+0000 7fa91759e640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 0x7fa9180c7fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:33:25.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:25.405+0000 7fa91659c640 1 -- 172.21.15.103:0/1419646090 >> v1:172.21.15.103:6789/0 conn(0x7fa91806c650 legacy=0x7fa9180c9c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:33:25.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:25.405+0000 7fa916d9d640 1 -- 172.21.15.103:0/1419646090 >> v2:172.21.15.103:3300/0 conn(0x7fa918150480 msgr2=0x7fa9180c7a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:33:25.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:25.405+0000 7fa916d9d640 1 --2- 172.21.15.103:0/1419646090 >> v2:172.21.15.103:3300/0 conn(0x7fa918150480 0x7fa9180c7a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:33:25.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:25.405+0000 7fa91759e640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 0x7fa9180c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:25.405+0000 7fa91759e640 1 -- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 msgr2=0x7fa9180c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:33:25.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:25.405+0000 7fa91759e640 1 -- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 msgr2=0x7fa9180c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:33:25.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:25.405+0000 7fa91759e640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 0x7fa9180c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:33:25.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:25.405+0000 7fa91759e640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 0x7fa9180c7fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:33:26.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:26.206+0000 7fa916d9d640 1 -- 172.21.15.103:0/1419646090 >> v2:172.21.15.103:3300/0 conn(0x7fa918150480 msgr2=0x7fa9180c7a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:33:26.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:26.206+0000 7fa91659c640 1 -- 172.21.15.103:0/1419646090 >> v1:172.21.15.103:6789/0 conn(0x7fa91806c650 legacy=0x7fa9180c9c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:33:26.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:26.206+0000 7fa916d9d640 1 --2- 172.21.15.103:0/1419646090 >> v2:172.21.15.103:3300/0 conn(0x7fa918150480 0x7fa9180c7a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:33:26.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:26.206+0000 7fa91759e640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 0x7fa9180c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:26.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:26.206+0000 7fa91759e640 1 -- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 msgr2=0x7fa9180c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:33:26.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:26.206+0000 7fa91759e640 1 -- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 msgr2=0x7fa9180c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:33:26.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:26.206+0000 7fa91759e640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 0x7fa9180c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:33:26.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:26.206+0000 7fa91759e640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 0x7fa9180c7fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:33:27.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:27.803+0000 7fa914d99640 1 -- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 msgr2=0x7fa9180c7fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:33:27.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:27.803+0000 7fa914d99640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9180ca390 0x7fa9180c7fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:27.803+0000 7fa914d99640 1 -- 172.21.15.103:0/1419646090 >> v2:172.21.15.103:3300/0 conn(0x7fa918150480 msgr2=0x7fa9180c7a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:33:27.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:27.803+0000 7fa914d99640 1 --2- 172.21.15.103:0/1419646090 >> v2:172.21.15.103:3300/0 conn(0x7fa918150480 0x7fa9180c7a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:27.803+0000 7fa914d99640 1 -- 172.21.15.103:0/1419646090 >> v1:172.21.15.103:6789/0 conn(0x7fa91806c650 legacy=0x7fa9180c9c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:33:27.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:27.803+0000 7fa914d99640 1 --2- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 0x7fa904005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:27.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:27.803+0000 7fa914d99640 1 -- 172.21.15.103:0/1419646090 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa918159a00 con 0x7fa904006170 2024-09-10T08:33:27.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:27.803+0000 7fa914d99640 1 -- 172.21.15.103:0/1419646090 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fa91815a330 con 0x7fa9040036a0 2024-09-10T08:33:27.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:27.803+0000 7fa916d9d640 1 --2- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 0x7fa904005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:27.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:27.803+0000 7fa916d9d640 1 -- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 msgr2=0x7fa904005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:33:27.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:27.803+0000 7fa916d9d640 1 -- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 msgr2=0x7fa904005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:33:27.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:27.803+0000 7fa916d9d640 1 --2- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 0x7fa904005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:33:27.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:27.803+0000 7fa916d9d640 1 --2- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 0x7fa904005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:33:28.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:28.004+0000 7fa916d9d640 1 --2- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 0x7fa904005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:28.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:28.004+0000 7fa916d9d640 1 -- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 msgr2=0x7fa904005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:33:28.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:28.004+0000 7fa916d9d640 1 -- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 msgr2=0x7fa904005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:33:28.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:28.004+0000 7fa916d9d640 1 --2- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 0x7fa904005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:33:28.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:28.004+0000 7fa916d9d640 1 --2- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 0x7fa904005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:33:28.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:28.405+0000 7fa916d9d640 1 --2- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 0x7fa904005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:28.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:28.405+0000 7fa916d9d640 1 -- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 msgr2=0x7fa904005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:33:28.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:28.405+0000 7fa916d9d640 1 -- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 msgr2=0x7fa904005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:33:28.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:28.405+0000 7fa916d9d640 1 --2- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 0x7fa904005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:33:28.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:28.405+0000 7fa916d9d640 1 --2- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 0x7fa904005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:33:29.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.207+0000 7fa916d9d640 1 --2- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 0x7fa904005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:29.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.207+0000 7fa916d9d640 1 -- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 msgr2=0x7fa904005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:33:29.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.207+0000 7fa916d9d640 1 -- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 msgr2=0x7fa904005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:33:29.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.207+0000 7fa916d9d640 1 --2- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 0x7fa904005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:33:29.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.207+0000 7fa916d9d640 1 --2- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 0x7fa904005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:33:29.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.313+0000 7fa915d9b640 1 -- 172.21.15.103:0/1419646090 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2575420063 0 0) 0x7fa918159a00 con 0x7fa904006170 2024-09-10T08:33:29.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.313+0000 7fa915d9b640 1 -- 172.21.15.103:0/1419646090 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa900003520 con 0x7fa904006170 2024-09-10T08:33:29.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.317+0000 7fa915d9b640 1 -- 172.21.15.103:0/1419646090 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 719695343 0 0) 0x7fa900003520 con 0x7fa904006170 2024-09-10T08:33:29.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.317+0000 7fa915d9b640 1 -- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 msgr2=0x7fa904005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:33:29.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.317+0000 7fa915d9b640 1 --2- 172.21.15.103:0/1419646090 >> v2:172.21.15.154:3300/0 conn(0x7fa9040036a0 0x7fa904005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.317+0000 7fa915d9b640 1 -- 172.21.15.103:0/1419646090 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91815a7c0 con 0x7fa904006170 2024-09-10T08:33:29.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.317+0000 7fa915d9b640 1 -- 172.21.15.103:0/1419646090 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7fa90c0040e0 con 0x7fa904006170 2024-09-10T08:33:29.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.317+0000 7fa915d9b640 1 -- 172.21.15.103:0/1419646090 >> v1:172.21.15.154:6789/0 conn(0x7fa904006170 legacy=0x7fa904008630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:29.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.317+0000 7fa91759e640 1 -- 172.21.15.103:0/1419646090 reap_dead start 2024-09-10T08:33:29.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.317+0000 7fa915d9b640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9000039b0 0x7fa900003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:29.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.317+0000 7fa915d9b640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa900004800 0x7fa900004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:29.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.317+0000 7fa915d9b640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9000052e0 0x7fa90000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:29.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.317+0000 7fa915d9b640 1 -- 172.21.15.103:0/1419646090 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa91815a330 con 0x7fa9000052e0 2024-09-10T08:33:29.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.317+0000 7fa915d9b640 1 -- 172.21.15.103:0/1419646090 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa90000c190 con 0x7fa9000039b0 2024-09-10T08:33:29.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.317+0000 7fa915d9b640 1 -- 172.21.15.103:0/1419646090 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa90000c390 con 0x7fa900004800 2024-09-10T08:33:29.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.317+0000 7fa91759e640 1 -- 172.21.15.103:0/1419646090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9000052e0 msgr2=0x7fa90000b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:33:29.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.317+0000 7fa91759e640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9000052e0 0x7fa90000b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:33:29.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.317+0000 7fa91659c640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa900004800 0x7fa900004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:29.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.317+0000 7fa916d9d640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9000039b0 0x7fa900003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:29.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.318+0000 7fa91659c640 1 -- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9000039b0 msgr2=0x7fa900003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:29.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.318+0000 7fa91659c640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9000039b0 0x7fa900003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.318+0000 7fa91659c640 1 -- 172.21.15.103:0/1419646090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9000052e0 msgr2=0x7fa90000b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:33:29.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.318+0000 7fa91659c640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9000052e0 0x7fa90000b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.318+0000 7fa91659c640 1 -- 172.21.15.103:0/1419646090 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa900003520 con 0x7fa900004800 2024-09-10T08:33:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.318+0000 7fa91659c640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa900004800 0x7fa900004c80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa90c003980 tx=0x7fa900005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8f3146179b5274c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.319+0000 7fa915d9b640 1 -- 172.21.15.103:0/1419646090 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c032020 con 0x7fa900004800 2024-09-10T08:33:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.319+0000 7fa915d9b640 1 -- 172.21.15.103:0/1419646090 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa90c008450 con 0x7fa900004800 2024-09-10T08:33:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.319+0000 7fa915d9b640 1 -- 172.21.15.103:0/1419646090 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c007cf0 con 0x7fa900004800 2024-09-10T08:33:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.319+0000 7fa91d103640 1 -- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa900004800 msgr2=0x7fa900004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.319+0000 7fa91d103640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa900004800 0x7fa900004c80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa90c003980 tx=0x7fa900005830 comp rx=0 tx=0).stop 2024-09-10T08:33:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.319+0000 7fa91d103640 1 -- 172.21.15.103:0/1419646090 shutdown_connections 2024-09-10T08:33:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.319+0000 7fa91d103640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9000052e0 0x7fa90000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.319+0000 7fa91d103640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa900004800 0x7fa900004c80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.319+0000 7fa91d103640 1 --2- 172.21.15.103:0/1419646090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9000039b0 0x7fa900003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.319+0000 7fa91d103640 1 -- 172.21.15.103:0/1419646090 >> 172.21.15.103:0/1419646090 conn(0x7fa918068030 msgr2=0x7fa918073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:29.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.320+0000 7fa91d103640 1 -- 172.21.15.103:0/1419646090 shutdown_connections 2024-09-10T08:33:29.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.320+0000 7fa91d103640 1 -- 172.21.15.103:0/1419646090 wait complete. 2024-09-10T08:33:29.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.322+0000 7fa91d103640 1 Processor -- start 2024-09-10T08:33:29.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.322+0000 7fa91d103640 1 -- start start 2024-09-10T08:33:29.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.322+0000 7fa91d103640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9000039b0 0x7fa9181ec180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:29.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.322+0000 7fa91d103640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa900004800 0x7fa918158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:29.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.322+0000 7fa91d103640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9000052e0 0x7fa9180aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:29.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.322+0000 7fa91d103640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa91806d270 con 0x7fa9000039b0 2024-09-10T08:33:29.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.323+0000 7fa91d103640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa918159fc0 con 0x7fa900004800 2024-09-10T08:33:29.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.323+0000 7fa91d103640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa918156270 con 0x7fa9000052e0 2024-09-10T08:33:29.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.323+0000 7fa916d9d640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9000039b0 msgr2=0x7fa9181ec180 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:33:29.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.323+0000 7fa916d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9000039b0 0x7fa9181ec180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:33:29.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.323+0000 7fa91659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa900004800 0x7fa918158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:29.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.323+0000 7fa91759e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9000052e0 0x7fa9180aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:29.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.323+0000 7fa91659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa900004800 0x7fa918158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:51368/0 (socket says 172.21.15.103:51368) 2024-09-10T08:33:29.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.323+0000 7fa91759e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9000052e0 0x7fa9180aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:34480/0 (socket says 172.21.15.103:34480) 2024-09-10T08:33:29.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.323+0000 7fa91659c640 1 -- 172.21.15.103:0/3658747802 learned_addr learned my addr 172.21.15.103:0/3658747802 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:29.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.323+0000 7fa91759e640 1 -- 172.21.15.103:0/3658747802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa900004800 msgr2=0x7fa918158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:29.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.323+0000 7fa91759e640 1 --2- 172.21.15.103:0/3658747802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa900004800 0x7fa918158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.323+0000 7fa91759e640 1 -- 172.21.15.103:0/3658747802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9000039b0 msgr2=0x7fa9181ec180 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:33:29.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.323+0000 7fa91759e640 1 --2- 172.21.15.103:0/3658747802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9000039b0 0x7fa9181ec180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.323+0000 7fa91759e640 1 -- 172.21.15.103:0/3658747802 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9180b0040 con 0x7fa9000052e0 2024-09-10T08:33:29.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.323+0000 7fa91659c640 1 --2- 172.21.15.103:0/3658747802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa900004800 0x7fa918158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:33:29.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.323+0000 7fa91759e640 1 --2- 172.21.15.103:0/3658747802 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9000052e0 0x7fa9180aea40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa91806bf40 tx=0x7fa910012db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:29.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.324+0000 7fa8ff7fe640 1 -- 172.21.15.103:0/3658747802 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91000b5a0 con 0x7fa9000052e0 2024-09-10T08:33:29.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.324+0000 7fa8ff7fe640 1 -- 172.21.15.103:0/3658747802 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa91001d070 con 0x7fa9000052e0 2024-09-10T08:33:29.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.324+0000 7fa91d103640 1 -- 172.21.15.103:0/3658747802 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9181eb980 con 0x7fa9000052e0 2024-09-10T08:33:29.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.324+0000 7fa8ff7fe640 1 -- 172.21.15.103:0/3658747802 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9100079e0 con 0x7fa9000052e0 2024-09-10T08:33:29.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.324+0000 7fa91d103640 1 -- 172.21.15.103:0/3658747802 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa918159530 con 0x7fa9000052e0 2024-09-10T08:33:29.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.325+0000 7fa91d103640 1 -- 172.21.15.103:0/3658747802 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa918159a00 con 0x7fa9000052e0 2024-09-10T08:33:29.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.325+0000 7fa8ff7fe640 1 -- 172.21.15.103:0/3658747802 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa910007b80 con 0x7fa9000052e0 2024-09-10T08:33:29.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.326+0000 7fa8ff7fe640 1 --2- 172.21.15.103:0/3658747802 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa90406c480 0x7fa90406e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:29.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.326+0000 7fa916d9d640 1 --2- 172.21.15.103:0/3658747802 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa90406c480 0x7fa90406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:29.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.326+0000 7fa8ff7fe640 1 -- 172.21.15.103:0/3658747802 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fa91008b660 con 0x7fa9000052e0 2024-09-10T08:33:29.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.326+0000 7fa916d9d640 1 --2- 172.21.15.103:0/3658747802 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa90406c480 0x7fa90406e940 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa9080038b0 tx=0x7fa908003c80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:29.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.330+0000 7fa8ff7fe640 1 -- 172.21.15.103:0/3658747802 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa910059c70 con 0x7fa9000052e0 2024-09-10T08:33:29.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.563+0000 7fa91d103640 1 -- 172.21.15.103:0/3658747802 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa91806c430 con 0x7fa9000052e0 2024-09-10T08:33:29.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.564+0000 7fa8ff7fe640 1 -- 172.21.15.103:0/3658747802 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7fa910059570 con 0x7fa9000052e0 2024-09-10T08:33:29.563 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":36,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:33:29.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.566+0000 7fa91d103640 1 -- 172.21.15.103:0/3658747802 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa90406c480 msgr2=0x7fa90406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:29.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.566+0000 7fa91d103640 1 --2- 172.21.15.103:0/3658747802 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa90406c480 0x7fa90406e940 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa9080038b0 tx=0x7fa908003c80 comp rx=0 tx=0).stop 2024-09-10T08:33:29.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.566+0000 7fa91d103640 1 -- 172.21.15.103:0/3658747802 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9000052e0 msgr2=0x7fa9180aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:29.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.566+0000 7fa91d103640 1 --2- 172.21.15.103:0/3658747802 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9000052e0 0x7fa9180aea40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa91806bf40 tx=0x7fa910012db0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.566+0000 7fa91d103640 1 -- 172.21.15.103:0/3658747802 shutdown_connections 2024-09-10T08:33:29.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.566+0000 7fa91d103640 1 --2- 172.21.15.103:0/3658747802 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa90406c480 0x7fa90406e940 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.566+0000 7fa91d103640 1 --2- 172.21.15.103:0/3658747802 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9000052e0 0x7fa9180aea40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.566+0000 7fa91d103640 1 --2- 172.21.15.103:0/3658747802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa900004800 0x7fa918158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.566+0000 7fa91d103640 1 --2- 172.21.15.103:0/3658747802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9000039b0 0x7fa9181ec180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.566+0000 7fa91d103640 1 -- 172.21.15.103:0/3658747802 >> 172.21.15.103:0/3658747802 conn(0x7fa918068030 msgr2=0x7fa9180c79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:29.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.566+0000 7fa91d103640 1 -- 172.21.15.103:0/3658747802 shutdown_connections 2024-09-10T08:33:29.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.566+0000 7fa91d103640 1 -- 172.21.15.103:0/3658747802 wait complete. 2024-09-10T08:33:29.576 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-10T08:33:29.576 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-10T08:33:29.576 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:33:29.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.676+0000 7f13de68d640 1 Processor -- start 2024-09-10T08:33:29.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.676+0000 7f13de68d640 1 -- start start 2024-09-10T08:33:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.676+0000 7f13de68d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13d81505f0 0x7f13d8153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.676+0000 7f13de68d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d80c5940 con 0x7f13d80c69c0 2024-09-10T08:33:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.676+0000 7f13de68d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d80c5c00 con 0x7f13d80c42b0 2024-09-10T08:33:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.676+0000 7f13de68d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f13d80c7860 con 0x7f13d81505f0 2024-09-10T08:33:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.676+0000 7f13d77fe640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7f13d80c69c0 legacy=0x7f13d80c2440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:33:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.677+0000 7f13d7fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13d81505f0 0x7f13d8153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.677+0000 7f13d7fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13d81505f0 0x7f13d8153910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:34490/0 (socket says 172.21.15.103:34490) 2024-09-10T08:33:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.677+0000 7f13d7fff640 1 -- 172.21.15.103:0/2980143219 learned_addr learned my addr 172.21.15.103:0/2980143219 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.677+0000 7f13d6ffd640 1 -- 172.21.15.103:0/2980143219 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 308228444 0 0) 0x7f13d80c5c00 con 0x7f13d80c42b0 2024-09-10T08:33:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.677+0000 7f13d7fff640 1 -- 172.21.15.103:0/2980143219 >> v1:172.21.15.154:6789/0 conn(0x7f13d80c42b0 legacy=0x7f13d80c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:29.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.677+0000 7f13d7fff640 1 -- 172.21.15.103:0/2980143219 >> v1:172.21.15.103:6789/0 conn(0x7f13d80c69c0 legacy=0x7f13d80c2440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:33:29.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.677+0000 7f13d7fff640 1 -- 172.21.15.103:0/2980143219 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d80c5ee0 con 0x7f13d81505f0 2024-09-10T08:33:29.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.678+0000 7f13d7fff640 1 --2- 172.21.15.103:0/2980143219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13d81505f0 0x7f13d8153910 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f13c80098a0 tx=0x7f13c802a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64d039c8b1c3fd1c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:29.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.678+0000 7f13d6ffd640 1 -- 172.21.15.103:0/2980143219 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c8037070 con 0x7f13d81505f0 2024-09-10T08:33:29.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.678+0000 7f13d6ffd640 1 -- 172.21.15.103:0/2980143219 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c8032440 con 0x7f13d81505f0 2024-09-10T08:33:29.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.678+0000 7f13d6ffd640 1 -- 172.21.15.103:0/2980143219 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c8032810 con 0x7f13d81505f0 2024-09-10T08:33:29.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.679+0000 7f13de68d640 1 -- 172.21.15.103:0/2980143219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13d81505f0 msgr2=0x7f13d8153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:29.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.679+0000 7f13de68d640 1 --2- 172.21.15.103:0/2980143219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13d81505f0 0x7f13d8153910 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f13c80098a0 tx=0x7f13c802a200 comp rx=0 tx=0).stop 2024-09-10T08:33:29.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.679+0000 7f13de68d640 1 -- 172.21.15.103:0/2980143219 shutdown_connections 2024-09-10T08:33:29.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.679+0000 7f13de68d640 1 --2- 172.21.15.103:0/2980143219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13d81505f0 0x7f13d8153910 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.679+0000 7f13de68d640 1 -- 172.21.15.103:0/2980143219 >> 172.21.15.103:0/2980143219 conn(0x7f13d80c7a40 msgr2=0x7f13d80c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:29.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.679+0000 7f13de68d640 1 -- 172.21.15.103:0/2980143219 shutdown_connections 2024-09-10T08:33:29.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.679+0000 7f13de68d640 1 -- 172.21.15.103:0/2980143219 wait complete. 2024-09-10T08:33:29.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.680+0000 7f13de68d640 1 Processor -- start 2024-09-10T08:33:29.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.680+0000 7f13de68d640 1 -- start start 2024-09-10T08:33:29.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.681+0000 7f13de68d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13d80c42b0 0x7f13d81df9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:29.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.681+0000 7f13de68d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13d81505f0 0x7f13d81ec340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:29.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.681+0000 7f13de68d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13d81449a0 0x7f13d8146a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:29.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.681+0000 7f13de68d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f13d81509d0 con 0x7f13d80c42b0 2024-09-10T08:33:29.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.681+0000 7f13de68d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f13d80c64a0 con 0x7f13d81505f0 2024-09-10T08:33:29.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.681+0000 7f13de68d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f13d8150b50 con 0x7f13d81449a0 2024-09-10T08:33:29.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.681+0000 7f13d7fff640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13d80c42b0 msgr2=0x7f13d81df9a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:33:29.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.681+0000 7f13d7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13d80c42b0 0x7f13d81df9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:33:29.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.681+0000 7f13dcc2a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13d81449a0 0x7f13d8146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:29.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.681+0000 7f13d77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13d81505f0 0x7f13d81ec340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:29.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.681+0000 7f13d77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13d81505f0 0x7f13d81ec340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:51374/0 (socket says 172.21.15.103:51374) 2024-09-10T08:33:29.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.681+0000 7f13dcc2a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13d81449a0 0x7f13d8146a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:34504/0 (socket says 172.21.15.103:34504) 2024-09-10T08:33:29.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.681+0000 7f13d77fe640 1 -- 172.21.15.103:0/3583350978 learned_addr learned my addr 172.21.15.103:0/3583350978 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:29.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.681+0000 7f13d77fe640 1 -- 172.21.15.103:0/3583350978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13d81449a0 msgr2=0x7f13d8146a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:29.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.681+0000 7f13d77fe640 1 --2- 172.21.15.103:0/3583350978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13d81449a0 0x7f13d8146a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.681+0000 7f13d77fe640 1 -- 172.21.15.103:0/3583350978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13d80c42b0 msgr2=0x7f13d81df9a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:33:29.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.681+0000 7f13d77fe640 1 --2- 172.21.15.103:0/3583350978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13d80c42b0 0x7f13d81df9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.681+0000 7f13d77fe640 1 -- 172.21.15.103:0/3583350978 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d8142a60 con 0x7f13d81505f0 2024-09-10T08:33:29.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.681+0000 7f13dcc2a640 1 --2- 172.21.15.103:0/3583350978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13d81449a0 0x7f13d8146a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:33:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.682+0000 7f13d77fe640 1 --2- 172.21.15.103:0/3583350978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13d81505f0 0x7f13d81ec340 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f13cc00b450 tx=0x7f13cc00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.682+0000 7f13d4ff9640 1 -- 172.21.15.103:0/3583350978 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13cc003dc0 con 0x7f13d81505f0 2024-09-10T08:33:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.682+0000 7f13d4ff9640 1 -- 172.21.15.103:0/3583350978 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13cc015070 con 0x7f13d81505f0 2024-09-10T08:33:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.682+0000 7f13de68d640 1 -- 172.21.15.103:0/3583350978 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d81574c0 con 0x7f13d81505f0 2024-09-10T08:33:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.682+0000 7f13d4ff9640 1 -- 172.21.15.103:0/3583350978 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13cc005290 con 0x7f13d81505f0 2024-09-10T08:33:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.682+0000 7f13de68d640 1 -- 172.21.15.103:0/3583350978 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d81dfee0 con 0x7f13d81505f0 2024-09-10T08:33:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.683+0000 7f13de68d640 1 --2- 172.21.15.103:0/3583350978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13d81ec880 0x7f13d8146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.683+0000 7f13de68d640 1 -- 172.21.15.103:0/3583350978 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f13d8148830 con 0x7f13d81ec880 2024-09-10T08:33:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.683+0000 7f13d7fff640 1 --2- 172.21.15.103:0/3583350978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13d81ec880 0x7f13d8146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.683+0000 7f13d7fff640 1 -- 172.21.15.103:0/3583350978 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f13d8142d00 con 0x7f13d81ec880 2024-09-10T08:33:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.683+0000 7f13d4ff9640 1 -- 172.21.15.103:0/3583350978 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f13cc00f070 con 0x7f13d81505f0 2024-09-10T08:33:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.683+0000 7f13d7fff640 1 --2- 172.21.15.103:0/3583350978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13d81ec880 0x7f13d8146f50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f13d8070600 tx=0x7f13c80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.684+0000 7f13d4ff9640 1 --2- 172.21.15.103:0/3583350978 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f13c406be10 0x7f13c406e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:29.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.684+0000 7f13d4ff9640 1 -- 172.21.15.103:0/3583350978 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f13cc08a9e0 con 0x7f13d81505f0 2024-09-10T08:33:29.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.684+0000 7f13dcc2a640 1 --2- 172.21.15.103:0/3583350978 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f13c406be10 0x7f13c406e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:29.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.684+0000 7f13d4ff9640 1 -- 172.21.15.103:0/3583350978 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c8041070 con 0x7f13d81ec880 2024-09-10T08:33:29.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.684+0000 7f13d4ff9640 1 -- 172.21.15.103:0/3583350978 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f13c8009490 con 0x7f13d81ec880 2024-09-10T08:33:29.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.684+0000 7f13d4ff9640 1 -- 172.21.15.103:0/3583350978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13d81ec880 msgr2=0x7f13d8146f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:29.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.684+0000 7f13d4ff9640 1 --2- 172.21.15.103:0/3583350978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13d81ec880 0x7f13d8146f50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f13d8070600 tx=0x7f13c80046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.684+0000 7f13d4ff9640 1 -- 172.21.15.103:0/3583350978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13d81ec880 msgr2=0x7f13d8146f50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:33:29.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.684+0000 7f13d4ff9640 1 --2- 172.21.15.103:0/3583350978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13d81ec880 0x7f13d8146f50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.684+0000 7f13dcc2a640 1 --2- 172.21.15.103:0/3583350978 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f13c406be10 0x7f13c406e2d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f13d00012e0 tx=0x7f13d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.690+0000 7f13de68d640 1 --2- 172.21.15.103:0/3583350978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13d80c69c0 0x7f13d8147490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.690+0000 7f13de68d640 1 -- 172.21.15.103:0/3583350978 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f13d81ebc80 con 0x7f13d80c69c0 2024-09-10T08:33:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.691+0000 7f13d7fff640 1 --2- 172.21.15.103:0/3583350978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13d80c69c0 0x7f13d8147490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.691+0000 7f13d7fff640 1 -- 172.21.15.103:0/3583350978 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f13d8153910 con 0x7f13d80c69c0 2024-09-10T08:33:29.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.691+0000 7f13d7fff640 1 --2- 172.21.15.103:0/3583350978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13d80c69c0 0x7f13d8147490 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f13c8000c00 tx=0x7f13c8008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:29.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.691+0000 7f13d4ff9640 1 -- 172.21.15.103:0/3583350978 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c8037040 con 0x7f13d80c69c0 2024-09-10T08:33:29.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.692+0000 7f13d4ff9640 1 -- 172.21.15.103:0/3583350978 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4877 (secure 0 0 0) 0x7f13c803d3f0 con 0x7f13d80c69c0 2024-09-10T08:33:29.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.692+0000 7f13d4ff9640 1 -- 172.21.15.103:0/3583350978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13d80c69c0 msgr2=0x7f13d8147490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:29.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.692+0000 7f13d4ff9640 1 --2- 172.21.15.103:0/3583350978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13d80c69c0 0x7f13d8147490 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f13c8000c00 tx=0x7f13c8008030 comp rx=0 tx=0).stop 2024-09-10T08:33:29.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.692+0000 7f13d4ff9640 1 -- 172.21.15.103:0/3583350978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13d80c69c0 msgr2=0x7f13d8147490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:33:29.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.692+0000 7f13d4ff9640 1 --2- 172.21.15.103:0/3583350978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13d80c69c0 0x7f13d8147490 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.692 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:33:29.692 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:33:29.692 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:33:29.692 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:33:29.692 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 36, 2024-09-10T08:33:29.692 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 42382, 2024-09-10T08:33:29.692 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:33:29.692 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:33:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:33:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:33:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:33:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:33:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:33:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:33:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:33:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:33:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:33:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:33:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:33:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:33:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:33:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:33:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:33:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:33:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:33:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:33:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:33:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:33:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:33:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:33:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:33:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:33:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:33:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:33:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:33:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:33:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:33:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:33:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:33:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:33:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:33:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:33:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:33:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:33:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:33:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:33:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:29.701 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:29.701 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.701 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.701 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:33:29.701 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:33:29.701 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:29.701 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:29.701 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.701 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:29.701 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:33:29.701 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:29.701 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.701 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.702 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:29.702 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:33:29.702 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:29.702 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:29.702 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:29.702 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.702 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:33:29.702 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:33:29.702 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:29.702 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:29.702 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:29.702 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:29.702 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:29.702 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.703 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:33:29.703 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:33:29.703 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.703 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:29.703 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:29.703 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:33:29.703 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:29.703 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:29.703 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:33:29.703 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.703 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:29.703 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:29.703 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:33:29.703 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:29.703 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:29.704 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:33:29.704 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.704 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:29.704 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:29.704 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:33:29.704 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:29.704 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:29.704 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:33:29.704 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.704 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:29.704 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:29.705 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:33:29.705 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:29.705 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:29.705 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.705 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:33:29.705 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:33:29.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.692+0000 7f13de68d640 1 -- 172.21.15.103:0/3583350978 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f13c406be10 msgr2=0x7f13c406e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:29.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.692+0000 7f13de68d640 1 --2- 172.21.15.103:0/3583350978 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f13c406be10 0x7f13c406e2d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f13d00012e0 tx=0x7f13d0009040 comp rx=0 tx=0).stop 2024-09-10T08:33:29.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.692+0000 7f13de68d640 1 -- 172.21.15.103:0/3583350978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13d81505f0 msgr2=0x7f13d81ec340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:29.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.692+0000 7f13de68d640 1 --2- 172.21.15.103:0/3583350978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13d81505f0 0x7f13d81ec340 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f13cc00b450 tx=0x7f13cc00b910 comp rx=0 tx=0).stop 2024-09-10T08:33:29.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.692+0000 7f13dcc2a640 1 -- 172.21.15.103:0/3583350978 reap_dead start 2024-09-10T08:33:29.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.692+0000 7f13de68d640 1 -- 172.21.15.103:0/3583350978 shutdown_connections 2024-09-10T08:33:29.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.692+0000 7f13de68d640 1 --2- 172.21.15.103:0/3583350978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13d81505f0 0x7f13d81ec340 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.692+0000 7f13de68d640 1 -- 172.21.15.103:0/3583350978 >> 172.21.15.103:0/3583350978 conn(0x7f13d80c7a40 msgr2=0x7f13d80c49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:29.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.692+0000 7f13de68d640 1 -- 172.21.15.103:0/3583350978 shutdown_connections 2024-09-10T08:33:29.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.692+0000 7f13de68d640 1 -- 172.21.15.103:0/3583350978 wait complete. 2024-09-10T08:33:29.708 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:33:29.708 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-10T08:33:29.708 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:33:29.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.808+0000 7f5af7eac640 1 Processor -- start 2024-09-10T08:33:29.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.808+0000 7f5af7eac640 1 -- start start 2024-09-10T08:33:29.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.809+0000 7f5af7eac640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af0153b10 0x7f5af00a9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:29.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.809+0000 7f5af7eac640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5af0074590 0x7f5af006cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:29.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.809+0000 7f5af7eac640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af0156dd0 con 0x7f5af00a7de0 2024-09-10T08:33:29.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.809+0000 7f5af7eac640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f5af0157350 con 0x7f5af0074590 2024-09-10T08:33:29.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.809+0000 7f5af7eac640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5af0159e50 con 0x7f5af0153b10 2024-09-10T08:33:29.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.810+0000 7f5af6449640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5af0074590 0x7f5af006cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:29.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.810+0000 7f5af5c48640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af0153b10 0x7f5af00a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:29.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.810+0000 7f5af6449640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5af0074590 0x7f5af006cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:51400/0 (socket says 172.21.15.103:51400) 2024-09-10T08:33:29.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.810+0000 7f5af5c48640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af0153b10 0x7f5af00a9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:34506/0 (socket says 172.21.15.103:34506) 2024-09-10T08:33:29.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.810+0000 7f5af6449640 1 -- 172.21.15.103:0/3112836554 learned_addr learned my addr 172.21.15.103:0/3112836554 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:29.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.810+0000 7f5af6449640 1 -- 172.21.15.103:0/3112836554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af0153b10 msgr2=0x7f5af00a9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:29.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.810+0000 7f5af6449640 1 --2- 172.21.15.103:0/3112836554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af0153b10 0x7f5af00a9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.810+0000 7f5af6449640 1 -- 172.21.15.103:0/3112836554 >> v1:172.21.15.154:6789/0 conn(0x7f5af00a7de0 legacy=0x7f5af015a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:29.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.810+0000 7f5af6449640 1 -- 172.21.15.103:0/3112836554 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af0157070 con 0x7f5af0074590 2024-09-10T08:33:29.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.811+0000 7f5af6449640 1 --2- 172.21.15.103:0/3112836554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5af0074590 0x7f5af006cf40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80098a0 tx=0x7f5ae802a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=450a71404cf9c9ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:29.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.811+0000 7f5af4c46640 1 -- 172.21.15.103:0/3112836554 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8037070 con 0x7f5af0074590 2024-09-10T08:33:29.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.811+0000 7f5af4c46640 1 -- 172.21.15.103:0/3112836554 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae8032440 con 0x7f5af0074590 2024-09-10T08:33:29.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.811+0000 7f5af4c46640 1 -- 172.21.15.103:0/3112836554 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8032810 con 0x7f5af0074590 2024-09-10T08:33:29.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.811+0000 7f5af7eac640 1 -- 172.21.15.103:0/3112836554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5af0074590 msgr2=0x7f5af006cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:29.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.811+0000 7f5af7eac640 1 --2- 172.21.15.103:0/3112836554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5af0074590 0x7f5af006cf40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80098a0 tx=0x7f5ae802a200 comp rx=0 tx=0).stop 2024-09-10T08:33:29.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.811+0000 7f5af7eac640 1 -- 172.21.15.103:0/3112836554 shutdown_connections 2024-09-10T08:33:29.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.811+0000 7f5af7eac640 1 --2- 172.21.15.103:0/3112836554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5af0074590 0x7f5af006cf40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.811+0000 7f5af7eac640 1 --2- 172.21.15.103:0/3112836554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af0153b10 0x7f5af00a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.811+0000 7f5af7eac640 1 -- 172.21.15.103:0/3112836554 >> 172.21.15.103:0/3112836554 conn(0x7f5af00c4fa0 msgr2=0x7f5af00c5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:29.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.811+0000 7f5af7eac640 1 -- 172.21.15.103:0/3112836554 shutdown_connections 2024-09-10T08:33:29.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.811+0000 7f5af7eac640 1 -- 172.21.15.103:0/3112836554 wait complete. 2024-09-10T08:33:29.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.813+0000 7f5af7eac640 1 Processor -- start 2024-09-10T08:33:29.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.813+0000 7f5af7eac640 1 -- start start 2024-09-10T08:33:29.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.813+0000 7f5af7eac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5af0074590 0x7f5af0073640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:29.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.813+0000 7f5af7eac640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af00a7de0 0x7f5af0072570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:29.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.813+0000 7f5af7eac640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af0153b10 0x7f5af014a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:29.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.813+0000 7f5af7eac640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0153ef0 con 0x7f5af0153b10 2024-09-10T08:33:29.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.813+0000 7f5af7eac640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5af00a9c40 con 0x7f5af0074590 2024-09-10T08:33:29.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.813+0000 7f5af7eac640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5af006db80 con 0x7f5af00a7de0 2024-09-10T08:33:29.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.813+0000 7f5af6449640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af0153b10 msgr2=0x7f5af014a910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:33:29.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.813+0000 7f5af6449640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af0153b10 0x7f5af014a910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:33:29.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.813+0000 7f5af5c48640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5af0074590 0x7f5af0073640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:29.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.813+0000 7f5af5447640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af00a7de0 0x7f5af0072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:29.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.813+0000 7f5af5c48640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5af0074590 0x7f5af0073640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:51416/0 (socket says 172.21.15.103:51416) 2024-09-10T08:33:29.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.813+0000 7f5af5c48640 1 -- 172.21.15.103:0/2273822221 learned_addr learned my addr 172.21.15.103:0/2273822221 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:29.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.813+0000 7f5af5447640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af00a7de0 0x7f5af0072570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:34512/0 (socket says 172.21.15.103:34512) 2024-09-10T08:33:29.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.814+0000 7f5af5c48640 1 -- 172.21.15.103:0/2273822221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af00a7de0 msgr2=0x7f5af0072570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:29.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.814+0000 7f5af5c48640 1 --2- 172.21.15.103:0/2273822221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af00a7de0 0x7f5af0072570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.814+0000 7f5af5c48640 1 -- 172.21.15.103:0/2273822221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af0153b10 msgr2=0x7f5af014a910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:33:29.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.814+0000 7f5af5c48640 1 --2- 172.21.15.103:0/2273822221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af0153b10 0x7f5af014a910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.814+0000 7f5af5c48640 1 -- 172.21.15.103:0/2273822221 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af00c73a0 con 0x7f5af0074590 2024-09-10T08:33:29.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.814+0000 7f5af5c48640 1 --2- 172.21.15.103:0/2273822221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5af0074590 0x7f5af0073640 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00efc0 tx=0x7f5aec00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:29.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.814+0000 7f5ae67fc640 1 -- 172.21.15.103:0/2273822221 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec018020 con 0x7f5af0074590 2024-09-10T08:33:29.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.814+0000 7f5ae67fc640 1 -- 172.21.15.103:0/2273822221 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5aec014480 con 0x7f5af0074590 2024-09-10T08:33:29.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.814+0000 7f5af7eac640 1 -- 172.21.15.103:0/2273822221 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af00c7680 con 0x7f5af0074590 2024-09-10T08:33:29.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.814+0000 7f5ae67fc640 1 -- 172.21.15.103:0/2273822221 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec014850 con 0x7f5af0074590 2024-09-10T08:33:29.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.814+0000 7f5af7eac640 1 -- 172.21.15.103:0/2273822221 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af0071fe0 con 0x7f5af0074590 2024-09-10T08:33:29.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.815+0000 7f5af7eac640 1 --2- 172.21.15.103:0/2273822221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af0157ca0 0x7f5af014ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:29.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.815+0000 7f5af7eac640 1 -- 172.21.15.103:0/2273822221 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5af00c7150 con 0x7f5af0157ca0 2024-09-10T08:33:29.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.815+0000 7f5af5447640 1 --2- 172.21.15.103:0/2273822221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af0157ca0 0x7f5af014ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:29.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.815+0000 7f5af5447640 1 -- 172.21.15.103:0/2273822221 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5af00a9700 con 0x7f5af0157ca0 2024-09-10T08:33:29.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.816+0000 7f5af5447640 1 --2- 172.21.15.103:0/2273822221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af0157ca0 0x7f5af014ae50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5af00c6ab0 tx=0x7f5ae000f9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:29.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.816+0000 7f5ae67fc640 1 -- 172.21.15.103:0/2273822221 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5aec01b020 con 0x7f5af0074590 2024-09-10T08:33:29.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.816+0000 7f5ae67fc640 1 --2- 172.21.15.103:0/2273822221 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5ad406bde0 0x7f5ad406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:29.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.816+0000 7f5ae67fc640 1 -- 172.21.15.103:0/2273822221 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f5aec08bc40 con 0x7f5af0074590 2024-09-10T08:33:29.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.816+0000 7f5af6449640 1 --2- 172.21.15.103:0/2273822221 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5ad406bde0 0x7f5ad406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:29.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.816+0000 7f5ae67fc640 1 -- 172.21.15.103:0/2273822221 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0019070 con 0x7f5af0157ca0 2024-09-10T08:33:29.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.816+0000 7f5ae67fc640 1 -- 172.21.15.103:0/2273822221 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5ae0005320 con 0x7f5af0157ca0 2024-09-10T08:33:29.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.816+0000 7f5ae67fc640 1 -- 172.21.15.103:0/2273822221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af0157ca0 msgr2=0x7f5af014ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:29.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.816+0000 7f5ae67fc640 1 --2- 172.21.15.103:0/2273822221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af0157ca0 0x7f5af014ae50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5af00c6ab0 tx=0x7f5ae000f9d0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.816+0000 7f5ae67fc640 1 -- 172.21.15.103:0/2273822221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af0157ca0 msgr2=0x7f5af014ae50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:33:29.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.816+0000 7f5ae67fc640 1 --2- 172.21.15.103:0/2273822221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af0157ca0 0x7f5af014ae50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.817+0000 7f5af6449640 1 --2- 172.21.15.103:0/2273822221 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5ad406bde0 0x7f5ad406e2a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8034000 tx=0x7f5ae802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:29.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.823+0000 7f5af7eac640 1 --2- 172.21.15.103:0/2273822221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af0072ab0 0x7f5af01ef4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:29.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.823+0000 7f5af7eac640 1 -- 172.21.15.103:0/2273822221 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5af0152c30 con 0x7f5af0072ab0 2024-09-10T08:33:29.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.823+0000 7f5af5447640 1 --2- 172.21.15.103:0/2273822221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af0072ab0 0x7f5af01ef4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:29.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.823+0000 7f5af5447640 1 -- 172.21.15.103:0/2273822221 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5af0067b90 con 0x7f5af0072ab0 2024-09-10T08:33:29.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.823+0000 7f5af5447640 1 --2- 172.21.15.103:0/2273822221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af0072ab0 0x7f5af01ef4f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0016000 tx=0x7f5ae0000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:29.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.823+0000 7f5ae67fc640 1 -- 172.21.15.103:0/2273822221 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0019030 con 0x7f5af0072ab0 2024-09-10T08:33:29.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.824+0000 7f5ae67fc640 1 -- 172.21.15.103:0/2273822221 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5043 (secure 0 0 0) 0x7f5ae0006cd0 con 0x7f5af0072ab0 2024-09-10T08:33:29.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.824+0000 7f5ae67fc640 1 -- 172.21.15.103:0/2273822221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af0072ab0 msgr2=0x7f5af01ef4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:29.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.824+0000 7f5ae67fc640 1 --2- 172.21.15.103:0/2273822221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af0072ab0 0x7f5af01ef4f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0016000 tx=0x7f5ae0000ed0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.824+0000 7f5ae67fc640 1 -- 172.21.15.103:0/2273822221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af0072ab0 msgr2=0x7f5af01ef4f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:33:29.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.824+0000 7f5ae67fc640 1 --2- 172.21.15.103:0/2273822221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5af0072ab0 0x7f5af01ef4f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:29.824 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:33:29.824 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:33:29.824 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:33:29.824 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:33:29.824 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 36, 2024-09-10T08:33:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 153982, 2024-09-10T08:33:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:33:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:33:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:33:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:33:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:33:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:33:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:33:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:29.826 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:29.826 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:29.826 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:29.826 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:29.826 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:29.826 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:29.826 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:29.826 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:29.826 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:29.826 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:33:29.826 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:33:29.826 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:29.826 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:33:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:33:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:33:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:33:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:33:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:33:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:33:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:33:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:33:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:33:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:33:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:33:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:33:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:33:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:33:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:33:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:33:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:33:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:33:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:33:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:33:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:33:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:33:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:33:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:33:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:33:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:33:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:33:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:33:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:33:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:33:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:33:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:33:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:33:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:33:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:33:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:33:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:33:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:33:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:33:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:33:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:33:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:33:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-10T08:33:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:33:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:33:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:33:29.838 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:29.838 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:29.838 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:29.838 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:33:29.838 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:29.838 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:29.838 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:29.838 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:33:29.838 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:33:29.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.824+0000 7f5af7eac640 1 -- 172.21.15.103:0/2273822221 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5ad406bde0 msgr2=0x7f5ad406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:29.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.824+0000 7f5af7eac640 1 --2- 172.21.15.103:0/2273822221 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5ad406bde0 0x7f5ad406e2a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8034000 tx=0x7f5ae802e000 comp rx=0 tx=0).stop 2024-09-10T08:33:29.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.824+0000 7f5af7eac640 1 -- 172.21.15.103:0/2273822221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5af0074590 msgr2=0x7f5af0073640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:29.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.824+0000 7f5af7eac640 1 --2- 172.21.15.103:0/2273822221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5af0074590 0x7f5af0073640 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00efc0 tx=0x7f5aec00c490 comp rx=0 tx=0).stop 2024-09-10T08:33:29.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.824+0000 7f5af6449640 1 -- 172.21.15.103:0/2273822221 reap_dead start 2024-09-10T08:33:29.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.824+0000 7f5af6449640 1 -- 172.21.15.103:0/2273822221 reap_dead start 2024-09-10T08:33:29.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.824+0000 7f5af7eac640 1 -- 172.21.15.103:0/2273822221 shutdown_connections 2024-09-10T08:33:29.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.824+0000 7f5af7eac640 1 -- 172.21.15.103:0/2273822221 >> 172.21.15.103:0/2273822221 conn(0x7f5af00c4fa0 msgr2=0x7f5af006d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:29.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.824+0000 7f5af7eac640 1 -- 172.21.15.103:0/2273822221 shutdown_connections 2024-09-10T08:33:29.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:29.824+0000 7f5af7eac640 1 -- 172.21.15.103:0/2273822221 wait complete. 2024-09-10T08:33:29.840 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:33:29.840 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-10T08:33:29.879 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:33:29.881 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:33:49.841 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-10T08:33:49.842 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-10T08:33:49.842 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T08:33:49.842 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T08:33:49.844 INFO:tasks.ceph.mon.a:Started 2024-09-10T08:33:49.844 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:33:49.845 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:33:49.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.953+0000 7feafa0b7640 1 Processor -- start 2024-09-10T08:33:49.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.953+0000 7feafa0b7640 1 -- start start 2024-09-10T08:33:49.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.953+0000 7feafa0b7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7feaf40acc30 0x7feaf40c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:49.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.953+0000 7feafa0b7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feaf40c8180 0x7feaf415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:49.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.954+0000 7feafa0b7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaf4070590 con 0x7feaf40c44b0 2024-09-10T08:33:49.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.954+0000 7feafa0b7640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7feaf40c4ea0 con 0x7feaf40acc30 2024-09-10T08:33:49.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.954+0000 7feaf37fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7feaf40acc30 0x7feaf40c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:49.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.954+0000 7feafa0b7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7feaf40a8220 con 0x7feaf40c8180 2024-09-10T08:33:49.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.954+0000 7feaf37fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7feaf40acc30 0x7feaf40c3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55088/0 (socket says 172.21.15.103:55088) 2024-09-10T08:33:49.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.954+0000 7feaf37fe640 1 -- 172.21.15.103:0/4092632743 learned_addr learned my addr 172.21.15.103:0/4092632743 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:49.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.954+0000 7feaf3fff640 1 --2- 172.21.15.103:0/4092632743 >> v2:172.21.15.154:3300/0 conn(0x7feaf40c8180 0x7feaf415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:49.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.954+0000 7feaf37fe640 1 -- 172.21.15.103:0/4092632743 >> v2:172.21.15.103:3300/0 conn(0x7feaf40acc30 msgr2=0x7feaf40c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:33:49.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.954+0000 7feaf37fe640 1 -- 172.21.15.103:0/4092632743 >> v2:172.21.15.103:3300/0 conn(0x7feaf40acc30 msgr2=0x7feaf40c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:33:49.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.954+0000 7feaf37fe640 1 --2- 172.21.15.103:0/4092632743 >> v2:172.21.15.103:3300/0 conn(0x7feaf40acc30 0x7feaf40c3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:33:49.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.954+0000 7feaf37fe640 1 --2- 172.21.15.103:0/4092632743 >> v2:172.21.15.103:3300/0 conn(0x7feaf40acc30 0x7feaf40c3f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:33:49.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.954+0000 7feaf27fc640 1 -- 172.21.15.103:0/4092632743 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2809434393 0 0) 0x7feaf4070590 con 0x7feaf40c44b0 2024-09-10T08:33:49.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.954+0000 7feaf27fc640 1 -- 172.21.15.103:0/4092632743 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feadc003520 con 0x7feaf40c44b0 2024-09-10T08:33:49.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.954+0000 7feaf3fff640 1 -- 172.21.15.103:0/4092632743 >> v2:172.21.15.103:3300/0 conn(0x7feaf40acc30 msgr2=0x7feaf40c3f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:33:49.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.954+0000 7feaf3fff640 1 --2- 172.21.15.103:0/4092632743 >> v2:172.21.15.103:3300/0 conn(0x7feaf40acc30 0x7feaf40c3f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:49.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.954+0000 7feaf3fff640 1 -- 172.21.15.103:0/4092632743 >> v1:172.21.15.154:6789/0 conn(0x7feaf40c44b0 legacy=0x7feaf40c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:49.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.954+0000 7feaf3fff640 1 -- 172.21.15.103:0/4092632743 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf40a84f0 con 0x7feaf40c8180 2024-09-10T08:33:49.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.955+0000 7feaf3fff640 1 --2- 172.21.15.103:0/4092632743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf40c8180 0x7feaf415dd40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feaf40c6340 tx=0x7feaec02a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31bf3d9b3dd0e36 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:49.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.955+0000 7feaf27fc640 1 -- 172.21.15.103:0/4092632743 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec007740 con 0x7feaf40c8180 2024-09-10T08:33:49.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.955+0000 7feaf27fc640 1 -- 172.21.15.103:0/4092632743 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaec0078e0 con 0x7feaf40c8180 2024-09-10T08:33:49.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.955+0000 7feaf27fc640 1 -- 172.21.15.103:0/4092632743 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec007cb0 con 0x7feaf40c8180 2024-09-10T08:33:49.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.956+0000 7feafa0b7640 1 -- 172.21.15.103:0/4092632743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf40c8180 msgr2=0x7feaf415dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:49.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.956+0000 7feafa0b7640 1 --2- 172.21.15.103:0/4092632743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf40c8180 0x7feaf415dd40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feaf40c6340 tx=0x7feaec02a560 comp rx=0 tx=0).stop 2024-09-10T08:33:49.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.956+0000 7feafa0b7640 1 -- 172.21.15.103:0/4092632743 shutdown_connections 2024-09-10T08:33:49.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.956+0000 7feafa0b7640 1 --2- 172.21.15.103:0/4092632743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf40c8180 0x7feaf415dd40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:49.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.956+0000 7feafa0b7640 1 --2- 172.21.15.103:0/4092632743 >> v2:172.21.15.103:3300/0 conn(0x7feaf40acc30 0x7feaf40c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:49.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.956+0000 7feafa0b7640 1 -- 172.21.15.103:0/4092632743 >> 172.21.15.103:0/4092632743 conn(0x7feaf40c5660 msgr2=0x7feaf40c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:49.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.956+0000 7feafa0b7640 1 -- 172.21.15.103:0/4092632743 shutdown_connections 2024-09-10T08:33:49.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.956+0000 7feafa0b7640 1 -- 172.21.15.103:0/4092632743 wait complete. 2024-09-10T08:33:49.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.957+0000 7feafa0b7640 1 Processor -- start 2024-09-10T08:33:49.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.958+0000 7feafa0b7640 1 -- start start 2024-09-10T08:33:49.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.958+0000 7feafa0b7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaf40acc30 0x7feaf40c0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:49.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.958+0000 7feafa0b7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf40c44b0 0x7feaf41e8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:49.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.958+0000 7feafa0b7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feaf40c8180 0x7feaf40a9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:49.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.958+0000 7feafa0b7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feaf40c5330 con 0x7feaf40c8180 2024-09-10T08:33:49.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.959+0000 7feafa0b7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feaf40702b0 con 0x7feaf40c44b0 2024-09-10T08:33:49.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.959+0000 7feafa0b7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7feaf40c63f0 con 0x7feaf40acc30 2024-09-10T08:33:49.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.959+0000 7feaf2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf40c44b0 0x7feaf41e8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:49.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.959+0000 7feaf37fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaf40acc30 0x7feaf40c0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:49.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.959+0000 7feaf3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feaf40c8180 0x7feaf40a9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:49.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.959+0000 7feaf2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf40c44b0 0x7feaf41e8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:47258/0 (socket says 172.21.15.103:47258) 2024-09-10T08:33:49.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.959+0000 7feaf2ffd640 1 -- 172.21.15.103:0/763677485 learned_addr learned my addr 172.21.15.103:0/763677485 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:49.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.959+0000 7feaf3fff640 1 -- 172.21.15.103:0/763677485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feaf40c8180 msgr2=0x7feaf40a9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-10T08:33:49.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.959+0000 7feaf3fff640 1 -- 172.21.15.103:0/763677485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feaf40c8180 msgr2=0x7feaf40a9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:33:49.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.959+0000 7feaf3fff640 1 --2- 172.21.15.103:0/763677485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feaf40c8180 0x7feaf40a9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:33:49.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.959+0000 7feaf3fff640 1 --2- 172.21.15.103:0/763677485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feaf40c8180 0x7feaf40a9b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:33:49.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.959+0000 7feaf2ffd640 1 -- 172.21.15.103:0/763677485 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaf40acc30 msgr2=0x7feaf40c0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:49.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.959+0000 7feaf2ffd640 1 --2- 172.21.15.103:0/763677485 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaf40acc30 0x7feaf40c0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:49.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.959+0000 7feaf2ffd640 1 -- 172.21.15.103:0/763677485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feaf40c8180 msgr2=0x7feaf40a9b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:33:49.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.959+0000 7feaf2ffd640 1 --2- 172.21.15.103:0/763677485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feaf40c8180 0x7feaf40a9b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:49.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.959+0000 7feaf2ffd640 1 -- 172.21.15.103:0/763677485 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf40c07c0 con 0x7feaf40c44b0 2024-09-10T08:33:49.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.959+0000 7feaf2ffd640 1 --2- 172.21.15.103:0/763677485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf40c44b0 0x7feaf41e8d00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7feae800e710 tx=0x7feae800ebd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:49.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.959+0000 7feadbfff640 1 -- 172.21.15.103:0/763677485 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae80052d0 con 0x7feaf40c44b0 2024-09-10T08:33:49.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.960+0000 7feadbfff640 1 -- 172.21.15.103:0/763677485 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae8005490 con 0x7feaf40c44b0 2024-09-10T08:33:49.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.960+0000 7feadbfff640 1 -- 172.21.15.103:0/763677485 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae800ca90 con 0x7feaf40c44b0 2024-09-10T08:33:49.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.960+0000 7feafa0b7640 1 -- 172.21.15.103:0/763677485 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf40c0aa0 con 0x7feaf40c44b0 2024-09-10T08:33:49.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.960+0000 7feafa0b7640 1 -- 172.21.15.103:0/763677485 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf41e87e0 con 0x7feaf40c44b0 2024-09-10T08:33:49.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.961+0000 7feafa0b7640 1 -- 172.21.15.103:0/763677485 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf41e89b0 con 0x7feaf40c44b0 2024-09-10T08:33:49.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.961+0000 7feadbfff640 1 -- 172.21.15.103:0/763677485 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feae800cc30 con 0x7feaf40c44b0 2024-09-10T08:33:49.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.962+0000 7feadbfff640 1 --2- 172.21.15.103:0/763677485 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7feae006be30 0x7feae006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:49.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.962+0000 7feaf37fe640 1 --2- 172.21.15.103:0/763677485 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7feae006be30 0x7feae006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:49.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.962+0000 7feadbfff640 1 -- 172.21.15.103:0/763677485 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7feae8059870 con 0x7feaf40c44b0 2024-09-10T08:33:49.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.962+0000 7feaf37fe640 1 --2- 172.21.15.103:0/763677485 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7feae006be30 0x7feae006e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7feaf40aa310 tx=0x7feae4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:49.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:49.968+0000 7feadbfff640 1 -- 172.21.15.103:0/763677485 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feae8016020 con 0x7feaf40c44b0 2024-09-10T08:33:50.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:50.249+0000 7feafa0b7640 1 -- 172.21.15.103:0/763677485 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7feaf40aa080 con 0x7feaf40c44b0 2024-09-10T08:33:50.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:50.249+0000 7feadbfff640 1 -- 172.21.15.103:0/763677485 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7feae8016020 con 0x7feaf40c44b0 2024-09-10T08:33:50.250 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":36,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:33:50.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:50.252+0000 7feafa0b7640 1 -- 172.21.15.103:0/763677485 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7feae006be30 msgr2=0x7feae006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:50.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:50.252+0000 7feafa0b7640 1 --2- 172.21.15.103:0/763677485 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7feae006be30 0x7feae006e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7feaf40aa310 tx=0x7feae4008040 comp rx=0 tx=0).stop 2024-09-10T08:33:50.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:50.252+0000 7feafa0b7640 1 -- 172.21.15.103:0/763677485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf40c44b0 msgr2=0x7feaf41e8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:50.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:50.252+0000 7feafa0b7640 1 --2- 172.21.15.103:0/763677485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf40c44b0 0x7feaf41e8d00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7feae800e710 tx=0x7feae800ebd0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:50.252+0000 7feafa0b7640 1 -- 172.21.15.103:0/763677485 shutdown_connections 2024-09-10T08:33:50.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:50.252+0000 7feafa0b7640 1 --2- 172.21.15.103:0/763677485 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7feae006be30 0x7feae006e2f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:50.252+0000 7feafa0b7640 1 --2- 172.21.15.103:0/763677485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feaf40c8180 0x7feaf40a9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:50.252+0000 7feafa0b7640 1 --2- 172.21.15.103:0/763677485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf40c44b0 0x7feaf41e8d00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:50.252+0000 7feafa0b7640 1 --2- 172.21.15.103:0/763677485 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaf40acc30 0x7feaf40c0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:50.252+0000 7feafa0b7640 1 -- 172.21.15.103:0/763677485 >> 172.21.15.103:0/763677485 conn(0x7feaf40c5660 msgr2=0x7feaf4072300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:50.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:50.252+0000 7feafa0b7640 1 -- 172.21.15.103:0/763677485 shutdown_connections 2024-09-10T08:33:50.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:50.252+0000 7feafa0b7640 1 -- 172.21.15.103:0/763677485 wait complete. 2024-09-10T08:33:53.264 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:33:53.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.378+0000 7f5942dfd640 1 Processor -- start 2024-09-10T08:33:53.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.378+0000 7f5942dfd640 1 -- start start 2024-09-10T08:33:53.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.379+0000 7f5942dfd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f593c074060 0x7f593c0c1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:53.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.379+0000 7f5942dfd640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f593c157420 con 0x7f593c0c17f0 2024-09-10T08:33:53.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.379+0000 7f5942dfd640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f593c0c2550 con 0x7f593c156f90 2024-09-10T08:33:53.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.379+0000 7f5942dfd640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f593c0aafa0 con 0x7f593c074060 2024-09-10T08:33:53.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.379+0000 7f5940b99640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f593c0c17f0 0x7f593c153970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44618/0 (socket says 172.21.15.103:44618) 2024-09-10T08:33:53.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.379+0000 7f5940b99640 1 -- 172.21.15.103:0/1090998815 learned_addr learned my addr 172.21.15.103:0/1090998815 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:33:53.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.379+0000 7f593bfff640 1 --2- 172.21.15.103:0/1090998815 >> v2:172.21.15.154:3300/0 conn(0x7f593c074060 0x7f593c0c1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:53.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.379+0000 7f593b7fe640 1 -- 172.21.15.103:0/1090998815 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3605228562 0 0) 0x7f593c0c2550 con 0x7f593c156f90 2024-09-10T08:33:53.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.379+0000 7f593b7fe640 1 -- 172.21.15.103:0/1090998815 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f592c003520 con 0x7f593c156f90 2024-09-10T08:33:53.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.379+0000 7f593bfff640 1 -- 172.21.15.103:0/1090998815 >> v1:172.21.15.154:6789/0 conn(0x7f593c156f90 legacy=0x7f593c0c3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:53.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.379+0000 7f593bfff640 1 -- 172.21.15.103:0/1090998815 >> v1:172.21.15.103:6789/0 conn(0x7f593c0c17f0 legacy=0x7f593c153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:53.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.379+0000 7f593bfff640 1 -- 172.21.15.103:0/1090998815 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593c0c2270 con 0x7f593c074060 2024-09-10T08:33:53.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.380+0000 7f593bfff640 1 --2- 172.21.15.103:0/1090998815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f593c074060 0x7f593c0c1bd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f59280097a0 tx=0x7f592802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=986f64e510d67f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:53.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.380+0000 7f593b7fe640 1 -- 172.21.15.103:0/1090998815 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5928037070 con 0x7f593c074060 2024-09-10T08:33:53.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.381+0000 7f593b7fe640 1 -- 172.21.15.103:0/1090998815 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5928032440 con 0x7f593c074060 2024-09-10T08:33:53.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.381+0000 7f593b7fe640 1 -- 172.21.15.103:0/1090998815 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59280327f0 con 0x7f593c074060 2024-09-10T08:33:53.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.381+0000 7f5942dfd640 1 -- 172.21.15.103:0/1090998815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f593c074060 msgr2=0x7f593c0c1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:53.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.381+0000 7f5942dfd640 1 --2- 172.21.15.103:0/1090998815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f593c074060 0x7f593c0c1bd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f59280097a0 tx=0x7f592802a1a0 comp rx=0 tx=0).stop 2024-09-10T08:33:53.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.381+0000 7f5942dfd640 1 -- 172.21.15.103:0/1090998815 shutdown_connections 2024-09-10T08:33:53.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.381+0000 7f5942dfd640 1 --2- 172.21.15.103:0/1090998815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f593c074060 0x7f593c0c1bd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:53.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.381+0000 7f5942dfd640 1 -- 172.21.15.103:0/1090998815 >> 172.21.15.103:0/1090998815 conn(0x7f593c0c4c50 msgr2=0x7f593c0c5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:53.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.381+0000 7f5942dfd640 1 -- 172.21.15.103:0/1090998815 shutdown_connections 2024-09-10T08:33:53.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.381+0000 7f5942dfd640 1 -- 172.21.15.103:0/1090998815 wait complete. 2024-09-10T08:33:53.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.383+0000 7f5942dfd640 1 Processor -- start 2024-09-10T08:33:53.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.383+0000 7f5942dfd640 1 -- start start 2024-09-10T08:33:53.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.384+0000 7f5942dfd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f593c074060 0x7f593c155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:53.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.384+0000 7f5942dfd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f593c0c17f0 0x7f593c14a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:53.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.384+0000 7f5942dfd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f593c156f90 0x7f593c14a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:53.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.384+0000 7f5942dfd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f593c154200 con 0x7f593c0c17f0 2024-09-10T08:33:53.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.384+0000 7f5942dfd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f593c154080 con 0x7f593c156f90 2024-09-10T08:33:53.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.384+0000 7f5942dfd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f593c0c3b90 con 0x7f593c074060 2024-09-10T08:33:53.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.384+0000 7f593bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f593c0c17f0 0x7f593c14a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:53.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.384+0000 7f5940b99640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f593c074060 0x7f593c155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:53.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.384+0000 7f594139a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f593c156f90 0x7f593c14a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:53.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.384+0000 7f5940b99640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f593c074060 0x7f593c155690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:55892/0 (socket says 172.21.15.103:55892) 2024-09-10T08:33:53.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.384+0000 7f5940b99640 1 -- 172.21.15.103:0/3201676645 learned_addr learned my addr 172.21.15.103:0/3201676645 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:53.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.384+0000 7f593bfff640 1 -- 172.21.15.103:0/3201676645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f593c0c17f0 msgr2=0x7f593c14a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-10T08:33:53.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.384+0000 7f593bfff640 1 -- 172.21.15.103:0/3201676645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f593c0c17f0 msgr2=0x7f593c14a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:33:53.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.384+0000 7f593bfff640 1 --2- 172.21.15.103:0/3201676645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f593c0c17f0 0x7f593c14a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:33:53.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.384+0000 7f593bfff640 1 --2- 172.21.15.103:0/3201676645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f593c0c17f0 0x7f593c14a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:33:53.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.384+0000 7f594139a640 1 -- 172.21.15.103:0/3201676645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f593c074060 msgr2=0x7f593c155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:53.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.384+0000 7f594139a640 1 --2- 172.21.15.103:0/3201676645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f593c074060 0x7f593c155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:53.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.384+0000 7f594139a640 1 -- 172.21.15.103:0/3201676645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f593c0c17f0 msgr2=0x7f593c14a420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:33:53.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.384+0000 7f594139a640 1 --2- 172.21.15.103:0/3201676645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f593c0c17f0 0x7f593c14a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:53.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.384+0000 7f594139a640 1 -- 172.21.15.103:0/3201676645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593c14fcd0 con 0x7f593c156f90 2024-09-10T08:33:53.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.384+0000 7f5940b99640 1 --2- 172.21.15.103:0/3201676645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f593c074060 0x7f593c155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:33:53.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.385+0000 7f594139a640 1 --2- 172.21.15.103:0/3201676645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f593c156f90 0x7f593c14a960 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f593400c730 tx=0x7f593400cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:53.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.385+0000 7f59397fa640 1 -- 172.21.15.103:0/3201676645 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934003b70 con 0x7f593c156f90 2024-09-10T08:33:53.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.385+0000 7f59397fa640 1 -- 172.21.15.103:0/3201676645 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5934003d30 con 0x7f593c156f90 2024-09-10T08:33:53.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.385+0000 7f59397fa640 1 -- 172.21.15.103:0/3201676645 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934005310 con 0x7f593c156f90 2024-09-10T08:33:53.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.385+0000 7f5942dfd640 1 -- 172.21.15.103:0/3201676645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f593c071280 con 0x7f593c156f90 2024-09-10T08:33:53.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.385+0000 7f5942dfd640 1 -- 172.21.15.103:0/3201676645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f593c155bd0 con 0x7f593c156f90 2024-09-10T08:33:53.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.386+0000 7f5942dfd640 1 -- 172.21.15.103:0/3201676645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f593c0c3f50 con 0x7f593c156f90 2024-09-10T08:33:53.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.386+0000 7f59397fa640 1 -- 172.21.15.103:0/3201676645 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f59340054b0 con 0x7f593c156f90 2024-09-10T08:33:53.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.387+0000 7f59397fa640 1 --2- 172.21.15.103:0/3201676645 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f592006be60 0x7f592006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:53.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.387+0000 7f59397fa640 1 -- 172.21.15.103:0/3201676645 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f593408aec0 con 0x7f593c156f90 2024-09-10T08:33:53.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.387+0000 7f5940b99640 1 --2- 172.21.15.103:0/3201676645 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f592006be60 0x7f592006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:53.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.387+0000 7f5940b99640 1 --2- 172.21.15.103:0/3201676645 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f592006be60 0x7f592006e320 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5930005880 tx=0x7f5930009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:53.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.392+0000 7f59397fa640 1 -- 172.21.15.103:0/3201676645 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5934059560 con 0x7f593c156f90 2024-09-10T08:33:53.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.673+0000 7f5942dfd640 1 -- 172.21.15.103:0/3201676645 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f593c156ba0 con 0x7f593c156f90 2024-09-10T08:33:53.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.673+0000 7f59397fa640 1 -- 172.21.15.103:0/3201676645 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f5934058e60 con 0x7f593c156f90 2024-09-10T08:33:53.674 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":36,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:33:53.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.675+0000 7f5942dfd640 1 -- 172.21.15.103:0/3201676645 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f592006be60 msgr2=0x7f592006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:53.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.675+0000 7f5942dfd640 1 --2- 172.21.15.103:0/3201676645 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f592006be60 0x7f592006e320 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5930005880 tx=0x7f5930009040 comp rx=0 tx=0).stop 2024-09-10T08:33:53.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.675+0000 7f5942dfd640 1 -- 172.21.15.103:0/3201676645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f593c156f90 msgr2=0x7f593c14a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:53.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.675+0000 7f5942dfd640 1 --2- 172.21.15.103:0/3201676645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f593c156f90 0x7f593c14a960 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f593400c730 tx=0x7f593400cbf0 comp rx=0 tx=0).stop 2024-09-10T08:33:53.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.675+0000 7f5942dfd640 1 -- 172.21.15.103:0/3201676645 shutdown_connections 2024-09-10T08:33:53.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.675+0000 7f5942dfd640 1 --2- 172.21.15.103:0/3201676645 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f592006be60 0x7f592006e320 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:53.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.675+0000 7f5942dfd640 1 --2- 172.21.15.103:0/3201676645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f593c156f90 0x7f593c14a960 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:53.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.675+0000 7f5942dfd640 1 --2- 172.21.15.103:0/3201676645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f593c0c17f0 0x7f593c14a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:53.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.675+0000 7f5942dfd640 1 --2- 172.21.15.103:0/3201676645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f593c074060 0x7f593c155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:53.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.675+0000 7f5942dfd640 1 -- 172.21.15.103:0/3201676645 >> 172.21.15.103:0/3201676645 conn(0x7f593c0c4c50 msgr2=0x7f593c0c3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:53.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.676+0000 7f5942dfd640 1 -- 172.21.15.103:0/3201676645 shutdown_connections 2024-09-10T08:33:53.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:53.676+0000 7f5942dfd640 1 -- 172.21.15.103:0/3201676645 wait complete. 2024-09-10T08:33:56.689 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:33:56.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.789+0000 7fe8d8b66640 1 Processor -- start 2024-09-10T08:33:56.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.789+0000 7fe8d8b66640 1 -- start start 2024-09-10T08:33:56.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.790+0000 7fe8d8b66640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe8d4153be0 0x7fe8d415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:56.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.790+0000 7fe8d8b66640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8d40c7070 con 0x7fe8d406cd80 2024-09-10T08:33:56.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.790+0000 7fe8d8b66640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8d406d210 con 0x7fe8d40c8b10 2024-09-10T08:33:56.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.790+0000 7fe8d8b66640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe8d40c69b0 con 0x7fe8d4153be0 2024-09-10T08:33:56.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.790+0000 7fe8d1d9b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe8d406cd80 0x7fe8d4156660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:59722/0 (socket says 172.21.15.103:59722) 2024-09-10T08:33:56.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.790+0000 7fe8d1d9b640 1 -- 172.21.15.103:0/1164646500 learned_addr learned my addr 172.21.15.103:0/1164646500 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:33:56.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.790+0000 7fe8d2d9d640 1 --2- 172.21.15.103:0/1164646500 >> v2:172.21.15.154:3300/0 conn(0x7fe8d4153be0 0x7fe8d415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:56.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.790+0000 7fe8d159a640 1 -- 172.21.15.103:0/1164646500 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2928436347 0 0) 0x7fe8d40c7070 con 0x7fe8d406cd80 2024-09-10T08:33:56.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.790+0000 7fe8d159a640 1 -- 172.21.15.103:0/1164646500 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8bc003520 con 0x7fe8d406cd80 2024-09-10T08:33:56.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.790+0000 7fe8d2d9d640 1 -- 172.21.15.103:0/1164646500 >> v1:172.21.15.154:6789/0 conn(0x7fe8d40c8b10 legacy=0x7fe8d41534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:56.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.790+0000 7fe8d2d9d640 1 -- 172.21.15.103:0/1164646500 >> v1:172.21.15.103:6789/0 conn(0x7fe8d406cd80 legacy=0x7fe8d4156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:56.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.790+0000 7fe8d2d9d640 1 -- 172.21.15.103:0/1164646500 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d40c6c90 con 0x7fe8d4153be0 2024-09-10T08:33:56.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.791+0000 7fe8d2d9d640 1 --2- 172.21.15.103:0/1164646500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8d4153be0 0x7fe8d415a4a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009d90 tx=0x7fe8cc02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55f964e578b9f9a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:56.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.791+0000 7fe8d159a640 1 -- 172.21.15.103:0/1164646500 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc007740 con 0x7fe8d4153be0 2024-09-10T08:33:56.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.792+0000 7fe8d159a640 1 -- 172.21.15.103:0/1164646500 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8cc0078e0 con 0x7fe8d4153be0 2024-09-10T08:33:56.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.792+0000 7fe8d159a640 1 -- 172.21.15.103:0/1164646500 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc007cb0 con 0x7fe8d4153be0 2024-09-10T08:33:56.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.792+0000 7fe8d8b66640 1 -- 172.21.15.103:0/1164646500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8d4153be0 msgr2=0x7fe8d415a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:56.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.792+0000 7fe8d8b66640 1 --2- 172.21.15.103:0/1164646500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8d4153be0 0x7fe8d415a4a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009d90 tx=0x7fe8cc02a660 comp rx=0 tx=0).stop 2024-09-10T08:33:56.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.792+0000 7fe8d8b66640 1 -- 172.21.15.103:0/1164646500 shutdown_connections 2024-09-10T08:33:56.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.792+0000 7fe8d8b66640 1 --2- 172.21.15.103:0/1164646500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8d4153be0 0x7fe8d415a4a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:56.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.792+0000 7fe8d8b66640 1 -- 172.21.15.103:0/1164646500 >> 172.21.15.103:0/1164646500 conn(0x7fe8d40adb80 msgr2=0x7fe8d40adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:56.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.792+0000 7fe8d8b66640 1 -- 172.21.15.103:0/1164646500 shutdown_connections 2024-09-10T08:33:56.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.792+0000 7fe8d8b66640 1 -- 172.21.15.103:0/1164646500 wait complete. 2024-09-10T08:33:56.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.794+0000 7fe8d8b66640 1 Processor -- start 2024-09-10T08:33:56.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.794+0000 7fe8d8b66640 1 -- start start 2024-09-10T08:33:56.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.794+0000 7fe8d8b66640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8d40c8b10 0x7fe8d41596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:56.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.794+0000 7fe8d8b66640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8d4153be0 0x7fe8d40b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:56.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.794+0000 7fe8d8b66640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8d414c7d0 0x7fe8d41ef380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:56.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.794+0000 7fe8d8b66640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d40c9070 con 0x7fe8d4153be0 2024-09-10T08:33:56.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.794+0000 7fe8d8b66640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d40c8ef0 con 0x7fe8d40c8b10 2024-09-10T08:33:56.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.794+0000 7fe8d8b66640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe8d4156d70 con 0x7fe8d414c7d0 2024-09-10T08:33:56.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.794+0000 7fe8d1d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8d4153be0 0x7fe8d40b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:56.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.794+0000 7fe8d1d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8d4153be0 0x7fe8d40b10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55020/0 (socket says 172.21.15.103:55020) 2024-09-10T08:33:56.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.794+0000 7fe8d1d9b640 1 -- 172.21.15.103:0/210004906 learned_addr learned my addr 172.21.15.103:0/210004906 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:56.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.794+0000 7fe8d259c640 1 --2- 172.21.15.103:0/210004906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8d40c8b10 0x7fe8d41596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:56.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.795+0000 7fe8d2d9d640 1 --2- 172.21.15.103:0/210004906 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8d414c7d0 0x7fe8d41ef380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:56.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.795+0000 7fe8d1d9b640 1 -- 172.21.15.103:0/210004906 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8d414c7d0 msgr2=0x7fe8d41ef380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:56.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.795+0000 7fe8d1d9b640 1 --2- 172.21.15.103:0/210004906 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8d414c7d0 0x7fe8d41ef380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:56.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.795+0000 7fe8d1d9b640 1 -- 172.21.15.103:0/210004906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8d40c8b10 msgr2=0x7fe8d41596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:56.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.795+0000 7fe8d1d9b640 1 --2- 172.21.15.103:0/210004906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8d40c8b10 0x7fe8d41596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:56.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.795+0000 7fe8d1d9b640 1 -- 172.21.15.103:0/210004906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d40b1cb0 con 0x7fe8d4153be0 2024-09-10T08:33:56.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.795+0000 7fe8d1d9b640 1 --2- 172.21.15.103:0/210004906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8d4153be0 0x7fe8d40b10d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe8c800c530 tx=0x7fe8c800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:56.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.795+0000 7fe8c2ffd640 1 -- 172.21.15.103:0/210004906 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8017070 con 0x7fe8d4153be0 2024-09-10T08:33:56.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.795+0000 7fe8c2ffd640 1 -- 172.21.15.103:0/210004906 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c8005ce0 con 0x7fe8d4153be0 2024-09-10T08:33:56.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.795+0000 7fe8c2ffd640 1 -- 172.21.15.103:0/210004906 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c80072b0 con 0x7fe8d4153be0 2024-09-10T08:33:56.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.795+0000 7fe8d8b66640 1 -- 172.21.15.103:0/210004906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8d414c4f0 con 0x7fe8d4153be0 2024-09-10T08:33:56.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.795+0000 7fe8d8b66640 1 -- 172.21.15.103:0/210004906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8d4150cf0 con 0x7fe8d4153be0 2024-09-10T08:33:56.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.797+0000 7fe8d8b66640 1 -- 172.21.15.103:0/210004906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8d41570d0 con 0x7fe8d4153be0 2024-09-10T08:33:56.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.798+0000 7fe8c2ffd640 1 -- 172.21.15.103:0/210004906 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe8c801a070 con 0x7fe8d4153be0 2024-09-10T08:33:56.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.798+0000 7fe8c2ffd640 1 --2- 172.21.15.103:0/210004906 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe8b406be30 0x7fe8b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:56.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.798+0000 7fe8c2ffd640 1 -- 172.21.15.103:0/210004906 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fe8c808a550 con 0x7fe8d4153be0 2024-09-10T08:33:56.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.799+0000 7fe8d259c640 1 --2- 172.21.15.103:0/210004906 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe8b406be30 0x7fe8b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:56.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.799+0000 7fe8d259c640 1 --2- 172.21.15.103:0/210004906 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe8b406be30 0x7fe8b406e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe8d41561b0 tx=0x7fe8c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:56.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:56.806+0000 7fe8c2ffd640 1 -- 172.21.15.103:0/210004906 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe8c80585e0 con 0x7fe8d4153be0 2024-09-10T08:33:57.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.077+0000 7fe8d8b66640 1 -- 172.21.15.103:0/210004906 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe8d40c9d90 con 0x7fe8d4153be0 2024-09-10T08:33:57.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.077+0000 7fe8c2ffd640 1 -- 172.21.15.103:0/210004906 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7fe8c805c8e0 con 0x7fe8d4153be0 2024-09-10T08:33:57.078 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":40,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:33:57.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.080+0000 7fe8d8b66640 1 -- 172.21.15.103:0/210004906 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe8b406be30 msgr2=0x7fe8b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.080+0000 7fe8d8b66640 1 --2- 172.21.15.103:0/210004906 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe8b406be30 0x7fe8b406e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe8d41561b0 tx=0x7fe8c4009040 comp rx=0 tx=0).stop 2024-09-10T08:33:57.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.080+0000 7fe8d8b66640 1 -- 172.21.15.103:0/210004906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8d4153be0 msgr2=0x7fe8d40b10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.080+0000 7fe8d8b66640 1 --2- 172.21.15.103:0/210004906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8d4153be0 0x7fe8d40b10d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe8c800c530 tx=0x7fe8c800c9f0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.080+0000 7fe8d8b66640 1 -- 172.21.15.103:0/210004906 shutdown_connections 2024-09-10T08:33:57.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.080+0000 7fe8d8b66640 1 --2- 172.21.15.103:0/210004906 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe8b406be30 0x7fe8b406e2f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.080+0000 7fe8d8b66640 1 --2- 172.21.15.103:0/210004906 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8d414c7d0 0x7fe8d41ef380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.080+0000 7fe8d8b66640 1 --2- 172.21.15.103:0/210004906 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8d4153be0 0x7fe8d40b10d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.080+0000 7fe8d8b66640 1 --2- 172.21.15.103:0/210004906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8d40c8b10 0x7fe8d41596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.080+0000 7fe8d8b66640 1 -- 172.21.15.103:0/210004906 >> 172.21.15.103:0/210004906 conn(0x7fe8d40adb80 msgr2=0x7fe8d41532a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:57.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.080+0000 7fe8d8b66640 1 -- 172.21.15.103:0/210004906 shutdown_connections 2024-09-10T08:33:57.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.080+0000 7fe8d8b66640 1 -- 172.21.15.103:0/210004906 wait complete. 2024-09-10T08:33:57.092 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:33:57.092 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:33:57.093 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:33:57.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.203+0000 7f237ec4c640 1 Processor -- start 2024-09-10T08:33:57.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.204+0000 7f237ec4c640 1 -- start start 2024-09-10T08:33:57.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.205+0000 7f237ec4c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f23780c4ac0 0x7f2378153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.205+0000 7f237ec4c640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f237806efa0 con 0x7f23780afc60 2024-09-10T08:33:57.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.205+0000 7f237ec4c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f237806f280 con 0x7f2378072ec0 2024-09-10T08:33:57.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.205+0000 7f237ec4c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f237806f560 con 0x7f23780c4ac0 2024-09-10T08:33:57.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.205+0000 7f237d1e9640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f23780afc60 0x7f2378151380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:59724/0 (socket says 172.21.15.103:59724) 2024-09-10T08:33:57.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.205+0000 7f237d1e9640 1 -- 172.21.15.103:0/2277975297 learned_addr learned my addr 172.21.15.103:0/2277975297 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:33:57.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.205+0000 7f2377fff640 1 --2- 172.21.15.103:0/2277975297 >> v2:172.21.15.154:3300/0 conn(0x7f23780c4ac0 0x7f2378153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.205+0000 7f23777fe640 1 -- 172.21.15.103:0/2277975297 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2876127255 0 0) 0x7f237806efa0 con 0x7f23780afc60 2024-09-10T08:33:57.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.205+0000 7f23777fe640 1 -- 172.21.15.103:0/2277975297 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2368003520 con 0x7f23780afc60 2024-09-10T08:33:57.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.205+0000 7f2377fff640 1 -- 172.21.15.103:0/2277975297 >> v1:172.21.15.154:6789/0 conn(0x7f2378072ec0 legacy=0x7f2378070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.205+0000 7f2377fff640 1 -- 172.21.15.103:0/2277975297 >> v1:172.21.15.103:6789/0 conn(0x7f23780afc60 legacy=0x7f2378151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.205+0000 7f2377fff640 1 -- 172.21.15.103:0/2277975297 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237806f840 con 0x7f23780c4ac0 2024-09-10T08:33:57.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.206+0000 7f2377fff640 1 --2- 172.21.15.103:0/2277975297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23780c4ac0 0x7f2378153ff0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f23640097a0 tx=0x7f236402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ae0dbf875917535 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.206+0000 7f23777fe640 1 -- 172.21.15.103:0/2277975297 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2364037070 con 0x7f23780c4ac0 2024-09-10T08:33:57.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.206+0000 7f23777fe640 1 -- 172.21.15.103:0/2277975297 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2364032440 con 0x7f23780c4ac0 2024-09-10T08:33:57.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.206+0000 7f23777fe640 1 -- 172.21.15.103:0/2277975297 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236402ae60 con 0x7f23780c4ac0 2024-09-10T08:33:57.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.207+0000 7f237ec4c640 1 -- 172.21.15.103:0/2277975297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23780c4ac0 msgr2=0x7f2378153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.207+0000 7f237ec4c640 1 --2- 172.21.15.103:0/2277975297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23780c4ac0 0x7f2378153ff0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f23640097a0 tx=0x7f236402a110 comp rx=0 tx=0).stop 2024-09-10T08:33:57.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.207+0000 7f237ec4c640 1 -- 172.21.15.103:0/2277975297 shutdown_connections 2024-09-10T08:33:57.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.207+0000 7f237ec4c640 1 --2- 172.21.15.103:0/2277975297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23780c4ac0 0x7f2378153ff0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.207+0000 7f237ec4c640 1 -- 172.21.15.103:0/2277975297 >> 172.21.15.103:0/2277975297 conn(0x7f23780c9d80 msgr2=0x7f23780ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:57.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.207+0000 7f237ec4c640 1 -- 172.21.15.103:0/2277975297 shutdown_connections 2024-09-10T08:33:57.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.207+0000 7f237ec4c640 1 -- 172.21.15.103:0/2277975297 wait complete. 2024-09-10T08:33:57.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.208+0000 7f237ec4c640 1 Processor -- start 2024-09-10T08:33:57.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.209+0000 7f237ec4c640 1 -- start start 2024-09-10T08:33:57.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.210+0000 7f237ec4c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2378072ec0 0x7f23781e9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.210+0000 7f237ec4c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23780afc60 0x7f237814dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.210+0000 7f237ec4c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23780c4ac0 0x7f2378157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.210+0000 7f237ec4c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2378070750 con 0x7f23780afc60 2024-09-10T08:33:57.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.210+0000 7f237ec4c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f23780c47f0 con 0x7f23780c4ac0 2024-09-10T08:33:57.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.210+0000 7f237ec4c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f23780708d0 con 0x7f2378072ec0 2024-09-10T08:33:57.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.210+0000 7f2377fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23780afc60 0x7f237814dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.210+0000 7f2377fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23780afc60 0x7f237814dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55036/0 (socket says 172.21.15.103:55036) 2024-09-10T08:33:57.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.210+0000 7f2377fff640 1 -- 172.21.15.103:0/33105794 learned_addr learned my addr 172.21.15.103:0/33105794 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:57.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.210+0000 7f237c9e8640 1 --2- 172.21.15.103:0/33105794 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2378072ec0 0x7f23781e9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.210+0000 7f237d1e9640 1 --2- 172.21.15.103:0/33105794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23780c4ac0 0x7f2378157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.210+0000 7f2377fff640 1 -- 172.21.15.103:0/33105794 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2378072ec0 msgr2=0x7f23781e9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.210+0000 7f2377fff640 1 --2- 172.21.15.103:0/33105794 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2378072ec0 0x7f23781e9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.210+0000 7f2377fff640 1 -- 172.21.15.103:0/33105794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23780c4ac0 msgr2=0x7f2378157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.210+0000 7f2377fff640 1 --2- 172.21.15.103:0/33105794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23780c4ac0 0x7f2378157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.210+0000 7f2377fff640 1 -- 172.21.15.103:0/33105794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237814a240 con 0x7f23780afc60 2024-09-10T08:33:57.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.210+0000 7f2377fff640 1 --2- 172.21.15.103:0/33105794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23780afc60 0x7f237814dff0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2364000c00 tx=0x7f23640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.210+0000 7f23757fa640 1 -- 172.21.15.103:0/33105794 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2364037040 con 0x7f23780afc60 2024-09-10T08:33:57.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.211+0000 7f23757fa640 1 -- 172.21.15.103:0/33105794 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2364042070 con 0x7f23780afc60 2024-09-10T08:33:57.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.211+0000 7f237ec4c640 1 -- 172.21.15.103:0/33105794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23781ea460 con 0x7f23780afc60 2024-09-10T08:33:57.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.211+0000 7f23757fa640 1 -- 172.21.15.103:0/33105794 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2364030920 con 0x7f23780afc60 2024-09-10T08:33:57.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.211+0000 7f237ec4c640 1 -- 172.21.15.103:0/33105794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2378149c80 con 0x7f23780afc60 2024-09-10T08:33:57.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.212+0000 7f237ec4c640 1 --2- 172.21.15.103:0/33105794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2378147f00 0x7f2378158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.212+0000 7f237ec4c640 1 -- 172.21.15.103:0/33105794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2378141250 con 0x7f2378147f00 2024-09-10T08:33:57.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.212+0000 7f237c9e8640 1 --2- 172.21.15.103:0/33105794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2378147f00 0x7f2378158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.212+0000 7f237c9e8640 1 -- 172.21.15.103:0/33105794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f23781527c0 con 0x7f2378147f00 2024-09-10T08:33:57.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.212+0000 7f237c9e8640 1 --2- 172.21.15.103:0/33105794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2378147f00 0x7f2378158350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f236c00f770 tx=0x7f236c00fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.212+0000 7f23757fa640 1 -- 172.21.15.103:0/33105794 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2364030ac0 con 0x7f23780afc60 2024-09-10T08:33:57.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.213+0000 7f23757fa640 1 --2- 172.21.15.103:0/33105794 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f235c06be30 0x7f235c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.213+0000 7f237d1e9640 1 --2- 172.21.15.103:0/33105794 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f235c06be30 0x7f235c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.213+0000 7f23757fa640 1 -- 172.21.15.103:0/33105794 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f2364077a30 con 0x7f23780afc60 2024-09-10T08:33:57.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.213+0000 7f237d1e9640 1 --2- 172.21.15.103:0/33105794 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f235c06be30 0x7f235c06e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2370001560 tx=0x7f2370001a10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.213+0000 7f23757fa640 1 -- 172.21.15.103:0/33105794 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c0050d0 con 0x7f2378147f00 2024-09-10T08:33:57.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.214+0000 7f23757fa640 1 -- 172.21.15.103:0/33105794 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f236c018070 con 0x7f2378147f00 2024-09-10T08:33:57.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.214+0000 7f23757fa640 1 -- 172.21.15.103:0/33105794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2378147f00 msgr2=0x7f2378158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.214+0000 7f23757fa640 1 --2- 172.21.15.103:0/33105794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2378147f00 0x7f2378158350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f236c00f770 tx=0x7f236c00fc30 comp rx=0 tx=0).stop 2024-09-10T08:33:57.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.214+0000 7f23757fa640 1 -- 172.21.15.103:0/33105794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2378147f00 msgr2=0x7f2378158350 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:33:57.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.214+0000 7f23757fa640 1 --2- 172.21.15.103:0/33105794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2378147f00 0x7f2378158350 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.221+0000 7f237ec4c640 1 --2- 172.21.15.103:0/33105794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f237814c9e0 0x7f237814cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.221+0000 7f237ec4c640 1 -- 172.21.15.103:0/33105794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f23780ca4e0 con 0x7f237814c9e0 2024-09-10T08:33:57.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.221+0000 7f237c9e8640 1 --2- 172.21.15.103:0/33105794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f237814c9e0 0x7f237814cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.221+0000 7f237c9e8640 1 -- 172.21.15.103:0/33105794 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f237814e530 con 0x7f237814c9e0 2024-09-10T08:33:57.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.221+0000 7f237c9e8640 1 --2- 172.21.15.103:0/33105794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f237814c9e0 0x7f237814cfa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f236c00f770 tx=0x7f236c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.221+0000 7f23757fa640 1 -- 172.21.15.103:0/33105794 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c007300 con 0x7f237814c9e0 2024-09-10T08:33:57.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.222+0000 7f23757fa640 1 -- 172.21.15.103:0/33105794 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f236c007300 con 0x7f237814c9e0 2024-09-10T08:33:57.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.222+0000 7f23757fa640 1 -- 172.21.15.103:0/33105794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f237814c9e0 msgr2=0x7f237814cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.222+0000 7f23757fa640 1 --2- 172.21.15.103:0/33105794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f237814c9e0 0x7f237814cfa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f236c00f770 tx=0x7f236c001120 comp rx=0 tx=0).stop 2024-09-10T08:33:57.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.222+0000 7f23757fa640 1 -- 172.21.15.103:0/33105794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f237814c9e0 msgr2=0x7f237814cfa0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:33:57.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.222+0000 7f23757fa640 1 --2- 172.21.15.103:0/33105794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f237814c9e0 0x7f237814cfa0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.223 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:33:57.223 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:33:57.223 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:33:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:33:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 40, 2024-09-10T08:33:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 7289, 2024-09-10T08:33:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:33:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:33:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:33:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:33:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 1, 2024-09-10T08:33:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:33:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:33:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:33:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:57.226 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:57.226 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:57.226 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:57.226 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:33:57.226 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:33:57.226 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:33:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:33:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:33:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:33:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:33:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:33:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:33:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:33:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:33:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:33:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:33:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:33:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:33:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:33:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:33:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:33:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:33:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:33:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:33:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:33:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:33:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:33:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:33:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:33:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:33:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:33:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:33:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:33:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:33:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:33:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:33:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:33:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:33:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:33:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:33:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:33:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:33:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:33:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:33:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:33:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:33:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:33:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:33:57.236 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:33:57.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.222+0000 7f237ec4c640 1 -- 172.21.15.103:0/33105794 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f235c06be30 msgr2=0x7f235c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.222+0000 7f237ec4c640 1 --2- 172.21.15.103:0/33105794 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f235c06be30 0x7f235c06e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2370001560 tx=0x7f2370001a10 comp rx=0 tx=0).stop 2024-09-10T08:33:57.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.222+0000 7f237ec4c640 1 -- 172.21.15.103:0/33105794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23780afc60 msgr2=0x7f237814dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.222+0000 7f237ec4c640 1 --2- 172.21.15.103:0/33105794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23780afc60 0x7f237814dff0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2364000c00 tx=0x7f23640046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.222+0000 7f237d1e9640 1 -- 172.21.15.103:0/33105794 reap_dead start 2024-09-10T08:33:57.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.222+0000 7f237d1e9640 1 -- 172.21.15.103:0/33105794 reap_dead start 2024-09-10T08:33:57.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.222+0000 7f237ec4c640 1 -- 172.21.15.103:0/33105794 shutdown_connections 2024-09-10T08:33:57.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.222+0000 7f237ec4c640 1 -- 172.21.15.103:0/33105794 >> 172.21.15.103:0/33105794 conn(0x7f23780c9d80 msgr2=0x7f2378151360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:57.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.222+0000 7f237ec4c640 1 -- 172.21.15.103:0/33105794 shutdown_connections 2024-09-10T08:33:57.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.222+0000 7f237ec4c640 1 -- 172.21.15.103:0/33105794 wait complete. 2024-09-10T08:33:57.239 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:33:57.239 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:33:57.239 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:33:57.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.347+0000 7f33002eb640 1 Processor -- start 2024-09-10T08:33:57.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.347+0000 7f33002eb640 1 -- start start 2024-09-10T08:33:57.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.348+0000 7f33002eb640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f32f8073e10 0x7f32f806e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.348+0000 7f33002eb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f80acb90 0x7f32f8152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.348+0000 7f33002eb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f32f80abc30 0x7f32f8152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.348+0000 7f33002eb640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f32f8150540 con 0x7f32f8073e10 2024-09-10T08:33:57.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.348+0000 7f33002eb640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f32f806f290 con 0x7f32f80abc30 2024-09-10T08:33:57.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.348+0000 7f33002eb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f32f80741f0 con 0x7f32f80acb90 2024-09-10T08:33:57.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.348+0000 7f32fe087640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f32f8073e10 0x7f32f806e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.348+0000 7f32fe087640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f32f8073e10 0x7f32f806e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55066/0 (socket says 172.21.15.103:55066) 2024-09-10T08:33:57.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.348+0000 7f32fe087640 1 -- 172.21.15.103:0/3681293526 learned_addr learned my addr 172.21.15.103:0/3681293526 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:57.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.348+0000 7f32fd886640 1 --2- 172.21.15.103:0/3681293526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f80acb90 0x7f32f8152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.348+0000 7f32fe888640 1 --2- 172.21.15.103:0/3681293526 >> v2:172.21.15.154:3300/0 conn(0x7f32f80abc30 0x7f32f8152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.348+0000 7f32fe087640 1 -- 172.21.15.103:0/3681293526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f80acb90 msgr2=0x7f32f8152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:57.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.348+0000 7f32fe087640 1 --2- 172.21.15.103:0/3681293526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f80acb90 0x7f32f8152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.348+0000 7f32fe087640 1 -- 172.21.15.103:0/3681293526 >> v2:172.21.15.154:3300/0 conn(0x7f32f80abc30 msgr2=0x7f32f8152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:57.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.348+0000 7f32fe087640 1 --2- 172.21.15.103:0/3681293526 >> v2:172.21.15.154:3300/0 conn(0x7f32f80abc30 0x7f32f8152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.348+0000 7f32fe087640 1 -- 172.21.15.103:0/3681293526 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f80c4a60 con 0x7f32f8073e10 2024-09-10T08:33:57.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.349+0000 7f32fe087640 1 --2- 172.21.15.103:0/3681293526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f8073e10 0x7f32f806e030 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f32f806cfb0 tx=0x7f32f402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f1633f159344a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.349+0000 7f32fd085640 1 -- 172.21.15.103:0/3681293526 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4037070 con 0x7f32f8073e10 2024-09-10T08:33:57.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.349+0000 7f32fd085640 1 -- 172.21.15.103:0/3681293526 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f4032440 con 0x7f32f8073e10 2024-09-10T08:33:57.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.349+0000 7f32fd085640 1 -- 172.21.15.103:0/3681293526 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4032810 con 0x7f32f8073e10 2024-09-10T08:33:57.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.350+0000 7f33002eb640 1 -- 172.21.15.103:0/3681293526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f8073e10 msgr2=0x7f32f806e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.350+0000 7f33002eb640 1 --2- 172.21.15.103:0/3681293526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f8073e10 0x7f32f806e030 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f32f806cfb0 tx=0x7f32f402a1e0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.350+0000 7f33002eb640 1 -- 172.21.15.103:0/3681293526 shutdown_connections 2024-09-10T08:33:57.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.350+0000 7f33002eb640 1 --2- 172.21.15.103:0/3681293526 >> v2:172.21.15.154:3300/0 conn(0x7f32f80abc30 0x7f32f8152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.350+0000 7f33002eb640 1 --2- 172.21.15.103:0/3681293526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f80acb90 0x7f32f8152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.350+0000 7f33002eb640 1 --2- 172.21.15.103:0/3681293526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f8073e10 0x7f32f806e030 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.350+0000 7f33002eb640 1 -- 172.21.15.103:0/3681293526 >> 172.21.15.103:0/3681293526 conn(0x7f32f80c83a0 msgr2=0x7f32f80c8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:57.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.350+0000 7f33002eb640 1 -- 172.21.15.103:0/3681293526 shutdown_connections 2024-09-10T08:33:57.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.350+0000 7f33002eb640 1 -- 172.21.15.103:0/3681293526 wait complete. 2024-09-10T08:33:57.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.351+0000 7f33002eb640 1 Processor -- start 2024-09-10T08:33:57.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.351+0000 7f33002eb640 1 -- start start 2024-09-10T08:33:57.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.352+0000 7f33002eb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f8073e10 0x7f32f81ec380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.352+0000 7f33002eb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f80abc30 0x7f32f81ecd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.352+0000 7f33002eb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f80acb90 0x7f32f80c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.352+0000 7f33002eb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f32f80ab7f0 con 0x7f32f8073e10 2024-09-10T08:33:57.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.352+0000 7f33002eb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f32f80ab670 con 0x7f32f80abc30 2024-09-10T08:33:57.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.352+0000 7f33002eb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f32f8153520 con 0x7f32f80acb90 2024-09-10T08:33:57.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.352+0000 7f32fe087640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f8073e10 0x7f32f81ec380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.352+0000 7f32fe087640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f8073e10 0x7f32f81ec380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55068/0 (socket says 172.21.15.103:55068) 2024-09-10T08:33:57.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.352+0000 7f32fe087640 1 -- 172.21.15.103:0/3309066071 learned_addr learned my addr 172.21.15.103:0/3309066071 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:57.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.352+0000 7f32fd886640 1 --2- 172.21.15.103:0/3309066071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f80abc30 0x7f32f81ecd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.352+0000 7f32fe888640 1 --2- 172.21.15.103:0/3309066071 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f80acb90 0x7f32f80c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.352+0000 7f32fe087640 1 -- 172.21.15.103:0/3309066071 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f80acb90 msgr2=0x7f32f80c1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.352+0000 7f32fe087640 1 --2- 172.21.15.103:0/3309066071 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f80acb90 0x7f32f80c1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.352+0000 7f32fe087640 1 -- 172.21.15.103:0/3309066071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f80abc30 msgr2=0x7f32f81ecd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.352+0000 7f32fe087640 1 --2- 172.21.15.103:0/3309066071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f80abc30 0x7f32f81ecd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.352+0000 7f32fe087640 1 -- 172.21.15.103:0/3309066071 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f814b9e0 con 0x7f32f8073e10 2024-09-10T08:33:57.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.352+0000 7f32fe087640 1 --2- 172.21.15.103:0/3309066071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f8073e10 0x7f32f81ec380 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f32f402a220 tx=0x7f32f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.353+0000 7f32eeffd640 1 -- 172.21.15.103:0/3309066071 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4041020 con 0x7f32f8073e10 2024-09-10T08:33:57.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.353+0000 7f32eeffd640 1 -- 172.21.15.103:0/3309066071 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f403d620 con 0x7f32f8073e10 2024-09-10T08:33:57.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.353+0000 7f32eeffd640 1 -- 172.21.15.103:0/3309066071 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4037040 con 0x7f32f8073e10 2024-09-10T08:33:57.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.353+0000 7f33002eb640 1 -- 172.21.15.103:0/3309066071 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f81eef10 con 0x7f32f8073e10 2024-09-10T08:33:57.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.353+0000 7f33002eb640 1 -- 172.21.15.103:0/3309066071 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f814af70 con 0x7f32f8073e10 2024-09-10T08:33:57.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.354+0000 7f33002eb640 1 --2- 172.21.15.103:0/3309066071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f81ef6d0 0x7f32f8147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.354+0000 7f33002eb640 1 -- 172.21.15.103:0/3309066071 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f32f8067950 con 0x7f32f81ef6d0 2024-09-10T08:33:57.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.354+0000 7f32fd886640 1 --2- 172.21.15.103:0/3309066071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f81ef6d0 0x7f32f8147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.354+0000 7f32fd886640 1 -- 172.21.15.103:0/3309066071 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f32f814ffd0 con 0x7f32f81ef6d0 2024-09-10T08:33:57.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.354+0000 7f32eeffd640 1 -- 172.21.15.103:0/3309066071 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32f4044020 con 0x7f32f8073e10 2024-09-10T08:33:57.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.354+0000 7f32fd886640 1 --2- 172.21.15.103:0/3309066071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f81ef6d0 0x7f32f8147320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f32f8160170 tx=0x7f32e8011d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.355+0000 7f32eeffd640 1 --2- 172.21.15.103:0/3309066071 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f32dc06be30 0x7f32dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.355+0000 7f32fe888640 1 --2- 172.21.15.103:0/3309066071 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f32dc06be30 0x7f32dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.355+0000 7f32eeffd640 1 -- 172.21.15.103:0/3309066071 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f32f40ab6a0 con 0x7f32f8073e10 2024-09-10T08:33:57.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.355+0000 7f32eeffd640 1 -- 172.21.15.103:0/3309066071 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e800fb30 con 0x7f32f81ef6d0 2024-09-10T08:33:57.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.355+0000 7f32eeffd640 1 -- 172.21.15.103:0/3309066071 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f32e800fcd0 con 0x7f32f81ef6d0 2024-09-10T08:33:57.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.355+0000 7f32eeffd640 1 -- 172.21.15.103:0/3309066071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f81ef6d0 msgr2=0x7f32f8147320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.355+0000 7f32eeffd640 1 --2- 172.21.15.103:0/3309066071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f81ef6d0 0x7f32f8147320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f32f8160170 tx=0x7f32e8011d40 comp rx=0 tx=0).stop 2024-09-10T08:33:57.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.355+0000 7f32eeffd640 1 -- 172.21.15.103:0/3309066071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f81ef6d0 msgr2=0x7f32f8147320 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:33:57.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.355+0000 7f32eeffd640 1 --2- 172.21.15.103:0/3309066071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f81ef6d0 0x7f32f8147320 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.355+0000 7f32fe888640 1 --2- 172.21.15.103:0/3309066071 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f32dc06be30 0x7f32dc06e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f32f80ac0e0 tx=0x7f32f000d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.363+0000 7f33002eb640 1 --2- 172.21.15.103:0/3309066071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f81efab0 0x7f32f8147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.364+0000 7f33002eb640 1 -- 172.21.15.103:0/3309066071 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f32f8147da0 con 0x7f32f81efab0 2024-09-10T08:33:57.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.364+0000 7f32fd886640 1 --2- 172.21.15.103:0/3309066071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f81efab0 0x7f32f8147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.364+0000 7f32fd886640 1 -- 172.21.15.103:0/3309066071 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f32f80c26c0 con 0x7f32f81efab0 2024-09-10T08:33:57.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.364+0000 7f32fd886640 1 --2- 172.21.15.103:0/3309066071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f81efab0 0x7f32f8147860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f32e801b000 tx=0x7f32e80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.364+0000 7f32eeffd640 1 -- 172.21.15.103:0/3309066071 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e8003da0 con 0x7f32f81efab0 2024-09-10T08:33:57.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.365+0000 7f32eeffd640 1 -- 172.21.15.103:0/3309066071 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4886 (secure 0 0 0) 0x7f32e8003da0 con 0x7f32f81efab0 2024-09-10T08:33:57.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.365+0000 7f32eeffd640 1 -- 172.21.15.103:0/3309066071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f81efab0 msgr2=0x7f32f8147860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.365+0000 7f32eeffd640 1 --2- 172.21.15.103:0/3309066071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f81efab0 0x7f32f8147860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f32e801b000 tx=0x7f32e80046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.365+0000 7f32eeffd640 1 -- 172.21.15.103:0/3309066071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f81efab0 msgr2=0x7f32f8147860 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:33:57.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.365+0000 7f32eeffd640 1 --2- 172.21.15.103:0/3309066071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f81efab0 0x7f32f8147860 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.366 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:33:57.366 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:33:57.366 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:33:57.366 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:33:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 40, 2024-09-10T08:33:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 70057, 2024-09-10T08:33:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:33:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:33:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:33:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:33:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 1, 2024-09-10T08:33:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:33:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:33:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:33:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:33:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:33:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:33:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:33:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:33:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:33:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:33:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:33:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:33:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:33:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:33:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:33:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:33:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:33:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:33:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:33:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:33:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:33:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:33:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:33:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:33:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:33:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:33:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:33:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:33:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:33:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:33:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:33:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:33:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:33:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:33:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:33:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:33:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:33:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:33:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:33:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:33:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:33:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:33:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:33:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:33:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:33:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:33:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:33:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:33:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:33:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:33:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.380 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:57.380 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:57.380 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:33:57.380 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.380 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:57.380 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.380 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:33:57.380 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:33:57.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.365+0000 7f33002eb640 1 -- 172.21.15.103:0/3309066071 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f32dc06be30 msgr2=0x7f32dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.365+0000 7f33002eb640 1 --2- 172.21.15.103:0/3309066071 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f32dc06be30 0x7f32dc06e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f32f80ac0e0 tx=0x7f32f000d040 comp rx=0 tx=0).stop 2024-09-10T08:33:57.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.365+0000 7f33002eb640 1 -- 172.21.15.103:0/3309066071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f8073e10 msgr2=0x7f32f81ec380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.365+0000 7f33002eb640 1 --2- 172.21.15.103:0/3309066071 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f8073e10 0x7f32f81ec380 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f32f402a220 tx=0x7f32f40046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.365+0000 7f32fe888640 1 -- 172.21.15.103:0/3309066071 reap_dead start 2024-09-10T08:33:57.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.365+0000 7f32fe888640 1 -- 172.21.15.103:0/3309066071 reap_dead start 2024-09-10T08:33:57.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.365+0000 7f33002eb640 1 -- 172.21.15.103:0/3309066071 shutdown_connections 2024-09-10T08:33:57.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.365+0000 7f33002eb640 1 -- 172.21.15.103:0/3309066071 >> 172.21.15.103:0/3309066071 conn(0x7f32f80c83a0 msgr2=0x7f32f80c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:57.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.365+0000 7f33002eb640 1 -- 172.21.15.103:0/3309066071 shutdown_connections 2024-09-10T08:33:57.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.365+0000 7f33002eb640 1 -- 172.21.15.103:0/3309066071 wait complete. 2024-09-10T08:33:57.383 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:33:57.383 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:33:57.383 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:33:57.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.498+0000 7f506df59640 1 Processor -- start 2024-09-10T08:33:57.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.498+0000 7f506df59640 1 -- start start 2024-09-10T08:33:57.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.499+0000 7f506df59640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50680c58f0 0x7f5068159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.499+0000 7f506df59640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50680c5430 con 0x7f50680ad510 2024-09-10T08:33:57.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.499+0000 7f506df59640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f506806ca00 con 0x7f50680c35f0 2024-09-10T08:33:57.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.499+0000 7f506df59640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f50680a8780 con 0x7f50680c58f0 2024-09-10T08:33:57.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.499+0000 7f5067fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f50680ad510 0x7f506806c2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:59728/0 (socket says 172.21.15.103:59728) 2024-09-10T08:33:57.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.499+0000 7f5067fff640 1 -- 172.21.15.103:0/2327880133 learned_addr learned my addr 172.21.15.103:0/2327880133 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:33:57.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.499+0000 7f50677fe640 1 --2- 172.21.15.103:0/2327880133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50680c58f0 0x7f5068159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.499+0000 7f50667fc640 1 -- 172.21.15.103:0/2327880133 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2023292898 0 0) 0x7f50680c5430 con 0x7f50680ad510 2024-09-10T08:33:57.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.499+0000 7f50667fc640 1 -- 172.21.15.103:0/2327880133 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5050003520 con 0x7f50680ad510 2024-09-10T08:33:57.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.499+0000 7f50667fc640 1 -- 172.21.15.103:0/2327880133 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2534092113 0 0) 0x7f506806ca00 con 0x7f50680c35f0 2024-09-10T08:33:57.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.499+0000 7f50667fc640 1 -- 172.21.15.103:0/2327880133 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50680c5430 con 0x7f50680c35f0 2024-09-10T08:33:57.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.499+0000 7f50677fe640 1 -- 172.21.15.103:0/2327880133 >> v1:172.21.15.154:6789/0 conn(0x7f50680c35f0 legacy=0x7f506806bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.499+0000 7f50677fe640 1 -- 172.21.15.103:0/2327880133 >> v1:172.21.15.103:6789/0 conn(0x7f50680ad510 legacy=0x7f506806c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.499+0000 7f50677fe640 1 -- 172.21.15.103:0/2327880133 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50680c5150 con 0x7f50680c58f0 2024-09-10T08:33:57.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.500+0000 7f50677fe640 1 --2- 172.21.15.103:0/2327880133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50680c58f0 0x7f5068159ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f50580097d0 tx=0x7f505802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=996ec586891b554e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.501+0000 7f50667fc640 1 -- 172.21.15.103:0/2327880133 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5058037070 con 0x7f50680c58f0 2024-09-10T08:33:57.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.501+0000 7f50667fc640 1 -- 172.21.15.103:0/2327880133 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5058032440 con 0x7f50680c58f0 2024-09-10T08:33:57.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.501+0000 7f50667fc640 1 -- 172.21.15.103:0/2327880133 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5058032810 con 0x7f50680c58f0 2024-09-10T08:33:57.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.501+0000 7f506df59640 1 -- 172.21.15.103:0/2327880133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50680c58f0 msgr2=0x7f5068159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.501+0000 7f506df59640 1 --2- 172.21.15.103:0/2327880133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50680c58f0 0x7f5068159ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f50580097d0 tx=0x7f505802a210 comp rx=0 tx=0).stop 2024-09-10T08:33:57.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.501+0000 7f506df59640 1 -- 172.21.15.103:0/2327880133 shutdown_connections 2024-09-10T08:33:57.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.501+0000 7f506df59640 1 --2- 172.21.15.103:0/2327880133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50680c58f0 0x7f5068159ad0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.501+0000 7f506df59640 1 -- 172.21.15.103:0/2327880133 >> 172.21.15.103:0/2327880133 conn(0x7f50680c8bf0 msgr2=0x7f50680c8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:57.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.501+0000 7f506df59640 1 -- 172.21.15.103:0/2327880133 shutdown_connections 2024-09-10T08:33:57.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.501+0000 7f506df59640 1 -- 172.21.15.103:0/2327880133 wait complete. 2024-09-10T08:33:57.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.503+0000 7f506df59640 1 Processor -- start 2024-09-10T08:33:57.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.503+0000 7f506df59640 1 -- start start 2024-09-10T08:33:57.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.504+0000 7f506df59640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50680ad510 0x7f50681eb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.504+0000 7f506df59640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50680c35f0 0x7f50680738b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.504+0000 7f506df59640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50680c58f0 0x7f5068154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.504+0000 7f506df59640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f50680c2f90 con 0x7f50680ad510 2024-09-10T08:33:57.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.504+0000 7f506df59640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f50680c2790 con 0x7f50680c58f0 2024-09-10T08:33:57.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.504+0000 7f506df59640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f50680c4d20 con 0x7f50680c35f0 2024-09-10T08:33:57.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.504+0000 7f50677fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50680ad510 0x7f50681eb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.504+0000 7f50677fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50680ad510 0x7f50681eb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55072/0 (socket says 172.21.15.103:55072) 2024-09-10T08:33:57.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.504+0000 7f50677fe640 1 -- 172.21.15.103:0/2895682612 learned_addr learned my addr 172.21.15.103:0/2895682612 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:57.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.504+0000 7f5066ffd640 1 --2- 172.21.15.103:0/2895682612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50680c35f0 0x7f50680738b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.504+0000 7f5067fff640 1 --2- 172.21.15.103:0/2895682612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50680c58f0 0x7f5068154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.504+0000 7f50677fe640 1 -- 172.21.15.103:0/2895682612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50680c35f0 msgr2=0x7f50680738b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.504+0000 7f50677fe640 1 --2- 172.21.15.103:0/2895682612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50680c35f0 0x7f50680738b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.504+0000 7f50677fe640 1 -- 172.21.15.103:0/2895682612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50680c58f0 msgr2=0x7f5068154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.504+0000 7f50677fe640 1 --2- 172.21.15.103:0/2895682612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50680c58f0 0x7f5068154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.504+0000 7f50677fe640 1 -- 172.21.15.103:0/2895682612 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5068072a30 con 0x7f50680ad510 2024-09-10T08:33:57.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.504+0000 7f50677fe640 1 --2- 172.21.15.103:0/2895682612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50680ad510 0x7f50681eb5f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f50580097d0 tx=0x7f50580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.505+0000 7f504ffff640 1 -- 172.21.15.103:0/2895682612 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5058041020 con 0x7f50680ad510 2024-09-10T08:33:57.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.505+0000 7f504ffff640 1 -- 172.21.15.103:0/2895682612 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f505803d640 con 0x7f50680ad510 2024-09-10T08:33:57.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.505+0000 7f506df59640 1 -- 172.21.15.103:0/2895682612 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5068072d10 con 0x7f50680ad510 2024-09-10T08:33:57.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.505+0000 7f504ffff640 1 -- 172.21.15.103:0/2895682612 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5058037040 con 0x7f50680ad510 2024-09-10T08:33:57.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.505+0000 7f506df59640 1 -- 172.21.15.103:0/2895682612 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5068155300 con 0x7f50680ad510 2024-09-10T08:33:57.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.506+0000 7f506df59640 1 --2- 172.21.15.103:0/2895682612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50680a9d00 0x7f50681ef220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.506+0000 7f506df59640 1 -- 172.21.15.103:0/2895682612 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f50681eeb60 con 0x7f50680a9d00 2024-09-10T08:33:57.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.506+0000 7f5066ffd640 1 --2- 172.21.15.103:0/2895682612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50680a9d00 0x7f50681ef220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.506+0000 7f504ffff640 1 -- 172.21.15.103:0/2895682612 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5058044020 con 0x7f50680ad510 2024-09-10T08:33:57.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.506+0000 7f5066ffd640 1 -- 172.21.15.103:0/2895682612 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f50680c5cd0 con 0x7f50680a9d00 2024-09-10T08:33:57.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.507+0000 7f5066ffd640 1 --2- 172.21.15.103:0/2895682612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50680a9d00 0x7f50681ef220 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f50680c9800 tx=0x7f505c00f9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.507+0000 7f504ffff640 1 --2- 172.21.15.103:0/2895682612 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f505406be30 0x7f505406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.507+0000 7f504ffff640 1 -- 172.21.15.103:0/2895682612 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f50580ab7d0 con 0x7f50680ad510 2024-09-10T08:33:57.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.507+0000 7f5067fff640 1 --2- 172.21.15.103:0/2895682612 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f505406be30 0x7f505406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.507+0000 7f504ffff640 1 -- 172.21.15.103:0/2895682612 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505c0052e0 con 0x7f50680a9d00 2024-09-10T08:33:57.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.507+0000 7f504ffff640 1 -- 172.21.15.103:0/2895682612 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f505c018070 con 0x7f50680a9d00 2024-09-10T08:33:57.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.507+0000 7f504ffff640 1 -- 172.21.15.103:0/2895682612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50680a9d00 msgr2=0x7f50681ef220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.507+0000 7f504ffff640 1 --2- 172.21.15.103:0/2895682612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50680a9d00 0x7f50681ef220 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f50680c9800 tx=0x7f505c00f9d0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.507+0000 7f504ffff640 1 -- 172.21.15.103:0/2895682612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50680a9d00 msgr2=0x7f50681ef220 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:33:57.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.507+0000 7f504ffff640 1 --2- 172.21.15.103:0/2895682612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50680a9d00 0x7f50681ef220 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f50680c9800 tx=0x7f505c00f9d0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.507+0000 7f5067fff640 1 --2- 172.21.15.103:0/2895682612 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f505406be30 0x7f505406e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f50600012e0 tx=0x7f5060001a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.513+0000 7f506df59640 1 --2- 172.21.15.103:0/2895682612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50681ef760 0x7f50680a6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.513+0000 7f506df59640 1 -- 172.21.15.103:0/2895682612 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5068072ee0 con 0x7f50681ef760 2024-09-10T08:33:57.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.514+0000 7f5066ffd640 1 --2- 172.21.15.103:0/2895682612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50681ef760 0x7f50680a6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.514+0000 7f5066ffd640 1 -- 172.21.15.103:0/2895682612 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f506806fb80 con 0x7f50681ef760 2024-09-10T08:33:57.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.514+0000 7f5066ffd640 1 --2- 172.21.15.103:0/2895682612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50681ef760 0x7f50680a6f00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f505c017000 tx=0x7f505c000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.514+0000 7f504ffff640 1 -- 172.21.15.103:0/2895682612 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505c003940 con 0x7f50681ef760 2024-09-10T08:33:57.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.515+0000 7f504ffff640 1 -- 172.21.15.103:0/2895682612 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7f505c003940 con 0x7f50681ef760 2024-09-10T08:33:57.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.515+0000 7f504ffff640 1 -- 172.21.15.103:0/2895682612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50681ef760 msgr2=0x7f50680a6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.515+0000 7f504ffff640 1 --2- 172.21.15.103:0/2895682612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50681ef760 0x7f50680a6f00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f505c017000 tx=0x7f505c000ed0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.515+0000 7f504ffff640 1 -- 172.21.15.103:0/2895682612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50681ef760 msgr2=0x7f50680a6f00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:33:57.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.515+0000 7f504ffff640 1 --2- 172.21.15.103:0/2895682612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50681ef760 0x7f50680a6f00 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f505c017000 tx=0x7f505c000ed0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.516 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:33:57.516 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:33:57.516 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:33:57.516 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:33:57.516 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 40, 2024-09-10T08:33:57.516 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 181675, 2024-09-10T08:33:57.516 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:33:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:33:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:33:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:33:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 1, 2024-09-10T08:33:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:33:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:33:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:33:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:33:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:33:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:33:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:33:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:33:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:33:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:33:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:33:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:33:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:33:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:33:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:33:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:33:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:33:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:33:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:33:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:33:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:33:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:33:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:33:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:33:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:33:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:33:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:33:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:33:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:33:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:33:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:33:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:33:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:33:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:33:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:33:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:33:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:33:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:33:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:33:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:33:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:33:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:33:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:33:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:33:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:33:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:33:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:33:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:33:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:33:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:33:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:33:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:33:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:33:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:33:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:33:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:33:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:33:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:33:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:33:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:33:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:33:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:33:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:33:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:33:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:33:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:33:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:33:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-10T08:33:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:33:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:33:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:33:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:33:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:33:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:33:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:33:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:33:57.530 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:33:57.530 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:33:57.530 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:33:57.530 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:33:57.530 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:33:57.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.515+0000 7f506df59640 1 -- 172.21.15.103:0/2895682612 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f505406be30 msgr2=0x7f505406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.515+0000 7f506df59640 1 --2- 172.21.15.103:0/2895682612 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f505406be30 0x7f505406e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f50600012e0 tx=0x7f5060001a30 comp rx=0 tx=0).stop 2024-09-10T08:33:57.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.515+0000 7f506df59640 1 -- 172.21.15.103:0/2895682612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50680ad510 msgr2=0x7f50681eb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.515+0000 7f506df59640 1 --2- 172.21.15.103:0/2895682612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50680ad510 0x7f50681eb5f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f50580097d0 tx=0x7f50580046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.515+0000 7f5067fff640 1 -- 172.21.15.103:0/2895682612 reap_dead start 2024-09-10T08:33:57.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.515+0000 7f5067fff640 1 -- 172.21.15.103:0/2895682612 reap_dead start 2024-09-10T08:33:57.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.515+0000 7f506df59640 1 -- 172.21.15.103:0/2895682612 shutdown_connections 2024-09-10T08:33:57.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.515+0000 7f506df59640 1 -- 172.21.15.103:0/2895682612 >> 172.21.15.103:0/2895682612 conn(0x7f50680c8bf0 msgr2=0x7f50680c8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:57.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.515+0000 7f506df59640 1 -- 172.21.15.103:0/2895682612 shutdown_connections 2024-09-10T08:33:57.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.515+0000 7f506df59640 1 -- 172.21.15.103:0/2895682612 wait complete. 2024-09-10T08:33:57.532 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:33:57.532 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-10T08:33:57.533 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-10T08:33:57.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.650+0000 7fae8f1fa640 1 Processor -- start 2024-09-10T08:33:57.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.650+0000 7fae8f1fa640 1 -- start start 2024-09-10T08:33:57.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.651+0000 7fae8f1fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae88074120 0x7fae880ca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.651+0000 7fae8f1fa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae8806c060 0x7fae8806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.651+0000 7fae8f1fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae88156c80 con 0x7fae88153910 2024-09-10T08:33:57.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.651+0000 7fae8f1fa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fae88156ef0 con 0x7fae8806c060 2024-09-10T08:33:57.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.651+0000 7fae8f1fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fae880caea0 con 0x7fae88074120 2024-09-10T08:33:57.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.651+0000 7fae8e9f9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae8806c060 0x7fae8806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.651+0000 7fae8d9f7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae88074120 0x7fae880ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.652+0000 7fae8e9f9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae8806c060 0x7fae8806c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:59132/0 (socket says 172.21.15.103:59132) 2024-09-10T08:33:57.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.652+0000 7fae8d9f7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae88074120 0x7fae880ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:59562/0 (socket says 172.21.15.103:59562) 2024-09-10T08:33:57.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.652+0000 7fae8e9f9640 1 -- 172.21.15.103:0/4291393341 learned_addr learned my addr 172.21.15.103:0/4291393341 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:57.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.652+0000 7fae8e9f9640 1 -- 172.21.15.103:0/4291393341 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae88074120 msgr2=0x7fae880ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:57.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.652+0000 7fae8e9f9640 1 --2- 172.21.15.103:0/4291393341 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae88074120 0x7fae880ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.652+0000 7fae8e9f9640 1 -- 172.21.15.103:0/4291393341 >> v1:172.21.15.154:6789/0 conn(0x7fae88153910 legacy=0x7fae880ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.652+0000 7fae8e9f9640 1 -- 172.21.15.103:0/4291393341 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae880736f0 con 0x7fae8806c060 2024-09-10T08:33:57.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.652+0000 7fae8d9f7640 1 --2- 172.21.15.103:0/4291393341 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae88074120 0x7fae880ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:33:57.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.653+0000 7fae8e9f9640 1 --2- 172.21.15.103:0/4291393341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae8806c060 0x7fae8806c4f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fae80009e50 tx=0x7fae8002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0f130b571a86c30 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.653+0000 7fae8d1f6640 1 -- 172.21.15.103:0/4291393341 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae80036070 con 0x7fae8806c060 2024-09-10T08:33:57.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.653+0000 7fae8d1f6640 1 -- 172.21.15.103:0/4291393341 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae80031600 con 0x7fae8806c060 2024-09-10T08:33:57.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.653+0000 7fae8d1f6640 1 -- 172.21.15.103:0/4291393341 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae800319d0 con 0x7fae8806c060 2024-09-10T08:33:57.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.654+0000 7fae8f1fa640 1 -- 172.21.15.103:0/4291393341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae8806c060 msgr2=0x7fae8806c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.654+0000 7fae8f1fa640 1 --2- 172.21.15.103:0/4291393341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae8806c060 0x7fae8806c4f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fae80009e50 tx=0x7fae8002a680 comp rx=0 tx=0).stop 2024-09-10T08:33:57.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.654+0000 7fae8f1fa640 1 -- 172.21.15.103:0/4291393341 shutdown_connections 2024-09-10T08:33:57.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.654+0000 7fae8f1fa640 1 --2- 172.21.15.103:0/4291393341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae8806c060 0x7fae8806c4f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.654+0000 7fae8f1fa640 1 --2- 172.21.15.103:0/4291393341 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae88074120 0x7fae880ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.654+0000 7fae8f1fa640 1 -- 172.21.15.103:0/4291393341 >> 172.21.15.103:0/4291393341 conn(0x7fae880ad840 msgr2=0x7fae880adc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:57.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.654+0000 7fae8f1fa640 1 -- 172.21.15.103:0/4291393341 shutdown_connections 2024-09-10T08:33:57.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.654+0000 7fae8f1fa640 1 -- 172.21.15.103:0/4291393341 wait complete. 2024-09-10T08:33:57.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.655+0000 7fae8f1fa640 1 Processor -- start 2024-09-10T08:33:57.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.656+0000 7fae8f1fa640 1 -- start start 2024-09-10T08:33:57.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.656+0000 7fae8f1fa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae8806c060 0x7fae881ebf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.656+0000 7fae8f1fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae88074120 0x7fae880af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.656+0000 7fae8f1fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae88153910 0x7fae8814c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.656+0000 7fae8f1fa640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fae88073490 con 0x7fae8806c060 2024-09-10T08:33:57.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.656+0000 7fae8f1fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fae88073310 con 0x7fae88074120 2024-09-10T08:33:57.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.656+0000 7fae8f1fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fae8806ca30 con 0x7fae88153910 2024-09-10T08:33:57.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.657+0000 7fae8e1f8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae8806c060 0x7fae881ebf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.657+0000 7fae8e1f8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae8806c060 0x7fae881ebf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55080/0 (socket says 172.21.15.103:55080) 2024-09-10T08:33:57.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.657+0000 7fae8e1f8640 1 -- 172.21.15.103:0/101108941 learned_addr learned my addr 172.21.15.103:0/101108941 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:33:57.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.657+0000 7fae8d9f7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae88074120 0x7fae880af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.657+0000 7fae8e9f9640 1 --2- 172.21.15.103:0/101108941 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae88153910 0x7fae8814c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.657+0000 7fae8e1f8640 1 -- 172.21.15.103:0/101108941 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae88153910 msgr2=0x7fae8814c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.657+0000 7fae8e1f8640 1 --2- 172.21.15.103:0/101108941 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae88153910 0x7fae8814c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.657+0000 7fae8e1f8640 1 -- 172.21.15.103:0/101108941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae88074120 msgr2=0x7fae880af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.657+0000 7fae8e1f8640 1 --2- 172.21.15.103:0/101108941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae88074120 0x7fae880af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.657+0000 7fae8e1f8640 1 -- 172.21.15.103:0/101108941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae881550c0 con 0x7fae8806c060 2024-09-10T08:33:57.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.657+0000 7fae8d9f7640 1 --2- 172.21.15.103:0/101108941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae88074120 0x7fae880af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:33:57.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.657+0000 7fae8e1f8640 1 --2- 172.21.15.103:0/101108941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae8806c060 0x7fae881ebf10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fae8400c3f0 tx=0x7fae8400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.657+0000 7fae7effd640 1 -- 172.21.15.103:0/101108941 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae840052d0 con 0x7fae8806c060 2024-09-10T08:33:57.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.657+0000 7fae7effd640 1 -- 172.21.15.103:0/101108941 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae84005490 con 0x7fae8806c060 2024-09-10T08:33:57.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.657+0000 7fae8f1fa640 1 -- 172.21.15.103:0/101108941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae88155e50 con 0x7fae8806c060 2024-09-10T08:33:57.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.657+0000 7fae7effd640 1 -- 172.21.15.103:0/101108941 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae84007260 con 0x7fae8806c060 2024-09-10T08:33:57.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.657+0000 7fae8f1fa640 1 -- 172.21.15.103:0/101108941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae880afda0 con 0x7fae8806c060 2024-09-10T08:33:57.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.658+0000 7fae8f1fa640 1 -- 172.21.15.103:0/101108941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae8806c4f0 con 0x7fae8806c060 2024-09-10T08:33:57.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.659+0000 7fae7effd640 1 -- 172.21.15.103:0/101108941 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae84007400 con 0x7fae8806c060 2024-09-10T08:33:57.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.659+0000 7fae7effd640 1 --2- 172.21.15.103:0/101108941 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae6c06be60 0x7fae6c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.660+0000 7fae7effd640 1 -- 172.21.15.103:0/101108941 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fae8408a5d0 con 0x7fae8806c060 2024-09-10T08:33:57.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.660+0000 7fae8d9f7640 1 --2- 172.21.15.103:0/101108941 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae6c06be60 0x7fae6c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.660+0000 7fae8d9f7640 1 --2- 172.21.15.103:0/101108941 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae6c06be60 0x7fae6c06e320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fae88073df0 tx=0x7fae78009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.664+0000 7fae7effd640 1 -- 172.21.15.103:0/101108941 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae84058600 con 0x7fae8806c060 2024-09-10T08:33:57.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.958+0000 7fae8f1fa640 1 -- 172.21.15.103:0/101108941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fae880ad4a0 con 0x7fae8806c060 2024-09-10T08:33:57.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.959+0000 7fae7effd640 1 -- 172.21.15.103:0/101108941 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fae8405c900 con 0x7fae8806c060 2024-09-10T08:33:57.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.962+0000 7fae8f1fa640 1 -- 172.21.15.103:0/101108941 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae6c06be60 msgr2=0x7fae6c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.962+0000 7fae8f1fa640 1 --2- 172.21.15.103:0/101108941 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae6c06be60 0x7fae6c06e320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fae88073df0 tx=0x7fae78009190 comp rx=0 tx=0).stop 2024-09-10T08:33:57.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.962+0000 7fae8f1fa640 1 -- 172.21.15.103:0/101108941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae8806c060 msgr2=0x7fae881ebf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.962+0000 7fae8f1fa640 1 --2- 172.21.15.103:0/101108941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae8806c060 0x7fae881ebf10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fae8400c3f0 tx=0x7fae8400c8b0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.962+0000 7fae8f1fa640 1 -- 172.21.15.103:0/101108941 shutdown_connections 2024-09-10T08:33:57.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.962+0000 7fae8f1fa640 1 --2- 172.21.15.103:0/101108941 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae6c06be60 0x7fae6c06e320 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.962+0000 7fae8f1fa640 1 --2- 172.21.15.103:0/101108941 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae88153910 0x7fae8814c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.962+0000 7fae8f1fa640 1 --2- 172.21.15.103:0/101108941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae88074120 0x7fae880af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.962+0000 7fae8f1fa640 1 --2- 172.21.15.103:0/101108941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae8806c060 0x7fae881ebf10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.962+0000 7fae8f1fa640 1 -- 172.21.15.103:0/101108941 >> 172.21.15.103:0/101108941 conn(0x7fae880ad840 msgr2=0x7fae880adcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:57.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.962+0000 7fae8f1fa640 1 -- 172.21.15.103:0/101108941 shutdown_connections 2024-09-10T08:33:57.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:33:57.962+0000 7fae8f1fa640 1 -- 172.21.15.103:0/101108941 wait complete. 2024-09-10T08:33:57.974 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-10T08:33:59.945 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:33:59.948 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:34:07.975 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:34:07.975 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:34:08.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.077+0000 7f2baf53b640 1 Processor -- start 2024-09-10T08:34:08.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.077+0000 7f2baf53b640 1 -- start start 2024-09-10T08:34:08.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.078+0000 7f2baf53b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2ba806cd80 0x7f2ba8153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.078+0000 7f2baf53b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ba815a4a0 0x7f2ba8156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.078+0000 7f2baf53b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ba80c7070 con 0x7f2ba80c8b10 2024-09-10T08:34:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.078+0000 7f2baf53b640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f2ba806d210 con 0x7f2ba806cd80 2024-09-10T08:34:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.078+0000 7f2baf53b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2ba80c69b0 con 0x7f2ba815a4a0 2024-09-10T08:34:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.078+0000 7f2bacad6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2ba806cd80 0x7f2ba8153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.078+0000 7f2bad2d7640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2ba80c8b10 0x7f2ba81534d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:55444/0 (socket says 172.21.15.103:55444) 2024-09-10T08:34:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.078+0000 7f2bad2d7640 1 -- 172.21.15.103:0/1106655662 learned_addr learned my addr 172.21.15.103:0/1106655662 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:34:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.078+0000 7f2badad8640 1 --2- 172.21.15.103:0/1106655662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ba815a4a0 0x7f2ba8156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.079+0000 7f2bacad6640 1 -- 172.21.15.103:0/1106655662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ba815a4a0 msgr2=0x7f2ba8156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.079+0000 7f2bacad6640 1 --2- 172.21.15.103:0/1106655662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ba815a4a0 0x7f2ba8156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.079+0000 7f2bacad6640 1 -- 172.21.15.103:0/1106655662 >> v1:172.21.15.103:6789/0 conn(0x7f2ba80c8b10 legacy=0x7f2ba81534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.079+0000 7f2bacad6640 1 -- 172.21.15.103:0/1106655662 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba80c6c90 con 0x7f2ba806cd80 2024-09-10T08:34:08.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.079+0000 7f2bacad6640 1 --2- 172.21.15.103:0/1106655662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ba806cd80 0x7f2ba8153be0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2b980097a0 tx=0x7f2b9802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6d1dbb61c24e08 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:08.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.080+0000 7f2b9ffff640 1 -- 172.21.15.103:0/1106655662 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b98037070 con 0x7f2ba806cd80 2024-09-10T08:34:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.080+0000 7f2b9ffff640 1 -- 172.21.15.103:0/1106655662 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b9802ae50 con 0x7f2ba806cd80 2024-09-10T08:34:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.080+0000 7f2b9ffff640 1 -- 172.21.15.103:0/1106655662 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b98032660 con 0x7f2ba806cd80 2024-09-10T08:34:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.080+0000 7f2baf53b640 1 -- 172.21.15.103:0/1106655662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ba806cd80 msgr2=0x7f2ba8153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.080+0000 7f2baf53b640 1 --2- 172.21.15.103:0/1106655662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ba806cd80 0x7f2ba8153be0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2b980097a0 tx=0x7f2b9802a100 comp rx=0 tx=0).stop 2024-09-10T08:34:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.080+0000 7f2baf53b640 1 -- 172.21.15.103:0/1106655662 shutdown_connections 2024-09-10T08:34:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.080+0000 7f2baf53b640 1 --2- 172.21.15.103:0/1106655662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ba815a4a0 0x7f2ba8156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.080+0000 7f2baf53b640 1 --2- 172.21.15.103:0/1106655662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ba806cd80 0x7f2ba8153be0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.080+0000 7f2baf53b640 1 -- 172.21.15.103:0/1106655662 >> 172.21.15.103:0/1106655662 conn(0x7f2ba80adb80 msgr2=0x7f2ba80adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.080+0000 7f2baf53b640 1 -- 172.21.15.103:0/1106655662 shutdown_connections 2024-09-10T08:34:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.080+0000 7f2baf53b640 1 -- 172.21.15.103:0/1106655662 wait complete. 2024-09-10T08:34:08.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.082+0000 7f2baf53b640 1 Processor -- start 2024-09-10T08:34:08.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.082+0000 7f2baf53b640 1 -- start start 2024-09-10T08:34:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.083+0000 7f2baf53b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ba80c8b10 0x7f2ba8146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.083+0000 7f2baf53b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ba815a4a0 0x7f2ba814fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.083+0000 7f2baf53b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ba814a680 0x7f2ba81efbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.083+0000 7f2baf53b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba80c9070 con 0x7f2ba815a4a0 2024-09-10T08:34:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.083+0000 7f2baf53b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba80c8ef0 con 0x7f2ba80c8b10 2024-09-10T08:34:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.083+0000 7f2baf53b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2ba8156ba0 con 0x7f2ba814a680 2024-09-10T08:34:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.083+0000 7f2bacad6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ba815a4a0 0x7f2ba814fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.083+0000 7f2bacad6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ba815a4a0 0x7f2ba814fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34922/0 (socket says 172.21.15.103:34922) 2024-09-10T08:34:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.083+0000 7f2bacad6640 1 -- 172.21.15.103:0/1669994577 learned_addr learned my addr 172.21.15.103:0/1669994577 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.083+0000 7f2badad8640 1 --2- 172.21.15.103:0/1669994577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ba814a680 0x7f2ba81efbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.083+0000 7f2bad2d7640 1 --2- 172.21.15.103:0/1669994577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ba80c8b10 0x7f2ba8146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.083+0000 7f2bacad6640 1 -- 172.21.15.103:0/1669994577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ba814a680 msgr2=0x7f2ba81efbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.083+0000 7f2bacad6640 1 --2- 172.21.15.103:0/1669994577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ba814a680 0x7f2ba81efbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.083+0000 7f2bacad6640 1 -- 172.21.15.103:0/1669994577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ba80c8b10 msgr2=0x7f2ba8146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.083+0000 7f2bacad6640 1 --2- 172.21.15.103:0/1669994577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ba80c8b10 0x7f2ba8146280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.083+0000 7f2bacad6640 1 -- 172.21.15.103:0/1669994577 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba80b1ed0 con 0x7f2ba815a4a0 2024-09-10T08:34:08.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.083+0000 7f2badad8640 1 --2- 172.21.15.103:0/1669994577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ba814a680 0x7f2ba81efbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:08.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.084+0000 7f2bacad6640 1 --2- 172.21.15.103:0/1669994577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ba815a4a0 0x7f2ba814fa80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2b9802a6f0 tx=0x7f2b980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:08.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.084+0000 7f2b9dffb640 1 -- 172.21.15.103:0/1669994577 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b98042020 con 0x7f2ba815a4a0 2024-09-10T08:34:08.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.084+0000 7f2b9dffb640 1 -- 172.21.15.103:0/1669994577 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b9803d690 con 0x7f2ba815a4a0 2024-09-10T08:34:08.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.084+0000 7f2b9dffb640 1 -- 172.21.15.103:0/1669994577 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b98037040 con 0x7f2ba815a4a0 2024-09-10T08:34:08.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.084+0000 7f2baf53b640 1 -- 172.21.15.103:0/1669994577 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ba8159750 con 0x7f2ba815a4a0 2024-09-10T08:34:08.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.084+0000 7f2baf53b640 1 -- 172.21.15.103:0/1669994577 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ba81ef6c0 con 0x7f2ba815a4a0 2024-09-10T08:34:08.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.086+0000 7f2baf53b640 1 -- 172.21.15.103:0/1669994577 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ba8068430 con 0x7f2ba815a4a0 2024-09-10T08:34:08.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.087+0000 7f2b9dffb640 1 -- 172.21.15.103:0/1669994577 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b98045020 con 0x7f2ba815a4a0 2024-09-10T08:34:08.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.087+0000 7f2b9dffb640 1 --2- 172.21.15.103:0/1669994577 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2b8c06be30 0x7f2b8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.087+0000 7f2b9dffb640 1 -- 172.21.15.103:0/1669994577 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f2b980ab880 con 0x7f2ba815a4a0 2024-09-10T08:34:08.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.088+0000 7f2bad2d7640 1 --2- 172.21.15.103:0/1669994577 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2b8c06be30 0x7f2b8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.088+0000 7f2bad2d7640 1 --2- 172.21.15.103:0/1669994577 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2b8c06be30 0x7f2b8c06e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4000f60 tx=0x7f2ba4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:08.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.093+0000 7f2b9dffb640 1 -- 172.21.15.103:0/1669994577 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ba8068430 con 0x7f2ba815a4a0 2024-09-10T08:34:08.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.384+0000 7f2baf53b640 1 -- 172.21.15.103:0/1669994577 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2ba80c9720 con 0x7f2ba815a4a0 2024-09-10T08:34:08.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.384+0000 7f2b9dffb640 1 -- 172.21.15.103:0/1669994577 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f2b9804c030 con 0x7f2ba815a4a0 2024-09-10T08:34:08.385 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":40,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:34:08.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.387+0000 7f2baf53b640 1 -- 172.21.15.103:0/1669994577 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2b8c06be30 msgr2=0x7f2b8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.387+0000 7f2baf53b640 1 --2- 172.21.15.103:0/1669994577 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2b8c06be30 0x7f2b8c06e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4000f60 tx=0x7f2ba4009040 comp rx=0 tx=0).stop 2024-09-10T08:34:08.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.387+0000 7f2baf53b640 1 -- 172.21.15.103:0/1669994577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ba815a4a0 msgr2=0x7f2ba814fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.387+0000 7f2baf53b640 1 --2- 172.21.15.103:0/1669994577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ba815a4a0 0x7f2ba814fa80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2b9802a6f0 tx=0x7f2b980046c0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.387+0000 7f2baf53b640 1 -- 172.21.15.103:0/1669994577 shutdown_connections 2024-09-10T08:34:08.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.387+0000 7f2baf53b640 1 --2- 172.21.15.103:0/1669994577 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2b8c06be30 0x7f2b8c06e2f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.387+0000 7f2baf53b640 1 --2- 172.21.15.103:0/1669994577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ba814a680 0x7f2ba81efbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.387+0000 7f2baf53b640 1 --2- 172.21.15.103:0/1669994577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ba815a4a0 0x7f2ba814fa80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.387+0000 7f2baf53b640 1 --2- 172.21.15.103:0/1669994577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ba80c8b10 0x7f2ba8146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.387+0000 7f2baf53b640 1 -- 172.21.15.103:0/1669994577 >> 172.21.15.103:0/1669994577 conn(0x7f2ba80adb80 msgr2=0x7f2ba8154ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:08.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.387+0000 7f2baf53b640 1 -- 172.21.15.103:0/1669994577 shutdown_connections 2024-09-10T08:34:08.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.387+0000 7f2baf53b640 1 -- 172.21.15.103:0/1669994577 wait complete. 2024-09-10T08:34:08.398 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:34:08.398 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-10T08:34:08.399 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:34:08.399 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:34:08.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.507+0000 7fdc3674b640 1 Processor -- start 2024-09-10T08:34:08.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.507+0000 7fdc3674b640 1 -- start start 2024-09-10T08:34:08.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.508+0000 7fdc3674b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdc30150480 0x7fdc300c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.508+0000 7fdc3674b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdc300ca390 0x7fdc300c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.508+0000 7fdc3674b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc3015a7c0 con 0x7fdc3006c650 2024-09-10T08:34:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.508+0000 7fdc3674b640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fdc3006c240 con 0x7fdc300ca390 2024-09-10T08:34:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.508+0000 7fdc3674b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fdc3015a330 con 0x7fdc30150480 2024-09-10T08:34:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.508+0000 7fdc34ce8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdc300ca390 0x7fdc300c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.508+0000 7fdc34ce8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdc300ca390 0x7fdc300c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34938/0 (socket says 172.21.15.103:34938) 2024-09-10T08:34:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.508+0000 7fdc34ce8640 1 -- 172.21.15.103:0/1408683744 learned_addr learned my addr 172.21.15.103:0/1408683744 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.508+0000 7fdc2ffff640 1 --2- 172.21.15.103:0/1408683744 >> v2:172.21.15.154:3300/0 conn(0x7fdc30150480 0x7fdc300c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.509+0000 7fdc34ce8640 1 -- 172.21.15.103:0/1408683744 >> v2:172.21.15.154:3300/0 conn(0x7fdc30150480 msgr2=0x7fdc300c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.509+0000 7fdc34ce8640 1 --2- 172.21.15.103:0/1408683744 >> v2:172.21.15.154:3300/0 conn(0x7fdc30150480 0x7fdc300c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.509+0000 7fdc34ce8640 1 -- 172.21.15.103:0/1408683744 >> v1:172.21.15.154:6789/0 conn(0x7fdc3006c650 legacy=0x7fdc300c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.509+0000 7fdc2effd640 1 -- 172.21.15.103:0/1408683744 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3162781246 0 0) 0x7fdc3015a7c0 con 0x7fdc3006c650 2024-09-10T08:34:08.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.509+0000 7fdc34ce8640 1 -- 172.21.15.103:0/1408683744 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc30159a00 con 0x7fdc300ca390 2024-09-10T08:34:08.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.509+0000 7fdc34ce8640 1 --2- 172.21.15.103:0/1408683744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc300ca390 0x7fdc300c7fd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdc300ccac0 tx=0x7fdc2802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d0f1c4781fc82f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:08.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.510+0000 7fdc2effd640 1 -- 172.21.15.103:0/1408683744 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc28036070 con 0x7fdc300ca390 2024-09-10T08:34:08.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.510+0000 7fdc2effd640 1 -- 172.21.15.103:0/1408683744 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc28031600 con 0x7fdc300ca390 2024-09-10T08:34:08.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.510+0000 7fdc2effd640 1 -- 172.21.15.103:0/1408683744 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc280319d0 con 0x7fdc300ca390 2024-09-10T08:34:08.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.510+0000 7fdc3674b640 1 -- 172.21.15.103:0/1408683744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc300ca390 msgr2=0x7fdc300c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.510+0000 7fdc3674b640 1 --2- 172.21.15.103:0/1408683744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc300ca390 0x7fdc300c7fd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdc300ccac0 tx=0x7fdc2802a730 comp rx=0 tx=0).stop 2024-09-10T08:34:08.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.510+0000 7fdc3674b640 1 -- 172.21.15.103:0/1408683744 shutdown_connections 2024-09-10T08:34:08.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.510+0000 7fdc3674b640 1 --2- 172.21.15.103:0/1408683744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc300ca390 0x7fdc300c7fd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.510+0000 7fdc3674b640 1 --2- 172.21.15.103:0/1408683744 >> v2:172.21.15.154:3300/0 conn(0x7fdc30150480 0x7fdc300c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.510+0000 7fdc3674b640 1 -- 172.21.15.103:0/1408683744 >> 172.21.15.103:0/1408683744 conn(0x7fdc30068030 msgr2=0x7fdc30073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:08.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.510+0000 7fdc3674b640 1 -- 172.21.15.103:0/1408683744 shutdown_connections 2024-09-10T08:34:08.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.510+0000 7fdc3674b640 1 -- 172.21.15.103:0/1408683744 wait complete. 2024-09-10T08:34:08.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.511+0000 7fdc3674b640 1 Processor -- start 2024-09-10T08:34:08.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.512+0000 7fdc3674b640 1 -- start start 2024-09-10T08:34:08.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.512+0000 7fdc3674b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc3006c650 0x7fdc3014dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.512+0000 7fdc3674b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc300ca390 0x7fdc301ebeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.512+0000 7fdc3674b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc30150480 0x7fdc301ec3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.512+0000 7fdc3674b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3006d270 con 0x7fdc3006c650 2024-09-10T08:34:08.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.512+0000 7fdc3674b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdc30159fc0 con 0x7fdc30150480 2024-09-10T08:34:08.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.512+0000 7fdc3674b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fdc30156270 con 0x7fdc300ca390 2024-09-10T08:34:08.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.512+0000 7fdc2ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc3006c650 0x7fdc3014dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.513+0000 7fdc2ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc3006c650 0x7fdc3014dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34942/0 (socket says 172.21.15.103:34942) 2024-09-10T08:34:08.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.513+0000 7fdc2ffff640 1 -- 172.21.15.103:0/3903849965 learned_addr learned my addr 172.21.15.103:0/3903849965 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:08.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.513+0000 7fdc34ce8640 1 --2- 172.21.15.103:0/3903849965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc30150480 0x7fdc301ec3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.513+0000 7fdc2f7fe640 1 --2- 172.21.15.103:0/3903849965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc300ca390 0x7fdc301ebeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.513+0000 7fdc2ffff640 1 -- 172.21.15.103:0/3903849965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc300ca390 msgr2=0x7fdc301ebeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.513+0000 7fdc2ffff640 1 --2- 172.21.15.103:0/3903849965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc300ca390 0x7fdc301ebeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.513+0000 7fdc2ffff640 1 -- 172.21.15.103:0/3903849965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc30150480 msgr2=0x7fdc301ec3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.513+0000 7fdc2ffff640 1 --2- 172.21.15.103:0/3903849965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc30150480 0x7fdc301ec3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.513+0000 7fdc2ffff640 1 -- 172.21.15.103:0/3903849965 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc3014b570 con 0x7fdc3006c650 2024-09-10T08:34:08.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.513+0000 7fdc2ffff640 1 --2- 172.21.15.103:0/3903849965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc3006c650 0x7fdc3014dbb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000e9b0 tx=0x7fdc2000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:08.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.513+0000 7fdc2cff9640 1 -- 172.21.15.103:0/3903849965 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc20017070 con 0x7fdc3006c650 2024-09-10T08:34:08.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.513+0000 7fdc2cff9640 1 -- 172.21.15.103:0/3903849965 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc2000c9a0 con 0x7fdc3006c650 2024-09-10T08:34:08.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.513+0000 7fdc2cff9640 1 -- 172.21.15.103:0/3903849965 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2000cd90 con 0x7fdc3006c650 2024-09-10T08:34:08.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.513+0000 7fdc3674b640 1 -- 172.21.15.103:0/3903849965 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc3014c260 con 0x7fdc3006c650 2024-09-10T08:34:08.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.513+0000 7fdc3674b640 1 -- 172.21.15.103:0/3903849965 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc301efe30 con 0x7fdc3006c650 2024-09-10T08:34:08.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.514+0000 7fdc3674b640 1 --2- 172.21.15.103:0/3903849965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc301f0030 0x7fdc30148190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.514+0000 7fdc3674b640 1 -- 172.21.15.103:0/3903849965 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3014b3f0 con 0x7fdc301f0030 2024-09-10T08:34:08.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.514+0000 7fdc2f7fe640 1 --2- 172.21.15.103:0/3903849965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc301f0030 0x7fdc30148190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.515+0000 7fdc2f7fe640 1 -- 172.21.15.103:0/3903849965 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc30159150 con 0x7fdc301f0030 2024-09-10T08:34:08.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.515+0000 7fdc2f7fe640 1 --2- 172.21.15.103:0/3903849965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc301f0030 0x7fdc30148190 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdc3014e7c0 tx=0x7fdc2400f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:08.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.515+0000 7fdc2cff9640 1 -- 172.21.15.103:0/3903849965 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc2001a070 con 0x7fdc3006c650 2024-09-10T08:34:08.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.515+0000 7fdc2cff9640 1 --2- 172.21.15.103:0/3903849965 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc1c06be30 0x7fdc1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.515+0000 7fdc2cff9640 1 -- 172.21.15.103:0/3903849965 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fdc2008b420 con 0x7fdc3006c650 2024-09-10T08:34:08.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.516+0000 7fdc34ce8640 1 --2- 172.21.15.103:0/3903849965 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc1c06be30 0x7fdc1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.516+0000 7fdc2cff9640 1 -- 172.21.15.103:0/3903849965 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc240052e0 con 0x7fdc301f0030 2024-09-10T08:34:08.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.516+0000 7fdc2cff9640 1 -- 172.21.15.103:0/3903849965 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fdc24018070 con 0x7fdc301f0030 2024-09-10T08:34:08.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.516+0000 7fdc2cff9640 1 -- 172.21.15.103:0/3903849965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc301f0030 msgr2=0x7fdc30148190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.516+0000 7fdc2cff9640 1 --2- 172.21.15.103:0/3903849965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc301f0030 0x7fdc30148190 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdc3014e7c0 tx=0x7fdc2400f9d0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.516+0000 7fdc2cff9640 1 -- 172.21.15.103:0/3903849965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc301f0030 msgr2=0x7fdc30148190 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:34:08.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.516+0000 7fdc2cff9640 1 --2- 172.21.15.103:0/3903849965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc301f0030 0x7fdc30148190 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdc3014e7c0 tx=0x7fdc2400f9d0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.516+0000 7fdc34ce8640 1 --2- 172.21.15.103:0/3903849965 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc1c06be30 0x7fdc1c06e2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdc28033000 tx=0x7fdc28009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:08.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.523+0000 7fdc3674b640 1 --2- 172.21.15.103:0/3903849965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc3014e0f0 0x7fdc301486d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.523+0000 7fdc3674b640 1 -- 172.21.15.103:0/3903849965 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdc30156dd0 con 0x7fdc3014e0f0 2024-09-10T08:34:08.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.524+0000 7fdc2f7fe640 1 --2- 172.21.15.103:0/3903849965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc3014e0f0 0x7fdc301486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.524+0000 7fdc2f7fe640 1 -- 172.21.15.103:0/3903849965 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdc300c9c80 con 0x7fdc3014e0f0 2024-09-10T08:34:08.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.524+0000 7fdc2f7fe640 1 --2- 172.21.15.103:0/3903849965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc3014e0f0 0x7fdc301486d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdc24014000 tx=0x7fdc24001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:08.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.524+0000 7fdc2cff9640 1 -- 172.21.15.103:0/3903849965 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2401de00 con 0x7fdc3014e0f0 2024-09-10T08:34:08.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.524+0000 7fdc2cff9640 1 -- 172.21.15.103:0/3903849965 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4555 (secure 0 0 0) 0x7fdc24003a80 con 0x7fdc3014e0f0 2024-09-10T08:34:08.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.524+0000 7fdc2cff9640 1 -- 172.21.15.103:0/3903849965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc3014e0f0 msgr2=0x7fdc301486d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.524+0000 7fdc2cff9640 1 --2- 172.21.15.103:0/3903849965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc3014e0f0 0x7fdc301486d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdc24014000 tx=0x7fdc24001080 comp rx=0 tx=0).stop 2024-09-10T08:34:08.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.524+0000 7fdc2cff9640 1 -- 172.21.15.103:0/3903849965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc3014e0f0 msgr2=0x7fdc301486d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:34:08.526 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:34:08.526 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:34:08.526 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:34:08.526 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:34:08.526 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 40, 2024-09-10T08:34:08.526 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 18592, 2024-09-10T08:34:08.526 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:34:08.526 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:34:08.526 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:34:08.526 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:34:08.527 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:08.527 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 12, 2024-09-10T08:34:08.527 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:34:08.527 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:34:08.527 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:34:08.527 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:08.527 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:08.527 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:08.527 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:08.527 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:08.527 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:08.527 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:08.527 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:08.528 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:08.528 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:08.528 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:08.528 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:08.528 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:34:08.528 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:34:08.528 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:08.528 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:08.528 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:08.528 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:08.528 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:08.528 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:08.528 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:08.529 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:08.529 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:08.529 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:08.529 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:08.529 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:08.529 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.529 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:34:08.529 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:34:08.529 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:34:08.529 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:34:08.529 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:34:08.529 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:34:08.529 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:34:08.530 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:34:08.530 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:34:08.530 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:34:08.530 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:34:08.530 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:34:08.530 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:34:08.530 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:34:08.530 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:34:08.530 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:34:08.530 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:34:08.530 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:08.530 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:08.530 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:08.530 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:08.531 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:08.531 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:08.531 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:08.531 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:08.531 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:08.531 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:08.531 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:08.531 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:08.531 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:34:08.531 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.531 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:34:08.531 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.531 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:34:08.532 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:34:08.532 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:08.532 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:08.532 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.532 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:08.532 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:34:08.532 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:08.532 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.532 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.532 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:08.532 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:34:08.532 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:08.532 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.532 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:08.533 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.533 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:34:08.533 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:34:08.533 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:08.533 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:08.533 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:08.533 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.533 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.533 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:34:08.533 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:34:08.533 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:08.533 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:08.533 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.534 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:08.534 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:34:08.534 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:08.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.534 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.534 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:08.534 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:34:08.534 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:08.534 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.534 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:08.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.534 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:34:08.534 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:34:08.534 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:08.535 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:08.535 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:08.535 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.535 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.535 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:34:08.535 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:34:08.535 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:08.535 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:08.535 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.535 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:08.535 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:34:08.535 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:08.535 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.536 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.536 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:08.536 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:34:08.536 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:08.536 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.536 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:08.536 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.536 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:34:08.536 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:34:08.536 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:08.536 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:08.536 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:08.536 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.536 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:08.537 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.537 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:34:08.537 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:34:08.537 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.537 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:08.537 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:08.537 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:34:08.537 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.537 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:08.537 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:34:08.537 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.537 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:08.537 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:08.537 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:34:08.538 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.538 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:08.538 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.538 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:34:08.538 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:34:08.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.524+0000 7fdc2cff9640 1 --2- 172.21.15.103:0/3903849965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc3014e0f0 0x7fdc301486d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.525+0000 7fdc3674b640 1 -- 172.21.15.103:0/3903849965 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc1c06be30 msgr2=0x7fdc1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.525+0000 7fdc3674b640 1 --2- 172.21.15.103:0/3903849965 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc1c06be30 0x7fdc1c06e2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdc28033000 tx=0x7fdc28009000 comp rx=0 tx=0).stop 2024-09-10T08:34:08.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.525+0000 7fdc3674b640 1 -- 172.21.15.103:0/3903849965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc3006c650 msgr2=0x7fdc3014dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.525+0000 7fdc3674b640 1 --2- 172.21.15.103:0/3903849965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc3006c650 0x7fdc3014dbb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000e9b0 tx=0x7fdc2000ee70 comp rx=0 tx=0).stop 2024-09-10T08:34:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.525+0000 7fdc34ce8640 1 -- 172.21.15.103:0/3903849965 reap_dead start 2024-09-10T08:34:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.525+0000 7fdc34ce8640 1 -- 172.21.15.103:0/3903849965 reap_dead start 2024-09-10T08:34:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.525+0000 7fdc3674b640 1 -- 172.21.15.103:0/3903849965 shutdown_connections 2024-09-10T08:34:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.525+0000 7fdc3674b640 1 -- 172.21.15.103:0/3903849965 >> 172.21.15.103:0/3903849965 conn(0x7fdc30068030 msgr2=0x7fdc3014eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.525+0000 7fdc3674b640 1 -- 172.21.15.103:0/3903849965 shutdown_connections 2024-09-10T08:34:08.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.525+0000 7fdc3674b640 1 -- 172.21.15.103:0/3903849965 wait complete. 2024-09-10T08:34:08.540 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:34:08.540 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:34:08.541 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:34:08.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.648+0000 7f0b8b265640 1 Processor -- start 2024-09-10T08:34:08.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.649+0000 7f0b8b265640 1 -- start start 2024-09-10T08:34:08.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.649+0000 7f0b8b265640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b840c4680 0x7f0b84156a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.649+0000 7f0b8b265640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0b84156fc0 0x7f0b84157410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.649+0000 7f0b8b265640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b84070590 con 0x7f0b840acc30 2024-09-10T08:34:08.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.649+0000 7f0b8b265640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f0b840c4ea0 con 0x7f0b84156fc0 2024-09-10T08:34:08.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.649+0000 7f0b8b265640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0b840c4a60 con 0x7f0b840c4680 2024-09-10T08:34:08.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.650+0000 7f0b88800640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b840c4680 0x7f0b84156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.650+0000 7f0b88800640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b840c4680 0x7f0b84156a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:36312/0 (socket says 172.21.15.103:36312) 2024-09-10T08:34:08.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.650+0000 7f0b88800640 1 -- 172.21.15.103:0/885745882 learned_addr learned my addr 172.21.15.103:0/885745882 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:08.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.650+0000 7f0b89802640 1 --2- 172.21.15.103:0/885745882 >> v2:172.21.15.154:3300/0 conn(0x7f0b84156fc0 0x7f0b84157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.650+0000 7f0b7bfff640 1 -- 172.21.15.103:0/885745882 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 925660482 0 0) 0x7f0b84070590 con 0x7f0b840acc30 2024-09-10T08:34:08.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.650+0000 7f0b7bfff640 1 -- 172.21.15.103:0/885745882 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b70003520 con 0x7f0b840acc30 2024-09-10T08:34:08.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.650+0000 7f0b88800640 1 -- 172.21.15.103:0/885745882 >> v2:172.21.15.154:3300/0 conn(0x7f0b84156fc0 msgr2=0x7f0b84157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:08.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.650+0000 7f0b88800640 1 --2- 172.21.15.103:0/885745882 >> v2:172.21.15.154:3300/0 conn(0x7f0b84156fc0 0x7f0b84157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.650+0000 7f0b88800640 1 -- 172.21.15.103:0/885745882 >> v1:172.21.15.154:6789/0 conn(0x7f0b840acc30 legacy=0x7f0b840c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.650+0000 7f0b88800640 1 -- 172.21.15.103:0/885745882 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b840a8220 con 0x7f0b840c4680 2024-09-10T08:34:08.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.651+0000 7f0b88800640 1 --2- 172.21.15.103:0/885745882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b840c4680 0x7f0b84156a80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0b74009870 tx=0x7f0b7402a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c335260f1fda060f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:08.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.651+0000 7f0b7bfff640 1 -- 172.21.15.103:0/885745882 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74037070 con 0x7f0b840c4680 2024-09-10T08:34:08.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.651+0000 7f0b7bfff640 1 -- 172.21.15.103:0/885745882 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b74032440 con 0x7f0b840c4680 2024-09-10T08:34:08.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.651+0000 7f0b7bfff640 1 -- 172.21.15.103:0/885745882 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74032810 con 0x7f0b840c4680 2024-09-10T08:34:08.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.652+0000 7f0b8b265640 1 -- 172.21.15.103:0/885745882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b840c4680 msgr2=0x7f0b84156a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.652+0000 7f0b8b265640 1 --2- 172.21.15.103:0/885745882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b840c4680 0x7f0b84156a80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0b74009870 tx=0x7f0b7402a130 comp rx=0 tx=0).stop 2024-09-10T08:34:08.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.652+0000 7f0b8b265640 1 -- 172.21.15.103:0/885745882 shutdown_connections 2024-09-10T08:34:08.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.652+0000 7f0b8b265640 1 --2- 172.21.15.103:0/885745882 >> v2:172.21.15.154:3300/0 conn(0x7f0b84156fc0 0x7f0b84157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.652+0000 7f0b8b265640 1 --2- 172.21.15.103:0/885745882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b840c4680 0x7f0b84156a80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.652+0000 7f0b8b265640 1 -- 172.21.15.103:0/885745882 >> 172.21.15.103:0/885745882 conn(0x7f0b840c5660 msgr2=0x7f0b840c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:08.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.652+0000 7f0b8b265640 1 -- 172.21.15.103:0/885745882 shutdown_connections 2024-09-10T08:34:08.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.652+0000 7f0b8b265640 1 -- 172.21.15.103:0/885745882 wait complete. 2024-09-10T08:34:08.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.653+0000 7f0b8b265640 1 Processor -- start 2024-09-10T08:34:08.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.653+0000 7f0b8b265640 1 -- start start 2024-09-10T08:34:08.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.654+0000 7f0b8b265640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b840acc30 0x7f0b840a7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.654+0000 7f0b8b265640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b840c4680 0x7f0b840a9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.654+0000 7f0b8b265640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b84156fc0 0x7f0b8406ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.654+0000 7f0b8b265640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0b840702b0 con 0x7f0b840c4680 2024-09-10T08:34:08.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.654+0000 7f0b8b265640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8406ffd0 con 0x7f0b84156fc0 2024-09-10T08:34:08.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.654+0000 7f0b8b265640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0b840c5330 con 0x7f0b840acc30 2024-09-10T08:34:08.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.654+0000 7f0b89001640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b840acc30 0x7f0b840a7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.654+0000 7f0b89802640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b84156fc0 0x7f0b8406ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.654+0000 7f0b88800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b840c4680 0x7f0b840a9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.654+0000 7f0b89802640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b84156fc0 0x7f0b8406ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:32878/0 (socket says 172.21.15.103:32878) 2024-09-10T08:34:08.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.654+0000 7f0b89001640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b840acc30 0x7f0b840a7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:36322/0 (socket says 172.21.15.103:36322) 2024-09-10T08:34:08.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.654+0000 7f0b89802640 1 -- 172.21.15.103:0/2234077142 learned_addr learned my addr 172.21.15.103:0/2234077142 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:08.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.655+0000 7f0b89802640 1 -- 172.21.15.103:0/2234077142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b840acc30 msgr2=0x7f0b840a7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.655+0000 7f0b89802640 1 --2- 172.21.15.103:0/2234077142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b840acc30 0x7f0b840a7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.655+0000 7f0b89802640 1 -- 172.21.15.103:0/2234077142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b840c4680 msgr2=0x7f0b840a9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.655+0000 7f0b89802640 1 --2- 172.21.15.103:0/2234077142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b840c4680 0x7f0b840a9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.655+0000 7f0b89802640 1 -- 172.21.15.103:0/2234077142 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b840bf190 con 0x7f0b84156fc0 2024-09-10T08:34:08.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.655+0000 7f0b88800640 1 --2- 172.21.15.103:0/2234077142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b840c4680 0x7f0b840a9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:34:08.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.655+0000 7f0b89001640 1 --2- 172.21.15.103:0/2234077142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b840acc30 0x7f0b840a7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:34:08.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.655+0000 7f0b89802640 1 --2- 172.21.15.103:0/2234077142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b84156fc0 0x7f0b8406ccf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00efc0 tx=0x7f0b7c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:08.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.655+0000 7f0b79ffb640 1 -- 172.21.15.103:0/2234077142 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c018020 con 0x7f0b84156fc0 2024-09-10T08:34:08.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.655+0000 7f0b79ffb640 1 -- 172.21.15.103:0/2234077142 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b7c014480 con 0x7f0b84156fc0 2024-09-10T08:34:08.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.655+0000 7f0b8b265640 1 -- 172.21.15.103:0/2234077142 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b841eb9a0 con 0x7f0b84156fc0 2024-09-10T08:34:08.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.655+0000 7f0b79ffb640 1 -- 172.21.15.103:0/2234077142 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c014870 con 0x7f0b84156fc0 2024-09-10T08:34:08.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.655+0000 7f0b8b265640 1 -- 172.21.15.103:0/2234077142 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b841ebf60 con 0x7f0b84156fc0 2024-09-10T08:34:08.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.656+0000 7f0b8b265640 1 --2- 172.21.15.103:0/2234077142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b840c23a0 0x7f0b8406d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.656+0000 7f0b8b265640 1 -- 172.21.15.103:0/2234077142 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0b84153b00 con 0x7f0b840c23a0 2024-09-10T08:34:08.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.657+0000 7f0b89001640 1 --2- 172.21.15.103:0/2234077142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b840c23a0 0x7f0b8406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.657+0000 7f0b89001640 1 -- 172.21.15.103:0/2234077142 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b8406d770 con 0x7f0b840c23a0 2024-09-10T08:34:08.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.657+0000 7f0b79ffb640 1 -- 172.21.15.103:0/2234077142 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b7c01b020 con 0x7f0b84156fc0 2024-09-10T08:34:08.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.657+0000 7f0b89001640 1 --2- 172.21.15.103:0/2234077142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b840c23a0 0x7f0b8406d230 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0b84070760 tx=0x7f0b8000fd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:08.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.658+0000 7f0b79ffb640 1 --2- 172.21.15.103:0/2234077142 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0b6806be30 0x7f0b6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.658+0000 7f0b79ffb640 1 -- 172.21.15.103:0/2234077142 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f0b7c08bc00 con 0x7f0b84156fc0 2024-09-10T08:34:08.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.658+0000 7f0b88800640 1 --2- 172.21.15.103:0/2234077142 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0b6806be30 0x7f0b6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.658+0000 7f0b79ffb640 1 -- 172.21.15.103:0/2234077142 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b800052e0 con 0x7f0b840c23a0 2024-09-10T08:34:08.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.658+0000 7f0b79ffb640 1 -- 172.21.15.103:0/2234077142 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0b80018070 con 0x7f0b840c23a0 2024-09-10T08:34:08.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.658+0000 7f0b79ffb640 1 -- 172.21.15.103:0/2234077142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b840c23a0 msgr2=0x7f0b8406d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.658+0000 7f0b79ffb640 1 --2- 172.21.15.103:0/2234077142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b840c23a0 0x7f0b8406d230 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0b84070760 tx=0x7f0b8000fd60 comp rx=0 tx=0).stop 2024-09-10T08:34:08.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.658+0000 7f0b79ffb640 1 -- 172.21.15.103:0/2234077142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b840c23a0 msgr2=0x7f0b8406d230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:34:08.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.658+0000 7f0b79ffb640 1 --2- 172.21.15.103:0/2234077142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b840c23a0 0x7f0b8406d230 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.658+0000 7f0b88800640 1 --2- 172.21.15.103:0/2234077142 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0b6806be30 0x7f0b6806e2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0b74034000 tx=0x7f0b7402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:08.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.664+0000 7f0b8b265640 1 --2- 172.21.15.103:0/2234077142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b840a9bd0 0x7f0b841eee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.664+0000 7f0b8b265640 1 -- 172.21.15.103:0/2234077142 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0b840c63f0 con 0x7f0b840a9bd0 2024-09-10T08:34:08.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.664+0000 7f0b89001640 1 --2- 172.21.15.103:0/2234077142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b840a9bd0 0x7f0b841eee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.664+0000 7f0b89001640 1 -- 172.21.15.103:0/2234077142 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0b84157490 con 0x7f0b840a9bd0 2024-09-10T08:34:08.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.665+0000 7f0b89001640 1 --2- 172.21.15.103:0/2234077142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b840a9bd0 0x7f0b841eee00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000d570 tx=0x7f0b80000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:08.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.665+0000 7f0b79ffb640 1 -- 172.21.15.103:0/2234077142 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8000dca0 con 0x7f0b840a9bd0 2024-09-10T08:34:08.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.665+0000 7f0b79ffb640 1 -- 172.21.15.103:0/2234077142 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4887 (secure 0 0 0) 0x7f0b8000dca0 con 0x7f0b840a9bd0 2024-09-10T08:34:08.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.665+0000 7f0b79ffb640 1 -- 172.21.15.103:0/2234077142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b840a9bd0 msgr2=0x7f0b841eee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.665+0000 7f0b79ffb640 1 --2- 172.21.15.103:0/2234077142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b840a9bd0 0x7f0b841eee00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000d570 tx=0x7f0b80000ed0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.665+0000 7f0b79ffb640 1 -- 172.21.15.103:0/2234077142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b840a9bd0 msgr2=0x7f0b841eee00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:34:08.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.665+0000 7f0b79ffb640 1 --2- 172.21.15.103:0/2234077142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b840a9bd0 0x7f0b841eee00 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000d570 tx=0x7f0b80000ed0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.666 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:34:08.666 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:34:08.667 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:34:08.667 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:34:08.667 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 40, 2024-09-10T08:34:08.667 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 81356, 2024-09-10T08:34:08.667 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:34:08.667 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:34:08.667 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:34:08.667 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:34:08.667 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:08.667 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 12, 2024-09-10T08:34:08.667 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:34:08.667 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:34:08.667 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:34:08.667 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:08.668 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:08.668 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:08.668 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:08.668 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:08.668 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:08.668 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:08.668 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:08.668 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:08.668 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:08.668 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:08.668 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:08.668 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:34:08.668 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:34:08.669 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:08.669 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:08.669 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:08.669 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:08.669 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:08.669 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:08.669 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:08.669 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:08.669 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:08.669 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:08.669 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:08.669 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:08.669 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.670 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:34:08.670 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:34:08.670 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:34:08.670 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:34:08.670 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:34:08.670 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:34:08.670 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:34:08.670 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:34:08.670 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:34:08.670 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:34:08.670 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:34:08.670 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:34:08.670 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:34:08.670 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:34:08.671 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:34:08.671 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:34:08.671 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:34:08.671 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:08.671 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:08.671 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:08.671 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:08.671 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:08.671 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:08.671 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:08.671 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:08.671 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:08.671 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:08.672 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:08.672 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:08.672 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:34:08.672 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.672 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:34:08.672 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.672 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:34:08.672 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:34:08.672 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:08.672 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:08.672 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.672 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:08.672 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:34:08.673 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:08.673 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.673 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.673 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:08.673 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:34:08.673 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:08.673 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.673 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:08.673 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.673 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:34:08.673 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:34:08.673 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:08.673 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:08.674 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:08.674 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.674 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.674 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:34:08.674 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:34:08.674 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:08.674 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:08.674 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.674 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:08.674 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:34:08.674 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:08.674 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.674 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.674 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:08.675 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:34:08.675 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:08.675 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.675 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:08.675 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.675 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:34:08.675 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:34:08.675 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:08.675 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:08.676 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:08.676 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.676 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.676 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:34:08.676 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:34:08.676 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:08.676 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:08.676 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.676 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:08.676 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:34:08.676 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:08.676 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.676 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.677 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:08.677 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:34:08.677 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:08.677 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.677 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:08.677 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.677 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:34:08.677 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:34:08.677 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:08.677 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:08.677 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:08.677 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.677 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:08.677 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.678 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:34:08.678 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:34:08.678 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.678 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:08.678 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:08.678 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:34:08.678 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.678 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:08.678 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:34:08.678 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.678 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:08.678 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:08.678 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:34:08.679 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.679 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:08.679 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:34:08.679 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.679 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:08.679 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:08.679 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:34:08.679 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.679 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:08.679 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:34:08.679 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.679 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:08.679 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:08.679 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:34:08.680 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.680 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:08.680 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.680 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:34:08.680 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:34:08.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.666+0000 7f0b8b265640 1 -- 172.21.15.103:0/2234077142 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0b6806be30 msgr2=0x7f0b6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.666+0000 7f0b8b265640 1 --2- 172.21.15.103:0/2234077142 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0b6806be30 0x7f0b6806e2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0b74034000 tx=0x7f0b7402e000 comp rx=0 tx=0).stop 2024-09-10T08:34:08.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.666+0000 7f0b8b265640 1 -- 172.21.15.103:0/2234077142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b84156fc0 msgr2=0x7f0b8406ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.666+0000 7f0b8b265640 1 --2- 172.21.15.103:0/2234077142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b84156fc0 0x7f0b8406ccf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00efc0 tx=0x7f0b7c00c490 comp rx=0 tx=0).stop 2024-09-10T08:34:08.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.666+0000 7f0b89802640 1 -- 172.21.15.103:0/2234077142 reap_dead start 2024-09-10T08:34:08.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.666+0000 7f0b89802640 1 -- 172.21.15.103:0/2234077142 reap_dead start 2024-09-10T08:34:08.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.666+0000 7f0b8b265640 1 -- 172.21.15.103:0/2234077142 shutdown_connections 2024-09-10T08:34:08.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.666+0000 7f0b8b265640 1 -- 172.21.15.103:0/2234077142 >> 172.21.15.103:0/2234077142 conn(0x7f0b840c5660 msgr2=0x7f0b84156540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:08.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.666+0000 7f0b8b265640 1 -- 172.21.15.103:0/2234077142 shutdown_connections 2024-09-10T08:34:08.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.666+0000 7f0b8b265640 1 -- 172.21.15.103:0/2234077142 wait complete. 2024-09-10T08:34:08.682 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:34:08.682 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:34:08.682 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:34:08.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.792+0000 7f173c381640 1 Processor -- start 2024-09-10T08:34:08.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.792+0000 7f173c381640 1 -- start start 2024-09-10T08:34:08.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.793+0000 7f173c381640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1734074230 0x7f17340c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.794+0000 7f173c381640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f17340c43c0 0x7f1734159e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.794+0000 7f173c381640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17340c47f0 con 0x7f17340c59f0 2024-09-10T08:34:08.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.794+0000 7f173c381640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f17340bed90 con 0x7f17340c43c0 2024-09-10T08:34:08.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.794+0000 7f173c381640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f17340c3820 con 0x7f1734074230 2024-09-10T08:34:08.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.794+0000 7f173991c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f17340c59f0 0x7f17340c3cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:55454/0 (socket says 172.21.15.103:55454) 2024-09-10T08:34:08.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.794+0000 7f173991c640 1 -- 172.21.15.103:0/181610870 learned_addr learned my addr 172.21.15.103:0/181610870 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:34:08.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.794+0000 7f173a11d640 1 --2- 172.21.15.103:0/181610870 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1734074230 0x7f17340c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.794+0000 7f173a91e640 1 --2- 172.21.15.103:0/181610870 >> v2:172.21.15.154:3300/0 conn(0x7f17340c43c0 0x7f1734159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.794+0000 7f173911b640 1 -- 172.21.15.103:0/181610870 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 202804388 0 0) 0x7f1724001110 con 0x7f17340c59f0 2024-09-10T08:34:08.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.794+0000 7f173911b640 1 -- 172.21.15.103:0/181610870 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1720003520 con 0x7f17340c59f0 2024-09-10T08:34:08.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.794+0000 7f173a11d640 1 -- 172.21.15.103:0/181610870 >> v2:172.21.15.154:3300/0 conn(0x7f17340c43c0 msgr2=0x7f1734159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:08.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.794+0000 7f173a11d640 1 --2- 172.21.15.103:0/181610870 >> v2:172.21.15.154:3300/0 conn(0x7f17340c43c0 0x7f1734159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.794+0000 7f173a11d640 1 -- 172.21.15.103:0/181610870 >> v1:172.21.15.103:6789/0 conn(0x7f17340c59f0 legacy=0x7f17340c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.794+0000 7f173a11d640 1 -- 172.21.15.103:0/181610870 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17340c34f0 con 0x7f1734074230 2024-09-10T08:34:08.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.795+0000 7f173a11d640 1 --2- 172.21.15.103:0/181610870 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1734074230 0x7f17340c54b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f17300097a0 tx=0x7f173002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db38255a195b8d04 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:08.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.795+0000 7f173911b640 1 -- 172.21.15.103:0/181610870 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730037070 con 0x7f1734074230 2024-09-10T08:34:08.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.795+0000 7f173911b640 1 -- 172.21.15.103:0/181610870 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f173002ae50 con 0x7f1734074230 2024-09-10T08:34:08.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.795+0000 7f173911b640 1 -- 172.21.15.103:0/181610870 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730032640 con 0x7f1734074230 2024-09-10T08:34:08.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.796+0000 7f173c381640 1 -- 172.21.15.103:0/181610870 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1734074230 msgr2=0x7f17340c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.796+0000 7f173c381640 1 --2- 172.21.15.103:0/181610870 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1734074230 0x7f17340c54b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f17300097a0 tx=0x7f173002a100 comp rx=0 tx=0).stop 2024-09-10T08:34:08.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.796+0000 7f173c381640 1 -- 172.21.15.103:0/181610870 shutdown_connections 2024-09-10T08:34:08.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.796+0000 7f173c381640 1 --2- 172.21.15.103:0/181610870 >> v2:172.21.15.154:3300/0 conn(0x7f17340c43c0 0x7f1734159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.796+0000 7f173c381640 1 --2- 172.21.15.103:0/181610870 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1734074230 0x7f17340c54b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.796+0000 7f173c381640 1 -- 172.21.15.103:0/181610870 >> 172.21.15.103:0/181610870 conn(0x7f17340c8a50 msgr2=0x7f17340c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:08.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.796+0000 7f173c381640 1 -- 172.21.15.103:0/181610870 shutdown_connections 2024-09-10T08:34:08.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.796+0000 7f173c381640 1 -- 172.21.15.103:0/181610870 wait complete. 2024-09-10T08:34:08.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.798+0000 7f173c381640 1 Processor -- start 2024-09-10T08:34:08.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.798+0000 7f173c381640 1 -- start start 2024-09-10T08:34:08.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.798+0000 7f173c381640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1734074230 0x7f17341dff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.798+0000 7f173c381640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17340c43c0 0x7f17340c1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.798+0000 7f173c381640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17340c59f0 0x7f17341e3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.798+0000 7f173c381640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f17340bf5a0 con 0x7f17340c43c0 2024-09-10T08:34:08.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.798+0000 7f173c381640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f17340bf2c0 con 0x7f1734074230 2024-09-10T08:34:08.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.798+0000 7f173c381640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1734074610 con 0x7f17340c59f0 2024-09-10T08:34:08.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.799+0000 7f173991c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17340c43c0 0x7f17340c1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.799+0000 7f173991c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17340c43c0 0x7f17340c1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34978/0 (socket says 172.21.15.103:34978) 2024-09-10T08:34:08.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.799+0000 7f173a11d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1734074230 0x7f17341dff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.799+0000 7f173a91e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17340c59f0 0x7f17341e3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.799+0000 7f173991c640 1 -- 172.21.15.103:0/348845168 learned_addr learned my addr 172.21.15.103:0/348845168 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:08.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.799+0000 7f173a11d640 1 -- 172.21.15.103:0/348845168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17340c59f0 msgr2=0x7f17341e3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.799+0000 7f173a11d640 1 --2- 172.21.15.103:0/348845168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17340c59f0 0x7f17341e3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.799+0000 7f173a11d640 1 -- 172.21.15.103:0/348845168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17340c43c0 msgr2=0x7f17340c1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.799+0000 7f173a11d640 1 --2- 172.21.15.103:0/348845168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17340c43c0 0x7f17340c1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.799+0000 7f173a11d640 1 -- 172.21.15.103:0/348845168 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17340c1da0 con 0x7f1734074230 2024-09-10T08:34:08.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.799+0000 7f173991c640 1 --2- 172.21.15.103:0/348845168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17340c43c0 0x7f17340c1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:34:08.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.799+0000 7f173a11d640 1 --2- 172.21.15.103:0/348845168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1734074230 0x7f17341dff70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1730031000 tx=0x7f17300046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:08.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.799+0000 7f172affd640 1 -- 172.21.15.103:0/348845168 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730041070 con 0x7f1734074230 2024-09-10T08:34:08.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.799+0000 7f172affd640 1 -- 172.21.15.103:0/348845168 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f173003c460 con 0x7f1734074230 2024-09-10T08:34:08.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.799+0000 7f173c381640 1 -- 172.21.15.103:0/348845168 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17340c2100 con 0x7f1734074230 2024-09-10T08:34:08.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.799+0000 7f172affd640 1 -- 172.21.15.103:0/348845168 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730037040 con 0x7f1734074230 2024-09-10T08:34:08.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.800+0000 7f173c381640 1 -- 172.21.15.103:0/348845168 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17340c7530 con 0x7f1734074230 2024-09-10T08:34:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.801+0000 7f173c381640 1 --2- 172.21.15.103:0/348845168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17340c54b0 0x7f17341ef420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.801+0000 7f173c381640 1 -- 172.21.15.103:0/348845168 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1734069a00 con 0x7f17340c54b0 2024-09-10T08:34:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.801+0000 7f173991c640 1 --2- 172.21.15.103:0/348845168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17340c54b0 0x7f17341ef420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.801+0000 7f172affd640 1 -- 172.21.15.103:0/348845168 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f173003a070 con 0x7f1734074230 2024-09-10T08:34:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.801+0000 7f173991c640 1 -- 172.21.15.103:0/348845168 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f17340c23e0 con 0x7f17340c54b0 2024-09-10T08:34:08.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.801+0000 7f173991c640 1 --2- 172.21.15.103:0/348845168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17340c54b0 0x7f17341ef420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f17340c7850 tx=0x7f1724007780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:08.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.802+0000 7f172affd640 1 --2- 172.21.15.103:0/348845168 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f171806be30 0x7f171806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.802+0000 7f172affd640 1 -- 172.21.15.103:0/348845168 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f17300ab230 con 0x7f1734074230 2024-09-10T08:34:08.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.802+0000 7f173a91e640 1 --2- 172.21.15.103:0/348845168 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f171806be30 0x7f171806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.802+0000 7f172affd640 1 -- 172.21.15.103:0/348845168 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1724017020 con 0x7f17340c54b0 2024-09-10T08:34:08.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.802+0000 7f172affd640 1 -- 172.21.15.103:0/348845168 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f172400f9f0 con 0x7f17340c54b0 2024-09-10T08:34:08.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.802+0000 7f172affd640 1 -- 172.21.15.103:0/348845168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17340c54b0 msgr2=0x7f17341ef420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.802+0000 7f172affd640 1 --2- 172.21.15.103:0/348845168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17340c54b0 0x7f17341ef420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f17340c7850 tx=0x7f1724007780 comp rx=0 tx=0).stop 2024-09-10T08:34:08.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.802+0000 7f172affd640 1 -- 172.21.15.103:0/348845168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17340c54b0 msgr2=0x7f17341ef420 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:34:08.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.802+0000 7f172affd640 1 --2- 172.21.15.103:0/348845168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17340c54b0 0x7f17341ef420 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f17340c7850 tx=0x7f1724007780 comp rx=0 tx=0).stop 2024-09-10T08:34:08.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.802+0000 7f173a91e640 1 --2- 172.21.15.103:0/348845168 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f171806be30 0x7f171806e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f17341e3040 tx=0x7f172c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:08.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.808+0000 7f173c381640 1 --2- 172.21.15.103:0/348845168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17341e27e0 0x7f17341ef960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.808+0000 7f173c381640 1 -- 172.21.15.103:0/348845168 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f17340c3140 con 0x7f17341e27e0 2024-09-10T08:34:08.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.808+0000 7f173991c640 1 --2- 172.21.15.103:0/348845168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17341e27e0 0x7f17341ef960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.809+0000 7f173991c640 1 -- 172.21.15.103:0/348845168 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f17340c4af0 con 0x7f17341e27e0 2024-09-10T08:34:08.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.809+0000 7f173991c640 1 --2- 172.21.15.103:0/348845168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17341e27e0 0x7f17341ef960 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f17341584d0 tx=0x7f1724000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:08.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.809+0000 7f172affd640 1 -- 172.21.15.103:0/348845168 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1724017070 con 0x7f17341e27e0 2024-09-10T08:34:08.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.809+0000 7f172affd640 1 -- 172.21.15.103:0/348845168 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f1724013450 con 0x7f17341e27e0 2024-09-10T08:34:08.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.809+0000 7f172affd640 1 -- 172.21.15.103:0/348845168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17341e27e0 msgr2=0x7f17341ef960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.809+0000 7f172affd640 1 --2- 172.21.15.103:0/348845168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17341e27e0 0x7f17341ef960 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f17341584d0 tx=0x7f1724000ed0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.809+0000 7f172affd640 1 -- 172.21.15.103:0/348845168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17341e27e0 msgr2=0x7f17341ef960 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:34:08.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.809+0000 7f172affd640 1 --2- 172.21.15.103:0/348845168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17341e27e0 0x7f17341ef960 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.811 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:34:08.811 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:34:08.811 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:34:08.811 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:34:08.811 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 40, 2024-09-10T08:34:08.811 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 192968, 2024-09-10T08:34:08.811 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:34:08.811 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:34:08.811 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:34:08.811 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:34:08.811 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:08.811 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 12, 2024-09-10T08:34:08.812 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:34:08.812 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:34:08.812 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:34:08.812 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:08.812 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:08.812 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:08.812 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:08.812 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:08.812 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:08.812 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:08.812 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:08.812 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:08.812 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:08.813 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:08.813 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:08.813 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:34:08.813 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:34:08.813 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:08.813 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:08.813 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:08.813 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:08.813 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:08.813 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:08.813 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:08.813 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:08.813 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:08.813 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:08.814 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:08.814 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:08.814 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.814 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:34:08.814 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:34:08.814 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:34:08.814 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:34:08.814 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:34:08.814 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:34:08.814 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:34:08.814 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:34:08.814 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:34:08.814 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:34:08.815 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:34:08.815 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:34:08.815 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:34:08.815 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:34:08.815 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:34:08.815 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:34:08.815 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:34:08.815 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:08.815 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:08.815 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:08.815 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:08.815 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:08.815 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:08.816 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:08.816 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:08.816 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:08.816 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:08.816 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:08.816 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:08.816 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:34:08.816 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.816 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:34:08.816 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.816 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:34:08.816 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:34:08.816 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:08.817 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:08.817 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.817 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:08.817 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:34:08.817 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:08.817 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.817 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.817 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:08.817 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:34:08.817 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:08.817 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.817 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:08.817 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.818 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:34:08.818 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:34:08.818 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:08.818 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:08.818 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:08.818 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.818 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.818 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:34:08.818 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:34:08.818 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:08.818 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:08.818 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.818 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:08.819 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:34:08.819 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:08.819 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.819 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.819 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:08.819 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:34:08.819 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:08.819 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.819 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:08.819 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.819 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:34:08.819 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:34:08.819 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:08.819 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:08.820 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:08.820 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.820 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.820 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:34:08.820 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:34:08.820 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:08.820 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:08.820 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.820 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:08.820 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:34:08.820 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:08.820 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.820 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.820 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:08.821 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:34:08.821 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:08.821 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.821 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:08.821 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.821 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:34:08.821 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:34:08.821 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:08.821 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:08.821 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:08.821 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.821 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:08.821 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.821 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:34:08.822 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:34:08.822 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.822 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:08.822 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:08.822 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:34:08.822 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.822 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:08.822 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:34:08.822 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.822 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:08.822 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:08.822 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:34:08.822 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.823 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:08.823 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:34:08.823 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.823 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:08.823 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:08.823 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-10T08:34:08.823 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.823 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:08.823 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:34:08.823 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.823 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:08.823 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:08.823 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:34:08.823 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.823 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:08.824 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:34:08.824 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:08.824 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:08.824 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:08.824 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:34:08.824 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:08.824 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:08.824 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:08.824 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:34:08.824 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:34:08.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.810+0000 7f173c381640 1 -- 172.21.15.103:0/348845168 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f171806be30 msgr2=0x7f171806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.810+0000 7f173c381640 1 --2- 172.21.15.103:0/348845168 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f171806be30 0x7f171806e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f17341e3040 tx=0x7f172c00b040 comp rx=0 tx=0).stop 2024-09-10T08:34:08.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.810+0000 7f173c381640 1 -- 172.21.15.103:0/348845168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1734074230 msgr2=0x7f17341dff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.810+0000 7f173c381640 1 --2- 172.21.15.103:0/348845168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1734074230 0x7f17341dff70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1730031000 tx=0x7f17300046c0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.810+0000 7f173a91e640 1 -- 172.21.15.103:0/348845168 reap_dead start 2024-09-10T08:34:08.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.810+0000 7f173a91e640 1 -- 172.21.15.103:0/348845168 reap_dead start 2024-09-10T08:34:08.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.810+0000 7f173c381640 1 -- 172.21.15.103:0/348845168 shutdown_connections 2024-09-10T08:34:08.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.810+0000 7f173c381640 1 -- 172.21.15.103:0/348845168 >> 172.21.15.103:0/348845168 conn(0x7f17340c8a50 msgr2=0x7f17340c78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:08.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.810+0000 7f173c381640 1 -- 172.21.15.103:0/348845168 shutdown_connections 2024-09-10T08:34:08.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.810+0000 7f173c381640 1 -- 172.21.15.103:0/348845168 wait complete. 2024-09-10T08:34:08.829 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:34:08.829 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-09-10T08:34:08.829 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-10T08:34:08.829 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-10T08:34:08.829 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-10T08:34:08.829 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T08:34:08.829 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:34:08.841 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T08:34:08.841 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-10T08:34:08.841 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:34:08.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.948+0000 7fdc4f042640 1 Processor -- start 2024-09-10T08:34:08.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.948+0000 7fdc4f042640 1 -- start start 2024-09-10T08:34:08.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.948+0000 7fdc4f042640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc480cc2d0 0x7fdc4815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.948+0000 7fdc4f042640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdc480c7a90 0x7fdc480c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.948+0000 7fdc4f042640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc48157f10 con 0x7fdc48156d90 2024-09-10T08:34:08.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.948+0000 7fdc4f042640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fdc4806c5b0 con 0x7fdc480c7a90 2024-09-10T08:34:08.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.948+0000 7fdc4f042640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fdc4806c890 con 0x7fdc480cc2d0 2024-09-10T08:34:08.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.948+0000 7fdc4d5df640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7fdc480c7a90 msgr2=0x7fdc480c7f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:34:08.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.948+0000 7fdc47fff640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7fdc48156d90 legacy=0x7fdc48157800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:34:08.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.949+0000 7fdc4d5df640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdc480c7a90 0x7fdc480c7f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:34:08.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.949+0000 7fdc4cdde640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc480cc2d0 0x7fdc4815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.949+0000 7fdc4cdde640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc480cc2d0 0x7fdc4815a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:36392/0 (socket says 172.21.15.103:36392) 2024-09-10T08:34:08.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.949+0000 7fdc4cdde640 1 -- 172.21.15.103:0/1567277437 learned_addr learned my addr 172.21.15.103:0/1567277437 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:08.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.949+0000 7fdc4cdde640 1 -- 172.21.15.103:0/1567277437 >> v2:172.21.15.154:3300/0 conn(0x7fdc480c7a90 msgr2=0x7fdc480c7f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:34:08.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.949+0000 7fdc4cdde640 1 --2- 172.21.15.103:0/1567277437 >> v2:172.21.15.154:3300/0 conn(0x7fdc480c7a90 0x7fdc480c7f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.949+0000 7fdc4cdde640 1 -- 172.21.15.103:0/1567277437 >> v1:172.21.15.154:6789/0 conn(0x7fdc48156d90 legacy=0x7fdc48157800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:34:08.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.949+0000 7fdc4cdde640 1 -- 172.21.15.103:0/1567277437 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc48159900 con 0x7fdc480cc2d0 2024-09-10T08:34:08.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.950+0000 7fdc4cdde640 1 --2- 172.21.15.103:0/1567277437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc480cc2d0 0x7fdc4815a3e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c009870 tx=0x7fdc3c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d17d1f73954c7f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:08.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.950+0000 7fdc477fe640 1 -- 172.21.15.103:0/1567277437 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c037070 con 0x7fdc480cc2d0 2024-09-10T08:34:08.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.950+0000 7fdc477fe640 1 -- 172.21.15.103:0/1567277437 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc3c032440 con 0x7fdc480cc2d0 2024-09-10T08:34:08.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.950+0000 7fdc477fe640 1 -- 172.21.15.103:0/1567277437 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c032810 con 0x7fdc480cc2d0 2024-09-10T08:34:08.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.950+0000 7fdc4f042640 1 -- 172.21.15.103:0/1567277437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc480cc2d0 msgr2=0x7fdc4815a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.950+0000 7fdc4f042640 1 --2- 172.21.15.103:0/1567277437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc480cc2d0 0x7fdc4815a3e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c009870 tx=0x7fdc3c02a1a0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.951+0000 7fdc4f042640 1 -- 172.21.15.103:0/1567277437 shutdown_connections 2024-09-10T08:34:08.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.951+0000 7fdc4f042640 1 --2- 172.21.15.103:0/1567277437 >> v2:172.21.15.154:3300/0 conn(0x7fdc480c7a90 0x7fdc480c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.951+0000 7fdc4f042640 1 --2- 172.21.15.103:0/1567277437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc480cc2d0 0x7fdc4815a3e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.951+0000 7fdc4f042640 1 -- 172.21.15.103:0/1567277437 >> 172.21.15.103:0/1567277437 conn(0x7fdc48067fe0 msgr2=0x7fdc48073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:08.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.951+0000 7fdc4f042640 1 -- 172.21.15.103:0/1567277437 shutdown_connections 2024-09-10T08:34:08.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.951+0000 7fdc4f042640 1 -- 172.21.15.103:0/1567277437 wait complete. 2024-09-10T08:34:08.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.952+0000 7fdc4f042640 1 Processor -- start 2024-09-10T08:34:08.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.952+0000 7fdc4f042640 1 -- start start 2024-09-10T08:34:08.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.953+0000 7fdc4f042640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc480c7a90 0x7fdc480c1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.953+0000 7fdc4f042640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc480cc2d0 0x7fdc480af350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.953+0000 7fdc4f042640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc48156d90 0x7fdc480af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.953+0000 7fdc4f042640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdc481571f0 con 0x7fdc480c7a90 2024-09-10T08:34:08.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.953+0000 7fdc4f042640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdc48159ec0 con 0x7fdc480cc2d0 2024-09-10T08:34:08.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.953+0000 7fdc4f042640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fdc4806d2c0 con 0x7fdc48156d90 2024-09-10T08:34:08.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.953+0000 7fdc47fff640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc480cc2d0 msgr2=0x7fdc480af350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:34:08.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.953+0000 7fdc47fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc480cc2d0 0x7fdc480af350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:34:08.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.953+0000 7fdc4cdde640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc480c7a90 0x7fdc480c1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.953+0000 7fdc4cdde640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc480c7a90 0x7fdc480c1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35004/0 (socket says 172.21.15.103:35004) 2024-09-10T08:34:08.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.953+0000 7fdc4cdde640 1 -- 172.21.15.103:0/3047947289 learned_addr learned my addr 172.21.15.103:0/3047947289 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:08.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.953+0000 7fdc4d5df640 1 --2- 172.21.15.103:0/3047947289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc48156d90 0x7fdc480af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.954+0000 7fdc4cdde640 1 -- 172.21.15.103:0/3047947289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc48156d90 msgr2=0x7fdc480af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.954+0000 7fdc4cdde640 1 --2- 172.21.15.103:0/3047947289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc48156d90 0x7fdc480af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.954+0000 7fdc4cdde640 1 -- 172.21.15.103:0/3047947289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc480cc2d0 msgr2=0x7fdc480af350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:34:08.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.954+0000 7fdc4cdde640 1 --2- 172.21.15.103:0/3047947289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc480cc2d0 0x7fdc480af350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.954+0000 7fdc4cdde640 1 -- 172.21.15.103:0/3047947289 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc481eced0 con 0x7fdc480c7a90 2024-09-10T08:34:08.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.954+0000 7fdc4d5df640 1 --2- 172.21.15.103:0/3047947289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc48156d90 0x7fdc480af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:34:08.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.954+0000 7fdc4cdde640 1 --2- 172.21.15.103:0/3047947289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc480c7a90 0x7fdc480c1100 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c000c00 tx=0x7fdc3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:08.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.954+0000 7fdc457fa640 1 -- 172.21.15.103:0/3047947289 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c041020 con 0x7fdc480c7a90 2024-09-10T08:34:08.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.954+0000 7fdc457fa640 1 -- 172.21.15.103:0/3047947289 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc3c032e50 con 0x7fdc480c7a90 2024-09-10T08:34:08.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.954+0000 7fdc457fa640 1 -- 172.21.15.103:0/3047947289 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c037040 con 0x7fdc480c7a90 2024-09-10T08:34:08.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.954+0000 7fdc4f042640 1 -- 172.21.15.103:0/3047947289 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc480b0a80 con 0x7fdc480c7a90 2024-09-10T08:34:08.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.954+0000 7fdc4f042640 1 -- 172.21.15.103:0/3047947289 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc480c1640 con 0x7fdc480c7a90 2024-09-10T08:34:08.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.955+0000 7fdc457fa640 1 -- 172.21.15.103:0/3047947289 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc3c044020 con 0x7fdc480c7a90 2024-09-10T08:34:08.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.955+0000 7fdc4f042640 1 -- 172.21.15.103:0/3047947289 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc480cc930 con 0x7fdc480c7a90 2024-09-10T08:34:08.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.956+0000 7fdc457fa640 1 --2- 172.21.15.103:0/3047947289 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc2c06bde0 0x7fdc2c06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:08.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.956+0000 7fdc457fa640 1 -- 172.21.15.103:0/3047947289 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fdc3c0abad0 con 0x7fdc480c7a90 2024-09-10T08:34:08.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.956+0000 7fdc47fff640 1 --2- 172.21.15.103:0/3047947289 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc2c06bde0 0x7fdc2c06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:08.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.956+0000 7fdc47fff640 1 --2- 172.21.15.103:0/3047947289 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc2c06bde0 0x7fdc2c06e2a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdc34006fd0 tx=0x7fdc34006d00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:08.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:08.960+0000 7fdc457fa640 1 -- 172.21.15.103:0/3047947289 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc480cc930 con 0x7fdc480c7a90 2024-09-10T08:34:09.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:09.270+0000 7fdc4f042640 1 -- 172.21.15.103:0/3047947289 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdc4806c1d0 con 0x7fdc480c7a90 2024-09-10T08:34:09.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:09.270+0000 7fdc457fa640 1 -- 172.21.15.103:0/3047947289 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fdc3c04b030 con 0x7fdc480c7a90 2024-09-10T08:34:09.271 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":40,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:34:09.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:09.272+0000 7fdc4f042640 1 -- 172.21.15.103:0/3047947289 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc2c06bde0 msgr2=0x7fdc2c06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:09.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:09.272+0000 7fdc4f042640 1 --2- 172.21.15.103:0/3047947289 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc2c06bde0 0x7fdc2c06e2a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdc34006fd0 tx=0x7fdc34006d00 comp rx=0 tx=0).stop 2024-09-10T08:34:09.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:09.272+0000 7fdc4f042640 1 -- 172.21.15.103:0/3047947289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc480c7a90 msgr2=0x7fdc480c1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:09.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:09.272+0000 7fdc4f042640 1 --2- 172.21.15.103:0/3047947289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc480c7a90 0x7fdc480c1100 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c000c00 tx=0x7fdc3c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:34:09.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:09.273+0000 7fdc4f042640 1 -- 172.21.15.103:0/3047947289 shutdown_connections 2024-09-10T08:34:09.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:09.273+0000 7fdc4f042640 1 --2- 172.21.15.103:0/3047947289 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdc2c06bde0 0x7fdc2c06e2a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:09.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:09.273+0000 7fdc4f042640 1 --2- 172.21.15.103:0/3047947289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc48156d90 0x7fdc480af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:09.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:09.273+0000 7fdc4f042640 1 --2- 172.21.15.103:0/3047947289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc480cc2d0 0x7fdc480af350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:09.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:09.273+0000 7fdc4f042640 1 --2- 172.21.15.103:0/3047947289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc480c7a90 0x7fdc480c1100 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:09.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:09.273+0000 7fdc4f042640 1 -- 172.21.15.103:0/3047947289 >> 172.21.15.103:0/3047947289 conn(0x7fdc48067fe0 msgr2=0x7fdc480ab880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:09.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:09.273+0000 7fdc4f042640 1 -- 172.21.15.103:0/3047947289 shutdown_connections 2024-09-10T08:34:09.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:09.273+0000 7fdc4f042640 1 -- 172.21.15.103:0/3047947289 wait complete. 2024-09-10T08:34:12.289 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:34:12.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.393+0000 7f7b51191640 1 Processor -- start 2024-09-10T08:34:12.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.393+0000 7f7b51191640 1 -- start start 2024-09-10T08:34:12.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.393+0000 7f7b51191640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b4c0c8b10 0x7f7b4c15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.393+0000 7f7b51191640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7b4c153be0 0x7f7b4c156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.394+0000 7f7b51191640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b4c0c7070 con 0x7f7b4c06cd80 2024-09-10T08:34:12.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.394+0000 7f7b51191640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f7b4c06d210 con 0x7f7b4c153be0 2024-09-10T08:34:12.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.394+0000 7f7b51191640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7b4c0c69b0 con 0x7f7b4c0c8b10 2024-09-10T08:34:12.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.394+0000 7f7b4a59c640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f7b4c06cd80 legacy=0x7f7b4c1534d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:34:12.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.394+0000 7f7b4b59e640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7f7b4c153be0 msgr2=0x7f7b4c156660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:34:12.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.394+0000 7f7b4b59e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7b4c153be0 0x7f7b4c156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:34:12.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.394+0000 7f7b4ad9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b4c0c8b10 0x7f7b4c15a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.394+0000 7f7b4ad9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b4c0c8b10 0x7f7b4c15a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:36416/0 (socket says 172.21.15.103:36416) 2024-09-10T08:34:12.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.394+0000 7f7b4ad9d640 1 -- 172.21.15.103:0/2550145871 learned_addr learned my addr 172.21.15.103:0/2550145871 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:12.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.394+0000 7f7b4ad9d640 1 -- 172.21.15.103:0/2550145871 >> v2:172.21.15.154:3300/0 conn(0x7f7b4c153be0 msgr2=0x7f7b4c156660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:34:12.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.394+0000 7f7b4ad9d640 1 --2- 172.21.15.103:0/2550145871 >> v2:172.21.15.154:3300/0 conn(0x7f7b4c153be0 0x7f7b4c156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.394+0000 7f7b4ad9d640 1 -- 172.21.15.103:0/2550145871 >> v1:172.21.15.154:6789/0 conn(0x7f7b4c06cd80 legacy=0x7f7b4c1534d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:34:12.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.394+0000 7f7b4ad9d640 1 -- 172.21.15.103:0/2550145871 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b4c0c6c90 con 0x7f7b4c0c8b10 2024-09-10T08:34:12.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.395+0000 7f7b4ad9d640 1 --2- 172.21.15.103:0/2550145871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b4c0c8b10 0x7f7b4c15a4a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009870 tx=0x7f7b3c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af2b65fe57bf77f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:12.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.395+0000 7f7b49d9b640 1 -- 172.21.15.103:0/2550145871 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c037070 con 0x7f7b4c0c8b10 2024-09-10T08:34:12.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.395+0000 7f7b49d9b640 1 -- 172.21.15.103:0/2550145871 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b3c032440 con 0x7f7b4c0c8b10 2024-09-10T08:34:12.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.395+0000 7f7b49d9b640 1 -- 172.21.15.103:0/2550145871 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c032810 con 0x7f7b4c0c8b10 2024-09-10T08:34:12.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.396+0000 7f7b51191640 1 -- 172.21.15.103:0/2550145871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b4c0c8b10 msgr2=0x7f7b4c15a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:12.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.396+0000 7f7b51191640 1 --2- 172.21.15.103:0/2550145871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b4c0c8b10 0x7f7b4c15a4a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009870 tx=0x7f7b3c02a1a0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.396+0000 7f7b51191640 1 -- 172.21.15.103:0/2550145871 shutdown_connections 2024-09-10T08:34:12.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.396+0000 7f7b51191640 1 --2- 172.21.15.103:0/2550145871 >> v2:172.21.15.154:3300/0 conn(0x7f7b4c153be0 0x7f7b4c156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.396+0000 7f7b51191640 1 --2- 172.21.15.103:0/2550145871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b4c0c8b10 0x7f7b4c15a4a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.396+0000 7f7b51191640 1 -- 172.21.15.103:0/2550145871 >> 172.21.15.103:0/2550145871 conn(0x7f7b4c0adb80 msgr2=0x7f7b4c0adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:12.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.396+0000 7f7b51191640 1 -- 172.21.15.103:0/2550145871 shutdown_connections 2024-09-10T08:34:12.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.396+0000 7f7b51191640 1 -- 172.21.15.103:0/2550145871 wait complete. 2024-09-10T08:34:12.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.398+0000 7f7b51191640 1 Processor -- start 2024-09-10T08:34:12.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.398+0000 7f7b51191640 1 -- start start 2024-09-10T08:34:12.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.398+0000 7f7b51191640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b4c0c8b10 0x7f7b4c151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.398+0000 7f7b51191640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b4c153be0 0x7f7b4c147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.399+0000 7f7b51191640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b4c1489c0 0x7f7b4c147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.399+0000 7f7b51191640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c0c9070 con 0x7f7b4c1489c0 2024-09-10T08:34:12.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.399+0000 7f7b51191640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c0c8ef0 con 0x7f7b4c153be0 2024-09-10T08:34:12.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.399+0000 7f7b51191640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7b4c156ba0 con 0x7f7b4c0c8b10 2024-09-10T08:34:12.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.399+0000 7f7b4a59c640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b4c153be0 msgr2=0x7f7b4c147750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:34:12.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.399+0000 7f7b4a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b4c153be0 0x7f7b4c147750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:34:12.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.399+0000 7f7b4b59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b4c1489c0 0x7f7b4c147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.399+0000 7f7b4ad9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b4c0c8b10 0x7f7b4c151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.399+0000 7f7b4ad9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b4c0c8b10 0x7f7b4c151650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:36426/0 (socket says 172.21.15.103:36426) 2024-09-10T08:34:12.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.399+0000 7f7b4b59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b4c1489c0 0x7f7b4c147c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35008/0 (socket says 172.21.15.103:35008) 2024-09-10T08:34:12.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.399+0000 7f7b4ad9d640 1 -- 172.21.15.103:0/2651009892 learned_addr learned my addr 172.21.15.103:0/2651009892 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:12.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.399+0000 7f7b4ad9d640 1 -- 172.21.15.103:0/2651009892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b4c153be0 msgr2=0x7f7b4c147750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:34:12.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.399+0000 7f7b4ad9d640 1 --2- 172.21.15.103:0/2651009892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b4c153be0 0x7f7b4c147750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.399+0000 7f7b4ad9d640 1 -- 172.21.15.103:0/2651009892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b4c1489c0 msgr2=0x7f7b4c147c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:12.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.399+0000 7f7b4ad9d640 1 --2- 172.21.15.103:0/2651009892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b4c1489c0 0x7f7b4c147c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.399+0000 7f7b4ad9d640 1 -- 172.21.15.103:0/2651009892 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b4c150570 con 0x7f7b4c0c8b10 2024-09-10T08:34:12.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.399+0000 7f7b4ad9d640 1 --2- 172.21.15.103:0/2651009892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b4c0c8b10 0x7f7b4c151650 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c000c00 tx=0x7f7b3c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:12.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.399+0000 7f7b337fe640 1 -- 172.21.15.103:0/2651009892 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c041070 con 0x7f7b4c0c8b10 2024-09-10T08:34:12.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.399+0000 7f7b337fe640 1 -- 172.21.15.103:0/2651009892 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b3c03c870 con 0x7f7b4c0c8b10 2024-09-10T08:34:12.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.399+0000 7f7b51191640 1 -- 172.21.15.103:0/2651009892 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b4c14f9f0 con 0x7f7b4c0c8b10 2024-09-10T08:34:12.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.399+0000 7f7b337fe640 1 -- 172.21.15.103:0/2651009892 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c037040 con 0x7f7b4c0c8b10 2024-09-10T08:34:12.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.400+0000 7f7b51191640 1 -- 172.21.15.103:0/2651009892 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b4c14ffb0 con 0x7f7b4c0c8b10 2024-09-10T08:34:12.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.401+0000 7f7b51191640 1 -- 172.21.15.103:0/2651009892 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b4c157070 con 0x7f7b4c0c8b10 2024-09-10T08:34:12.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.401+0000 7f7b337fe640 1 -- 172.21.15.103:0/2651009892 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b3c044070 con 0x7f7b4c0c8b10 2024-09-10T08:34:12.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.402+0000 7f7b337fe640 1 --2- 172.21.15.103:0/2651009892 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7b3806bde0 0x7f7b3806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.402+0000 7f7b337fe640 1 -- 172.21.15.103:0/2651009892 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f7b3c0abed0 con 0x7f7b4c0c8b10 2024-09-10T08:34:12.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.402+0000 7f7b4a59c640 1 --2- 172.21.15.103:0/2651009892 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7b3806bde0 0x7f7b3806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.402+0000 7f7b4a59c640 1 --2- 172.21.15.103:0/2651009892 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7b3806bde0 0x7f7b3806e2a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7b40006fd0 tx=0x7f7b40006d80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:12.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.406+0000 7f7b337fe640 1 -- 172.21.15.103:0/2651009892 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b3c079fb0 con 0x7f7b4c0c8b10 2024-09-10T08:34:12.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.680+0000 7f7b51191640 1 -- 172.21.15.103:0/2651009892 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7b4c0c9d90 con 0x7f7b4c0c8b10 2024-09-10T08:34:12.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.681+0000 7f7b337fe640 1 -- 172.21.15.103:0/2651009892 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f7b3c07e2b0 con 0x7f7b4c0c8b10 2024-09-10T08:34:12.680 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":40,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:34:12.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.683+0000 7f7b51191640 1 -- 172.21.15.103:0/2651009892 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7b3806bde0 msgr2=0x7f7b3806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:12.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.683+0000 7f7b51191640 1 --2- 172.21.15.103:0/2651009892 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7b3806bde0 0x7f7b3806e2a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7b40006fd0 tx=0x7f7b40006d80 comp rx=0 tx=0).stop 2024-09-10T08:34:12.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.683+0000 7f7b51191640 1 -- 172.21.15.103:0/2651009892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b4c0c8b10 msgr2=0x7f7b4c151650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:12.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.683+0000 7f7b51191640 1 --2- 172.21.15.103:0/2651009892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b4c0c8b10 0x7f7b4c151650 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c000c00 tx=0x7f7b3c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.683+0000 7f7b51191640 1 -- 172.21.15.103:0/2651009892 shutdown_connections 2024-09-10T08:34:12.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.683+0000 7f7b51191640 1 --2- 172.21.15.103:0/2651009892 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7b3806bde0 0x7f7b3806e2a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.683+0000 7f7b51191640 1 --2- 172.21.15.103:0/2651009892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b4c1489c0 0x7f7b4c147c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.683+0000 7f7b51191640 1 --2- 172.21.15.103:0/2651009892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b4c153be0 0x7f7b4c147750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.683+0000 7f7b51191640 1 --2- 172.21.15.103:0/2651009892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b4c0c8b10 0x7f7b4c151650 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.683+0000 7f7b51191640 1 -- 172.21.15.103:0/2651009892 >> 172.21.15.103:0/2651009892 conn(0x7f7b4c0adb80 msgr2=0x7f7b4c06c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:12.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.683+0000 7f7b51191640 1 -- 172.21.15.103:0/2651009892 shutdown_connections 2024-09-10T08:34:12.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:12.683+0000 7f7b51191640 1 -- 172.21.15.103:0/2651009892 wait complete. 2024-09-10T08:34:15.697 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:34:15.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.802+0000 7f1469503640 1 Processor -- start 2024-09-10T08:34:15.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.802+0000 7f1469503640 1 -- start start 2024-09-10T08:34:15.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.803+0000 7f1469503640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f14640ad6a0 0x7f1464159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:15.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.803+0000 7f1469503640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14640c2f60 con 0x7f14640c5130 2024-09-10T08:34:15.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.803+0000 7f14637fe640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f1464153fd0 legacy=0x7f146415a1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:34:15.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.803+0000 7f1469503640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14640c3240 con 0x7f1464153fd0 2024-09-10T08:34:15.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.803+0000 7f1469503640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f14640c1f80 con 0x7f14640ad6a0 2024-09-10T08:34:15.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.803+0000 7f14627fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f14640ad6a0 0x7f1464159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:15.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.803+0000 7f1462ffd640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f14640c5130 0x7f14641538c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:52326/0 (socket says 172.21.15.103:52326) 2024-09-10T08:34:15.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.803+0000 7f1462ffd640 1 -- 172.21.15.103:0/1174839624 learned_addr learned my addr 172.21.15.103:0/1174839624 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:34:15.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.804+0000 7f14627fc640 1 -- 172.21.15.103:0/1174839624 >> v1:172.21.15.154:6789/0 conn(0x7f1464153fd0 legacy=0x7f146415a1a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:34:15.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.804+0000 7f14627fc640 1 -- 172.21.15.103:0/1174839624 >> v1:172.21.15.103:6789/0 conn(0x7f14640c5130 legacy=0x7f14641538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:15.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.804+0000 7f14627fc640 1 -- 172.21.15.103:0/1174839624 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14640c1c10 con 0x7f14640ad6a0 2024-09-10T08:34:15.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.805+0000 7f14627fc640 1 --2- 172.21.15.103:0/1174839624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14640ad6a0 0x7f1464159c60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f14580097a0 tx=0x7f145802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4ba9c5afc1d220 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:15.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.805+0000 7f1461ffb640 1 -- 172.21.15.103:0/1174839624 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1458037070 con 0x7f14640ad6a0 2024-09-10T08:34:15.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.805+0000 7f1461ffb640 1 -- 172.21.15.103:0/1174839624 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f145802adc0 con 0x7f14640ad6a0 2024-09-10T08:34:15.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.805+0000 7f1461ffb640 1 -- 172.21.15.103:0/1174839624 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1458032660 con 0x7f14640ad6a0 2024-09-10T08:34:15.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.805+0000 7f1469503640 1 -- 172.21.15.103:0/1174839624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14640ad6a0 msgr2=0x7f1464159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:15.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.805+0000 7f1469503640 1 --2- 172.21.15.103:0/1174839624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14640ad6a0 0x7f1464159c60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f14580097a0 tx=0x7f145802a0b0 comp rx=0 tx=0).stop 2024-09-10T08:34:15.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.805+0000 7f1469503640 1 -- 172.21.15.103:0/1174839624 shutdown_connections 2024-09-10T08:34:15.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.805+0000 7f1469503640 1 --2- 172.21.15.103:0/1174839624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14640ad6a0 0x7f1464159c60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:15.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.805+0000 7f1469503640 1 -- 172.21.15.103:0/1174839624 >> 172.21.15.103:0/1174839624 conn(0x7f14640c8430 msgr2=0x7f14640c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:15.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.806+0000 7f1469503640 1 -- 172.21.15.103:0/1174839624 shutdown_connections 2024-09-10T08:34:15.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.806+0000 7f1469503640 1 -- 172.21.15.103:0/1174839624 wait complete. 2024-09-10T08:34:15.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.807+0000 7f1469503640 1 Processor -- start 2024-09-10T08:34:15.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.807+0000 7f1469503640 1 -- start start 2024-09-10T08:34:15.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.808+0000 7f1469503640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14640ad6a0 0x7f14640c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:15.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.808+0000 7f1469503640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14640c5130 0x7f14641e32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:15.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.808+0000 7f1469503640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1464153fd0 0x7f14641ef5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:15.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.808+0000 7f1469503640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f14640c4250 con 0x7f14640ad6a0 2024-09-10T08:34:15.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.808+0000 7f1469503640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f14640c40d0 con 0x7f1464153fd0 2024-09-10T08:34:15.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.808+0000 7f1469503640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f14640c5510 con 0x7f14640c5130 2024-09-10T08:34:15.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.808+0000 7f14637fe640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1464153fd0 msgr2=0x7f14641ef5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:34:15.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.808+0000 7f1462ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14640ad6a0 0x7f14640c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:15.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.808+0000 7f14637fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1464153fd0 0x7f14641ef5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:34:15.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.808+0000 7f1462ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14640ad6a0 0x7f14640c7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60218/0 (socket says 172.21.15.103:60218) 2024-09-10T08:34:15.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.808+0000 7f1462ffd640 1 -- 172.21.15.103:0/2381132119 learned_addr learned my addr 172.21.15.103:0/2381132119 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:15.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.808+0000 7f14627fc640 1 --2- 172.21.15.103:0/2381132119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14640c5130 0x7f14641e32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:15.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.808+0000 7f1462ffd640 1 -- 172.21.15.103:0/2381132119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14640c5130 msgr2=0x7f14641e32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:15.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.808+0000 7f1462ffd640 1 --2- 172.21.15.103:0/2381132119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14640c5130 0x7f14641e32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:15.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.808+0000 7f1462ffd640 1 -- 172.21.15.103:0/2381132119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1464153fd0 msgr2=0x7f14641ef5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:34:15.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.808+0000 7f1462ffd640 1 --2- 172.21.15.103:0/2381132119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1464153fd0 0x7f14641ef5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:15.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.808+0000 7f1462ffd640 1 -- 172.21.15.103:0/2381132119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146414bdd0 con 0x7f14640ad6a0 2024-09-10T08:34:15.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.808+0000 7f1462ffd640 1 --2- 172.21.15.103:0/2381132119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14640ad6a0 0x7f14640c7e70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f145400c480 tx=0x7f145400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:15.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.808+0000 7f144b7fe640 1 -- 172.21.15.103:0/2381132119 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1454017070 con 0x7f14640ad6a0 2024-09-10T08:34:15.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.808+0000 7f144b7fe640 1 -- 172.21.15.103:0/2381132119 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1454005ce0 con 0x7f14640ad6a0 2024-09-10T08:34:15.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.808+0000 7f1469503640 1 -- 172.21.15.103:0/2381132119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14641dfe20 con 0x7f14640ad6a0 2024-09-10T08:34:15.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.808+0000 7f144b7fe640 1 -- 172.21.15.103:0/2381132119 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14540072f0 con 0x7f14640ad6a0 2024-09-10T08:34:15.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.809+0000 7f1469503640 1 -- 172.21.15.103:0/2381132119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f146414f710 con 0x7f14640ad6a0 2024-09-10T08:34:15.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.809+0000 7f1469503640 1 -- 172.21.15.103:0/2381132119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14640c7b60 con 0x7f14640ad6a0 2024-09-10T08:34:15.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.810+0000 7f144b7fe640 1 -- 172.21.15.103:0/2381132119 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f145401a070 con 0x7f14640ad6a0 2024-09-10T08:34:15.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.811+0000 7f144b7fe640 1 --2- 172.21.15.103:0/2381132119 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f145006bde0 0x7f145006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:15.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.811+0000 7f144b7fe640 1 -- 172.21.15.103:0/2381132119 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f145408a3f0 con 0x7f14640ad6a0 2024-09-10T08:34:15.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.811+0000 7f14627fc640 1 --2- 172.21.15.103:0/2381132119 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f145006bde0 0x7f145006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:15.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.811+0000 7f14627fc640 1 --2- 172.21.15.103:0/2381132119 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f145006bde0 0x7f145006e2a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1458034000 tx=0x7f145802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:15.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:15.816+0000 7f144b7fe640 1 -- 172.21.15.103:0/2381132119 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1454058440 con 0x7f14640ad6a0 2024-09-10T08:34:16.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:16.105+0000 7f1469503640 1 -- 172.21.15.103:0/2381132119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1464067950 con 0x7f14640ad6a0 2024-09-10T08:34:16.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:16.105+0000 7f144b7fe640 1 -- 172.21.15.103:0/2381132119 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f145405c740 con 0x7f14640ad6a0 2024-09-10T08:34:16.105 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":40,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:34:16.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:16.107+0000 7f1469503640 1 -- 172.21.15.103:0/2381132119 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f145006bde0 msgr2=0x7f145006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:16.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:16.107+0000 7f1469503640 1 --2- 172.21.15.103:0/2381132119 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f145006bde0 0x7f145006e2a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1458034000 tx=0x7f145802e000 comp rx=0 tx=0).stop 2024-09-10T08:34:16.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:16.107+0000 7f1469503640 1 -- 172.21.15.103:0/2381132119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14640ad6a0 msgr2=0x7f14640c7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:16.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:16.107+0000 7f1469503640 1 --2- 172.21.15.103:0/2381132119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14640ad6a0 0x7f14640c7e70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f145400c480 tx=0x7f145400c940 comp rx=0 tx=0).stop 2024-09-10T08:34:16.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:16.107+0000 7f1469503640 1 -- 172.21.15.103:0/2381132119 shutdown_connections 2024-09-10T08:34:16.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:16.107+0000 7f1469503640 1 --2- 172.21.15.103:0/2381132119 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f145006bde0 0x7f145006e2a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:16.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:16.107+0000 7f1469503640 1 --2- 172.21.15.103:0/2381132119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1464153fd0 0x7f14641ef5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:16.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:16.107+0000 7f1469503640 1 --2- 172.21.15.103:0/2381132119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14640c5130 0x7f14641e32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:16.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:16.107+0000 7f1469503640 1 --2- 172.21.15.103:0/2381132119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14640ad6a0 0x7f14640c7e70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:16.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:16.107+0000 7f1469503640 1 -- 172.21.15.103:0/2381132119 >> 172.21.15.103:0/2381132119 conn(0x7f14640c8430 msgr2=0x7f1464158980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:16.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:16.107+0000 7f1469503640 1 -- 172.21.15.103:0/2381132119 shutdown_connections 2024-09-10T08:34:16.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:16.107+0000 7f1469503640 1 -- 172.21.15.103:0/2381132119 wait complete. 2024-09-10T08:34:19.119 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:34:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.225+0000 7f8e542ed640 1 Processor -- start 2024-09-10T08:34:19.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.225+0000 7f8e542ed640 1 -- start start 2024-09-10T08:34:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.226+0000 7f8e542ed640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8e4c0cc2d0 0x7f8e4c15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.226+0000 7f8e542ed640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 0x7f8e4c157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:19.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.226+0000 7f8e542ed640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e4c06c5b0 con 0x7f8e4c0c7a90 2024-09-10T08:34:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.226+0000 7f8e542ed640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f8e4c06c890 con 0x7f8e4c156d90 2024-09-10T08:34:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.226+0000 7f8e542ed640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8e4c159900 con 0x7f8e4c0cc2d0 2024-09-10T08:34:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.226+0000 7f8e52089640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7f8e4c0cc2d0 msgr2=0x7f8e4c15a3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:34:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.226+0000 7f8e51888640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 0x7f8e4c157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.226+0000 7f8e52089640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8e4c0cc2d0 0x7f8e4c15a3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:34:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.226+0000 7f8e51888640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 0x7f8e4c157800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60228/0 (socket says 172.21.15.103:60228) 2024-09-10T08:34:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.226+0000 7f8e5288a640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8e4c0c7a90 0x7f8e4c0c8790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:52338/0 (socket says 172.21.15.103:52338) 2024-09-10T08:34:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.226+0000 7f8e51888640 1 -- 172.21.15.103:0/1070105849 learned_addr learned my addr 172.21.15.103:0/1070105849 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.226+0000 7f8e51888640 1 -- 172.21.15.103:0/1070105849 >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 msgr2=0x7f8e4c157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:34:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.226+0000 7f8e51888640 1 -- 172.21.15.103:0/1070105849 >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 msgr2=0x7f8e4c157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:34:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.226+0000 7f8e51888640 1 --2- 172.21.15.103:0/1070105849 >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 0x7f8e4c157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:34:19.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.226+0000 7f8e51888640 1 --2- 172.21.15.103:0/1070105849 >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 0x7f8e4c157800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:34:19.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.427+0000 7f8e52089640 1 -- 172.21.15.103:0/1070105849 >> v2:172.21.15.154:3300/0 conn(0x7f8e4c0cc2d0 msgr2=0x7f8e4c15a3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:34:19.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.427+0000 7f8e52089640 1 --2- 172.21.15.103:0/1070105849 >> v2:172.21.15.154:3300/0 conn(0x7f8e4c0cc2d0 0x7f8e4c15a3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:34:19.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.427+0000 7f8e51888640 1 --2- 172.21.15.103:0/1070105849 >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 0x7f8e4c157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:19.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.427+0000 7f8e51888640 1 -- 172.21.15.103:0/1070105849 >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 msgr2=0x7f8e4c157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:34:19.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.427+0000 7f8e51888640 1 -- 172.21.15.103:0/1070105849 >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 msgr2=0x7f8e4c157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:34:19.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.427+0000 7f8e51888640 1 --2- 172.21.15.103:0/1070105849 >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 0x7f8e4c157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:34:19.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.427+0000 7f8e51888640 1 --2- 172.21.15.103:0/1070105849 >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 0x7f8e4c157800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:34:19.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.828+0000 7f8e52089640 1 -- 172.21.15.103:0/1070105849 >> v2:172.21.15.154:3300/0 conn(0x7f8e4c0cc2d0 msgr2=0x7f8e4c15a3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:34:19.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.828+0000 7f8e52089640 1 --2- 172.21.15.103:0/1070105849 >> v2:172.21.15.154:3300/0 conn(0x7f8e4c0cc2d0 0x7f8e4c15a3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:34:19.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.828+0000 7f8e51888640 1 --2- 172.21.15.103:0/1070105849 >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 0x7f8e4c157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:19.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.828+0000 7f8e51888640 1 -- 172.21.15.103:0/1070105849 >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 msgr2=0x7f8e4c157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:34:19.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.828+0000 7f8e51888640 1 -- 172.21.15.103:0/1070105849 >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 msgr2=0x7f8e4c157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:34:19.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.828+0000 7f8e51888640 1 --2- 172.21.15.103:0/1070105849 >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 0x7f8e4c157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:34:19.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:19.828+0000 7f8e51888640 1 --2- 172.21.15.103:0/1070105849 >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 0x7f8e4c157800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:34:20.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:20.629+0000 7f8e52089640 1 -- 172.21.15.103:0/1070105849 >> v2:172.21.15.154:3300/0 conn(0x7f8e4c0cc2d0 msgr2=0x7f8e4c15a3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:34:20.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:20.629+0000 7f8e52089640 1 --2- 172.21.15.103:0/1070105849 >> v2:172.21.15.154:3300/0 conn(0x7f8e4c0cc2d0 0x7f8e4c15a3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:34:20.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:20.629+0000 7f8e51888640 1 --2- 172.21.15.103:0/1070105849 >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 0x7f8e4c157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:20.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:20.629+0000 7f8e51888640 1 -- 172.21.15.103:0/1070105849 >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 msgr2=0x7f8e4c157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:34:20.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:20.629+0000 7f8e51888640 1 -- 172.21.15.103:0/1070105849 >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 msgr2=0x7f8e4c157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:34:20.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:20.629+0000 7f8e51888640 1 --2- 172.21.15.103:0/1070105849 >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 0x7f8e4c157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:34:20.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:20.629+0000 7f8e51888640 1 --2- 172.21.15.103:0/1070105849 >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 0x7f8e4c157800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:34:22.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.226+0000 7f8e43fff640 1 -- 172.21.15.103:0/1070105849 >> v2:172.21.15.154:3300/0 conn(0x7f8e4c0cc2d0 msgr2=0x7f8e4c15a3e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:34:22.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.226+0000 7f8e43fff640 1 --2- 172.21.15.103:0/1070105849 >> v2:172.21.15.154:3300/0 conn(0x7f8e4c0cc2d0 0x7f8e4c15a3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:22.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.226+0000 7f8e43fff640 1 -- 172.21.15.103:0/1070105849 >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 msgr2=0x7f8e4c157800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:34:22.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.226+0000 7f8e43fff640 1 --2- 172.21.15.103:0/1070105849 >> v2:172.21.15.103:3300/0 conn(0x7f8e4c156d90 0x7f8e4c157800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:22.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.226+0000 7f8e43fff640 1 -- 172.21.15.103:0/1070105849 >> v1:172.21.15.103:6789/0 conn(0x7f8e4c0c7a90 legacy=0x7f8e4c0c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:22.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.226+0000 7f8e43fff640 1 --2- 172.21.15.103:0/1070105849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e30003690 0x7f8e30005ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:22.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.226+0000 7f8e43fff640 1 -- 172.21.15.103:0/1070105849 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e4c159be0 con 0x7f8e30006170 2024-09-10T08:34:22.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.226+0000 7f8e43fff640 1 -- 172.21.15.103:0/1070105849 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8e4c06c890 con 0x7f8e30003690 2024-09-10T08:34:22.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.226+0000 7f8e51888640 1 -- 172.21.15.103:0/1070105849 >> v1:172.21.15.154:6789/0 conn(0x7f8e30006170 legacy=0x7f8e30008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:34:22.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.226+0000 7f8e52089640 1 --2- 172.21.15.103:0/1070105849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e30003690 0x7f8e30005ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:22.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.226+0000 7f8e52089640 1 -- 172.21.15.103:0/1070105849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e30003690 msgr2=0x7f8e30005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:34:22.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.226+0000 7f8e52089640 1 -- 172.21.15.103:0/1070105849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e30003690 msgr2=0x7f8e30005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:34:22.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.226+0000 7f8e52089640 1 --2- 172.21.15.103:0/1070105849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e30003690 0x7f8e30005ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:34:22.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.226+0000 7f8e52089640 1 --2- 172.21.15.103:0/1070105849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e30003690 0x7f8e30005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:34:22.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.427+0000 7f8e51888640 1 -- 172.21.15.103:0/1070105849 >> v1:172.21.15.154:6789/0 conn(0x7f8e30006170 legacy=0x7f8e30008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:34:22.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.427+0000 7f8e52089640 1 --2- 172.21.15.103:0/1070105849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e30003690 0x7f8e30005ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:22.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.427+0000 7f8e52089640 1 -- 172.21.15.103:0/1070105849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e30003690 msgr2=0x7f8e30005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:34:22.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.427+0000 7f8e52089640 1 -- 172.21.15.103:0/1070105849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e30003690 msgr2=0x7f8e30005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:34:22.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.427+0000 7f8e52089640 1 --2- 172.21.15.103:0/1070105849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e30003690 0x7f8e30005ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:34:22.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.427+0000 7f8e52089640 1 --2- 172.21.15.103:0/1070105849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e30003690 0x7f8e30005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:34:22.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.828+0000 7f8e51888640 1 -- 172.21.15.103:0/1070105849 >> v1:172.21.15.154:6789/0 conn(0x7f8e30006170 legacy=0x7f8e30008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:34:22.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.828+0000 7f8e52089640 1 --2- 172.21.15.103:0/1070105849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e30003690 0x7f8e30005ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:22.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.828+0000 7f8e52089640 1 -- 172.21.15.103:0/1070105849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e30003690 msgr2=0x7f8e30005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:34:22.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.828+0000 7f8e52089640 1 -- 172.21.15.103:0/1070105849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e30003690 msgr2=0x7f8e30005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:34:22.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.828+0000 7f8e52089640 1 --2- 172.21.15.103:0/1070105849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e30003690 0x7f8e30005ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:34:22.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:22.828+0000 7f8e52089640 1 --2- 172.21.15.103:0/1070105849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e30003690 0x7f8e30005ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:34:23.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.629+0000 7f8e51888640 1 -- 172.21.15.103:0/1070105849 >> v1:172.21.15.154:6789/0 conn(0x7f8e30006170 legacy=0x7f8e30008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:34:23.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.629+0000 7f8e52089640 1 --2- 172.21.15.103:0/1070105849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e30003690 0x7f8e30005ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:23.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.629+0000 7f8e52089640 1 -- 172.21.15.103:0/1070105849 >> v1:172.21.15.154:6789/0 conn(0x7f8e30006170 legacy=0x7f8e30008610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:34:23.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.629+0000 7f8e52089640 1 -- 172.21.15.103:0/1070105849 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e3000b000 con 0x7f8e30003690 2024-09-10T08:34:23.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.630+0000 7f8e52089640 1 --2- 172.21.15.103:0/1070105849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e30003690 0x7f8e30005ae0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8e48009d60 tx=0x7f8e4802b1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f03bf84021624b0e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:23.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.630+0000 7f8e51087640 1 -- 172.21.15.103:0/1070105849 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48031070 con 0x7f8e30003690 2024-09-10T08:34:23.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.630+0000 7f8e51087640 1 -- 172.21.15.103:0/1070105849 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e48035410 con 0x7f8e30003690 2024-09-10T08:34:23.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.630+0000 7f8e51087640 1 -- 172.21.15.103:0/1070105849 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48035800 con 0x7f8e30003690 2024-09-10T08:34:23.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.631+0000 7f8e542ed640 1 -- 172.21.15.103:0/1070105849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e30003690 msgr2=0x7f8e30005ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:23.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.631+0000 7f8e542ed640 1 --2- 172.21.15.103:0/1070105849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e30003690 0x7f8e30005ae0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8e48009d60 tx=0x7f8e4802b1e0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.631+0000 7f8e5288a640 1 -- 172.21.15.103:0/1070105849 reap_dead start 2024-09-10T08:34:23.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.631+0000 7f8e542ed640 1 -- 172.21.15.103:0/1070105849 shutdown_connections 2024-09-10T08:34:23.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.631+0000 7f8e542ed640 1 -- 172.21.15.103:0/1070105849 >> 172.21.15.103:0/1070105849 conn(0x7f8e4c067fe0 msgr2=0x7f8e4c073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:23.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.631+0000 7f8e542ed640 1 -- 172.21.15.103:0/1070105849 shutdown_connections 2024-09-10T08:34:23.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.631+0000 7f8e542ed640 1 -- 172.21.15.103:0/1070105849 wait complete. 2024-09-10T08:34:23.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.632+0000 7f8e542ed640 1 Processor -- start 2024-09-10T08:34:23.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.633+0000 7f8e542ed640 1 -- start start 2024-09-10T08:34:23.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.633+0000 7f8e542ed640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e30003690 0x7f8e4c1e20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:23.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.633+0000 7f8e542ed640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e4c14a8e0 0x7f8e4c0c1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:23.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.633+0000 7f8e542ed640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e4c1dfbb0 0x7f8e4c149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:23.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.633+0000 7f8e542ed640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c06d2c0 con 0x7f8e30003690 2024-09-10T08:34:23.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.633+0000 7f8e542ed640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c1571f0 con 0x7f8e4c14a8e0 2024-09-10T08:34:23.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.633+0000 7f8e542ed640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8e4c06c1d0 con 0x7f8e4c1dfbb0 2024-09-10T08:34:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.633+0000 7f8e51888640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e4c14a8e0 msgr2=0x7f8e4c0c1350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:34:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.633+0000 7f8e51888640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e4c14a8e0 0x7f8e4c0c1350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:34:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.634+0000 7f8e52089640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e30003690 0x7f8e4c1e20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.634+0000 7f8e52089640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e30003690 0x7f8e4c1e20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60264/0 (socket says 172.21.15.103:60264) 2024-09-10T08:34:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.634+0000 7f8e52089640 1 -- 172.21.15.103:0/34331138 learned_addr learned my addr 172.21.15.103:0/34331138 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.634+0000 7f8e5288a640 1 --2- 172.21.15.103:0/34331138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e4c1dfbb0 0x7f8e4c149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.634+0000 7f8e52089640 1 -- 172.21.15.103:0/34331138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e4c1dfbb0 msgr2=0x7f8e4c149820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.634+0000 7f8e52089640 1 --2- 172.21.15.103:0/34331138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e4c1dfbb0 0x7f8e4c149820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.634+0000 7f8e52089640 1 -- 172.21.15.103:0/34331138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e4c14a8e0 msgr2=0x7f8e4c0c1350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:34:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.634+0000 7f8e52089640 1 --2- 172.21.15.103:0/34331138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e4c14a8e0 0x7f8e4c0c1350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.634+0000 7f8e52089640 1 -- 172.21.15.103:0/34331138 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4c14ad70 con 0x7f8e30003690 2024-09-10T08:34:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.634+0000 7f8e52089640 1 --2- 172.21.15.103:0/34331138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e30003690 0x7f8e4c1e20a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8e4802b7d0 tx=0x7f8e48005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:23.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.634+0000 7f8e42ffd640 1 -- 172.21.15.103:0/34331138 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48044070 con 0x7f8e30003690 2024-09-10T08:34:23.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.634+0000 7f8e42ffd640 1 -- 172.21.15.103:0/34331138 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e48009450 con 0x7f8e30003690 2024-09-10T08:34:23.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.634+0000 7f8e542ed640 1 -- 172.21.15.103:0/34331138 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e4c14a600 con 0x7f8e30003690 2024-09-10T08:34:23.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.634+0000 7f8e42ffd640 1 -- 172.21.15.103:0/34331138 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48034bf0 con 0x7f8e30003690 2024-09-10T08:34:23.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.634+0000 7f8e542ed640 1 -- 172.21.15.103:0/34331138 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e4c0c1890 con 0x7f8e30003690 2024-09-10T08:34:23.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.636+0000 7f8e542ed640 1 -- 172.21.15.103:0/34331138 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e4c15a3e0 con 0x7f8e30003690 2024-09-10T08:34:23.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.636+0000 7f8e42ffd640 1 -- 172.21.15.103:0/34331138 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e48047070 con 0x7f8e30003690 2024-09-10T08:34:23.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.636+0000 7f8e42ffd640 1 --2- 172.21.15.103:0/34331138 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8e3006cb30 0x7f8e3006eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:23.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.636+0000 7f8e42ffd640 1 -- 172.21.15.103:0/34331138 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f8e480abdc0 con 0x7f8e30003690 2024-09-10T08:34:23.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.636+0000 7f8e51888640 1 --2- 172.21.15.103:0/34331138 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8e3006cb30 0x7f8e3006eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:23.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.637+0000 7f8e51888640 1 --2- 172.21.15.103:0/34331138 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8e3006cb30 0x7f8e3006eff0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c14b190 tx=0x7f8e3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:23.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.641+0000 7f8e42ffd640 1 -- 172.21.15.103:0/34331138 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e48003910 con 0x7f8e30003690 2024-09-10T08:34:23.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.871+0000 7f8e542ed640 1 -- 172.21.15.103:0/34331138 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8e4c0c1b80 con 0x7f8e30003690 2024-09-10T08:34:23.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.871+0000 7f8e42ffd640 1 -- 172.21.15.103:0/34331138 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7f8e48079e10 con 0x7f8e30003690 2024-09-10T08:34:23.871 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":44,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:34:23.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.873+0000 7f8e542ed640 1 -- 172.21.15.103:0/34331138 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8e3006cb30 msgr2=0x7f8e3006eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:23.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.873+0000 7f8e542ed640 1 --2- 172.21.15.103:0/34331138 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8e3006cb30 0x7f8e3006eff0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c14b190 tx=0x7f8e3c008040 comp rx=0 tx=0).stop 2024-09-10T08:34:23.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.873+0000 7f8e542ed640 1 -- 172.21.15.103:0/34331138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e30003690 msgr2=0x7f8e4c1e20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:23.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.873+0000 7f8e542ed640 1 --2- 172.21.15.103:0/34331138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e30003690 0x7f8e4c1e20a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8e4802b7d0 tx=0x7f8e48005d40 comp rx=0 tx=0).stop 2024-09-10T08:34:23.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.873+0000 7f8e542ed640 1 -- 172.21.15.103:0/34331138 shutdown_connections 2024-09-10T08:34:23.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.873+0000 7f8e542ed640 1 --2- 172.21.15.103:0/34331138 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8e3006cb30 0x7f8e3006eff0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.873+0000 7f8e542ed640 1 --2- 172.21.15.103:0/34331138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8e4c1dfbb0 0x7f8e4c149820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.873+0000 7f8e542ed640 1 --2- 172.21.15.103:0/34331138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e4c14a8e0 0x7f8e4c0c1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.873+0000 7f8e542ed640 1 --2- 172.21.15.103:0/34331138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e30003690 0x7f8e4c1e20a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.873+0000 7f8e542ed640 1 -- 172.21.15.103:0/34331138 >> 172.21.15.103:0/34331138 conn(0x7f8e4c067fe0 msgr2=0x7f8e4c157ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:23.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.874+0000 7f8e542ed640 1 -- 172.21.15.103:0/34331138 shutdown_connections 2024-09-10T08:34:23.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.874+0000 7f8e542ed640 1 -- 172.21.15.103:0/34331138 wait complete. 2024-09-10T08:34:23.884 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-10T08:34:23.884 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-10T08:34:23.884 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:34:23.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.984+0000 7f68fc7f6640 1 Processor -- start 2024-09-10T08:34:23.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.984+0000 7f68fc7f6640 1 -- start start 2024-09-10T08:34:23.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.985+0000 7f68fc7f6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f68f4151680 0x7f68f406e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:23.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.985+0000 7f68fc7f6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f68f4154210 0x7f68f4154660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:23.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.985+0000 7f68fc7f6640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f406f060 con 0x7f68f406e920 2024-09-10T08:34:23.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.985+0000 7f68fc7f6640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f68f406fc70 con 0x7f68f4151680 2024-09-10T08:34:23.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.985+0000 7f68fc7f6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f68f406f340 con 0x7f68f4154210 2024-09-10T08:34:23.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.985+0000 7f68fad93640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7f68f4154210 msgr2=0x7f68f4154660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:34:23.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.985+0000 7f68fa592640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f68f4151680 0x7f68f406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:23.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.985+0000 7f68fad93640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f68f4154210 0x7f68f4154660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:34:23.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.985+0000 7f68f9d91640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f68f406e920 0x7f68f40ad7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:52346/0 (socket says 172.21.15.103:52346) 2024-09-10T08:34:23.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.986+0000 7f68f9d91640 1 -- 172.21.15.103:0/946178338 learned_addr learned my addr 172.21.15.103:0/946178338 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:34:23.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.986+0000 7f68fa592640 1 -- 172.21.15.103:0/946178338 >> v2:172.21.15.154:3300/0 conn(0x7f68f4154210 msgr2=0x7f68f4154660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:34:23.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.986+0000 7f68fa592640 1 --2- 172.21.15.103:0/946178338 >> v2:172.21.15.154:3300/0 conn(0x7f68f4154210 0x7f68f4154660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.986+0000 7f68fa592640 1 -- 172.21.15.103:0/946178338 >> v1:172.21.15.103:6789/0 conn(0x7f68f406e920 legacy=0x7f68f40ad7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:23.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.986+0000 7f68fa592640 1 -- 172.21.15.103:0/946178338 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f406f620 con 0x7f68f4151680 2024-09-10T08:34:23.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.986+0000 7f68f9590640 1 -- 172.21.15.103:0/946178338 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3763041035 0 0) 0x7f68f406f060 con 0x7f68f406e920 2024-09-10T08:34:23.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.987+0000 7f68fa592640 1 --2- 172.21.15.103:0/946178338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f4151680 0x7f68f406e260 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f68f406cf80 tx=0x7f68f002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e07c39f075a3f99 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:23.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.987+0000 7f68f9590640 1 -- 172.21.15.103:0/946178338 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f0037070 con 0x7f68f4151680 2024-09-10T08:34:23.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.987+0000 7f68f9590640 1 -- 172.21.15.103:0/946178338 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f0032440 con 0x7f68f4151680 2024-09-10T08:34:23.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.987+0000 7f68f9590640 1 -- 172.21.15.103:0/946178338 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f0032810 con 0x7f68f4151680 2024-09-10T08:34:23.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.988+0000 7f68fc7f6640 1 -- 172.21.15.103:0/946178338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f4151680 msgr2=0x7f68f406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:23.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.988+0000 7f68fc7f6640 1 --2- 172.21.15.103:0/946178338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f4151680 0x7f68f406e260 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f68f406cf80 tx=0x7f68f002a130 comp rx=0 tx=0).stop 2024-09-10T08:34:23.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.988+0000 7f68fc7f6640 1 -- 172.21.15.103:0/946178338 shutdown_connections 2024-09-10T08:34:23.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.988+0000 7f68fc7f6640 1 --2- 172.21.15.103:0/946178338 >> v2:172.21.15.154:3300/0 conn(0x7f68f4154210 0x7f68f4154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.988+0000 7f68fc7f6640 1 --2- 172.21.15.103:0/946178338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f4151680 0x7f68f406e260 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.988+0000 7f68fc7f6640 1 -- 172.21.15.103:0/946178338 >> 172.21.15.103:0/946178338 conn(0x7f68f40c8410 msgr2=0x7f68f40c87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:23.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.988+0000 7f68fc7f6640 1 -- 172.21.15.103:0/946178338 shutdown_connections 2024-09-10T08:34:23.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.988+0000 7f68fc7f6640 1 -- 172.21.15.103:0/946178338 wait complete. 2024-09-10T08:34:23.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.989+0000 7f68fc7f6640 1 Processor -- start 2024-09-10T08:34:23.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.989+0000 7f68fc7f6640 1 -- start start 2024-09-10T08:34:23.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.990+0000 7f68fc7f6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68f406e920 0x7f68f4071d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:23.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.990+0000 7f68fc7f6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f4151680 0x7f68f40c1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:23.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.990+0000 7f68fc7f6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f4154210 0x7f68f40c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:23.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.990+0000 7f68fc7f6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f68f40ae060 con 0x7f68f4154210 2024-09-10T08:34:23.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.990+0000 7f68fc7f6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f68f40adee0 con 0x7f68f4151680 2024-09-10T08:34:23.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.990+0000 7f68fc7f6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f68f4151a60 con 0x7f68f406e920 2024-09-10T08:34:23.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.990+0000 7f68f9d91640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f4151680 msgr2=0x7f68f40c1ab0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:34:23.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.990+0000 7f68f9d91640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f4151680 0x7f68f40c1ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:34:23.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.990+0000 7f68fad93640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f4154210 0x7f68f40c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:23.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.990+0000 7f68fad93640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f4154210 0x7f68f40c6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60288/0 (socket says 172.21.15.103:60288) 2024-09-10T08:34:23.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.990+0000 7f68fad93640 1 -- 172.21.15.103:0/2443843160 learned_addr learned my addr 172.21.15.103:0/2443843160 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:23.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.990+0000 7f68fa592640 1 --2- 172.21.15.103:0/2443843160 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68f406e920 0x7f68f4071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:23.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.990+0000 7f68fad93640 1 -- 172.21.15.103:0/2443843160 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68f406e920 msgr2=0x7f68f4071d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:23.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.990+0000 7f68fad93640 1 --2- 172.21.15.103:0/2443843160 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68f406e920 0x7f68f4071d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.990+0000 7f68fad93640 1 -- 172.21.15.103:0/2443843160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f4151680 msgr2=0x7f68f40c1ab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:34:23.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.990+0000 7f68fad93640 1 --2- 172.21.15.103:0/2443843160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f4151680 0x7f68f40c1ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.990+0000 7f68fad93640 1 -- 172.21.15.103:0/2443843160 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f41efeb0 con 0x7f68f4154210 2024-09-10T08:34:23.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.990+0000 7f68fad93640 1 --2- 172.21.15.103:0/2443843160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f4154210 0x7f68f40c6d30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00be80 tx=0x7f68ec00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:23.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.990+0000 7f68eaffd640 1 -- 172.21.15.103:0/2443843160 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec016430 con 0x7f68f4154210 2024-09-10T08:34:23.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.991+0000 7f68eaffd640 1 -- 172.21.15.103:0/2443843160 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68ec010030 con 0x7f68f4154210 2024-09-10T08:34:23.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.991+0000 7f68fc7f6640 1 -- 172.21.15.103:0/2443843160 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f41ebe80 con 0x7f68f4154210 2024-09-10T08:34:23.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.991+0000 7f68eaffd640 1 -- 172.21.15.103:0/2443843160 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec016810 con 0x7f68f4154210 2024-09-10T08:34:23.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.991+0000 7f68fc7f6640 1 -- 172.21.15.103:0/2443843160 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f40c1ff0 con 0x7f68f4154210 2024-09-10T08:34:23.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.992+0000 7f68fc7f6640 1 --2- 172.21.15.103:0/2443843160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f4148250 0x7f68f40c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:23.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.992+0000 7f68fc7f6640 1 -- 172.21.15.103:0/2443843160 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f68f41ec3a0 con 0x7f68f4148250 2024-09-10T08:34:23.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.992+0000 7f68fa592640 1 --2- 172.21.15.103:0/2443843160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f4148250 0x7f68f40c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:23.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.992+0000 7f68eaffd640 1 -- 172.21.15.103:0/2443843160 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f68ec0153e0 con 0x7f68f4154210 2024-09-10T08:34:23.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.992+0000 7f68fa592640 1 -- 172.21.15.103:0/2443843160 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68f40adab0 con 0x7f68f4148250 2024-09-10T08:34:23.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.992+0000 7f68fa592640 1 --2- 172.21.15.103:0/2443843160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f4148250 0x7f68f40c7270 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f68f40c4960 tx=0x7f68f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:23.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.993+0000 7f68eaffd640 1 --2- 172.21.15.103:0/2443843160 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f68d806bde0 0x7f68d806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:23.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.993+0000 7f68eaffd640 1 -- 172.21.15.103:0/2443843160 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f68ec08b6a0 con 0x7f68f4154210 2024-09-10T08:34:23.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.993+0000 7f68f9d91640 1 --2- 172.21.15.103:0/2443843160 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f68d806bde0 0x7f68d806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:23.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.993+0000 7f68eaffd640 1 -- 172.21.15.103:0/2443843160 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f0037040 con 0x7f68f4148250 2024-09-10T08:34:23.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.993+0000 7f68eaffd640 1 -- 172.21.15.103:0/2443843160 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f68f003c820 con 0x7f68f4148250 2024-09-10T08:34:23.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.993+0000 7f68eaffd640 1 -- 172.21.15.103:0/2443843160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f4148250 msgr2=0x7f68f40c7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:23.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.993+0000 7f68eaffd640 1 --2- 172.21.15.103:0/2443843160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f4148250 0x7f68f40c7270 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f68f40c4960 tx=0x7f68f00046c0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.993+0000 7f68eaffd640 1 -- 172.21.15.103:0/2443843160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f4148250 msgr2=0x7f68f40c7270 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:34:23.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.993+0000 7f68eaffd640 1 --2- 172.21.15.103:0/2443843160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f4148250 0x7f68f40c7270 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f68f40c4960 tx=0x7f68f00046c0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.993+0000 7f68f9d91640 1 --2- 172.21.15.103:0/2443843160 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f68d806bde0 0x7f68d806e2a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f68e4007fd0 tx=0x7f68e4007ac0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:24.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.999+0000 7f68fc7f6640 1 --2- 172.21.15.103:0/2443843160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f41471f0 0x7f68f4147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:24.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.999+0000 7f68fc7f6640 1 -- 172.21.15.103:0/2443843160 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f68f41ec680 con 0x7f68f41471f0 2024-09-10T08:34:24.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:23.999+0000 7f68fa592640 1 --2- 172.21.15.103:0/2443843160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f41471f0 0x7f68f4147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:24.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.000+0000 7f68fa592640 1 -- 172.21.15.103:0/2443843160 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f68f406e260 con 0x7f68f41471f0 2024-09-10T08:34:24.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.000+0000 7f68fa592640 1 --2- 172.21.15.103:0/2443843160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f41471f0 0x7f68f4147600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f68f0000c00 tx=0x7f68f0008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:24.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.000+0000 7f68eaffd640 1 -- 172.21.15.103:0/2443843160 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f004f070 con 0x7f68f41471f0 2024-09-10T08:34:24.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.000+0000 7f68eaffd640 1 -- 172.21.15.103:0/2443843160 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4710 (secure 0 0 0) 0x7f68f00093c0 con 0x7f68f41471f0 2024-09-10T08:34:24.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.000+0000 7f68eaffd640 1 -- 172.21.15.103:0/2443843160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f41471f0 msgr2=0x7f68f4147600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:24.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.000+0000 7f68eaffd640 1 --2- 172.21.15.103:0/2443843160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f41471f0 0x7f68f4147600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f68f0000c00 tx=0x7f68f0008030 comp rx=0 tx=0).stop 2024-09-10T08:34:24.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.000+0000 7f68eaffd640 1 -- 172.21.15.103:0/2443843160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f41471f0 msgr2=0x7f68f4147600 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:34:24.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.000+0000 7f68eaffd640 1 --2- 172.21.15.103:0/2443843160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f41471f0 0x7f68f4147600 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f68f0000c00 tx=0x7f68f0008030 comp rx=0 tx=0).stop 2024-09-10T08:34:24.003 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:34:24.003 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:34:24.003 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:34:24.003 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:34:24.003 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 44, 2024-09-10T08:34:24.003 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 34068, 2024-09-10T08:34:24.003 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:34:24.003 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:34:24.003 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:34:24.003 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:24.003 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:34:24.003 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:34:24.004 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:34:24.004 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:34:24.004 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:24.004 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:24.004 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:24.004 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:24.004 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:24.004 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:24.004 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:24.004 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:24.004 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:24.004 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:24.004 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:24.005 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:24.005 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:34:24.005 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:34:24.005 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:24.005 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:24.005 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:24.005 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:24.005 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:24.005 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:24.005 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:24.005 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:24.005 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:24.005 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:24.005 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:24.006 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:24.006 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.006 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:34:24.006 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:34:24.006 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:34:24.006 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:34:24.006 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:34:24.006 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:34:24.006 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:34:24.006 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:34:24.006 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:34:24.006 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:34:24.006 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:34:24.006 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:34:24.006 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:34:24.007 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:34:24.007 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:34:24.007 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:34:24.007 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:34:24.007 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:24.007 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:24.007 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:24.007 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:24.007 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:24.007 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:24.007 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:24.007 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:24.007 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:24.007 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:24.008 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:24.008 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:24.008 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:34:24.008 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.008 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:34:24.008 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.008 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:34:24.008 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:34:24.008 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:24.008 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:24.008 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.008 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:24.008 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:34:24.009 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:24.009 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.009 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.009 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:24.009 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:34:24.009 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:24.009 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:24.009 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:24.009 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.009 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:34:24.009 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:34:24.009 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:24.009 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:24.009 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:24.010 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.010 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.010 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:34:24.010 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:34:24.010 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:24.010 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:24.010 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.010 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:24.010 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:34:24.010 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:24.010 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.010 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.010 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:24.010 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:34:24.011 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:24.011 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:24.011 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:24.011 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.011 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:34:24.011 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:34:24.011 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:24.011 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:24.011 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:24.011 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.011 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.011 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:34:24.011 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:34:24.011 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:24.012 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:24.012 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.012 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:24.012 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:34:24.012 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:24.012 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.012 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.012 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:24.012 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:34:24.012 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:24.012 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:24.012 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:24.012 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.013 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:34:24.013 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:34:24.013 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:24.013 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:24.013 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:24.013 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:24.013 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:24.013 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.013 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:34:24.013 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:34:24.013 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.013 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:24.013 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:24.013 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:34:24.014 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:24.014 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:24.014 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:34:24.014 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.014 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:24.014 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:24.014 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:34:24.014 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:24.014 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:24.014 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:34:24.014 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.014 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:24.014 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:24.014 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:34:24.015 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:24.015 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:24.015 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.015 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:34:24.015 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:34:24.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.001+0000 7f68fc7f6640 1 -- 172.21.15.103:0/2443843160 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f68d806bde0 msgr2=0x7f68d806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:24.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.001+0000 7f68fc7f6640 1 --2- 172.21.15.103:0/2443843160 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f68d806bde0 0x7f68d806e2a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f68e4007fd0 tx=0x7f68e4007ac0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.001+0000 7f68fc7f6640 1 -- 172.21.15.103:0/2443843160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f4154210 msgr2=0x7f68f40c6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:24.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.001+0000 7f68fc7f6640 1 --2- 172.21.15.103:0/2443843160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68f4154210 0x7f68f40c6d30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00be80 tx=0x7f68ec00beb0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.001+0000 7f68fad93640 1 -- 172.21.15.103:0/2443843160 reap_dead start 2024-09-10T08:34:24.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.001+0000 7f68fad93640 1 -- 172.21.15.103:0/2443843160 reap_dead start 2024-09-10T08:34:24.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.001+0000 7f68fc7f6640 1 -- 172.21.15.103:0/2443843160 shutdown_connections 2024-09-10T08:34:24.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.001+0000 7f68fc7f6640 1 -- 172.21.15.103:0/2443843160 >> 172.21.15.103:0/2443843160 conn(0x7f68f40c8410 msgr2=0x7f68f414f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:24.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.001+0000 7f68fc7f6640 1 -- 172.21.15.103:0/2443843160 shutdown_connections 2024-09-10T08:34:24.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.001+0000 7f68fc7f6640 1 -- 172.21.15.103:0/2443843160 wait complete. 2024-09-10T08:34:24.017 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:34:24.017 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-10T08:34:24.017 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:34:24.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.117+0000 7fa6ad696640 1 Processor -- start 2024-09-10T08:34:24.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.117+0000 7fa6ad696640 1 -- start start 2024-09-10T08:34:24.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.118+0000 7fa6ad696640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6a80c55f0 0x7fa6a80ac470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:24.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.118+0000 7fa6ad696640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a80c59d0 0x7fa6a8157c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:24.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.118+0000 7fa6ad696640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6a80c3e60 con 0x7fa6a80addf0 2024-09-10T08:34:24.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.118+0000 7fa6ad696640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa6a80c8580 con 0x7fa6a80c55f0 2024-09-10T08:34:24.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.118+0000 7fa6ad696640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a80c4120 con 0x7fa6a80c59d0 2024-09-10T08:34:24.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.118+0000 7fa6a6ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6a80c55f0 0x7fa6a80ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:24.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.118+0000 7fa6a6ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa6a80c55f0 0x7fa6a80ac470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60316/0 (socket says 172.21.15.103:60316) 2024-09-10T08:34:24.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.118+0000 7fa6a67fc640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa6a80addf0 0x7fa6a80ac9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:52354/0 (socket says 172.21.15.103:52354) 2024-09-10T08:34:24.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.118+0000 7fa6a6ffd640 1 -- 172.21.15.103:0/937042732 learned_addr learned my addr 172.21.15.103:0/937042732 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:24.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.119+0000 7fa6a6ffd640 1 -- 172.21.15.103:0/937042732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a80c59d0 msgr2=0x7fa6a8157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:24.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.119+0000 7fa6a6ffd640 1 --2- 172.21.15.103:0/937042732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a80c59d0 0x7fa6a8157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.119+0000 7fa6a6ffd640 1 -- 172.21.15.103:0/937042732 >> v1:172.21.15.103:6789/0 conn(0x7fa6a80addf0 legacy=0x7fa6a80ac9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:24.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.119+0000 7fa6a6ffd640 1 -- 172.21.15.103:0/937042732 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a80c4400 con 0x7fa6a80c55f0 2024-09-10T08:34:24.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.120+0000 7fa6a6ffd640 1 --2- 172.21.15.103:0/937042732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a80c55f0 0x7fa6a80ac470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0009870 tx=0x7fa6a002a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3552865da49d6985 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:24.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.120+0000 7fa6a5ffb640 1 -- 172.21.15.103:0/937042732 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0037070 con 0x7fa6a80c55f0 2024-09-10T08:34:24.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.120+0000 7fa6a5ffb640 1 -- 172.21.15.103:0/937042732 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6a002ad60 con 0x7fa6a80c55f0 2024-09-10T08:34:24.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.120+0000 7fa6a5ffb640 1 -- 172.21.15.103:0/937042732 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0032660 con 0x7fa6a80c55f0 2024-09-10T08:34:24.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.121+0000 7fa6ad696640 1 -- 172.21.15.103:0/937042732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a80c55f0 msgr2=0x7fa6a80ac470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:24.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.121+0000 7fa6ad696640 1 --2- 172.21.15.103:0/937042732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a80c55f0 0x7fa6a80ac470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0009870 tx=0x7fa6a002a0d0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.121+0000 7fa6ad696640 1 -- 172.21.15.103:0/937042732 shutdown_connections 2024-09-10T08:34:24.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.121+0000 7fa6ad696640 1 --2- 172.21.15.103:0/937042732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a80c59d0 0x7fa6a8157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.121+0000 7fa6ad696640 1 --2- 172.21.15.103:0/937042732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a80c55f0 0x7fa6a80ac470 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.121+0000 7fa6ad696640 1 -- 172.21.15.103:0/937042732 >> 172.21.15.103:0/937042732 conn(0x7fa6a80c8a50 msgr2=0x7fa6a80c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:24.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.121+0000 7fa6ad696640 1 -- 172.21.15.103:0/937042732 shutdown_connections 2024-09-10T08:34:24.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.121+0000 7fa6ad696640 1 -- 172.21.15.103:0/937042732 wait complete. 2024-09-10T08:34:24.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.122+0000 7fa6ad696640 1 Processor -- start 2024-09-10T08:34:24.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.122+0000 7fa6ad696640 1 -- start start 2024-09-10T08:34:24.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.123+0000 7fa6ad696640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6a80addf0 0x7fa6a806f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:24.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.123+0000 7fa6ad696640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a80c55f0 0x7fa6a8150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:24.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.123+0000 7fa6ad696640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a80c59d0 0x7fa6a8151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:24.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.123+0000 7fa6ad696640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a80c35d0 con 0x7fa6a80c55f0 2024-09-10T08:34:24.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.123+0000 7fa6ad696640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a80c3450 con 0x7fa6a80addf0 2024-09-10T08:34:24.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.123+0000 7fa6ad696640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a80abb00 con 0x7fa6a80c59d0 2024-09-10T08:34:24.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.123+0000 7fa6a6ffd640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6a80addf0 msgr2=0x7fa6a806f1e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:34:24.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.123+0000 7fa6a6ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6a80addf0 0x7fa6a806f1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:34:24.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.123+0000 7fa6a67fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a80c55f0 0x7fa6a8150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:24.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.123+0000 7fa6a67fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a80c55f0 0x7fa6a8150bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60332/0 (socket says 172.21.15.103:60332) 2024-09-10T08:34:24.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.123+0000 7fa6a67fc640 1 -- 172.21.15.103:0/1910706911 learned_addr learned my addr 172.21.15.103:0/1910706911 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:24.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.123+0000 7fa6a77fe640 1 --2- 172.21.15.103:0/1910706911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a80c59d0 0x7fa6a8151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:24.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.123+0000 7fa6a67fc640 1 -- 172.21.15.103:0/1910706911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a80c59d0 msgr2=0x7fa6a8151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:24.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.123+0000 7fa6a67fc640 1 --2- 172.21.15.103:0/1910706911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a80c59d0 0x7fa6a8151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.123+0000 7fa6a67fc640 1 -- 172.21.15.103:0/1910706911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6a80addf0 msgr2=0x7fa6a806f1e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:34:24.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.123+0000 7fa6a67fc640 1 --2- 172.21.15.103:0/1910706911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6a80addf0 0x7fa6a806f1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.123+0000 7fa6a67fc640 1 -- 172.21.15.103:0/1910706911 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a8151670 con 0x7fa6a80c55f0 2024-09-10T08:34:24.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.123+0000 7fa6a67fc640 1 --2- 172.21.15.103:0/1910706911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a80c55f0 0x7fa6a8150bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa69c00c8e0 tx=0x7fa69c00cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:24.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.124+0000 7fa68f7fe640 1 -- 172.21.15.103:0/1910706911 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69c018070 con 0x7fa6a80c55f0 2024-09-10T08:34:24.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.124+0000 7fa68f7fe640 1 -- 172.21.15.103:0/1910706911 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa69c00a640 con 0x7fa6a80c55f0 2024-09-10T08:34:24.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.124+0000 7fa68f7fe640 1 -- 172.21.15.103:0/1910706911 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69c00aa30 con 0x7fa6a80c55f0 2024-09-10T08:34:24.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.124+0000 7fa6ad696640 1 -- 172.21.15.103:0/1910706911 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a81ea9e0 con 0x7fa6a80c55f0 2024-09-10T08:34:24.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.124+0000 7fa6ad696640 1 -- 172.21.15.103:0/1910706911 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a80ab3b0 con 0x7fa6a80c55f0 2024-09-10T08:34:24.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.125+0000 7fa6ad696640 1 --2- 172.21.15.103:0/1910706911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a80c0820 0x7fa6a81eddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:24.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.125+0000 7fa6ad696640 1 -- 172.21.15.103:0/1910706911 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a8069a00 con 0x7fa6a80c0820 2024-09-10T08:34:24.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.125+0000 7fa6a6ffd640 1 --2- 172.21.15.103:0/1910706911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a80c0820 0x7fa6a81eddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:24.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.125+0000 7fa68f7fe640 1 -- 172.21.15.103:0/1910706911 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa69c01b070 con 0x7fa6a80c55f0 2024-09-10T08:34:24.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.125+0000 7fa6a6ffd640 1 -- 172.21.15.103:0/1910706911 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa6a80aade0 con 0x7fa6a80c0820 2024-09-10T08:34:24.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.126+0000 7fa6a6ffd640 1 --2- 172.21.15.103:0/1910706911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a80c0820 0x7fa6a81eddf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80c64a0 tx=0x7fa6a00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:24.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.126+0000 7fa68f7fe640 1 --2- 172.21.15.103:0/1910706911 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa69406bde0 0x7fa69406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:24.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.126+0000 7fa6a77fe640 1 --2- 172.21.15.103:0/1910706911 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa69406bde0 0x7fa69406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:24.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.126+0000 7fa68f7fe640 1 -- 172.21.15.103:0/1910706911 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fa69c08a9a0 con 0x7fa6a80c55f0 2024-09-10T08:34:24.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.126+0000 7fa68f7fe640 1 -- 172.21.15.103:0/1910706911 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0042070 con 0x7fa6a80c0820 2024-09-10T08:34:24.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.126+0000 7fa68f7fe640 1 -- 172.21.15.103:0/1910706911 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa6a0032c50 con 0x7fa6a80c0820 2024-09-10T08:34:24.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.126+0000 7fa68f7fe640 1 -- 172.21.15.103:0/1910706911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a80c0820 msgr2=0x7fa6a81eddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:24.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.126+0000 7fa68f7fe640 1 --2- 172.21.15.103:0/1910706911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a80c0820 0x7fa6a81eddf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80c64a0 tx=0x7fa6a00046c0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.126+0000 7fa68f7fe640 1 -- 172.21.15.103:0/1910706911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a80c0820 msgr2=0x7fa6a81eddf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:34:24.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.126+0000 7fa68f7fe640 1 --2- 172.21.15.103:0/1910706911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a80c0820 0x7fa6a81eddf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.126+0000 7fa6a77fe640 1 --2- 172.21.15.103:0/1910706911 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa69406bde0 0x7fa69406e2a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa698006a00 tx=0x7fa698006990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:24.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.132+0000 7fa6ad696640 1 --2- 172.21.15.103:0/1910706911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a80bfe10 0x7fa6a80a8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:24.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.132+0000 7fa6ad696640 1 -- 172.21.15.103:0/1910706911 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a81ee330 con 0x7fa6a80bfe10 2024-09-10T08:34:24.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.132+0000 7fa6a6ffd640 1 --2- 172.21.15.103:0/1910706911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a80bfe10 0x7fa6a80a8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.133+0000 7fa6a6ffd640 1 -- 172.21.15.103:0/1910706911 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa6a80731d0 con 0x7fa6a80bfe10 2024-09-10T08:34:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.133+0000 7fa6a6ffd640 1 --2- 172.21.15.103:0/1910706911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a80bfe10 0x7fa6a80a8770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0000c00 tx=0x7fa6a0008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.133+0000 7fa68f7fe640 1 -- 172.21.15.103:0/1910706911 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0037040 con 0x7fa6a80bfe10 2024-09-10T08:34:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.133+0000 7fa68f7fe640 1 -- 172.21.15.103:0/1910706911 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5043 (secure 0 0 0) 0x7fa6a003c970 con 0x7fa6a80bfe10 2024-09-10T08:34:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.133+0000 7fa68f7fe640 1 -- 172.21.15.103:0/1910706911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a80bfe10 msgr2=0x7fa6a80a8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.133+0000 7fa68f7fe640 1 --2- 172.21.15.103:0/1910706911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a80bfe10 0x7fa6a80a8770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0000c00 tx=0x7fa6a0008030 comp rx=0 tx=0).stop 2024-09-10T08:34:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.133+0000 7fa68f7fe640 1 -- 172.21.15.103:0/1910706911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a80bfe10 msgr2=0x7fa6a80a8770 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:34:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.133+0000 7fa68f7fe640 1 --2- 172.21.15.103:0/1910706911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6a80bfe10 0x7fa6a80a8770 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.134 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:34:24.134 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:34:24.134 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:34:24.134 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:34:24.134 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 44, 2024-09-10T08:34:24.134 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 208292, 2024-09-10T08:34:24.134 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:34:24.134 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:34:24.135 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:34:24.135 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:24.135 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:34:24.135 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:34:24.135 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:34:24.135 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:34:24.135 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:24.135 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:24.135 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:24.135 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:24.135 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:24.135 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:24.135 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:24.136 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:24.136 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:24.136 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:24.136 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:24.136 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:24.136 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:34:24.136 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:34:24.136 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:24.136 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:24.136 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:24.136 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:24.136 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:24.137 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:24.137 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:24.137 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:24.137 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:24.137 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:24.137 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:24.137 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:24.137 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.137 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:34:24.137 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:34:24.137 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:34:24.137 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:34:24.137 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:34:24.137 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:34:24.138 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:34:24.138 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:34:24.138 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:34:24.138 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:34:24.138 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:34:24.138 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:34:24.138 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:34:24.138 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:34:24.138 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:34:24.138 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:34:24.138 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:34:24.138 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:24.138 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:24.139 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:24.139 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:24.139 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:24.139 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:24.139 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:24.139 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:24.139 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:24.139 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:24.139 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:24.139 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:24.139 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:34:24.139 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.140 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:34:24.140 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.140 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:34:24.140 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:34:24.140 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:24.140 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:24.140 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.140 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:24.140 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:34:24.140 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:24.140 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.140 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.140 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:24.141 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:34:24.141 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:24.141 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:24.141 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:24.141 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.141 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:34:24.141 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:34:24.141 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:24.141 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:24.141 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:24.141 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.141 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.141 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:34:24.141 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:34:24.142 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:24.142 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:24.142 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.142 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:24.142 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:34:24.142 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:24.142 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.142 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.142 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:24.142 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:34:24.142 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:24.142 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:24.142 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:24.143 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.143 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:34:24.143 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:34:24.143 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:24.143 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:24.143 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:24.143 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.143 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.143 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:34:24.143 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:34:24.143 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:24.143 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:24.143 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.143 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:24.144 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:34:24.144 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:24.144 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.144 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.144 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:24.144 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:34:24.144 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:24.144 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:24.144 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:24.144 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.144 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:34:24.144 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:34:24.144 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:24.145 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:24.145 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:24.145 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:24.145 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:24.145 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.145 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:34:24.145 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:34:24.145 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.145 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:24.145 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:24.145 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:34:24.145 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:24.145 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:24.145 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:34:24.146 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.146 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:24.146 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:24.146 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:34:24.146 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:24.146 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:24.146 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:34:24.146 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.146 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:24.146 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:24.146 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 8 2024-09-10T08:34:24.146 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:24.146 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:24.147 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:34:24.147 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.147 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:24.147 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:24.147 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:34:24.147 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:24.147 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:24.147 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:34:24.147 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:24.147 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:24.147 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:24.147 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:34:24.147 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:24.147 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:24.147 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:24.148 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:34:24.148 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:34:24.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.134+0000 7fa6ad696640 1 -- 172.21.15.103:0/1910706911 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa69406bde0 msgr2=0x7fa69406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:24.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.134+0000 7fa6ad696640 1 --2- 172.21.15.103:0/1910706911 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa69406bde0 0x7fa69406e2a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa698006a00 tx=0x7fa698006990 comp rx=0 tx=0).stop 2024-09-10T08:34:24.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.134+0000 7fa6ad696640 1 -- 172.21.15.103:0/1910706911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a80c55f0 msgr2=0x7fa6a8150bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:24.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.134+0000 7fa6ad696640 1 --2- 172.21.15.103:0/1910706911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6a80c55f0 0x7fa6a8150bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa69c00c8e0 tx=0x7fa69c00cda0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.134+0000 7fa6a77fe640 1 -- 172.21.15.103:0/1910706911 reap_dead start 2024-09-10T08:34:24.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.134+0000 7fa6a77fe640 1 -- 172.21.15.103:0/1910706911 reap_dead start 2024-09-10T08:34:24.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.134+0000 7fa6ad696640 1 -- 172.21.15.103:0/1910706911 shutdown_connections 2024-09-10T08:34:24.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.134+0000 7fa6ad696640 1 -- 172.21.15.103:0/1910706911 >> 172.21.15.103:0/1910706911 conn(0x7fa6a80c8a50 msgr2=0x7fa6a80c6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:24.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.134+0000 7fa6ad696640 1 -- 172.21.15.103:0/1910706911 shutdown_connections 2024-09-10T08:34:24.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:24.134+0000 7fa6ad696640 1 -- 172.21.15.103:0/1910706911 wait complete. 2024-09-10T08:34:24.150 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:34:24.150 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-10T08:34:30.278 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:34:30.281 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:34:44.151 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-10T08:34:44.151 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-10T08:34:44.151 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T08:34:44.151 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T08:34:44.154 INFO:tasks.ceph.mon.b:Started 2024-09-10T08:34:44.154 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:34:44.154 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:34:44.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.263+0000 7f95eba2e640 1 Processor -- start 2024-09-10T08:34:44.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.263+0000 7f95eba2e640 1 -- start start 2024-09-10T08:34:44.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.264+0000 7f95eba2e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95e40c8b10 0x7f95e415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:44.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.264+0000 7f95eba2e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f95e406cd80 0x7f95e41534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:44.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.264+0000 7f95eba2e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95e40c7070 con 0x7f95e4153a10 2024-09-10T08:34:44.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.264+0000 7f95eba2e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f95e406d210 con 0x7f95e406cd80 2024-09-10T08:34:44.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.264+0000 7f95eba2e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f95e40c69b0 con 0x7f95e40c8b10 2024-09-10T08:34:44.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.265+0000 7f95e97ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95e40c8b10 0x7f95e415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:44.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.265+0000 7f95e8fc9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f95e406cd80 0x7f95e41534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:44.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.265+0000 7f95e9fcb640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f95e4153a10 0x7f95e4156660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:43118/0 (socket says 172.21.15.103:43118) 2024-09-10T08:34:44.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.265+0000 7f95e9fcb640 1 -- 172.21.15.103:0/3019384219 learned_addr learned my addr 172.21.15.103:0/3019384219 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:34:44.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.265+0000 7f95e8fc9640 1 -- 172.21.15.103:0/3019384219 >> v2:172.21.15.154:3300/0 conn(0x7f95e406cd80 msgr2=0x7f95e41534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:34:44.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.265+0000 7f95e8fc9640 1 -- 172.21.15.103:0/3019384219 >> v2:172.21.15.154:3300/0 conn(0x7f95e406cd80 msgr2=0x7f95e41534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:34:44.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.265+0000 7f95e8fc9640 1 --2- 172.21.15.103:0/3019384219 >> v2:172.21.15.154:3300/0 conn(0x7f95e406cd80 0x7f95e41534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:34:44.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.265+0000 7f95e8fc9640 1 --2- 172.21.15.103:0/3019384219 >> v2:172.21.15.154:3300/0 conn(0x7f95e406cd80 0x7f95e41534d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:34:44.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.265+0000 7f95e97ca640 1 -- 172.21.15.103:0/3019384219 >> v2:172.21.15.154:3300/0 conn(0x7f95e406cd80 msgr2=0x7f95e41534d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:34:44.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.265+0000 7f95e97ca640 1 --2- 172.21.15.103:0/3019384219 >> v2:172.21.15.154:3300/0 conn(0x7f95e406cd80 0x7f95e41534d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.265+0000 7f95e97ca640 1 -- 172.21.15.103:0/3019384219 >> v1:172.21.15.154:6789/0 conn(0x7f95e4153a10 legacy=0x7f95e4156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:44.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.265+0000 7f95e97ca640 1 -- 172.21.15.103:0/3019384219 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e40c6c90 con 0x7f95e40c8b10 2024-09-10T08:34:44.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.266+0000 7f95e97ca640 1 --2- 172.21.15.103:0/3019384219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95e40c8b10 0x7f95e415a4a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f95e00097a0 tx=0x7f95e002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a50d4973026fcabc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:44.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.266+0000 7f95dbfff640 1 -- 172.21.15.103:0/3019384219 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e0037070 con 0x7f95e40c8b10 2024-09-10T08:34:44.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.266+0000 7f95dbfff640 1 -- 172.21.15.103:0/3019384219 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e002ae50 con 0x7f95e40c8b10 2024-09-10T08:34:44.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.266+0000 7f95dbfff640 1 -- 172.21.15.103:0/3019384219 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e0032660 con 0x7f95e40c8b10 2024-09-10T08:34:44.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.267+0000 7f95eba2e640 1 -- 172.21.15.103:0/3019384219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95e40c8b10 msgr2=0x7f95e415a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:44.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.267+0000 7f95eba2e640 1 --2- 172.21.15.103:0/3019384219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95e40c8b10 0x7f95e415a4a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f95e00097a0 tx=0x7f95e002a100 comp rx=0 tx=0).stop 2024-09-10T08:34:44.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.267+0000 7f95eba2e640 1 -- 172.21.15.103:0/3019384219 shutdown_connections 2024-09-10T08:34:44.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.267+0000 7f95eba2e640 1 --2- 172.21.15.103:0/3019384219 >> v2:172.21.15.154:3300/0 conn(0x7f95e406cd80 0x7f95e41534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.267+0000 7f95eba2e640 1 --2- 172.21.15.103:0/3019384219 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95e40c8b10 0x7f95e415a4a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.267+0000 7f95eba2e640 1 -- 172.21.15.103:0/3019384219 >> 172.21.15.103:0/3019384219 conn(0x7f95e40adb80 msgr2=0x7f95e40adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:44.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.267+0000 7f95eba2e640 1 -- 172.21.15.103:0/3019384219 shutdown_connections 2024-09-10T08:34:44.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.267+0000 7f95eba2e640 1 -- 172.21.15.103:0/3019384219 wait complete. 2024-09-10T08:34:44.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.268+0000 7f95eba2e640 1 Processor -- start 2024-09-10T08:34:44.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.268+0000 7f95eba2e640 1 -- start start 2024-09-10T08:34:44.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.269+0000 7f95eba2e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95e40c8b10 0x7f95e4148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:44.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.269+0000 7f95eba2e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95e4153a10 0x7f95e41ef870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:44.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.269+0000 7f95eba2e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95e4152a40 0x7f95e41efdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:44.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.269+0000 7f95eba2e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f95e4154020 con 0x7f95e4152a40 2024-09-10T08:34:44.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.269+0000 7f95eba2e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f95e4153ea0 con 0x7f95e4153a10 2024-09-10T08:34:44.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.269+0000 7f95eba2e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f95e40c8ef0 con 0x7f95e40c8b10 2024-09-10T08:34:44.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.269+0000 7f95e97ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95e40c8b10 0x7f95e4148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:44.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.269+0000 7f95e9fcb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95e4152a40 0x7f95e41efdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:44.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.269+0000 7f95e97ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95e40c8b10 0x7f95e4148d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:55678/0 (socket says 172.21.15.103:55678) 2024-09-10T08:34:44.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.269+0000 7f95e8fc9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95e4153a10 0x7f95e41ef870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:44.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.269+0000 7f95e97ca640 1 -- 172.21.15.103:0/1252522400 learned_addr learned my addr 172.21.15.103:0/1252522400 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:44.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.269+0000 7f95e8fc9640 1 -- 172.21.15.103:0/1252522400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95e4153a10 msgr2=0x7f95e41ef870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-10T08:34:44.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.269+0000 7f95e8fc9640 1 -- 172.21.15.103:0/1252522400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95e4153a10 msgr2=0x7f95e41ef870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:34:44.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.269+0000 7f95e8fc9640 1 --2- 172.21.15.103:0/1252522400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95e4153a10 0x7f95e41ef870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:34:44.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.269+0000 7f95e8fc9640 1 --2- 172.21.15.103:0/1252522400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95e4153a10 0x7f95e41ef870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:34:44.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.270+0000 7f95e97ca640 1 -- 172.21.15.103:0/1252522400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95e4153a10 msgr2=0x7f95e41ef870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:34:44.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.270+0000 7f95e97ca640 1 --2- 172.21.15.103:0/1252522400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95e4153a10 0x7f95e41ef870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.270+0000 7f95e97ca640 1 -- 172.21.15.103:0/1252522400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95e4152a40 msgr2=0x7f95e41efdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:44.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.270+0000 7f95e97ca640 1 --2- 172.21.15.103:0/1252522400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95e4152a40 0x7f95e41efdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.270+0000 7f95e97ca640 1 -- 172.21.15.103:0/1252522400 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e41e27b0 con 0x7f95e40c8b10 2024-09-10T08:34:44.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.270+0000 7f95e9fcb640 1 --2- 172.21.15.103:0/1252522400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95e4152a40 0x7f95e41efdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:34:44.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.270+0000 7f95e97ca640 1 --2- 172.21.15.103:0/1252522400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95e40c8b10 0x7f95e4148d70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f95e00098c0 tx=0x7f95e00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:44.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.270+0000 7f95d9ffb640 1 -- 172.21.15.103:0/1252522400 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e0041020 con 0x7f95e40c8b10 2024-09-10T08:34:44.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.270+0000 7f95d9ffb640 1 -- 172.21.15.103:0/1252522400 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e003c670 con 0x7f95e40c8b10 2024-09-10T08:34:44.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.270+0000 7f95d9ffb640 1 -- 172.21.15.103:0/1252522400 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e0037040 con 0x7f95e40c8b10 2024-09-10T08:34:44.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.270+0000 7f95eba2e640 1 -- 172.21.15.103:0/1252522400 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e41dfa50 con 0x7f95e40c8b10 2024-09-10T08:34:44.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.270+0000 7f95eba2e640 1 -- 172.21.15.103:0/1252522400 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e41492b0 con 0x7f95e40c8b10 2024-09-10T08:34:44.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.271+0000 7f95eba2e640 1 -- 172.21.15.103:0/1252522400 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95e41534d0 con 0x7f95e40c8b10 2024-09-10T08:34:44.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.272+0000 7f95d9ffb640 1 -- 172.21.15.103:0/1252522400 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f95e0044020 con 0x7f95e40c8b10 2024-09-10T08:34:44.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.272+0000 7f95d9ffb640 1 --2- 172.21.15.103:0/1252522400 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f95c806be30 0x7f95c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:44.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.273+0000 7f95d9ffb640 1 -- 172.21.15.103:0/1252522400 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f95e00ab830 con 0x7f95e40c8b10 2024-09-10T08:34:44.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.273+0000 7f95e8fc9640 1 --2- 172.21.15.103:0/1252522400 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f95c806be30 0x7f95c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:44.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.273+0000 7f95e8fc9640 1 --2- 172.21.15.103:0/1252522400 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f95c806be30 0x7f95c806e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f95e40ad140 tx=0x7f95d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:44.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.277+0000 7f95d9ffb640 1 -- 172.21.15.103:0/1252522400 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f95e004b030 con 0x7f95e40c8b10 2024-09-10T08:34:44.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.559+0000 7f95eba2e640 1 -- 172.21.15.103:0/1252522400 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f95e40c9d90 con 0x7f95e40c8b10 2024-09-10T08:34:44.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.560+0000 7f95d9ffb640 1 -- 172.21.15.103:0/1252522400 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f95e0079e20 con 0x7f95e40c8b10 2024-09-10T08:34:44.561 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":44,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:34:44.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.562+0000 7f95eba2e640 1 -- 172.21.15.103:0/1252522400 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f95c806be30 msgr2=0x7f95c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:44.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.562+0000 7f95eba2e640 1 --2- 172.21.15.103:0/1252522400 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f95c806be30 0x7f95c806e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f95e40ad140 tx=0x7f95d4008040 comp rx=0 tx=0).stop 2024-09-10T08:34:44.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.562+0000 7f95eba2e640 1 -- 172.21.15.103:0/1252522400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95e40c8b10 msgr2=0x7f95e4148d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:44.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.562+0000 7f95eba2e640 1 --2- 172.21.15.103:0/1252522400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95e40c8b10 0x7f95e4148d70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f95e00098c0 tx=0x7f95e00046c0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.562+0000 7f95eba2e640 1 -- 172.21.15.103:0/1252522400 shutdown_connections 2024-09-10T08:34:44.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.562+0000 7f95eba2e640 1 --2- 172.21.15.103:0/1252522400 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f95c806be30 0x7f95c806e2f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.562+0000 7f95eba2e640 1 --2- 172.21.15.103:0/1252522400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95e4152a40 0x7f95e41efdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.562+0000 7f95eba2e640 1 --2- 172.21.15.103:0/1252522400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95e4153a10 0x7f95e41ef870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.562+0000 7f95eba2e640 1 --2- 172.21.15.103:0/1252522400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95e40c8b10 0x7f95e4148d70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.562+0000 7f95eba2e640 1 -- 172.21.15.103:0/1252522400 >> 172.21.15.103:0/1252522400 conn(0x7f95e40adb80 msgr2=0x7f95e41541c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:44.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.563+0000 7f95eba2e640 1 -- 172.21.15.103:0/1252522400 shutdown_connections 2024-09-10T08:34:44.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:44.563+0000 7f95eba2e640 1 -- 172.21.15.103:0/1252522400 wait complete. 2024-09-10T08:34:47.576 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:34:47.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.687+0000 7f3184931640 1 Processor -- start 2024-09-10T08:34:47.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.687+0000 7f3184931640 1 -- start start 2024-09-10T08:34:47.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.688+0000 7f3184931640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 0x7f318015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:47.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.688+0000 7f3184931640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 0x7f31801534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:47.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.688+0000 7f3184931640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31800c7070 con 0x7f3180153a10 2024-09-10T08:34:47.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.688+0000 7f3184931640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f318006d210 con 0x7f31800c8b10 2024-09-10T08:34:47.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.688+0000 7f3184931640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f31800c69b0 con 0x7f318006cd80 2024-09-10T08:34:47.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.688+0000 7f317e59c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 0x7f318015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:47.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.688+0000 7f317e59c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 0x7f318015a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43720/0 (socket says 172.21.15.103:43720) 2024-09-10T08:34:47.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.688+0000 7f317e59c640 1 -- 172.21.15.103:0/2682029804 learned_addr learned my addr 172.21.15.103:0/2682029804 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:47.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.688+0000 7f3177fff640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 0x7f31801534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:47.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.688+0000 7f317e59c640 1 -- 172.21.15.103:0/2682029804 >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 msgr2=0x7f318015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:34:47.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.688+0000 7f317e59c640 1 -- 172.21.15.103:0/2682029804 >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 msgr2=0x7f318015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:34:47.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.688+0000 7f317e59c640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 0x7f318015a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:34:47.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.688+0000 7f317e59c640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 0x7f318015a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:34:47.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.688+0000 7f3177fff640 1 -- 172.21.15.103:0/2682029804 >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 msgr2=0x7f31801534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:34:47.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.688+0000 7f3177fff640 1 -- 172.21.15.103:0/2682029804 >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 msgr2=0x7f31801534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:34:47.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.688+0000 7f3177fff640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 0x7f31801534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:34:47.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.688+0000 7f3177fff640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 0x7f31801534d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:34:47.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.889+0000 7f317e59c640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 0x7f318015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:47.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.889+0000 7f3177fff640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 0x7f31801534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:47.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.889+0000 7f317e59c640 1 -- 172.21.15.103:0/2682029804 >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 msgr2=0x7f318015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:34:47.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.889+0000 7f317e59c640 1 -- 172.21.15.103:0/2682029804 >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 msgr2=0x7f318015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:34:47.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.889+0000 7f317e59c640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 0x7f318015a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:34:47.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.889+0000 7f317e59c640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 0x7f318015a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:34:47.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.889+0000 7f3177fff640 1 -- 172.21.15.103:0/2682029804 >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 msgr2=0x7f31801534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:34:47.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.889+0000 7f3177fff640 1 -- 172.21.15.103:0/2682029804 >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 msgr2=0x7f31801534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:34:47.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.889+0000 7f3177fff640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 0x7f31801534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:34:47.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:47.889+0000 7f3177fff640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 0x7f31801534d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:34:48.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:48.290+0000 7f317e59c640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 0x7f318015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:48.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:48.290+0000 7f3177fff640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 0x7f31801534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:48.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:48.290+0000 7f317e59c640 1 -- 172.21.15.103:0/2682029804 >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 msgr2=0x7f318015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:34:48.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:48.290+0000 7f317e59c640 1 -- 172.21.15.103:0/2682029804 >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 msgr2=0x7f318015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:34:48.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:48.290+0000 7f317e59c640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 0x7f318015a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:34:48.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:48.290+0000 7f317e59c640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 0x7f318015a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:34:48.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:48.290+0000 7f3177fff640 1 -- 172.21.15.103:0/2682029804 >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 msgr2=0x7f31801534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:34:48.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:48.290+0000 7f3177fff640 1 -- 172.21.15.103:0/2682029804 >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 msgr2=0x7f31801534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:34:48.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:48.290+0000 7f3177fff640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 0x7f31801534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:34:48.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:48.290+0000 7f3177fff640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 0x7f31801534d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:34:49.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.091+0000 7f317e59c640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 0x7f318015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:49.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.091+0000 7f3177fff640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 0x7f31801534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:49.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.091+0000 7f317e59c640 1 -- 172.21.15.103:0/2682029804 >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 msgr2=0x7f318015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:34:49.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.091+0000 7f317e59c640 1 -- 172.21.15.103:0/2682029804 >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 msgr2=0x7f318015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:34:49.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.091+0000 7f317e59c640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 0x7f318015a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:34:49.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.091+0000 7f317e59c640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 0x7f318015a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:34:49.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.091+0000 7f3177fff640 1 -- 172.21.15.103:0/2682029804 >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 msgr2=0x7f31801534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:34:49.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.091+0000 7f3177fff640 1 -- 172.21.15.103:0/2682029804 >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 msgr2=0x7f31801534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:34:49.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.091+0000 7f3177fff640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 0x7f31801534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:34:49.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.091+0000 7f3177fff640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 0x7f31801534d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:34:49.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.883+0000 7f317dd9b640 1 -- 172.21.15.103:0/2682029804 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 715525200 0 0) 0x7f31800c7070 con 0x7f3180153a10 2024-09-10T08:34:49.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.883+0000 7f317dd9b640 1 -- 172.21.15.103:0/2682029804 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f316c003520 con 0x7f3180153a10 2024-09-10T08:34:49.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.883+0000 7f317dd9b640 1 -- 172.21.15.103:0/2682029804 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1188328805 0 0) 0x7f316c003520 con 0x7f3180153a10 2024-09-10T08:34:49.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.883+0000 7f317dd9b640 1 -- 172.21.15.103:0/2682029804 >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 msgr2=0x7f31801534d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:34:49.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.883+0000 7f317dd9b640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.154:3300/0 conn(0x7f318006cd80 0x7f31801534d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:49.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.883+0000 7f317dd9b640 1 -- 172.21.15.103:0/2682029804 >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 msgr2=0x7f318015a4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:34:49.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.883+0000 7f317dd9b640 1 --2- 172.21.15.103:0/2682029804 >> v2:172.21.15.103:3300/0 conn(0x7f31800c8b10 0x7f318015a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:49.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.883+0000 7f317dd9b640 1 -- 172.21.15.103:0/2682029804 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31800c6c90 con 0x7f3180153a10 2024-09-10T08:34:49.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.883+0000 7f317dd9b640 1 -- 172.21.15.103:0/2682029804 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f31780019f0 con 0x7f3180153a10 2024-09-10T08:34:49.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.883+0000 7f317dd9b640 1 -- 172.21.15.103:0/2682029804 >> v1:172.21.15.154:6789/0 conn(0x7f3180153a10 legacy=0x7f3180156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:49.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.883+0000 7f317dd9b640 1 --2- 172.21.15.103:0/2682029804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316c0039b0 0x7f316c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:49.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.883+0000 7f317dd9b640 1 --2- 172.21.15.103:0/2682029804 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f316c004800 0x7f316c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:49.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.883+0000 7f317dd9b640 1 --2- 172.21.15.103:0/2682029804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f316c0051c0 0x7f316c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:49.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.883+0000 7f317dd9b640 1 -- 172.21.15.103:0/2682029804 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f318006d210 con 0x7f316c0051c0 2024-09-10T08:34:49.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.883+0000 7f317dd9b640 1 -- 172.21.15.103:0/2682029804 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f31800c69b0 con 0x7f316c0039b0 2024-09-10T08:34:49.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.883+0000 7f317dd9b640 1 -- 172.21.15.103:0/2682029804 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f316c00c170 con 0x7f316c004800 2024-09-10T08:34:49.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.884+0000 7f317e59c640 1 --2- 172.21.15.103:0/2682029804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316c0039b0 0x7f316c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:49.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.884+0000 7f3177fff640 1 --2- 172.21.15.103:0/2682029804 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f316c004800 0x7f316c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:49.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.884+0000 7f317e59c640 1 -- 172.21.15.103:0/2682029804 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f316c004800 msgr2=0x7f316c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:49.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.884+0000 7f317e59c640 1 --2- 172.21.15.103:0/2682029804 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f316c004800 0x7f316c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:49.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.884+0000 7f317e59c640 1 -- 172.21.15.103:0/2682029804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f316c0051c0 msgr2=0x7f316c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:49.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.884+0000 7f317e59c640 1 --2- 172.21.15.103:0/2682029804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f316c0051c0 0x7f316c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:49.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.884+0000 7f317ed9d640 1 -- 172.21.15.103:0/2682029804 reap_dead start 2024-09-10T08:34:49.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.884+0000 7f317e59c640 1 -- 172.21.15.103:0/2682029804 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316c003520 con 0x7f316c0039b0 2024-09-10T08:34:49.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.885+0000 7f317e59c640 1 --2- 172.21.15.103:0/2682029804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316c0039b0 0x7f316c003dd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f31700129f0 tx=0x7f316c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acf6c5984674a48b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:49.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.885+0000 7f317dd9b640 1 -- 172.21.15.103:0/2682029804 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3170031070 con 0x7f316c0039b0 2024-09-10T08:34:49.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.885+0000 7f317dd9b640 1 -- 172.21.15.103:0/2682029804 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f317002b920 con 0x7f316c0039b0 2024-09-10T08:34:49.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.885+0000 7f317dd9b640 1 -- 172.21.15.103:0/2682029804 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317000f040 con 0x7f316c0039b0 2024-09-10T08:34:49.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.886+0000 7f3184931640 1 -- 172.21.15.103:0/2682029804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316c0039b0 msgr2=0x7f316c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:49.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.886+0000 7f3184931640 1 --2- 172.21.15.103:0/2682029804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316c0039b0 0x7f316c003dd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f31700129f0 tx=0x7f316c005830 comp rx=0 tx=0).stop 2024-09-10T08:34:49.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.886+0000 7f3184931640 1 -- 172.21.15.103:0/2682029804 shutdown_connections 2024-09-10T08:34:49.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.886+0000 7f3184931640 1 --2- 172.21.15.103:0/2682029804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316c0039b0 0x7f316c003dd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:49.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.886+0000 7f3184931640 1 -- 172.21.15.103:0/2682029804 >> 172.21.15.103:0/2682029804 conn(0x7f31800adb80 msgr2=0x7f31800adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:49.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.886+0000 7f3184931640 1 -- 172.21.15.103:0/2682029804 shutdown_connections 2024-09-10T08:34:49.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.886+0000 7f3184931640 1 -- 172.21.15.103:0/2682029804 wait complete. 2024-09-10T08:34:49.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.888+0000 7f3184931640 1 Processor -- start 2024-09-10T08:34:49.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.888+0000 7f3184931640 1 -- start start 2024-09-10T08:34:49.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.889+0000 7f3184931640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316c0039b0 0x7f318014c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:49.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.889+0000 7f3184931640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f318014cbc0 0x7f31800abf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:49.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.889+0000 7f3184931640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31800ac4d0 0x7f31800afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:49.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.889+0000 7f3184931640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3180154020 con 0x7f31800ac4d0 2024-09-10T08:34:49.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.889+0000 7f3184931640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3180153ea0 con 0x7f316c0039b0 2024-09-10T08:34:49.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.889+0000 7f3184931640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f31800c8ef0 con 0x7f318014cbc0 2024-09-10T08:34:49.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.889+0000 7f317ed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31800ac4d0 0x7f31800afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:49.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.889+0000 7f317ed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31800ac4d0 0x7f31800afda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43768/0 (socket says 172.21.15.103:43768) 2024-09-10T08:34:49.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.889+0000 7f317ed9d640 1 -- 172.21.15.103:0/4077780603 learned_addr learned my addr 172.21.15.103:0/4077780603 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:49.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.889+0000 7f317e59c640 1 --2- 172.21.15.103:0/4077780603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316c0039b0 0x7f318014c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:49.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.890+0000 7f3177fff640 1 --2- 172.21.15.103:0/4077780603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f318014cbc0 0x7f31800abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:49.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.890+0000 7f317ed9d640 1 -- 172.21.15.103:0/4077780603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f318014cbc0 msgr2=0x7f31800abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:49.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.890+0000 7f317ed9d640 1 --2- 172.21.15.103:0/4077780603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f318014cbc0 0x7f31800abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.890+0000 7f317ed9d640 1 -- 172.21.15.103:0/4077780603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316c0039b0 msgr2=0x7f318014c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.890+0000 7f317ed9d640 1 --2- 172.21.15.103:0/4077780603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316c0039b0 0x7f318014c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.890+0000 7f317ed9d640 1 -- 172.21.15.103:0/4077780603 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31801eca40 con 0x7f31800ac4d0 2024-09-10T08:34:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.890+0000 7f317ed9d640 1 --2- 172.21.15.103:0/4077780603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31800ac4d0 0x7f31800afda0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f31780012e0 tx=0x7f317800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.890+0000 7f3176ffd640 1 -- 172.21.15.103:0/4077780603 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178017070 con 0x7f31800ac4d0 2024-09-10T08:34:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.890+0000 7f3176ffd640 1 -- 172.21.15.103:0/4077780603 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f317800a5b0 con 0x7f31800ac4d0 2024-09-10T08:34:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.890+0000 7f3176ffd640 1 -- 172.21.15.103:0/4077780603 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317800cea0 con 0x7f31800ac4d0 2024-09-10T08:34:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.890+0000 7f3184931640 1 -- 172.21.15.103:0/4077780603 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31801ecd20 con 0x7f31800ac4d0 2024-09-10T08:34:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.890+0000 7f3184931640 1 -- 172.21.15.103:0/4077780603 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31800b11e0 con 0x7f31800ac4d0 2024-09-10T08:34:49.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.892+0000 7f3184931640 1 -- 172.21.15.103:0/4077780603 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31801534d0 con 0x7f31800ac4d0 2024-09-10T08:34:49.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.892+0000 7f3176ffd640 1 -- 172.21.15.103:0/4077780603 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f317801a070 con 0x7f31800ac4d0 2024-09-10T08:34:49.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.893+0000 7f3176ffd640 1 --2- 172.21.15.103:0/4077780603 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f316006be60 0x7f316006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:49.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.893+0000 7f3176ffd640 1 -- 172.21.15.103:0/4077780603 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f317808a610 con 0x7f31800ac4d0 2024-09-10T08:34:49.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.893+0000 7f317e59c640 1 --2- 172.21.15.103:0/4077780603 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f316006be60 0x7f316006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:49.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.894+0000 7f317e59c640 1 --2- 172.21.15.103:0/4077780603 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f316006be60 0x7f316006e320 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3170036000 tx=0x7f3170031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:49.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:49.898+0000 7f3176ffd640 1 -- 172.21.15.103:0/4077780603 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3178058cb0 con 0x7f31800ac4d0 2024-09-10T08:34:50.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.167+0000 7f3184931640 1 -- 172.21.15.103:0/4077780603 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f31800b2160 con 0x7f31800ac4d0 2024-09-10T08:34:50.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.168+0000 7f3176ffd640 1 -- 172.21.15.103:0/4077780603 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f31780585b0 con 0x7f31800ac4d0 2024-09-10T08:34:50.169 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:34:50.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.170+0000 7f3184931640 1 -- 172.21.15.103:0/4077780603 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f316006be60 msgr2=0x7f316006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.170+0000 7f3184931640 1 --2- 172.21.15.103:0/4077780603 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f316006be60 0x7f316006e320 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3170036000 tx=0x7f3170031000 comp rx=0 tx=0).stop 2024-09-10T08:34:50.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.170+0000 7f3184931640 1 -- 172.21.15.103:0/4077780603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31800ac4d0 msgr2=0x7f31800afda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.170+0000 7f3184931640 1 --2- 172.21.15.103:0/4077780603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31800ac4d0 0x7f31800afda0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f31780012e0 tx=0x7f317800cc50 comp rx=0 tx=0).stop 2024-09-10T08:34:50.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.170+0000 7f3184931640 1 -- 172.21.15.103:0/4077780603 shutdown_connections 2024-09-10T08:34:50.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.170+0000 7f3184931640 1 --2- 172.21.15.103:0/4077780603 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f316006be60 0x7f316006e320 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.170+0000 7f3184931640 1 --2- 172.21.15.103:0/4077780603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31800ac4d0 0x7f31800afda0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.170+0000 7f3184931640 1 --2- 172.21.15.103:0/4077780603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f318014cbc0 0x7f31800abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.170+0000 7f3184931640 1 --2- 172.21.15.103:0/4077780603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316c0039b0 0x7f318014c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.170+0000 7f3184931640 1 -- 172.21.15.103:0/4077780603 >> 172.21.15.103:0/4077780603 conn(0x7f31800adb80 msgr2=0x7f31800cbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:50.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.170+0000 7f3184931640 1 -- 172.21.15.103:0/4077780603 shutdown_connections 2024-09-10T08:34:50.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.170+0000 7f3184931640 1 -- 172.21.15.103:0/4077780603 wait complete. 2024-09-10T08:34:50.182 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:34:50.182 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:34:50.184 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:34:50.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.299+0000 7efc4c0d0640 1 Processor -- start 2024-09-10T08:34:50.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.299+0000 7efc4c0d0640 1 -- start start 2024-09-10T08:34:50.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.300+0000 7efc4c0d0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efc44073ae0 0x7efc44153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.300+0000 7efc4c0d0640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efc44156f50 0x7efc441538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.300+0000 7efc4c0d0640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc4406dd50 con 0x7efc440733d0 2024-09-10T08:34:50.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.300+0000 7efc4c0d0640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7efc4406e030 con 0x7efc44156f50 2024-09-10T08:34:50.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.300+0000 7efc4c0d0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7efc4406e310 con 0x7efc44073ae0 2024-09-10T08:34:50.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.300+0000 7efc4a66d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efc44156f50 0x7efc441538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.300+0000 7efc4a66d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efc44156f50 0x7efc441538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43784/0 (socket says 172.21.15.103:43784) 2024-09-10T08:34:50.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.300+0000 7efc4966b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7efc440733d0 0x7efc44156840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39894/0 (socket says 172.21.15.103:39894) 2024-09-10T08:34:50.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.300+0000 7efc4a66d640 1 -- 172.21.15.103:0/2082088569 learned_addr learned my addr 172.21.15.103:0/2082088569 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:50.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.300+0000 7efc49e6c640 1 --2- 172.21.15.103:0/2082088569 >> v2:172.21.15.154:3300/0 conn(0x7efc44073ae0 0x7efc44153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.301+0000 7efc4a66d640 1 -- 172.21.15.103:0/2082088569 >> v2:172.21.15.154:3300/0 conn(0x7efc44073ae0 msgr2=0x7efc44153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:50.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.301+0000 7efc4a66d640 1 --2- 172.21.15.103:0/2082088569 >> v2:172.21.15.154:3300/0 conn(0x7efc44073ae0 0x7efc44153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.301+0000 7efc48e6a640 1 -- 172.21.15.103:0/2082088569 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4273486899 0 0) 0x7efc4406dd50 con 0x7efc440733d0 2024-09-10T08:34:50.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.301+0000 7efc4a66d640 1 -- 172.21.15.103:0/2082088569 >> v1:172.21.15.103:6789/0 conn(0x7efc440733d0 legacy=0x7efc44156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.301+0000 7efc4a66d640 1 -- 172.21.15.103:0/2082088569 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc4406e5f0 con 0x7efc44156f50 2024-09-10T08:34:50.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.301+0000 7efc4a66d640 1 --2- 172.21.15.103:0/2082088569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc44156f50 0x7efc441538c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc44076720 tx=0x7efc3c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66a0f6be090360e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:50.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.302+0000 7efc48e6a640 1 -- 172.21.15.103:0/2082088569 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3c036070 con 0x7efc44156f50 2024-09-10T08:34:50.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.302+0000 7efc48e6a640 1 -- 172.21.15.103:0/2082088569 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc3c031600 con 0x7efc44156f50 2024-09-10T08:34:50.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.302+0000 7efc48e6a640 1 -- 172.21.15.103:0/2082088569 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3c0319d0 con 0x7efc44156f50 2024-09-10T08:34:50.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.302+0000 7efc4c0d0640 1 -- 172.21.15.103:0/2082088569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc44156f50 msgr2=0x7efc441538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.302+0000 7efc4c0d0640 1 --2- 172.21.15.103:0/2082088569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc44156f50 0x7efc441538c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc44076720 tx=0x7efc3c02a730 comp rx=0 tx=0).stop 2024-09-10T08:34:50.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.302+0000 7efc4c0d0640 1 -- 172.21.15.103:0/2082088569 shutdown_connections 2024-09-10T08:34:50.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.302+0000 7efc4c0d0640 1 --2- 172.21.15.103:0/2082088569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc44156f50 0x7efc441538c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.302+0000 7efc4c0d0640 1 --2- 172.21.15.103:0/2082088569 >> v2:172.21.15.154:3300/0 conn(0x7efc44073ae0 0x7efc44153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.302+0000 7efc4c0d0640 1 -- 172.21.15.103:0/2082088569 >> 172.21.15.103:0/2082088569 conn(0x7efc440c9d80 msgr2=0x7efc440ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:50.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.302+0000 7efc4c0d0640 1 -- 172.21.15.103:0/2082088569 shutdown_connections 2024-09-10T08:34:50.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.302+0000 7efc4c0d0640 1 -- 172.21.15.103:0/2082088569 wait complete. 2024-09-10T08:34:50.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.304+0000 7efc4c0d0640 1 Processor -- start 2024-09-10T08:34:50.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.304+0000 7efc4c0d0640 1 -- start start 2024-09-10T08:34:50.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.304+0000 7efc4c0d0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efc440733d0 0x7efc4414c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.304+0000 7efc4c0d0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc44073ae0 0x7efc44147f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.304+0000 7efc4c0d0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc44156f50 0x7efc441499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.304+0000 7efc4c0d0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efc4406edd0 con 0x7efc44156f50 2024-09-10T08:34:50.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.304+0000 7efc4c0d0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efc4406ec50 con 0x7efc44073ae0 2024-09-10T08:34:50.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.304+0000 7efc4c0d0640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7efc44073ec0 con 0x7efc440733d0 2024-09-10T08:34:50.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.304+0000 7efc4a66d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc44156f50 0x7efc441499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.304+0000 7efc4a66d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc44156f50 0x7efc441499f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43786/0 (socket says 172.21.15.103:43786) 2024-09-10T08:34:50.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.305+0000 7efc4a66d640 1 -- 172.21.15.103:0/1612813282 learned_addr learned my addr 172.21.15.103:0/1612813282 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:50.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.305+0000 7efc4966b640 1 --2- 172.21.15.103:0/1612813282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc44073ae0 0x7efc44147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.305+0000 7efc49e6c640 1 --2- 172.21.15.103:0/1612813282 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efc440733d0 0x7efc4414c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.305+0000 7efc4a66d640 1 -- 172.21.15.103:0/1612813282 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efc440733d0 msgr2=0x7efc4414c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.305+0000 7efc4a66d640 1 --2- 172.21.15.103:0/1612813282 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efc440733d0 0x7efc4414c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.305+0000 7efc4a66d640 1 -- 172.21.15.103:0/1612813282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc44073ae0 msgr2=0x7efc44147f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.305+0000 7efc4a66d640 1 --2- 172.21.15.103:0/1612813282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc44073ae0 0x7efc44147f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.305+0000 7efc4a66d640 1 -- 172.21.15.103:0/1612813282 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc44146b50 con 0x7efc44156f50 2024-09-10T08:34:50.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.305+0000 7efc4a66d640 1 --2- 172.21.15.103:0/1612813282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc44156f50 0x7efc441499f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009f40 tx=0x7efc3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:50.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.305+0000 7efc3a7fc640 1 -- 172.21.15.103:0/1612813282 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3c036050 con 0x7efc44156f50 2024-09-10T08:34:50.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.305+0000 7efc3a7fc640 1 -- 172.21.15.103:0/1612813282 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc3c042070 con 0x7efc44156f50 2024-09-10T08:34:50.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.305+0000 7efc4c0d0640 1 -- 172.21.15.103:0/1612813282 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc4414c6d0 con 0x7efc44156f50 2024-09-10T08:34:50.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.305+0000 7efc3a7fc640 1 -- 172.21.15.103:0/1612813282 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3c009510 con 0x7efc44156f50 2024-09-10T08:34:50.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.305+0000 7efc4c0d0640 1 -- 172.21.15.103:0/1612813282 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc441470d0 con 0x7efc44156f50 2024-09-10T08:34:50.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.306+0000 7efc4c0d0640 1 --2- 172.21.15.103:0/1612813282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc44149f30 0x7efc4414a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.306+0000 7efc4c0d0640 1 -- 172.21.15.103:0/1612813282 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efc440c5ba0 con 0x7efc44149f30 2024-09-10T08:34:50.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.306+0000 7efc49e6c640 1 --2- 172.21.15.103:0/1612813282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc44149f30 0x7efc4414a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.307+0000 7efc49e6c640 1 -- 172.21.15.103:0/1612813282 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efc4406d850 con 0x7efc44149f30 2024-09-10T08:34:50.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.307+0000 7efc3a7fc640 1 -- 172.21.15.103:0/1612813282 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc3c007bf0 con 0x7efc44156f50 2024-09-10T08:34:50.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.307+0000 7efc49e6c640 1 --2- 172.21.15.103:0/1612813282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc44149f30 0x7efc4414a830 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efc400118e0 tx=0x7efc40011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:50.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.307+0000 7efc3a7fc640 1 --2- 172.21.15.103:0/1612813282 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efc2806be30 0x7efc2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.308+0000 7efc4966b640 1 --2- 172.21.15.103:0/1612813282 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efc2806be30 0x7efc2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.308+0000 7efc3a7fc640 1 -- 172.21.15.103:0/1612813282 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7efc3c0abd90 con 0x7efc44156f50 2024-09-10T08:34:50.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.308+0000 7efc3a7fc640 1 -- 172.21.15.103:0/1612813282 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc40019070 con 0x7efc44149f30 2024-09-10T08:34:50.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.308+0000 7efc3a7fc640 1 -- 172.21.15.103:0/1612813282 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7efc40004300 con 0x7efc44149f30 2024-09-10T08:34:50.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.308+0000 7efc3a7fc640 1 -- 172.21.15.103:0/1612813282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc44149f30 msgr2=0x7efc4414a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.308+0000 7efc3a7fc640 1 --2- 172.21.15.103:0/1612813282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc44149f30 0x7efc4414a830 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efc400118e0 tx=0x7efc40011da0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.308+0000 7efc3a7fc640 1 -- 172.21.15.103:0/1612813282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc44149f30 msgr2=0x7efc4414a830 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:34:50.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.308+0000 7efc3a7fc640 1 --2- 172.21.15.103:0/1612813282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc44149f30 0x7efc4414a830 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efc400118e0 tx=0x7efc40011da0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.308+0000 7efc4966b640 1 --2- 172.21.15.103:0/1612813282 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efc2806be30 0x7efc2806e2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efc441495b0 tx=0x7efc34007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:50.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.315+0000 7efc4c0d0640 1 --2- 172.21.15.103:0/1612813282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc4414ad70 0x7efc441eed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.315+0000 7efc4c0d0640 1 -- 172.21.15.103:0/1612813282 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efc44155130 con 0x7efc4414ad70 2024-09-10T08:34:50.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.315+0000 7efc49e6c640 1 --2- 172.21.15.103:0/1612813282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc4414ad70 0x7efc441eed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.316+0000 7efc49e6c640 1 -- 172.21.15.103:0/1612813282 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efc44154e50 con 0x7efc4414ad70 2024-09-10T08:34:50.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.316+0000 7efc49e6c640 1 --2- 172.21.15.103:0/1612813282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc4414ad70 0x7efc441eed70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efc400118e0 tx=0x7efc400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:50.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.316+0000 7efc3a7fc640 1 -- 172.21.15.103:0/1612813282 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc40019040 con 0x7efc4414ad70 2024-09-10T08:34:50.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.316+0000 7efc3a7fc640 1 -- 172.21.15.103:0/1612813282 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4721 (secure 0 0 0) 0x7efc40003da0 con 0x7efc4414ad70 2024-09-10T08:34:50.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.316+0000 7efc3a7fc640 1 -- 172.21.15.103:0/1612813282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc4414ad70 msgr2=0x7efc441eed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.316+0000 7efc3a7fc640 1 --2- 172.21.15.103:0/1612813282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc4414ad70 0x7efc441eed70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efc400118e0 tx=0x7efc400046c0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.316+0000 7efc3a7fc640 1 -- 172.21.15.103:0/1612813282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc4414ad70 msgr2=0x7efc441eed70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:34:50.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.316+0000 7efc3a7fc640 1 --2- 172.21.15.103:0/1612813282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc4414ad70 0x7efc441eed70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.318 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:34:50.318 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:34:50.319 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:34:50.319 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:34:50.319 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 52, 2024-09-10T08:34:50.319 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 60384, 2024-09-10T08:34:50.319 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:34:50.319 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:34:50.319 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:34:50.319 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:34:50.319 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:50.319 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:34:50.320 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:34:50.320 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:34:50.320 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:34:50.320 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:50.320 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:50.320 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:50.320 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:50.320 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:50.320 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:50.320 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:50.321 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:50.321 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:50.321 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:50.321 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:50.321 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:50.321 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:34:50.321 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:34:50.321 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:50.321 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:50.321 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:50.321 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:50.322 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:50.322 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:50.322 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:50.322 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:50.322 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:50.322 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:50.322 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:50.322 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:50.322 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.322 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:34:50.322 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:34:50.323 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:34:50.323 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:34:50.323 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:34:50.323 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:34:50.323 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:34:50.323 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:34:50.323 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:34:50.323 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:34:50.323 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:34:50.324 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:34:50.324 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:34:50.324 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:34:50.324 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:34:50.324 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:34:50.324 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:34:50.324 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:50.324 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:50.324 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:50.324 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:50.324 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:50.324 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:50.324 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:50.325 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:50.325 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:50.325 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:50.325 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:50.325 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:50.325 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:34:50.325 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.325 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:34:50.325 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.325 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:34:50.325 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:34:50.325 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:50.325 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:50.326 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.326 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:50.326 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:34:50.326 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:50.326 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.326 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.326 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:50.326 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:34:50.326 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:50.326 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:50.326 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:50.326 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.326 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:34:50.327 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:34:50.327 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:50.327 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:50.327 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:50.327 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.327 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.327 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:34:50.327 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:34:50.327 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:50.327 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:50.327 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.327 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:50.327 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:34:50.328 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:50.328 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.328 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.328 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:50.328 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:34:50.328 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:50.328 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:50.328 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:50.328 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.328 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:34:50.328 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:34:50.328 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:50.328 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:50.329 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:50.329 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.329 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.329 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:34:50.329 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:34:50.329 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:50.329 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:50.329 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.329 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:50.329 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:34:50.329 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:50.329 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.329 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.330 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:50.330 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:34:50.330 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:50.330 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:50.330 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:50.330 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.330 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:34:50.330 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:34:50.330 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:50.330 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:50.330 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:50.330 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:50.331 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:50.331 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.331 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:34:50.331 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:34:50.331 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.331 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:50.331 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:50.331 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:34:50.331 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:50.331 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:50.331 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:34:50.331 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.331 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:50.331 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:50.332 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:34:50.332 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:50.332 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:50.332 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:34:50.332 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.332 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:50.332 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:50.332 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:34:50.332 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:50.332 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:50.332 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.332 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:34:50.333 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:34:50.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.317+0000 7efc4c0d0640 1 -- 172.21.15.103:0/1612813282 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efc2806be30 msgr2=0x7efc2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.317+0000 7efc4c0d0640 1 --2- 172.21.15.103:0/1612813282 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efc2806be30 0x7efc2806e2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efc441495b0 tx=0x7efc34007d50 comp rx=0 tx=0).stop 2024-09-10T08:34:50.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.317+0000 7efc4c0d0640 1 -- 172.21.15.103:0/1612813282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc44156f50 msgr2=0x7efc441499f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.317+0000 7efc4c0d0640 1 --2- 172.21.15.103:0/1612813282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc44156f50 0x7efc441499f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009f40 tx=0x7efc3c004a40 comp rx=0 tx=0).stop 2024-09-10T08:34:50.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.317+0000 7efc4a66d640 1 -- 172.21.15.103:0/1612813282 reap_dead start 2024-09-10T08:34:50.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.317+0000 7efc4a66d640 1 -- 172.21.15.103:0/1612813282 reap_dead start 2024-09-10T08:34:50.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.317+0000 7efc4c0d0640 1 -- 172.21.15.103:0/1612813282 shutdown_connections 2024-09-10T08:34:50.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.317+0000 7efc4c0d0640 1 -- 172.21.15.103:0/1612813282 >> 172.21.15.103:0/1612813282 conn(0x7efc440c9d80 msgr2=0x7efc44154080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:50.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.317+0000 7efc4c0d0640 1 -- 172.21.15.103:0/1612813282 shutdown_connections 2024-09-10T08:34:50.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.317+0000 7efc4c0d0640 1 -- 172.21.15.103:0/1612813282 wait complete. 2024-09-10T08:34:50.335 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:34:50.335 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:34:50.336 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:34:50.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.441+0000 7f572b3af640 1 Processor -- start 2024-09-10T08:34:50.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.442+0000 7f572b3af640 1 -- start start 2024-09-10T08:34:50.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.443+0000 7f572b3af640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f57240c3560 0x7f57240c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.443+0000 7f572b3af640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5724153fc0 con 0x7f57240c7fb0 2024-09-10T08:34:50.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.443+0000 7f572b3af640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57240c8400 con 0x7f5724153be0 2024-09-10T08:34:50.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.443+0000 7f572b3af640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f5724156db0 con 0x7f57240c3560 2024-09-10T08:34:50.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.443+0000 7f572894a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f57240c3560 0x7f57240c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.443+0000 7f572994c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f57240c7fb0 0x7f5724160bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39908/0 (socket says 172.21.15.103:39908) 2024-09-10T08:34:50.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.443+0000 7f572894a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f57240c3560 0x7f57240c7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43814/0 (socket says 172.21.15.103:43814) 2024-09-10T08:34:50.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.443+0000 7f572994c640 1 -- 172.21.15.103:0/2394601790 learned_addr learned my addr 172.21.15.103:0/2394601790 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:34:50.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.443+0000 7f572894a640 1 -- 172.21.15.103:0/2394601790 >> v1:172.21.15.154:6789/0 conn(0x7f5724153be0 legacy=0x7f57240ac720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.443+0000 7f572894a640 1 -- 172.21.15.103:0/2394601790 >> v1:172.21.15.103:6789/0 conn(0x7f57240c7fb0 legacy=0x7f5724160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.443+0000 7f572894a640 1 -- 172.21.15.103:0/2394601790 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57240a8030 con 0x7f57240c3560 2024-09-10T08:34:50.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.443+0000 7f571bfff640 1 -- 172.21.15.103:0/2394601790 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1524437868 0 0) 0x7f571c001490 con 0x7f57240c7fb0 2024-09-10T08:34:50.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.444+0000 7f572894a640 1 --2- 172.21.15.103:0/2394601790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57240c3560 0x7f57240c7a70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f57140097a0 tx=0x7f571402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395fdcd9a3ba232b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:50.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.444+0000 7f571bfff640 1 -- 172.21.15.103:0/2394601790 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5714037070 con 0x7f57240c3560 2024-09-10T08:34:50.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.444+0000 7f571bfff640 1 -- 172.21.15.103:0/2394601790 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5714032440 con 0x7f57240c3560 2024-09-10T08:34:50.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.444+0000 7f571bfff640 1 -- 172.21.15.103:0/2394601790 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571402ae60 con 0x7f57240c3560 2024-09-10T08:34:50.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.444+0000 7f572b3af640 1 -- 172.21.15.103:0/2394601790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57240c3560 msgr2=0x7f57240c7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.444+0000 7f572b3af640 1 --2- 172.21.15.103:0/2394601790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57240c3560 0x7f57240c7a70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f57140097a0 tx=0x7f571402a110 comp rx=0 tx=0).stop 2024-09-10T08:34:50.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.445+0000 7f572b3af640 1 -- 172.21.15.103:0/2394601790 shutdown_connections 2024-09-10T08:34:50.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.445+0000 7f572b3af640 1 --2- 172.21.15.103:0/2394601790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57240c3560 0x7f57240c7a70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.445+0000 7f572b3af640 1 -- 172.21.15.103:0/2394601790 >> 172.21.15.103:0/2394601790 conn(0x7f57240c5660 msgr2=0x7f57240c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:50.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.445+0000 7f572b3af640 1 -- 172.21.15.103:0/2394601790 shutdown_connections 2024-09-10T08:34:50.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.445+0000 7f572b3af640 1 -- 172.21.15.103:0/2394601790 wait complete. 2024-09-10T08:34:50.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.446+0000 7f572b3af640 1 Processor -- start 2024-09-10T08:34:50.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.446+0000 7f572b3af640 1 -- start start 2024-09-10T08:34:50.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.447+0000 7f572b3af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57240c3560 0x7f572414c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.447+0000 7f572b3af640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57240c7fb0 0x7f57240c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.447+0000 7f572b3af640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5724153be0 0x7f57241e1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.447+0000 7f572b3af640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f57240a83e0 con 0x7f57240c7fb0 2024-09-10T08:34:50.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.447+0000 7f572b3af640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5724157240 con 0x7f57240c3560 2024-09-10T08:34:50.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.447+0000 7f572b3af640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f57240ac370 con 0x7f5724153be0 2024-09-10T08:34:50.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.447+0000 7f572894a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57240c7fb0 0x7f57240c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.447+0000 7f572894a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57240c7fb0 0x7f57240c3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43830/0 (socket says 172.21.15.103:43830) 2024-09-10T08:34:50.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.447+0000 7f572894a640 1 -- 172.21.15.103:0/1610816216 learned_addr learned my addr 172.21.15.103:0/1610816216 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:50.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.447+0000 7f572914b640 1 --2- 172.21.15.103:0/1610816216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57240c3560 0x7f572414c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.447+0000 7f572994c640 1 --2- 172.21.15.103:0/1610816216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5724153be0 0x7f57241e1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.448+0000 7f572894a640 1 -- 172.21.15.103:0/1610816216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5724153be0 msgr2=0x7f57241e1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.448+0000 7f572894a640 1 --2- 172.21.15.103:0/1610816216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5724153be0 0x7f57241e1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.448+0000 7f572894a640 1 -- 172.21.15.103:0/1610816216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57240c3560 msgr2=0x7f572414c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.448+0000 7f572894a640 1 --2- 172.21.15.103:0/1610816216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57240c3560 0x7f572414c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.448+0000 7f572894a640 1 -- 172.21.15.103:0/1610816216 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57241ecc30 con 0x7f57240c7fb0 2024-09-10T08:34:50.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.448+0000 7f572894a640 1 --2- 172.21.15.103:0/1610816216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57240c7fb0 0x7f57240c3bb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f57140098c0 tx=0x7f57140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:50.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.448+0000 7f5719ffb640 1 -- 172.21.15.103:0/1610816216 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5714037040 con 0x7f57240c7fb0 2024-09-10T08:34:50.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.448+0000 7f5719ffb640 1 -- 172.21.15.103:0/1610816216 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5714042070 con 0x7f57240c7fb0 2024-09-10T08:34:50.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.448+0000 7f572b3af640 1 -- 172.21.15.103:0/1610816216 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57241ecea0 con 0x7f57240c7fb0 2024-09-10T08:34:50.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.448+0000 7f5719ffb640 1 -- 172.21.15.103:0/1610816216 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5714030c70 con 0x7f57240c7fb0 2024-09-10T08:34:50.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.448+0000 7f572b3af640 1 -- 172.21.15.103:0/1610816216 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f572414e300 con 0x7f57240c7fb0 2024-09-10T08:34:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.449+0000 7f572b3af640 1 --2- 172.21.15.103:0/1610816216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f572414be70 0x7f57241e22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.449+0000 7f572b3af640 1 -- 172.21.15.103:0/1610816216 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f572414bcb0 con 0x7f572414be70 2024-09-10T08:34:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.450+0000 7f572914b640 1 --2- 172.21.15.103:0/1610816216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f572414be70 0x7f57241e22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.450+0000 7f5719ffb640 1 -- 172.21.15.103:0/1610816216 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5714047460 con 0x7f57240c7fb0 2024-09-10T08:34:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.450+0000 7f572914b640 1 -- 172.21.15.103:0/1610816216 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f57241ed070 con 0x7f572414be70 2024-09-10T08:34:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.450+0000 7f572914b640 1 --2- 172.21.15.103:0/1610816216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f572414be70 0x7f57241e22f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5720000f60 tx=0x7f572000f9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.450+0000 7f5719ffb640 1 --2- 172.21.15.103:0/1610816216 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f570806be30 0x7f570806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.450+0000 7f5719ffb640 1 -- 172.21.15.103:0/1610816216 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f57140abd60 con 0x7f57240c7fb0 2024-09-10T08:34:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.450+0000 7f572994c640 1 --2- 172.21.15.103:0/1610816216 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f570806be30 0x7f570806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.450+0000 7f5719ffb640 1 -- 172.21.15.103:0/1610816216 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57200052e0 con 0x7f572414be70 2024-09-10T08:34:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.451+0000 7f5719ffb640 1 -- 172.21.15.103:0/1610816216 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f57200052e0 con 0x7f572414be70 2024-09-10T08:34:50.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.451+0000 7f5719ffb640 1 -- 172.21.15.103:0/1610816216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f572414be70 msgr2=0x7f57241e22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.451+0000 7f5719ffb640 1 --2- 172.21.15.103:0/1610816216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f572414be70 0x7f57241e22f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5720000f60 tx=0x7f572000f9d0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.451+0000 7f5719ffb640 1 -- 172.21.15.103:0/1610816216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f572414be70 msgr2=0x7f57241e22f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:34:50.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.451+0000 7f5719ffb640 1 --2- 172.21.15.103:0/1610816216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f572414be70 0x7f57241e22f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.451+0000 7f572994c640 1 --2- 172.21.15.103:0/1610816216 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f570806be30 0x7f570806e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f571c0012e0 tx=0x7f571c007e50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:50.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.461+0000 7f572b3af640 1 --2- 172.21.15.103:0/1610816216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f572414e820 0x7f572414ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.461+0000 7f572b3af640 1 -- 172.21.15.103:0/1610816216 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f57240c7ad0 con 0x7f572414e820 2024-09-10T08:34:50.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.461+0000 7f572914b640 1 --2- 172.21.15.103:0/1610816216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f572414e820 0x7f572414ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.462+0000 7f572914b640 1 -- 172.21.15.103:0/1610816216 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f57240c77f0 con 0x7f572414e820 2024-09-10T08:34:50.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.462+0000 7f572914b640 1 --2- 172.21.15.103:0/1610816216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f572414e820 0x7f572414ec30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5720000f60 tx=0x7f5720001080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:50.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.462+0000 7f5719ffb640 1 -- 172.21.15.103:0/1610816216 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5720005490 con 0x7f572414e820 2024-09-10T08:34:50.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.462+0000 7f5719ffb640 1 -- 172.21.15.103:0/1610816216 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4551 (secure 0 0 0) 0x7f572001c770 con 0x7f572414e820 2024-09-10T08:34:50.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.462+0000 7f5719ffb640 1 -- 172.21.15.103:0/1610816216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f572414e820 msgr2=0x7f572414ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.462+0000 7f5719ffb640 1 --2- 172.21.15.103:0/1610816216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f572414e820 0x7f572414ec30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5720000f60 tx=0x7f5720001080 comp rx=0 tx=0).stop 2024-09-10T08:34:50.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.462+0000 7f5719ffb640 1 -- 172.21.15.103:0/1610816216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f572414e820 msgr2=0x7f572414ec30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:34:50.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.462+0000 7f5719ffb640 1 --2- 172.21.15.103:0/1610816216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f572414e820 0x7f572414ec30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.464 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:34:50.464 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:34:50.464 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:34:50.464 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:34:50.464 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 52, 2024-09-10T08:34:50.464 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 6218, 2024-09-10T08:34:50.464 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:34:50.464 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:34:50.465 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:34:50.465 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:34:50.465 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:50.465 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:34:50.465 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:34:50.465 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:34:50.465 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:34:50.465 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:50.465 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:50.465 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:50.465 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:50.465 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:50.465 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:50.465 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:50.466 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:50.466 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:50.466 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:50.466 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:50.466 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:50.466 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:34:50.466 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:34:50.466 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:50.466 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:50.466 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:50.466 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:50.466 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:50.466 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:50.466 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:50.467 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:50.467 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:50.467 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:50.467 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:50.467 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:50.467 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.467 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:34:50.467 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:34:50.467 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:34:50.467 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:34:50.467 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:34:50.467 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:34:50.467 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:34:50.468 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:34:50.468 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:34:50.468 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:34:50.468 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:34:50.468 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:34:50.468 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:34:50.468 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:34:50.468 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:34:50.468 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:34:50.468 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:34:50.468 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:50.468 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:50.468 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:50.469 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:50.469 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:50.469 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:50.469 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:50.469 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:50.469 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:50.469 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:50.469 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:50.469 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:50.469 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:34:50.469 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.469 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:34:50.469 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.470 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:34:50.470 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:34:50.470 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:50.470 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:50.470 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.470 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:50.470 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:34:50.470 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:50.470 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.470 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.470 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:50.470 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:34:50.470 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:50.471 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:50.471 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:50.471 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.471 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:34:50.471 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:34:50.471 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:50.471 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:50.471 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:50.471 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.471 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.471 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:34:50.471 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:34:50.471 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:50.472 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:50.472 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.472 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:50.472 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:34:50.472 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:50.472 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.472 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.472 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:50.472 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:34:50.472 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:50.472 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:50.472 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:50.472 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.472 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:34:50.472 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:34:50.473 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:50.473 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:50.473 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:50.473 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.473 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.473 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:34:50.473 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:34:50.473 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:50.473 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:50.473 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.473 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:50.473 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:34:50.473 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:50.473 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.474 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.474 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:50.474 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:34:50.474 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:50.474 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:50.474 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:50.474 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.474 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:34:50.474 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:34:50.474 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:50.474 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:50.474 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:50.474 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:50.475 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:50.475 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.475 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:34:50.475 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:34:50.475 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.475 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:50.475 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:50.475 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:34:50.475 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:50.475 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:50.475 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:34:50.475 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.475 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:50.475 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:50.476 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:34:50.476 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:50.476 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:50.476 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.476 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:34:50.476 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:34:50.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.463+0000 7f572b3af640 1 -- 172.21.15.103:0/1610816216 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f570806be30 msgr2=0x7f570806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.463+0000 7f572b3af640 1 --2- 172.21.15.103:0/1610816216 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f570806be30 0x7f570806e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f571c0012e0 tx=0x7f571c007e50 comp rx=0 tx=0).stop 2024-09-10T08:34:50.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.463+0000 7f572b3af640 1 -- 172.21.15.103:0/1610816216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57240c7fb0 msgr2=0x7f57240c3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.463+0000 7f572b3af640 1 --2- 172.21.15.103:0/1610816216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57240c7fb0 0x7f57240c3bb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f57140098c0 tx=0x7f57140046c0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.463+0000 7f572994c640 1 -- 172.21.15.103:0/1610816216 reap_dead start 2024-09-10T08:34:50.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.463+0000 7f572994c640 1 -- 172.21.15.103:0/1610816216 reap_dead start 2024-09-10T08:34:50.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.463+0000 7f572b3af640 1 -- 172.21.15.103:0/1610816216 shutdown_connections 2024-09-10T08:34:50.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.463+0000 7f572b3af640 1 -- 172.21.15.103:0/1610816216 >> 172.21.15.103:0/1610816216 conn(0x7f57240c5660 msgr2=0x7f57240c2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:50.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.463+0000 7f572b3af640 1 -- 172.21.15.103:0/1610816216 shutdown_connections 2024-09-10T08:34:50.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.463+0000 7f572b3af640 1 -- 172.21.15.103:0/1610816216 wait complete. 2024-09-10T08:34:50.478 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:34:50.478 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:34:50.479 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:34:50.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.593+0000 7f54a39a6640 1 Processor -- start 2024-09-10T08:34:50.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.593+0000 7f54a39a6640 1 -- start start 2024-09-10T08:34:50.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.594+0000 7f54a39a6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c0c2e30 0x7f549c153390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.594+0000 7f54a39a6640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f549c0c37a0 con 0x7f549c0aba60 2024-09-10T08:34:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.594+0000 7f54a39a6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f549c0c3a80 con 0x7f549c0c3d60 2024-09-10T08:34:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.594+0000 7f54a39a6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f549c155fb0 con 0x7f549c0c2e30 2024-09-10T08:34:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.594+0000 7f54a1742640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f549c0aba60 0x7f549c1567b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39910/0 (socket says 172.21.15.103:39910) 2024-09-10T08:34:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.594+0000 7f54a1742640 1 -- 172.21.15.103:0/1212507033 learned_addr learned my addr 172.21.15.103:0/1212507033 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:34:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.594+0000 7f54a0f41640 1 --2- 172.21.15.103:0/1212507033 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c0c2e30 0x7f549c153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.595+0000 7f5493fff640 1 -- 172.21.15.103:0/1212507033 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3954759456 0 0) 0x7f549c0c37a0 con 0x7f549c0aba60 2024-09-10T08:34:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.595+0000 7f5493fff640 1 -- 172.21.15.103:0/1212507033 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5488003520 con 0x7f549c0aba60 2024-09-10T08:34:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.595+0000 7f5493fff640 1 -- 172.21.15.103:0/1212507033 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1384359434 0 0) 0x7f549c0c3a80 con 0x7f549c0c3d60 2024-09-10T08:34:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.595+0000 7f5493fff640 1 -- 172.21.15.103:0/1212507033 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f549c0c37a0 con 0x7f549c0c3d60 2024-09-10T08:34:50.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.595+0000 7f54a0f41640 1 -- 172.21.15.103:0/1212507033 >> v1:172.21.15.154:6789/0 conn(0x7f549c0c3d60 legacy=0x7f549c14fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.595+0000 7f54a0f41640 1 -- 172.21.15.103:0/1212507033 >> v1:172.21.15.103:6789/0 conn(0x7f549c0aba60 legacy=0x7f549c1567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.595+0000 7f5493fff640 1 -- 172.21.15.103:0/1212507033 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 223261861 0 0) 0x7f5488003520 con 0x7f549c0aba60 2024-09-10T08:34:50.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.595+0000 7f54a0f41640 1 -- 172.21.15.103:0/1212507033 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f549c156290 con 0x7f549c0c2e30 2024-09-10T08:34:50.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.596+0000 7f54a0f41640 1 --2- 172.21.15.103:0/1212507033 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c0c2e30 0x7f549c153390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f548c0097d0 tx=0x7f548c02a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e959f86dfe25db4b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:50.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.596+0000 7f5493fff640 1 -- 172.21.15.103:0/1212507033 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548c037070 con 0x7f549c0c2e30 2024-09-10T08:34:50.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.596+0000 7f5493fff640 1 -- 172.21.15.103:0/1212507033 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f548c02ab10 con 0x7f549c0c2e30 2024-09-10T08:34:50.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.596+0000 7f5493fff640 1 -- 172.21.15.103:0/1212507033 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5498001670 con 0x7f549c0c2e30 2024-09-10T08:34:50.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.597+0000 7f54a39a6640 1 -- 172.21.15.103:0/1212507033 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c0c2e30 msgr2=0x7f549c153390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.597+0000 7f54a39a6640 1 --2- 172.21.15.103:0/1212507033 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c0c2e30 0x7f549c153390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f548c0097d0 tx=0x7f548c02a080 comp rx=0 tx=0).stop 2024-09-10T08:34:50.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.597+0000 7f54a39a6640 1 -- 172.21.15.103:0/1212507033 shutdown_connections 2024-09-10T08:34:50.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.597+0000 7f54a39a6640 1 --2- 172.21.15.103:0/1212507033 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c0c2e30 0x7f549c153390 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.597+0000 7f54a39a6640 1 -- 172.21.15.103:0/1212507033 >> 172.21.15.103:0/1212507033 conn(0x7f549c0c8430 msgr2=0x7f549c0c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:50.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.597+0000 7f54a39a6640 1 -- 172.21.15.103:0/1212507033 shutdown_connections 2024-09-10T08:34:50.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.597+0000 7f54a39a6640 1 -- 172.21.15.103:0/1212507033 wait complete. 2024-09-10T08:34:50.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.598+0000 7f54a39a6640 1 Processor -- start 2024-09-10T08:34:50.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.598+0000 7f54a39a6640 1 -- start start 2024-09-10T08:34:50.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.599+0000 7f54a39a6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c0aba60 0x7f549c0c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.599+0000 7f54a39a6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f549c0c2e30 0x7f549c1eb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.599+0000 7f54a39a6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f549c0c3d60 0x7f549c14e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.599+0000 7f54a39a6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f549c150430 con 0x7f549c0c3d60 2024-09-10T08:34:50.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.599+0000 7f54a39a6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f549c1502b0 con 0x7f549c0c2e30 2024-09-10T08:34:50.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.599+0000 7f54a39a6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f549c1505b0 con 0x7f549c0aba60 2024-09-10T08:34:50.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.599+0000 7f54a1f43640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f549c0c3d60 0x7f549c14e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.599+0000 7f54a1742640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c0aba60 0x7f549c0c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.599+0000 7f54a1f43640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f549c0c3d60 0x7f549c14e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43846/0 (socket says 172.21.15.103:43846) 2024-09-10T08:34:50.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.599+0000 7f54a1f43640 1 -- 172.21.15.103:0/3913784967 learned_addr learned my addr 172.21.15.103:0/3913784967 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:50.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.599+0000 7f54a0f41640 1 --2- 172.21.15.103:0/3913784967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f549c0c2e30 0x7f549c1eb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.599+0000 7f54a1f43640 1 -- 172.21.15.103:0/3913784967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c0aba60 msgr2=0x7f549c0c28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.599+0000 7f54a1f43640 1 --2- 172.21.15.103:0/3913784967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c0aba60 0x7f549c0c28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.599+0000 7f54a1f43640 1 -- 172.21.15.103:0/3913784967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f549c0c2e30 msgr2=0x7f549c1eb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.599+0000 7f54a1f43640 1 --2- 172.21.15.103:0/3913784967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f549c0c2e30 0x7f549c1eb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.599+0000 7f54a1f43640 1 -- 172.21.15.103:0/3913784967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f549c155930 con 0x7f549c0c3d60 2024-09-10T08:34:50.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.599+0000 7f54a1f43640 1 --2- 172.21.15.103:0/3913784967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f549c0c3d60 0x7f549c14e760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f549400c710 tx=0x7f549400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:50.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.600+0000 7f5491ffb640 1 -- 172.21.15.103:0/3913784967 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5494003b70 con 0x7f549c0c3d60 2024-09-10T08:34:50.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.600+0000 7f5491ffb640 1 -- 172.21.15.103:0/3913784967 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5494003d10 con 0x7f549c0c3d60 2024-09-10T08:34:50.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.600+0000 7f5491ffb640 1 -- 172.21.15.103:0/3913784967 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549400aa50 con 0x7f549c0c3d60 2024-09-10T08:34:50.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.600+0000 7f54a39a6640 1 -- 172.21.15.103:0/3913784967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f549c155650 con 0x7f549c0c3d60 2024-09-10T08:34:50.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.600+0000 7f54a39a6640 1 -- 172.21.15.103:0/3913784967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f549c1dd9f0 con 0x7f549c0c3d60 2024-09-10T08:34:50.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.601+0000 7f54a39a6640 1 --2- 172.21.15.103:0/3913784967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c1ebac0 0x7f549c14a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.601+0000 7f54a39a6640 1 -- 172.21.15.103:0/3913784967 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f549c1ddc30 con 0x7f549c1ebac0 2024-09-10T08:34:50.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.601+0000 7f54a1742640 1 --2- 172.21.15.103:0/3913784967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c1ebac0 0x7f549c14a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.601+0000 7f5491ffb640 1 -- 172.21.15.103:0/3913784967 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f549400abf0 con 0x7f549c0c3d60 2024-09-10T08:34:50.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.601+0000 7f54a1742640 1 -- 172.21.15.103:0/3913784967 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f549c0c4170 con 0x7f549c1ebac0 2024-09-10T08:34:50.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.602+0000 7f5491ffb640 1 --2- 172.21.15.103:0/3913784967 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f548006be30 0x7f548006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.602+0000 7f54a1742640 1 --2- 172.21.15.103:0/3913784967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c1ebac0 0x7f549c14a1b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f54980011e0 tx=0x7f549800ff70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:50.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.602+0000 7f54a0f41640 1 --2- 172.21.15.103:0/3913784967 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f548006be30 0x7f548006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.602+0000 7f5491ffb640 1 -- 172.21.15.103:0/3913784967 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f549408aed0 con 0x7f549c0c3d60 2024-09-10T08:34:50.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.602+0000 7f5491ffb640 1 -- 172.21.15.103:0/3913784967 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5498017020 con 0x7f549c1ebac0 2024-09-10T08:34:50.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.602+0000 7f5491ffb640 1 -- 172.21.15.103:0/3913784967 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f549800d980 con 0x7f549c1ebac0 2024-09-10T08:34:50.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.602+0000 7f5491ffb640 1 -- 172.21.15.103:0/3913784967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c1ebac0 msgr2=0x7f549c14a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.602+0000 7f5491ffb640 1 --2- 172.21.15.103:0/3913784967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c1ebac0 0x7f549c14a1b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f54980011e0 tx=0x7f549800ff70 comp rx=0 tx=0).stop 2024-09-10T08:34:50.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.602+0000 7f5491ffb640 1 -- 172.21.15.103:0/3913784967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c1ebac0 msgr2=0x7f549c14a1b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:34:50.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.602+0000 7f5491ffb640 1 --2- 172.21.15.103:0/3913784967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c1ebac0 0x7f549c14a1b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.602+0000 7f54a0f41640 1 --2- 172.21.15.103:0/3913784967 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f548006be30 0x7f548006e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f548c034000 tx=0x7f548c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:50.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.608+0000 7f54a39a6640 1 --2- 172.21.15.103:0/3913784967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c1550e0 0x7f549c14a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.608+0000 7f54a39a6640 1 -- 172.21.15.103:0/3913784967 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f549c14f240 con 0x7f549c1550e0 2024-09-10T08:34:50.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.608+0000 7f54a1742640 1 --2- 172.21.15.103:0/3913784967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c1550e0 0x7f549c14a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.609+0000 7f54a1742640 1 -- 172.21.15.103:0/3913784967 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f549c076430 con 0x7f549c1550e0 2024-09-10T08:34:50.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.609+0000 7f54a1742640 1 --2- 172.21.15.103:0/3913784967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c1550e0 0x7f549c14a6f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f54980011e0 tx=0x7f5498001150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:50.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.609+0000 7f5491ffb640 1 -- 172.21.15.103:0/3913784967 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5498017040 con 0x7f549c1550e0 2024-09-10T08:34:50.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.609+0000 7f5491ffb640 1 -- 172.21.15.103:0/3913784967 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7f549801e220 con 0x7f549c1550e0 2024-09-10T08:34:50.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.609+0000 7f5491ffb640 1 -- 172.21.15.103:0/3913784967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c1550e0 msgr2=0x7f549c14a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.609+0000 7f5491ffb640 1 --2- 172.21.15.103:0/3913784967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c1550e0 0x7f549c14a6f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f54980011e0 tx=0x7f5498001150 comp rx=0 tx=0).stop 2024-09-10T08:34:50.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.609+0000 7f5491ffb640 1 -- 172.21.15.103:0/3913784967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c1550e0 msgr2=0x7f549c14a6f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:34:50.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.609+0000 7f5491ffb640 1 --2- 172.21.15.103:0/3913784967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f549c1550e0 0x7f549c14a6f0 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f54980011e0 tx=0x7f5498001150 comp rx=0 tx=0).stop 2024-09-10T08:34:50.611 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:34:50.611 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:34:50.611 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:34:50.611 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:34:50.611 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 52, 2024-09-10T08:34:50.611 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 234769, 2024-09-10T08:34:50.611 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:34:50.612 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:34:50.612 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:34:50.612 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:34:50.612 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:50.612 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:34:50.612 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:34:50.612 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:34:50.612 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:34:50.612 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:50.612 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:50.612 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:50.612 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:50.613 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:50.613 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:50.613 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:50.613 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:50.613 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:50.613 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:50.613 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:50.613 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:50.613 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:34:50.613 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:34:50.613 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:50.613 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:50.613 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:50.614 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:50.614 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:50.614 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:50.614 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:50.614 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:50.614 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:50.614 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:50.614 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:50.614 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:50.614 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.614 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:34:50.614 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:34:50.615 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:34:50.615 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:34:50.615 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:34:50.615 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:34:50.615 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:34:50.615 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:34:50.615 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:34:50.615 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:34:50.615 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:34:50.615 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:34:50.615 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:34:50.615 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:34:50.616 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:34:50.616 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:34:50.616 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:34:50.616 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:34:50.616 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:34:50.616 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:34:50.616 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:34:50.616 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:34:50.616 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:34:50.616 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:34:50.616 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:34:50.616 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:34:50.616 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:34:50.617 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:34:50.617 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:50.617 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:34:50.617 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.617 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:34:50.617 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.617 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:34:50.617 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:34:50.617 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:50.617 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:50.617 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.617 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:50.617 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:34:50.618 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:50.618 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.618 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.618 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:50.618 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:34:50.618 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:50.618 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:50.618 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:50.618 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.618 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:34:50.618 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:34:50.618 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:50.618 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:50.619 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:50.619 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.619 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.619 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:34:50.619 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:34:50.619 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:50.619 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:50.619 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.619 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:50.619 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:34:50.619 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:50.619 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.619 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.620 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:50.620 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:34:50.620 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:50.620 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:50.620 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:50.620 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.620 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:34:50.620 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:34:50.620 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:50.620 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:50.620 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:50.620 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.620 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.621 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:34:50.621 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:34:50.621 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:34:50.621 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:34:50.621 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.621 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:34:50.621 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:34:50.621 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:50.621 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.621 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.621 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:34:50.621 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:34:50.622 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:34:50.622 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:50.622 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:50.622 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.622 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:34:50.622 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:34:50.622 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:34:50.622 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:34:50.622 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:34:50.622 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:50.622 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:50.622 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.623 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:34:50.623 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:34:50.623 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.623 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:50.623 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:50.623 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:34:50.623 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:50.623 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:50.623 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:34:50.623 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.623 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:50.623 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:50.623 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:34:50.623 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:50.624 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:50.624 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:34:50.624 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.624 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:50.624 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:50.624 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 8 2024-09-10T08:34:50.624 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:50.624 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:50.624 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:34:50.624 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.624 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:50.624 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:50.624 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:34:50.625 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:50.625 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:34:50.625 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:34:50.625 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:34:50.625 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:34:50.625 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:34:50.625 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:34:50.625 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:34:50.625 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:34:50.625 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:34:50.625 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:34:50.625 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:34:50.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.610+0000 7f54a39a6640 1 -- 172.21.15.103:0/3913784967 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f548006be30 msgr2=0x7f548006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.610+0000 7f54a39a6640 1 --2- 172.21.15.103:0/3913784967 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f548006be30 0x7f548006e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f548c034000 tx=0x7f548c02e000 comp rx=0 tx=0).stop 2024-09-10T08:34:50.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.610+0000 7f54a39a6640 1 -- 172.21.15.103:0/3913784967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f549c0c3d60 msgr2=0x7f549c14e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.610+0000 7f54a39a6640 1 --2- 172.21.15.103:0/3913784967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f549c0c3d60 0x7f549c14e760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f549400c710 tx=0x7f549400cbd0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.610+0000 7f54a1f43640 1 -- 172.21.15.103:0/3913784967 reap_dead start 2024-09-10T08:34:50.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.610+0000 7f54a1f43640 1 -- 172.21.15.103:0/3913784967 reap_dead start 2024-09-10T08:34:50.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.610+0000 7f54a39a6640 1 -- 172.21.15.103:0/3913784967 shutdown_connections 2024-09-10T08:34:50.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.610+0000 7f54a39a6640 1 -- 172.21.15.103:0/3913784967 >> 172.21.15.103:0/3913784967 conn(0x7f549c0c8430 msgr2=0x7f549c0c4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:50.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.610+0000 7f54a39a6640 1 -- 172.21.15.103:0/3913784967 shutdown_connections 2024-09-10T08:34:50.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.610+0000 7f54a39a6640 1 -- 172.21.15.103:0/3913784967 wait complete. 2024-09-10T08:34:50.628 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:34:50.628 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-10T08:34:50.628 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-10T08:34:50.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.738+0000 7f714eb86640 1 Processor -- start 2024-09-10T08:34:50.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.738+0000 7f714eb86640 1 -- start start 2024-09-10T08:34:50.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.739+0000 7f714eb86640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7148153be0 0x7f71480c3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.739+0000 7f714eb86640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f71480ac720 0x7f71480c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.739+0000 7f714eb86640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7148153fc0 con 0x7f71480c7fb0 2024-09-10T08:34:50.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.739+0000 7f714eb86640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f7148156db0 con 0x7f7148153be0 2024-09-10T08:34:50.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.739+0000 7f714eb86640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f71480c8420 con 0x7f71480ac720 2024-09-10T08:34:50.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.739+0000 7f714c922640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7148153be0 0x7f71480c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.739+0000 7f714c922640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7148153be0 0x7f71480c3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43852/0 (socket says 172.21.15.103:43852) 2024-09-10T08:34:50.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.739+0000 7f714c922640 1 -- 172.21.15.103:0/2158460612 learned_addr learned my addr 172.21.15.103:0/2158460612 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:50.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.739+0000 7f7147fff640 1 --2- 172.21.15.103:0/2158460612 >> v2:172.21.15.154:3300/0 conn(0x7f71480ac720 0x7f71480c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.740+0000 7f714c922640 1 -- 172.21.15.103:0/2158460612 >> v2:172.21.15.154:3300/0 conn(0x7f71480ac720 msgr2=0x7f71480c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:50.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.740+0000 7f714c922640 1 --2- 172.21.15.103:0/2158460612 >> v2:172.21.15.154:3300/0 conn(0x7f71480ac720 0x7f71480c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.740+0000 7f714c922640 1 -- 172.21.15.103:0/2158460612 >> v1:172.21.15.154:6789/0 conn(0x7f71480c7fb0 legacy=0x7f71481598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.740+0000 7f714c922640 1 -- 172.21.15.103:0/2158460612 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71480a8030 con 0x7f7148153be0 2024-09-10T08:34:50.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.740+0000 7f714c922640 1 --2- 172.21.15.103:0/2158460612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7148153be0 0x7f71480c3560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f71480ac130 tx=0x7f713c02a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47ca361d3a5db30 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:50.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.741+0000 7f71477fe640 1 -- 172.21.15.103:0/2158460612 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c037070 con 0x7f7148153be0 2024-09-10T08:34:50.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.741+0000 7f71477fe640 1 -- 172.21.15.103:0/2158460612 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f713c032440 con 0x7f7148153be0 2024-09-10T08:34:50.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.741+0000 7f71477fe640 1 -- 172.21.15.103:0/2158460612 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c032810 con 0x7f7148153be0 2024-09-10T08:34:50.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.741+0000 7f714eb86640 1 -- 172.21.15.103:0/2158460612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7148153be0 msgr2=0x7f71480c3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.741+0000 7f714eb86640 1 --2- 172.21.15.103:0/2158460612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7148153be0 0x7f71480c3560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f71480ac130 tx=0x7f713c02a150 comp rx=0 tx=0).stop 2024-09-10T08:34:50.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.741+0000 7f714eb86640 1 -- 172.21.15.103:0/2158460612 shutdown_connections 2024-09-10T08:34:50.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.741+0000 7f714eb86640 1 --2- 172.21.15.103:0/2158460612 >> v2:172.21.15.154:3300/0 conn(0x7f71480ac720 0x7f71480c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.741+0000 7f714eb86640 1 --2- 172.21.15.103:0/2158460612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7148153be0 0x7f71480c3560 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.741+0000 7f714eb86640 1 -- 172.21.15.103:0/2158460612 >> 172.21.15.103:0/2158460612 conn(0x7f71480c5660 msgr2=0x7f71480c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:50.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.741+0000 7f714eb86640 1 -- 172.21.15.103:0/2158460612 shutdown_connections 2024-09-10T08:34:50.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.741+0000 7f714eb86640 1 -- 172.21.15.103:0/2158460612 wait complete. 2024-09-10T08:34:50.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.743+0000 7f714eb86640 1 Processor -- start 2024-09-10T08:34:50.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.743+0000 7f714eb86640 1 -- start start 2024-09-10T08:34:50.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.744+0000 7f714eb86640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71480ac720 0x7f71481efb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.744+0000 7f714eb86640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71480c7fb0 0x7f71481592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.744+0000 7f714eb86640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7148153be0 0x7f71481ebb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.744+0000 7f714eb86640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f71480a83e0 con 0x7f7148153be0 2024-09-10T08:34:50.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.744+0000 7f714eb86640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7148157240 con 0x7f71480ac720 2024-09-10T08:34:50.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.744+0000 7f714eb86640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f71480ac370 con 0x7f71480c7fb0 2024-09-10T08:34:50.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.744+0000 7f714d123640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7148153be0 0x7f71481ebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.744+0000 7f714c922640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71480ac720 0x7f71481efb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.744+0000 7f714d123640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7148153be0 0x7f71481ebb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43868/0 (socket says 172.21.15.103:43868) 2024-09-10T08:34:50.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.744+0000 7f714c922640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71480ac720 0x7f71481efb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:54436/0 (socket says 172.21.15.103:54436) 2024-09-10T08:34:50.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.744+0000 7f714d123640 1 -- 172.21.15.103:0/2849091280 learned_addr learned my addr 172.21.15.103:0/2849091280 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:34:50.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.744+0000 7f7147fff640 1 --2- 172.21.15.103:0/2849091280 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71480c7fb0 0x7f71481592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.744+0000 7f714d123640 1 -- 172.21.15.103:0/2849091280 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71480c7fb0 msgr2=0x7f71481592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.744+0000 7f714d123640 1 --2- 172.21.15.103:0/2849091280 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71480c7fb0 0x7f71481592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.744+0000 7f714d123640 1 -- 172.21.15.103:0/2849091280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71480ac720 msgr2=0x7f71481efb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:50.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.744+0000 7f714d123640 1 --2- 172.21.15.103:0/2849091280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71480ac720 0x7f71481efb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:50.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.744+0000 7f714d123640 1 -- 172.21.15.103:0/2849091280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7148159810 con 0x7f7148153be0 2024-09-10T08:34:50.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.744+0000 7f714c922640 1 --2- 172.21.15.103:0/2849091280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71480ac720 0x7f71481efb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:34:50.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.744+0000 7f714d123640 1 --2- 172.21.15.103:0/2849091280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7148153be0 0x7f71481ebb80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f714000c7a0 tx=0x7f714000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:50.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.744+0000 7f71457fa640 1 -- 172.21.15.103:0/2849091280 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7140003b70 con 0x7f7148153be0 2024-09-10T08:34:50.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.745+0000 7f71457fa640 1 -- 172.21.15.103:0/2849091280 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7140003d30 con 0x7f7148153be0 2024-09-10T08:34:50.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.745+0000 7f714eb86640 1 -- 172.21.15.103:0/2849091280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7148153590 con 0x7f7148153be0 2024-09-10T08:34:50.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.745+0000 7f71457fa640 1 -- 172.21.15.103:0/2849091280 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714000aa90 con 0x7f7148153be0 2024-09-10T08:34:50.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.745+0000 7f714eb86640 1 -- 172.21.15.103:0/2849091280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7148159f70 con 0x7f7148153be0 2024-09-10T08:34:50.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.746+0000 7f714eb86640 1 -- 172.21.15.103:0/2849091280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71480c63f0 con 0x7f7148153be0 2024-09-10T08:34:50.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.746+0000 7f71457fa640 1 -- 172.21.15.103:0/2849091280 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f714000ac30 con 0x7f7148153be0 2024-09-10T08:34:50.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.747+0000 7f71457fa640 1 --2- 172.21.15.103:0/2849091280 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f712c06be30 0x7f712c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:50.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.747+0000 7f71457fa640 1 -- 172.21.15.103:0/2849091280 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f714008afe0 con 0x7f7148153be0 2024-09-10T08:34:50.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.747+0000 7f714c922640 1 --2- 172.21.15.103:0/2849091280 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f712c06be30 0x7f712c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:50.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.747+0000 7f714c922640 1 --2- 172.21.15.103:0/2849091280 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f712c06be30 0x7f712c06e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f713c034000 tx=0x7f713c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:50.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:50.752+0000 7f71457fa640 1 -- 172.21.15.103:0/2849091280 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7148153fc0 con 0x7f7148153be0 2024-09-10T08:34:51.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:51.036+0000 7f714eb86640 1 -- 172.21.15.103:0/2849091280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f71480a98e0 con 0x7f7148153be0 2024-09-10T08:34:51.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:51.037+0000 7f71457fa640 1 -- 172.21.15.103:0/2849091280 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f7140058fb0 con 0x7f7148153be0 2024-09-10T08:34:51.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:51.039+0000 7f714eb86640 1 -- 172.21.15.103:0/2849091280 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f712c06be30 msgr2=0x7f712c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:51.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:51.039+0000 7f714eb86640 1 --2- 172.21.15.103:0/2849091280 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f712c06be30 0x7f712c06e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f713c034000 tx=0x7f713c02e000 comp rx=0 tx=0).stop 2024-09-10T08:34:51.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:51.039+0000 7f714eb86640 1 -- 172.21.15.103:0/2849091280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7148153be0 msgr2=0x7f71481ebb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:51.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:51.039+0000 7f714eb86640 1 --2- 172.21.15.103:0/2849091280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7148153be0 0x7f71481ebb80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f714000c7a0 tx=0x7f714000cc60 comp rx=0 tx=0).stop 2024-09-10T08:34:51.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:51.039+0000 7f714eb86640 1 -- 172.21.15.103:0/2849091280 shutdown_connections 2024-09-10T08:34:51.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:51.039+0000 7f714eb86640 1 --2- 172.21.15.103:0/2849091280 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f712c06be30 0x7f712c06e2f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:51.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:51.039+0000 7f714eb86640 1 --2- 172.21.15.103:0/2849091280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7148153be0 0x7f71481ebb80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:51.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:51.039+0000 7f714eb86640 1 --2- 172.21.15.103:0/2849091280 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71480c7fb0 0x7f71481592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:51.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:51.039+0000 7f714eb86640 1 --2- 172.21.15.103:0/2849091280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71480ac720 0x7f71481efb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:51.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:51.039+0000 7f714eb86640 1 -- 172.21.15.103:0/2849091280 >> 172.21.15.103:0/2849091280 conn(0x7f71480c5660 msgr2=0x7f71480c3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:51.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:51.039+0000 7f714eb86640 1 -- 172.21.15.103:0/2849091280 shutdown_connections 2024-09-10T08:34:51.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:34:51.039+0000 7f714eb86640 1 -- 172.21.15.103:0/2849091280 wait complete. 2024-09-10T08:34:51.052 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-10T08:35:00.361 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:35:00.363 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:35:01.052 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:35:01.053 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:35:01.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.159+0000 7f2023986640 1 Processor -- start 2024-09-10T08:35:01.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.160+0000 7f2023986640 1 -- start start 2024-09-10T08:35:01.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.160+0000 7f2023986640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f201c0744a0 0x7f201c157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.160+0000 7f2023986640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f201c158560 con 0x7f201c0c7a70 2024-09-10T08:35:01.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.160+0000 7f2023986640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f201c154e00 con 0x7f201c158130 2024-09-10T08:35:01.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.160+0000 7f2023986640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f201c0c4ba0 con 0x7f201c0744a0 2024-09-10T08:35:01.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.161+0000 7f2021722640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f201c0c7a70 0x7f201c0c7e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33086/0 (socket says 172.21.15.103:33086) 2024-09-10T08:35:01.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.161+0000 7f2021722640 1 -- 172.21.15.103:0/3223041963 learned_addr learned my addr 172.21.15.103:0/3223041963 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:35:01.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.161+0000 7f2020f21640 1 --2- 172.21.15.103:0/3223041963 >> v2:172.21.15.154:3300/0 conn(0x7f201c0744a0 0x7f201c157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.161+0000 7f2013fff640 1 -- 172.21.15.103:0/3223041963 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3819484913 0 0) 0x7f201c158560 con 0x7f201c0c7a70 2024-09-10T08:35:01.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.161+0000 7f2013fff640 1 -- 172.21.15.103:0/3223041963 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2008003520 con 0x7f201c0c7a70 2024-09-10T08:35:01.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.161+0000 7f2020f21640 1 -- 172.21.15.103:0/3223041963 >> v1:172.21.15.154:6789/0 conn(0x7f201c158130 legacy=0x7f201c15e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.161+0000 7f2020f21640 1 -- 172.21.15.103:0/3223041963 >> v1:172.21.15.103:6789/0 conn(0x7f201c0c7a70 legacy=0x7f201c0c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.161+0000 7f2020f21640 1 -- 172.21.15.103:0/3223041963 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201c0c50e0 con 0x7f201c0744a0 2024-09-10T08:35:01.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.162+0000 7f2020f21640 1 --2- 172.21.15.103:0/3223041963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f201c0744a0 0x7f201c157bf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f200c0097a0 tx=0x7f200c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28b37c0f9c6250d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:01.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.162+0000 7f2013fff640 1 -- 172.21.15.103:0/3223041963 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c037070 con 0x7f201c0744a0 2024-09-10T08:35:01.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.162+0000 7f2013fff640 1 -- 172.21.15.103:0/3223041963 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f200c032440 con 0x7f201c0744a0 2024-09-10T08:35:01.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.162+0000 7f2013fff640 1 -- 172.21.15.103:0/3223041963 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c032810 con 0x7f201c0744a0 2024-09-10T08:35:01.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.163+0000 7f2023986640 1 -- 172.21.15.103:0/3223041963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f201c0744a0 msgr2=0x7f201c157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.163+0000 7f2023986640 1 --2- 172.21.15.103:0/3223041963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f201c0744a0 0x7f201c157bf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f200c0097a0 tx=0x7f200c02a230 comp rx=0 tx=0).stop 2024-09-10T08:35:01.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.163+0000 7f2023986640 1 -- 172.21.15.103:0/3223041963 shutdown_connections 2024-09-10T08:35:01.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.163+0000 7f2023986640 1 --2- 172.21.15.103:0/3223041963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f201c0744a0 0x7f201c157bf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.163+0000 7f2023986640 1 -- 172.21.15.103:0/3223041963 >> 172.21.15.103:0/3223041963 conn(0x7f201c0c5660 msgr2=0x7f201c0c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:01.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.163+0000 7f2023986640 1 -- 172.21.15.103:0/3223041963 shutdown_connections 2024-09-10T08:35:01.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.163+0000 7f2023986640 1 -- 172.21.15.103:0/3223041963 wait complete. 2024-09-10T08:35:01.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.164+0000 7f2023986640 1 Processor -- start 2024-09-10T08:35:01.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.164+0000 7f2023986640 1 -- start start 2024-09-10T08:35:01.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.165+0000 7f2023986640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f201c0744a0 0x7f201c1e0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.165+0000 7f2023986640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201c0c7a70 0x7f201c14ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.165+0000 7f2023986640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f201c158130 0x7f201c14d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.165+0000 7f2023986640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f201c0c53c0 con 0x7f201c0c7a70 2024-09-10T08:35:01.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.165+0000 7f2023986640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f201c154b10 con 0x7f201c0744a0 2024-09-10T08:35:01.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.165+0000 7f2023986640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f201c071bb0 con 0x7f201c158130 2024-09-10T08:35:01.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.165+0000 7f2020f21640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201c0c7a70 0x7f201c14ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.165+0000 7f2020f21640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201c0c7a70 0x7f201c14ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34224/0 (socket says 172.21.15.103:34224) 2024-09-10T08:35:01.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.165+0000 7f2020f21640 1 -- 172.21.15.103:0/3889183534 learned_addr learned my addr 172.21.15.103:0/3889183534 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:01.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.165+0000 7f2021722640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f201c0744a0 0x7f201c1e0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.165+0000 7f2021f23640 1 --2- 172.21.15.103:0/3889183534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f201c158130 0x7f201c14d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.165+0000 7f2020f21640 1 -- 172.21.15.103:0/3889183534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f201c158130 msgr2=0x7f201c14d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.165+0000 7f2020f21640 1 --2- 172.21.15.103:0/3889183534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f201c158130 0x7f201c14d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.165+0000 7f2020f21640 1 -- 172.21.15.103:0/3889183534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f201c0744a0 msgr2=0x7f201c1e0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.165+0000 7f2020f21640 1 --2- 172.21.15.103:0/3889183534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f201c0744a0 0x7f201c1e0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.165+0000 7f2020f21640 1 -- 172.21.15.103:0/3889183534 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201c14b470 con 0x7f201c0c7a70 2024-09-10T08:35:01.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.165+0000 7f2020f21640 1 --2- 172.21.15.103:0/3889183534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201c0c7a70 0x7f201c14ccf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f200c035040 tx=0x7f200c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:01.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.165+0000 7f2011ffb640 1 -- 172.21.15.103:0/3889183534 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c037040 con 0x7f201c0c7a70 2024-09-10T08:35:01.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.166+0000 7f2011ffb640 1 -- 172.21.15.103:0/3889183534 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f200c030500 con 0x7f201c0c7a70 2024-09-10T08:35:01.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.166+0000 7f2023986640 1 -- 172.21.15.103:0/3889183534 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f201c14c210 con 0x7f201c0c7a70 2024-09-10T08:35:01.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.166+0000 7f2011ffb640 1 -- 172.21.15.103:0/3889183534 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c0308d0 con 0x7f201c0c7a70 2024-09-10T08:35:01.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.166+0000 7f2023986640 1 -- 172.21.15.103:0/3889183534 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f201c14df40 con 0x7f201c0c7a70 2024-09-10T08:35:01.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.167+0000 7f2023986640 1 -- 172.21.15.103:0/3889183534 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f201c151bc0 con 0x7f201c0c7a70 2024-09-10T08:35:01.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.167+0000 7f2011ffb640 1 -- 172.21.15.103:0/3889183534 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f200c044020 con 0x7f201c0c7a70 2024-09-10T08:35:01.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.168+0000 7f2011ffb640 1 --2- 172.21.15.103:0/3889183534 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f200006be60 0x7f200006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.168+0000 7f2011ffb640 1 -- 172.21.15.103:0/3889183534 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f200c0ab2b0 con 0x7f201c0c7a70 2024-09-10T08:35:01.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.168+0000 7f2021722640 1 --2- 172.21.15.103:0/3889183534 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f200006be60 0x7f200006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.168+0000 7f2021722640 1 --2- 172.21.15.103:0/3889183534 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f200006be60 0x7f200006e320 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f20180011e0 tx=0x7f2018007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:01.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.173+0000 7f2011ffb640 1 -- 172.21.15.103:0/3889183534 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f200c0792e0 con 0x7f201c0c7a70 2024-09-10T08:35:01.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.468+0000 7f2023986640 1 -- 172.21.15.103:0/3889183534 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f201c072ef0 con 0x7f201c0c7a70 2024-09-10T08:35:01.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.468+0000 7f2011ffb640 1 -- 172.21.15.103:0/3889183534 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f200c07d5e0 con 0x7f201c0c7a70 2024-09-10T08:35:01.469 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:35:01.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.470+0000 7f2023986640 1 -- 172.21.15.103:0/3889183534 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f200006be60 msgr2=0x7f200006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.470+0000 7f2023986640 1 --2- 172.21.15.103:0/3889183534 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f200006be60 0x7f200006e320 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f20180011e0 tx=0x7f2018007d30 comp rx=0 tx=0).stop 2024-09-10T08:35:01.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.470+0000 7f2023986640 1 -- 172.21.15.103:0/3889183534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201c0c7a70 msgr2=0x7f201c14ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.470+0000 7f2023986640 1 --2- 172.21.15.103:0/3889183534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201c0c7a70 0x7f201c14ccf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f200c035040 tx=0x7f200c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.470+0000 7f2023986640 1 -- 172.21.15.103:0/3889183534 shutdown_connections 2024-09-10T08:35:01.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.470+0000 7f2023986640 1 --2- 172.21.15.103:0/3889183534 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f200006be60 0x7f200006e320 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.470+0000 7f2023986640 1 --2- 172.21.15.103:0/3889183534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f201c158130 0x7f201c14d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.470+0000 7f2023986640 1 --2- 172.21.15.103:0/3889183534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201c0c7a70 0x7f201c14ccf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.470+0000 7f2023986640 1 --2- 172.21.15.103:0/3889183534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f201c0744a0 0x7f201c1e0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.470+0000 7f2023986640 1 -- 172.21.15.103:0/3889183534 >> 172.21.15.103:0/3889183534 conn(0x7f201c0c5660 msgr2=0x7f201c0c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:01.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.471+0000 7f2023986640 1 -- 172.21.15.103:0/3889183534 shutdown_connections 2024-09-10T08:35:01.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.471+0000 7f2023986640 1 -- 172.21.15.103:0/3889183534 wait complete. 2024-09-10T08:35:01.482 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:35:01.482 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-10T08:35:01.483 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:35:01.483 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:35:01.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.593+0000 7ff844731640 1 Processor -- start 2024-09-10T08:35:01.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.593+0000 7ff844731640 1 -- start start 2024-09-10T08:35:01.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.594+0000 7ff844731640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff83c150aa0 0x7ff83c074500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.594+0000 7ff844731640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff83c073fb0 0x7ff83c06fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.594+0000 7ff844731640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff83c153290 con 0x7ff83c070080 2024-09-10T08:35:01.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.594+0000 7ff844731640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7ff83c153ea0 con 0x7ff83c150aa0 2024-09-10T08:35:01.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.594+0000 7ff844731640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff83c153570 con 0x7ff83c073fb0 2024-09-10T08:35:01.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.594+0000 7ff8424cd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff83c150aa0 0x7ff83c074500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.594+0000 7ff842cce640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff83c070080 0x7ff83c06cd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33102/0 (socket says 172.21.15.103:33102) 2024-09-10T08:35:01.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.594+0000 7ff842cce640 1 -- 172.21.15.103:0/1460967045 learned_addr learned my addr 172.21.15.103:0/1460967045 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:35:01.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.594+0000 7ff841ccc640 1 --2- 172.21.15.103:0/1460967045 >> v2:172.21.15.154:3300/0 conn(0x7ff83c073fb0 0x7ff83c06fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.594+0000 7ff8424cd640 1 -- 172.21.15.103:0/1460967045 >> v2:172.21.15.154:3300/0 conn(0x7ff83c073fb0 msgr2=0x7ff83c06fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:01.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.594+0000 7ff8424cd640 1 --2- 172.21.15.103:0/1460967045 >> v2:172.21.15.154:3300/0 conn(0x7ff83c073fb0 0x7ff83c06fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.594+0000 7ff8424cd640 1 -- 172.21.15.103:0/1460967045 >> v1:172.21.15.103:6789/0 conn(0x7ff83c070080 legacy=0x7ff83c06cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.594+0000 7ff8424cd640 1 -- 172.21.15.103:0/1460967045 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff83c153850 con 0x7ff83c150aa0 2024-09-10T08:35:01.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.595+0000 7ff8424cd640 1 --2- 172.21.15.103:0/1460967045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c150aa0 0x7ff83c074500 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff8380097a0 tx=0x7ff83802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9407af5eb932e81 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:01.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.595+0000 7ff8414cb640 1 -- 172.21.15.103:0/1460967045 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff838037070 con 0x7ff83c150aa0 2024-09-10T08:35:01.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.595+0000 7ff8414cb640 1 -- 172.21.15.103:0/1460967045 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff83802ae50 con 0x7ff83c150aa0 2024-09-10T08:35:01.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.595+0000 7ff8414cb640 1 -- 172.21.15.103:0/1460967045 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff838032660 con 0x7ff83c150aa0 2024-09-10T08:35:01.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.596+0000 7ff844731640 1 -- 172.21.15.103:0/1460967045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c150aa0 msgr2=0x7ff83c074500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.596+0000 7ff844731640 1 --2- 172.21.15.103:0/1460967045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c150aa0 0x7ff83c074500 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff8380097a0 tx=0x7ff83802a140 comp rx=0 tx=0).stop 2024-09-10T08:35:01.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.596+0000 7ff844731640 1 -- 172.21.15.103:0/1460967045 shutdown_connections 2024-09-10T08:35:01.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.596+0000 7ff844731640 1 --2- 172.21.15.103:0/1460967045 >> v2:172.21.15.154:3300/0 conn(0x7ff83c073fb0 0x7ff83c06fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.596+0000 7ff844731640 1 --2- 172.21.15.103:0/1460967045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c150aa0 0x7ff83c074500 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.596+0000 7ff844731640 1 -- 172.21.15.103:0/1460967045 >> 172.21.15.103:0/1460967045 conn(0x7ff83c0c5550 msgr2=0x7ff83c0c5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:01.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.596+0000 7ff844731640 1 -- 172.21.15.103:0/1460967045 shutdown_connections 2024-09-10T08:35:01.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.596+0000 7ff844731640 1 -- 172.21.15.103:0/1460967045 wait complete. 2024-09-10T08:35:01.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.597+0000 7ff844731640 1 Processor -- start 2024-09-10T08:35:01.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.597+0000 7ff844731640 1 -- start start 2024-09-10T08:35:01.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.598+0000 7ff844731640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c070080 0x7ff83c1ea8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.598+0000 7ff844731640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff83c073fb0 0x7ff83c0bddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.598+0000 7ff844731640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff83c150aa0 0x7ff83c14fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.598+0000 7ff844731640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c06d490 con 0x7ff83c070080 2024-09-10T08:35:01.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.598+0000 7ff844731640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c06df30 con 0x7ff83c150aa0 2024-09-10T08:35:01.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.598+0000 7ff844731640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff83c06d610 con 0x7ff83c073fb0 2024-09-10T08:35:01.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.598+0000 7ff8424cd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c070080 0x7ff83c1ea8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.598+0000 7ff8424cd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c070080 0x7ff83c1ea8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34250/0 (socket says 172.21.15.103:34250) 2024-09-10T08:35:01.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.598+0000 7ff8424cd640 1 -- 172.21.15.103:0/472271770 learned_addr learned my addr 172.21.15.103:0/472271770 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:01.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.598+0000 7ff842cce640 1 --2- 172.21.15.103:0/472271770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff83c150aa0 0x7ff83c14fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.598+0000 7ff841ccc640 1 --2- 172.21.15.103:0/472271770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff83c073fb0 0x7ff83c0bddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.598+0000 7ff8424cd640 1 -- 172.21.15.103:0/472271770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff83c073fb0 msgr2=0x7ff83c0bddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.598+0000 7ff8424cd640 1 --2- 172.21.15.103:0/472271770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff83c073fb0 0x7ff83c0bddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.598+0000 7ff8424cd640 1 -- 172.21.15.103:0/472271770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff83c150aa0 msgr2=0x7ff83c14fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.598+0000 7ff8424cd640 1 --2- 172.21.15.103:0/472271770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff83c150aa0 0x7ff83c14fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.598+0000 7ff8424cd640 1 -- 172.21.15.103:0/472271770 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff83c071ca0 con 0x7ff83c070080 2024-09-10T08:35:01.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.598+0000 7ff8424cd640 1 --2- 172.21.15.103:0/472271770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c070080 0x7ff83c1ea8e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff8380097a0 tx=0x7ff8380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:01.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.598+0000 7ff832ffd640 1 -- 172.21.15.103:0/472271770 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff838042070 con 0x7ff83c070080 2024-09-10T08:35:01.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.598+0000 7ff832ffd640 1 -- 172.21.15.103:0/472271770 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff83803e460 con 0x7ff83c070080 2024-09-10T08:35:01.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.598+0000 7ff832ffd640 1 -- 172.21.15.103:0/472271770 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff838037040 con 0x7ff83c070080 2024-09-10T08:35:01.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.598+0000 7ff844731640 1 -- 172.21.15.103:0/472271770 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff83c0c25a0 con 0x7ff83c070080 2024-09-10T08:35:01.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.599+0000 7ff844731640 1 -- 172.21.15.103:0/472271770 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff83c14f5b0 con 0x7ff83c070080 2024-09-10T08:35:01.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.599+0000 7ff844731640 1 --2- 172.21.15.103:0/472271770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c0be330 0x7ff83c1502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.599+0000 7ff844731640 1 -- 172.21.15.103:0/472271770 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c14f430 con 0x7ff83c0be330 2024-09-10T08:35:01.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.600+0000 7ff841ccc640 1 --2- 172.21.15.103:0/472271770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c0be330 0x7ff83c1502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.600+0000 7ff841ccc640 1 -- 172.21.15.103:0/472271770 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff83c06fb40 con 0x7ff83c0be330 2024-09-10T08:35:01.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.600+0000 7ff832ffd640 1 -- 172.21.15.103:0/472271770 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff838045070 con 0x7ff83c070080 2024-09-10T08:35:01.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.600+0000 7ff841ccc640 1 --2- 172.21.15.103:0/472271770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c0be330 0x7ff83c1502f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff83c152660 tx=0x7ff82c011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:01.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.600+0000 7ff832ffd640 1 --2- 172.21.15.103:0/472271770 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff82006be60 0x7ff82006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.601+0000 7ff832ffd640 1 -- 172.21.15.103:0/472271770 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7ff8380abca0 con 0x7ff83c070080 2024-09-10T08:35:01.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.601+0000 7ff842cce640 1 --2- 172.21.15.103:0/472271770 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff82006be60 0x7ff82006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.601+0000 7ff832ffd640 1 -- 172.21.15.103:0/472271770 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c019070 con 0x7ff83c0be330 2024-09-10T08:35:01.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.601+0000 7ff832ffd640 1 -- 172.21.15.103:0/472271770 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff82c004300 con 0x7ff83c0be330 2024-09-10T08:35:01.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.601+0000 7ff832ffd640 1 -- 172.21.15.103:0/472271770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c0be330 msgr2=0x7ff83c1502f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.601+0000 7ff832ffd640 1 --2- 172.21.15.103:0/472271770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c0be330 0x7ff83c1502f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff83c152660 tx=0x7ff82c011d40 comp rx=0 tx=0).stop 2024-09-10T08:35:01.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.601+0000 7ff832ffd640 1 -- 172.21.15.103:0/472271770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c0be330 msgr2=0x7ff83c1502f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:35:01.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.601+0000 7ff832ffd640 1 --2- 172.21.15.103:0/472271770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c0be330 0x7ff83c1502f0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff83c152660 tx=0x7ff82c011d40 comp rx=0 tx=0).stop 2024-09-10T08:35:01.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.601+0000 7ff842cce640 1 --2- 172.21.15.103:0/472271770 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff82006be60 0x7ff82006e320 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff834005c00 tx=0x7ff834009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:01.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.609+0000 7ff844731640 1 --2- 172.21.15.103:0/472271770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c14f780 0x7ff83c14e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.609+0000 7ff844731640 1 -- 172.21.15.103:0/472271770 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c0c2370 con 0x7ff83c14f780 2024-09-10T08:35:01.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.609+0000 7ff841ccc640 1 --2- 172.21.15.103:0/472271770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c14f780 0x7ff83c14e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.609+0000 7ff841ccc640 1 -- 172.21.15.103:0/472271770 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff83c14fb60 con 0x7ff83c14f780 2024-09-10T08:35:01.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.609+0000 7ff841ccc640 1 --2- 172.21.15.103:0/472271770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c14f780 0x7ff83c14e750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff83c152660 tx=0x7ff82c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:01.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.609+0000 7ff832ffd640 1 -- 172.21.15.103:0/472271770 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c019040 con 0x7ff83c14f780 2024-09-10T08:35:01.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.610+0000 7ff832ffd640 1 -- 172.21.15.103:0/472271770 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4722 (secure 0 0 0) 0x7ff82c003aa0 con 0x7ff83c14f780 2024-09-10T08:35:01.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.610+0000 7ff832ffd640 1 -- 172.21.15.103:0/472271770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c14f780 msgr2=0x7ff83c14e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.610+0000 7ff832ffd640 1 --2- 172.21.15.103:0/472271770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c14f780 0x7ff83c14e750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff83c152660 tx=0x7ff82c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.610+0000 7ff832ffd640 1 -- 172.21.15.103:0/472271770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c14f780 msgr2=0x7ff83c14e750 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:35:01.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.610+0000 7ff832ffd640 1 --2- 172.21.15.103:0/472271770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c14f780 0x7ff83c14e750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.611 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:35:01.611 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:35:01.612 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:35:01.612 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:35:01.612 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 52, 2024-09-10T08:35:01.612 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 71678, 2024-09-10T08:35:01.612 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:35:01.612 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:35:01.612 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:35:01.612 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:35:01.612 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:01.612 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 11, 2024-09-10T08:35:01.612 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:35:01.612 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:35:01.613 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:35:01.613 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:01.613 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:01.613 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:01.613 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:01.613 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:01.613 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:01.613 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:01.613 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:01.613 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:01.613 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:01.613 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:01.613 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:01.614 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:35:01.614 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:35:01.614 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:01.614 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:01.614 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:01.614 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:01.614 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:01.614 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:01.614 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:01.614 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:01.614 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:01.614 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:01.614 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:01.615 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:01.615 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.615 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:35:01.615 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:35:01.615 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:35:01.615 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:35:01.615 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:35:01.615 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:35:01.615 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:35:01.615 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:35:01.615 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:35:01.615 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:35:01.615 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:35:01.616 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:35:01.616 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:35:01.616 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:35:01.616 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:35:01.616 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:35:01.616 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:35:01.616 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:01.616 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:01.616 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:01.616 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:01.616 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:01.616 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:01.616 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:01.617 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:01.617 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:01.617 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:01.617 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:01.617 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:01.617 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:35:01.617 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.617 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:35:01.617 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.617 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:35:01.617 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:35:01.617 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:01.617 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:01.618 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.618 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:01.618 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:35:01.618 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:01.618 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.618 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.618 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:01.618 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:35:01.618 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:01.618 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:01.618 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:01.618 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.618 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:35:01.619 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:35:01.619 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:01.619 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:01.619 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:01.619 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.619 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.619 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:35:01.619 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:35:01.619 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:01.619 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:01.619 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.619 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:01.619 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:35:01.619 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:01.620 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.620 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.620 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:01.620 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:35:01.620 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:01.620 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:01.620 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:01.620 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.620 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:35:01.620 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:35:01.620 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:01.620 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:01.620 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:01.621 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.621 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.621 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:35:01.621 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:35:01.621 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:01.621 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:01.621 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.621 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:01.621 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:35:01.621 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:01.621 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.621 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.621 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:01.622 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:35:01.622 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:01.622 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:01.622 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:01.622 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.622 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:35:01.622 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:35:01.622 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:01.622 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:01.622 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:01.622 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:01.622 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:01.622 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.622 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:35:01.623 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:35:01.623 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.623 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:01.623 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:01.623 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:35:01.623 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:01.623 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:01.623 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:35:01.623 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.623 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:01.623 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:01.623 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:35:01.623 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:01.623 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:01.624 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:35:01.624 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.624 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:01.624 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:01.624 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:35:01.624 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:01.624 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:01.624 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.624 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:35:01.624 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:35:01.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.610+0000 7ff844731640 1 -- 172.21.15.103:0/472271770 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff82006be60 msgr2=0x7ff82006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.610+0000 7ff844731640 1 --2- 172.21.15.103:0/472271770 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff82006be60 0x7ff82006e320 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff834005c00 tx=0x7ff834009040 comp rx=0 tx=0).stop 2024-09-10T08:35:01.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.610+0000 7ff844731640 1 -- 172.21.15.103:0/472271770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c070080 msgr2=0x7ff83c1ea8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.610+0000 7ff844731640 1 --2- 172.21.15.103:0/472271770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff83c070080 0x7ff83c1ea8e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff8380097a0 tx=0x7ff8380046c0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.610+0000 7ff842cce640 1 -- 172.21.15.103:0/472271770 reap_dead start 2024-09-10T08:35:01.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.610+0000 7ff842cce640 1 -- 172.21.15.103:0/472271770 reap_dead start 2024-09-10T08:35:01.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.610+0000 7ff844731640 1 -- 172.21.15.103:0/472271770 shutdown_connections 2024-09-10T08:35:01.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.610+0000 7ff844731640 1 -- 172.21.15.103:0/472271770 >> 172.21.15.103:0/472271770 conn(0x7ff83c0c5550 msgr2=0x7ff83c06cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:01.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.610+0000 7ff844731640 1 -- 172.21.15.103:0/472271770 shutdown_connections 2024-09-10T08:35:01.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.610+0000 7ff844731640 1 -- 172.21.15.103:0/472271770 wait complete. 2024-09-10T08:35:01.627 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:35:01.627 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:35:01.627 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:35:01.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.736+0000 7f9817e23640 1 Processor -- start 2024-09-10T08:35:01.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.736+0000 7f9817e23640 1 -- start start 2024-09-10T08:35:01.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.737+0000 7f9817e23640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9810150480 0x7f98100c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.737+0000 7f9817e23640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f981006c650 0x7f98100c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.737+0000 7f9817e23640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981015a7c0 con 0x7f98100c9c80 2024-09-10T08:35:01.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.737+0000 7f9817e23640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f981006c240 con 0x7f9810150480 2024-09-10T08:35:01.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.737+0000 7f9817e23640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f981015a330 con 0x7f981006c650 2024-09-10T08:35:01.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.737+0000 7f98153be640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f981006c650 0x7f98100c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.737+0000 7f9815bbf640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9810150480 0x7f98100c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.737+0000 7f9815bbf640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9810150480 0x7f98100c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:33842/0 (socket says 172.21.15.103:33842) 2024-09-10T08:35:01.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.737+0000 7f98153be640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f981006c650 0x7f98100c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:43396/0 (socket says 172.21.15.103:43396) 2024-09-10T08:35:01.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.737+0000 7f9815bbf640 1 -- 172.21.15.103:0/3628290122 learned_addr learned my addr 172.21.15.103:0/3628290122 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:01.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.738+0000 7f98153be640 1 -- 172.21.15.103:0/3628290122 >> v2:172.21.15.154:3300/0 conn(0x7f9810150480 msgr2=0x7f98100c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:01.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.738+0000 7f98153be640 1 --2- 172.21.15.103:0/3628290122 >> v2:172.21.15.154:3300/0 conn(0x7f9810150480 0x7f98100c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.738+0000 7f98153be640 1 -- 172.21.15.103:0/3628290122 >> v1:172.21.15.154:6789/0 conn(0x7f98100c9c80 legacy=0x7f98100ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.738+0000 7f98153be640 1 -- 172.21.15.103:0/3628290122 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9810159a00 con 0x7f981006c650 2024-09-10T08:35:01.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.738+0000 7f9815bbf640 1 --2- 172.21.15.103:0/3628290122 >> v2:172.21.15.154:3300/0 conn(0x7f9810150480 0x7f98100c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:35:01.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.738+0000 7f98153be640 1 --2- 172.21.15.103:0/3628290122 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f981006c650 0x7f98100c7fd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f98000097a0 tx=0x7f980002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37ace5fc91ab6ce5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:01.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.738+0000 7f9814bbd640 1 -- 172.21.15.103:0/3628290122 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9800037070 con 0x7f981006c650 2024-09-10T08:35:01.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.739+0000 7f9814bbd640 1 -- 172.21.15.103:0/3628290122 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9800032440 con 0x7f981006c650 2024-09-10T08:35:01.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.739+0000 7f9814bbd640 1 -- 172.21.15.103:0/3628290122 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9800032810 con 0x7f981006c650 2024-09-10T08:35:01.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.739+0000 7f9817e23640 1 -- 172.21.15.103:0/3628290122 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f981006c650 msgr2=0x7f98100c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.739+0000 7f9817e23640 1 --2- 172.21.15.103:0/3628290122 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f981006c650 0x7f98100c7fd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f98000097a0 tx=0x7f980002a180 comp rx=0 tx=0).stop 2024-09-10T08:35:01.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.739+0000 7f9817e23640 1 -- 172.21.15.103:0/3628290122 shutdown_connections 2024-09-10T08:35:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.739+0000 7f9817e23640 1 --2- 172.21.15.103:0/3628290122 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f981006c650 0x7f98100c7fd0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.739+0000 7f9817e23640 1 --2- 172.21.15.103:0/3628290122 >> v2:172.21.15.154:3300/0 conn(0x7f9810150480 0x7f98100c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.739+0000 7f9817e23640 1 -- 172.21.15.103:0/3628290122 >> 172.21.15.103:0/3628290122 conn(0x7f9810068030 msgr2=0x7f9810073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.739+0000 7f9817e23640 1 -- 172.21.15.103:0/3628290122 shutdown_connections 2024-09-10T08:35:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.739+0000 7f9817e23640 1 -- 172.21.15.103:0/3628290122 wait complete. 2024-09-10T08:35:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.741+0000 7f9817e23640 1 Processor -- start 2024-09-10T08:35:01.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.741+0000 7f9817e23640 1 -- start start 2024-09-10T08:35:01.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.741+0000 7f9817e23640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f981006c650 0x7f981014f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.741+0000 7f9817e23640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98100c9c80 0x7f98101ef870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.741+0000 7f9817e23640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9810150480 0x7f98101efdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.742+0000 7f9817e23640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f981006d270 con 0x7f981006c650 2024-09-10T08:35:01.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.742+0000 7f9817e23640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9810159fc0 con 0x7f98100c9c80 2024-09-10T08:35:01.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.742+0000 7f9817e23640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9810156270 con 0x7f9810150480 2024-09-10T08:35:01.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.742+0000 7f9815bbf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f981006c650 0x7f981014f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.742+0000 7f9815bbf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f981006c650 0x7f981014f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34274/0 (socket says 172.21.15.103:34274) 2024-09-10T08:35:01.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.742+0000 7f9815bbf640 1 -- 172.21.15.103:0/3221504762 learned_addr learned my addr 172.21.15.103:0/3221504762 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:01.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.742+0000 7f98153be640 1 --2- 172.21.15.103:0/3221504762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98100c9c80 0x7f98101ef870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.742+0000 7f98163c0640 1 --2- 172.21.15.103:0/3221504762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9810150480 0x7f98101efdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.742+0000 7f98153be640 1 -- 172.21.15.103:0/3221504762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9810150480 msgr2=0x7f98101efdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.742+0000 7f98153be640 1 --2- 172.21.15.103:0/3221504762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9810150480 0x7f98101efdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.742+0000 7f98153be640 1 -- 172.21.15.103:0/3221504762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f981006c650 msgr2=0x7f981014f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.742+0000 7f98153be640 1 --2- 172.21.15.103:0/3221504762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f981006c650 0x7f981014f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.742+0000 7f98153be640 1 -- 172.21.15.103:0/3221504762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98101dfb20 con 0x7f98100c9c80 2024-09-10T08:35:01.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.742+0000 7f9815bbf640 1 --2- 172.21.15.103:0/3221504762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f981006c650 0x7f981014f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:35:01.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.742+0000 7f98153be640 1 --2- 172.21.15.103:0/3221504762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98100c9c80 0x7f98101ef870 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9800031000 tx=0x7f98000046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:01.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.742+0000 7f98067fc640 1 -- 172.21.15.103:0/3221504762 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9800041020 con 0x7f98100c9c80 2024-09-10T08:35:01.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.742+0000 7f98067fc640 1 -- 172.21.15.103:0/3221504762 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9800030700 con 0x7f98100c9c80 2024-09-10T08:35:01.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.742+0000 7f98067fc640 1 -- 172.21.15.103:0/3221504762 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9800037040 con 0x7f98100c9c80 2024-09-10T08:35:01.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.742+0000 7f9817e23640 1 -- 172.21.15.103:0/3221504762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98100aeb80 con 0x7f98100c9c80 2024-09-10T08:35:01.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.743+0000 7f9817e23640 1 -- 172.21.15.103:0/3221504762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98101ef350 con 0x7f98100c9c80 2024-09-10T08:35:01.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.743+0000 7f9817e23640 1 --2- 172.21.15.103:0/3221504762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98101e0650 0x7f9810149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.743+0000 7f9817e23640 1 -- 172.21.15.103:0/3221504762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f98101ef590 con 0x7f98101e0650 2024-09-10T08:35:01.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.743+0000 7f9815bbf640 1 --2- 172.21.15.103:0/3221504762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98101e0650 0x7f9810149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.744+0000 7f9815bbf640 1 -- 172.21.15.103:0/3221504762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f98101df8d0 con 0x7f98101e0650 2024-09-10T08:35:01.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.744+0000 7f9815bbf640 1 --2- 172.21.15.103:0/3221504762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98101e0650 0x7f9810149660 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f980c011cf0 tx=0x7f980c00f610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:01.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.744+0000 7f98067fc640 1 -- 172.21.15.103:0/3221504762 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c004030 con 0x7f98101e0650 2024-09-10T08:35:01.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.744+0000 7f98067fc640 1 -- 172.21.15.103:0/3221504762 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9800044020 con 0x7f98100c9c80 2024-09-10T08:35:01.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.745+0000 7f98067fc640 1 --2- 172.21.15.103:0/3221504762 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f97f406bd30 0x7f97f406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.745+0000 7f98067fc640 1 -- 172.21.15.103:0/3221504762 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f98000ab840 con 0x7f98100c9c80 2024-09-10T08:35:01.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.745+0000 7f98163c0640 1 --2- 172.21.15.103:0/3221504762 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f97f406bd30 0x7f97f406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.745+0000 7f98067fc640 1 -- 172.21.15.103:0/3221504762 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f980c0041d0 con 0x7f98101e0650 2024-09-10T08:35:01.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.745+0000 7f98067fc640 1 -- 172.21.15.103:0/3221504762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98101e0650 msgr2=0x7f9810149660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.745+0000 7f98067fc640 1 --2- 172.21.15.103:0/3221504762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98101e0650 0x7f9810149660 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f980c011cf0 tx=0x7f980c00f610 comp rx=0 tx=0).stop 2024-09-10T08:35:01.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.745+0000 7f98067fc640 1 -- 172.21.15.103:0/3221504762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98101e0650 msgr2=0x7f9810149660 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:35:01.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.745+0000 7f98067fc640 1 --2- 172.21.15.103:0/3221504762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98101e0650 0x7f9810149660 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.745+0000 7f98163c0640 1 --2- 172.21.15.103:0/3221504762 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f97f406bd30 0x7f97f406e1f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f981014a490 tx=0x7f9808009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:01.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.751+0000 7f9817e23640 1 --2- 172.21.15.103:0/3221504762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9810149ba0 0x7f98101e2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.751+0000 7f9817e23640 1 -- 172.21.15.103:0/3221504762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f98100ca130 con 0x7f9810149ba0 2024-09-10T08:35:01.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.752+0000 7f9815bbf640 1 --2- 172.21.15.103:0/3221504762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9810149ba0 0x7f98101e2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.752+0000 7f9815bbf640 1 -- 172.21.15.103:0/3221504762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f981006c430 con 0x7f9810149ba0 2024-09-10T08:35:01.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.752+0000 7f9815bbf640 1 --2- 172.21.15.103:0/3221504762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9810149ba0 0x7f98101e2c60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f980c011cf0 tx=0x7f980c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:01.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.752+0000 7f98067fc640 1 -- 172.21.15.103:0/3221504762 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c014ba0 con 0x7f9810149ba0 2024-09-10T08:35:01.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.753+0000 7f98067fc640 1 -- 172.21.15.103:0/3221504762 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f980c0133a0 con 0x7f9810149ba0 2024-09-10T08:35:01.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.753+0000 7f98067fc640 1 -- 172.21.15.103:0/3221504762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9810149ba0 msgr2=0x7f98101e2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.753+0000 7f98067fc640 1 --2- 172.21.15.103:0/3221504762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9810149ba0 0x7f98101e2c60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f980c011cf0 tx=0x7f980c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.753+0000 7f98067fc640 1 -- 172.21.15.103:0/3221504762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9810149ba0 msgr2=0x7f98101e2c60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:35:01.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.753+0000 7f98067fc640 1 --2- 172.21.15.103:0/3221504762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9810149ba0 0x7f98101e2c60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.754 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:35:01.754 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:35:01.754 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:35:01.754 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:35:01.754 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 52, 2024-09-10T08:35:01.755 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 17510, 2024-09-10T08:35:01.755 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:35:01.755 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:35:01.755 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:35:01.755 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:35:01.755 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:01.755 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 11, 2024-09-10T08:35:01.755 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:35:01.755 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:35:01.755 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:35:01.755 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:01.755 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:01.755 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:01.755 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:01.756 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:01.756 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:01.756 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:01.756 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:01.756 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:01.756 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:01.756 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:01.756 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:01.756 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:35:01.756 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:35:01.756 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:01.756 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:01.756 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:01.757 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:01.757 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:01.757 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:01.757 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:01.757 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:01.757 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:01.757 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:01.757 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:01.757 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:01.757 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.757 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:35:01.757 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:35:01.757 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:35:01.758 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:35:01.758 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:35:01.758 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:35:01.758 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:35:01.758 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:35:01.758 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:35:01.758 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:35:01.758 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:35:01.758 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:35:01.758 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:35:01.758 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:35:01.758 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:35:01.758 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:35:01.758 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:35:01.759 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:01.759 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:01.759 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:01.759 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:01.759 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:01.759 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:01.759 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:01.759 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:01.759 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:01.759 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:01.759 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:01.759 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:01.759 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:35:01.760 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.760 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:35:01.760 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.760 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:35:01.760 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:35:01.760 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:01.760 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:01.760 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.760 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:01.760 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:35:01.760 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:01.760 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.760 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.761 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:01.761 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:35:01.761 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:01.761 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:01.761 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:01.761 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.761 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:35:01.761 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:35:01.761 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:01.761 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:01.761 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:01.761 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.761 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.761 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:35:01.762 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:35:01.762 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:01.762 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:01.762 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.762 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:01.762 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:35:01.762 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:01.762 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.762 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.762 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:01.762 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:35:01.762 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:01.763 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:01.763 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:01.763 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.763 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:35:01.763 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:35:01.763 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:01.763 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:01.763 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:01.763 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.763 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.763 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:35:01.763 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:35:01.763 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:01.763 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:01.764 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.764 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:01.764 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:35:01.764 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:01.764 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.764 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.764 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:01.764 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:35:01.764 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:01.764 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:01.764 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:01.764 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.764 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:35:01.764 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:35:01.765 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:01.765 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:01.765 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:01.765 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:01.765 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:01.765 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.765 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:35:01.765 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:35:01.765 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.765 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:01.765 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:01.765 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:35:01.765 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:01.766 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:01.766 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:35:01.766 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.766 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:01.766 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:01.766 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:35:01.766 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:01.766 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:01.766 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.766 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:35:01.766 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:35:01.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.753+0000 7f9817e23640 1 -- 172.21.15.103:0/3221504762 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f97f406bd30 msgr2=0x7f97f406e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.753+0000 7f9817e23640 1 --2- 172.21.15.103:0/3221504762 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f97f406bd30 0x7f97f406e1f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f981014a490 tx=0x7f9808009040 comp rx=0 tx=0).stop 2024-09-10T08:35:01.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.753+0000 7f9817e23640 1 -- 172.21.15.103:0/3221504762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98100c9c80 msgr2=0x7f98101ef870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.753+0000 7f9817e23640 1 --2- 172.21.15.103:0/3221504762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98100c9c80 0x7f98101ef870 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9800031000 tx=0x7f98000046c0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.753+0000 7f98163c0640 1 -- 172.21.15.103:0/3221504762 reap_dead start 2024-09-10T08:35:01.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.753+0000 7f98163c0640 1 -- 172.21.15.103:0/3221504762 reap_dead start 2024-09-10T08:35:01.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.753+0000 7f9817e23640 1 -- 172.21.15.103:0/3221504762 shutdown_connections 2024-09-10T08:35:01.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.753+0000 7f9817e23640 1 -- 172.21.15.103:0/3221504762 >> 172.21.15.103:0/3221504762 conn(0x7f9810068030 msgr2=0x7f9810073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:01.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.753+0000 7f9817e23640 1 -- 172.21.15.103:0/3221504762 shutdown_connections 2024-09-10T08:35:01.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.753+0000 7f9817e23640 1 -- 172.21.15.103:0/3221504762 wait complete. 2024-09-10T08:35:01.768 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:35:01.769 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:35:01.769 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:35:01.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.883+0000 7f794b9fd640 1 Processor -- start 2024-09-10T08:35:01.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.884+0000 7f794b9fd640 1 -- start start 2024-09-10T08:35:01.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.885+0000 7f794b9fd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f794406c650 0x7f79440c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.885+0000 7f794b9fd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f79440ca1c0 0x7f7944160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.885+0000 7f794b9fd640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f794415a7c0 con 0x7f7944150480 2024-09-10T08:35:01.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.885+0000 7f794b9fd640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f794406c240 con 0x7f794406c650 2024-09-10T08:35:01.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.885+0000 7f794b9fd640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f794415a330 con 0x7f79440ca1c0 2024-09-10T08:35:01.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.885+0000 7f7948f98640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f794406c650 0x7f79440c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.885+0000 7f7948f98640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f794406c650 0x7f79440c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34288/0 (socket says 172.21.15.103:34288) 2024-09-10T08:35:01.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.885+0000 7f7949799640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7944150480 0x7f79440c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:45242/0 (socket says 172.21.15.103:45242) 2024-09-10T08:35:01.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.885+0000 7f7948f98640 1 -- 172.21.15.103:0/1414016806 learned_addr learned my addr 172.21.15.103:0/1414016806 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:01.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.885+0000 7f7949f9a640 1 --2- 172.21.15.103:0/1414016806 >> v2:172.21.15.154:3300/0 conn(0x7f79440ca1c0 0x7f7944160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.885+0000 7f7948f98640 1 -- 172.21.15.103:0/1414016806 >> v2:172.21.15.154:3300/0 conn(0x7f79440ca1c0 msgr2=0x7f7944160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:01.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.885+0000 7f7948f98640 1 --2- 172.21.15.103:0/1414016806 >> v2:172.21.15.154:3300/0 conn(0x7f79440ca1c0 0x7f7944160bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.885+0000 7f7948f98640 1 -- 172.21.15.103:0/1414016806 >> v1:172.21.15.154:6789/0 conn(0x7f7944150480 legacy=0x7f79440c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.885+0000 7f7948f98640 1 -- 172.21.15.103:0/1414016806 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7944159a00 con 0x7f794406c650 2024-09-10T08:35:01.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.886+0000 7f7948f98640 1 --2- 172.21.15.103:0/1414016806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f794406c650 0x7f79440c9c80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f794406bc70 tx=0x7f793402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f634cc1c2fcce1c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:01.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.886+0000 7f793bfff640 1 -- 172.21.15.103:0/1414016806 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934037070 con 0x7f794406c650 2024-09-10T08:35:01.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.886+0000 7f793bfff640 1 -- 172.21.15.103:0/1414016806 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7934032440 con 0x7f794406c650 2024-09-10T08:35:01.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.886+0000 7f793bfff640 1 -- 172.21.15.103:0/1414016806 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934032810 con 0x7f794406c650 2024-09-10T08:35:01.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.887+0000 7f794b9fd640 1 -- 172.21.15.103:0/1414016806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f794406c650 msgr2=0x7f79440c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.887+0000 7f794b9fd640 1 --2- 172.21.15.103:0/1414016806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f794406c650 0x7f79440c9c80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f794406bc70 tx=0x7f793402a270 comp rx=0 tx=0).stop 2024-09-10T08:35:01.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.887+0000 7f794b9fd640 1 -- 172.21.15.103:0/1414016806 shutdown_connections 2024-09-10T08:35:01.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.887+0000 7f794b9fd640 1 --2- 172.21.15.103:0/1414016806 >> v2:172.21.15.154:3300/0 conn(0x7f79440ca1c0 0x7f7944160bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.887+0000 7f794b9fd640 1 --2- 172.21.15.103:0/1414016806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f794406c650 0x7f79440c9c80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.887+0000 7f794b9fd640 1 -- 172.21.15.103:0/1414016806 >> 172.21.15.103:0/1414016806 conn(0x7f7944068030 msgr2=0x7f7944073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:01.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.887+0000 7f794b9fd640 1 -- 172.21.15.103:0/1414016806 shutdown_connections 2024-09-10T08:35:01.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.887+0000 7f794b9fd640 1 -- 172.21.15.103:0/1414016806 wait complete. 2024-09-10T08:35:01.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.888+0000 7f794b9fd640 1 Processor -- start 2024-09-10T08:35:01.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.888+0000 7f794b9fd640 1 -- start start 2024-09-10T08:35:01.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.889+0000 7f794b9fd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f794406c650 0x7f79441586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.889+0000 7f794b9fd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79440ca1c0 0x7f7944150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.889+0000 7f794b9fd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7944150480 0x7f79441ef2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.889+0000 7f794b9fd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f794406d270 con 0x7f79440ca1c0 2024-09-10T08:35:01.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.889+0000 7f794b9fd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7944159fc0 con 0x7f794406c650 2024-09-10T08:35:01.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.889+0000 7f794b9fd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f79440ca5f0 con 0x7f7944150480 2024-09-10T08:35:01.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.889+0000 7f7948f98640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79440ca1c0 0x7f7944150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.889+0000 7f7949799640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f794406c650 0x7f79441586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.889+0000 7f7948f98640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79440ca1c0 0x7f7944150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34304/0 (socket says 172.21.15.103:34304) 2024-09-10T08:35:01.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.889+0000 7f7948f98640 1 -- 172.21.15.103:0/2556355525 learned_addr learned my addr 172.21.15.103:0/2556355525 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:01.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.889+0000 7f7949f9a640 1 --2- 172.21.15.103:0/2556355525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7944150480 0x7f79441ef2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.890+0000 7f7948f98640 1 -- 172.21.15.103:0/2556355525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7944150480 msgr2=0x7f79441ef2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.890+0000 7f7948f98640 1 --2- 172.21.15.103:0/2556355525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7944150480 0x7f79441ef2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.890+0000 7f7948f98640 1 -- 172.21.15.103:0/2556355525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f794406c650 msgr2=0x7f79441586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.890+0000 7f7948f98640 1 --2- 172.21.15.103:0/2556355525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f794406c650 0x7f79441586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.890+0000 7f7948f98640 1 -- 172.21.15.103:0/2556355525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79441e16a0 con 0x7f79440ca1c0 2024-09-10T08:35:01.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.890+0000 7f7948f98640 1 --2- 172.21.15.103:0/2556355525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79440ca1c0 0x7f7944150d80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7934000c00 tx=0x7f79340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:01.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.890+0000 7f7939ffb640 1 -- 172.21.15.103:0/2556355525 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934037040 con 0x7f79440ca1c0 2024-09-10T08:35:01.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.890+0000 7f7939ffb640 1 -- 172.21.15.103:0/2556355525 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7934042070 con 0x7f79440ca1c0 2024-09-10T08:35:01.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.890+0000 7f794b9fd640 1 -- 172.21.15.103:0/2556355525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79441e20d0 con 0x7f79440ca1c0 2024-09-10T08:35:01.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.890+0000 7f7939ffb640 1 -- 172.21.15.103:0/2556355525 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934030880 con 0x7f79440ca1c0 2024-09-10T08:35:01.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.890+0000 7f794b9fd640 1 -- 172.21.15.103:0/2556355525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79441e2690 con 0x7f79440ca1c0 2024-09-10T08:35:01.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.891+0000 7f794b9fd640 1 --2- 172.21.15.103:0/2556355525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79441512c0 0x7f794414ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.891+0000 7f794b9fd640 1 -- 172.21.15.103:0/2556355525 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7944150aa0 con 0x7f79441512c0 2024-09-10T08:35:01.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.892+0000 7f7949799640 1 --2- 172.21.15.103:0/2556355525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79441512c0 0x7f794414ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.892+0000 7f7949799640 1 -- 172.21.15.103:0/2556355525 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7944156270 con 0x7f79441512c0 2024-09-10T08:35:01.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.892+0000 7f7939ffb640 1 -- 172.21.15.103:0/2556355525 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7934030a20 con 0x7f79440ca1c0 2024-09-10T08:35:01.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.892+0000 7f7949799640 1 --2- 172.21.15.103:0/2556355525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79441512c0 0x7f794414ee20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f79400014e0 tx=0x7f79400019a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:01.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.892+0000 7f7939ffb640 1 --2- 172.21.15.103:0/2556355525 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f792806be30 0x7f792806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.892+0000 7f7939ffb640 1 -- 172.21.15.103:0/2556355525 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f79340ab8d0 con 0x7f79440ca1c0 2024-09-10T08:35:01.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.892+0000 7f7949f9a640 1 --2- 172.21.15.103:0/2556355525 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f792806be30 0x7f792806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.893+0000 7f7939ffb640 1 -- 172.21.15.103:0/2556355525 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79400115b0 con 0x7f79441512c0 2024-09-10T08:35:01.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.893+0000 7f7939ffb640 1 -- 172.21.15.103:0/2556355525 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7940018070 con 0x7f79441512c0 2024-09-10T08:35:01.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.893+0000 7f7939ffb640 1 -- 172.21.15.103:0/2556355525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79441512c0 msgr2=0x7f794414ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.893+0000 7f7939ffb640 1 --2- 172.21.15.103:0/2556355525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79441512c0 0x7f794414ee20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f79400014e0 tx=0x7f79400019a0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.893+0000 7f7939ffb640 1 -- 172.21.15.103:0/2556355525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79441512c0 msgr2=0x7f794414ee20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:35:01.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.893+0000 7f7939ffb640 1 --2- 172.21.15.103:0/2556355525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79441512c0 0x7f794414ee20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.893+0000 7f7949f9a640 1 --2- 172.21.15.103:0/2556355525 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f792806be30 0x7f792806e2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f79441573b0 tx=0x7f793c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:01.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.900+0000 7f794b9fd640 1 --2- 172.21.15.103:0/2556355525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79441ef7f0 0x7f794414f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:01.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.900+0000 7f794b9fd640 1 -- 172.21.15.103:0/2556355525 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f79440cc230 con 0x7f79441ef7f0 2024-09-10T08:35:01.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.901+0000 7f7949799640 1 --2- 172.21.15.103:0/2556355525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79441ef7f0 0x7f794414f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:01.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.901+0000 7f7949799640 1 -- 172.21.15.103:0/2556355525 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7944158c30 con 0x7f79441ef7f0 2024-09-10T08:35:01.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.901+0000 7f7949799640 1 --2- 172.21.15.103:0/2556355525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79441ef7f0 0x7f794414f360 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f79400014e0 tx=0x7f7940007f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:01.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.902+0000 7f7939ffb640 1 -- 172.21.15.103:0/2556355525 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7940026410 con 0x7f79441ef7f0 2024-09-10T08:35:01.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.902+0000 7f7939ffb640 1 -- 172.21.15.103:0/2556355525 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f7940026410 con 0x7f79441ef7f0 2024-09-10T08:35:01.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.902+0000 7f7939ffb640 1 -- 172.21.15.103:0/2556355525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79441ef7f0 msgr2=0x7f794414f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.902+0000 7f7939ffb640 1 --2- 172.21.15.103:0/2556355525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79441ef7f0 0x7f794414f360 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f79400014e0 tx=0x7f7940007f90 comp rx=0 tx=0).stop 2024-09-10T08:35:01.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.902+0000 7f7939ffb640 1 -- 172.21.15.103:0/2556355525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79441ef7f0 msgr2=0x7f794414f360 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:35:01.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.902+0000 7f7939ffb640 1 --2- 172.21.15.103:0/2556355525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79441ef7f0 0x7f794414f360 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f79400014e0 tx=0x7f7940007f90 comp rx=0 tx=0).stop 2024-09-10T08:35:01.904 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:35:01.904 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:35:01.904 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:35:01.904 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:35:01.904 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 52, 2024-09-10T08:35:01.904 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 246062, 2024-09-10T08:35:01.904 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:35:01.904 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:35:01.904 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:35:01.904 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:35:01.904 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:01.904 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 12, 2024-09-10T08:35:01.905 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:35:01.905 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:35:01.905 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:35:01.905 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:01.905 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:01.905 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:01.905 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:01.905 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:01.905 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:01.905 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:01.905 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:01.905 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:01.905 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:01.905 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:01.906 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:01.906 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:35:01.906 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:35:01.906 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:01.906 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:01.906 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:01.906 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:01.906 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:01.906 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:01.906 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:01.906 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:01.906 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:01.906 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:01.907 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:01.907 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:01.907 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.907 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:35:01.907 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:35:01.907 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:35:01.907 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:35:01.907 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:35:01.907 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:35:01.907 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:35:01.907 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:35:01.907 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:35:01.907 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:35:01.908 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:35:01.908 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:35:01.908 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:35:01.908 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:35:01.908 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:35:01.908 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:35:01.908 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:35:01.908 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:01.908 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:01.908 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:01.908 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:01.908 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:01.908 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:01.909 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:01.909 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:01.909 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:01.909 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:01.909 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:01.909 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:01.909 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:35:01.909 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.909 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:35:01.909 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.909 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:35:01.909 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:35:01.909 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:01.909 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:01.910 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.910 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:01.910 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:35:01.910 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:01.910 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.910 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.910 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:01.910 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:35:01.910 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:01.910 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:01.910 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:01.910 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.910 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:35:01.910 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:35:01.911 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:01.911 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:01.911 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:01.911 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.911 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.911 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:35:01.911 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:35:01.911 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:01.911 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:01.911 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.911 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:01.911 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:35:01.911 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:01.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.912 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.912 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:01.912 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:35:01.912 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:01.912 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:01.912 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:01.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.912 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:35:01.912 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:35:01.912 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:01.912 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:01.912 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:01.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.913 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.913 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:35:01.913 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:35:01.913 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:01.913 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:01.913 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.913 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:01.913 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:35:01.913 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:01.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.913 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.913 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:01.913 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:35:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:35:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:35:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.914 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:35:01.915 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:35:01.915 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.915 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:01.915 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:01.915 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:35:01.915 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:01.915 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:01.915 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:35:01.915 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.915 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:01.915 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:01.915 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:35:01.915 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:01.916 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:01.916 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:35:01.916 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.916 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:01.916 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:01.916 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 8 2024-09-10T08:35:01.916 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:01.916 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:01.916 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:35:01.916 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.916 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:01.916 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:01.916 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:35:01.916 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:01.917 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:01.917 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:35:01.917 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:01.917 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:01.917 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:01.917 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:35:01.917 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:01.917 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:01.917 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:01.917 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:35:01.917 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:35:01.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.903+0000 7f794b9fd640 1 -- 172.21.15.103:0/2556355525 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f792806be30 msgr2=0x7f792806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.903+0000 7f794b9fd640 1 --2- 172.21.15.103:0/2556355525 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f792806be30 0x7f792806e2f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f79441573b0 tx=0x7f793c00b040 comp rx=0 tx=0).stop 2024-09-10T08:35:01.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.903+0000 7f794b9fd640 1 -- 172.21.15.103:0/2556355525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79440ca1c0 msgr2=0x7f7944150d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:01.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.903+0000 7f794b9fd640 1 --2- 172.21.15.103:0/2556355525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79440ca1c0 0x7f7944150d80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7934000c00 tx=0x7f79340046c0 comp rx=0 tx=0).stop 2024-09-10T08:35:01.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.903+0000 7f7949f9a640 1 -- 172.21.15.103:0/2556355525 reap_dead start 2024-09-10T08:35:01.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.903+0000 7f7949f9a640 1 -- 172.21.15.103:0/2556355525 reap_dead start 2024-09-10T08:35:01.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.903+0000 7f794b9fd640 1 -- 172.21.15.103:0/2556355525 shutdown_connections 2024-09-10T08:35:01.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.903+0000 7f794b9fd640 1 -- 172.21.15.103:0/2556355525 >> 172.21.15.103:0/2556355525 conn(0x7f7944068030 msgr2=0x7f79440c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:01.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.903+0000 7f794b9fd640 1 -- 172.21.15.103:0/2556355525 shutdown_connections 2024-09-10T08:35:01.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:01.903+0000 7f794b9fd640 1 -- 172.21.15.103:0/2556355525 wait complete. 2024-09-10T08:35:01.920 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:35:01.920 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-09-10T08:35:01.920 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-10T08:35:01.920 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-10T08:35:01.920 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-10T08:35:01.920 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T08:35:01.920 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:35:01.934 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T08:35:01.934 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-10T08:35:01.934 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:35:02.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.034+0000 7feeac5c4640 1 Processor -- start 2024-09-10T08:35:02.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.034+0000 7feeac5c4640 1 -- start start 2024-09-10T08:35:02.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.036+0000 7feeac5c4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7feea40c8b10 0x7feea415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:02.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.036+0000 7feeac5c4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea406cd80 0x7feea41534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:02.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.036+0000 7feeac5c4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feea4153a10 0x7feea4156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:02.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.036+0000 7feeac5c4640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7feea40c7070 con 0x7feea40c8b10 2024-09-10T08:35:02.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.036+0000 7feeac5c4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7feea406d210 con 0x7feea4153a10 2024-09-10T08:35:02.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.036+0000 7feeac5c4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7feea40c69b0 con 0x7feea406cd80 2024-09-10T08:35:02.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.036+0000 7feea9b5f640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea406cd80 msgr2=0x7feea41534d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:35:02.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.036+0000 7feea9b5f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea406cd80 0x7feea41534d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:35:02.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.036+0000 7feeaa360640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7feea40c8b10 0x7feea415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:02.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.036+0000 7feeaa360640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7feea40c8b10 0x7feea415a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34384/0 (socket says 172.21.15.103:34384) 2024-09-10T08:35:02.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.036+0000 7feeaa360640 1 -- 172.21.15.103:0/730144150 learned_addr learned my addr 172.21.15.103:0/730144150 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:02.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.036+0000 7feeaab61640 1 --2- 172.21.15.103:0/730144150 >> v2:172.21.15.154:3300/0 conn(0x7feea4153a10 0x7feea4156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:02.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.036+0000 7feeaa360640 1 -- 172.21.15.103:0/730144150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea406cd80 msgr2=0x7feea41534d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:35:02.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.036+0000 7feeaa360640 1 --2- 172.21.15.103:0/730144150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea406cd80 0x7feea41534d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:02.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.036+0000 7feeaa360640 1 -- 172.21.15.103:0/730144150 >> v2:172.21.15.154:3300/0 conn(0x7feea4153a10 msgr2=0x7feea4156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:02.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.036+0000 7feeaa360640 1 --2- 172.21.15.103:0/730144150 >> v2:172.21.15.154:3300/0 conn(0x7feea4153a10 0x7feea4156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:02.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.036+0000 7feeaa360640 1 -- 172.21.15.103:0/730144150 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea40c6c90 con 0x7feea40c8b10 2024-09-10T08:35:02.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.037+0000 7feeaa360640 1 --2- 172.21.15.103:0/730144150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea40c8b10 0x7feea415a4a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feea40cbe60 tx=0x7feea002a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3925080877d169df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:02.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.037+0000 7feea935e640 1 -- 172.21.15.103:0/730144150 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea0037070 con 0x7feea40c8b10 2024-09-10T08:35:02.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.037+0000 7feea935e640 1 -- 172.21.15.103:0/730144150 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea0032440 con 0x7feea40c8b10 2024-09-10T08:35:02.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.037+0000 7feea935e640 1 -- 172.21.15.103:0/730144150 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea0032810 con 0x7feea40c8b10 2024-09-10T08:35:02.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.038+0000 7feeac5c4640 1 -- 172.21.15.103:0/730144150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea40c8b10 msgr2=0x7feea415a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:02.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.038+0000 7feeac5c4640 1 --2- 172.21.15.103:0/730144150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea40c8b10 0x7feea415a4a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feea40cbe60 tx=0x7feea002a160 comp rx=0 tx=0).stop 2024-09-10T08:35:02.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.038+0000 7feeac5c4640 1 -- 172.21.15.103:0/730144150 shutdown_connections 2024-09-10T08:35:02.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.038+0000 7feeac5c4640 1 --2- 172.21.15.103:0/730144150 >> v2:172.21.15.154:3300/0 conn(0x7feea4153a10 0x7feea4156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:02.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.038+0000 7feeac5c4640 1 --2- 172.21.15.103:0/730144150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea406cd80 0x7feea41534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:02.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.038+0000 7feeac5c4640 1 --2- 172.21.15.103:0/730144150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea40c8b10 0x7feea415a4a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:02.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.038+0000 7feeac5c4640 1 -- 172.21.15.103:0/730144150 >> 172.21.15.103:0/730144150 conn(0x7feea40adb80 msgr2=0x7feea40adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:02.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.038+0000 7feeac5c4640 1 -- 172.21.15.103:0/730144150 shutdown_connections 2024-09-10T08:35:02.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.038+0000 7feeac5c4640 1 -- 172.21.15.103:0/730144150 wait complete. 2024-09-10T08:35:02.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.039+0000 7feeac5c4640 1 Processor -- start 2024-09-10T08:35:02.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.039+0000 7feeac5c4640 1 -- start start 2024-09-10T08:35:02.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.040+0000 7feeac5c4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea40c8b10 0x7feea40cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:02.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.040+0000 7feeac5c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea4153a10 0x7feea414fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:02.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.040+0000 7feeac5c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feea40cbc40 0x7feea414ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:02.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.040+0000 7feeac5c4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feea4154020 con 0x7feea4153a10 2024-09-10T08:35:02.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.040+0000 7feeac5c4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feea4153ea0 con 0x7feea40cbc40 2024-09-10T08:35:02.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.040+0000 7feeac5c4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7feea40c8ef0 con 0x7feea40c8b10 2024-09-10T08:35:02.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.040+0000 7feeaa360640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea40c8b10 msgr2=0x7feea40cb700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:35:02.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.040+0000 7feeaa360640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea40c8b10 0x7feea40cb700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:35:02.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.040+0000 7feea9b5f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea4153a10 0x7feea414fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:02.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.040+0000 7feea9b5f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea4153a10 0x7feea414fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34388/0 (socket says 172.21.15.103:34388) 2024-09-10T08:35:02.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.040+0000 7feea9b5f640 1 -- 172.21.15.103:0/817083437 learned_addr learned my addr 172.21.15.103:0/817083437 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:02.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.040+0000 7feeaab61640 1 --2- 172.21.15.103:0/817083437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feea40cbc40 0x7feea414ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:02.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.040+0000 7feea9b5f640 1 -- 172.21.15.103:0/817083437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea40c8b10 msgr2=0x7feea40cb700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:35:02.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.040+0000 7feea9b5f640 1 --2- 172.21.15.103:0/817083437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea40c8b10 0x7feea40cb700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:02.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.040+0000 7feea9b5f640 1 -- 172.21.15.103:0/817083437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feea40cbc40 msgr2=0x7feea414ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:02.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.040+0000 7feea9b5f640 1 --2- 172.21.15.103:0/817083437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feea40cbc40 0x7feea414ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:02.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.040+0000 7feea9b5f640 1 -- 172.21.15.103:0/817083437 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea414db10 con 0x7feea4153a10 2024-09-10T08:35:02.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.040+0000 7feea9b5f640 1 --2- 172.21.15.103:0/817083437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea4153a10 0x7feea414fa50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fee9400b4d0 tx=0x7fee9400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:02.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.040+0000 7fee9affd640 1 -- 172.21.15.103:0/817083437 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee94003bc0 con 0x7feea4153a10 2024-09-10T08:35:02.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.040+0000 7fee9affd640 1 -- 172.21.15.103:0/817083437 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee94015070 con 0x7feea4153a10 2024-09-10T08:35:02.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.040+0000 7feeac5c4640 1 -- 172.21.15.103:0/817083437 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea414ddf0 con 0x7feea4153a10 2024-09-10T08:35:02.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.040+0000 7fee9affd640 1 -- 172.21.15.103:0/817083437 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee94005070 con 0x7feea4153a10 2024-09-10T08:35:02.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.041+0000 7feeac5c4640 1 -- 172.21.15.103:0/817083437 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea414e3b0 con 0x7feea4153a10 2024-09-10T08:35:02.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.042+0000 7feeac5c4640 1 -- 172.21.15.103:0/817083437 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feea41534d0 con 0x7feea4153a10 2024-09-10T08:35:02.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.042+0000 7fee9affd640 1 -- 172.21.15.103:0/817083437 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee94005210 con 0x7feea4153a10 2024-09-10T08:35:02.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.043+0000 7fee9affd640 1 --2- 172.21.15.103:0/817083437 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fee8806bde0 0x7fee8806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:02.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.043+0000 7feeaa360640 1 --2- 172.21.15.103:0/817083437 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fee8806bde0 0x7fee8806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:02.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.043+0000 7fee9affd640 1 -- 172.21.15.103:0/817083437 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fee9408aa60 con 0x7feea4153a10 2024-09-10T08:35:02.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.043+0000 7feeaa360640 1 --2- 172.21.15.103:0/817083437 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fee8806bde0 0x7fee8806e2a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7feea0034000 tx=0x7feea002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:02.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.048+0000 7fee9affd640 1 -- 172.21.15.103:0/817083437 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee94059100 con 0x7feea4153a10 2024-09-10T08:35:02.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.330+0000 7feeac5c4640 1 -- 172.21.15.103:0/817083437 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7feea40c9d90 con 0x7feea4153a10 2024-09-10T08:35:02.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.331+0000 7fee9affd640 1 -- 172.21.15.103:0/817083437 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fee94058a00 con 0x7feea4153a10 2024-09-10T08:35:02.331 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:35:02.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.333+0000 7feeac5c4640 1 -- 172.21.15.103:0/817083437 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fee8806bde0 msgr2=0x7fee8806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:02.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.333+0000 7feeac5c4640 1 --2- 172.21.15.103:0/817083437 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fee8806bde0 0x7fee8806e2a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7feea0034000 tx=0x7feea002e000 comp rx=0 tx=0).stop 2024-09-10T08:35:02.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.333+0000 7feeac5c4640 1 -- 172.21.15.103:0/817083437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea4153a10 msgr2=0x7feea414fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:02.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.333+0000 7feeac5c4640 1 --2- 172.21.15.103:0/817083437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea4153a10 0x7feea414fa50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fee9400b4d0 tx=0x7fee9400b990 comp rx=0 tx=0).stop 2024-09-10T08:35:02.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.333+0000 7feeac5c4640 1 -- 172.21.15.103:0/817083437 shutdown_connections 2024-09-10T08:35:02.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.333+0000 7feeac5c4640 1 --2- 172.21.15.103:0/817083437 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fee8806bde0 0x7fee8806e2a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:02.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.333+0000 7feeac5c4640 1 --2- 172.21.15.103:0/817083437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feea40cbc40 0x7feea414ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:02.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.333+0000 7feeac5c4640 1 --2- 172.21.15.103:0/817083437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea4153a10 0x7feea414fa50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:02.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.333+0000 7feeac5c4640 1 --2- 172.21.15.103:0/817083437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feea40c8b10 0x7feea40cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:02.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.333+0000 7feeac5c4640 1 -- 172.21.15.103:0/817083437 >> 172.21.15.103:0/817083437 conn(0x7feea40adb80 msgr2=0x7feea40ad3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:02.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.333+0000 7feeac5c4640 1 -- 172.21.15.103:0/817083437 shutdown_connections 2024-09-10T08:35:02.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:02.333+0000 7feeac5c4640 1 -- 172.21.15.103:0/817083437 wait complete. 2024-09-10T08:35:05.344 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:35:05.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.459+0000 7f00ee949640 1 Processor -- start 2024-09-10T08:35:05.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.459+0000 7f00ee949640 1 -- start start 2024-09-10T08:35:05.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.460+0000 7f00ee949640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00e80c8b10 0x7f00e815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:05.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.460+0000 7f00ee949640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f00e806cd80 0x7f00e81534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:05.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.460+0000 7f00ee949640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00e80c7070 con 0x7f00e8153a10 2024-09-10T08:35:05.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.460+0000 7f00ee949640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f00e806d210 con 0x7f00e806cd80 2024-09-10T08:35:05.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.460+0000 7f00ee949640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f00e80c69b0 con 0x7f00e80c8b10 2024-09-10T08:35:05.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.460+0000 7f00e7fff640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00e80c8b10 msgr2=0x7f00e815a4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:35:05.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.460+0000 7f00e7fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00e80c8b10 0x7f00e815a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:35:05.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.460+0000 7f00e77fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f00e806cd80 0x7f00e81534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:05.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.460+0000 7f00e77fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f00e806cd80 0x7f00e81534d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36862/0 (socket says 172.21.15.103:36862) 2024-09-10T08:35:05.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.460+0000 7f00e77fe640 1 -- 172.21.15.103:0/4243315261 learned_addr learned my addr 172.21.15.103:0/4243315261 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:05.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.460+0000 7f00e77fe640 1 -- 172.21.15.103:0/4243315261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00e80c8b10 msgr2=0x7f00e815a4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:35:05.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.460+0000 7f00e77fe640 1 --2- 172.21.15.103:0/4243315261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00e80c8b10 0x7f00e815a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:05.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.460+0000 7f00e77fe640 1 -- 172.21.15.103:0/4243315261 >> v1:172.21.15.103:6789/0 conn(0x7f00e8153a10 legacy=0x7f00e8156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:05.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.460+0000 7f00e77fe640 1 -- 172.21.15.103:0/4243315261 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e80c6c90 con 0x7f00e806cd80 2024-09-10T08:35:05.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.461+0000 7f00e77fe640 1 --2- 172.21.15.103:0/4243315261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00e806cd80 0x7f00e81534d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009870 tx=0x7f00dc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ab6cdd944593f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:05.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.461+0000 7f00e6ffd640 1 -- 172.21.15.103:0/4243315261 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc037070 con 0x7f00e806cd80 2024-09-10T08:35:05.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.461+0000 7f00e6ffd640 1 -- 172.21.15.103:0/4243315261 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00dc032440 con 0x7f00e806cd80 2024-09-10T08:35:05.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.461+0000 7f00e6ffd640 1 -- 172.21.15.103:0/4243315261 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc032810 con 0x7f00e806cd80 2024-09-10T08:35:05.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.462+0000 7f00ee949640 1 -- 172.21.15.103:0/4243315261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00e806cd80 msgr2=0x7f00e81534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:05.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.462+0000 7f00ee949640 1 --2- 172.21.15.103:0/4243315261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00e806cd80 0x7f00e81534d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009870 tx=0x7f00dc02a1e0 comp rx=0 tx=0).stop 2024-09-10T08:35:05.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.462+0000 7f00ee949640 1 -- 172.21.15.103:0/4243315261 shutdown_connections 2024-09-10T08:35:05.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.462+0000 7f00ee949640 1 --2- 172.21.15.103:0/4243315261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00e806cd80 0x7f00e81534d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:05.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.462+0000 7f00ee949640 1 --2- 172.21.15.103:0/4243315261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00e80c8b10 0x7f00e815a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:05.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.462+0000 7f00ee949640 1 -- 172.21.15.103:0/4243315261 >> 172.21.15.103:0/4243315261 conn(0x7f00e80adb80 msgr2=0x7f00e80adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:05.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.462+0000 7f00ee949640 1 -- 172.21.15.103:0/4243315261 shutdown_connections 2024-09-10T08:35:05.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.462+0000 7f00ee949640 1 -- 172.21.15.103:0/4243315261 wait complete. 2024-09-10T08:35:05.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.463+0000 7f00ee949640 1 Processor -- start 2024-09-10T08:35:05.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.463+0000 7f00ee949640 1 -- start start 2024-09-10T08:35:05.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.464+0000 7f00ee949640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00e80c8b10 0x7f00e81ef390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:05.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.464+0000 7f00ee949640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00e8153a10 0x7f00e8152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:05.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.464+0000 7f00ee949640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00e815a550 0x7f00e8157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:05.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.464+0000 7f00ee949640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f00e8154020 con 0x7f00e815a550 2024-09-10T08:35:05.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.464+0000 7f00ee949640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f00e8153ea0 con 0x7f00e8153a10 2024-09-10T08:35:05.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.464+0000 7f00ee949640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f00e80c8ef0 con 0x7f00e80c8b10 2024-09-10T08:35:05.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.464+0000 7f00e7fff640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00e80c8b10 msgr2=0x7f00e81ef390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:35:05.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.464+0000 7f00e7fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00e80c8b10 0x7f00e81ef390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:35:05.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.464+0000 7f00ecee6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00e815a550 0x7f00e8157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:05.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.464+0000 7f00ecee6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00e815a550 0x7f00e8157840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36870/0 (socket says 172.21.15.103:36870) 2024-09-10T08:35:05.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.464+0000 7f00ecee6640 1 -- 172.21.15.103:0/3642541460 learned_addr learned my addr 172.21.15.103:0/3642541460 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:05.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.464+0000 7f00e77fe640 1 --2- 172.21.15.103:0/3642541460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00e8153a10 0x7f00e8152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:05.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.464+0000 7f00ecee6640 1 -- 172.21.15.103:0/3642541460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00e80c8b10 msgr2=0x7f00e81ef390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:35:05.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.464+0000 7f00ecee6640 1 --2- 172.21.15.103:0/3642541460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00e80c8b10 0x7f00e81ef390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:05.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.464+0000 7f00ecee6640 1 -- 172.21.15.103:0/3642541460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00e8153a10 msgr2=0x7f00e8152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:05.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.464+0000 7f00ecee6640 1 --2- 172.21.15.103:0/3642541460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00e8153a10 0x7f00e8152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:05.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.464+0000 7f00ecee6640 1 -- 172.21.15.103:0/3642541460 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e81581d0 con 0x7f00e815a550 2024-09-10T08:35:05.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.465+0000 7f00ecee6640 1 --2- 172.21.15.103:0/3642541460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00e815a550 0x7f00e8157840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f00e000c7a0 tx=0x7f00e000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:05.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.465+0000 7f00e4ff9640 1 -- 172.21.15.103:0/3642541460 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e0003b70 con 0x7f00e815a550 2024-09-10T08:35:05.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.465+0000 7f00e4ff9640 1 -- 172.21.15.103:0/3642541460 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00e0003d30 con 0x7f00e815a550 2024-09-10T08:35:05.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.465+0000 7f00e4ff9640 1 -- 172.21.15.103:0/3642541460 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e000aa90 con 0x7f00e815a550 2024-09-10T08:35:05.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.465+0000 7f00ee949640 1 -- 172.21.15.103:0/3642541460 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e81505d0 con 0x7f00e815a550 2024-09-10T08:35:05.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.465+0000 7f00ee949640 1 -- 172.21.15.103:0/3642541460 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e81e1b20 con 0x7f00e815a550 2024-09-10T08:35:05.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.466+0000 7f00ee949640 1 -- 172.21.15.103:0/3642541460 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00e81534d0 con 0x7f00e815a550 2024-09-10T08:35:05.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.466+0000 7f00e4ff9640 1 -- 172.21.15.103:0/3642541460 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f00e000ac30 con 0x7f00e815a550 2024-09-10T08:35:05.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.467+0000 7f00e4ff9640 1 --2- 172.21.15.103:0/3642541460 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f00d406bde0 0x7f00d406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:05.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.467+0000 7f00e7fff640 1 --2- 172.21.15.103:0/3642541460 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f00d406bde0 0x7f00d406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:05.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.467+0000 7f00e4ff9640 1 -- 172.21.15.103:0/3642541460 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f00e008b050 con 0x7f00e815a550 2024-09-10T08:35:05.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.467+0000 7f00e7fff640 1 --2- 172.21.15.103:0/3642541460 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f00d406bde0 0x7f00d406e2a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f00d8006fd0 tx=0x7f00d8006d80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:05.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.471+0000 7f00e4ff9640 1 -- 172.21.15.103:0/3642541460 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f00e00596f0 con 0x7f00e815a550 2024-09-10T08:35:05.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.781+0000 7f00ee949640 1 -- 172.21.15.103:0/3642541460 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f00e80c9d90 con 0x7f00e815a550 2024-09-10T08:35:05.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.781+0000 7f00e4ff9640 1 -- 172.21.15.103:0/3642541460 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f00e0058ff0 con 0x7f00e815a550 2024-09-10T08:35:05.781 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:35:05.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.783+0000 7f00ee949640 1 -- 172.21.15.103:0/3642541460 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f00d406bde0 msgr2=0x7f00d406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:05.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.783+0000 7f00ee949640 1 --2- 172.21.15.103:0/3642541460 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f00d406bde0 0x7f00d406e2a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f00d8006fd0 tx=0x7f00d8006d80 comp rx=0 tx=0).stop 2024-09-10T08:35:05.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.783+0000 7f00ee949640 1 -- 172.21.15.103:0/3642541460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00e815a550 msgr2=0x7f00e8157840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:05.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.783+0000 7f00ee949640 1 --2- 172.21.15.103:0/3642541460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00e815a550 0x7f00e8157840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f00e000c7a0 tx=0x7f00e000cc60 comp rx=0 tx=0).stop 2024-09-10T08:35:05.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.783+0000 7f00ee949640 1 -- 172.21.15.103:0/3642541460 shutdown_connections 2024-09-10T08:35:05.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.783+0000 7f00ee949640 1 --2- 172.21.15.103:0/3642541460 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f00d406bde0 0x7f00d406e2a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:05.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.783+0000 7f00ee949640 1 --2- 172.21.15.103:0/3642541460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00e815a550 0x7f00e8157840 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:05.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.783+0000 7f00ee949640 1 --2- 172.21.15.103:0/3642541460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00e8153a10 0x7f00e8152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:05.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.783+0000 7f00ee949640 1 --2- 172.21.15.103:0/3642541460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00e80c8b10 0x7f00e81ef390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:05.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.783+0000 7f00ee949640 1 -- 172.21.15.103:0/3642541460 >> 172.21.15.103:0/3642541460 conn(0x7f00e80adb80 msgr2=0x7f00e80ca1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:05.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.783+0000 7f00ee949640 1 -- 172.21.15.103:0/3642541460 shutdown_connections 2024-09-10T08:35:05.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:05.784+0000 7f00ee949640 1 -- 172.21.15.103:0/3642541460 wait complete. 2024-09-10T08:35:08.795 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:35:08.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.913+0000 7f78eba2e640 1 Processor -- start 2024-09-10T08:35:08.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.913+0000 7f78eba2e640 1 -- start start 2024-09-10T08:35:08.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.914+0000 7f78eba2e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f78e41544a0 0x7f78e4154880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:08.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.914+0000 7f78eba2e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e406eca0 con 0x7f78e40c3160 2024-09-10T08:35:08.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.914+0000 7f78eba2e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e406ef80 con 0x7f78e4067d30 2024-09-10T08:35:08.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.914+0000 7f78eba2e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f78e406ea50 con 0x7f78e41544a0 2024-09-10T08:35:08.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.914+0000 7f78e97ca640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f78e41544a0 0x7f78e4154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:08.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.914+0000 7f78e97ca640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f78e41544a0 0x7f78e4154880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36872/0 (socket says 172.21.15.103:36872) 2024-09-10T08:35:08.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.914+0000 7f78e97ca640 1 -- 172.21.15.103:0/1221840765 learned_addr learned my addr 172.21.15.103:0/1221840765 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:08.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.915+0000 7f78e97ca640 1 -- 172.21.15.103:0/1221840765 >> v1:172.21.15.154:6789/0 conn(0x7f78e4067d30 legacy=0x7f78e4151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:08.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.915+0000 7f78e97ca640 1 -- 172.21.15.103:0/1221840765 >> v1:172.21.15.103:6789/0 conn(0x7f78e40c3160 legacy=0x7f78e4072db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:08.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.915+0000 7f78e97ca640 1 -- 172.21.15.103:0/1221840765 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e40712f0 con 0x7f78e41544a0 2024-09-10T08:35:08.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.916+0000 7f78e97ca640 1 --2- 172.21.15.103:0/1221840765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78e41544a0 0x7f78e4154880 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f78e0009870 tx=0x7f78e002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c169ebe91c6b336 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:08.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.916+0000 7f78dbfff640 1 -- 172.21.15.103:0/1221840765 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0037070 con 0x7f78e41544a0 2024-09-10T08:35:08.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.916+0000 7f78dbfff640 1 -- 172.21.15.103:0/1221840765 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78e002ae50 con 0x7f78e41544a0 2024-09-10T08:35:08.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.916+0000 7f78dbfff640 1 -- 172.21.15.103:0/1221840765 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0032860 con 0x7f78e41544a0 2024-09-10T08:35:08.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.916+0000 7f78eba2e640 1 -- 172.21.15.103:0/1221840765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78e41544a0 msgr2=0x7f78e4154880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:08.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.916+0000 7f78eba2e640 1 --2- 172.21.15.103:0/1221840765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78e41544a0 0x7f78e4154880 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f78e0009870 tx=0x7f78e002a300 comp rx=0 tx=0).stop 2024-09-10T08:35:08.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.916+0000 7f78eba2e640 1 -- 172.21.15.103:0/1221840765 shutdown_connections 2024-09-10T08:35:08.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.916+0000 7f78eba2e640 1 --2- 172.21.15.103:0/1221840765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78e41544a0 0x7f78e4154880 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:08.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.916+0000 7f78eba2e640 1 -- 172.21.15.103:0/1221840765 >> 172.21.15.103:0/1221840765 conn(0x7f78e406bbe0 msgr2=0x7f78e406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:08.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.917+0000 7f78eba2e640 1 -- 172.21.15.103:0/1221840765 shutdown_connections 2024-09-10T08:35:08.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.917+0000 7f78eba2e640 1 -- 172.21.15.103:0/1221840765 wait complete. 2024-09-10T08:35:08.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.918+0000 7f78eba2e640 1 Processor -- start 2024-09-10T08:35:08.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.918+0000 7f78eba2e640 1 -- start start 2024-09-10T08:35:08.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.918+0000 7f78eba2e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78e4067d30 0x7f78e40c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:08.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.918+0000 7f78eba2e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78e40c3160 0x7f78e40c19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:08.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.918+0000 7f78eba2e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78e41544a0 0x7f78e40ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:08.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.918+0000 7f78eba2e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f78e4073640 con 0x7f78e4067d30 2024-09-10T08:35:08.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.918+0000 7f78eba2e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78e40734c0 con 0x7f78e41544a0 2024-09-10T08:35:08.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.918+0000 7f78eba2e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f78e4151c60 con 0x7f78e40c3160 2024-09-10T08:35:08.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.918+0000 7f78e8fc9640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78e40c3160 msgr2=0x7f78e40c19d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:35:08.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.918+0000 7f78e8fc9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78e40c3160 0x7f78e40c19d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:35:08.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.918+0000 7f78e97ca640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78e4067d30 0x7f78e40c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:08.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.919+0000 7f78e97ca640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78e4067d30 0x7f78e40c36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36888/0 (socket says 172.21.15.103:36888) 2024-09-10T08:35:08.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.919+0000 7f78e97ca640 1 -- 172.21.15.103:0/853925900 learned_addr learned my addr 172.21.15.103:0/853925900 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:08.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.919+0000 7f78e9fcb640 1 --2- 172.21.15.103:0/853925900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78e41544a0 0x7f78e40ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:08.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.919+0000 7f78e97ca640 1 -- 172.21.15.103:0/853925900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78e40c3160 msgr2=0x7f78e40c19d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:35:08.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.919+0000 7f78e97ca640 1 --2- 172.21.15.103:0/853925900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78e40c3160 0x7f78e40c19d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:08.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.919+0000 7f78e97ca640 1 -- 172.21.15.103:0/853925900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78e41544a0 msgr2=0x7f78e40ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:08.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.919+0000 7f78e97ca640 1 --2- 172.21.15.103:0/853925900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78e41544a0 0x7f78e40ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:08.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.919+0000 7f78e97ca640 1 -- 172.21.15.103:0/853925900 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e40c5310 con 0x7f78e4067d30 2024-09-10T08:35:08.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.919+0000 7f78e97ca640 1 --2- 172.21.15.103:0/853925900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78e4067d30 0x7f78e40c36c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f78e0000c00 tx=0x7f78e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:08.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.919+0000 7f78d9ffb640 1 -- 172.21.15.103:0/853925900 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0041070 con 0x7f78e4067d30 2024-09-10T08:35:08.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.919+0000 7f78d9ffb640 1 -- 172.21.15.103:0/853925900 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78e003c890 con 0x7f78e4067d30 2024-09-10T08:35:08.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.919+0000 7f78d9ffb640 1 -- 172.21.15.103:0/853925900 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0037040 con 0x7f78e4067d30 2024-09-10T08:35:08.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.919+0000 7f78eba2e640 1 -- 172.21.15.103:0/853925900 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e40c5580 con 0x7f78e4067d30 2024-09-10T08:35:08.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.920+0000 7f78eba2e640 1 -- 172.21.15.103:0/853925900 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e41efd80 con 0x7f78e4067d30 2024-09-10T08:35:08.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.921+0000 7f78eba2e640 1 -- 172.21.15.103:0/853925900 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78e4151550 con 0x7f78e4067d30 2024-09-10T08:35:08.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.921+0000 7f78d9ffb640 1 -- 172.21.15.103:0/853925900 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f78e0044070 con 0x7f78e4067d30 2024-09-10T08:35:08.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.921+0000 7f78d9ffb640 1 --2- 172.21.15.103:0/853925900 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f78c806bde0 0x7f78c806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:08.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.922+0000 7f78d9ffb640 1 -- 172.21.15.103:0/853925900 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f78e00abc10 con 0x7f78e4067d30 2024-09-10T08:35:08.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.922+0000 7f78e8fc9640 1 --2- 172.21.15.103:0/853925900 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f78c806bde0 0x7f78c806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:08.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.922+0000 7f78e8fc9640 1 --2- 172.21.15.103:0/853925900 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f78c806bde0 0x7f78c806e2a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f78d4001030 tx=0x7f78d4007a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:08.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:08.926+0000 7f78d9ffb640 1 -- 172.21.15.103:0/853925900 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f78e0079cf0 con 0x7f78e4067d30 2024-09-10T08:35:09.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:09.222+0000 7f78eba2e640 1 -- 172.21.15.103:0/853925900 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f78e40c5ce0 con 0x7f78e4067d30 2024-09-10T08:35:09.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:09.222+0000 7f78d9ffb640 1 -- 172.21.15.103:0/853925900 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f78e007dff0 con 0x7f78e4067d30 2024-09-10T08:35:09.225 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:35:09.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:09.224+0000 7f78eba2e640 1 -- 172.21.15.103:0/853925900 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f78c806bde0 msgr2=0x7f78c806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:09.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:09.224+0000 7f78eba2e640 1 --2- 172.21.15.103:0/853925900 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f78c806bde0 0x7f78c806e2a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f78d4001030 tx=0x7f78d4007a30 comp rx=0 tx=0).stop 2024-09-10T08:35:09.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:09.224+0000 7f78eba2e640 1 -- 172.21.15.103:0/853925900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78e4067d30 msgr2=0x7f78e40c36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:09.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:09.224+0000 7f78eba2e640 1 --2- 172.21.15.103:0/853925900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78e4067d30 0x7f78e40c36c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f78e0000c00 tx=0x7f78e00046c0 comp rx=0 tx=0).stop 2024-09-10T08:35:09.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:09.224+0000 7f78eba2e640 1 -- 172.21.15.103:0/853925900 shutdown_connections 2024-09-10T08:35:09.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:09.224+0000 7f78eba2e640 1 --2- 172.21.15.103:0/853925900 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f78c806bde0 0x7f78c806e2a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:09.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:09.224+0000 7f78eba2e640 1 --2- 172.21.15.103:0/853925900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78e41544a0 0x7f78e40ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:09.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:09.224+0000 7f78eba2e640 1 --2- 172.21.15.103:0/853925900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78e40c3160 0x7f78e40c19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:09.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:09.224+0000 7f78eba2e640 1 --2- 172.21.15.103:0/853925900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78e4067d30 0x7f78e40c36c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:09.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:09.224+0000 7f78eba2e640 1 -- 172.21.15.103:0/853925900 >> 172.21.15.103:0/853925900 conn(0x7f78e406bbe0 msgr2=0x7f78e414fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:09.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:09.225+0000 7f78eba2e640 1 -- 172.21.15.103:0/853925900 shutdown_connections 2024-09-10T08:35:09.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:09.225+0000 7f78eba2e640 1 -- 172.21.15.103:0/853925900 wait complete. 2024-09-10T08:35:12.236 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:35:12.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.345+0000 7fef2776d640 1 Processor -- start 2024-09-10T08:35:12.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.345+0000 7fef2776d640 1 -- start start 2024-09-10T08:35:12.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.346+0000 7fef2776d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 0x7fef20153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:12.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.346+0000 7fef2776d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef20071bb0 0x7fef200c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:12.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.346+0000 7fef2776d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef200c7c30 con 0x7fef200c51b0 2024-09-10T08:35:12.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.346+0000 7fef2776d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fef200c7f10 con 0x7fef200a8270 2024-09-10T08:35:12.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.346+0000 7fef2776d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fef200c81f0 con 0x7fef20071bb0 2024-09-10T08:35:12.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.346+0000 7fef24d08640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef20071bb0 msgr2=0x7fef200c4c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:35:12.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.346+0000 7fef25509640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 0x7fef20153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:12.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.346+0000 7fef24d08640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef20071bb0 0x7fef200c4c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:35:12.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.346+0000 7fef25509640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 0x7fef20153ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36896/0 (socket says 172.21.15.103:36896) 2024-09-10T08:35:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.346+0000 7fef25509640 1 -- 172.21.15.103:0/496419522 learned_addr learned my addr 172.21.15.103:0/496419522 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.346+0000 7fef25d0a640 1 --1- 172.21.15.103:0/496419522 >> v1:172.21.15.103:6789/0 conn(0x7fef200c51b0 0x7fef200c3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:58170/0 (socket says 172.21.15.103:58170) 2024-09-10T08:35:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.346+0000 7fef25509640 1 -- 172.21.15.103:0/496419522 >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 msgr2=0x7fef20153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:35:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.346+0000 7fef25509640 1 -- 172.21.15.103:0/496419522 >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 msgr2=0x7fef20153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:35:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.346+0000 7fef25509640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 0x7fef20153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:35:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.346+0000 7fef25509640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 0x7fef20153ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:35:12.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.547+0000 7fef24d08640 1 -- 172.21.15.103:0/496419522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef20071bb0 msgr2=0x7fef200c4c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:35:12.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.547+0000 7fef24d08640 1 --2- 172.21.15.103:0/496419522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef20071bb0 0x7fef200c4c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:35:12.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.547+0000 7fef25509640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 0x7fef20153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:12.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.547+0000 7fef25509640 1 -- 172.21.15.103:0/496419522 >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 msgr2=0x7fef20153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:35:12.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.547+0000 7fef25509640 1 -- 172.21.15.103:0/496419522 >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 msgr2=0x7fef20153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:35:12.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.547+0000 7fef25509640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 0x7fef20153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:35:12.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.547+0000 7fef25509640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 0x7fef20153ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:35:12.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.948+0000 7fef24d08640 1 -- 172.21.15.103:0/496419522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef20071bb0 msgr2=0x7fef200c4c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:35:12.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.948+0000 7fef24d08640 1 --2- 172.21.15.103:0/496419522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef20071bb0 0x7fef200c4c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:35:12.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.948+0000 7fef25509640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 0x7fef20153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:12.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.948+0000 7fef25509640 1 -- 172.21.15.103:0/496419522 >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 msgr2=0x7fef20153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:35:12.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.948+0000 7fef25509640 1 -- 172.21.15.103:0/496419522 >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 msgr2=0x7fef20153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:35:12.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.948+0000 7fef25509640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 0x7fef20153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:35:12.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:12.948+0000 7fef25509640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 0x7fef20153ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:35:13.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:13.749+0000 7fef24d08640 1 -- 172.21.15.103:0/496419522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef20071bb0 msgr2=0x7fef200c4c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:35:13.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:13.749+0000 7fef25509640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 0x7fef20153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:13.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:13.749+0000 7fef24d08640 1 --2- 172.21.15.103:0/496419522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef20071bb0 0x7fef200c4c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:35:13.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:13.749+0000 7fef25509640 1 -- 172.21.15.103:0/496419522 >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 msgr2=0x7fef20153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:35:13.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:13.749+0000 7fef25509640 1 -- 172.21.15.103:0/496419522 >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 msgr2=0x7fef20153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:35:13.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:13.749+0000 7fef25509640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 0x7fef20153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:35:13.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:13.749+0000 7fef25509640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 0x7fef20153ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:35:15.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.346+0000 7fef16ffd640 1 -- 172.21.15.103:0/496419522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef20071bb0 msgr2=0x7fef200c4c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:35:15.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.346+0000 7fef16ffd640 1 --2- 172.21.15.103:0/496419522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef20071bb0 0x7fef200c4c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:15.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.346+0000 7fef16ffd640 1 -- 172.21.15.103:0/496419522 >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 msgr2=0x7fef20153ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:35:15.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.346+0000 7fef16ffd640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.103:3300/0 conn(0x7fef200a8270 0x7fef20153ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:15.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.346+0000 7fef16ffd640 1 -- 172.21.15.103:0/496419522 >> v1:172.21.15.103:6789/0 conn(0x7fef200c51b0 legacy=0x7fef200c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:15.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.346+0000 7fef16ffd640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 0x7fef04009860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:15.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.346+0000 7fef16ffd640 1 -- 172.21.15.103:0/496419522 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef200c3720 con 0x7fef04003710 2024-09-10T08:35:15.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.346+0000 7fef16ffd640 1 -- 172.21.15.103:0/496419522 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fef200c7f10 con 0x7fef040073c0 2024-09-10T08:35:15.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.346+0000 7fef24d08640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 0x7fef04009860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:15.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.346+0000 7fef24d08640 1 -- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 msgr2=0x7fef04009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:35:15.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.346+0000 7fef24d08640 1 -- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 msgr2=0x7fef04009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:35:15.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.346+0000 7fef24d08640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 0x7fef04009860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:35:15.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.347+0000 7fef24d08640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 0x7fef04009860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:35:15.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.548+0000 7fef24d08640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 0x7fef04009860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:15.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.548+0000 7fef24d08640 1 -- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 msgr2=0x7fef04009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:35:15.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.548+0000 7fef24d08640 1 -- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 msgr2=0x7fef04009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:35:15.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.548+0000 7fef24d08640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 0x7fef04009860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:35:15.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.548+0000 7fef24d08640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 0x7fef04009860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:35:15.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.949+0000 7fef24d08640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 0x7fef04009860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:15.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.949+0000 7fef24d08640 1 -- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 msgr2=0x7fef04009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:35:15.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.949+0000 7fef24d08640 1 -- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 msgr2=0x7fef04009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:35:15.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.949+0000 7fef24d08640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 0x7fef04009860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:35:15.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:15.949+0000 7fef24d08640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 0x7fef04009860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:35:16.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.750+0000 7fef24d08640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 0x7fef04009860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:16.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.750+0000 7fef24d08640 1 -- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 msgr2=0x7fef04009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:35:16.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.750+0000 7fef24d08640 1 -- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 msgr2=0x7fef04009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:35:16.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.750+0000 7fef24d08640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 0x7fef04009860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:35:16.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.750+0000 7fef24d08640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 0x7fef04009860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:35:16.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.911+0000 7fef17fff640 1 -- 172.21.15.103:0/496419522 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 377564265 0 0) 0x7fef200c3720 con 0x7fef04003710 2024-09-10T08:35:16.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.911+0000 7fef17fff640 1 -- 172.21.15.103:0/496419522 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef0c003520 con 0x7fef04003710 2024-09-10T08:35:16.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.919+0000 7fef17fff640 1 -- 172.21.15.103:0/496419522 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 127344321 0 0) 0x7fef0c003520 con 0x7fef04003710 2024-09-10T08:35:16.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.919+0000 7fef17fff640 1 -- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 msgr2=0x7fef04009860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:35:16.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.919+0000 7fef17fff640 1 --2- 172.21.15.103:0/496419522 >> v2:172.21.15.154:3300/0 conn(0x7fef040073c0 0x7fef04009860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:16.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.919+0000 7fef17fff640 1 -- 172.21.15.103:0/496419522 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef0400af90 con 0x7fef04003710 2024-09-10T08:35:16.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.919+0000 7fef17fff640 1 -- 172.21.15.103:0/496419522 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7fef1c009700 con 0x7fef04003710 2024-09-10T08:35:16.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.919+0000 7fef17fff640 1 -- 172.21.15.103:0/496419522 >> v1:172.21.15.154:6789/0 conn(0x7fef04003710 legacy=0x7fef04005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:16.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.919+0000 7fef25d0a640 1 -- 172.21.15.103:0/496419522 reap_dead start 2024-09-10T08:35:16.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.919+0000 7fef17fff640 1 --2- 172.21.15.103:0/496419522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef0c0039b0 0x7fef0c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:16.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.919+0000 7fef17fff640 1 --2- 172.21.15.103:0/496419522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef0c004800 0x7fef0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:16.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.919+0000 7fef17fff640 1 --2- 172.21.15.103:0/496419522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef0c005210 0x7fef0c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:16.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.919+0000 7fef17fff640 1 -- 172.21.15.103:0/496419522 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fef200c7f10 con 0x7fef0c005210 2024-09-10T08:35:16.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.919+0000 7fef17fff640 1 -- 172.21.15.103:0/496419522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fef0c00c140 con 0x7fef0c0039b0 2024-09-10T08:35:16.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.919+0000 7fef17fff640 1 -- 172.21.15.103:0/496419522 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fef0c00c340 con 0x7fef0c004800 2024-09-10T08:35:16.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.919+0000 7fef24d08640 1 -- 172.21.15.103:0/496419522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef0c004800 msgr2=0x7fef0c004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:35:16.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.919+0000 7fef24d08640 1 --2- 172.21.15.103:0/496419522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef0c004800 0x7fef0c004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:35:16.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.919+0000 7fef25d0a640 1 --2- 172.21.15.103:0/496419522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef0c005210 0x7fef0c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:16.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.919+0000 7fef25509640 1 --2- 172.21.15.103:0/496419522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef0c0039b0 0x7fef0c003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:16.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.920+0000 7fef25d0a640 1 -- 172.21.15.103:0/496419522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef0c004800 msgr2=0x7fef0c004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:35:16.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.920+0000 7fef25d0a640 1 --2- 172.21.15.103:0/496419522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef0c004800 0x7fef0c004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:16.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.920+0000 7fef25d0a640 1 -- 172.21.15.103:0/496419522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef0c0039b0 msgr2=0x7fef0c003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:16.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.920+0000 7fef25d0a640 1 --2- 172.21.15.103:0/496419522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef0c0039b0 0x7fef0c003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:16.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.920+0000 7fef25d0a640 1 -- 172.21.15.103:0/496419522 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef0c003520 con 0x7fef0c005210 2024-09-10T08:35:16.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.921+0000 7fef25d0a640 1 --2- 172.21.15.103:0/496419522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef0c005210 0x7fef0c00b9c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fef200c3240 tx=0x7fef0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df43a8b428ebf9d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:16.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.921+0000 7fef17fff640 1 -- 172.21.15.103:0/496419522 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef180012a0 con 0x7fef0c005210 2024-09-10T08:35:16.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.921+0000 7fef17fff640 1 -- 172.21.15.103:0/496419522 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef1802e070 con 0x7fef0c005210 2024-09-10T08:35:16.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.921+0000 7fef17fff640 1 -- 172.21.15.103:0/496419522 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef18007490 con 0x7fef0c005210 2024-09-10T08:35:16.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.921+0000 7fef2776d640 1 -- 172.21.15.103:0/496419522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef0c005210 msgr2=0x7fef0c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:16.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.921+0000 7fef2776d640 1 --2- 172.21.15.103:0/496419522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef0c005210 0x7fef0c00b9c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fef200c3240 tx=0x7fef0c005830 comp rx=0 tx=0).stop 2024-09-10T08:35:16.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.922+0000 7fef2776d640 1 -- 172.21.15.103:0/496419522 shutdown_connections 2024-09-10T08:35:16.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.922+0000 7fef2776d640 1 --2- 172.21.15.103:0/496419522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef0c005210 0x7fef0c00b9c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:16.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.922+0000 7fef2776d640 1 --2- 172.21.15.103:0/496419522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef0c004800 0x7fef0c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:16.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.922+0000 7fef2776d640 1 --2- 172.21.15.103:0/496419522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef0c0039b0 0x7fef0c003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:16.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.922+0000 7fef2776d640 1 -- 172.21.15.103:0/496419522 >> 172.21.15.103:0/496419522 conn(0x7fef200c5680 msgr2=0x7fef200c5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:16.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.922+0000 7fef2776d640 1 -- 172.21.15.103:0/496419522 shutdown_connections 2024-09-10T08:35:16.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.922+0000 7fef2776d640 1 -- 172.21.15.103:0/496419522 wait complete. 2024-09-10T08:35:16.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.923+0000 7fef2776d640 1 Processor -- start 2024-09-10T08:35:16.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.923+0000 7fef2776d640 1 -- start start 2024-09-10T08:35:16.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.924+0000 7fef2776d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef0c0039b0 0x7fef201ef850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:16.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.924+0000 7fef2776d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef0c004800 0x7fef201eac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:16.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.924+0000 7fef2776d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef0c005210 0x7fef2013d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:16.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.924+0000 7fef2776d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fef20072310 con 0x7fef0c005210 2024-09-10T08:35:16.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.924+0000 7fef2776d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fef20072190 con 0x7fef0c0039b0 2024-09-10T08:35:16.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.924+0000 7fef2776d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fef200c4c70 con 0x7fef0c004800 2024-09-10T08:35:16.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.924+0000 7fef24d08640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef0c004800 msgr2=0x7fef201eac50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:35:16.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.924+0000 7fef24d08640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef0c004800 0x7fef201eac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:35:16.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.924+0000 7fef25d0a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef0c005210 0x7fef2013d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:16.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.924+0000 7fef25509640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef0c0039b0 0x7fef201ef850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:16.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.924+0000 7fef25d0a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef0c005210 0x7fef2013d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:32802/0 (socket says 172.21.15.103:32802) 2024-09-10T08:35:16.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.924+0000 7fef25509640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef0c0039b0 0x7fef201ef850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:38124/0 (socket says 172.21.15.103:38124) 2024-09-10T08:35:16.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.924+0000 7fef25d0a640 1 -- 172.21.15.103:0/1187678385 learned_addr learned my addr 172.21.15.103:0/1187678385 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:16.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.924+0000 7fef25d0a640 1 -- 172.21.15.103:0/1187678385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef0c004800 msgr2=0x7fef201eac50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:35:16.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.924+0000 7fef25d0a640 1 --2- 172.21.15.103:0/1187678385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef0c004800 0x7fef201eac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:16.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.924+0000 7fef25d0a640 1 -- 172.21.15.103:0/1187678385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef0c0039b0 msgr2=0x7fef201ef850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:16.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.924+0000 7fef25d0a640 1 --2- 172.21.15.103:0/1187678385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef0c0039b0 0x7fef201ef850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:16.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.924+0000 7fef25d0a640 1 -- 172.21.15.103:0/1187678385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef20150650 con 0x7fef0c005210 2024-09-10T08:35:16.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.924+0000 7fef25d0a640 1 --2- 172.21.15.103:0/1187678385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef0c005210 0x7fef2013d410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fef18000f60 tx=0x7fef18001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:16.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.925+0000 7fef15ffb640 1 -- 172.21.15.103:0/1187678385 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef180076d0 con 0x7fef0c005210 2024-09-10T08:35:16.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.925+0000 7fef15ffb640 1 -- 172.21.15.103:0/1187678385 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef180049f0 con 0x7fef0c005210 2024-09-10T08:35:16.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.925+0000 7fef2776d640 1 -- 172.21.15.103:0/1187678385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef20141390 con 0x7fef0c005210 2024-09-10T08:35:16.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.925+0000 7fef15ffb640 1 -- 172.21.15.103:0/1187678385 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef18004e20 con 0x7fef0c005210 2024-09-10T08:35:16.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.925+0000 7fef2776d640 1 -- 172.21.15.103:0/1187678385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef201ef330 con 0x7fef0c005210 2024-09-10T08:35:16.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.926+0000 7fef2776d640 1 -- 172.21.15.103:0/1187678385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef200c81f0 con 0x7fef0c005210 2024-09-10T08:35:16.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.927+0000 7fef15ffb640 1 -- 172.21.15.103:0/1187678385 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef18030040 con 0x7fef0c005210 2024-09-10T08:35:16.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.927+0000 7fef15ffb640 1 --2- 172.21.15.103:0/1187678385 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fef0406c5f0 0x7fef0406eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:16.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.927+0000 7fef15ffb640 1 -- 172.21.15.103:0/1187678385 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fef180a9a40 con 0x7fef0c005210 2024-09-10T08:35:16.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.927+0000 7fef25509640 1 --2- 172.21.15.103:0/1187678385 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fef0406c5f0 0x7fef0406eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:16.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.928+0000 7fef25509640 1 --2- 172.21.15.103:0/1187678385 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fef0406c5f0 0x7fef0406eab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009410 tx=0x7fef1c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:16.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:16.933+0000 7fef15ffb640 1 -- 172.21.15.103:0/1187678385 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fef180780e0 con 0x7fef0c005210 2024-09-10T08:35:17.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.211+0000 7fef2776d640 1 -- 172.21.15.103:0/1187678385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fef200c81f0 con 0x7fef0c005210 2024-09-10T08:35:17.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.211+0000 7fef15ffb640 1 -- 172.21.15.103:0/1187678385 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7fef180779e0 con 0x7fef0c005210 2024-09-10T08:35:17.211 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":56,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:35:17.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.214+0000 7fef2776d640 1 -- 172.21.15.103:0/1187678385 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fef0406c5f0 msgr2=0x7fef0406eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:17.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.214+0000 7fef2776d640 1 --2- 172.21.15.103:0/1187678385 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fef0406c5f0 0x7fef0406eab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009410 tx=0x7fef1c009040 comp rx=0 tx=0).stop 2024-09-10T08:35:17.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.214+0000 7fef2776d640 1 -- 172.21.15.103:0/1187678385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef0c005210 msgr2=0x7fef2013d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:17.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.214+0000 7fef2776d640 1 --2- 172.21.15.103:0/1187678385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef0c005210 0x7fef2013d410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fef18000f60 tx=0x7fef18001120 comp rx=0 tx=0).stop 2024-09-10T08:35:17.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.214+0000 7fef2776d640 1 -- 172.21.15.103:0/1187678385 shutdown_connections 2024-09-10T08:35:17.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.214+0000 7fef2776d640 1 --2- 172.21.15.103:0/1187678385 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fef0406c5f0 0x7fef0406eab0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:17.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.214+0000 7fef2776d640 1 --2- 172.21.15.103:0/1187678385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef0c005210 0x7fef2013d410 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:17.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.214+0000 7fef2776d640 1 --2- 172.21.15.103:0/1187678385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef0c004800 0x7fef201eac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:17.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.214+0000 7fef2776d640 1 --2- 172.21.15.103:0/1187678385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef0c0039b0 0x7fef201ef850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:17.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.214+0000 7fef2776d640 1 -- 172.21.15.103:0/1187678385 >> 172.21.15.103:0/1187678385 conn(0x7fef200c5680 msgr2=0x7fef200a9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:17.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.214+0000 7fef2776d640 1 -- 172.21.15.103:0/1187678385 shutdown_connections 2024-09-10T08:35:17.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.214+0000 7fef2776d640 1 -- 172.21.15.103:0/1187678385 wait complete. 2024-09-10T08:35:17.226 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-10T08:35:17.226 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-10T08:35:17.226 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:35:17.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.338+0000 7fd34d277640 1 Processor -- start 2024-09-10T08:35:17.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.338+0000 7fd34d277640 1 -- start start 2024-09-10T08:35:17.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.338+0000 7fd34d277640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd348154ac0 0x7fd3480708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:17.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.338+0000 7fd34d277640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3480703b0 0x7fd34815e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:17.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.338+0000 7fd34d277640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd348154ff0 con 0x7fd348151780 2024-09-10T08:35:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.338+0000 7fd34d277640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fd34806f5f0 con 0x7fd348154ac0 2024-09-10T08:35:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.338+0000 7fd34d277640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd34806f8d0 con 0x7fd3480703b0 2024-09-10T08:35:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.339+0000 7fd3477fe640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3480703b0 msgr2=0x7fd34815e9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:35:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.339+0000 7fd3467fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd348154ac0 0x7fd3480708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.339+0000 7fd3477fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3480703b0 0x7fd34815e9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:35:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.339+0000 7fd3467fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd348154ac0 0x7fd3480708a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:32810/0 (socket says 172.21.15.103:32810) 2024-09-10T08:35:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.339+0000 7fd3467fc640 1 -- 172.21.15.103:0/600270419 learned_addr learned my addr 172.21.15.103:0/600270419 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.339+0000 7fd346ffd640 1 --1- 172.21.15.103:0/600270419 >> v1:172.21.15.103:6789/0 conn(0x7fd348151780 0x7fd348155560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:38430/0 (socket says 172.21.15.103:38430) 2024-09-10T08:35:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.339+0000 7fd3467fc640 1 -- 172.21.15.103:0/600270419 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3480703b0 msgr2=0x7fd34815e9f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:35:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.339+0000 7fd3467fc640 1 --2- 172.21.15.103:0/600270419 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3480703b0 0x7fd34815e9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.339+0000 7fd3467fc640 1 -- 172.21.15.103:0/600270419 >> v1:172.21.15.103:6789/0 conn(0x7fd348151780 legacy=0x7fd348155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.339+0000 7fd3467fc640 1 -- 172.21.15.103:0/600270419 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34806fbb0 con 0x7fd348154ac0 2024-09-10T08:35:17.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.340+0000 7fd3467fc640 1 --2- 172.21.15.103:0/600270419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd348154ac0 0x7fd3480708a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009870 tx=0x7fd33c02a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb5414816d0ced6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:17.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.340+0000 7fd345ffb640 1 -- 172.21.15.103:0/600270419 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c037070 con 0x7fd348154ac0 2024-09-10T08:35:17.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.340+0000 7fd345ffb640 1 -- 172.21.15.103:0/600270419 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd33c032440 con 0x7fd348154ac0 2024-09-10T08:35:17.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.340+0000 7fd345ffb640 1 -- 172.21.15.103:0/600270419 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c032810 con 0x7fd348154ac0 2024-09-10T08:35:17.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.340+0000 7fd34d277640 1 -- 172.21.15.103:0/600270419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd348154ac0 msgr2=0x7fd3480708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:17.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.340+0000 7fd34d277640 1 --2- 172.21.15.103:0/600270419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd348154ac0 0x7fd3480708a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009870 tx=0x7fd33c02a150 comp rx=0 tx=0).stop 2024-09-10T08:35:17.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.341+0000 7fd34d277640 1 -- 172.21.15.103:0/600270419 shutdown_connections 2024-09-10T08:35:17.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.341+0000 7fd34d277640 1 --2- 172.21.15.103:0/600270419 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3480703b0 0x7fd34815e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:17.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.341+0000 7fd34d277640 1 --2- 172.21.15.103:0/600270419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd348154ac0 0x7fd3480708a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:17.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.341+0000 7fd34d277640 1 -- 172.21.15.103:0/600270419 >> 172.21.15.103:0/600270419 conn(0x7fd3480c6980 msgr2=0x7fd3480c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:17.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.341+0000 7fd34d277640 1 -- 172.21.15.103:0/600270419 shutdown_connections 2024-09-10T08:35:17.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.341+0000 7fd34d277640 1 -- 172.21.15.103:0/600270419 wait complete. 2024-09-10T08:35:17.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.342+0000 7fd34d277640 1 Processor -- start 2024-09-10T08:35:17.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.342+0000 7fd34d277640 1 -- start start 2024-09-10T08:35:17.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.343+0000 7fd34d277640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3480703b0 0x7fd348151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:17.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.343+0000 7fd34d277640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd348151780 0x7fd348149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:17.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.343+0000 7fd34d277640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd348154ac0 0x7fd3480c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:17.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.343+0000 7fd34d277640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd348155c70 con 0x7fd348154ac0 2024-09-10T08:35:17.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.343+0000 7fd34d277640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd348073f30 con 0x7fd3480703b0 2024-09-10T08:35:17.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.343+0000 7fd34d277640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd3481540b0 con 0x7fd348151780 2024-09-10T08:35:17.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.343+0000 7fd3467fc640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd348151780 msgr2=0x7fd348149b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:35:17.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.343+0000 7fd3467fc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd348151780 0x7fd348149b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:35:17.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.343+0000 7fd3477fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd348154ac0 0x7fd3480c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:17.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.343+0000 7fd3477fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd348154ac0 0x7fd3480c32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:32822/0 (socket says 172.21.15.103:32822) 2024-09-10T08:35:17.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.343+0000 7fd3477fe640 1 -- 172.21.15.103:0/1137679740 learned_addr learned my addr 172.21.15.103:0/1137679740 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:17.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.343+0000 7fd346ffd640 1 --2- 172.21.15.103:0/1137679740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3480703b0 0x7fd348151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:17.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.344+0000 7fd3477fe640 1 -- 172.21.15.103:0/1137679740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd348151780 msgr2=0x7fd348149b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:35:17.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.344+0000 7fd3477fe640 1 --2- 172.21.15.103:0/1137679740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd348151780 0x7fd348149b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:17.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.344+0000 7fd3477fe640 1 -- 172.21.15.103:0/1137679740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3480703b0 msgr2=0x7fd348151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:17.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.344+0000 7fd3477fe640 1 --2- 172.21.15.103:0/1137679740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3480703b0 0x7fd348151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:17.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.344+0000 7fd3477fe640 1 -- 172.21.15.103:0/1137679740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd348152500 con 0x7fd348154ac0 2024-09-10T08:35:17.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.344+0000 7fd3477fe640 1 --2- 172.21.15.103:0/1137679740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd348154ac0 0x7fd3480c32b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd34000b9c0 tx=0x7fd34000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:17.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.344+0000 7fd32f7fe640 1 -- 172.21.15.103:0/1137679740 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34000cb20 con 0x7fd348154ac0 2024-09-10T08:35:17.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.344+0000 7fd32f7fe640 1 -- 172.21.15.103:0/1137679740 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd340010070 con 0x7fd348154ac0 2024-09-10T08:35:17.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.344+0000 7fd34d277640 1 -- 172.21.15.103:0/1137679740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd34814a090 con 0x7fd348154ac0 2024-09-10T08:35:17.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.344+0000 7fd32f7fe640 1 -- 172.21.15.103:0/1137679740 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd340015470 con 0x7fd348154ac0 2024-09-10T08:35:17.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.344+0000 7fd34d277640 1 -- 172.21.15.103:0/1137679740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd34806cf00 con 0x7fd348154ac0 2024-09-10T08:35:17.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.345+0000 7fd34d277640 1 --2- 172.21.15.103:0/1137679740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3480c37f0 0x7fd348152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:17.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.345+0000 7fd34d277640 1 -- 172.21.15.103:0/1137679740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd348156f70 con 0x7fd3480c37f0 2024-09-10T08:35:17.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.345+0000 7fd346ffd640 1 --2- 172.21.15.103:0/1137679740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3480c37f0 0x7fd348152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:17.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.345+0000 7fd346ffd640 1 -- 172.21.15.103:0/1137679740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd34814d870 con 0x7fd3480c37f0 2024-09-10T08:35:17.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.346+0000 7fd346ffd640 1 --2- 172.21.15.103:0/1137679740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3480c37f0 0x7fd348152c80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd338000f60 tx=0x7fd338001920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:17.355 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:35:17.355 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:35:17.355 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:35:17.355 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:35:17.355 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 56, 2024-09-10T08:35:17.355 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 87423, 2024-09-10T08:35:17.355 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:35:17.355 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:35:17.355 INFO:teuthology.orchestra.run.smithi103.stdout: 1 2024-09-10T08:35:17.355 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:17.355 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:35:17.356 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:35:17.356 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:35:17.356 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:35:17.356 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:17.356 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:17.356 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:17.356 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:17.356 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:17.356 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:17.356 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:17.356 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:17.356 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:17.356 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:17.356 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:17.357 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:17.357 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:35:17.357 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:35:17.357 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:17.357 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:17.357 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:17.357 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:17.357 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:17.357 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:17.357 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:17.357 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:17.357 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:17.357 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:17.357 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:17.358 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:17.358 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.358 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:35:17.358 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:35:17.358 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:35:17.358 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:35:17.358 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:35:17.358 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:35:17.358 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:35:17.358 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:35:17.358 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:35:17.358 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:35:17.358 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:35:17.358 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:35:17.359 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:35:17.359 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:35:17.359 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:35:17.359 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:35:17.359 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:35:17.359 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:17.359 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:17.359 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:17.359 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:17.359 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:17.359 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:17.359 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:17.359 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:17.359 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:17.359 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:17.360 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:17.360 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:17.360 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:35:17.360 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.360 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:35:17.360 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.360 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:35:17.360 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:35:17.360 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:17.360 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:17.360 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.360 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:17.360 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:35:17.360 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:17.361 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.361 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.361 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:17.361 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:35:17.361 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:17.361 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:17.361 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:17.361 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.361 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:35:17.361 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:35:17.361 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:17.361 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:17.361 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:17.361 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.361 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.362 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:35:17.362 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:35:17.362 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:17.362 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:17.362 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.362 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:17.362 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:35:17.362 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:17.362 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.362 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.362 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:17.362 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:35:17.362 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:17.362 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:17.362 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:17.363 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.363 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:35:17.363 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:35:17.363 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:17.363 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:17.363 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:17.363 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.363 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.363 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:35:17.363 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:35:17.363 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:17.363 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:17.363 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.363 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:17.364 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:35:17.364 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:17.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.364 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.364 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:17.364 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:35:17.364 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:17.364 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:17.364 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:17.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.364 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:35:17.364 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:35:17.364 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:17.364 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:17.365 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:17.365 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:17.365 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:17.365 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.365 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:35:17.365 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:35:17.365 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.365 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:17.365 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:17.365 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:35:17.365 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:17.365 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:17.365 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:35:17.366 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.366 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:17.366 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:17.366 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:35:17.366 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:17.366 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:17.366 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:35:17.366 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.366 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:17.366 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:17.366 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:35:17.366 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:17.366 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:17.366 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:35:17.367 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.367 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:17.367 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:17.367 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:35:17.367 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:17.367 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:17.367 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:35:17.367 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.367 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:17.367 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:17.367 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:35:17.367 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:17.367 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:17.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.368 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:35:17.368 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:35:17.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.346+0000 7fd32f7fe640 1 -- 172.21.15.103:0/1137679740 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd338011580 con 0x7fd3480c37f0 2024-09-10T08:35:17.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.346+0000 7fd32f7fe640 1 -- 172.21.15.103:0/1137679740 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd34001e3f0 con 0x7fd348154ac0 2024-09-10T08:35:17.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.346+0000 7fd32f7fe640 1 --2- 172.21.15.103:0/1137679740 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd33406bd30 0x7fd33406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:17.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.346+0000 7fd3467fc640 1 --2- 172.21.15.103:0/1137679740 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd33406bd30 0x7fd33406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:17.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.346+0000 7fd32f7fe640 1 -- 172.21.15.103:0/1137679740 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fd34008b380 con 0x7fd348154ac0 2024-09-10T08:35:17.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.346+0000 7fd32f7fe640 1 -- 172.21.15.103:0/1137679740 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd338018070 con 0x7fd3480c37f0 2024-09-10T08:35:17.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.347+0000 7fd32f7fe640 1 -- 172.21.15.103:0/1137679740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3480c37f0 msgr2=0x7fd348152c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:17.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.347+0000 7fd32f7fe640 1 --2- 172.21.15.103:0/1137679740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3480c37f0 0x7fd348152c80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd338000f60 tx=0x7fd338001920 comp rx=0 tx=0).stop 2024-09-10T08:35:17.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.347+0000 7fd32f7fe640 1 -- 172.21.15.103:0/1137679740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3480c37f0 msgr2=0x7fd348152c80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:35:17.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.347+0000 7fd32f7fe640 1 --2- 172.21.15.103:0/1137679740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3480c37f0 0x7fd348152c80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:17.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.347+0000 7fd3467fc640 1 --2- 172.21.15.103:0/1137679740 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd33406bd30 0x7fd33406e1f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd33c034000 tx=0x7fd33c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:17.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.354+0000 7fd34d277640 1 --2- 172.21.15.103:0/1137679740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3481531c0 0x7fd34814ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:17.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.354+0000 7fd34d277640 1 -- 172.21.15.103:0/1137679740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd3481529c0 con 0x7fd3481531c0 2024-09-10T08:35:17.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.354+0000 7fd346ffd640 1 --2- 172.21.15.103:0/1137679740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3481531c0 0x7fd34814ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:17.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.354+0000 7fd346ffd640 1 -- 172.21.15.103:0/1137679740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd348154710 con 0x7fd3481531c0 2024-09-10T08:35:17.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.355+0000 7fd346ffd640 1 --2- 172.21.15.103:0/1137679740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3481531c0 0x7fd34814ef30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd338000f60 tx=0x7fd338000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:17.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.355+0000 7fd32f7fe640 1 -- 172.21.15.103:0/1137679740 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33801ee60 con 0x7fd3481531c0 2024-09-10T08:35:17.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.355+0000 7fd32f7fe640 1 -- 172.21.15.103:0/1137679740 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5044 (secure 0 0 0) 0x7fd338013600 con 0x7fd3481531c0 2024-09-10T08:35:17.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.355+0000 7fd32f7fe640 1 -- 172.21.15.103:0/1137679740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3481531c0 msgr2=0x7fd34814ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:17.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.355+0000 7fd32f7fe640 1 --2- 172.21.15.103:0/1137679740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3481531c0 0x7fd34814ef30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd338000f60 tx=0x7fd338000ed0 comp rx=0 tx=0).stop 2024-09-10T08:35:17.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.355+0000 7fd32f7fe640 1 -- 172.21.15.103:0/1137679740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3481531c0 msgr2=0x7fd34814ef30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:35:17.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.355+0000 7fd32f7fe640 1 --2- 172.21.15.103:0/1137679740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3481531c0 0x7fd34814ef30 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd338000f60 tx=0x7fd338000ed0 comp rx=0 tx=0).stop 2024-09-10T08:35:17.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.355+0000 7fd34d277640 1 -- 172.21.15.103:0/1137679740 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd33406bd30 msgr2=0x7fd33406e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:17.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.355+0000 7fd34d277640 1 --2- 172.21.15.103:0/1137679740 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd33406bd30 0x7fd33406e1f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd33c034000 tx=0x7fd33c02e000 comp rx=0 tx=0).stop 2024-09-10T08:35:17.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.356+0000 7fd34d277640 1 -- 172.21.15.103:0/1137679740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd348154ac0 msgr2=0x7fd3480c32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:17.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.356+0000 7fd34d277640 1 --2- 172.21.15.103:0/1137679740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd348154ac0 0x7fd3480c32b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd34000b9c0 tx=0x7fd34000be80 comp rx=0 tx=0).stop 2024-09-10T08:35:17.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.356+0000 7fd3477fe640 1 -- 172.21.15.103:0/1137679740 reap_dead start 2024-09-10T08:35:17.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.356+0000 7fd3477fe640 1 -- 172.21.15.103:0/1137679740 reap_dead start 2024-09-10T08:35:17.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.356+0000 7fd34d277640 1 -- 172.21.15.103:0/1137679740 shutdown_connections 2024-09-10T08:35:17.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.356+0000 7fd34d277640 1 -- 172.21.15.103:0/1137679740 >> 172.21.15.103:0/1137679740 conn(0x7fd3480c6980 msgr2=0x7fd348150490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:17.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.356+0000 7fd34d277640 1 -- 172.21.15.103:0/1137679740 shutdown_connections 2024-09-10T08:35:17.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.356+0000 7fd34d277640 1 -- 172.21.15.103:0/1137679740 wait complete. 2024-09-10T08:35:17.434 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:35:17.434 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-10T08:35:17.434 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:35:17.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.549+0000 7fbf2a65c640 1 Processor -- start 2024-09-10T08:35:17.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.549+0000 7fbf2a65c640 1 -- start start 2024-09-10T08:35:17.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.550+0000 7fbf2a65c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf24150480 0x7fbf240c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:17.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.550+0000 7fbf2a65c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbf240ca390 0x7fbf240c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:17.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.550+0000 7fbf2a65c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf2415a7c0 con 0x7fbf2406c650 2024-09-10T08:35:17.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.550+0000 7fbf2a65c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fbf2406c240 con 0x7fbf240ca390 2024-09-10T08:35:17.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.550+0000 7fbf2a65c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fbf2415a330 con 0x7fbf24150480 2024-09-10T08:35:17.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.550+0000 7fbf23fff640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf24150480 msgr2=0x7fbf240c7a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:35:17.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.550+0000 7fbf23fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf24150480 0x7fbf240c7a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:35:17.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.550+0000 7fbf28bf9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbf240ca390 0x7fbf240c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:17.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.550+0000 7fbf28bf9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbf240ca390 0x7fbf240c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:38144/0 (socket says 172.21.15.103:38144) 2024-09-10T08:35:17.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.550+0000 7fbf28bf9640 1 -- 172.21.15.103:0/2013409684 learned_addr learned my addr 172.21.15.103:0/2013409684 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:17.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.551+0000 7fbf28bf9640 1 -- 172.21.15.103:0/2013409684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf24150480 msgr2=0x7fbf240c7a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:35:17.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.551+0000 7fbf28bf9640 1 --2- 172.21.15.103:0/2013409684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf24150480 0x7fbf240c7a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:17.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.551+0000 7fbf28bf9640 1 -- 172.21.15.103:0/2013409684 >> v1:172.21.15.154:6789/0 conn(0x7fbf2406c650 legacy=0x7fbf240c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:17.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.551+0000 7fbf28bf9640 1 -- 172.21.15.103:0/2013409684 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf24159a00 con 0x7fbf240ca390 2024-09-10T08:35:17.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.552+0000 7fbf28bf9640 1 --2- 172.21.15.103:0/2013409684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf240ca390 0x7fbf240c7fd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c009e50 tx=0x7fbf1c02a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ece6f531aa3ef9f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:17.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.552+0000 7fbf22ffd640 1 -- 172.21.15.103:0/2013409684 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c036070 con 0x7fbf240ca390 2024-09-10T08:35:17.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.552+0000 7fbf22ffd640 1 -- 172.21.15.103:0/2013409684 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf1c031600 con 0x7fbf240ca390 2024-09-10T08:35:17.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.552+0000 7fbf22ffd640 1 -- 172.21.15.103:0/2013409684 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c0319d0 con 0x7fbf240ca390 2024-09-10T08:35:17.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.552+0000 7fbf2a65c640 1 -- 172.21.15.103:0/2013409684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf240ca390 msgr2=0x7fbf240c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:17.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.552+0000 7fbf2a65c640 1 --2- 172.21.15.103:0/2013409684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf240ca390 0x7fbf240c7fd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c009e50 tx=0x7fbf1c02a730 comp rx=0 tx=0).stop 2024-09-10T08:35:17.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.553+0000 7fbf2a65c640 1 -- 172.21.15.103:0/2013409684 shutdown_connections 2024-09-10T08:35:17.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.553+0000 7fbf2a65c640 1 --2- 172.21.15.103:0/2013409684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf240ca390 0x7fbf240c7fd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:17.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.553+0000 7fbf2a65c640 1 --2- 172.21.15.103:0/2013409684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf24150480 0x7fbf240c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:17.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.553+0000 7fbf2a65c640 1 -- 172.21.15.103:0/2013409684 >> 172.21.15.103:0/2013409684 conn(0x7fbf24068030 msgr2=0x7fbf24073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:17.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.553+0000 7fbf2a65c640 1 -- 172.21.15.103:0/2013409684 shutdown_connections 2024-09-10T08:35:17.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.553+0000 7fbf2a65c640 1 -- 172.21.15.103:0/2013409684 wait complete. 2024-09-10T08:35:17.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.554+0000 7fbf2a65c640 1 Processor -- start 2024-09-10T08:35:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.554+0000 7fbf2a65c640 1 -- start start 2024-09-10T08:35:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.555+0000 7fbf2a65c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf2406c650 0x7fbf24158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.555+0000 7fbf2a65c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf240ca390 0x7fbf24149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.555+0000 7fbf2a65c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf24150480 0x7fbf2414a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.555+0000 7fbf2a65c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2406d270 con 0x7fbf2406c650 2024-09-10T08:35:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.555+0000 7fbf2a65c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbf24159fc0 con 0x7fbf240ca390 2024-09-10T08:35:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.555+0000 7fbf2a65c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fbf24156270 con 0x7fbf24150480 2024-09-10T08:35:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.555+0000 7fbf28bf9640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf24150480 msgr2=0x7fbf2414a800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:35:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.555+0000 7fbf28bf9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf24150480 0x7fbf2414a800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:35:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.555+0000 7fbf23fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf2406c650 0x7fbf24158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.555+0000 7fbf237fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf240ca390 0x7fbf24149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:17.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.555+0000 7fbf23fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf2406c650 0x7fbf24158640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:32840/0 (socket says 172.21.15.103:32840) 2024-09-10T08:35:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.555+0000 7fbf237fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf240ca390 0x7fbf24149c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:38146/0 (socket says 172.21.15.103:38146) 2024-09-10T08:35:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.555+0000 7fbf23fff640 1 -- 172.21.15.103:0/3651114723 learned_addr learned my addr 172.21.15.103:0/3651114723 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.555+0000 7fbf23fff640 1 -- 172.21.15.103:0/3651114723 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf24150480 msgr2=0x7fbf2414a800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:35:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.555+0000 7fbf23fff640 1 --2- 172.21.15.103:0/3651114723 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf24150480 0x7fbf2414a800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.555+0000 7fbf23fff640 1 -- 172.21.15.103:0/3651114723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf240ca390 msgr2=0x7fbf24149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.555+0000 7fbf23fff640 1 --2- 172.21.15.103:0/3651114723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf240ca390 0x7fbf24149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.555+0000 7fbf23fff640 1 -- 172.21.15.103:0/3651114723 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2414a140 con 0x7fbf2406c650 2024-09-10T08:35:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.555+0000 7fbf237fe640 1 --2- 172.21.15.103:0/3651114723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf240ca390 0x7fbf24149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:35:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.555+0000 7fbf23fff640 1 --2- 172.21.15.103:0/3651114723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf2406c650 0x7fbf24158640 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbf1400b550 tx=0x7fbf1400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.556+0000 7fbf20ff9640 1 -- 172.21.15.103:0/3651114723 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14013020 con 0x7fbf2406c650 2024-09-10T08:35:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.556+0000 7fbf20ff9640 1 -- 172.21.15.103:0/3651114723 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf14003de0 con 0x7fbf2406c650 2024-09-10T08:35:17.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.556+0000 7fbf2a65c640 1 -- 172.21.15.103:0/3651114723 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf2414c620 con 0x7fbf2406c650 2024-09-10T08:35:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.556+0000 7fbf20ff9640 1 -- 172.21.15.103:0/3651114723 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf140052b0 con 0x7fbf2406c650 2024-09-10T08:35:17.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.556+0000 7fbf2a65c640 1 -- 172.21.15.103:0/3651114723 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf240cc020 con 0x7fbf2406c650 2024-09-10T08:35:17.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.557+0000 7fbf2a65c640 1 --2- 172.21.15.103:0/3651114723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf24158120 0x7fbf240aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:17.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.557+0000 7fbf2a65c640 1 -- 172.21.15.103:0/3651114723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbf24159860 con 0x7fbf24158120 2024-09-10T08:35:17.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.557+0000 7fbf237fe640 1 --2- 172.21.15.103:0/3651114723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf24158120 0x7fbf240aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:17.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.557+0000 7fbf20ff9640 1 -- 172.21.15.103:0/3651114723 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf14016020 con 0x7fbf2406c650 2024-09-10T08:35:17.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.557+0000 7fbf237fe640 1 -- 172.21.15.103:0/3651114723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf240c9c80 con 0x7fbf24158120 2024-09-10T08:35:17.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.557+0000 7fbf237fe640 1 --2- 172.21.15.103:0/3651114723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf24158120 0x7fbf240aeae0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbf240c6110 tx=0x7fbf1800fd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:17.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.558+0000 7fbf20ff9640 1 --2- 172.21.15.103:0/3651114723 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbf1006bde0 0x7fbf1006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:17.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.558+0000 7fbf20ff9640 1 -- 172.21.15.103:0/3651114723 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fbf1408ae50 con 0x7fbf2406c650 2024-09-10T08:35:17.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.558+0000 7fbf28bf9640 1 --2- 172.21.15.103:0/3651114723 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbf1006bde0 0x7fbf1006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:17.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.558+0000 7fbf20ff9640 1 -- 172.21.15.103:0/3651114723 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf180052e0 con 0x7fbf24158120 2024-09-10T08:35:17.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.558+0000 7fbf20ff9640 1 -- 172.21.15.103:0/3651114723 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbf180052e0 con 0x7fbf24158120 2024-09-10T08:35:17.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.558+0000 7fbf20ff9640 1 -- 172.21.15.103:0/3651114723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf24158120 msgr2=0x7fbf240aeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:17.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.558+0000 7fbf20ff9640 1 --2- 172.21.15.103:0/3651114723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf24158120 0x7fbf240aeae0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbf240c6110 tx=0x7fbf1800fd40 comp rx=0 tx=0).stop 2024-09-10T08:35:17.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.558+0000 7fbf20ff9640 1 -- 172.21.15.103:0/3651114723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf24158120 msgr2=0x7fbf240aeae0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:35:17.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.558+0000 7fbf20ff9640 1 --2- 172.21.15.103:0/3651114723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf24158120 0x7fbf240aeae0 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbf240c6110 tx=0x7fbf1800fd40 comp rx=0 tx=0).stop 2024-09-10T08:35:17.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.558+0000 7fbf28bf9640 1 --2- 172.21.15.103:0/3651114723 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbf1006bde0 0x7fbf1006e2a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c033000 tx=0x7fbf1c009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:17.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.565+0000 7fbf2a65c640 1 --2- 172.21.15.103:0/3651114723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf241592d0 0x7fbf240af020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:17.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.565+0000 7fbf2a65c640 1 -- 172.21.15.103:0/3651114723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2406c430 con 0x7fbf241592d0 2024-09-10T08:35:17.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.565+0000 7fbf237fe640 1 --2- 172.21.15.103:0/3651114723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf241592d0 0x7fbf240af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:17.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.565+0000 7fbf237fe640 1 -- 172.21.15.103:0/3651114723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbf240cbde0 con 0x7fbf241592d0 2024-09-10T08:35:17.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.565+0000 7fbf237fe640 1 --2- 172.21.15.103:0/3651114723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf241592d0 0x7fbf240af020 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbf1800d570 tx=0x7fbf18000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:17.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.565+0000 7fbf20ff9640 1 -- 172.21.15.103:0/3651114723 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf18005490 con 0x7fbf241592d0 2024-09-10T08:35:17.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.566+0000 7fbf20ff9640 1 -- 172.21.15.103:0/3651114723 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5042 (secure 0 0 0) 0x7fbf18005490 con 0x7fbf241592d0 2024-09-10T08:35:17.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.566+0000 7fbf20ff9640 1 -- 172.21.15.103:0/3651114723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf241592d0 msgr2=0x7fbf240af020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:17.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.566+0000 7fbf20ff9640 1 --2- 172.21.15.103:0/3651114723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf241592d0 0x7fbf240af020 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbf1800d570 tx=0x7fbf18000ed0 comp rx=0 tx=0).stop 2024-09-10T08:35:17.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.566+0000 7fbf20ff9640 1 -- 172.21.15.103:0/3651114723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf241592d0 msgr2=0x7fbf240af020 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:35:17.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.566+0000 7fbf20ff9640 1 --2- 172.21.15.103:0/3651114723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf241592d0 0x7fbf240af020 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbf1800d570 tx=0x7fbf18000ed0 comp rx=0 tx=0).stop 2024-09-10T08:35:17.566 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:35:17.566 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:35:17.566 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:35:17.566 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:35:17.566 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 56, 2024-09-10T08:35:17.567 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 33322, 2024-09-10T08:35:17.567 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:35:17.567 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:35:17.567 INFO:teuthology.orchestra.run.smithi103.stdout: 1 2024-09-10T08:35:17.567 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:17.567 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:35:17.567 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:35:17.567 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:35:17.567 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:35:17.567 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:17.567 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:17.567 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:17.567 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:17.567 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:17.568 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:17.568 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:17.568 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:17.568 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:17.568 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:17.568 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:17.568 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:17.568 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:35:17.568 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:35:17.568 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:17.568 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:17.568 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:17.569 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:17.569 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:17.569 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:17.569 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:17.569 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:17.569 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:17.569 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:17.569 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:17.569 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:17.569 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.569 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:35:17.569 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:35:17.569 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:35:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:35:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:35:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:35:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:35:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:35:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:35:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:35:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:35:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:35:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:35:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:35:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:35:17.570 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:35:17.571 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:35:17.571 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:17.571 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:17.571 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:17.571 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:17.571 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:17.571 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:17.571 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:17.571 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:17.571 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:17.571 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:17.571 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:17.571 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:17.572 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:35:17.572 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.572 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:35:17.572 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.572 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:35:17.572 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:35:17.572 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:17.572 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:17.572 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.572 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:17.572 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:35:17.572 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:17.572 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.573 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.573 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:17.573 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:35:17.573 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:17.573 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:17.573 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:17.573 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.573 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:35:17.573 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:35:17.573 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:17.573 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:17.573 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:17.573 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.574 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.574 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:35:17.574 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:35:17.574 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:17.574 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:17.574 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.574 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:17.574 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:35:17.574 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:17.574 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.574 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.574 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:17.574 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:35:17.574 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:17.575 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:17.575 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:17.575 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.575 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:35:17.575 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:35:17.575 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:17.575 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:17.575 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:17.575 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.575 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.575 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:35:17.575 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:35:17.575 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:17.575 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:17.575 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.576 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:17.576 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:35:17.576 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:17.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.576 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.576 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:17.576 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:35:17.576 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:17.576 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:17.576 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:17.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.576 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:35:17.576 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:35:17.577 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:17.577 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:17.577 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:17.577 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:17.577 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:17.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.577 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:35:17.577 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:35:17.577 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.577 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:17.577 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:17.577 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:35:17.577 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:17.577 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:17.578 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:35:17.578 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.578 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:17.578 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:17.578 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:35:17.578 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:17.578 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:17.578 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:35:17.578 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.578 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:17.578 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:17.578 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:35:17.578 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:17.578 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:17.579 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:35:17.579 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.579 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:17.579 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:17.579 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:35:17.579 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:17.579 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:17.579 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:35:17.579 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:17.579 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:17.579 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:17.579 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:35:17.579 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:17.580 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:17.580 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:17.580 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:35:17.580 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:35:17.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.566+0000 7fbf2a65c640 1 -- 172.21.15.103:0/3651114723 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbf1006bde0 msgr2=0x7fbf1006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:17.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.566+0000 7fbf2a65c640 1 --2- 172.21.15.103:0/3651114723 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbf1006bde0 0x7fbf1006e2a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c033000 tx=0x7fbf1c009000 comp rx=0 tx=0).stop 2024-09-10T08:35:17.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.566+0000 7fbf2a65c640 1 -- 172.21.15.103:0/3651114723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf2406c650 msgr2=0x7fbf24158640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:17.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.566+0000 7fbf2a65c640 1 --2- 172.21.15.103:0/3651114723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf2406c650 0x7fbf24158640 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbf1400b550 tx=0x7fbf1400ba10 comp rx=0 tx=0).stop 2024-09-10T08:35:17.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.566+0000 7fbf28bf9640 1 -- 172.21.15.103:0/3651114723 reap_dead start 2024-09-10T08:35:17.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.566+0000 7fbf28bf9640 1 -- 172.21.15.103:0/3651114723 reap_dead start 2024-09-10T08:35:17.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.566+0000 7fbf2a65c640 1 -- 172.21.15.103:0/3651114723 shutdown_connections 2024-09-10T08:35:17.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.566+0000 7fbf2a65c640 1 -- 172.21.15.103:0/3651114723 >> 172.21.15.103:0/3651114723 conn(0x7fbf24068030 msgr2=0x7fbf24154c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:17.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.566+0000 7fbf2a65c640 1 -- 172.21.15.103:0/3651114723 shutdown_connections 2024-09-10T08:35:17.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:17.566+0000 7fbf2a65c640 1 -- 172.21.15.103:0/3651114723 wait complete. 2024-09-10T08:35:17.582 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:35:17.582 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-10T08:35:30.486 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:35:30.489 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:35:37.583 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-10T08:35:37.584 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-10T08:35:37.584 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T08:35:37.584 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T08:35:37.586 INFO:tasks.ceph.mon.c:Started 2024-09-10T08:35:37.586 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:35:37.587 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:35:37.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.693+0000 7f05ec181640 1 Processor -- start 2024-09-10T08:35:37.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.693+0000 7f05ec181640 1 -- start start 2024-09-10T08:35:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.694+0000 7f05ec181640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05e406cd80 0x7f05e4153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.694+0000 7f05ec181640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f05e415a4a0 0x7f05e4156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.694+0000 7f05ec181640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e40c7070 con 0x7f05e40c8b10 2024-09-10T08:35:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.694+0000 7f05ec181640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f05e406d210 con 0x7f05e415a4a0 2024-09-10T08:35:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.694+0000 7f05ec181640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f05e40c69b0 con 0x7f05e406cd80 2024-09-10T08:35:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.694+0000 7f05ea71e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f05e415a4a0 0x7f05e4156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.694+0000 7f05e971c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05e406cd80 0x7f05e4153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.694+0000 7f05ea71e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f05e415a4a0 0x7f05e4156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39102/0 (socket says 172.21.15.103:39102) 2024-09-10T08:35:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.694+0000 7f05e9f1d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f05e40c8b10 0x7f05e41534d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:40476/0 (socket says 172.21.15.103:40476) 2024-09-10T08:35:37.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.694+0000 7f05ea71e640 1 -- 172.21.15.103:0/3268568881 learned_addr learned my addr 172.21.15.103:0/3268568881 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:37.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.694+0000 7f05e971c640 1 -- 172.21.15.103:0/3268568881 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05e406cd80 msgr2=0x7f05e4153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:35:37.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.694+0000 7f05e971c640 1 -- 172.21.15.103:0/3268568881 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05e406cd80 msgr2=0x7f05e4153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:35:37.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.694+0000 7f05e971c640 1 --2- 172.21.15.103:0/3268568881 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05e406cd80 0x7f05e4153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:35:37.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.694+0000 7f05e971c640 1 --2- 172.21.15.103:0/3268568881 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05e406cd80 0x7f05e4153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:35:37.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.694+0000 7f05ea71e640 1 -- 172.21.15.103:0/3268568881 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05e406cd80 msgr2=0x7f05e4153be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:35:37.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.694+0000 7f05ea71e640 1 --2- 172.21.15.103:0/3268568881 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05e406cd80 0x7f05e4153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:37.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.694+0000 7f05ea71e640 1 -- 172.21.15.103:0/3268568881 >> v1:172.21.15.154:6789/0 conn(0x7f05e40c8b10 legacy=0x7f05e41534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:37.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.694+0000 7f05e8f1b640 1 -- 172.21.15.103:0/3268568881 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1220547503 0 0) 0x7f05e40c7070 con 0x7f05e40c8b10 2024-09-10T08:35:37.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.694+0000 7f05ea71e640 1 -- 172.21.15.103:0/3268568881 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e40c6c90 con 0x7f05e415a4a0 2024-09-10T08:35:37.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.695+0000 7f05ea71e640 1 --2- 172.21.15.103:0/3268568881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e415a4a0 0x7f05e4156660 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009e50 tx=0x7f05dc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51a9a8cd6ca4f40 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:37.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.695+0000 7f05e8f1b640 1 -- 172.21.15.103:0/3268568881 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05dc036070 con 0x7f05e415a4a0 2024-09-10T08:35:37.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.695+0000 7f05e8f1b640 1 -- 172.21.15.103:0/3268568881 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05dc031600 con 0x7f05e415a4a0 2024-09-10T08:35:37.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.695+0000 7f05e8f1b640 1 -- 172.21.15.103:0/3268568881 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05dc0319d0 con 0x7f05e415a4a0 2024-09-10T08:35:37.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.696+0000 7f05ec181640 1 -- 172.21.15.103:0/3268568881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e415a4a0 msgr2=0x7f05e4156660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:37.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.696+0000 7f05ec181640 1 --2- 172.21.15.103:0/3268568881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e415a4a0 0x7f05e4156660 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009e50 tx=0x7f05dc02a680 comp rx=0 tx=0).stop 2024-09-10T08:35:37.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.696+0000 7f05ec181640 1 -- 172.21.15.103:0/3268568881 shutdown_connections 2024-09-10T08:35:37.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.696+0000 7f05ec181640 1 --2- 172.21.15.103:0/3268568881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e415a4a0 0x7f05e4156660 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:37.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.696+0000 7f05ec181640 1 --2- 172.21.15.103:0/3268568881 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05e406cd80 0x7f05e4153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:37.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.696+0000 7f05ec181640 1 -- 172.21.15.103:0/3268568881 >> 172.21.15.103:0/3268568881 conn(0x7f05e40adb80 msgr2=0x7f05e40adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:37.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.696+0000 7f05ec181640 1 -- 172.21.15.103:0/3268568881 shutdown_connections 2024-09-10T08:35:37.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.696+0000 7f05ec181640 1 -- 172.21.15.103:0/3268568881 wait complete. 2024-09-10T08:35:37.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.697+0000 7f05ec181640 1 Processor -- start 2024-09-10T08:35:37.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.697+0000 7f05ec181640 1 -- start start 2024-09-10T08:35:37.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.698+0000 7f05ec181640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05e40c8b10 0x7f05e40aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:37.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.698+0000 7f05ec181640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05e415a4a0 0x7f05e414e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.698+0000 7f05ec181640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e41552a0 0x7f05e41502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.698+0000 7f05ec181640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f05e40c9070 con 0x7f05e41552a0 2024-09-10T08:35:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.698+0000 7f05ec181640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f05e40c8ef0 con 0x7f05e40c8b10 2024-09-10T08:35:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.698+0000 7f05ec181640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f05e4156ba0 con 0x7f05e415a4a0 2024-09-10T08:35:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.698+0000 7f05ea71e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e41552a0 0x7f05e41502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.698+0000 7f05e9f1d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05e40c8b10 0x7f05e40aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.698+0000 7f05ea71e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e41552a0 0x7f05e41502c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39110/0 (socket says 172.21.15.103:39110) 2024-09-10T08:35:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.698+0000 7f05e9f1d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05e40c8b10 0x7f05e40aec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:57162/0 (socket says 172.21.15.103:57162) 2024-09-10T08:35:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.698+0000 7f05ea71e640 1 -- 172.21.15.103:0/346422785 learned_addr learned my addr 172.21.15.103:0/346422785 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.698+0000 7f05e971c640 1 --2- 172.21.15.103:0/346422785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05e415a4a0 0x7f05e414e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.698+0000 7f05e971c640 1 -- 172.21.15.103:0/346422785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05e415a4a0 msgr2=0x7f05e414e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-10T08:35:37.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.698+0000 7f05e971c640 1 -- 172.21.15.103:0/346422785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05e415a4a0 msgr2=0x7f05e414e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:35:37.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.698+0000 7f05e971c640 1 --2- 172.21.15.103:0/346422785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05e415a4a0 0x7f05e414e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:35:37.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.698+0000 7f05e971c640 1 --2- 172.21.15.103:0/346422785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05e415a4a0 0x7f05e414e3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:35:37.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.698+0000 7f05ea71e640 1 -- 172.21.15.103:0/346422785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05e415a4a0 msgr2=0x7f05e414e3f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:35:37.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.698+0000 7f05ea71e640 1 --2- 172.21.15.103:0/346422785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05e415a4a0 0x7f05e414e3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:37.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.698+0000 7f05ea71e640 1 -- 172.21.15.103:0/346422785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05e40c8b10 msgr2=0x7f05e40aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:37.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.698+0000 7f05ea71e640 1 --2- 172.21.15.103:0/346422785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05e40c8b10 0x7f05e40aec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:37.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.698+0000 7f05ea71e640 1 -- 172.21.15.103:0/346422785 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e414e930 con 0x7f05e41552a0 2024-09-10T08:35:37.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.699+0000 7f05ea71e640 1 --2- 172.21.15.103:0/346422785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e41552a0 0x7f05e41502c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009f70 tx=0x7f05dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:37.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.699+0000 7f05da7fc640 1 -- 172.21.15.103:0/346422785 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05dc041020 con 0x7f05e41552a0 2024-09-10T08:35:37.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.699+0000 7f05da7fc640 1 -- 172.21.15.103:0/346422785 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05dc007780 con 0x7f05e41552a0 2024-09-10T08:35:37.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.699+0000 7f05da7fc640 1 -- 172.21.15.103:0/346422785 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05dc036040 con 0x7f05e41552a0 2024-09-10T08:35:37.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.699+0000 7f05ec181640 1 -- 172.21.15.103:0/346422785 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e40b1c50 con 0x7f05e41552a0 2024-09-10T08:35:37.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.699+0000 7f05ec181640 1 -- 172.21.15.103:0/346422785 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e414f870 con 0x7f05e41552a0 2024-09-10T08:35:37.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.700+0000 7f05ec181640 1 -- 172.21.15.103:0/346422785 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e40b2170 con 0x7f05e41552a0 2024-09-10T08:35:37.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.701+0000 7f05da7fc640 1 -- 172.21.15.103:0/346422785 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05dc044020 con 0x7f05e41552a0 2024-09-10T08:35:37.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.701+0000 7f05da7fc640 1 --2- 172.21.15.103:0/346422785 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f05c806be30 0x7f05c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:37.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.701+0000 7f05da7fc640 1 -- 172.21.15.103:0/346422785 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f05dc0abd40 con 0x7f05e41552a0 2024-09-10T08:35:37.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.701+0000 7f05e9f1d640 1 --2- 172.21.15.103:0/346422785 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f05c806be30 0x7f05c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:37.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.702+0000 7f05e9f1d640 1 --2- 172.21.15.103:0/346422785 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f05c806be30 0x7f05c806e2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f05e0000f60 tx=0x7f05e0007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:37.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:37.708+0000 7f05da7fc640 1 -- 172.21.15.103:0/346422785 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05dc04b030 con 0x7f05e41552a0 2024-09-10T08:35:38.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:38.030+0000 7f05ec181640 1 -- 172.21.15.103:0/346422785 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f05e4157030 con 0x7f05e41552a0 2024-09-10T08:35:38.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:38.030+0000 7f05da7fc640 1 -- 172.21.15.103:0/346422785 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f05dc07a3e0 con 0x7f05e41552a0 2024-09-10T08:35:38.031 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":56,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:35:38.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:38.033+0000 7f05ec181640 1 -- 172.21.15.103:0/346422785 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f05c806be30 msgr2=0x7f05c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:38.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:38.033+0000 7f05ec181640 1 --2- 172.21.15.103:0/346422785 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f05c806be30 0x7f05c806e2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f05e0000f60 tx=0x7f05e0007d50 comp rx=0 tx=0).stop 2024-09-10T08:35:38.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:38.033+0000 7f05ec181640 1 -- 172.21.15.103:0/346422785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e41552a0 msgr2=0x7f05e41502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:38.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:38.033+0000 7f05ec181640 1 --2- 172.21.15.103:0/346422785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e41552a0 0x7f05e41502c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009f70 tx=0x7f05dc004a40 comp rx=0 tx=0).stop 2024-09-10T08:35:38.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:38.033+0000 7f05ec181640 1 -- 172.21.15.103:0/346422785 shutdown_connections 2024-09-10T08:35:38.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:38.033+0000 7f05ec181640 1 --2- 172.21.15.103:0/346422785 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f05c806be30 0x7f05c806e2f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:38.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:38.033+0000 7f05ec181640 1 --2- 172.21.15.103:0/346422785 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05e41552a0 0x7f05e41502c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:38.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:38.033+0000 7f05ec181640 1 --2- 172.21.15.103:0/346422785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05e415a4a0 0x7f05e414e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:38.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:38.033+0000 7f05ec181640 1 --2- 172.21.15.103:0/346422785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05e40c8b10 0x7f05e40aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:38.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:38.033+0000 7f05ec181640 1 -- 172.21.15.103:0/346422785 >> 172.21.15.103:0/346422785 conn(0x7f05e40adb80 msgr2=0x7f05e40aba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:38.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:38.033+0000 7f05ec181640 1 -- 172.21.15.103:0/346422785 shutdown_connections 2024-09-10T08:35:38.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:38.033+0000 7f05ec181640 1 -- 172.21.15.103:0/346422785 wait complete. 2024-09-10T08:35:41.045 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:35:41.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.162+0000 7f52e0047640 1 Processor -- start 2024-09-10T08:35:41.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.163+0000 7f52e0047640 1 -- start start 2024-09-10T08:35:41.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.163+0000 7f52e0047640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52d806cd80 0x7f52d8153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:41.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.163+0000 7f52e0047640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52d80c7070 con 0x7f52d815a4a0 2024-09-10T08:35:41.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.163+0000 7f52e0047640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52d806d210 con 0x7f52d80c8b10 2024-09-10T08:35:41.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.163+0000 7f52e0047640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f52d80c69b0 con 0x7f52d806cd80 2024-09-10T08:35:41.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52de5e4640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f52d815a4a0 0x7f52d8156660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33362/0 (socket says 172.21.15.103:33362) 2024-09-10T08:35:41.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52de5e4640 1 -- 172.21.15.103:0/3637186119 learned_addr learned my addr 172.21.15.103:0/3637186119 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:35:41.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dd5e2640 1 --2- 172.21.15.103:0/3637186119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52d806cd80 0x7f52d8153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:41.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dd5e2640 1 -- 172.21.15.103:0/3637186119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52d806cd80 msgr2=0x7f52d8153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:35:41.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dd5e2640 1 -- 172.21.15.103:0/3637186119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52d806cd80 msgr2=0x7f52d8153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:35:41.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dd5e2640 1 --2- 172.21.15.103:0/3637186119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52d806cd80 0x7f52d8153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:35:41.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dd5e2640 1 --2- 172.21.15.103:0/3637186119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52d806cd80 0x7f52d8153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:35:41.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dcde1640 1 -- 172.21.15.103:0/3637186119 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1502594809 0 0) 0x7f52d80c7070 con 0x7f52d815a4a0 2024-09-10T08:35:41.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dcde1640 1 -- 172.21.15.103:0/3637186119 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52c4003520 con 0x7f52d815a4a0 2024-09-10T08:35:41.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dcde1640 1 -- 172.21.15.103:0/3637186119 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 919059282 0 0) 0x7f52d806d210 con 0x7f52d80c8b10 2024-09-10T08:35:41.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dcde1640 1 -- 172.21.15.103:0/3637186119 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52d80c7070 con 0x7f52d80c8b10 2024-09-10T08:35:41.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dcde1640 1 -- 172.21.15.103:0/3637186119 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1255388865 0 0) 0x7f52c4003520 con 0x7f52d815a4a0 2024-09-10T08:35:41.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dcde1640 1 -- 172.21.15.103:0/3637186119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52d806cd80 msgr2=0x7f52d8153be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:35:41.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dcde1640 1 --2- 172.21.15.103:0/3637186119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52d806cd80 0x7f52d8153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:41.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dcde1640 1 -- 172.21.15.103:0/3637186119 >> v1:172.21.15.154:6789/0 conn(0x7f52d80c8b10 legacy=0x7f52d81534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:41.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dcde1640 1 -- 172.21.15.103:0/3637186119 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d80c6c90 con 0x7f52d815a4a0 2024-09-10T08:35:41.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dcde1640 1 -- 172.21.15.103:0/3637186119 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f52d00019f0 con 0x7f52d815a4a0 2024-09-10T08:35:41.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dcde1640 1 -- 172.21.15.103:0/3637186119 >> v1:172.21.15.103:6789/0 conn(0x7f52d815a4a0 legacy=0x7f52d8156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:41.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dcde1640 1 --2- 172.21.15.103:0/3637186119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52c4003b70 0x7f52c4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:41.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dcde1640 1 --2- 172.21.15.103:0/3637186119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004800 0x7f52c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:41.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dcde1640 1 --2- 172.21.15.103:0/3637186119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52c40052e0 0x7f52c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:41.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dcde1640 1 -- 172.21.15.103:0/3637186119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f52d80c69b0 con 0x7f52c4004800 2024-09-10T08:35:41.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dcde1640 1 -- 172.21.15.103:0/3637186119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f52c400bfe0 con 0x7f52c4003b70 2024-09-10T08:35:41.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dcde1640 1 -- 172.21.15.103:0/3637186119 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f52c400c1e0 con 0x7f52c40052e0 2024-09-10T08:35:41.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.164+0000 7f52dd5e2640 1 --2- 172.21.15.103:0/3637186119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004800 0x7f52c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:41.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.165+0000 7f52de5e4640 1 --2- 172.21.15.103:0/3637186119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52c40052e0 0x7f52c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:41.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.165+0000 7f52ddde3640 1 --2- 172.21.15.103:0/3637186119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52c4003b70 0x7f52c4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:41.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.165+0000 7f52dd5e2640 1 -- 172.21.15.103:0/3637186119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52c40052e0 msgr2=0x7f52c400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:41.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.165+0000 7f52dd5e2640 1 --2- 172.21.15.103:0/3637186119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52c40052e0 0x7f52c400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:41.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.165+0000 7f52dd5e2640 1 -- 172.21.15.103:0/3637186119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52c4003b70 msgr2=0x7f52c4003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:41.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.165+0000 7f52dd5e2640 1 --2- 172.21.15.103:0/3637186119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52c4003b70 0x7f52c4003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:41.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.165+0000 7f52dd5e2640 1 -- 172.21.15.103:0/3637186119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c4003520 con 0x7f52c4004800 2024-09-10T08:35:41.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.166+0000 7f52dd5e2640 1 --2- 172.21.15.103:0/3637186119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004800 0x7f52c4004c80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f52d806ec00 tx=0x7f52c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efcd3743d49d8dc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:41.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.166+0000 7f52dcde1640 1 -- 172.21.15.103:0/3637186119 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c8030070 con 0x7f52c4004800 2024-09-10T08:35:41.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.166+0000 7f52dcde1640 1 -- 172.21.15.103:0/3637186119 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c802ad40 con 0x7f52c4004800 2024-09-10T08:35:41.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.166+0000 7f52dcde1640 1 -- 172.21.15.103:0/3637186119 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c800b5e0 con 0x7f52c4004800 2024-09-10T08:35:41.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.167+0000 7f52e0047640 1 -- 172.21.15.103:0/3637186119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004800 msgr2=0x7f52c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:41.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.167+0000 7f52e0047640 1 --2- 172.21.15.103:0/3637186119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004800 0x7f52c4004c80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f52d806ec00 tx=0x7f52c4005830 comp rx=0 tx=0).stop 2024-09-10T08:35:41.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.167+0000 7f52de5e4640 1 -- 172.21.15.103:0/3637186119 reap_dead start 2024-09-10T08:35:41.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.167+0000 7f52e0047640 1 -- 172.21.15.103:0/3637186119 shutdown_connections 2024-09-10T08:35:41.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.167+0000 7f52e0047640 1 -- 172.21.15.103:0/3637186119 >> 172.21.15.103:0/3637186119 conn(0x7f52d80adb80 msgr2=0x7f52d80adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:41.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.167+0000 7f52e0047640 1 -- 172.21.15.103:0/3637186119 shutdown_connections 2024-09-10T08:35:41.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.167+0000 7f52e0047640 1 -- 172.21.15.103:0/3637186119 wait complete. 2024-09-10T08:35:41.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.168+0000 7f52e0047640 1 Processor -- start 2024-09-10T08:35:41.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.168+0000 7f52e0047640 1 -- start start 2024-09-10T08:35:41.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.169+0000 7f52e0047640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004800 0x7f52d80accb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:41.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.169+0000 7f52e0047640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52d8158c40 0x7f52d814d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:41.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.169+0000 7f52e0047640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52d814df20 0x7f52d8149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:41.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.169+0000 7f52e0047640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f52d80c9070 con 0x7f52c4004800 2024-09-10T08:35:41.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.169+0000 7f52e0047640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f52d80c8ef0 con 0x7f52d814df20 2024-09-10T08:35:41.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.169+0000 7f52e0047640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f52d8153be0 con 0x7f52d8158c40 2024-09-10T08:35:41.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.169+0000 7f52ddde3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004800 0x7f52d80accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:41.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.169+0000 7f52ddde3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004800 0x7f52d80accb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39126/0 (socket says 172.21.15.103:39126) 2024-09-10T08:35:41.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.169+0000 7f52ddde3640 1 -- 172.21.15.103:0/564860356 learned_addr learned my addr 172.21.15.103:0/564860356 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:41.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.169+0000 7f52dd5e2640 1 --2- 172.21.15.103:0/564860356 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52d8158c40 0x7f52d814d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:41.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.169+0000 7f52de5e4640 1 --2- 172.21.15.103:0/564860356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52d814df20 0x7f52d8149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.169+0000 7f52dd5e2640 1 -- 172.21.15.103:0/564860356 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52d8158c40 msgr2=0x7f52d814d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-10T08:35:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.169+0000 7f52dd5e2640 1 -- 172.21.15.103:0/564860356 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52d8158c40 msgr2=0x7f52d814d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:35:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.169+0000 7f52dd5e2640 1 --2- 172.21.15.103:0/564860356 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52d8158c40 0x7f52d814d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:35:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.169+0000 7f52dd5e2640 1 --2- 172.21.15.103:0/564860356 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52d8158c40 0x7f52d814d9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:35:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.169+0000 7f52ddde3640 1 -- 172.21.15.103:0/564860356 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52d8158c40 msgr2=0x7f52d814d9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:35:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.169+0000 7f52ddde3640 1 --2- 172.21.15.103:0/564860356 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52d8158c40 0x7f52d814d9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.169+0000 7f52ddde3640 1 -- 172.21.15.103:0/564860356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52d814df20 msgr2=0x7f52d8149700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.169+0000 7f52ddde3640 1 --2- 172.21.15.103:0/564860356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52d814df20 0x7f52d8149700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.170+0000 7f52ddde3640 1 -- 172.21.15.103:0/564860356 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d8150770 con 0x7f52c4004800 2024-09-10T08:35:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.170+0000 7f52ddde3640 1 --2- 172.21.15.103:0/564860356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004800 0x7f52d80accb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f52d400f730 tx=0x7f52d400fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.170+0000 7f52ce7fc640 1 -- 172.21.15.103:0/564860356 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d400fe40 con 0x7f52c4004800 2024-09-10T08:35:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.170+0000 7f52ce7fc640 1 -- 172.21.15.103:0/564860356 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d4018070 con 0x7f52c4004800 2024-09-10T08:35:41.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.170+0000 7f52ce7fc640 1 -- 172.21.15.103:0/564860356 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d400d730 con 0x7f52c4004800 2024-09-10T08:35:41.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.170+0000 7f52e0047640 1 -- 172.21.15.103:0/564860356 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d8159760 con 0x7f52c4004800 2024-09-10T08:35:41.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.170+0000 7f52e0047640 1 -- 172.21.15.103:0/564860356 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d81ebc20 con 0x7f52c4004800 2024-09-10T08:35:41.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.171+0000 7f52e0047640 1 -- 172.21.15.103:0/564860356 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52d8153f40 con 0x7f52c4004800 2024-09-10T08:35:41.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.172+0000 7f52ce7fc640 1 -- 172.21.15.103:0/564860356 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f52d400d8d0 con 0x7f52c4004800 2024-09-10T08:35:41.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.172+0000 7f52ce7fc640 1 --2- 172.21.15.103:0/564860356 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f52bc06be30 0x7f52bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:41.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.172+0000 7f52ce7fc640 1 -- 172.21.15.103:0/564860356 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f52d408b170 con 0x7f52c4004800 2024-09-10T08:35:41.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.172+0000 7f52dd5e2640 1 --2- 172.21.15.103:0/564860356 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f52bc06be30 0x7f52bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:41.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.173+0000 7f52dd5e2640 1 --2- 172.21.15.103:0/564860356 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f52bc06be30 0x7f52bc06e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f52c8035000 tx=0x7f52c8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:41.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.177+0000 7f52ce7fc640 1 -- 172.21.15.103:0/564860356 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f52d4059790 con 0x7f52c4004800 2024-09-10T08:35:41.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.491+0000 7f52e0047640 1 -- 172.21.15.103:0/564860356 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f52d814e330 con 0x7f52c4004800 2024-09-10T08:35:41.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.492+0000 7f52ce7fc640 1 -- 172.21.15.103:0/564860356 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f52d4059090 con 0x7f52c4004800 2024-09-10T08:35:41.493 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":56,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:35:41.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.494+0000 7f52e0047640 1 -- 172.21.15.103:0/564860356 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f52bc06be30 msgr2=0x7f52bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:41.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.494+0000 7f52e0047640 1 --2- 172.21.15.103:0/564860356 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f52bc06be30 0x7f52bc06e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f52c8035000 tx=0x7f52c8030000 comp rx=0 tx=0).stop 2024-09-10T08:35:41.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.494+0000 7f52e0047640 1 -- 172.21.15.103:0/564860356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004800 msgr2=0x7f52d80accb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:41.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.494+0000 7f52e0047640 1 --2- 172.21.15.103:0/564860356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004800 0x7f52d80accb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f52d400f730 tx=0x7f52d400fbf0 comp rx=0 tx=0).stop 2024-09-10T08:35:41.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.494+0000 7f52e0047640 1 -- 172.21.15.103:0/564860356 shutdown_connections 2024-09-10T08:35:41.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.494+0000 7f52e0047640 1 --2- 172.21.15.103:0/564860356 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f52bc06be30 0x7f52bc06e2f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:41.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.494+0000 7f52e0047640 1 --2- 172.21.15.103:0/564860356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52d814df20 0x7f52d8149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:41.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.494+0000 7f52e0047640 1 --2- 172.21.15.103:0/564860356 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52d8158c40 0x7f52d814d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:41.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.494+0000 7f52e0047640 1 --2- 172.21.15.103:0/564860356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52c4004800 0x7f52d80accb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:41.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.494+0000 7f52e0047640 1 -- 172.21.15.103:0/564860356 >> 172.21.15.103:0/564860356 conn(0x7f52d80adb80 msgr2=0x7f52d80ca2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:41.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.494+0000 7f52e0047640 1 -- 172.21.15.103:0/564860356 shutdown_connections 2024-09-10T08:35:41.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:41.494+0000 7f52e0047640 1 -- 172.21.15.103:0/564860356 wait complete. 2024-09-10T08:35:44.509 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:35:44.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.623+0000 7f014e29b640 1 Processor -- start 2024-09-10T08:35:44.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.623+0000 7f014e29b640 1 -- start start 2024-09-10T08:35:44.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.624+0000 7f014e29b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f01480ade30 0x7f01480c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:44.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.624+0000 7f014e29b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01480c7fb0 0x7f01480c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:44.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.624+0000 7f014e29b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0148153470 con 0x7f01480aea70 2024-09-10T08:35:44.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.624+0000 7f014e29b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f0148150d00 con 0x7f01480ade30 2024-09-10T08:35:44.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.624+0000 7f014e29b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0148153750 con 0x7f01480c7fb0 2024-09-10T08:35:44.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.625+0000 7f01477fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f01480aea70 0x7f01480c38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33364/0 (socket says 172.21.15.103:33364) 2024-09-10T08:35:44.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.625+0000 7f01477fe640 1 -- 172.21.15.103:0/256279116 learned_addr learned my addr 172.21.15.103:0/256279116 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:35:44.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.625+0000 7f0147fff640 1 --2- 172.21.15.103:0/256279116 >> v2:172.21.15.154:3300/0 conn(0x7f01480ade30 0x7f01480c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:44.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.625+0000 7f014c838640 1 --2- 172.21.15.103:0/256279116 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01480c7fb0 0x7f01480c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:44.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.625+0000 7f0146ffd640 1 -- 172.21.15.103:0/256279116 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2749642517 0 0) 0x7f0148153470 con 0x7f01480aea70 2024-09-10T08:35:44.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.625+0000 7f0146ffd640 1 -- 172.21.15.103:0/256279116 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0130003520 con 0x7f01480aea70 2024-09-10T08:35:44.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.625+0000 7f0147fff640 1 -- 172.21.15.103:0/256279116 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01480c7fb0 msgr2=0x7f01480c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:44.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.625+0000 7f0147fff640 1 --2- 172.21.15.103:0/256279116 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01480c7fb0 0x7f01480c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:44.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.625+0000 7f0147fff640 1 -- 172.21.15.103:0/256279116 >> v1:172.21.15.103:6789/0 conn(0x7f01480aea70 legacy=0x7f01480c38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:44.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.625+0000 7f0147fff640 1 -- 172.21.15.103:0/256279116 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0148153a30 con 0x7f01480ade30 2024-09-10T08:35:44.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.625+0000 7f014c838640 1 --2- 172.21.15.103:0/256279116 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01480c7fb0 0x7f01480c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:35:44.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.626+0000 7f0147fff640 1 --2- 172.21.15.103:0/256279116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01480ade30 0x7f01480c7a70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f01380097a0 tx=0x7f013802a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd46b249e3ae36bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:44.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.626+0000 7f0146ffd640 1 -- 172.21.15.103:0/256279116 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0138037070 con 0x7f01480ade30 2024-09-10T08:35:44.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.626+0000 7f0146ffd640 1 -- 172.21.15.103:0/256279116 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f013802adb0 con 0x7f01480ade30 2024-09-10T08:35:44.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.626+0000 7f0146ffd640 1 -- 172.21.15.103:0/256279116 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0138032640 con 0x7f01480ade30 2024-09-10T08:35:44.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.626+0000 7f014e29b640 1 -- 172.21.15.103:0/256279116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01480ade30 msgr2=0x7f01480c7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:44.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.626+0000 7f014e29b640 1 --2- 172.21.15.103:0/256279116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01480ade30 0x7f01480c7a70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f01380097a0 tx=0x7f013802a060 comp rx=0 tx=0).stop 2024-09-10T08:35:44.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.627+0000 7f014e29b640 1 -- 172.21.15.103:0/256279116 shutdown_connections 2024-09-10T08:35:44.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.627+0000 7f014e29b640 1 --2- 172.21.15.103:0/256279116 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01480c7fb0 0x7f01480c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:44.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.627+0000 7f014e29b640 1 --2- 172.21.15.103:0/256279116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01480ade30 0x7f01480c7a70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:44.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.627+0000 7f014e29b640 1 -- 172.21.15.103:0/256279116 >> 172.21.15.103:0/256279116 conn(0x7f01480c5660 msgr2=0x7f01480c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:44.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.627+0000 7f014e29b640 1 -- 172.21.15.103:0/256279116 shutdown_connections 2024-09-10T08:35:44.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.627+0000 7f014e29b640 1 -- 172.21.15.103:0/256279116 wait complete. 2024-09-10T08:35:44.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.628+0000 7f014e29b640 1 Processor -- start 2024-09-10T08:35:44.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.628+0000 7f014e29b640 1 -- start start 2024-09-10T08:35:44.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.629+0000 7f014e29b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01480ade30 0x7f01481e0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:44.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.629+0000 7f014e29b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01480aea70 0x7f0148071c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:44.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.629+0000 7f014e29b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01480c7fb0 0x7f01480721d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:44.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.629+0000 7f014e29b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0148153040 con 0x7f01480c7fb0 2024-09-10T08:35:44.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.629+0000 7f014e29b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f01480c4520 con 0x7f01480aea70 2024-09-10T08:35:44.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.629+0000 7f014e29b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f01481531c0 con 0x7f01480ade30 2024-09-10T08:35:44.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.629+0000 7f014c838640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01480c7fb0 0x7f01480721d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:44.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.629+0000 7f014c838640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01480c7fb0 0x7f01480721d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39128/0 (socket says 172.21.15.103:39128) 2024-09-10T08:35:44.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.629+0000 7f014c838640 1 -- 172.21.15.103:0/1086256614 learned_addr learned my addr 172.21.15.103:0/1086256614 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:44.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.629+0000 7f0147fff640 1 --2- 172.21.15.103:0/1086256614 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01480ade30 0x7f01481e0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:44.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.629+0000 7f01477fe640 1 --2- 172.21.15.103:0/1086256614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01480aea70 0x7f0148071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:44.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.629+0000 7f014c838640 1 -- 172.21.15.103:0/1086256614 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01480ade30 msgr2=0x7f01481e0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:44.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.629+0000 7f014c838640 1 --2- 172.21.15.103:0/1086256614 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01480ade30 0x7f01481e0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:44.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.629+0000 7f014c838640 1 -- 172.21.15.103:0/1086256614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01480aea70 msgr2=0x7f0148071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:44.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.629+0000 7f014c838640 1 --2- 172.21.15.103:0/1086256614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01480aea70 0x7f0148071c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:44.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.629+0000 7f014c838640 1 -- 172.21.15.103:0/1086256614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01480a88d0 con 0x7f01480c7fb0 2024-09-10T08:35:44.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.629+0000 7f014c838640 1 --2- 172.21.15.103:0/1086256614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01480c7fb0 0x7f01480721d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f014000efc0 tx=0x7f014000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:44.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.630+0000 7f0144ff9640 1 -- 172.21.15.103:0/1086256614 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0140018030 con 0x7f01480c7fb0 2024-09-10T08:35:44.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.630+0000 7f0144ff9640 1 -- 172.21.15.103:0/1086256614 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f014000cdf0 con 0x7f01480c7fb0 2024-09-10T08:35:44.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.630+0000 7f014e29b640 1 -- 172.21.15.103:0/1086256614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01481ecab0 con 0x7f01480c7fb0 2024-09-10T08:35:44.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.630+0000 7f0144ff9640 1 -- 172.21.15.103:0/1086256614 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0140003bb0 con 0x7f01480c7fb0 2024-09-10T08:35:44.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.630+0000 7f014e29b640 1 -- 172.21.15.103:0/1086256614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01481ec7d0 con 0x7f01480c7fb0 2024-09-10T08:35:44.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.631+0000 7f014e29b640 1 -- 172.21.15.103:0/1086256614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01481ec5c0 con 0x7f01480c7fb0 2024-09-10T08:35:44.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.631+0000 7f0144ff9640 1 -- 172.21.15.103:0/1086256614 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0140005d10 con 0x7f01480c7fb0 2024-09-10T08:35:44.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.632+0000 7f0144ff9640 1 --2- 172.21.15.103:0/1086256614 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f013406be30 0x7f013406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:44.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.632+0000 7f0144ff9640 1 -- 172.21.15.103:0/1086256614 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f014008b9d0 con 0x7f01480c7fb0 2024-09-10T08:35:44.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.632+0000 7f0147fff640 1 --2- 172.21.15.103:0/1086256614 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f013406be30 0x7f013406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:44.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.633+0000 7f0147fff640 1 --2- 172.21.15.103:0/1086256614 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f013406be30 0x7f013406e2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0138034000 tx=0x7f013802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:44.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.637+0000 7f0144ff9640 1 -- 172.21.15.103:0/1086256614 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0140022070 con 0x7f01480c7fb0 2024-09-10T08:35:44.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.944+0000 7f014e29b640 1 -- 172.21.15.103:0/1086256614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f01480ae210 con 0x7f01480c7fb0 2024-09-10T08:35:44.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.945+0000 7f0144ff9640 1 -- 172.21.15.103:0/1086256614 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f01480a88d0 con 0x7f01480c7fb0 2024-09-10T08:35:44.946 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:35:44.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.948+0000 7f014e29b640 1 -- 172.21.15.103:0/1086256614 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f013406be30 msgr2=0x7f013406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:44.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.948+0000 7f014e29b640 1 --2- 172.21.15.103:0/1086256614 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f013406be30 0x7f013406e2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0138034000 tx=0x7f013802e000 comp rx=0 tx=0).stop 2024-09-10T08:35:44.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.948+0000 7f014e29b640 1 -- 172.21.15.103:0/1086256614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01480c7fb0 msgr2=0x7f01480721d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:44.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.948+0000 7f014e29b640 1 --2- 172.21.15.103:0/1086256614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01480c7fb0 0x7f01480721d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f014000efc0 tx=0x7f014000c490 comp rx=0 tx=0).stop 2024-09-10T08:35:44.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.948+0000 7f014e29b640 1 -- 172.21.15.103:0/1086256614 shutdown_connections 2024-09-10T08:35:44.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.948+0000 7f014e29b640 1 --2- 172.21.15.103:0/1086256614 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f013406be30 0x7f013406e2f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:44.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.948+0000 7f014e29b640 1 --2- 172.21.15.103:0/1086256614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01480c7fb0 0x7f01480721d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:44.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.948+0000 7f014e29b640 1 --2- 172.21.15.103:0/1086256614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01480aea70 0x7f0148071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:44.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.948+0000 7f014e29b640 1 --2- 172.21.15.103:0/1086256614 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01480ade30 0x7f01481e0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:44.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.948+0000 7f014e29b640 1 -- 172.21.15.103:0/1086256614 >> 172.21.15.103:0/1086256614 conn(0x7f01480c5660 msgr2=0x7f01480c4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:44.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.948+0000 7f014e29b640 1 -- 172.21.15.103:0/1086256614 shutdown_connections 2024-09-10T08:35:44.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:44.948+0000 7f014e29b640 1 -- 172.21.15.103:0/1086256614 wait complete. 2024-09-10T08:35:44.960 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:35:44.960 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:35:44.960 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:35:45.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.067+0000 7fad16a77640 1 Processor -- start 2024-09-10T08:35:45.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.067+0000 7fad16a77640 1 -- start start 2024-09-10T08:35:45.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.068+0000 7fad16a77640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fad1014df40 0x7fad10072b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.068+0000 7fad16a77640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fad100c44d0 0x7fad100709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.068+0000 7fad16a77640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad100ac4f0 con 0x7fad10153fe0 2024-09-10T08:35:45.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.068+0000 7fad16a77640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fad1006f9a0 con 0x7fad1014df40 2024-09-10T08:35:45.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.068+0000 7fad16a77640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fad10070520 con 0x7fad100c44d0 2024-09-10T08:35:45.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.068+0000 7fad14813640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fad1014df40 0x7fad10072b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.068+0000 7fad14813640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fad1014df40 0x7fad10072b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39140/0 (socket says 172.21.15.103:39140) 2024-09-10T08:35:45.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.068+0000 7fad14813640 1 -- 172.21.15.103:0/3220846156 learned_addr learned my addr 172.21.15.103:0/3220846156 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:45.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.068+0000 7fad0ffff640 1 --2- 172.21.15.103:0/3220846156 >> v2:172.21.15.154:3300/0 conn(0x7fad100c44d0 0x7fad100709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.069+0000 7fad14813640 1 -- 172.21.15.103:0/3220846156 >> v2:172.21.15.154:3300/0 conn(0x7fad100c44d0 msgr2=0x7fad100709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:45.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.069+0000 7fad14813640 1 --2- 172.21.15.103:0/3220846156 >> v2:172.21.15.154:3300/0 conn(0x7fad100c44d0 0x7fad100709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.069+0000 7fad14813640 1 -- 172.21.15.103:0/3220846156 >> v1:172.21.15.103:6789/0 conn(0x7fad10153fe0 legacy=0x7fad101575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.069+0000 7fad14813640 1 -- 172.21.15.103:0/3220846156 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1006fbf0 con 0x7fad1014df40 2024-09-10T08:35:45.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.070+0000 7fad14813640 1 --2- 172.21.15.103:0/3220846156 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad1014df40 0x7fad10072b90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fad100c4190 tx=0x7fad0402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1fd4b04909ec728 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:45.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.070+0000 7fad0f7fe640 1 -- 172.21.15.103:0/3220846156 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad04037070 con 0x7fad1014df40 2024-09-10T08:35:45.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.070+0000 7fad0f7fe640 1 -- 172.21.15.103:0/3220846156 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad04032440 con 0x7fad1014df40 2024-09-10T08:35:45.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.070+0000 7fad0f7fe640 1 -- 172.21.15.103:0/3220846156 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad04032810 con 0x7fad1014df40 2024-09-10T08:35:45.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.070+0000 7fad16a77640 1 -- 172.21.15.103:0/3220846156 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad1014df40 msgr2=0x7fad10072b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.070+0000 7fad16a77640 1 --2- 172.21.15.103:0/3220846156 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad1014df40 0x7fad10072b90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fad100c4190 tx=0x7fad0402a1e0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.071+0000 7fad16a77640 1 -- 172.21.15.103:0/3220846156 shutdown_connections 2024-09-10T08:35:45.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.071+0000 7fad16a77640 1 --2- 172.21.15.103:0/3220846156 >> v2:172.21.15.154:3300/0 conn(0x7fad100c44d0 0x7fad100709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.071+0000 7fad16a77640 1 --2- 172.21.15.103:0/3220846156 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad1014df40 0x7fad10072b90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.071+0000 7fad16a77640 1 -- 172.21.15.103:0/3220846156 >> 172.21.15.103:0/3220846156 conn(0x7fad100c9ad0 msgr2=0x7fad100c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:45.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.071+0000 7fad16a77640 1 -- 172.21.15.103:0/3220846156 shutdown_connections 2024-09-10T08:35:45.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.071+0000 7fad16a77640 1 -- 172.21.15.103:0/3220846156 wait complete. 2024-09-10T08:35:45.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.072+0000 7fad16a77640 1 Processor -- start 2024-09-10T08:35:45.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.072+0000 7fad16a77640 1 -- start start 2024-09-10T08:35:45.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.073+0000 7fad16a77640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad100c44d0 0x7fad100c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.073+0000 7fad16a77640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad1014df40 0x7fad10149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.073+0000 7fad16a77640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad10153fe0 0x7fad101495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.073+0000 7fad16a77640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fad100afe60 con 0x7fad100c44d0 2024-09-10T08:35:45.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.073+0000 7fad16a77640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fad100701b0 con 0x7fad1014df40 2024-09-10T08:35:45.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.073+0000 7fad16a77640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fad100affe0 con 0x7fad10153fe0 2024-09-10T08:35:45.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.073+0000 7fad14813640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad100c44d0 0x7fad100c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.073+0000 7fad14813640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad100c44d0 0x7fad100c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39152/0 (socket says 172.21.15.103:39152) 2024-09-10T08:35:45.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.073+0000 7fad14813640 1 -- 172.21.15.103:0/3427792254 learned_addr learned my addr 172.21.15.103:0/3427792254 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:45.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.074+0000 7fad0ffff640 1 --2- 172.21.15.103:0/3427792254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad1014df40 0x7fad10149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.074+0000 7fad15014640 1 --2- 172.21.15.103:0/3427792254 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad10153fe0 0x7fad101495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.074+0000 7fad14813640 1 -- 172.21.15.103:0/3427792254 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad10153fe0 msgr2=0x7fad101495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.074+0000 7fad14813640 1 --2- 172.21.15.103:0/3427792254 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad10153fe0 0x7fad101495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.074+0000 7fad14813640 1 -- 172.21.15.103:0/3427792254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad1014df40 msgr2=0x7fad10149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.074+0000 7fad14813640 1 --2- 172.21.15.103:0/3427792254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad1014df40 0x7fad10149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.074+0000 7fad14813640 1 -- 172.21.15.103:0/3427792254 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1014e8e0 con 0x7fad100c44d0 2024-09-10T08:35:45.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.074+0000 7fad15014640 1 --2- 172.21.15.103:0/3427792254 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad10153fe0 0x7fad101495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:35:45.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.074+0000 7fad14813640 1 --2- 172.21.15.103:0/3427792254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad100c44d0 0x7fad100c34b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fad0402a220 tx=0x7fad040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:45.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.074+0000 7fad0d7fa640 1 -- 172.21.15.103:0/3427792254 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad04037040 con 0x7fad100c44d0 2024-09-10T08:35:45.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.074+0000 7fad0d7fa640 1 -- 172.21.15.103:0/3427792254 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad04042070 con 0x7fad100c44d0 2024-09-10T08:35:45.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.074+0000 7fad16a77640 1 -- 172.21.15.103:0/3427792254 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad1014ebc0 con 0x7fad100c44d0 2024-09-10T08:35:45.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.074+0000 7fad0d7fa640 1 -- 172.21.15.103:0/3427792254 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad04030880 con 0x7fad100c44d0 2024-09-10T08:35:45.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.074+0000 7fad16a77640 1 -- 172.21.15.103:0/3427792254 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad1006ec50 con 0x7fad100c44d0 2024-09-10T08:35:45.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.075+0000 7fad16a77640 1 --2- 172.21.15.103:0/3427792254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad10151340 0x7fad101ebe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.075+0000 7fad16a77640 1 -- 172.21.15.103:0/3427792254 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fad100ab540 con 0x7fad10151340 2024-09-10T08:35:45.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.076+0000 7fad0ffff640 1 --2- 172.21.15.103:0/3427792254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad10151340 0x7fad101ebe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.076+0000 7fad0ffff640 1 -- 172.21.15.103:0/3427792254 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad1014e320 con 0x7fad10151340 2024-09-10T08:35:45.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.077+0000 7fad0ffff640 1 --2- 172.21.15.103:0/3427792254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad10151340 0x7fad101ebe90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fad100c3de0 tx=0x7facfc011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:45.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.077+0000 7fad0d7fa640 1 -- 172.21.15.103:0/3427792254 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad04030a20 con 0x7fad100c44d0 2024-09-10T08:35:45.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.077+0000 7fad0d7fa640 1 --2- 172.21.15.103:0/3427792254 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7facf406be30 0x7facf406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.077+0000 7fad0d7fa640 1 -- 172.21.15.103:0/3427792254 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fad040aba20 con 0x7fad100c44d0 2024-09-10T08:35:45.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.077+0000 7fad15014640 1 --2- 172.21.15.103:0/3427792254 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7facf406be30 0x7facf406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.077+0000 7fad0d7fa640 1 -- 172.21.15.103:0/3427792254 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc019070 con 0x7fad10151340 2024-09-10T08:35:45.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.077+0000 7fad0d7fa640 1 -- 172.21.15.103:0/3427792254 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7facfc004240 con 0x7fad10151340 2024-09-10T08:35:45.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.077+0000 7fad0d7fa640 1 -- 172.21.15.103:0/3427792254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad10151340 msgr2=0x7fad101ebe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.077+0000 7fad0d7fa640 1 --2- 172.21.15.103:0/3427792254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad10151340 0x7fad101ebe90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fad100c3de0 tx=0x7facfc011cf0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.078+0000 7fad0d7fa640 1 -- 172.21.15.103:0/3427792254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad10151340 msgr2=0x7fad101ebe90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:35:45.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.078+0000 7fad0d7fa640 1 --2- 172.21.15.103:0/3427792254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad10151340 0x7fad101ebe90 secure :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fad100c3de0 tx=0x7facfc011cf0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.078+0000 7fad15014640 1 --2- 172.21.15.103:0/3427792254 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7facf406be30 0x7facf406e2f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fad1014d670 tx=0x7fad08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:45.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.087+0000 7fad16a77640 1 --2- 172.21.15.103:0/3427792254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad1014ef40 0x7fad101ec3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.087+0000 7fad16a77640 1 -- 172.21.15.103:0/3427792254 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fad101ebc00 con 0x7fad1014ef40 2024-09-10T08:35:45.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.087+0000 7fad0ffff640 1 --2- 172.21.15.103:0/3427792254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad1014ef40 0x7fad101ec3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.087+0000 7fad0ffff640 1 -- 172.21.15.103:0/3427792254 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fad100c5490 con 0x7fad1014ef40 2024-09-10T08:35:45.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.088+0000 7fad0ffff640 1 --2- 172.21.15.103:0/3427792254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad1014ef40 0x7fad101ec3d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7facfc01b000 tx=0x7facfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:45.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.088+0000 7fad0d7fa640 1 -- 172.21.15.103:0/3427792254 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc019040 con 0x7fad1014ef40 2024-09-10T08:35:45.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.088+0000 7fad0d7fa640 1 -- 172.21.15.103:0/3427792254 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5056 (secure 0 0 0) 0x7facfc0044d0 con 0x7fad1014ef40 2024-09-10T08:35:45.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.088+0000 7fad0d7fa640 1 -- 172.21.15.103:0/3427792254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad1014ef40 msgr2=0x7fad101ec3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.088+0000 7fad0d7fa640 1 --2- 172.21.15.103:0/3427792254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad1014ef40 0x7fad101ec3d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7facfc01b000 tx=0x7facfc0046c0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.088+0000 7fad0d7fa640 1 -- 172.21.15.103:0/3427792254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad1014ef40 msgr2=0x7fad101ec3d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:35:45.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.088+0000 7fad0d7fa640 1 --2- 172.21.15.103:0/3427792254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad1014ef40 0x7fad101ec3d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.091 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:35:45.091 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:35:45.092 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:35:45.092 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:35:45.092 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 58, 2024-09-10T08:35:45.092 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 115156, 2024-09-10T08:35:45.092 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:35:45.092 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:35:45.093 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:35:45.093 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:35:45.093 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:45.093 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 2, 2024-09-10T08:35:45.093 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:35:45.093 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:35:45.094 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:35:45.094 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:45.094 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:45.094 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:45.094 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:45.094 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:45.094 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:45.094 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:45.094 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:45.094 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:45.095 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:45.095 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:45.095 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:45.095 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:35:45.095 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:35:45.095 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:45.095 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:45.095 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:45.095 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:45.095 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:45.095 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:45.095 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:45.095 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:45.095 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:45.096 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:45.096 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:45.096 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:45.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.096 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:35:45.096 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:35:45.096 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:35:45.096 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:35:45.096 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:35:45.096 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:35:45.096 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:35:45.096 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:35:45.096 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:35:45.097 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:35:45.097 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:35:45.097 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:35:45.097 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:35:45.097 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:35:45.097 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:35:45.097 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:35:45.097 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:35:45.098 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:45.098 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:45.098 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:45.098 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:45.098 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:45.098 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:45.099 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:45.099 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:45.099 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:45.099 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:45.099 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:45.099 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:45.099 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:35:45.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.100 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:35:45.100 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.100 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:35:45.100 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:35:45.100 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:45.100 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:45.100 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.100 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:45.101 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:35:45.101 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:45.101 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.101 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.101 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:45.101 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:35:45.101 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:45.101 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.101 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:45.101 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.101 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:35:45.101 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:35:45.102 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:45.102 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:45.102 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:45.102 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.102 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.102 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:35:45.102 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:35:45.102 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:45.102 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:45.102 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.102 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:45.102 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:35:45.102 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:45.103 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.103 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.103 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:45.103 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:35:45.103 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:45.103 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.103 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:45.103 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.103 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:35:45.103 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:35:45.103 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:45.103 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:45.103 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:35:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:35:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:35:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.104 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.105 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:45.105 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:35:45.105 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:45.105 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.105 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:45.105 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.105 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:35:45.105 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:35:45.105 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:45.105 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:45.105 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:45.105 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.105 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:45.106 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.106 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:35:45.106 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:35:45.106 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.106 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:45.106 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:45.106 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:35:45.106 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.106 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:45.106 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:35:45.106 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.106 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:45.106 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:45.106 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:35:45.107 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.107 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:45.107 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:35:45.107 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.107 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:45.107 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:45.107 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:35:45.107 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.107 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:45.108 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:35:45.108 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.108 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:45.108 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:45.108 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:35:45.108 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.108 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:45.108 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:35:45.108 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.108 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:45.108 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:45.109 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:35:45.109 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.109 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:45.109 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.109 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:35:45.109 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:35:45.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.088+0000 7fad16a77640 1 -- 172.21.15.103:0/3427792254 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7facf406be30 msgr2=0x7facf406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.088+0000 7fad16a77640 1 --2- 172.21.15.103:0/3427792254 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7facf406be30 0x7facf406e2f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fad1014d670 tx=0x7fad08009040 comp rx=0 tx=0).stop 2024-09-10T08:35:45.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.088+0000 7fad16a77640 1 -- 172.21.15.103:0/3427792254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad100c44d0 msgr2=0x7fad100c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.088+0000 7fad16a77640 1 --2- 172.21.15.103:0/3427792254 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad100c44d0 0x7fad100c34b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fad0402a220 tx=0x7fad040046c0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.089+0000 7fad15014640 1 -- 172.21.15.103:0/3427792254 reap_dead start 2024-09-10T08:35:45.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.089+0000 7fad15014640 1 -- 172.21.15.103:0/3427792254 reap_dead start 2024-09-10T08:35:45.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.089+0000 7fad16a77640 1 -- 172.21.15.103:0/3427792254 shutdown_connections 2024-09-10T08:35:45.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.089+0000 7fad16a77640 1 -- 172.21.15.103:0/3427792254 >> 172.21.15.103:0/3427792254 conn(0x7fad100c9ad0 msgr2=0x7fad100c48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:45.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.089+0000 7fad16a77640 1 -- 172.21.15.103:0/3427792254 shutdown_connections 2024-09-10T08:35:45.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.089+0000 7fad16a77640 1 -- 172.21.15.103:0/3427792254 wait complete. 2024-09-10T08:35:45.113 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:35:45.114 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:35:45.114 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:35:45.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.231+0000 7f69a591a640 1 Processor -- start 2024-09-10T08:35:45.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.231+0000 7f69a591a640 1 -- start start 2024-09-10T08:35:45.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.232+0000 7f69a591a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f69a01505f0 0x7f69a0153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.232+0000 7f69a591a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a00c42b0 0x7f69a00c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.232+0000 7f69a591a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69a00c5940 con 0x7f69a00c69c0 2024-09-10T08:35:45.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.232+0000 7f69a591a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f69a00c7860 con 0x7f69a01505f0 2024-09-10T08:35:45.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.232+0000 7f69a591a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f69a00c5c00 con 0x7f69a00c42b0 2024-09-10T08:35:45.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.232+0000 7f699f7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a00c42b0 0x7f69a00c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.232+0000 7f699effd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f69a01505f0 0x7f69a0153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.232+0000 7f699f7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a00c42b0 0x7f69a00c46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:60496/0 (socket says 172.21.15.103:60496) 2024-09-10T08:35:45.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.232+0000 7f699f7fe640 1 -- 172.21.15.103:0/1857919507 learned_addr learned my addr 172.21.15.103:0/1857919507 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:45.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.232+0000 7f699f7fe640 1 -- 172.21.15.103:0/1857919507 >> v2:172.21.15.154:3300/0 conn(0x7f69a01505f0 msgr2=0x7f69a0153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:45.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.232+0000 7f699f7fe640 1 --2- 172.21.15.103:0/1857919507 >> v2:172.21.15.154:3300/0 conn(0x7f69a01505f0 0x7f69a0153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.232+0000 7f699f7fe640 1 -- 172.21.15.103:0/1857919507 >> v1:172.21.15.154:6789/0 conn(0x7f69a00c69c0 legacy=0x7f69a00c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.232+0000 7f699f7fe640 1 -- 172.21.15.103:0/1857919507 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a00c5ee0 con 0x7f69a00c42b0 2024-09-10T08:35:45.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.232+0000 7f699effd640 1 --2- 172.21.15.103:0/1857919507 >> v2:172.21.15.154:3300/0 conn(0x7f69a01505f0 0x7f69a0153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:35:45.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.233+0000 7f699f7fe640 1 --2- 172.21.15.103:0/1857919507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a00c42b0 0x7f69a00c46d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6998009e50 tx=0x7f699802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d1fc6984dd129c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:45.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.233+0000 7f699dffb640 1 -- 172.21.15.103:0/1857919507 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6998036070 con 0x7f69a00c42b0 2024-09-10T08:35:45.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.233+0000 7f699dffb640 1 -- 172.21.15.103:0/1857919507 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6998031600 con 0x7f69a00c42b0 2024-09-10T08:35:45.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.233+0000 7f699dffb640 1 -- 172.21.15.103:0/1857919507 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69980319d0 con 0x7f69a00c42b0 2024-09-10T08:35:45.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.234+0000 7f69a591a640 1 -- 172.21.15.103:0/1857919507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a00c42b0 msgr2=0x7f69a00c46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.234+0000 7f69a591a640 1 --2- 172.21.15.103:0/1857919507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a00c42b0 0x7f69a00c46d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6998009e50 tx=0x7f699802a680 comp rx=0 tx=0).stop 2024-09-10T08:35:45.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.234+0000 7f69a591a640 1 -- 172.21.15.103:0/1857919507 shutdown_connections 2024-09-10T08:35:45.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.234+0000 7f69a591a640 1 --2- 172.21.15.103:0/1857919507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a00c42b0 0x7f69a00c46d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.234+0000 7f69a591a640 1 --2- 172.21.15.103:0/1857919507 >> v2:172.21.15.154:3300/0 conn(0x7f69a01505f0 0x7f69a0153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.234+0000 7f69a591a640 1 -- 172.21.15.103:0/1857919507 >> 172.21.15.103:0/1857919507 conn(0x7f69a00c7a40 msgr2=0x7f69a00c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:45.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.234+0000 7f69a591a640 1 -- 172.21.15.103:0/1857919507 shutdown_connections 2024-09-10T08:35:45.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.234+0000 7f69a591a640 1 -- 172.21.15.103:0/1857919507 wait complete. 2024-09-10T08:35:45.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.235+0000 7f69a591a640 1 Processor -- start 2024-09-10T08:35:45.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.236+0000 7f69a591a640 1 -- start start 2024-09-10T08:35:45.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.236+0000 7f69a591a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a00c42b0 0x7f69a014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.236+0000 7f69a591a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a01505f0 0x7f69a0145cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.236+0000 7f69a591a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69a00c1cd0 0x7f69a0146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.236+0000 7f69a591a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f69a01509d0 con 0x7f69a00c1cd0 2024-09-10T08:35:45.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.236+0000 7f69a591a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f69a00c64a0 con 0x7f69a00c42b0 2024-09-10T08:35:45.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.236+0000 7f69a591a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f69a0150b50 con 0x7f69a01505f0 2024-09-10T08:35:45.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.236+0000 7f699effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a00c42b0 0x7f69a014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.236+0000 7f699f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69a00c1cd0 0x7f69a0146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.236+0000 7f699effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a00c42b0 0x7f69a014a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:34548/0 (socket says 172.21.15.103:34548) 2024-09-10T08:35:45.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.236+0000 7f699effd640 1 -- 172.21.15.103:0/259196520 learned_addr learned my addr 172.21.15.103:0/259196520 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:45.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.236+0000 7f699e7fc640 1 --2- 172.21.15.103:0/259196520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a01505f0 0x7f69a0145cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.237+0000 7f699effd640 1 -- 172.21.15.103:0/259196520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a01505f0 msgr2=0x7f69a0145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.237+0000 7f699effd640 1 --2- 172.21.15.103:0/259196520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69a01505f0 0x7f69a0145cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.237+0000 7f699effd640 1 -- 172.21.15.103:0/259196520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69a00c1cd0 msgr2=0x7f69a0146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.237+0000 7f699effd640 1 --2- 172.21.15.103:0/259196520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69a00c1cd0 0x7f69a0146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.237+0000 7f699effd640 1 -- 172.21.15.103:0/259196520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a00ac140 con 0x7f69a00c42b0 2024-09-10T08:35:45.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.237+0000 7f699f7fe640 1 --2- 172.21.15.103:0/259196520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69a00c1cd0 0x7f69a0146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:35:45.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.237+0000 7f699effd640 1 --2- 172.21.15.103:0/259196520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a00c42b0 0x7f69a014a5b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f699000ec10 tx=0x7f699000c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:45.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.237+0000 7f6987fff640 1 -- 172.21.15.103:0/259196520 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6990017070 con 0x7f69a00c42b0 2024-09-10T08:35:45.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.237+0000 7f6987fff640 1 -- 172.21.15.103:0/259196520 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f699000cc30 con 0x7f69a00c42b0 2024-09-10T08:35:45.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.237+0000 7f69a591a640 1 -- 172.21.15.103:0/259196520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69a00abcf0 con 0x7f69a00c42b0 2024-09-10T08:35:45.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.237+0000 7f6987fff640 1 -- 172.21.15.103:0/259196520 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6990013470 con 0x7f69a00c42b0 2024-09-10T08:35:45.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.237+0000 7f69a591a640 1 -- 172.21.15.103:0/259196520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69a014aaf0 con 0x7f69a00c42b0 2024-09-10T08:35:45.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.238+0000 7f69a591a640 1 --2- 172.21.15.103:0/259196520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a00c69c0 0x7f69a01eef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.238+0000 7f69a591a640 1 -- 172.21.15.103:0/259196520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f69a014afa0 con 0x7f69a00c69c0 2024-09-10T08:35:45.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.238+0000 7f699e7fc640 1 --2- 172.21.15.103:0/259196520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a00c69c0 0x7f69a01eef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.239+0000 7f699e7fc640 1 -- 172.21.15.103:0/259196520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f69a006e380 con 0x7f69a00c69c0 2024-09-10T08:35:45.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.239+0000 7f699e7fc640 1 --2- 172.21.15.103:0/259196520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a00c69c0 0x7f69a01eef70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f699400f540 tx=0x7f699400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:45.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.239+0000 7f6987fff640 1 -- 172.21.15.103:0/259196520 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f699001a070 con 0x7f69a00c42b0 2024-09-10T08:35:45.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.240+0000 7f6987fff640 1 --2- 172.21.15.103:0/259196520 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f698c06be30 0x7f698c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.240+0000 7f6987fff640 1 -- 172.21.15.103:0/259196520 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f699008b3c0 con 0x7f69a00c42b0 2024-09-10T08:35:45.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.240+0000 7f699f7fe640 1 --2- 172.21.15.103:0/259196520 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f698c06be30 0x7f698c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.240+0000 7f6987fff640 1 -- 172.21.15.103:0/259196520 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6994019070 con 0x7f69a00c69c0 2024-09-10T08:35:45.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.240+0000 7f6987fff640 1 -- 172.21.15.103:0/259196520 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6994005320 con 0x7f69a00c69c0 2024-09-10T08:35:45.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.240+0000 7f6987fff640 1 -- 172.21.15.103:0/259196520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a00c69c0 msgr2=0x7f69a01eef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.240+0000 7f6987fff640 1 --2- 172.21.15.103:0/259196520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a00c69c0 0x7f69a01eef70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f699400f540 tx=0x7f699400fa00 comp rx=0 tx=0).stop 2024-09-10T08:35:45.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.240+0000 7f6987fff640 1 -- 172.21.15.103:0/259196520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a00c69c0 msgr2=0x7f69a01eef70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:35:45.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.240+0000 7f6987fff640 1 --2- 172.21.15.103:0/259196520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a00c69c0 0x7f69a01eef70 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f699400f540 tx=0x7f699400fa00 comp rx=0 tx=0).stop 2024-09-10T08:35:45.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.240+0000 7f699f7fe640 1 --2- 172.21.15.103:0/259196520 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f698c06be30 0x7f698c06e2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6998033000 tx=0x7f6998009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:45.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.248+0000 7f69a591a640 1 --2- 172.21.15.103:0/259196520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a00c0e70 0x7f69a01ef4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.248+0000 7f69a591a640 1 -- 172.21.15.103:0/259196520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f69a00abb50 con 0x7f69a00c0e70 2024-09-10T08:35:45.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.248+0000 7f699e7fc640 1 --2- 172.21.15.103:0/259196520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a00c0e70 0x7f69a01ef4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.248+0000 7f699e7fc640 1 -- 172.21.15.103:0/259196520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f69a0153910 con 0x7f69a00c0e70 2024-09-10T08:35:45.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.248+0000 7f699e7fc640 1 --2- 172.21.15.103:0/259196520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a00c0e70 0x7f69a01ef4b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f699400f540 tx=0x7f6994000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:45.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.248+0000 7f6987fff640 1 -- 172.21.15.103:0/259196520 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6994019030 con 0x7f69a00c0e70 2024-09-10T08:35:45.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.249+0000 7f6987fff640 1 -- 172.21.15.103:0/259196520 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5053 (secure 0 0 0) 0x7f6994006aa0 con 0x7f69a00c0e70 2024-09-10T08:35:45.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.249+0000 7f6987fff640 1 -- 172.21.15.103:0/259196520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a00c0e70 msgr2=0x7f69a01ef4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.249+0000 7f6987fff640 1 --2- 172.21.15.103:0/259196520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a00c0e70 0x7f69a01ef4b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f699400f540 tx=0x7f6994000ed0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.249+0000 7f6987fff640 1 -- 172.21.15.103:0/259196520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a00c0e70 msgr2=0x7f69a01ef4b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:35:45.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.249+0000 7f6987fff640 1 --2- 172.21.15.103:0/259196520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a00c0e70 0x7f69a01ef4b0 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f699400f540 tx=0x7f6994000ed0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.250 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:35:45.250 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:35:45.250 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:35:45.250 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:35:45.251 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 58, 2024-09-10T08:35:45.251 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 61006, 2024-09-10T08:35:45.251 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:35:45.251 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:35:45.251 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:35:45.251 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:35:45.251 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:45.251 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 2, 2024-09-10T08:35:45.251 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:35:45.251 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:35:45.251 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:35:45.251 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:45.251 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:45.252 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:45.252 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:45.252 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:45.252 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:45.252 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:45.252 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:45.252 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:45.252 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:45.252 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:45.252 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:45.252 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:35:45.252 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:35:45.252 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:45.253 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:45.253 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:45.253 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:45.253 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:45.253 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:45.253 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:45.253 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:45.253 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:45.253 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:45.253 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:45.253 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:45.253 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.253 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:35:45.253 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:35:45.254 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:35:45.254 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:35:45.254 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:35:45.254 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:35:45.254 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:35:45.254 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:35:45.254 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:35:45.254 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:35:45.254 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:35:45.254 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:35:45.254 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:35:45.254 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:35:45.254 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:35:45.254 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:35:45.255 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:35:45.255 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:45.255 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:45.255 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:45.255 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:45.255 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:45.255 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:45.255 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:45.255 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:45.255 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:45.255 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:45.255 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:45.255 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:45.256 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:35:45.256 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.256 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:35:45.256 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.256 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:35:45.256 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:35:45.256 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:45.256 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:45.256 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.256 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:45.256 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:35:45.257 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:45.257 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.257 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.257 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:45.257 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:35:45.257 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:45.257 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.257 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:45.257 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.257 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:35:45.257 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:35:45.257 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:45.257 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:45.258 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:45.258 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.258 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.258 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:35:45.258 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:35:45.258 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:45.258 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:45.258 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.258 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:45.258 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:35:45.258 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:45.259 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.259 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.259 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:45.259 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:35:45.259 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:45.259 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.259 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:45.259 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.259 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:35:45.259 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:35:45.259 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:45.259 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:45.259 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:45.260 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.260 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.260 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:35:45.260 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:35:45.260 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:45.260 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:45.260 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.260 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:45.260 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:35:45.260 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:45.261 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.261 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.261 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:45.261 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:35:45.261 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:45.261 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.261 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:45.261 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.261 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:35:45.261 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:35:45.262 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:45.262 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:45.262 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:45.262 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.262 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:45.262 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.262 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:35:45.262 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:35:45.262 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.262 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:45.262 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:45.262 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:35:45.262 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.263 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:45.263 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:35:45.263 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.263 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:45.263 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:45.263 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:35:45.263 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.263 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:45.263 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:35:45.263 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.263 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:45.263 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:45.264 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:35:45.264 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.264 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:45.264 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:35:45.264 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.264 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:45.264 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:45.264 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:35:45.264 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.264 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:45.264 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:35:45.264 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.265 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:45.265 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:45.265 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:35:45.265 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.265 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:45.265 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.265 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:35:45.265 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:35:45.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.249+0000 7f69a591a640 1 -- 172.21.15.103:0/259196520 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f698c06be30 msgr2=0x7f698c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.249+0000 7f69a591a640 1 --2- 172.21.15.103:0/259196520 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f698c06be30 0x7f698c06e2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6998033000 tx=0x7f6998009000 comp rx=0 tx=0).stop 2024-09-10T08:35:45.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.249+0000 7f69a591a640 1 -- 172.21.15.103:0/259196520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a00c42b0 msgr2=0x7f69a014a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.249+0000 7f69a591a640 1 --2- 172.21.15.103:0/259196520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69a00c42b0 0x7f69a014a5b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f699000ec10 tx=0x7f699000c520 comp rx=0 tx=0).stop 2024-09-10T08:35:45.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.249+0000 7f699f7fe640 1 -- 172.21.15.103:0/259196520 reap_dead start 2024-09-10T08:35:45.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.249+0000 7f699f7fe640 1 -- 172.21.15.103:0/259196520 reap_dead start 2024-09-10T08:35:45.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.249+0000 7f69a591a640 1 -- 172.21.15.103:0/259196520 shutdown_connections 2024-09-10T08:35:45.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.249+0000 7f69a591a640 1 -- 172.21.15.103:0/259196520 >> 172.21.15.103:0/259196520 conn(0x7f69a00c7a40 msgr2=0x7f69a00c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:45.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.249+0000 7f69a591a640 1 -- 172.21.15.103:0/259196520 shutdown_connections 2024-09-10T08:35:45.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.249+0000 7f69a591a640 1 -- 172.21.15.103:0/259196520 wait complete. 2024-09-10T08:35:45.268 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:35:45.268 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:35:45.268 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:35:45.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.387+0000 7f76e3e4c640 1 Processor -- start 2024-09-10T08:35:45.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.387+0000 7f76e3e4c640 1 -- start start 2024-09-10T08:35:45.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.388+0000 7f76e3e4c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f76dc073ae0 0x7f76dc153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.388+0000 7f76e3e4c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc156f50 0x7f76dc1538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.388+0000 7f76e3e4c640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76dc06dd50 con 0x7f76dc0733d0 2024-09-10T08:35:45.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.388+0000 7f76e3e4c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f76dc06e030 con 0x7f76dc073ae0 2024-09-10T08:35:45.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.388+0000 7f76e3e4c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f76dc06e310 con 0x7f76dc156f50 2024-09-10T08:35:45.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.388+0000 7f76e1be8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f76dc073ae0 0x7f76dc153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.388+0000 7f76e1be8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f76dc073ae0 0x7f76dc153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59506/0 (socket says 172.21.15.103:59506) 2024-09-10T08:35:45.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.388+0000 7f76e1be8640 1 -- 172.21.15.103:0/2689081332 learned_addr learned my addr 172.21.15.103:0/2689081332 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:45.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.388+0000 7f76e23e9640 1 --2- 172.21.15.103:0/2689081332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc156f50 0x7f76dc1538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.388+0000 7f76e1be8640 1 -- 172.21.15.103:0/2689081332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc156f50 msgr2=0x7f76dc1538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:45.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.388+0000 7f76e1be8640 1 --2- 172.21.15.103:0/2689081332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc156f50 0x7f76dc1538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.388+0000 7f76e1be8640 1 -- 172.21.15.103:0/2689081332 >> v1:172.21.15.103:6789/0 conn(0x7f76dc0733d0 legacy=0x7f76dc156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.389+0000 7f76e1be8640 1 -- 172.21.15.103:0/2689081332 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76dc06e5f0 con 0x7f76dc073ae0 2024-09-10T08:35:45.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.389+0000 7f76e1be8640 1 --2- 172.21.15.103:0/2689081332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76dc073ae0 0x7f76dc153380 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f76d8009870 tx=0x7f76d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d45a9ccdc08c500 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:45.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.389+0000 7f76e0be6640 1 -- 172.21.15.103:0/2689081332 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8037070 con 0x7f76dc073ae0 2024-09-10T08:35:45.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.389+0000 7f76e0be6640 1 -- 172.21.15.103:0/2689081332 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76d8032440 con 0x7f76dc073ae0 2024-09-10T08:35:45.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.389+0000 7f76e0be6640 1 -- 172.21.15.103:0/2689081332 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8032810 con 0x7f76dc073ae0 2024-09-10T08:35:45.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.390+0000 7f76e3e4c640 1 -- 172.21.15.103:0/2689081332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76dc073ae0 msgr2=0x7f76dc153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.390+0000 7f76e3e4c640 1 --2- 172.21.15.103:0/2689081332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76dc073ae0 0x7f76dc153380 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f76d8009870 tx=0x7f76d802a270 comp rx=0 tx=0).stop 2024-09-10T08:35:45.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.390+0000 7f76e3e4c640 1 -- 172.21.15.103:0/2689081332 shutdown_connections 2024-09-10T08:35:45.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.390+0000 7f76e3e4c640 1 --2- 172.21.15.103:0/2689081332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc156f50 0x7f76dc1538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.390+0000 7f76e3e4c640 1 --2- 172.21.15.103:0/2689081332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76dc073ae0 0x7f76dc153380 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.390+0000 7f76e3e4c640 1 -- 172.21.15.103:0/2689081332 >> 172.21.15.103:0/2689081332 conn(0x7f76dc0c9d80 msgr2=0x7f76dc0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:45.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.390+0000 7f76e3e4c640 1 -- 172.21.15.103:0/2689081332 shutdown_connections 2024-09-10T08:35:45.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.390+0000 7f76e3e4c640 1 -- 172.21.15.103:0/2689081332 wait complete. 2024-09-10T08:35:45.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.391+0000 7f76e3e4c640 1 Processor -- start 2024-09-10T08:35:45.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.391+0000 7f76e3e4c640 1 -- start start 2024-09-10T08:35:45.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.392+0000 7f76e3e4c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76dc0733d0 0x7f76dc14b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.392+0000 7f76e3e4c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76dc073ae0 0x7f76dc1ef220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.392+0000 7f76e3e4c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc156f50 0x7f76dc0c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.392+0000 7f76e3e4c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc06edd0 con 0x7f76dc0733d0 2024-09-10T08:35:45.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.392+0000 7f76e3e4c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc06ec50 con 0x7f76dc073ae0 2024-09-10T08:35:45.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.392+0000 7f76e3e4c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f76dc073ec0 con 0x7f76dc156f50 2024-09-10T08:35:45.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.392+0000 7f76e1be8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76dc0733d0 0x7f76dc14b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.392+0000 7f76e1be8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76dc0733d0 0x7f76dc14b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59514/0 (socket says 172.21.15.103:59514) 2024-09-10T08:35:45.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.392+0000 7f76e1be8640 1 -- 172.21.15.103:0/3786654637 learned_addr learned my addr 172.21.15.103:0/3786654637 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:45.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.392+0000 7f76e23e9640 1 --2- 172.21.15.103:0/3786654637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc156f50 0x7f76dc0c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.392+0000 7f76e13e7640 1 --2- 172.21.15.103:0/3786654637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76dc073ae0 0x7f76dc1ef220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.393+0000 7f76e1be8640 1 -- 172.21.15.103:0/3786654637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc156f50 msgr2=0x7f76dc0c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.393+0000 7f76e1be8640 1 --2- 172.21.15.103:0/3786654637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc156f50 0x7f76dc0c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.393+0000 7f76e1be8640 1 -- 172.21.15.103:0/3786654637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76dc073ae0 msgr2=0x7f76dc1ef220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.393+0000 7f76e1be8640 1 --2- 172.21.15.103:0/3786654637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76dc073ae0 0x7f76dc1ef220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.393+0000 7f76e1be8640 1 -- 172.21.15.103:0/3786654637 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76dc1542d0 con 0x7f76dc0733d0 2024-09-10T08:35:45.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.393+0000 7f76e1be8640 1 --2- 172.21.15.103:0/3786654637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76dc0733d0 0x7f76dc14b8a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f76d802a2b0 tx=0x7f76d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:45.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.393+0000 7f76d27fc640 1 -- 172.21.15.103:0/3786654637 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8037040 con 0x7f76dc0733d0 2024-09-10T08:35:45.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.393+0000 7f76d27fc640 1 -- 172.21.15.103:0/3786654637 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76d8042070 con 0x7f76dc0733d0 2024-09-10T08:35:45.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.393+0000 7f76e3e4c640 1 -- 172.21.15.103:0/3786654637 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76dc147c90 con 0x7f76dc0733d0 2024-09-10T08:35:45.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.393+0000 7f76d27fc640 1 -- 172.21.15.103:0/3786654637 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8030880 con 0x7f76dc0733d0 2024-09-10T08:35:45.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.393+0000 7f76e3e4c640 1 -- 172.21.15.103:0/3786654637 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76dc14c730 con 0x7f76dc0733d0 2024-09-10T08:35:45.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.394+0000 7f76e3e4c640 1 --2- 172.21.15.103:0/3786654637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc1ef760 0x7f76dc155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.394+0000 7f76e3e4c640 1 -- 172.21.15.103:0/3786654637 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f76dc147e60 con 0x7f76dc1ef760 2024-09-10T08:35:45.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.394+0000 7f76e13e7640 1 --2- 172.21.15.103:0/3786654637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc1ef760 0x7f76dc155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.394+0000 7f76e13e7640 1 -- 172.21.15.103:0/3786654637 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f76dc154080 con 0x7f76dc1ef760 2024-09-10T08:35:45.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.395+0000 7f76d27fc640 1 -- 172.21.15.103:0/3786654637 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76d8030a20 con 0x7f76dc0733d0 2024-09-10T08:35:45.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.395+0000 7f76e13e7640 1 --2- 172.21.15.103:0/3786654637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc1ef760 0x7f76dc155c80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f76dc0691f0 tx=0x7f76cc00f900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:45.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.395+0000 7f76d27fc640 1 --2- 172.21.15.103:0/3786654637 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f76c006be60 0x7f76c006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.395+0000 7f76d27fc640 1 -- 172.21.15.103:0/3786654637 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f76d80ab920 con 0x7f76dc0733d0 2024-09-10T08:35:45.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.395+0000 7f76e23e9640 1 --2- 172.21.15.103:0/3786654637 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f76c006be60 0x7f76c006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.395+0000 7f76d27fc640 1 -- 172.21.15.103:0/3786654637 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc019070 con 0x7f76dc1ef760 2024-09-10T08:35:45.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.395+0000 7f76d27fc640 1 -- 172.21.15.103:0/3786654637 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f76cc005320 con 0x7f76dc1ef760 2024-09-10T08:35:45.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.395+0000 7f76d27fc640 1 -- 172.21.15.103:0/3786654637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc1ef760 msgr2=0x7f76dc155c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.395+0000 7f76d27fc640 1 --2- 172.21.15.103:0/3786654637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc1ef760 0x7f76dc155c80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f76dc0691f0 tx=0x7f76cc00f900 comp rx=0 tx=0).stop 2024-09-10T08:35:45.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.395+0000 7f76d27fc640 1 -- 172.21.15.103:0/3786654637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc1ef760 msgr2=0x7f76dc155c80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:35:45.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.395+0000 7f76d27fc640 1 --2- 172.21.15.103:0/3786654637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc1ef760 0x7f76dc155c80 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f76dc0691f0 tx=0x7f76cc00f900 comp rx=0 tx=0).stop 2024-09-10T08:35:45.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.396+0000 7f76e23e9640 1 --2- 172.21.15.103:0/3786654637 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f76c006be60 0x7f76c006e320 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f76dc1480a0 tx=0x7f76d400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:45.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.402+0000 7f76e3e4c640 1 --2- 172.21.15.103:0/3786654637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc0c80c0 0x7f76dc0c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.402+0000 7f76e3e4c640 1 -- 172.21.15.103:0/3786654637 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f76dc1544a0 con 0x7f76dc0c80c0 2024-09-10T08:35:45.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.402+0000 7f76e13e7640 1 --2- 172.21.15.103:0/3786654637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc0c80c0 0x7f76dc0c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.403+0000 7f76e13e7640 1 -- 172.21.15.103:0/3786654637 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f76dc06d850 con 0x7f76dc0c80c0 2024-09-10T08:35:45.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.403+0000 7f76e13e7640 1 --2- 172.21.15.103:0/3786654637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc0c80c0 0x7f76dc0c84d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f76cc001eb0 tx=0x7f76cc000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:45.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.403+0000 7f76d27fc640 1 -- 172.21.15.103:0/3786654637 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc019030 con 0x7f76dc0c80c0 2024-09-10T08:35:45.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.403+0000 7f76d27fc640 1 -- 172.21.15.103:0/3786654637 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4551 (secure 0 0 0) 0x7f76cc006aa0 con 0x7f76dc0c80c0 2024-09-10T08:35:45.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.403+0000 7f76d27fc640 1 -- 172.21.15.103:0/3786654637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc0c80c0 msgr2=0x7f76dc0c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.403+0000 7f76d27fc640 1 --2- 172.21.15.103:0/3786654637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc0c80c0 0x7f76dc0c84d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f76cc001eb0 tx=0x7f76cc000ed0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.403+0000 7f76d27fc640 1 -- 172.21.15.103:0/3786654637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc0c80c0 msgr2=0x7f76dc0c84d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:35:45.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.403+0000 7f76d27fc640 1 --2- 172.21.15.103:0/3786654637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76dc0c80c0 0x7f76dc0c84d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.408 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:35:45.408 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:35:45.408 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:35:45.408 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:35:45.408 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 58, 2024-09-10T08:35:45.409 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 7726, 2024-09-10T08:35:45.409 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:35:45.409 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:35:45.409 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:35:45.409 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:35:45.410 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:45.410 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 2, 2024-09-10T08:35:45.410 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:35:45.410 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:35:45.410 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:35:45.410 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:45.410 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:45.410 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:45.411 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:45.411 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:45.411 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:45.411 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:45.411 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:45.411 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:45.411 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:45.411 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:45.411 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:45.411 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:35:45.411 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:35:45.411 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:45.411 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:45.412 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:45.412 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:45.412 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:45.412 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:45.412 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:45.412 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:45.412 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:45.412 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:45.412 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:45.413 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:45.413 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.413 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:35:45.413 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:35:45.413 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:35:45.414 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:35:45.414 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:35:45.414 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:35:45.414 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:35:45.414 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:35:45.414 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:35:45.415 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:35:45.415 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:35:45.415 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:35:45.415 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:35:45.415 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:35:45.416 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:35:45.416 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:35:45.416 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:35:45.416 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:45.416 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:45.417 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:45.417 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:45.417 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:45.417 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:45.417 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:45.418 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:45.418 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:45.418 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:45.418 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:45.418 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:45.418 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:35:45.418 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.418 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:35:45.418 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.419 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:35:45.419 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:35:45.419 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:45.419 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:45.419 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.419 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:45.419 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:35:45.419 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:45.419 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.419 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.419 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:45.419 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:35:45.419 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:45.419 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.420 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:45.420 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.420 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:35:45.420 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:35:45.420 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:45.420 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:45.420 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:45.420 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.420 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.420 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:35:45.420 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:35:45.421 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:45.421 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:45.421 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.421 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:45.421 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:35:45.421 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:45.421 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.421 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.422 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:45.422 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:35:45.422 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:45.422 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.422 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:45.422 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.422 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:35:45.422 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:35:45.425 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:45.425 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:45.425 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:45.425 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.426 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.426 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:35:45.426 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:35:45.426 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:45.426 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:45.427 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.427 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:45.427 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:35:45.427 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:45.427 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.428 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.428 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:45.428 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:35:45.428 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:45.428 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.429 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:45.429 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.429 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:35:45.429 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:35:45.429 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:45.430 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:45.430 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:45.430 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.430 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:45.430 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.430 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:35:45.431 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:35:45.431 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.431 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:45.431 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:45.431 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:35:45.432 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.432 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:45.432 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:35:45.432 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:45.432 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:45.433 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:45.433 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:35:45.433 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:45.433 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:45.433 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:45.434 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:35:45.434 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:35:45.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.404+0000 7f76e3e4c640 1 -- 172.21.15.103:0/3786654637 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f76c006be60 msgr2=0x7f76c006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.404+0000 7f76e3e4c640 1 --2- 172.21.15.103:0/3786654637 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f76c006be60 0x7f76c006e320 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f76dc1480a0 tx=0x7f76d400b040 comp rx=0 tx=0).stop 2024-09-10T08:35:45.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.404+0000 7f76e3e4c640 1 -- 172.21.15.103:0/3786654637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76dc0733d0 msgr2=0x7f76dc14b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.404+0000 7f76e3e4c640 1 --2- 172.21.15.103:0/3786654637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76dc0733d0 0x7f76dc14b8a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f76d802a2b0 tx=0x7f76d80046c0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.404+0000 7f76e23e9640 1 -- 172.21.15.103:0/3786654637 reap_dead start 2024-09-10T08:35:45.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.404+0000 7f76e23e9640 1 -- 172.21.15.103:0/3786654637 reap_dead start 2024-09-10T08:35:45.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.404+0000 7f76e3e4c640 1 -- 172.21.15.103:0/3786654637 shutdown_connections 2024-09-10T08:35:45.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.404+0000 7f76e3e4c640 1 -- 172.21.15.103:0/3786654637 >> 172.21.15.103:0/3786654637 conn(0x7f76dc0c9d80 msgr2=0x7f76dc0705d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:45.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.404+0000 7f76e3e4c640 1 -- 172.21.15.103:0/3786654637 shutdown_connections 2024-09-10T08:35:45.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.404+0000 7f76e3e4c640 1 -- 172.21.15.103:0/3786654637 wait complete. 2024-09-10T08:35:45.436 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:35:45.437 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-10T08:35:45.437 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-10T08:35:45.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.546+0000 7f5bea6ed640 1 Processor -- start 2024-09-10T08:35:45.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.546+0000 7f5bea6ed640 1 -- start start 2024-09-10T08:35:45.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.547+0000 7f5bea6ed640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5be406c650 0x7f5be40c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.547+0000 7f5bea6ed640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5be40ca1c0 0x7f5be4160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.547+0000 7f5bea6ed640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5be415a7c0 con 0x7f5be4150480 2024-09-10T08:35:45.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.547+0000 7f5bea6ed640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f5be406c240 con 0x7f5be40ca1c0 2024-09-10T08:35:45.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.547+0000 7f5bea6ed640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5be415a330 con 0x7f5be406c650 2024-09-10T08:35:45.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.547+0000 7f5be8c8a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5be40ca1c0 0x7f5be4160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.547+0000 7f5be8c8a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5be40ca1c0 0x7f5be4160bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59530/0 (socket says 172.21.15.103:59530) 2024-09-10T08:35:45.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.547+0000 7f5be8c8a640 1 -- 172.21.15.103:0/182090370 learned_addr learned my addr 172.21.15.103:0/182090370 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:45.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.547+0000 7f5be37fe640 1 --2- 172.21.15.103:0/182090370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5be406c650 0x7f5be40c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.547+0000 7f5be8c8a640 1 -- 172.21.15.103:0/182090370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5be406c650 msgr2=0x7f5be40c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:45.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.547+0000 7f5be8c8a640 1 --2- 172.21.15.103:0/182090370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5be406c650 0x7f5be40c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.547+0000 7f5be8c8a640 1 -- 172.21.15.103:0/182090370 >> v1:172.21.15.103:6789/0 conn(0x7f5be4150480 legacy=0x7f5be40c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.547+0000 7f5be8c8a640 1 -- 172.21.15.103:0/182090370 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be4159a00 con 0x7f5be40ca1c0 2024-09-10T08:35:45.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.547+0000 7f5be37fe640 1 --2- 172.21.15.103:0/182090370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5be406c650 0x7f5be40c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:35:45.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.548+0000 7f5be8c8a640 1 --2- 172.21.15.103:0/182090370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5be40ca1c0 0x7f5be4160bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc009e50 tx=0x7f5bdc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e0564cb303b9ff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:45.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.548+0000 7f5be2ffd640 1 -- 172.21.15.103:0/182090370 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc036070 con 0x7f5be40ca1c0 2024-09-10T08:35:45.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.548+0000 7f5be2ffd640 1 -- 172.21.15.103:0/182090370 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bdc031600 con 0x7f5be40ca1c0 2024-09-10T08:35:45.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.548+0000 7f5be2ffd640 1 -- 172.21.15.103:0/182090370 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc0319d0 con 0x7f5be40ca1c0 2024-09-10T08:35:45.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.549+0000 7f5bea6ed640 1 -- 172.21.15.103:0/182090370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5be40ca1c0 msgr2=0x7f5be4160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.549+0000 7f5bea6ed640 1 --2- 172.21.15.103:0/182090370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5be40ca1c0 0x7f5be4160bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc009e50 tx=0x7f5bdc02a710 comp rx=0 tx=0).stop 2024-09-10T08:35:45.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.549+0000 7f5bea6ed640 1 -- 172.21.15.103:0/182090370 shutdown_connections 2024-09-10T08:35:45.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.549+0000 7f5bea6ed640 1 --2- 172.21.15.103:0/182090370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5be40ca1c0 0x7f5be4160bf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.549+0000 7f5bea6ed640 1 --2- 172.21.15.103:0/182090370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5be406c650 0x7f5be40c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.549+0000 7f5bea6ed640 1 -- 172.21.15.103:0/182090370 >> 172.21.15.103:0/182090370 conn(0x7f5be4068030 msgr2=0x7f5be4073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:45.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.549+0000 7f5bea6ed640 1 -- 172.21.15.103:0/182090370 shutdown_connections 2024-09-10T08:35:45.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.549+0000 7f5bea6ed640 1 -- 172.21.15.103:0/182090370 wait complete. 2024-09-10T08:35:45.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.550+0000 7f5bea6ed640 1 Processor -- start 2024-09-10T08:35:45.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.550+0000 7f5bea6ed640 1 -- start start 2024-09-10T08:35:45.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.551+0000 7f5bea6ed640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5be406c650 0x7f5be4151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.551+0000 7f5bea6ed640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5be40ca1c0 0x7f5be40afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.551+0000 7f5bea6ed640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5be4150480 0x7f5be41dfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.551+0000 7f5bea6ed640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5be40ca670 con 0x7f5be406c650 2024-09-10T08:35:45.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.551+0000 7f5bea6ed640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5be4159fc0 con 0x7f5be40ca1c0 2024-09-10T08:35:45.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.551+0000 7f5bea6ed640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5be406d270 con 0x7f5be4150480 2024-09-10T08:35:45.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.551+0000 7f5be3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5be406c650 0x7f5be4151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.552+0000 7f5be3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5be406c650 0x7f5be4151bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59542/0 (socket says 172.21.15.103:59542) 2024-09-10T08:35:45.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.552+0000 7f5be3fff640 1 -- 172.21.15.103:0/1963736800 learned_addr learned my addr 172.21.15.103:0/1963736800 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:45.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.552+0000 7f5be8c8a640 1 --2- 172.21.15.103:0/1963736800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5be4150480 0x7f5be41dfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.552+0000 7f5be37fe640 1 --2- 172.21.15.103:0/1963736800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5be40ca1c0 0x7f5be40afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.552+0000 7f5be3fff640 1 -- 172.21.15.103:0/1963736800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5be4150480 msgr2=0x7f5be41dfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.552+0000 7f5be3fff640 1 --2- 172.21.15.103:0/1963736800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5be4150480 0x7f5be41dfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.552+0000 7f5be3fff640 1 -- 172.21.15.103:0/1963736800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5be40ca1c0 msgr2=0x7f5be40afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.552+0000 7f5be3fff640 1 --2- 172.21.15.103:0/1963736800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5be40ca1c0 0x7f5be40afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.552+0000 7f5be3fff640 1 -- 172.21.15.103:0/1963736800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be4152110 con 0x7f5be406c650 2024-09-10T08:35:45.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.552+0000 7f5be3fff640 1 --2- 172.21.15.103:0/1963736800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5be406c650 0x7f5be4151bd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400c400 tx=0x7f5bd400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:45.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.552+0000 7f5be0ff9640 1 -- 172.21.15.103:0/1963736800 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd40052d0 con 0x7f5be406c650 2024-09-10T08:35:45.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.552+0000 7f5be0ff9640 1 -- 172.21.15.103:0/1963736800 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd4005490 con 0x7f5be406c650 2024-09-10T08:35:45.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.552+0000 7f5bea6ed640 1 -- 172.21.15.103:0/1963736800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be4150a20 con 0x7f5be406c650 2024-09-10T08:35:45.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.552+0000 7f5be0ff9640 1 -- 172.21.15.103:0/1963736800 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4007260 con 0x7f5be406c650 2024-09-10T08:35:45.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.552+0000 7f5bea6ed640 1 -- 172.21.15.103:0/1963736800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be4150fe0 con 0x7f5be406c650 2024-09-10T08:35:45.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.553+0000 7f5bea6ed640 1 -- 172.21.15.103:0/1963736800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5be4156270 con 0x7f5be406c650 2024-09-10T08:35:45.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.554+0000 7f5be0ff9640 1 -- 172.21.15.103:0/1963736800 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5bd4007400 con 0x7f5be406c650 2024-09-10T08:35:45.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.554+0000 7f5be0ff9640 1 --2- 172.21.15.103:0/1963736800 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5bd006be30 0x7f5bd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:45.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.554+0000 7f5be0ff9640 1 -- 172.21.15.103:0/1963736800 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f5bd408a650 con 0x7f5be406c650 2024-09-10T08:35:45.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.555+0000 7f5be37fe640 1 --2- 172.21.15.103:0/1963736800 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5bd006be30 0x7f5bd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:45.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.555+0000 7f5be37fe640 1 --2- 172.21.15.103:0/1963736800 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5bd006be30 0x7f5bd006e2f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5be41e29b0 tx=0x7f5bd8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:45.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.559+0000 7f5be0ff9640 1 -- 172.21.15.103:0/1963736800 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5bd40586a0 con 0x7f5be406c650 2024-09-10T08:35:45.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.867+0000 7f5bea6ed640 1 -- 172.21.15.103:0/1963736800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f5be41df8d0 con 0x7f5be406c650 2024-09-10T08:35:45.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.868+0000 7f5be0ff9640 1 -- 172.21.15.103:0/1963736800 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f5bd405c9a0 con 0x7f5be406c650 2024-09-10T08:35:45.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.871+0000 7f5bea6ed640 1 -- 172.21.15.103:0/1963736800 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5bd006be30 msgr2=0x7f5bd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.871+0000 7f5bea6ed640 1 --2- 172.21.15.103:0/1963736800 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5bd006be30 0x7f5bd006e2f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5be41e29b0 tx=0x7f5bd8008040 comp rx=0 tx=0).stop 2024-09-10T08:35:45.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.871+0000 7f5bea6ed640 1 -- 172.21.15.103:0/1963736800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5be406c650 msgr2=0x7f5be4151bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:45.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.871+0000 7f5bea6ed640 1 --2- 172.21.15.103:0/1963736800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5be406c650 0x7f5be4151bd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400c400 tx=0x7f5bd400c8c0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.871+0000 7f5bea6ed640 1 -- 172.21.15.103:0/1963736800 shutdown_connections 2024-09-10T08:35:45.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.871+0000 7f5bea6ed640 1 --2- 172.21.15.103:0/1963736800 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5bd006be30 0x7f5bd006e2f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.871+0000 7f5bea6ed640 1 --2- 172.21.15.103:0/1963736800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5be4150480 0x7f5be41dfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.871+0000 7f5bea6ed640 1 --2- 172.21.15.103:0/1963736800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5be40ca1c0 0x7f5be40afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.871+0000 7f5bea6ed640 1 --2- 172.21.15.103:0/1963736800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5be406c650 0x7f5be4151bd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:45.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.871+0000 7f5bea6ed640 1 -- 172.21.15.103:0/1963736800 >> 172.21.15.103:0/1963736800 conn(0x7f5be4068030 msgr2=0x7f5be40c79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:45.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.871+0000 7f5bea6ed640 1 -- 172.21.15.103:0/1963736800 shutdown_connections 2024-09-10T08:35:45.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:45.871+0000 7f5bea6ed640 1 -- 172.21.15.103:0/1963736800 wait complete. 2024-09-10T08:35:45.884 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-10T08:35:55.886 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:35:55.886 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:35:55.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.992+0000 7f1a18677640 1 Processor -- start 2024-09-10T08:35:55.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.992+0000 7f1a18677640 1 -- start start 2024-09-10T08:35:55.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.993+0000 7f1a18677640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1a100ca170 0x7f1a100a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:55.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.994+0000 7f1a18677640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1a10158ea0 0x7f1a10159310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:55.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.994+0000 7f1a18677640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a100c42f0 con 0x7f1a100c88f0 2024-09-10T08:35:55.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.994+0000 7f1a18677640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f1a10073920 con 0x7f1a10158ea0 2024-09-10T08:35:55.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.994+0000 7f1a18677640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1a10073420 con 0x7f1a100ca170 2024-09-10T08:35:55.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.994+0000 7f1a16c14640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1a10158ea0 0x7f1a10159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:55.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.994+0000 7f1a16c14640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1a10158ea0 0x7f1a10159310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58206/0 (socket says 172.21.15.103:58206) 2024-09-10T08:35:55.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.994+0000 7f1a16c14640 1 -- 172.21.15.103:0/3805740133 learned_addr learned my addr 172.21.15.103:0/3805740133 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:55.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.994+0000 7f1a16413640 1 --2- 172.21.15.103:0/3805740133 >> v2:172.21.15.154:3300/0 conn(0x7f1a100ca170 0x7f1a100a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:55.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.994+0000 7f1a16c14640 1 -- 172.21.15.103:0/3805740133 >> v2:172.21.15.154:3300/0 conn(0x7f1a100ca170 msgr2=0x7f1a100a92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:55.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.994+0000 7f1a16c14640 1 --2- 172.21.15.103:0/3805740133 >> v2:172.21.15.154:3300/0 conn(0x7f1a100ca170 0x7f1a100a92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:55.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.994+0000 7f1a16c14640 1 -- 172.21.15.103:0/3805740133 >> v1:172.21.15.103:6789/0 conn(0x7f1a100c88f0 legacy=0x7f1a100c3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:55.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.994+0000 7f1a16c14640 1 -- 172.21.15.103:0/3805740133 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a10072bd0 con 0x7f1a10158ea0 2024-09-10T08:35:55.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.995+0000 7f1a16c14640 1 --2- 172.21.15.103:0/3805740133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a10158ea0 0x7f1a10159310 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1a100688e0 tx=0x7f1a0802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ad9c87634de17 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:55.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.995+0000 7f1a15411640 1 -- 172.21.15.103:0/3805740133 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a08036070 con 0x7f1a10158ea0 2024-09-10T08:35:55.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.995+0000 7f1a15411640 1 -- 172.21.15.103:0/3805740133 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a08031600 con 0x7f1a10158ea0 2024-09-10T08:35:55.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.995+0000 7f1a15411640 1 -- 172.21.15.103:0/3805740133 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a080319d0 con 0x7f1a10158ea0 2024-09-10T08:35:55.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.996+0000 7f1a18677640 1 -- 172.21.15.103:0/3805740133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a10158ea0 msgr2=0x7f1a10159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:55.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.996+0000 7f1a18677640 1 --2- 172.21.15.103:0/3805740133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a10158ea0 0x7f1a10159310 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1a100688e0 tx=0x7f1a0802a6a0 comp rx=0 tx=0).stop 2024-09-10T08:35:55.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.996+0000 7f1a18677640 1 -- 172.21.15.103:0/3805740133 shutdown_connections 2024-09-10T08:35:55.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.996+0000 7f1a18677640 1 --2- 172.21.15.103:0/3805740133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a10158ea0 0x7f1a10159310 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:55.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.996+0000 7f1a18677640 1 --2- 172.21.15.103:0/3805740133 >> v2:172.21.15.154:3300/0 conn(0x7f1a100ca170 0x7f1a100a92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:55.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.996+0000 7f1a18677640 1 -- 172.21.15.103:0/3805740133 >> 172.21.15.103:0/3805740133 conn(0x7f1a10067b30 msgr2=0x7f1a10067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:55.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.996+0000 7f1a18677640 1 -- 172.21.15.103:0/3805740133 shutdown_connections 2024-09-10T08:35:55.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.996+0000 7f1a18677640 1 -- 172.21.15.103:0/3805740133 wait complete. 2024-09-10T08:35:55.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.998+0000 7f1a18677640 1 Processor -- start 2024-09-10T08:35:55.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.998+0000 7f1a18677640 1 -- start start 2024-09-10T08:35:55.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.999+0000 7f1a18677640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a100c88f0 0x7f1a101ec860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:55.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.999+0000 7f1a18677640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a100ca170 0x7f1a101573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:55.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.999+0000 7f1a18677640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a10158ea0 0x7f1a1014de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.999+0000 7f1a18677640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1a10070960 con 0x7f1a100c88f0 2024-09-10T08:35:56.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.999+0000 7f1a18677640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1a10159850 con 0x7f1a100ca170 2024-09-10T08:35:56.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.999+0000 7f1a18677640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1a100705a0 con 0x7f1a10158ea0 2024-09-10T08:35:56.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.999+0000 7f1a16413640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a100c88f0 0x7f1a101ec860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.999+0000 7f1a16413640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a100c88f0 0x7f1a101ec860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58208/0 (socket says 172.21.15.103:58208) 2024-09-10T08:35:56.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.999+0000 7f1a16413640 1 -- 172.21.15.103:0/3622342550 learned_addr learned my addr 172.21.15.103:0/3622342550 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:56.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.999+0000 7f1a15c12640 1 --2- 172.21.15.103:0/3622342550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a100ca170 0x7f1a101573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.999+0000 7f1a16c14640 1 --2- 172.21.15.103:0/3622342550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a10158ea0 0x7f1a1014de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.999+0000 7f1a16413640 1 -- 172.21.15.103:0/3622342550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a10158ea0 msgr2=0x7f1a1014de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.999+0000 7f1a16413640 1 --2- 172.21.15.103:0/3622342550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a10158ea0 0x7f1a1014de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.999+0000 7f1a16413640 1 -- 172.21.15.103:0/3622342550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a100ca170 msgr2=0x7f1a101573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.999+0000 7f1a16413640 1 --2- 172.21.15.103:0/3622342550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a100ca170 0x7f1a101573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.999+0000 7f1a16413640 1 -- 172.21.15.103:0/3622342550 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a101ecda0 con 0x7f1a100c88f0 2024-09-10T08:35:56.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:55.999+0000 7f1a16413640 1 --2- 172.21.15.103:0/3622342550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a100c88f0 0x7f1a101ec860 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c00e9e0 tx=0x7f1a0c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:56.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.000+0000 7f1a06ffd640 1 -- 172.21.15.103:0/3622342550 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c017070 con 0x7f1a100c88f0 2024-09-10T08:35:56.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.000+0000 7f1a06ffd640 1 -- 172.21.15.103:0/3622342550 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a0c00c9d0 con 0x7f1a100c88f0 2024-09-10T08:35:56.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.000+0000 7f1a06ffd640 1 -- 172.21.15.103:0/3622342550 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c00cdc0 con 0x7f1a100c88f0 2024-09-10T08:35:56.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.000+0000 7f1a18677640 1 -- 172.21.15.103:0/3622342550 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a100a90b0 con 0x7f1a100c88f0 2024-09-10T08:35:56.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.000+0000 7f1a18677640 1 -- 172.21.15.103:0/3622342550 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a1014f9b0 con 0x7f1a100c88f0 2024-09-10T08:35:56.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.001+0000 7f1a18677640 1 -- 172.21.15.103:0/3622342550 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a100affa0 con 0x7f1a100c88f0 2024-09-10T08:35:56.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.002+0000 7f1a06ffd640 1 -- 172.21.15.103:0/3622342550 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a0c01a070 con 0x7f1a100c88f0 2024-09-10T08:35:56.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.002+0000 7f1a06ffd640 1 --2- 172.21.15.103:0/3622342550 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f19f406be30 0x7f19f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.002+0000 7f1a06ffd640 1 -- 172.21.15.103:0/3622342550 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f1a0c08b160 con 0x7f1a100c88f0 2024-09-10T08:35:56.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.002+0000 7f1a15c12640 1 --2- 172.21.15.103:0/3622342550 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f19f406be30 0x7f19f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.003+0000 7f1a15c12640 1 --2- 172.21.15.103:0/3622342550 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f19f406be30 0x7f19f406e2f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1a00007fd0 tx=0x7f1a00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:56.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.009+0000 7f1a06ffd640 1 -- 172.21.15.103:0/3622342550 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1a100affa0 con 0x7f1a100c88f0 2024-09-10T08:35:56.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.306+0000 7f1a18677640 1 -- 172.21.15.103:0/3622342550 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1a100ca550 con 0x7f1a100c88f0 2024-09-10T08:35:56.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.306+0000 7f1a06ffd640 1 -- 172.21.15.103:0/3622342550 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f1a101ecda0 con 0x7f1a100c88f0 2024-09-10T08:35:56.306 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:35:56.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.309+0000 7f1a18677640 1 -- 172.21.15.103:0/3622342550 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f19f406be30 msgr2=0x7f19f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.309+0000 7f1a18677640 1 --2- 172.21.15.103:0/3622342550 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f19f406be30 0x7f19f406e2f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1a00007fd0 tx=0x7f1a00009040 comp rx=0 tx=0).stop 2024-09-10T08:35:56.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.309+0000 7f1a18677640 1 -- 172.21.15.103:0/3622342550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a100c88f0 msgr2=0x7f1a101ec860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.309+0000 7f1a18677640 1 --2- 172.21.15.103:0/3622342550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a100c88f0 0x7f1a101ec860 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c00e9e0 tx=0x7f1a0c00eea0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.309+0000 7f1a18677640 1 -- 172.21.15.103:0/3622342550 shutdown_connections 2024-09-10T08:35:56.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.309+0000 7f1a18677640 1 --2- 172.21.15.103:0/3622342550 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f19f406be30 0x7f19f406e2f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.309+0000 7f1a18677640 1 --2- 172.21.15.103:0/3622342550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a10158ea0 0x7f1a1014de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.309+0000 7f1a18677640 1 --2- 172.21.15.103:0/3622342550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a100ca170 0x7f1a101573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.309+0000 7f1a18677640 1 --2- 172.21.15.103:0/3622342550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a100c88f0 0x7f1a101ec860 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.309+0000 7f1a18677640 1 -- 172.21.15.103:0/3622342550 >> 172.21.15.103:0/3622342550 conn(0x7f1a10067b30 msgr2=0x7f1a10075030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:56.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.309+0000 7f1a18677640 1 -- 172.21.15.103:0/3622342550 shutdown_connections 2024-09-10T08:35:56.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.309+0000 7f1a18677640 1 -- 172.21.15.103:0/3622342550 wait complete. 2024-09-10T08:35:56.320 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:35:56.320 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-10T08:35:56.320 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:35:56.321 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:35:56.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.435+0000 7fb8029a8640 1 Processor -- start 2024-09-10T08:35:56.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.435+0000 7fb8029a8640 1 -- start start 2024-09-10T08:35:56.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.436+0000 7fb8029a8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7fc06c650 0x7fb7fc0c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.436+0000 7fb8029a8640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7fc15a7c0 con 0x7fb7fc150480 2024-09-10T08:35:56.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.436+0000 7fb8029a8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7fc159a00 con 0x7fb7fc0ca1c0 2024-09-10T08:35:56.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.436+0000 7fb8029a8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb7fc06c240 con 0x7fb7fc06c650 2024-09-10T08:35:56.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.436+0000 7fb7fbfff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb7fc150480 0x7fb7fc0c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:52444/0 (socket says 172.21.15.103:52444) 2024-09-10T08:35:56.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.436+0000 7fb7fbfff640 1 -- 172.21.15.103:0/1934120275 learned_addr learned my addr 172.21.15.103:0/1934120275 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:35:56.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.436+0000 7fb7fb7fe640 1 --2- 172.21.15.103:0/1934120275 >> v2:172.21.15.154:3300/0 conn(0x7fb7fc06c650 0x7fb7fc0c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.436+0000 7fb7faffd640 1 -- 172.21.15.103:0/1934120275 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1030611811 0 0) 0x7fb7fc15a7c0 con 0x7fb7fc150480 2024-09-10T08:35:56.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.436+0000 7fb7faffd640 1 -- 172.21.15.103:0/1934120275 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7e4003520 con 0x7fb7fc150480 2024-09-10T08:35:56.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.436+0000 7fb7fb7fe640 1 -- 172.21.15.103:0/1934120275 >> v1:172.21.15.154:6789/0 conn(0x7fb7fc0ca1c0 legacy=0x7fb7fc160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.436+0000 7fb7fb7fe640 1 -- 172.21.15.103:0/1934120275 >> v1:172.21.15.103:6789/0 conn(0x7fb7fc150480 legacy=0x7fb7fc0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.436+0000 7fb7faffd640 1 -- 172.21.15.103:0/1934120275 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2516094788 0 0) 0x7fb7e4003520 con 0x7fb7fc150480 2024-09-10T08:35:56.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.436+0000 7fb7fb7fe640 1 -- 172.21.15.103:0/1934120275 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7fc159ce0 con 0x7fb7fc06c650 2024-09-10T08:35:56.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.437+0000 7fb7fb7fe640 1 --2- 172.21.15.103:0/1934120275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7fc06c650 0x7fb7fc0c9c80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00097a0 tx=0x7fb7f002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e891d671daee7ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:56.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.437+0000 7fb7faffd640 1 -- 172.21.15.103:0/1934120275 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0037070 con 0x7fb7fc06c650 2024-09-10T08:35:56.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.437+0000 7fb7faffd640 1 -- 172.21.15.103:0/1934120275 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f002ac50 con 0x7fb7fc06c650 2024-09-10T08:35:56.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.437+0000 7fb7faffd640 1 -- 172.21.15.103:0/1934120275 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec001670 con 0x7fb7fc06c650 2024-09-10T08:35:56.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.438+0000 7fb8029a8640 1 -- 172.21.15.103:0/1934120275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7fc06c650 msgr2=0x7fb7fc0c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.438+0000 7fb8029a8640 1 --2- 172.21.15.103:0/1934120275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7fc06c650 0x7fb7fc0c9c80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00097a0 tx=0x7fb7f002a1c0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.438+0000 7fb8029a8640 1 -- 172.21.15.103:0/1934120275 shutdown_connections 2024-09-10T08:35:56.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.438+0000 7fb8029a8640 1 --2- 172.21.15.103:0/1934120275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7fc06c650 0x7fb7fc0c9c80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.438+0000 7fb8029a8640 1 -- 172.21.15.103:0/1934120275 >> 172.21.15.103:0/1934120275 conn(0x7fb7fc068030 msgr2=0x7fb7fc073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:56.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.438+0000 7fb8029a8640 1 -- 172.21.15.103:0/1934120275 shutdown_connections 2024-09-10T08:35:56.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.438+0000 7fb8029a8640 1 -- 172.21.15.103:0/1934120275 wait complete. 2024-09-10T08:35:56.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.439+0000 7fb8029a8640 1 Processor -- start 2024-09-10T08:35:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.439+0000 7fb8029a8640 1 -- start start 2024-09-10T08:35:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.440+0000 7fb8029a8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7fc06c650 0x7fb7fc14f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.440+0000 7fb8029a8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7fc0ca1c0 0x7fb7fc0c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.440+0000 7fb8029a8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7fc150480 0x7fb7fc1586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.440+0000 7fb8029a8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb7fc06d270 con 0x7fb7fc0ca1c0 2024-09-10T08:35:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.440+0000 7fb8029a8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb7fc15a330 con 0x7fb7fc06c650 2024-09-10T08:35:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.440+0000 7fb8029a8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb7fc0ca5f0 con 0x7fb7fc150480 2024-09-10T08:35:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.440+0000 7fb7fbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7fc06c650 0x7fb7fc14f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.440+0000 7fb7fb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7fc0ca1c0 0x7fb7fc0c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.440+0000 7fb7fb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7fc0ca1c0 0x7fb7fc0c5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58224/0 (socket says 172.21.15.103:58224) 2024-09-10T08:35:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.440+0000 7fb7fb7fe640 1 -- 172.21.15.103:0/2242210495 learned_addr learned my addr 172.21.15.103:0/2242210495 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:56.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.440+0000 7fb800f45640 1 --2- 172.21.15.103:0/2242210495 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7fc150480 0x7fb7fc1586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.441+0000 7fb7fbfff640 1 -- 172.21.15.103:0/2242210495 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7fc150480 msgr2=0x7fb7fc1586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.441+0000 7fb7fbfff640 1 --2- 172.21.15.103:0/2242210495 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7fc150480 0x7fb7fc1586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.441+0000 7fb7fbfff640 1 -- 172.21.15.103:0/2242210495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7fc0ca1c0 msgr2=0x7fb7fc0c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.441+0000 7fb7fbfff640 1 --2- 172.21.15.103:0/2242210495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7fc0ca1c0 0x7fb7fc0c5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.441+0000 7fb7fbfff640 1 -- 172.21.15.103:0/2242210495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7fc0b08a0 con 0x7fb7fc06c650 2024-09-10T08:35:56.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.441+0000 7fb800f45640 1 --2- 172.21.15.103:0/2242210495 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7fc150480 0x7fb7fc1586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:35:56.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.441+0000 7fb7fb7fe640 1 --2- 172.21.15.103:0/2242210495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7fc0ca1c0 0x7fb7fc0c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:35:56.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.441+0000 7fb7fbfff640 1 --2- 172.21.15.103:0/2242210495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7fc06c650 0x7fb7fc14f830 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00c4d0 tx=0x7fb7ec00c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:56.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.441+0000 7fb7f8ff9640 1 -- 172.21.15.103:0/2242210495 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec017070 con 0x7fb7fc06c650 2024-09-10T08:35:56.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.441+0000 7fb7f8ff9640 1 -- 172.21.15.103:0/2242210495 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ec005ce0 con 0x7fb7fc06c650 2024-09-10T08:35:56.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.441+0000 7fb7f8ff9640 1 -- 172.21.15.103:0/2242210495 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0072b0 con 0x7fb7fc06c650 2024-09-10T08:35:56.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.441+0000 7fb8029a8640 1 -- 172.21.15.103:0/2242210495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7fc0b0b80 con 0x7fb7fc06c650 2024-09-10T08:35:56.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.441+0000 7fb8029a8640 1 -- 172.21.15.103:0/2242210495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7fc14ff30 con 0x7fb7fc06c650 2024-09-10T08:35:56.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.442+0000 7fb8029a8640 1 --2- 172.21.15.103:0/2242210495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7fc0c5ef0 0x7fb7fc1ebdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.442+0000 7fb8029a8640 1 -- 172.21.15.103:0/2242210495 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb7fc1595c0 con 0x7fb7fc0c5ef0 2024-09-10T08:35:56.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.442+0000 7fb7fb7fe640 1 --2- 172.21.15.103:0/2242210495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7fc0c5ef0 0x7fb7fc1ebdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.442+0000 7fb7fb7fe640 1 -- 172.21.15.103:0/2242210495 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb7fc156270 con 0x7fb7fc0c5ef0 2024-09-10T08:35:56.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.443+0000 7fb7fb7fe640 1 --2- 172.21.15.103:0/2242210495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7fc0c5ef0 0x7fb7fc1ebdf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00097a0 tx=0x7fb7f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:56.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.443+0000 7fb7f8ff9640 1 -- 172.21.15.103:0/2242210495 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0044070 con 0x7fb7fc0c5ef0 2024-09-10T08:35:56.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.443+0000 7fb7f8ff9640 1 -- 172.21.15.103:0/2242210495 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7ec01a070 con 0x7fb7fc06c650 2024-09-10T08:35:56.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.443+0000 7fb7f8ff9640 1 --2- 172.21.15.103:0/2242210495 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb7e806bd30 0x7fb7e806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.443+0000 7fb7f8ff9640 1 -- 172.21.15.103:0/2242210495 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fb7ec08a590 con 0x7fb7fc06c650 2024-09-10T08:35:56.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.444+0000 7fb800f45640 1 --2- 172.21.15.103:0/2242210495 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb7e806bd30 0x7fb7e806e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.444+0000 7fb7f8ff9640 1 -- 172.21.15.103:0/2242210495 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb7f002ac50 con 0x7fb7fc0c5ef0 2024-09-10T08:35:56.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.444+0000 7fb7f8ff9640 1 -- 172.21.15.103:0/2242210495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7fc0c5ef0 msgr2=0x7fb7fc1ebdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.444+0000 7fb7f8ff9640 1 --2- 172.21.15.103:0/2242210495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7fc0c5ef0 0x7fb7fc1ebdf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00097a0 tx=0x7fb7f00046c0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.444+0000 7fb7f8ff9640 1 -- 172.21.15.103:0/2242210495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7fc0c5ef0 msgr2=0x7fb7fc1ebdf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:35:56.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.444+0000 7fb7f8ff9640 1 --2- 172.21.15.103:0/2242210495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7fc0c5ef0 0x7fb7fc1ebdf0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.444+0000 7fb800f45640 1 --2- 172.21.15.103:0/2242210495 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb7e806bd30 0x7fb7e806e1f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40012e0 tx=0x7fb7f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:56.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.450+0000 7fb8029a8640 1 --2- 172.21.15.103:0/2242210495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7fc158bf0 0x7fb7fc1ec330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.450+0000 7fb8029a8640 1 -- 172.21.15.103:0/2242210495 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb7fc1ec870 con 0x7fb7fc158bf0 2024-09-10T08:35:56.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.450+0000 7fb7fb7fe640 1 --2- 172.21.15.103:0/2242210495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7fc158bf0 0x7fb7fc1ec330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.451+0000 7fb7fb7fe640 1 -- 172.21.15.103:0/2242210495 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb7fc06c430 con 0x7fb7fc158bf0 2024-09-10T08:35:56.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.451+0000 7fb7fb7fe640 1 --2- 172.21.15.103:0/2242210495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7fc158bf0 0x7fb7fc1ec330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0affe0 tx=0x7fb7f0009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:56.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.451+0000 7fb7f8ff9640 1 -- 172.21.15.103:0/2242210495 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0057020 con 0x7fb7fc158bf0 2024-09-10T08:35:56.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.451+0000 7fb7f8ff9640 1 -- 172.21.15.103:0/2242210495 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5057 (secure 0 0 0) 0x7fb7f003ee20 con 0x7fb7fc158bf0 2024-09-10T08:35:56.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.451+0000 7fb7f8ff9640 1 -- 172.21.15.103:0/2242210495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7fc158bf0 msgr2=0x7fb7fc1ec330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.451+0000 7fb7f8ff9640 1 --2- 172.21.15.103:0/2242210495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7fc158bf0 0x7fb7fc1ec330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0affe0 tx=0x7fb7f0009190 comp rx=0 tx=0).stop 2024-09-10T08:35:56.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.451+0000 7fb7f8ff9640 1 -- 172.21.15.103:0/2242210495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7fc158bf0 msgr2=0x7fb7fc1ec330 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:35:56.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.451+0000 7fb7f8ff9640 1 --2- 172.21.15.103:0/2242210495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7fc158bf0 0x7fb7fc1ec330 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.453 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:35:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:35:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:35:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:35:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 58, 2024-09-10T08:35:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 126519, 2024-09-10T08:35:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:35:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:35:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:35:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:35:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 13, 2024-09-10T08:35:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:35:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:35:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:35:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:35:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:35:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:35:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:35:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:35:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:35:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:35:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:35:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:35:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:35:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:35:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:35:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:35:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:35:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:35:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:35:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:35:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:35:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:35:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:35:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:35:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:35:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:35:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:35:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:35:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:35:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:35:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:35:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:35:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:35:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:35:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:35:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:35:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:35:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:35:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:35:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:35:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:35:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:35:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:35:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:35:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:35:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:35:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:35:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:35:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:35:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:35:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:35:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:35:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:35:56.468 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.468 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:56.468 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.468 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:35:56.468 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:35:56.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.452+0000 7fb8029a8640 1 -- 172.21.15.103:0/2242210495 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb7e806bd30 msgr2=0x7fb7e806e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.452+0000 7fb8029a8640 1 --2- 172.21.15.103:0/2242210495 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb7e806bd30 0x7fb7e806e1f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40012e0 tx=0x7fb7f4009040 comp rx=0 tx=0).stop 2024-09-10T08:35:56.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.452+0000 7fb8029a8640 1 -- 172.21.15.103:0/2242210495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7fc06c650 msgr2=0x7fb7fc14f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.452+0000 7fb8029a8640 1 --2- 172.21.15.103:0/2242210495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7fc06c650 0x7fb7fc14f830 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00c4d0 tx=0x7fb7ec00c990 comp rx=0 tx=0).stop 2024-09-10T08:35:56.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.452+0000 7fb800f45640 1 -- 172.21.15.103:0/2242210495 reap_dead start 2024-09-10T08:35:56.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.452+0000 7fb800f45640 1 -- 172.21.15.103:0/2242210495 reap_dead start 2024-09-10T08:35:56.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.452+0000 7fb8029a8640 1 -- 172.21.15.103:0/2242210495 shutdown_connections 2024-09-10T08:35:56.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.452+0000 7fb8029a8640 1 -- 172.21.15.103:0/2242210495 >> 172.21.15.103:0/2242210495 conn(0x7fb7fc068030 msgr2=0x7fb7fc0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:56.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.452+0000 7fb8029a8640 1 -- 172.21.15.103:0/2242210495 shutdown_connections 2024-09-10T08:35:56.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.452+0000 7fb8029a8640 1 -- 172.21.15.103:0/2242210495 wait complete. 2024-09-10T08:35:56.470 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:35:56.470 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:35:56.470 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:35:56.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.579+0000 7f2ab888d640 1 Processor -- start 2024-09-10T08:35:56.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.579+0000 7f2ab888d640 1 -- start start 2024-09-10T08:35:56.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.580+0000 7f2ab888d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2ab406c650 0x7f2ab40c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.580+0000 7f2ab888d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ab415a7c0 con 0x7f2ab4150480 2024-09-10T08:35:56.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.580+0000 7f2ab888d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ab4159a00 con 0x7f2ab40ca1c0 2024-09-10T08:35:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.580+0000 7f2ab888d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f2ab406c240 con 0x7f2ab406c650 2024-09-10T08:35:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.580+0000 7f2ab1d9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2ab406c650 0x7f2ab40c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.580+0000 7f2ab1d9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2ab406c650 0x7f2ab40c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58254/0 (socket says 172.21.15.103:58254) 2024-09-10T08:35:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.580+0000 7f2ab1d9b640 1 -- 172.21.15.103:0/270414409 learned_addr learned my addr 172.21.15.103:0/270414409 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.581+0000 7f2ab1d9b640 1 -- 172.21.15.103:0/270414409 >> v1:172.21.15.154:6789/0 conn(0x7f2ab40ca1c0 legacy=0x7f2ab4160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.581+0000 7f2ab1d9b640 1 -- 172.21.15.103:0/270414409 >> v1:172.21.15.103:6789/0 conn(0x7f2ab4150480 legacy=0x7f2ab40c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.581+0000 7f2ab159a640 1 -- 172.21.15.103:0/270414409 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1134387173 0 0) 0x7f2ab4159a00 con 0x7f2ab40ca1c0 2024-09-10T08:35:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.581+0000 7f2ab1d9b640 1 -- 172.21.15.103:0/270414409 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab4159ce0 con 0x7f2ab406c650 2024-09-10T08:35:56.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.581+0000 7f2ab1d9b640 1 --2- 172.21.15.103:0/270414409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab406c650 0x7f2ab40c9c80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009870 tx=0x7f2aa802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b69d0d5b27554a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:56.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.582+0000 7f2ab159a640 1 -- 172.21.15.103:0/270414409 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8037070 con 0x7f2ab406c650 2024-09-10T08:35:56.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.582+0000 7f2ab159a640 1 -- 172.21.15.103:0/270414409 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa8032440 con 0x7f2ab406c650 2024-09-10T08:35:56.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.582+0000 7f2ab159a640 1 -- 172.21.15.103:0/270414409 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8032810 con 0x7f2ab406c650 2024-09-10T08:35:56.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.582+0000 7f2ab888d640 1 -- 172.21.15.103:0/270414409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab406c650 msgr2=0x7f2ab40c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.582+0000 7f2ab888d640 1 --2- 172.21.15.103:0/270414409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab406c650 0x7f2ab40c9c80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009870 tx=0x7f2aa802a200 comp rx=0 tx=0).stop 2024-09-10T08:35:56.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.582+0000 7f2ab888d640 1 -- 172.21.15.103:0/270414409 shutdown_connections 2024-09-10T08:35:56.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.582+0000 7f2ab888d640 1 --2- 172.21.15.103:0/270414409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab406c650 0x7f2ab40c9c80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.582+0000 7f2ab888d640 1 -- 172.21.15.103:0/270414409 >> 172.21.15.103:0/270414409 conn(0x7f2ab4068030 msgr2=0x7f2ab4073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:56.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.582+0000 7f2ab888d640 1 -- 172.21.15.103:0/270414409 shutdown_connections 2024-09-10T08:35:56.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.582+0000 7f2ab888d640 1 -- 172.21.15.103:0/270414409 wait complete. 2024-09-10T08:35:56.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.584+0000 7f2ab888d640 1 Processor -- start 2024-09-10T08:35:56.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.584+0000 7f2ab888d640 1 -- start start 2024-09-10T08:35:56.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.584+0000 7f2ab888d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab406c650 0x7f2ab4150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.584+0000 7f2ab888d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab40ca1c0 0x7f2ab41ef390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.584+0000 7f2ab888d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ab4150480 0x7f2ab41e2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.584+0000 7f2ab888d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab406d270 con 0x7f2ab406c650 2024-09-10T08:35:56.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.584+0000 7f2ab888d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab415a330 con 0x7f2ab40ca1c0 2024-09-10T08:35:56.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.584+0000 7f2ab888d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2ab40ca5f0 con 0x7f2ab4150480 2024-09-10T08:35:56.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.584+0000 7f2ab259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab406c650 0x7f2ab4150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.584+0000 7f2ab259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab406c650 0x7f2ab4150b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58268/0 (socket says 172.21.15.103:58268) 2024-09-10T08:35:56.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.584+0000 7f2ab259c640 1 -- 172.21.15.103:0/177320456 learned_addr learned my addr 172.21.15.103:0/177320456 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:56.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.584+0000 7f2ab1d9b640 1 --2- 172.21.15.103:0/177320456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab40ca1c0 0x7f2ab41ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.584+0000 7f2ab2d9d640 1 --2- 172.21.15.103:0/177320456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ab4150480 0x7f2ab41e2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.585+0000 7f2ab259c640 1 -- 172.21.15.103:0/177320456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ab4150480 msgr2=0x7f2ab41e2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.585+0000 7f2ab259c640 1 --2- 172.21.15.103:0/177320456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ab4150480 0x7f2ab41e2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.585+0000 7f2ab259c640 1 -- 172.21.15.103:0/177320456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab40ca1c0 msgr2=0x7f2ab41ef390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.585+0000 7f2ab259c640 1 --2- 172.21.15.103:0/177320456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab40ca1c0 0x7f2ab41ef390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.585+0000 7f2ab259c640 1 -- 172.21.15.103:0/177320456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab40af080 con 0x7f2ab406c650 2024-09-10T08:35:56.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.585+0000 7f2ab259c640 1 --2- 172.21.15.103:0/177320456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab406c650 0x7f2ab4150b30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400c780 tx=0x7f2aa400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.585+0000 7f2aa2ffd640 1 -- 172.21.15.103:0/177320456 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa4017070 con 0x7f2ab406c650 2024-09-10T08:35:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.585+0000 7f2aa2ffd640 1 -- 172.21.15.103:0/177320456 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa4005290 con 0x7f2ab406c650 2024-09-10T08:35:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.585+0000 7f2ab888d640 1 -- 172.21.15.103:0/177320456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab4151070 con 0x7f2ab406c650 2024-09-10T08:35:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.585+0000 7f2aa2ffd640 1 -- 172.21.15.103:0/177320456 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa400a880 con 0x7f2ab406c650 2024-09-10T08:35:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.585+0000 7f2ab888d640 1 -- 172.21.15.103:0/177320456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab41531f0 con 0x7f2ab406c650 2024-09-10T08:35:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.586+0000 7f2ab888d640 1 --2- 172.21.15.103:0/177320456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab4151b30 0x7f2ab414eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.586+0000 7f2ab888d640 1 -- 172.21.15.103:0/177320456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab4156270 con 0x7f2ab4151b30 2024-09-10T08:35:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.586+0000 7f2ab1d9b640 1 --2- 172.21.15.103:0/177320456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab4151b30 0x7f2ab414eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.587+0000 7f2ab1d9b640 1 -- 172.21.15.103:0/177320456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ab406c430 con 0x7f2ab4151b30 2024-09-10T08:35:56.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.587+0000 7f2aa2ffd640 1 -- 172.21.15.103:0/177320456 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2aa401a070 con 0x7f2ab406c650 2024-09-10T08:35:56.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.587+0000 7f2ab1d9b640 1 --2- 172.21.15.103:0/177320456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab4151b30 0x7f2ab414eb90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2ab40ccac0 tx=0x7f2aa80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:56.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.587+0000 7f2aa2ffd640 1 --2- 172.21.15.103:0/177320456 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2a9406be30 0x7f2a9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.587+0000 7f2aa2ffd640 1 -- 172.21.15.103:0/177320456 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f2aa408a580 con 0x7f2ab406c650 2024-09-10T08:35:56.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.587+0000 7f2ab2d9d640 1 --2- 172.21.15.103:0/177320456 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2a9406be30 0x7f2a9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.587+0000 7f2aa2ffd640 1 -- 172.21.15.103:0/177320456 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8037040 con 0x7f2ab4151b30 2024-09-10T08:35:56.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.588+0000 7f2aa2ffd640 1 -- 172.21.15.103:0/177320456 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2aa8046640 con 0x7f2ab4151b30 2024-09-10T08:35:56.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.588+0000 7f2aa2ffd640 1 -- 172.21.15.103:0/177320456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab4151b30 msgr2=0x7f2ab414eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.588+0000 7f2aa2ffd640 1 --2- 172.21.15.103:0/177320456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab4151b30 0x7f2ab414eb90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2ab40ccac0 tx=0x7f2aa80046c0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.588+0000 7f2aa2ffd640 1 -- 172.21.15.103:0/177320456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab4151b30 msgr2=0x7f2ab414eb90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:35:56.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.588+0000 7f2aa2ffd640 1 --2- 172.21.15.103:0/177320456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab4151b30 0x7f2ab414eb90 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2ab40ccac0 tx=0x7f2aa80046c0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.588+0000 7f2ab2d9d640 1 --2- 172.21.15.103:0/177320456 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2a9406be30 0x7f2a9406e2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4150110 tx=0x7f2aac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:56.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.594+0000 7f2ab888d640 1 --2- 172.21.15.103:0/177320456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab4151f10 0x7f2ab414f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.594+0000 7f2ab888d640 1 -- 172.21.15.103:0/177320456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab414f610 con 0x7f2ab4151f10 2024-09-10T08:35:56.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.594+0000 7f2ab1d9b640 1 --2- 172.21.15.103:0/177320456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab4151f10 0x7f2ab414f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.594+0000 7f2ab1d9b640 1 -- 172.21.15.103:0/177320456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2ab41ef8d0 con 0x7f2ab4151f10 2024-09-10T08:35:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.595+0000 7f2ab1d9b640 1 --2- 172.21.15.103:0/177320456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab4151f10 0x7f2ab414f0d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8000c00 tx=0x7f2aa8008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.595+0000 7f2aa2ffd640 1 -- 172.21.15.103:0/177320456 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8037040 con 0x7f2ab4151f10 2024-09-10T08:35:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.595+0000 7f2aa2ffd640 1 -- 172.21.15.103:0/177320456 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7f2aa803cb40 con 0x7f2ab4151f10 2024-09-10T08:35:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.595+0000 7f2aa2ffd640 1 -- 172.21.15.103:0/177320456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab4151f10 msgr2=0x7f2ab414f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.595+0000 7f2aa2ffd640 1 --2- 172.21.15.103:0/177320456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab4151f10 0x7f2ab414f0d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8000c00 tx=0x7f2aa8008030 comp rx=0 tx=0).stop 2024-09-10T08:35:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.595+0000 7f2aa2ffd640 1 -- 172.21.15.103:0/177320456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab4151f10 msgr2=0x7f2ab414f0d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:35:56.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.595+0000 7f2aa2ffd640 1 --2- 172.21.15.103:0/177320456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab4151f10 0x7f2ab414f0d0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8000c00 tx=0x7f2aa8008030 comp rx=0 tx=0).stop 2024-09-10T08:35:56.596 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:35:56.596 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:35:56.596 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:35:56.596 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:35:56.596 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 58, 2024-09-10T08:35:56.596 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 72351, 2024-09-10T08:35:56.596 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:35:56.596 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:35:56.596 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:35:56.597 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:35:56.597 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:56.597 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 14, 2024-09-10T08:35:56.597 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:35:56.597 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:35:56.597 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:35:56.597 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:56.597 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:56.597 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:56.597 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:56.597 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:56.598 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:56.598 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:56.598 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:56.598 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:56.598 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:56.598 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:56.598 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:56.598 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:35:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:35:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:35:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:35:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:35:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:35:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:35:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:35:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:35:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:35:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:35:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:35:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:35:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:35:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:35:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:35:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:35:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:35:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:35:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:35:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:35:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:35:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:35:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:35:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:35:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:35:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:35:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:35:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:35:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:35:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:35:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:35:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:35:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:35:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:35:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:35:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:35:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:35:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:35:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:35:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:35:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:35:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:35:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:35:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:35:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:35:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:35:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:35:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:35:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:56.611 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:56.611 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:35:56.611 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.611 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:56.611 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.611 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:35:56.611 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:35:56.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.596+0000 7f2ab888d640 1 -- 172.21.15.103:0/177320456 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2a9406be30 msgr2=0x7f2a9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.596+0000 7f2ab888d640 1 --2- 172.21.15.103:0/177320456 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2a9406be30 0x7f2a9406e2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4150110 tx=0x7f2aac009040 comp rx=0 tx=0).stop 2024-09-10T08:35:56.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.596+0000 7f2ab888d640 1 -- 172.21.15.103:0/177320456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab406c650 msgr2=0x7f2ab4150b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.596+0000 7f2ab888d640 1 --2- 172.21.15.103:0/177320456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ab406c650 0x7f2ab4150b30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400c780 tx=0x7f2aa400cc40 comp rx=0 tx=0).stop 2024-09-10T08:35:56.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.596+0000 7f2ab2d9d640 1 -- 172.21.15.103:0/177320456 reap_dead start 2024-09-10T08:35:56.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.596+0000 7f2ab2d9d640 1 -- 172.21.15.103:0/177320456 reap_dead start 2024-09-10T08:35:56.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.596+0000 7f2ab888d640 1 -- 172.21.15.103:0/177320456 shutdown_connections 2024-09-10T08:35:56.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.596+0000 7f2ab888d640 1 -- 172.21.15.103:0/177320456 >> 172.21.15.103:0/177320456 conn(0x7f2ab4068030 msgr2=0x7f2ab40c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:56.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.596+0000 7f2ab888d640 1 -- 172.21.15.103:0/177320456 shutdown_connections 2024-09-10T08:35:56.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.596+0000 7f2ab888d640 1 -- 172.21.15.103:0/177320456 wait complete. 2024-09-10T08:35:56.613 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:35:56.614 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:35:56.614 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:35:56.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.726+0000 7fd387159640 1 Processor -- start 2024-09-10T08:35:56.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.726+0000 7fd387159640 1 -- start start 2024-09-10T08:35:56.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.727+0000 7fd387159640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd380153be0 0x7fd3800c3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.727+0000 7fd387159640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd3800c8180 0x7fd380160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.727+0000 7fd387159640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd380153fc0 con 0x7fd3800ac720 2024-09-10T08:35:56.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.727+0000 7fd387159640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fd380156db0 con 0x7fd3800c8180 2024-09-10T08:35:56.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.727+0000 7fd387159640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd3800a8030 con 0x7fd380153be0 2024-09-10T08:35:56.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.727+0000 7fd3856f6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd3800c8180 0x7fd380160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.727+0000 7fd3856f6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd3800c8180 0x7fd380160bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58276/0 (socket says 172.21.15.103:58276) 2024-09-10T08:35:56.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.727+0000 7fd3856f6640 1 -- 172.21.15.103:0/2757999530 learned_addr learned my addr 172.21.15.103:0/2757999530 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:56.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.727+0000 7fd384ef5640 1 --2- 172.21.15.103:0/2757999530 >> v2:172.21.15.154:3300/0 conn(0x7fd380153be0 0x7fd3800c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.728+0000 7fd3856f6640 1 -- 172.21.15.103:0/2757999530 >> v2:172.21.15.154:3300/0 conn(0x7fd380153be0 msgr2=0x7fd3800c3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:56.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.728+0000 7fd3856f6640 1 --2- 172.21.15.103:0/2757999530 >> v2:172.21.15.154:3300/0 conn(0x7fd380153be0 0x7fd3800c3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.728+0000 7fd3856f6640 1 -- 172.21.15.103:0/2757999530 >> v1:172.21.15.154:6789/0 conn(0x7fd3800ac720 legacy=0x7fd3800c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.728+0000 7fd3856f6640 1 -- 172.21.15.103:0/2757999530 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3800c86d0 con 0x7fd3800c8180 2024-09-10T08:35:56.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.728+0000 7fd3856f6640 1 --2- 172.21.15.103:0/2757999530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3800c8180 0x7fd380160bd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd3800c9a90 tx=0x7fd37802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ebe27c39152e6f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:56.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.729+0000 7fd37f7fe640 1 -- 172.21.15.103:0/2757999530 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd378036070 con 0x7fd3800c8180 2024-09-10T08:35:56.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.729+0000 7fd37f7fe640 1 -- 172.21.15.103:0/2757999530 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd378031600 con 0x7fd3800c8180 2024-09-10T08:35:56.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.729+0000 7fd37f7fe640 1 -- 172.21.15.103:0/2757999530 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3780319d0 con 0x7fd3800c8180 2024-09-10T08:35:56.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.729+0000 7fd387159640 1 -- 172.21.15.103:0/2757999530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3800c8180 msgr2=0x7fd380160bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.729+0000 7fd387159640 1 --2- 172.21.15.103:0/2757999530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3800c8180 0x7fd380160bd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd3800c9a90 tx=0x7fd37802a610 comp rx=0 tx=0).stop 2024-09-10T08:35:56.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.729+0000 7fd387159640 1 -- 172.21.15.103:0/2757999530 shutdown_connections 2024-09-10T08:35:56.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.729+0000 7fd387159640 1 --2- 172.21.15.103:0/2757999530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3800c8180 0x7fd380160bd0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.729+0000 7fd387159640 1 --2- 172.21.15.103:0/2757999530 >> v2:172.21.15.154:3300/0 conn(0x7fd380153be0 0x7fd3800c3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.729+0000 7fd387159640 1 -- 172.21.15.103:0/2757999530 >> 172.21.15.103:0/2757999530 conn(0x7fd3800c5660 msgr2=0x7fd3800c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:56.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.729+0000 7fd387159640 1 -- 172.21.15.103:0/2757999530 shutdown_connections 2024-09-10T08:35:56.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.729+0000 7fd387159640 1 -- 172.21.15.103:0/2757999530 wait complete. 2024-09-10T08:35:56.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.730+0000 7fd387159640 1 Processor -- start 2024-09-10T08:35:56.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.730+0000 7fd387159640 1 -- start start 2024-09-10T08:35:56.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.731+0000 7fd387159640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3800ac720 0x7fd3800be000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.731+0000 7fd387159640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3800c8180 0x7fd3800be540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.731+0000 7fd387159640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd380153be0 0x7fd380158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.731+0000 7fd387159640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd3800ac370 con 0x7fd3800c8180 2024-09-10T08:35:56.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.731+0000 7fd387159640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd3800a83e0 con 0x7fd380153be0 2024-09-10T08:35:56.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.731+0000 7fd387159640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd3800ac4f0 con 0x7fd3800ac720 2024-09-10T08:35:56.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.731+0000 7fd37ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3800c8180 0x7fd3800be540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.731+0000 7fd37ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3800c8180 0x7fd3800be540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58288/0 (socket says 172.21.15.103:58288) 2024-09-10T08:35:56.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.731+0000 7fd37ffff640 1 -- 172.21.15.103:0/2604004839 learned_addr learned my addr 172.21.15.103:0/2604004839 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.731+0000 7fd3856f6640 1 --2- 172.21.15.103:0/2604004839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd380153be0 0x7fd380158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.731+0000 7fd384ef5640 1 --2- 172.21.15.103:0/2604004839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3800ac720 0x7fd3800be000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.732+0000 7fd37ffff640 1 -- 172.21.15.103:0/2604004839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3800ac720 msgr2=0x7fd3800be000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.732+0000 7fd37ffff640 1 --2- 172.21.15.103:0/2604004839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3800ac720 0x7fd3800be000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.732+0000 7fd37ffff640 1 -- 172.21.15.103:0/2604004839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd380153be0 msgr2=0x7fd380158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.732+0000 7fd37ffff640 1 --2- 172.21.15.103:0/2604004839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd380153be0 0x7fd380158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.732+0000 7fd37ffff640 1 -- 172.21.15.103:0/2604004839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd380158810 con 0x7fd3800c8180 2024-09-10T08:35:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.732+0000 7fd37ffff640 1 --2- 172.21.15.103:0/2604004839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3800c8180 0x7fd3800be540 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00c430 tx=0x7fd36c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.732+0000 7fd37d7fa640 1 -- 172.21.15.103:0/2604004839 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c0052d0 con 0x7fd3800c8180 2024-09-10T08:35:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.732+0000 7fd37d7fa640 1 -- 172.21.15.103:0/2604004839 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd36c005490 con 0x7fd3800c8180 2024-09-10T08:35:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.732+0000 7fd37d7fa640 1 -- 172.21.15.103:0/2604004839 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c007260 con 0x7fd3800c8180 2024-09-10T08:35:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.732+0000 7fd387159640 1 -- 172.21.15.103:0/2604004839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3801ecb50 con 0x7fd3800c8180 2024-09-10T08:35:56.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.732+0000 7fd387159640 1 -- 172.21.15.103:0/2604004839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd380159fe0 con 0x7fd3800c8180 2024-09-10T08:35:56.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.733+0000 7fd387159640 1 --2- 172.21.15.103:0/2604004839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd380158380 0x7fd380158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.733+0000 7fd387159640 1 -- 172.21.15.103:0/2604004839 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd380070080 con 0x7fd380158380 2024-09-10T08:35:56.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.733+0000 7fd384ef5640 1 --2- 172.21.15.103:0/2604004839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd380158380 0x7fd380158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.734+0000 7fd384ef5640 1 -- 172.21.15.103:0/2604004839 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd3800c7f60 con 0x7fd380158380 2024-09-10T08:35:56.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.734+0000 7fd384ef5640 1 --2- 172.21.15.103:0/2604004839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd380158380 0x7fd380158ff0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd374011860 tx=0x7fd374011d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:56.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.734+0000 7fd37d7fa640 1 -- 172.21.15.103:0/2604004839 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd36c007400 con 0x7fd3800c8180 2024-09-10T08:35:56.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.734+0000 7fd37d7fa640 1 --2- 172.21.15.103:0/2604004839 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd36406be30 0x7fd36406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.735+0000 7fd37d7fa640 1 -- 172.21.15.103:0/2604004839 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fd36c08a5e0 con 0x7fd3800c8180 2024-09-10T08:35:56.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.735+0000 7fd3856f6640 1 --2- 172.21.15.103:0/2604004839 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd36406be30 0x7fd36406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.735+0000 7fd37d7fa640 1 -- 172.21.15.103:0/2604004839 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd374019070 con 0x7fd380158380 2024-09-10T08:35:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.735+0000 7fd37d7fa640 1 -- 172.21.15.103:0/2604004839 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd374004240 con 0x7fd380158380 2024-09-10T08:35:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.735+0000 7fd37d7fa640 1 -- 172.21.15.103:0/2604004839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd380158380 msgr2=0x7fd380158ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.735+0000 7fd37d7fa640 1 --2- 172.21.15.103:0/2604004839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd380158380 0x7fd380158ff0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd374011860 tx=0x7fd374011d20 comp rx=0 tx=0).stop 2024-09-10T08:35:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.735+0000 7fd37d7fa640 1 -- 172.21.15.103:0/2604004839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd380158380 msgr2=0x7fd380158ff0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:35:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.735+0000 7fd37d7fa640 1 --2- 172.21.15.103:0/2604004839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd380158380 0x7fd380158ff0 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd374011860 tx=0x7fd374011d20 comp rx=0 tx=0).stop 2024-09-10T08:35:56.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.735+0000 7fd3856f6640 1 --2- 172.21.15.103:0/2604004839 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd36406be30 0x7fd36406e2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd378033000 tx=0x7fd378009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:56.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.742+0000 7fd387159640 1 --2- 172.21.15.103:0/2604004839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd380159530 0x7fd3801ef510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.742+0000 7fd387159640 1 -- 172.21.15.103:0/2604004839 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd3800764a0 con 0x7fd380159530 2024-09-10T08:35:56.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.742+0000 7fd384ef5640 1 --2- 172.21.15.103:0/2604004839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd380159530 0x7fd3801ef510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.742+0000 7fd384ef5640 1 -- 172.21.15.103:0/2604004839 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd3800c61b0 con 0x7fd380159530 2024-09-10T08:35:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.743+0000 7fd384ef5640 1 --2- 172.21.15.103:0/2604004839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd380159530 0x7fd3801ef510 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd374011860 tx=0x7fd3740046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.743+0000 7fd37d7fa640 1 -- 172.21.15.103:0/2604004839 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd374019040 con 0x7fd380159530 2024-09-10T08:35:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.743+0000 7fd37d7fa640 1 -- 172.21.15.103:0/2604004839 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7fd3740044d0 con 0x7fd380159530 2024-09-10T08:35:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.743+0000 7fd37d7fa640 1 -- 172.21.15.103:0/2604004839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd380159530 msgr2=0x7fd3801ef510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.743+0000 7fd37d7fa640 1 --2- 172.21.15.103:0/2604004839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd380159530 0x7fd3801ef510 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd374011860 tx=0x7fd3740046c0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.743+0000 7fd37d7fa640 1 -- 172.21.15.103:0/2604004839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd380159530 msgr2=0x7fd3801ef510 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:35:56.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.743+0000 7fd37d7fa640 1 --2- 172.21.15.103:0/2604004839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd380159530 0x7fd3801ef510 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd374011860 tx=0x7fd3740046c0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.744 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:35:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:35:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:35:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:35:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 58, 2024-09-10T08:35:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 19064, 2024-09-10T08:35:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:35:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:35:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:35:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:35:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 14, 2024-09-10T08:35:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:35:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:35:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:35:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:35:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:35:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:35:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:35:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:35:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:35:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:35:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:35:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:35:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:35:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:35:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:35:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:35:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:35:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:35:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:35:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:35:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:35:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:35:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:35:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:35:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:35:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:35:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:35:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:35:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:35:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:35:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:35:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:35:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:35:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:35:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:35:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:35:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:35:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:35:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:35:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:35:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:35:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:35:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:35:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:35:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:35:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:35:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:35:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:56.753 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:56.753 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.753 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.753 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:35:56.753 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:35:56.753 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:35:56.753 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:35:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:35:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:35:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:35:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:35:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:35:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:35:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:35:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:35:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:35:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:35:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:35:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:35:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:35:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:35:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:35:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:35:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:35:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:35:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:35:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:35:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:35:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:35:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:35:56.756 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:35:56.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.743+0000 7fd387159640 1 -- 172.21.15.103:0/2604004839 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd36406be30 msgr2=0x7fd36406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.743+0000 7fd387159640 1 --2- 172.21.15.103:0/2604004839 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd36406be30 0x7fd36406e2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd378033000 tx=0x7fd378009000 comp rx=0 tx=0).stop 2024-09-10T08:35:56.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.743+0000 7fd387159640 1 -- 172.21.15.103:0/2604004839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3800c8180 msgr2=0x7fd3800be540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.743+0000 7fd387159640 1 --2- 172.21.15.103:0/2604004839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3800c8180 0x7fd3800be540 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00c430 tx=0x7fd36c00c8f0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.743+0000 7fd3856f6640 1 -- 172.21.15.103:0/2604004839 reap_dead start 2024-09-10T08:35:56.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.743+0000 7fd3856f6640 1 -- 172.21.15.103:0/2604004839 reap_dead start 2024-09-10T08:35:56.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.744+0000 7fd387159640 1 -- 172.21.15.103:0/2604004839 shutdown_connections 2024-09-10T08:35:56.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.744+0000 7fd387159640 1 -- 172.21.15.103:0/2604004839 >> 172.21.15.103:0/2604004839 conn(0x7fd3800c5660 msgr2=0x7fd380072730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:56.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.744+0000 7fd387159640 1 -- 172.21.15.103:0/2604004839 shutdown_connections 2024-09-10T08:35:56.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.744+0000 7fd387159640 1 -- 172.21.15.103:0/2604004839 wait complete. 2024-09-10T08:35:56.759 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:35:56.759 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-09-10T08:35:56.759 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-10T08:35:56.759 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-10T08:35:56.759 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-10T08:35:56.760 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T08:35:56.760 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:35:56.771 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T08:35:56.771 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-10T08:35:56.771 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:35:56.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.887+0000 7f6c61731640 1 Processor -- start 2024-09-10T08:35:56.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.887+0000 7f6c61731640 1 -- start start 2024-09-10T08:35:56.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.888+0000 7f6c61731640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6c5c0c4680 0x7f6c5c156a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.888+0000 7f6c61731640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c5c156fc0 0x7f6c5c1573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.888+0000 7f6c61731640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c5c070590 con 0x7f6c5c0acc30 2024-09-10T08:35:56.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.888+0000 7f6c61731640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f6c5c0c4ea0 con 0x7f6c5c0c4680 2024-09-10T08:35:56.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.888+0000 7f6c61731640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6c5c0a8220 con 0x7f6c5c156fc0 2024-09-10T08:35:56.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.888+0000 7f6c5a7fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6c5c0c4680 0x7f6c5c156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.888+0000 7f6c5b7fe640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c5c156fc0 msgr2=0x7f6c5c1573e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:35:56.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.888+0000 7f6c5b7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c5c156fc0 0x7f6c5c1573e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:35:56.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.888+0000 7f6c5a7fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6c5c0c4680 0x7f6c5c156a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58304/0 (socket says 172.21.15.103:58304) 2024-09-10T08:35:56.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.888+0000 7f6c5a7fc640 1 -- 172.21.15.103:0/4030625406 learned_addr learned my addr 172.21.15.103:0/4030625406 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:56.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.889+0000 7f6c59ffb640 1 -- 172.21.15.103:0/4030625406 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 193632906 0 0) 0x7f6c5c070590 con 0x7f6c5c0acc30 2024-09-10T08:35:56.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.889+0000 7f6c5a7fc640 1 -- 172.21.15.103:0/4030625406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c5c156fc0 msgr2=0x7f6c5c1573e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:35:56.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.889+0000 7f6c5a7fc640 1 --2- 172.21.15.103:0/4030625406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c5c156fc0 0x7f6c5c1573e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.889+0000 7f6c5a7fc640 1 -- 172.21.15.103:0/4030625406 >> v1:172.21.15.154:6789/0 conn(0x7f6c5c0acc30 legacy=0x7f6c5c0c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.889+0000 7f6c5a7fc640 1 -- 172.21.15.103:0/4030625406 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c5c0a84f0 con 0x7f6c5c0c4680 2024-09-10T08:35:56.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.890+0000 7f6c5a7fc640 1 --2- 172.21.15.103:0/4030625406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c5c0c4680 0x7f6c5c156a80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6c50009870 tx=0x7f6c5002a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384e0ea4b80f67c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:56.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.890+0000 7f6c59ffb640 1 -- 172.21.15.103:0/4030625406 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c50037070 con 0x7f6c5c0c4680 2024-09-10T08:35:56.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.890+0000 7f6c59ffb640 1 -- 172.21.15.103:0/4030625406 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c50032440 con 0x7f6c5c0c4680 2024-09-10T08:35:56.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.890+0000 7f6c59ffb640 1 -- 172.21.15.103:0/4030625406 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c50032810 con 0x7f6c5c0c4680 2024-09-10T08:35:56.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.891+0000 7f6c61731640 1 -- 172.21.15.103:0/4030625406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c5c0c4680 msgr2=0x7f6c5c156a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.891+0000 7f6c61731640 1 --2- 172.21.15.103:0/4030625406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c5c0c4680 0x7f6c5c156a80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6c50009870 tx=0x7f6c5002a150 comp rx=0 tx=0).stop 2024-09-10T08:35:56.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.891+0000 7f6c61731640 1 -- 172.21.15.103:0/4030625406 shutdown_connections 2024-09-10T08:35:56.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.891+0000 7f6c61731640 1 --2- 172.21.15.103:0/4030625406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c5c156fc0 0x7f6c5c1573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.891+0000 7f6c61731640 1 --2- 172.21.15.103:0/4030625406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c5c0c4680 0x7f6c5c156a80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.891+0000 7f6c61731640 1 -- 172.21.15.103:0/4030625406 >> 172.21.15.103:0/4030625406 conn(0x7f6c5c0c5660 msgr2=0x7f6c5c0c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:56.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.891+0000 7f6c61731640 1 -- 172.21.15.103:0/4030625406 shutdown_connections 2024-09-10T08:35:56.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.891+0000 7f6c61731640 1 -- 172.21.15.103:0/4030625406 wait complete. 2024-09-10T08:35:56.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.893+0000 7f6c61731640 1 Processor -- start 2024-09-10T08:35:56.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.893+0000 7f6c61731640 1 -- start start 2024-09-10T08:35:56.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.893+0000 7f6c61731640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5c0acc30 0x7f6c5c1ec5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.893+0000 7f6c61731640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c5c0c4680 0x7f6c5c1ecfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.893+0000 7f6c61731640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c5c156fc0 0x7f6c5c1ed510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.893+0000 7f6c61731640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5c0c5330 con 0x7f6c5c156fc0 2024-09-10T08:35:56.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.893+0000 7f6c61731640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5c0702b0 con 0x7f6c5c0acc30 2024-09-10T08:35:56.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.893+0000 7f6c61731640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6c5c0c63f0 con 0x7f6c5c0c4680 2024-09-10T08:35:56.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.894+0000 7f6c5b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c5c156fc0 0x7f6c5c1ed510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.894+0000 7f6c5affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5c0acc30 0x7f6c5c1ec5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.894+0000 7f6c5b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c5c156fc0 0x7f6c5c1ed510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58314/0 (socket says 172.21.15.103:58314) 2024-09-10T08:35:56.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.894+0000 7f6c5b7fe640 1 -- 172.21.15.103:0/439624490 learned_addr learned my addr 172.21.15.103:0/439624490 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:35:56.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.894+0000 7f6c5a7fc640 1 -- 172.21.15.103:0/439624490 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c5c0c4680 msgr2=0x7f6c5c1ecfd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:35:56.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.894+0000 7f6c5a7fc640 1 --2- 172.21.15.103:0/439624490 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c5c0c4680 0x7f6c5c1ecfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:35:56.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.894+0000 7f6c5b7fe640 1 -- 172.21.15.103:0/439624490 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c5c0c4680 msgr2=0x7f6c5c1ecfd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:35:56.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.894+0000 7f6c5b7fe640 1 --2- 172.21.15.103:0/439624490 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c5c0c4680 0x7f6c5c1ecfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.894+0000 7f6c5b7fe640 1 -- 172.21.15.103:0/439624490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5c0acc30 msgr2=0x7f6c5c1ec5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:56.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.894+0000 7f6c5b7fe640 1 --2- 172.21.15.103:0/439624490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5c0acc30 0x7f6c5c1ec5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:56.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.894+0000 7f6c5b7fe640 1 -- 172.21.15.103:0/439624490 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c5c1eda50 con 0x7f6c5c156fc0 2024-09-10T08:35:56.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.894+0000 7f6c5b7fe640 1 --2- 172.21.15.103:0/439624490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c5c156fc0 0x7f6c5c1ed510 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6c5400be80 tx=0x7f6c5400beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:56.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.894+0000 7f6c437fe640 1 -- 172.21.15.103:0/439624490 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c54016430 con 0x7f6c5c156fc0 2024-09-10T08:35:56.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.894+0000 7f6c437fe640 1 -- 172.21.15.103:0/439624490 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c54010030 con 0x7f6c5c156fc0 2024-09-10T08:35:56.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.894+0000 7f6c61731640 1 -- 172.21.15.103:0/439624490 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c5c06fda0 con 0x7f6c5c156fc0 2024-09-10T08:35:56.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.895+0000 7f6c437fe640 1 -- 172.21.15.103:0/439624490 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c54016810 con 0x7f6c5c156fc0 2024-09-10T08:35:56.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.895+0000 7f6c61731640 1 -- 172.21.15.103:0/439624490 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c5c06c660 con 0x7f6c5c156fc0 2024-09-10T08:35:56.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.896+0000 7f6c61731640 1 -- 172.21.15.103:0/439624490 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c5c0abc10 con 0x7f6c5c156fc0 2024-09-10T08:35:56.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.896+0000 7f6c437fe640 1 -- 172.21.15.103:0/439624490 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c540153e0 con 0x7f6c5c156fc0 2024-09-10T08:35:56.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.897+0000 7f6c437fe640 1 --2- 172.21.15.103:0/439624490 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6c4806bde0 0x7f6c4806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:56.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.897+0000 7f6c437fe640 1 -- 172.21.15.103:0/439624490 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f6c5408b5f0 con 0x7f6c5c156fc0 2024-09-10T08:35:56.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.897+0000 7f6c5affd640 1 --2- 172.21.15.103:0/439624490 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6c4806bde0 0x7f6c4806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:56.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.897+0000 7f6c5affd640 1 --2- 172.21.15.103:0/439624490 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6c4806bde0 0x7f6c4806e2a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c000f60 tx=0x7f6c4c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:56.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:56.902+0000 7f6c437fe640 1 -- 172.21.15.103:0/439624490 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6c54059640 con 0x7f6c5c156fc0 2024-09-10T08:35:57.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:57.206+0000 7f6c61731640 1 -- 172.21.15.103:0/439624490 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6c5c0a8000 con 0x7f6c5c156fc0 2024-09-10T08:35:57.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:57.207+0000 7f6c437fe640 1 -- 172.21.15.103:0/439624490 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f6c5405d940 con 0x7f6c5c156fc0 2024-09-10T08:35:57.207 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:35:57.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:57.210+0000 7f6c61731640 1 -- 172.21.15.103:0/439624490 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6c4806bde0 msgr2=0x7f6c4806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:57.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:57.210+0000 7f6c61731640 1 --2- 172.21.15.103:0/439624490 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6c4806bde0 0x7f6c4806e2a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c000f60 tx=0x7f6c4c009040 comp rx=0 tx=0).stop 2024-09-10T08:35:57.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:57.210+0000 7f6c61731640 1 -- 172.21.15.103:0/439624490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c5c156fc0 msgr2=0x7f6c5c1ed510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:57.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:57.210+0000 7f6c61731640 1 --2- 172.21.15.103:0/439624490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c5c156fc0 0x7f6c5c1ed510 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6c5400be80 tx=0x7f6c5400beb0 comp rx=0 tx=0).stop 2024-09-10T08:35:57.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:57.210+0000 7f6c61731640 1 -- 172.21.15.103:0/439624490 shutdown_connections 2024-09-10T08:35:57.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:57.210+0000 7f6c61731640 1 --2- 172.21.15.103:0/439624490 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6c4806bde0 0x7f6c4806e2a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:57.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:57.210+0000 7f6c61731640 1 --2- 172.21.15.103:0/439624490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c5c156fc0 0x7f6c5c1ed510 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:57.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:57.210+0000 7f6c61731640 1 --2- 172.21.15.103:0/439624490 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c5c0c4680 0x7f6c5c1ecfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:57.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:57.210+0000 7f6c61731640 1 --2- 172.21.15.103:0/439624490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c5c0acc30 0x7f6c5c1ec5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:57.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:57.210+0000 7f6c61731640 1 -- 172.21.15.103:0/439624490 >> 172.21.15.103:0/439624490 conn(0x7f6c5c0c5660 msgr2=0x7f6c5c0c80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:57.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:57.210+0000 7f6c61731640 1 -- 172.21.15.103:0/439624490 shutdown_connections 2024-09-10T08:35:57.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:35:57.210+0000 7f6c61731640 1 -- 172.21.15.103:0/439624490 wait complete. 2024-09-10T08:35:57.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-10T08:36:00.223 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:36:00.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.342+0000 7f8af3b86640 1 Processor -- start 2024-09-10T08:36:00.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.342+0000 7f8af3b86640 1 -- start start 2024-09-10T08:36:00.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.343+0000 7f8af3b86640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8aec0ca220 0x7f8aec0c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:00.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.343+0000 7f8af3b86640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8aec0a9230 0x7f8aec072b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:00.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.343+0000 7f8af3b86640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8aec154b80 0x7f8aec151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:00.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.343+0000 7f8af3b86640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f8aec0c99b0 con 0x7f8aec0ca220 2024-09-10T08:36:00.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.343+0000 7f8af3b86640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8aec073070 con 0x7f8aec154b80 2024-09-10T08:36:00.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.343+0000 7f8af3b86640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8aec070800 con 0x7f8aec0a9230 2024-09-10T08:36:00.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.343+0000 7f8af1922640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8aec0ca220 0x7f8aec0c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:00.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.343+0000 7f8af1121640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8aec0a9230 msgr2=0x7f8aec072b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:36:00.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.343+0000 7f8af1922640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8aec0ca220 0x7f8aec0c3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58324/0 (socket says 172.21.15.103:58324) 2024-09-10T08:36:00.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.343+0000 7f8af1922640 1 -- 172.21.15.103:0/1159227186 learned_addr learned my addr 172.21.15.103:0/1159227186 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:00.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.343+0000 7f8af2123640 1 --2- 172.21.15.103:0/1159227186 >> v2:172.21.15.154:3300/0 conn(0x7f8aec154b80 0x7f8aec151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:00.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.343+0000 7f8af1121640 1 --2- 172.21.15.103:0/1159227186 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8aec0a9230 0x7f8aec072b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:36:00.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.344+0000 7f8af1922640 1 -- 172.21.15.103:0/1159227186 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8aec0a9230 msgr2=0x7f8aec072b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:36:00.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.344+0000 7f8af1922640 1 --2- 172.21.15.103:0/1159227186 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8aec0a9230 0x7f8aec072b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:00.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.344+0000 7f8af1922640 1 -- 172.21.15.103:0/1159227186 >> v2:172.21.15.154:3300/0 conn(0x7f8aec154b80 msgr2=0x7f8aec151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:00.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.344+0000 7f8af1922640 1 --2- 172.21.15.103:0/1159227186 >> v2:172.21.15.154:3300/0 conn(0x7f8aec154b80 0x7f8aec151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:00.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.344+0000 7f8af1922640 1 -- 172.21.15.103:0/1159227186 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aec0c93f0 con 0x7f8aec0ca220 2024-09-10T08:36:00.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.345+0000 7f8af1922640 1 --2- 172.21.15.103:0/1159227186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aec0ca220 0x7f8aec0c3f10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8aec06f0b0 tx=0x7f8ae802a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f315181c8f735937 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:00.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.345+0000 7f8af0920640 1 -- 172.21.15.103:0/1159227186 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8037070 con 0x7f8aec0ca220 2024-09-10T08:36:00.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.345+0000 7f8af0920640 1 -- 172.21.15.103:0/1159227186 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae8032440 con 0x7f8aec0ca220 2024-09-10T08:36:00.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.345+0000 7f8af0920640 1 -- 172.21.15.103:0/1159227186 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8032810 con 0x7f8aec0ca220 2024-09-10T08:36:00.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.345+0000 7f8af3b86640 1 -- 172.21.15.103:0/1159227186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aec0ca220 msgr2=0x7f8aec0c3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:00.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.345+0000 7f8af3b86640 1 --2- 172.21.15.103:0/1159227186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aec0ca220 0x7f8aec0c3f10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8aec06f0b0 tx=0x7f8ae802a160 comp rx=0 tx=0).stop 2024-09-10T08:36:00.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.345+0000 7f8af3b86640 1 -- 172.21.15.103:0/1159227186 shutdown_connections 2024-09-10T08:36:00.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.345+0000 7f8af3b86640 1 --2- 172.21.15.103:0/1159227186 >> v2:172.21.15.154:3300/0 conn(0x7f8aec154b80 0x7f8aec151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:00.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.345+0000 7f8af3b86640 1 --2- 172.21.15.103:0/1159227186 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8aec0a9230 0x7f8aec072b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:00.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.345+0000 7f8af3b86640 1 --2- 172.21.15.103:0/1159227186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aec0ca220 0x7f8aec0c3f10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:00.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.345+0000 7f8af3b86640 1 -- 172.21.15.103:0/1159227186 >> 172.21.15.103:0/1159227186 conn(0x7f8aec067b30 msgr2=0x7f8aec067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:00.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.345+0000 7f8af3b86640 1 -- 172.21.15.103:0/1159227186 shutdown_connections 2024-09-10T08:36:00.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.345+0000 7f8af3b86640 1 -- 172.21.15.103:0/1159227186 wait complete. 2024-09-10T08:36:00.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.347+0000 7f8af3b86640 1 Processor -- start 2024-09-10T08:36:00.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.347+0000 7f8af3b86640 1 -- start start 2024-09-10T08:36:00.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.348+0000 7f8af3b86640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8aec0a9230 0x7f8aec0c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:00.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.348+0000 7f8af3b86640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8aec0ca220 0x7f8aec1e8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:00.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.348+0000 7f8af3b86640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aec154b80 0x7f8aec0c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:00.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.348+0000 7f8af3b86640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8aec154660 con 0x7f8aec154b80 2024-09-10T08:36:00.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.348+0000 7f8af3b86640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8aec154380 con 0x7f8aec0a9230 2024-09-10T08:36:00.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.348+0000 7f8af3b86640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8aec155010 con 0x7f8aec0ca220 2024-09-10T08:36:00.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.348+0000 7f8af1121640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8aec0ca220 msgr2=0x7f8aec1e8a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:36:00.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.348+0000 7f8af1121640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8aec0ca220 0x7f8aec1e8a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:36:00.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.348+0000 7f8af2123640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aec154b80 0x7f8aec0c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:00.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.348+0000 7f8af2123640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aec154b80 0x7f8aec0c5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58332/0 (socket says 172.21.15.103:58332) 2024-09-10T08:36:00.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.348+0000 7f8af2123640 1 -- 172.21.15.103:0/1806333925 learned_addr learned my addr 172.21.15.103:0/1806333925 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:00.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.348+0000 7f8af1922640 1 --2- 172.21.15.103:0/1806333925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8aec0a9230 0x7f8aec0c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:00.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.348+0000 7f8af2123640 1 -- 172.21.15.103:0/1806333925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8aec0ca220 msgr2=0x7f8aec1e8a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:36:00.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.348+0000 7f8af2123640 1 --2- 172.21.15.103:0/1806333925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8aec0ca220 0x7f8aec1e8a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:00.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.348+0000 7f8af2123640 1 -- 172.21.15.103:0/1806333925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8aec0a9230 msgr2=0x7f8aec0c32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:00.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.348+0000 7f8af2123640 1 --2- 172.21.15.103:0/1806333925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8aec0a9230 0x7f8aec0c32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:00.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.348+0000 7f8af2123640 1 -- 172.21.15.103:0/1806333925 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aec06ecc0 con 0x7f8aec154b80 2024-09-10T08:36:00.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.348+0000 7f8af2123640 1 --2- 172.21.15.103:0/1806333925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aec154b80 0x7f8aec0c5eb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400efc0 tx=0x7f8ae400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:00.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.349+0000 7f8ae27fc640 1 -- 172.21.15.103:0/1806333925 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4018020 con 0x7f8aec154b80 2024-09-10T08:36:00.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.349+0000 7f8ae27fc640 1 -- 172.21.15.103:0/1806333925 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae4014480 con 0x7f8aec154b80 2024-09-10T08:36:00.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.349+0000 7f8af3b86640 1 -- 172.21.15.103:0/1806333925 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aec0c6d90 con 0x7f8aec154b80 2024-09-10T08:36:00.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.349+0000 7f8ae27fc640 1 -- 172.21.15.103:0/1806333925 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4014870 con 0x7f8aec154b80 2024-09-10T08:36:00.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.349+0000 7f8af3b86640 1 -- 172.21.15.103:0/1806333925 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aec0c7350 con 0x7f8aec154b80 2024-09-10T08:36:00.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.350+0000 7f8af3b86640 1 -- 172.21.15.103:0/1806333925 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aec0ca600 con 0x7f8aec154b80 2024-09-10T08:36:00.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.350+0000 7f8ae27fc640 1 -- 172.21.15.103:0/1806333925 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ae4005d10 con 0x7f8aec154b80 2024-09-10T08:36:00.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.351+0000 7f8ae27fc640 1 --2- 172.21.15.103:0/1806333925 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8ad006bde0 0x7f8ad006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:00.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.351+0000 7f8af1922640 1 --2- 172.21.15.103:0/1806333925 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8ad006bde0 0x7f8ad006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:00.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.351+0000 7f8ae27fc640 1 -- 172.21.15.103:0/1806333925 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f8ae408bb60 con 0x7f8aec154b80 2024-09-10T08:36:00.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.352+0000 7f8af1922640 1 --2- 172.21.15.103:0/1806333925 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8ad006bde0 0x7f8ad006e2a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8034000 tx=0x7f8ae802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:00.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.356+0000 7f8ae27fc640 1 -- 172.21.15.103:0/1806333925 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ae4022070 con 0x7f8aec154b80 2024-09-10T08:36:00.543 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:36:00.547 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:36:00.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.641+0000 7f8af3b86640 1 -- 172.21.15.103:0/1806333925 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8aec0c8890 con 0x7f8aec154b80 2024-09-10T08:36:00.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.641+0000 7f8ae27fc640 1 -- 172.21.15.103:0/1806333925 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f8ae4010040 con 0x7f8aec154b80 2024-09-10T08:36:00.641 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:36:00.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.643+0000 7f8af3b86640 1 -- 172.21.15.103:0/1806333925 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8ad006bde0 msgr2=0x7f8ad006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:00.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.643+0000 7f8af3b86640 1 --2- 172.21.15.103:0/1806333925 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8ad006bde0 0x7f8ad006e2a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8034000 tx=0x7f8ae802e000 comp rx=0 tx=0).stop 2024-09-10T08:36:00.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.643+0000 7f8af3b86640 1 -- 172.21.15.103:0/1806333925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aec154b80 msgr2=0x7f8aec0c5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:00.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.643+0000 7f8af3b86640 1 --2- 172.21.15.103:0/1806333925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aec154b80 0x7f8aec0c5eb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400efc0 tx=0x7f8ae400c490 comp rx=0 tx=0).stop 2024-09-10T08:36:00.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.643+0000 7f8af3b86640 1 -- 172.21.15.103:0/1806333925 shutdown_connections 2024-09-10T08:36:00.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.643+0000 7f8af3b86640 1 --2- 172.21.15.103:0/1806333925 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8ad006bde0 0x7f8ad006e2a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:00.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.643+0000 7f8af3b86640 1 --2- 172.21.15.103:0/1806333925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aec154b80 0x7f8aec0c5eb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:00.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.643+0000 7f8af3b86640 1 --2- 172.21.15.103:0/1806333925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8aec0ca220 0x7f8aec1e8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:00.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.643+0000 7f8af3b86640 1 --2- 172.21.15.103:0/1806333925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8aec0a9230 0x7f8aec0c32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:00.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.643+0000 7f8af3b86640 1 -- 172.21.15.103:0/1806333925 >> 172.21.15.103:0/1806333925 conn(0x7f8aec067b30 msgr2=0x7f8aec0731f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:00.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.644+0000 7f8af3b86640 1 -- 172.21.15.103:0/1806333925 shutdown_connections 2024-09-10T08:36:00.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:00.644+0000 7f8af3b86640 1 -- 172.21.15.103:0/1806333925 wait complete. 2024-09-10T08:36:03.655 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:36:03.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.765+0000 7f431912a640 1 Processor -- start 2024-09-10T08:36:03.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.765+0000 7f431912a640 1 -- start start 2024-09-10T08:36:03.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.766+0000 7f431912a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43140cc2d0 0x7f431415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:03.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.766+0000 7f431912a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4314156d90 0x7f4314157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:03.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.766+0000 7f431912a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f431406c5b0 con 0x7f43140c7a90 2024-09-10T08:36:03.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.766+0000 7f431912a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f431406c890 con 0x7f4314156d90 2024-09-10T08:36:03.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.766+0000 7f431912a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4314159900 con 0x7f43140cc2d0 2024-09-10T08:36:03.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.766+0000 7f4312d9d640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43140cc2d0 msgr2=0x7f431415a3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:36:03.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.766+0000 7f4312d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43140cc2d0 0x7f431415a3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:36:03.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.766+0000 7f431359e640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f43140c7a90 0x7f43140c8790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:52450/0 (socket says 172.21.15.103:52450) 2024-09-10T08:36:03.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.766+0000 7f431359e640 1 -- 172.21.15.103:0/2070478534 learned_addr learned my addr 172.21.15.103:0/2070478534 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:36:03.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.766+0000 7f431259c640 1 --2- 172.21.15.103:0/2070478534 >> v2:172.21.15.154:3300/0 conn(0x7f4314156d90 0x7f4314157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:03.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.766+0000 7f431259c640 1 -- 172.21.15.103:0/2070478534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43140cc2d0 msgr2=0x7f431415a3e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:36:03.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.766+0000 7f431259c640 1 --2- 172.21.15.103:0/2070478534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43140cc2d0 0x7f431415a3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:03.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.766+0000 7f431259c640 1 -- 172.21.15.103:0/2070478534 >> v1:172.21.15.103:6789/0 conn(0x7f43140c7a90 legacy=0x7f43140c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:03.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.766+0000 7f431259c640 1 -- 172.21.15.103:0/2070478534 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4314159be0 con 0x7f4314156d90 2024-09-10T08:36:03.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.767+0000 7f431259c640 1 --2- 172.21.15.103:0/2070478534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4314156d90 0x7f4314157800 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f43080097a0 tx=0x7f430802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a75f1538095d96e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:03.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.767+0000 7f4311d9b640 1 -- 172.21.15.103:0/2070478534 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4308037070 con 0x7f4314156d90 2024-09-10T08:36:03.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.767+0000 7f4311d9b640 1 -- 172.21.15.103:0/2070478534 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4308032440 con 0x7f4314156d90 2024-09-10T08:36:03.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.767+0000 7f4311d9b640 1 -- 172.21.15.103:0/2070478534 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4308032810 con 0x7f4314156d90 2024-09-10T08:36:03.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.768+0000 7f431912a640 1 -- 172.21.15.103:0/2070478534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4314156d90 msgr2=0x7f4314157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:03.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.768+0000 7f431912a640 1 --2- 172.21.15.103:0/2070478534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4314156d90 0x7f4314157800 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f43080097a0 tx=0x7f430802a1a0 comp rx=0 tx=0).stop 2024-09-10T08:36:03.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.768+0000 7f431912a640 1 -- 172.21.15.103:0/2070478534 shutdown_connections 2024-09-10T08:36:03.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.768+0000 7f431912a640 1 --2- 172.21.15.103:0/2070478534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4314156d90 0x7f4314157800 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:03.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.768+0000 7f431912a640 1 --2- 172.21.15.103:0/2070478534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43140cc2d0 0x7f431415a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:03.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.768+0000 7f431912a640 1 -- 172.21.15.103:0/2070478534 >> 172.21.15.103:0/2070478534 conn(0x7f4314067fe0 msgr2=0x7f4314073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:03.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.768+0000 7f431912a640 1 -- 172.21.15.103:0/2070478534 shutdown_connections 2024-09-10T08:36:03.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.768+0000 7f431912a640 1 -- 172.21.15.103:0/2070478534 wait complete. 2024-09-10T08:36:03.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.770+0000 7f431912a640 1 Processor -- start 2024-09-10T08:36:03.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.770+0000 7f431912a640 1 -- start start 2024-09-10T08:36:03.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.771+0000 7f431912a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43140c7a90 0x7f431414cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:03.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.771+0000 7f431912a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43140cc2d0 0x7f43140c12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:03.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.771+0000 7f431912a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4314156d90 0x7f43141ed490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:03.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.771+0000 7f431912a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f431406d2c0 con 0x7f43140cc2d0 2024-09-10T08:36:03.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.771+0000 7f431912a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f43141571f0 con 0x7f4314156d90 2024-09-10T08:36:03.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.771+0000 7f431912a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f431406c1d0 con 0x7f43140c7a90 2024-09-10T08:36:03.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.771+0000 7f4312d9d640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43140c7a90 msgr2=0x7f431414cb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:36:03.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.771+0000 7f4312d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43140c7a90 0x7f431414cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:36:03.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.771+0000 7f431259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43140cc2d0 0x7f43140c12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:03.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.771+0000 7f431259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43140cc2d0 0x7f43140c12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58346/0 (socket says 172.21.15.103:58346) 2024-09-10T08:36:03.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.771+0000 7f431259c640 1 -- 172.21.15.103:0/2582339531 learned_addr learned my addr 172.21.15.103:0/2582339531 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:03.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.771+0000 7f431359e640 1 --2- 172.21.15.103:0/2582339531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4314156d90 0x7f43141ed490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:03.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.771+0000 7f431259c640 1 -- 172.21.15.103:0/2582339531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43140c7a90 msgr2=0x7f431414cb30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:36:03.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.771+0000 7f431259c640 1 --2- 172.21.15.103:0/2582339531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43140c7a90 0x7f431414cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:03.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.771+0000 7f431259c640 1 -- 172.21.15.103:0/2582339531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4314156d90 msgr2=0x7f43141ed490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:03.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.771+0000 7f431259c640 1 --2- 172.21.15.103:0/2582339531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4314156d90 0x7f43141ed490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:03.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.771+0000 7f431259c640 1 -- 172.21.15.103:0/2582339531 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f431414d070 con 0x7f43140cc2d0 2024-09-10T08:36:03.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.771+0000 7f431259c640 1 --2- 172.21.15.103:0/2582339531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43140cc2d0 0x7f43140c12e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4308000c00 tx=0x7f43080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:03.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.772+0000 7f42fb7fe640 1 -- 172.21.15.103:0/2582339531 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4308041070 con 0x7f43140cc2d0 2024-09-10T08:36:03.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.772+0000 7f42fb7fe640 1 -- 172.21.15.103:0/2582339531 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f430803c950 con 0x7f43140cc2d0 2024-09-10T08:36:03.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.772+0000 7f431912a640 1 -- 172.21.15.103:0/2582339531 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43140c5500 con 0x7f43140cc2d0 2024-09-10T08:36:03.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.772+0000 7f42fb7fe640 1 -- 172.21.15.103:0/2582339531 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4308037040 con 0x7f43140cc2d0 2024-09-10T08:36:03.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.772+0000 7f431912a640 1 -- 172.21.15.103:0/2582339531 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43141e2220 con 0x7f43140cc2d0 2024-09-10T08:36:03.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.773+0000 7f431912a640 1 -- 172.21.15.103:0/2582339531 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f431415a3e0 con 0x7f43140cc2d0 2024-09-10T08:36:03.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.773+0000 7f42fb7fe640 1 -- 172.21.15.103:0/2582339531 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4308044070 con 0x7f43140cc2d0 2024-09-10T08:36:03.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.774+0000 7f42fb7fe640 1 --2- 172.21.15.103:0/2582339531 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f430006bde0 0x7f430006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:03.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.774+0000 7f42fb7fe640 1 -- 172.21.15.103:0/2582339531 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f43080abe80 con 0x7f43140cc2d0 2024-09-10T08:36:03.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.774+0000 7f4312d9d640 1 --2- 172.21.15.103:0/2582339531 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f430006bde0 0x7f430006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:03.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.774+0000 7f4312d9d640 1 --2- 172.21.15.103:0/2582339531 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f430006bde0 0x7f430006e2a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4304006fd0 tx=0x7f4304006d80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:03.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:03.778+0000 7f42fb7fe640 1 -- 172.21.15.103:0/2582339531 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f431414d070 con 0x7f43140cc2d0 2024-09-10T08:36:03.988 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-10T08:36:04.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:04.066+0000 7f431912a640 1 -- 172.21.15.103:0/2582339531 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f43140b11f0 con 0x7f43140cc2d0 2024-09-10T08:36:04.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:04.066+0000 7f42fb7fe640 1 -- 172.21.15.103:0/2582339531 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f4308079f50 con 0x7f43140cc2d0 2024-09-10T08:36:04.066 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:36:04.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:04.068+0000 7f431912a640 1 -- 172.21.15.103:0/2582339531 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f430006bde0 msgr2=0x7f430006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:04.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:04.068+0000 7f431912a640 1 --2- 172.21.15.103:0/2582339531 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f430006bde0 0x7f430006e2a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4304006fd0 tx=0x7f4304006d80 comp rx=0 tx=0).stop 2024-09-10T08:36:04.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:04.068+0000 7f431912a640 1 -- 172.21.15.103:0/2582339531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43140cc2d0 msgr2=0x7f43140c12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:04.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:04.068+0000 7f431912a640 1 --2- 172.21.15.103:0/2582339531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43140cc2d0 0x7f43140c12e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4308000c00 tx=0x7f43080046c0 comp rx=0 tx=0).stop 2024-09-10T08:36:04.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:04.068+0000 7f431912a640 1 -- 172.21.15.103:0/2582339531 shutdown_connections 2024-09-10T08:36:04.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:04.068+0000 7f431912a640 1 --2- 172.21.15.103:0/2582339531 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f430006bde0 0x7f430006e2a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:04.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:04.068+0000 7f431912a640 1 --2- 172.21.15.103:0/2582339531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4314156d90 0x7f43141ed490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:04.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:04.068+0000 7f431912a640 1 --2- 172.21.15.103:0/2582339531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43140cc2d0 0x7f43140c12e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:04.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:04.068+0000 7f431912a640 1 --2- 172.21.15.103:0/2582339531 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43140c7a90 0x7f431414cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:04.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:04.068+0000 7f431912a640 1 -- 172.21.15.103:0/2582339531 >> 172.21.15.103:0/2582339531 conn(0x7f4314067fe0 msgr2=0x7f4314157700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:04.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:04.068+0000 7f431912a640 1 -- 172.21.15.103:0/2582339531 shutdown_connections 2024-09-10T08:36:04.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:04.068+0000 7f431912a640 1 -- 172.21.15.103:0/2582339531 wait complete. 2024-09-10T08:36:07.079 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:36:07.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:07.187+0000 7fd965cac640 1 Processor -- start 2024-09-10T08:36:07.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:07.187+0000 7fd965cac640 1 -- start start 2024-09-10T08:36:07.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:07.188+0000 7fd965cac640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd960150b70 0x7fd9600ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:07.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:07.188+0000 7fd965cac640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd960153d70 con 0x7fd960067d20 2024-09-10T08:36:07.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:07.188+0000 7fd965cac640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd960154010 con 0x7fd9600ac6e0 2024-09-10T08:36:07.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:07.188+0000 7fd965cac640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd9600a82c0 con 0x7fd960150b70 2024-09-10T08:36:07.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:07.188+0000 7fd95f7fe640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd960150b70 msgr2=0x7fd9600ac1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:36:07.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:07.188+0000 7fd95f7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd960150b70 0x7fd9600ac1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:36:07.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:07.188+0000 7fd95effd640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd960067d20 0x7fd9600c3350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:57082/0 (socket says 172.21.15.103:57082) 2024-09-10T08:36:07.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:07.188+0000 7fd95effd640 1 -- 172.21.15.103:0/3053431762 learned_addr learned my addr 172.21.15.103:0/3053431762 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:36:07.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:07.389+0000 7fd95f7fe640 1 -- 172.21.15.103:0/3053431762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd960150b70 msgr2=0x7fd9600ac1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:36:07.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:07.389+0000 7fd95f7fe640 1 --2- 172.21.15.103:0/3053431762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd960150b70 0x7fd9600ac1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:36:07.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:07.790+0000 7fd95f7fe640 1 -- 172.21.15.103:0/3053431762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd960150b70 msgr2=0x7fd9600ac1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:36:07.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:07.790+0000 7fd95f7fe640 1 --2- 172.21.15.103:0/3053431762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd960150b70 0x7fd9600ac1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:36:08.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:08.591+0000 7fd95f7fe640 1 -- 172.21.15.103:0/3053431762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd960150b70 msgr2=0x7fd9600ac1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:36:08.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:08.591+0000 7fd95f7fe640 1 --2- 172.21.15.103:0/3053431762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd960150b70 0x7fd9600ac1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:36:10.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.188+0000 7fd95d7fa640 1 -- 172.21.15.103:0/3053431762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd960150b70 msgr2=0x7fd9600ac1a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:36:10.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.188+0000 7fd95d7fa640 1 --2- 172.21.15.103:0/3053431762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd960150b70 0x7fd9600ac1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:10.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.188+0000 7fd95d7fa640 1 -- 172.21.15.103:0/3053431762 >> v1:172.21.15.154:6789/0 conn(0x7fd9600ac6e0 legacy=0x7fd9600c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:10.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.188+0000 7fd95d7fa640 1 -- 172.21.15.103:0/3053431762 >> v1:172.21.15.103:6789/0 conn(0x7fd960067d20 legacy=0x7fd9600c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:10.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.188+0000 7fd95d7fa640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 0x7fd94c005b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:10.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.188+0000 7fd95d7fa640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 0x7fd94c008700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:10.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.188+0000 7fd95d7fa640 1 -- 172.21.15.103:0/3053431762 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fd9600a82c0 con 0x7fd94c003710 2024-09-10T08:36:10.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.188+0000 7fd95d7fa640 1 -- 172.21.15.103:0/3053431762 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd94c008dc0 con 0x7fd94c006280 2024-09-10T08:36:10.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.188+0000 7fd95f7fe640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 0x7fd94c005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:10.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.188+0000 7fd95effd640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 0x7fd94c008700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:10.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.188+0000 7fd95f7fe640 1 -- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 msgr2=0x7fd94c005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:36:10.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.188+0000 7fd95f7fe640 1 -- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 msgr2=0x7fd94c005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:36:10.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.188+0000 7fd95f7fe640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 0x7fd94c005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:36:10.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.188+0000 7fd95f7fe640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 0x7fd94c005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:36:10.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.188+0000 7fd95effd640 1 -- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 msgr2=0x7fd94c008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:36:10.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.188+0000 7fd95effd640 1 -- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 msgr2=0x7fd94c008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:36:10.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.188+0000 7fd95effd640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 0x7fd94c008700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:36:10.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.188+0000 7fd95effd640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 0x7fd94c008700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:36:10.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.389+0000 7fd95f7fe640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 0x7fd94c005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:10.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.389+0000 7fd95effd640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 0x7fd94c008700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:10.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.389+0000 7fd95f7fe640 1 -- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 msgr2=0x7fd94c005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:36:10.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.389+0000 7fd95f7fe640 1 -- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 msgr2=0x7fd94c005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:36:10.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.389+0000 7fd95f7fe640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 0x7fd94c005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:36:10.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.389+0000 7fd95f7fe640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 0x7fd94c005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:36:10.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.389+0000 7fd95effd640 1 -- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 msgr2=0x7fd94c008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:36:10.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.389+0000 7fd95effd640 1 -- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 msgr2=0x7fd94c008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:36:10.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.389+0000 7fd95effd640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 0x7fd94c008700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:36:10.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.389+0000 7fd95effd640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 0x7fd94c008700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:36:10.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.790+0000 7fd95f7fe640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 0x7fd94c005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:10.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.790+0000 7fd95effd640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 0x7fd94c008700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:10.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.790+0000 7fd95f7fe640 1 -- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 msgr2=0x7fd94c005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:36:10.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.790+0000 7fd95f7fe640 1 -- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 msgr2=0x7fd94c005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:36:10.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.790+0000 7fd95f7fe640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 0x7fd94c005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:36:10.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.790+0000 7fd95f7fe640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 0x7fd94c005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:36:10.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.790+0000 7fd95effd640 1 -- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 msgr2=0x7fd94c008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:36:10.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.790+0000 7fd95effd640 1 -- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 msgr2=0x7fd94c008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:36:10.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.790+0000 7fd95effd640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 0x7fd94c008700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:36:10.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:10.790+0000 7fd95effd640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 0x7fd94c008700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:36:11.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:11.591+0000 7fd95f7fe640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 0x7fd94c005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:11.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:11.591+0000 7fd95effd640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 0x7fd94c008700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:11.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:11.591+0000 7fd95f7fe640 1 -- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 msgr2=0x7fd94c005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:36:11.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:11.591+0000 7fd95f7fe640 1 -- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 msgr2=0x7fd94c005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:36:11.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:11.591+0000 7fd95f7fe640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 0x7fd94c005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:36:11.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:11.591+0000 7fd95effd640 1 -- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 msgr2=0x7fd94c008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:36:11.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:11.591+0000 7fd95effd640 1 -- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 msgr2=0x7fd94c008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:36:11.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:11.591+0000 7fd95f7fe640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 0x7fd94c005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:36:11.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:11.591+0000 7fd95effd640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 0x7fd94c008700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:36:11.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:11.591+0000 7fd95effd640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 0x7fd94c008700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:36:13.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.188+0000 7fd95d7fa640 1 -- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 msgr2=0x7fd94c008700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:36:13.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.188+0000 7fd95d7fa640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.154:3300/0 conn(0x7fd94c006280 0x7fd94c008700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.188+0000 7fd95d7fa640 1 -- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 msgr2=0x7fd94c005b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:36:13.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.188+0000 7fd95d7fa640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c003710 0x7fd94c005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.188+0000 7fd95ffff640 1 -- 172.21.15.103:0/3053431762 reap_dead start 2024-09-10T08:36:13.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.188+0000 7fd95d7fa640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c0066d0 0x7fd94c003af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.188+0000 7fd95d7fa640 1 --2- 172.21.15.103:0/3053431762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd94c004030 0x7fd94c0044e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.188+0000 7fd95d7fa640 1 -- 172.21.15.103:0/3053431762 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9600ab610 con 0x7fd9600ac6e0 2024-09-10T08:36:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.188+0000 7fd95d7fa640 1 -- 172.21.15.103:0/3053431762 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fd9600a82c0 con 0x7fd94c0066d0 2024-09-10T08:36:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.188+0000 7fd95d7fa640 1 -- 172.21.15.103:0/3053431762 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd94c008dc0 con 0x7fd94c004030 2024-09-10T08:36:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.188+0000 7fd95ffff640 1 -- 172.21.15.103:0/3053431762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd94c004030 msgr2=0x7fd94c0044e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:36:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.188+0000 7fd95ffff640 1 --2- 172.21.15.103:0/3053431762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd94c004030 0x7fd94c0044e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:36:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.188+0000 7fd95effd640 1 --2- 172.21.15.103:0/3053431762 >> v2:172.21.15.103:3300/0 conn(0x7fd94c0066d0 0x7fd94c003af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.188+0000 7fd95effd640 1 -- 172.21.15.103:0/3053431762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd94c004030 msgr2=0x7fd94c0044e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:36:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.188+0000 7fd95effd640 1 --2- 172.21.15.103:0/3053431762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd94c004030 0x7fd94c0044e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.188+0000 7fd95effd640 1 -- 172.21.15.103:0/3053431762 >> v1:172.21.15.154:6789/0 conn(0x7fd9600ac6e0 legacy=0x7fd94c00b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.188+0000 7fd95effd640 1 -- 172.21.15.103:0/3053431762 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94c005bf0 con 0x7fd94c0066d0 2024-09-10T08:36:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.189+0000 7fd95effd640 1 --2- 172.21.15.103:0/3053431762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd94c0066d0 0x7fd94c003af0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd954005d10 tx=0x7fd95402ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eae7e05c8ef3983 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:13.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.189+0000 7fd95e7fc640 1 -- 172.21.15.103:0/3053431762 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd954031070 con 0x7fd94c0066d0 2024-09-10T08:36:13.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.189+0000 7fd95e7fc640 1 -- 172.21.15.103:0/3053431762 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd95402b800 con 0x7fd94c0066d0 2024-09-10T08:36:13.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.189+0000 7fd95e7fc640 1 -- 172.21.15.103:0/3053431762 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95402bbd0 con 0x7fd94c0066d0 2024-09-10T08:36:13.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.190+0000 7fd965cac640 1 -- 172.21.15.103:0/3053431762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd94c0066d0 msgr2=0x7fd94c003af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:13.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.190+0000 7fd965cac640 1 --2- 172.21.15.103:0/3053431762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd94c0066d0 0x7fd94c003af0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd954005d10 tx=0x7fd95402ad00 comp rx=0 tx=0).stop 2024-09-10T08:36:13.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.190+0000 7fd965cac640 1 -- 172.21.15.103:0/3053431762 shutdown_connections 2024-09-10T08:36:13.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.190+0000 7fd965cac640 1 --2- 172.21.15.103:0/3053431762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd94c004030 0x7fd94c0044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.190+0000 7fd965cac640 1 --2- 172.21.15.103:0/3053431762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd94c0066d0 0x7fd94c003af0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.190+0000 7fd965cac640 1 -- 172.21.15.103:0/3053431762 >> 172.21.15.103:0/3053431762 conn(0x7fd9600c8430 msgr2=0x7fd9600c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:13.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.190+0000 7fd965cac640 1 -- 172.21.15.103:0/3053431762 shutdown_connections 2024-09-10T08:36:13.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.190+0000 7fd965cac640 1 -- 172.21.15.103:0/3053431762 wait complete. 2024-09-10T08:36:13.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.192+0000 7fd965cac640 1 Processor -- start 2024-09-10T08:36:13.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.192+0000 7fd965cac640 1 -- start start 2024-09-10T08:36:13.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.192+0000 7fd965cac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd94c004030 0x7fd9600c1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.192+0000 7fd965cac640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd94c0066d0 0x7fd9601555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.192+0000 7fd965cac640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9600ac6e0 0x7fd96014cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.192+0000 7fd965cac640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd9600c2e30 con 0x7fd9600ac6e0 2024-09-10T08:36:13.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.192+0000 7fd965cac640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd9601542f0 con 0x7fd94c004030 2024-09-10T08:36:13.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.192+0000 7fd965cac640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd960150f50 con 0x7fd94c0066d0 2024-09-10T08:36:13.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.193+0000 7fd95effd640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd94c0066d0 msgr2=0x7fd9601555b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:36:13.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.193+0000 7fd95effd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd94c0066d0 0x7fd9601555b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:36:13.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.193+0000 7fd95ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9600ac6e0 0x7fd96014cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:13.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.193+0000 7fd95f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd94c004030 0x7fd9600c1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:13.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.193+0000 7fd95f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd94c004030 0x7fd9600c1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:41382/0 (socket says 172.21.15.103:41382) 2024-09-10T08:36:13.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.193+0000 7fd95f7fe640 1 -- 172.21.15.103:0/862811062 learned_addr learned my addr 172.21.15.103:0/862811062 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:13.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.193+0000 7fd95ffff640 1 -- 172.21.15.103:0/862811062 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd94c0066d0 msgr2=0x7fd9601555b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:36:13.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.193+0000 7fd95ffff640 1 --2- 172.21.15.103:0/862811062 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd94c0066d0 0x7fd9601555b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.193+0000 7fd95ffff640 1 -- 172.21.15.103:0/862811062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd94c004030 msgr2=0x7fd9600c1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:13.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.193+0000 7fd95ffff640 1 --2- 172.21.15.103:0/862811062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd94c004030 0x7fd9600c1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.193+0000 7fd95ffff640 1 -- 172.21.15.103:0/862811062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd96014d740 con 0x7fd9600ac6e0 2024-09-10T08:36:13.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.193+0000 7fd95ffff640 1 --2- 172.21.15.103:0/862811062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9600ac6e0 0x7fd96014cc70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd9600c9260 tx=0x7fd95800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:13.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.193+0000 7fd947fff640 1 -- 172.21.15.103:0/862811062 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958017070 con 0x7fd9600ac6e0 2024-09-10T08:36:13.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.193+0000 7fd947fff640 1 -- 172.21.15.103:0/862811062 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd958005d60 con 0x7fd9600ac6e0 2024-09-10T08:36:13.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.193+0000 7fd947fff640 1 -- 172.21.15.103:0/862811062 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95800a7f0 con 0x7fd9600ac6e0 2024-09-10T08:36:13.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.193+0000 7fd965cac640 1 -- 172.21.15.103:0/862811062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9601545d0 con 0x7fd9600ac6e0 2024-09-10T08:36:13.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.193+0000 7fd965cac640 1 -- 172.21.15.103:0/862811062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9600c2010 con 0x7fd9600ac6e0 2024-09-10T08:36:13.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.194+0000 7fd965cac640 1 -- 172.21.15.103:0/862811062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd960154c90 con 0x7fd9600ac6e0 2024-09-10T08:36:13.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.195+0000 7fd947fff640 1 -- 172.21.15.103:0/862811062 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd95800a990 con 0x7fd9600ac6e0 2024-09-10T08:36:13.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.195+0000 7fd947fff640 1 --2- 172.21.15.103:0/862811062 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd94c06d770 0x7fd94c06fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.195+0000 7fd947fff640 1 -- 172.21.15.103:0/862811062 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fd95808a240 con 0x7fd9600ac6e0 2024-09-10T08:36:13.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.195+0000 7fd95f7fe640 1 --2- 172.21.15.103:0/862811062 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd94c06d770 0x7fd94c06fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:13.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.196+0000 7fd95f7fe640 1 --2- 172.21.15.103:0/862811062 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd94c06d770 0x7fd94c06fc30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd950005010 tx=0x7fd95000d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:13.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.200+0000 7fd947fff640 1 -- 172.21.15.103:0/862811062 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd960154c90 con 0x7fd9600ac6e0 2024-09-10T08:36:13.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.467+0000 7fd965cac640 1 -- 172.21.15.103:0/862811062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd9600abc50 con 0x7fd9600ac6e0 2024-09-10T08:36:13.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.467+0000 7fd947fff640 1 -- 172.21.15.103:0/862811062 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7fd958058290 con 0x7fd9600ac6e0 2024-09-10T08:36:13.467 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":62,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:36:13.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.470+0000 7fd965cac640 1 -- 172.21.15.103:0/862811062 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd94c06d770 msgr2=0x7fd94c06fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:13.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.470+0000 7fd965cac640 1 --2- 172.21.15.103:0/862811062 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd94c06d770 0x7fd94c06fc30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd950005010 tx=0x7fd95000d040 comp rx=0 tx=0).stop 2024-09-10T08:36:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.470+0000 7fd965cac640 1 -- 172.21.15.103:0/862811062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9600ac6e0 msgr2=0x7fd96014cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.470+0000 7fd965cac640 1 --2- 172.21.15.103:0/862811062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9600ac6e0 0x7fd96014cc70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd9600c9260 tx=0x7fd95800cb90 comp rx=0 tx=0).stop 2024-09-10T08:36:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.470+0000 7fd965cac640 1 -- 172.21.15.103:0/862811062 shutdown_connections 2024-09-10T08:36:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.470+0000 7fd965cac640 1 --2- 172.21.15.103:0/862811062 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd94c06d770 0x7fd94c06fc30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.470+0000 7fd965cac640 1 --2- 172.21.15.103:0/862811062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9600ac6e0 0x7fd96014cc70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.470+0000 7fd965cac640 1 --2- 172.21.15.103:0/862811062 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd94c0066d0 0x7fd9601555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.470+0000 7fd965cac640 1 --2- 172.21.15.103:0/862811062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd94c004030 0x7fd9600c1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.470+0000 7fd965cac640 1 -- 172.21.15.103:0/862811062 >> 172.21.15.103:0/862811062 conn(0x7fd9600c8430 msgr2=0x7fd9600c6810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.470+0000 7fd965cac640 1 -- 172.21.15.103:0/862811062 shutdown_connections 2024-09-10T08:36:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.470+0000 7fd965cac640 1 -- 172.21.15.103:0/862811062 wait complete. 2024-09-10T08:36:13.482 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-10T08:36:13.482 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-10T08:36:13.483 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:36:13.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.596+0000 7fd1b7f52640 1 Processor -- start 2024-09-10T08:36:13.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.597+0000 7fd1b7f52640 1 -- start start 2024-09-10T08:36:13.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.597+0000 7fd1b7f52640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd1b0150480 0x7fd1b00c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.597+0000 7fd1b7f52640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd1b006c650 0x7fd1b00c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.597+0000 7fd1b7f52640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1b015a7c0 con 0x7fd1b00c9c80 2024-09-10T08:36:13.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.597+0000 7fd1b7f52640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fd1b006c240 con 0x7fd1b006c650 2024-09-10T08:36:13.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.597+0000 7fd1b7f52640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd1b015a330 con 0x7fd1b0150480 2024-09-10T08:36:13.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.598+0000 7fd1b54ed640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd1b006c650 0x7fd1b00c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:13.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.598+0000 7fd1b54ed640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd1b006c650 0x7fd1b00c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40816/0 (socket says 172.21.15.103:40816) 2024-09-10T08:36:13.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.598+0000 7fd1b54ed640 1 -- 172.21.15.103:0/2974732091 learned_addr learned my addr 172.21.15.103:0/2974732091 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:13.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.598+0000 7fd1b5cee640 1 --2- 172.21.15.103:0/2974732091 >> v2:172.21.15.154:3300/0 conn(0x7fd1b0150480 0x7fd1b00c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:13.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.598+0000 7fd1b54ed640 1 -- 172.21.15.103:0/2974732091 >> v2:172.21.15.154:3300/0 conn(0x7fd1b0150480 msgr2=0x7fd1b00c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:13.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.598+0000 7fd1b54ed640 1 --2- 172.21.15.103:0/2974732091 >> v2:172.21.15.154:3300/0 conn(0x7fd1b0150480 0x7fd1b00c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.598+0000 7fd1b54ed640 1 -- 172.21.15.103:0/2974732091 >> v1:172.21.15.154:6789/0 conn(0x7fd1b00c9c80 legacy=0x7fd1b00ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:13.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.598+0000 7fd1b54ed640 1 -- 172.21.15.103:0/2974732091 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b0159a00 con 0x7fd1b006c650 2024-09-10T08:36:13.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.599+0000 7fd1b54ed640 1 --2- 172.21.15.103:0/2974732091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b006c650 0x7fd1b00c7fd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd1b00ccac0 tx=0x7fd1a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4213b2df2e76170 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:13.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.599+0000 7fd1b4cec640 1 -- 172.21.15.103:0/2974732091 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0037070 con 0x7fd1b006c650 2024-09-10T08:36:13.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.599+0000 7fd1b4cec640 1 -- 172.21.15.103:0/2974732091 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1a0032440 con 0x7fd1b006c650 2024-09-10T08:36:13.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.599+0000 7fd1b4cec640 1 -- 172.21.15.103:0/2974732091 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0032810 con 0x7fd1b006c650 2024-09-10T08:36:13.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.600+0000 7fd1b7f52640 1 -- 172.21.15.103:0/2974732091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b006c650 msgr2=0x7fd1b00c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:13.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.600+0000 7fd1b7f52640 1 --2- 172.21.15.103:0/2974732091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b006c650 0x7fd1b00c7fd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd1b00ccac0 tx=0x7fd1a002a270 comp rx=0 tx=0).stop 2024-09-10T08:36:13.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.600+0000 7fd1b7f52640 1 -- 172.21.15.103:0/2974732091 shutdown_connections 2024-09-10T08:36:13.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.600+0000 7fd1b7f52640 1 --2- 172.21.15.103:0/2974732091 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b006c650 0x7fd1b00c7fd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.600+0000 7fd1b7f52640 1 --2- 172.21.15.103:0/2974732091 >> v2:172.21.15.154:3300/0 conn(0x7fd1b0150480 0x7fd1b00c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.600+0000 7fd1b7f52640 1 -- 172.21.15.103:0/2974732091 >> 172.21.15.103:0/2974732091 conn(0x7fd1b0068030 msgr2=0x7fd1b0073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:13.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.600+0000 7fd1b7f52640 1 -- 172.21.15.103:0/2974732091 shutdown_connections 2024-09-10T08:36:13.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.600+0000 7fd1b7f52640 1 -- 172.21.15.103:0/2974732091 wait complete. 2024-09-10T08:36:13.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.601+0000 7fd1b7f52640 1 Processor -- start 2024-09-10T08:36:13.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.601+0000 7fd1b7f52640 1 -- start start 2024-09-10T08:36:13.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.602+0000 7fd1b7f52640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b006c650 0x7fd1b00cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.602+0000 7fd1b7f52640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1b00c9c80 0x7fd1b0151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.602+0000 7fd1b7f52640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1b0150480 0x7fd1b0151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.602+0000 7fd1b7f52640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b006d270 con 0x7fd1b006c650 2024-09-10T08:36:13.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.602+0000 7fd1b7f52640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b0159fc0 con 0x7fd1b0150480 2024-09-10T08:36:13.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.602+0000 7fd1b7f52640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd1b0156270 con 0x7fd1b00c9c80 2024-09-10T08:36:13.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.602+0000 7fd1b54ed640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1b00c9c80 msgr2=0x7fd1b0151a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:36:13.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.602+0000 7fd1b54ed640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1b00c9c80 0x7fd1b0151a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:36:13.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.602+0000 7fd1b5cee640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b006c650 0x7fd1b00cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:13.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.602+0000 7fd1b5cee640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b006c650 0x7fd1b00cbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40830/0 (socket says 172.21.15.103:40830) 2024-09-10T08:36:13.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.602+0000 7fd1b5cee640 1 -- 172.21.15.103:0/3859337215 learned_addr learned my addr 172.21.15.103:0/3859337215 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:13.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.602+0000 7fd1b64ef640 1 --2- 172.21.15.103:0/3859337215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1b0150480 0x7fd1b0151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:13.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.602+0000 7fd1b5cee640 1 -- 172.21.15.103:0/3859337215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1b00c9c80 msgr2=0x7fd1b0151a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:36:13.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.602+0000 7fd1b5cee640 1 --2- 172.21.15.103:0/3859337215 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1b00c9c80 0x7fd1b0151a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.602+0000 7fd1b5cee640 1 -- 172.21.15.103:0/3859337215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1b0150480 msgr2=0x7fd1b0151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:13.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.602+0000 7fd1b5cee640 1 --2- 172.21.15.103:0/3859337215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1b0150480 0x7fd1b0151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.602+0000 7fd1b5cee640 1 -- 172.21.15.103:0/3859337215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b014f4e0 con 0x7fd1b006c650 2024-09-10T08:36:13.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.602+0000 7fd1b5cee640 1 --2- 172.21.15.103:0/3859337215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b006c650 0x7fd1b00cbad0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00e9b0 tx=0x7fd1ac00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:13.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.603+0000 7fd1a67fc640 1 -- 172.21.15.103:0/3859337215 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac017070 con 0x7fd1b006c650 2024-09-10T08:36:13.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.603+0000 7fd1a67fc640 1 -- 172.21.15.103:0/3859337215 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1ac00c9a0 con 0x7fd1b006c650 2024-09-10T08:36:13.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.603+0000 7fd1a67fc640 1 -- 172.21.15.103:0/3859337215 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac00cd90 con 0x7fd1b006c650 2024-09-10T08:36:13.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.603+0000 7fd1b7f52640 1 -- 172.21.15.103:0/3859337215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1b01e1fc0 con 0x7fd1b006c650 2024-09-10T08:36:13.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.603+0000 7fd1b7f52640 1 -- 172.21.15.103:0/3859337215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1b014f7c0 con 0x7fd1b006c650 2024-09-10T08:36:13.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.603+0000 7fd1b7f52640 1 --2- 172.21.15.103:0/3859337215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b0152a40 0x7fd1b0152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.603+0000 7fd1b7f52640 1 -- 172.21.15.103:0/3859337215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b01ef240 con 0x7fd1b0152a40 2024-09-10T08:36:13.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.604+0000 7fd1b54ed640 1 --2- 172.21.15.103:0/3859337215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b0152a40 0x7fd1b0152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:13.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.604+0000 7fd1b54ed640 1 -- 172.21.15.103:0/3859337215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd1b014f290 con 0x7fd1b0152a40 2024-09-10T08:36:13.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.604+0000 7fd1a67fc640 1 -- 172.21.15.103:0/3859337215 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd1ac01a070 con 0x7fd1b006c650 2024-09-10T08:36:13.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.604+0000 7fd1b54ed640 1 --2- 172.21.15.103:0/3859337215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b0152a40 0x7fd1b0152e20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd1b00cc9c0 tx=0x7fd1a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:13.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.605+0000 7fd1a67fc640 1 --2- 172.21.15.103:0/3859337215 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd19406be10 0x7fd19406e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.605+0000 7fd1a67fc640 1 -- 172.21.15.103:0/3859337215 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fd1ac08b130 con 0x7fd1b006c650 2024-09-10T08:36:13.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.605+0000 7fd1b64ef640 1 --2- 172.21.15.103:0/3859337215 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd19406be10 0x7fd19406e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:13.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.605+0000 7fd1a67fc640 1 -- 172.21.15.103:0/3859337215 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0041070 con 0x7fd1b0152a40 2024-09-10T08:36:13.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.605+0000 7fd1a67fc640 1 -- 172.21.15.103:0/3859337215 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd1a0032e00 con 0x7fd1b0152a40 2024-09-10T08:36:13.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.605+0000 7fd1a67fc640 1 -- 172.21.15.103:0/3859337215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b0152a40 msgr2=0x7fd1b0152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:13.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.605+0000 7fd1a67fc640 1 --2- 172.21.15.103:0/3859337215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b0152a40 0x7fd1b0152e20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd1b00cc9c0 tx=0x7fd1a00046c0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.605+0000 7fd1a67fc640 1 -- 172.21.15.103:0/3859337215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b0152a40 msgr2=0x7fd1b0152e20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:36:13.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.605+0000 7fd1a67fc640 1 --2- 172.21.15.103:0/3859337215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b0152a40 0x7fd1b0152e20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.605+0000 7fd1b64ef640 1 --2- 172.21.15.103:0/3859337215 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd19406be10 0x7fd19406e2d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80012e0 tx=0x7fd1a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:13.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.612+0000 7fd1b7f52640 1 --2- 172.21.15.103:0/3859337215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b0153360 0x7fd1b01e2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.612+0000 7fd1b7f52640 1 -- 172.21.15.103:0/3859337215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b01e2610 con 0x7fd1b0153360 2024-09-10T08:36:13.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.612+0000 7fd1b54ed640 1 --2- 172.21.15.103:0/3859337215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b0153360 0x7fd1b01e2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:13.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.612+0000 7fd1b54ed640 1 -- 172.21.15.103:0/3859337215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd1b00ca0f0 con 0x7fd1b0153360 2024-09-10T08:36:13.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.613+0000 7fd1b54ed640 1 --2- 172.21.15.103:0/3859337215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b0153360 0x7fd1b01e2b10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0000c00 tx=0x7fd1a0009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:13.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.613+0000 7fd1a67fc640 1 -- 172.21.15.103:0/3859337215 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0037040 con 0x7fd1b0153360 2024-09-10T08:36:13.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.613+0000 7fd1a67fc640 1 -- 172.21.15.103:0/3859337215 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5045 (secure 0 0 0) 0x7fd1a0003e40 con 0x7fd1b0153360 2024-09-10T08:36:13.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.613+0000 7fd1a67fc640 1 -- 172.21.15.103:0/3859337215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b0153360 msgr2=0x7fd1b01e2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:13.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.613+0000 7fd1a67fc640 1 --2- 172.21.15.103:0/3859337215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b0153360 0x7fd1b01e2b10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0000c00 tx=0x7fd1a0009240 comp rx=0 tx=0).stop 2024-09-10T08:36:13.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.613+0000 7fd1a67fc640 1 -- 172.21.15.103:0/3859337215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b0153360 msgr2=0x7fd1b01e2b10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:36:13.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.613+0000 7fd1a67fc640 1 --2- 172.21.15.103:0/3859337215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b0153360 0x7fd1b01e2b10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.618 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:36:13.618 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:36:13.618 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:36:13.618 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:36:13.618 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 62, 2024-09-10T08:36:13.618 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 143681, 2024-09-10T08:36:13.619 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:36:13.619 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:36:13.619 INFO:teuthology.orchestra.run.smithi103.stdout: 1 2024-09-10T08:36:13.619 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:13.619 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 1, 2024-09-10T08:36:13.619 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:36:13.619 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:36:13.619 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:36:13.619 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:13.619 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:13.619 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:13.620 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:13.620 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:13.620 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:13.620 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:13.620 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:13.620 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:13.620 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:13.621 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:13.621 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:13.621 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:36:13.621 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:36:13.621 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:13.621 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:13.621 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:13.621 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:13.621 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:13.621 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:13.621 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:13.622 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:13.622 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:13.622 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:13.622 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:13.622 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:13.622 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.622 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:36:13.622 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:36:13.622 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:36:13.622 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:36:13.622 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:36:13.623 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:36:13.623 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:36:13.623 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:36:13.623 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:36:13.623 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:36:13.623 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:36:13.623 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:36:13.623 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:36:13.623 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:36:13.623 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:36:13.623 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:36:13.624 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:36:13.624 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:13.624 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:13.624 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:13.624 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:13.624 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:13.624 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:13.624 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:13.624 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:13.624 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:13.625 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:13.625 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:13.625 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:13.625 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:36:13.625 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.625 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:36:13.625 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.625 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:36:13.625 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:36:13.625 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:13.626 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:13.626 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.628 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:13.628 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:36:13.628 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:13.628 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.629 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.629 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:13.629 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:36:13.629 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:13.629 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:13.629 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:13.629 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.629 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:36:13.629 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:36:13.629 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:13.629 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:13.630 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:13.630 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.630 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.630 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:36:13.630 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:36:13.630 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:13.630 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:13.630 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.630 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:13.630 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:36:13.630 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:13.631 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.631 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.631 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:13.631 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:36:13.631 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:13.631 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:13.631 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:13.631 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.631 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:36:13.631 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:36:13.632 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:13.632 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:13.632 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:13.632 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.632 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.632 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:36:13.632 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:36:13.632 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:13.632 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:13.632 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.633 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:13.633 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:36:13.633 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:13.633 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.633 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.633 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:13.633 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:36:13.633 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:13.633 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:13.633 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:13.633 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.634 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:36:13.634 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:36:13.634 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:13.634 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:13.634 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:13.634 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:13.634 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:13.634 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.634 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:36:13.634 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:36:13.634 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.634 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:13.635 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:13.635 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:36:13.635 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:13.635 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:13.635 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:36:13.635 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.635 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:13.635 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:13.635 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:36:13.635 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:13.635 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:13.635 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:36:13.635 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.635 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:13.636 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:13.636 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:36:13.636 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:13.636 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:13.636 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:36:13.636 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.636 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:13.636 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:13.636 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:36:13.636 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:13.636 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:13.636 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:36:13.637 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.637 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:13.637 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:13.637 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:36:13.637 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:13.637 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:13.637 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.637 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:36:13.637 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:36:13.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.613+0000 7fd1b7f52640 1 -- 172.21.15.103:0/3859337215 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd19406be10 msgr2=0x7fd19406e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:13.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.613+0000 7fd1b7f52640 1 --2- 172.21.15.103:0/3859337215 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd19406be10 0x7fd19406e2d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80012e0 tx=0x7fd1a8009040 comp rx=0 tx=0).stop 2024-09-10T08:36:13.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.613+0000 7fd1b7f52640 1 -- 172.21.15.103:0/3859337215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b006c650 msgr2=0x7fd1b00cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:13.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.613+0000 7fd1b7f52640 1 --2- 172.21.15.103:0/3859337215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1b006c650 0x7fd1b00cbad0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00e9b0 tx=0x7fd1ac00ee70 comp rx=0 tx=0).stop 2024-09-10T08:36:13.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.613+0000 7fd1b64ef640 1 -- 172.21.15.103:0/3859337215 reap_dead start 2024-09-10T08:36:13.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.613+0000 7fd1b64ef640 1 -- 172.21.15.103:0/3859337215 reap_dead start 2024-09-10T08:36:13.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.614+0000 7fd1b7f52640 1 -- 172.21.15.103:0/3859337215 shutdown_connections 2024-09-10T08:36:13.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.614+0000 7fd1b7f52640 1 -- 172.21.15.103:0/3859337215 >> 172.21.15.103:0/3859337215 conn(0x7fd1b0068030 msgr2=0x7fd1b0155340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:13.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.614+0000 7fd1b7f52640 1 -- 172.21.15.103:0/3859337215 shutdown_connections 2024-09-10T08:36:13.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.614+0000 7fd1b7f52640 1 -- 172.21.15.103:0/3859337215 wait complete. 2024-09-10T08:36:13.640 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:36:13.640 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-10T08:36:13.641 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:36:13.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.759+0000 7f0285dc0640 1 Processor -- start 2024-09-10T08:36:13.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.759+0000 7f0285dc0640 1 -- start start 2024-09-10T08:36:13.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f0285dc0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02800c2b80 0x7f0280156a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f0285dc0640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0280156fc0 con 0x7f028006da50 2024-09-10T08:36:13.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f0285dc0640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0280074070 con 0x7f028006bbe0 2024-09-10T08:36:13.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f0285dc0640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f028006c7c0 con 0x7f02800c2b80 2024-09-10T08:36:13.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f027ffff640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02800c2b80 msgr2=0x7f0280156a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:36:13.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f027ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02800c2b80 0x7f0280156a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:36:13.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f027f7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f028006da50 0x7f02801537d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:57086/0 (socket says 172.21.15.103:57086) 2024-09-10T08:36:13.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f027f7fe640 1 -- 172.21.15.103:0/2898245743 learned_addr learned my addr 172.21.15.103:0/2898245743 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:36:13.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f027e7fc640 1 -- 172.21.15.103:0/2898245743 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3911459758 0 0) 0x7f0280156fc0 con 0x7f028006da50 2024-09-10T08:36:13.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f027e7fc640 1 -- 172.21.15.103:0/2898245743 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0268003520 con 0x7f028006da50 2024-09-10T08:36:13.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f027e7fc640 1 -- 172.21.15.103:0/2898245743 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 647452375 0 0) 0x7f0280074070 con 0x7f028006bbe0 2024-09-10T08:36:13.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f027e7fc640 1 -- 172.21.15.103:0/2898245743 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0280156fc0 con 0x7f028006bbe0 2024-09-10T08:36:13.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f027e7fc640 1 -- 172.21.15.103:0/2898245743 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1140103438 0 0) 0x7f0268003520 con 0x7f028006da50 2024-09-10T08:36:13.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f027e7fc640 1 -- 172.21.15.103:0/2898245743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02800c2b80 msgr2=0x7f0280156a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:36:13.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f027e7fc640 1 --2- 172.21.15.103:0/2898245743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02800c2b80 0x7f0280156a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f027e7fc640 1 -- 172.21.15.103:0/2898245743 >> v1:172.21.15.154:6789/0 conn(0x7f028006bbe0 legacy=0x7f0280156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:13.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f027e7fc640 1 -- 172.21.15.103:0/2898245743 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f028015a390 con 0x7f028006da50 2024-09-10T08:36:13.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f027e7fc640 1 -- 172.21.15.103:0/2898245743 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f0270001670 con 0x7f028006da50 2024-09-10T08:36:13.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f027e7fc640 1 -- 172.21.15.103:0/2898245743 >> v1:172.21.15.103:6789/0 conn(0x7f028006da50 legacy=0x7f02801537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:13.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f027e7fc640 1 --2- 172.21.15.103:0/2898245743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0268004bd0 0x7f0268004fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f027e7fc640 1 --2- 172.21.15.103:0/2898245743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02680037a0 0x7f0268003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f027e7fc640 1 --2- 172.21.15.103:0/2898245743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02800c2b80 0x7f026800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f027e7fc640 1 -- 172.21.15.103:0/2898245743 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f028006c7c0 con 0x7f02680037a0 2024-09-10T08:36:13.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f027e7fc640 1 -- 172.21.15.103:0/2898245743 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0268004510 con 0x7f0268004bd0 2024-09-10T08:36:13.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.760+0000 7f027e7fc640 1 -- 172.21.15.103:0/2898245743 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f026800bf00 con 0x7f02800c2b80 2024-09-10T08:36:13.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.761+0000 7f027ffff640 1 -- 172.21.15.103:0/2898245743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02800c2b80 msgr2=0x7f026800b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:36:13.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.761+0000 7f027ffff640 1 --2- 172.21.15.103:0/2898245743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02800c2b80 0x7f026800b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:36:13.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.761+0000 7f027f7fe640 1 --2- 172.21.15.103:0/2898245743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0268004bd0 0x7f0268004fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:13.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.761+0000 7f027effd640 1 --2- 172.21.15.103:0/2898245743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02680037a0 0x7f0268003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:13.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.761+0000 7f027effd640 1 -- 172.21.15.103:0/2898245743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02800c2b80 msgr2=0x7f026800b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:36:13.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.761+0000 7f027effd640 1 --2- 172.21.15.103:0/2898245743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02800c2b80 0x7f026800b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.761+0000 7f027effd640 1 -- 172.21.15.103:0/2898245743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0268004bd0 msgr2=0x7f0268004fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:13.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.761+0000 7f027effd640 1 --2- 172.21.15.103:0/2898245743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0268004bd0 0x7f0268004fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.761+0000 7f027effd640 1 -- 172.21.15.103:0/2898245743 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0268003520 con 0x7f02680037a0 2024-09-10T08:36:13.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.761+0000 7f027f7fe640 1 --2- 172.21.15.103:0/2898245743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0268004bd0 0x7f0268004fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:36:13.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.762+0000 7f027effd640 1 --2- 172.21.15.103:0/2898245743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02680037a0 0x7f0268003c20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0274001870 tx=0x7f0268005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=820e911e8c7adf44 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:13.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.762+0000 7f027e7fc640 1 -- 172.21.15.103:0/2898245743 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02740014c0 con 0x7f02680037a0 2024-09-10T08:36:13.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.762+0000 7f027e7fc640 1 -- 172.21.15.103:0/2898245743 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f027402aca0 con 0x7f02680037a0 2024-09-10T08:36:13.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.762+0000 7f027e7fc640 1 -- 172.21.15.103:0/2898245743 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02740052f0 con 0x7f02680037a0 2024-09-10T08:36:13.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.762+0000 7f0285dc0640 1 -- 172.21.15.103:0/2898245743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02680037a0 msgr2=0x7f0268003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:13.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.762+0000 7f0285dc0640 1 --2- 172.21.15.103:0/2898245743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02680037a0 0x7f0268003c20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0274001870 tx=0x7f0268005830 comp rx=0 tx=0).stop 2024-09-10T08:36:13.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.762+0000 7f027ffff640 1 -- 172.21.15.103:0/2898245743 reap_dead start 2024-09-10T08:36:13.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.762+0000 7f0285dc0640 1 -- 172.21.15.103:0/2898245743 shutdown_connections 2024-09-10T08:36:13.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.762+0000 7f0285dc0640 1 -- 172.21.15.103:0/2898245743 >> 172.21.15.103:0/2898245743 conn(0x7f028006ccf0 msgr2=0x7f028006d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:13.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.762+0000 7f0285dc0640 1 -- 172.21.15.103:0/2898245743 shutdown_connections 2024-09-10T08:36:13.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.762+0000 7f0285dc0640 1 -- 172.21.15.103:0/2898245743 wait complete. 2024-09-10T08:36:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.763+0000 7f0285dc0640 1 Processor -- start 2024-09-10T08:36:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.764+0000 7f0285dc0640 1 -- start start 2024-09-10T08:36:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.764+0000 7f0285dc0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02680037a0 0x7f02801e0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.764+0000 7f0285dc0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f028014ff00 0x7f0280157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.764+0000 7f0285dc0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f028014a9b0 0x7f028014ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.764+0000 7f0285dc0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0280154060 con 0x7f028014a9b0 2024-09-10T08:36:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.764+0000 7f0285dc0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0280153ee0 con 0x7f02680037a0 2024-09-10T08:36:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.764+0000 7f0285dc0640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0280073c90 con 0x7f028014ff00 2024-09-10T08:36:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.764+0000 7f027effd640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f028014ff00 msgr2=0x7f0280157f10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:36:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.764+0000 7f027effd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f028014ff00 0x7f0280157f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:36:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.765+0000 7f027ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f028014a9b0 0x7f028014ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.765+0000 7f027f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02680037a0 0x7f02801e0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.765+0000 7f027f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02680037a0 0x7f02801e0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:41418/0 (socket says 172.21.15.103:41418) 2024-09-10T08:36:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.765+0000 7f027f7fe640 1 -- 172.21.15.103:0/4093676211 learned_addr learned my addr 172.21.15.103:0/4093676211 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.765+0000 7f027ffff640 1 -- 172.21.15.103:0/4093676211 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f028014ff00 msgr2=0x7f0280157f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:36:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.765+0000 7f027ffff640 1 --2- 172.21.15.103:0/4093676211 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f028014ff00 0x7f0280157f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.765+0000 7f027ffff640 1 -- 172.21.15.103:0/4093676211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02680037a0 msgr2=0x7f02801e0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.765+0000 7f027ffff640 1 --2- 172.21.15.103:0/4093676211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02680037a0 0x7f02801e0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.765+0000 7f027ffff640 1 -- 172.21.15.103:0/4093676211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02801e27f0 con 0x7f028014a9b0 2024-09-10T08:36:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.765+0000 7f027f7fe640 1 --2- 172.21.15.103:0/4093676211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02680037a0 0x7f02801e0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:36:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.765+0000 7f027ffff640 1 --2- 172.21.15.103:0/4093676211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f028014a9b0 0x7f028014ae30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0280068980 tx=0x7f027800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.765+0000 7f0267fff640 1 -- 172.21.15.103:0/4093676211 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0270007ca0 con 0x7f028014a9b0 2024-09-10T08:36:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.765+0000 7f0267fff640 1 -- 172.21.15.103:0/4093676211 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0278010070 con 0x7f028014a9b0 2024-09-10T08:36:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.765+0000 7f0267fff640 1 -- 172.21.15.103:0/4093676211 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02780156b0 con 0x7f028014a9b0 2024-09-10T08:36:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.765+0000 7f0285dc0640 1 -- 172.21.15.103:0/4093676211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02801dfe70 con 0x7f028014a9b0 2024-09-10T08:36:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.765+0000 7f0285dc0640 1 -- 172.21.15.103:0/4093676211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02801e2510 con 0x7f028014a9b0 2024-09-10T08:36:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.766+0000 7f0285dc0640 1 --2- 172.21.15.103:0/4093676211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02801522b0 0x7f0280152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.766+0000 7f0285dc0640 1 -- 172.21.15.103:0/4093676211 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f02801e0570 con 0x7f02801522b0 2024-09-10T08:36:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.766+0000 7f027f7fe640 1 --2- 172.21.15.103:0/4093676211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02801522b0 0x7f0280152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.767+0000 7f027f7fe640 1 -- 172.21.15.103:0/4093676211 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f02801e0d90 con 0x7f02801522b0 2024-09-10T08:36:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.767+0000 7f0267fff640 1 -- 172.21.15.103:0/4093676211 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0278015850 con 0x7f028014a9b0 2024-09-10T08:36:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.767+0000 7f027f7fe640 1 --2- 172.21.15.103:0/4093676211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02801522b0 0x7f0280152690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0270004fd0 tx=0x7f0270012690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.767+0000 7f0267fff640 1 --2- 172.21.15.103:0/4093676211 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f026c06be10 0x7f026c06e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.767+0000 7f027effd640 1 --2- 172.21.15.103:0/4093676211 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f026c06be10 0x7f026c06e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.767+0000 7f0267fff640 1 -- 172.21.15.103:0/4093676211 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f027808b0f0 con 0x7f028014a9b0 2024-09-10T08:36:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.768+0000 7f0267fff640 1 -- 172.21.15.103:0/4093676211 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0270015440 con 0x7f02801522b0 2024-09-10T08:36:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.768+0000 7f0267fff640 1 -- 172.21.15.103:0/4093676211 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f027001a070 con 0x7f02801522b0 2024-09-10T08:36:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.768+0000 7f0267fff640 1 -- 172.21.15.103:0/4093676211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02801522b0 msgr2=0x7f0280152690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.768+0000 7f0267fff640 1 --2- 172.21.15.103:0/4093676211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02801522b0 0x7f0280152690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0270004fd0 tx=0x7f0270012690 comp rx=0 tx=0).stop 2024-09-10T08:36:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.768+0000 7f0267fff640 1 -- 172.21.15.103:0/4093676211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02801522b0 msgr2=0x7f0280152690 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:36:13.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.768+0000 7f0267fff640 1 --2- 172.21.15.103:0/4093676211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02801522b0 0x7f0280152690 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.768+0000 7f027effd640 1 --2- 172.21.15.103:0/4093676211 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f026c06be10 0x7f026c06e2d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0274032000 tx=0x7f027402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:13.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.774+0000 7f0285dc0640 1 --2- 172.21.15.103:0/4093676211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0280152bd0 0x7f028014eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:13.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.774+0000 7f0285dc0640 1 -- 172.21.15.103:0/4093676211 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f028006de30 con 0x7f0280152bd0 2024-09-10T08:36:13.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.774+0000 7f027f7fe640 1 --2- 172.21.15.103:0/4093676211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0280152bd0 0x7f028014eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:13.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.775+0000 7f027f7fe640 1 -- 172.21.15.103:0/4093676211 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f02800c2960 con 0x7f0280152bd0 2024-09-10T08:36:13.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.775+0000 7f027f7fe640 1 --2- 172.21.15.103:0/4093676211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0280152bd0 0x7f028014eb10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0270004fd0 tx=0x7f02800af0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:13.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.775+0000 7f0267fff640 1 -- 172.21.15.103:0/4093676211 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0270015c40 con 0x7f0280152bd0 2024-09-10T08:36:13.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.775+0000 7f0267fff640 1 -- 172.21.15.103:0/4093676211 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5042 (secure 0 0 0) 0x7f0270015c40 con 0x7f0280152bd0 2024-09-10T08:36:13.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.775+0000 7f0267fff640 1 -- 172.21.15.103:0/4093676211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0280152bd0 msgr2=0x7f028014eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:13.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.775+0000 7f0267fff640 1 --2- 172.21.15.103:0/4093676211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0280152bd0 0x7f028014eb10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0270004fd0 tx=0x7f02800af0e0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.775+0000 7f0267fff640 1 -- 172.21.15.103:0/4093676211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0280152bd0 msgr2=0x7f028014eb10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:36:13.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.775+0000 7f0267fff640 1 --2- 172.21.15.103:0/4093676211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0280152bd0 0x7f028014eb10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.776 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:36:13.776 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:36:13.777 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:36:13.777 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:36:13.777 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 62, 2024-09-10T08:36:13.777 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 89532, 2024-09-10T08:36:13.777 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:36:13.777 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:36:13.777 INFO:teuthology.orchestra.run.smithi103.stdout: 1 2024-09-10T08:36:13.777 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:13.777 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 2, 2024-09-10T08:36:13.777 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:36:13.777 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:36:13.777 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:36:13.777 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:13.778 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:13.778 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:13.778 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:13.778 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:13.778 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:13.778 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:13.778 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:13.778 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:13.778 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:13.778 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:13.778 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:13.778 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:36:13.778 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:36:13.778 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:13.779 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:13.779 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:13.779 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:13.779 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:13.779 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:13.779 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:13.779 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:13.779 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:13.779 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:13.780 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:13.780 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:13.780 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.780 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:36:13.780 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:36:13.780 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:36:13.780 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:36:13.780 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:36:13.780 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:36:13.780 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:36:13.780 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:36:13.780 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:36:13.781 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:36:13.781 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:36:13.781 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:36:13.781 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:36:13.781 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:36:13.781 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:36:13.781 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:36:13.781 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:36:13.781 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:13.781 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:13.781 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:13.781 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:13.782 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:13.782 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:13.782 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:13.782 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:13.782 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:13.782 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:13.782 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:13.782 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:13.782 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:36:13.782 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.782 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:36:13.782 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.782 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:36:13.783 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:36:13.783 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:13.783 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:13.783 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.783 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:13.783 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:36:13.783 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:13.783 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.783 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.783 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:13.783 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:36:13.783 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:13.783 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:13.783 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:13.784 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.784 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:36:13.784 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:36:13.784 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:13.784 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:13.784 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:13.784 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.784 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.784 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:36:13.784 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:36:13.784 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:13.784 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:13.784 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.785 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:13.785 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:36:13.785 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:13.785 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.785 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.785 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:13.785 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:36:13.785 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:13.786 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:13.786 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:13.786 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.786 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:36:13.786 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:36:13.786 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:13.786 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:13.786 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:13.786 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.786 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.786 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:36:13.787 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:36:13.787 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:13.787 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:13.787 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.787 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:13.787 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:36:13.787 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:13.787 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.787 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.787 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:13.787 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:36:13.787 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:13.788 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:13.788 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:13.788 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.788 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:36:13.788 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:36:13.788 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:13.788 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:13.788 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:13.788 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:13.788 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:13.788 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.788 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:36:13.789 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:36:13.789 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.789 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:13.789 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:13.789 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:36:13.789 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:13.789 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:13.789 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:36:13.789 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.789 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:13.789 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:13.789 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:36:13.789 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:13.790 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:13.790 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:36:13.790 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.790 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:13.790 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:13.790 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:36:13.790 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:13.790 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:13.790 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:36:13.790 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.790 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:13.790 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:13.791 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:36:13.791 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:13.791 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:13.791 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:36:13.791 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:13.791 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:13.791 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:13.791 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:36:13.791 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:13.791 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:13.791 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:13.791 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:36:13.791 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:36:13.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.776+0000 7f0285dc0640 1 -- 172.21.15.103:0/4093676211 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f026c06be10 msgr2=0x7f026c06e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:13.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.776+0000 7f0285dc0640 1 --2- 172.21.15.103:0/4093676211 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f026c06be10 0x7f026c06e2d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0274032000 tx=0x7f027402e000 comp rx=0 tx=0).stop 2024-09-10T08:36:13.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.776+0000 7f0285dc0640 1 -- 172.21.15.103:0/4093676211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f028014a9b0 msgr2=0x7f028014ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:13.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.776+0000 7f027ffff640 1 -- 172.21.15.103:0/4093676211 reap_dead start 2024-09-10T08:36:13.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.776+0000 7f0285dc0640 1 --2- 172.21.15.103:0/4093676211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f028014a9b0 0x7f028014ae30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0280068980 tx=0x7f027800bf40 comp rx=0 tx=0).stop 2024-09-10T08:36:13.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.776+0000 7f0285dc0640 1 -- 172.21.15.103:0/4093676211 shutdown_connections 2024-09-10T08:36:13.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.776+0000 7f0285dc0640 1 --2- 172.21.15.103:0/4093676211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f028014a9b0 0x7f028014ae30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:13.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.776+0000 7f0285dc0640 1 -- 172.21.15.103:0/4093676211 >> 172.21.15.103:0/4093676211 conn(0x7f028006ccf0 msgr2=0x7f0280073440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:13.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.776+0000 7f0285dc0640 1 -- 172.21.15.103:0/4093676211 shutdown_connections 2024-09-10T08:36:13.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:13.776+0000 7f0285dc0640 1 -- 172.21.15.103:0/4093676211 wait complete. 2024-09-10T08:36:13.794 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:36:13.794 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-10T08:36:30.989 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:36:30.992 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:36:33.795 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-10T08:36:33.795 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-10T08:36:33.795 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T08:36:33.796 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T08:36:33.798 INFO:tasks.ceph.mon.c:Started 2024-09-10T08:36:33.799 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:36:33.799 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:36:33.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.903+0000 7f44cea53640 1 Processor -- start 2024-09-10T08:36:33.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.904+0000 7f44cea53640 1 -- start start 2024-09-10T08:36:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.905+0000 7f44cea53640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44c80c8b10 0x7f44c815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.905+0000 7f44cea53640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44c8153be0 0x7f44c8156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.905+0000 7f44cea53640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c80c7070 con 0x7f44c806cd80 2024-09-10T08:36:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.905+0000 7f44cea53640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f44c806d210 con 0x7f44c8153be0 2024-09-10T08:36:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.905+0000 7f44cea53640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f44c80c69b0 con 0x7f44c80c8b10 2024-09-10T08:36:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.905+0000 7f44c7fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44c80c8b10 0x7f44c815a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:33.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.905+0000 7f44c7fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44c80c8b10 0x7f44c815a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:49300/0 (socket says 172.21.15.103:49300) 2024-09-10T08:36:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.905+0000 7f44c7fff640 1 -- 172.21.15.103:0/1398590903 learned_addr learned my addr 172.21.15.103:0/1398590903 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.905+0000 7f44ccff0640 1 --2- 172.21.15.103:0/1398590903 >> v2:172.21.15.154:3300/0 conn(0x7f44c8153be0 0x7f44c8156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.905+0000 7f44c7fff640 1 -- 172.21.15.103:0/1398590903 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44c80c8b10 msgr2=0x7f44c815a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:36:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.905+0000 7f44c7fff640 1 -- 172.21.15.103:0/1398590903 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44c80c8b10 msgr2=0x7f44c815a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:36:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.905+0000 7f44c7fff640 1 --2- 172.21.15.103:0/1398590903 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44c80c8b10 0x7f44c815a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:36:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.905+0000 7f44c7fff640 1 --2- 172.21.15.103:0/1398590903 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44c80c8b10 0x7f44c815a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:36:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.905+0000 7f44ccff0640 1 -- 172.21.15.103:0/1398590903 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44c80c8b10 msgr2=0x7f44c815a4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:36:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.905+0000 7f44ccff0640 1 --2- 172.21.15.103:0/1398590903 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44c80c8b10 0x7f44c815a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.905+0000 7f44ccff0640 1 -- 172.21.15.103:0/1398590903 >> v1:172.21.15.154:6789/0 conn(0x7f44c806cd80 legacy=0x7f44c81534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.905+0000 7f44ccff0640 1 -- 172.21.15.103:0/1398590903 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c80c6c90 con 0x7f44c8153be0 2024-09-10T08:36:33.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.905+0000 7f44c6ffd640 1 -- 172.21.15.103:0/1398590903 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 743701112 0 0) 0x7f44c80c7070 con 0x7f44c806cd80 2024-09-10T08:36:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.907+0000 7f44ccff0640 1 --2- 172.21.15.103:0/1398590903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44c8153be0 0x7f44c8156660 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f44c0009d90 tx=0x7f44c002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca07d09ae604fd87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.907+0000 7f44c6ffd640 1 -- 172.21.15.103:0/1398590903 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c0031600 con 0x7f44c8153be0 2024-09-10T08:36:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.907+0000 7f44c6ffd640 1 -- 172.21.15.103:0/1398590903 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c00317a0 con 0x7f44c8153be0 2024-09-10T08:36:33.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.907+0000 7f44c6ffd640 1 -- 172.21.15.103:0/1398590903 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c0031b70 con 0x7f44c8153be0 2024-09-10T08:36:33.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.908+0000 7f44cea53640 1 -- 172.21.15.103:0/1398590903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44c8153be0 msgr2=0x7f44c8156660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:33.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.908+0000 7f44cea53640 1 --2- 172.21.15.103:0/1398590903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44c8153be0 0x7f44c8156660 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f44c0009d90 tx=0x7f44c002a5d0 comp rx=0 tx=0).stop 2024-09-10T08:36:33.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.908+0000 7f44cea53640 1 -- 172.21.15.103:0/1398590903 shutdown_connections 2024-09-10T08:36:33.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.908+0000 7f44cea53640 1 --2- 172.21.15.103:0/1398590903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44c8153be0 0x7f44c8156660 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:33.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.908+0000 7f44cea53640 1 --2- 172.21.15.103:0/1398590903 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44c80c8b10 0x7f44c815a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:33.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.908+0000 7f44cea53640 1 -- 172.21.15.103:0/1398590903 >> 172.21.15.103:0/1398590903 conn(0x7f44c80adb80 msgr2=0x7f44c80adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:33.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.908+0000 7f44cea53640 1 -- 172.21.15.103:0/1398590903 shutdown_connections 2024-09-10T08:36:33.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.908+0000 7f44cea53640 1 -- 172.21.15.103:0/1398590903 wait complete. 2024-09-10T08:36:33.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.910+0000 7f44cea53640 1 Processor -- start 2024-09-10T08:36:33.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.910+0000 7f44cea53640 1 -- start start 2024-09-10T08:36:33.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.911+0000 7f44cea53640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44c80c8b10 0x7f44c80b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:33.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.912+0000 7f44cea53640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44c8153be0 0x7f44c81ebb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:33.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.912+0000 7f44cea53640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44c814f7f0 0x7f44c80c5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:33.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.912+0000 7f44cea53640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f44c80c9070 con 0x7f44c8153be0 2024-09-10T08:36:33.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.912+0000 7f44cea53640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f44c80c8ef0 con 0x7f44c80c8b10 2024-09-10T08:36:33.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.912+0000 7f44cea53640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f44c8156ba0 con 0x7f44c814f7f0 2024-09-10T08:36:33.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.912+0000 7f44c77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44c8153be0 0x7f44c81ebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:33.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.912+0000 7f44c77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44c8153be0 0x7f44c81ebb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36008/0 (socket says 172.21.15.103:36008) 2024-09-10T08:36:33.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.912+0000 7f44c77fe640 1 -- 172.21.15.103:0/3465053981 learned_addr learned my addr 172.21.15.103:0/3465053981 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:33.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.912+0000 7f44c7fff640 1 --2- 172.21.15.103:0/3465053981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44c80c8b10 0x7f44c80b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:33.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.912+0000 7f44c77fe640 1 -- 172.21.15.103:0/3465053981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44c814f7f0 msgr2=0x7f44c80c5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:33.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.912+0000 7f44c77fe640 1 --2- 172.21.15.103:0/3465053981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44c814f7f0 0x7f44c80c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:33.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.912+0000 7f44c77fe640 1 -- 172.21.15.103:0/3465053981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44c80c8b10 msgr2=0x7f44c80b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:33.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.912+0000 7f44c77fe640 1 --2- 172.21.15.103:0/3465053981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44c80c8b10 0x7f44c80b1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:33.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.912+0000 7f44c77fe640 1 -- 172.21.15.103:0/3465053981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c80afeb0 con 0x7f44c8153be0 2024-09-10T08:36:33.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.912+0000 7f44c7fff640 1 --2- 172.21.15.103:0/3465053981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44c80c8b10 0x7f44c80b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:33.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.912+0000 7f44c77fe640 1 --2- 172.21.15.103:0/3465053981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44c8153be0 0x7f44c81ebb80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00c450 tx=0x7f44bc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:33.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.913+0000 7f44c4ff9640 1 -- 172.21.15.103:0/3465053981 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc017070 con 0x7f44c8153be0 2024-09-10T08:36:33.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.913+0000 7f44c4ff9640 1 -- 172.21.15.103:0/3465053981 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44bc0035f0 con 0x7f44c8153be0 2024-09-10T08:36:33.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.913+0000 7f44c4ff9640 1 -- 172.21.15.103:0/3465053981 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc0039e0 con 0x7f44c8153be0 2024-09-10T08:36:33.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.913+0000 7f44cea53640 1 -- 172.21.15.103:0/3465053981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c81ec3c0 con 0x7f44c8153be0 2024-09-10T08:36:33.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.913+0000 7f44cea53640 1 -- 172.21.15.103:0/3465053981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c80afa70 con 0x7f44c8153be0 2024-09-10T08:36:33.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.914+0000 7f44cea53640 1 -- 172.21.15.103:0/3465053981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44c8156fe0 con 0x7f44c8153be0 2024-09-10T08:36:33.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.914+0000 7f44c4ff9640 1 -- 172.21.15.103:0/3465053981 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44bc01a070 con 0x7f44c8153be0 2024-09-10T08:36:33.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.915+0000 7f44c4ff9640 1 --2- 172.21.15.103:0/3465053981 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f44b406be30 0x7f44b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:33.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.915+0000 7f44c4ff9640 1 -- 172.21.15.103:0/3465053981 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f44bc08a560 con 0x7f44c8153be0 2024-09-10T08:36:33.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.915+0000 7f44c7fff640 1 --2- 172.21.15.103:0/3465053981 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f44b406be30 0x7f44b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:33.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.915+0000 7f44c7fff640 1 --2- 172.21.15.103:0/3465053981 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f44b406be30 0x7f44b406e2f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009100 tx=0x7f44b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:33.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:33.921+0000 7f44c4ff9640 1 -- 172.21.15.103:0/3465053981 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f44bc058c00 con 0x7f44c8153be0 2024-09-10T08:36:34.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:34.206+0000 7f44cea53640 1 -- 172.21.15.103:0/3465053981 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f44c80c9d90 con 0x7f44c8153be0 2024-09-10T08:36:34.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:34.206+0000 7f44c4ff9640 1 -- 172.21.15.103:0/3465053981 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f44bc058500 con 0x7f44c8153be0 2024-09-10T08:36:34.207 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":62,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:36:34.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:34.208+0000 7f44cea53640 1 -- 172.21.15.103:0/3465053981 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f44b406be30 msgr2=0x7f44b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:34.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:34.208+0000 7f44cea53640 1 --2- 172.21.15.103:0/3465053981 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f44b406be30 0x7f44b406e2f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009100 tx=0x7f44b8008040 comp rx=0 tx=0).stop 2024-09-10T08:36:34.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:34.208+0000 7f44cea53640 1 -- 172.21.15.103:0/3465053981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44c8153be0 msgr2=0x7f44c81ebb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:34.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:34.208+0000 7f44cea53640 1 --2- 172.21.15.103:0/3465053981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44c8153be0 0x7f44c81ebb80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00c450 tx=0x7f44bc00c910 comp rx=0 tx=0).stop 2024-09-10T08:36:34.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:34.208+0000 7f44cea53640 1 -- 172.21.15.103:0/3465053981 shutdown_connections 2024-09-10T08:36:34.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:34.209+0000 7f44cea53640 1 --2- 172.21.15.103:0/3465053981 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f44b406be30 0x7f44b406e2f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:34.209+0000 7f44cea53640 1 --2- 172.21.15.103:0/3465053981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44c814f7f0 0x7f44c80c5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:34.209+0000 7f44cea53640 1 --2- 172.21.15.103:0/3465053981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44c8153be0 0x7f44c81ebb80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:34.209+0000 7f44cea53640 1 --2- 172.21.15.103:0/3465053981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44c80c8b10 0x7f44c80b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:34.209+0000 7f44cea53640 1 -- 172.21.15.103:0/3465053981 >> 172.21.15.103:0/3465053981 conn(0x7f44c80adb80 msgr2=0x7f44c806c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:34.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:34.209+0000 7f44cea53640 1 -- 172.21.15.103:0/3465053981 shutdown_connections 2024-09-10T08:36:34.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:34.209+0000 7f44cea53640 1 -- 172.21.15.103:0/3465053981 wait complete. 2024-09-10T08:36:37.224 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:36:37.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.336+0000 7f66d1601640 1 Processor -- start 2024-09-10T08:36:37.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.336+0000 7f66d1601640 1 -- start start 2024-09-10T08:36:37.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.337+0000 7f66d1601640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f66cc0a8ea0 0x7f66cc1573d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:37.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.337+0000 7f66d1601640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66cc0c82c0 0x7f66cc0c6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:37.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.337+0000 7f66d1601640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66cc071400 con 0x7f66cc0c6070 2024-09-10T08:36:37.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.337+0000 7f66d1601640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f66cc0c7e30 con 0x7f66cc0a8ea0 2024-09-10T08:36:37.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.337+0000 7f66d1601640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f66cc070e40 con 0x7f66cc0c82c0 2024-09-10T08:36:37.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.337+0000 7f66ca7fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f66cc0a8ea0 0x7f66cc1573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:37.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.337+0000 7f66ca7fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f66cc0a8ea0 0x7f66cc1573d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49610/0 (socket says 172.21.15.103:49610) 2024-09-10T08:36:37.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.337+0000 7f66ca7fc640 1 -- 172.21.15.103:0/141503968 learned_addr learned my addr 172.21.15.103:0/141503968 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:37.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.337+0000 7f66cb7fe640 1 --2- 172.21.15.103:0/141503968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66cc0c82c0 0x7f66cc0c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:37.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.337+0000 7f66cb7fe640 1 -- 172.21.15.103:0/141503968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66cc0c82c0 msgr2=0x7f66cc0c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:36:37.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.337+0000 7f66cb7fe640 1 -- 172.21.15.103:0/141503968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66cc0c82c0 msgr2=0x7f66cc0c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:36:37.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.337+0000 7f66cb7fe640 1 --2- 172.21.15.103:0/141503968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66cc0c82c0 0x7f66cc0c6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:36:37.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.337+0000 7f66cb7fe640 1 --2- 172.21.15.103:0/141503968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66cc0c82c0 0x7f66cc0c6450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:36:37.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.337+0000 7f66ca7fc640 1 -- 172.21.15.103:0/141503968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66cc0c82c0 msgr2=0x7f66cc0c6450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:36:37.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.337+0000 7f66ca7fc640 1 --2- 172.21.15.103:0/141503968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66cc0c82c0 0x7f66cc0c6450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:37.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.337+0000 7f66ca7fc640 1 -- 172.21.15.103:0/141503968 >> v1:172.21.15.103:6789/0 conn(0x7f66cc0c6070 legacy=0x7f66cc074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:37.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.337+0000 7f66ca7fc640 1 -- 172.21.15.103:0/141503968 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66cc071120 con 0x7f66cc0a8ea0 2024-09-10T08:36:37.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.338+0000 7f66ca7fc640 1 --2- 172.21.15.103:0/141503968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66cc0a8ea0 0x7f66cc1573d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f66c0009870 tx=0x7f66c002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba49477158e2a2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:37.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.338+0000 7f66c9ffb640 1 -- 172.21.15.103:0/141503968 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c0037070 con 0x7f66cc0a8ea0 2024-09-10T08:36:37.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.338+0000 7f66c9ffb640 1 -- 172.21.15.103:0/141503968 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c0032440 con 0x7f66cc0a8ea0 2024-09-10T08:36:37.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.338+0000 7f66c9ffb640 1 -- 172.21.15.103:0/141503968 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c0032810 con 0x7f66cc0a8ea0 2024-09-10T08:36:37.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.339+0000 7f66d1601640 1 -- 172.21.15.103:0/141503968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66cc0a8ea0 msgr2=0x7f66cc1573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:37.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.339+0000 7f66d1601640 1 --2- 172.21.15.103:0/141503968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66cc0a8ea0 0x7f66cc1573d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f66c0009870 tx=0x7f66c002a130 comp rx=0 tx=0).stop 2024-09-10T08:36:37.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.339+0000 7f66d1601640 1 -- 172.21.15.103:0/141503968 shutdown_connections 2024-09-10T08:36:37.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.339+0000 7f66d1601640 1 --2- 172.21.15.103:0/141503968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66cc0c82c0 0x7f66cc0c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:37.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.339+0000 7f66d1601640 1 --2- 172.21.15.103:0/141503968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66cc0a8ea0 0x7f66cc1573d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:37.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.339+0000 7f66d1601640 1 -- 172.21.15.103:0/141503968 >> 172.21.15.103:0/141503968 conn(0x7f66cc0c9a90 msgr2=0x7f66cc0c9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:37.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.339+0000 7f66d1601640 1 -- 172.21.15.103:0/141503968 shutdown_connections 2024-09-10T08:36:37.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.339+0000 7f66d1601640 1 -- 172.21.15.103:0/141503968 wait complete. 2024-09-10T08:36:37.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.340+0000 7f66d1601640 1 Processor -- start 2024-09-10T08:36:37.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.340+0000 7f66d1601640 1 -- start start 2024-09-10T08:36:37.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.341+0000 7f66d1601640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66cc0a8ea0 0x7f66cc1efc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:37.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.341+0000 7f66d1601640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66cc0c6070 0x7f66cc1ebd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:37.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.341+0000 7f66d1601640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66cc0c82c0 0x7f66cc1de9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.341+0000 7f66d1601640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc157a90 con 0x7f66cc0a8ea0 2024-09-10T08:36:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.341+0000 7f66d1601640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc157910 con 0x7f66cc0c82c0 2024-09-10T08:36:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.341+0000 7f66d1601640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f66cc157c10 con 0x7f66cc0c6070 2024-09-10T08:36:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.341+0000 7f66caffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66cc0a8ea0 0x7f66cc1efc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.341+0000 7f66caffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66cc0a8ea0 0x7f66cc1efc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49620/0 (socket says 172.21.15.103:49620) 2024-09-10T08:36:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.341+0000 7f66caffd640 1 -- 172.21.15.103:0/3911222766 learned_addr learned my addr 172.21.15.103:0/3911222766 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.341+0000 7f66ca7fc640 1 --2- 172.21.15.103:0/3911222766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66cc0c6070 0x7f66cc1ebd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.341+0000 7f66cb7fe640 1 --2- 172.21.15.103:0/3911222766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66cc0c82c0 0x7f66cc1de9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.341+0000 7f66ca7fc640 1 -- 172.21.15.103:0/3911222766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66cc0c6070 msgr2=0x7f66cc1ebd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-10T08:36:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.341+0000 7f66ca7fc640 1 -- 172.21.15.103:0/3911222766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66cc0c6070 msgr2=0x7f66cc1ebd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:36:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.341+0000 7f66ca7fc640 1 --2- 172.21.15.103:0/3911222766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66cc0c6070 0x7f66cc1ebd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:36:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.341+0000 7f66ca7fc640 1 --2- 172.21.15.103:0/3911222766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66cc0c6070 0x7f66cc1ebd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:36:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.341+0000 7f66caffd640 1 -- 172.21.15.103:0/3911222766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66cc0c6070 msgr2=0x7f66cc1ebd20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:36:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.341+0000 7f66caffd640 1 --2- 172.21.15.103:0/3911222766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66cc0c6070 0x7f66cc1ebd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.341+0000 7f66caffd640 1 -- 172.21.15.103:0/3911222766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66cc0c82c0 msgr2=0x7f66cc1de9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.341+0000 7f66caffd640 1 --2- 172.21.15.103:0/3911222766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66cc0c82c0 0x7f66cc1de9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.341+0000 7f66caffd640 1 -- 172.21.15.103:0/3911222766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66cc1f0170 con 0x7f66cc0a8ea0 2024-09-10T08:36:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.342+0000 7f66caffd640 1 --2- 172.21.15.103:0/3911222766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66cc0a8ea0 0x7f66cc1efc30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f66bc00c3c0 tx=0x7f66bc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.342+0000 7f66b37fe640 1 -- 172.21.15.103:0/3911222766 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc0052d0 con 0x7f66cc0a8ea0 2024-09-10T08:36:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.342+0000 7f66b37fe640 1 -- 172.21.15.103:0/3911222766 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66bc005490 con 0x7f66cc0a8ea0 2024-09-10T08:36:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.342+0000 7f66d1601640 1 -- 172.21.15.103:0/3911222766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66cc153640 con 0x7f66cc0a8ea0 2024-09-10T08:36:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.342+0000 7f66b37fe640 1 -- 172.21.15.103:0/3911222766 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc007260 con 0x7f66cc0a8ea0 2024-09-10T08:36:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.342+0000 7f66d1601640 1 -- 172.21.15.103:0/3911222766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66cc1ef430 con 0x7f66cc0a8ea0 2024-09-10T08:36:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.343+0000 7f66d1601640 1 -- 172.21.15.103:0/3911222766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66cc153b60 con 0x7f66cc0a8ea0 2024-09-10T08:36:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.343+0000 7f66b37fe640 1 -- 172.21.15.103:0/3911222766 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f66bc007400 con 0x7f66cc0a8ea0 2024-09-10T08:36:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.344+0000 7f66b37fe640 1 --2- 172.21.15.103:0/3911222766 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f66b806be30 0x7f66b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:37.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.344+0000 7f66ca7fc640 1 --2- 172.21.15.103:0/3911222766 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f66b806be30 0x7f66b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:37.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.344+0000 7f66b37fe640 1 -- 172.21.15.103:0/3911222766 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f66bc08a600 con 0x7f66cc0a8ea0 2024-09-10T08:36:37.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.344+0000 7f66ca7fc640 1 --2- 172.21.15.103:0/3911222766 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f66b806be30 0x7f66b806e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f66c0034000 tx=0x7f66c002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:37.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.349+0000 7f66b37fe640 1 -- 172.21.15.103:0/3911222766 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f66cc153b60 con 0x7f66cc0a8ea0 2024-09-10T08:36:37.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.657+0000 7f66d1601640 1 -- 172.21.15.103:0/3911222766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f66cc0c6a20 con 0x7f66cc0a8ea0 2024-09-10T08:36:37.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.657+0000 7f66b37fe640 1 -- 172.21.15.103:0/3911222766 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f66bc0585c0 con 0x7f66cc0a8ea0 2024-09-10T08:36:37.658 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":62,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:36:37.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.660+0000 7f66d1601640 1 -- 172.21.15.103:0/3911222766 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f66b806be30 msgr2=0x7f66b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:37.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.660+0000 7f66d1601640 1 --2- 172.21.15.103:0/3911222766 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f66b806be30 0x7f66b806e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f66c0034000 tx=0x7f66c002e000 comp rx=0 tx=0).stop 2024-09-10T08:36:37.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.660+0000 7f66d1601640 1 -- 172.21.15.103:0/3911222766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66cc0a8ea0 msgr2=0x7f66cc1efc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:37.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.660+0000 7f66d1601640 1 --2- 172.21.15.103:0/3911222766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66cc0a8ea0 0x7f66cc1efc30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f66bc00c3c0 tx=0x7f66bc00c880 comp rx=0 tx=0).stop 2024-09-10T08:36:37.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.660+0000 7f66d1601640 1 -- 172.21.15.103:0/3911222766 shutdown_connections 2024-09-10T08:36:37.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.660+0000 7f66d1601640 1 --2- 172.21.15.103:0/3911222766 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f66b806be30 0x7f66b806e2f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:37.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.660+0000 7f66d1601640 1 --2- 172.21.15.103:0/3911222766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66cc0c82c0 0x7f66cc1de9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:37.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.660+0000 7f66d1601640 1 --2- 172.21.15.103:0/3911222766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66cc0c6070 0x7f66cc1ebd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:37.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.660+0000 7f66d1601640 1 --2- 172.21.15.103:0/3911222766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66cc0a8ea0 0x7f66cc1efc30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:37.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.660+0000 7f66d1601640 1 -- 172.21.15.103:0/3911222766 >> 172.21.15.103:0/3911222766 conn(0x7f66cc0c9a90 msgr2=0x7f66cc06f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:37.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.660+0000 7f66d1601640 1 -- 172.21.15.103:0/3911222766 shutdown_connections 2024-09-10T08:36:37.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:37.660+0000 7f66d1601640 1 -- 172.21.15.103:0/3911222766 wait complete. 2024-09-10T08:36:40.675 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:36:40.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:40.791+0000 7fe7647e4640 1 Processor -- start 2024-09-10T08:36:40.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:40.791+0000 7fe7647e4640 1 -- start start 2024-09-10T08:36:40.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:40.792+0000 7fe7647e4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 0x7fe75c0c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:40.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:40.792+0000 7fe7647e4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe75c153d70 con 0x7fe75c067d20 2024-09-10T08:36:40.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:40.792+0000 7fe7647e4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe75c154010 con 0x7fe75c150b70 2024-09-10T08:36:40.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:40.792+0000 7fe7647e4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe75c0a82c0 con 0x7fe75c0abc50 2024-09-10T08:36:40.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:40.792+0000 7fe761d7f640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe75c067d20 0x7fe75c0c3350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41276/0 (socket says 172.21.15.103:41276) 2024-09-10T08:36:40.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:40.792+0000 7fe761d7f640 1 -- 172.21.15.103:0/2182357475 learned_addr learned my addr 172.21.15.103:0/2182357475 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:36:40.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:40.792+0000 7fe762d81640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 0x7fe75c0c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:40.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:40.792+0000 7fe762d81640 1 -- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 msgr2=0x7fe75c0c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:36:40.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:40.792+0000 7fe762d81640 1 -- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 msgr2=0x7fe75c0c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:36:40.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:40.792+0000 7fe762d81640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 0x7fe75c0c3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:36:40.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:40.792+0000 7fe762d81640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 0x7fe75c0c3a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:36:40.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:40.993+0000 7fe762d81640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 0x7fe75c0c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:40.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:40.993+0000 7fe762d81640 1 -- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 msgr2=0x7fe75c0c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:36:40.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:40.993+0000 7fe762d81640 1 -- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 msgr2=0x7fe75c0c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:36:40.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:40.993+0000 7fe762d81640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 0x7fe75c0c3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:36:40.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:40.993+0000 7fe762d81640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 0x7fe75c0c3a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:36:41.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:41.394+0000 7fe762d81640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 0x7fe75c0c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:41.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:41.394+0000 7fe762d81640 1 -- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 msgr2=0x7fe75c0c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:36:41.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:41.394+0000 7fe762d81640 1 -- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 msgr2=0x7fe75c0c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:36:41.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:41.394+0000 7fe762d81640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 0x7fe75c0c3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:36:41.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:41.394+0000 7fe762d81640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 0x7fe75c0c3a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:36:42.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.195+0000 7fe762d81640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 0x7fe75c0c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.195+0000 7fe762d81640 1 -- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 msgr2=0x7fe75c0c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:36:42.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.195+0000 7fe762d81640 1 -- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 msgr2=0x7fe75c0c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:36:42.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.195+0000 7fe762d81640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 0x7fe75c0c3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:36:42.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.195+0000 7fe762d81640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 0x7fe75c0c3a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:36:42.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.721+0000 7fe76157e640 1 -- 172.21.15.103:0/2182357475 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3804971045 0 0) 0x7fe75c154010 con 0x7fe75c150b70 2024-09-10T08:36:42.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.721+0000 7fe76157e640 1 -- 172.21.15.103:0/2182357475 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe748003520 con 0x7fe75c150b70 2024-09-10T08:36:42.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.722+0000 7fe76157e640 1 -- 172.21.15.103:0/2182357475 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2477828831 0 0) 0x7fe748003520 con 0x7fe75c150b70 2024-09-10T08:36:42.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.722+0000 7fe76157e640 1 -- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 msgr2=0x7fe75c0c3a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:36:42.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.722+0000 7fe76157e640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 0x7fe75c0c3a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.722+0000 7fe76157e640 1 -- 172.21.15.103:0/2182357475 >> v1:172.21.15.103:6789/0 conn(0x7fe75c067d20 legacy=0x7fe75c0c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:42.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.722+0000 7fe76157e640 1 -- 172.21.15.103:0/2182357475 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75c0ab610 con 0x7fe75c150b70 2024-09-10T08:36:42.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.722+0000 7fe76157e640 1 -- 172.21.15.103:0/2182357475 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7fe758001670 con 0x7fe75c150b70 2024-09-10T08:36:42.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.722+0000 7fe76157e640 1 -- 172.21.15.103:0/2182357475 >> v1:172.21.15.154:6789/0 conn(0x7fe75c150b70 legacy=0x7fe75c0ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:42.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.722+0000 7fe76157e640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7480039b0 0x7fe748003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.722+0000 7fe76157e640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 0x7fe748004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.722+0000 7fe76157e640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe748004db0 0x7fe748005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.722+0000 7fe76157e640 1 -- 172.21.15.103:0/2182357475 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe75c0a82c0 con 0x7fe7480039b0 2024-09-10T08:36:42.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.722+0000 7fe76157e640 1 -- 172.21.15.103:0/2182357475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe748010080 con 0x7fe748004db0 2024-09-10T08:36:42.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.722+0000 7fe76157e640 1 -- 172.21.15.103:0/2182357475 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe748010280 con 0x7fe75c0abc50 2024-09-10T08:36:42.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.722+0000 7fe761d7f640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 0x7fe748004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.722+0000 7fe762d81640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe748004db0 0x7fe748005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.722+0000 7fe762580640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7480039b0 0x7fe748003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.722+0000 7fe762d81640 1 -- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 msgr2=0x7fe748004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:42.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.722+0000 7fe762d81640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 0x7fe748004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.722+0000 7fe762d81640 1 -- 172.21.15.103:0/2182357475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7480039b0 msgr2=0x7fe748003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:42.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.722+0000 7fe762d81640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7480039b0 0x7fe748003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.722+0000 7fe762d81640 1 -- 172.21.15.103:0/2182357475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe748003520 con 0x7fe748004db0 2024-09-10T08:36:42.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.722+0000 7fe761d7f640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe75c0abc50 0x7fe748004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:36:42.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.723+0000 7fe762d81640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe748004db0 0x7fe748005230 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe754004470 tx=0x7fe748005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43bf26bb66142f24 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:42.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.724+0000 7fe76157e640 1 -- 172.21.15.103:0/2182357475 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe754031070 con 0x7fe748004db0 2024-09-10T08:36:42.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.724+0000 7fe76157e640 1 -- 172.21.15.103:0/2182357475 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe75402ba20 con 0x7fe748004db0 2024-09-10T08:36:42.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.724+0000 7fe76157e640 1 -- 172.21.15.103:0/2182357475 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe754004040 con 0x7fe748004db0 2024-09-10T08:36:42.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.725+0000 7fe7647e4640 1 -- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe748004db0 msgr2=0x7fe748005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:42.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.725+0000 7fe7647e4640 1 --2- 172.21.15.103:0/2182357475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe748004db0 0x7fe748005230 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe754004470 tx=0x7fe748005830 comp rx=0 tx=0).stop 2024-09-10T08:36:42.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.725+0000 7fe762d81640 1 -- 172.21.15.103:0/2182357475 reap_dead start 2024-09-10T08:36:42.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.725+0000 7fe7647e4640 1 -- 172.21.15.103:0/2182357475 shutdown_connections 2024-09-10T08:36:42.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.725+0000 7fe7647e4640 1 -- 172.21.15.103:0/2182357475 >> 172.21.15.103:0/2182357475 conn(0x7fe75c0c8430 msgr2=0x7fe75c0c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:42.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.725+0000 7fe7647e4640 1 -- 172.21.15.103:0/2182357475 shutdown_connections 2024-09-10T08:36:42.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.725+0000 7fe7647e4640 1 -- 172.21.15.103:0/2182357475 wait complete. 2024-09-10T08:36:42.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.727+0000 7fe7647e4640 1 Processor -- start 2024-09-10T08:36:42.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.727+0000 7fe7647e4640 1 -- start start 2024-09-10T08:36:42.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.728+0000 7fe7647e4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe748004db0 0x7fe75c1eb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.728+0000 7fe7647e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe75c071f10 0x7fe75c0c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.728+0000 7fe7647e4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe75c14d6c0 0x7fe75c14db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.728+0000 7fe7647e4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe75c0c2e30 con 0x7fe75c14d6c0 2024-09-10T08:36:42.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.728+0000 7fe7647e4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe75c1542f0 con 0x7fe75c071f10 2024-09-10T08:36:42.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.728+0000 7fe7647e4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe75c150f50 con 0x7fe748004db0 2024-09-10T08:36:42.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.728+0000 7fe762d81640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe75c14d6c0 0x7fe75c14db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.728+0000 7fe762580640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe748004db0 0x7fe75c1eb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.728+0000 7fe762580640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe748004db0 0x7fe75c1eb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:55878/0 (socket says 172.21.15.103:55878) 2024-09-10T08:36:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.728+0000 7fe762d81640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe75c14d6c0 0x7fe75c14db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49644/0 (socket says 172.21.15.103:49644) 2024-09-10T08:36:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.728+0000 7fe762580640 1 -- 172.21.15.103:0/1568641520 learned_addr learned my addr 172.21.15.103:0/1568641520 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.728+0000 7fe761d7f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe75c071f10 0x7fe75c0c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.728+0000 7fe762580640 1 -- 172.21.15.103:0/1568641520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe748004db0 msgr2=0x7fe75c1eb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-10T08:36:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.728+0000 7fe762580640 1 -- 172.21.15.103:0/1568641520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe748004db0 msgr2=0x7fe75c1eb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:36:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.728+0000 7fe762580640 1 --2- 172.21.15.103:0/1568641520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe748004db0 0x7fe75c1eb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:36:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.728+0000 7fe762580640 1 --2- 172.21.15.103:0/1568641520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe748004db0 0x7fe75c1eb5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:36:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.728+0000 7fe761d7f640 1 -- 172.21.15.103:0/1568641520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe748004db0 msgr2=0x7fe75c1eb5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:36:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.728+0000 7fe761d7f640 1 --2- 172.21.15.103:0/1568641520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe748004db0 0x7fe75c1eb5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.728+0000 7fe761d7f640 1 -- 172.21.15.103:0/1568641520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe75c14d6c0 msgr2=0x7fe75c14db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.728+0000 7fe761d7f640 1 --2- 172.21.15.103:0/1568641520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe75c14d6c0 0x7fe75c14db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.728+0000 7fe761d7f640 1 -- 172.21.15.103:0/1568641520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75c1574e0 con 0x7fe75c071f10 2024-09-10T08:36:42.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.728+0000 7fe762d81640 1 --2- 172.21.15.103:0/1568641520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe75c14d6c0 0x7fe75c14db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:36:42.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.729+0000 7fe761d7f640 1 --2- 172.21.15.103:0/1568641520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe75c071f10 0x7fe75c0c7bc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe74c007840 tx=0x7fe74c0019d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:42.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.731+0000 7fe752ffd640 1 -- 172.21.15.103:0/1568641520 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c01a070 con 0x7fe75c071f10 2024-09-10T08:36:42.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.731+0000 7fe752ffd640 1 -- 172.21.15.103:0/1568641520 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe74c00f710 con 0x7fe75c071f10 2024-09-10T08:36:42.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.731+0000 7fe7647e4640 1 -- 172.21.15.103:0/1568641520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe75c1577c0 con 0x7fe75c071f10 2024-09-10T08:36:42.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.731+0000 7fe752ffd640 1 -- 172.21.15.103:0/1568641520 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c00fac0 con 0x7fe75c071f10 2024-09-10T08:36:42.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.731+0000 7fe7647e4640 1 -- 172.21.15.103:0/1568641520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe75c1eb0a0 con 0x7fe75c071f10 2024-09-10T08:36:42.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.732+0000 7fe7647e4640 1 -- 172.21.15.103:0/1568641520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe75c0ac1a0 con 0x7fe75c071f10 2024-09-10T08:36:42.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.732+0000 7fe752ffd640 1 -- 172.21.15.103:0/1568641520 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe74c01d070 con 0x7fe75c071f10 2024-09-10T08:36:42.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.733+0000 7fe752ffd640 1 --2- 172.21.15.103:0/1568641520 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe74006be60 0x7fe74006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.733+0000 7fe752ffd640 1 -- 172.21.15.103:0/1568641520 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fe74c08aae0 con 0x7fe75c071f10 2024-09-10T08:36:42.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.733+0000 7fe762580640 1 --2- 172.21.15.103:0/1568641520 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe74006be60 0x7fe74006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.733+0000 7fe762580640 1 --2- 172.21.15.103:0/1568641520 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe74006be60 0x7fe74006e320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe758001010 tx=0x7fe758009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:42.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:42.738+0000 7fe752ffd640 1 -- 172.21.15.103:0/1568641520 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe74c058a80 con 0x7fe75c071f10 2024-09-10T08:36:43.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:43.053+0000 7fe7647e4640 1 -- 172.21.15.103:0/1568641520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe75c067b00 con 0x7fe75c071f10 2024-09-10T08:36:43.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:43.053+0000 7fe752ffd640 1 -- 172.21.15.103:0/1568641520 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7fe74c05cd80 con 0x7fe75c071f10 2024-09-10T08:36:43.054 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":66,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:36:43.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:43.055+0000 7fe7647e4640 1 -- 172.21.15.103:0/1568641520 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe74006be60 msgr2=0x7fe74006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:43.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:43.055+0000 7fe7647e4640 1 --2- 172.21.15.103:0/1568641520 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe74006be60 0x7fe74006e320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe758001010 tx=0x7fe758009040 comp rx=0 tx=0).stop 2024-09-10T08:36:43.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:43.055+0000 7fe7647e4640 1 -- 172.21.15.103:0/1568641520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe75c071f10 msgr2=0x7fe75c0c7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:43.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:43.055+0000 7fe7647e4640 1 --2- 172.21.15.103:0/1568641520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe75c071f10 0x7fe75c0c7bc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe74c007840 tx=0x7fe74c0019d0 comp rx=0 tx=0).stop 2024-09-10T08:36:43.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:43.055+0000 7fe7647e4640 1 -- 172.21.15.103:0/1568641520 shutdown_connections 2024-09-10T08:36:43.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:43.055+0000 7fe7647e4640 1 --2- 172.21.15.103:0/1568641520 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe74006be60 0x7fe74006e320 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:43.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:43.056+0000 7fe7647e4640 1 --2- 172.21.15.103:0/1568641520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe75c14d6c0 0x7fe75c14db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:43.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:43.056+0000 7fe7647e4640 1 --2- 172.21.15.103:0/1568641520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe75c071f10 0x7fe75c0c7bc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:43.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:43.056+0000 7fe7647e4640 1 --2- 172.21.15.103:0/1568641520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe748004db0 0x7fe75c1eb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:43.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:43.056+0000 7fe7647e4640 1 -- 172.21.15.103:0/1568641520 >> 172.21.15.103:0/1568641520 conn(0x7fe75c0c8430 msgr2=0x7fe75c14e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:43.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:43.056+0000 7fe7647e4640 1 -- 172.21.15.103:0/1568641520 shutdown_connections 2024-09-10T08:36:43.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:43.056+0000 7fe7647e4640 1 -- 172.21.15.103:0/1568641520 wait complete. 2024-09-10T08:36:46.071 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:36:46.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.186+0000 7fed19250640 1 Processor -- start 2024-09-10T08:36:46.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.186+0000 7fed19250640 1 -- start start 2024-09-10T08:36:46.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.187+0000 7fed19250640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed140aa870 0x7fed1406e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.187+0000 7fed19250640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fed1406e910 0x7fed1415eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.187+0000 7fed19250640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed14158610 con 0x7fed1414e720 2024-09-10T08:36:46.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.187+0000 7fed19250640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fed140a9cd0 con 0x7fed1406e910 2024-09-10T08:36:46.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.187+0000 7fed19250640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fed140a7f70 con 0x7fed140aa870 2024-09-10T08:36:46.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.187+0000 7fed1259c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed140aa870 0x7fed1406e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.187+0000 7fed12d9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fed1414e720 0x7fed140aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:60250/0 (socket says 172.21.15.103:60250) 2024-09-10T08:36:46.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.187+0000 7fed12d9d640 1 -- 172.21.15.103:0/3305165151 learned_addr learned my addr 172.21.15.103:0/3305165151 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:36:46.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.188+0000 7fed1359e640 1 --2- 172.21.15.103:0/3305165151 >> v2:172.21.15.154:3300/0 conn(0x7fed1406e910 0x7fed1415eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.188+0000 7fed11d9b640 1 -- 172.21.15.103:0/3305165151 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4167648189 0 0) 0x7fed14158610 con 0x7fed1414e720 2024-09-10T08:36:46.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.188+0000 7fed11d9b640 1 -- 172.21.15.103:0/3305165151 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecfc003520 con 0x7fed1414e720 2024-09-10T08:36:46.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.188+0000 7fed1259c640 1 -- 172.21.15.103:0/3305165151 >> v2:172.21.15.154:3300/0 conn(0x7fed1406e910 msgr2=0x7fed1415eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:46.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.188+0000 7fed1259c640 1 --2- 172.21.15.103:0/3305165151 >> v2:172.21.15.154:3300/0 conn(0x7fed1406e910 0x7fed1415eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.188+0000 7fed1259c640 1 -- 172.21.15.103:0/3305165151 >> v1:172.21.15.154:6789/0 conn(0x7fed1414e720 legacy=0x7fed140aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.188+0000 7fed1259c640 1 -- 172.21.15.103:0/3305165151 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed140a8250 con 0x7fed140aa870 2024-09-10T08:36:46.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.189+0000 7fed1259c640 1 --2- 172.21.15.103:0/3305165151 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed140aa870 0x7fed1406e3d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fed080097a0 tx=0x7fed0802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2afbb0e938490dbd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:46.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.189+0000 7fed11d9b640 1 -- 172.21.15.103:0/3305165151 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed08037070 con 0x7fed140aa870 2024-09-10T08:36:46.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.189+0000 7fed11d9b640 1 -- 172.21.15.103:0/3305165151 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed0802ae50 con 0x7fed140aa870 2024-09-10T08:36:46.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.189+0000 7fed11d9b640 1 -- 172.21.15.103:0/3305165151 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed08032660 con 0x7fed140aa870 2024-09-10T08:36:46.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.189+0000 7fed19250640 1 -- 172.21.15.103:0/3305165151 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed140aa870 msgr2=0x7fed1406e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.189+0000 7fed19250640 1 --2- 172.21.15.103:0/3305165151 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed140aa870 0x7fed1406e3d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fed080097a0 tx=0x7fed0802a100 comp rx=0 tx=0).stop 2024-09-10T08:36:46.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.189+0000 7fed19250640 1 -- 172.21.15.103:0/3305165151 shutdown_connections 2024-09-10T08:36:46.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.189+0000 7fed19250640 1 --2- 172.21.15.103:0/3305165151 >> v2:172.21.15.154:3300/0 conn(0x7fed1406e910 0x7fed1415eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.189+0000 7fed19250640 1 --2- 172.21.15.103:0/3305165151 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed140aa870 0x7fed1406e3d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.189+0000 7fed19250640 1 -- 172.21.15.103:0/3305165151 >> 172.21.15.103:0/3305165151 conn(0x7fed140c8430 msgr2=0x7fed140c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:46.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.190+0000 7fed19250640 1 -- 172.21.15.103:0/3305165151 shutdown_connections 2024-09-10T08:36:46.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.190+0000 7fed19250640 1 -- 172.21.15.103:0/3305165151 wait complete. 2024-09-10T08:36:46.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.191+0000 7fed19250640 1 Processor -- start 2024-09-10T08:36:46.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.191+0000 7fed19250640 1 -- start start 2024-09-10T08:36:46.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.192+0000 7fed19250640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed1406e910 0x7fed14154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.192+0000 7fed19250640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed140aa870 0x7fed14151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.192+0000 7fed19250640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed1414e720 0x7fed14071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.192+0000 7fed19250640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fed14067fe0 con 0x7fed1414e720 2024-09-10T08:36:46.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.192+0000 7fed19250640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fed14067e60 con 0x7fed140aa870 2024-09-10T08:36:46.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.192+0000 7fed19250640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fed140aac90 con 0x7fed1406e910 2024-09-10T08:36:46.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.192+0000 7fed1359e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed1414e720 0x7fed14071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.192+0000 7fed1259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed140aa870 0x7fed14151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.192+0000 7fed12d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed1406e910 0x7fed14154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.192+0000 7fed1359e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed1414e720 0x7fed14071390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50640/0 (socket says 172.21.15.103:50640) 2024-09-10T08:36:46.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.192+0000 7fed1359e640 1 -- 172.21.15.103:0/2501752594 learned_addr learned my addr 172.21.15.103:0/2501752594 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:46.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.192+0000 7fed1359e640 1 -- 172.21.15.103:0/2501752594 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed1406e910 msgr2=0x7fed14154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.192+0000 7fed1359e640 1 --2- 172.21.15.103:0/2501752594 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed1406e910 0x7fed14154230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.192+0000 7fed1359e640 1 -- 172.21.15.103:0/2501752594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed140aa870 msgr2=0x7fed14151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.192+0000 7fed1359e640 1 --2- 172.21.15.103:0/2501752594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed140aa870 0x7fed14151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.192+0000 7fed1359e640 1 -- 172.21.15.103:0/2501752594 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed141551c0 con 0x7fed1414e720 2024-09-10T08:36:46.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.193+0000 7fed1359e640 1 --2- 172.21.15.103:0/2501752594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed1414e720 0x7fed14071390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fed0c009dd0 tx=0x7fed0c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:46.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.193+0000 7fecfb7fe640 1 -- 172.21.15.103:0/2501752594 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0c018020 con 0x7fed1414e720 2024-09-10T08:36:46.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.193+0000 7fecfb7fe640 1 -- 172.21.15.103:0/2501752594 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed0c014480 con 0x7fed1414e720 2024-09-10T08:36:46.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.193+0000 7fed19250640 1 -- 172.21.15.103:0/2501752594 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed14153a30 con 0x7fed1414e720 2024-09-10T08:36:46.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.193+0000 7fecfb7fe640 1 -- 172.21.15.103:0/2501752594 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0c014870 con 0x7fed1414e720 2024-09-10T08:36:46.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.193+0000 7fed19250640 1 -- 172.21.15.103:0/2501752594 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed14151ab0 con 0x7fed1414e720 2024-09-10T08:36:46.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.194+0000 7fed19250640 1 -- 172.21.15.103:0/2501752594 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed141581e0 con 0x7fed1414e720 2024-09-10T08:36:46.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.195+0000 7fecfb7fe640 1 -- 172.21.15.103:0/2501752594 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed0c005d10 con 0x7fed1414e720 2024-09-10T08:36:46.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.195+0000 7fecfb7fe640 1 --2- 172.21.15.103:0/2501752594 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fed0006be30 0x7fed0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.195+0000 7fecfb7fe640 1 -- 172.21.15.103:0/2501752594 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fed0c08bbb0 con 0x7fed1414e720 2024-09-10T08:36:46.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.195+0000 7fed12d9d640 1 --2- 172.21.15.103:0/2501752594 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fed0006be30 0x7fed0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.196+0000 7fed12d9d640 1 --2- 172.21.15.103:0/2501752594 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fed0006be30 0x7fed0006e2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fed040011e0 tx=0x7fed04007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:46.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.200+0000 7fecfb7fe640 1 -- 172.21.15.103:0/2501752594 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fed0c022070 con 0x7fed1414e720 2024-09-10T08:36:46.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.487+0000 7fed19250640 1 -- 172.21.15.103:0/2501752594 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fed140c5cc0 con 0x7fed1414e720 2024-09-10T08:36:46.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.487+0000 7fecfb7fe640 1 -- 172.21.15.103:0/2501752594 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7fed0c010040 con 0x7fed1414e720 2024-09-10T08:36:46.487 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":68,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:36:46.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.490+0000 7fed19250640 1 -- 172.21.15.103:0/2501752594 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fed0006be30 msgr2=0x7fed0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.490+0000 7fed19250640 1 --2- 172.21.15.103:0/2501752594 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fed0006be30 0x7fed0006e2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fed040011e0 tx=0x7fed04007d30 comp rx=0 tx=0).stop 2024-09-10T08:36:46.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.490+0000 7fed19250640 1 -- 172.21.15.103:0/2501752594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed1414e720 msgr2=0x7fed14071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.490+0000 7fed19250640 1 --2- 172.21.15.103:0/2501752594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed1414e720 0x7fed14071390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fed0c009dd0 tx=0x7fed0c00c490 comp rx=0 tx=0).stop 2024-09-10T08:36:46.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.490+0000 7fed19250640 1 -- 172.21.15.103:0/2501752594 shutdown_connections 2024-09-10T08:36:46.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.490+0000 7fed19250640 1 --2- 172.21.15.103:0/2501752594 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fed0006be30 0x7fed0006e2f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.490+0000 7fed19250640 1 --2- 172.21.15.103:0/2501752594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed1414e720 0x7fed14071390 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.490+0000 7fed19250640 1 --2- 172.21.15.103:0/2501752594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed140aa870 0x7fed14151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.490+0000 7fed19250640 1 --2- 172.21.15.103:0/2501752594 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed1406e910 0x7fed14154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.490+0000 7fed19250640 1 -- 172.21.15.103:0/2501752594 >> 172.21.15.103:0/2501752594 conn(0x7fed140c8430 msgr2=0x7fed140c6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:46.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.490+0000 7fed19250640 1 -- 172.21.15.103:0/2501752594 shutdown_connections 2024-09-10T08:36:46.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.490+0000 7fed19250640 1 -- 172.21.15.103:0/2501752594 wait complete. 2024-09-10T08:36:46.501 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:36:46.501 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:36:46.501 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:36:46.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.616+0000 7f26dbed2640 1 Processor -- start 2024-09-10T08:36:46.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.616+0000 7f26dbed2640 1 -- start start 2024-09-10T08:36:46.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.617+0000 7f26dbed2640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f26d406bbe0 0x7f26d4156370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.617+0000 7f26dbed2640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d4156fc0 con 0x7f26d406da50 2024-09-10T08:36:46.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.617+0000 7f26dbed2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d4074070 con 0x7f26d40c2b80 2024-09-10T08:36:46.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.617+0000 7f26dbed2640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f26d406c7c0 con 0x7f26d406bbe0 2024-09-10T08:36:46.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.617+0000 7f26d946d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f26d406bbe0 0x7f26d4156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.617+0000 7f26d946d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f26d406bbe0 0x7f26d4156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50648/0 (socket says 172.21.15.103:50648) 2024-09-10T08:36:46.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.617+0000 7f26d946d640 1 -- 172.21.15.103:0/1421007469 learned_addr learned my addr 172.21.15.103:0/1421007469 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:46.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.617+0000 7f26d8c6c640 1 -- 172.21.15.103:0/1421007469 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2113019866 0 0) 0x7f26d4074070 con 0x7f26d40c2b80 2024-09-10T08:36:46.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.617+0000 7f26d8c6c640 1 -- 172.21.15.103:0/1421007469 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26c0003520 con 0x7f26d40c2b80 2024-09-10T08:36:46.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.618+0000 7f26d946d640 1 -- 172.21.15.103:0/1421007469 >> v1:172.21.15.154:6789/0 conn(0x7f26d40c2b80 legacy=0x7f26d41568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.618+0000 7f26d946d640 1 -- 172.21.15.103:0/1421007469 >> v1:172.21.15.103:6789/0 conn(0x7f26d406da50 legacy=0x7f26d41537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.618+0000 7f26d946d640 1 -- 172.21.15.103:0/1421007469 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d415a390 con 0x7f26d406bbe0 2024-09-10T08:36:46.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.618+0000 7f26d946d640 1 --2- 172.21.15.103:0/1421007469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d406bbe0 0x7f26d4156370 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009870 tx=0x7f26c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef92813b38aa2dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:46.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.619+0000 7f26d8c6c640 1 -- 172.21.15.103:0/1421007469 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c4037070 con 0x7f26d406bbe0 2024-09-10T08:36:46.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.619+0000 7f26d8c6c640 1 -- 172.21.15.103:0/1421007469 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c4032440 con 0x7f26d406bbe0 2024-09-10T08:36:46.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.619+0000 7f26d8c6c640 1 -- 172.21.15.103:0/1421007469 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c4032810 con 0x7f26d406bbe0 2024-09-10T08:36:46.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.619+0000 7f26dbed2640 1 -- 172.21.15.103:0/1421007469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d406bbe0 msgr2=0x7f26d4156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.619+0000 7f26dbed2640 1 --2- 172.21.15.103:0/1421007469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d406bbe0 0x7f26d4156370 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009870 tx=0x7f26c402a270 comp rx=0 tx=0).stop 2024-09-10T08:36:46.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.619+0000 7f26dbed2640 1 -- 172.21.15.103:0/1421007469 shutdown_connections 2024-09-10T08:36:46.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.619+0000 7f26dbed2640 1 --2- 172.21.15.103:0/1421007469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d406bbe0 0x7f26d4156370 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.619+0000 7f26dbed2640 1 -- 172.21.15.103:0/1421007469 >> 172.21.15.103:0/1421007469 conn(0x7f26d406ccf0 msgr2=0x7f26d406d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:46.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.619+0000 7f26dbed2640 1 -- 172.21.15.103:0/1421007469 shutdown_connections 2024-09-10T08:36:46.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.619+0000 7f26dbed2640 1 -- 172.21.15.103:0/1421007469 wait complete. 2024-09-10T08:36:46.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.620+0000 7f26dbed2640 1 Processor -- start 2024-09-10T08:36:46.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.620+0000 7f26dbed2640 1 -- start start 2024-09-10T08:36:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.621+0000 7f26dbed2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d406bbe0 0x7f26d40abd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.621+0000 7f26dbed2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26d406da50 0x7f26d40ad240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.621+0000 7f26dbed2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26d40c2b80 0x7f26d40ad780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.621+0000 7f26dbed2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f26d4154060 con 0x7f26d406bbe0 2024-09-10T08:36:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.621+0000 7f26dbed2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26d4153ee0 con 0x7f26d406da50 2024-09-10T08:36:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.621+0000 7f26dbed2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f26d4073c90 con 0x7f26d40c2b80 2024-09-10T08:36:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.621+0000 7f26d9c6e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d406bbe0 0x7f26d40abd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.621+0000 7f26d9c6e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d406bbe0 0x7f26d40abd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50660/0 (socket says 172.21.15.103:50660) 2024-09-10T08:36:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.621+0000 7f26d9c6e640 1 -- 172.21.15.103:0/308454137 learned_addr learned my addr 172.21.15.103:0/308454137 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.621+0000 7f26da46f640 1 --2- 172.21.15.103:0/308454137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26d40c2b80 0x7f26d40ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.621+0000 7f26d946d640 1 --2- 172.21.15.103:0/308454137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26d406da50 0x7f26d40ad240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.622+0000 7f26d9c6e640 1 -- 172.21.15.103:0/308454137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26d40c2b80 msgr2=0x7f26d40ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.622+0000 7f26d9c6e640 1 --2- 172.21.15.103:0/308454137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26d40c2b80 0x7f26d40ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.622+0000 7f26d9c6e640 1 -- 172.21.15.103:0/308454137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26d406da50 msgr2=0x7f26d40ad240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.622+0000 7f26d9c6e640 1 --2- 172.21.15.103:0/308454137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26d406da50 0x7f26d40ad240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.622+0000 7f26d9c6e640 1 -- 172.21.15.103:0/308454137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d41ecbc0 con 0x7f26d406bbe0 2024-09-10T08:36:46.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.622+0000 7f26d9c6e640 1 --2- 172.21.15.103:0/308454137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d406bbe0 0x7f26d40abd30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c430 tx=0x7f26d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:46.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.622+0000 7f26ca7fc640 1 -- 172.21.15.103:0/308454137 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d0017070 con 0x7f26d406bbe0 2024-09-10T08:36:46.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.622+0000 7f26ca7fc640 1 -- 172.21.15.103:0/308454137 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26d00052d0 con 0x7f26d406bbe0 2024-09-10T08:36:46.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.622+0000 7f26dbed2640 1 -- 172.21.15.103:0/308454137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26d41dfb40 con 0x7f26d406bbe0 2024-09-10T08:36:46.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.622+0000 7f26ca7fc640 1 -- 172.21.15.103:0/308454137 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d0003830 con 0x7f26d406bbe0 2024-09-10T08:36:46.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.622+0000 7f26dbed2640 1 -- 172.21.15.103:0/308454137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26d406fa30 con 0x7f26d406bbe0 2024-09-10T08:36:46.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.623+0000 7f26dbed2640 1 --2- 172.21.15.103:0/308454137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d41dfd10 0x7f26d41ef340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.623+0000 7f26dbed2640 1 -- 172.21.15.103:0/308454137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f26d406de30 con 0x7f26d41dfd10 2024-09-10T08:36:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.623+0000 7f26d946d640 1 --2- 172.21.15.103:0/308454137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d41dfd10 0x7f26d41ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.623+0000 7f26d946d640 1 -- 172.21.15.103:0/308454137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f26d40c2960 con 0x7f26d41dfd10 2024-09-10T08:36:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.624+0000 7f26ca7fc640 1 -- 172.21.15.103:0/308454137 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f26d001a070 con 0x7f26d406bbe0 2024-09-10T08:36:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.624+0000 7f26d946d640 1 --2- 172.21.15.103:0/308454137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d41dfd10 0x7f26d41ef340 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f26d40c66f0 tx=0x7f26c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.624+0000 7f26ca7fc640 1 --2- 172.21.15.103:0/308454137 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f26b806be60 0x7f26b806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.624+0000 7f26ca7fc640 1 -- 172.21.15.103:0/308454137 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f26d008a430 con 0x7f26d406bbe0 2024-09-10T08:36:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.625+0000 7f26da46f640 1 --2- 172.21.15.103:0/308454137 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f26b806be60 0x7f26b806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.625+0000 7f26ca7fc640 1 -- 172.21.15.103:0/308454137 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c4043070 con 0x7f26d41dfd10 2024-09-10T08:36:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.625+0000 7f26ca7fc640 1 -- 172.21.15.103:0/308454137 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f26c4009490 con 0x7f26d41dfd10 2024-09-10T08:36:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.625+0000 7f26ca7fc640 1 -- 172.21.15.103:0/308454137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d41dfd10 msgr2=0x7f26d41ef340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.625+0000 7f26ca7fc640 1 --2- 172.21.15.103:0/308454137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d41dfd10 0x7f26d41ef340 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f26d40c66f0 tx=0x7f26c40046c0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.625+0000 7f26ca7fc640 1 -- 172.21.15.103:0/308454137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d41dfd10 msgr2=0x7f26d41ef340 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:36:46.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.625+0000 7f26ca7fc640 1 --2- 172.21.15.103:0/308454137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d41dfd10 0x7f26d41ef340 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.625+0000 7f26da46f640 1 --2- 172.21.15.103:0/308454137 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f26b806be60 0x7f26b806e320 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f26cc001560 tx=0x7f26cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:46.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.633+0000 7f26dbed2640 1 --2- 172.21.15.103:0/308454137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d40adcc0 0x7f26d41ef880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.633+0000 7f26dbed2640 1 -- 172.21.15.103:0/308454137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f26d4153ca0 con 0x7f26d40adcc0 2024-09-10T08:36:46.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.633+0000 7f26d946d640 1 --2- 172.21.15.103:0/308454137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d40adcc0 0x7f26d41ef880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.633+0000 7f26d946d640 1 -- 172.21.15.103:0/308454137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f26d41539c0 con 0x7f26d40adcc0 2024-09-10T08:36:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.633+0000 7f26d946d640 1 --2- 172.21.15.103:0/308454137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d40adcc0 0x7f26d41ef880 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f26c402a2b0 tx=0x7f26c4009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.634+0000 7f26ca7fc640 1 -- 172.21.15.103:0/308454137 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c4037040 con 0x7f26d40adcc0 2024-09-10T08:36:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.634+0000 7f26ca7fc640 1 -- 172.21.15.103:0/308454137 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5056 (secure 0 0 0) 0x7f26c4047400 con 0x7f26d40adcc0 2024-09-10T08:36:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.634+0000 7f26ca7fc640 1 -- 172.21.15.103:0/308454137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d40adcc0 msgr2=0x7f26d41ef880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.634+0000 7f26ca7fc640 1 --2- 172.21.15.103:0/308454137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d40adcc0 0x7f26d41ef880 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f26c402a2b0 tx=0x7f26c4009240 comp rx=0 tx=0).stop 2024-09-10T08:36:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.634+0000 7f26ca7fc640 1 -- 172.21.15.103:0/308454137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d40adcc0 msgr2=0x7f26d41ef880 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:36:46.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.634+0000 7f26ca7fc640 1 --2- 172.21.15.103:0/308454137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d40adcc0 0x7f26d41ef880 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.634 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:36:46.635 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:36:46.635 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:36:46.635 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:36:46.635 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 68, 2024-09-10T08:36:46.635 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 176702, 2024-09-10T08:36:46.635 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:36:46.635 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:36:46.635 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:36:46.635 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:36:46.635 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:46.635 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 2, 2024-09-10T08:36:46.635 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:36:46.636 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:36:46.636 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:36:46.636 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:46.636 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:46.636 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:46.636 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:46.636 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:46.636 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:46.636 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:46.636 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:46.636 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:46.636 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:46.636 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:46.637 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:46.637 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:36:46.637 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:36:46.637 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:46.637 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:46.637 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:46.637 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:46.637 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:46.637 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:46.637 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:46.637 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:46.637 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:46.638 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:46.638 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:46.638 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:46.638 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.638 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:36:46.638 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:36:46.638 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:36:46.638 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:36:46.638 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:36:46.638 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:36:46.638 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:36:46.638 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:36:46.638 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:36:46.638 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:36:46.639 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:36:46.639 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:36:46.639 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:36:46.639 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:36:46.639 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:36:46.639 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:36:46.639 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:36:46.639 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:46.639 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:46.639 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:46.639 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:46.639 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:46.639 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:46.640 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:46.640 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:46.640 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:46.640 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:46.640 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:46.640 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:46.640 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:36:46.640 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.640 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:36:46.640 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.640 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:36:46.640 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:36:46.640 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:46.641 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:46.641 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.641 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:46.641 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:36:46.641 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:46.641 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.641 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.641 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:46.641 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:36:46.641 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:46.641 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.641 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:46.641 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.642 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:36:46.642 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:36:46.642 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:46.642 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:46.642 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:46.642 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.642 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.642 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:36:46.642 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:36:46.642 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:46.642 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:46.642 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.642 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:46.642 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:36:46.643 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:46.643 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.643 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.643 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:46.643 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:36:46.643 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:46.643 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.643 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:46.643 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.643 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:36:46.643 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:36:46.643 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:46.643 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:46.643 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:46.644 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.644 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.644 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:36:46.644 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:36:46.644 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:46.644 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:46.644 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.644 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:46.644 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:36:46.644 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:46.644 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.644 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.644 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:46.645 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:36:46.645 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:46.645 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.645 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:46.645 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.645 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:36:46.645 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:36:46.645 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:46.645 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:46.645 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:46.645 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.645 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:46.645 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.645 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:36:46.646 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:36:46.646 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.646 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:46.646 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:46.646 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:36:46.646 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.646 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:46.646 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:36:46.646 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.646 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:46.646 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:46.646 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:36:46.646 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.647 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:46.647 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:36:46.647 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.647 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:46.647 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:46.647 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:36:46.647 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.647 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:46.647 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:36:46.647 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.647 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:46.647 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:46.647 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:36:46.647 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.648 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:46.648 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:36:46.648 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.648 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:46.648 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:46.648 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:36:46.648 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.648 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:46.648 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.648 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:36:46.649 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:36:46.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.634+0000 7f26dbed2640 1 -- 172.21.15.103:0/308454137 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f26b806be60 msgr2=0x7f26b806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.634+0000 7f26dbed2640 1 --2- 172.21.15.103:0/308454137 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f26b806be60 0x7f26b806e320 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f26cc001560 tx=0x7f26cc009040 comp rx=0 tx=0).stop 2024-09-10T08:36:46.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.634+0000 7f26dbed2640 1 -- 172.21.15.103:0/308454137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d406bbe0 msgr2=0x7f26d40abd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.634+0000 7f26dbed2640 1 --2- 172.21.15.103:0/308454137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d406bbe0 0x7f26d40abd30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c430 tx=0x7f26d000c8f0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.634+0000 7f26da46f640 1 -- 172.21.15.103:0/308454137 reap_dead start 2024-09-10T08:36:46.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.634+0000 7f26da46f640 1 -- 172.21.15.103:0/308454137 reap_dead start 2024-09-10T08:36:46.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.634+0000 7f26dbed2640 1 -- 172.21.15.103:0/308454137 shutdown_connections 2024-09-10T08:36:46.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.634+0000 7f26dbed2640 1 -- 172.21.15.103:0/308454137 >> 172.21.15.103:0/308454137 conn(0x7f26d406ccf0 msgr2=0x7f26d40c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:46.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.634+0000 7f26dbed2640 1 -- 172.21.15.103:0/308454137 shutdown_connections 2024-09-10T08:36:46.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.634+0000 7f26dbed2640 1 -- 172.21.15.103:0/308454137 wait complete. 2024-09-10T08:36:46.651 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:36:46.651 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:36:46.651 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:36:46.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.761+0000 7f55e925e640 1 Processor -- start 2024-09-10T08:36:46.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.761+0000 7f55e925e640 1 -- start start 2024-09-10T08:36:46.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.761+0000 7f55e925e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f55e40acc30 0x7f55e40c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.761+0000 7f55e925e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e40c8180 0x7f55e415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.762+0000 7f55e925e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55e4070590 con 0x7f55e40c44b0 2024-09-10T08:36:46.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.762+0000 7f55e925e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f55e40c4ea0 con 0x7f55e40acc30 2024-09-10T08:36:46.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.762+0000 7f55e925e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f55e40a8220 con 0x7f55e40c8180 2024-09-10T08:36:46.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.762+0000 7f55e2d9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f55e40acc30 0x7f55e40c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.762+0000 7f55e2d9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f55e40acc30 0x7f55e40c3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50676/0 (socket says 172.21.15.103:50676) 2024-09-10T08:36:46.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.762+0000 7f55e2d9d640 1 -- 172.21.15.103:0/2489169056 learned_addr learned my addr 172.21.15.103:0/2489169056 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:46.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.762+0000 7f55e359e640 1 --2- 172.21.15.103:0/2489169056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e40c8180 0x7f55e415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.762+0000 7f55e2d9d640 1 -- 172.21.15.103:0/2489169056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e40c8180 msgr2=0x7f55e415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:46.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.762+0000 7f55e2d9d640 1 --2- 172.21.15.103:0/2489169056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e40c8180 0x7f55e415dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.762+0000 7f55e2d9d640 1 -- 172.21.15.103:0/2489169056 >> v1:172.21.15.103:6789/0 conn(0x7f55e40c44b0 legacy=0x7f55e40c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.762+0000 7f55e2d9d640 1 -- 172.21.15.103:0/2489169056 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e40a84f0 con 0x7f55e40acc30 2024-09-10T08:36:46.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.763+0000 7f55e2d9d640 1 --2- 172.21.15.103:0/2489169056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e40acc30 0x7f55e40c3f70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009870 tx=0x7f55d402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da26a490d576a55 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:46.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.763+0000 7f55e1d9b640 1 -- 172.21.15.103:0/2489169056 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d4037070 con 0x7f55e40acc30 2024-09-10T08:36:46.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.763+0000 7f55e1d9b640 1 -- 172.21.15.103:0/2489169056 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d4032440 con 0x7f55e40acc30 2024-09-10T08:36:46.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.763+0000 7f55e1d9b640 1 -- 172.21.15.103:0/2489169056 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d4032810 con 0x7f55e40acc30 2024-09-10T08:36:46.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.764+0000 7f55e925e640 1 -- 172.21.15.103:0/2489169056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e40acc30 msgr2=0x7f55e40c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.764+0000 7f55e925e640 1 --2- 172.21.15.103:0/2489169056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e40acc30 0x7f55e40c3f70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009870 tx=0x7f55d402a130 comp rx=0 tx=0).stop 2024-09-10T08:36:46.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.764+0000 7f55e925e640 1 -- 172.21.15.103:0/2489169056 shutdown_connections 2024-09-10T08:36:46.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.764+0000 7f55e925e640 1 --2- 172.21.15.103:0/2489169056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e40c8180 0x7f55e415dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.764+0000 7f55e925e640 1 --2- 172.21.15.103:0/2489169056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e40acc30 0x7f55e40c3f70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.764+0000 7f55e925e640 1 -- 172.21.15.103:0/2489169056 >> 172.21.15.103:0/2489169056 conn(0x7f55e40c5660 msgr2=0x7f55e40c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:46.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.764+0000 7f55e925e640 1 -- 172.21.15.103:0/2489169056 shutdown_connections 2024-09-10T08:36:46.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.764+0000 7f55e925e640 1 -- 172.21.15.103:0/2489169056 wait complete. 2024-09-10T08:36:46.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.765+0000 7f55e925e640 1 Processor -- start 2024-09-10T08:36:46.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.765+0000 7f55e925e640 1 -- start start 2024-09-10T08:36:46.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.766+0000 7f55e925e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e40acc30 0x7f55e40be1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.766+0000 7f55e925e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e40c44b0 0x7f55e40a9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.766+0000 7f55e925e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e40c8180 0x7f55e41eb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.766+0000 7f55e925e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f55e40c5330 con 0x7f55e40c8180 2024-09-10T08:36:46.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.766+0000 7f55e925e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55e40702b0 con 0x7f55e40acc30 2024-09-10T08:36:46.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.766+0000 7f55e925e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f55e40c63f0 con 0x7f55e40c44b0 2024-09-10T08:36:46.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.766+0000 7f55e359e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e40c8180 0x7f55e41eb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.766+0000 7f55e359e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e40c8180 0x7f55e41eb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50680/0 (socket says 172.21.15.103:50680) 2024-09-10T08:36:46.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.766+0000 7f55e2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e40acc30 0x7f55e40be1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.766+0000 7f55e359e640 1 -- 172.21.15.103:0/2770191076 learned_addr learned my addr 172.21.15.103:0/2770191076 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:46.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.767+0000 7f55e259c640 1 --2- 172.21.15.103:0/2770191076 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e40c44b0 0x7f55e40a9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.767+0000 7f55e359e640 1 -- 172.21.15.103:0/2770191076 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e40c44b0 msgr2=0x7f55e40a9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.767+0000 7f55e359e640 1 --2- 172.21.15.103:0/2770191076 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55e40c44b0 0x7f55e40a9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.767+0000 7f55e359e640 1 -- 172.21.15.103:0/2770191076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e40acc30 msgr2=0x7f55e40be1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.767+0000 7f55e359e640 1 --2- 172.21.15.103:0/2770191076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e40acc30 0x7f55e40be1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.767+0000 7f55e359e640 1 -- 172.21.15.103:0/2770191076 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e41eda60 con 0x7f55e40c8180 2024-09-10T08:36:46.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.767+0000 7f55e2d9d640 1 --2- 172.21.15.103:0/2770191076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e40acc30 0x7f55e40be1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:36:46.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.767+0000 7f55e359e640 1 --2- 172.21.15.103:0/2770191076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e40c8180 0x7f55e41eb020 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00efc0 tx=0x7f55dc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:46.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.767+0000 7f55cb7fe640 1 -- 172.21.15.103:0/2770191076 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc018020 con 0x7f55e40c8180 2024-09-10T08:36:46.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.767+0000 7f55cb7fe640 1 -- 172.21.15.103:0/2770191076 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55dc014480 con 0x7f55e40c8180 2024-09-10T08:36:46.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.767+0000 7f55e925e640 1 -- 172.21.15.103:0/2770191076 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e41edd40 con 0x7f55e40c8180 2024-09-10T08:36:46.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.767+0000 7f55cb7fe640 1 -- 172.21.15.103:0/2770191076 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc014870 con 0x7f55e40c8180 2024-09-10T08:36:46.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.767+0000 7f55e925e640 1 -- 172.21.15.103:0/2770191076 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e41de8c0 con 0x7f55e40c8180 2024-09-10T08:36:46.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.768+0000 7f55e925e640 1 --2- 172.21.15.103:0/2770191076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e41eb560 0x7f55e41eb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.768+0000 7f55e925e640 1 -- 172.21.15.103:0/2770191076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55e406fe40 con 0x7f55e41eb560 2024-09-10T08:36:46.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.768+0000 7f55e2d9d640 1 --2- 172.21.15.103:0/2770191076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e41eb560 0x7f55e41eb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.769+0000 7f55e2d9d640 1 -- 172.21.15.103:0/2770191076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f55e41deac0 con 0x7f55e41eb560 2024-09-10T08:36:46.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.769+0000 7f55cb7fe640 1 -- 172.21.15.103:0/2770191076 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f55dc005d10 con 0x7f55e40c8180 2024-09-10T08:36:46.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.769+0000 7f55e2d9d640 1 --2- 172.21.15.103:0/2770191076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e41eb560 0x7f55e41eb940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f55e40c4c60 tx=0x7f55d40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:46.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.769+0000 7f55cb7fe640 1 --2- 172.21.15.103:0/2770191076 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f55d006be30 0x7f55d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.769+0000 7f55cb7fe640 1 -- 172.21.15.103:0/2770191076 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f55dc08baf0 con 0x7f55e40c8180 2024-09-10T08:36:46.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.769+0000 7f55e259c640 1 --2- 172.21.15.103:0/2770191076 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f55d006be30 0x7f55d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.769+0000 7f55cb7fe640 1 -- 172.21.15.103:0/2770191076 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d4037040 con 0x7f55e41eb560 2024-09-10T08:36:46.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.769+0000 7f55cb7fe640 1 -- 172.21.15.103:0/2770191076 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f55d4032440 con 0x7f55e41eb560 2024-09-10T08:36:46.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.769+0000 7f55cb7fe640 1 -- 172.21.15.103:0/2770191076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e41eb560 msgr2=0x7f55e41eb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.769+0000 7f55cb7fe640 1 --2- 172.21.15.103:0/2770191076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e41eb560 0x7f55e41eb940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f55e40c4c60 tx=0x7f55d40046c0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.770+0000 7f55cb7fe640 1 -- 172.21.15.103:0/2770191076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e41eb560 msgr2=0x7f55e41eb940 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:36:46.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.770+0000 7f55cb7fe640 1 --2- 172.21.15.103:0/2770191076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e41eb560 0x7f55e41eb940 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.770+0000 7f55e259c640 1 --2- 172.21.15.103:0/2770191076 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f55d006be30 0x7f55d006e2f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f55e40aa2d0 tx=0x7f55d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:46.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.776+0000 7f55e925e640 1 --2- 172.21.15.103:0/2770191076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e41dca20 0x7f55e41dce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.776+0000 7f55e925e640 1 -- 172.21.15.103:0/2770191076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55e406c0f0 con 0x7f55e41dca20 2024-09-10T08:36:46.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.776+0000 7f55e2d9d640 1 --2- 172.21.15.103:0/2770191076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e41dca20 0x7f55e41dce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.777+0000 7f55e2d9d640 1 -- 172.21.15.103:0/2770191076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f55e41de390 con 0x7f55e41dca20 2024-09-10T08:36:46.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.777+0000 7f55e2d9d640 1 --2- 172.21.15.103:0/2770191076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e41dca20 0x7f55e41dce00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009870 tx=0x7f55d4008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:46.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.777+0000 7f55cb7fe640 1 -- 172.21.15.103:0/2770191076 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d4037040 con 0x7f55e41dca20 2024-09-10T08:36:46.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.777+0000 7f55cb7fe640 1 -- 172.21.15.103:0/2770191076 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7f55d4003d70 con 0x7f55e41dca20 2024-09-10T08:36:46.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.777+0000 7f55cb7fe640 1 -- 172.21.15.103:0/2770191076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e41dca20 msgr2=0x7f55e41dce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.777+0000 7f55cb7fe640 1 --2- 172.21.15.103:0/2770191076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e41dca20 0x7f55e41dce00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009870 tx=0x7f55d4008030 comp rx=0 tx=0).stop 2024-09-10T08:36:46.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.777+0000 7f55cb7fe640 1 -- 172.21.15.103:0/2770191076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e41dca20 msgr2=0x7f55e41dce00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:36:46.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.777+0000 7f55cb7fe640 1 --2- 172.21.15.103:0/2770191076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55e41dca20 0x7f55e41dce00 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009870 tx=0x7f55d4008030 comp rx=0 tx=0).stop 2024-09-10T08:36:46.778 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:36:46.778 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:36:46.778 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:36:46.778 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:36:46.778 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 68, 2024-09-10T08:36:46.778 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 122534, 2024-09-10T08:36:46.778 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:36:46.779 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:36:46.779 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:36:46.779 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:36:46.779 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:46.779 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 3, 2024-09-10T08:36:46.779 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:36:46.779 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:36:46.779 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:36:46.779 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:46.779 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:46.779 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:46.779 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:46.779 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:46.780 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:46.780 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:46.780 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:46.780 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:46.780 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:46.780 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:46.780 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:46.780 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:36:46.780 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:36:46.780 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:46.780 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:46.780 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:46.780 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:46.781 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:46.781 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:46.781 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:46.781 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:46.781 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:46.781 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:46.781 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:46.781 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:46.781 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.781 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:36:46.781 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:36:46.781 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:36:46.782 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:36:46.782 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:36:46.782 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:36:46.782 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:36:46.782 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:36:46.782 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:36:46.782 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:36:46.782 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:36:46.782 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:36:46.782 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:36:46.782 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:36:46.782 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:36:46.782 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:36:46.783 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:36:46.783 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:46.783 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:46.783 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:46.783 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:46.783 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:46.783 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:46.783 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:46.783 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:46.783 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:46.783 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:46.783 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:46.783 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:46.784 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:36:46.784 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.784 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:36:46.784 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.784 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:36:46.784 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:36:46.784 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:46.784 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:46.784 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.784 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:46.784 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:36:46.784 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:46.784 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.785 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.785 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:46.785 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:36:46.785 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:46.785 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.785 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:46.785 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.785 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:36:46.785 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:36:46.785 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:46.785 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:46.785 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:46.785 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.785 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.786 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:36:46.786 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:36:46.786 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:46.786 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:46.786 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.786 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:46.786 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:36:46.786 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:46.786 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.786 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.787 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:46.787 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:36:46.787 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:46.787 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.787 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:46.787 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.787 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:36:46.787 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:36:46.787 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:46.787 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:46.787 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:46.787 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.787 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.788 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:36:46.788 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:36:46.788 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:46.788 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:46.788 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.788 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:46.788 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:36:46.788 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:46.788 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.788 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.788 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:46.788 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:36:46.788 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:46.788 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.789 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:46.789 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.789 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:36:46.789 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:36:46.789 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:46.789 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:46.789 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:46.789 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.789 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:46.789 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.789 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:36:46.789 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:36:46.789 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.790 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:46.790 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:46.790 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:36:46.790 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.790 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:46.790 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:36:46.790 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.790 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:46.790 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:46.790 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:36:46.790 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.790 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:46.790 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:36:46.791 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.791 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:46.791 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:46.791 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:36:46.791 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.791 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:46.791 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:36:46.791 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.791 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:46.791 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:46.791 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:36:46.791 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.791 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:46.791 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:36:46.792 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.792 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:46.792 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:46.792 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:36:46.792 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.792 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:46.792 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.792 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:36:46.792 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:36:46.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.778+0000 7f55e925e640 1 -- 172.21.15.103:0/2770191076 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f55d006be30 msgr2=0x7f55d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.778+0000 7f55e925e640 1 --2- 172.21.15.103:0/2770191076 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f55d006be30 0x7f55d006e2f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f55e40aa2d0 tx=0x7f55d8009040 comp rx=0 tx=0).stop 2024-09-10T08:36:46.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.778+0000 7f55e925e640 1 -- 172.21.15.103:0/2770191076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e40c8180 msgr2=0x7f55e41eb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.778+0000 7f55e925e640 1 --2- 172.21.15.103:0/2770191076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e40c8180 0x7f55e41eb020 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00efc0 tx=0x7f55dc00c490 comp rx=0 tx=0).stop 2024-09-10T08:36:46.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.778+0000 7f55e359e640 1 -- 172.21.15.103:0/2770191076 reap_dead start 2024-09-10T08:36:46.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.778+0000 7f55e925e640 1 -- 172.21.15.103:0/2770191076 shutdown_connections 2024-09-10T08:36:46.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.778+0000 7f55e925e640 1 --2- 172.21.15.103:0/2770191076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e40c8180 0x7f55e41eb020 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.778+0000 7f55e925e640 1 -- 172.21.15.103:0/2770191076 >> 172.21.15.103:0/2770191076 conn(0x7f55e40c5660 msgr2=0x7f55e4072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:46.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.778+0000 7f55e925e640 1 -- 172.21.15.103:0/2770191076 shutdown_connections 2024-09-10T08:36:46.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.778+0000 7f55e925e640 1 -- 172.21.15.103:0/2770191076 wait complete. 2024-09-10T08:36:46.795 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:36:46.795 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:36:46.795 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:36:46.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.912+0000 7f32f79c6640 1 Processor -- start 2024-09-10T08:36:46.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.912+0000 7f32f79c6640 1 -- start start 2024-09-10T08:36:46.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.913+0000 7f32f79c6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f006c650 0x7f32f00c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.913+0000 7f32f79c6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f32f00ca1c0 0x7f32f0160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.913+0000 7f32f79c6640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32f015a7c0 con 0x7f32f0150480 2024-09-10T08:36:46.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.913+0000 7f32f79c6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f32f006c240 con 0x7f32f00ca1c0 2024-09-10T08:36:46.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.913+0000 7f32f79c6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f32f015a330 con 0x7f32f006c650 2024-09-10T08:36:46.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.913+0000 7f32f5762640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f32f0150480 0x7f32f00c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50218/0 (socket says 172.21.15.103:50218) 2024-09-10T08:36:46.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.913+0000 7f32f5762640 1 -- 172.21.15.103:0/1068257823 learned_addr learned my addr 172.21.15.103:0/1068257823 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:36:46.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.913+0000 7f32f5f63640 1 --2- 172.21.15.103:0/1068257823 >> v2:172.21.15.154:3300/0 conn(0x7f32f00ca1c0 0x7f32f0160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.913+0000 7f32f4f61640 1 --2- 172.21.15.103:0/1068257823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f006c650 0x7f32f00c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.913+0000 7f32e7fff640 1 -- 172.21.15.103:0/1068257823 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 141996337 0 0) 0x7f32f015a7c0 con 0x7f32f0150480 2024-09-10T08:36:46.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.913+0000 7f32e7fff640 1 -- 172.21.15.103:0/1068257823 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32dc003520 con 0x7f32f0150480 2024-09-10T08:36:46.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.913+0000 7f32f5f63640 1 -- 172.21.15.103:0/1068257823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f006c650 msgr2=0x7f32f00c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:46.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.913+0000 7f32f5f63640 1 --2- 172.21.15.103:0/1068257823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f006c650 0x7f32f00c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.913+0000 7f32f5f63640 1 -- 172.21.15.103:0/1068257823 >> v1:172.21.15.103:6789/0 conn(0x7f32f0150480 legacy=0x7f32f00c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.913+0000 7f32f5f63640 1 -- 172.21.15.103:0/1068257823 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f0159a00 con 0x7f32f00ca1c0 2024-09-10T08:36:46.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.914+0000 7f32f5f63640 1 --2- 172.21.15.103:0/1068257823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f00ca1c0 0x7f32f0160bf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009d90 tx=0x7f32e802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5ef98be32713c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:46.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.914+0000 7f32e7fff640 1 -- 172.21.15.103:0/1068257823 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e8007740 con 0x7f32f00ca1c0 2024-09-10T08:36:46.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.914+0000 7f32e7fff640 1 -- 172.21.15.103:0/1068257823 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e80078e0 con 0x7f32f00ca1c0 2024-09-10T08:36:46.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.914+0000 7f32e7fff640 1 -- 172.21.15.103:0/1068257823 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e8007cb0 con 0x7f32f00ca1c0 2024-09-10T08:36:46.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.915+0000 7f32f79c6640 1 -- 172.21.15.103:0/1068257823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f00ca1c0 msgr2=0x7f32f0160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.915+0000 7f32f79c6640 1 --2- 172.21.15.103:0/1068257823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f00ca1c0 0x7f32f0160bf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009d90 tx=0x7f32e802a660 comp rx=0 tx=0).stop 2024-09-10T08:36:46.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.915+0000 7f32f79c6640 1 -- 172.21.15.103:0/1068257823 shutdown_connections 2024-09-10T08:36:46.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.915+0000 7f32f79c6640 1 --2- 172.21.15.103:0/1068257823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f00ca1c0 0x7f32f0160bf0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.915+0000 7f32f79c6640 1 --2- 172.21.15.103:0/1068257823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f006c650 0x7f32f00c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.915+0000 7f32f79c6640 1 -- 172.21.15.103:0/1068257823 >> 172.21.15.103:0/1068257823 conn(0x7f32f0068030 msgr2=0x7f32f0073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:46.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.915+0000 7f32f79c6640 1 -- 172.21.15.103:0/1068257823 shutdown_connections 2024-09-10T08:36:46.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.915+0000 7f32f79c6640 1 -- 172.21.15.103:0/1068257823 wait complete. 2024-09-10T08:36:46.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.916+0000 7f32f79c6640 1 Processor -- start 2024-09-10T08:36:46.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.916+0000 7f32f79c6640 1 -- start start 2024-09-10T08:36:46.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.917+0000 7f32f79c6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f006c650 0x7f32f01537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.917+0000 7f32f79c6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f00ca1c0 0x7f32f01dfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.917+0000 7f32f79c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f0150480 0x7f32f01ec8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.917+0000 7f32f79c6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f32f00ca670 con 0x7f32f00ca1c0 2024-09-10T08:36:46.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.917+0000 7f32f79c6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f32f0159fc0 con 0x7f32f0150480 2024-09-10T08:36:46.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.917+0000 7f32f79c6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f32f006d270 con 0x7f32f006c650 2024-09-10T08:36:46.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.917+0000 7f32f5762640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f006c650 0x7f32f01537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.917+0000 7f32f4f61640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f00ca1c0 0x7f32f01dfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.917+0000 7f32f5f63640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f0150480 0x7f32f01ec8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.917+0000 7f32f5762640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f006c650 0x7f32f01537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:47384/0 (socket says 172.21.15.103:47384) 2024-09-10T08:36:46.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.917+0000 7f32f5762640 1 -- 172.21.15.103:0/877768726 learned_addr learned my addr 172.21.15.103:0/877768726 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:46.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.918+0000 7f32f5762640 1 -- 172.21.15.103:0/877768726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f0150480 msgr2=0x7f32f01ec8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.918+0000 7f32f5762640 1 --2- 172.21.15.103:0/877768726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f0150480 0x7f32f01ec8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.918+0000 7f32f5762640 1 -- 172.21.15.103:0/877768726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f00ca1c0 msgr2=0x7f32f01dfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.918+0000 7f32f5762640 1 --2- 172.21.15.103:0/877768726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f00ca1c0 0x7f32f01dfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.918+0000 7f32f5762640 1 -- 172.21.15.103:0/877768726 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f01e0020 con 0x7f32f006c650 2024-09-10T08:36:46.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.918+0000 7f32f5f63640 1 --2- 172.21.15.103:0/877768726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32f0150480 0x7f32f01ec8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:36:46.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.918+0000 7f32f4f61640 1 --2- 172.21.15.103:0/877768726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32f00ca1c0 0x7f32f01dfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:36:46.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.918+0000 7f32f5762640 1 --2- 172.21.15.103:0/877768726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f006c650 0x7f32f01537a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00c430 tx=0x7f32ec00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:46.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.918+0000 7f32e5ffb640 1 -- 172.21.15.103:0/877768726 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ec017070 con 0x7f32f006c650 2024-09-10T08:36:46.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.918+0000 7f32e5ffb640 1 -- 172.21.15.103:0/877768726 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ec005ce0 con 0x7f32f006c650 2024-09-10T08:36:46.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.918+0000 7f32f79c6640 1 -- 172.21.15.103:0/877768726 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f01ecde0 con 0x7f32f006c650 2024-09-10T08:36:46.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.918+0000 7f32e5ffb640 1 -- 172.21.15.103:0/877768726 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ec0072f0 con 0x7f32f006c650 2024-09-10T08:36:46.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.918+0000 7f32f79c6640 1 -- 172.21.15.103:0/877768726 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f01f0110 con 0x7f32f006c650 2024-09-10T08:36:46.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.919+0000 7f32f79c6640 1 --2- 172.21.15.103:0/877768726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f01532c0 0x7f32f00c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.919+0000 7f32f79c6640 1 -- 172.21.15.103:0/877768726 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f32f00b0c40 con 0x7f32f01532c0 2024-09-10T08:36:46.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.920+0000 7f32f4f61640 1 --2- 172.21.15.103:0/877768726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f01532c0 0x7f32f00c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.920+0000 7f32f4f61640 1 -- 172.21.15.103:0/877768726 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f32f01ec3f0 con 0x7f32f01532c0 2024-09-10T08:36:46.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.920+0000 7f32e5ffb640 1 -- 172.21.15.103:0/877768726 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32ec01a070 con 0x7f32f006c650 2024-09-10T08:36:46.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.920+0000 7f32f4f61640 1 --2- 172.21.15.103:0/877768726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f01532c0 0x7f32f00c8a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f32f0156b30 tx=0x7f32e000f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.920+0000 7f32e5ffb640 1 --2- 172.21.15.103:0/877768726 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f32d406be30 0x7f32d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.920+0000 7f32f5f63640 1 --2- 172.21.15.103:0/877768726 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f32d406be30 0x7f32d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.920+0000 7f32e5ffb640 1 -- 172.21.15.103:0/877768726 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f32ec08a6c0 con 0x7f32f006c650 2024-09-10T08:36:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.921+0000 7f32e5ffb640 1 -- 172.21.15.103:0/877768726 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e0004030 con 0x7f32f01532c0 2024-09-10T08:36:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.921+0000 7f32e5ffb640 1 -- 172.21.15.103:0/877768726 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f32e00041d0 con 0x7f32f01532c0 2024-09-10T08:36:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.921+0000 7f32e5ffb640 1 -- 172.21.15.103:0/877768726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f01532c0 msgr2=0x7f32f00c8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.921+0000 7f32e5ffb640 1 --2- 172.21.15.103:0/877768726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f01532c0 0x7f32f00c8a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f32f0156b30 tx=0x7f32e000f610 comp rx=0 tx=0).stop 2024-09-10T08:36:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.921+0000 7f32e5ffb640 1 -- 172.21.15.103:0/877768726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f01532c0 msgr2=0x7f32f00c8a00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:36:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.921+0000 7f32e5ffb640 1 --2- 172.21.15.103:0/877768726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f01532c0 0x7f32f00c8a00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.921+0000 7f32f5f63640 1 --2- 172.21.15.103:0/877768726 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f32d406be30 0x7f32d406e2f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f32e8034000 tx=0x7f32e802f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:46.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.927+0000 7f32f79c6640 1 --2- 172.21.15.103:0/877768726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f01ebeb0 0x7f32f01e92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:46.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.928+0000 7f32f79c6640 1 -- 172.21.15.103:0/877768726 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f32f0156270 con 0x7f32f01ebeb0 2024-09-10T08:36:46.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.928+0000 7f32f4f61640 1 --2- 172.21.15.103:0/877768726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f01ebeb0 0x7f32f01e92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:46.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.928+0000 7f32f4f61640 1 -- 172.21.15.103:0/877768726 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f32f00ad780 con 0x7f32f01ebeb0 2024-09-10T08:36:46.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.928+0000 7f32f4f61640 1 --2- 172.21.15.103:0/877768726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f01ebeb0 0x7f32f01e92d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f32f0156b30 tx=0x7f32e00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:46.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.928+0000 7f32e5ffb640 1 -- 172.21.15.103:0/877768726 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e0004030 con 0x7f32f01ebeb0 2024-09-10T08:36:46.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.929+0000 7f32e5ffb640 1 -- 172.21.15.103:0/877768726 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4552 (secure 0 0 0) 0x7f32e0003e00 con 0x7f32f01ebeb0 2024-09-10T08:36:46.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.929+0000 7f32e5ffb640 1 -- 172.21.15.103:0/877768726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f01ebeb0 msgr2=0x7f32f01e92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.929+0000 7f32e5ffb640 1 --2- 172.21.15.103:0/877768726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f01ebeb0 0x7f32f01e92d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f32f0156b30 tx=0x7f32e00046c0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.929+0000 7f32e5ffb640 1 -- 172.21.15.103:0/877768726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f01ebeb0 msgr2=0x7f32f01e92d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:36:46.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.929+0000 7f32e5ffb640 1 --2- 172.21.15.103:0/877768726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f01ebeb0 0x7f32f01e92d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.929 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:36:46.929 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:36:46.929 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:36:46.929 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:36:46.929 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 68, 2024-09-10T08:36:46.929 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 13044, 2024-09-10T08:36:46.930 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:36:46.930 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:36:46.930 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:36:46.930 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:36:46.930 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:46.930 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 3, 2024-09-10T08:36:46.930 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:36:46.930 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:36:46.930 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:36:46.930 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:46.930 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:46.930 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:46.930 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:46.931 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:46.931 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:46.931 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:46.931 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:46.931 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:46.931 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:46.931 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:46.931 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:46.931 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:36:46.931 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:36:46.931 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:46.931 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:46.931 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:46.931 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:46.932 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:46.932 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:46.932 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:46.932 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:46.932 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:46.932 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:46.932 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:46.932 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:46.932 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.932 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:36:46.932 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:36:46.932 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:36:46.933 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:36:46.933 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:36:46.933 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:36:46.933 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:36:46.933 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:36:46.933 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:36:46.933 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:36:46.934 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:36:46.934 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:36:46.934 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:36:46.934 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:36:46.934 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:36:46.934 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:36:46.934 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:36:46.934 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:46.934 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:46.934 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:46.934 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:46.934 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:46.934 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:46.935 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:46.935 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:46.935 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:46.935 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:46.935 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:46.935 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:46.935 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:36:46.935 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.935 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:36:46.935 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.935 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:36:46.935 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:36:46.935 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:46.936 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:46.936 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.936 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:46.936 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:36:46.936 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:46.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.936 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.936 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:46.936 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:36:46.936 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:46.936 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.936 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:46.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.937 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:36:46.937 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:36:46.937 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:46.937 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:46.937 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:46.937 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.937 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.937 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:36:46.937 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:36:46.937 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:46.937 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:46.937 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.937 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:46.937 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:36:46.938 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:46.938 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.938 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.938 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:46.938 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:36:46.938 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:46.938 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.938 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:46.938 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.938 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:36:46.938 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:36:46.938 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:46.938 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:46.938 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:46.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.939 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.939 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:36:46.939 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:36:46.939 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:46.939 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:46.939 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.939 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:46.939 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:36:46.939 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:46.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.939 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.939 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:46.940 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:36:46.940 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:46.940 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.940 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:46.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.940 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:36:46.940 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:36:46.940 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:46.940 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:46.940 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:46.940 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.940 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:46.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.940 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:36:46.941 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:36:46.941 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.941 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:46.941 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:46.941 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:36:46.941 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.941 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:46.941 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:36:46.941 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:46.941 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:46.941 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:46.941 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:36:46.941 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:46.942 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:46.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:46.942 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:36:46.942 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:36:46.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.929+0000 7f32f79c6640 1 -- 172.21.15.103:0/877768726 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f32d406be30 msgr2=0x7f32d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.929+0000 7f32f79c6640 1 --2- 172.21.15.103:0/877768726 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f32d406be30 0x7f32d406e2f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f32e8034000 tx=0x7f32e802f000 comp rx=0 tx=0).stop 2024-09-10T08:36:46.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.929+0000 7f32f79c6640 1 -- 172.21.15.103:0/877768726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f006c650 msgr2=0x7f32f01537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:46.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.929+0000 7f32f79c6640 1 --2- 172.21.15.103:0/877768726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32f006c650 0x7f32f01537a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00c430 tx=0x7f32ec00c8f0 comp rx=0 tx=0).stop 2024-09-10T08:36:46.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.929+0000 7f32f5f63640 1 -- 172.21.15.103:0/877768726 reap_dead start 2024-09-10T08:36:46.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.929+0000 7f32f5f63640 1 -- 172.21.15.103:0/877768726 reap_dead start 2024-09-10T08:36:46.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.929+0000 7f32f79c6640 1 -- 172.21.15.103:0/877768726 shutdown_connections 2024-09-10T08:36:46.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.929+0000 7f32f79c6640 1 -- 172.21.15.103:0/877768726 >> 172.21.15.103:0/877768726 conn(0x7f32f0068030 msgr2=0x7f32f00acee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:46.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.929+0000 7f32f79c6640 1 -- 172.21.15.103:0/877768726 shutdown_connections 2024-09-10T08:36:46.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:46.929+0000 7f32f79c6640 1 -- 172.21.15.103:0/877768726 wait complete. 2024-09-10T08:36:46.944 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:36:46.944 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-10T08:36:46.944 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-10T08:36:47.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.060+0000 7fae722ae640 1 Processor -- start 2024-09-10T08:36:47.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.060+0000 7fae722ae640 1 -- start start 2024-09-10T08:36:47.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.061+0000 7fae722ae640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae6c0acc30 0x7fae6c0c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:47.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.061+0000 7fae722ae640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae6c0c8180 0x7fae6c15dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:47.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.061+0000 7fae722ae640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae6c070590 con 0x7fae6c0c44b0 2024-09-10T08:36:47.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.061+0000 7fae722ae640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fae6c0c4ea0 con 0x7fae6c0acc30 2024-09-10T08:36:47.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.061+0000 7fae722ae640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fae6c0a8220 con 0x7fae6c0c8180 2024-09-10T08:36:47.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.061+0000 7fae7084b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae6c0c8180 0x7fae6c15dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:47.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.061+0000 7fae6bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae6c0acc30 0x7fae6c0c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:47.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.061+0000 7fae7084b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae6c0c8180 0x7fae6c15dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:47422/0 (socket says 172.21.15.103:47422) 2024-09-10T08:36:47.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.061+0000 7fae7084b640 1 -- 172.21.15.103:0/1160210764 learned_addr learned my addr 172.21.15.103:0/1160210764 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:47.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.062+0000 7fae7084b640 1 -- 172.21.15.103:0/1160210764 >> v2:172.21.15.154:3300/0 conn(0x7fae6c0acc30 msgr2=0x7fae6c0c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:47.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.062+0000 7fae7084b640 1 --2- 172.21.15.103:0/1160210764 >> v2:172.21.15.154:3300/0 conn(0x7fae6c0acc30 0x7fae6c0c3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:47.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.062+0000 7fae7084b640 1 -- 172.21.15.103:0/1160210764 >> v1:172.21.15.154:6789/0 conn(0x7fae6c0c44b0 legacy=0x7fae6c0c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:47.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.062+0000 7fae7084b640 1 -- 172.21.15.103:0/1160210764 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae6c0a84f0 con 0x7fae6c0c8180 2024-09-10T08:36:47.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.063+0000 7fae7084b640 1 --2- 172.21.15.103:0/1160210764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae6c0c8180 0x7fae6c15dd40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fae64009e50 tx=0x7fae6402a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=435e478a37dd9797 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:47.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.063+0000 7fae6affd640 1 -- 172.21.15.103:0/1160210764 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae64036070 con 0x7fae6c0c8180 2024-09-10T08:36:47.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.063+0000 7fae6affd640 1 -- 172.21.15.103:0/1160210764 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae64031600 con 0x7fae6c0c8180 2024-09-10T08:36:47.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.063+0000 7fae6affd640 1 -- 172.21.15.103:0/1160210764 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae640319d0 con 0x7fae6c0c8180 2024-09-10T08:36:47.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.064+0000 7fae722ae640 1 -- 172.21.15.103:0/1160210764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae6c0c8180 msgr2=0x7fae6c15dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:47.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.064+0000 7fae722ae640 1 --2- 172.21.15.103:0/1160210764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae6c0c8180 0x7fae6c15dd40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fae64009e50 tx=0x7fae6402a5f0 comp rx=0 tx=0).stop 2024-09-10T08:36:47.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.064+0000 7fae722ae640 1 -- 172.21.15.103:0/1160210764 shutdown_connections 2024-09-10T08:36:47.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.064+0000 7fae722ae640 1 --2- 172.21.15.103:0/1160210764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae6c0c8180 0x7fae6c15dd40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:47.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.064+0000 7fae722ae640 1 --2- 172.21.15.103:0/1160210764 >> v2:172.21.15.154:3300/0 conn(0x7fae6c0acc30 0x7fae6c0c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:47.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.064+0000 7fae722ae640 1 -- 172.21.15.103:0/1160210764 >> 172.21.15.103:0/1160210764 conn(0x7fae6c0c5660 msgr2=0x7fae6c0c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:47.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.064+0000 7fae722ae640 1 -- 172.21.15.103:0/1160210764 shutdown_connections 2024-09-10T08:36:47.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.064+0000 7fae722ae640 1 -- 172.21.15.103:0/1160210764 wait complete. 2024-09-10T08:36:47.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.065+0000 7fae722ae640 1 Processor -- start 2024-09-10T08:36:47.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.065+0000 7fae722ae640 1 -- start start 2024-09-10T08:36:47.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.066+0000 7fae722ae640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae6c0acc30 0x7fae6c1eca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:47.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.066+0000 7fae722ae640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae6c0c44b0 0x7fae6c1eff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:47.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.066+0000 7fae722ae640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae6c0c8180 0x7fae6c0c2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.066+0000 7fae722ae640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fae6c0c5330 con 0x7fae6c0c44b0 2024-09-10T08:36:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.066+0000 7fae722ae640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fae6c0702b0 con 0x7fae6c0acc30 2024-09-10T08:36:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.066+0000 7fae722ae640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fae6c0c63f0 con 0x7fae6c0c8180 2024-09-10T08:36:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.066+0000 7fae6bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae6c0acc30 0x7fae6c1eca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.066+0000 7fae6b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae6c0c44b0 0x7fae6c1eff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.066+0000 7fae6bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae6c0acc30 0x7fae6c1eca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:60852/0 (socket says 172.21.15.103:60852) 2024-09-10T08:36:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.066+0000 7fae6bfff640 1 -- 172.21.15.103:0/3511468657 learned_addr learned my addr 172.21.15.103:0/3511468657 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.066+0000 7fae7084b640 1 --2- 172.21.15.103:0/3511468657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae6c0c8180 0x7fae6c0c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.066+0000 7fae6b7fe640 1 -- 172.21.15.103:0/3511468657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae6c0c8180 msgr2=0x7fae6c0c2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.066+0000 7fae6b7fe640 1 --2- 172.21.15.103:0/3511468657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae6c0c8180 0x7fae6c0c2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:47.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.066+0000 7fae6b7fe640 1 -- 172.21.15.103:0/3511468657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae6c0acc30 msgr2=0x7fae6c1eca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:47.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.067+0000 7fae6b7fe640 1 --2- 172.21.15.103:0/3511468657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae6c0acc30 0x7fae6c1eca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:47.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.067+0000 7fae6b7fe640 1 -- 172.21.15.103:0/3511468657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae6c1ebfe0 con 0x7fae6c0c44b0 2024-09-10T08:36:47.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.067+0000 7fae6bfff640 1 --2- 172.21.15.103:0/3511468657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae6c0acc30 0x7fae6c1eca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:36:47.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.067+0000 7fae6b7fe640 1 --2- 172.21.15.103:0/3511468657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae6c0c44b0 0x7fae6c1eff10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fae6000c3c0 tx=0x7fae6000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:47.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.067+0000 7fae68ff9640 1 -- 172.21.15.103:0/3511468657 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae600052d0 con 0x7fae6c0c44b0 2024-09-10T08:36:47.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.067+0000 7fae68ff9640 1 -- 172.21.15.103:0/3511468657 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae60005490 con 0x7fae6c0c44b0 2024-09-10T08:36:47.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.067+0000 7fae722ae640 1 -- 172.21.15.103:0/3511468657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae6c1f0450 con 0x7fae6c0c44b0 2024-09-10T08:36:47.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.067+0000 7fae68ff9640 1 -- 172.21.15.103:0/3511468657 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae60007260 con 0x7fae6c0c44b0 2024-09-10T08:36:47.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.067+0000 7fae722ae640 1 -- 172.21.15.103:0/3511468657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae6c06c780 con 0x7fae6c0c44b0 2024-09-10T08:36:47.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.068+0000 7fae722ae640 1 -- 172.21.15.103:0/3511468657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae6c0abc10 con 0x7fae6c0c44b0 2024-09-10T08:36:47.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.069+0000 7fae68ff9640 1 -- 172.21.15.103:0/3511468657 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae60007400 con 0x7fae6c0c44b0 2024-09-10T08:36:47.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.069+0000 7fae68ff9640 1 --2- 172.21.15.103:0/3511468657 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae5806be30 0x7fae5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:47.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.069+0000 7fae68ff9640 1 -- 172.21.15.103:0/3511468657 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fae6008a410 con 0x7fae6c0c44b0 2024-09-10T08:36:47.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.069+0000 7fae6bfff640 1 --2- 172.21.15.103:0/3511468657 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae5806be30 0x7fae5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:47.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.070+0000 7fae6bfff640 1 --2- 172.21.15.103:0/3511468657 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae5806be30 0x7fae5806e2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fae5c009f50 tx=0x7fae5c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:47.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.074+0000 7fae68ff9640 1 -- 172.21.15.103:0/3511468657 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae6c1ebfe0 con 0x7fae6c0c44b0 2024-09-10T08:36:47.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.346+0000 7fae722ae640 1 -- 172.21.15.103:0/3511468657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fae6c0c76e0 con 0x7fae6c0c44b0 2024-09-10T08:36:47.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.347+0000 7fae68ff9640 1 -- 172.21.15.103:0/3511468657 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fae60058460 con 0x7fae6c0c44b0 2024-09-10T08:36:47.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.349+0000 7fae722ae640 1 -- 172.21.15.103:0/3511468657 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae5806be30 msgr2=0x7fae5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:47.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.349+0000 7fae722ae640 1 --2- 172.21.15.103:0/3511468657 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae5806be30 0x7fae5806e2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fae5c009f50 tx=0x7fae5c009190 comp rx=0 tx=0).stop 2024-09-10T08:36:47.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.349+0000 7fae722ae640 1 -- 172.21.15.103:0/3511468657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae6c0c44b0 msgr2=0x7fae6c1eff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:47.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.349+0000 7fae722ae640 1 --2- 172.21.15.103:0/3511468657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae6c0c44b0 0x7fae6c1eff10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fae6000c3c0 tx=0x7fae6000c880 comp rx=0 tx=0).stop 2024-09-10T08:36:47.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.350+0000 7fae722ae640 1 -- 172.21.15.103:0/3511468657 shutdown_connections 2024-09-10T08:36:47.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.350+0000 7fae722ae640 1 --2- 172.21.15.103:0/3511468657 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae5806be30 0x7fae5806e2f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:47.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.350+0000 7fae722ae640 1 --2- 172.21.15.103:0/3511468657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae6c0c8180 0x7fae6c0c2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:47.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.350+0000 7fae722ae640 1 --2- 172.21.15.103:0/3511468657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae6c0c44b0 0x7fae6c1eff10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:47.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.350+0000 7fae722ae640 1 --2- 172.21.15.103:0/3511468657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae6c0acc30 0x7fae6c1eca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:47.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.350+0000 7fae722ae640 1 -- 172.21.15.103:0/3511468657 >> 172.21.15.103:0/3511468657 conn(0x7fae6c0c5660 msgr2=0x7fae6c154d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:47.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.350+0000 7fae722ae640 1 -- 172.21.15.103:0/3511468657 shutdown_connections 2024-09-10T08:36:47.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:47.350+0000 7fae722ae640 1 -- 172.21.15.103:0/3511468657 wait complete. 2024-09-10T08:36:47.362 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-10T08:36:57.363 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:36:57.363 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:36:57.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.473+0000 7fd8c4c37640 1 Processor -- start 2024-09-10T08:36:57.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.473+0000 7fd8c4c37640 1 -- start start 2024-09-10T08:36:57.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.475+0000 7fd8c4c37640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8c0154ac0 0x7fd8c00708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:57.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.475+0000 7fd8c4c37640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8c00703b0 0x7fd8c015e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:57.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.475+0000 7fd8c4c37640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8c0154ff0 con 0x7fd8c0151780 2024-09-10T08:36:57.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.475+0000 7fd8c4c37640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd8c006f5f0 con 0x7fd8c0154ac0 2024-09-10T08:36:57.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.475+0000 7fd8c4c37640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd8c006f8d0 con 0x7fd8c00703b0 2024-09-10T08:36:57.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.475+0000 7fd8bed9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8c00703b0 0x7fd8c015e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:57.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.475+0000 7fd8bdd9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8c0154ac0 0x7fd8c00708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:57.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.475+0000 7fd8bed9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8c00703b0 0x7fd8c015e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:45788/0 (socket says 172.21.15.103:45788) 2024-09-10T08:36:57.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.475+0000 7fd8bdd9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8c0154ac0 0x7fd8c00708a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:60804/0 (socket says 172.21.15.103:60804) 2024-09-10T08:36:57.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.475+0000 7fd8be59c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd8c0151780 0x7fd8c0155560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:41912/0 (socket says 172.21.15.103:41912) 2024-09-10T08:36:57.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.475+0000 7fd8bed9d640 1 -- 172.21.15.103:0/179839751 learned_addr learned my addr 172.21.15.103:0/179839751 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:57.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.475+0000 7fd8bdd9b640 1 -- 172.21.15.103:0/179839751 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8c00703b0 msgr2=0x7fd8c015e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:57.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.475+0000 7fd8bdd9b640 1 --2- 172.21.15.103:0/179839751 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8c00703b0 0x7fd8c015e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:57.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.475+0000 7fd8bdd9b640 1 -- 172.21.15.103:0/179839751 >> v1:172.21.15.154:6789/0 conn(0x7fd8c0151780 legacy=0x7fd8c0155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:57.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.475+0000 7fd8bdd9b640 1 -- 172.21.15.103:0/179839751 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c006fbb0 con 0x7fd8c0154ac0 2024-09-10T08:36:57.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.475+0000 7fd8bed9d640 1 --2- 172.21.15.103:0/179839751 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8c00703b0 0x7fd8c015e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:36:57.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.476+0000 7fd8bdd9b640 1 --2- 172.21.15.103:0/179839751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c0154ac0 0x7fd8c00708a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40097a0 tx=0x7fd8b402a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fea148c4a2dfaf45 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:57.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.476+0000 7fd8bd59a640 1 -- 172.21.15.103:0/179839751 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4037070 con 0x7fd8c0154ac0 2024-09-10T08:36:57.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.476+0000 7fd8bd59a640 1 -- 172.21.15.103:0/179839751 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b402adb0 con 0x7fd8c0154ac0 2024-09-10T08:36:57.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.476+0000 7fd8bd59a640 1 -- 172.21.15.103:0/179839751 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4032660 con 0x7fd8c0154ac0 2024-09-10T08:36:57.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.477+0000 7fd8c4c37640 1 -- 172.21.15.103:0/179839751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c0154ac0 msgr2=0x7fd8c00708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:57.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.477+0000 7fd8c4c37640 1 --2- 172.21.15.103:0/179839751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c0154ac0 0x7fd8c00708a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40097a0 tx=0x7fd8b402a060 comp rx=0 tx=0).stop 2024-09-10T08:36:57.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.477+0000 7fd8c4c37640 1 -- 172.21.15.103:0/179839751 shutdown_connections 2024-09-10T08:36:57.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.477+0000 7fd8c4c37640 1 --2- 172.21.15.103:0/179839751 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8c00703b0 0x7fd8c015e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:57.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.477+0000 7fd8c4c37640 1 --2- 172.21.15.103:0/179839751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c0154ac0 0x7fd8c00708a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:57.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.477+0000 7fd8c4c37640 1 -- 172.21.15.103:0/179839751 >> 172.21.15.103:0/179839751 conn(0x7fd8c00c6980 msgr2=0x7fd8c00c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:57.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.477+0000 7fd8c4c37640 1 -- 172.21.15.103:0/179839751 shutdown_connections 2024-09-10T08:36:57.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.477+0000 7fd8c4c37640 1 -- 172.21.15.103:0/179839751 wait complete. 2024-09-10T08:36:57.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.479+0000 7fd8c4c37640 1 Processor -- start 2024-09-10T08:36:57.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.479+0000 7fd8c4c37640 1 -- start start 2024-09-10T08:36:57.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.479+0000 7fd8c4c37640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8c00703b0 0x7fd8c01dfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:57.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.479+0000 7fd8c4c37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c0151780 0x7fd8c00c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:57.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.479+0000 7fd8c4c37640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8c0154ac0 0x7fd8c014c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:57.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.479+0000 7fd8c4c37640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c0155c70 con 0x7fd8c0154ac0 2024-09-10T08:36:57.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.479+0000 7fd8c4c37640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c0073f30 con 0x7fd8c0151780 2024-09-10T08:36:57.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.479+0000 7fd8c4c37640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd8c014d280 con 0x7fd8c00703b0 2024-09-10T08:36:57.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.479+0000 7fd8bed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8c0154ac0 0x7fd8c014c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:57.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.479+0000 7fd8be59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8c00703b0 0x7fd8c01dfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:57.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.479+0000 7fd8bdd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c0151780 0x7fd8c00c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:57.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.479+0000 7fd8bed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8c0154ac0 0x7fd8c014c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60666/0 (socket says 172.21.15.103:60666) 2024-09-10T08:36:57.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.479+0000 7fd8bdd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c0151780 0x7fd8c00c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:60810/0 (socket says 172.21.15.103:60810) 2024-09-10T08:36:57.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.479+0000 7fd8bed9d640 1 -- 172.21.15.103:0/1403007366 learned_addr learned my addr 172.21.15.103:0/1403007366 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:57.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.479+0000 7fd8be59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8c00703b0 0x7fd8c01dfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:45790/0 (socket says 172.21.15.103:45790) 2024-09-10T08:36:57.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.480+0000 7fd8bdd9b640 1 -- 172.21.15.103:0/1403007366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8c00703b0 msgr2=0x7fd8c01dfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:57.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.480+0000 7fd8bdd9b640 1 --2- 172.21.15.103:0/1403007366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8c00703b0 0x7fd8c01dfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:57.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.480+0000 7fd8bdd9b640 1 -- 172.21.15.103:0/1403007366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8c0154ac0 msgr2=0x7fd8c014c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:57.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.480+0000 7fd8bdd9b640 1 --2- 172.21.15.103:0/1403007366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8c0154ac0 0x7fd8c014c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:57.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.480+0000 7fd8bdd9b640 1 -- 172.21.15.103:0/1403007366 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c014d970 con 0x7fd8c0151780 2024-09-10T08:36:57.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.480+0000 7fd8be59c640 1 --2- 172.21.15.103:0/1403007366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8c00703b0 0x7fd8c01dfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:36:57.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.480+0000 7fd8bed9d640 1 --2- 172.21.15.103:0/1403007366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8c0154ac0 0x7fd8c014c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:36:57.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.480+0000 7fd8bdd9b640 1 --2- 172.21.15.103:0/1403007366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c0151780 0x7fd8c00c8f40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0069330 tx=0x7fd8b40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:57.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.480+0000 7fd8aeffd640 1 -- 172.21.15.103:0/1403007366 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4041030 con 0x7fd8c0151780 2024-09-10T08:36:57.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.480+0000 7fd8aeffd640 1 -- 172.21.15.103:0/1403007366 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b402abb0 con 0x7fd8c0151780 2024-09-10T08:36:57.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.480+0000 7fd8c4c37640 1 -- 172.21.15.103:0/1403007366 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8c014cdd0 con 0x7fd8c0151780 2024-09-10T08:36:57.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.480+0000 7fd8aeffd640 1 -- 172.21.15.103:0/1403007366 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4037040 con 0x7fd8c0151780 2024-09-10T08:36:57.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.480+0000 7fd8c4c37640 1 -- 172.21.15.103:0/1403007366 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8c014d4d0 con 0x7fd8c0151780 2024-09-10T08:36:57.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.481+0000 7fd8c4c37640 1 -- 172.21.15.103:0/1403007366 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8c00af630 con 0x7fd8c0151780 2024-09-10T08:36:57.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.482+0000 7fd8aeffd640 1 -- 172.21.15.103:0/1403007366 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8b4044070 con 0x7fd8c0151780 2024-09-10T08:36:57.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.482+0000 7fd8aeffd640 1 --2- 172.21.15.103:0/1403007366 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd8a006be30 0x7fd8a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:57.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.483+0000 7fd8aeffd640 1 -- 172.21.15.103:0/1403007366 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fd8b40ab600 con 0x7fd8c0151780 2024-09-10T08:36:57.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.483+0000 7fd8be59c640 1 --2- 172.21.15.103:0/1403007366 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd8a006be30 0x7fd8a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:57.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.483+0000 7fd8be59c640 1 --2- 172.21.15.103:0/1403007366 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd8a006be30 0x7fd8a006e2f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0007fd0 tx=0x7fd8b0007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:57.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.487+0000 7fd8aeffd640 1 -- 172.21.15.103:0/1403007366 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd8b4032e20 con 0x7fd8c0151780 2024-09-10T08:36:57.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.769+0000 7fd8c4c37640 1 -- 172.21.15.103:0/1403007366 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd8c0073ca0 con 0x7fd8c0151780 2024-09-10T08:36:57.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.769+0000 7fd8aeffd640 1 -- 172.21.15.103:0/1403007366 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fd8b4079bf0 con 0x7fd8c0151780 2024-09-10T08:36:57.770 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":68,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:36:57.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.772+0000 7fd8c4c37640 1 -- 172.21.15.103:0/1403007366 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd8a006be30 msgr2=0x7fd8a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:57.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.772+0000 7fd8c4c37640 1 --2- 172.21.15.103:0/1403007366 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd8a006be30 0x7fd8a006e2f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0007fd0 tx=0x7fd8b0007e80 comp rx=0 tx=0).stop 2024-09-10T08:36:57.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.772+0000 7fd8c4c37640 1 -- 172.21.15.103:0/1403007366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c0151780 msgr2=0x7fd8c00c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:57.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.772+0000 7fd8c4c37640 1 --2- 172.21.15.103:0/1403007366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c0151780 0x7fd8c00c8f40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0069330 tx=0x7fd8b40046c0 comp rx=0 tx=0).stop 2024-09-10T08:36:57.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.772+0000 7fd8c4c37640 1 -- 172.21.15.103:0/1403007366 shutdown_connections 2024-09-10T08:36:57.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.772+0000 7fd8c4c37640 1 --2- 172.21.15.103:0/1403007366 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd8a006be30 0x7fd8a006e2f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:57.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.772+0000 7fd8c4c37640 1 --2- 172.21.15.103:0/1403007366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8c0154ac0 0x7fd8c014c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:57.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.772+0000 7fd8c4c37640 1 --2- 172.21.15.103:0/1403007366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c0151780 0x7fd8c00c8f40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:57.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.772+0000 7fd8c4c37640 1 --2- 172.21.15.103:0/1403007366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8c00703b0 0x7fd8c01dfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:57.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.772+0000 7fd8c4c37640 1 -- 172.21.15.103:0/1403007366 >> 172.21.15.103:0/1403007366 conn(0x7fd8c00c6980 msgr2=0x7fd8c0150470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:57.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.772+0000 7fd8c4c37640 1 -- 172.21.15.103:0/1403007366 shutdown_connections 2024-09-10T08:36:57.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.772+0000 7fd8c4c37640 1 -- 172.21.15.103:0/1403007366 wait complete. 2024-09-10T08:36:57.783 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:36:57.783 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-10T08:36:57.784 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:36:57.784 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:36:57.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.896+0000 7f9dc536d640 1 Processor -- start 2024-09-10T08:36:57.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.896+0000 7f9dc536d640 1 -- start start 2024-09-10T08:36:57.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.897+0000 7f9dc536d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9dc0072ec0 0x7f9dc0153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:57.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.897+0000 7f9dc536d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dc00c4ac0 0x7f9dc0070040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:57.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.897+0000 7f9dc536d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9dc00afc60 0x7f9dc0151380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:57.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.897+0000 7f9dc536d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f9dc006efa0 con 0x7f9dc0072ec0 2024-09-10T08:36:57.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.897+0000 7f9dc536d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9dc006f280 con 0x7f9dc00afc60 2024-09-10T08:36:57.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.897+0000 7f9dc536d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9dc006f560 con 0x7f9dc00c4ac0 2024-09-10T08:36:57.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.897+0000 7f9dbeffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9dc0072ec0 0x7f9dc0153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:57.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.897+0000 7f9dbeffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9dc0072ec0 0x7f9dc0153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60668/0 (socket says 172.21.15.103:60668) 2024-09-10T08:36:57.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.897+0000 7f9dbeffd640 1 -- 172.21.15.103:0/3446260302 learned_addr learned my addr 172.21.15.103:0/3446260302 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:57.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.897+0000 7f9db7fff640 1 --2- 172.21.15.103:0/3446260302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dc00c4ac0 0x7f9dc0070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:57.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.897+0000 7f9dbf7fe640 1 --2- 172.21.15.103:0/3446260302 >> v2:172.21.15.154:3300/0 conn(0x7f9dc00afc60 0x7f9dc0151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:57.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.897+0000 7f9dbeffd640 1 -- 172.21.15.103:0/3446260302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dc00c4ac0 msgr2=0x7f9dc0070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:57.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.897+0000 7f9dbeffd640 1 --2- 172.21.15.103:0/3446260302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dc00c4ac0 0x7f9dc0070040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:57.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.898+0000 7f9dbeffd640 1 -- 172.21.15.103:0/3446260302 >> v2:172.21.15.154:3300/0 conn(0x7f9dc00afc60 msgr2=0x7f9dc0151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:57.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.898+0000 7f9dbeffd640 1 --2- 172.21.15.103:0/3446260302 >> v2:172.21.15.154:3300/0 conn(0x7f9dc00afc60 0x7f9dc0151380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:57.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.898+0000 7f9dbeffd640 1 -- 172.21.15.103:0/3446260302 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc006f840 con 0x7f9dc0072ec0 2024-09-10T08:36:57.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.898+0000 7f9dbeffd640 1 --2- 172.21.15.103:0/3446260302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc0072ec0 0x7f9dc0153ff0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0075ed0 tx=0x7f9db002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e027df3335aace server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:57.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.899+0000 7f9dbe7fc640 1 -- 172.21.15.103:0/3446260302 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db0037070 con 0x7f9dc0072ec0 2024-09-10T08:36:57.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.899+0000 7f9dbe7fc640 1 -- 172.21.15.103:0/3446260302 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9db002ae00 con 0x7f9dc0072ec0 2024-09-10T08:36:57.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.899+0000 7f9dbe7fc640 1 -- 172.21.15.103:0/3446260302 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db0032660 con 0x7f9dc0072ec0 2024-09-10T08:36:57.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.899+0000 7f9dc536d640 1 -- 172.21.15.103:0/3446260302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc0072ec0 msgr2=0x7f9dc0153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:57.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.899+0000 7f9dc536d640 1 --2- 172.21.15.103:0/3446260302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc0072ec0 0x7f9dc0153ff0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0075ed0 tx=0x7f9db002a0b0 comp rx=0 tx=0).stop 2024-09-10T08:36:57.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.899+0000 7f9dc536d640 1 -- 172.21.15.103:0/3446260302 shutdown_connections 2024-09-10T08:36:57.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.899+0000 7f9dc536d640 1 --2- 172.21.15.103:0/3446260302 >> v2:172.21.15.154:3300/0 conn(0x7f9dc00afc60 0x7f9dc0151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:57.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.899+0000 7f9dc536d640 1 --2- 172.21.15.103:0/3446260302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dc00c4ac0 0x7f9dc0070040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:57.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.899+0000 7f9dc536d640 1 --2- 172.21.15.103:0/3446260302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc0072ec0 0x7f9dc0153ff0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:57.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.899+0000 7f9dc536d640 1 -- 172.21.15.103:0/3446260302 >> 172.21.15.103:0/3446260302 conn(0x7f9dc00c9d80 msgr2=0x7f9dc00ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:57.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.899+0000 7f9dc536d640 1 -- 172.21.15.103:0/3446260302 shutdown_connections 2024-09-10T08:36:57.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.899+0000 7f9dc536d640 1 -- 172.21.15.103:0/3446260302 wait complete. 2024-09-10T08:36:57.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.901+0000 7f9dc536d640 1 Processor -- start 2024-09-10T08:36:57.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.901+0000 7f9dc536d640 1 -- start start 2024-09-10T08:36:57.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.901+0000 7f9dc536d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dc0072ec0 0x7f9dc01ddca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:57.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.902+0000 7f9dc536d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dc00afc60 0x7f9dc01de590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:57.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.902+0000 7f9dc536d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc00c4ac0 0x7f9dc0143650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:57.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.902+0000 7f9dc536d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc00732a0 con 0x7f9dc00c4ac0 2024-09-10T08:36:57.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.902+0000 7f9dc536d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc00c47f0 con 0x7f9dc00afc60 2024-09-10T08:36:57.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.902+0000 7f9dc536d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9dc0073420 con 0x7f9dc0072ec0 2024-09-10T08:36:57.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.902+0000 7f9dbf7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc00c4ac0 0x7f9dc0143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:57.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.902+0000 7f9dbeffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dc0072ec0 0x7f9dc01ddca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:57.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.902+0000 7f9db7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dc00afc60 0x7f9dc01de590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:57.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.902+0000 7f9dbf7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc00c4ac0 0x7f9dc0143650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60670/0 (socket says 172.21.15.103:60670) 2024-09-10T08:36:57.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.902+0000 7f9dbeffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dc0072ec0 0x7f9dc01ddca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:45794/0 (socket says 172.21.15.103:45794) 2024-09-10T08:36:57.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.902+0000 7f9dbf7fe640 1 -- 172.21.15.103:0/2094853557 learned_addr learned my addr 172.21.15.103:0/2094853557 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:57.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.902+0000 7f9db7fff640 1 -- 172.21.15.103:0/2094853557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dc0072ec0 msgr2=0x7f9dc01ddca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:57.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.902+0000 7f9db7fff640 1 --2- 172.21.15.103:0/2094853557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dc0072ec0 0x7f9dc01ddca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:57.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.902+0000 7f9db7fff640 1 -- 172.21.15.103:0/2094853557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc00c4ac0 msgr2=0x7f9dc0143650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:57.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.902+0000 7f9db7fff640 1 --2- 172.21.15.103:0/2094853557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc00c4ac0 0x7f9dc0143650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:57.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.902+0000 7f9db7fff640 1 -- 172.21.15.103:0/2094853557 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc00c9840 con 0x7f9dc00afc60 2024-09-10T08:36:57.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.902+0000 7f9dbf7fe640 1 --2- 172.21.15.103:0/2094853557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc00c4ac0 0x7f9dc0143650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:36:57.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.902+0000 7f9db7fff640 1 --2- 172.21.15.103:0/2094853557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dc00afc60 0x7f9dc01de590 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9da800e880 tx=0x7f9da800ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:57.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.902+0000 7f9db77fe640 1 -- 172.21.15.103:0/2094853557 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8017070 con 0x7f9dc00afc60 2024-09-10T08:36:57.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.903+0000 7f9db77fe640 1 -- 172.21.15.103:0/2094853557 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da800c940 con 0x7f9dc00afc60 2024-09-10T08:36:57.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.903+0000 7f9dc536d640 1 -- 172.21.15.103:0/2094853557 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc01e0300 con 0x7f9dc00afc60 2024-09-10T08:36:57.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.903+0000 7f9db77fe640 1 -- 172.21.15.103:0/2094853557 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da800cd30 con 0x7f9dc00afc60 2024-09-10T08:36:57.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.903+0000 7f9dc536d640 1 -- 172.21.15.103:0/2094853557 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc01dead0 con 0x7f9dc00afc60 2024-09-10T08:36:57.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.903+0000 7f9dc536d640 1 --2- 172.21.15.103:0/2094853557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc01dd810 0x7f9dc0143b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:57.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.903+0000 7f9dc536d640 1 -- 172.21.15.103:0/2094853557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc006ed00 con 0x7f9dc01dd810 2024-09-10T08:36:57.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.904+0000 7f9dbeffd640 1 --2- 172.21.15.103:0/2094853557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc01dd810 0x7f9dc0143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:57.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.904+0000 7f9dbeffd640 1 -- 172.21.15.103:0/2094853557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9dc0153ff0 con 0x7f9dc01dd810 2024-09-10T08:36:57.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.904+0000 7f9dbeffd640 1 --2- 172.21.15.103:0/2094853557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc01dd810 0x7f9dc0143b90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00766f0 tx=0x7f9db00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:57.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.904+0000 7f9db77fe640 1 -- 172.21.15.103:0/2094853557 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db0032850 con 0x7f9dc01dd810 2024-09-10T08:36:57.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.904+0000 7f9db77fe640 1 -- 172.21.15.103:0/2094853557 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9da801a070 con 0x7f9dc00afc60 2024-09-10T08:36:57.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.905+0000 7f9db77fe640 1 --2- 172.21.15.103:0/2094853557 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9da006bd30 0x7f9da006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:57.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.905+0000 7f9dbf7fe640 1 --2- 172.21.15.103:0/2094853557 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9da006bd30 0x7f9da006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:57.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.905+0000 7f9db77fe640 1 -- 172.21.15.103:0/2094853557 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f9da808b040 con 0x7f9dc00afc60 2024-09-10T08:36:57.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.905+0000 7f9db77fe640 1 -- 172.21.15.103:0/2094853557 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9db0009490 con 0x7f9dc01dd810 2024-09-10T08:36:57.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.905+0000 7f9db77fe640 1 -- 172.21.15.103:0/2094853557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc01dd810 msgr2=0x7f9dc0143b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:57.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.905+0000 7f9db77fe640 1 --2- 172.21.15.103:0/2094853557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc01dd810 0x7f9dc0143b90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00766f0 tx=0x7f9db00046c0 comp rx=0 tx=0).stop 2024-09-10T08:36:57.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.905+0000 7f9db77fe640 1 -- 172.21.15.103:0/2094853557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc01dd810 msgr2=0x7f9dc0143b90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:36:57.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.905+0000 7f9db77fe640 1 --2- 172.21.15.103:0/2094853557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc01dd810 0x7f9dc0143b90 secure :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00766f0 tx=0x7f9db00046c0 comp rx=0 tx=0).stop 2024-09-10T08:36:57.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.905+0000 7f9dbf7fe640 1 --2- 172.21.15.103:0/2094853557 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9da006bd30 0x7f9da006e1f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9db80094c0 tx=0x7f9db800d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:57.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.912+0000 7f9dc536d640 1 --2- 172.21.15.103:0/2094853557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc014f550 0x7f9dc01e9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:57.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.912+0000 7f9dc536d640 1 -- 172.21.15.103:0/2094853557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc014db60 con 0x7f9dc014f550 2024-09-10T08:36:57.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.912+0000 7f9dbeffd640 1 --2- 172.21.15.103:0/2094853557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc014f550 0x7f9dc01e9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:57.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.912+0000 7f9dbeffd640 1 -- 172.21.15.103:0/2094853557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9dc014a420 con 0x7f9dc014f550 2024-09-10T08:36:57.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.912+0000 7f9dbeffd640 1 --2- 172.21.15.103:0/2094853557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc014f550 0x7f9dc01e9d10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9db002a0f0 tx=0x7f9db0009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:57.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.912+0000 7f9db77fe640 1 -- 172.21.15.103:0/2094853557 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db004bac0 con 0x7f9dc014f550 2024-09-10T08:36:57.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.912+0000 7f9db77fe640 1 -- 172.21.15.103:0/2094853557 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5057 (secure 0 0 0) 0x7f9db004bac0 con 0x7f9dc014f550 2024-09-10T08:36:57.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.912+0000 7f9db77fe640 1 -- 172.21.15.103:0/2094853557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc014f550 msgr2=0x7f9dc01e9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:57.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.912+0000 7f9db77fe640 1 --2- 172.21.15.103:0/2094853557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc014f550 0x7f9dc01e9d10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9db002a0f0 tx=0x7f9db0009240 comp rx=0 tx=0).stop 2024-09-10T08:36:57.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.912+0000 7f9db77fe640 1 -- 172.21.15.103:0/2094853557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc014f550 msgr2=0x7f9dc01e9d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:36:57.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.912+0000 7f9db77fe640 1 --2- 172.21.15.103:0/2094853557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dc014f550 0x7f9dc01e9d10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:57.913 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:36:57.914 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:36:57.914 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:36:57.914 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:36:57.914 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 68, 2024-09-10T08:36:57.914 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 187980, 2024-09-10T08:36:57.914 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:36:57.914 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:36:57.914 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:36:57.914 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:36:57.914 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:57.915 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 14, 2024-09-10T08:36:57.915 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:36:57.915 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:36:57.915 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:36:57.915 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:57.915 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:57.915 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:57.915 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:57.915 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:57.915 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:57.915 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:57.916 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:57.916 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:57.916 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:57.916 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:57.916 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:57.916 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:36:57.916 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:36:57.916 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:57.916 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:57.916 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:57.916 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:57.917 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:57.917 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:57.917 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:57.917 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:57.917 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:57.917 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:57.917 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:57.917 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:57.917 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:57.917 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:36:57.917 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:36:57.918 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:36:57.918 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:36:57.918 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:36:57.918 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:36:57.918 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:36:57.918 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:36:57.918 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:36:57.918 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:36:57.918 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:36:57.918 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:36:57.918 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:36:57.919 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:36:57.919 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:36:57.919 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:36:57.919 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:36:57.919 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:57.919 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:57.919 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:57.919 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:57.919 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:57.919 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:57.919 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:57.920 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:57.920 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:57.920 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:57.920 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:57.920 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:57.920 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:36:57.920 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:57.920 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:36:57.920 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:57.920 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:36:57.920 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:36:57.921 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:57.921 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:57.921 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:57.921 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:57.921 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:36:57.921 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:57.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:57.921 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:57.921 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:57.921 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:36:57.921 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:57.922 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:57.922 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:57.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:57.922 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:36:57.922 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:36:57.922 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:57.922 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:57.922 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:57.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:57.922 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:57.922 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:36:57.922 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:36:57.923 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:57.923 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:57.923 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:57.923 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:57.923 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:36:57.923 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:57.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:57.923 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:57.923 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:57.923 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:36:57.923 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:57.924 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:57.924 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:57.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:57.924 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:36:57.924 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:36:57.924 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:57.924 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:57.924 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:57.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:57.924 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:57.925 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:36:57.925 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:36:57.925 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:57.925 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:57.925 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:57.925 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:57.925 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:36:57.925 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:57.925 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:57.925 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:57.926 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:57.926 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:36:57.926 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:57.926 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:57.926 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:57.926 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:57.926 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:36:57.926 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:36:57.926 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:57.926 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:57.926 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:57.926 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:57.927 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:57.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:57.927 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:36:57.927 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:36:57.927 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:57.927 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:57.927 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:57.927 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:36:57.927 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:57.927 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:57.927 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:36:57.927 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:57.928 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:57.928 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:57.928 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:36:57.928 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:57.928 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:57.928 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:36:57.928 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:57.928 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:57.928 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:57.928 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:36:57.928 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:57.928 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:57.929 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:36:57.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:57.929 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:57.929 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:57.929 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:36:57.929 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:57.929 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:57.929 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:36:57.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:57.929 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:57.929 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:57.930 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:36:57.930 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:57.930 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:57.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:57.930 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:36:57.930 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:36:57.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.913+0000 7f9dc536d640 1 -- 172.21.15.103:0/2094853557 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9da006bd30 msgr2=0x7f9da006e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:57.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.913+0000 7f9dc536d640 1 --2- 172.21.15.103:0/2094853557 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9da006bd30 0x7f9da006e1f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9db80094c0 tx=0x7f9db800d040 comp rx=0 tx=0).stop 2024-09-10T08:36:57.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.913+0000 7f9dc536d640 1 -- 172.21.15.103:0/2094853557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dc00afc60 msgr2=0x7f9dc01de590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:57.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.913+0000 7f9dc536d640 1 --2- 172.21.15.103:0/2094853557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dc00afc60 0x7f9dc01de590 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9da800e880 tx=0x7f9da800ed40 comp rx=0 tx=0).stop 2024-09-10T08:36:57.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.913+0000 7f9dbf7fe640 1 -- 172.21.15.103:0/2094853557 reap_dead start 2024-09-10T08:36:57.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.913+0000 7f9dbf7fe640 1 -- 172.21.15.103:0/2094853557 reap_dead start 2024-09-10T08:36:57.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.913+0000 7f9dc536d640 1 -- 172.21.15.103:0/2094853557 shutdown_connections 2024-09-10T08:36:57.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.913+0000 7f9dc536d640 1 -- 172.21.15.103:0/2094853557 >> 172.21.15.103:0/2094853557 conn(0x7f9dc00c9d80 msgr2=0x7f9dc014a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:57.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.913+0000 7f9dc536d640 1 -- 172.21.15.103:0/2094853557 shutdown_connections 2024-09-10T08:36:57.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:57.913+0000 7f9dc536d640 1 -- 172.21.15.103:0/2094853557 wait complete. 2024-09-10T08:36:57.932 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:36:57.932 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:36:57.933 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:36:58.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.046+0000 7f3025cb7640 1 Processor -- start 2024-09-10T08:36:58.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.046+0000 7f3025cb7640 1 -- start start 2024-09-10T08:36:58.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.046+0000 7f3025cb7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3020150480 0x7f30200c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:58.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.047+0000 7f3025cb7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30200ca390 0x7f30200c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:58.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.047+0000 7f3025cb7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f302015a7c0 con 0x7f302006c650 2024-09-10T08:36:58.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.047+0000 7f3025cb7640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f302006c240 con 0x7f3020150480 2024-09-10T08:36:58.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.047+0000 7f3025cb7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f302015a330 con 0x7f30200ca390 2024-09-10T08:36:58.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.047+0000 7f301f7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3020150480 0x7f30200c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:58.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.047+0000 7f301f7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3020150480 0x7f30200c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60696/0 (socket says 172.21.15.103:60696) 2024-09-10T08:36:58.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.047+0000 7f301f7fe640 1 -- 172.21.15.103:0/3184781849 learned_addr learned my addr 172.21.15.103:0/3184781849 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:58.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.047+0000 7f301ffff640 1 --2- 172.21.15.103:0/3184781849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30200ca390 0x7f30200c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:58.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.047+0000 7f301f7fe640 1 -- 172.21.15.103:0/3184781849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30200ca390 msgr2=0x7f30200c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:58.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.047+0000 7f301f7fe640 1 --2- 172.21.15.103:0/3184781849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30200ca390 0x7f30200c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.047+0000 7f301f7fe640 1 -- 172.21.15.103:0/3184781849 >> v1:172.21.15.154:6789/0 conn(0x7f302006c650 legacy=0x7f30200c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:58.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.047+0000 7f301e7fc640 1 -- 172.21.15.103:0/3184781849 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 49692827 0 0) 0x7f302015a7c0 con 0x7f302006c650 2024-09-10T08:36:58.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.047+0000 7f301f7fe640 1 -- 172.21.15.103:0/3184781849 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3020159a00 con 0x7f3020150480 2024-09-10T08:36:58.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.048+0000 7f301f7fe640 1 --2- 172.21.15.103:0/3184781849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3020150480 0x7f30200c7a90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3010009870 tx=0x7f301002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bed9dce0a72629f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:58.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.048+0000 7f301e7fc640 1 -- 172.21.15.103:0/3184781849 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3010037070 con 0x7f3020150480 2024-09-10T08:36:58.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.048+0000 7f301e7fc640 1 -- 172.21.15.103:0/3184781849 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3010032440 con 0x7f3020150480 2024-09-10T08:36:58.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.048+0000 7f301e7fc640 1 -- 172.21.15.103:0/3184781849 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3010032810 con 0x7f3020150480 2024-09-10T08:36:58.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.049+0000 7f3025cb7640 1 -- 172.21.15.103:0/3184781849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3020150480 msgr2=0x7f30200c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:58.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.049+0000 7f3025cb7640 1 --2- 172.21.15.103:0/3184781849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3020150480 0x7f30200c7a90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3010009870 tx=0x7f301002a270 comp rx=0 tx=0).stop 2024-09-10T08:36:58.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.049+0000 7f3025cb7640 1 -- 172.21.15.103:0/3184781849 shutdown_connections 2024-09-10T08:36:58.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.049+0000 7f3025cb7640 1 --2- 172.21.15.103:0/3184781849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30200ca390 0x7f30200c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.049+0000 7f3025cb7640 1 --2- 172.21.15.103:0/3184781849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3020150480 0x7f30200c7a90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.049+0000 7f3025cb7640 1 -- 172.21.15.103:0/3184781849 >> 172.21.15.103:0/3184781849 conn(0x7f3020068030 msgr2=0x7f3020073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:58.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.049+0000 7f3025cb7640 1 -- 172.21.15.103:0/3184781849 shutdown_connections 2024-09-10T08:36:58.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.049+0000 7f3025cb7640 1 -- 172.21.15.103:0/3184781849 wait complete. 2024-09-10T08:36:58.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.050+0000 7f3025cb7640 1 Processor -- start 2024-09-10T08:36:58.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.050+0000 7f3025cb7640 1 -- start start 2024-09-10T08:36:58.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.051+0000 7f3025cb7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f302006c650 0x7f30201efcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:58.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.051+0000 7f3025cb7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30200ca390 0x7f30200adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:58.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.051+0000 7f3025cb7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3020150480 0x7f30200afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:58.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.051+0000 7f3025cb7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f302006d270 con 0x7f302006c650 2024-09-10T08:36:58.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.051+0000 7f3025cb7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3020159fc0 con 0x7f3020150480 2024-09-10T08:36:58.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.051+0000 7f3025cb7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3020156270 con 0x7f30200ca390 2024-09-10T08:36:58.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.051+0000 7f301f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f302006c650 0x7f30201efcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:58.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.051+0000 7f301f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f302006c650 0x7f30201efcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60710/0 (socket says 172.21.15.103:60710) 2024-09-10T08:36:58.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.051+0000 7f301f7fe640 1 -- 172.21.15.103:0/3486070370 learned_addr learned my addr 172.21.15.103:0/3486070370 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:58.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.051+0000 7f301effd640 1 --2- 172.21.15.103:0/3486070370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30200ca390 0x7f30200adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:58.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.051+0000 7f301ffff640 1 --2- 172.21.15.103:0/3486070370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3020150480 0x7f30200afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:58.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.051+0000 7f301f7fe640 1 -- 172.21.15.103:0/3486070370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30200ca390 msgr2=0x7f30200adc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:58.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.051+0000 7f301f7fe640 1 --2- 172.21.15.103:0/3486070370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30200ca390 0x7f30200adc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.051+0000 7f301f7fe640 1 -- 172.21.15.103:0/3486070370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3020150480 msgr2=0x7f30200afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:58.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.051+0000 7f301f7fe640 1 --2- 172.21.15.103:0/3486070370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3020150480 0x7f30200afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.051+0000 7f301f7fe640 1 -- 172.21.15.103:0/3486070370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30200ae500 con 0x7f302006c650 2024-09-10T08:36:58.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.051+0000 7f301effd640 1 --2- 172.21.15.103:0/3486070370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30200ca390 0x7f30200adc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:36:58.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.052+0000 7f301f7fe640 1 --2- 172.21.15.103:0/3486070370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f302006c650 0x7f30201efcd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3010035040 tx=0x7f30100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:58.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.052+0000 7f3007fff640 1 -- 172.21.15.103:0/3486070370 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3010037040 con 0x7f302006c650 2024-09-10T08:36:58.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.052+0000 7f3007fff640 1 -- 172.21.15.103:0/3486070370 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3010004030 con 0x7f302006c650 2024-09-10T08:36:58.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.052+0000 7f3007fff640 1 -- 172.21.15.103:0/3486070370 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3010004420 con 0x7f302006c650 2024-09-10T08:36:58.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.052+0000 7f3025cb7640 1 -- 172.21.15.103:0/3486070370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30200abb00 con 0x7f302006c650 2024-09-10T08:36:58.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.052+0000 7f3025cb7640 1 -- 172.21.15.103:0/3486070370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30201ef7b0 con 0x7f302006c650 2024-09-10T08:36:58.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.053+0000 7f3025cb7640 1 --2- 172.21.15.103:0/3486070370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30200ace00 0x7f30201ebd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:58.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.053+0000 7f3025cb7640 1 -- 172.21.15.103:0/3486070370 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30201ef9f0 con 0x7f30200ace00 2024-09-10T08:36:58.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.053+0000 7f301effd640 1 --2- 172.21.15.103:0/3486070370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30200ace00 0x7f30201ebd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:58.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.053+0000 7f301effd640 1 -- 172.21.15.103:0/3486070370 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f30200c9c80 con 0x7f30200ace00 2024-09-10T08:36:58.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.054+0000 7f3007fff640 1 -- 172.21.15.103:0/3486070370 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f301003a070 con 0x7f302006c650 2024-09-10T08:36:58.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.054+0000 7f301effd640 1 --2- 172.21.15.103:0/3486070370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30200ace00 0x7f30201ebd10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f30200ca190 tx=0x7f301400ff70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:58.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.054+0000 7f3007fff640 1 --2- 172.21.15.103:0/3486070370 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f300c06be30 0x7f300c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:58.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.054+0000 7f3007fff640 1 -- 172.21.15.103:0/3486070370 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f30100ab6a0 con 0x7f302006c650 2024-09-10T08:36:58.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.054+0000 7f301ffff640 1 --2- 172.21.15.103:0/3486070370 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f300c06be30 0x7f300c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:58.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.054+0000 7f3007fff640 1 -- 172.21.15.103:0/3486070370 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30140053a0 con 0x7f30200ace00 2024-09-10T08:36:58.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.054+0000 7f3007fff640 1 -- 172.21.15.103:0/3486070370 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3014018070 con 0x7f30200ace00 2024-09-10T08:36:58.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.054+0000 7f3007fff640 1 -- 172.21.15.103:0/3486070370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30200ace00 msgr2=0x7f30201ebd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:58.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.054+0000 7f3007fff640 1 --2- 172.21.15.103:0/3486070370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30200ace00 0x7f30201ebd10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f30200ca190 tx=0x7f301400ff70 comp rx=0 tx=0).stop 2024-09-10T08:36:58.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.054+0000 7f3007fff640 1 -- 172.21.15.103:0/3486070370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30200ace00 msgr2=0x7f30201ebd10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:36:58.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.054+0000 7f3007fff640 1 --2- 172.21.15.103:0/3486070370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30200ace00 0x7f30201ebd10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.055+0000 7f301ffff640 1 --2- 172.21.15.103:0/3486070370 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f300c06be30 0x7f300c06e2f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3018011340 tx=0x7f301800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:58.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.060+0000 7f3025cb7640 1 --2- 172.21.15.103:0/3486070370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3020148650 0x7f3020148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:58.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.060+0000 7f3025cb7640 1 -- 172.21.15.103:0/3486070370 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f302006c430 con 0x7f3020148650 2024-09-10T08:36:58.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.061+0000 7f301effd640 1 --2- 172.21.15.103:0/3486070370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3020148650 0x7f3020148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:58.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.061+0000 7f301effd640 1 -- 172.21.15.103:0/3486070370 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f30200abcd0 con 0x7f3020148650 2024-09-10T08:36:58.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.061+0000 7f301effd640 1 --2- 172.21.15.103:0/3486070370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3020148650 0x7f3020148a60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f30200ca190 tx=0x7f3014001080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:58.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.061+0000 7f3007fff640 1 -- 172.21.15.103:0/3486070370 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301400dcd0 con 0x7f3020148650 2024-09-10T08:36:58.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.062+0000 7f3007fff640 1 -- 172.21.15.103:0/3486070370 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f301400dcd0 con 0x7f3020148650 2024-09-10T08:36:58.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.062+0000 7f3007fff640 1 -- 172.21.15.103:0/3486070370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3020148650 msgr2=0x7f3020148a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:58.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.062+0000 7f3007fff640 1 --2- 172.21.15.103:0/3486070370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3020148650 0x7f3020148a60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f30200ca190 tx=0x7f3014001080 comp rx=0 tx=0).stop 2024-09-10T08:36:58.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.062+0000 7f3007fff640 1 -- 172.21.15.103:0/3486070370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3020148650 msgr2=0x7f3020148a60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:36:58.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.062+0000 7f3007fff640 1 --2- 172.21.15.103:0/3486070370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3020148650 0x7f3020148a60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.062 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:36:58.063 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:36:58.063 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:36:58.063 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:36:58.063 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 68, 2024-09-10T08:36:58.063 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 133818, 2024-09-10T08:36:58.063 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:36:58.063 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:36:58.063 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:36:58.063 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:36:58.063 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:58.064 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 14, 2024-09-10T08:36:58.064 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:36:58.064 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:36:58.064 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:36:58.064 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:58.064 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:58.064 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:58.064 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:58.064 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:58.064 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:58.065 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:58.065 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:58.065 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:58.065 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:58.065 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:58.065 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:58.065 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:36:58.065 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:36:58.065 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:58.065 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:58.065 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:58.066 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:58.066 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:58.066 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:58.066 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:58.066 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:58.066 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:58.066 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:58.066 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:58.066 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:58.066 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.066 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:36:58.067 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:36:58.067 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:36:58.067 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:36:58.067 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:36:58.067 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:36:58.067 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:36:58.067 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:36:58.067 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:36:58.067 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:36:58.067 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:36:58.068 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:36:58.068 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:36:58.068 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:36:58.068 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:36:58.068 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:36:58.068 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:36:58.068 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:58.068 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:58.068 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:58.068 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:58.068 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:58.069 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:58.069 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:58.069 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:58.069 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:58.069 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:58.069 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:58.069 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:58.069 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:36:58.069 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.069 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:36:58.070 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.070 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:36:58.070 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:36:58.070 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:58.070 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:58.070 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.070 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:58.070 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:36:58.070 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:58.070 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.070 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.070 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:58.071 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:36:58.071 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:58.071 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:58.071 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:58.071 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.071 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:36:58.071 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:36:58.071 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:58.071 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:58.071 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:58.072 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.072 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.072 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:36:58.072 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:36:58.072 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:58.072 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:58.072 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.072 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:58.072 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:36:58.072 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:58.072 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.073 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.073 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:58.073 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:36:58.073 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:58.073 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:58.073 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:58.073 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.073 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:36:58.073 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:36:58.073 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:58.073 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:58.073 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:58.074 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.074 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.074 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:36:58.074 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:36:58.074 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:58.074 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:58.074 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.074 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:58.074 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:36:58.074 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:58.074 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.075 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.075 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:58.075 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:36:58.075 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:58.075 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:58.075 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:58.075 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.075 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:36:58.075 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:36:58.075 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:58.075 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:58.075 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:58.075 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:58.076 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:58.076 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.076 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:36:58.076 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:36:58.076 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.076 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:58.076 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:58.076 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:36:58.076 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:58.076 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:58.076 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:36:58.076 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.076 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:58.077 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:58.077 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:36:58.077 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:58.077 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:58.077 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:36:58.077 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.077 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:58.077 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:58.077 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:36:58.077 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:58.077 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:58.077 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:36:58.077 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.078 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:58.078 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:58.078 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:36:58.078 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:58.078 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:58.078 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:36:58.078 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.078 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:58.078 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:58.078 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:36:58.078 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:58.078 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:58.078 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.078 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:36:58.079 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:36:58.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.062+0000 7f3025cb7640 1 -- 172.21.15.103:0/3486070370 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f300c06be30 msgr2=0x7f300c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:58.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.062+0000 7f3025cb7640 1 --2- 172.21.15.103:0/3486070370 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f300c06be30 0x7f300c06e2f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3018011340 tx=0x7f301800b040 comp rx=0 tx=0).stop 2024-09-10T08:36:58.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.062+0000 7f3025cb7640 1 -- 172.21.15.103:0/3486070370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f302006c650 msgr2=0x7f30201efcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:58.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.062+0000 7f3025cb7640 1 --2- 172.21.15.103:0/3486070370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f302006c650 0x7f30201efcd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3010035040 tx=0x7f30100046c0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.062+0000 7f301ffff640 1 -- 172.21.15.103:0/3486070370 reap_dead start 2024-09-10T08:36:58.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.062+0000 7f301ffff640 1 -- 172.21.15.103:0/3486070370 reap_dead start 2024-09-10T08:36:58.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.062+0000 7f3025cb7640 1 -- 172.21.15.103:0/3486070370 shutdown_connections 2024-09-10T08:36:58.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.062+0000 7f3025cb7640 1 -- 172.21.15.103:0/3486070370 >> 172.21.15.103:0/3486070370 conn(0x7f3020068030 msgr2=0x7f3020158ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:58.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.062+0000 7f3025cb7640 1 -- 172.21.15.103:0/3486070370 shutdown_connections 2024-09-10T08:36:58.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.062+0000 7f3025cb7640 1 -- 172.21.15.103:0/3486070370 wait complete. 2024-09-10T08:36:58.081 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:36:58.081 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:36:58.081 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:36:58.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.193+0000 7fcc689af640 1 Processor -- start 2024-09-10T08:36:58.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.194+0000 7fcc689af640 1 -- start start 2024-09-10T08:36:58.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.194+0000 7fcc689af640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcc64151780 0x7fcc64155560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:58.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.195+0000 7fcc689af640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc640703b0 0x7fcc6415e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:58.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.195+0000 7fcc689af640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc64154ff0 con 0x7fcc64154ac0 2024-09-10T08:36:58.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.195+0000 7fcc689af640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fcc6406f5f0 con 0x7fcc64151780 2024-09-10T08:36:58.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.195+0000 7fcc689af640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcc6406f8d0 con 0x7fcc640703b0 2024-09-10T08:36:58.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.195+0000 7fcc6259c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcc64151780 0x7fcc64155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:58.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.195+0000 7fcc62d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc640703b0 0x7fcc6415e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:58.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.195+0000 7fcc61d9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcc64154ac0 0x7fcc640708a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:41942/0 (socket says 172.21.15.103:41942) 2024-09-10T08:36:58.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.195+0000 7fcc61d9b640 1 -- 172.21.15.103:0/1570883126 learned_addr learned my addr 172.21.15.103:0/1570883126 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:36:58.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.195+0000 7fcc6259c640 1 -- 172.21.15.103:0/1570883126 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc640703b0 msgr2=0x7fcc6415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:58.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.195+0000 7fcc6259c640 1 --2- 172.21.15.103:0/1570883126 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc640703b0 0x7fcc6415e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.195+0000 7fcc6259c640 1 -- 172.21.15.103:0/1570883126 >> v1:172.21.15.154:6789/0 conn(0x7fcc64154ac0 legacy=0x7fcc640708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:58.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.195+0000 7fcc6259c640 1 -- 172.21.15.103:0/1570883126 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc6406fbb0 con 0x7fcc64151780 2024-09-10T08:36:58.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.196+0000 7fcc6259c640 1 --2- 172.21.15.103:0/1570883126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc64151780 0x7fcc64155560 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcc540097a0 tx=0x7fcc5402a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c13947642a1fc9e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:58.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.196+0000 7fcc6159a640 1 -- 172.21.15.103:0/1570883126 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc54037070 con 0x7fcc64151780 2024-09-10T08:36:58.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.196+0000 7fcc6159a640 1 -- 172.21.15.103:0/1570883126 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc5402adb0 con 0x7fcc64151780 2024-09-10T08:36:58.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.196+0000 7fcc6159a640 1 -- 172.21.15.103:0/1570883126 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc54032660 con 0x7fcc64151780 2024-09-10T08:36:58.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.197+0000 7fcc689af640 1 -- 172.21.15.103:0/1570883126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc64151780 msgr2=0x7fcc64155560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:58.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.197+0000 7fcc689af640 1 --2- 172.21.15.103:0/1570883126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc64151780 0x7fcc64155560 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcc540097a0 tx=0x7fcc5402a060 comp rx=0 tx=0).stop 2024-09-10T08:36:58.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.197+0000 7fcc689af640 1 -- 172.21.15.103:0/1570883126 shutdown_connections 2024-09-10T08:36:58.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.197+0000 7fcc689af640 1 --2- 172.21.15.103:0/1570883126 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc640703b0 0x7fcc6415e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.197+0000 7fcc689af640 1 --2- 172.21.15.103:0/1570883126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc64151780 0x7fcc64155560 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.197+0000 7fcc689af640 1 -- 172.21.15.103:0/1570883126 >> 172.21.15.103:0/1570883126 conn(0x7fcc640c6980 msgr2=0x7fcc640c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:58.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.197+0000 7fcc689af640 1 -- 172.21.15.103:0/1570883126 shutdown_connections 2024-09-10T08:36:58.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.197+0000 7fcc689af640 1 -- 172.21.15.103:0/1570883126 wait complete. 2024-09-10T08:36:58.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.199+0000 7fcc689af640 1 Processor -- start 2024-09-10T08:36:58.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.199+0000 7fcc689af640 1 -- start start 2024-09-10T08:36:58.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.200+0000 7fcc689af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc640703b0 0x7fcc641502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:58.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.200+0000 7fcc689af640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc64151780 0x7fcc64152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:58.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.200+0000 7fcc689af640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc64154ac0 0x7fcc640ac430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:58.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.200+0000 7fcc689af640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcc64071130 con 0x7fcc64151780 2024-09-10T08:36:58.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.200+0000 7fcc689af640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcc64070fb0 con 0x7fcc640703b0 2024-09-10T08:36:58.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.200+0000 7fcc689af640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcc64073f30 con 0x7fcc64154ac0 2024-09-10T08:36:58.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.200+0000 7fcc61d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc64151780 0x7fcc64152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:58.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.200+0000 7fcc61d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc64151780 0x7fcc64152f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60740/0 (socket says 172.21.15.103:60740) 2024-09-10T08:36:58.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.200+0000 7fcc61d9b640 1 -- 172.21.15.103:0/2663550671 learned_addr learned my addr 172.21.15.103:0/2663550671 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:58.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.200+0000 7fcc6259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc640703b0 0x7fcc641502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:58.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.200+0000 7fcc62d9d640 1 --2- 172.21.15.103:0/2663550671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc64154ac0 0x7fcc640ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:58.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.200+0000 7fcc61d9b640 1 -- 172.21.15.103:0/2663550671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc64154ac0 msgr2=0x7fcc640ac430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:58.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.200+0000 7fcc61d9b640 1 --2- 172.21.15.103:0/2663550671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc64154ac0 0x7fcc640ac430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.200+0000 7fcc61d9b640 1 -- 172.21.15.103:0/2663550671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc640703b0 msgr2=0x7fcc641502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:58.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.200+0000 7fcc61d9b640 1 --2- 172.21.15.103:0/2663550671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc640703b0 0x7fcc641502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.200+0000 7fcc61d9b640 1 -- 172.21.15.103:0/2663550671 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc64153f20 con 0x7fcc64151780 2024-09-10T08:36:58.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.200+0000 7fcc61d9b640 1 --2- 172.21.15.103:0/2663550671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc64151780 0x7fcc64152f30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800c440 tx=0x7fcc5800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:58.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.200+0000 7fcc52ffd640 1 -- 172.21.15.103:0/2663550671 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc58017070 con 0x7fcc64151780 2024-09-10T08:36:58.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.200+0000 7fcc52ffd640 1 -- 172.21.15.103:0/2663550671 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc58005ce0 con 0x7fcc64151780 2024-09-10T08:36:58.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.200+0000 7fcc52ffd640 1 -- 172.21.15.103:0/2663550671 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc580072f0 con 0x7fcc64151780 2024-09-10T08:36:58.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.200+0000 7fcc689af640 1 -- 172.21.15.103:0/2663550671 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc641e9fc0 con 0x7fcc64151780 2024-09-10T08:36:58.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.200+0000 7fcc689af640 1 -- 172.21.15.103:0/2663550671 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc641ea580 con 0x7fcc64151780 2024-09-10T08:36:58.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.201+0000 7fcc689af640 1 --2- 172.21.15.103:0/2663550671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc640ae770 0x7fcc641574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:58.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.201+0000 7fcc689af640 1 -- 172.21.15.103:0/2663550671 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcc64073ca0 con 0x7fcc640ae770 2024-09-10T08:36:58.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.202+0000 7fcc6259c640 1 --2- 172.21.15.103:0/2663550671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc640ae770 0x7fcc641574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:58.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.202+0000 7fcc6259c640 1 -- 172.21.15.103:0/2663550671 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc64158250 con 0x7fcc640ae770 2024-09-10T08:36:58.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.202+0000 7fcc6259c640 1 --2- 172.21.15.103:0/2663550671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc640ae770 0x7fcc641574e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcc64072620 tx=0x7fcc540046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:58.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.203+0000 7fcc52ffd640 1 -- 172.21.15.103:0/2663550671 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc5801a070 con 0x7fcc64151780 2024-09-10T08:36:58.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.203+0000 7fcc52ffd640 1 --2- 172.21.15.103:0/2663550671 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcc4406be30 0x7fcc4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:58.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.203+0000 7fcc52ffd640 1 -- 172.21.15.103:0/2663550671 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fcc5808a400 con 0x7fcc64151780 2024-09-10T08:36:58.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.203+0000 7fcc62d9d640 1 --2- 172.21.15.103:0/2663550671 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcc4406be30 0x7fcc4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:58.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.203+0000 7fcc52ffd640 1 -- 172.21.15.103:0/2663550671 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc54037040 con 0x7fcc640ae770 2024-09-10T08:36:58.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.203+0000 7fcc52ffd640 1 -- 172.21.15.103:0/2663550671 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fcc54032d40 con 0x7fcc640ae770 2024-09-10T08:36:58.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.203+0000 7fcc52ffd640 1 -- 172.21.15.103:0/2663550671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc640ae770 msgr2=0x7fcc641574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:58.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.203+0000 7fcc52ffd640 1 --2- 172.21.15.103:0/2663550671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc640ae770 0x7fcc641574e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcc64072620 tx=0x7fcc540046c0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.203+0000 7fcc52ffd640 1 -- 172.21.15.103:0/2663550671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc640ae770 msgr2=0x7fcc641574e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:36:58.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.203+0000 7fcc52ffd640 1 --2- 172.21.15.103:0/2663550671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc640ae770 0x7fcc641574e0 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcc64072620 tx=0x7fcc540046c0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.204+0000 7fcc62d9d640 1 --2- 172.21.15.103:0/2663550671 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcc4406be30 0x7fcc4406e2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c0113e0 tx=0x7fcc5c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:58.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.209+0000 7fcc689af640 1 --2- 172.21.15.103:0/2663550671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc64150c20 0x7fcc641ed270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:58.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.209+0000 7fcc689af640 1 -- 172.21.15.103:0/2663550671 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcc641e9ca0 con 0x7fcc64150c20 2024-09-10T08:36:58.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.210+0000 7fcc6259c640 1 --2- 172.21.15.103:0/2663550671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc64150c20 0x7fcc641ed270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:58.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.210+0000 7fcc6259c640 1 -- 172.21.15.103:0/2663550671 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcc64075850 con 0x7fcc64150c20 2024-09-10T08:36:58.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.210+0000 7fcc6259c640 1 --2- 172.21.15.103:0/2663550671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc64150c20 0x7fcc641ed270 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcc64073e20 tx=0x7fcc54009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:58.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.210+0000 7fcc52ffd640 1 -- 172.21.15.103:0/2663550671 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5403c820 con 0x7fcc64150c20 2024-09-10T08:36:58.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.211+0000 7fcc52ffd640 1 -- 172.21.15.103:0/2663550671 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7fcc5403c820 con 0x7fcc64150c20 2024-09-10T08:36:58.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.211+0000 7fcc52ffd640 1 -- 172.21.15.103:0/2663550671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc64150c20 msgr2=0x7fcc641ed270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:58.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.211+0000 7fcc52ffd640 1 --2- 172.21.15.103:0/2663550671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc64150c20 0x7fcc641ed270 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcc64073e20 tx=0x7fcc54009190 comp rx=0 tx=0).stop 2024-09-10T08:36:58.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.211+0000 7fcc52ffd640 1 -- 172.21.15.103:0/2663550671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc64150c20 msgr2=0x7fcc641ed270 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:36:58.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.211+0000 7fcc52ffd640 1 --2- 172.21.15.103:0/2663550671 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc64150c20 0x7fcc641ed270 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcc64073e20 tx=0x7fcc54009190 comp rx=0 tx=0).stop 2024-09-10T08:36:58.211 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:36:58.211 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:36:58.211 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:36:58.211 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:36:58.211 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 68, 2024-09-10T08:36:58.212 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 24326, 2024-09-10T08:36:58.212 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:36:58.212 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:36:58.212 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:36:58.212 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:36:58.212 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:58.212 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 14, 2024-09-10T08:36:58.212 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:36:58.212 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:36:58.212 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:36:58.213 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:58.213 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:58.213 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:58.213 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:58.213 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:58.213 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:58.213 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:58.213 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:58.213 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:58.213 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:58.213 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:58.213 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:58.214 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:36:58.214 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:36:58.214 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:58.214 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:58.214 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:58.214 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:58.214 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:58.214 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:58.214 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:58.214 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:58.214 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:58.214 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:58.214 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:58.214 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:58.215 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.215 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:36:58.215 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:36:58.215 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:36:58.215 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:36:58.215 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:36:58.215 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:36:58.215 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:36:58.215 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:36:58.215 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:36:58.215 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:36:58.215 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:36:58.215 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:36:58.216 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:36:58.216 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:36:58.216 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:36:58.216 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:36:58.216 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:36:58.216 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:36:58.216 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:36:58.216 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:36:58.216 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:36:58.216 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:36:58.216 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:36:58.216 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:36:58.217 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:36:58.217 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:36:58.217 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:36:58.217 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:36:58.217 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:58.217 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:36:58.217 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.217 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:36:58.217 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.217 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:36:58.218 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:36:58.218 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:58.218 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:58.218 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.218 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:58.218 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:36:58.218 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:58.218 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.218 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.218 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:58.218 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:36:58.219 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:58.219 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:58.219 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:58.219 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.219 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:36:58.219 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:36:58.219 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:58.219 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:58.219 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:58.219 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.220 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.220 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:36:58.220 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:36:58.220 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:58.220 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:58.220 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.220 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:58.220 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:36:58.220 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:58.220 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.220 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.220 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:58.221 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:36:58.221 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:58.221 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:58.221 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:58.221 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.221 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:36:58.221 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:36:58.221 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:58.221 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:58.221 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:58.222 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.222 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.222 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:36:58.222 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:36:58.222 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:36:58.222 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:36:58.222 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.222 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:36:58.222 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:36:58.222 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:58.222 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.222 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.223 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:36:58.223 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:36:58.223 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:36:58.223 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:58.223 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:58.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.223 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:36:58.223 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:36:58.223 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:36:58.223 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:36:58.223 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:36:58.224 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:58.224 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:58.224 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.224 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:36:58.224 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:36:58.224 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.224 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:58.224 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:58.224 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:36:58.224 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:58.225 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:36:58.225 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:36:58.225 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:36:58.225 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:36:58.225 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:36:58.225 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:36:58.225 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:36:58.225 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:36:58.225 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:36:58.225 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:36:58.225 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:36:58.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.211+0000 7fcc689af640 1 -- 172.21.15.103:0/2663550671 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcc4406be30 msgr2=0x7fcc4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:58.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.211+0000 7fcc689af640 1 --2- 172.21.15.103:0/2663550671 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcc4406be30 0x7fcc4406e2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c0113e0 tx=0x7fcc5c00b040 comp rx=0 tx=0).stop 2024-09-10T08:36:58.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.211+0000 7fcc689af640 1 -- 172.21.15.103:0/2663550671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc64151780 msgr2=0x7fcc64152f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:58.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.211+0000 7fcc689af640 1 --2- 172.21.15.103:0/2663550671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc64151780 0x7fcc64152f30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800c440 tx=0x7fcc5800c900 comp rx=0 tx=0).stop 2024-09-10T08:36:58.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.211+0000 7fcc62d9d640 1 -- 172.21.15.103:0/2663550671 reap_dead start 2024-09-10T08:36:58.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.211+0000 7fcc62d9d640 1 -- 172.21.15.103:0/2663550671 reap_dead start 2024-09-10T08:36:58.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.211+0000 7fcc689af640 1 -- 172.21.15.103:0/2663550671 shutdown_connections 2024-09-10T08:36:58.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.211+0000 7fcc689af640 1 -- 172.21.15.103:0/2663550671 >> 172.21.15.103:0/2663550671 conn(0x7fcc640c6980 msgr2=0x7fcc641dff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:58.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.211+0000 7fcc689af640 1 -- 172.21.15.103:0/2663550671 shutdown_connections 2024-09-10T08:36:58.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.211+0000 7fcc689af640 1 -- 172.21.15.103:0/2663550671 wait complete. 2024-09-10T08:36:58.228 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:36:58.229 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-09-10T08:36:58.229 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-10T08:36:58.229 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-10T08:36:58.229 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-10T08:36:58.229 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T08:36:58.229 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:36:58.241 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T08:36:58.242 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-10T08:36:58.242 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:36:58.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.359+0000 7f8d26ffd640 1 Processor -- start 2024-09-10T08:36:58.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.359+0000 7f8d26ffd640 1 -- start start 2024-09-10T08:36:58.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.360+0000 7f8d26ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8d200acc30 0x7f8d200c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.360+0000 7f8d26ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8d200c44b0 0x7f8d200c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.360+0000 7f8d26ffd640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d20070590 con 0x7f8d200c7fb0 2024-09-10T08:36:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.360+0000 7f8d26ffd640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f8d200c4ea0 con 0x7f8d200acc30 2024-09-10T08:36:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.360+0000 7f8d26ffd640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8d200a8220 con 0x7f8d200c44b0 2024-09-10T08:36:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.360+0000 7f8d1ffff640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7f8d200c44b0 msgr2=0x7f8d200c7a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:36:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.360+0000 7f8d1ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8d200c44b0 0x7f8d200c7a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:36:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.360+0000 7f8d24d99640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8d200acc30 0x7f8d200c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.360+0000 7f8d2559a640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8d200c7fb0 0x7f8d20156a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48114/0 (socket says 172.21.15.103:48114) 2024-09-10T08:36:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.360+0000 7f8d24d99640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8d200acc30 0x7f8d200c3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60784/0 (socket says 172.21.15.103:60784) 2024-09-10T08:36:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.360+0000 7f8d2559a640 1 -- 172.21.15.103:0/3717684900 learned_addr learned my addr 172.21.15.103:0/3717684900 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:36:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.360+0000 7f8d24d99640 1 -- 172.21.15.103:0/3717684900 >> v2:172.21.15.154:3300/0 conn(0x7f8d200c44b0 msgr2=0x7f8d200c7a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:36:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.360+0000 7f8d24d99640 1 --2- 172.21.15.103:0/3717684900 >> v2:172.21.15.154:3300/0 conn(0x7f8d200c44b0 0x7f8d200c7a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.360+0000 7f8d24d99640 1 -- 172.21.15.103:0/3717684900 >> v1:172.21.15.103:6789/0 conn(0x7f8d200c7fb0 legacy=0x7f8d20156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.361+0000 7f8d1f7fe640 1 -- 172.21.15.103:0/3717684900 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 356364077 0 0) 0x7f8d20070590 con 0x7f8d200c7fb0 2024-09-10T08:36:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.361+0000 7f8d24d99640 1 -- 172.21.15.103:0/3717684900 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d200a84f0 con 0x7f8d200acc30 2024-09-10T08:36:58.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.361+0000 7f8d24d99640 1 --2- 172.21.15.103:0/3717684900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d200acc30 0x7f8d200c3f70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8d200c4c60 tx=0x7f8d1402a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a4c97beac02cdd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.362+0000 7f8d1f7fe640 1 -- 172.21.15.103:0/3717684900 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d14037070 con 0x7f8d200acc30 2024-09-10T08:36:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.362+0000 7f8d1f7fe640 1 -- 172.21.15.103:0/3717684900 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d1402adf0 con 0x7f8d200acc30 2024-09-10T08:36:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.362+0000 7f8d1f7fe640 1 -- 172.21.15.103:0/3717684900 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d14032660 con 0x7f8d200acc30 2024-09-10T08:36:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.362+0000 7f8d26ffd640 1 -- 172.21.15.103:0/3717684900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d200acc30 msgr2=0x7f8d200c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.362+0000 7f8d26ffd640 1 --2- 172.21.15.103:0/3717684900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d200acc30 0x7f8d200c3f70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8d200c4c60 tx=0x7f8d1402a0a0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.362+0000 7f8d26ffd640 1 -- 172.21.15.103:0/3717684900 shutdown_connections 2024-09-10T08:36:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.362+0000 7f8d26ffd640 1 --2- 172.21.15.103:0/3717684900 >> v2:172.21.15.154:3300/0 conn(0x7f8d200c44b0 0x7f8d200c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.362+0000 7f8d26ffd640 1 --2- 172.21.15.103:0/3717684900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d200acc30 0x7f8d200c3f70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.362+0000 7f8d26ffd640 1 -- 172.21.15.103:0/3717684900 >> 172.21.15.103:0/3717684900 conn(0x7f8d200c5660 msgr2=0x7f8d200c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.362+0000 7f8d26ffd640 1 -- 172.21.15.103:0/3717684900 shutdown_connections 2024-09-10T08:36:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.362+0000 7f8d26ffd640 1 -- 172.21.15.103:0/3717684900 wait complete. 2024-09-10T08:36:58.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.363+0000 7f8d26ffd640 1 Processor -- start 2024-09-10T08:36:58.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.363+0000 7f8d26ffd640 1 -- start start 2024-09-10T08:36:58.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.365+0000 7f8d26ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d200acc30 0x7f8d20156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:58.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.365+0000 7f8d26ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d200c44b0 0x7f8d201eafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:58.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.365+0000 7f8d26ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d200c7fb0 0x7f8d2014cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:58.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.365+0000 7f8d26ffd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8d200c5330 con 0x7f8d200acc30 2024-09-10T08:36:58.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.365+0000 7f8d26ffd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8d200702b0 con 0x7f8d200c7fb0 2024-09-10T08:36:58.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.365+0000 7f8d26ffd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8d200c63f0 con 0x7f8d200c44b0 2024-09-10T08:36:58.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.365+0000 7f8d2559a640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d200c7fb0 msgr2=0x7f8d2014cb30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:36:58.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.365+0000 7f8d24d99640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d200acc30 0x7f8d20156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:58.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.365+0000 7f8d2559a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d200c7fb0 0x7f8d2014cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:36:58.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.365+0000 7f8d24d99640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d200acc30 0x7f8d20156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60792/0 (socket says 172.21.15.103:60792) 2024-09-10T08:36:58.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.365+0000 7f8d24d99640 1 -- 172.21.15.103:0/751683813 learned_addr learned my addr 172.21.15.103:0/751683813 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:36:58.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.365+0000 7f8d1ffff640 1 --2- 172.21.15.103:0/751683813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d200c44b0 0x7f8d201eafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:58.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.365+0000 7f8d24d99640 1 -- 172.21.15.103:0/751683813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d200c44b0 msgr2=0x7f8d201eafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:58.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.365+0000 7f8d24d99640 1 --2- 172.21.15.103:0/751683813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d200c44b0 0x7f8d201eafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.365+0000 7f8d24d99640 1 -- 172.21.15.103:0/751683813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d200c7fb0 msgr2=0x7f8d2014cb30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:36:58.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.365+0000 7f8d24d99640 1 --2- 172.21.15.103:0/751683813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d200c7fb0 0x7f8d2014cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.365+0000 7f8d24d99640 1 -- 172.21.15.103:0/751683813 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d20154fc0 con 0x7f8d200acc30 2024-09-10T08:36:58.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.365+0000 7f8d24d99640 1 --2- 172.21.15.103:0/751683813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d200acc30 0x7f8d20156780 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8d14000c00 tx=0x7f8d140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:58.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.365+0000 7f8d1d7fa640 1 -- 172.21.15.103:0/751683813 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d14037040 con 0x7f8d200acc30 2024-09-10T08:36:58.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.365+0000 7f8d1d7fa640 1 -- 172.21.15.103:0/751683813 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d14032e30 con 0x7f8d200acc30 2024-09-10T08:36:58.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.365+0000 7f8d26ffd640 1 -- 172.21.15.103:0/751683813 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d20157200 con 0x7f8d200acc30 2024-09-10T08:36:58.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.365+0000 7f8d1d7fa640 1 -- 172.21.15.103:0/751683813 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d14004230 con 0x7f8d200acc30 2024-09-10T08:36:58.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.366+0000 7f8d26ffd640 1 -- 172.21.15.103:0/751683813 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d2006ddd0 con 0x7f8d200acc30 2024-09-10T08:36:58.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.367+0000 7f8d26ffd640 1 -- 172.21.15.103:0/751683813 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d200aba00 con 0x7f8d200acc30 2024-09-10T08:36:58.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.367+0000 7f8d1d7fa640 1 -- 172.21.15.103:0/751683813 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d1403a040 con 0x7f8d200acc30 2024-09-10T08:36:58.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.367+0000 7f8d1d7fa640 1 --2- 172.21.15.103:0/751683813 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8d0406bde0 0x7f8d0406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:58.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.368+0000 7f8d1d7fa640 1 -- 172.21.15.103:0/751683813 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f8d140ab780 con 0x7f8d200acc30 2024-09-10T08:36:58.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.368+0000 7f8d1ffff640 1 --2- 172.21.15.103:0/751683813 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8d0406bde0 0x7f8d0406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:58.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.368+0000 7f8d1ffff640 1 --2- 172.21.15.103:0/751683813 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8d0406bde0 0x7f8d0406e2a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8d2006f000 tx=0x7f8d0c003b90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:58.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.373+0000 7f8d1d7fa640 1 -- 172.21.15.103:0/751683813 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d200aba00 con 0x7f8d200acc30 2024-09-10T08:36:58.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.658+0000 7f8d26ffd640 1 -- 172.21.15.103:0/751683813 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8d2006d770 con 0x7f8d200acc30 2024-09-10T08:36:58.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.658+0000 7f8d1d7fa640 1 -- 172.21.15.103:0/751683813 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f8d2006d770 con 0x7f8d200acc30 2024-09-10T08:36:58.658 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":68,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:36:58.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.661+0000 7f8d26ffd640 1 -- 172.21.15.103:0/751683813 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8d0406bde0 msgr2=0x7f8d0406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:58.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.661+0000 7f8d26ffd640 1 --2- 172.21.15.103:0/751683813 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8d0406bde0 0x7f8d0406e2a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8d2006f000 tx=0x7f8d0c003b90 comp rx=0 tx=0).stop 2024-09-10T08:36:58.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.661+0000 7f8d26ffd640 1 -- 172.21.15.103:0/751683813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d200acc30 msgr2=0x7f8d20156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:58.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.661+0000 7f8d26ffd640 1 --2- 172.21.15.103:0/751683813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d200acc30 0x7f8d20156780 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8d14000c00 tx=0x7f8d140046c0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.661+0000 7f8d26ffd640 1 -- 172.21.15.103:0/751683813 shutdown_connections 2024-09-10T08:36:58.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.661+0000 7f8d26ffd640 1 --2- 172.21.15.103:0/751683813 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8d0406bde0 0x7f8d0406e2a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.661+0000 7f8d26ffd640 1 --2- 172.21.15.103:0/751683813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d200c7fb0 0x7f8d2014cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.661+0000 7f8d26ffd640 1 --2- 172.21.15.103:0/751683813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d200c44b0 0x7f8d201eafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.661+0000 7f8d26ffd640 1 --2- 172.21.15.103:0/751683813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d200acc30 0x7f8d20156780 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:58.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.661+0000 7f8d26ffd640 1 -- 172.21.15.103:0/751683813 >> 172.21.15.103:0/751683813 conn(0x7f8d200c5660 msgr2=0x7f8d200a9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:58.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.661+0000 7f8d26ffd640 1 -- 172.21.15.103:0/751683813 shutdown_connections 2024-09-10T08:36:58.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:36:58.661+0000 7f8d26ffd640 1 -- 172.21.15.103:0/751683813 wait complete. 2024-09-10T08:37:01.341 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:37:01.344 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:37:01.673 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:37:01.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.777+0000 7f599513b640 1 Processor -- start 2024-09-10T08:37:01.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.777+0000 7f599513b640 1 -- start start 2024-09-10T08:37:01.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.778+0000 7f599513b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5990153be0 0x7f599015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:01.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.778+0000 7f599513b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59900c7070 con 0x7f59900c8b10 2024-09-10T08:37:01.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.778+0000 7f599513b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f599006d210 con 0x7f599006cd80 2024-09-10T08:37:01.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.778+0000 7f599513b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f59900c69b0 con 0x7f5990153be0 2024-09-10T08:37:01.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.778+0000 7f598e59c640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f599006cd80 legacy=0x7f5990156660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:37:01.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.778+0000 7f598ed9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f59900c8b10 0x7f59901534d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48122/0 (socket says 172.21.15.103:48122) 2024-09-10T08:37:01.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.778+0000 7f598ed9d640 1 -- 172.21.15.103:0/811137810 learned_addr learned my addr 172.21.15.103:0/811137810 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:37:01.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.778+0000 7f598f59e640 1 --2- 172.21.15.103:0/811137810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5990153be0 0x7f599015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:01.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.778+0000 7f598dd9b640 1 -- 172.21.15.103:0/811137810 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3378925190 0 0) 0x7f59900c7070 con 0x7f59900c8b10 2024-09-10T08:37:01.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.778+0000 7f598dd9b640 1 -- 172.21.15.103:0/811137810 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5978003520 con 0x7f59900c8b10 2024-09-10T08:37:01.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.778+0000 7f598f59e640 1 -- 172.21.15.103:0/811137810 >> v1:172.21.15.154:6789/0 conn(0x7f599006cd80 legacy=0x7f5990156660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:37:01.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.778+0000 7f598f59e640 1 -- 172.21.15.103:0/811137810 >> v1:172.21.15.103:6789/0 conn(0x7f59900c8b10 legacy=0x7f59901534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:01.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.778+0000 7f598f59e640 1 -- 172.21.15.103:0/811137810 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59900c6c90 con 0x7f5990153be0 2024-09-10T08:37:01.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.779+0000 7f598f59e640 1 --2- 172.21.15.103:0/811137810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5990153be0 0x7f599015a4a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5988009dc0 tx=0x7f598802a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a2d0e5d5f61c518 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:01.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.779+0000 7f598dd9b640 1 -- 172.21.15.103:0/811137810 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5988007740 con 0x7f5990153be0 2024-09-10T08:37:01.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.779+0000 7f598dd9b640 1 -- 172.21.15.103:0/811137810 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59880078e0 con 0x7f5990153be0 2024-09-10T08:37:01.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.779+0000 7f598dd9b640 1 -- 172.21.15.103:0/811137810 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5988007cb0 con 0x7f5990153be0 2024-09-10T08:37:01.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.780+0000 7f599513b640 1 -- 172.21.15.103:0/811137810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5990153be0 msgr2=0x7f599015a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:01.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.780+0000 7f599513b640 1 --2- 172.21.15.103:0/811137810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5990153be0 0x7f599015a4a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5988009dc0 tx=0x7f598802a5f0 comp rx=0 tx=0).stop 2024-09-10T08:37:01.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.780+0000 7f599513b640 1 -- 172.21.15.103:0/811137810 shutdown_connections 2024-09-10T08:37:01.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.780+0000 7f599513b640 1 --2- 172.21.15.103:0/811137810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5990153be0 0x7f599015a4a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:01.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.780+0000 7f599513b640 1 -- 172.21.15.103:0/811137810 >> 172.21.15.103:0/811137810 conn(0x7f59900adb80 msgr2=0x7f59900adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:01.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.780+0000 7f599513b640 1 -- 172.21.15.103:0/811137810 shutdown_connections 2024-09-10T08:37:01.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.780+0000 7f599513b640 1 -- 172.21.15.103:0/811137810 wait complete. 2024-09-10T08:37:01.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.782+0000 7f599513b640 1 Processor -- start 2024-09-10T08:37:01.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.782+0000 7f599513b640 1 -- start start 2024-09-10T08:37:01.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.782+0000 7f599513b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59900c8b10 0x7f59900acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:01.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.783+0000 7f599513b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5990153be0 0x7f59901ec3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:01.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.783+0000 7f599513b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59901dfc60 0x7f5990148aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:01.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.783+0000 7f599513b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f59900c9070 con 0x7f5990153be0 2024-09-10T08:37:01.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.783+0000 7f599513b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f59900c8ef0 con 0x7f59900c8b10 2024-09-10T08:37:01.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.783+0000 7f599513b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5990156d70 con 0x7f59901dfc60 2024-09-10T08:37:01.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.783+0000 7f598ed9d640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59900c8b10 msgr2=0x7f59900acfc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:37:01.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.783+0000 7f598ed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59900c8b10 0x7f59900acfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:37:01.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.783+0000 7f598e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5990153be0 0x7f59901ec3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:01.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.783+0000 7f598e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5990153be0 0x7f59901ec3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60794/0 (socket says 172.21.15.103:60794) 2024-09-10T08:37:01.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.783+0000 7f598e59c640 1 -- 172.21.15.103:0/3776163173 learned_addr learned my addr 172.21.15.103:0/3776163173 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:01.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.783+0000 7f598f59e640 1 --2- 172.21.15.103:0/3776163173 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59901dfc60 0x7f5990148aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:01.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.783+0000 7f598e59c640 1 -- 172.21.15.103:0/3776163173 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59901dfc60 msgr2=0x7f5990148aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:01.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.783+0000 7f598e59c640 1 --2- 172.21.15.103:0/3776163173 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59901dfc60 0x7f5990148aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:01.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.783+0000 7f598e59c640 1 -- 172.21.15.103:0/3776163173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59900c8b10 msgr2=0x7f59900acfc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:37:01.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.783+0000 7f598e59c640 1 --2- 172.21.15.103:0/3776163173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59900c8b10 0x7f59900acfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:01.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.783+0000 7f598e59c640 1 -- 172.21.15.103:0/3776163173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59900ad5a0 con 0x7f5990153be0 2024-09-10T08:37:01.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.783+0000 7f598e59c640 1 --2- 172.21.15.103:0/3776163173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5990153be0 0x7f59901ec3a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f598400b550 tx=0x7f598400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:01.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.783+0000 7f59777fe640 1 -- 172.21.15.103:0/3776163173 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5984013020 con 0x7f5990153be0 2024-09-10T08:37:01.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.783+0000 7f59777fe640 1 -- 172.21.15.103:0/3776163173 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5984003de0 con 0x7f5990153be0 2024-09-10T08:37:01.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.784+0000 7f599513b640 1 -- 172.21.15.103:0/3776163173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59900ad880 con 0x7f5990153be0 2024-09-10T08:37:01.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.784+0000 7f59777fe640 1 -- 172.21.15.103:0/3776163173 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59840052b0 con 0x7f5990153be0 2024-09-10T08:37:01.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.784+0000 7f599513b640 1 -- 172.21.15.103:0/3776163173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59900abd70 con 0x7f5990153be0 2024-09-10T08:37:01.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.785+0000 7f599513b640 1 -- 172.21.15.103:0/3776163173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5990157150 con 0x7f5990153be0 2024-09-10T08:37:01.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.785+0000 7f59777fe640 1 -- 172.21.15.103:0/3776163173 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5984016020 con 0x7f5990153be0 2024-09-10T08:37:01.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.786+0000 7f59777fe640 1 --2- 172.21.15.103:0/3776163173 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f597c06bde0 0x7f597c06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:01.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.786+0000 7f59777fe640 1 -- 172.21.15.103:0/3776163173 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f598408aca0 con 0x7f5990153be0 2024-09-10T08:37:01.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.786+0000 7f598ed9d640 1 --2- 172.21.15.103:0/3776163173 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f597c06bde0 0x7f597c06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:01.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.786+0000 7f598ed9d640 1 --2- 172.21.15.103:0/3776163173 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f597c06bde0 0x7f597c06e2a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5980000c00 tx=0x7f5980007a10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:01.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:01.790+0000 7f59777fe640 1 -- 172.21.15.103:0/3776163173 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f598401d020 con 0x7f5990153be0 2024-09-10T08:37:02.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:02.081+0000 7f599513b640 1 -- 172.21.15.103:0/3776163173 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f59900c9d90 con 0x7f5990153be0 2024-09-10T08:37:02.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:02.081+0000 7f59777fe640 1 -- 172.21.15.103:0/3776163173 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f5984059340 con 0x7f5990153be0 2024-09-10T08:37:02.081 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":68,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:37:02.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:02.084+0000 7f599513b640 1 -- 172.21.15.103:0/3776163173 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f597c06bde0 msgr2=0x7f597c06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:02.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:02.084+0000 7f599513b640 1 --2- 172.21.15.103:0/3776163173 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f597c06bde0 0x7f597c06e2a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5980000c00 tx=0x7f5980007a10 comp rx=0 tx=0).stop 2024-09-10T08:37:02.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:02.084+0000 7f599513b640 1 -- 172.21.15.103:0/3776163173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5990153be0 msgr2=0x7f59901ec3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:02.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:02.084+0000 7f599513b640 1 --2- 172.21.15.103:0/3776163173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5990153be0 0x7f59901ec3a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f598400b550 tx=0x7f598400ba10 comp rx=0 tx=0).stop 2024-09-10T08:37:02.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:02.084+0000 7f599513b640 1 -- 172.21.15.103:0/3776163173 shutdown_connections 2024-09-10T08:37:02.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:02.084+0000 7f599513b640 1 --2- 172.21.15.103:0/3776163173 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f597c06bde0 0x7f597c06e2a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:02.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:02.084+0000 7f599513b640 1 --2- 172.21.15.103:0/3776163173 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59901dfc60 0x7f5990148aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:02.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:02.084+0000 7f599513b640 1 --2- 172.21.15.103:0/3776163173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5990153be0 0x7f59901ec3a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:02.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:02.084+0000 7f599513b640 1 --2- 172.21.15.103:0/3776163173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59900c8b10 0x7f59900acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:02.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:02.084+0000 7f599513b640 1 -- 172.21.15.103:0/3776163173 >> 172.21.15.103:0/3776163173 conn(0x7f59900adb80 msgr2=0x7f59900adf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:02.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:02.084+0000 7f599513b640 1 -- 172.21.15.103:0/3776163173 shutdown_connections 2024-09-10T08:37:02.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:02.084+0000 7f599513b640 1 -- 172.21.15.103:0/3776163173 wait complete. 2024-09-10T08:37:05.096 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:37:05.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:05.208+0000 7fe2a192a640 1 Processor -- start 2024-09-10T08:37:05.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:05.208+0000 7fe2a192a640 1 -- start start 2024-09-10T08:37:05.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:05.209+0000 7fe2a192a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe29c06cd80 0x7fe29c153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:05.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:05.209+0000 7fe2a192a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe29c0c7070 con 0x7fe29c15a4a0 2024-09-10T08:37:05.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:05.209+0000 7fe2a192a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe29c06d210 con 0x7fe29c0c8b10 2024-09-10T08:37:05.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:05.209+0000 7fe2a192a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe29c0c69b0 con 0x7fe29c06cd80 2024-09-10T08:37:05.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:05.209+0000 7fe29a7fc640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7fe29c06cd80 msgr2=0x7fe29c153be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:37:05.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:05.209+0000 7fe29affd640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7fe29c0c8b10 legacy=0x7fe29c1534d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:37:05.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:05.209+0000 7fe29a7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe29c06cd80 0x7fe29c153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:37:05.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:05.209+0000 7fe29b7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe29c15a4a0 0x7fe29c156660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:34044/0 (socket says 172.21.15.103:34044) 2024-09-10T08:37:05.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:05.209+0000 7fe29b7fe640 1 -- 172.21.15.103:0/1875862572 learned_addr learned my addr 172.21.15.103:0/1875862572 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:37:05.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:05.410+0000 7fe29affd640 1 -- 172.21.15.103:0/1875862572 >> v1:172.21.15.154:6789/0 conn(0x7fe29c0c8b10 legacy=0x7fe29c1534d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:37:05.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:05.410+0000 7fe29a7fc640 1 -- 172.21.15.103:0/1875862572 >> v2:172.21.15.154:3300/0 conn(0x7fe29c06cd80 msgr2=0x7fe29c153be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:37:05.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:05.410+0000 7fe29a7fc640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.154:3300/0 conn(0x7fe29c06cd80 0x7fe29c153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:37:05.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:05.811+0000 7fe29a7fc640 1 -- 172.21.15.103:0/1875862572 >> v2:172.21.15.154:3300/0 conn(0x7fe29c06cd80 msgr2=0x7fe29c153be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:37:05.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:05.811+0000 7fe29affd640 1 -- 172.21.15.103:0/1875862572 >> v1:172.21.15.154:6789/0 conn(0x7fe29c0c8b10 legacy=0x7fe29c1534d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:37:05.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:05.811+0000 7fe29a7fc640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.154:3300/0 conn(0x7fe29c06cd80 0x7fe29c153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:37:06.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:06.612+0000 7fe29affd640 1 -- 172.21.15.103:0/1875862572 >> v1:172.21.15.154:6789/0 conn(0x7fe29c0c8b10 legacy=0x7fe29c1534d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:37:06.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:06.612+0000 7fe29a7fc640 1 -- 172.21.15.103:0/1875862572 >> v2:172.21.15.154:3300/0 conn(0x7fe29c06cd80 msgr2=0x7fe29c153be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:37:06.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:06.612+0000 7fe29a7fc640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.154:3300/0 conn(0x7fe29c06cd80 0x7fe29c153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:37:08.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.208+0000 7fe298ff9640 1 -- 172.21.15.103:0/1875862572 >> v2:172.21.15.154:3300/0 conn(0x7fe29c06cd80 msgr2=0x7fe29c153be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:37:08.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.208+0000 7fe298ff9640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.154:3300/0 conn(0x7fe29c06cd80 0x7fe29c153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:08.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.208+0000 7fe298ff9640 1 -- 172.21.15.103:0/1875862572 >> v1:172.21.15.154:6789/0 conn(0x7fe29c0c8b10 legacy=0x7fe29c1534d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:37:08.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.208+0000 7fe298ff9640 1 -- 172.21.15.103:0/1875862572 >> v1:172.21.15.103:6789/0 conn(0x7fe29c15a4a0 legacy=0x7fe29c156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:08.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.208+0000 7fe298ff9640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 0x7fe288005b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:08.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.208+0000 7fe298ff9640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 0x7fe288008660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:08.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.208+0000 7fe298ff9640 1 -- 172.21.15.103:0/1875862572 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fe29c0c69b0 con 0x7fe2880061a0 2024-09-10T08:37:08.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.208+0000 7fe298ff9640 1 -- 172.21.15.103:0/1875862572 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe288008d20 con 0x7fe2880036c0 2024-09-10T08:37:08.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.208+0000 7fe29a7fc640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 0x7fe288008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:08.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.208+0000 7fe29affd640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 0x7fe288005b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:08.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.208+0000 7fe29a7fc640 1 -- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 msgr2=0x7fe288008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:37:08.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.208+0000 7fe29a7fc640 1 -- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 msgr2=0x7fe288008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:37:08.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.208+0000 7fe29a7fc640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 0x7fe288008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:37:08.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.208+0000 7fe29a7fc640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 0x7fe288008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:37:08.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.208+0000 7fe29affd640 1 -- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 msgr2=0x7fe288005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:37:08.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.208+0000 7fe29affd640 1 -- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 msgr2=0x7fe288005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:37:08.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.208+0000 7fe29affd640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 0x7fe288005b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:37:08.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.208+0000 7fe29affd640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 0x7fe288005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:37:08.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.409+0000 7fe29a7fc640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 0x7fe288008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:08.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.409+0000 7fe29affd640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 0x7fe288005b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:08.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.409+0000 7fe29a7fc640 1 -- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 msgr2=0x7fe288008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:37:08.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.409+0000 7fe29a7fc640 1 -- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 msgr2=0x7fe288008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:37:08.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.409+0000 7fe29a7fc640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 0x7fe288008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:37:08.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.409+0000 7fe29a7fc640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 0x7fe288008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:37:08.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.409+0000 7fe29affd640 1 -- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 msgr2=0x7fe288005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:37:08.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.409+0000 7fe29affd640 1 -- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 msgr2=0x7fe288005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:37:08.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.409+0000 7fe29affd640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 0x7fe288005b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:37:08.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.409+0000 7fe29affd640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 0x7fe288005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:37:08.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.810+0000 7fe29a7fc640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 0x7fe288008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:08.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.810+0000 7fe29affd640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 0x7fe288005b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:08.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.810+0000 7fe29a7fc640 1 -- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 msgr2=0x7fe288008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:37:08.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.810+0000 7fe29a7fc640 1 -- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 msgr2=0x7fe288008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:37:08.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.810+0000 7fe29a7fc640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 0x7fe288008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:37:08.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.810+0000 7fe29a7fc640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 0x7fe288008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:37:08.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.810+0000 7fe29affd640 1 -- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 msgr2=0x7fe288005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:37:08.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.810+0000 7fe29affd640 1 -- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 msgr2=0x7fe288005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:37:08.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.810+0000 7fe29affd640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 0x7fe288005b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:37:08.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:08.810+0000 7fe29affd640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 0x7fe288005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:37:09.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:09.611+0000 7fe29a7fc640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 0x7fe288008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:09.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:09.611+0000 7fe29affd640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 0x7fe288005b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:09.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:09.611+0000 7fe29a7fc640 1 -- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 msgr2=0x7fe288008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:37:09.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:09.611+0000 7fe29a7fc640 1 -- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 msgr2=0x7fe288008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:37:09.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:09.611+0000 7fe29a7fc640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 0x7fe288008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:37:09.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:09.611+0000 7fe29a7fc640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 0x7fe288008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:37:09.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:09.611+0000 7fe29affd640 1 -- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 msgr2=0x7fe288005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:37:09.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:09.611+0000 7fe29affd640 1 -- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 msgr2=0x7fe288005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:37:09.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:09.611+0000 7fe29affd640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 0x7fe288005b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:37:09.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:09.611+0000 7fe29affd640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 0x7fe288005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:37:11.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.208+0000 7fe298ff9640 1 -- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 msgr2=0x7fe288005b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:37:11.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.208+0000 7fe298ff9640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880036c0 0x7fe288005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:11.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.208+0000 7fe298ff9640 1 -- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 msgr2=0x7fe288008660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:37:11.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.208+0000 7fe298ff9640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe2880061a0 0x7fe288008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:11.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.208+0000 7fe29b7fe640 1 -- 172.21.15.103:0/1875862572 reap_dead start 2024-09-10T08:37:11.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.208+0000 7fe298ff9640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.154:3300/0 conn(0x7fe288003b00 0x7fe2880065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:11.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.208+0000 7fe298ff9640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 0x7fe28800d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:11.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.208+0000 7fe298ff9640 1 -- 172.21.15.103:0/1875862572 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe29c0c6c90 con 0x7fe288006b10 2024-09-10T08:37:11.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.208+0000 7fe298ff9640 1 -- 172.21.15.103:0/1875862572 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe29c0c69b0 con 0x7fe288003b00 2024-09-10T08:37:11.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.208+0000 7fe298ff9640 1 -- 172.21.15.103:0/1875862572 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe288008d20 con 0x7fe2880086a0 2024-09-10T08:37:11.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.208+0000 7fe29a7fc640 1 -- 172.21.15.103:0/1875862572 >> v1:172.21.15.154:6789/0 conn(0x7fe288006b10 legacy=0x7fe288006f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:37:11.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.208+0000 7fe29affd640 1 -- 172.21.15.103:0/1875862572 >> v2:172.21.15.154:3300/0 conn(0x7fe288003b00 msgr2=0x7fe2880065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:37:11.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.208+0000 7fe29affd640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.154:3300/0 conn(0x7fe288003b00 0x7fe2880065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:37:11.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.208+0000 7fe29b7fe640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 0x7fe28800d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:11.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.208+0000 7fe29b7fe640 1 -- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 msgr2=0x7fe28800d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:37:11.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.208+0000 7fe29b7fe640 1 -- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 msgr2=0x7fe28800d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:37:11.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.208+0000 7fe29b7fe640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 0x7fe28800d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:37:11.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.208+0000 7fe29b7fe640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 0x7fe28800d200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:37:11.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.409+0000 7fe29a7fc640 1 -- 172.21.15.103:0/1875862572 >> v1:172.21.15.154:6789/0 conn(0x7fe288006b10 legacy=0x7fe288006f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:37:11.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.409+0000 7fe29affd640 1 -- 172.21.15.103:0/1875862572 >> v2:172.21.15.154:3300/0 conn(0x7fe288003b00 msgr2=0x7fe2880065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:37:11.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.409+0000 7fe29affd640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.154:3300/0 conn(0x7fe288003b00 0x7fe2880065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:37:11.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.409+0000 7fe29b7fe640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 0x7fe28800d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:11.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.409+0000 7fe29b7fe640 1 -- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 msgr2=0x7fe28800d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:37:11.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.409+0000 7fe29b7fe640 1 -- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 msgr2=0x7fe28800d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:37:11.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.409+0000 7fe29b7fe640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 0x7fe28800d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:37:11.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.409+0000 7fe29b7fe640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 0x7fe28800d200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:37:11.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.810+0000 7fe29affd640 1 -- 172.21.15.103:0/1875862572 >> v2:172.21.15.154:3300/0 conn(0x7fe288003b00 msgr2=0x7fe2880065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:37:11.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.810+0000 7fe29affd640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.154:3300/0 conn(0x7fe288003b00 0x7fe2880065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:37:11.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.810+0000 7fe29a7fc640 1 -- 172.21.15.103:0/1875862572 >> v1:172.21.15.154:6789/0 conn(0x7fe288006b10 legacy=0x7fe288006f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:37:11.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.810+0000 7fe29b7fe640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 0x7fe28800d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:11.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.811+0000 7fe29b7fe640 1 -- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 msgr2=0x7fe28800d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:37:11.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.811+0000 7fe29b7fe640 1 -- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 msgr2=0x7fe28800d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:37:11.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.811+0000 7fe29b7fe640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 0x7fe28800d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:37:11.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:11.811+0000 7fe29b7fe640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 0x7fe28800d200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:37:12.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:12.611+0000 7fe29affd640 1 -- 172.21.15.103:0/1875862572 >> v2:172.21.15.154:3300/0 conn(0x7fe288003b00 msgr2=0x7fe2880065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:37:12.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:12.611+0000 7fe29a7fc640 1 -- 172.21.15.103:0/1875862572 >> v1:172.21.15.154:6789/0 conn(0x7fe288006b10 legacy=0x7fe288006f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:37:12.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:12.611+0000 7fe29affd640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.154:3300/0 conn(0x7fe288003b00 0x7fe2880065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:37:12.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:12.612+0000 7fe29b7fe640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 0x7fe28800d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:12.612+0000 7fe29b7fe640 1 -- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 msgr2=0x7fe28800d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:37:12.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:12.612+0000 7fe29b7fe640 1 -- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 msgr2=0x7fe28800d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:37:12.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:12.612+0000 7fe29b7fe640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 0x7fe28800d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:37:12.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:12.612+0000 7fe29b7fe640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 0x7fe28800d200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:37:14.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.208+0000 7fe298ff9640 1 -- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 msgr2=0x7fe28800d200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:37:14.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.208+0000 7fe298ff9640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2880086a0 0x7fe28800d200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.208+0000 7fe298ff9640 1 -- 172.21.15.103:0/1875862572 >> v2:172.21.15.154:3300/0 conn(0x7fe288003b00 msgr2=0x7fe2880065d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:37:14.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.208+0000 7fe298ff9640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.154:3300/0 conn(0x7fe288003b00 0x7fe2880065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.208+0000 7fe298ff9640 1 -- 172.21.15.103:0/1875862572 >> v1:172.21.15.154:6789/0 conn(0x7fe288006b10 legacy=0x7fe288006f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:37:14.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.208+0000 7fe298ff9640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe288011b30 0x7fe288013f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.208+0000 7fe298ff9640 1 -- 172.21.15.103:0/1875862572 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe29c06d210 con 0x7fe28800d960 2024-09-10T08:37:14.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.208+0000 7fe298ff9640 1 -- 172.21.15.103:0/1875862572 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fe29c0c69b0 con 0x7fe288011b30 2024-09-10T08:37:14.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.208+0000 7fe29a7fc640 1 --2- 172.21.15.103:0/1875862572 >> v2:172.21.15.103:3300/0 conn(0x7fe288011b30 0x7fe288013f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.209+0000 7fe29a7fc640 1 -- 172.21.15.103:0/1875862572 >> v1:172.21.15.103:6789/0 conn(0x7fe28800d960 legacy=0x7fe28800dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.209+0000 7fe29a7fc640 1 -- 172.21.15.103:0/1875862572 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29c0c6c90 con 0x7fe288011b30 2024-09-10T08:37:14.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.210+0000 7fe29a7fc640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe288011b30 0x7fe288013f20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe290003930 tx=0x7fe29002b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de5aa96aab10228 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:14.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.210+0000 7fe299ffb640 1 -- 172.21.15.103:0/1875862572 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290039070 con 0x7fe288011b30 2024-09-10T08:37:14.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.210+0000 7fe299ffb640 1 -- 172.21.15.103:0/1875862572 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe290031480 con 0x7fe288011b30 2024-09-10T08:37:14.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.210+0000 7fe299ffb640 1 -- 172.21.15.103:0/1875862572 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290031650 con 0x7fe288011b30 2024-09-10T08:37:14.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.211+0000 7fe2a192a640 1 -- 172.21.15.103:0/1875862572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe288011b30 msgr2=0x7fe288013f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.211+0000 7fe2a192a640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe288011b30 0x7fe288013f20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe290003930 tx=0x7fe29002b5c0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.211+0000 7fe29b7fe640 1 -- 172.21.15.103:0/1875862572 reap_dead start 2024-09-10T08:37:14.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.211+0000 7fe2a192a640 1 -- 172.21.15.103:0/1875862572 shutdown_connections 2024-09-10T08:37:14.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.211+0000 7fe2a192a640 1 --2- 172.21.15.103:0/1875862572 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe288011b30 0x7fe288013f20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.211+0000 7fe2a192a640 1 -- 172.21.15.103:0/1875862572 >> 172.21.15.103:0/1875862572 conn(0x7fe29c0adb80 msgr2=0x7fe29c0adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:14.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.211+0000 7fe2a192a640 1 -- 172.21.15.103:0/1875862572 shutdown_connections 2024-09-10T08:37:14.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.211+0000 7fe2a192a640 1 -- 172.21.15.103:0/1875862572 wait complete. 2024-09-10T08:37:14.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.212+0000 7fe2a192a640 1 Processor -- start 2024-09-10T08:37:14.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.213+0000 7fe2a192a640 1 -- start start 2024-09-10T08:37:14.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.213+0000 7fe2a192a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe288011b30 0x7fe29c1594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.213+0000 7fe2a192a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe29c1e2560 0x7fe29c1e0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.213+0000 7fe2a192a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe29c1e1440 0x7fe29c1ef450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.213+0000 7fe2a192a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c0c9070 con 0x7fe288011b30 2024-09-10T08:37:14.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.213+0000 7fe2a192a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c0c8ef0 con 0x7fe29c1e1440 2024-09-10T08:37:14.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.213+0000 7fe2a192a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe29c1534d0 con 0x7fe29c1e2560 2024-09-10T08:37:14.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.214+0000 7fe29affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe288011b30 0x7fe29c1594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.214+0000 7fe29b7fe640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe29c1e1440 msgr2=0x7fe29c1ef450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:37:14.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.214+0000 7fe29b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe29c1e1440 0x7fe29c1ef450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:37:14.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.214+0000 7fe29affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe288011b30 0x7fe29c1594b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52174/0 (socket says 172.21.15.103:52174) 2024-09-10T08:37:14.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.214+0000 7fe29affd640 1 -- 172.21.15.103:0/760334611 learned_addr learned my addr 172.21.15.103:0/760334611 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:14.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.214+0000 7fe29a7fc640 1 --2- 172.21.15.103:0/760334611 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe29c1e2560 0x7fe29c1e0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.214+0000 7fe29affd640 1 -- 172.21.15.103:0/760334611 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe29c1e2560 msgr2=0x7fe29c1e0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.214+0000 7fe29affd640 1 --2- 172.21.15.103:0/760334611 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe29c1e2560 0x7fe29c1e0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.214+0000 7fe29affd640 1 -- 172.21.15.103:0/760334611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe29c1e1440 msgr2=0x7fe29c1ef450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:37:14.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.214+0000 7fe29affd640 1 --2- 172.21.15.103:0/760334611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe29c1e1440 0x7fe29c1ef450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.214+0000 7fe29affd640 1 -- 172.21.15.103:0/760334611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29c1dfae0 con 0x7fe288011b30 2024-09-10T08:37:14.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.214+0000 7fe29affd640 1 --2- 172.21.15.103:0/760334611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe288011b30 0x7fe29c1594b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe28c007090 tx=0x7fe28c00a7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:14.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.214+0000 7fe283fff640 1 -- 172.21.15.103:0/760334611 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c01b020 con 0x7fe288011b30 2024-09-10T08:37:14.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.214+0000 7fe283fff640 1 -- 172.21.15.103:0/760334611 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe28c00ae60 con 0x7fe288011b30 2024-09-10T08:37:14.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.214+0000 7fe2a192a640 1 -- 172.21.15.103:0/760334611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe29c1dfdc0 con 0x7fe288011b30 2024-09-10T08:37:14.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.214+0000 7fe283fff640 1 -- 172.21.15.103:0/760334611 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c017840 con 0x7fe288011b30 2024-09-10T08:37:14.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.214+0000 7fe2a192a640 1 -- 172.21.15.103:0/760334611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe29c1e0380 con 0x7fe288011b30 2024-09-10T08:37:14.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.216+0000 7fe2a192a640 1 -- 172.21.15.103:0/760334611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe29c156460 con 0x7fe288011b30 2024-09-10T08:37:14.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.216+0000 7fe283fff640 1 -- 172.21.15.103:0/760334611 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe28c01e020 con 0x7fe288011b30 2024-09-10T08:37:14.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.217+0000 7fe283fff640 1 --2- 172.21.15.103:0/760334611 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe28806d910 0x7fe28806fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.217+0000 7fe283fff640 1 -- 172.21.15.103:0/760334611 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fe28c08c090 con 0x7fe288011b30 2024-09-10T08:37:14.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.217+0000 7fe29a7fc640 1 --2- 172.21.15.103:0/760334611 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe28806d910 0x7fe28806fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.217+0000 7fe29a7fc640 1 --2- 172.21.15.103:0/760334611 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe28806d910 0x7fe28806fdd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe290036000 tx=0x7fe29002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:14.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.221+0000 7fe283fff640 1 -- 172.21.15.103:0/760334611 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe29c156460 con 0x7fe288011b30 2024-09-10T08:37:14.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.503+0000 7fe2a192a640 1 -- 172.21.15.103:0/760334611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe29c153860 con 0x7fe288011b30 2024-09-10T08:37:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.503+0000 7fe283fff640 1 -- 172.21.15.103:0/760334611 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7fe28c025070 con 0x7fe288011b30 2024-09-10T08:37:14.505 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":72,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:37:14.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.506+0000 7fe2a192a640 1 -- 172.21.15.103:0/760334611 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe28806d910 msgr2=0x7fe28806fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.506+0000 7fe2a192a640 1 --2- 172.21.15.103:0/760334611 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe28806d910 0x7fe28806fdd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe290036000 tx=0x7fe29002f000 comp rx=0 tx=0).stop 2024-09-10T08:37:14.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.506+0000 7fe2a192a640 1 -- 172.21.15.103:0/760334611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe288011b30 msgr2=0x7fe29c1594b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.506+0000 7fe2a192a640 1 --2- 172.21.15.103:0/760334611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe288011b30 0x7fe29c1594b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe28c007090 tx=0x7fe28c00a7b0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.506+0000 7fe2a192a640 1 -- 172.21.15.103:0/760334611 shutdown_connections 2024-09-10T08:37:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.506+0000 7fe2a192a640 1 --2- 172.21.15.103:0/760334611 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe28806d910 0x7fe28806fdd0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.506+0000 7fe2a192a640 1 --2- 172.21.15.103:0/760334611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe29c1e1440 0x7fe29c1ef450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.506+0000 7fe2a192a640 1 --2- 172.21.15.103:0/760334611 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe29c1e2560 0x7fe29c1e0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.506+0000 7fe2a192a640 1 --2- 172.21.15.103:0/760334611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe288011b30 0x7fe29c1594b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.506+0000 7fe2a192a640 1 -- 172.21.15.103:0/760334611 >> 172.21.15.103:0/760334611 conn(0x7fe29c0adb80 msgr2=0x7fe29c1541c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:14.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.506+0000 7fe2a192a640 1 -- 172.21.15.103:0/760334611 shutdown_connections 2024-09-10T08:37:14.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.506+0000 7fe2a192a640 1 -- 172.21.15.103:0/760334611 wait complete. 2024-09-10T08:37:14.520 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-10T08:37:14.520 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-10T08:37:14.521 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:37:14.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.638+0000 7fa26a2fa640 1 Processor -- start 2024-09-10T08:37:14.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.638+0000 7fa26a2fa640 1 -- start start 2024-09-10T08:37:14.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.639+0000 7fa26a2fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2640ca390 0x7fa264161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.639+0000 7fa26a2fa640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa26415a7c0 con 0x7fa264150480 2024-09-10T08:37:14.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.639+0000 7fa26a2fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa264159a00 con 0x7fa26406c650 2024-09-10T08:37:14.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.639+0000 7fa26a2fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa26406c240 con 0x7fa2640ca390 2024-09-10T08:37:14.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.639+0000 7fa2637fe640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7fa26406c650 legacy=0x7fa2640c9c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:37:14.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.639+0000 7fa263fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa264150480 0x7fa2640c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:34068/0 (socket says 172.21.15.103:34068) 2024-09-10T08:37:14.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.639+0000 7fa263fff640 1 -- 172.21.15.103:0/3431417723 learned_addr learned my addr 172.21.15.103:0/3431417723 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:37:14.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.639+0000 7fa268897640 1 --2- 172.21.15.103:0/3431417723 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2640ca390 0x7fa264161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.639+0000 7fa262ffd640 1 -- 172.21.15.103:0/3431417723 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2036079969 0 0) 0x7fa26415a7c0 con 0x7fa264150480 2024-09-10T08:37:14.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.639+0000 7fa262ffd640 1 -- 172.21.15.103:0/3431417723 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa24c003520 con 0x7fa264150480 2024-09-10T08:37:14.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.639+0000 7fa268897640 1 -- 172.21.15.103:0/3431417723 >> v1:172.21.15.154:6789/0 conn(0x7fa26406c650 legacy=0x7fa2640c9c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:37:14.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.639+0000 7fa268897640 1 -- 172.21.15.103:0/3431417723 >> v1:172.21.15.103:6789/0 conn(0x7fa264150480 legacy=0x7fa2640c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.639+0000 7fa268897640 1 -- 172.21.15.103:0/3431417723 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa264159ce0 con 0x7fa2640ca390 2024-09-10T08:37:14.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.640+0000 7fa268897640 1 --2- 172.21.15.103:0/3431417723 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2640ca390 0x7fa264161c00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa25c009dc0 tx=0x7fa25c02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efcdc8801f193d1d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:14.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.640+0000 7fa262ffd640 1 -- 172.21.15.103:0/3431417723 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c02ae60 con 0x7fa2640ca390 2024-09-10T08:37:14.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.640+0000 7fa262ffd640 1 -- 172.21.15.103:0/3431417723 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa25c007740 con 0x7fa2640ca390 2024-09-10T08:37:14.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.640+0000 7fa262ffd640 1 -- 172.21.15.103:0/3431417723 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c007b10 con 0x7fa2640ca390 2024-09-10T08:37:14.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.641+0000 7fa26a2fa640 1 -- 172.21.15.103:0/3431417723 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2640ca390 msgr2=0x7fa264161c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.641+0000 7fa26a2fa640 1 --2- 172.21.15.103:0/3431417723 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2640ca390 0x7fa264161c00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa25c009dc0 tx=0x7fa25c02a680 comp rx=0 tx=0).stop 2024-09-10T08:37:14.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.641+0000 7fa26a2fa640 1 -- 172.21.15.103:0/3431417723 shutdown_connections 2024-09-10T08:37:14.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.641+0000 7fa26a2fa640 1 --2- 172.21.15.103:0/3431417723 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2640ca390 0x7fa264161c00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.641+0000 7fa26a2fa640 1 -- 172.21.15.103:0/3431417723 >> 172.21.15.103:0/3431417723 conn(0x7fa264068030 msgr2=0x7fa264073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:14.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.641+0000 7fa26a2fa640 1 -- 172.21.15.103:0/3431417723 shutdown_connections 2024-09-10T08:37:14.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.641+0000 7fa26a2fa640 1 -- 172.21.15.103:0/3431417723 wait complete. 2024-09-10T08:37:14.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.643+0000 7fa26a2fa640 1 Processor -- start 2024-09-10T08:37:14.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.643+0000 7fa26a2fa640 1 -- start start 2024-09-10T08:37:14.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.644+0000 7fa26a2fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa26406c650 0x7fa2641ec0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.644+0000 7fa26a2fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2640ca390 0x7fa2641e34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.644+0000 7fa26a2fa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa264150480 0x7fa2641508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.644+0000 7fa26a2fa640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa26406d270 con 0x7fa264150480 2024-09-10T08:37:14.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.644+0000 7fa26a2fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa26415a330 con 0x7fa26406c650 2024-09-10T08:37:14.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.644+0000 7fa26a2fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa2640c81a0 con 0x7fa2640ca390 2024-09-10T08:37:14.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.644+0000 7fa263fff640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa26406c650 msgr2=0x7fa2641ec0e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:37:14.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.644+0000 7fa263fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa26406c650 0x7fa2641ec0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:37:14.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.644+0000 7fa268897640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa264150480 0x7fa2641508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.644+0000 7fa268897640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa264150480 0x7fa2641508f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52190/0 (socket says 172.21.15.103:52190) 2024-09-10T08:37:14.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.644+0000 7fa268897640 1 -- 172.21.15.103:0/3520864607 learned_addr learned my addr 172.21.15.103:0/3520864607 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:14.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.644+0000 7fa2637fe640 1 --2- 172.21.15.103:0/3520864607 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2640ca390 0x7fa2641e34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.644+0000 7fa268897640 1 -- 172.21.15.103:0/3520864607 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2640ca390 msgr2=0x7fa2641e34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.644+0000 7fa268897640 1 --2- 172.21.15.103:0/3520864607 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2640ca390 0x7fa2641e34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.644+0000 7fa268897640 1 -- 172.21.15.103:0/3520864607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa26406c650 msgr2=0x7fa2641ec0e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:37:14.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.644+0000 7fa268897640 1 --2- 172.21.15.103:0/3520864607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa26406c650 0x7fa2641ec0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.644+0000 7fa268897640 1 -- 172.21.15.103:0/3520864607 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2641f0010 con 0x7fa264150480 2024-09-10T08:37:14.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.644+0000 7fa268897640 1 --2- 172.21.15.103:0/3520864607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa264150480 0x7fa2641508f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa25c009ee0 tx=0x7fa25c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:14.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.645+0000 7fa260ff9640 1 -- 172.21.15.103:0/3520864607 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c040070 con 0x7fa264150480 2024-09-10T08:37:14.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.645+0000 7fa260ff9640 1 -- 172.21.15.103:0/3520864607 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa25c02ae60 con 0x7fa264150480 2024-09-10T08:37:14.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.645+0000 7fa26a2fa640 1 -- 172.21.15.103:0/3520864607 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2641f02b0 con 0x7fa264150480 2024-09-10T08:37:14.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.645+0000 7fa260ff9640 1 -- 172.21.15.103:0/3520864607 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c009450 con 0x7fa264150480 2024-09-10T08:37:14.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.645+0000 7fa26a2fa640 1 -- 172.21.15.103:0/3520864607 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2641e3a20 con 0x7fa264150480 2024-09-10T08:37:14.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.646+0000 7fa26a2fa640 1 --2- 172.21.15.103:0/3520864607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa264151250 0x7fa2640afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.646+0000 7fa26a2fa640 1 -- 172.21.15.103:0/3520864607 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa26406c430 con 0x7fa264151250 2024-09-10T08:37:14.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.646+0000 7fa263fff640 1 --2- 172.21.15.103:0/3520864607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa264151250 0x7fa2640afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.646+0000 7fa260ff9640 1 -- 172.21.15.103:0/3520864607 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa25c039040 con 0x7fa264150480 2024-09-10T08:37:14.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.646+0000 7fa263fff640 1 -- 172.21.15.103:0/3520864607 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2640734f0 con 0x7fa264151250 2024-09-10T08:37:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.646+0000 7fa263fff640 1 --2- 172.21.15.103:0/3520864607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa264151250 0x7fa2640afb30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa2641e2a00 tx=0x7fa25400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.647+0000 7fa260ff9640 1 --2- 172.21.15.103:0/3520864607 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa25006bde0 0x7fa25006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.647+0000 7fa260ff9640 1 -- 172.21.15.103:0/3520864607 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fa25c0ac8c0 con 0x7fa264150480 2024-09-10T08:37:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.647+0000 7fa2637fe640 1 --2- 172.21.15.103:0/3520864607 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa25006bde0 0x7fa25006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.647+0000 7fa260ff9640 1 -- 172.21.15.103:0/3520864607 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa254017070 con 0x7fa264151250 2024-09-10T08:37:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.647+0000 7fa260ff9640 1 -- 172.21.15.103:0/3520864607 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa254005da0 con 0x7fa264151250 2024-09-10T08:37:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.647+0000 7fa260ff9640 1 -- 172.21.15.103:0/3520864607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa264151250 msgr2=0x7fa2640afb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.647+0000 7fa260ff9640 1 --2- 172.21.15.103:0/3520864607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa264151250 0x7fa2640afb30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa2641e2a00 tx=0x7fa25400c7a0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.647+0000 7fa260ff9640 1 -- 172.21.15.103:0/3520864607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa264151250 msgr2=0x7fa2640afb30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:37:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.647+0000 7fa260ff9640 1 --2- 172.21.15.103:0/3520864607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa264151250 0x7fa2640afb30 secure :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa2641e2a00 tx=0x7fa25400c7a0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.647+0000 7fa2637fe640 1 --2- 172.21.15.103:0/3520864607 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa25006bde0 0x7fa25006e2a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa2580093d0 tx=0x7fa258009360 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:14.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.654+0000 7fa26a2fa640 1 --2- 172.21.15.103:0/3520864607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2640b0070 0x7fa2640b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.654+0000 7fa26a2fa640 1 -- 172.21.15.103:0/3520864607 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa2640b0990 con 0x7fa2640b0070 2024-09-10T08:37:14.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.654+0000 7fa263fff640 1 --2- 172.21.15.103:0/3520864607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2640b0070 0x7fa2640b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.654+0000 7fa263fff640 1 -- 172.21.15.103:0/3520864607 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa2641e2380 con 0x7fa2640b0070 2024-09-10T08:37:14.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.654+0000 7fa263fff640 1 --2- 172.21.15.103:0/3520864607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2640b0070 0x7fa2640b0450 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa254000c00 tx=0x7fa254000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:14.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.654+0000 7fa260ff9640 1 -- 172.21.15.103:0/3520864607 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa254017040 con 0x7fa2640b0070 2024-09-10T08:37:14.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.655+0000 7fa260ff9640 1 -- 172.21.15.103:0/3520864607 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5045 (secure 0 0 0) 0x7fa25401bb00 con 0x7fa2640b0070 2024-09-10T08:37:14.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.655+0000 7fa260ff9640 1 -- 172.21.15.103:0/3520864607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2640b0070 msgr2=0x7fa2640b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.655+0000 7fa260ff9640 1 --2- 172.21.15.103:0/3520864607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2640b0070 0x7fa2640b0450 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa254000c00 tx=0x7fa254000ed0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.655+0000 7fa260ff9640 1 -- 172.21.15.103:0/3520864607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2640b0070 msgr2=0x7fa2640b0450 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:37:14.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.655+0000 7fa260ff9640 1 --2- 172.21.15.103:0/3520864607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2640b0070 0x7fa2640b0450 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.656 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:37:14.657 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:37:14.657 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:37:14.657 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:37:14.657 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 72, 2024-09-10T08:37:14.657 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 204722, 2024-09-10T08:37:14.657 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:37:14.657 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:37:14.657 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:37:14.658 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:14.658 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 1, 2024-09-10T08:37:14.658 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:37:14.658 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:37:14.658 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:37:14.658 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:14.658 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:14.658 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:14.658 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:14.658 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:14.659 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:14.659 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:14.659 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:14.659 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:14.659 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:14.659 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:14.659 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:14.659 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:37:14.659 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:37:14.659 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:14.659 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:14.660 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:14.660 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:14.660 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:14.660 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:14.660 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:14.660 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:14.660 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:14.660 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:14.660 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:14.660 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:14.660 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.660 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:37:14.660 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:37:14.661 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:37:14.661 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:37:14.661 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:37:14.661 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:37:14.661 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:37:14.661 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:37:14.661 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:37:14.661 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:37:14.661 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:37:14.661 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:37:14.661 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:37:14.661 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:37:14.662 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:37:14.662 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:37:14.662 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:37:14.662 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:14.662 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:14.662 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:14.662 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:14.662 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:14.662 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:14.662 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:14.662 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:14.662 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:14.662 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:14.662 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:14.663 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:14.663 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:37:14.663 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.663 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:37:14.663 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.663 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:37:14.663 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:37:14.663 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:14.663 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:14.663 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.663 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:14.663 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:37:14.663 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:14.664 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.664 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.664 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:14.664 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:37:14.664 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:14.664 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:14.664 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:14.664 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.664 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:37:14.664 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:37:14.664 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:14.664 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:14.665 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:14.665 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.665 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.665 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:37:14.665 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:37:14.665 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:14.665 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:14.665 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.665 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:14.665 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:37:14.665 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:14.665 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.666 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.666 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:14.666 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:37:14.666 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:14.666 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:14.666 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:14.666 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.666 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:37:14.666 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:37:14.666 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:14.666 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:14.667 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:14.667 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.667 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.667 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:37:14.667 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:37:14.667 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:14.667 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:14.667 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.667 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:14.667 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:37:14.667 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:14.667 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.668 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.668 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:14.668 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:37:14.668 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:14.668 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:14.669 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:14.669 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.669 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:37:14.669 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:37:14.670 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:14.670 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:14.670 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:14.670 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:14.670 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:14.670 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.671 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:37:14.671 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:37:14.671 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.671 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:14.671 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:14.671 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:37:14.671 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:14.672 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:14.672 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:37:14.672 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.672 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:14.672 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:14.672 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:37:14.672 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:14.673 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:14.673 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:37:14.673 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.673 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:14.673 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:14.673 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:37:14.673 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:14.674 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:14.674 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:37:14.674 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.674 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:14.674 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:14.674 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 8 2024-09-10T08:37:14.674 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:14.675 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:14.675 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:37:14.675 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.675 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:14.675 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:14.675 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:37:14.676 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:14.676 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:14.676 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.676 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:37:14.676 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:37:14.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.655+0000 7fa26a2fa640 1 -- 172.21.15.103:0/3520864607 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa25006bde0 msgr2=0x7fa25006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.655+0000 7fa26a2fa640 1 --2- 172.21.15.103:0/3520864607 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa25006bde0 0x7fa25006e2a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa2580093d0 tx=0x7fa258009360 comp rx=0 tx=0).stop 2024-09-10T08:37:14.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.655+0000 7fa26a2fa640 1 -- 172.21.15.103:0/3520864607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa264150480 msgr2=0x7fa2641508f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.655+0000 7fa26a2fa640 1 --2- 172.21.15.103:0/3520864607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa264150480 0x7fa2641508f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa25c009ee0 tx=0x7fa25c004a40 comp rx=0 tx=0).stop 2024-09-10T08:37:14.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.655+0000 7fa268897640 1 -- 172.21.15.103:0/3520864607 reap_dead start 2024-09-10T08:37:14.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.655+0000 7fa268897640 1 -- 172.21.15.103:0/3520864607 reap_dead start 2024-09-10T08:37:14.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.655+0000 7fa26a2fa640 1 -- 172.21.15.103:0/3520864607 shutdown_connections 2024-09-10T08:37:14.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.655+0000 7fa26a2fa640 1 -- 172.21.15.103:0/3520864607 >> 172.21.15.103:0/3520864607 conn(0x7fa264068030 msgr2=0x7fa2640ca770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:14.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.655+0000 7fa26a2fa640 1 -- 172.21.15.103:0/3520864607 shutdown_connections 2024-09-10T08:37:14.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.655+0000 7fa26a2fa640 1 -- 172.21.15.103:0/3520864607 wait complete. 2024-09-10T08:37:14.679 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:37:14.679 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-10T08:37:14.680 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:37:14.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.793+0000 7f199cfd6640 1 Processor -- start 2024-09-10T08:37:14.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.793+0000 7f199cfd6640 1 -- start start 2024-09-10T08:37:14.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.794+0000 7f199cfd6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1998150aa0 0x7f1998153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.794+0000 7f199cfd6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f19980bda70 0x7f19980bf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.794+0000 7f199cfd6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19980bf8f0 0x7f19980c5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.794+0000 7f199cfd6640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f1998074100 con 0x7f1998150aa0 2024-09-10T08:37:14.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.794+0000 7f199cfd6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f19980c8290 con 0x7f19980bda70 2024-09-10T08:37:14.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.794+0000 7f199cfd6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f19980c8570 con 0x7f19980bf8f0 2024-09-10T08:37:14.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.794+0000 7f199659c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1998150aa0 0x7f1998153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.794+0000 7f1995d9b640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7f19980bda70 msgr2=0x7f19980bf3b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:37:14.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.794+0000 7f1995d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f19980bda70 0x7f19980bf3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:37:14.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.794+0000 7f199659c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1998150aa0 0x7f1998153ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52222/0 (socket says 172.21.15.103:52222) 2024-09-10T08:37:14.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.794+0000 7f199659c640 1 -- 172.21.15.103:0/1419742286 learned_addr learned my addr 172.21.15.103:0/1419742286 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:14.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.794+0000 7f1996d9d640 1 --2- 172.21.15.103:0/1419742286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19980bf8f0 0x7f19980c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.794+0000 7f199659c640 1 -- 172.21.15.103:0/1419742286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19980bf8f0 msgr2=0x7f19980c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:14.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.794+0000 7f199659c640 1 --2- 172.21.15.103:0/1419742286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19980bf8f0 0x7f19980c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.794+0000 7f199659c640 1 -- 172.21.15.103:0/1419742286 >> v2:172.21.15.154:3300/0 conn(0x7f19980bda70 msgr2=0x7f19980bf3b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:37:14.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.794+0000 7f199659c640 1 --2- 172.21.15.103:0/1419742286 >> v2:172.21.15.154:3300/0 conn(0x7f19980bda70 0x7f19980bf3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.794+0000 7f199659c640 1 -- 172.21.15.103:0/1419742286 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1998074350 con 0x7f1998150aa0 2024-09-10T08:37:14.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.795+0000 7f199659c640 1 --2- 172.21.15.103:0/1419742286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1998150aa0 0x7f1998153ce0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f19980c9ac0 tx=0x7f198802a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c2460a34030a4a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:14.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.796+0000 7f199559a640 1 -- 172.21.15.103:0/1419742286 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1988037070 con 0x7f1998150aa0 2024-09-10T08:37:14.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.796+0000 7f199559a640 1 -- 172.21.15.103:0/1419742286 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1988032440 con 0x7f1998150aa0 2024-09-10T08:37:14.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.796+0000 7f199559a640 1 -- 172.21.15.103:0/1419742286 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1988032810 con 0x7f1998150aa0 2024-09-10T08:37:14.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.796+0000 7f199cfd6640 1 -- 172.21.15.103:0/1419742286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1998150aa0 msgr2=0x7f1998153ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.796+0000 7f199cfd6640 1 --2- 172.21.15.103:0/1419742286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1998150aa0 0x7f1998153ce0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f19980c9ac0 tx=0x7f198802a160 comp rx=0 tx=0).stop 2024-09-10T08:37:14.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.796+0000 7f199cfd6640 1 -- 172.21.15.103:0/1419742286 shutdown_connections 2024-09-10T08:37:14.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.796+0000 7f199cfd6640 1 --2- 172.21.15.103:0/1419742286 >> v2:172.21.15.154:3300/0 conn(0x7f19980bda70 0x7f19980bf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.796+0000 7f199cfd6640 1 --2- 172.21.15.103:0/1419742286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19980bf8f0 0x7f19980c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.796+0000 7f199cfd6640 1 --2- 172.21.15.103:0/1419742286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1998150aa0 0x7f1998153ce0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.796+0000 7f199cfd6640 1 -- 172.21.15.103:0/1419742286 >> 172.21.15.103:0/1419742286 conn(0x7f19980c8a50 msgr2=0x7f19980c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:14.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.796+0000 7f199cfd6640 1 -- 172.21.15.103:0/1419742286 shutdown_connections 2024-09-10T08:37:14.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.796+0000 7f199cfd6640 1 -- 172.21.15.103:0/1419742286 wait complete. 2024-09-10T08:37:14.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.798+0000 7f199cfd6640 1 Processor -- start 2024-09-10T08:37:14.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.798+0000 7f199cfd6640 1 -- start start 2024-09-10T08:37:14.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.799+0000 7f199cfd6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19980bda70 0x7f199806be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.799+0000 7f199cfd6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19980bf8f0 0x7f19980a94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.799+0000 7f199cfd6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1998150aa0 0x7f19980a9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.799+0000 7f199cfd6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f19980c55d0 con 0x7f19980bf8f0 2024-09-10T08:37:14.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.799+0000 7f199cfd6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1998150e80 con 0x7f1998150aa0 2024-09-10T08:37:14.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.799+0000 7f199cfd6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f19980c5750 con 0x7f19980bda70 2024-09-10T08:37:14.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.799+0000 7f1996d9d640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1998150aa0 msgr2=0x7f19980a9a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:37:14.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.799+0000 7f1996d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1998150aa0 0x7f19980a9a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:37:14.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.799+0000 7f1995d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19980bf8f0 0x7f19980a94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.799+0000 7f199659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19980bda70 0x7f199806be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.799+0000 7f199659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19980bda70 0x7f199806be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:44378/0 (socket says 172.21.15.103:44378) 2024-09-10T08:37:14.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.799+0000 7f1995d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19980bf8f0 0x7f19980a94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52238/0 (socket says 172.21.15.103:52238) 2024-09-10T08:37:14.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.799+0000 7f199659c640 1 -- 172.21.15.103:0/1961320616 learned_addr learned my addr 172.21.15.103:0/1961320616 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:14.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.799+0000 7f1995d9b640 1 -- 172.21.15.103:0/1961320616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19980bda70 msgr2=0x7f199806be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.799+0000 7f1995d9b640 1 --2- 172.21.15.103:0/1961320616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19980bda70 0x7f199806be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.799+0000 7f1995d9b640 1 -- 172.21.15.103:0/1961320616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1998150aa0 msgr2=0x7f19980a9a30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:37:14.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.799+0000 7f1995d9b640 1 --2- 172.21.15.103:0/1961320616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1998150aa0 0x7f19980a9a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.800+0000 7f1995d9b640 1 -- 172.21.15.103:0/1961320616 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19980a8af0 con 0x7f19980bf8f0 2024-09-10T08:37:14.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.800+0000 7f1995d9b640 1 --2- 172.21.15.103:0/1961320616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19980bf8f0 0x7f19980a94f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f198c003930 tx=0x7f198c00b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:14.811 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:37:14.811 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:37:14.811 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:37:14.812 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:37:14.812 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 72, 2024-09-10T08:37:14.812 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 40926, 2024-09-10T08:37:14.812 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:37:14.812 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:37:14.812 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:37:14.812 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:14.812 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 1, 2024-09-10T08:37:14.812 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:37:14.812 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:37:14.812 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:37:14.813 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:14.813 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:14.813 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:14.813 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:14.813 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:14.813 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:14.813 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:14.813 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:14.813 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:14.813 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:14.813 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:14.813 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:14.814 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:37:14.814 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:37:14.814 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:14.814 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:14.814 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:14.814 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:14.814 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:14.814 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:14.814 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:14.814 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:14.814 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:14.814 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:14.814 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:14.814 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:14.815 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.815 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:37:14.815 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:37:14.815 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:37:14.815 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:37:14.815 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:37:14.815 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:37:14.815 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:37:14.815 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:37:14.815 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:37:14.815 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:37:14.815 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:37:14.815 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:37:14.816 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:37:14.816 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:37:14.816 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:37:14.816 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:37:14.816 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:37:14.816 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:14.816 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:14.816 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:14.816 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:14.816 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:14.816 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:14.816 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:14.816 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:14.817 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:14.817 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:14.817 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:14.817 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:14.817 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:37:14.817 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.817 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:37:14.817 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.817 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:37:14.817 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:37:14.817 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:14.817 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:14.817 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.818 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:14.818 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:37:14.818 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:14.818 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.818 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.818 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:14.818 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:37:14.818 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:14.818 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:14.818 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:14.818 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.818 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:37:14.818 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:37:14.819 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:14.819 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:14.819 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:14.819 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.819 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.819 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:37:14.819 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:37:14.819 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:14.820 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:14.820 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.820 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:14.820 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:37:14.820 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:14.820 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.820 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.820 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:14.820 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:37:14.821 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:14.821 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:14.821 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:14.821 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.821 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:37:14.821 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:37:14.821 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:14.821 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:14.821 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:14.821 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.821 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.821 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:37:14.821 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:37:14.821 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:14.822 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:14.822 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.822 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:14.822 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:37:14.822 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:14.822 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.822 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.822 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:14.822 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:37:14.822 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:14.822 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:14.822 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:14.822 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.823 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:37:14.823 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:37:14.823 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:14.823 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:14.823 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:14.823 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:14.823 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:14.823 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.823 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:37:14.823 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:37:14.823 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.823 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:14.823 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:14.824 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:37:14.824 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:14.824 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:14.824 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:37:14.824 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.824 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:14.824 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:14.824 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:37:14.824 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:14.825 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:14.825 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:37:14.825 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.825 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:14.825 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:14.825 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:37:14.826 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:14.826 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:14.826 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:37:14.826 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.826 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:14.826 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:14.826 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:37:14.827 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:14.827 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:14.827 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:37:14.827 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:14.827 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:14.827 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:14.827 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:37:14.828 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:14.828 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:14.828 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:14.828 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:37:14.828 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:37:14.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.800+0000 7f1986ffd640 1 -- 172.21.15.103:0/1961320616 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c003dc0 con 0x7f19980bf8f0 2024-09-10T08:37:14.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.800+0000 7f1986ffd640 1 -- 172.21.15.103:0/1961320616 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f198c015070 con 0x7f19980bf8f0 2024-09-10T08:37:14.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.800+0000 7f199cfd6640 1 -- 172.21.15.103:0/1961320616 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19981ddfe0 con 0x7f19980bf8f0 2024-09-10T08:37:14.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.800+0000 7f1986ffd640 1 -- 172.21.15.103:0/1961320616 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c005290 con 0x7f19980bf8f0 2024-09-10T08:37:14.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.800+0000 7f199cfd6640 1 -- 172.21.15.103:0/1961320616 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f199806c390 con 0x7f19980bf8f0 2024-09-10T08:37:14.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.801+0000 7f199cfd6640 1 --2- 172.21.15.103:0/1961320616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19980a8df0 0x7f19980a70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.801+0000 7f199cfd6640 1 -- 172.21.15.103:0/1961320616 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f19981f00b0 con 0x7f19980a8df0 2024-09-10T08:37:14.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.801+0000 7f199659c640 1 --2- 172.21.15.103:0/1961320616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19980a8df0 0x7f19980a70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.801+0000 7f1986ffd640 1 -- 172.21.15.103:0/1961320616 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f198c00f070 con 0x7f19980bf8f0 2024-09-10T08:37:14.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.801+0000 7f199659c640 1 -- 172.21.15.103:0/1961320616 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f19980a88a0 con 0x7f19980a8df0 2024-09-10T08:37:14.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.802+0000 7f199659c640 1 --2- 172.21.15.103:0/1961320616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19980a8df0 0x7f19980a70a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1988035040 tx=0x7f19880046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:14.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.802+0000 7f1986ffd640 1 --2- 172.21.15.103:0/1961320616 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f197806bde0 0x7f197806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.802+0000 7f1996d9d640 1 --2- 172.21.15.103:0/1961320616 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f197806bde0 0x7f197806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.802+0000 7f1986ffd640 1 -- 172.21.15.103:0/1961320616 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f198c08a8d0 con 0x7f19980bf8f0 2024-09-10T08:37:14.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.802+0000 7f1986ffd640 1 -- 172.21.15.103:0/1961320616 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1988037040 con 0x7f19980a8df0 2024-09-10T08:37:14.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.802+0000 7f1986ffd640 1 -- 172.21.15.103:0/1961320616 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f198803c640 con 0x7f19980a8df0 2024-09-10T08:37:14.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.802+0000 7f1986ffd640 1 -- 172.21.15.103:0/1961320616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19980a8df0 msgr2=0x7f19980a70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.802+0000 7f1986ffd640 1 --2- 172.21.15.103:0/1961320616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19980a8df0 0x7f19980a70a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1988035040 tx=0x7f19880046c0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.802+0000 7f1986ffd640 1 -- 172.21.15.103:0/1961320616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19980a8df0 msgr2=0x7f19980a70a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:37:14.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.802+0000 7f1986ffd640 1 --2- 172.21.15.103:0/1961320616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19980a8df0 0x7f19980a70a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.802+0000 7f1996d9d640 1 --2- 172.21.15.103:0/1961320616 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f197806bde0 0x7f197806e2a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1990009b10 tx=0x7f199000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:14.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.809+0000 7f199cfd6640 1 --2- 172.21.15.103:0/1961320616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1998157320 0x7f19980a75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.809+0000 7f199cfd6640 1 -- 172.21.15.103:0/1961320616 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1998069a00 con 0x7f1998157320 2024-09-10T08:37:14.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.810+0000 7f199659c640 1 --2- 172.21.15.103:0/1961320616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1998157320 0x7f19980a75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.810+0000 7f199659c640 1 -- 172.21.15.103:0/1961320616 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f19980a7b20 con 0x7f1998157320 2024-09-10T08:37:14.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.810+0000 7f199659c640 1 --2- 172.21.15.103:0/1961320616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1998157320 0x7f19980a75e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f19980beb20 tx=0x7f1988009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:14.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.810+0000 7f1986ffd640 1 -- 172.21.15.103:0/1961320616 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1988037030 con 0x7f1998157320 2024-09-10T08:37:14.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.811+0000 7f1986ffd640 1 -- 172.21.15.103:0/1961320616 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5042 (secure 0 0 0) 0x7f1988003820 con 0x7f1998157320 2024-09-10T08:37:14.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.811+0000 7f1986ffd640 1 -- 172.21.15.103:0/1961320616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1998157320 msgr2=0x7f19980a75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.811+0000 7f1986ffd640 1 --2- 172.21.15.103:0/1961320616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1998157320 0x7f19980a75e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f19980beb20 tx=0x7f1988009240 comp rx=0 tx=0).stop 2024-09-10T08:37:14.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.811+0000 7f1986ffd640 1 -- 172.21.15.103:0/1961320616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1998157320 msgr2=0x7f19980a75e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:37:14.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.811+0000 7f1986ffd640 1 --2- 172.21.15.103:0/1961320616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1998157320 0x7f19980a75e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.811+0000 7f199cfd6640 1 -- 172.21.15.103:0/1961320616 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f197806bde0 msgr2=0x7f197806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.811+0000 7f199cfd6640 1 --2- 172.21.15.103:0/1961320616 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f197806bde0 0x7f197806e2a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1990009b10 tx=0x7f199000b040 comp rx=0 tx=0).stop 2024-09-10T08:37:14.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.811+0000 7f199cfd6640 1 -- 172.21.15.103:0/1961320616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19980bf8f0 msgr2=0x7f19980a94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.811+0000 7f199cfd6640 1 --2- 172.21.15.103:0/1961320616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19980bf8f0 0x7f19980a94f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f198c003930 tx=0x7f198c00b9b0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.811+0000 7f1996d9d640 1 -- 172.21.15.103:0/1961320616 reap_dead start 2024-09-10T08:37:14.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.811+0000 7f199cfd6640 1 -- 172.21.15.103:0/1961320616 shutdown_connections 2024-09-10T08:37:14.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.811+0000 7f199cfd6640 1 --2- 172.21.15.103:0/1961320616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19980bf8f0 0x7f19980a94f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.811+0000 7f199cfd6640 1 -- 172.21.15.103:0/1961320616 >> 172.21.15.103:0/1961320616 conn(0x7f19980c8a50 msgr2=0x7f19980ad870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:14.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.811+0000 7f199cfd6640 1 -- 172.21.15.103:0/1961320616 shutdown_connections 2024-09-10T08:37:14.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:14.811+0000 7f199cfd6640 1 -- 172.21.15.103:0/1961320616 wait complete. 2024-09-10T08:37:14.881 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:37:14.881 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-10T08:37:31.485 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:37:31.488 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:37:34.882 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-10T08:37:34.883 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-10T08:37:34.883 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T08:37:34.883 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T08:37:34.885 INFO:tasks.ceph.mon.b:Started 2024-09-10T08:37:34.886 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:37:34.886 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:37:35.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.779+0000 7f559c242640 1 Processor -- start 2024-09-10T08:37:35.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.779+0000 7f559c242640 1 -- start start 2024-09-10T08:37:35.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.780+0000 7f559c242640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f55940c8b10 0x7f559415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:35.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.780+0000 7f559c242640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5594153be0 0x7f5594156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:35.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.780+0000 7f559c242640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55940c7070 con 0x7f559406cd80 2024-09-10T08:37:35.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.780+0000 7f559c242640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f559406d210 con 0x7f55940c8b10 2024-09-10T08:37:35.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.780+0000 7f559c242640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f55940c69b0 con 0x7f5594153be0 2024-09-10T08:37:35.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.780+0000 7f5599fde640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f55940c8b10 0x7f559415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:35.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.780+0000 7f5599fde640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f55940c8b10 0x7f559415a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59016/0 (socket says 172.21.15.103:59016) 2024-09-10T08:37:35.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.780+0000 7f5599fde640 1 -- 172.21.15.103:0/1601082005 learned_addr learned my addr 172.21.15.103:0/1601082005 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:35.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.780+0000 7f55997dd640 1 --1- 172.21.15.103:0/1601082005 >> v1:172.21.15.103:6789/0 conn(0x7f559406cd80 0x7f55941534d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33318/0 (socket says 172.21.15.103:33318) 2024-09-10T08:37:35.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.780+0000 7f559a7df640 1 --2- 172.21.15.103:0/1601082005 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5594153be0 0x7f5594156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:35.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.781+0000 7f5599fde640 1 -- 172.21.15.103:0/1601082005 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5594153be0 msgr2=0x7f5594156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:35.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.781+0000 7f5599fde640 1 --2- 172.21.15.103:0/1601082005 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5594153be0 0x7f5594156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:35.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.781+0000 7f5599fde640 1 -- 172.21.15.103:0/1601082005 >> v1:172.21.15.103:6789/0 conn(0x7f559406cd80 legacy=0x7f55941534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:35.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.781+0000 7f5599fde640 1 -- 172.21.15.103:0/1601082005 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55940c6c90 con 0x7f55940c8b10 2024-09-10T08:37:35.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.781+0000 7f5599fde640 1 --2- 172.21.15.103:0/1601082005 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55940c8b10 0x7f559415a4a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5590009870 tx=0x7f559002a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56681831be79f3af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:35.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.782+0000 7f5598fdc640 1 -- 172.21.15.103:0/1601082005 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5590037070 con 0x7f55940c8b10 2024-09-10T08:37:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.782+0000 7f5598fdc640 1 -- 172.21.15.103:0/1601082005 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f559002ad60 con 0x7f55940c8b10 2024-09-10T08:37:35.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.782+0000 7f5598fdc640 1 -- 172.21.15.103:0/1601082005 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5590032660 con 0x7f55940c8b10 2024-09-10T08:37:35.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.782+0000 7f559c242640 1 -- 172.21.15.103:0/1601082005 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55940c8b10 msgr2=0x7f559415a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:35.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.782+0000 7f559c242640 1 --2- 172.21.15.103:0/1601082005 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55940c8b10 0x7f559415a4a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5590009870 tx=0x7f559002a0d0 comp rx=0 tx=0).stop 2024-09-10T08:37:35.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.782+0000 7f559c242640 1 -- 172.21.15.103:0/1601082005 shutdown_connections 2024-09-10T08:37:35.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.782+0000 7f559c242640 1 --2- 172.21.15.103:0/1601082005 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5594153be0 0x7f5594156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:35.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.782+0000 7f559c242640 1 --2- 172.21.15.103:0/1601082005 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55940c8b10 0x7f559415a4a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:35.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.782+0000 7f559c242640 1 -- 172.21.15.103:0/1601082005 >> 172.21.15.103:0/1601082005 conn(0x7f55940adb80 msgr2=0x7f55940adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:35.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.782+0000 7f559c242640 1 -- 172.21.15.103:0/1601082005 shutdown_connections 2024-09-10T08:37:35.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.782+0000 7f559c242640 1 -- 172.21.15.103:0/1601082005 wait complete. 2024-09-10T08:37:35.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.784+0000 7f559c242640 1 Processor -- start 2024-09-10T08:37:35.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.784+0000 7f559c242640 1 -- start start 2024-09-10T08:37:35.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.784+0000 7f559c242640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55940c8b10 0x7f55940ad250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:35.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.784+0000 7f559c242640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5594153be0 0x7f55941efb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:35.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.784+0000 7f559c242640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55941ebf90 0x7f55941f0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:35.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.784+0000 7f559c242640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f55940c9070 con 0x7f55940c8b10 2024-09-10T08:37:35.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.784+0000 7f559c242640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55940c8ef0 con 0x7f5594153be0 2024-09-10T08:37:35.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.784+0000 7f559c242640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5594156ba0 con 0x7f55941ebf90 2024-09-10T08:37:35.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.784+0000 7f5599fde640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55940c8b10 0x7f55940ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:35.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.784+0000 7f5599fde640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55940c8b10 0x7f55940ad250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59032/0 (socket says 172.21.15.103:59032) 2024-09-10T08:37:35.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.784+0000 7f5599fde640 1 -- 172.21.15.103:0/4159753692 learned_addr learned my addr 172.21.15.103:0/4159753692 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:35.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.785+0000 7f559a7df640 1 --2- 172.21.15.103:0/4159753692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55941ebf90 0x7f55941f0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:35.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.785+0000 7f55997dd640 1 --2- 172.21.15.103:0/4159753692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5594153be0 0x7f55941efb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:35.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.785+0000 7f55997dd640 1 -- 172.21.15.103:0/4159753692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5594153be0 msgr2=0x7f55941efb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-10T08:37:35.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.785+0000 7f55997dd640 1 -- 172.21.15.103:0/4159753692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5594153be0 msgr2=0x7f55941efb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:37:35.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.785+0000 7f55997dd640 1 --2- 172.21.15.103:0/4159753692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5594153be0 0x7f55941efb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:37:35.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.785+0000 7f55997dd640 1 --2- 172.21.15.103:0/4159753692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5594153be0 0x7f55941efb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:37:35.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.785+0000 7f5599fde640 1 -- 172.21.15.103:0/4159753692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55941ebf90 msgr2=0x7f55941f0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:35.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.785+0000 7f5599fde640 1 --2- 172.21.15.103:0/4159753692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55941ebf90 0x7f55941f0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:35.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.785+0000 7f5599fde640 1 -- 172.21.15.103:0/4159753692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5594153be0 msgr2=0x7f55941efb50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:37:35.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.785+0000 7f5599fde640 1 --2- 172.21.15.103:0/4159753692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5594153be0 0x7f55941efb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:35.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.785+0000 7f5599fde640 1 -- 172.21.15.103:0/4159753692 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559414e2b0 con 0x7f55940c8b10 2024-09-10T08:37:35.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.785+0000 7f5599fde640 1 --2- 172.21.15.103:0/4159753692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55940c8b10 0x7f55940ad250 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5590000c00 tx=0x7f55900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:35.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.785+0000 7f558a7fc640 1 -- 172.21.15.103:0/4159753692 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5590037040 con 0x7f55940c8b10 2024-09-10T08:37:35.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.785+0000 7f558a7fc640 1 -- 172.21.15.103:0/4159753692 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5590004030 con 0x7f55940c8b10 2024-09-10T08:37:35.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.785+0000 7f558a7fc640 1 -- 172.21.15.103:0/4159753692 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5590004420 con 0x7f55940c8b10 2024-09-10T08:37:35.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.785+0000 7f559c242640 1 -- 172.21.15.103:0/4159753692 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f559414e520 con 0x7f55940c8b10 2024-09-10T08:37:35.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.785+0000 7f559c242640 1 -- 172.21.15.103:0/4159753692 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55940ad790 con 0x7f55940c8b10 2024-09-10T08:37:35.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.786+0000 7f559c242640 1 -- 172.21.15.103:0/4159753692 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5594157030 con 0x7f55940c8b10 2024-09-10T08:37:35.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.787+0000 7f558a7fc640 1 -- 172.21.15.103:0/4159753692 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5590003610 con 0x7f55940c8b10 2024-09-10T08:37:35.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.787+0000 7f558a7fc640 1 --2- 172.21.15.103:0/4159753692 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f557806be30 0x7f557806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:35.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.787+0000 7f558a7fc640 1 -- 172.21.15.103:0/4159753692 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f55900ab9b0 con 0x7f55940c8b10 2024-09-10T08:37:35.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.787+0000 7f55997dd640 1 --2- 172.21.15.103:0/4159753692 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f557806be30 0x7f557806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:35.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.788+0000 7f55997dd640 1 --2- 172.21.15.103:0/4159753692 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f557806be30 0x7f557806e2f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f55940b2350 tx=0x7f5584007ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:35.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:35.792+0000 7f558a7fc640 1 -- 172.21.15.103:0/4159753692 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f559007a150 con 0x7f55940c8b10 2024-09-10T08:37:36.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:36.077+0000 7f559c242640 1 -- 172.21.15.103:0/4159753692 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5594157030 con 0x7f55940c8b10 2024-09-10T08:37:36.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:36.078+0000 7f558a7fc640 1 -- 172.21.15.103:0/4159753692 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f5590079a50 con 0x7f55940c8b10 2024-09-10T08:37:36.078 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":72,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:37:36.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:36.080+0000 7f559c242640 1 -- 172.21.15.103:0/4159753692 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f557806be30 msgr2=0x7f557806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:36.080+0000 7f559c242640 1 --2- 172.21.15.103:0/4159753692 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f557806be30 0x7f557806e2f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f55940b2350 tx=0x7f5584007ca0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:36.080+0000 7f559c242640 1 -- 172.21.15.103:0/4159753692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55940c8b10 msgr2=0x7f55940ad250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:36.080+0000 7f559c242640 1 --2- 172.21.15.103:0/4159753692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55940c8b10 0x7f55940ad250 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5590000c00 tx=0x7f55900046c0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:36.080+0000 7f559c242640 1 -- 172.21.15.103:0/4159753692 shutdown_connections 2024-09-10T08:37:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:36.080+0000 7f559c242640 1 --2- 172.21.15.103:0/4159753692 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f557806be30 0x7f557806e2f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:36.080+0000 7f559c242640 1 --2- 172.21.15.103:0/4159753692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55941ebf90 0x7f55941f0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:36.080+0000 7f559c242640 1 --2- 172.21.15.103:0/4159753692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5594153be0 0x7f55941efb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:36.080+0000 7f559c242640 1 --2- 172.21.15.103:0/4159753692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55940c8b10 0x7f55940ad250 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:36.081+0000 7f559c242640 1 -- 172.21.15.103:0/4159753692 >> 172.21.15.103:0/4159753692 conn(0x7f55940adb80 msgr2=0x7f5594151fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:36.081+0000 7f559c242640 1 -- 172.21.15.103:0/4159753692 shutdown_connections 2024-09-10T08:37:36.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:36.081+0000 7f559c242640 1 -- 172.21.15.103:0/4159753692 wait complete. 2024-09-10T08:37:39.093 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:37:39.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.217+0000 7f1693178640 1 Processor -- start 2024-09-10T08:37:39.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.217+0000 7f1693178640 1 -- start start 2024-09-10T08:37:39.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.218+0000 7f1693178640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f168c0c8b10 0x7f168c15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.218+0000 7f1693178640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f168c06cd80 0x7f168c1534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.218+0000 7f1693178640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f168c153a10 0x7f168c156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.218+0000 7f1693178640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f168c0c7070 con 0x7f168c0c8b10 2024-09-10T08:37:39.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.218+0000 7f1693178640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f168c06d210 con 0x7f168c06cd80 2024-09-10T08:37:39.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.218+0000 7f1693178640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f168c0c69b0 con 0x7f168c153a10 2024-09-10T08:37:39.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.218+0000 7f1690f14640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f168c0c8b10 0x7f168c15a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.218+0000 7f1690f14640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f168c0c8b10 0x7f168c15a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59048/0 (socket says 172.21.15.103:59048) 2024-09-10T08:37:39.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.219+0000 7f1690f14640 1 -- 172.21.15.103:0/3180378651 learned_addr learned my addr 172.21.15.103:0/3180378651 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:39.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.219+0000 7f168bfff640 1 --2- 172.21.15.103:0/3180378651 >> v2:172.21.15.154:3300/0 conn(0x7f168c06cd80 0x7f168c1534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.219+0000 7f1691715640 1 --2- 172.21.15.103:0/3180378651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f168c153a10 0x7f168c156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.219+0000 7f168bfff640 1 -- 172.21.15.103:0/3180378651 >> v2:172.21.15.154:3300/0 conn(0x7f168c06cd80 msgr2=0x7f168c1534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:37:39.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.219+0000 7f168bfff640 1 -- 172.21.15.103:0/3180378651 >> v2:172.21.15.154:3300/0 conn(0x7f168c06cd80 msgr2=0x7f168c1534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:37:39.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.219+0000 7f168bfff640 1 --2- 172.21.15.103:0/3180378651 >> v2:172.21.15.154:3300/0 conn(0x7f168c06cd80 0x7f168c1534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:37:39.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.219+0000 7f168bfff640 1 --2- 172.21.15.103:0/3180378651 >> v2:172.21.15.154:3300/0 conn(0x7f168c06cd80 0x7f168c1534d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:37:39.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.219+0000 7f1690f14640 1 -- 172.21.15.103:0/3180378651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f168c153a10 msgr2=0x7f168c156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:39.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.219+0000 7f1690f14640 1 --2- 172.21.15.103:0/3180378651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f168c153a10 0x7f168c156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.219+0000 7f1690f14640 1 -- 172.21.15.103:0/3180378651 >> v2:172.21.15.154:3300/0 conn(0x7f168c06cd80 msgr2=0x7f168c1534d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:37:39.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.219+0000 7f1690f14640 1 --2- 172.21.15.103:0/3180378651 >> v2:172.21.15.154:3300/0 conn(0x7f168c06cd80 0x7f168c1534d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.219+0000 7f1690f14640 1 -- 172.21.15.103:0/3180378651 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f168c0c6c90 con 0x7f168c0c8b10 2024-09-10T08:37:39.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.220+0000 7f1690f14640 1 --2- 172.21.15.103:0/3180378651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f168c0c8b10 0x7f168c15a4a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f168c06ec00 tx=0x7f168002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb6254b6bbf29b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.220+0000 7f168b7fe640 1 -- 172.21.15.103:0/3180378651 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1680037070 con 0x7f168c0c8b10 2024-09-10T08:37:39.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.220+0000 7f168b7fe640 1 -- 172.21.15.103:0/3180378651 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1680032440 con 0x7f168c0c8b10 2024-09-10T08:37:39.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.220+0000 7f168b7fe640 1 -- 172.21.15.103:0/3180378651 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1680032810 con 0x7f168c0c8b10 2024-09-10T08:37:39.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.221+0000 7f1693178640 1 -- 172.21.15.103:0/3180378651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f168c0c8b10 msgr2=0x7f168c15a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.221+0000 7f1693178640 1 --2- 172.21.15.103:0/3180378651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f168c0c8b10 0x7f168c15a4a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f168c06ec00 tx=0x7f168002a140 comp rx=0 tx=0).stop 2024-09-10T08:37:39.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.221+0000 7f1693178640 1 -- 172.21.15.103:0/3180378651 shutdown_connections 2024-09-10T08:37:39.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.221+0000 7f1693178640 1 --2- 172.21.15.103:0/3180378651 >> v2:172.21.15.154:3300/0 conn(0x7f168c06cd80 0x7f168c1534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.221+0000 7f1693178640 1 --2- 172.21.15.103:0/3180378651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f168c153a10 0x7f168c156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.221+0000 7f1693178640 1 --2- 172.21.15.103:0/3180378651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f168c0c8b10 0x7f168c15a4a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.221+0000 7f1693178640 1 -- 172.21.15.103:0/3180378651 >> 172.21.15.103:0/3180378651 conn(0x7f168c0adb80 msgr2=0x7f168c0adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:39.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.221+0000 7f1693178640 1 -- 172.21.15.103:0/3180378651 shutdown_connections 2024-09-10T08:37:39.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.221+0000 7f1693178640 1 -- 172.21.15.103:0/3180378651 wait complete. 2024-09-10T08:37:39.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.222+0000 7f1693178640 1 Processor -- start 2024-09-10T08:37:39.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.222+0000 7f1693178640 1 -- start start 2024-09-10T08:37:39.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.223+0000 7f1693178640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f168c0c8b10 0x7f168c14c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.223+0000 7f1693178640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f168c153a10 0x7f168c1ee8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.223+0000 7f1693178640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f168c0caf00 0x7f168c0cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.223+0000 7f1693178640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f168c154020 con 0x7f168c0c8b10 2024-09-10T08:37:39.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.223+0000 7f1693178640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f168c153ea0 con 0x7f168c153a10 2024-09-10T08:37:39.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.223+0000 7f1693178640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f168c0c8ef0 con 0x7f168c0caf00 2024-09-10T08:37:39.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.224+0000 7f1690f14640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f168c0c8b10 0x7f168c14c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.224+0000 7f1690f14640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f168c0c8b10 0x7f168c14c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59050/0 (socket says 172.21.15.103:59050) 2024-09-10T08:37:39.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.224+0000 7f1690f14640 1 -- 172.21.15.103:0/2103248904 learned_addr learned my addr 172.21.15.103:0/2103248904 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:39.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.224+0000 7f168bfff640 1 --2- 172.21.15.103:0/2103248904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f168c153a10 0x7f168c1ee8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.224+0000 7f1691715640 1 --2- 172.21.15.103:0/2103248904 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f168c0caf00 0x7f168c0cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.224+0000 7f168bfff640 1 -- 172.21.15.103:0/2103248904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f168c153a10 msgr2=0x7f168c1ee8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-10T08:37:39.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.224+0000 7f168bfff640 1 -- 172.21.15.103:0/2103248904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f168c153a10 msgr2=0x7f168c1ee8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:37:39.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.224+0000 7f168bfff640 1 --2- 172.21.15.103:0/2103248904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f168c153a10 0x7f168c1ee8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:37:39.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.224+0000 7f168bfff640 1 --2- 172.21.15.103:0/2103248904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f168c153a10 0x7f168c1ee8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:37:39.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.224+0000 7f1690f14640 1 -- 172.21.15.103:0/2103248904 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f168c0caf00 msgr2=0x7f168c0cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.224+0000 7f1690f14640 1 --2- 172.21.15.103:0/2103248904 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f168c0caf00 0x7f168c0cb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.224+0000 7f1690f14640 1 -- 172.21.15.103:0/2103248904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f168c153a10 msgr2=0x7f168c1ee8e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:37:39.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.224+0000 7f1690f14640 1 --2- 172.21.15.103:0/2103248904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f168c153a10 0x7f168c1ee8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.224+0000 7f1690f14640 1 -- 172.21.15.103:0/2103248904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f168c1ebc70 con 0x7f168c0c8b10 2024-09-10T08:37:39.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.224+0000 7f1690f14640 1 --2- 172.21.15.103:0/2103248904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f168c0c8b10 0x7f168c14c910 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f168002a180 tx=0x7f16800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.224+0000 7f16897fa640 1 -- 172.21.15.103:0/2103248904 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1680037040 con 0x7f168c0c8b10 2024-09-10T08:37:39.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.224+0000 7f16897fa640 1 -- 172.21.15.103:0/2103248904 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1680042070 con 0x7f168c0c8b10 2024-09-10T08:37:39.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.224+0000 7f1693178640 1 -- 172.21.15.103:0/2103248904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f168c1effe0 con 0x7f168c0c8b10 2024-09-10T08:37:39.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.224+0000 7f16897fa640 1 -- 172.21.15.103:0/2103248904 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1680030880 con 0x7f168c0c8b10 2024-09-10T08:37:39.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.224+0000 7f1693178640 1 -- 172.21.15.103:0/2103248904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f168c1501e0 con 0x7f168c0c8b10 2024-09-10T08:37:39.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.226+0000 7f1693178640 1 -- 172.21.15.103:0/2103248904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f168c1534d0 con 0x7f168c0c8b10 2024-09-10T08:37:39.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.226+0000 7f16897fa640 1 -- 172.21.15.103:0/2103248904 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1680030a20 con 0x7f168c0c8b10 2024-09-10T08:37:39.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.226+0000 7f16897fa640 1 --2- 172.21.15.103:0/2103248904 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f167006be30 0x7f167006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.227+0000 7f16897fa640 1 -- 172.21.15.103:0/2103248904 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f16800ab9a0 con 0x7f168c0c8b10 2024-09-10T08:37:39.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.227+0000 7f168bfff640 1 --2- 172.21.15.103:0/2103248904 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f167006be30 0x7f167006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.227+0000 7f168bfff640 1 --2- 172.21.15.103:0/2103248904 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f167006be30 0x7f167006e2f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f168c14cf30 tx=0x7f1678008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.231+0000 7f16897fa640 1 -- 172.21.15.103:0/2103248904 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f168007a040 con 0x7f168c0c8b10 2024-09-10T08:37:39.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.533+0000 7f1693178640 1 -- 172.21.15.103:0/2103248904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f168c0c9d90 con 0x7f168c0c8b10 2024-09-10T08:37:39.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.534+0000 7f16897fa640 1 -- 172.21.15.103:0/2103248904 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f1680079940 con 0x7f168c0c8b10 2024-09-10T08:37:39.534 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":74,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:37:39.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.536+0000 7f1693178640 1 -- 172.21.15.103:0/2103248904 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f167006be30 msgr2=0x7f167006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.536+0000 7f1693178640 1 --2- 172.21.15.103:0/2103248904 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f167006be30 0x7f167006e2f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f168c14cf30 tx=0x7f1678008040 comp rx=0 tx=0).stop 2024-09-10T08:37:39.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.536+0000 7f1693178640 1 -- 172.21.15.103:0/2103248904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f168c0c8b10 msgr2=0x7f168c14c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.536+0000 7f1693178640 1 --2- 172.21.15.103:0/2103248904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f168c0c8b10 0x7f168c14c910 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f168002a180 tx=0x7f16800046c0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.536+0000 7f1693178640 1 -- 172.21.15.103:0/2103248904 shutdown_connections 2024-09-10T08:37:39.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.536+0000 7f1693178640 1 --2- 172.21.15.103:0/2103248904 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f167006be30 0x7f167006e2f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.536+0000 7f1693178640 1 --2- 172.21.15.103:0/2103248904 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f168c0caf00 0x7f168c0cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.536+0000 7f1693178640 1 --2- 172.21.15.103:0/2103248904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f168c153a10 0x7f168c1ee8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.536+0000 7f1693178640 1 --2- 172.21.15.103:0/2103248904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f168c0c8b10 0x7f168c14c910 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.536+0000 7f1693178640 1 -- 172.21.15.103:0/2103248904 >> 172.21.15.103:0/2103248904 conn(0x7f168c0adb80 msgr2=0x7f168c1525d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:39.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.536+0000 7f1693178640 1 -- 172.21.15.103:0/2103248904 shutdown_connections 2024-09-10T08:37:39.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.536+0000 7f1693178640 1 -- 172.21.15.103:0/2103248904 wait complete. 2024-09-10T08:37:39.553 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:37:39.553 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:37:39.553 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:37:39.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.667+0000 7fbf276a5640 1 Processor -- start 2024-09-10T08:37:39.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.667+0000 7fbf276a5640 1 -- start start 2024-09-10T08:37:39.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.668+0000 7fbf276a5640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbf2006c650 0x7fbf200c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.668+0000 7fbf276a5640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf2015a7c0 con 0x7fbf200ca1c0 2024-09-10T08:37:39.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.668+0000 7fbf276a5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf20159a00 con 0x7fbf20150480 2024-09-10T08:37:39.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.668+0000 7fbf276a5640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fbf2006c240 con 0x7fbf2006c650 2024-09-10T08:37:39.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.668+0000 7fbf24c40640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbf2006c650 0x7fbf200c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.668+0000 7fbf24c40640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbf2006c650 0x7fbf200c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59062/0 (socket says 172.21.15.103:59062) 2024-09-10T08:37:39.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.668+0000 7fbf24c40640 1 -- 172.21.15.103:0/372274802 learned_addr learned my addr 172.21.15.103:0/372274802 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:39.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.668+0000 7fbf25c42640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbf200ca1c0 0x7fbf20160bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33326/0 (socket says 172.21.15.103:33326) 2024-09-10T08:37:39.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.669+0000 7fbf24c40640 1 -- 172.21.15.103:0/372274802 >> v1:172.21.15.154:6789/0 conn(0x7fbf20150480 legacy=0x7fbf200c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.669+0000 7fbf24c40640 1 -- 172.21.15.103:0/372274802 >> v1:172.21.15.103:6789/0 conn(0x7fbf200ca1c0 legacy=0x7fbf20160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.669+0000 7fbf17fff640 1 -- 172.21.15.103:0/372274802 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1252554908 0 0) 0x7fbf2015a7c0 con 0x7fbf200ca1c0 2024-09-10T08:37:39.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.669+0000 7fbf24c40640 1 -- 172.21.15.103:0/372274802 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf20159ce0 con 0x7fbf2006c650 2024-09-10T08:37:39.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.669+0000 7fbf24c40640 1 --2- 172.21.15.103:0/372274802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf2006c650 0x7fbf200c9c80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009870 tx=0x7fbf1002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb95f82a975add1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.670+0000 7fbf17fff640 1 -- 172.21.15.103:0/372274802 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf10037070 con 0x7fbf2006c650 2024-09-10T08:37:39.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.670+0000 7fbf17fff640 1 -- 172.21.15.103:0/372274802 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf1002ae50 con 0x7fbf2006c650 2024-09-10T08:37:39.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.670+0000 7fbf17fff640 1 -- 172.21.15.103:0/372274802 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf10032860 con 0x7fbf2006c650 2024-09-10T08:37:39.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.670+0000 7fbf276a5640 1 -- 172.21.15.103:0/372274802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf2006c650 msgr2=0x7fbf200c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.670+0000 7fbf276a5640 1 --2- 172.21.15.103:0/372274802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf2006c650 0x7fbf200c9c80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009870 tx=0x7fbf1002a300 comp rx=0 tx=0).stop 2024-09-10T08:37:39.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.670+0000 7fbf276a5640 1 -- 172.21.15.103:0/372274802 shutdown_connections 2024-09-10T08:37:39.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.670+0000 7fbf276a5640 1 --2- 172.21.15.103:0/372274802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf2006c650 0x7fbf200c9c80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.670+0000 7fbf276a5640 1 -- 172.21.15.103:0/372274802 >> 172.21.15.103:0/372274802 conn(0x7fbf20068030 msgr2=0x7fbf20073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:39.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.671+0000 7fbf276a5640 1 -- 172.21.15.103:0/372274802 shutdown_connections 2024-09-10T08:37:39.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.671+0000 7fbf276a5640 1 -- 172.21.15.103:0/372274802 wait complete. 2024-09-10T08:37:39.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.672+0000 7fbf276a5640 1 Processor -- start 2024-09-10T08:37:39.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.672+0000 7fbf276a5640 1 -- start start 2024-09-10T08:37:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.673+0000 7fbf276a5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf2006c650 0x7fbf2014f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.673+0000 7fbf276a5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf200ca1c0 0x7fbf201ef3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.673+0000 7fbf276a5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf20150480 0x7fbf201e1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.673+0000 7fbf276a5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2006d270 con 0x7fbf200ca1c0 2024-09-10T08:37:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.673+0000 7fbf276a5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2015a330 con 0x7fbf20150480 2024-09-10T08:37:39.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.673+0000 7fbf276a5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fbf200ca5f0 con 0x7fbf2006c650 2024-09-10T08:37:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.673+0000 7fbf24c40640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf200ca1c0 0x7fbf201ef3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.673+0000 7fbf24c40640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf200ca1c0 0x7fbf201ef3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59064/0 (socket says 172.21.15.103:59064) 2024-09-10T08:37:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.673+0000 7fbf24c40640 1 -- 172.21.15.103:0/4197679584 learned_addr learned my addr 172.21.15.103:0/4197679584 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.673+0000 7fbf25c42640 1 --2- 172.21.15.103:0/4197679584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf20150480 0x7fbf201e1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.673+0000 7fbf25441640 1 --2- 172.21.15.103:0/4197679584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf2006c650 0x7fbf2014f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.673+0000 7fbf24c40640 1 -- 172.21.15.103:0/4197679584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf2006c650 msgr2=0x7fbf2014f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.673+0000 7fbf24c40640 1 --2- 172.21.15.103:0/4197679584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf2006c650 0x7fbf2014f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.673+0000 7fbf24c40640 1 -- 172.21.15.103:0/4197679584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf20150480 msgr2=0x7fbf201e1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.673+0000 7fbf24c40640 1 --2- 172.21.15.103:0/4197679584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf20150480 0x7fbf201e1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.673+0000 7fbf24c40640 1 -- 172.21.15.103:0/4197679584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2014fbf0 con 0x7fbf200ca1c0 2024-09-10T08:37:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.674+0000 7fbf24c40640 1 --2- 172.21.15.103:0/4197679584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf200ca1c0 0x7fbf201ef3f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009870 tx=0x7fbf100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.674+0000 7fbf15ffb640 1 -- 172.21.15.103:0/4197679584 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf10041070 con 0x7fbf200ca1c0 2024-09-10T08:37:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.674+0000 7fbf15ffb640 1 -- 172.21.15.103:0/4197679584 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf1003c870 con 0x7fbf200ca1c0 2024-09-10T08:37:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.674+0000 7fbf15ffb640 1 -- 172.21.15.103:0/4197679584 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf10037040 con 0x7fbf200ca1c0 2024-09-10T08:37:39.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.674+0000 7fbf276a5640 1 -- 172.21.15.103:0/4197679584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf2014f410 con 0x7fbf200ca1c0 2024-09-10T08:37:39.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.674+0000 7fbf276a5640 1 -- 172.21.15.103:0/4197679584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf201ef930 con 0x7fbf200ca1c0 2024-09-10T08:37:39.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.675+0000 7fbf276a5640 1 --2- 172.21.15.103:0/4197679584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf201e1a90 0x7fbf20152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.675+0000 7fbf276a5640 1 -- 172.21.15.103:0/4197679584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbf20156270 con 0x7fbf201e1a90 2024-09-10T08:37:39.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.675+0000 7fbf25441640 1 --2- 172.21.15.103:0/4197679584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf201e1a90 0x7fbf20152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.676+0000 7fbf25441640 1 -- 172.21.15.103:0/4197679584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf2006c430 con 0x7fbf201e1a90 2024-09-10T08:37:39.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.676+0000 7fbf25441640 1 --2- 172.21.15.103:0/4197679584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf201e1a90 0x7fbf20152d50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c000f60 tx=0x7fbf1c00fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.676+0000 7fbf15ffb640 1 -- 172.21.15.103:0/4197679584 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf10044070 con 0x7fbf200ca1c0 2024-09-10T08:37:39.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.676+0000 7fbf15ffb640 1 --2- 172.21.15.103:0/4197679584 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbf0406be30 0x7fbf0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.676+0000 7fbf15ffb640 1 -- 172.21.15.103:0/4197679584 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fbf100abdb0 con 0x7fbf200ca1c0 2024-09-10T08:37:39.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.676+0000 7fbf25c42640 1 --2- 172.21.15.103:0/4197679584 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbf0406be30 0x7fbf0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.677+0000 7fbf15ffb640 1 -- 172.21.15.103:0/4197679584 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c0050d0 con 0x7fbf201e1a90 2024-09-10T08:37:39.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.677+0000 7fbf15ffb640 1 -- 172.21.15.103:0/4197679584 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbf1c005270 con 0x7fbf201e1a90 2024-09-10T08:37:39.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.677+0000 7fbf15ffb640 1 -- 172.21.15.103:0/4197679584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf201e1a90 msgr2=0x7fbf20152d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.677+0000 7fbf15ffb640 1 --2- 172.21.15.103:0/4197679584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf201e1a90 0x7fbf20152d50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c000f60 tx=0x7fbf1c00fc00 comp rx=0 tx=0).stop 2024-09-10T08:37:39.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.677+0000 7fbf15ffb640 1 -- 172.21.15.103:0/4197679584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf201e1a90 msgr2=0x7fbf20152d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:37:39.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.677+0000 7fbf15ffb640 1 --2- 172.21.15.103:0/4197679584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf201e1a90 0x7fbf20152d50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.677+0000 7fbf25c42640 1 --2- 172.21.15.103:0/4197679584 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbf0406be30 0x7fbf0406e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbf180012e0 tx=0x7fbf18004d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.684+0000 7fbf276a5640 1 --2- 172.21.15.103:0/4197679584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf201e02e0 0x7fbf2014e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.684+0000 7fbf276a5640 1 -- 172.21.15.103:0/4197679584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbf200cb4e0 con 0x7fbf201e02e0 2024-09-10T08:37:39.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.684+0000 7fbf25441640 1 --2- 172.21.15.103:0/4197679584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf201e02e0 0x7fbf2014e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.684+0000 7fbf25441640 1 -- 172.21.15.103:0/4197679584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbf201efb60 con 0x7fbf201e02e0 2024-09-10T08:37:39.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.685+0000 7fbf25441640 1 --2- 172.21.15.103:0/4197679584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf201e02e0 0x7fbf2014e6b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c000f60 tx=0x7fbf1c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.685+0000 7fbf15ffb640 1 -- 172.21.15.103:0/4197679584 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c0050d0 con 0x7fbf201e02e0 2024-09-10T08:37:39.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.685+0000 7fbf15ffb640 1 -- 172.21.15.103:0/4197679584 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5056 (secure 0 0 0) 0x7fbf1c006c60 con 0x7fbf201e02e0 2024-09-10T08:37:39.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.685+0000 7fbf15ffb640 1 -- 172.21.15.103:0/4197679584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf201e02e0 msgr2=0x7fbf2014e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.685+0000 7fbf15ffb640 1 --2- 172.21.15.103:0/4197679584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf201e02e0 0x7fbf2014e6b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c000f60 tx=0x7fbf1c001120 comp rx=0 tx=0).stop 2024-09-10T08:37:39.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.685+0000 7fbf15ffb640 1 -- 172.21.15.103:0/4197679584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf201e02e0 msgr2=0x7fbf2014e6b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:37:39.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.685+0000 7fbf15ffb640 1 --2- 172.21.15.103:0/4197679584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf201e02e0 0x7fbf2014e6b0 secure :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c000f60 tx=0x7fbf1c001120 comp rx=0 tx=0).stop 2024-09-10T08:37:39.686 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:37:39.686 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:37:39.686 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:37:39.686 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:37:39.686 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 74, 2024-09-10T08:37:39.686 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 229753, 2024-09-10T08:37:39.686 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:37:39.686 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:37:39.686 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:37:39.686 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:37:39.686 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:39.687 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 1, 2024-09-10T08:37:39.687 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:37:39.687 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:37:39.687 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:37:39.687 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:39.687 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:39.687 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:39.687 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:39.687 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:39.687 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:39.687 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:39.687 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:39.687 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:39.688 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:39.688 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:39.688 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:39.688 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:37:39.688 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:37:39.688 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:39.688 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:39.688 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:39.688 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:39.688 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:39.688 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:39.688 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:39.688 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:39.688 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:39.689 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:39.689 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:39.689 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:39.689 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.689 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:37:39.689 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:37:39.689 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:37:39.689 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:37:39.689 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:37:39.689 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:37:39.689 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:37:39.689 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:37:39.689 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:37:39.690 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:37:39.690 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:37:39.690 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:37:39.690 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:37:39.690 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:37:39.690 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:37:39.690 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:37:39.690 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:37:39.690 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:39.690 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:39.690 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:39.690 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:39.690 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:39.690 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:39.691 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:39.691 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:39.691 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:39.691 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:39.691 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:39.691 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:39.691 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:37:39.691 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.691 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:37:39.691 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.691 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:37:39.691 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:37:39.692 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:39.692 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:39.692 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.692 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:39.692 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:37:39.692 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:39.692 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.692 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.692 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:39.692 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:37:39.692 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:39.692 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.693 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:39.693 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.693 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:37:39.693 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:37:39.693 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:39.693 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:39.693 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:39.693 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.693 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.693 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:37:39.693 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:37:39.693 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:39.694 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:39.694 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.694 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:39.694 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:37:39.694 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:39.694 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.694 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.694 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:39.694 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:37:39.694 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:39.694 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.694 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:39.694 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.695 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:37:39.695 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:37:39.695 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:39.695 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:39.695 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:39.695 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.695 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.695 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:37:39.695 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:37:39.695 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:39.695 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:39.695 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.695 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:39.696 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:37:39.696 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:39.696 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.696 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.696 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:39.696 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:37:39.696 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:39.696 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.696 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:39.696 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.696 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:37:39.696 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:37:39.696 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:39.696 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:39.697 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:39.697 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.697 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:39.697 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.697 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:37:39.697 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:37:39.697 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.697 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:39.697 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:39.697 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:37:39.697 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.697 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:39.697 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:37:39.698 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.698 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:39.698 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:39.698 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:37:39.698 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.698 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:39.698 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:37:39.698 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.698 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:39.698 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:39.698 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:37:39.698 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.698 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:39.698 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:37:39.699 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.699 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:39.699 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:39.699 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 8 2024-09-10T08:37:39.699 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.699 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:39.699 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:37:39.699 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.699 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:39.699 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:39.699 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:37:39.699 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.699 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:39.699 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.700 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:37:39.700 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:37:39.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.685+0000 7fbf276a5640 1 -- 172.21.15.103:0/4197679584 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbf0406be30 msgr2=0x7fbf0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.685+0000 7fbf276a5640 1 --2- 172.21.15.103:0/4197679584 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbf0406be30 0x7fbf0406e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbf180012e0 tx=0x7fbf18004d40 comp rx=0 tx=0).stop 2024-09-10T08:37:39.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.685+0000 7fbf276a5640 1 -- 172.21.15.103:0/4197679584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf200ca1c0 msgr2=0x7fbf201ef3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.685+0000 7fbf276a5640 1 --2- 172.21.15.103:0/4197679584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf200ca1c0 0x7fbf201ef3f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009870 tx=0x7fbf100046c0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.685+0000 7fbf25c42640 1 -- 172.21.15.103:0/4197679584 reap_dead start 2024-09-10T08:37:39.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.686+0000 7fbf25c42640 1 -- 172.21.15.103:0/4197679584 reap_dead start 2024-09-10T08:37:39.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.686+0000 7fbf276a5640 1 -- 172.21.15.103:0/4197679584 shutdown_connections 2024-09-10T08:37:39.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.686+0000 7fbf276a5640 1 -- 172.21.15.103:0/4197679584 >> 172.21.15.103:0/4197679584 conn(0x7fbf20068030 msgr2=0x7fbf20155210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:39.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.686+0000 7fbf276a5640 1 -- 172.21.15.103:0/4197679584 shutdown_connections 2024-09-10T08:37:39.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.686+0000 7fbf276a5640 1 -- 172.21.15.103:0/4197679584 wait complete. 2024-09-10T08:37:39.702 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:37:39.702 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:37:39.702 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:37:39.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.808+0000 7f28df082640 1 Processor -- start 2024-09-10T08:37:39.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.808+0000 7f28df082640 1 -- start start 2024-09-10T08:37:39.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.809+0000 7f28df082640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28d80ad6a0 0x7f28d8159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.809+0000 7f28df082640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f28d8153fd0 0x7f28d815a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.809+0000 7f28df082640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28d80c2f60 con 0x7f28d80c5130 2024-09-10T08:37:39.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.809+0000 7f28df082640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f28d80c1f80 con 0x7f28d8153fd0 2024-09-10T08:37:39.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.809+0000 7f28df082640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f28d80c3240 con 0x7f28d80ad6a0 2024-09-10T08:37:39.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.809+0000 7f28dd61f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f28d8153fd0 0x7f28d815a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.809+0000 7f28dd61f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f28d8153fd0 0x7f28d815a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59088/0 (socket says 172.21.15.103:59088) 2024-09-10T08:37:39.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.809+0000 7f28dce1e640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f28d80c5130 0x7f28d81538c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33342/0 (socket says 172.21.15.103:33342) 2024-09-10T08:37:39.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.809+0000 7f28dd61f640 1 -- 172.21.15.103:0/4286973995 learned_addr learned my addr 172.21.15.103:0/4286973995 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:39.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.809+0000 7f28d7fff640 1 --2- 172.21.15.103:0/4286973995 >> v2:172.21.15.154:3300/0 conn(0x7f28d80ad6a0 0x7f28d8159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.809+0000 7f28dd61f640 1 -- 172.21.15.103:0/4286973995 >> v2:172.21.15.154:3300/0 conn(0x7f28d80ad6a0 msgr2=0x7f28d8159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:39.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.809+0000 7f28dd61f640 1 --2- 172.21.15.103:0/4286973995 >> v2:172.21.15.154:3300/0 conn(0x7f28d80ad6a0 0x7f28d8159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.809+0000 7f28dd61f640 1 -- 172.21.15.103:0/4286973995 >> v1:172.21.15.103:6789/0 conn(0x7f28d80c5130 legacy=0x7f28d81538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.810+0000 7f28dd61f640 1 -- 172.21.15.103:0/4286973995 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d80c1c10 con 0x7f28d8153fd0 2024-09-10T08:37:39.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.810+0000 7f28dd61f640 1 --2- 172.21.15.103:0/4286973995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28d8153fd0 0x7f28d815a1a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f28d8074910 tx=0x7f28d002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c54cfecf701829 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.810+0000 7f28d77fe640 1 -- 172.21.15.103:0/4286973995 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d0036070 con 0x7f28d8153fd0 2024-09-10T08:37:39.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.810+0000 7f28d77fe640 1 -- 172.21.15.103:0/4286973995 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d0031600 con 0x7f28d8153fd0 2024-09-10T08:37:39.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.810+0000 7f28d77fe640 1 -- 172.21.15.103:0/4286973995 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d00319d0 con 0x7f28d8153fd0 2024-09-10T08:37:39.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.811+0000 7f28df082640 1 -- 172.21.15.103:0/4286973995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28d8153fd0 msgr2=0x7f28d815a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.811+0000 7f28df082640 1 --2- 172.21.15.103:0/4286973995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28d8153fd0 0x7f28d815a1a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f28d8074910 tx=0x7f28d002a610 comp rx=0 tx=0).stop 2024-09-10T08:37:39.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.811+0000 7f28df082640 1 -- 172.21.15.103:0/4286973995 shutdown_connections 2024-09-10T08:37:39.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.811+0000 7f28df082640 1 --2- 172.21.15.103:0/4286973995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28d8153fd0 0x7f28d815a1a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.811+0000 7f28df082640 1 --2- 172.21.15.103:0/4286973995 >> v2:172.21.15.154:3300/0 conn(0x7f28d80ad6a0 0x7f28d8159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.811+0000 7f28df082640 1 -- 172.21.15.103:0/4286973995 >> 172.21.15.103:0/4286973995 conn(0x7f28d80c8430 msgr2=0x7f28d80c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:39.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.811+0000 7f28df082640 1 -- 172.21.15.103:0/4286973995 shutdown_connections 2024-09-10T08:37:39.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.811+0000 7f28df082640 1 -- 172.21.15.103:0/4286973995 wait complete. 2024-09-10T08:37:39.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.812+0000 7f28df082640 1 Processor -- start 2024-09-10T08:37:39.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.812+0000 7f28df082640 1 -- start start 2024-09-10T08:37:39.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.813+0000 7f28df082640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d80ad6a0 0x7f28d809cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.813+0000 7f28df082640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28d80c5130 0x7f28d81e91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.813+0000 7f28df082640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28d8153fd0 0x7f28d80aa290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.813+0000 7f28df082640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f28d80c5690 con 0x7f28d8153fd0 2024-09-10T08:37:39.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.813+0000 7f28df082640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f28d80c5510 con 0x7f28d80ad6a0 2024-09-10T08:37:39.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.813+0000 7f28df082640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f28d815a6e0 con 0x7f28d80c5130 2024-09-10T08:37:39.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.813+0000 7f28dd61f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28d8153fd0 0x7f28d80aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.813+0000 7f28dd61f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28d8153fd0 0x7f28d80aa290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59090/0 (socket says 172.21.15.103:59090) 2024-09-10T08:37:39.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.813+0000 7f28dd61f640 1 -- 172.21.15.103:0/1479318145 learned_addr learned my addr 172.21.15.103:0/1479318145 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:39.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.813+0000 7f28dce1e640 1 --2- 172.21.15.103:0/1479318145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d80ad6a0 0x7f28d809cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.813+0000 7f28d7fff640 1 --2- 172.21.15.103:0/1479318145 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28d80c5130 0x7f28d81e91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.813+0000 7f28dd61f640 1 -- 172.21.15.103:0/1479318145 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28d80c5130 msgr2=0x7f28d81e91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.813+0000 7f28dd61f640 1 --2- 172.21.15.103:0/1479318145 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28d80c5130 0x7f28d81e91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.813+0000 7f28dd61f640 1 -- 172.21.15.103:0/1479318145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d80ad6a0 msgr2=0x7f28d809cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.813+0000 7f28dd61f640 1 --2- 172.21.15.103:0/1479318145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d80ad6a0 0x7f28d809cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.813+0000 7f28dd61f640 1 -- 172.21.15.103:0/1479318145 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d8071570 con 0x7f28d8153fd0 2024-09-10T08:37:39.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.814+0000 7f28dd61f640 1 --2- 172.21.15.103:0/1479318145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28d8153fd0 0x7f28d80aa290 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f28d0034040 tx=0x7f28d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.814+0000 7f28d57fa640 1 -- 172.21.15.103:0/1479318145 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d0036050 con 0x7f28d8153fd0 2024-09-10T08:37:39.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.814+0000 7f28d57fa640 1 -- 172.21.15.103:0/1479318145 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d0042070 con 0x7f28d8153fd0 2024-09-10T08:37:39.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.814+0000 7f28df082640 1 -- 172.21.15.103:0/1479318145 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28d8071850 con 0x7f28d8153fd0 2024-09-10T08:37:39.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.814+0000 7f28d57fa640 1 -- 172.21.15.103:0/1479318145 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d0009510 con 0x7f28d8153fd0 2024-09-10T08:37:39.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.814+0000 7f28df082640 1 -- 172.21.15.103:0/1479318145 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28d8074830 con 0x7f28d8153fd0 2024-09-10T08:37:39.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.815+0000 7f28df082640 1 --2- 172.21.15.103:0/1479318145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d80723a0 0x7f28d80aa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.815+0000 7f28df082640 1 -- 172.21.15.103:0/1479318145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f28d80a9b90 con 0x7f28d80723a0 2024-09-10T08:37:39.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.815+0000 7f28dce1e640 1 --2- 172.21.15.103:0/1479318145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d80723a0 0x7f28d80aa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.815+0000 7f28dce1e640 1 -- 172.21.15.103:0/1479318145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f28d8067950 con 0x7f28d80723a0 2024-09-10T08:37:39.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.816+0000 7f28dce1e640 1 --2- 172.21.15.103:0/1479318145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d80723a0 0x7f28d80aa7d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f28cc000f60 tx=0x7f28cc001920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.816+0000 7f28d57fa640 1 -- 172.21.15.103:0/1479318145 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f28d0007bf0 con 0x7f28d8153fd0 2024-09-10T08:37:39.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.816+0000 7f28d57fa640 1 --2- 172.21.15.103:0/1479318145 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f28bc06be30 0x7f28bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.816+0000 7f28d7fff640 1 --2- 172.21.15.103:0/1479318145 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f28bc06be30 0x7f28bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.816+0000 7f28d57fa640 1 -- 172.21.15.103:0/1479318145 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f28d00abeb0 con 0x7f28d8153fd0 2024-09-10T08:37:39.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.816+0000 7f28d57fa640 1 -- 172.21.15.103:0/1479318145 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28cc011580 con 0x7f28d80723a0 2024-09-10T08:37:39.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.816+0000 7f28d57fa640 1 -- 172.21.15.103:0/1479318145 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f28cc018070 con 0x7f28d80723a0 2024-09-10T08:37:39.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.816+0000 7f28d57fa640 1 -- 172.21.15.103:0/1479318145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d80723a0 msgr2=0x7f28d80aa7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.816+0000 7f28d57fa640 1 --2- 172.21.15.103:0/1479318145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d80723a0 0x7f28d80aa7d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f28cc000f60 tx=0x7f28cc001920 comp rx=0 tx=0).stop 2024-09-10T08:37:39.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.816+0000 7f28d57fa640 1 -- 172.21.15.103:0/1479318145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d80723a0 msgr2=0x7f28d80aa7d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:37:39.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.816+0000 7f28d57fa640 1 --2- 172.21.15.103:0/1479318145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d80723a0 0x7f28d80aa7d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.817+0000 7f28d7fff640 1 --2- 172.21.15.103:0/1479318145 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f28bc06be30 0x7f28bc06e2f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f28d81593d0 tx=0x7f28c4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.824+0000 7f28df082640 1 --2- 172.21.15.103:0/1479318145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d81e9730 0x7f28d81ef370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.824+0000 7f28df082640 1 -- 172.21.15.103:0/1479318145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f28d80c4880 con 0x7f28d81e9730 2024-09-10T08:37:39.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.824+0000 7f28dce1e640 1 --2- 172.21.15.103:0/1479318145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d81e9730 0x7f28d81ef370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.825+0000 7f28dce1e640 1 -- 172.21.15.103:0/1479318145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f28d80c45a0 con 0x7f28d81e9730 2024-09-10T08:37:39.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.825+0000 7f28dce1e640 1 --2- 172.21.15.103:0/1479318145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d81e9730 0x7f28d81ef370 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f28cc000f60 tx=0x7f28cc000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.825+0000 7f28d57fa640 1 -- 172.21.15.103:0/1479318145 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28cc027410 con 0x7f28d81e9730 2024-09-10T08:37:39.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.825+0000 7f28d57fa640 1 -- 172.21.15.103:0/1479318145 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4551 (secure 0 0 0) 0x7f28cc0133f0 con 0x7f28d81e9730 2024-09-10T08:37:39.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.825+0000 7f28d57fa640 1 -- 172.21.15.103:0/1479318145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d81e9730 msgr2=0x7f28d81ef370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.825+0000 7f28d57fa640 1 --2- 172.21.15.103:0/1479318145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d81e9730 0x7f28d81ef370 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f28cc000f60 tx=0x7f28cc000ed0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.825+0000 7f28d57fa640 1 -- 172.21.15.103:0/1479318145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d81e9730 msgr2=0x7f28d81ef370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:37:39.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.825+0000 7f28d57fa640 1 --2- 172.21.15.103:0/1479318145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d81e9730 0x7f28d81ef370 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f28cc000f60 tx=0x7f28cc000ed0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.826 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:37:39.826 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:37:39.826 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:37:39.826 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:37:39.826 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 74, 2024-09-10T08:37:39.826 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 4851, 2024-09-10T08:37:39.826 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:37:39.827 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:37:39.827 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:37:39.827 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:37:39.827 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:39.827 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 1, 2024-09-10T08:37:39.827 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:37:39.827 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:37:39.827 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:37:39.827 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:39.827 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:39.827 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:39.827 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:39.827 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:39.828 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:39.828 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:39.828 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:39.828 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:39.828 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:39.828 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:39.828 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:39.828 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:37:39.828 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:37:39.828 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:39.828 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:39.828 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:39.828 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:39.829 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:39.829 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:39.829 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:39.829 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:39.829 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:39.829 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:39.829 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:39.829 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:39.829 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.829 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:37:39.829 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:37:39.829 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:37:39.829 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:37:39.830 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:37:39.830 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:37:39.830 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:37:39.830 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:37:39.830 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:37:39.830 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:37:39.830 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:37:39.830 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:37:39.830 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:37:39.830 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:37:39.830 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:37:39.830 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:37:39.830 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:37:39.831 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:39.831 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:39.831 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:39.831 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:39.831 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:39.831 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:39.831 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:39.831 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:39.831 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:39.831 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:39.831 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:39.831 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:39.831 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:37:39.831 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.832 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:37:39.832 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.832 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:37:39.832 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:37:39.832 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:39.832 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:39.832 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.832 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:39.832 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:37:39.832 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:39.832 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.832 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.832 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:39.833 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:37:39.833 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:39.833 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.833 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:39.833 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.833 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:37:39.833 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:37:39.833 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:39.833 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:39.833 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:39.833 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.833 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.834 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:37:39.834 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:37:39.834 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:39.834 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:39.834 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.834 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:39.834 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:37:39.834 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:39.834 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.834 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.834 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:39.834 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:37:39.834 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:39.834 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.835 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:39.835 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.835 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:37:39.835 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:37:39.835 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:39.835 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:39.835 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:39.835 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.835 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.835 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:37:39.835 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:37:39.835 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:39.835 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:39.836 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.836 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:39.836 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:37:39.836 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:39.836 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.836 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.836 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:39.836 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:37:39.836 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:39.836 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.836 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:39.836 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.837 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:37:39.837 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:37:39.837 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:39.837 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:39.837 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:39.837 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.837 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:39.837 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.837 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:37:39.837 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:37:39.837 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.837 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:39.837 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:39.838 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:37:39.838 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.838 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:39.838 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:37:39.838 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.838 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:39.838 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:39.838 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:37:39.838 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.838 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:39.838 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.839 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:37:39.839 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:37:39.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.826+0000 7f28df082640 1 -- 172.21.15.103:0/1479318145 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f28bc06be30 msgr2=0x7f28bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.826+0000 7f28df082640 1 --2- 172.21.15.103:0/1479318145 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f28bc06be30 0x7f28bc06e2f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f28d81593d0 tx=0x7f28c4009190 comp rx=0 tx=0).stop 2024-09-10T08:37:39.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.826+0000 7f28df082640 1 -- 172.21.15.103:0/1479318145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28d8153fd0 msgr2=0x7f28d80aa290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.826+0000 7f28df082640 1 --2- 172.21.15.103:0/1479318145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28d8153fd0 0x7f28d80aa290 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f28d0034040 tx=0x7f28d0004a40 comp rx=0 tx=0).stop 2024-09-10T08:37:39.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.826+0000 7f28dd61f640 1 -- 172.21.15.103:0/1479318145 reap_dead start 2024-09-10T08:37:39.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.826+0000 7f28dd61f640 1 -- 172.21.15.103:0/1479318145 reap_dead start 2024-09-10T08:37:39.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.826+0000 7f28df082640 1 -- 172.21.15.103:0/1479318145 shutdown_connections 2024-09-10T08:37:39.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.826+0000 7f28df082640 1 -- 172.21.15.103:0/1479318145 >> 172.21.15.103:0/1479318145 conn(0x7f28d80c8430 msgr2=0x7f28d806e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:39.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.826+0000 7f28df082640 1 -- 172.21.15.103:0/1479318145 shutdown_connections 2024-09-10T08:37:39.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.826+0000 7f28df082640 1 -- 172.21.15.103:0/1479318145 wait complete. 2024-09-10T08:37:39.841 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:37:39.841 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:37:39.841 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:37:39.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.950+0000 7f2cb0ea6640 1 Processor -- start 2024-09-10T08:37:39.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.950+0000 7f2cb0ea6640 1 -- start start 2024-09-10T08:37:39.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.950+0000 7f2cb0ea6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2cac0c4680 0x7f2cac156a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.950+0000 7f2cb0ea6640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cac070590 con 0x7f2cac156fc0 2024-09-10T08:37:39.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.950+0000 7f2cb0ea6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cac0a8220 con 0x7f2cac0acc30 2024-09-10T08:37:39.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.950+0000 7f2cb0ea6640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f2cac0c4ea0 con 0x7f2cac0c4680 2024-09-10T08:37:39.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.951+0000 7f2ca3fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2cac0c4680 0x7f2cac156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.951+0000 7f2caad9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2cac156fc0 0x7f2cac15dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33344/0 (socket says 172.21.15.103:33344) 2024-09-10T08:37:39.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.951+0000 7f2caad9d640 1 -- 172.21.15.103:0/415594410 learned_addr learned my addr 172.21.15.103:0/415594410 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:37:39.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.951+0000 7f2ca3fff640 1 -- 172.21.15.103:0/415594410 >> v1:172.21.15.154:6789/0 conn(0x7f2cac0acc30 legacy=0x7f2cac0c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.951+0000 7f2ca3fff640 1 -- 172.21.15.103:0/415594410 >> v1:172.21.15.103:6789/0 conn(0x7f2cac156fc0 legacy=0x7f2cac15dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.951+0000 7f2ca9d9b640 1 -- 172.21.15.103:0/415594410 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 427949504 0 0) 0x7f2cac070590 con 0x7f2cac156fc0 2024-09-10T08:37:39.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.951+0000 7f2ca3fff640 1 -- 172.21.15.103:0/415594410 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cac0a84f0 con 0x7f2cac0c4680 2024-09-10T08:37:39.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.952+0000 7f2ca3fff640 1 --2- 172.21.15.103:0/415594410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cac0c4680 0x7f2cac156a80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2c940097a0 tx=0x7f2c9402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a1bb43619406ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.952+0000 7f2ca9d9b640 1 -- 172.21.15.103:0/415594410 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94037070 con 0x7f2cac0c4680 2024-09-10T08:37:39.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.952+0000 7f2ca9d9b640 1 -- 172.21.15.103:0/415594410 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c94032440 con 0x7f2cac0c4680 2024-09-10T08:37:39.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.952+0000 7f2ca9d9b640 1 -- 172.21.15.103:0/415594410 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9402ae60 con 0x7f2cac0c4680 2024-09-10T08:37:39.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.953+0000 7f2cb0ea6640 1 -- 172.21.15.103:0/415594410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cac0c4680 msgr2=0x7f2cac156a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.953+0000 7f2cb0ea6640 1 --2- 172.21.15.103:0/415594410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cac0c4680 0x7f2cac156a80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2c940097a0 tx=0x7f2c9402a110 comp rx=0 tx=0).stop 2024-09-10T08:37:39.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.953+0000 7f2cb0ea6640 1 -- 172.21.15.103:0/415594410 shutdown_connections 2024-09-10T08:37:39.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.953+0000 7f2cb0ea6640 1 --2- 172.21.15.103:0/415594410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cac0c4680 0x7f2cac156a80 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.953+0000 7f2cb0ea6640 1 -- 172.21.15.103:0/415594410 >> 172.21.15.103:0/415594410 conn(0x7f2cac0c5660 msgr2=0x7f2cac0c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:39.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.953+0000 7f2cb0ea6640 1 -- 172.21.15.103:0/415594410 shutdown_connections 2024-09-10T08:37:39.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.953+0000 7f2cb0ea6640 1 -- 172.21.15.103:0/415594410 wait complete. 2024-09-10T08:37:39.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.954+0000 7f2cb0ea6640 1 Processor -- start 2024-09-10T08:37:39.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.954+0000 7f2cb0ea6640 1 -- start start 2024-09-10T08:37:39.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.955+0000 7f2cb0ea6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cac0acc30 0x7f2cac0c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.955+0000 7f2cb0ea6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cac0c4680 0x7f2cac150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.955+0000 7f2cb0ea6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cac156fc0 0x7f2cac1509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.955+0000 7f2cb0ea6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2cac0c5330 con 0x7f2cac0acc30 2024-09-10T08:37:39.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.955+0000 7f2cb0ea6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2cac0702b0 con 0x7f2cac156fc0 2024-09-10T08:37:39.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.955+0000 7f2cb0ea6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2cac0c63f0 con 0x7f2cac0c4680 2024-09-10T08:37:39.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.955+0000 7f2caa59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cac0acc30 0x7f2cac0c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.955+0000 7f2caa59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cac0acc30 0x7f2cac0c7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59100/0 (socket says 172.21.15.103:59100) 2024-09-10T08:37:39.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.955+0000 7f2caa59c640 1 -- 172.21.15.103:0/2775575650 learned_addr learned my addr 172.21.15.103:0/2775575650 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:39.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.955+0000 7f2ca3fff640 1 --2- 172.21.15.103:0/2775575650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cac0c4680 0x7f2cac150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.956+0000 7f2caad9d640 1 --2- 172.21.15.103:0/2775575650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cac156fc0 0x7f2cac1509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.956+0000 7f2caa59c640 1 -- 172.21.15.103:0/2775575650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cac0c4680 msgr2=0x7f2cac150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.956+0000 7f2caa59c640 1 --2- 172.21.15.103:0/2775575650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cac0c4680 0x7f2cac150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.956+0000 7f2caa59c640 1 -- 172.21.15.103:0/2775575650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cac156fc0 msgr2=0x7f2cac1509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.956+0000 7f2caa59c640 1 --2- 172.21.15.103:0/2775575650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cac156fc0 0x7f2cac1509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.956+0000 7f2caa59c640 1 -- 172.21.15.103:0/2775575650 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cac06fde0 con 0x7f2cac0acc30 2024-09-10T08:37:39.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.956+0000 7f2caa59c640 1 --2- 172.21.15.103:0/2775575650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cac0acc30 0x7f2cac0c7af0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00c400 tx=0x7f2c9c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.956+0000 7f2ca2ffd640 1 -- 172.21.15.103:0/2775575650 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c017070 con 0x7f2cac0acc30 2024-09-10T08:37:39.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.956+0000 7f2ca2ffd640 1 -- 172.21.15.103:0/2775575650 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c9c0052d0 con 0x7f2cac0acc30 2024-09-10T08:37:39.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.956+0000 7f2cb0ea6640 1 -- 172.21.15.103:0/2775575650 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cac06fb00 con 0x7f2cac0acc30 2024-09-10T08:37:39.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.956+0000 7f2ca2ffd640 1 -- 172.21.15.103:0/2775575650 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c003830 con 0x7f2cac0acc30 2024-09-10T08:37:39.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.956+0000 7f2cb0ea6640 1 -- 172.21.15.103:0/2775575650 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cac151430 con 0x7f2cac0acc30 2024-09-10T08:37:39.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.957+0000 7f2cb0ea6640 1 --2- 172.21.15.103:0/2775575650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cac0c2370 0x7f2cac1e8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.957+0000 7f2cb0ea6640 1 -- 172.21.15.103:0/2775575650 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2cac1e8390 con 0x7f2cac0c2370 2024-09-10T08:37:39.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.957+0000 7f2ca3fff640 1 --2- 172.21.15.103:0/2775575650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cac0c2370 0x7f2cac1e8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.958+0000 7f2ca3fff640 1 -- 172.21.15.103:0/2775575650 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2cac0abc10 con 0x7f2cac0c2370 2024-09-10T08:37:39.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.958+0000 7f2ca2ffd640 1 -- 172.21.15.103:0/2775575650 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2c9c01a070 con 0x7f2cac0acc30 2024-09-10T08:37:39.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.958+0000 7f2ca3fff640 1 --2- 172.21.15.103:0/2775575650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cac0c2370 0x7f2cac1e8600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0c6340 tx=0x7f2c940046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.958+0000 7f2ca2ffd640 1 --2- 172.21.15.103:0/2775575650 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2c8c06be30 0x7f2c8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.958+0000 7f2ca2ffd640 1 -- 172.21.15.103:0/2775575650 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f2c9c08a390 con 0x7f2cac0acc30 2024-09-10T08:37:39.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.958+0000 7f2caad9d640 1 --2- 172.21.15.103:0/2775575650 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2c8c06be30 0x7f2c8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.958+0000 7f2ca2ffd640 1 -- 172.21.15.103:0/2775575650 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94041030 con 0x7f2cac0c2370 2024-09-10T08:37:39.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.959+0000 7f2ca2ffd640 1 -- 172.21.15.103:0/2775575650 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2c94038040 con 0x7f2cac0c2370 2024-09-10T08:37:39.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.959+0000 7f2ca2ffd640 1 -- 172.21.15.103:0/2775575650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cac0c2370 msgr2=0x7f2cac1e8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.959+0000 7f2ca2ffd640 1 --2- 172.21.15.103:0/2775575650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cac0c2370 0x7f2cac1e8600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0c6340 tx=0x7f2c940046c0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.959+0000 7f2ca2ffd640 1 -- 172.21.15.103:0/2775575650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cac0c2370 msgr2=0x7f2cac1e8600 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:37:39.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.959+0000 7f2ca2ffd640 1 --2- 172.21.15.103:0/2775575650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cac0c2370 0x7f2cac1e8600 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.959+0000 7f2caad9d640 1 --2- 172.21.15.103:0/2775575650 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2c8c06be30 0x7f2c8c06e2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40018a0 tx=0x7f2ca4001830 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.965+0000 7f2cb0ea6640 1 --2- 172.21.15.103:0/2775575650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cac1e8b40 0x7f2cac1e8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.965+0000 7f2cb0ea6640 1 -- 172.21.15.103:0/2775575650 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2cac1f4ce0 con 0x7f2cac1e8b40 2024-09-10T08:37:39.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.966+0000 7f2ca3fff640 1 --2- 172.21.15.103:0/2775575650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cac1e8b40 0x7f2cac1e8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.967+0000 7f2ca3fff640 1 -- 172.21.15.103:0/2775575650 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2cac0c8030 con 0x7f2cac1e8b40 2024-09-10T08:37:39.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.967+0000 7f2ca3fff640 1 --2- 172.21.15.103:0/2775575650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cac1e8b40 0x7f2cac1e8f60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2c9402a150 tx=0x7f2c94008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.968+0000 7f2ca2ffd640 1 -- 172.21.15.103:0/2775575650 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94041050 con 0x7f2cac1e8b40 2024-09-10T08:37:39.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.968+0000 7f2ca2ffd640 1 -- 172.21.15.103:0/2775575650 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5053 (secure 0 0 0) 0x7f2c9403d3f0 con 0x7f2cac1e8b40 2024-09-10T08:37:39.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.968+0000 7f2ca2ffd640 1 -- 172.21.15.103:0/2775575650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cac1e8b40 msgr2=0x7f2cac1e8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.968+0000 7f2ca2ffd640 1 --2- 172.21.15.103:0/2775575650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cac1e8b40 0x7f2cac1e8f60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2c9402a150 tx=0x7f2c94008030 comp rx=0 tx=0).stop 2024-09-10T08:37:39.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.968+0000 7f2ca2ffd640 1 -- 172.21.15.103:0/2775575650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cac1e8b40 msgr2=0x7f2cac1e8f60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:37:39.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.968+0000 7f2ca2ffd640 1 --2- 172.21.15.103:0/2775575650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cac1e8b40 0x7f2cac1e8f60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.969 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:37:39.969 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:37:39.969 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:37:39.969 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:37:39.969 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 74, 2024-09-10T08:37:39.969 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 66083, 2024-09-10T08:37:39.969 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:37:39.969 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:37:39.969 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:37:39.969 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:37:39.969 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:39.969 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 1, 2024-09-10T08:37:39.970 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:37:39.970 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:37:39.970 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:37:39.970 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:39.970 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:39.970 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:39.970 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:39.970 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:39.970 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:39.970 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:39.970 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:39.970 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:39.971 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:39.971 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:39.971 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:39.971 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:37:39.971 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:37:39.971 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:39.971 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:39.971 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:39.971 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:39.971 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:39.971 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:39.971 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:39.971 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:39.972 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:39.972 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:39.972 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:39.972 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:39.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.972 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:37:39.972 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:37:39.972 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:37:39.972 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:37:39.972 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:37:39.972 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:37:39.972 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:37:39.972 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:37:39.972 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:37:39.973 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:37:39.973 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:37:39.973 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:37:39.973 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:37:39.973 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:37:39.973 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:37:39.973 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:37:39.973 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:37:39.973 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:39.973 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:39.973 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:39.974 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:39.974 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:39.974 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:39.974 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:39.974 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:39.974 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:39.974 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:39.974 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:39.974 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:39.974 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:37:39.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.975 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:37:39.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.975 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:37:39.975 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:37:39.975 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:39.975 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:39.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.975 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:39.975 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:37:39.975 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:39.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.975 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:39.976 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:37:39.976 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:39.976 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.976 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:39.976 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.976 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:37:39.976 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:37:39.976 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:39.976 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:39.976 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:39.976 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.976 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.976 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:37:39.977 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:37:39.977 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:39.977 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:39.977 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.977 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:39.977 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:37:39.977 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:39.977 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.977 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.977 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:39.977 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:37:39.977 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:39.977 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.978 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:39.978 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.978 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:37:39.978 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:37:39.978 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:39.978 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:39.978 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:39.978 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.978 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.978 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:37:39.978 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:37:39.978 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:39.978 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:39.978 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.979 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:39.979 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:37:39.979 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:39.979 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.979 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.979 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:39.979 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:37:39.979 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:39.979 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.979 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:39.979 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.979 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:37:39.979 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:37:39.980 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:39.980 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:39.980 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:39.980 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.980 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:39.980 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.980 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:37:39.980 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:37:39.980 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.980 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:39.980 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:39.980 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:37:39.980 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.981 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:39.981 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:37:39.981 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.981 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:39.981 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:39.981 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:37:39.981 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.981 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:39.981 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:37:39.981 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.981 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:39.981 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:39.981 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:37:39.982 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.982 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:39.982 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:37:39.982 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.982 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:39.982 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:39.982 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:37:39.982 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.982 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:39.982 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:37:39.982 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:39.982 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:39.982 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:39.982 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:37:39.983 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:39.983 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:39.983 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:39.983 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:37:39.983 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:37:39.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.969+0000 7f2cb0ea6640 1 -- 172.21.15.103:0/2775575650 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2c8c06be30 msgr2=0x7f2c8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.969+0000 7f2cb0ea6640 1 --2- 172.21.15.103:0/2775575650 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2c8c06be30 0x7f2c8c06e2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40018a0 tx=0x7f2ca4001830 comp rx=0 tx=0).stop 2024-09-10T08:37:39.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.969+0000 7f2cb0ea6640 1 -- 172.21.15.103:0/2775575650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cac0acc30 msgr2=0x7f2cac0c7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.969+0000 7f2cb0ea6640 1 --2- 172.21.15.103:0/2775575650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cac0acc30 0x7f2cac0c7af0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00c400 tx=0x7f2c9c00c8c0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.969+0000 7f2caad9d640 1 -- 172.21.15.103:0/2775575650 reap_dead start 2024-09-10T08:37:39.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.969+0000 7f2cb0ea6640 1 -- 172.21.15.103:0/2775575650 shutdown_connections 2024-09-10T08:37:39.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.969+0000 7f2cb0ea6640 1 --2- 172.21.15.103:0/2775575650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cac0acc30 0x7f2cac0c7af0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.969+0000 7f2cb0ea6640 1 -- 172.21.15.103:0/2775575650 >> 172.21.15.103:0/2775575650 conn(0x7f2cac0c5660 msgr2=0x7f2cac1521b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:39.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.969+0000 7f2cb0ea6640 1 -- 172.21.15.103:0/2775575650 shutdown_connections 2024-09-10T08:37:39.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:39.969+0000 7f2cb0ea6640 1 -- 172.21.15.103:0/2775575650 wait complete. 2024-09-10T08:37:39.985 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:37:39.986 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-10T08:37:39.986 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-10T08:37:40.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.097+0000 7fc014ef8640 1 Processor -- start 2024-09-10T08:37:40.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.097+0000 7fc014ef8640 1 -- start start 2024-09-10T08:37:40.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.098+0000 7fc014ef8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc010153be0 0x7fc0100c3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:40.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.098+0000 7fc014ef8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc0100ac720 0x7fc0100c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:40.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.098+0000 7fc014ef8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc010153fc0 con 0x7fc0100c7fb0 2024-09-10T08:37:40.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.098+0000 7fc014ef8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fc010156db0 con 0x7fc0100ac720 2024-09-10T08:37:40.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.098+0000 7fc014ef8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc0100c8420 con 0x7fc010153be0 2024-09-10T08:37:40.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.098+0000 7fc00dd9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc0100ac720 0x7fc0100c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:40.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.098+0000 7fc00dd9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc0100ac720 0x7fc0100c7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59108/0 (socket says 172.21.15.103:59108) 2024-09-10T08:37:40.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.098+0000 7fc00dd9b640 1 -- 172.21.15.103:0/2650779967 learned_addr learned my addr 172.21.15.103:0/2650779967 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:40.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.099+0000 7fc00dd9b640 1 -- 172.21.15.103:0/2650779967 >> v2:172.21.15.154:3300/0 conn(0x7fc010153be0 msgr2=0x7fc0100c3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:40.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.099+0000 7fc00dd9b640 1 --2- 172.21.15.103:0/2650779967 >> v2:172.21.15.154:3300/0 conn(0x7fc010153be0 0x7fc0100c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:40.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.099+0000 7fc00dd9b640 1 -- 172.21.15.103:0/2650779967 >> v1:172.21.15.154:6789/0 conn(0x7fc0100c7fb0 legacy=0x7fc0101598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:40.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.099+0000 7fc00dd9b640 1 -- 172.21.15.103:0/2650779967 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0100a8030 con 0x7fc0100ac720 2024-09-10T08:37:40.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.100+0000 7fc00dd9b640 1 --2- 172.21.15.103:0/2650779967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0100ac720 0x7fc0100c7a70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc0100c9a90 tx=0x7fc00402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ce5c2e48d42ef3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:40.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.100+0000 7fc00d59a640 1 -- 172.21.15.103:0/2650779967 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc004037070 con 0x7fc0100ac720 2024-09-10T08:37:40.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.100+0000 7fc00d59a640 1 -- 172.21.15.103:0/2650779967 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc00402ae20 con 0x7fc0100ac720 2024-09-10T08:37:40.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.100+0000 7fc00d59a640 1 -- 172.21.15.103:0/2650779967 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc004032660 con 0x7fc0100ac720 2024-09-10T08:37:40.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.101+0000 7fc014ef8640 1 -- 172.21.15.103:0/2650779967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0100ac720 msgr2=0x7fc0100c7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:40.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.101+0000 7fc014ef8640 1 --2- 172.21.15.103:0/2650779967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0100ac720 0x7fc0100c7a70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc0100c9a90 tx=0x7fc00402a110 comp rx=0 tx=0).stop 2024-09-10T08:37:40.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.101+0000 7fc014ef8640 1 -- 172.21.15.103:0/2650779967 shutdown_connections 2024-09-10T08:37:40.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.101+0000 7fc014ef8640 1 --2- 172.21.15.103:0/2650779967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0100ac720 0x7fc0100c7a70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:40.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.101+0000 7fc014ef8640 1 --2- 172.21.15.103:0/2650779967 >> v2:172.21.15.154:3300/0 conn(0x7fc010153be0 0x7fc0100c3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:40.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.101+0000 7fc014ef8640 1 -- 172.21.15.103:0/2650779967 >> 172.21.15.103:0/2650779967 conn(0x7fc0100c5660 msgr2=0x7fc0100c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:40.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.101+0000 7fc014ef8640 1 -- 172.21.15.103:0/2650779967 shutdown_connections 2024-09-10T08:37:40.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.101+0000 7fc014ef8640 1 -- 172.21.15.103:0/2650779967 wait complete. 2024-09-10T08:37:40.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.103+0000 7fc014ef8640 1 Processor -- start 2024-09-10T08:37:40.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.103+0000 7fc014ef8640 1 -- start start 2024-09-10T08:37:40.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.104+0000 7fc014ef8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0100ac720 0x7fc0100bf370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:40.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.104+0000 7fc014ef8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0100c7fb0 0x7fc0101e1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:40.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.104+0000 7fc014ef8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc010153be0 0x7fc010152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:40.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.104+0000 7fc014ef8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc0100a83e0 con 0x7fc0100ac720 2024-09-10T08:37:40.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.104+0000 7fc014ef8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc010157240 con 0x7fc0100c7fb0 2024-09-10T08:37:40.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.104+0000 7fc014ef8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc0100ac370 con 0x7fc010153be0 2024-09-10T08:37:40.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.104+0000 7fc00e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0100ac720 0x7fc0100bf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:40.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.104+0000 7fc00dd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0100c7fb0 0x7fc0101e1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:40.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.104+0000 7fc00e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0100ac720 0x7fc0100bf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59112/0 (socket says 172.21.15.103:59112) 2024-09-10T08:37:40.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.104+0000 7fc00e59c640 1 -- 172.21.15.103:0/2178842354 learned_addr learned my addr 172.21.15.103:0/2178842354 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:40.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.104+0000 7fc00ed9d640 1 --2- 172.21.15.103:0/2178842354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc010153be0 0x7fc010152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.104+0000 7fc00e59c640 1 -- 172.21.15.103:0/2178842354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc010153be0 msgr2=0x7fc010152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.104+0000 7fc00e59c640 1 --2- 172.21.15.103:0/2178842354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc010153be0 0x7fc010152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.104+0000 7fc00e59c640 1 -- 172.21.15.103:0/2178842354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0100c7fb0 msgr2=0x7fc0101e1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.104+0000 7fc00e59c640 1 --2- 172.21.15.103:0/2178842354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0100c7fb0 0x7fc0101e1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.104+0000 7fc00e59c640 1 -- 172.21.15.103:0/2178842354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0100bf8b0 con 0x7fc0100ac720 2024-09-10T08:37:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.104+0000 7fc00e59c640 1 --2- 172.21.15.103:0/2178842354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0100ac720 0x7fc0100bf370 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc00000b440 tx=0x7fc00000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.105+0000 7fbffeffd640 1 -- 172.21.15.103:0/2178842354 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc000015020 con 0x7fc0100ac720 2024-09-10T08:37:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.105+0000 7fbffeffd640 1 -- 172.21.15.103:0/2178842354 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc000011890 con 0x7fc0100ac720 2024-09-10T08:37:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.105+0000 7fbffeffd640 1 -- 172.21.15.103:0/2178842354 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc000011c80 con 0x7fc0100ac720 2024-09-10T08:37:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.105+0000 7fc014ef8640 1 -- 172.21.15.103:0/2178842354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0101efdd0 con 0x7fc0100ac720 2024-09-10T08:37:40.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.105+0000 7fc014ef8640 1 -- 172.21.15.103:0/2178842354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0100be780 con 0x7fc0100ac720 2024-09-10T08:37:40.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.106+0000 7fc014ef8640 1 -- 172.21.15.103:0/2178842354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0100be9c0 con 0x7fc0100ac720 2024-09-10T08:37:40.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.106+0000 7fbffeffd640 1 -- 172.21.15.103:0/2178842354 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc000018020 con 0x7fc0100ac720 2024-09-10T08:37:40.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.107+0000 7fbffeffd640 1 --2- 172.21.15.103:0/2178842354 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbff006be30 0x7fbff006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:40.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.107+0000 7fbffeffd640 1 -- 172.21.15.103:0/2178842354 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fc00008b0d0 con 0x7fc0100ac720 2024-09-10T08:37:40.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.107+0000 7fc00dd9b640 1 --2- 172.21.15.103:0/2178842354 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbff006be30 0x7fbff006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:40.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.108+0000 7fc00dd9b640 1 --2- 172.21.15.103:0/2178842354 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbff006be30 0x7fbff006e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc004034000 tx=0x7fc00402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:40.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.112+0000 7fbffeffd640 1 -- 172.21.15.103:0/2178842354 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc0100be9c0 con 0x7fc0100ac720 2024-09-10T08:37:40.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.382+0000 7fc014ef8640 1 -- 172.21.15.103:0/2178842354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fc0100aa5f0 con 0x7fc0100ac720 2024-09-10T08:37:40.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.383+0000 7fbffeffd640 1 -- 172.21.15.103:0/2178842354 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fc00001f020 con 0x7fc0100ac720 2024-09-10T08:37:40.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.386+0000 7fc014ef8640 1 -- 172.21.15.103:0/2178842354 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbff006be30 msgr2=0x7fbff006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:40.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.386+0000 7fc014ef8640 1 --2- 172.21.15.103:0/2178842354 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbff006be30 0x7fbff006e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc004034000 tx=0x7fc00402e000 comp rx=0 tx=0).stop 2024-09-10T08:37:40.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.386+0000 7fc014ef8640 1 -- 172.21.15.103:0/2178842354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0100ac720 msgr2=0x7fc0100bf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:40.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.386+0000 7fc014ef8640 1 --2- 172.21.15.103:0/2178842354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0100ac720 0x7fc0100bf370 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc00000b440 tx=0x7fc00000b900 comp rx=0 tx=0).stop 2024-09-10T08:37:40.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.386+0000 7fc014ef8640 1 -- 172.21.15.103:0/2178842354 shutdown_connections 2024-09-10T08:37:40.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.386+0000 7fc014ef8640 1 --2- 172.21.15.103:0/2178842354 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbff006be30 0x7fbff006e2f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:40.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.386+0000 7fc014ef8640 1 --2- 172.21.15.103:0/2178842354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc010153be0 0x7fc010152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:40.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.386+0000 7fc014ef8640 1 --2- 172.21.15.103:0/2178842354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0100c7fb0 0x7fc0101e1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:40.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.386+0000 7fc014ef8640 1 --2- 172.21.15.103:0/2178842354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0100ac720 0x7fc0100bf370 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:40.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.387+0000 7fc014ef8640 1 -- 172.21.15.103:0/2178842354 >> 172.21.15.103:0/2178842354 conn(0x7fc0100c5660 msgr2=0x7fc0100c44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:40.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.387+0000 7fc014ef8640 1 -- 172.21.15.103:0/2178842354 shutdown_connections 2024-09-10T08:37:40.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:40.387+0000 7fc014ef8640 1 -- 172.21.15.103:0/2178842354 wait complete. 2024-09-10T08:37:40.401 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-10T08:37:50.401 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:37:50.402 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:37:50.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.511+0000 7f511485c640 1 Processor -- start 2024-09-10T08:37:50.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.511+0000 7f511485c640 1 -- start start 2024-09-10T08:37:50.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.512+0000 7f511485c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f51100c8b10 0x7f511015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:50.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.512+0000 7f511485c640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51100c7070 con 0x7f5110153be0 2024-09-10T08:37:50.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.512+0000 7f511485c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f511006d210 con 0x7f511006cd80 2024-09-10T08:37:50.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.512+0000 7f511485c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f51100c69b0 con 0x7f51100c8b10 2024-09-10T08:37:50.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.512+0000 7f510e59c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f51100c8b10 0x7f511015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:50.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.512+0000 7f510e59c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f51100c8b10 0x7f511015a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42756/0 (socket says 172.21.15.103:42756) 2024-09-10T08:37:50.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.512+0000 7f510ed9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5110153be0 0x7f5110156660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45186/0 (socket says 172.21.15.103:45186) 2024-09-10T08:37:50.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.512+0000 7f510e59c640 1 -- 172.21.15.103:0/2534368737 learned_addr learned my addr 172.21.15.103:0/2534368737 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:50.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.512+0000 7f510e59c640 1 -- 172.21.15.103:0/2534368737 >> v1:172.21.15.154:6789/0 conn(0x7f511006cd80 legacy=0x7f51101534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:50.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.512+0000 7f510d59a640 1 -- 172.21.15.103:0/2534368737 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2234033421 0 0) 0x7f51100c7070 con 0x7f5110153be0 2024-09-10T08:37:50.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.512+0000 7f510e59c640 1 -- 172.21.15.103:0/2534368737 >> v1:172.21.15.103:6789/0 conn(0x7f5110153be0 legacy=0x7f5110156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:50.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.512+0000 7f510e59c640 1 -- 172.21.15.103:0/2534368737 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51100c6c90 con 0x7f51100c8b10 2024-09-10T08:37:50.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.513+0000 7f510e59c640 1 --2- 172.21.15.103:0/2534368737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51100c8b10 0x7f511015a4a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f51000097f0 tx=0x7f510002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5b578be4365009 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:50.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.513+0000 7f510d59a640 1 -- 172.21.15.103:0/2534368737 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100037070 con 0x7f51100c8b10 2024-09-10T08:37:50.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.513+0000 7f510d59a640 1 -- 172.21.15.103:0/2534368737 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f510002ae20 con 0x7f51100c8b10 2024-09-10T08:37:50.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.513+0000 7f510d59a640 1 -- 172.21.15.103:0/2534368737 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100032660 con 0x7f51100c8b10 2024-09-10T08:37:50.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.514+0000 7f511485c640 1 -- 172.21.15.103:0/2534368737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51100c8b10 msgr2=0x7f511015a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:50.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.514+0000 7f511485c640 1 --2- 172.21.15.103:0/2534368737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51100c8b10 0x7f511015a4a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f51000097f0 tx=0x7f510002a110 comp rx=0 tx=0).stop 2024-09-10T08:37:50.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.514+0000 7f511485c640 1 -- 172.21.15.103:0/2534368737 shutdown_connections 2024-09-10T08:37:50.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.514+0000 7f511485c640 1 --2- 172.21.15.103:0/2534368737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51100c8b10 0x7f511015a4a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:50.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.514+0000 7f511485c640 1 -- 172.21.15.103:0/2534368737 >> 172.21.15.103:0/2534368737 conn(0x7f51100adb80 msgr2=0x7f51100adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:50.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.514+0000 7f511485c640 1 -- 172.21.15.103:0/2534368737 shutdown_connections 2024-09-10T08:37:50.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.514+0000 7f511485c640 1 -- 172.21.15.103:0/2534368737 wait complete. 2024-09-10T08:37:50.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.515+0000 7f511485c640 1 Processor -- start 2024-09-10T08:37:50.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.515+0000 7f511485c640 1 -- start start 2024-09-10T08:37:50.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.516+0000 7f511485c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51100c8b10 0x7f5110148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:50.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.516+0000 7f511485c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5110153be0 0x7f51101ec240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:50.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.516+0000 7f511485c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51101ec780 0x7f51100ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:50.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.516+0000 7f511485c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f51100c9070 con 0x7f5110153be0 2024-09-10T08:37:50.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.516+0000 7f511485c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f51100c8ef0 con 0x7f51101ec780 2024-09-10T08:37:50.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.516+0000 7f511485c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5110156d70 con 0x7f51100c8b10 2024-09-10T08:37:50.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.516+0000 7f510dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5110153be0 0x7f51101ec240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:50.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.516+0000 7f510dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5110153be0 0x7f51101ec240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42762/0 (socket says 172.21.15.103:42762) 2024-09-10T08:37:50.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.516+0000 7f510dd9b640 1 -- 172.21.15.103:0/3897872790 learned_addr learned my addr 172.21.15.103:0/3897872790 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:50.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.516+0000 7f510e59c640 1 --2- 172.21.15.103:0/3897872790 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51100c8b10 0x7f5110148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:50.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.517+0000 7f510ed9d640 1 --2- 172.21.15.103:0/3897872790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51101ec780 0x7f51100ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:50.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.517+0000 7f510dd9b640 1 -- 172.21.15.103:0/3897872790 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51100c8b10 msgr2=0x7f5110148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:50.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.517+0000 7f510dd9b640 1 --2- 172.21.15.103:0/3897872790 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51100c8b10 0x7f5110148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:50.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.517+0000 7f510dd9b640 1 -- 172.21.15.103:0/3897872790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51101ec780 msgr2=0x7f51100ab9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:50.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.517+0000 7f510dd9b640 1 --2- 172.21.15.103:0/3897872790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51101ec780 0x7f51100ab9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:50.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.517+0000 7f510dd9b640 1 -- 172.21.15.103:0/3897872790 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511014e8d0 con 0x7f5110153be0 2024-09-10T08:37:50.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.517+0000 7f510dd9b640 1 --2- 172.21.15.103:0/3897872790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5110153be0 0x7f51101ec240 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f510400c780 tx=0x7f510400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:50.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.517+0000 7f50feffd640 1 -- 172.21.15.103:0/3897872790 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5104005270 con 0x7f5110153be0 2024-09-10T08:37:50.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.517+0000 7f50feffd640 1 -- 172.21.15.103:0/3897872790 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5104005430 con 0x7f5110153be0 2024-09-10T08:37:50.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.517+0000 7f511485c640 1 -- 172.21.15.103:0/3897872790 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51101e1a80 con 0x7f5110153be0 2024-09-10T08:37:50.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.517+0000 7f50feffd640 1 -- 172.21.15.103:0/3897872790 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510400a880 con 0x7f5110153be0 2024-09-10T08:37:50.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.517+0000 7f511485c640 1 -- 172.21.15.103:0/3897872790 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51101e1d40 con 0x7f5110153be0 2024-09-10T08:37:50.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.518+0000 7f511485c640 1 -- 172.21.15.103:0/3897872790 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51101570d0 con 0x7f5110153be0 2024-09-10T08:37:50.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.519+0000 7f50feffd640 1 -- 172.21.15.103:0/3897872790 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f510400aa20 con 0x7f5110153be0 2024-09-10T08:37:50.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.519+0000 7f50feffd640 1 --2- 172.21.15.103:0/3897872790 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f50f006be30 0x7f50f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:50.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.520+0000 7f510e59c640 1 --2- 172.21.15.103:0/3897872790 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f50f006be30 0x7f50f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:50.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.520+0000 7f50feffd640 1 -- 172.21.15.103:0/3897872790 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f510408aee0 con 0x7f5110153be0 2024-09-10T08:37:50.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.520+0000 7f510e59c640 1 --2- 172.21.15.103:0/3897872790 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f50f006be30 0x7f50f006e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5100034000 tx=0x7f510002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:50.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.524+0000 7f50feffd640 1 -- 172.21.15.103:0/3897872790 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f51040012b0 con 0x7f5110153be0 2024-09-10T08:37:50.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.815+0000 7f511485c640 1 -- 172.21.15.103:0/3897872790 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f51100c9d90 con 0x7f5110153be0 2024-09-10T08:37:50.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.816+0000 7f50feffd640 1 -- 172.21.15.103:0/3897872790 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f5104058eb0 con 0x7f5110153be0 2024-09-10T08:37:50.816 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":74,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:37:50.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.818+0000 7f511485c640 1 -- 172.21.15.103:0/3897872790 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f50f006be30 msgr2=0x7f50f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:50.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.818+0000 7f511485c640 1 --2- 172.21.15.103:0/3897872790 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f50f006be30 0x7f50f006e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5100034000 tx=0x7f510002e000 comp rx=0 tx=0).stop 2024-09-10T08:37:50.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.818+0000 7f511485c640 1 -- 172.21.15.103:0/3897872790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5110153be0 msgr2=0x7f51101ec240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:50.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.818+0000 7f511485c640 1 --2- 172.21.15.103:0/3897872790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5110153be0 0x7f51101ec240 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f510400c780 tx=0x7f510400cc40 comp rx=0 tx=0).stop 2024-09-10T08:37:50.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.818+0000 7f511485c640 1 -- 172.21.15.103:0/3897872790 shutdown_connections 2024-09-10T08:37:50.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.818+0000 7f511485c640 1 --2- 172.21.15.103:0/3897872790 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f50f006be30 0x7f50f006e2f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:50.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.818+0000 7f511485c640 1 --2- 172.21.15.103:0/3897872790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51101ec780 0x7f51100ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:50.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.818+0000 7f511485c640 1 --2- 172.21.15.103:0/3897872790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5110153be0 0x7f51101ec240 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:50.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.818+0000 7f511485c640 1 --2- 172.21.15.103:0/3897872790 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51100c8b10 0x7f5110148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:50.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.818+0000 7f511485c640 1 -- 172.21.15.103:0/3897872790 >> 172.21.15.103:0/3897872790 conn(0x7f51100adb80 msgr2=0x7f5110149890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:50.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.818+0000 7f511485c640 1 -- 172.21.15.103:0/3897872790 shutdown_connections 2024-09-10T08:37:50.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.818+0000 7f511485c640 1 -- 172.21.15.103:0/3897872790 wait complete. 2024-09-10T08:37:50.830 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:37:50.830 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-10T08:37:50.830 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:37:50.830 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:37:50.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.946+0000 7f2182ced640 1 Processor -- start 2024-09-10T08:37:50.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.946+0000 7f2182ced640 1 -- start start 2024-09-10T08:37:50.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.946+0000 7f2182ced640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f217c0c5130 0x7f217c1538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:50.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.946+0000 7f2182ced640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f217c0ad6a0 0x7f217c153e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:50.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.946+0000 7f2182ced640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f217c0c2f60 con 0x7f217c067950 2024-09-10T08:37:50.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.946+0000 7f2182ced640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f217c0c1f80 con 0x7f217c0ad6a0 2024-09-10T08:37:50.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.946+0000 7f2182ced640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f217c0c3240 con 0x7f217c0c5130 2024-09-10T08:37:50.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.947+0000 7f217bfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f217c0ad6a0 0x7f217c153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:50.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.947+0000 7f217bfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f217c0ad6a0 0x7f217c153e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42772/0 (socket says 172.21.15.103:42772) 2024-09-10T08:37:50.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.947+0000 7f217bfff640 1 -- 172.21.15.103:0/3843254737 learned_addr learned my addr 172.21.15.103:0/3843254737 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:50.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.947+0000 7f2180a89640 1 --2- 172.21.15.103:0/3843254737 >> v2:172.21.15.154:3300/0 conn(0x7f217c0c5130 0x7f217c1538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:50.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.947+0000 7f217bfff640 1 -- 172.21.15.103:0/3843254737 >> v2:172.21.15.154:3300/0 conn(0x7f217c0c5130 msgr2=0x7f217c1538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:50.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.947+0000 7f217bfff640 1 --2- 172.21.15.103:0/3843254737 >> v2:172.21.15.154:3300/0 conn(0x7f217c0c5130 0x7f217c1538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:50.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.947+0000 7f217bfff640 1 -- 172.21.15.103:0/3843254737 >> v1:172.21.15.154:6789/0 conn(0x7f217c067950 legacy=0x7f217c159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:50.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.947+0000 7f217bfff640 1 -- 172.21.15.103:0/3843254737 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217c0c1c10 con 0x7f217c0ad6a0 2024-09-10T08:37:50.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.948+0000 7f217bfff640 1 --2- 172.21.15.103:0/3843254737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c0ad6a0 0x7f217c153e00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f217c075f00 tx=0x7f216802a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587eaa19e5a9dae3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:50.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.948+0000 7f217b7fe640 1 -- 172.21.15.103:0/3843254737 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2168037070 con 0x7f217c0ad6a0 2024-09-10T08:37:50.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.948+0000 7f217b7fe640 1 -- 172.21.15.103:0/3843254737 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2168032440 con 0x7f217c0ad6a0 2024-09-10T08:37:50.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.948+0000 7f217b7fe640 1 -- 172.21.15.103:0/3843254737 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2168032810 con 0x7f217c0ad6a0 2024-09-10T08:37:50.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.948+0000 7f2182ced640 1 -- 172.21.15.103:0/3843254737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c0ad6a0 msgr2=0x7f217c153e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:50.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.948+0000 7f2182ced640 1 --2- 172.21.15.103:0/3843254737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c0ad6a0 0x7f217c153e00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f217c075f00 tx=0x7f216802a150 comp rx=0 tx=0).stop 2024-09-10T08:37:50.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.949+0000 7f2182ced640 1 -- 172.21.15.103:0/3843254737 shutdown_connections 2024-09-10T08:37:50.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.949+0000 7f2182ced640 1 --2- 172.21.15.103:0/3843254737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c0ad6a0 0x7f217c153e00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:50.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.949+0000 7f2182ced640 1 --2- 172.21.15.103:0/3843254737 >> v2:172.21.15.154:3300/0 conn(0x7f217c0c5130 0x7f217c1538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:50.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.949+0000 7f2182ced640 1 -- 172.21.15.103:0/3843254737 >> 172.21.15.103:0/3843254737 conn(0x7f217c0c8430 msgr2=0x7f217c0c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:50.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.949+0000 7f2182ced640 1 -- 172.21.15.103:0/3843254737 shutdown_connections 2024-09-10T08:37:50.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.949+0000 7f2182ced640 1 -- 172.21.15.103:0/3843254737 wait complete. 2024-09-10T08:37:50.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.950+0000 7f2182ced640 1 Processor -- start 2024-09-10T08:37:50.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.950+0000 7f2182ced640 1 -- start start 2024-09-10T08:37:50.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.951+0000 7f2182ced640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f217c067950 0x7f217c1ef000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:50.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.951+0000 7f2182ced640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c0ad6a0 0x7f217c14e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:50.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.951+0000 7f2182ced640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f217c0c5130 0x7f217c14e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:50.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.951+0000 7f2182ced640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f217c0c5690 con 0x7f217c0ad6a0 2024-09-10T08:37:50.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.951+0000 7f2182ced640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f217c0c5510 con 0x7f217c0c5130 2024-09-10T08:37:50.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.951+0000 7f2182ced640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f217c15a370 con 0x7f217c067950 2024-09-10T08:37:50.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.951+0000 7f217bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c0ad6a0 0x7f217c14e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:50.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.951+0000 7f217bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c0ad6a0 0x7f217c14e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42778/0 (socket says 172.21.15.103:42778) 2024-09-10T08:37:50.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.951+0000 7f217bfff640 1 -- 172.21.15.103:0/585016363 learned_addr learned my addr 172.21.15.103:0/585016363 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:50.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.951+0000 7f2180a89640 1 --2- 172.21.15.103:0/585016363 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f217c067950 0x7f217c1ef000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:50.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.951+0000 7f218128a640 1 --2- 172.21.15.103:0/585016363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f217c0c5130 0x7f217c14e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:50.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.951+0000 7f217bfff640 1 -- 172.21.15.103:0/585016363 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f217c067950 msgr2=0x7f217c1ef000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:50.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.951+0000 7f217bfff640 1 --2- 172.21.15.103:0/585016363 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f217c067950 0x7f217c1ef000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:50.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.951+0000 7f217bfff640 1 -- 172.21.15.103:0/585016363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f217c0c5130 msgr2=0x7f217c14e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:50.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.951+0000 7f217bfff640 1 --2- 172.21.15.103:0/585016363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f217c0c5130 0x7f217c14e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:50.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.951+0000 7f217bfff640 1 -- 172.21.15.103:0/585016363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217c0a8680 con 0x7f217c0ad6a0 2024-09-10T08:37:50.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.952+0000 7f217bfff640 1 --2- 172.21.15.103:0/585016363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c0ad6a0 0x7f217c14e1f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f216802a190 tx=0x7f21680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:50.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.952+0000 7f21797fa640 1 -- 172.21.15.103:0/585016363 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2168041070 con 0x7f217c0ad6a0 2024-09-10T08:37:50.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.952+0000 7f21797fa640 1 -- 172.21.15.103:0/585016363 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f216803c890 con 0x7f217c0ad6a0 2024-09-10T08:37:50.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.952+0000 7f2182ced640 1 -- 172.21.15.103:0/585016363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f217c1efab0 con 0x7f217c0ad6a0 2024-09-10T08:37:50.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.952+0000 7f21797fa640 1 -- 172.21.15.103:0/585016363 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2168037040 con 0x7f217c0ad6a0 2024-09-10T08:37:50.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.952+0000 7f2182ced640 1 -- 172.21.15.103:0/585016363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f217c0a91d0 con 0x7f217c0ad6a0 2024-09-10T08:37:50.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.953+0000 7f2182ced640 1 --2- 172.21.15.103:0/585016363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c1ef540 0x7f217c0a7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:50.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.953+0000 7f2182ced640 1 -- 172.21.15.103:0/585016363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f217c14ec70 con 0x7f217c1ef540 2024-09-10T08:37:50.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.953+0000 7f2180a89640 1 --2- 172.21.15.103:0/585016363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c1ef540 0x7f217c0a7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:50.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.953+0000 7f2180a89640 1 -- 172.21.15.103:0/585016363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f217c15a760 con 0x7f217c1ef540 2024-09-10T08:37:50.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.953+0000 7f2180a89640 1 --2- 172.21.15.103:0/585016363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c1ef540 0x7f217c0a7e90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2170011890 tx=0x7f2170011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:50.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.953+0000 7f21797fa640 1 -- 172.21.15.103:0/585016363 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2170019070 con 0x7f217c1ef540 2024-09-10T08:37:50.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.954+0000 7f21797fa640 1 -- 172.21.15.103:0/585016363 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2168044070 con 0x7f217c0ad6a0 2024-09-10T08:37:50.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.954+0000 7f21797fa640 1 --2- 172.21.15.103:0/585016363 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f216006bd30 0x7f216006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:50.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.954+0000 7f21797fa640 1 -- 172.21.15.103:0/585016363 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f21680abaf0 con 0x7f217c0ad6a0 2024-09-10T08:37:50.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.954+0000 7f218128a640 1 --2- 172.21.15.103:0/585016363 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f216006bd30 0x7f216006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:50.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.954+0000 7f21797fa640 1 -- 172.21.15.103:0/585016363 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2170004240 con 0x7f217c1ef540 2024-09-10T08:37:50.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.954+0000 7f21797fa640 1 -- 172.21.15.103:0/585016363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c1ef540 msgr2=0x7f217c0a7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:50.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.954+0000 7f21797fa640 1 --2- 172.21.15.103:0/585016363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c1ef540 0x7f217c0a7e90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2170011890 tx=0x7f2170011d50 comp rx=0 tx=0).stop 2024-09-10T08:37:50.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.954+0000 7f21797fa640 1 -- 172.21.15.103:0/585016363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c1ef540 msgr2=0x7f217c0a7e90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:37:50.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.954+0000 7f21797fa640 1 --2- 172.21.15.103:0/585016363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c1ef540 0x7f217c0a7e90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:50.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.955+0000 7f218128a640 1 --2- 172.21.15.103:0/585016363 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f216006bd30 0x7f216006e1f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f21740012e0 tx=0x7f2174009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:50.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.962+0000 7f2182ced640 1 --2- 172.21.15.103:0/585016363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c1571b0 0x7f217c1575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:50.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.962+0000 7f2182ced640 1 -- 172.21.15.103:0/585016363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f217c0ad020 con 0x7f217c1571b0 2024-09-10T08:37:50.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.962+0000 7f2180a89640 1 --2- 172.21.15.103:0/585016363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c1571b0 0x7f217c1575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:50.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.962+0000 7f2180a89640 1 -- 172.21.15.103:0/585016363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f217c0a8f80 con 0x7f217c1571b0 2024-09-10T08:37:50.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.962+0000 7f2180a89640 1 --2- 172.21.15.103:0/585016363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c1571b0 0x7f217c1575c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2170011890 tx=0x7f21700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:50.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.963+0000 7f21797fa640 1 -- 172.21.15.103:0/585016363 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217001e450 con 0x7f217c1571b0 2024-09-10T08:37:50.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.963+0000 7f21797fa640 1 -- 172.21.15.103:0/585016363 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5057 (secure 0 0 0) 0x7f21700283f0 con 0x7f217c1571b0 2024-09-10T08:37:50.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.963+0000 7f21797fa640 1 -- 172.21.15.103:0/585016363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c1571b0 msgr2=0x7f217c1575c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:50.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.963+0000 7f21797fa640 1 --2- 172.21.15.103:0/585016363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c1571b0 0x7f217c1575c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2170011890 tx=0x7f21700046c0 comp rx=0 tx=0).stop 2024-09-10T08:37:50.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.963+0000 7f21797fa640 1 -- 172.21.15.103:0/585016363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c1571b0 msgr2=0x7f217c1575c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:37:50.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.963+0000 7f21797fa640 1 --2- 172.21.15.103:0/585016363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c1571b0 0x7f217c1575c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:50.964 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:37:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:37:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:37:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:37:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 74, 2024-09-10T08:37:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 241031, 2024-09-10T08:37:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:37:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:37:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:37:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:37:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 12, 2024-09-10T08:37:50.965 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:37:50.965 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:37:50.965 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:37:50.965 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:50.965 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:50.965 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:50.965 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:50.965 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:50.965 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:50.965 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:50.965 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:50.965 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:50.965 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:37:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:37:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:37:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:37:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:37:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:37:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:37:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:37:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:37:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:37:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:37:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:37:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:37:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:37:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:37:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:37:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:37:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:37:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:37:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:37:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:37:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:37:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:37:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:37:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:37:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:37:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:37:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:37:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:37:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:37:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:37:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:37:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:37:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:37:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:37:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:37:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:37:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:37:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:37:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:37:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:37:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:37:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:37:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:50.976 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:50.976 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:37:50.976 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:50.976 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:50.976 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:37:50.976 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:50.976 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:50.976 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:50.976 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:37:50.976 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:50.976 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:50.976 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:37:50.976 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:50.976 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:50.977 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:50.977 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 8 2024-09-10T08:37:50.977 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:50.977 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:50.977 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:37:50.977 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:50.977 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:50.977 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:50.977 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:37:50.977 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:50.977 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:50.977 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:50.977 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:37:50.977 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:37:50.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.963+0000 7f2182ced640 1 -- 172.21.15.103:0/585016363 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f216006bd30 msgr2=0x7f216006e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:50.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.963+0000 7f2182ced640 1 --2- 172.21.15.103:0/585016363 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f216006bd30 0x7f216006e1f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f21740012e0 tx=0x7f2174009040 comp rx=0 tx=0).stop 2024-09-10T08:37:50.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.963+0000 7f2182ced640 1 -- 172.21.15.103:0/585016363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c0ad6a0 msgr2=0x7f217c14e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:50.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.963+0000 7f2182ced640 1 --2- 172.21.15.103:0/585016363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f217c0ad6a0 0x7f217c14e1f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f216802a190 tx=0x7f21680046c0 comp rx=0 tx=0).stop 2024-09-10T08:37:50.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.963+0000 7f218128a640 1 -- 172.21.15.103:0/585016363 reap_dead start 2024-09-10T08:37:50.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.963+0000 7f218128a640 1 -- 172.21.15.103:0/585016363 reap_dead start 2024-09-10T08:37:50.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.963+0000 7f2182ced640 1 -- 172.21.15.103:0/585016363 shutdown_connections 2024-09-10T08:37:50.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.963+0000 7f2182ced640 1 -- 172.21.15.103:0/585016363 >> 172.21.15.103:0/585016363 conn(0x7f217c0c8430 msgr2=0x7f217c0ac010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:50.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.963+0000 7f2182ced640 1 -- 172.21.15.103:0/585016363 shutdown_connections 2024-09-10T08:37:50.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:50.963+0000 7f2182ced640 1 -- 172.21.15.103:0/585016363 wait complete. 2024-09-10T08:37:50.980 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:37:50.980 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:37:50.980 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:37:51.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.093+0000 7f83b1274640 1 Processor -- start 2024-09-10T08:37:51.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.093+0000 7f83b1274640 1 -- start start 2024-09-10T08:37:51.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.094+0000 7f83b1274640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f83ac0c4fe0 0x7f83ac06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.094+0000 7f83b1274640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83ac0c53c0 0x7f83ac159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.094+0000 7f83b1274640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83ac067c30 con 0x7f83ac0adbc0 2024-09-10T08:37:51.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.094+0000 7f83b1274640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f83ac06e640 con 0x7f83ac0c4fe0 2024-09-10T08:37:51.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.094+0000 7f83b1274640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f83ac06f140 con 0x7f83ac0c53c0 2024-09-10T08:37:51.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.094+0000 7f83aaffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f83ac0c4fe0 0x7f83ac06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:51.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.094+0000 7f83aa7fc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83ac0c53c0 0x7f83ac159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:51.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.094+0000 7f83ab7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f83ac0adbc0 0x7f83ac1559c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:49560/0 (socket says 172.21.15.103:49560) 2024-09-10T08:37:51.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.094+0000 7f83ab7fe640 1 -- 172.21.15.103:0/1086858856 learned_addr learned my addr 172.21.15.103:0/1086858856 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:37:51.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.094+0000 7f83aa7fc640 1 -- 172.21.15.103:0/1086858856 >> v2:172.21.15.154:3300/0 conn(0x7f83ac0c4fe0 msgr2=0x7f83ac06f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:51.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.094+0000 7f83aa7fc640 1 --2- 172.21.15.103:0/1086858856 >> v2:172.21.15.154:3300/0 conn(0x7f83ac0c4fe0 0x7f83ac06f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.094+0000 7f83aa7fc640 1 -- 172.21.15.103:0/1086858856 >> v1:172.21.15.154:6789/0 conn(0x7f83ac0adbc0 legacy=0x7f83ac1559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:51.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.094+0000 7f83aa7fc640 1 -- 172.21.15.103:0/1086858856 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ac067f10 con 0x7f83ac0c53c0 2024-09-10T08:37:51.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.094+0000 7f83aaffd640 1 --2- 172.21.15.103:0/1086858856 >> v2:172.21.15.154:3300/0 conn(0x7f83ac0c4fe0 0x7f83ac06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:37:51.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.095+0000 7f83aa7fc640 1 --2- 172.21.15.103:0/1086858856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83ac0c53c0 0x7f83ac159a40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f83a00097a0 tx=0x7f83a002a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f03632ed2bbdc80a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:51.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.095+0000 7f83a9ffb640 1 -- 172.21.15.103:0/1086858856 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a0037070 con 0x7f83ac0c53c0 2024-09-10T08:37:51.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.095+0000 7f83a9ffb640 1 -- 172.21.15.103:0/1086858856 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a002adb0 con 0x7f83ac0c53c0 2024-09-10T08:37:51.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.095+0000 7f83a9ffb640 1 -- 172.21.15.103:0/1086858856 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a0032660 con 0x7f83ac0c53c0 2024-09-10T08:37:51.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.096+0000 7f83b1274640 1 -- 172.21.15.103:0/1086858856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83ac0c53c0 msgr2=0x7f83ac159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:51.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.096+0000 7f83b1274640 1 --2- 172.21.15.103:0/1086858856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83ac0c53c0 0x7f83ac159a40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f83a00097a0 tx=0x7f83a002a060 comp rx=0 tx=0).stop 2024-09-10T08:37:51.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.096+0000 7f83b1274640 1 -- 172.21.15.103:0/1086858856 shutdown_connections 2024-09-10T08:37:51.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.096+0000 7f83b1274640 1 --2- 172.21.15.103:0/1086858856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83ac0c53c0 0x7f83ac159a40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.096+0000 7f83b1274640 1 --2- 172.21.15.103:0/1086858856 >> v2:172.21.15.154:3300/0 conn(0x7f83ac0c4fe0 0x7f83ac06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.096+0000 7f83b1274640 1 -- 172.21.15.103:0/1086858856 >> 172.21.15.103:0/1086858856 conn(0x7f83ac0c8410 msgr2=0x7f83ac0c87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:51.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.096+0000 7f83b1274640 1 -- 172.21.15.103:0/1086858856 shutdown_connections 2024-09-10T08:37:51.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.096+0000 7f83b1274640 1 -- 172.21.15.103:0/1086858856 wait complete. 2024-09-10T08:37:51.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.097+0000 7f83b1274640 1 Processor -- start 2024-09-10T08:37:51.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.097+0000 7f83b1274640 1 -- start start 2024-09-10T08:37:51.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.098+0000 7f83b1274640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83ac0adbc0 0x7f83ac0728e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.098+0000 7f83b1274640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac0c4fe0 0x7f83ac1ebee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.098+0000 7f83b1274640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83ac0c53c0 0x7f83ac1ec420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.098+0000 7f83b1274640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac06e3e0 con 0x7f83ac0adbc0 2024-09-10T08:37:51.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.098+0000 7f83b1274640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac06e260 con 0x7f83ac0c4fe0 2024-09-10T08:37:51.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.098+0000 7f83b1274640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f83ac159f80 con 0x7f83ac0c53c0 2024-09-10T08:37:51.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.098+0000 7f83aaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83ac0adbc0 0x7f83ac0728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:51.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.098+0000 7f83aaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83ac0adbc0 0x7f83ac0728e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42810/0 (socket says 172.21.15.103:42810) 2024-09-10T08:37:51.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.098+0000 7f83aaffd640 1 -- 172.21.15.103:0/3247751203 learned_addr learned my addr 172.21.15.103:0/3247751203 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:51.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.098+0000 7f83aa7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac0c4fe0 0x7f83ac1ebee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:51.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.098+0000 7f83ab7fe640 1 --2- 172.21.15.103:0/3247751203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83ac0c53c0 0x7f83ac1ec420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.098+0000 7f83aaffd640 1 -- 172.21.15.103:0/3247751203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83ac0c53c0 msgr2=0x7f83ac1ec420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.098+0000 7f83aaffd640 1 --2- 172.21.15.103:0/3247751203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83ac0c53c0 0x7f83ac1ec420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.098+0000 7f83aaffd640 1 -- 172.21.15.103:0/3247751203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac0c4fe0 msgr2=0x7f83ac1ebee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.098+0000 7f83aaffd640 1 --2- 172.21.15.103:0/3247751203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac0c4fe0 0x7f83ac1ebee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.098+0000 7f83aaffd640 1 -- 172.21.15.103:0/3247751203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ac0c74b0 con 0x7f83ac0adbc0 2024-09-10T08:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.098+0000 7f83aa7fc640 1 --2- 172.21.15.103:0/3247751203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac0c4fe0 0x7f83ac1ebee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.099+0000 7f83aaffd640 1 --2- 172.21.15.103:0/3247751203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83ac0adbc0 0x7f83ac0728e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f839c00ebe0 tx=0x7f839c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.099+0000 7f83937fe640 1 -- 172.21.15.103:0/3247751203 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c017070 con 0x7f83ac0adbc0 2024-09-10T08:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.099+0000 7f83937fe640 1 -- 172.21.15.103:0/3247751203 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839c00cc30 con 0x7f83ac0adbc0 2024-09-10T08:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.099+0000 7f83b1274640 1 -- 172.21.15.103:0/3247751203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83ac0c7790 con 0x7f83ac0adbc0 2024-09-10T08:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.099+0000 7f83937fe640 1 -- 172.21.15.103:0/3247751203 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c013470 con 0x7f83ac0adbc0 2024-09-10T08:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.099+0000 7f83b1274640 1 -- 172.21.15.103:0/3247751203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83ac072e20 con 0x7f83ac0adbc0 2024-09-10T08:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.100+0000 7f83b1274640 1 --2- 172.21.15.103:0/3247751203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac157630 0x7f83ac157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.100+0000 7f83b1274640 1 -- 172.21.15.103:0/3247751203 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac1eb820 con 0x7f83ac157630 2024-09-10T08:37:51.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.100+0000 7f83aa7fc640 1 --2- 172.21.15.103:0/3247751203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac157630 0x7f83ac157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:51.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.100+0000 7f83aa7fc640 1 -- 172.21.15.103:0/3247751203 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83ac0c7260 con 0x7f83ac157630 2024-09-10T08:37:51.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.100+0000 7f83937fe640 1 -- 172.21.15.103:0/3247751203 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f839c01a070 con 0x7f83ac0adbc0 2024-09-10T08:37:51.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.101+0000 7f83aa7fc640 1 --2- 172.21.15.103:0/3247751203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac157630 0x7f83ac157d90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0c5c60 tx=0x7f83a00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:51.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.101+0000 7f83937fe640 1 --2- 172.21.15.103:0/3247751203 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f839806be30 0x7f839806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.101+0000 7f83937fe640 1 -- 172.21.15.103:0/3247751203 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f839c08b3b0 con 0x7f83ac0adbc0 2024-09-10T08:37:51.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.101+0000 7f83ab7fe640 1 --2- 172.21.15.103:0/3247751203 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f839806be30 0x7f839806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:51.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.101+0000 7f83937fe640 1 -- 172.21.15.103:0/3247751203 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a0037040 con 0x7f83ac157630 2024-09-10T08:37:51.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.101+0000 7f83937fe640 1 -- 172.21.15.103:0/3247751203 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f83a003e630 con 0x7f83ac157630 2024-09-10T08:37:51.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.101+0000 7f83937fe640 1 -- 172.21.15.103:0/3247751203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac157630 msgr2=0x7f83ac157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:51.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.101+0000 7f83937fe640 1 --2- 172.21.15.103:0/3247751203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac157630 0x7f83ac157d90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0c5c60 tx=0x7f83a00046c0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.101+0000 7f83937fe640 1 -- 172.21.15.103:0/3247751203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac157630 msgr2=0x7f83ac157d90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:37:51.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.101+0000 7f83937fe640 1 --2- 172.21.15.103:0/3247751203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac157630 0x7f83ac157d90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.101+0000 7f83ab7fe640 1 --2- 172.21.15.103:0/3247751203 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f839806be30 0x7f839806e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f83a4005c00 tx=0x7f83a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:51.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.109+0000 7f83b1274640 1 --2- 172.21.15.103:0/3247751203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac0744b0 0x7f83ac1582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.109+0000 7f83b1274640 1 -- 172.21.15.103:0/3247751203 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac158810 con 0x7f83ac0744b0 2024-09-10T08:37:51.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.110+0000 7f83aa7fc640 1 --2- 172.21.15.103:0/3247751203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac0744b0 0x7f83ac1582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:51.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.110+0000 7f83aa7fc640 1 -- 172.21.15.103:0/3247751203 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f83ac1ebac0 con 0x7f83ac0744b0 2024-09-10T08:37:51.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.110+0000 7f83aa7fc640 1 --2- 172.21.15.103:0/3247751203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac0744b0 0x7f83ac1582d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f83a002a0a0 tx=0x7f83a0009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:51.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.110+0000 7f83937fe640 1 -- 172.21.15.103:0/3247751203 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a0053430 con 0x7f83ac0744b0 2024-09-10T08:37:51.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.111+0000 7f83937fe640 1 -- 172.21.15.103:0/3247751203 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f83a003d3c0 con 0x7f83ac0744b0 2024-09-10T08:37:51.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.111+0000 7f83937fe640 1 -- 172.21.15.103:0/3247751203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac0744b0 msgr2=0x7f83ac1582d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:51.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.111+0000 7f83937fe640 1 --2- 172.21.15.103:0/3247751203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac0744b0 0x7f83ac1582d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f83a002a0a0 tx=0x7f83a0009190 comp rx=0 tx=0).stop 2024-09-10T08:37:51.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.111+0000 7f83937fe640 1 -- 172.21.15.103:0/3247751203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac0744b0 msgr2=0x7f83ac1582d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:37:51.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.111+0000 7f83937fe640 1 --2- 172.21.15.103:0/3247751203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83ac0744b0 0x7f83ac1582d0 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f83a002a0a0 tx=0x7f83a0009190 comp rx=0 tx=0).stop 2024-09-10T08:37:51.111 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:37:51.111 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:37:51.111 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:37:51.111 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:37:51.111 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 74, 2024-09-10T08:37:51.112 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 16136, 2024-09-10T08:37:51.112 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:37:51.112 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:37:51.112 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:37:51.112 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:37:51.112 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:51.112 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 13, 2024-09-10T08:37:51.112 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:37:51.112 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:37:51.112 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:37:51.112 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:51.112 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:51.112 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:51.113 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:51.113 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:51.113 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:51.113 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:51.113 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:51.113 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:51.113 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:51.113 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:51.113 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:51.113 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:37:51.113 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:37:51.113 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:51.113 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:51.114 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:51.114 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:51.114 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:51.114 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:51.114 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:51.114 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:51.114 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:51.114 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:51.114 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:51.114 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:51.114 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.114 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:37:51.114 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:37:51.114 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:37:51.115 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:37:51.115 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:37:51.115 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:37:51.115 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:37:51.115 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:37:51.115 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:37:51.115 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:37:51.115 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:37:51.115 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:37:51.115 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:37:51.115 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:37:51.115 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:37:51.115 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:37:51.116 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:37:51.116 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:51.116 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:51.116 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:51.116 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:51.116 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:51.116 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:51.116 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:51.116 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:51.116 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:51.116 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:51.116 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:51.116 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:51.117 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:37:51.117 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.117 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:37:51.117 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.117 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:37:51.117 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:37:51.117 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:51.117 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:51.117 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.117 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:51.117 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:37:51.117 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:51.117 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.118 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.118 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:51.118 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:37:51.118 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:51.118 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:51.118 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:51.118 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.118 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:37:51.118 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:37:51.118 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:51.118 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:51.118 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:51.118 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.118 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.119 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:37:51.119 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:37:51.119 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:51.119 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:51.119 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.119 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:51.119 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:37:51.119 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:51.119 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.119 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.119 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:51.119 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:37:51.119 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:51.119 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:51.120 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:51.120 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.120 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:37:51.120 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:37:51.120 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:51.120 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:51.120 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:51.120 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.120 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.120 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:37:51.120 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:37:51.120 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:51.120 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:51.121 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.121 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:51.121 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:37:51.121 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:51.121 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.121 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.121 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:51.121 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:37:51.121 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:51.121 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:51.121 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:51.121 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.121 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:37:51.121 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:37:51.122 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:51.122 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:51.122 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:51.122 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:51.122 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:51.122 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.122 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:37:51.122 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:37:51.122 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.122 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:51.122 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:51.122 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:37:51.122 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:51.123 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:51.123 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:37:51.123 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.123 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:51.123 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:51.123 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:37:51.123 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:51.123 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:51.123 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.123 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:37:51.123 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:37:51.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.111+0000 7f83b1274640 1 -- 172.21.15.103:0/3247751203 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f839806be30 msgr2=0x7f839806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:51.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.111+0000 7f83b1274640 1 --2- 172.21.15.103:0/3247751203 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f839806be30 0x7f839806e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f83a4005c00 tx=0x7f83a4009040 comp rx=0 tx=0).stop 2024-09-10T08:37:51.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.111+0000 7f83b1274640 1 -- 172.21.15.103:0/3247751203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83ac0adbc0 msgr2=0x7f83ac0728e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:51.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.111+0000 7f83b1274640 1 --2- 172.21.15.103:0/3247751203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83ac0adbc0 0x7f83ac0728e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f839c00ebe0 tx=0x7f839c00c520 comp rx=0 tx=0).stop 2024-09-10T08:37:51.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.111+0000 7f83ab7fe640 1 -- 172.21.15.103:0/3247751203 reap_dead start 2024-09-10T08:37:51.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.111+0000 7f83ab7fe640 1 -- 172.21.15.103:0/3247751203 reap_dead start 2024-09-10T08:37:51.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.111+0000 7f83b1274640 1 -- 172.21.15.103:0/3247751203 shutdown_connections 2024-09-10T08:37:51.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.111+0000 7f83b1274640 1 -- 172.21.15.103:0/3247751203 >> 172.21.15.103:0/3247751203 conn(0x7f83ac0c8410 msgr2=0x7f83ac0c2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:51.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.111+0000 7f83b1274640 1 -- 172.21.15.103:0/3247751203 shutdown_connections 2024-09-10T08:37:51.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.111+0000 7f83b1274640 1 -- 172.21.15.103:0/3247751203 wait complete. 2024-09-10T08:37:51.126 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:37:51.126 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:37:51.126 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:37:51.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.231+0000 7faf18f78640 1 Processor -- start 2024-09-10T08:37:51.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.231+0000 7faf18f78640 1 -- start start 2024-09-10T08:37:51.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.232+0000 7faf18f78640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faf140c26b0 0x7faf14166490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.232+0000 7faf18f78640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf1408d440 0x7faf1408d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.232+0000 7faf18f78640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf14166a70 con 0x7faf140c5940 2024-09-10T08:37:51.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.232+0000 7faf18f78640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7faf1408ddf0 con 0x7faf140c26b0 2024-09-10T08:37:51.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.232+0000 7faf18f78640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7faf141630c0 con 0x7faf1408d440 2024-09-10T08:37:51.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.232+0000 7faf1259c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faf140c26b0 0x7faf14166490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:51.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.232+0000 7faf1259c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faf140c26b0 0x7faf14166490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42812/0 (socket says 172.21.15.103:42812) 2024-09-10T08:37:51.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.232+0000 7faf1259c640 1 -- 172.21.15.103:0/3522108699 learned_addr learned my addr 172.21.15.103:0/3522108699 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:51.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.232+0000 7faf1159a640 1 -- 172.21.15.103:0/3522108699 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 611208811 0 0) 0x7faf14166a70 con 0x7faf140c5940 2024-09-10T08:37:51.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.232+0000 7faf12d9d640 1 --2- 172.21.15.103:0/3522108699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf1408d440 0x7faf1408d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:51.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.346+0000 7faf1159a640 1 -- 172.21.15.103:0/3522108699 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faefc003500 con 0x7faf140c5940 2024-09-10T08:37:51.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.346+0000 7faf1259c640 1 -- 172.21.15.103:0/3522108699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf1408d440 msgr2=0x7faf1408d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:51.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.346+0000 7faf1259c640 1 --2- 172.21.15.103:0/3522108699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf1408d440 0x7faf1408d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.346+0000 7faf1259c640 1 -- 172.21.15.103:0/3522108699 >> v1:172.21.15.154:6789/0 conn(0x7faf140c5940 legacy=0x7faf14163550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:51.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.346+0000 7faf1259c640 1 -- 172.21.15.103:0/3522108699 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf14166d50 con 0x7faf140c26b0 2024-09-10T08:37:51.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.347+0000 7faf1259c640 1 --2- 172.21.15.103:0/3522108699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf140c26b0 0x7faf14166490 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faf0400b970 tx=0x7faf0402a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e10c51065b11ad2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:51.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.348+0000 7faf1159a640 1 -- 172.21.15.103:0/3522108699 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf04039070 con 0x7faf140c26b0 2024-09-10T08:37:51.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.348+0000 7faf1159a640 1 -- 172.21.15.103:0/3522108699 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf040316d0 con 0x7faf140c26b0 2024-09-10T08:37:51.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.348+0000 7faf1159a640 1 -- 172.21.15.103:0/3522108699 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf04031a80 con 0x7faf140c26b0 2024-09-10T08:37:51.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.348+0000 7faf18f78640 1 -- 172.21.15.103:0/3522108699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf140c26b0 msgr2=0x7faf14166490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:51.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.348+0000 7faf18f78640 1 --2- 172.21.15.103:0/3522108699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf140c26b0 0x7faf14166490 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faf0400b970 tx=0x7faf0402a860 comp rx=0 tx=0).stop 2024-09-10T08:37:51.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.349+0000 7faf18f78640 1 -- 172.21.15.103:0/3522108699 shutdown_connections 2024-09-10T08:37:51.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.349+0000 7faf18f78640 1 --2- 172.21.15.103:0/3522108699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf1408d440 0x7faf1408d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.349+0000 7faf18f78640 1 --2- 172.21.15.103:0/3522108699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf140c26b0 0x7faf14166490 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.349+0000 7faf18f78640 1 -- 172.21.15.103:0/3522108699 >> 172.21.15.103:0/3522108699 conn(0x7faf140c7a40 msgr2=0x7faf140c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:51.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.349+0000 7faf18f78640 1 -- 172.21.15.103:0/3522108699 shutdown_connections 2024-09-10T08:37:51.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.349+0000 7faf18f78640 1 -- 172.21.15.103:0/3522108699 wait complete. 2024-09-10T08:37:51.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.350+0000 7faf18f78640 1 Processor -- start 2024-09-10T08:37:51.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.350+0000 7faf18f78640 1 -- start start 2024-09-10T08:37:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.351+0000 7faf18f78640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf1408d440 0x7faf141602b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.351+0000 7faf18f78640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf140c26b0 0x7faf140870b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.351+0000 7faf18f78640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf140c5940 0x7faf140abc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.351+0000 7faf18f78640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faf1406f2e0 con 0x7faf140c26b0 2024-09-10T08:37:51.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.351+0000 7faf18f78640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faf14167310 con 0x7faf1408d440 2024-09-10T08:37:51.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.351+0000 7faf18f78640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7faf1406f460 con 0x7faf140c5940 2024-09-10T08:37:51.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.351+0000 7faf11d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf140c26b0 0x7faf140870b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:51.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.351+0000 7faf12d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf140c5940 0x7faf140abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:51.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.351+0000 7faf1259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf1408d440 0x7faf141602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:51.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.351+0000 7faf11d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf140c26b0 0x7faf140870b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42828/0 (socket says 172.21.15.103:42828) 2024-09-10T08:37:51.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.351+0000 7faf11d9b640 1 -- 172.21.15.103:0/2103985232 learned_addr learned my addr 172.21.15.103:0/2103985232 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:51.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.351+0000 7faf11d9b640 1 -- 172.21.15.103:0/2103985232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf140c5940 msgr2=0x7faf140abc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:51.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.351+0000 7faf11d9b640 1 --2- 172.21.15.103:0/2103985232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf140c5940 0x7faf140abc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.351+0000 7faf11d9b640 1 -- 172.21.15.103:0/2103985232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf1408d440 msgr2=0x7faf141602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:51.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.351+0000 7faf11d9b640 1 --2- 172.21.15.103:0/2103985232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf1408d440 0x7faf141602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.351+0000 7faf11d9b640 1 -- 172.21.15.103:0/2103985232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf140875f0 con 0x7faf140c26b0 2024-09-10T08:37:51.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.351+0000 7faf1259c640 1 --2- 172.21.15.103:0/2103985232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf1408d440 0x7faf141602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:37:51.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.351+0000 7faf11d9b640 1 --2- 172.21.15.103:0/2103985232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf140c26b0 0x7faf140870b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faf0800c460 tx=0x7faf0800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:51.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.352+0000 7faf02ffd640 1 -- 172.21.15.103:0/2103985232 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08017070 con 0x7faf140c26b0 2024-09-10T08:37:51.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.352+0000 7faf02ffd640 1 -- 172.21.15.103:0/2103985232 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf080052f0 con 0x7faf140c26b0 2024-09-10T08:37:51.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.352+0000 7faf02ffd640 1 -- 172.21.15.103:0/2103985232 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08003830 con 0x7faf140c26b0 2024-09-10T08:37:51.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.352+0000 7faf18f78640 1 -- 172.21.15.103:0/2103985232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf141fcbc0 con 0x7faf140c26b0 2024-09-10T08:37:51.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.352+0000 7faf18f78640 1 -- 172.21.15.103:0/2103985232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf140ab700 con 0x7faf140c26b0 2024-09-10T08:37:51.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.353+0000 7faf18f78640 1 --2- 172.21.15.103:0/2103985232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf141fc720 0x7faf140ac580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.353+0000 7faf18f78640 1 -- 172.21.15.103:0/2103985232 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7faf141607f0 con 0x7faf141fc720 2024-09-10T08:37:51.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.353+0000 7faf1259c640 1 --2- 172.21.15.103:0/2103985232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf141fc720 0x7faf140ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:51.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.353+0000 7faf1259c640 1 -- 172.21.15.103:0/2103985232 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf140c6dc0 con 0x7faf141fc720 2024-09-10T08:37:51.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.353+0000 7faf02ffd640 1 -- 172.21.15.103:0/2103985232 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf0801a070 con 0x7faf140c26b0 2024-09-10T08:37:51.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.353+0000 7faf1259c640 1 --2- 172.21.15.103:0/2103985232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf141fc720 0x7faf140ac580 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faf140685a0 tx=0x7faf040046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:51.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.354+0000 7faf02ffd640 1 --2- 172.21.15.103:0/2103985232 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7faef406be30 0x7faef406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.354+0000 7faf02ffd640 1 -- 172.21.15.103:0/2103985232 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7faf0808a4c0 con 0x7faf140c26b0 2024-09-10T08:37:51.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.354+0000 7faf12d9d640 1 --2- 172.21.15.103:0/2103985232 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7faef406be30 0x7faef406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:51.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.354+0000 7faf02ffd640 1 -- 172.21.15.103:0/2103985232 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf04039040 con 0x7faf141fc720 2024-09-10T08:37:51.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.354+0000 7faf02ffd640 1 -- 172.21.15.103:0/2103985232 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7faf04031e40 con 0x7faf141fc720 2024-09-10T08:37:51.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.354+0000 7faf02ffd640 1 -- 172.21.15.103:0/2103985232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf141fc720 msgr2=0x7faf140ac580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:51.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.354+0000 7faf02ffd640 1 --2- 172.21.15.103:0/2103985232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf141fc720 0x7faf140ac580 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faf140685a0 tx=0x7faf040046c0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.354+0000 7faf02ffd640 1 -- 172.21.15.103:0/2103985232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf141fc720 msgr2=0x7faf140ac580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:37:51.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.354+0000 7faf02ffd640 1 --2- 172.21.15.103:0/2103985232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf141fc720 0x7faf140ac580 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.354+0000 7faf12d9d640 1 --2- 172.21.15.103:0/2103985232 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7faef406be30 0x7faef406e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7faf0c006570 tx=0x7faf0c006360 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:51.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.361+0000 7faf18f78640 1 --2- 172.21.15.103:0/2103985232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf14089fa0 0x7faf140acac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.361+0000 7faf18f78640 1 -- 172.21.15.103:0/2103985232 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7faf141629c0 con 0x7faf14089fa0 2024-09-10T08:37:51.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.361+0000 7faf1259c640 1 --2- 172.21.15.103:0/2103985232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf14089fa0 0x7faf140acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:51.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.362+0000 7faf1259c640 1 -- 172.21.15.103:0/2103985232 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faf140ac160 con 0x7faf14089fa0 2024-09-10T08:37:51.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.362+0000 7faf1259c640 1 --2- 172.21.15.103:0/2103985232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf14089fa0 0x7faf140acac0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faf0400b970 tx=0x7faf04032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:51.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.362+0000 7faf02ffd640 1 -- 172.21.15.103:0/2103985232 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf04039030 con 0x7faf14089fa0 2024-09-10T08:37:51.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.362+0000 7faf02ffd640 1 -- 172.21.15.103:0/2103985232 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7faf04003a50 con 0x7faf14089fa0 2024-09-10T08:37:51.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.362+0000 7faf02ffd640 1 -- 172.21.15.103:0/2103985232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf14089fa0 msgr2=0x7faf140acac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:51.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.362+0000 7faf02ffd640 1 --2- 172.21.15.103:0/2103985232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf14089fa0 0x7faf140acac0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faf0400b970 tx=0x7faf04032000 comp rx=0 tx=0).stop 2024-09-10T08:37:51.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.362+0000 7faf02ffd640 1 -- 172.21.15.103:0/2103985232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf14089fa0 msgr2=0x7faf140acac0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:37:51.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.362+0000 7faf02ffd640 1 --2- 172.21.15.103:0/2103985232 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf14089fa0 0x7faf140acac0 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faf0400b970 tx=0x7faf04032000 comp rx=0 tx=0).stop 2024-09-10T08:37:51.371 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:37:51.371 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:37:51.371 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:37:51.371 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:37:51.371 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 74, 2024-09-10T08:37:51.372 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 77476, 2024-09-10T08:37:51.372 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:37:51.372 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:37:51.372 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:37:51.372 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:37:51.372 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:51.373 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 13, 2024-09-10T08:37:51.373 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:37:51.373 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:37:51.373 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:37:51.373 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:51.373 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:51.374 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:51.374 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:51.374 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:51.374 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:51.374 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:51.374 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:51.375 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:51.375 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:51.375 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:51.375 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:51.375 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:37:51.375 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:37:51.375 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:51.376 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:51.376 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:51.376 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:51.376 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:51.376 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:51.376 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:51.377 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:51.377 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:51.377 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:51.377 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:51.377 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:51.377 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.378 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:37:51.378 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:37:51.378 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:37:51.378 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:37:51.379 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:37:51.379 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:37:51.379 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:37:51.379 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:37:51.379 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:37:51.380 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:37:51.380 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:37:51.380 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:37:51.380 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:37:51.381 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:37:51.381 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:37:51.381 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:37:51.381 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:37:51.382 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:37:51.382 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:37:51.382 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:37:51.382 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:37:51.382 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:37:51.383 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:37:51.383 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:37:51.383 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:37:51.383 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:37:51.383 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:37:51.384 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:37:51.384 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:51.384 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:37:51.384 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.385 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:37:51.385 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.385 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:37:51.385 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:37:51.385 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:51.386 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:51.386 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.386 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:51.386 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:37:51.387 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:51.387 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.387 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.387 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:51.388 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:37:51.388 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:51.388 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:51.388 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:51.389 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.389 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:37:51.389 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:37:51.389 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:51.389 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:51.390 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:51.390 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.390 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.390 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:37:51.391 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:37:51.391 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:51.391 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:51.391 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.392 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:51.392 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:37:51.392 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:51.393 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.393 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.393 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:51.393 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:37:51.394 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:51.394 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:51.394 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:51.395 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.395 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:37:51.395 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:37:51.396 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:51.396 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:51.396 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:51.396 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.397 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.397 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:37:51.397 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:37:51.397 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:37:51.398 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:37:51.398 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.398 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:37:51.398 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:37:51.399 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:51.399 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.399 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.399 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:37:51.399 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:37:51.399 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:37:51.400 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:51.400 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:51.400 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.400 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:37:51.400 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:37:51.400 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:37:51.400 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:37:51.400 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:37:51.400 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:51.400 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:51.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.401 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:37:51.401 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:37:51.401 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.401 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:51.401 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:51.401 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:37:51.401 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:51.401 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:51.401 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:37:51.401 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.402 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:51.402 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:51.402 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:37:51.402 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:51.402 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:51.402 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:37:51.402 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.402 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:51.402 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:51.402 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:37:51.402 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:51.402 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:51.402 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:37:51.403 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.403 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:51.403 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:51.403 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:37:51.403 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:51.403 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:37:51.403 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:37:51.403 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:37:51.403 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:37:51.403 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:37:51.403 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:37:51.403 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:37:51.404 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:37:51.404 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:37:51.404 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:37:51.404 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:37:51.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.363+0000 7faf18f78640 1 -- 172.21.15.103:0/2103985232 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7faef406be30 msgr2=0x7faef406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:51.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.363+0000 7faf18f78640 1 --2- 172.21.15.103:0/2103985232 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7faef406be30 0x7faef406e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7faf0c006570 tx=0x7faf0c006360 comp rx=0 tx=0).stop 2024-09-10T08:37:51.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.363+0000 7faf18f78640 1 -- 172.21.15.103:0/2103985232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf140c26b0 msgr2=0x7faf140870b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:51.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.363+0000 7faf18f78640 1 --2- 172.21.15.103:0/2103985232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf140c26b0 0x7faf140870b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faf0800c460 tx=0x7faf0800c920 comp rx=0 tx=0).stop 2024-09-10T08:37:51.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.363+0000 7faf12d9d640 1 -- 172.21.15.103:0/2103985232 reap_dead start 2024-09-10T08:37:51.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.363+0000 7faf12d9d640 1 -- 172.21.15.103:0/2103985232 reap_dead start 2024-09-10T08:37:51.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.363+0000 7faf18f78640 1 -- 172.21.15.103:0/2103985232 shutdown_connections 2024-09-10T08:37:51.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.363+0000 7faf18f78640 1 -- 172.21.15.103:0/2103985232 >> 172.21.15.103:0/2103985232 conn(0x7faf140c7a40 msgr2=0x7faf14160ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:51.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.363+0000 7faf18f78640 1 -- 172.21.15.103:0/2103985232 shutdown_connections 2024-09-10T08:37:51.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.363+0000 7faf18f78640 1 -- 172.21.15.103:0/2103985232 wait complete. 2024-09-10T08:37:51.406 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:37:51.407 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-09-10T08:37:51.407 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-10T08:37:51.407 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-10T08:37:51.407 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-10T08:37:51.407 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T08:37:51.407 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:37:51.421 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T08:37:51.421 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-10T08:37:51.421 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:37:51.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.530+0000 7fca2cae6640 1 Processor -- start 2024-09-10T08:37:51.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.530+0000 7fca2cae6640 1 -- start start 2024-09-10T08:37:51.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.531+0000 7fca2cae6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca2814e720 0x7fca280aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.531+0000 7fca2cae6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fca280aaac0 0x7fca2806eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.531+0000 7fca2cae6640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca28158610 con 0x7fca280aa6a0 2024-09-10T08:37:51.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.531+0000 7fca2cae6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fca280a9cd0 con 0x7fca280aaac0 2024-09-10T08:37:51.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.531+0000 7fca2cae6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fca280a7f70 con 0x7fca2814e720 2024-09-10T08:37:51.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.531+0000 7fca2659c640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca2814e720 msgr2=0x7fca280aa160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:37:51.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.531+0000 7fca2659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca2814e720 0x7fca280aa160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:37:51.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.531+0000 7fca25d9b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fca280aa6a0 0x7fca2806e3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45196/0 (socket says 172.21.15.103:45196) 2024-09-10T08:37:51.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.531+0000 7fca25d9b640 1 -- 172.21.15.103:0/3318719613 learned_addr learned my addr 172.21.15.103:0/3318719613 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:37:51.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.531+0000 7fca26d9d640 1 --2- 172.21.15.103:0/3318719613 >> v2:172.21.15.154:3300/0 conn(0x7fca280aaac0 0x7fca2806eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:51.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.531+0000 7fca2559a640 1 -- 172.21.15.103:0/3318719613 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1045507073 0 0) 0x7fca28158610 con 0x7fca280aa6a0 2024-09-10T08:37:51.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.531+0000 7fca2559a640 1 -- 172.21.15.103:0/3318719613 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca10003520 con 0x7fca280aa6a0 2024-09-10T08:37:51.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.531+0000 7fca2559a640 1 -- 172.21.15.103:0/3318719613 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1605155310 0 0) 0x7fca10003520 con 0x7fca280aa6a0 2024-09-10T08:37:51.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.531+0000 7fca2559a640 1 -- 172.21.15.103:0/3318719613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca2814e720 msgr2=0x7fca280aa160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:37:51.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.531+0000 7fca2559a640 1 --2- 172.21.15.103:0/3318719613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca2814e720 0x7fca280aa160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.531+0000 7fca2559a640 1 -- 172.21.15.103:0/3318719613 >> v2:172.21.15.154:3300/0 conn(0x7fca280aaac0 msgr2=0x7fca2806eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:51.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.531+0000 7fca2559a640 1 --2- 172.21.15.103:0/3318719613 >> v2:172.21.15.154:3300/0 conn(0x7fca280aaac0 0x7fca2806eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.531+0000 7fca2559a640 1 -- 172.21.15.103:0/3318719613 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca280a8250 con 0x7fca280aa6a0 2024-09-10T08:37:51.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.531+0000 7fca2559a640 1 -- 172.21.15.103:0/3318719613 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7fca1c001670 con 0x7fca280aa6a0 2024-09-10T08:37:51.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.531+0000 7fca2559a640 1 -- 172.21.15.103:0/3318719613 >> v1:172.21.15.103:6789/0 conn(0x7fca280aa6a0 legacy=0x7fca2806e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:51.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.532+0000 7fca2559a640 1 --2- 172.21.15.103:0/3318719613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca100039b0 0x7fca10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.532+0000 7fca2559a640 1 --2- 172.21.15.103:0/3318719613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca2814e720 0x7fca10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.532+0000 7fca2559a640 1 --2- 172.21.15.103:0/3318719613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca10004d40 0x7fca100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.532+0000 7fca2559a640 1 -- 172.21.15.103:0/3318719613 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fca280a9cd0 con 0x7fca100039b0 2024-09-10T08:37:51.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.532+0000 7fca2559a640 1 -- 172.21.15.103:0/3318719613 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca280a7f70 con 0x7fca10004d40 2024-09-10T08:37:51.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.532+0000 7fca2559a640 1 -- 172.21.15.103:0/3318719613 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fca1000bb50 con 0x7fca2814e720 2024-09-10T08:37:51.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.532+0000 7fca2659c640 1 --2- 172.21.15.103:0/3318719613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca100039b0 0x7fca10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:51.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.532+0000 7fca25d9b640 1 -- 172.21.15.103:0/3318719613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca2814e720 msgr2=0x7fca10004800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:37:51.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.532+0000 7fca25d9b640 1 --2- 172.21.15.103:0/3318719613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca2814e720 0x7fca10004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:37:51.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.532+0000 7fca26d9d640 1 --2- 172.21.15.103:0/3318719613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca10004d40 0x7fca100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:51.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.532+0000 7fca2659c640 1 -- 172.21.15.103:0/3318719613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca2814e720 msgr2=0x7fca10004800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:37:51.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.532+0000 7fca2659c640 1 --2- 172.21.15.103:0/3318719613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca2814e720 0x7fca10004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.532+0000 7fca2659c640 1 -- 172.21.15.103:0/3318719613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca10004d40 msgr2=0x7fca100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:51.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.532+0000 7fca2659c640 1 --2- 172.21.15.103:0/3318719613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca10004d40 0x7fca100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.532+0000 7fca2659c640 1 -- 172.21.15.103:0/3318719613 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca10003520 con 0x7fca100039b0 2024-09-10T08:37:51.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.533+0000 7fca2659c640 1 --2- 172.21.15.103:0/3318719613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca100039b0 0x7fca10003dd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fca18009900 tx=0x7fca10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b00fc434f5fd35d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:51.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.533+0000 7fca2559a640 1 -- 172.21.15.103:0/3318719613 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca18009500 con 0x7fca100039b0 2024-09-10T08:37:51.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.533+0000 7fca2559a640 1 -- 172.21.15.103:0/3318719613 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca1802e070 con 0x7fca100039b0 2024-09-10T08:37:51.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.533+0000 7fca2559a640 1 -- 172.21.15.103:0/3318719613 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca18003df0 con 0x7fca100039b0 2024-09-10T08:37:51.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.534+0000 7fca2cae6640 1 -- 172.21.15.103:0/3318719613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca100039b0 msgr2=0x7fca10003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:51.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.534+0000 7fca2cae6640 1 --2- 172.21.15.103:0/3318719613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca100039b0 0x7fca10003dd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fca18009900 tx=0x7fca10005830 comp rx=0 tx=0).stop 2024-09-10T08:37:51.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.534+0000 7fca26d9d640 1 -- 172.21.15.103:0/3318719613 reap_dead start 2024-09-10T08:37:51.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.534+0000 7fca2cae6640 1 -- 172.21.15.103:0/3318719613 shutdown_connections 2024-09-10T08:37:51.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.534+0000 7fca2cae6640 1 -- 172.21.15.103:0/3318719613 >> 172.21.15.103:0/3318719613 conn(0x7fca280c8430 msgr2=0x7fca280c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:51.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.534+0000 7fca2cae6640 1 -- 172.21.15.103:0/3318719613 shutdown_connections 2024-09-10T08:37:51.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.534+0000 7fca2cae6640 1 -- 172.21.15.103:0/3318719613 wait complete. 2024-09-10T08:37:51.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.535+0000 7fca2cae6640 1 Processor -- start 2024-09-10T08:37:51.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.535+0000 7fca2cae6640 1 -- start start 2024-09-10T08:37:51.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.536+0000 7fca2cae6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca100039b0 0x7fca28154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.536+0000 7fca2cae6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca2814d630 0x7fca2814dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.536+0000 7fca2cae6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca281ed580 0x7fca281eda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.536+0000 7fca2cae6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fca28067e60 con 0x7fca281ed580 2024-09-10T08:37:51.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.536+0000 7fca2cae6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca2806f020 con 0x7fca2814d630 2024-09-10T08:37:51.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.536+0000 7fca2cae6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fca28067fe0 con 0x7fca100039b0 2024-09-10T08:37:51.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.536+0000 7fca2659c640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca100039b0 msgr2=0x7fca28154600 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:37:51.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.536+0000 7fca2659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca100039b0 0x7fca28154600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:37:51.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.537+0000 7fca26d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca281ed580 0x7fca281eda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:51.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.537+0000 7fca26d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca281ed580 0x7fca281eda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42850/0 (socket says 172.21.15.103:42850) 2024-09-10T08:37:51.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.537+0000 7fca26d9d640 1 -- 172.21.15.103:0/3078245366 learned_addr learned my addr 172.21.15.103:0/3078245366 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:51.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.537+0000 7fca25d9b640 1 --2- 172.21.15.103:0/3078245366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca2814d630 0x7fca2814dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:51.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.537+0000 7fca26d9d640 1 -- 172.21.15.103:0/3078245366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca100039b0 msgr2=0x7fca28154600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:37:51.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.537+0000 7fca26d9d640 1 --2- 172.21.15.103:0/3078245366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca100039b0 0x7fca28154600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.537+0000 7fca26d9d640 1 -- 172.21.15.103:0/3078245366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca2814d630 msgr2=0x7fca2814dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:51.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.537+0000 7fca26d9d640 1 --2- 172.21.15.103:0/3078245366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca2814d630 0x7fca2814dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.537+0000 7fca26d9d640 1 -- 172.21.15.103:0/3078245366 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca28152410 con 0x7fca281ed580 2024-09-10T08:37:51.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.537+0000 7fca26d9d640 1 --2- 172.21.15.103:0/3078245366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca281ed580 0x7fca281eda00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fca28070f20 tx=0x7fca2000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:51.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.537+0000 7fca16ffd640 1 -- 172.21.15.103:0/3078245366 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca20023070 con 0x7fca281ed580 2024-09-10T08:37:51.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.537+0000 7fca16ffd640 1 -- 172.21.15.103:0/3078245366 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca2000fdb0 con 0x7fca281ed580 2024-09-10T08:37:51.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.537+0000 7fca2cae6640 1 -- 172.21.15.103:0/3078245366 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca281eab30 con 0x7fca281ed580 2024-09-10T08:37:51.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.537+0000 7fca16ffd640 1 -- 172.21.15.103:0/3078245366 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca200168f0 con 0x7fca281ed580 2024-09-10T08:37:51.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.537+0000 7fca2cae6640 1 -- 172.21.15.103:0/3078245366 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca28151940 con 0x7fca281ed580 2024-09-10T08:37:51.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.538+0000 7fca2cae6640 1 -- 172.21.15.103:0/3078245366 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca281581e0 con 0x7fca281ed580 2024-09-10T08:37:51.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.539+0000 7fca16ffd640 1 -- 172.21.15.103:0/3078245366 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca20026070 con 0x7fca281ed580 2024-09-10T08:37:51.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.539+0000 7fca16ffd640 1 --2- 172.21.15.103:0/3078245366 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca0806bde0 0x7fca0806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:51.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.540+0000 7fca16ffd640 1 -- 172.21.15.103:0/3078245366 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fca2008f890 con 0x7fca281ed580 2024-09-10T08:37:51.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.540+0000 7fca2659c640 1 --2- 172.21.15.103:0/3078245366 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca0806bde0 0x7fca0806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:51.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.540+0000 7fca2659c640 1 --2- 172.21.15.103:0/3078245366 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca0806bde0 0x7fca0806e2a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fca18032000 tx=0x7fca18037040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:51.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.544+0000 7fca16ffd640 1 -- 172.21.15.103:0/3078245366 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca20010040 con 0x7fca281ed580 2024-09-10T08:37:51.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.834+0000 7fca2cae6640 1 -- 172.21.15.103:0/3078245366 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fca280c5cc0 con 0x7fca281ed580 2024-09-10T08:37:51.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.835+0000 7fca16ffd640 1 -- 172.21.15.103:0/3078245366 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fca2005d850 con 0x7fca281ed580 2024-09-10T08:37:51.835 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":74,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:37:51.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.837+0000 7fca2cae6640 1 -- 172.21.15.103:0/3078245366 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca0806bde0 msgr2=0x7fca0806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:51.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.837+0000 7fca2cae6640 1 --2- 172.21.15.103:0/3078245366 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca0806bde0 0x7fca0806e2a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fca18032000 tx=0x7fca18037040 comp rx=0 tx=0).stop 2024-09-10T08:37:51.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.837+0000 7fca2cae6640 1 -- 172.21.15.103:0/3078245366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca281ed580 msgr2=0x7fca281eda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:51.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.837+0000 7fca2cae6640 1 --2- 172.21.15.103:0/3078245366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca281ed580 0x7fca281eda00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fca28070f20 tx=0x7fca2000f580 comp rx=0 tx=0).stop 2024-09-10T08:37:51.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.837+0000 7fca2cae6640 1 -- 172.21.15.103:0/3078245366 shutdown_connections 2024-09-10T08:37:51.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.837+0000 7fca2cae6640 1 --2- 172.21.15.103:0/3078245366 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca0806bde0 0x7fca0806e2a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.837+0000 7fca2cae6640 1 --2- 172.21.15.103:0/3078245366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca281ed580 0x7fca281eda00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.837+0000 7fca2cae6640 1 --2- 172.21.15.103:0/3078245366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca2814d630 0x7fca2814dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.837+0000 7fca2cae6640 1 --2- 172.21.15.103:0/3078245366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca100039b0 0x7fca28154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:51.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.837+0000 7fca2cae6640 1 -- 172.21.15.103:0/3078245366 >> 172.21.15.103:0/3078245366 conn(0x7fca280c8430 msgr2=0x7fca280c5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:51.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.837+0000 7fca2cae6640 1 -- 172.21.15.103:0/3078245366 shutdown_connections 2024-09-10T08:37:51.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:51.837+0000 7fca2cae6640 1 -- 172.21.15.103:0/3078245366 wait complete. 2024-09-10T08:37:54.850 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:37:54.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.962+0000 7f46fee30640 1 Processor -- start 2024-09-10T08:37:54.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.962+0000 7f46fee30640 1 -- start start 2024-09-10T08:37:54.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.963+0000 7f46fee30640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f46f80a8270 0x7f46f8153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:54.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.963+0000 7f46fee30640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f46f80c3c40 0x7f46f80c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:54.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.963+0000 7f46fee30640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46f80c7c30 con 0x7f46f8071bb0 2024-09-10T08:37:54.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.963+0000 7f46fee30640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f46f80c4610 con 0x7f46f80a8270 2024-09-10T08:37:54.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.963+0000 7f46fee30640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f46f80c7f10 con 0x7f46f80c3c40 2024-09-10T08:37:54.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.963+0000 7f46fcbcc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f46f80a8270 0x7f46f8153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:54.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.963+0000 7f46f7fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f46f8071bb0 0x7f46f80c4c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45212/0 (socket says 172.21.15.103:45212) 2024-09-10T08:37:54.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.963+0000 7f46f7fff640 1 -- 172.21.15.103:0/207370545 learned_addr learned my addr 172.21.15.103:0/207370545 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:37:54.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.963+0000 7f46fd3cd640 1 --2- 172.21.15.103:0/207370545 >> v2:172.21.15.154:3300/0 conn(0x7f46f80c3c40 0x7f46f80c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:54.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.964+0000 7f46fcbcc640 1 -- 172.21.15.103:0/207370545 >> v2:172.21.15.154:3300/0 conn(0x7f46f80c3c40 msgr2=0x7f46f80c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:54.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.964+0000 7f46fcbcc640 1 --2- 172.21.15.103:0/207370545 >> v2:172.21.15.154:3300/0 conn(0x7f46f80c3c40 0x7f46f80c40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:54.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.964+0000 7f46fcbcc640 1 -- 172.21.15.103:0/207370545 >> v1:172.21.15.103:6789/0 conn(0x7f46f8071bb0 legacy=0x7f46f80c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:54.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.964+0000 7f46fcbcc640 1 -- 172.21.15.103:0/207370545 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f80c81f0 con 0x7f46f80a8270 2024-09-10T08:37:54.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.964+0000 7f46fcbcc640 1 --2- 172.21.15.103:0/207370545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46f80a8270 0x7f46f8153ae0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f46f8157670 tx=0x7f46ec02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4053aeb76acf48b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:54.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.964+0000 7f46f77fe640 1 -- 172.21.15.103:0/207370545 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ec037070 con 0x7f46f80a8270 2024-09-10T08:37:54.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.964+0000 7f46f77fe640 1 -- 172.21.15.103:0/207370545 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46ec032440 con 0x7f46f80a8270 2024-09-10T08:37:54.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.964+0000 7f46f77fe640 1 -- 172.21.15.103:0/207370545 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ec02ae60 con 0x7f46f80a8270 2024-09-10T08:37:54.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.965+0000 7f46fee30640 1 -- 172.21.15.103:0/207370545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46f80a8270 msgr2=0x7f46f8153ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:54.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.965+0000 7f46fee30640 1 --2- 172.21.15.103:0/207370545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46f80a8270 0x7f46f8153ae0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f46f8157670 tx=0x7f46ec02a110 comp rx=0 tx=0).stop 2024-09-10T08:37:54.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.965+0000 7f46fee30640 1 -- 172.21.15.103:0/207370545 shutdown_connections 2024-09-10T08:37:54.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.965+0000 7f46fee30640 1 --2- 172.21.15.103:0/207370545 >> v2:172.21.15.154:3300/0 conn(0x7f46f80c3c40 0x7f46f80c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:54.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.965+0000 7f46fee30640 1 --2- 172.21.15.103:0/207370545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46f80a8270 0x7f46f8153ae0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:54.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.965+0000 7f46fee30640 1 -- 172.21.15.103:0/207370545 >> 172.21.15.103:0/207370545 conn(0x7f46f80c5680 msgr2=0x7f46f80c5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:54.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.965+0000 7f46fee30640 1 -- 172.21.15.103:0/207370545 shutdown_connections 2024-09-10T08:37:54.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.965+0000 7f46fee30640 1 -- 172.21.15.103:0/207370545 wait complete. 2024-09-10T08:37:54.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.967+0000 7f46fee30640 1 Processor -- start 2024-09-10T08:37:54.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.967+0000 7f46fee30640 1 -- start start 2024-09-10T08:37:54.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.968+0000 7f46fee30640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46f8071bb0 0x7f46f806fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:54.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.968+0000 7f46fee30640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46f80a8270 0x7f46f806c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:54.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.968+0000 7f46fee30640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46f80c3c40 0x7f46f80a9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:54.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.968+0000 7f46fee30640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f46f80c5380 con 0x7f46f80a8270 2024-09-10T08:37:54.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.968+0000 7f46fcbcc640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46f8071bb0 msgr2=0x7f46f806fa20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:37:54.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.968+0000 7f46fee30640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f46f80a8650 con 0x7f46f80c3c40 2024-09-10T08:37:54.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.968+0000 7f46fcbcc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46f8071bb0 0x7f46f806fa20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:37:54.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.968+0000 7f46fee30640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f46f80c5500 con 0x7f46f8071bb0 2024-09-10T08:37:54.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.968+0000 7f46f7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46f80a8270 0x7f46f806c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:54.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.968+0000 7f46f7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46f80a8270 0x7f46f806c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42888/0 (socket says 172.21.15.103:42888) 2024-09-10T08:37:54.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.968+0000 7f46f7fff640 1 -- 172.21.15.103:0/2484265119 learned_addr learned my addr 172.21.15.103:0/2484265119 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:37:54.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.968+0000 7f46fd3cd640 1 --2- 172.21.15.103:0/2484265119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46f80c3c40 0x7f46f80a9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:54.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.968+0000 7f46f7fff640 1 -- 172.21.15.103:0/2484265119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46f8071bb0 msgr2=0x7f46f806fa20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:37:54.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.968+0000 7f46f7fff640 1 --2- 172.21.15.103:0/2484265119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46f8071bb0 0x7f46f806fa20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:54.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.968+0000 7f46f7fff640 1 -- 172.21.15.103:0/2484265119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46f80c3c40 msgr2=0x7f46f80a9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:54.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.968+0000 7f46f7fff640 1 --2- 172.21.15.103:0/2484265119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46f80c3c40 0x7f46f80a9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:54.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.968+0000 7f46f7fff640 1 -- 172.21.15.103:0/2484265119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f81ed2b0 con 0x7f46f80a8270 2024-09-10T08:37:54.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.968+0000 7f46f7fff640 1 --2- 172.21.15.103:0/2484265119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46f80a8270 0x7f46f806c040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f46e400c3c0 tx=0x7f46e400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:54.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.968+0000 7f46f57fa640 1 -- 172.21.15.103:0/2484265119 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e4017070 con 0x7f46f80a8270 2024-09-10T08:37:54.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.969+0000 7f46f57fa640 1 -- 172.21.15.103:0/2484265119 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e4005ce0 con 0x7f46f80a8270 2024-09-10T08:37:54.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.969+0000 7f46f57fa640 1 -- 172.21.15.103:0/2484265119 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e40072f0 con 0x7f46f80a8270 2024-09-10T08:37:54.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.969+0000 7f46fee30640 1 -- 172.21.15.103:0/2484265119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f81ed590 con 0x7f46f80a8270 2024-09-10T08:37:54.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.969+0000 7f46fee30640 1 -- 172.21.15.103:0/2484265119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f80aa300 con 0x7f46f80a8270 2024-09-10T08:37:54.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.970+0000 7f46fee30640 1 -- 172.21.15.103:0/2484265119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46f8072190 con 0x7f46f80a8270 2024-09-10T08:37:54.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.970+0000 7f46f57fa640 1 -- 172.21.15.103:0/2484265119 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f46e401a070 con 0x7f46f80a8270 2024-09-10T08:37:54.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.971+0000 7f46f57fa640 1 --2- 172.21.15.103:0/2484265119 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f46dc06be10 0x7f46dc06e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:54.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.971+0000 7f46f57fa640 1 -- 172.21.15.103:0/2484265119 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f46e408a3e0 con 0x7f46f80a8270 2024-09-10T08:37:54.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.971+0000 7f46fcbcc640 1 --2- 172.21.15.103:0/2484265119 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f46dc06be10 0x7f46dc06e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:54.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.971+0000 7f46fcbcc640 1 --2- 172.21.15.103:0/2484265119 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f46dc06be10 0x7f46dc06e2d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f46ec034000 tx=0x7f46ec02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:54.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:54.977+0000 7f46f57fa640 1 -- 172.21.15.103:0/2484265119 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f46e4058430 con 0x7f46f80a8270 2024-09-10T08:37:55.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:55.240+0000 7f46fee30640 1 -- 172.21.15.103:0/2484265119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f46f80aeca0 con 0x7f46f80a8270 2024-09-10T08:37:55.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:55.240+0000 7f46f57fa640 1 -- 172.21.15.103:0/2484265119 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f46e405c730 con 0x7f46f80a8270 2024-09-10T08:37:55.241 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":74,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:37:55.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:55.243+0000 7f46fee30640 1 -- 172.21.15.103:0/2484265119 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f46dc06be10 msgr2=0x7f46dc06e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:55.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:55.243+0000 7f46fee30640 1 --2- 172.21.15.103:0/2484265119 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f46dc06be10 0x7f46dc06e2d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f46ec034000 tx=0x7f46ec02e000 comp rx=0 tx=0).stop 2024-09-10T08:37:55.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:55.243+0000 7f46fee30640 1 -- 172.21.15.103:0/2484265119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46f80a8270 msgr2=0x7f46f806c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:55.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:55.243+0000 7f46fee30640 1 --2- 172.21.15.103:0/2484265119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46f80a8270 0x7f46f806c040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f46e400c3c0 tx=0x7f46e400c880 comp rx=0 tx=0).stop 2024-09-10T08:37:55.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:55.243+0000 7f46fee30640 1 -- 172.21.15.103:0/2484265119 shutdown_connections 2024-09-10T08:37:55.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:55.243+0000 7f46fee30640 1 --2- 172.21.15.103:0/2484265119 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f46dc06be10 0x7f46dc06e2d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:55.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:55.243+0000 7f46fee30640 1 --2- 172.21.15.103:0/2484265119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46f80c3c40 0x7f46f80a9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:55.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:55.243+0000 7f46fee30640 1 --2- 172.21.15.103:0/2484265119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46f80a8270 0x7f46f806c040 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:55.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:55.243+0000 7f46fee30640 1 --2- 172.21.15.103:0/2484265119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46f8071bb0 0x7f46f806fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:55.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:55.243+0000 7f46fee30640 1 -- 172.21.15.103:0/2484265119 >> 172.21.15.103:0/2484265119 conn(0x7f46f80c5680 msgr2=0x7f46f8153410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:55.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:55.243+0000 7f46fee30640 1 -- 172.21.15.103:0/2484265119 shutdown_connections 2024-09-10T08:37:55.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:55.243+0000 7f46fee30640 1 -- 172.21.15.103:0/2484265119 wait complete. 2024-09-10T08:37:58.256 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:37:58.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:58.373+0000 7f6143c5a640 1 Processor -- start 2024-09-10T08:37:58.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:58.373+0000 7f6143c5a640 1 -- start start 2024-09-10T08:37:58.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:58.374+0000 7f6143c5a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613c06cd80 0x7f613c153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:58.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:58.374+0000 7f6143c5a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613c0c7070 con 0x7f613c0c8b10 2024-09-10T08:37:58.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:58.374+0000 7f6143c5a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613c06d210 con 0x7f613c15a4a0 2024-09-10T08:37:58.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:58.374+0000 7f6143c5a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f613c0c69b0 con 0x7f613c06cd80 2024-09-10T08:37:58.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:58.374+0000 7f61411f5640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613c06cd80 msgr2=0x7f613c153be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:37:58.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:58.374+0000 7f61411f5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613c06cd80 0x7f613c153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:37:58.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:58.374+0000 7f61419f6640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f613c0c8b10 0x7f613c1534d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:60272/0 (socket says 172.21.15.103:60272) 2024-09-10T08:37:58.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:58.374+0000 7f61419f6640 1 -- 172.21.15.103:0/746730281 learned_addr learned my addr 172.21.15.103:0/746730281 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:37:58.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:58.575+0000 7f61411f5640 1 -- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613c06cd80 msgr2=0x7f613c153be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:37:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:58.575+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613c06cd80 0x7f613c153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:37:58.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:58.976+0000 7f61411f5640 1 -- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613c06cd80 msgr2=0x7f613c153be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:37:58.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:58.976+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613c06cd80 0x7f613c153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:37:59.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:59.776+0000 7f61411f5640 1 -- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613c06cd80 msgr2=0x7f613c153be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:37:59.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:37:59.776+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613c06cd80 0x7f613c153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:38:01.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.373+0000 7f61337fe640 1 -- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613c06cd80 msgr2=0x7f613c153be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:38:01.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.373+0000 7f61337fe640 1 --2- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613c06cd80 0x7f613c153be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.373+0000 7f61337fe640 1 -- 172.21.15.103:0/746730281 >> v1:172.21.15.154:6789/0 conn(0x7f613c15a4a0 legacy=0x7f613c156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:01.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.373+0000 7f61337fe640 1 -- 172.21.15.103:0/746730281 >> v1:172.21.15.103:6789/0 conn(0x7f613c0c8b10 legacy=0x7f613c1534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:01.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.373+0000 7f61337fe640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 0x7f6120005b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.373+0000 7f61337fe640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 0x7f6120008660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.373+0000 7f61337fe640 1 -- 172.21.15.103:0/746730281 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f613c0c69b0 con 0x7f6120003710 2024-09-10T08:38:01.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.373+0000 7f61337fe640 1 -- 172.21.15.103:0/746730281 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f6120008d20 con 0x7f61200061e0 2024-09-10T08:38:01.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.373+0000 7f61419f6640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 0x7f6120005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.373+0000 7f61419f6640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 msgr2=0x7f6120005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:38:01.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.373+0000 7f61419f6640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 msgr2=0x7f6120005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:01.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.373+0000 7f61419f6640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 0x7f6120005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:01.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.373+0000 7f61419f6640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 0x7f6120005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:38:01.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.373+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 0x7f6120008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.373+0000 7f61411f5640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 msgr2=0x7f6120008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:38:01.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.373+0000 7f61411f5640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 msgr2=0x7f6120008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:01.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.373+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 0x7f6120008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:01.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.373+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 0x7f6120008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:38:01.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.574+0000 7f61419f6640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 0x7f6120005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.574+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 0x7f6120008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.574+0000 7f61419f6640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 msgr2=0x7f6120005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:38:01.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.574+0000 7f61419f6640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 msgr2=0x7f6120005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:01.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.574+0000 7f61419f6640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 0x7f6120005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:01.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.574+0000 7f61419f6640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 0x7f6120005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:38:01.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.574+0000 7f61411f5640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 msgr2=0x7f6120008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:38:01.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.574+0000 7f61411f5640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 msgr2=0x7f6120008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:01.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.574+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 0x7f6120008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:01.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.574+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 0x7f6120008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:38:01.934 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:38:01.937 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:38:01.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.975+0000 7f61419f6640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 0x7f6120005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.975+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 0x7f6120008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.975+0000 7f61419f6640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 msgr2=0x7f6120005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:38:01.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.975+0000 7f61419f6640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 msgr2=0x7f6120005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:01.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.975+0000 7f61419f6640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 0x7f6120005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:01.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.975+0000 7f61419f6640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 0x7f6120005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:38:01.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.975+0000 7f61411f5640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 msgr2=0x7f6120008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:38:01.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.975+0000 7f61411f5640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 msgr2=0x7f6120008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:01.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.975+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 0x7f6120008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:01.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:01.975+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 0x7f6120008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:38:02.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:02.776+0000 7f61419f6640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 0x7f6120005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:02.776+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 0x7f6120008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:02.776+0000 7f61419f6640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 msgr2=0x7f6120005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:38:02.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:02.776+0000 7f61419f6640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 msgr2=0x7f6120005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:02.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:02.776+0000 7f61419f6640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 0x7f6120005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:02.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:02.776+0000 7f61419f6640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 0x7f6120005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:38:02.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:02.776+0000 7f61411f5640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 msgr2=0x7f6120008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:38:02.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:02.776+0000 7f61411f5640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 msgr2=0x7f6120008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:02.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:02.776+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 0x7f6120008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:02.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:02.776+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 0x7f6120008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:38:04.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.373+0000 7f61337fe640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 msgr2=0x7f6120008660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:38:04.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.373+0000 7f61337fe640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f61200061e0 0x7f6120008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:04.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.373+0000 7f61337fe640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 msgr2=0x7f6120005b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:38:04.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.373+0000 7f61337fe640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.103:3300/0 conn(0x7f6120003710 0x7f6120005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:04.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.373+0000 7f61421f7640 1 -- 172.21.15.103:0/746730281 reap_dead start 2024-09-10T08:38:04.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.373+0000 7f61337fe640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 0x7f6120003af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:04.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.373+0000 7f61337fe640 1 --2- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6120004030 0x7f61200044e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:04.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.373+0000 7f61337fe640 1 -- 172.21.15.103:0/746730281 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613c0c6c90 con 0x7f613c15a4a0 2024-09-10T08:38:04.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.373+0000 7f61337fe640 1 -- 172.21.15.103:0/746730281 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f613c0c69b0 con 0x7f6120006630 2024-09-10T08:38:04.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.373+0000 7f61337fe640 1 -- 172.21.15.103:0/746730281 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6120008d20 con 0x7f6120004030 2024-09-10T08:38:04.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.373+0000 7f61421f7640 1 -- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6120004030 msgr2=0x7f61200044e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:38:04.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.373+0000 7f61421f7640 1 --2- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6120004030 0x7f61200044e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:38:04.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.373+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 0x7f6120003af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:04.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.373+0000 7f61411f5640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 msgr2=0x7f6120003af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:38:04.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.373+0000 7f61411f5640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 msgr2=0x7f6120003af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:04.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.373+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 0x7f6120003af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:04.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.373+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 0x7f6120003af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:38:04.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.574+0000 7f61421f7640 1 -- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6120004030 msgr2=0x7f61200044e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:38:04.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.574+0000 7f61421f7640 1 --2- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6120004030 0x7f61200044e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:38:04.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.574+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 0x7f6120003af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:04.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.574+0000 7f61411f5640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 msgr2=0x7f6120003af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:38:04.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.574+0000 7f61411f5640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 msgr2=0x7f6120003af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:04.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.574+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 0x7f6120003af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:04.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.574+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 0x7f6120003af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:38:04.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.975+0000 7f61421f7640 1 -- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6120004030 msgr2=0x7f61200044e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:38:04.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.975+0000 7f61421f7640 1 --2- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6120004030 0x7f61200044e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:38:04.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.975+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 0x7f6120003af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:04.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.975+0000 7f61411f5640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 msgr2=0x7f6120003af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:38:04.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.975+0000 7f61411f5640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 msgr2=0x7f6120003af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:04.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.975+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 0x7f6120003af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:04.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:04.975+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 0x7f6120003af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:38:05.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:05.776+0000 7f61421f7640 1 -- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6120004030 msgr2=0x7f61200044e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:38:05.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:05.776+0000 7f61421f7640 1 --2- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6120004030 0x7f61200044e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:38:05.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:05.776+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 0x7f6120003af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:05.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:05.776+0000 7f61411f5640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 msgr2=0x7f6120003af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:38:05.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:05.776+0000 7f61411f5640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 msgr2=0x7f6120003af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:05.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:05.776+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 0x7f6120003af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:05.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:05.776+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 0x7f6120003af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:38:06.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.105+0000 7f61409f4640 1 -- 172.21.15.103:0/746730281 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1003419420 0 0) 0x7f613c0c6c90 con 0x7f613c15a4a0 2024-09-10T08:38:06.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.105+0000 7f61409f4640 1 -- 172.21.15.103:0/746730281 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6128003520 con 0x7f613c15a4a0 2024-09-10T08:38:06.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.109+0000 7f61409f4640 1 -- 172.21.15.103:0/746730281 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1836226313 0 0) 0x7f6128003520 con 0x7f613c15a4a0 2024-09-10T08:38:06.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.109+0000 7f61409f4640 1 -- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6120004030 msgr2=0x7f61200044e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:38:06.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.109+0000 7f61409f4640 1 --2- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6120004030 0x7f61200044e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.109+0000 7f61409f4640 1 -- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 msgr2=0x7f6120003af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:38:06.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.109+0000 7f61409f4640 1 --2- 172.21.15.103:0/746730281 >> v2:172.21.15.154:3300/0 conn(0x7f6120006630 0x7f6120003af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.109+0000 7f61409f4640 1 -- 172.21.15.103:0/746730281 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6120005c80 con 0x7f613c15a4a0 2024-09-10T08:38:06.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.109+0000 7f61409f4640 1 -- 172.21.15.103:0/746730281 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f6138001620 con 0x7f613c15a4a0 2024-09-10T08:38:06.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.109+0000 7f61409f4640 1 -- 172.21.15.103:0/746730281 >> v1:172.21.15.154:6789/0 conn(0x7f613c15a4a0 legacy=0x7f612000b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.110+0000 7f61409f4640 1 --2- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6120004030 0x7f6128003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.110+0000 7f61409f4640 1 --2- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6128004030 0x7f6128004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.110+0000 7f61409f4640 1 --2- 172.21.15.103:0/746730281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6128004d40 0x7f61280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.110+0000 7f61409f4640 1 -- 172.21.15.103:0/746730281 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f613c0c69b0 con 0x7f6128004d40 2024-09-10T08:38:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.110+0000 7f61409f4640 1 -- 172.21.15.103:0/746730281 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6120008d20 con 0x7f6128004030 2024-09-10T08:38:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.110+0000 7f61409f4640 1 -- 172.21.15.103:0/746730281 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f612800bca0 con 0x7f6120004030 2024-09-10T08:38:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.110+0000 7f61419f6640 1 -- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6120004030 msgr2=0x7f6128003a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:38:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.110+0000 7f61419f6640 1 --2- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6120004030 0x7f6128003a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:38:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.110+0000 7f61421f7640 1 --2- 172.21.15.103:0/746730281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6128004d40 0x7f61280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.110+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6128004030 0x7f6128004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.110+0000 7f61421f7640 1 -- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6120004030 msgr2=0x7f6128003a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:38:06.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.110+0000 7f61421f7640 1 --2- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6120004030 0x7f6128003a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.110+0000 7f61421f7640 1 -- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6128004030 msgr2=0x7f6128004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.110+0000 7f61421f7640 1 --2- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6128004030 0x7f6128004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.110+0000 7f61421f7640 1 -- 172.21.15.103:0/746730281 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6128003520 con 0x7f6128004d40 2024-09-10T08:38:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.110+0000 7f61411f5640 1 --2- 172.21.15.103:0/746730281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6128004030 0x7f6128004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.111+0000 7f61421f7640 1 --2- 172.21.15.103:0/746730281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6128004d40 0x7f61280051c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f613c15a470 tx=0x7f6128005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb60b348a5c6eef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.111+0000 7f61409f4640 1 -- 172.21.15.103:0/746730281 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6134001a00 con 0x7f6128004d40 2024-09-10T08:38:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.111+0000 7f61409f4640 1 -- 172.21.15.103:0/746730281 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f613402e070 con 0x7f6128004d40 2024-09-10T08:38:06.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.111+0000 7f61409f4640 1 -- 172.21.15.103:0/746730281 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613402ab10 con 0x7f6128004d40 2024-09-10T08:38:06.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.112+0000 7f6143c5a640 1 -- 172.21.15.103:0/746730281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6128004d40 msgr2=0x7f61280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.112+0000 7f6143c5a640 1 --2- 172.21.15.103:0/746730281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6128004d40 0x7f61280051c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f613c15a470 tx=0x7f6128005830 comp rx=0 tx=0).stop 2024-09-10T08:38:06.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.112+0000 7f61421f7640 1 -- 172.21.15.103:0/746730281 reap_dead start 2024-09-10T08:38:06.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.112+0000 7f6143c5a640 1 -- 172.21.15.103:0/746730281 shutdown_connections 2024-09-10T08:38:06.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.112+0000 7f6143c5a640 1 -- 172.21.15.103:0/746730281 >> 172.21.15.103:0/746730281 conn(0x7f613c0adb80 msgr2=0x7f613c0adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:06.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.112+0000 7f6143c5a640 1 -- 172.21.15.103:0/746730281 shutdown_connections 2024-09-10T08:38:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.112+0000 7f6143c5a640 1 -- 172.21.15.103:0/746730281 wait complete. 2024-09-10T08:38:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.113+0000 7f6143c5a640 1 Processor -- start 2024-09-10T08:38:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.113+0000 7f6143c5a640 1 -- start start 2024-09-10T08:38:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.114+0000 7f6143c5a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f613c0b1730 0x7f613c0cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.114+0000 7f6143c5a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613c14cea0 0x7f613c14db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.114+0000 7f6143c5a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f613c0cbcf0 0x7f613c14e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.114+0000 7f6143c5a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f613c0c9070 con 0x7f613c0b1730 2024-09-10T08:38:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.114+0000 7f6143c5a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f613c0c8ef0 con 0x7f613c0cbcf0 2024-09-10T08:38:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.114+0000 7f6143c5a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f613c1534d0 con 0x7f613c14cea0 2024-09-10T08:38:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.114+0000 7f61411f5640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613c14cea0 msgr2=0x7f613c14db90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:38:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.114+0000 7f61411f5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613c14cea0 0x7f613c14db90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:38:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.114+0000 7f61419f6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f613c0b1730 0x7f613c0cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.114+0000 7f61419f6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f613c0b1730 0x7f613c0cb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38198/0 (socket says 172.21.15.103:38198) 2024-09-10T08:38:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.114+0000 7f61419f6640 1 -- 172.21.15.103:0/3747194715 learned_addr learned my addr 172.21.15.103:0/3747194715 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.115+0000 7f61421f7640 1 --2- 172.21.15.103:0/3747194715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f613c0cbcf0 0x7f613c14e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.115+0000 7f61419f6640 1 -- 172.21.15.103:0/3747194715 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613c14cea0 msgr2=0x7f613c14db90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:38:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.115+0000 7f61419f6640 1 --2- 172.21.15.103:0/3747194715 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613c14cea0 0x7f613c14db90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.115+0000 7f61419f6640 1 -- 172.21.15.103:0/3747194715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f613c0cbcf0 msgr2=0x7f613c14e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.115+0000 7f61419f6640 1 --2- 172.21.15.103:0/3747194715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f613c0cbcf0 0x7f613c14e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.115+0000 7f61419f6640 1 -- 172.21.15.103:0/3747194715 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613c1e03c0 con 0x7f613c0b1730 2024-09-10T08:38:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.115+0000 7f61419f6640 1 --2- 172.21.15.103:0/3747194715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f613c0b1730 0x7f613c0cb7b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6138005e90 tx=0x7f6138007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.115+0000 7f61327fc640 1 -- 172.21.15.103:0/3747194715 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613801a070 con 0x7f613c0b1730 2024-09-10T08:38:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.115+0000 7f61327fc640 1 -- 172.21.15.103:0/3747194715 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6138016660 con 0x7f613c0b1730 2024-09-10T08:38:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.115+0000 7f6143c5a640 1 -- 172.21.15.103:0/3747194715 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f613c1e06a0 con 0x7f613c0b1730 2024-09-10T08:38:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.115+0000 7f61327fc640 1 -- 172.21.15.103:0/3747194715 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6138016a90 con 0x7f613c0b1730 2024-09-10T08:38:06.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.115+0000 7f6143c5a640 1 -- 172.21.15.103:0/3747194715 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f613c1e15e0 con 0x7f613c0b1730 2024-09-10T08:38:06.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.116+0000 7f6143c5a640 1 -- 172.21.15.103:0/3747194715 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f613c153860 con 0x7f613c0b1730 2024-09-10T08:38:06.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.117+0000 7f61327fc640 1 -- 172.21.15.103:0/3747194715 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f613801d070 con 0x7f613c0b1730 2024-09-10T08:38:06.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.117+0000 7f61327fc640 1 --2- 172.21.15.103:0/3747194715 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f612006d480 0x7f612006f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.117+0000 7f61327fc640 1 -- 172.21.15.103:0/3747194715 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f613808b7e0 con 0x7f613c0b1730 2024-09-10T08:38:06.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.117+0000 7f61411f5640 1 --2- 172.21.15.103:0/3747194715 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f612006d480 0x7f612006f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.118+0000 7f61411f5640 1 --2- 172.21.15.103:0/3747194715 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f612006d480 0x7f612006f940 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f613c0b1fc0 tx=0x7f612c00d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.124+0000 7f61327fc640 1 -- 172.21.15.103:0/3747194715 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6138059860 con 0x7f613c0b1730 2024-09-10T08:38:06.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.393+0000 7f6143c5a640 1 -- 172.21.15.103:0/3747194715 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f613c0c9d90 con 0x7f613c0b1730 2024-09-10T08:38:06.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.393+0000 7f61327fc640 1 -- 172.21.15.103:0/3747194715 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7f613805db60 con 0x7f613c0b1730 2024-09-10T08:38:06.394 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":78,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:38:06.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.395+0000 7f6143c5a640 1 -- 172.21.15.103:0/3747194715 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f612006d480 msgr2=0x7f612006f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.395+0000 7f6143c5a640 1 --2- 172.21.15.103:0/3747194715 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f612006d480 0x7f612006f940 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f613c0b1fc0 tx=0x7f612c00d040 comp rx=0 tx=0).stop 2024-09-10T08:38:06.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.395+0000 7f6143c5a640 1 -- 172.21.15.103:0/3747194715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f613c0b1730 msgr2=0x7f613c0cb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.395+0000 7f6143c5a640 1 --2- 172.21.15.103:0/3747194715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f613c0b1730 0x7f613c0cb7b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6138005e90 tx=0x7f6138007420 comp rx=0 tx=0).stop 2024-09-10T08:38:06.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.396+0000 7f6143c5a640 1 -- 172.21.15.103:0/3747194715 shutdown_connections 2024-09-10T08:38:06.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.396+0000 7f6143c5a640 1 --2- 172.21.15.103:0/3747194715 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f612006d480 0x7f612006f940 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.396+0000 7f6143c5a640 1 --2- 172.21.15.103:0/3747194715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f613c0cbcf0 0x7f613c14e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.396+0000 7f6143c5a640 1 --2- 172.21.15.103:0/3747194715 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613c14cea0 0x7f613c14db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.396+0000 7f6143c5a640 1 --2- 172.21.15.103:0/3747194715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f613c0b1730 0x7f613c0cb7b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.396+0000 7f6143c5a640 1 -- 172.21.15.103:0/3747194715 >> 172.21.15.103:0/3747194715 conn(0x7f613c0adb80 msgr2=0x7f613c0abda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:06.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.396+0000 7f6143c5a640 1 -- 172.21.15.103:0/3747194715 shutdown_connections 2024-09-10T08:38:06.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.396+0000 7f6143c5a640 1 -- 172.21.15.103:0/3747194715 wait complete. 2024-09-10T08:38:06.409 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-10T08:38:06.409 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-10T08:38:06.409 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:38:06.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.514+0000 7fcbb1dc4640 1 Processor -- start 2024-09-10T08:38:06.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.514+0000 7fcbb1dc4640 1 -- start start 2024-09-10T08:38:06.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.515+0000 7fcbb1dc4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbac073bf0 0x7fcbac0c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.515+0000 7fcbb1dc4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcbac154dc0 0x7fcbac155270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.515+0000 7fcbb1dc4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbac158120 con 0x7fcbac06fdb0 2024-09-10T08:38:06.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.515+0000 7fcbb1dc4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fcbac0c3aa0 con 0x7fcbac154dc0 2024-09-10T08:38:06.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.515+0000 7fcbb1dc4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcbac0c4770 con 0x7fcbac073bf0 2024-09-10T08:38:06.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.515+0000 7fcbaaffd640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbac073bf0 msgr2=0x7fcbac0c83a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:38:06.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.515+0000 7fcbaaffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbac073bf0 0x7fcbac0c83a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:38:06.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.515+0000 7fcbabfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcbac154dc0 0x7fcbac155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.515+0000 7fcbab7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcbac06fdb0 0x7fcbac157a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:48972/0 (socket says 172.21.15.103:48972) 2024-09-10T08:38:06.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.515+0000 7fcbab7fe640 1 -- 172.21.15.103:0/730308257 learned_addr learned my addr 172.21.15.103:0/730308257 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:38:06.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.516+0000 7fcbabfff640 1 -- 172.21.15.103:0/730308257 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbac073bf0 msgr2=0x7fcbac0c83a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:38:06.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.516+0000 7fcbabfff640 1 --2- 172.21.15.103:0/730308257 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbac073bf0 0x7fcbac0c83a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.516+0000 7fcbabfff640 1 -- 172.21.15.103:0/730308257 >> v1:172.21.15.154:6789/0 conn(0x7fcbac06fdb0 legacy=0x7fcbac157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.516+0000 7fcbabfff640 1 -- 172.21.15.103:0/730308257 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbac0c4a50 con 0x7fcbac154dc0 2024-09-10T08:38:06.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.516+0000 7fcbaa7fc640 1 -- 172.21.15.103:0/730308257 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4242605628 0 0) 0x7fcbac158120 con 0x7fcbac06fdb0 2024-09-10T08:38:06.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.516+0000 7fcbabfff640 1 --2- 172.21.15.103:0/730308257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbac154dc0 0x7fcbac155270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009d90 tx=0x7fcba402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ea966d38c98a393 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.517+0000 7fcbaa7fc640 1 -- 172.21.15.103:0/730308257 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba4007740 con 0x7fcbac154dc0 2024-09-10T08:38:06.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.517+0000 7fcbaa7fc640 1 -- 172.21.15.103:0/730308257 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcba40078e0 con 0x7fcbac154dc0 2024-09-10T08:38:06.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.517+0000 7fcbaa7fc640 1 -- 172.21.15.103:0/730308257 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba4007cb0 con 0x7fcbac154dc0 2024-09-10T08:38:06.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.517+0000 7fcbb1dc4640 1 -- 172.21.15.103:0/730308257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbac154dc0 msgr2=0x7fcbac155270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.517+0000 7fcbb1dc4640 1 --2- 172.21.15.103:0/730308257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbac154dc0 0x7fcbac155270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009d90 tx=0x7fcba402a710 comp rx=0 tx=0).stop 2024-09-10T08:38:06.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.517+0000 7fcbb1dc4640 1 -- 172.21.15.103:0/730308257 shutdown_connections 2024-09-10T08:38:06.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.517+0000 7fcbb1dc4640 1 --2- 172.21.15.103:0/730308257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbac154dc0 0x7fcbac155270 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.517+0000 7fcbb1dc4640 1 --2- 172.21.15.103:0/730308257 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbac073bf0 0x7fcbac0c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.517+0000 7fcbb1dc4640 1 -- 172.21.15.103:0/730308257 >> 172.21.15.103:0/730308257 conn(0x7fcbac0c5550 msgr2=0x7fcbac0c5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:06.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.517+0000 7fcbb1dc4640 1 -- 172.21.15.103:0/730308257 shutdown_connections 2024-09-10T08:38:06.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.517+0000 7fcbb1dc4640 1 -- 172.21.15.103:0/730308257 wait complete. 2024-09-10T08:38:06.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.519+0000 7fcbb1dc4640 1 Processor -- start 2024-09-10T08:38:06.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.519+0000 7fcbb1dc4640 1 -- start start 2024-09-10T08:38:06.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.519+0000 7fcbb1dc4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbac06fdb0 0x7fcbac0c2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.519+0000 7fcbb1dc4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbac073bf0 0x7fcbac06c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.519+0000 7fcbb1dc4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbac154dc0 0x7fcbac06ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.519+0000 7fcbb1dc4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcbac0c6290 con 0x7fcbac154dc0 2024-09-10T08:38:06.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.519+0000 7fcbb1dc4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcbac0c3730 con 0x7fcbac06fdb0 2024-09-10T08:38:06.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.519+0000 7fcbb1dc4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcbac0c6410 con 0x7fcbac073bf0 2024-09-10T08:38:06.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.520+0000 7fcbab7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbac06fdb0 0x7fcbac0c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.520+0000 7fcbaaffd640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbac073bf0 msgr2=0x7fcbac06c8d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:38:06.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.520+0000 7fcbabfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbac154dc0 0x7fcbac06ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.520+0000 7fcbaaffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbac073bf0 0x7fcbac06c8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:38:06.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.520+0000 7fcbab7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbac06fdb0 0x7fcbac0c2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:39596/0 (socket says 172.21.15.103:39596) 2024-09-10T08:38:06.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.520+0000 7fcbabfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbac154dc0 0x7fcbac06ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38200/0 (socket says 172.21.15.103:38200) 2024-09-10T08:38:06.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.520+0000 7fcbab7fe640 1 -- 172.21.15.103:0/2692308036 learned_addr learned my addr 172.21.15.103:0/2692308036 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:06.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.520+0000 7fcbab7fe640 1 -- 172.21.15.103:0/2692308036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbac073bf0 msgr2=0x7fcbac06c8d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:38:06.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.520+0000 7fcbab7fe640 1 --2- 172.21.15.103:0/2692308036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbac073bf0 0x7fcbac06c8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.520+0000 7fcbab7fe640 1 -- 172.21.15.103:0/2692308036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbac154dc0 msgr2=0x7fcbac06ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.520+0000 7fcbab7fe640 1 --2- 172.21.15.103:0/2692308036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbac154dc0 0x7fcbac06ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.520+0000 7fcbab7fe640 1 -- 172.21.15.103:0/2692308036 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbac1571a0 con 0x7fcbac06fdb0 2024-09-10T08:38:06.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.520+0000 7fcbab7fe640 1 --2- 172.21.15.103:0/2692308036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbac06fdb0 0x7fcbac0c2120 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00c3f0 tx=0x7fcb9c00c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.520+0000 7fcb93fff640 1 -- 172.21.15.103:0/2692308036 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c0074e0 con 0x7fcbac06fdb0 2024-09-10T08:38:06.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.520+0000 7fcb93fff640 1 -- 172.21.15.103:0/2692308036 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb9c0047e0 con 0x7fcbac06fdb0 2024-09-10T08:38:06.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.520+0000 7fcbb1dc4640 1 -- 172.21.15.103:0/2692308036 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbac06e600 con 0x7fcbac06fdb0 2024-09-10T08:38:06.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.520+0000 7fcb93fff640 1 -- 172.21.15.103:0/2692308036 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c004c10 con 0x7fcbac06fdb0 2024-09-10T08:38:06.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.520+0000 7fcbb1dc4640 1 -- 172.21.15.103:0/2692308036 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbac06df50 con 0x7fcbac06fdb0 2024-09-10T08:38:06.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.521+0000 7fcbb1dc4640 1 --2- 172.21.15.103:0/2692308036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbac06d350 0x7fcbac151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.521+0000 7fcbb1dc4640 1 -- 172.21.15.103:0/2692308036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcbac070190 con 0x7fcbac06d350 2024-09-10T08:38:06.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.521+0000 7fcbaaffd640 1 --2- 172.21.15.103:0/2692308036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbac06d350 0x7fcbac151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.522+0000 7fcbaaffd640 1 -- 172.21.15.103:0/2692308036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcbac0c2ac0 con 0x7fcbac06d350 2024-09-10T08:38:06.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.522+0000 7fcbaaffd640 1 --2- 172.21.15.103:0/2692308036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbac06d350 0x7fcbac151b90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0c3110 tx=0x7fcba000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.522+0000 7fcb93fff640 1 -- 172.21.15.103:0/2692308036 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb9c011070 con 0x7fcbac06fdb0 2024-09-10T08:38:06.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.523+0000 7fcb93fff640 1 --2- 172.21.15.103:0/2692308036 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb9806bde0 0x7fcb9806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.523+0000 7fcbabfff640 1 --2- 172.21.15.103:0/2692308036 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb9806bde0 0x7fcb9806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.523+0000 7fcb93fff640 1 -- 172.21.15.103:0/2692308036 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fcb9c08acd0 con 0x7fcbac06fdb0 2024-09-10T08:38:06.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.523+0000 7fcb93fff640 1 -- 172.21.15.103:0/2692308036 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba0016070 con 0x7fcbac06d350 2024-09-10T08:38:06.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.523+0000 7fcb93fff640 1 -- 172.21.15.103:0/2692308036 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fcba0003e00 con 0x7fcbac06d350 2024-09-10T08:38:06.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.523+0000 7fcb93fff640 1 -- 172.21.15.103:0/2692308036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbac06d350 msgr2=0x7fcbac151b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.523+0000 7fcb93fff640 1 --2- 172.21.15.103:0/2692308036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbac06d350 0x7fcbac151b90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0c3110 tx=0x7fcba000b870 comp rx=0 tx=0).stop 2024-09-10T08:38:06.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.523+0000 7fcb93fff640 1 -- 172.21.15.103:0/2692308036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbac06d350 msgr2=0x7fcbac151b90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:38:06.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.523+0000 7fcb93fff640 1 --2- 172.21.15.103:0/2692308036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbac06d350 0x7fcbac151b90 secure :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0c3110 tx=0x7fcba000b870 comp rx=0 tx=0).stop 2024-09-10T08:38:06.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.523+0000 7fcbabfff640 1 --2- 172.21.15.103:0/2692308036 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb9806bde0 0x7fcb9806e2a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcba4034000 tx=0x7fcba402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.529+0000 7fcbb1dc4640 1 --2- 172.21.15.103:0/2692308036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbac1520d0 0x7fcbac1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.529+0000 7fcbb1dc4640 1 -- 172.21.15.103:0/2692308036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcbac0a8550 con 0x7fcbac1520d0 2024-09-10T08:38:06.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.529+0000 7fcbaaffd640 1 --2- 172.21.15.103:0/2692308036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbac1520d0 0x7fcbac1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.530+0000 7fcbaaffd640 1 -- 172.21.15.103:0/2692308036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcbac0c7c90 con 0x7fcbac1520d0 2024-09-10T08:38:06.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.530+0000 7fcbaaffd640 1 --2- 172.21.15.103:0/2692308036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbac1520d0 0x7fcbac1524e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0c3110 tx=0x7fcba0005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.530+0000 7fcb93fff640 1 -- 172.21.15.103:0/2692308036 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba0016040 con 0x7fcbac1520d0 2024-09-10T08:38:06.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.530+0000 7fcb93fff640 1 -- 172.21.15.103:0/2692308036 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5045 (secure 0 0 0) 0x7fcba0022420 con 0x7fcbac1520d0 2024-09-10T08:38:06.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.530+0000 7fcb93fff640 1 -- 172.21.15.103:0/2692308036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbac1520d0 msgr2=0x7fcbac1524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.530+0000 7fcb93fff640 1 --2- 172.21.15.103:0/2692308036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbac1520d0 0x7fcbac1524e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0c3110 tx=0x7fcba0005a10 comp rx=0 tx=0).stop 2024-09-10T08:38:06.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.530+0000 7fcb93fff640 1 -- 172.21.15.103:0/2692308036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbac1520d0 msgr2=0x7fcbac1524e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:38:06.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.530+0000 7fcb93fff640 1 --2- 172.21.15.103:0/2692308036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbac1520d0 0x7fcbac1524e0 secure :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0c3110 tx=0x7fcba0005a10 comp rx=0 tx=0).stop 2024-09-10T08:38:06.532 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:38:06.532 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:38:06.532 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:38:06.532 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:38:06.532 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 78, 2024-09-10T08:38:06.532 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 256598, 2024-09-10T08:38:06.532 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:38:06.532 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:38:06.532 INFO:teuthology.orchestra.run.smithi103.stdout: 1 2024-09-10T08:38:06.532 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:06.533 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:38:06.533 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:38:06.533 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:38:06.533 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:38:06.533 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:06.533 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:06.533 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:06.533 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:06.533 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:06.533 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:06.533 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:06.533 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:06.533 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:06.534 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:06.534 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:06.534 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:06.534 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:38:06.534 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:38:06.534 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:06.534 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:06.534 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:06.534 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:06.534 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:06.534 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:06.534 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:06.534 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:06.535 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:06.535 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:06.535 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:06.535 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:06.535 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.535 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:38:06.535 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:38:06.535 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:38:06.535 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:38:06.535 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:38:06.535 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:38:06.535 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:38:06.535 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:38:06.536 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:38:06.536 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:38:06.536 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:38:06.536 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:38:06.536 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:38:06.536 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:38:06.536 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:38:06.536 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:38:06.536 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:38:06.536 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:06.536 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:06.536 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:06.536 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:06.536 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:06.537 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:06.537 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:06.537 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:06.537 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:06.537 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:06.537 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:06.537 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:06.537 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:38:06.537 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.537 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:38:06.537 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.537 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:38:06.537 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:38:06.538 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:06.538 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:06.538 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.538 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:06.538 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:38:06.538 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:06.538 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.538 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.538 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:06.538 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:38:06.538 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:06.538 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:06.538 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:06.538 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.539 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:38:06.539 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:38:06.539 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:06.539 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:06.539 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:06.539 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.539 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.539 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:38:06.539 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:38:06.539 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:06.539 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:06.539 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.540 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:06.540 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:38:06.540 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:06.540 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.540 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.540 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:06.540 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:38:06.540 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:06.540 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:06.540 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:06.540 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.540 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:38:06.540 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:38:06.541 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:06.541 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:06.541 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:06.541 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.541 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.541 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:38:06.541 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:38:06.541 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:06.541 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:06.541 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.541 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:06.541 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:38:06.542 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:06.542 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.542 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.542 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:06.542 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:38:06.542 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:06.542 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:06.542 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:06.542 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.542 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:38:06.542 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:38:06.542 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:06.542 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:06.542 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:06.543 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:06.543 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:06.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.543 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:38:06.543 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:38:06.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.543 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:06.543 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:06.543 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:38:06.543 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:06.543 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:06.543 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:38:06.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.543 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:06.544 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:06.544 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:38:06.544 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:06.544 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:06.544 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:38:06.544 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.544 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:06.544 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:06.544 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 8 2024-09-10T08:38:06.544 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:06.544 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:06.544 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:38:06.545 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.545 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:06.545 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:06.545 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-10T08:38:06.545 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:06.545 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:06.545 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:38:06.545 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.545 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:06.545 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:06.545 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:38:06.545 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:06.545 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:06.546 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.546 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:38:06.546 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:38:06.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.530+0000 7fcbb1dc4640 1 -- 172.21.15.103:0/2692308036 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb9806bde0 msgr2=0x7fcb9806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.530+0000 7fcbb1dc4640 1 --2- 172.21.15.103:0/2692308036 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb9806bde0 0x7fcb9806e2a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcba4034000 tx=0x7fcba402f000 comp rx=0 tx=0).stop 2024-09-10T08:38:06.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.530+0000 7fcbb1dc4640 1 -- 172.21.15.103:0/2692308036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbac06fdb0 msgr2=0x7fcbac0c2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.530+0000 7fcbb1dc4640 1 --2- 172.21.15.103:0/2692308036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbac06fdb0 0x7fcbac0c2120 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00c3f0 tx=0x7fcb9c00c8b0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.530+0000 7fcbabfff640 1 -- 172.21.15.103:0/2692308036 reap_dead start 2024-09-10T08:38:06.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.531+0000 7fcbabfff640 1 -- 172.21.15.103:0/2692308036 reap_dead start 2024-09-10T08:38:06.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.531+0000 7fcbb1dc4640 1 -- 172.21.15.103:0/2692308036 shutdown_connections 2024-09-10T08:38:06.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.531+0000 7fcbb1dc4640 1 -- 172.21.15.103:0/2692308036 >> 172.21.15.103:0/2692308036 conn(0x7fcbac0c5550 msgr2=0x7fcbac0a9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:06.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.531+0000 7fcbb1dc4640 1 -- 172.21.15.103:0/2692308036 shutdown_connections 2024-09-10T08:38:06.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.531+0000 7fcbb1dc4640 1 -- 172.21.15.103:0/2692308036 wait complete. 2024-09-10T08:38:06.549 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:38:06.549 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-10T08:38:06.549 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:38:06.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.666+0000 7f4cddec3640 1 Processor -- start 2024-09-10T08:38:06.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.666+0000 7f4cddec3640 1 -- start start 2024-09-10T08:38:06.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.666+0000 7f4cddec3640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cd80c4ac0 0x7f4cd8153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.666+0000 7f4cddec3640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4cd80afc60 0x7f4cd8151380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.667+0000 7f4cddec3640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cd806efa0 con 0x7f4cd8072ec0 2024-09-10T08:38:06.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.667+0000 7f4cddec3640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f4cd806f280 con 0x7f4cd80afc60 2024-09-10T08:38:06.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.667+0000 7f4cddec3640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4cd806f560 con 0x7f4cd80c4ac0 2024-09-10T08:38:06.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.667+0000 7f4cd7fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4cd80afc60 0x7f4cd8151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.667+0000 7f4cd6ffd640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cd80c4ac0 msgr2=0x7f4cd8153ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:38:06.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.667+0000 7f4cd77fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4cd8072ec0 0x7f4cd8070040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:38428/0 (socket says 172.21.15.103:38428) 2024-09-10T08:38:06.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.667+0000 7f4cd7fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4cd80afc60 0x7f4cd8151380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38228/0 (socket says 172.21.15.103:38228) 2024-09-10T08:38:06.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.667+0000 7f4cd77fe640 1 -- 172.21.15.103:0/915025013 learned_addr learned my addr 172.21.15.103:0/915025013 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:38:06.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.667+0000 7f4cd6ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cd80c4ac0 0x7f4cd8153ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:38:06.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.667+0000 7f4cd7fff640 1 -- 172.21.15.103:0/915025013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cd80c4ac0 msgr2=0x7f4cd8153ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:38:06.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.667+0000 7f4cd7fff640 1 --2- 172.21.15.103:0/915025013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cd80c4ac0 0x7f4cd8153ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.667+0000 7f4cd7fff640 1 -- 172.21.15.103:0/915025013 >> v1:172.21.15.103:6789/0 conn(0x7f4cd8072ec0 legacy=0x7f4cd8070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.667+0000 7f4cd7fff640 1 -- 172.21.15.103:0/915025013 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd806f840 con 0x7f4cd80afc60 2024-09-10T08:38:06.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.667+0000 7f4cd67fc640 1 -- 172.21.15.103:0/915025013 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2565424278 0 0) 0x7f4cd806efa0 con 0x7f4cd8072ec0 2024-09-10T08:38:06.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.668+0000 7f4cd7fff640 1 --2- 172.21.15.103:0/915025013 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cd80afc60 0x7f4cd8151380 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0009d90 tx=0x7f4cd002a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb3c894959fadf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.668+0000 7f4cd67fc640 1 -- 172.21.15.103:0/915025013 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd0007740 con 0x7f4cd80afc60 2024-09-10T08:38:06.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.668+0000 7f4cd67fc640 1 -- 172.21.15.103:0/915025013 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cd00078e0 con 0x7f4cd80afc60 2024-09-10T08:38:06.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.668+0000 7f4cd67fc640 1 -- 172.21.15.103:0/915025013 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd0007cb0 con 0x7f4cd80afc60 2024-09-10T08:38:06.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.669+0000 7f4cddec3640 1 -- 172.21.15.103:0/915025013 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cd80afc60 msgr2=0x7f4cd8151380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.669+0000 7f4cddec3640 1 --2- 172.21.15.103:0/915025013 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cd80afc60 0x7f4cd8151380 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0009d90 tx=0x7f4cd002a560 comp rx=0 tx=0).stop 2024-09-10T08:38:06.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.669+0000 7f4cddec3640 1 -- 172.21.15.103:0/915025013 shutdown_connections 2024-09-10T08:38:06.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.669+0000 7f4cddec3640 1 --2- 172.21.15.103:0/915025013 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cd80afc60 0x7f4cd8151380 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.669+0000 7f4cddec3640 1 --2- 172.21.15.103:0/915025013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cd80c4ac0 0x7f4cd8153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.669+0000 7f4cddec3640 1 -- 172.21.15.103:0/915025013 >> 172.21.15.103:0/915025013 conn(0x7f4cd80c9d80 msgr2=0x7f4cd80ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:06.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.669+0000 7f4cddec3640 1 -- 172.21.15.103:0/915025013 shutdown_connections 2024-09-10T08:38:06.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.669+0000 7f4cddec3640 1 -- 172.21.15.103:0/915025013 wait complete. 2024-09-10T08:38:06.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.670+0000 7f4cddec3640 1 Processor -- start 2024-09-10T08:38:06.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.670+0000 7f4cddec3640 1 -- start start 2024-09-10T08:38:06.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.671+0000 7f4cddec3640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cd8072ec0 0x7f4cd80c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.671+0000 7f4cddec3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cd80afc60 0x7f4cd81e89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.671+0000 7f4cddec3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd80c4ac0 0x7f4cd81e8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.671+0000 7f4cddec3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd8070750 con 0x7f4cd80afc60 2024-09-10T08:38:06.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.671+0000 7f4cddec3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd80c47f0 con 0x7f4cd80c4ac0 2024-09-10T08:38:06.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.671+0000 7f4cddec3640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4cd80708d0 con 0x7f4cd8072ec0 2024-09-10T08:38:06.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.671+0000 7f4cd77fe640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cd8072ec0 msgr2=0x7f4cd80c34b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:38:06.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.671+0000 7f4cd77fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cd8072ec0 0x7f4cd80c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:38:06.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.671+0000 7f4cd6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cd80afc60 0x7f4cd81e89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.671+0000 7f4cd6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cd80afc60 0x7f4cd81e89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38234/0 (socket says 172.21.15.103:38234) 2024-09-10T08:38:06.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.671+0000 7f4cd6ffd640 1 -- 172.21.15.103:0/4217510928 learned_addr learned my addr 172.21.15.103:0/4217510928 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:06.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.671+0000 7f4cd7fff640 1 --2- 172.21.15.103:0/4217510928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd80c4ac0 0x7f4cd81e8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.671+0000 7f4cd6ffd640 1 -- 172.21.15.103:0/4217510928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cd8072ec0 msgr2=0x7f4cd80c34b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:38:06.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.671+0000 7f4cd6ffd640 1 --2- 172.21.15.103:0/4217510928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cd8072ec0 0x7f4cd80c34b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.671+0000 7f4cd6ffd640 1 -- 172.21.15.103:0/4217510928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd80c4ac0 msgr2=0x7f4cd81e8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.671+0000 7f4cd6ffd640 1 --2- 172.21.15.103:0/4217510928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd80c4ac0 0x7f4cd81e8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.671+0000 7f4cd6ffd640 1 -- 172.21.15.103:0/4217510928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd80af8a0 con 0x7f4cd80afc60 2024-09-10T08:38:06.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.672+0000 7f4cd6ffd640 1 --2- 172.21.15.103:0/4217510928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cd80afc60 0x7f4cd81e89c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00b530 tx=0x7f4ccc00b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.672+0000 7f4cbffff640 1 -- 172.21.15.103:0/4217510928 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc013020 con 0x7f4cd80afc60 2024-09-10T08:38:06.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.672+0000 7f4cbffff640 1 -- 172.21.15.103:0/4217510928 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ccc003dc0 con 0x7f4cd80afc60 2024-09-10T08:38:06.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.672+0000 7f4cddec3640 1 -- 172.21.15.103:0/4217510928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd806e6e0 con 0x7f4cd80afc60 2024-09-10T08:38:06.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.672+0000 7f4cbffff640 1 -- 172.21.15.103:0/4217510928 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc005290 con 0x7f4cd80afc60 2024-09-10T08:38:06.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.672+0000 7f4cddec3640 1 -- 172.21.15.103:0/4217510928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd81ec7b0 con 0x7f4cd80afc60 2024-09-10T08:38:06.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.673+0000 7f4cddec3640 1 --2- 172.21.15.103:0/4217510928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd806cea0 0x7f4cd806d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.673+0000 7f4cddec3640 1 -- 172.21.15.103:0/4217510928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd81e9440 con 0x7f4cd806cea0 2024-09-10T08:38:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.673+0000 7f4cd77fe640 1 --2- 172.21.15.103:0/4217510928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd806cea0 0x7f4cd806d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.673+0000 7f4cbffff640 1 -- 172.21.15.103:0/4217510928 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ccc016020 con 0x7f4cd80afc60 2024-09-10T08:38:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.673+0000 7f4cd77fe640 1 -- 172.21.15.103:0/4217510928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4cd80732a0 con 0x7f4cd806cea0 2024-09-10T08:38:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.674+0000 7f4cd77fe640 1 --2- 172.21.15.103:0/4217510928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd806cea0 0x7f4cd806d280 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4cc80010e0 tx=0x7f4cc800cb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.674+0000 7f4cbffff640 1 --2- 172.21.15.103:0/4217510928 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4cc406bde0 0x7f4cc406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.674+0000 7f4cd7fff640 1 --2- 172.21.15.103:0/4217510928 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4cc406bde0 0x7f4cc406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.674+0000 7f4cbffff640 1 -- 172.21.15.103:0/4217510928 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f4ccc08ad90 con 0x7f4cd80afc60 2024-09-10T08:38:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.674+0000 7f4cbffff640 1 -- 172.21.15.103:0/4217510928 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc8017070 con 0x7f4cd806cea0 2024-09-10T08:38:06.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.674+0000 7f4cbffff640 1 -- 172.21.15.103:0/4217510928 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4cc800ce50 con 0x7f4cd806cea0 2024-09-10T08:38:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.674+0000 7f4cbffff640 1 -- 172.21.15.103:0/4217510928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd806cea0 msgr2=0x7f4cd806d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.674+0000 7f4cbffff640 1 --2- 172.21.15.103:0/4217510928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd806cea0 0x7f4cd806d280 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4cc80010e0 tx=0x7f4cc800cb10 comp rx=0 tx=0).stop 2024-09-10T08:38:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.674+0000 7f4cbffff640 1 -- 172.21.15.103:0/4217510928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd806cea0 msgr2=0x7f4cd806d280 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:38:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.674+0000 7f4cbffff640 1 --2- 172.21.15.103:0/4217510928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd806cea0 0x7f4cd806d280 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4cc80010e0 tx=0x7f4cc800cb10 comp rx=0 tx=0).stop 2024-09-10T08:38:06.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.674+0000 7f4cd7fff640 1 --2- 172.21.15.103:0/4217510928 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4cc406bde0 0x7f4cc406e2a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0034000 tx=0x7f4cd002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.680+0000 7f4cddec3640 1 --2- 172.21.15.103:0/4217510928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd806d7c0 0x7f4cd81eefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.680+0000 7f4cddec3640 1 -- 172.21.15.103:0/4217510928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd806dba0 con 0x7f4cd806d7c0 2024-09-10T08:38:06.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.680+0000 7f4cd77fe640 1 --2- 172.21.15.103:0/4217510928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd806d7c0 0x7f4cd81eefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.681+0000 7f4cd77fe640 1 -- 172.21.15.103:0/4217510928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4cd80ca290 con 0x7f4cd806d7c0 2024-09-10T08:38:06.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.681+0000 7f4cd77fe640 1 --2- 172.21.15.103:0/4217510928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd806d7c0 0x7f4cd81eefa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8011000 tx=0x7f4cc800f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.681+0000 7f4cbffff640 1 -- 172.21.15.103:0/4217510928 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc80076a0 con 0x7f4cd806d7c0 2024-09-10T08:38:06.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.681+0000 7f4cbffff640 1 -- 172.21.15.103:0/4217510928 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4541 (secure 0 0 0) 0x7f4cc80076a0 con 0x7f4cd806d7c0 2024-09-10T08:38:06.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.681+0000 7f4cbffff640 1 -- 172.21.15.103:0/4217510928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd806d7c0 msgr2=0x7f4cd81eefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.681+0000 7f4cbffff640 1 --2- 172.21.15.103:0/4217510928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd806d7c0 0x7f4cd81eefa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8011000 tx=0x7f4cc800f000 comp rx=0 tx=0).stop 2024-09-10T08:38:06.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.681+0000 7f4cbffff640 1 -- 172.21.15.103:0/4217510928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd806d7c0 msgr2=0x7f4cd81eefa0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:38:06.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.681+0000 7f4cbffff640 1 --2- 172.21.15.103:0/4217510928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cd806d7c0 0x7f4cd81eefa0 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8011000 tx=0x7f4cc800f000 comp rx=0 tx=0).stop 2024-09-10T08:38:06.683 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:38:06.683 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:38:06.683 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:38:06.683 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:38:06.683 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 78, 2024-09-10T08:38:06.683 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 31709, 2024-09-10T08:38:06.684 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:38:06.684 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:38:06.684 INFO:teuthology.orchestra.run.smithi103.stdout: 1 2024-09-10T08:38:06.684 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:06.684 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:38:06.684 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:38:06.684 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:38:06.684 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:38:06.684 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:06.684 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:06.684 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:06.684 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:06.685 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:06.685 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:06.685 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:06.685 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:06.685 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:06.685 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:06.685 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:06.685 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:06.685 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:38:06.685 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:38:06.685 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:06.685 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:06.685 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:06.685 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:06.686 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:06.686 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:06.686 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:06.686 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:06.686 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:06.686 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:06.686 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:06.686 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:06.686 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.686 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:38:06.686 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:38:06.686 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:38:06.686 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:38:06.687 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:38:06.687 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:38:06.687 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:38:06.687 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:38:06.687 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:38:06.687 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:38:06.687 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:38:06.687 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:38:06.687 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:38:06.687 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:38:06.687 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:38:06.687 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:38:06.687 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:38:06.687 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:06.688 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:06.688 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:06.688 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:06.688 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:06.688 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:06.688 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:06.688 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:06.688 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:06.688 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:06.688 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:06.688 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:06.688 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:38:06.688 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.689 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:38:06.689 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.689 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:38:06.689 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:38:06.689 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:06.689 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:06.689 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.689 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:06.689 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:38:06.689 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:06.689 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.689 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.689 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:06.689 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:38:06.690 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:06.690 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:06.690 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:06.690 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.690 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:38:06.690 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:38:06.690 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:06.690 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:06.690 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:06.690 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.690 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.690 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:38:06.690 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:38:06.691 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:06.691 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:06.691 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.691 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:06.691 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:38:06.691 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:06.691 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.691 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.691 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:06.691 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:38:06.691 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:06.691 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:06.691 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:06.691 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.692 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:38:06.692 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:38:06.692 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:06.692 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:06.692 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:06.692 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.692 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.692 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:38:06.692 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:38:06.692 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:06.692 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:06.692 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.692 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:06.692 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:38:06.693 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:06.693 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.693 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.693 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:06.693 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:38:06.693 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:06.693 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:06.693 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:06.693 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.693 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:38:06.693 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:38:06.693 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:06.693 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:06.694 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:06.694 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:06.694 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:06.694 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.694 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:38:06.694 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:38:06.694 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.694 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:06.694 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:06.694 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:38:06.694 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:06.694 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:06.694 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:38:06.695 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:06.695 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:06.695 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:06.695 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:38:06.695 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:06.695 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:06.695 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:06.695 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:38:06.695 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:38:06.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.682+0000 7f4cddec3640 1 -- 172.21.15.103:0/4217510928 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4cc406bde0 msgr2=0x7f4cc406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.682+0000 7f4cddec3640 1 --2- 172.21.15.103:0/4217510928 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4cc406bde0 0x7f4cc406e2a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0034000 tx=0x7f4cd002f000 comp rx=0 tx=0).stop 2024-09-10T08:38:06.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.682+0000 7f4cddec3640 1 -- 172.21.15.103:0/4217510928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cd80afc60 msgr2=0x7f4cd81e89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.682+0000 7f4cddec3640 1 --2- 172.21.15.103:0/4217510928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cd80afc60 0x7f4cd81e89c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00b530 tx=0x7f4ccc00b9f0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.682+0000 7f4cd7fff640 1 -- 172.21.15.103:0/4217510928 reap_dead start 2024-09-10T08:38:06.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.682+0000 7f4cddec3640 1 -- 172.21.15.103:0/4217510928 shutdown_connections 2024-09-10T08:38:06.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.682+0000 7f4cddec3640 1 --2- 172.21.15.103:0/4217510928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cd80afc60 0x7f4cd81e89c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.682+0000 7f4cddec3640 1 -- 172.21.15.103:0/4217510928 >> 172.21.15.103:0/4217510928 conn(0x7f4cd80c9d80 msgr2=0x7f4cd8152600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:06.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.682+0000 7f4cddec3640 1 -- 172.21.15.103:0/4217510928 shutdown_connections 2024-09-10T08:38:06.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:06.682+0000 7f4cddec3640 1 -- 172.21.15.103:0/4217510928 wait complete. 2024-09-10T08:38:06.697 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:38:06.698 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-10T08:38:16.562 INFO:tasks.workunit.client.1.smithi154.stdout:fs setup took 448 secs 2024-09-10T08:38:16.892 INFO:tasks.workunit.client.1.smithi154.stdout:Syncing()...0 sec 2024-09-10T08:38:16.894 INFO:tasks.workunit.client.1.smithi154.stdout:Starting Actual Benchmark At: Tue Sep 10 08:38:16 2024 2024-09-10T08:38:16.894 INFO:tasks.workunit.client.1.smithi154.stdout: 2024-09-10T08:38:17.178 INFO:tasks.workunit.client.0.smithi103.stdout:fs setup took 446 secs 2024-09-10T08:38:23.357 INFO:tasks.workunit.client.0.smithi103.stdout:Syncing()...6 sec 2024-09-10T08:38:23.358 INFO:tasks.workunit.client.0.smithi103.stdout:Starting Actual Benchmark At: Tue Sep 10 08:38:23 2024 2024-09-10T08:38:23.358 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-10T08:38:26.698 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-10T08:38:26.698 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-10T08:38:26.699 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T08:38:26.699 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T08:38:26.703 INFO:tasks.ceph.mon.c:Started 2024-09-10T08:38:26.704 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:38:26.704 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:38:26.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.894+0000 7fc12b89b640 1 Processor -- start 2024-09-10T08:38:26.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.894+0000 7fc12b89b640 1 -- start start 2024-09-10T08:38:26.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.895+0000 7fc12b89b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1240aa870 0x7fc12406e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:26.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.896+0000 7fc12b89b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc12406e910 0x7fc12415eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:26.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.896+0000 7fc129637640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc12414e720 0x7fc1240aa160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42834/0 (socket says 172.21.15.103:42834) 2024-09-10T08:38:26.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.896+0000 7fc129e38640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc12406e910 0x7fc12415eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:26.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.896+0000 7fc129e38640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc12406e910 0x7fc12415eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50568/0 (socket says 172.21.15.103:50568) 2024-09-10T08:38:26.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.896+0000 7fc129e38640 1 -- 172.21.15.103:0/2977670509 learned_addr learned my addr 172.21.15.103:0/2977670509 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:26.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.896+0000 7fc12b89b640 1 -- 172.21.15.103:0/2977670509 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc124158610 con 0x7fc12414e720 2024-09-10T08:38:26.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.896+0000 7fc128e36640 1 -- 172.21.15.103:0/2977670509 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1240aa870 msgr2=0x7fc12406e3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:38:26.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.896+0000 7fc12b89b640 1 -- 172.21.15.103:0/2977670509 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fc1240a9cd0 con 0x7fc12406e910 2024-09-10T08:38:26.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.896+0000 7fc12b89b640 1 -- 172.21.15.103:0/2977670509 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc1240a7f70 con 0x7fc1240aa870 2024-09-10T08:38:26.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.896+0000 7fc128e36640 1 --2- 172.21.15.103:0/2977670509 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1240aa870 0x7fc12406e3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:38:26.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.897+0000 7fc129e38640 1 -- 172.21.15.103:0/2977670509 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1240aa870 msgr2=0x7fc12406e3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:38:26.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.897+0000 7fc129e38640 1 --2- 172.21.15.103:0/2977670509 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1240aa870 0x7fc12406e3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.897+0000 7fc129e38640 1 -- 172.21.15.103:0/2977670509 >> v1:172.21.15.103:6789/0 conn(0x7fc12414e720 legacy=0x7fc1240aa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.897+0000 7fc129e38640 1 -- 172.21.15.103:0/2977670509 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1240a8250 con 0x7fc12406e910 2024-09-10T08:38:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.898+0000 7fc129e38640 1 --2- 172.21.15.103:0/2977670509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc12406e910 0x7fc12415eb60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009e50 tx=0x7fc11c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d6dbcd1697336d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.898+0000 7fc11bfff640 1 -- 172.21.15.103:0/2977670509 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c036070 con 0x7fc12406e910 2024-09-10T08:38:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.898+0000 7fc11bfff640 1 -- 172.21.15.103:0/2977670509 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc11c031600 con 0x7fc12406e910 2024-09-10T08:38:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.898+0000 7fc11bfff640 1 -- 172.21.15.103:0/2977670509 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c0319d0 con 0x7fc12406e910 2024-09-10T08:38:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.899+0000 7fc12b89b640 1 -- 172.21.15.103:0/2977670509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc12406e910 msgr2=0x7fc12415eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.899+0000 7fc12b89b640 1 --2- 172.21.15.103:0/2977670509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc12406e910 0x7fc12415eb60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009e50 tx=0x7fc11c02a6a0 comp rx=0 tx=0).stop 2024-09-10T08:38:26.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.900+0000 7fc12b89b640 1 -- 172.21.15.103:0/2977670509 shutdown_connections 2024-09-10T08:38:26.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.900+0000 7fc12b89b640 1 --2- 172.21.15.103:0/2977670509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc12406e910 0x7fc12415eb60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:26.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.900+0000 7fc12b89b640 1 --2- 172.21.15.103:0/2977670509 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1240aa870 0x7fc12406e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:26.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.900+0000 7fc12b89b640 1 -- 172.21.15.103:0/2977670509 >> 172.21.15.103:0/2977670509 conn(0x7fc1240c8430 msgr2=0x7fc1240c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:26.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.900+0000 7fc12b89b640 1 -- 172.21.15.103:0/2977670509 shutdown_connections 2024-09-10T08:38:26.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.900+0000 7fc12b89b640 1 -- 172.21.15.103:0/2977670509 wait complete. 2024-09-10T08:38:26.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.902+0000 7fc12b89b640 1 Processor -- start 2024-09-10T08:38:26.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.903+0000 7fc12b89b640 1 -- start start 2024-09-10T08:38:26.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.904+0000 7fc12b89b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc12406e910 0x7fc1241eab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:26.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.904+0000 7fc12b89b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1240aa870 0x7fc1240c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:26.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.904+0000 7fc129637640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc12406e910 msgr2=0x7fc1241eab90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:38:26.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.904+0000 7fc129637640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc12406e910 0x7fc1241eab90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:38:26.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.904+0000 7fc12b89b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc12414e720 0x7fc1241530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:26.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.904+0000 7fc12b89b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc124067fe0 con 0x7fc1240aa870 2024-09-10T08:38:26.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.904+0000 7fc12b89b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc124067e60 con 0x7fc12414e720 2024-09-10T08:38:26.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.904+0000 7fc12b89b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc1240aac90 con 0x7fc12406e910 2024-09-10T08:38:26.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.904+0000 7fc128e36640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1240aa870 0x7fc1240c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:26.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.904+0000 7fc128e36640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1240aa870 0x7fc1240c47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50570/0 (socket says 172.21.15.103:50570) 2024-09-10T08:38:26.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.904+0000 7fc128e36640 1 -- 172.21.15.103:0/1699964764 learned_addr learned my addr 172.21.15.103:0/1699964764 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:26.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.904+0000 7fc129e38640 1 --2- 172.21.15.103:0/1699964764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc12414e720 0x7fc1241530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:26.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.905+0000 7fc128e36640 1 -- 172.21.15.103:0/1699964764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc12406e910 msgr2=0x7fc1241eab90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:38:26.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.905+0000 7fc128e36640 1 --2- 172.21.15.103:0/1699964764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc12406e910 0x7fc1241eab90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:26.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.905+0000 7fc128e36640 1 -- 172.21.15.103:0/1699964764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc12414e720 msgr2=0x7fc1241530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:26.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.905+0000 7fc128e36640 1 --2- 172.21.15.103:0/1699964764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc12414e720 0x7fc1241530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:26.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.905+0000 7fc128e36640 1 -- 172.21.15.103:0/1699964764 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc124071610 con 0x7fc1240aa870 2024-09-10T08:38:26.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.905+0000 7fc128e36640 1 --2- 172.21.15.103:0/1699964764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1240aa870 0x7fc1240c47a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc11400b4e0 tx=0x7fc11400b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:26.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.905+0000 7fc119ffb640 1 -- 172.21.15.103:0/1699964764 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc114003db0 con 0x7fc1240aa870 2024-09-10T08:38:26.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.905+0000 7fc119ffb640 1 -- 172.21.15.103:0/1699964764 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc114015070 con 0x7fc1240aa870 2024-09-10T08:38:26.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.905+0000 7fc119ffb640 1 -- 172.21.15.103:0/1699964764 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1140052b0 con 0x7fc1240aa870 2024-09-10T08:38:26.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.905+0000 7fc12b89b640 1 -- 172.21.15.103:0/1699964764 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc124154d10 con 0x7fc1240aa870 2024-09-10T08:38:26.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.905+0000 7fc12b89b640 1 -- 172.21.15.103:0/1699964764 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1241ea0b0 con 0x7fc1240aa870 2024-09-10T08:38:26.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.908+0000 7fc119ffb640 1 -- 172.21.15.103:0/1699964764 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc114005450 con 0x7fc1240aa870 2024-09-10T08:38:26.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.908+0000 7fc12b89b640 1 -- 172.21.15.103:0/1699964764 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1240c7e30 con 0x7fc1240aa870 2024-09-10T08:38:26.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.908+0000 7fc119ffb640 1 --2- 172.21.15.103:0/1699964764 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc10806be30 0x7fc10806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:26.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.908+0000 7fc119ffb640 1 -- 172.21.15.103:0/1699964764 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fc11408ad70 con 0x7fc1240aa870 2024-09-10T08:38:26.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.908+0000 7fc129637640 1 --2- 172.21.15.103:0/1699964764 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc10806be30 0x7fc10806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:26.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.909+0000 7fc129637640 1 --2- 172.21.15.103:0/1699964764 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc10806be30 0x7fc10806e2f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc1241542c0 tx=0x7fc120007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:26.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:26.915+0000 7fc119ffb640 1 -- 172.21.15.103:0/1699964764 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc1240c7e30 con 0x7fc1240aa870 2024-09-10T08:38:27.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:27.372+0000 7fc12b89b640 1 -- 172.21.15.103:0/1699964764 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc1240c5cc0 con 0x7fc1240aa870 2024-09-10T08:38:27.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:27.372+0000 7fc119ffb640 1 -- 172.21.15.103:0/1699964764 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7fc1140594f0 con 0x7fc1240aa870 2024-09-10T08:38:27.374 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":78,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:38:27.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:27.376+0000 7fc12b89b640 1 -- 172.21.15.103:0/1699964764 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc10806be30 msgr2=0x7fc10806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:27.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:27.376+0000 7fc12b89b640 1 --2- 172.21.15.103:0/1699964764 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc10806be30 0x7fc10806e2f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc1241542c0 tx=0x7fc120007a40 comp rx=0 tx=0).stop 2024-09-10T08:38:27.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:27.376+0000 7fc12b89b640 1 -- 172.21.15.103:0/1699964764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1240aa870 msgr2=0x7fc1240c47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:27.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:27.376+0000 7fc12b89b640 1 --2- 172.21.15.103:0/1699964764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1240aa870 0x7fc1240c47a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc11400b4e0 tx=0x7fc11400b9a0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:27.376+0000 7fc12b89b640 1 -- 172.21.15.103:0/1699964764 shutdown_connections 2024-09-10T08:38:27.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:27.376+0000 7fc12b89b640 1 --2- 172.21.15.103:0/1699964764 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc10806be30 0x7fc10806e2f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:27.376+0000 7fc12b89b640 1 --2- 172.21.15.103:0/1699964764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc12414e720 0x7fc1241530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:27.376+0000 7fc12b89b640 1 --2- 172.21.15.103:0/1699964764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1240aa870 0x7fc1240c47a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:27.376+0000 7fc12b89b640 1 --2- 172.21.15.103:0/1699964764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc12406e910 0x7fc1241eab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:27.376+0000 7fc12b89b640 1 -- 172.21.15.103:0/1699964764 >> 172.21.15.103:0/1699964764 conn(0x7fc1240c8430 msgr2=0x7fc1240c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:27.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:27.377+0000 7fc12b89b640 1 -- 172.21.15.103:0/1699964764 shutdown_connections 2024-09-10T08:38:27.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:27.377+0000 7fc12b89b640 1 -- 172.21.15.103:0/1699964764 wait complete. 2024-09-10T08:38:30.397 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:38:30.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.553+0000 7ff5cf959640 1 Processor -- start 2024-09-10T08:38:30.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.554+0000 7ff5cf959640 1 -- start start 2024-09-10T08:38:30.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.555+0000 7ff5cf959640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 0x7ff5c81562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:30.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.555+0000 7ff5cf959640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 0x7ff5c814fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:30.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.555+0000 7ff5cf959640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5c80c53f0 con 0x7ff5c8152bc0 2024-09-10T08:38:30.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.555+0000 7ff5cf959640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7ff5c80c2d60 con 0x7ff5c814f820 2024-09-10T08:38:30.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.555+0000 7ff5cf959640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff5c80c3040 con 0x7ff5c80c7230 2024-09-10T08:38:30.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.555+0000 7ff5cd6f5640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 0x7ff5c81562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:30.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.555+0000 7ff5cdef6640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff5c8152bc0 0x7ff5c80c41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42846/0 (socket says 172.21.15.103:42846) 2024-09-10T08:38:30.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.555+0000 7ff5cd6f5640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 0x7ff5c81562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50580/0 (socket says 172.21.15.103:50580) 2024-09-10T08:38:30.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.555+0000 7ff5cdef6640 1 -- 172.21.15.103:0/3504293052 learned_addr learned my addr 172.21.15.103:0/3504293052 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:38:30.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.556+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 0x7ff5c814fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:30.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.556+0000 7ff5cd6f5640 1 -- 172.21.15.103:0/3504293052 >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 msgr2=0x7ff5c81562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:38:30.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.556+0000 7ff5cd6f5640 1 -- 172.21.15.103:0/3504293052 >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 msgr2=0x7ff5c81562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:30.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.556+0000 7ff5cd6f5640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 0x7ff5c81562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:30.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.556+0000 7ff5cd6f5640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 0x7ff5c81562d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:38:30.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.556+0000 7ff5ccef4640 1 -- 172.21.15.103:0/3504293052 >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 msgr2=0x7ff5c814fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:38:30.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.556+0000 7ff5ccef4640 1 -- 172.21.15.103:0/3504293052 >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 msgr2=0x7ff5c814fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:30.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.556+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 0x7ff5c814fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:30.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.556+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 0x7ff5c814fc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:38:30.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.757+0000 7ff5cd6f5640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 0x7ff5c81562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:30.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.757+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 0x7ff5c814fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:30.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.757+0000 7ff5cd6f5640 1 -- 172.21.15.103:0/3504293052 >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 msgr2=0x7ff5c81562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:38:30.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.757+0000 7ff5cd6f5640 1 -- 172.21.15.103:0/3504293052 >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 msgr2=0x7ff5c81562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:30.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.757+0000 7ff5cd6f5640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 0x7ff5c81562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:30.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.757+0000 7ff5cd6f5640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 0x7ff5c81562d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:38:30.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.757+0000 7ff5ccef4640 1 -- 172.21.15.103:0/3504293052 >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 msgr2=0x7ff5c814fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:38:30.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.757+0000 7ff5ccef4640 1 -- 172.21.15.103:0/3504293052 >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 msgr2=0x7ff5c814fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:30.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.757+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 0x7ff5c814fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:30.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:30.757+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 0x7ff5c814fc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:38:31.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:31.158+0000 7ff5cd6f5640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 0x7ff5c81562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:31.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:31.158+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 0x7ff5c814fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:31.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:31.158+0000 7ff5cd6f5640 1 -- 172.21.15.103:0/3504293052 >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 msgr2=0x7ff5c81562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:38:31.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:31.158+0000 7ff5cd6f5640 1 -- 172.21.15.103:0/3504293052 >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 msgr2=0x7ff5c81562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:31.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:31.158+0000 7ff5cd6f5640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 0x7ff5c81562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:31.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:31.158+0000 7ff5cd6f5640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 0x7ff5c81562d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:38:31.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:31.158+0000 7ff5ccef4640 1 -- 172.21.15.103:0/3504293052 >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 msgr2=0x7ff5c814fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:38:31.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:31.158+0000 7ff5ccef4640 1 -- 172.21.15.103:0/3504293052 >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 msgr2=0x7ff5c814fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:31.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:31.158+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 0x7ff5c814fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:31.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:31.158+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 0x7ff5c814fc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:38:31.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:31.959+0000 7ff5cd6f5640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 0x7ff5c81562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:31.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:31.960+0000 7ff5cd6f5640 1 -- 172.21.15.103:0/3504293052 >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 msgr2=0x7ff5c81562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:38:31.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:31.960+0000 7ff5cd6f5640 1 -- 172.21.15.103:0/3504293052 >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 msgr2=0x7ff5c81562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:31.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:31.960+0000 7ff5cd6f5640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 0x7ff5c81562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:31.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:31.960+0000 7ff5cd6f5640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 0x7ff5c81562d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:38:31.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:31.960+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 0x7ff5c814fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:31.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:31.961+0000 7ff5ccef4640 1 -- 172.21.15.103:0/3504293052 >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 msgr2=0x7ff5c814fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:38:31.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:31.961+0000 7ff5ccef4640 1 -- 172.21.15.103:0/3504293052 >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 msgr2=0x7ff5c814fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:31.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:31.961+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 0x7ff5c814fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:31.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:31.961+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 0x7ff5c814fc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:38:32.042 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:38:32.045 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:38:33.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:33.555+0000 7ff5beffd640 1 -- 172.21.15.103:0/3504293052 >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 msgr2=0x7ff5c814fc00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:38:33.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:33.555+0000 7ff5beffd640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.154:3300/0 conn(0x7ff5c80c7230 0x7ff5c814fc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:33.555+0000 7ff5beffd640 1 -- 172.21.15.103:0/3504293052 >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 msgr2=0x7ff5c81562d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:38:33.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:33.555+0000 7ff5beffd640 1 --2- 172.21.15.103:0/3504293052 >> v2:172.21.15.103:3300/0 conn(0x7ff5c814f820 0x7ff5c81562d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:33.555+0000 7ff5beffd640 1 -- 172.21.15.103:0/3504293052 >> v1:172.21.15.103:6789/0 conn(0x7ff5c8152bc0 legacy=0x7ff5c80c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:33.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:33.555+0000 7ff5beffd640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 0x7ff5ac009800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:33.555+0000 7ff5beffd640 1 -- 172.21.15.103:0/3504293052 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5c81526a0 con 0x7ff5ac003690 2024-09-10T08:38:33.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:33.555+0000 7ff5beffd640 1 -- 172.21.15.103:0/3504293052 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff5c80c2d60 con 0x7ff5ac007340 2024-09-10T08:38:33.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:33.556+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 0x7ff5ac009800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:33.556+0000 7ff5ccef4640 1 -- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 msgr2=0x7ff5ac009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:38:33.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:33.556+0000 7ff5ccef4640 1 -- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 msgr2=0x7ff5ac009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:33.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:33.556+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 0x7ff5ac009800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:33.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:33.556+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 0x7ff5ac009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:38:33.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:33.757+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 0x7ff5ac009800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:33.757+0000 7ff5ccef4640 1 -- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 msgr2=0x7ff5ac009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:38:33.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:33.757+0000 7ff5ccef4640 1 -- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 msgr2=0x7ff5ac009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:33.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:33.757+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 0x7ff5ac009800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:33.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:33.757+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 0x7ff5ac009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:38:34.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:34.158+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 0x7ff5ac009800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:34.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:34.158+0000 7ff5ccef4640 1 -- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 msgr2=0x7ff5ac009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:38:34.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:34.158+0000 7ff5ccef4640 1 -- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 msgr2=0x7ff5ac009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:34.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:34.158+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 0x7ff5ac009800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:34.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:34.158+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 0x7ff5ac009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:38:34.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:34.959+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 0x7ff5ac009800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:34.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:34.959+0000 7ff5ccef4640 1 -- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 msgr2=0x7ff5ac009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:38:34.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:34.959+0000 7ff5ccef4640 1 -- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 msgr2=0x7ff5ac009800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:38:34.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:34.959+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 0x7ff5ac009800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:34.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:34.959+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 0x7ff5ac009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:38:35.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.441+0000 7ff5bffff640 1 -- 172.21.15.103:0/3504293052 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3547989942 0 0) 0x7ff5c81526a0 con 0x7ff5ac003690 2024-09-10T08:38:35.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.441+0000 7ff5bffff640 1 -- 172.21.15.103:0/3504293052 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5b4003520 con 0x7ff5ac003690 2024-09-10T08:38:35.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.442+0000 7ff5bffff640 1 -- 172.21.15.103:0/3504293052 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3034331858 0 0) 0x7ff5b4003520 con 0x7ff5ac003690 2024-09-10T08:38:35.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.442+0000 7ff5bffff640 1 -- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 msgr2=0x7ff5ac009800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:38:35.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.442+0000 7ff5bffff640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5ac007340 0x7ff5ac009800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:35.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.442+0000 7ff5bffff640 1 -- 172.21.15.103:0/3504293052 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5ac00b030 con 0x7ff5ac003690 2024-09-10T08:38:35.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.442+0000 7ff5bffff640 1 -- 172.21.15.103:0/3504293052 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7ff5c400d580 con 0x7ff5ac003690 2024-09-10T08:38:35.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.442+0000 7ff5bffff640 1 -- 172.21.15.103:0/3504293052 >> v1:172.21.15.154:6789/0 conn(0x7ff5ac003690 legacy=0x7ff5ac005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:35.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.442+0000 7ff5cdef6640 1 -- 172.21.15.103:0/3504293052 reap_dead start 2024-09-10T08:38:35.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.442+0000 7ff5bffff640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5b40039b0 0x7ff5b4003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:35.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.442+0000 7ff5bffff640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b4004800 0x7ff5b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:35.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.442+0000 7ff5bffff640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5b4005290 0x7ff5b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:35.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.443+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b4004800 0x7ff5b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:35.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.443+0000 7ff5cd6f5640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5b40039b0 0x7ff5b4003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:35.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.443+0000 7ff5bffff640 1 -- 172.21.15.103:0/3504293052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c80c2d60 con 0x7ff5b4004800 2024-09-10T08:38:35.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.443+0000 7ff5bffff640 1 -- 172.21.15.103:0/3504293052 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b400c1e0 con 0x7ff5b4005290 2024-09-10T08:38:35.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.443+0000 7ff5bffff640 1 -- 172.21.15.103:0/3504293052 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff5b400c3e0 con 0x7ff5b40039b0 2024-09-10T08:38:35.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.443+0000 7ff5cdef6640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5b4005290 0x7ff5b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:35.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.443+0000 7ff5ccef4640 1 -- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5b40039b0 msgr2=0x7ff5b4003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:35.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.443+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5b40039b0 0x7ff5b4003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:35.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.443+0000 7ff5ccef4640 1 -- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5b4005290 msgr2=0x7ff5b400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:35.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.443+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5b4005290 0x7ff5b400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:35.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.443+0000 7ff5ccef4640 1 -- 172.21.15.103:0/3504293052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b4003520 con 0x7ff5b4004800 2024-09-10T08:38:35.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.444+0000 7ff5cdef6640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5b4005290 0x7ff5b400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:35.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.445+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b4004800 0x7ff5b4004c80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8014ab0 tx=0x7ff5b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281f18410266f23e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:35.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.449+0000 7ff5bffff640 1 -- 172.21.15.103:0/3504293052 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8038070 con 0x7ff5b4004800 2024-09-10T08:38:35.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.449+0000 7ff5bffff640 1 -- 172.21.15.103:0/3504293052 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b8033620 con 0x7ff5b4004800 2024-09-10T08:38:35.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.449+0000 7ff5bffff640 1 -- 172.21.15.103:0/3504293052 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b800f040 con 0x7ff5b4004800 2024-09-10T08:38:35.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.450+0000 7ff5cf959640 1 -- 172.21.15.103:0/3504293052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b4004800 msgr2=0x7ff5b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:35.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.450+0000 7ff5cf959640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b4004800 0x7ff5b4004c80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8014ab0 tx=0x7ff5b4005830 comp rx=0 tx=0).stop 2024-09-10T08:38:35.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.450+0000 7ff5cf959640 1 -- 172.21.15.103:0/3504293052 shutdown_connections 2024-09-10T08:38:35.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.450+0000 7ff5cf959640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5b4005290 0x7ff5b400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:35.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.450+0000 7ff5cf959640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b4004800 0x7ff5b4004c80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:35.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.450+0000 7ff5cf959640 1 --2- 172.21.15.103:0/3504293052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5b40039b0 0x7ff5b4003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:35.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.450+0000 7ff5cf959640 1 -- 172.21.15.103:0/3504293052 >> 172.21.15.103:0/3504293052 conn(0x7ff5c80c7a40 msgr2=0x7ff5c80c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:35.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.450+0000 7ff5cf959640 1 -- 172.21.15.103:0/3504293052 shutdown_connections 2024-09-10T08:38:35.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.450+0000 7ff5cf959640 1 -- 172.21.15.103:0/3504293052 wait complete. 2024-09-10T08:38:35.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.452+0000 7ff5cf959640 1 Processor -- start 2024-09-10T08:38:35.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.452+0000 7ff5cf959640 1 -- start start 2024-09-10T08:38:35.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.453+0000 7ff5cf959640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b40039b0 0x7ff5c814dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:35.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.453+0000 7ff5cf959640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5b4004800 0x7ff5c8072200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:35.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.453+0000 7ff5cf959640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5b4005290 0x7ff5c81efc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:35.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.453+0000 7ff5cf959640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c80c5d70 con 0x7ff5b40039b0 2024-09-10T08:38:35.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.453+0000 7ff5cf959640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c80c5bf0 con 0x7ff5b4004800 2024-09-10T08:38:35.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.453+0000 7ff5cf959640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff5c806edd0 con 0x7ff5b4005290 2024-09-10T08:38:35.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.453+0000 7ff5cd6f5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b40039b0 0x7ff5c814dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:35.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.453+0000 7ff5cd6f5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b40039b0 0x7ff5c814dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51562/0 (socket says 172.21.15.103:51562) 2024-09-10T08:38:35.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.453+0000 7ff5cd6f5640 1 -- 172.21.15.103:0/190362395 learned_addr learned my addr 172.21.15.103:0/190362395 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:35.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.454+0000 7ff5cdef6640 1 --2- 172.21.15.103:0/190362395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5b4005290 0x7ff5c81efc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:35.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.454+0000 7ff5cdef6640 1 -- 172.21.15.103:0/190362395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5b4005290 msgr2=0x7ff5c81efc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-10T08:38:35.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.454+0000 7ff5cdef6640 1 -- 172.21.15.103:0/190362395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5b4005290 msgr2=0x7ff5c81efc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:38:35.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.454+0000 7ff5cdef6640 1 --2- 172.21.15.103:0/190362395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5b4005290 0x7ff5c81efc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:38:35.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.454+0000 7ff5cdef6640 1 --2- 172.21.15.103:0/190362395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5b4005290 0x7ff5c81efc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:38:35.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.454+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/190362395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5b4004800 0x7ff5c8072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:35.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.454+0000 7ff5cd6f5640 1 -- 172.21.15.103:0/190362395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5b4005290 msgr2=0x7ff5c81efc60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:38:35.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.454+0000 7ff5cd6f5640 1 --2- 172.21.15.103:0/190362395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5b4005290 0x7ff5c81efc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:35.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.454+0000 7ff5cd6f5640 1 -- 172.21.15.103:0/190362395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5b4004800 msgr2=0x7ff5c8072200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:35.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.454+0000 7ff5cd6f5640 1 --2- 172.21.15.103:0/190362395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5b4004800 0x7ff5c8072200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:35.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.454+0000 7ff5cd6f5640 1 -- 172.21.15.103:0/190362395 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5c8074150 con 0x7ff5b40039b0 2024-09-10T08:38:35.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.454+0000 7ff5cd6f5640 1 --2- 172.21.15.103:0/190362395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b40039b0 0x7ff5c814dea0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4006e80 tx=0x7ff5c4015e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:35.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.455+0000 7ff5bdffb640 1 -- 172.21.15.103:0/190362395 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4013a70 con 0x7ff5b40039b0 2024-09-10T08:38:35.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.455+0000 7ff5bdffb640 1 -- 172.21.15.103:0/190362395 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c4013c10 con 0x7ff5b40039b0 2024-09-10T08:38:35.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.455+0000 7ff5bdffb640 1 -- 172.21.15.103:0/190362395 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4017440 con 0x7ff5b40039b0 2024-09-10T08:38:35.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.455+0000 7ff5cf959640 1 -- 172.21.15.103:0/190362395 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5c814e3e0 con 0x7ff5b40039b0 2024-09-10T08:38:35.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.456+0000 7ff5cf959640 1 -- 172.21.15.103:0/190362395 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5c80743f0 con 0x7ff5b40039b0 2024-09-10T08:38:35.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.457+0000 7ff5bdffb640 1 -- 172.21.15.103:0/190362395 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff5c401f020 con 0x7ff5b40039b0 2024-09-10T08:38:35.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.458+0000 7ff5bdffb640 1 --2- 172.21.15.103:0/190362395 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff5ac06c610 0x7ff5ac06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:35.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.458+0000 7ff5bdffb640 1 -- 172.21.15.103:0/190362395 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7ff5c408be30 con 0x7ff5b40039b0 2024-09-10T08:38:35.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.458+0000 7ff5cf959640 1 -- 172.21.15.103:0/190362395 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5c80c3420 con 0x7ff5b40039b0 2024-09-10T08:38:35.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.459+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/190362395 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff5ac06c610 0x7ff5ac06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:35.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.462+0000 7ff5ccef4640 1 --2- 172.21.15.103:0/190362395 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff5ac06c610 0x7ff5ac06ead0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8035000 tx=0x7ff5b8016030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:35.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.467+0000 7ff5bdffb640 1 -- 172.21.15.103:0/190362395 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff5c80c3420 con 0x7ff5b40039b0 2024-09-10T08:38:35.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.920+0000 7ff5cf959640 1 -- 172.21.15.103:0/190362395 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff5c8152fd0 con 0x7ff5b40039b0 2024-09-10T08:38:35.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.920+0000 7ff5bdffb640 1 -- 172.21.15.103:0/190362395 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7ff5c405a4b0 con 0x7ff5b40039b0 2024-09-10T08:38:35.920 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":82,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:38:35.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.924+0000 7ff5cf959640 1 -- 172.21.15.103:0/190362395 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff5ac06c610 msgr2=0x7ff5ac06ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:35.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.924+0000 7ff5cf959640 1 --2- 172.21.15.103:0/190362395 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff5ac06c610 0x7ff5ac06ead0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8035000 tx=0x7ff5b8016030 comp rx=0 tx=0).stop 2024-09-10T08:38:35.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.924+0000 7ff5cf959640 1 -- 172.21.15.103:0/190362395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b40039b0 msgr2=0x7ff5c814dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:35.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.924+0000 7ff5cf959640 1 --2- 172.21.15.103:0/190362395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b40039b0 0x7ff5c814dea0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4006e80 tx=0x7ff5c4015e10 comp rx=0 tx=0).stop 2024-09-10T08:38:35.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.924+0000 7ff5cf959640 1 -- 172.21.15.103:0/190362395 shutdown_connections 2024-09-10T08:38:35.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.924+0000 7ff5cf959640 1 --2- 172.21.15.103:0/190362395 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff5ac06c610 0x7ff5ac06ead0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:35.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.924+0000 7ff5cf959640 1 --2- 172.21.15.103:0/190362395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5b4005290 0x7ff5c81efc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:35.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.924+0000 7ff5cf959640 1 --2- 172.21.15.103:0/190362395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5b4004800 0x7ff5c8072200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:35.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.924+0000 7ff5cf959640 1 --2- 172.21.15.103:0/190362395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5b40039b0 0x7ff5c814dea0 secure :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4006e80 tx=0x7ff5c4015e10 comp rx=0 tx=0).stop 2024-09-10T08:38:35.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.924+0000 7ff5cf959640 1 -- 172.21.15.103:0/190362395 >> 172.21.15.103:0/190362395 conn(0x7ff5c80c7a40 msgr2=0x7ff5c80c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:35.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.925+0000 7ff5cf959640 1 -- 172.21.15.103:0/190362395 shutdown_connections 2024-09-10T08:38:35.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:35.925+0000 7ff5cf959640 1 -- 172.21.15.103:0/190362395 wait complete. 2024-09-10T08:38:38.945 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:38:39.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.107+0000 7f4abf5b9640 1 Processor -- start 2024-09-10T08:38:39.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.107+0000 7f4abf5b9640 1 -- start start 2024-09-10T08:38:39.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.109+0000 7f4abf5b9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ab80c4c40 0x7f4ab806ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:39.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.109+0000 7f4abf5b9640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ab815a580 con 0x7f4ab80c56e0 2024-09-10T08:38:39.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.109+0000 7f4abf5b9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ab806e5f0 con 0x7f4ab80708f0 2024-09-10T08:38:39.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.109+0000 7f4abf5b9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4ab8159700 con 0x7f4ab80c4c40 2024-09-10T08:38:39.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.109+0000 7f4abd355640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4ab80c56e0 0x7f4ab8159e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:54712/0 (socket says 172.21.15.103:54712) 2024-09-10T08:38:39.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.109+0000 7f4abd355640 1 -- 172.21.15.103:0/2597385562 learned_addr learned my addr 172.21.15.103:0/2597385562 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:38:39.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.109+0000 7f4abdb56640 1 --2- 172.21.15.103:0/2597385562 >> v2:172.21.15.154:3300/0 conn(0x7f4ab80c4c40 0x7f4ab806ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:39.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.110+0000 7f4aaffff640 1 -- 172.21.15.103:0/2597385562 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 668982844 0 0) 0x7f4ab815a580 con 0x7f4ab80c56e0 2024-09-10T08:38:39.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.110+0000 7f4aaffff640 1 -- 172.21.15.103:0/2597385562 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4aa4003520 con 0x7f4ab80c56e0 2024-09-10T08:38:39.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.110+0000 7f4aaffff640 1 -- 172.21.15.103:0/2597385562 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3162294497 0 0) 0x7f4aa4003520 con 0x7f4ab80c56e0 2024-09-10T08:38:39.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.110+0000 7f4aaffff640 1 -- 172.21.15.103:0/2597385562 >> v2:172.21.15.154:3300/0 conn(0x7f4ab80c4c40 msgr2=0x7f4ab806ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:39.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.110+0000 7f4aaffff640 1 --2- 172.21.15.103:0/2597385562 >> v2:172.21.15.154:3300/0 conn(0x7f4ab80c4c40 0x7f4ab806ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.110+0000 7f4aaffff640 1 -- 172.21.15.103:0/2597385562 >> v1:172.21.15.154:6789/0 conn(0x7f4ab80708f0 legacy=0x7f4ab8153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:39.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.110+0000 7f4aaffff640 1 -- 172.21.15.103:0/2597385562 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab80702c0 con 0x7f4ab80c56e0 2024-09-10T08:38:39.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.110+0000 7f4aaffff640 1 -- 172.21.15.103:0/2597385562 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f4ab4001670 con 0x7f4ab80c56e0 2024-09-10T08:38:39.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.110+0000 7f4aaffff640 1 -- 172.21.15.103:0/2597385562 >> v1:172.21.15.103:6789/0 conn(0x7f4ab80c56e0 legacy=0x7f4ab8159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:39.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.110+0000 7f4aaffff640 1 --2- 172.21.15.103:0/2597385562 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4aa40039b0 0x7f4aa4003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:39.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.110+0000 7f4aaffff640 1 --2- 172.21.15.103:0/2597385562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aa4004800 0x7f4aa4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:39.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.110+0000 7f4aaffff640 1 --2- 172.21.15.103:0/2597385562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aa4005230 0x7f4aa400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:39.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.110+0000 7f4aaffff640 1 -- 172.21.15.103:0/2597385562 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab8159700 con 0x7f4aa4005230 2024-09-10T08:38:39.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.110+0000 7f4aaffff640 1 -- 172.21.15.103:0/2597385562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa400c190 con 0x7f4aa4004800 2024-09-10T08:38:39.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.110+0000 7f4aaffff640 1 -- 172.21.15.103:0/2597385562 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4aa400c390 con 0x7f4aa40039b0 2024-09-10T08:38:39.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.111+0000 7f4abdb56640 1 --2- 172.21.15.103:0/2597385562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aa4005230 0x7f4aa400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:39.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.111+0000 7f4abcb54640 1 --2- 172.21.15.103:0/2597385562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aa4004800 0x7f4aa4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:39.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.111+0000 7f4abd355640 1 --2- 172.21.15.103:0/2597385562 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4aa40039b0 0x7f4aa4003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:39.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.111+0000 7f4abcb54640 1 -- 172.21.15.103:0/2597385562 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4aa40039b0 msgr2=0x7f4aa4003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:39.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.111+0000 7f4abcb54640 1 --2- 172.21.15.103:0/2597385562 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4aa40039b0 0x7f4aa4003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.111+0000 7f4abcb54640 1 -- 172.21.15.103:0/2597385562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aa4005230 msgr2=0x7f4aa400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:39.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.111+0000 7f4abcb54640 1 --2- 172.21.15.103:0/2597385562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aa4005230 0x7f4aa400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.111+0000 7f4abcb54640 1 -- 172.21.15.103:0/2597385562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab80702c0 con 0x7f4aa4004800 2024-09-10T08:38:39.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.111+0000 7f4abdb56640 1 -- 172.21.15.103:0/2597385562 reap_dead start 2024-09-10T08:38:39.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.112+0000 7f4abcb54640 1 --2- 172.21.15.103:0/2597385562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aa4004800 0x7f4aa4004c80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8003db0 tx=0x7f4aa4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80bcd88ed969d449 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:39.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.113+0000 7f4aaffff640 1 -- 172.21.15.103:0/2597385562 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8037070 con 0x7f4aa4004800 2024-09-10T08:38:39.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.113+0000 7f4aaffff640 1 -- 172.21.15.103:0/2597385562 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aa802a9e0 con 0x7f4aa4004800 2024-09-10T08:38:39.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.113+0000 7f4aaffff640 1 -- 172.21.15.103:0/2597385562 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8003980 con 0x7f4aa4004800 2024-09-10T08:38:39.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.114+0000 7f4abf5b9640 1 -- 172.21.15.103:0/2597385562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aa4004800 msgr2=0x7f4aa4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:39.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.114+0000 7f4abf5b9640 1 --2- 172.21.15.103:0/2597385562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aa4004800 0x7f4aa4004c80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8003db0 tx=0x7f4aa4005830 comp rx=0 tx=0).stop 2024-09-10T08:38:39.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.114+0000 7f4abf5b9640 1 -- 172.21.15.103:0/2597385562 shutdown_connections 2024-09-10T08:38:39.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.114+0000 7f4abf5b9640 1 --2- 172.21.15.103:0/2597385562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aa4004800 0x7f4aa4004c80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.114+0000 7f4abf5b9640 1 -- 172.21.15.103:0/2597385562 >> 172.21.15.103:0/2597385562 conn(0x7f4ab80c9d80 msgr2=0x7f4ab80ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:39.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.115+0000 7f4abf5b9640 1 -- 172.21.15.103:0/2597385562 shutdown_connections 2024-09-10T08:38:39.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.115+0000 7f4abf5b9640 1 -- 172.21.15.103:0/2597385562 wait complete. 2024-09-10T08:38:39.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.117+0000 7f4abf5b9640 1 Processor -- start 2024-09-10T08:38:39.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.117+0000 7f4abf5b9640 1 -- start start 2024-09-10T08:38:39.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.118+0000 7f4abf5b9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aa4004800 0x7f4ab8159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:39.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.118+0000 7f4abf5b9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ab80abe50 0x7f4ab80af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:39.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.118+0000 7f4abf5b9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ab814ee20 0x7f4ab81f0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:39.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.118+0000 7f4abf5b9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab806e2f0 con 0x7f4ab814ee20 2024-09-10T08:38:39.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.118+0000 7f4abf5b9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab8159950 con 0x7f4aa4004800 2024-09-10T08:38:39.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.118+0000 7f4abf5b9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4ab80c5ac0 con 0x7f4ab80abe50 2024-09-10T08:38:39.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.118+0000 7f4abdb56640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ab814ee20 0x7f4ab81f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:39.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.118+0000 7f4abdb56640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ab814ee20 0x7f4ab81f0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51584/0 (socket says 172.21.15.103:51584) 2024-09-10T08:38:39.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.118+0000 7f4abdb56640 1 -- 172.21.15.103:0/1993996142 learned_addr learned my addr 172.21.15.103:0/1993996142 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:39.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.118+0000 7f4abd355640 1 --2- 172.21.15.103:0/1993996142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aa4004800 0x7f4ab8159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:39.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.119+0000 7f4abdb56640 1 -- 172.21.15.103:0/1993996142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ab80abe50 msgr2=0x7f4ab80af420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:39.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.119+0000 7f4abcb54640 1 --2- 172.21.15.103:0/1993996142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ab80abe50 0x7f4ab80af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:39.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.119+0000 7f4abdb56640 1 --2- 172.21.15.103:0/1993996142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ab80abe50 0x7f4ab80af420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.119+0000 7f4abdb56640 1 -- 172.21.15.103:0/1993996142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aa4004800 msgr2=0x7f4ab8159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:39.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.119+0000 7f4abdb56640 1 --2- 172.21.15.103:0/1993996142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aa4004800 0x7f4ab8159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.119+0000 7f4abdb56640 1 -- 172.21.15.103:0/1993996142 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab80ab7b0 con 0x7f4ab814ee20 2024-09-10T08:38:39.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.119+0000 7f4abcb54640 1 --2- 172.21.15.103:0/1993996142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ab80abe50 0x7f4ab80af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:39.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.119+0000 7f4abd355640 1 --2- 172.21.15.103:0/1993996142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aa4004800 0x7f4ab8159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:39.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.119+0000 7f4abdb56640 1 --2- 172.21.15.103:0/1993996142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ab814ee20 0x7f4ab81f0120 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8076750 tx=0x7f4ab000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:39.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.120+0000 7f4aadffb640 1 -- 172.21.15.103:0/1993996142 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab000fd80 con 0x7f4ab814ee20 2024-09-10T08:38:39.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.120+0000 7f4aadffb640 1 -- 172.21.15.103:0/1993996142 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab001c070 con 0x7f4ab814ee20 2024-09-10T08:38:39.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.120+0000 7f4aadffb640 1 -- 172.21.15.103:0/1993996142 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0003bd0 con 0x7f4ab814ee20 2024-09-10T08:38:39.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.120+0000 7f4abf5b9640 1 -- 172.21.15.103:0/1993996142 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ab8156cb0 con 0x7f4ab814ee20 2024-09-10T08:38:39.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.120+0000 7f4abf5b9640 1 -- 172.21.15.103:0/1993996142 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ab81f3a60 con 0x7f4ab814ee20 2024-09-10T08:38:39.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.123+0000 7f4abf5b9640 1 -- 172.21.15.103:0/1993996142 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ab806ebe0 con 0x7f4ab814ee20 2024-09-10T08:38:39.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.123+0000 7f4aadffb640 1 -- 172.21.15.103:0/1993996142 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ab0004030 con 0x7f4ab814ee20 2024-09-10T08:38:39.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.124+0000 7f4aadffb640 1 --2- 172.21.15.103:0/1993996142 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4a9c06beb0 0x7f4a9c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:39.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.124+0000 7f4aadffb640 1 -- 172.21.15.103:0/1993996142 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f4ab008bb10 con 0x7f4ab814ee20 2024-09-10T08:38:39.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.124+0000 7f4abd355640 1 --2- 172.21.15.103:0/1993996142 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4a9c06beb0 0x7f4a9c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:39.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.125+0000 7f4abd355640 1 --2- 172.21.15.103:0/1993996142 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4a9c06beb0 0x7f4a9c06e370 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4001ce0 tx=0x7f4ab4007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:39.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.131+0000 7f4aadffb640 1 -- 172.21.15.103:0/1993996142 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ab0010040 con 0x7f4ab814ee20 2024-09-10T08:38:39.594 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":84,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:38:39.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.592+0000 7f4abf5b9640 1 -- 172.21.15.103:0/1993996142 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4ab80c4220 con 0x7f4ab814ee20 2024-09-10T08:38:39.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.593+0000 7f4aadffb640 1 -- 172.21.15.103:0/1993996142 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f4ab005a100 con 0x7f4ab814ee20 2024-09-10T08:38:39.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.597+0000 7f4abf5b9640 1 -- 172.21.15.103:0/1993996142 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4a9c06beb0 msgr2=0x7f4a9c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:39.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.597+0000 7f4abf5b9640 1 --2- 172.21.15.103:0/1993996142 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4a9c06beb0 0x7f4a9c06e370 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4001ce0 tx=0x7f4ab4007040 comp rx=0 tx=0).stop 2024-09-10T08:38:39.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.597+0000 7f4abf5b9640 1 -- 172.21.15.103:0/1993996142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ab814ee20 msgr2=0x7f4ab81f0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:39.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.597+0000 7f4abf5b9640 1 --2- 172.21.15.103:0/1993996142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ab814ee20 0x7f4ab81f0120 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8076750 tx=0x7f4ab000f580 comp rx=0 tx=0).stop 2024-09-10T08:38:39.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.597+0000 7f4abf5b9640 1 -- 172.21.15.103:0/1993996142 shutdown_connections 2024-09-10T08:38:39.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.597+0000 7f4abf5b9640 1 --2- 172.21.15.103:0/1993996142 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4a9c06beb0 0x7f4a9c06e370 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.597+0000 7f4abf5b9640 1 --2- 172.21.15.103:0/1993996142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ab814ee20 0x7f4ab81f0120 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.597+0000 7f4abf5b9640 1 --2- 172.21.15.103:0/1993996142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ab80abe50 0x7f4ab80af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.597+0000 7f4abf5b9640 1 --2- 172.21.15.103:0/1993996142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aa4004800 0x7f4ab8159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.597+0000 7f4abf5b9640 1 -- 172.21.15.103:0/1993996142 >> 172.21.15.103:0/1993996142 conn(0x7f4ab80c9d80 msgr2=0x7f4ab80ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:39.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.597+0000 7f4abf5b9640 1 -- 172.21.15.103:0/1993996142 shutdown_connections 2024-09-10T08:38:39.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.598+0000 7f4abf5b9640 1 -- 172.21.15.103:0/1993996142 wait complete. 2024-09-10T08:38:39.614 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:38:39.614 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:38:39.614 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:38:39.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.782+0000 7fcafc8ae640 1 Processor -- start 2024-09-10T08:38:39.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.782+0000 7fcafc8ae640 1 -- start start 2024-09-10T08:38:39.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.783+0000 7fcafc8ae640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcaf80a6c10 0x7fcaf80c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:39.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.783+0000 7fcafc8ae640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcaf80c6010 0x7fcaf806dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:39.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.783+0000 7fcafc8ae640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcaf80c5940 0x7fcaf806dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:39.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.783+0000 7fcafc8ae640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fcaf815a970 con 0x7fcaf80a6c10 2024-09-10T08:38:39.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.783+0000 7fcafc8ae640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fcaf815ac50 con 0x7fcaf80c6010 2024-09-10T08:38:39.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.783+0000 7fcafc8ae640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcaf815af30 con 0x7fcaf80c5940 2024-09-10T08:38:39.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.783+0000 7fcaf659c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcaf80a6c10 0x7fcaf80c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:39.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.783+0000 7fcaf659c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcaf80a6c10 0x7fcaf80c2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51586/0 (socket says 172.21.15.103:51586) 2024-09-10T08:38:39.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.783+0000 7fcaf659c640 1 -- 172.21.15.103:0/2274260146 learned_addr learned my addr 172.21.15.103:0/2274260146 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:39.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.783+0000 7fcaf6d9d640 1 --2- 172.21.15.103:0/2274260146 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcaf80c5940 0x7fcaf806dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:39.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.784+0000 7fcaf659c640 1 -- 172.21.15.103:0/2274260146 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcaf80c5940 msgr2=0x7fcaf806dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:39.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.784+0000 7fcaf659c640 1 --2- 172.21.15.103:0/2274260146 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcaf80c5940 0x7fcaf806dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.784+0000 7fcaf659c640 1 -- 172.21.15.103:0/2274260146 >> v2:172.21.15.154:3300/0 conn(0x7fcaf80c6010 msgr2=0x7fcaf806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:39.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.784+0000 7fcaf659c640 1 --2- 172.21.15.103:0/2274260146 >> v2:172.21.15.154:3300/0 conn(0x7fcaf80c6010 0x7fcaf806dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.784+0000 7fcaf659c640 1 -- 172.21.15.103:0/2274260146 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf815b210 con 0x7fcaf80a6c10 2024-09-10T08:38:39.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.785+0000 7fcaf659c640 1 --2- 172.21.15.103:0/2274260146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf80a6c10 0x7fcaf80c2440 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80709e0 tx=0x7fcae802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a502f7dc3ade4a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:39.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.785+0000 7fcaf559a640 1 -- 172.21.15.103:0/2274260146 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae8037070 con 0x7fcaf80a6c10 2024-09-10T08:38:39.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.785+0000 7fcaf559a640 1 -- 172.21.15.103:0/2274260146 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcae8032440 con 0x7fcaf80a6c10 2024-09-10T08:38:39.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.785+0000 7fcaf559a640 1 -- 172.21.15.103:0/2274260146 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae8032810 con 0x7fcaf80a6c10 2024-09-10T08:38:39.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.786+0000 7fcafc8ae640 1 -- 172.21.15.103:0/2274260146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf80a6c10 msgr2=0x7fcaf80c2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:39.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.786+0000 7fcafc8ae640 1 --2- 172.21.15.103:0/2274260146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf80a6c10 0x7fcaf80c2440 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80709e0 tx=0x7fcae802a140 comp rx=0 tx=0).stop 2024-09-10T08:38:39.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.786+0000 7fcafc8ae640 1 -- 172.21.15.103:0/2274260146 shutdown_connections 2024-09-10T08:38:39.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.786+0000 7fcafc8ae640 1 --2- 172.21.15.103:0/2274260146 >> v2:172.21.15.154:3300/0 conn(0x7fcaf80c6010 0x7fcaf806dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.786+0000 7fcafc8ae640 1 --2- 172.21.15.103:0/2274260146 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcaf80c5940 0x7fcaf806dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.786+0000 7fcafc8ae640 1 --2- 172.21.15.103:0/2274260146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf80a6c10 0x7fcaf80c2440 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.786+0000 7fcafc8ae640 1 -- 172.21.15.103:0/2274260146 >> 172.21.15.103:0/2274260146 conn(0x7fcaf80c7a40 msgr2=0x7fcaf80c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:39.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.787+0000 7fcafc8ae640 1 -- 172.21.15.103:0/2274260146 shutdown_connections 2024-09-10T08:38:39.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.787+0000 7fcafc8ae640 1 -- 172.21.15.103:0/2274260146 wait complete. 2024-09-10T08:38:39.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.789+0000 7fcafc8ae640 1 Processor -- start 2024-09-10T08:38:39.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.789+0000 7fcafc8ae640 1 -- start start 2024-09-10T08:38:39.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.790+0000 7fcafc8ae640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaf80a6c10 0x7fcaf80ac780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:39.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.790+0000 7fcafc8ae640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcaf80c5940 0x7fcaf80aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:39.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.790+0000 7fcafc8ae640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf80c6010 0x7fcaf814d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:39.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.790+0000 7fcafc8ae640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf80a7520 con 0x7fcaf80c6010 2024-09-10T08:38:39.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.790+0000 7fcafc8ae640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf80a73a0 con 0x7fcaf80a6c10 2024-09-10T08:38:39.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.790+0000 7fcafc8ae640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcaf806e530 con 0x7fcaf80c5940 2024-09-10T08:38:39.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.790+0000 7fcaf659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaf80a6c10 0x7fcaf80ac780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:39.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.790+0000 7fcaf5d9b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcaf80c5940 0x7fcaf80aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:39.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.790+0000 7fcaf659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaf80a6c10 0x7fcaf80ac780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:54694/0 (socket says 172.21.15.103:54694) 2024-09-10T08:38:39.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.790+0000 7fcaf659c640 1 -- 172.21.15.103:0/1755782820 learned_addr learned my addr 172.21.15.103:0/1755782820 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:39.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.790+0000 7fcaf6d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf80c6010 0x7fcaf814d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:39.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.791+0000 7fcaf6d9d640 1 -- 172.21.15.103:0/1755782820 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcaf80c5940 msgr2=0x7fcaf80aa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:39.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.791+0000 7fcaf6d9d640 1 --2- 172.21.15.103:0/1755782820 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcaf80c5940 0x7fcaf80aa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.791+0000 7fcaf6d9d640 1 -- 172.21.15.103:0/1755782820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaf80a6c10 msgr2=0x7fcaf80ac780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:39.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.791+0000 7fcaf6d9d640 1 --2- 172.21.15.103:0/1755782820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcaf80a6c10 0x7fcaf80ac780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.791+0000 7fcaf6d9d640 1 -- 172.21.15.103:0/1755782820 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf80acfc0 con 0x7fcaf80c6010 2024-09-10T08:38:39.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.791+0000 7fcaf6d9d640 1 --2- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf80c6010 0x7fcaf814d450 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000efc0 tx=0x7fcaf000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:39.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.792+0000 7fcae6ffd640 1 -- 172.21.15.103:0/1755782820 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0018020 con 0x7fcaf80c6010 2024-09-10T08:38:39.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.792+0000 7fcae6ffd640 1 -- 172.21.15.103:0/1755782820 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf0014480 con 0x7fcaf80c6010 2024-09-10T08:38:39.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.792+0000 7fcae6ffd640 1 -- 172.21.15.103:0/1755782820 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0014870 con 0x7fcaf80c6010 2024-09-10T08:38:39.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.792+0000 7fcafc8ae640 1 -- 172.21.15.103:0/1755782820 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf814e0f0 con 0x7fcaf80c6010 2024-09-10T08:38:39.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.792+0000 7fcafc8ae640 1 -- 172.21.15.103:0/1755782820 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf8150a40 con 0x7fcaf80c6010 2024-09-10T08:38:39.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.794+0000 7fcafc8ae640 1 --2- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf814d990 0x7fcaf81f3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:39.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.794+0000 7fcafc8ae640 1 -- 172.21.15.103:0/1755782820 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf80ac0c0 con 0x7fcaf814d990 2024-09-10T08:38:39.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.794+0000 7fcae6ffd640 1 -- 172.21.15.103:0/1755782820 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcaf001b020 con 0x7fcaf80c6010 2024-09-10T08:38:39.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.794+0000 7fcaf659c640 1 --2- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf814d990 0x7fcaf81f3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:39.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.795+0000 7fcae6ffd640 1 --2- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcad806be80 0x7fcad806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:39.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.795+0000 7fcae6ffd640 1 -- 172.21.15.103:0/1755782820 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fcaf008be50 con 0x7fcaf80c6010 2024-09-10T08:38:39.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.796+0000 7fcaf5d9b640 1 --2- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcad806be80 0x7fcad806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:39.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.797+0000 7fcaf659c640 1 -- 172.21.15.103:0/1755782820 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcaf80c8b30 con 0x7fcaf814d990 2024-09-10T08:38:39.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.797+0000 7fcaf659c640 1 --2- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf814d990 0x7fcaf81f3630 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcae80090b0 tx=0x7fcae80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:39.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.798+0000 7fcaf5d9b640 1 --2- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcad806be80 0x7fcad806e340 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80c4e70 tx=0x7fcaec009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:39.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.798+0000 7fcae6ffd640 1 -- 172.21.15.103:0/1755782820 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae8043070 con 0x7fcaf814d990 2024-09-10T08:38:39.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.798+0000 7fcae6ffd640 1 -- 172.21.15.103:0/1755782820 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fcae8009490 con 0x7fcaf814d990 2024-09-10T08:38:39.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.798+0000 7fcae6ffd640 1 -- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf814d990 msgr2=0x7fcaf81f3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:39.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.798+0000 7fcae6ffd640 1 --2- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf814d990 0x7fcaf81f3630 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcae80090b0 tx=0x7fcae80046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.798+0000 7fcae6ffd640 1 -- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf814d990 msgr2=0x7fcaf81f3630 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:38:39.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.798+0000 7fcae6ffd640 1 --2- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf814d990 0x7fcaf81f3630 secure :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcae80090b0 tx=0x7fcae80046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.808+0000 7fcafc8ae640 1 --2- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf81f3b70 0x7fcaf81f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:39.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.808+0000 7fcafc8ae640 1 -- 172.21.15.103:0/1755782820 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf81f4490 con 0x7fcaf81f3b70 2024-09-10T08:38:39.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.809+0000 7fcaf659c640 1 --2- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf81f3b70 0x7fcaf81f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:39.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.809+0000 7fcaf659c640 1 -- 172.21.15.103:0/1755782820 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcaf814e2c0 con 0x7fcaf81f3b70 2024-09-10T08:38:39.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.810+0000 7fcaf659c640 1 --2- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf81f3b70 0x7fcaf81f3f50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcaf806da60 tx=0x7fcae802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:39.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.810+0000 7fcae6ffd640 1 -- 172.21.15.103:0/1755782820 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae8037040 con 0x7fcaf81f3b70 2024-09-10T08:38:39.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.810+0000 7fcae6ffd640 1 -- 172.21.15.103:0/1755782820 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5056 (secure 0 0 0) 0x7fcae8003960 con 0x7fcaf81f3b70 2024-09-10T08:38:39.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.810+0000 7fcae6ffd640 1 -- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf81f3b70 msgr2=0x7fcaf81f3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:39.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.810+0000 7fcae6ffd640 1 --2- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf81f3b70 0x7fcaf81f3f50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcaf806da60 tx=0x7fcae802a140 comp rx=0 tx=0).stop 2024-09-10T08:38:39.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.810+0000 7fcae6ffd640 1 -- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf81f3b70 msgr2=0x7fcaf81f3f50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:38:39.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.810+0000 7fcae6ffd640 1 --2- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf81f3b70 0x7fcaf81f3f50 secure :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcaf806da60 tx=0x7fcae802a140 comp rx=0 tx=0).stop 2024-09-10T08:38:39.810 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:38:39.811 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:38:39.811 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:38:39.811 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:38:39.811 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 84, 2024-09-10T08:38:39.811 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 289878, 2024-09-10T08:38:39.811 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:38:39.811 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:38:39.811 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:38:39.811 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:38:39.811 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:39.811 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 3, 2024-09-10T08:38:39.811 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:38:39.811 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:38:39.812 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:38:39.812 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:39.812 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:39.812 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:39.812 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:39.812 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:39.812 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:39.812 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:39.812 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:39.812 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:39.812 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:39.812 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:39.812 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:39.812 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:38:39.812 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:38:39.813 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:39.813 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:39.813 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:39.813 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:39.813 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:39.813 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:39.813 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:39.813 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:39.813 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:39.813 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:39.813 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:39.814 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:39.814 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:39.814 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:38:39.814 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:38:39.814 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:38:39.814 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:38:39.814 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:38:39.814 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:38:39.814 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:38:39.814 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:38:39.814 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:38:39.814 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:38:39.814 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:38:39.815 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:38:39.815 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:38:39.815 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:38:39.815 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:38:39.815 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:38:39.815 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:38:39.815 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:39.815 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:39.815 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:39.815 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:39.815 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:39.815 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:39.815 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:39.816 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:39.816 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:39.816 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:39.816 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:39.816 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:39.816 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:38:39.816 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:39.816 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:38:39.816 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:39.816 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:38:39.816 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:38:39.816 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:39.816 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:39.816 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:39.817 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:39.817 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:38:39.817 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:39.817 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:39.817 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:39.817 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:39.817 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:38:39.817 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:39.817 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:39.818 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:39.818 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:39.818 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:38:39.818 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:38:39.818 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:39.818 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:39.818 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:39.818 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:39.818 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:39.818 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:38:39.818 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:38:39.818 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:39.818 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:39.819 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:39.819 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:39.819 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:38:39.819 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:39.819 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:39.819 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:39.819 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:39.819 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:38:39.819 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:39.819 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:39.819 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:39.819 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:39.819 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:38:39.820 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:38:39.820 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:39.820 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:39.820 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:39.820 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:39.820 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:39.820 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:38:39.820 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:38:39.820 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:39.820 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:39.820 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:39.820 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:39.821 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:38:39.821 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:39.821 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:39.821 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:39.821 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:39.821 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:38:39.821 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:39.821 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:39.821 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:39.821 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:39.821 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:38:39.821 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:38:39.821 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:39.821 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:39.822 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:39.822 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:39.822 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:39.822 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:39.822 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:38:39.822 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:38:39.822 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:39.822 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:39.822 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:39.822 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:38:39.822 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:39.822 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:39.822 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:38:39.823 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:39.823 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:39.823 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:39.823 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:38:39.823 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:39.823 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:39.823 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:38:39.823 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:39.823 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:39.823 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:39.823 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 8 2024-09-10T08:38:39.823 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:39.823 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:39.823 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:38:39.824 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:39.824 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:39.824 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:39.824 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 8 2024-09-10T08:38:39.824 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:39.824 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:39.824 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:38:39.824 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:39.824 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:39.824 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:39.824 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:38:39.824 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:39.825 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:39.825 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:39.825 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:38:39.825 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:38:39.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.811+0000 7fcafc8ae640 1 -- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcad806be80 msgr2=0x7fcad806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:39.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.811+0000 7fcafc8ae640 1 --2- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcad806be80 0x7fcad806e340 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80c4e70 tx=0x7fcaec009060 comp rx=0 tx=0).stop 2024-09-10T08:38:39.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.811+0000 7fcafc8ae640 1 -- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf80c6010 msgr2=0x7fcaf814d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:39.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.811+0000 7fcafc8ae640 1 --2- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf80c6010 0x7fcaf814d450 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000efc0 tx=0x7fcaf000c490 comp rx=0 tx=0).stop 2024-09-10T08:38:39.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.811+0000 7fcaf6d9d640 1 -- 172.21.15.103:0/1755782820 reap_dead start 2024-09-10T08:38:39.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.811+0000 7fcafc8ae640 1 -- 172.21.15.103:0/1755782820 shutdown_connections 2024-09-10T08:38:39.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.811+0000 7fcafc8ae640 1 --2- 172.21.15.103:0/1755782820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcaf80c6010 0x7fcaf814d450 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.811+0000 7fcafc8ae640 1 -- 172.21.15.103:0/1755782820 >> 172.21.15.103:0/1755782820 conn(0x7fcaf80c7a40 msgr2=0x7fcaf80c6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:39.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.811+0000 7fcafc8ae640 1 -- 172.21.15.103:0/1755782820 shutdown_connections 2024-09-10T08:38:39.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.811+0000 7fcafc8ae640 1 -- 172.21.15.103:0/1755782820 wait complete. 2024-09-10T08:38:39.828 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:38:39.828 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:38:39.829 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:38:39.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.992+0000 7fca7f247640 1 Processor -- start 2024-09-10T08:38:39.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.992+0000 7fca7f247640 1 -- start start 2024-09-10T08:38:39.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.994+0000 7fca7f247640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca780c44d0 0x7fca780709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:39.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.994+0000 7fca7f247640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fca78153fe0 0x7fca78070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:39.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.994+0000 7fca7f247640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca780ac4f0 con 0x7fca7814df40 2024-09-10T08:38:39.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.994+0000 7fca7f247640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fca7806f9a0 con 0x7fca78153fe0 2024-09-10T08:38:39.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.994+0000 7fca7f247640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fca78070520 con 0x7fca780c44d0 2024-09-10T08:38:39.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.994+0000 7fca7cfe3640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fca7814df40 0x7fca78072b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:54716/0 (socket says 172.21.15.103:54716) 2024-09-10T08:38:39.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.994+0000 7fca7cfe3640 1 -- 172.21.15.103:0/1189618141 learned_addr learned my addr 172.21.15.103:0/1189618141 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:38:39.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.994+0000 7fca77fff640 1 --2- 172.21.15.103:0/1189618141 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca780c44d0 0x7fca780709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:39.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.994+0000 7fca7d7e4640 1 --2- 172.21.15.103:0/1189618141 >> v2:172.21.15.103:3300/0 conn(0x7fca78153fe0 0x7fca78070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:39.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.994+0000 7fca777fe640 1 -- 172.21.15.103:0/1189618141 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1482979087 0 0) 0x7fca780ac4f0 con 0x7fca7814df40 2024-09-10T08:38:39.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.995+0000 7fca777fe640 1 -- 172.21.15.103:0/1189618141 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca68003520 con 0x7fca7814df40 2024-09-10T08:38:39.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.995+0000 7fca77fff640 1 -- 172.21.15.103:0/1189618141 >> v2:172.21.15.103:3300/0 conn(0x7fca78153fe0 msgr2=0x7fca78070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:39.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.995+0000 7fca777fe640 1 -- 172.21.15.103:0/1189618141 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1656723009 0 0) 0x7fca68003520 con 0x7fca7814df40 2024-09-10T08:38:39.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.995+0000 7fca77fff640 1 --2- 172.21.15.103:0/1189618141 >> v2:172.21.15.103:3300/0 conn(0x7fca78153fe0 0x7fca78070ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.995+0000 7fca77fff640 1 -- 172.21.15.103:0/1189618141 >> v1:172.21.15.103:6789/0 conn(0x7fca7814df40 legacy=0x7fca78072b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:39.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.995+0000 7fca77fff640 1 -- 172.21.15.103:0/1189618141 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7806fbf0 con 0x7fca780c44d0 2024-09-10T08:38:39.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.995+0000 7fca7d7e4640 1 --2- 172.21.15.103:0/1189618141 >> v2:172.21.15.103:3300/0 conn(0x7fca78153fe0 0x7fca78070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:39.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.996+0000 7fca77fff640 1 --2- 172.21.15.103:0/1189618141 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca780c44d0 0x7fca780709b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fca640097a0 tx=0x7fca6402a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e467d62728b5f55 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:39.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.996+0000 7fca777fe640 1 -- 172.21.15.103:0/1189618141 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64037070 con 0x7fca780c44d0 2024-09-10T08:38:39.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.997+0000 7fca777fe640 1 -- 172.21.15.103:0/1189618141 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca6402ab10 con 0x7fca780c44d0 2024-09-10T08:38:39.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.997+0000 7fca777fe640 1 -- 172.21.15.103:0/1189618141 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c001670 con 0x7fca780c44d0 2024-09-10T08:38:39.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.998+0000 7fca7f247640 1 -- 172.21.15.103:0/1189618141 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca780c44d0 msgr2=0x7fca780709b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:39.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.998+0000 7fca7f247640 1 --2- 172.21.15.103:0/1189618141 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca780c44d0 0x7fca780709b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fca640097a0 tx=0x7fca6402a080 comp rx=0 tx=0).stop 2024-09-10T08:38:39.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.998+0000 7fca7f247640 1 -- 172.21.15.103:0/1189618141 shutdown_connections 2024-09-10T08:38:39.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.998+0000 7fca7f247640 1 --2- 172.21.15.103:0/1189618141 >> v2:172.21.15.103:3300/0 conn(0x7fca78153fe0 0x7fca78070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.998+0000 7fca7f247640 1 --2- 172.21.15.103:0/1189618141 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca780c44d0 0x7fca780709b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:39.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.998+0000 7fca7f247640 1 -- 172.21.15.103:0/1189618141 >> 172.21.15.103:0/1189618141 conn(0x7fca780c9ad0 msgr2=0x7fca780c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:39.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.999+0000 7fca7f247640 1 -- 172.21.15.103:0/1189618141 shutdown_connections 2024-09-10T08:38:39.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:39.999+0000 7fca7f247640 1 -- 172.21.15.103:0/1189618141 wait complete. 2024-09-10T08:38:40.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.001+0000 7fca7f247640 1 Processor -- start 2024-09-10T08:38:40.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.001+0000 7fca7f247640 1 -- start start 2024-09-10T08:38:40.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.002+0000 7fca7f247640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca780c44d0 0x7fca7814e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:40.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.003+0000 7fca7f247640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca7814df40 0x7fca780c0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:40.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.003+0000 7fca7f247640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca78153fe0 0x7fca780bf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:40.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.003+0000 7fca7f247640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fca780732a0 con 0x7fca780c44d0 2024-09-10T08:38:40.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.003+0000 7fca7f247640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca780701b0 con 0x7fca7814df40 2024-09-10T08:38:40.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.003+0000 7fca7f247640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fca78073420 con 0x7fca78153fe0 2024-09-10T08:38:40.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.003+0000 7fca7d7e4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca78153fe0 0x7fca780bf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:40.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.004+0000 7fca7d7e4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca78153fe0 0x7fca780bf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:44842/0 (socket says 172.21.15.103:44842) 2024-09-10T08:38:40.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.004+0000 7fca7d7e4640 1 -- 172.21.15.103:0/447000501 learned_addr learned my addr 172.21.15.103:0/447000501 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:40.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.004+0000 7fca77fff640 1 --2- 172.21.15.103:0/447000501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca7814df40 0x7fca780c0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:40.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.004+0000 7fca7cfe3640 1 --2- 172.21.15.103:0/447000501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca780c44d0 0x7fca7814e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:40.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.004+0000 7fca7cfe3640 1 -- 172.21.15.103:0/447000501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca78153fe0 msgr2=0x7fca780bf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:40.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.004+0000 7fca7cfe3640 1 --2- 172.21.15.103:0/447000501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca78153fe0 0x7fca780bf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.004+0000 7fca7cfe3640 1 -- 172.21.15.103:0/447000501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca7814df40 msgr2=0x7fca780c0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:40.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.004+0000 7fca7cfe3640 1 --2- 172.21.15.103:0/447000501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca7814df40 0x7fca780c0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.004+0000 7fca7cfe3640 1 -- 172.21.15.103:0/447000501 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca780bf920 con 0x7fca780c44d0 2024-09-10T08:38:40.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.005+0000 7fca7cfe3640 1 --2- 172.21.15.103:0/447000501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca780c44d0 0x7fca7814e320 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fca6c007fd0 tx=0x7fca6c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:40.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.005+0000 7fca757fa640 1 -- 172.21.15.103:0/447000501 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c017070 con 0x7fca780c44d0 2024-09-10T08:38:40.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.005+0000 7fca757fa640 1 -- 172.21.15.103:0/447000501 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca6c005ce0 con 0x7fca780c44d0 2024-09-10T08:38:40.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.006+0000 7fca757fa640 1 -- 172.21.15.103:0/447000501 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c0072b0 con 0x7fca780c44d0 2024-09-10T08:38:40.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.006+0000 7fca7f247640 1 -- 172.21.15.103:0/447000501 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca780bfc00 con 0x7fca780c44d0 2024-09-10T08:38:40.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.006+0000 7fca7f247640 1 -- 172.21.15.103:0/447000501 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca780c01c0 con 0x7fca780c44d0 2024-09-10T08:38:40.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.007+0000 7fca7f247640 1 --2- 172.21.15.103:0/447000501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca78151220 0x7fca78151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:40.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.007+0000 7fca7f247640 1 -- 172.21.15.103:0/447000501 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca780afe60 con 0x7fca78151220 2024-09-10T08:38:40.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.008+0000 7fca77fff640 1 --2- 172.21.15.103:0/447000501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca78151220 0x7fca78151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:40.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.009+0000 7fca77fff640 1 -- 172.21.15.103:0/447000501 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca780c1690 con 0x7fca78151220 2024-09-10T08:38:40.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.009+0000 7fca757fa640 1 -- 172.21.15.103:0/447000501 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca6c01a070 con 0x7fca780c44d0 2024-09-10T08:38:40.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.010+0000 7fca77fff640 1 --2- 172.21.15.103:0/447000501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca78151220 0x7fca78151600 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fca780763a0 tx=0x7fca640046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:40.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.010+0000 7fca757fa640 1 --2- 172.21.15.103:0/447000501 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca5c06be80 0x7fca5c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:40.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.010+0000 7fca757fa640 1 -- 172.21.15.103:0/447000501 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fca6c08a560 con 0x7fca780c44d0 2024-09-10T08:38:40.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.010+0000 7fca7d7e4640 1 --2- 172.21.15.103:0/447000501 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca5c06be80 0x7fca5c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.010+0000 7fca757fa640 1 -- 172.21.15.103:0/447000501 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64043070 con 0x7fca78151220 2024-09-10T08:38:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.010+0000 7fca757fa640 1 -- 172.21.15.103:0/447000501 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fca6402ab10 con 0x7fca78151220 2024-09-10T08:38:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.011+0000 7fca757fa640 1 -- 172.21.15.103:0/447000501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca78151220 msgr2=0x7fca78151600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.011+0000 7fca757fa640 1 --2- 172.21.15.103:0/447000501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca78151220 0x7fca78151600 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fca780763a0 tx=0x7fca640046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.011+0000 7fca7d7e4640 1 --2- 172.21.15.103:0/447000501 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca5c06be80 0x7fca5c06e340 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fca7814d770 tx=0x7fca7000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.011+0000 7fca757fa640 1 -- 172.21.15.103:0/447000501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca78151220 msgr2=0x7fca78151600 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:38:40.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.011+0000 7fca757fa640 1 --2- 172.21.15.103:0/447000501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca78151220 0x7fca78151600 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.020+0000 7fca7f247640 1 --2- 172.21.15.103:0/447000501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca781eeb60 0x7fca781eef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:40.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.020+0000 7fca7f247640 1 -- 172.21.15.103:0/447000501 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca780bf5e0 con 0x7fca781eeb60 2024-09-10T08:38:40.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.021+0000 7fca77fff640 1 --2- 172.21.15.103:0/447000501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca781eeb60 0x7fca781eef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:40.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.021+0000 7fca77fff640 1 -- 172.21.15.103:0/447000501 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fca78075900 con 0x7fca781eeb60 2024-09-10T08:38:40.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.022+0000 7fca77fff640 1 --2- 172.21.15.103:0/447000501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca781eeb60 0x7fca781eef40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fca64000c00 tx=0x7fca64008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:40.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.022+0000 7fca757fa640 1 -- 172.21.15.103:0/447000501 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64037040 con 0x7fca781eeb60 2024-09-10T08:38:40.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.022+0000 7fca757fa640 1 -- 172.21.15.103:0/447000501 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4552 (secure 0 0 0) 0x7fca640093c0 con 0x7fca781eeb60 2024-09-10T08:38:40.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.022+0000 7fca757fa640 1 -- 172.21.15.103:0/447000501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca781eeb60 msgr2=0x7fca781eef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:40.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.023+0000 7fca757fa640 1 --2- 172.21.15.103:0/447000501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca781eeb60 0x7fca781eef40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fca64000c00 tx=0x7fca64008030 comp rx=0 tx=0).stop 2024-09-10T08:38:40.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.023+0000 7fca757fa640 1 -- 172.21.15.103:0/447000501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca781eeb60 msgr2=0x7fca781eef40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:38:40.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.023+0000 7fca757fa640 1 --2- 172.21.15.103:0/447000501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca781eeb60 0x7fca781eef40 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fca64000c00 tx=0x7fca64008030 comp rx=0 tx=0).stop 2024-09-10T08:38:40.023 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:38:40.023 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:38:40.023 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:38:40.023 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:38:40.023 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 84, 2024-09-10T08:38:40.023 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 65048, 2024-09-10T08:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 3, 2024-09-10T08:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:40.024 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:40.025 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:38:40.026 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:38:40.027 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:40.028 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:40.029 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:40.029 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:38:40.029 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.029 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:38:40.029 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:40.032 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:38:40.032 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.033 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:40.034 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:40.035 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:38:40.036 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:40.037 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:40.037 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:40.037 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:40.037 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:38:40.037 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:40.037 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.037 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:40.037 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:40.037 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:38:40.037 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:40.037 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:40.038 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:40.038 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.038 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:38:40.038 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:38:40.038 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:40.038 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:40.038 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:40.038 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:40.038 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:40.039 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.039 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:38:40.039 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:38:40.039 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:40.039 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:40.039 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:40.039 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:38:40.039 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:40.039 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:40.039 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:38:40.040 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:40.040 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:40.040 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:40.040 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:38:40.040 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:40.040 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:40.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.040 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:38:40.040 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:38:40.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.023+0000 7fca7f247640 1 -- 172.21.15.103:0/447000501 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca5c06be80 msgr2=0x7fca5c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:40.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.023+0000 7fca7f247640 1 --2- 172.21.15.103:0/447000501 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca5c06be80 0x7fca5c06e340 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fca7814d770 tx=0x7fca7000b040 comp rx=0 tx=0).stop 2024-09-10T08:38:40.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.023+0000 7fca7f247640 1 -- 172.21.15.103:0/447000501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca780c44d0 msgr2=0x7fca7814e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:40.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.023+0000 7fca7f247640 1 --2- 172.21.15.103:0/447000501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca780c44d0 0x7fca7814e320 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fca6c007fd0 tx=0x7fca6c00c9b0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.023+0000 7fca7d7e4640 1 -- 172.21.15.103:0/447000501 reap_dead start 2024-09-10T08:38:40.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.023+0000 7fca7d7e4640 1 -- 172.21.15.103:0/447000501 reap_dead start 2024-09-10T08:38:40.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.024+0000 7fca7f247640 1 -- 172.21.15.103:0/447000501 shutdown_connections 2024-09-10T08:38:40.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.024+0000 7fca7f247640 1 -- 172.21.15.103:0/447000501 >> 172.21.15.103:0/447000501 conn(0x7fca780c9ad0 msgr2=0x7fca78072b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:40.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.024+0000 7fca7f247640 1 -- 172.21.15.103:0/447000501 shutdown_connections 2024-09-10T08:38:40.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.024+0000 7fca7f247640 1 -- 172.21.15.103:0/447000501 wait complete. 2024-09-10T08:38:40.044 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:38:40.044 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:38:40.044 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:38:40.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.213+0000 7f20f0f52640 1 Processor -- start 2024-09-10T08:38:40.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.213+0000 7f20f0f52640 1 -- start start 2024-09-10T08:38:40.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.214+0000 7f20f0f52640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec067bc0 0x7f20ec156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:40.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.214+0000 7f20f0f52640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ec06d1c0 con 0x7f20ec0ca010 2024-09-10T08:38:40.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.214+0000 7f20f0f52640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ec06d460 con 0x7f20ec0c6190 2024-09-10T08:38:40.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.215+0000 7f20f0f52640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f20ec06d740 con 0x7f20ec067bc0 2024-09-10T08:38:40.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.215+0000 7f20ead9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f20ec0ca010 0x7f20ec0ca480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:54722/0 (socket says 172.21.15.103:54722) 2024-09-10T08:38:40.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.215+0000 7f20ead9d640 1 -- 172.21.15.103:0/3723303057 learned_addr learned my addr 172.21.15.103:0/3723303057 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:38:40.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.215+0000 7f20ea59c640 1 --2- 172.21.15.103:0/3723303057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec067bc0 0x7f20ec156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:40.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.215+0000 7f20e959a640 1 -- 172.21.15.103:0/3723303057 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1143699242 0 0) 0x7f20ec06d1c0 con 0x7f20ec0ca010 2024-09-10T08:38:40.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.215+0000 7f20e959a640 1 -- 172.21.15.103:0/3723303057 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20d4003520 con 0x7f20ec0ca010 2024-09-10T08:38:40.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.215+0000 7f20ea59c640 1 -- 172.21.15.103:0/3723303057 >> v1:172.21.15.154:6789/0 conn(0x7f20ec0c6190 legacy=0x7f20ec153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:40.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.215+0000 7f20ea59c640 1 -- 172.21.15.103:0/3723303057 >> v1:172.21.15.103:6789/0 conn(0x7f20ec0ca010 legacy=0x7f20ec0ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:40.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.215+0000 7f20ea59c640 1 -- 172.21.15.103:0/3723303057 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ec06da20 con 0x7f20ec067bc0 2024-09-10T08:38:40.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.217+0000 7f20ea59c640 1 --2- 172.21.15.103:0/3723303057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec067bc0 0x7f20ec156cc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0097d0 tx=0x7f20dc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbee510d46612af5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:40.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.217+0000 7f20e959a640 1 -- 172.21.15.103:0/3723303057 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20dc037070 con 0x7f20ec067bc0 2024-09-10T08:38:40.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.217+0000 7f20e959a640 1 -- 172.21.15.103:0/3723303057 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20dc032440 con 0x7f20ec067bc0 2024-09-10T08:38:40.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.218+0000 7f20e959a640 1 -- 172.21.15.103:0/3723303057 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0327f0 con 0x7f20ec067bc0 2024-09-10T08:38:40.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.219+0000 7f20f0f52640 1 -- 172.21.15.103:0/3723303057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec067bc0 msgr2=0x7f20ec156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:40.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.219+0000 7f20f0f52640 1 --2- 172.21.15.103:0/3723303057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec067bc0 0x7f20ec156cc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0097d0 tx=0x7f20dc02a180 comp rx=0 tx=0).stop 2024-09-10T08:38:40.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.220+0000 7f20f0f52640 1 -- 172.21.15.103:0/3723303057 shutdown_connections 2024-09-10T08:38:40.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.220+0000 7f20f0f52640 1 --2- 172.21.15.103:0/3723303057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec067bc0 0x7f20ec156cc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.220+0000 7f20f0f52640 1 -- 172.21.15.103:0/3723303057 >> 172.21.15.103:0/3723303057 conn(0x7f20ec0c87f0 msgr2=0x7f20ec0c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:40.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.222+0000 7f20f0f52640 1 -- 172.21.15.103:0/3723303057 shutdown_connections 2024-09-10T08:38:40.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.222+0000 7f20f0f52640 1 -- 172.21.15.103:0/3723303057 wait complete. 2024-09-10T08:38:40.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.225+0000 7f20f0f52640 1 Processor -- start 2024-09-10T08:38:40.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.225+0000 7f20f0f52640 1 -- start start 2024-09-10T08:38:40.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.227+0000 7f20f0f52640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec067bc0 0x7f20ec157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:40.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.227+0000 7f20f0f52640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20ec0c6190 0x7f20ec14e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:40.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.227+0000 7f20f0f52640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20ec0ca010 0x7f20ec14e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:40.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.227+0000 7f20f0f52640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec0cad10 con 0x7f20ec0ca010 2024-09-10T08:38:40.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.227+0000 7f20f0f52640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec0cab90 con 0x7f20ec0c6190 2024-09-10T08:38:40.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.227+0000 7f20f0f52640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f20ec153d50 con 0x7f20ec067bc0 2024-09-10T08:38:40.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.227+0000 7f20ea59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec067bc0 0x7f20ec157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:40.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.227+0000 7f20ea59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec067bc0 0x7f20ec157f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:44862/0 (socket says 172.21.15.103:44862) 2024-09-10T08:38:40.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.227+0000 7f20ea59c640 1 -- 172.21.15.103:0/3608110402 learned_addr learned my addr 172.21.15.103:0/3608110402 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:40.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.227+0000 7f20ead9d640 1 --2- 172.21.15.103:0/3608110402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20ec0ca010 0x7f20ec14e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:40.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.228+0000 7f20ea59c640 1 -- 172.21.15.103:0/3608110402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20ec0c6190 msgr2=0x7f20ec14e1a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:38:40.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.228+0000 7f20ea59c640 1 --2- 172.21.15.103:0/3608110402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20ec0c6190 0x7f20ec14e1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.228+0000 7f20ea59c640 1 -- 172.21.15.103:0/3608110402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20ec0ca010 msgr2=0x7f20ec14e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:40.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.228+0000 7f20ea59c640 1 --2- 172.21.15.103:0/3608110402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20ec0ca010 0x7f20ec14e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.228+0000 7f20ea59c640 1 -- 172.21.15.103:0/3608110402 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ec0c2020 con 0x7f20ec067bc0 2024-09-10T08:38:40.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.229+0000 7f20ead9d640 1 --2- 172.21.15.103:0/3608110402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20ec0ca010 0x7f20ec14e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:40.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.229+0000 7f20ea59c640 1 --2- 172.21.15.103:0/3608110402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec067bc0 0x7f20ec157f90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0097d0 tx=0x7f20dc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:40.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.229+0000 7f20daffd640 1 -- 172.21.15.103:0/3608110402 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20dc037050 con 0x7f20ec067bc0 2024-09-10T08:38:40.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.229+0000 7f20f0f52640 1 -- 172.21.15.103:0/3608110402 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20ec1ec010 con 0x7f20ec067bc0 2024-09-10T08:38:40.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.229+0000 7f20daffd640 1 -- 172.21.15.103:0/3608110402 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20dc043070 con 0x7f20ec067bc0 2024-09-10T08:38:40.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.229+0000 7f20f0f52640 1 -- 172.21.15.103:0/3608110402 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f20ec1ec2b0 con 0x7f20ec067bc0 2024-09-10T08:38:40.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.229+0000 7f20daffd640 1 -- 172.21.15.103:0/3608110402 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20dc006e10 con 0x7f20ec067bc0 2024-09-10T08:38:40.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.230+0000 7f20f0f52640 1 --2- 172.21.15.103:0/3608110402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec0c0d10 0x7f20ec0c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:40.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.230+0000 7f20f0f52640 1 -- 172.21.15.103:0/3608110402 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f20ec068f80 con 0x7f20ec0c0d10 2024-09-10T08:38:40.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.231+0000 7f20e9d9b640 1 --2- 172.21.15.103:0/3608110402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec0c0d10 0x7f20ec0c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:40.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.231+0000 7f20e9d9b640 1 -- 172.21.15.103:0/3608110402 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20ec0c8f50 con 0x7f20ec0c0d10 2024-09-10T08:38:40.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.231+0000 7f20e9d9b640 1 --2- 172.21.15.103:0/3608110402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec0c0d10 0x7f20ec0c55b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0cbc10 tx=0x7f20e000c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:40.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.232+0000 7f20daffd640 1 -- 172.21.15.103:0/3608110402 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f20dc032830 con 0x7f20ec067bc0 2024-09-10T08:38:40.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.232+0000 7f20daffd640 1 --2- 172.21.15.103:0/3608110402 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f20cc06be60 0x7f20cc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:40.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.232+0000 7f20daffd640 1 -- 172.21.15.103:0/3608110402 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f20dc0abe20 con 0x7f20ec067bc0 2024-09-10T08:38:40.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.232+0000 7f20daffd640 1 -- 172.21.15.103:0/3608110402 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e000cea0 con 0x7f20ec0c0d10 2024-09-10T08:38:40.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.233+0000 7f20daffd640 1 -- 172.21.15.103:0/3608110402 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f20e0005280 con 0x7f20ec0c0d10 2024-09-10T08:38:40.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.233+0000 7f20daffd640 1 -- 172.21.15.103:0/3608110402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec0c0d10 msgr2=0x7f20ec0c55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:40.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.233+0000 7f20daffd640 1 --2- 172.21.15.103:0/3608110402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec0c0d10 0x7f20ec0c55b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0cbc10 tx=0x7f20e000c7a0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.233+0000 7f20daffd640 1 -- 172.21.15.103:0/3608110402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec0c0d10 msgr2=0x7f20ec0c55b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:38:40.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.233+0000 7f20daffd640 1 --2- 172.21.15.103:0/3608110402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec0c0d10 0x7f20ec0c55b0 secure :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0cbc10 tx=0x7f20e000c7a0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.235+0000 7f20ead9d640 1 --2- 172.21.15.103:0/3608110402 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f20cc06be60 0x7f20cc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:40.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.236+0000 7f20ead9d640 1 --2- 172.21.15.103:0/3608110402 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f20cc06be60 0x7f20cc06e320 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f20e4002230 tx=0x7f20e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:40.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.245+0000 7f20f0f52640 1 --2- 172.21.15.103:0/3608110402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec1592f0 0x7f20ec159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:40.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.245+0000 7f20f0f52640 1 -- 172.21.15.103:0/3608110402 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f20ec1584d0 con 0x7f20ec1592f0 2024-09-10T08:38:40.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.246+0000 7f20e9d9b640 1 --2- 172.21.15.103:0/3608110402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec1592f0 0x7f20ec159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:40.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.247+0000 7f20e9d9b640 1 -- 172.21.15.103:0/3608110402 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f20ec0cb6e0 con 0x7f20ec1592f0 2024-09-10T08:38:40.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.248+0000 7f20e9d9b640 1 --2- 172.21.15.103:0/3608110402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec1592f0 0x7f20ec159700 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f20e0000f60 tx=0x7f20e0000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:40.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.248+0000 7f20daffd640 1 -- 172.21.15.103:0/3608110402 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e0017040 con 0x7f20ec1592f0 2024-09-10T08:38:40.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.249+0000 7f20daffd640 1 -- 172.21.15.103:0/3608110402 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4552 (secure 0 0 0) 0x7f20e00067d0 con 0x7f20ec1592f0 2024-09-10T08:38:40.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.249+0000 7f20daffd640 1 -- 172.21.15.103:0/3608110402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec1592f0 msgr2=0x7f20ec159700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:40.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.249+0000 7f20daffd640 1 --2- 172.21.15.103:0/3608110402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec1592f0 0x7f20ec159700 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f20e0000f60 tx=0x7f20e0000ed0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.249+0000 7f20daffd640 1 -- 172.21.15.103:0/3608110402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec1592f0 msgr2=0x7f20ec159700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:38:40.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.249+0000 7f20daffd640 1 --2- 172.21.15.103:0/3608110402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec1592f0 0x7f20ec159700 secure :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f20e0000f60 tx=0x7f20e0000ed0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.249 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:38:40.249 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:38:40.250 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:38:40.250 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:38:40.250 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 84, 2024-09-10T08:38:40.250 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 13082, 2024-09-10T08:38:40.250 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:38:40.250 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:38:40.250 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:38:40.250 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:38:40.250 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:40.250 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 3, 2024-09-10T08:38:40.250 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:38:40.250 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:38:40.250 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:38:40.251 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:40.251 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:40.251 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:40.251 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:40.251 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:40.251 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:40.251 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:40.251 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:40.251 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:40.251 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:40.251 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:40.251 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:40.251 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:38:40.251 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:38:40.252 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:40.252 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:40.252 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:40.252 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:40.252 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:40.252 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:40.252 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:40.252 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:40.252 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:40.252 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:40.252 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:40.252 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:40.252 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.253 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:38:40.253 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:38:40.253 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:38:40.253 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:38:40.253 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:38:40.253 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:38:40.253 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:38:40.253 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:38:40.253 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:38:40.253 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:38:40.253 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:38:40.253 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:38:40.253 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:38:40.253 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:38:40.254 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:38:40.254 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:38:40.254 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:38:40.254 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:40.254 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:40.254 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:40.254 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:40.254 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:40.254 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:40.254 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:40.254 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:40.254 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:40.254 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:40.254 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:40.255 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:40.255 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:38:40.255 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.255 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:38:40.255 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:40.255 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:38:40.255 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:38:40.255 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:40.255 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:40.255 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:40.255 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:40.255 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:38:40.255 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:40.255 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:38:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:38:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:38:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:38:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:38:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:38:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:38:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:38:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:38:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:38:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:38:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:38:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:38:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:38:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:38:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:38:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:38:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:38:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:40.261 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:40.261 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:38:40.261 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:40.261 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:40.261 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:40.261 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:38:40.261 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:40.261 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:40.261 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:40.261 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:38:40.261 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:38:40.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.250+0000 7f20f0f52640 1 -- 172.21.15.103:0/3608110402 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f20cc06be60 msgr2=0x7f20cc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:40.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.250+0000 7f20f0f52640 1 --2- 172.21.15.103:0/3608110402 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f20cc06be60 0x7f20cc06e320 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f20e4002230 tx=0x7f20e4009040 comp rx=0 tx=0).stop 2024-09-10T08:38:40.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.250+0000 7f20f0f52640 1 -- 172.21.15.103:0/3608110402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec067bc0 msgr2=0x7f20ec157f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:40.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.250+0000 7f20f0f52640 1 --2- 172.21.15.103:0/3608110402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20ec067bc0 0x7f20ec157f90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0097d0 tx=0x7f20dc0046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.250+0000 7f20ead9d640 1 -- 172.21.15.103:0/3608110402 reap_dead start 2024-09-10T08:38:40.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.250+0000 7f20ead9d640 1 -- 172.21.15.103:0/3608110402 reap_dead start 2024-09-10T08:38:40.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.250+0000 7f20f0f52640 1 -- 172.21.15.103:0/3608110402 shutdown_connections 2024-09-10T08:38:40.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.250+0000 7f20f0f52640 1 -- 172.21.15.103:0/3608110402 >> 172.21.15.103:0/3608110402 conn(0x7f20ec0c87f0 msgr2=0x7f20ec0ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:40.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.250+0000 7f20f0f52640 1 -- 172.21.15.103:0/3608110402 shutdown_connections 2024-09-10T08:38:40.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.250+0000 7f20f0f52640 1 -- 172.21.15.103:0/3608110402 wait complete. 2024-09-10T08:38:40.265 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:38:40.265 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-10T08:38:40.265 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-10T08:38:40.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.430+0000 7f005cc2e640 1 Processor -- start 2024-09-10T08:38:40.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.430+0000 7f005cc2e640 1 -- start start 2024-09-10T08:38:40.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.431+0000 7f005cc2e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f00580c7230 0x7f00581562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:40.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.431+0000 7f005cc2e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f005806edd0 0x7f005814fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:40.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.431+0000 7f005cc2e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00580c53f0 con 0x7f005814f820 2024-09-10T08:38:40.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.431+0000 7f005cc2e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f00581532d0 con 0x7f005806edd0 2024-09-10T08:38:40.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.431+0000 7f005cc2e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f00580c2d60 con 0x7f00580c7230 2024-09-10T08:38:40.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.431+0000 7f005659c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f005814f820 0x7f0058152bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:54736/0 (socket says 172.21.15.103:54736) 2024-09-10T08:38:40.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.431+0000 7f005659c640 1 -- 172.21.15.103:0/1764987647 learned_addr learned my addr 172.21.15.103:0/1764987647 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:38:40.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.431+0000 7f004ffff640 1 --2- 172.21.15.103:0/1764987647 >> v2:172.21.15.154:3300/0 conn(0x7f00580c7230 0x7f00581562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:40.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.432+0000 7f0056d9d640 1 --2- 172.21.15.103:0/1764987647 >> v2:172.21.15.103:3300/0 conn(0x7f005806edd0 0x7f005814fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:40.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.432+0000 7f004ffff640 1 -- 172.21.15.103:0/1764987647 >> v2:172.21.15.103:3300/0 conn(0x7f005806edd0 msgr2=0x7f005814fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:40.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.432+0000 7f004ffff640 1 --2- 172.21.15.103:0/1764987647 >> v2:172.21.15.103:3300/0 conn(0x7f005806edd0 0x7f005814fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.432+0000 7f004ffff640 1 -- 172.21.15.103:0/1764987647 >> v1:172.21.15.103:6789/0 conn(0x7f005814f820 legacy=0x7f0058152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:40.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.432+0000 7f004ffff640 1 -- 172.21.15.103:0/1764987647 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00580c3040 con 0x7f00580c7230 2024-09-10T08:38:40.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.433+0000 7f004ffff640 1 --2- 172.21.15.103:0/1764987647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00580c7230 0x7f00581562d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0058070250 tx=0x7f0040029f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40e66565a87d8902 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:40.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.433+0000 7f0055d9b640 1 -- 172.21.15.103:0/1764987647 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0040037070 con 0x7f00580c7230 2024-09-10T08:38:40.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.434+0000 7f0055d9b640 1 -- 172.21.15.103:0/1764987647 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f004002ac20 con 0x7f00580c7230 2024-09-10T08:38:40.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.434+0000 7f0055d9b640 1 -- 172.21.15.103:0/1764987647 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0040032440 con 0x7f00580c7230 2024-09-10T08:38:40.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.435+0000 7f005cc2e640 1 -- 172.21.15.103:0/1764987647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00580c7230 msgr2=0x7f00581562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:40.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.435+0000 7f005cc2e640 1 --2- 172.21.15.103:0/1764987647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00580c7230 0x7f00581562d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0058070250 tx=0x7f0040029f90 comp rx=0 tx=0).stop 2024-09-10T08:38:40.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.435+0000 7f005cc2e640 1 -- 172.21.15.103:0/1764987647 shutdown_connections 2024-09-10T08:38:40.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.435+0000 7f005cc2e640 1 --2- 172.21.15.103:0/1764987647 >> v2:172.21.15.103:3300/0 conn(0x7f005806edd0 0x7f005814fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.435+0000 7f005cc2e640 1 --2- 172.21.15.103:0/1764987647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00580c7230 0x7f00581562d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.435+0000 7f005cc2e640 1 -- 172.21.15.103:0/1764987647 >> 172.21.15.103:0/1764987647 conn(0x7f00580c7a40 msgr2=0x7f00580c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:40.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.435+0000 7f005cc2e640 1 -- 172.21.15.103:0/1764987647 shutdown_connections 2024-09-10T08:38:40.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.435+0000 7f005cc2e640 1 -- 172.21.15.103:0/1764987647 wait complete. 2024-09-10T08:38:40.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.437+0000 7f005cc2e640 1 Processor -- start 2024-09-10T08:38:40.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.437+0000 7f005cc2e640 1 -- start start 2024-09-10T08:38:40.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.438+0000 7f005cc2e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f005806edd0 0x7f0058155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:40.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.439+0000 7f005cc2e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00580c7230 0x7f00581e4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:40.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.439+0000 7f005cc2e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f005814f820 0x7f00581e50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:40.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.439+0000 7f005659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f005806edd0 0x7f0058155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:40.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.439+0000 7f005659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f005806edd0 0x7f0058155110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:54740/0 (socket says 172.21.15.103:54740) 2024-09-10T08:38:40.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.439+0000 7f004ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00580c7230 0x7f00581e4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:40.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.439+0000 7f004ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00580c7230 0x7f00581e4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51654/0 (socket says 172.21.15.103:51654) 2024-09-10T08:38:40.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.439+0000 7f005659c640 1 -- 172.21.15.103:0/1844300582 learned_addr learned my addr 172.21.15.103:0/1844300582 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:40.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.440+0000 7f005cc2e640 1 -- 172.21.15.103:0/1844300582 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f00580c5bf0 con 0x7f00580c7230 2024-09-10T08:38:40.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.440+0000 7f0056d9d640 1 --2- 172.21.15.103:0/1844300582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f005814f820 0x7f00581e50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:40.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.440+0000 7f005cc2e640 1 -- 172.21.15.103:0/1844300582 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0058152350 con 0x7f005806edd0 2024-09-10T08:38:40.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.440+0000 7f005cc2e640 1 -- 172.21.15.103:0/1844300582 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f00580c5d70 con 0x7f005814f820 2024-09-10T08:38:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.441+0000 7f005659c640 1 -- 172.21.15.103:0/1844300582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f005814f820 msgr2=0x7f00581e50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.441+0000 7f005659c640 1 --2- 172.21.15.103:0/1844300582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f005814f820 0x7f00581e50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.441+0000 7f005659c640 1 -- 172.21.15.103:0/1844300582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00580c7230 msgr2=0x7f00581e4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.441+0000 7f005659c640 1 --2- 172.21.15.103:0/1844300582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00580c7230 0x7f00581e4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.441+0000 7f005659c640 1 -- 172.21.15.103:0/1844300582 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0058156570 con 0x7f005806edd0 2024-09-10T08:38:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.442+0000 7f005659c640 1 --2- 172.21.15.103:0/1844300582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f005806edd0 0x7f0058155110 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f004800caf0 tx=0x7f00480020c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.443+0000 7f004effd640 1 -- 172.21.15.103:0/1844300582 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0048018070 con 0x7f005806edd0 2024-09-10T08:38:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.443+0000 7f004effd640 1 -- 172.21.15.103:0/1844300582 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f004800a700 con 0x7f005806edd0 2024-09-10T08:38:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.443+0000 7f005cc2e640 1 -- 172.21.15.103:0/1844300582 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0058155b00 con 0x7f005806edd0 2024-09-10T08:38:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.443+0000 7f004effd640 1 -- 172.21.15.103:0/1844300582 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004800aaf0 con 0x7f005806edd0 2024-09-10T08:38:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.443+0000 7f005cc2e640 1 -- 172.21.15.103:0/1844300582 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00580aa0a0 con 0x7f005806edd0 2024-09-10T08:38:40.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.445+0000 7f005cc2e640 1 -- 172.21.15.103:0/1844300582 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f005814fc00 con 0x7f005806edd0 2024-09-10T08:38:40.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.445+0000 7f004effd640 1 -- 172.21.15.103:0/1844300582 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f004800ac90 con 0x7f005806edd0 2024-09-10T08:38:40.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.446+0000 7f004effd640 1 --2- 172.21.15.103:0/1844300582 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f003806be60 0x7f003806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:40.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.447+0000 7f004effd640 1 -- 172.21.15.103:0/1844300582 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f004808a990 con 0x7f005806edd0 2024-09-10T08:38:40.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.447+0000 7f004ffff640 1 --2- 172.21.15.103:0/1844300582 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f003806be60 0x7f003806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.448+0000 7f004ffff640 1 --2- 172.21.15.103:0/1844300582 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f003806be60 0x7f003806e320 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0040034000 tx=0x7f004002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:40.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.454+0000 7f004effd640 1 -- 172.21.15.103:0/1844300582 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0048058960 con 0x7f005806edd0 2024-09-10T08:38:40.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.894+0000 7f005cc2e640 1 -- 172.21.15.103:0/1844300582 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f00580c8070 con 0x7f005806edd0 2024-09-10T08:38:40.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.896+0000 7f004effd640 1 -- 172.21.15.103:0/1844300582 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f004805cc60 con 0x7f005806edd0 2024-09-10T08:38:40.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.900+0000 7f005cc2e640 1 -- 172.21.15.103:0/1844300582 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f003806be60 msgr2=0x7f003806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:40.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.900+0000 7f005cc2e640 1 --2- 172.21.15.103:0/1844300582 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f003806be60 0x7f003806e320 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0040034000 tx=0x7f004002e000 comp rx=0 tx=0).stop 2024-09-10T08:38:40.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.900+0000 7f005cc2e640 1 -- 172.21.15.103:0/1844300582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f005806edd0 msgr2=0x7f0058155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:40.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.900+0000 7f005cc2e640 1 --2- 172.21.15.103:0/1844300582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f005806edd0 0x7f0058155110 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f004800caf0 tx=0x7f00480020c0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.900+0000 7f005cc2e640 1 -- 172.21.15.103:0/1844300582 shutdown_connections 2024-09-10T08:38:40.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.900+0000 7f005cc2e640 1 --2- 172.21.15.103:0/1844300582 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f003806be60 0x7f003806e320 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.900+0000 7f005cc2e640 1 --2- 172.21.15.103:0/1844300582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f005814f820 0x7f00581e50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.900+0000 7f005cc2e640 1 --2- 172.21.15.103:0/1844300582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00580c7230 0x7f00581e4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.900+0000 7f005cc2e640 1 --2- 172.21.15.103:0/1844300582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f005806edd0 0x7f0058155110 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:40.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.900+0000 7f005cc2e640 1 -- 172.21.15.103:0/1844300582 >> 172.21.15.103:0/1844300582 conn(0x7f00580c7a40 msgr2=0x7f00580ac7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:40.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.900+0000 7f005cc2e640 1 -- 172.21.15.103:0/1844300582 shutdown_connections 2024-09-10T08:38:40.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:40.900+0000 7f005cc2e640 1 -- 172.21.15.103:0/1844300582 wait complete. 2024-09-10T08:38:40.922 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-10T08:38:50.923 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:38:50.924 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:38:51.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.327+0000 7fd2b2050640 1 Processor -- start 2024-09-10T08:38:51.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.327+0000 7fd2b2050640 1 -- start start 2024-09-10T08:38:51.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.328+0000 7fd2b2050640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2ac0ca150 0x7fd2ac06fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.328+0000 7fd2b2050640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd2ac158260 0x7fd2ac072b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.328+0000 7fd2b2050640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2ac0af1e0 con 0x7fd2ac0c7b00 2024-09-10T08:38:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.329+0000 7fd2b2050640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd2ac070210 con 0x7fd2ac158260 2024-09-10T08:38:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.329+0000 7fd2b2050640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd2ac070450 con 0x7fd2ac0ca150 2024-09-10T08:38:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.329+0000 7fd2ab7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2ac0ca150 0x7fd2ac06fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.329+0000 7fd2ab7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2ac0ca150 0x7fd2ac06fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:36846/0 (socket says 172.21.15.103:36846) 2024-09-10T08:38:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.329+0000 7fd2ab7fe640 1 -- 172.21.15.103:0/2657911995 learned_addr learned my addr 172.21.15.103:0/2657911995 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.329+0000 7fd2abfff640 1 --2- 172.21.15.103:0/2657911995 >> v2:172.21.15.154:3300/0 conn(0x7fd2ac158260 0x7fd2ac072b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:51.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.329+0000 7fd2a2ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd2ac0c7b00 0x7fd2ac157b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:39378/0 (socket says 172.21.15.103:39378) 2024-09-10T08:38:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.329+0000 7fd2abfff640 1 -- 172.21.15.103:0/2657911995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2ac0ca150 msgr2=0x7fd2ac06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.329+0000 7fd2abfff640 1 --2- 172.21.15.103:0/2657911995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2ac0ca150 0x7fd2ac06fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.329+0000 7fd2abfff640 1 -- 172.21.15.103:0/2657911995 >> v1:172.21.15.154:6789/0 conn(0x7fd2ac0c7b00 legacy=0x7fd2ac157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.329+0000 7fd2abfff640 1 -- 172.21.15.103:0/2657911995 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ac15e830 con 0x7fd2ac158260 2024-09-10T08:38:51.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.330+0000 7fd2abfff640 1 --2- 172.21.15.103:0/2657911995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2ac158260 0x7fd2ac072b30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40097a0 tx=0x7fd2a402a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe03d09a60dd32da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.331+0000 7fd2aaffd640 1 -- 172.21.15.103:0/2657911995 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4037070 con 0x7fd2ac158260 2024-09-10T08:38:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.331+0000 7fd2aaffd640 1 -- 172.21.15.103:0/2657911995 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a402adb0 con 0x7fd2ac158260 2024-09-10T08:38:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.331+0000 7fd2aaffd640 1 -- 172.21.15.103:0/2657911995 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4032660 con 0x7fd2ac158260 2024-09-10T08:38:51.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.332+0000 7fd2b2050640 1 -- 172.21.15.103:0/2657911995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2ac158260 msgr2=0x7fd2ac072b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:51.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.332+0000 7fd2b2050640 1 --2- 172.21.15.103:0/2657911995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2ac158260 0x7fd2ac072b30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40097a0 tx=0x7fd2a402a060 comp rx=0 tx=0).stop 2024-09-10T08:38:51.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.332+0000 7fd2b2050640 1 -- 172.21.15.103:0/2657911995 shutdown_connections 2024-09-10T08:38:51.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.332+0000 7fd2b2050640 1 --2- 172.21.15.103:0/2657911995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2ac158260 0x7fd2ac072b30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:51.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.332+0000 7fd2b2050640 1 --2- 172.21.15.103:0/2657911995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2ac0ca150 0x7fd2ac06fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:51.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.332+0000 7fd2b2050640 1 -- 172.21.15.103:0/2657911995 >> 172.21.15.103:0/2657911995 conn(0x7fd2ac067b30 msgr2=0x7fd2ac067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:51.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.332+0000 7fd2b2050640 1 -- 172.21.15.103:0/2657911995 shutdown_connections 2024-09-10T08:38:51.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.333+0000 7fd2b2050640 1 -- 172.21.15.103:0/2657911995 wait complete. 2024-09-10T08:38:51.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.334+0000 7fd2b2050640 1 Processor -- start 2024-09-10T08:38:51.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.335+0000 7fd2b2050640 1 -- start start 2024-09-10T08:38:51.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.337+0000 7fd2b2050640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2ac0c7b00 0x7fd2ac0c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:51.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.337+0000 7fd2b2050640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2ac0ca150 0x7fd2ac15a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:51.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.337+0000 7fd2b2050640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2ac158260 0x7fd2ac15ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:51.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.337+0000 7fd2b2050640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ac0c92c0 con 0x7fd2ac0c7b00 2024-09-10T08:38:51.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.337+0000 7fd2ab7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2ac0c7b00 0x7fd2ac0c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:51.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.337+0000 7fd2b2050640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ac0c95c0 con 0x7fd2ac0ca150 2024-09-10T08:38:51.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.337+0000 7fd2b2050640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd2ac0ca530 con 0x7fd2ac158260 2024-09-10T08:38:51.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.337+0000 7fd2ab7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2ac0c7b00 0x7fd2ac0c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48506/0 (socket says 172.21.15.103:48506) 2024-09-10T08:38:51.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.337+0000 7fd2ab7fe640 1 -- 172.21.15.103:0/174381212 learned_addr learned my addr 172.21.15.103:0/174381212 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:51.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.337+0000 7fd2a2ffd640 1 --2- 172.21.15.103:0/174381212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2ac0ca150 0x7fd2ac15a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:51.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.337+0000 7fd2abfff640 1 --2- 172.21.15.103:0/174381212 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2ac158260 0x7fd2ac15ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:51.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.338+0000 7fd2ab7fe640 1 -- 172.21.15.103:0/174381212 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2ac158260 msgr2=0x7fd2ac15ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:51.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.338+0000 7fd2ab7fe640 1 --2- 172.21.15.103:0/174381212 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2ac158260 0x7fd2ac15ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:51.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.338+0000 7fd2ab7fe640 1 -- 172.21.15.103:0/174381212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2ac0ca150 msgr2=0x7fd2ac15a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:51.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.338+0000 7fd2ab7fe640 1 --2- 172.21.15.103:0/174381212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2ac0ca150 0x7fd2ac15a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:51.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.338+0000 7fd2ab7fe640 1 -- 172.21.15.103:0/174381212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ac0c71a0 con 0x7fd2ac0c7b00 2024-09-10T08:38:51.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.338+0000 7fd2a2ffd640 1 --2- 172.21.15.103:0/174381212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2ac0ca150 0x7fd2ac15a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:51.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.339+0000 7fd2ab7fe640 1 --2- 172.21.15.103:0/174381212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2ac0c7b00 0x7fd2ac0c47f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00efc0 tx=0x7fd29c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:51.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.339+0000 7fd2a8ff9640 1 -- 172.21.15.103:0/174381212 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c00cda0 con 0x7fd2ac0c7b00 2024-09-10T08:38:51.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.339+0000 7fd2a8ff9640 1 -- 172.21.15.103:0/174381212 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd29c019070 con 0x7fd2ac0c7b00 2024-09-10T08:38:51.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.339+0000 7fd2a8ff9640 1 -- 172.21.15.103:0/174381212 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c00cda0 con 0x7fd2ac0c7b00 2024-09-10T08:38:51.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.341+0000 7fd2b2050640 1 -- 172.21.15.103:0/174381212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2ac0c6660 con 0x7fd2ac0c7b00 2024-09-10T08:38:51.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.341+0000 7fd2b2050640 1 -- 172.21.15.103:0/174381212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2ac0c5620 con 0x7fd2ac0c7b00 2024-09-10T08:38:51.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.344+0000 7fd2a8ff9640 1 -- 172.21.15.103:0/174381212 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd29c005d10 con 0x7fd2ac0c7b00 2024-09-10T08:38:51.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.344+0000 7fd2a8ff9640 1 --2- 172.21.15.103:0/174381212 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd28c06c230 0x7fd28c06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:51.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.344+0000 7fd2b2050640 1 -- 172.21.15.103:0/174381212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2ac152390 con 0x7fd2ac0c7b00 2024-09-10T08:38:51.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.345+0000 7fd2a8ff9640 1 -- 172.21.15.103:0/174381212 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fd29c00cba0 con 0x7fd2ac0c7b00 2024-09-10T08:38:51.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.345+0000 7fd2a2ffd640 1 --2- 172.21.15.103:0/174381212 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd28c06c230 0x7fd28c06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:51.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.345+0000 7fd2a2ffd640 1 --2- 172.21.15.103:0/174381212 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd28c06c230 0x7fd28c06e6f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac157b00 tx=0x7fd294000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:51.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.354+0000 7fd2a8ff9640 1 -- 172.21.15.103:0/174381212 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2ac152390 con 0x7fd2ac0c7b00 2024-09-10T08:38:51.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.813+0000 7fd2b2050640 1 -- 172.21.15.103:0/174381212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd2ac0740b0 con 0x7fd2ac0c7b00 2024-09-10T08:38:51.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.813+0000 7fd2a8ff9640 1 -- 172.21.15.103:0/174381212 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fd29c06e020 con 0x7fd2ac0c7b00 2024-09-10T08:38:51.814 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":84,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:38:51.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.817+0000 7fd2b2050640 1 -- 172.21.15.103:0/174381212 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd28c06c230 msgr2=0x7fd28c06e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:51.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.817+0000 7fd2b2050640 1 --2- 172.21.15.103:0/174381212 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd28c06c230 0x7fd28c06e6f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac157b00 tx=0x7fd294000ed0 comp rx=0 tx=0).stop 2024-09-10T08:38:51.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.817+0000 7fd2b2050640 1 -- 172.21.15.103:0/174381212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2ac0c7b00 msgr2=0x7fd2ac0c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:51.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.817+0000 7fd2b2050640 1 --2- 172.21.15.103:0/174381212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2ac0c7b00 0x7fd2ac0c47f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00efc0 tx=0x7fd29c00c490 comp rx=0 tx=0).stop 2024-09-10T08:38:51.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.817+0000 7fd2b2050640 1 -- 172.21.15.103:0/174381212 shutdown_connections 2024-09-10T08:38:51.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.817+0000 7fd2b2050640 1 --2- 172.21.15.103:0/174381212 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd28c06c230 0x7fd28c06e6f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:51.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.817+0000 7fd2b2050640 1 --2- 172.21.15.103:0/174381212 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2ac158260 0x7fd2ac15ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:51.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.817+0000 7fd2b2050640 1 --2- 172.21.15.103:0/174381212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2ac0ca150 0x7fd2ac15a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:51.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.817+0000 7fd2b2050640 1 --2- 172.21.15.103:0/174381212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2ac0c7b00 0x7fd2ac0c47f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:51.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.817+0000 7fd2b2050640 1 -- 172.21.15.103:0/174381212 >> 172.21.15.103:0/174381212 conn(0x7fd2ac067b30 msgr2=0x7fd2ac15d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:51.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.817+0000 7fd2b2050640 1 -- 172.21.15.103:0/174381212 shutdown_connections 2024-09-10T08:38:51.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:51.817+0000 7fd2b2050640 1 -- 172.21.15.103:0/174381212 wait complete. 2024-09-10T08:38:51.836 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:38:51.836 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-10T08:38:51.836 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:38:51.836 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:38:52.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.007+0000 7f7982b52640 1 Processor -- start 2024-09-10T08:38:52.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.007+0000 7f7982b52640 1 -- start start 2024-09-10T08:38:52.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.008+0000 7f7982b52640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f797c0cb050 0x7f797c0cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.008+0000 7f7982b52640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f797c06c610 0x7f797c0c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.008+0000 7f7982b52640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f797c158370 con 0x7f797c06ce90 2024-09-10T08:38:52.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.008+0000 7f7982b52640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f797c15aab0 con 0x7f797c0cb050 2024-09-10T08:38:52.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.008+0000 7f7982b52640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f797c15ad90 con 0x7f797c06c610 2024-09-10T08:38:52.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.008+0000 7f79808ee640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f797c0cb050 0x7f797c0cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.008+0000 7f79808ee640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f797c0cb050 0x7f797c0cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48510/0 (socket says 172.21.15.103:48510) 2024-09-10T08:38:52.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.008+0000 7f79808ee640 1 -- 172.21.15.103:0/1481738221 learned_addr learned my addr 172.21.15.103:0/1481738221 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:52.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.008+0000 7f797bfff640 1 --2- 172.21.15.103:0/1481738221 >> v2:172.21.15.154:3300/0 conn(0x7f797c06c610 0x7f797c0c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.008+0000 7f79808ee640 1 -- 172.21.15.103:0/1481738221 >> v2:172.21.15.154:3300/0 conn(0x7f797c06c610 msgr2=0x7f797c0c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:52.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.008+0000 7f79808ee640 1 --2- 172.21.15.103:0/1481738221 >> v2:172.21.15.154:3300/0 conn(0x7f797c06c610 0x7f797c0c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.008+0000 7f79808ee640 1 -- 172.21.15.103:0/1481738221 >> v1:172.21.15.103:6789/0 conn(0x7f797c06ce90 legacy=0x7f797c0ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:52.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.009+0000 7f79808ee640 1 -- 172.21.15.103:0/1481738221 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797c15b070 con 0x7f797c0cb050 2024-09-10T08:38:52.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.010+0000 7f79808ee640 1 --2- 172.21.15.103:0/1481738221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c0cb050 0x7f797c0cb430 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f797c08e310 tx=0x7f796c02a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01034354f698bd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:52.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.010+0000 7f797b7fe640 1 -- 172.21.15.103:0/1481738221 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c037070 con 0x7f797c0cb050 2024-09-10T08:38:52.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.010+0000 7f797b7fe640 1 -- 172.21.15.103:0/1481738221 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f796c032440 con 0x7f797c0cb050 2024-09-10T08:38:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.010+0000 7f797b7fe640 1 -- 172.21.15.103:0/1481738221 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c032810 con 0x7f797c0cb050 2024-09-10T08:38:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.011+0000 7f7982b52640 1 -- 172.21.15.103:0/1481738221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c0cb050 msgr2=0x7f797c0cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.011+0000 7f7982b52640 1 --2- 172.21.15.103:0/1481738221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c0cb050 0x7f797c0cb430 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f797c08e310 tx=0x7f796c02a1f0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.011+0000 7f7982b52640 1 -- 172.21.15.103:0/1481738221 shutdown_connections 2024-09-10T08:38:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.011+0000 7f7982b52640 1 --2- 172.21.15.103:0/1481738221 >> v2:172.21.15.154:3300/0 conn(0x7f797c06c610 0x7f797c0c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.011+0000 7f7982b52640 1 --2- 172.21.15.103:0/1481738221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c0cb050 0x7f797c0cb430 secure :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f797c08e310 tx=0x7f796c02a1f0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.011+0000 7f7982b52640 1 -- 172.21.15.103:0/1481738221 >> 172.21.15.103:0/1481738221 conn(0x7f797c068030 msgr2=0x7f797c073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:52.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.012+0000 7f7982b52640 1 -- 172.21.15.103:0/1481738221 shutdown_connections 2024-09-10T08:38:52.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.013+0000 7f7982b52640 1 -- 172.21.15.103:0/1481738221 wait complete. 2024-09-10T08:38:52.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.015+0000 7f7982b52640 1 Processor -- start 2024-09-10T08:38:52.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.015+0000 7f7982b52640 1 -- start start 2024-09-10T08:38:52.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.016+0000 7f7982b52640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c06c610 0x7f797c1f09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.016+0000 7f7982b52640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f797c06ce90 0x7f797c1e5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.016+0000 7f7982b52640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f797c0b0c80 0x7f797c1f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.016+0000 7f7982b52640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f797c0cab70 con 0x7f797c06c610 2024-09-10T08:38:52.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.017+0000 7f7982b52640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f797c15b630 con 0x7f797c0b0c80 2024-09-10T08:38:52.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.017+0000 7f7982b52640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f797c15a6d0 con 0x7f797c06ce90 2024-09-10T08:38:52.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.017+0000 7f797bfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f797c06ce90 0x7f797c1e5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.017+0000 7f797bfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f797c06ce90 0x7f797c1e5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:36860/0 (socket says 172.21.15.103:36860) 2024-09-10T08:38:52.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.017+0000 7f797bfff640 1 -- 172.21.15.103:0/759711890 learned_addr learned my addr 172.21.15.103:0/759711890 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:52.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.017+0000 7f79808ee640 1 --2- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c06c610 0x7f797c1f09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.017+0000 7f79810ef640 1 --2- 172.21.15.103:0/759711890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f797c0b0c80 0x7f797c1f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.017+0000 7f79808ee640 1 -- 172.21.15.103:0/759711890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f797c06ce90 msgr2=0x7f797c1e5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:52.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.017+0000 7f79808ee640 1 --2- 172.21.15.103:0/759711890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f797c06ce90 0x7f797c1e5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.017+0000 7f79808ee640 1 -- 172.21.15.103:0/759711890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f797c0b0c80 msgr2=0x7f797c1f47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:52.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.017+0000 7f79808ee640 1 --2- 172.21.15.103:0/759711890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f797c0b0c80 0x7f797c1f47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.017+0000 7f79808ee640 1 -- 172.21.15.103:0/759711890 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797c14c5d0 con 0x7f797c06c610 2024-09-10T08:38:52.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.017+0000 7f79808ee640 1 --2- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c06c610 0x7f797c1f09a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f796c031000 tx=0x7f796c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:52.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.018+0000 7f79797fa640 1 -- 172.21.15.103:0/759711890 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c041020 con 0x7f797c06c610 2024-09-10T08:38:52.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.018+0000 7f79797fa640 1 -- 172.21.15.103:0/759711890 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f796c0306e0 con 0x7f797c06c610 2024-09-10T08:38:52.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.018+0000 7f79797fa640 1 -- 172.21.15.103:0/759711890 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c037040 con 0x7f797c06c610 2024-09-10T08:38:52.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.019+0000 7f7982b52640 1 -- 172.21.15.103:0/759711890 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f797c14c010 con 0x7f797c06c610 2024-09-10T08:38:52.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.019+0000 7f7982b52640 1 -- 172.21.15.103:0/759711890 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f797c1f3fb0 con 0x7f797c06c610 2024-09-10T08:38:52.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.022+0000 7f7982b52640 1 --2- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c1f41f0 0x7f797c148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.022+0000 7f7982b52640 1 -- 172.21.15.103:0/759711890 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f797c1f0ee0 con 0x7f797c1f41f0 2024-09-10T08:38:52.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.022+0000 7f797bfff640 1 --2- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c1f41f0 0x7f797c148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.023+0000 7f797bfff640 1 -- 172.21.15.103:0/759711890 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f797c0cb430 con 0x7f797c1f41f0 2024-09-10T08:38:52.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.023+0000 7f79797fa640 1 -- 172.21.15.103:0/759711890 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f796c044020 con 0x7f797c06c610 2024-09-10T08:38:52.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.023+0000 7f797bfff640 1 --2- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c1f41f0 0x7f797c148920 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f797c0ca8c0 tx=0x7f7970010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.023+0000 7f79797fa640 1 --2- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f796806bf00 0x7f796806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.024+0000 7f79810ef640 1 --2- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f796806bf00 0x7f796806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.024+0000 7f79797fa640 1 -- 172.21.15.103:0/759711890 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f796c0ab770 con 0x7f797c06c610 2024-09-10T08:38:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.024+0000 7f79797fa640 1 -- 172.21.15.103:0/759711890 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7970018070 con 0x7f797c1f41f0 2024-09-10T08:38:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.025+0000 7f79797fa640 1 -- 172.21.15.103:0/759711890 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7970004020 con 0x7f797c1f41f0 2024-09-10T08:38:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.025+0000 7f79797fa640 1 -- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c1f41f0 msgr2=0x7f797c148920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.025+0000 7f79810ef640 1 --2- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f796806bf00 0x7f796806e3c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7974001e90 tx=0x7f7974009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.025+0000 7f79797fa640 1 --2- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c1f41f0 0x7f797c148920 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f797c0ca8c0 tx=0x7f7970010c80 comp rx=0 tx=0).stop 2024-09-10T08:38:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.025+0000 7f79797fa640 1 -- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c1f41f0 msgr2=0x7f797c148920 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:38:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.025+0000 7f79797fa640 1 --2- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c1f41f0 0x7f797c148920 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.039+0000 7f7982b52640 1 --2- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c148e60 0x7f797c159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.040+0000 7f7982b52640 1 -- 172.21.15.103:0/759711890 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f797c06c3f0 con 0x7f797c148e60 2024-09-10T08:38:52.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.040+0000 7f797bfff640 1 --2- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c148e60 0x7f797c159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.040+0000 7f797bfff640 1 -- 172.21.15.103:0/759711890 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f797c0730f0 con 0x7f797c148e60 2024-09-10T08:38:52.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.041+0000 7f797bfff640 1 --2- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c148e60 0x7f797c159580 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7970017000 tx=0x7f79700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:52.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.041+0000 7f79797fa640 1 -- 172.21.15.103:0/759711890 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7970003ca0 con 0x7f797c148e60 2024-09-10T08:38:52.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.041+0000 7f79797fa640 1 -- 172.21.15.103:0/759711890 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5057 (secure 0 0 0) 0x7f7970003ca0 con 0x7f797c148e60 2024-09-10T08:38:52.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.041+0000 7f79797fa640 1 -- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c148e60 msgr2=0x7f797c159580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:52.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.041+0000 7f79797fa640 1 --2- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c148e60 0x7f797c159580 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7970017000 tx=0x7f79700046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.041+0000 7f79797fa640 1 -- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c148e60 msgr2=0x7f797c159580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:38:52.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.041+0000 7f79797fa640 1 --2- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c148e60 0x7f797c159580 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.044 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:38:52.044 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:38:52.044 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:38:52.044 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:38:52.044 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 84, 2024-09-10T08:38:52.044 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 302110, 2024-09-10T08:38:52.044 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:38:52.044 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:38:52.044 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:38:52.044 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:38:52.044 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:52.045 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 15, 2024-09-10T08:38:52.045 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:38:52.045 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:38:52.045 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:38:52.045 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:52.045 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:52.045 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:52.045 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:52.045 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:52.045 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:52.045 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:52.045 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:52.045 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:52.046 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:52.046 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:52.046 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:52.046 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:38:52.046 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:38:52.046 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:52.046 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:52.046 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:52.046 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:52.046 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:52.046 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:52.046 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:52.046 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:52.046 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:52.047 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:52.047 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:52.047 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:52.047 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.047 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:38:52.047 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:38:52.047 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:38:52.047 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:38:52.047 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:38:52.047 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:38:52.047 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:38:52.047 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:38:52.047 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:38:52.048 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:38:52.048 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:38:52.048 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:38:52.048 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:38:52.048 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:38:52.048 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:38:52.048 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:38:52.048 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:38:52.048 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:52.048 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:52.048 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:52.048 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:52.048 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:52.049 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:52.049 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:52.049 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:52.049 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:52.049 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:52.049 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:52.049 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:52.049 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:38:52.049 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.049 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:38:52.049 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.049 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:38:52.049 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:38:52.050 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:52.050 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:52.050 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.050 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:52.050 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:38:52.050 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:52.050 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.050 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.050 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:52.050 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:38:52.050 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:52.050 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:52.051 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:52.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.051 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:38:52.051 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:38:52.051 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:52.051 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:52.051 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:52.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.051 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.051 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:38:52.051 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:38:52.051 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:52.051 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:52.052 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.052 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:52.052 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:38:52.052 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:52.052 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.052 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.052 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:52.052 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:38:52.052 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:52.052 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:52.052 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:52.052 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.052 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:38:52.053 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:38:52.053 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:52.053 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:52.053 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:52.053 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.053 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.053 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:38:52.053 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:38:52.053 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:52.053 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:52.053 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.053 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:52.053 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:38:52.053 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:52.054 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.054 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.054 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:52.054 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:38:52.054 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:52.054 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:52.054 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:52.054 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.054 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:38:52.054 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:38:52.054 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:52.054 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:52.054 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:52.054 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:52.055 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:52.055 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.055 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:38:52.055 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:38:52.055 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.055 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:52.055 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:52.055 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:38:52.055 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:52.055 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:52.055 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:38:52.055 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.055 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:52.055 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:52.055 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:38:52.056 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:52.056 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:52.056 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:38:52.056 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.056 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:52.056 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:52.056 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 8 2024-09-10T08:38:52.056 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:52.056 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:52.057 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:38:52.057 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.057 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:52.057 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:52.057 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 8 2024-09-10T08:38:52.057 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:52.057 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:52.057 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:38:52.057 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.057 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:52.057 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:52.057 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:38:52.057 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:52.057 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:52.058 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.058 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:38:52.058 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:38:52.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.042+0000 7f7982b52640 1 -- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f796806bf00 msgr2=0x7f796806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:52.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.042+0000 7f7982b52640 1 --2- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f796806bf00 0x7f796806e3c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7974001e90 tx=0x7f7974009040 comp rx=0 tx=0).stop 2024-09-10T08:38:52.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.042+0000 7f7982b52640 1 -- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c06c610 msgr2=0x7f797c1f09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:52.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.042+0000 7f7982b52640 1 --2- 172.21.15.103:0/759711890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797c06c610 0x7f797c1f09a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f796c031000 tx=0x7f796c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.042+0000 7f79810ef640 1 -- 172.21.15.103:0/759711890 reap_dead start 2024-09-10T08:38:52.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.042+0000 7f79810ef640 1 -- 172.21.15.103:0/759711890 reap_dead start 2024-09-10T08:38:52.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.042+0000 7f7982b52640 1 -- 172.21.15.103:0/759711890 shutdown_connections 2024-09-10T08:38:52.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.042+0000 7f7982b52640 1 -- 172.21.15.103:0/759711890 >> 172.21.15.103:0/759711890 conn(0x7f797c068030 msgr2=0x7f797c155f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:52.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.043+0000 7f7982b52640 1 -- 172.21.15.103:0/759711890 shutdown_connections 2024-09-10T08:38:52.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.043+0000 7f7982b52640 1 -- 172.21.15.103:0/759711890 wait complete. 2024-09-10T08:38:52.062 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:38:52.062 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:38:52.062 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:38:52.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.227+0000 7f8077568640 1 Processor -- start 2024-09-10T08:38:52.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.228+0000 7f8077568640 1 -- start start 2024-09-10T08:38:52.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.228+0000 7f8077568640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f80700a8070 0x7f80700c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.228+0000 7f8077568640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80700c3450 0x7f80700c3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.229+0000 7f8077568640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80700be420 con 0x7f80700743a0 2024-09-10T08:38:52.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.229+0000 7f8077568640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f80700be700 con 0x7f80700a8070 2024-09-10T08:38:52.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.229+0000 7f8077568640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f80700be9e0 con 0x7f80700c3450 2024-09-10T08:38:52.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.229+0000 7f8075304640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f80700743a0 0x7f80700c54e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:39382/0 (socket says 172.21.15.103:39382) 2024-09-10T08:38:52.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.229+0000 7f8075304640 1 -- 172.21.15.103:0/446462595 learned_addr learned my addr 172.21.15.103:0/446462595 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:38:52.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.229+0000 7f8074b03640 1 --2- 172.21.15.103:0/446462595 >> v2:172.21.15.154:3300/0 conn(0x7f80700a8070 0x7f80700c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.229+0000 7f8075b05640 1 --2- 172.21.15.103:0/446462595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80700c3450 0x7f80700c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.229+0000 7f8074b03640 1 -- 172.21.15.103:0/446462595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80700c3450 msgr2=0x7f80700c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:52.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.229+0000 7f8074b03640 1 --2- 172.21.15.103:0/446462595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80700c3450 0x7f80700c3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.229+0000 7f8074b03640 1 -- 172.21.15.103:0/446462595 >> v1:172.21.15.154:6789/0 conn(0x7f80700743a0 legacy=0x7f80700c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:52.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.229+0000 7f8074b03640 1 -- 172.21.15.103:0/446462595 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80700becc0 con 0x7f80700a8070 2024-09-10T08:38:52.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.230+0000 7f8075b05640 1 --2- 172.21.15.103:0/446462595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80700c3450 0x7f80700c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:52.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.231+0000 7f8074b03640 1 --2- 172.21.15.103:0/446462595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80700a8070 0x7f80700c7a30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f80600097a0 tx=0x7f806002a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9f773254179cc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:52.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.231+0000 7f8067fff640 1 -- 172.21.15.103:0/446462595 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8060037070 con 0x7f80700a8070 2024-09-10T08:38:52.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.231+0000 7f8067fff640 1 -- 172.21.15.103:0/446462595 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f806002adb0 con 0x7f80700a8070 2024-09-10T08:38:52.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.231+0000 7f8067fff640 1 -- 172.21.15.103:0/446462595 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8060032660 con 0x7f80700a8070 2024-09-10T08:38:52.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.232+0000 7f8077568640 1 -- 172.21.15.103:0/446462595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80700a8070 msgr2=0x7f80700c7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:52.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.232+0000 7f8077568640 1 --2- 172.21.15.103:0/446462595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80700a8070 0x7f80700c7a30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f80600097a0 tx=0x7f806002a060 comp rx=0 tx=0).stop 2024-09-10T08:38:52.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.232+0000 7f8077568640 1 -- 172.21.15.103:0/446462595 shutdown_connections 2024-09-10T08:38:52.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.232+0000 7f8077568640 1 --2- 172.21.15.103:0/446462595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80700c3450 0x7f80700c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.232+0000 7f8077568640 1 --2- 172.21.15.103:0/446462595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80700a8070 0x7f80700c7a30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.232+0000 7f8077568640 1 -- 172.21.15.103:0/446462595 >> 172.21.15.103:0/446462595 conn(0x7f80700c8a50 msgr2=0x7f80700c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:52.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.232+0000 7f8077568640 1 -- 172.21.15.103:0/446462595 shutdown_connections 2024-09-10T08:38:52.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.232+0000 7f8077568640 1 -- 172.21.15.103:0/446462595 wait complete. 2024-09-10T08:38:52.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.234+0000 7f8077568640 1 Processor -- start 2024-09-10T08:38:52.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.234+0000 7f8077568640 1 -- start start 2024-09-10T08:38:52.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.235+0000 7f8077568640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80700743a0 0x7f80700ab320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.235+0000 7f8077568640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80700a8070 0x7f80700732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.235+0000 7f8077568640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80700c3450 0x7f80701da160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.235+0000 7f8075304640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80700743a0 0x7f80700ab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.235+0000 7f8075304640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80700743a0 0x7f80700ab320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48548/0 (socket says 172.21.15.103:48548) 2024-09-10T08:38:52.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.235+0000 7f8075304640 1 -- 172.21.15.103:0/782824633 learned_addr learned my addr 172.21.15.103:0/782824633 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:52.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.235+0000 7f8077568640 1 -- 172.21.15.103:0/782824633 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f80700c5bf0 con 0x7f80700743a0 2024-09-10T08:38:52.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.235+0000 7f8077568640 1 -- 172.21.15.103:0/782824633 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f80700c6bd0 con 0x7f80700c3450 2024-09-10T08:38:52.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.235+0000 7f8077568640 1 -- 172.21.15.103:0/782824633 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f80700c5d70 con 0x7f80700a8070 2024-09-10T08:38:52.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.236+0000 7f8075304640 1 -- 172.21.15.103:0/782824633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80700a8070 msgr2=0x7f80700732c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:38:52.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.236+0000 7f8075304640 1 --2- 172.21.15.103:0/782824633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80700a8070 0x7f80700732c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.236+0000 7f8075304640 1 -- 172.21.15.103:0/782824633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80700c3450 msgr2=0x7f80701da160 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:38:52.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.236+0000 7f8075304640 1 --2- 172.21.15.103:0/782824633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80700c3450 0x7f80701da160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.236+0000 7f8075304640 1 -- 172.21.15.103:0/782824633 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80701f16a0 con 0x7f80700743a0 2024-09-10T08:38:52.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.236+0000 7f8075304640 1 --2- 172.21.15.103:0/782824633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80700743a0 0x7f80700ab320 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f806c00c3f0 tx=0x7f806c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:52.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.237+0000 7f8065ffb640 1 -- 172.21.15.103:0/782824633 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c017070 con 0x7f80700743a0 2024-09-10T08:38:52.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.237+0000 7f8065ffb640 1 -- 172.21.15.103:0/782824633 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f806c005ce0 con 0x7f80700743a0 2024-09-10T08:38:52.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.237+0000 7f8077568640 1 -- 172.21.15.103:0/782824633 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80701e0840 con 0x7f80700743a0 2024-09-10T08:38:52.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.237+0000 7f8065ffb640 1 -- 172.21.15.103:0/782824633 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806c0072f0 con 0x7f80700743a0 2024-09-10T08:38:52.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.238+0000 7f8077568640 1 -- 172.21.15.103:0/782824633 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80701f13c0 con 0x7f80700743a0 2024-09-10T08:38:52.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.239+0000 7f8077568640 1 --2- 172.21.15.103:0/782824633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80700ad470 0x7f80701da6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.239+0000 7f8077568640 1 -- 172.21.15.103:0/782824633 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8070069a00 con 0x7f80700ad470 2024-09-10T08:38:52.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.240+0000 7f8074b03640 1 --2- 172.21.15.103:0/782824633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80700ad470 0x7f80701da6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.240+0000 7f8065ffb640 1 -- 172.21.15.103:0/782824633 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f806c01a070 con 0x7f80700743a0 2024-09-10T08:38:52.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.240+0000 7f8074b03640 1 -- 172.21.15.103:0/782824633 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f80700befa0 con 0x7f80700ad470 2024-09-10T08:38:52.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.240+0000 7f8065ffb640 1 --2- 172.21.15.103:0/782824633 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f805406be80 0x7f805406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.241+0000 7f8074b03640 1 --2- 172.21.15.103:0/782824633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80700ad470 0x7f80701da6a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8070071170 tx=0x7f80600046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:52.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.241+0000 7f8075b05640 1 --2- 172.21.15.103:0/782824633 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f805406be80 0x7f805406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.241+0000 7f8065ffb640 1 -- 172.21.15.103:0/782824633 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f806c08a3d0 con 0x7f80700743a0 2024-09-10T08:38:52.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.241+0000 7f8065ffb640 1 -- 172.21.15.103:0/782824633 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8060041070 con 0x7f80700ad470 2024-09-10T08:38:52.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.242+0000 7f8075b05640 1 --2- 172.21.15.103:0/782824633 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f805406be80 0x7f805406e340 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f806800e140 tx=0x7f806800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:52.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.242+0000 7f8065ffb640 1 -- 172.21.15.103:0/782824633 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8060032b50 con 0x7f80700ad470 2024-09-10T08:38:52.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.242+0000 7f8065ffb640 1 -- 172.21.15.103:0/782824633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80700ad470 msgr2=0x7f80701da6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:52.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.242+0000 7f8065ffb640 1 --2- 172.21.15.103:0/782824633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80700ad470 0x7f80701da6a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8070071170 tx=0x7f80600046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.242+0000 7f8065ffb640 1 -- 172.21.15.103:0/782824633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80700ad470 msgr2=0x7f80701da6a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:38:52.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.242+0000 7f8065ffb640 1 --2- 172.21.15.103:0/782824633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80700ad470 0x7f80701da6a0 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8070071170 tx=0x7f80600046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.253+0000 7f8077568640 1 --2- 172.21.15.103:0/782824633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80700abb10 0x7f80700abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.253+0000 7f8077568640 1 -- 172.21.15.103:0/782824633 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f80700c7a30 con 0x7f80700abb10 2024-09-10T08:38:52.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.254+0000 7f8074b03640 1 --2- 172.21.15.103:0/782824633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80700abb10 0x7f80700abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.254+0000 7f8074b03640 1 -- 172.21.15.103:0/782824633 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f80700c6e30 con 0x7f80700abb10 2024-09-10T08:38:52.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.255+0000 7f8074b03640 1 --2- 172.21.15.103:0/782824633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80700abb10 0x7f80700abef0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f80600097a0 tx=0x7f8060009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:52.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.255+0000 7f8065ffb640 1 -- 172.21.15.103:0/782824633 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8060037040 con 0x7f80700abb10 2024-09-10T08:38:52.259 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:38:52.259 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:38:52.259 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:38:52.259 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:38:52.259 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 84, 2024-09-10T08:38:52.259 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 77281, 2024-09-10T08:38:52.259 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:38:52.259 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:38:52.259 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:38:52.260 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:38:52.260 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:52.260 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 15, 2024-09-10T08:38:52.260 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:38:52.260 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:38:52.260 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:38:52.260 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:52.260 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:52.260 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:52.260 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:52.260 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:52.260 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:52.260 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:52.261 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:52.261 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:52.261 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:52.261 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:52.261 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:52.261 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:38:52.261 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:38:52.261 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:52.261 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:52.261 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:52.261 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:52.261 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:52.261 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:52.262 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:52.262 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:52.262 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:52.262 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:52.262 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:52.262 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:52.262 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.262 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:38:52.262 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:38:52.262 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:38:52.262 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:38:52.262 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:38:52.262 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:38:52.263 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:38:52.263 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:38:52.263 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:38:52.263 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:38:52.263 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:38:52.263 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:38:52.263 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:38:52.263 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:38:52.263 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:38:52.263 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:38:52.263 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:38:52.263 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:52.263 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:52.263 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:52.264 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:52.264 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:52.264 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:52.264 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:52.264 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:52.264 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:52.264 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:52.264 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:52.264 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:52.264 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:38:52.264 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.264 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:38:52.264 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.265 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:38:52.265 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:38:52.265 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:52.265 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:52.265 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.265 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:52.265 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:38:52.265 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:52.265 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.265 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.265 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:52.265 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:38:52.265 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:52.266 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:52.266 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:52.266 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.266 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:38:52.266 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:38:52.266 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:52.266 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:52.266 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:52.266 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.266 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.266 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:38:52.266 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:38:52.266 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:52.266 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:52.267 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.267 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:52.267 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:38:52.267 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:52.267 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.267 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.267 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:52.267 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:38:52.267 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:52.267 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:52.267 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:52.267 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.267 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:38:52.268 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:38:52.268 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:52.268 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:52.268 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:52.268 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.268 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.268 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:38:52.268 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:38:52.268 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:52.269 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:52.269 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.269 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:52.269 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:38:52.269 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:52.269 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.269 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.269 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:52.269 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:38:52.269 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:52.269 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:52.269 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:52.269 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.269 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:38:52.270 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:38:52.270 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:52.270 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:52.270 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:52.270 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:52.270 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:52.270 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.270 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:38:52.270 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:38:52.270 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.270 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:52.270 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:52.270 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:38:52.270 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:52.271 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:52.271 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:38:52.271 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.271 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:52.271 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:52.271 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:38:52.271 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:52.271 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:52.271 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.271 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:38:52.271 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:38:52.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.258+0000 7f8065ffb640 1 -- 172.21.15.103:0/782824633 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f806003c660 con 0x7f80700abb10 2024-09-10T08:38:52.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.258+0000 7f8065ffb640 1 -- 172.21.15.103:0/782824633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80700abb10 msgr2=0x7f80700abef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:52.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.258+0000 7f8065ffb640 1 --2- 172.21.15.103:0/782824633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80700abb10 0x7f80700abef0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f80600097a0 tx=0x7f8060009190 comp rx=0 tx=0).stop 2024-09-10T08:38:52.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.258+0000 7f8065ffb640 1 -- 172.21.15.103:0/782824633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80700abb10 msgr2=0x7f80700abef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:38:52.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.258+0000 7f8065ffb640 1 --2- 172.21.15.103:0/782824633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80700abb10 0x7f80700abef0 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f80600097a0 tx=0x7f8060009190 comp rx=0 tx=0).stop 2024-09-10T08:38:52.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.259+0000 7f8077568640 1 -- 172.21.15.103:0/782824633 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f805406be80 msgr2=0x7f805406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:52.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.260+0000 7f8077568640 1 --2- 172.21.15.103:0/782824633 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f805406be80 0x7f805406e340 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f806800e140 tx=0x7f806800b040 comp rx=0 tx=0).stop 2024-09-10T08:38:52.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.260+0000 7f8077568640 1 -- 172.21.15.103:0/782824633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80700743a0 msgr2=0x7f80700ab320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:52.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.260+0000 7f8077568640 1 --2- 172.21.15.103:0/782824633 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80700743a0 0x7f80700ab320 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f806c00c3f0 tx=0x7f806c00c8b0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.260+0000 7f8075b05640 1 -- 172.21.15.103:0/782824633 reap_dead start 2024-09-10T08:38:52.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.260+0000 7f8075b05640 1 -- 172.21.15.103:0/782824633 reap_dead start 2024-09-10T08:38:52.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.260+0000 7f8077568640 1 -- 172.21.15.103:0/782824633 shutdown_connections 2024-09-10T08:38:52.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.260+0000 7f8077568640 1 -- 172.21.15.103:0/782824633 >> 172.21.15.103:0/782824633 conn(0x7f80700c8a50 msgr2=0x7f807006ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:52.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.260+0000 7f8077568640 1 -- 172.21.15.103:0/782824633 shutdown_connections 2024-09-10T08:38:52.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.261+0000 7f8077568640 1 -- 172.21.15.103:0/782824633 wait complete. 2024-09-10T08:38:52.280 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:38:52.281 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:38:52.281 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:38:52.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.442+0000 7f120c853640 1 Processor -- start 2024-09-10T08:38:52.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.443+0000 7f120c853640 1 -- start start 2024-09-10T08:38:52.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.444+0000 7f120c853640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1208153be0 0x7f12080c3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.444+0000 7f120c853640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12080ac720 0x7f12080c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.444+0000 7f120c853640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12080c8460 con 0x7f12080c7fb0 2024-09-10T08:38:52.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.445+0000 7f120c853640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1208156db0 con 0x7f12080ac720 2024-09-10T08:38:52.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.445+0000 7f120c853640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1208153fc0 con 0x7f1208153be0 2024-09-10T08:38:52.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.445+0000 7f120659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1208153be0 0x7f12080c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.445+0000 7f120659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1208153be0 0x7f12080c3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:36886/0 (socket says 172.21.15.103:36886) 2024-09-10T08:38:52.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.445+0000 7f120659c640 1 -- 172.21.15.103:0/3037956502 learned_addr learned my addr 172.21.15.103:0/3037956502 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:52.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.445+0000 7f120659c640 1 -- 172.21.15.103:0/3037956502 >> v2:172.21.15.154:3300/0 conn(0x7f12080ac720 msgr2=0x7f12080c7a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T08:38:52.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.445+0000 7f120659c640 1 --2- 172.21.15.103:0/3037956502 >> v2:172.21.15.154:3300/0 conn(0x7f12080ac720 0x7f12080c7a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.445+0000 7f120659c640 1 -- 172.21.15.103:0/3037956502 >> v1:172.21.15.154:6789/0 conn(0x7f12080c7fb0 legacy=0x7f12081598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:52.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.445+0000 7f120659c640 1 -- 172.21.15.103:0/3037956502 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12080a8030 con 0x7f1208153be0 2024-09-10T08:38:52.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.446+0000 7f120659c640 1 --2- 172.21.15.103:0/3037956502 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1208153be0 0x7f12080c3560 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f11f8009870 tx=0x7f11f802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b04ee5bf566229e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:52.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.447+0000 7f1205d9b640 1 -- 172.21.15.103:0/3037956502 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8037070 con 0x7f1208153be0 2024-09-10T08:38:52.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.447+0000 7f1205d9b640 1 -- 172.21.15.103:0/3037956502 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f802ae20 con 0x7f1208153be0 2024-09-10T08:38:52.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.447+0000 7f1205d9b640 1 -- 172.21.15.103:0/3037956502 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8032660 con 0x7f1208153be0 2024-09-10T08:38:52.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.448+0000 7f120c853640 1 -- 172.21.15.103:0/3037956502 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1208153be0 msgr2=0x7f12080c3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:52.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.448+0000 7f120c853640 1 --2- 172.21.15.103:0/3037956502 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1208153be0 0x7f12080c3560 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f11f8009870 tx=0x7f11f802a110 comp rx=0 tx=0).stop 2024-09-10T08:38:52.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.448+0000 7f120c853640 1 -- 172.21.15.103:0/3037956502 shutdown_connections 2024-09-10T08:38:52.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.448+0000 7f120c853640 1 --2- 172.21.15.103:0/3037956502 >> v2:172.21.15.154:3300/0 conn(0x7f12080ac720 0x7f12080c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.448+0000 7f120c853640 1 --2- 172.21.15.103:0/3037956502 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1208153be0 0x7f12080c3560 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.448+0000 7f120c853640 1 -- 172.21.15.103:0/3037956502 >> 172.21.15.103:0/3037956502 conn(0x7f12080c5660 msgr2=0x7f12080c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:52.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.449+0000 7f120c853640 1 -- 172.21.15.103:0/3037956502 shutdown_connections 2024-09-10T08:38:52.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.449+0000 7f120c853640 1 -- 172.21.15.103:0/3037956502 wait complete. 2024-09-10T08:38:52.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.451+0000 7f120c853640 1 Processor -- start 2024-09-10T08:38:52.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.452+0000 7f120c853640 1 -- start start 2024-09-10T08:38:52.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.453+0000 7f120c853640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12080ac720 0x7f1208155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.453+0000 7f120c853640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12080c7fb0 0x7f12081f3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.453+0000 7f120c853640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1208153be0 0x7f12081f43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.453+0000 7f120c853640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f12080a83e0 con 0x7f1208153be0 2024-09-10T08:38:52.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.453+0000 7f120c853640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1208157240 con 0x7f12080c7fb0 2024-09-10T08:38:52.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.453+0000 7f120c853640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f12080ac370 con 0x7f12080ac720 2024-09-10T08:38:52.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.453+0000 7f1206d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1208153be0 0x7f12081f43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.453+0000 7f1206d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1208153be0 0x7f12081f43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48556/0 (socket says 172.21.15.103:48556) 2024-09-10T08:38:52.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.453+0000 7f1206d9d640 1 -- 172.21.15.103:0/2569566334 learned_addr learned my addr 172.21.15.103:0/2569566334 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:52.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.453+0000 7f1206d9d640 1 -- 172.21.15.103:0/2569566334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12080ac720 msgr2=0x7f1208155550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:38:52.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.453+0000 7f1206d9d640 1 --2- 172.21.15.103:0/2569566334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12080ac720 0x7f1208155550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.454+0000 7f1206d9d640 1 -- 172.21.15.103:0/2569566334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12080c7fb0 msgr2=0x7f12081f3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:52.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.454+0000 7f1206d9d640 1 --2- 172.21.15.103:0/2569566334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12080c7fb0 0x7f12081f3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.454+0000 7f1206d9d640 1 -- 172.21.15.103:0/2569566334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1208157490 con 0x7f1208153be0 2024-09-10T08:38:52.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.454+0000 7f1206d9d640 1 --2- 172.21.15.103:0/2569566334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1208153be0 0x7f12081f43c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f120000c780 tx=0x7f120000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:52.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.454+0000 7f11ff7fe640 1 -- 172.21.15.103:0/2569566334 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1200004b60 con 0x7f1208153be0 2024-09-10T08:38:52.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.455+0000 7f120c853640 1 -- 172.21.15.103:0/2569566334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1208157770 con 0x7f1208153be0 2024-09-10T08:38:52.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.455+0000 7f120c853640 1 -- 172.21.15.103:0/2569566334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1208157d30 con 0x7f1208153be0 2024-09-10T08:38:52.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.455+0000 7f11ff7fe640 1 -- 172.21.15.103:0/2569566334 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1200004d00 con 0x7f1208153be0 2024-09-10T08:38:52.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.455+0000 7f11ff7fe640 1 -- 172.21.15.103:0/2569566334 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120000aa70 con 0x7f1208153be0 2024-09-10T08:38:52.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.456+0000 7f120c853640 1 --2- 172.21.15.103:0/2569566334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11ec002a70 0x7f11ec004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.457+0000 7f120c853640 1 -- 172.21.15.103:0/2569566334 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f11ec007ec0 con 0x7f11ec002a70 2024-09-10T08:38:52.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.457+0000 7f120659c640 1 --2- 172.21.15.103:0/2569566334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11ec002a70 0x7f11ec004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.457+0000 7f120659c640 1 -- 172.21.15.103:0/2569566334 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11ec0080c0 con 0x7f11ec002a70 2024-09-10T08:38:52.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.458+0000 7f11ff7fe640 1 -- 172.21.15.103:0/2569566334 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f120000ac10 con 0x7f1208153be0 2024-09-10T08:38:52.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.459+0000 7f120659c640 1 --2- 172.21.15.103:0/2569566334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11ec002a70 0x7f11ec004f30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f12080aee90 tx=0x7f11f80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:52.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.459+0000 7f11ff7fe640 1 --2- 172.21.15.103:0/2569566334 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f11e806bf00 0x7f11e806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.459+0000 7f11ff7fe640 1 -- 172.21.15.103:0/2569566334 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f120008b770 con 0x7f1208153be0 2024-09-10T08:38:52.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.459+0000 7f11fdd9b640 1 --2- 172.21.15.103:0/2569566334 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f11e806bf00 0x7f11e806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.459+0000 7f11ff7fe640 1 -- 172.21.15.103:0/2569566334 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8041070 con 0x7f11ec002a70 2024-09-10T08:38:52.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.460+0000 7f11ff7fe640 1 -- 172.21.15.103:0/2569566334 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f11f8009490 con 0x7f11ec002a70 2024-09-10T08:38:52.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.460+0000 7f11ff7fe640 1 -- 172.21.15.103:0/2569566334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11ec002a70 msgr2=0x7f11ec004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:52.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.460+0000 7f11ff7fe640 1 --2- 172.21.15.103:0/2569566334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11ec002a70 0x7f11ec004f30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f12080aee90 tx=0x7f11f80046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.460+0000 7f11fdd9b640 1 --2- 172.21.15.103:0/2569566334 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f11e806bf00 0x7f11e806e3c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1208151400 tx=0x7f11f0006c40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:52.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.460+0000 7f11ff7fe640 1 -- 172.21.15.103:0/2569566334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11ec002a70 msgr2=0x7f11ec004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:38:52.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.460+0000 7f11ff7fe640 1 --2- 172.21.15.103:0/2569566334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11ec002a70 0x7f11ec004f30 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f12080aee90 tx=0x7f11f80046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.471+0000 7f120c853640 1 --2- 172.21.15.103:0/2569566334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11ec006eb0 0x7f11ec007340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.471+0000 7f120c853640 1 -- 172.21.15.103:0/2569566334 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f11ec00a4a0 con 0x7f11ec006eb0 2024-09-10T08:38:52.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.471+0000 7f120659c640 1 --2- 172.21.15.103:0/2569566334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11ec006eb0 0x7f11ec007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.472+0000 7f120659c640 1 -- 172.21.15.103:0/2569566334 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f11ec007880 con 0x7f11ec006eb0 2024-09-10T08:38:52.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.473+0000 7f120659c640 1 --2- 172.21.15.103:0/2569566334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11ec006eb0 0x7f11ec007340 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f11f8009870 tx=0x7f11f8009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:52.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.473+0000 7f11ff7fe640 1 -- 172.21.15.103:0/2569566334 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8037040 con 0x7f11ec006eb0 2024-09-10T08:38:52.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.474+0000 7f11ff7fe640 1 -- 172.21.15.103:0/2569566334 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f11f803ce70 con 0x7f11ec006eb0 2024-09-10T08:38:52.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.474+0000 7f11ff7fe640 1 -- 172.21.15.103:0/2569566334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11ec006eb0 msgr2=0x7f11ec007340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:52.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.474+0000 7f11ff7fe640 1 --2- 172.21.15.103:0/2569566334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11ec006eb0 0x7f11ec007340 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f11f8009870 tx=0x7f11f8009240 comp rx=0 tx=0).stop 2024-09-10T08:38:52.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.474+0000 7f11ff7fe640 1 -- 172.21.15.103:0/2569566334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11ec006eb0 msgr2=0x7f11ec007340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:38:52.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.474+0000 7f11ff7fe640 1 --2- 172.21.15.103:0/2569566334 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11ec006eb0 0x7f11ec007340 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f11f8009870 tx=0x7f11f8009240 comp rx=0 tx=0).stop 2024-09-10T08:38:52.475 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:38:52.475 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:38:52.475 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:38:52.475 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:38:52.476 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 84, 2024-09-10T08:38:52.476 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 25308, 2024-09-10T08:38:52.476 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:38:52.476 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:38:52.476 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:38:52.476 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:38:52.476 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:52.476 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 16, 2024-09-10T08:38:52.476 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:38:52.476 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:38:52.476 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:38:52.476 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:52.476 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:52.477 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:52.477 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:52.477 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:52.477 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:52.477 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:52.477 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:52.477 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:52.477 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:52.477 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:52.477 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:52.477 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:38:52.477 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:38:52.478 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:52.478 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:52.478 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:52.478 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:52.478 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:52.478 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:52.478 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:52.478 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:52.478 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:52.478 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:52.478 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:52.478 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:52.478 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.478 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:38:52.479 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:38:52.479 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:38:52.479 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:38:52.479 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:38:52.479 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:38:52.479 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:38:52.479 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:38:52.479 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:38:52.479 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:38:52.479 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:38:52.479 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:38:52.479 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:38:52.479 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:38:52.480 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:38:52.480 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:38:52.480 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:38:52.480 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:38:52.480 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:38:52.480 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:38:52.480 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:38:52.480 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:38:52.480 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:38:52.480 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:38:52.480 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:38:52.481 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:38:52.481 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:38:52.481 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:38:52.481 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:52.481 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:38:52.482 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.482 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:38:52.482 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.482 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:38:52.482 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:38:52.482 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:52.482 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:52.482 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.482 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:52.482 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:38:52.482 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:52.482 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.482 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.483 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:52.483 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:38:52.483 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:52.483 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:52.483 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:52.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.483 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:38:52.483 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:38:52.483 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:52.483 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:52.483 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:52.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.483 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.483 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:38:52.484 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:38:52.484 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:52.484 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:52.484 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.484 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:52.484 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:38:52.484 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:52.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.484 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.484 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:52.484 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:38:52.484 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:52.484 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:52.485 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:52.485 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.485 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:38:52.485 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:38:52.485 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:52.485 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:52.485 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:52.485 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.485 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.485 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:38:52.485 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:38:52.485 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:38:52.485 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:38:52.486 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.486 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:38:52.486 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:38:52.486 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:52.486 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.486 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.486 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:38:52.486 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:38:52.486 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:38:52.486 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:52.486 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:52.486 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.486 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:38:52.486 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:38:52.487 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:38:52.487 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:38:52.487 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:38:52.487 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:52.487 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:52.487 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.487 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:38:52.487 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:38:52.487 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.487 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:52.487 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:52.487 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:38:52.487 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:52.487 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:38:52.488 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:38:52.488 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:38:52.488 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:38:52.488 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:38:52.488 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:38:52.488 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:38:52.488 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:38:52.488 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:38:52.488 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:38:52.488 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:38:52.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.475+0000 7f120c853640 1 -- 172.21.15.103:0/2569566334 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f11e806bf00 msgr2=0x7f11e806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:52.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.475+0000 7f120c853640 1 --2- 172.21.15.103:0/2569566334 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f11e806bf00 0x7f11e806e3c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1208151400 tx=0x7f11f0006c40 comp rx=0 tx=0).stop 2024-09-10T08:38:52.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.475+0000 7f1206d9d640 1 -- 172.21.15.103:0/2569566334 reap_dead start 2024-09-10T08:38:52.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.475+0000 7f120c853640 1 -- 172.21.15.103:0/2569566334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1208153be0 msgr2=0x7f12081f43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:52.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.475+0000 7f120c853640 1 --2- 172.21.15.103:0/2569566334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1208153be0 0x7f12081f43c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f120000c780 tx=0x7f120000cc40 comp rx=0 tx=0).stop 2024-09-10T08:38:52.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.475+0000 7f120c853640 1 -- 172.21.15.103:0/2569566334 shutdown_connections 2024-09-10T08:38:52.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.475+0000 7f120c853640 1 --2- 172.21.15.103:0/2569566334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1208153be0 0x7f12081f43c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.475+0000 7f120c853640 1 -- 172.21.15.103:0/2569566334 >> 172.21.15.103:0/2569566334 conn(0x7f12080c5660 msgr2=0x7f1208152480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:52.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.475+0000 7f120c853640 1 -- 172.21.15.103:0/2569566334 shutdown_connections 2024-09-10T08:38:52.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.475+0000 7f120c853640 1 -- 172.21.15.103:0/2569566334 wait complete. 2024-09-10T08:38:52.494 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:38:52.494 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-10T08:38:52.494 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-10T08:38:52.495 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-10T08:38:52.495 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-10T08:38:52.495 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T08:38:52.495 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:38:52.520 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T08:38:52.521 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-10T08:38:52.521 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:38:52.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.723+0000 7f9730b98640 1 Processor -- start 2024-09-10T08:38:52.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.723+0000 7f9730b98640 1 -- start start 2024-09-10T08:38:52.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.725+0000 7f9730b98640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f972c0c5940 0x7f972c166490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.725+0000 7f9730b98640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c08d440 0x7f972c08d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.725+0000 7f9730b98640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f972c166a70 con 0x7f972c0c26b0 2024-09-10T08:38:52.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.725+0000 7f9730b98640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f972c08ddf0 con 0x7f972c0c5940 2024-09-10T08:38:52.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.725+0000 7f9730b98640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f972c1630c0 con 0x7f972c08d440 2024-09-10T08:38:52.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.725+0000 7f9729d9b640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7f972c0c5940 msgr2=0x7f972c166490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:38:52.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.725+0000 7f9729d9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f972c0c5940 0x7f972c166490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:38:52.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.725+0000 7f972a59c640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7f972c0c26b0 legacy=0x7f972c163550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:38:52.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.725+0000 7f972ad9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c08d440 0x7f972c08d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.725+0000 7f972ad9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c08d440 0x7f972c08d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:37020/0 (socket says 172.21.15.103:37020) 2024-09-10T08:38:52.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.945+0000 7f972ad9d640 1 -- 172.21.15.103:0/4164732244 learned_addr learned my addr 172.21.15.103:0/4164732244 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:52.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.926+0000 7f972a59c640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7f972c0c26b0 legacy=0x7f972c163550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:38:52.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.926+0000 7f9729d9b640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7f972c0c5940 msgr2=0x7f972c166490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:38:52.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.946+0000 7f9729d9b640 1 --2- 172.21.15.103:0/4164732244 >> v2:172.21.15.103:3300/0 conn(0x7f972c0c5940 0x7f972c166490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:38:52.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.946+0000 7f972ad9d640 1 -- 172.21.15.103:0/4164732244 >> v2:172.21.15.103:3300/0 conn(0x7f972c0c5940 msgr2=0x7f972c166490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:38:52.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.946+0000 7f972ad9d640 1 --2- 172.21.15.103:0/4164732244 >> v2:172.21.15.103:3300/0 conn(0x7f972c0c5940 0x7f972c166490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.946+0000 7f972ad9d640 1 -- 172.21.15.103:0/4164732244 >> v1:172.21.15.103:6789/0 conn(0x7f972c0c26b0 legacy=0x7f972c163550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:38:52.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.946+0000 7f972ad9d640 1 -- 172.21.15.103:0/4164732244 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f972c166d50 con 0x7f972c08d440 2024-09-10T08:38:52.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.948+0000 7f972ad9d640 1 --2- 172.21.15.103:0/4164732244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c08d440 0x7f972c08d8b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9724007630 tx=0x7f972402cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9726ecc51c6ba688 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:52.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.949+0000 7f972959a640 1 -- 172.21.15.103:0/4164732244 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9724033070 con 0x7f972c08d440 2024-09-10T08:38:52.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.949+0000 7f972959a640 1 -- 172.21.15.103:0/4164732244 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f972402dbb0 con 0x7f972c08d440 2024-09-10T08:38:52.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.949+0000 7f972959a640 1 -- 172.21.15.103:0/4164732244 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9724037400 con 0x7f972c08d440 2024-09-10T08:38:52.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.950+0000 7f9730b98640 1 -- 172.21.15.103:0/4164732244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c08d440 msgr2=0x7f972c08d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:52.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.950+0000 7f9730b98640 1 --2- 172.21.15.103:0/4164732244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c08d440 0x7f972c08d8b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9724007630 tx=0x7f972402cea0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.950+0000 7f9730b98640 1 -- 172.21.15.103:0/4164732244 shutdown_connections 2024-09-10T08:38:52.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.950+0000 7f9730b98640 1 --2- 172.21.15.103:0/4164732244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c08d440 0x7f972c08d8b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.950+0000 7f9730b98640 1 --2- 172.21.15.103:0/4164732244 >> v2:172.21.15.103:3300/0 conn(0x7f972c0c5940 0x7f972c166490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.950+0000 7f9730b98640 1 -- 172.21.15.103:0/4164732244 >> 172.21.15.103:0/4164732244 conn(0x7f972c0c7a40 msgr2=0x7f972c0c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:52.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.950+0000 7f9730b98640 1 -- 172.21.15.103:0/4164732244 shutdown_connections 2024-09-10T08:38:52.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.950+0000 7f9730b98640 1 -- 172.21.15.103:0/4164732244 wait complete. 2024-09-10T08:38:52.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.952+0000 7f9730b98640 1 Processor -- start 2024-09-10T08:38:52.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.952+0000 7f9730b98640 1 -- start start 2024-09-10T08:38:52.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.953+0000 7f9730b98640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f972c08d440 0x7f972c0aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.953+0000 7f9730b98640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f972c0c26b0 0x7f972c1fd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.953+0000 7f9730b98640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c0c5940 0x7f972c1fd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.953+0000 7f9730b98640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f972c06f2e0 con 0x7f972c08d440 2024-09-10T08:38:52.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.953+0000 7f9730b98640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f972c167310 con 0x7f972c0c26b0 2024-09-10T08:38:52.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.953+0000 7f9730b98640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f972c06f460 con 0x7f972c0c5940 2024-09-10T08:38:52.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.954+0000 7f972a59c640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f972c08d440 msgr2=0x7f972c0aab50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:38:52.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.954+0000 7f972a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f972c08d440 0x7f972c0aab50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:38:52.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.954+0000 7f9729d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f972c0c26b0 0x7f972c1fd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.954+0000 7f9729d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f972c0c26b0 0x7f972c1fd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:52148/0 (socket says 172.21.15.103:52148) 2024-09-10T08:38:52.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.954+0000 7f9729d9b640 1 -- 172.21.15.103:0/3805352179 learned_addr learned my addr 172.21.15.103:0/3805352179 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:52.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.954+0000 7f972ad9d640 1 --2- 172.21.15.103:0/3805352179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c0c5940 0x7f972c1fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.955+0000 7f9729d9b640 1 -- 172.21.15.103:0/3805352179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c0c5940 msgr2=0x7f972c1fd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:52.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.955+0000 7f9729d9b640 1 --2- 172.21.15.103:0/3805352179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c0c5940 0x7f972c1fd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.955+0000 7f9729d9b640 1 -- 172.21.15.103:0/3805352179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f972c08d440 msgr2=0x7f972c0aab50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:38:52.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.955+0000 7f9729d9b640 1 --2- 172.21.15.103:0/3805352179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f972c08d440 0x7f972c0aab50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:52.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.955+0000 7f9729d9b640 1 -- 172.21.15.103:0/3805352179 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f972c0ad5e0 con 0x7f972c0c26b0 2024-09-10T08:38:52.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.955+0000 7f972ad9d640 1 --2- 172.21.15.103:0/3805352179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c0c5940 0x7f972c1fd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:52.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.956+0000 7f9729d9b640 1 --2- 172.21.15.103:0/3805352179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f972c0c26b0 0x7f972c1fd3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f972000b480 tx=0x7f972000b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:52.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.957+0000 7f971affd640 1 -- 172.21.15.103:0/3805352179 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9720016070 con 0x7f972c0c26b0 2024-09-10T08:38:52.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.957+0000 7f971affd640 1 -- 172.21.15.103:0/3805352179 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9720003dc0 con 0x7f972c0c26b0 2024-09-10T08:38:52.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.957+0000 7f971affd640 1 -- 172.21.15.103:0/3805352179 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97200062f0 con 0x7f972c0c26b0 2024-09-10T08:38:52.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.958+0000 7f9730b98640 1 -- 172.21.15.103:0/3805352179 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f972c0ad8c0 con 0x7f972c0c26b0 2024-09-10T08:38:52.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.958+0000 7f9730b98640 1 -- 172.21.15.103:0/3805352179 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f972c1f32e0 con 0x7f972c0c26b0 2024-09-10T08:38:52.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.960+0000 7f9730b98640 1 -- 172.21.15.103:0/3805352179 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f972c0c62f0 con 0x7f972c0c26b0 2024-09-10T08:38:52.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.961+0000 7f971affd640 1 -- 172.21.15.103:0/3805352179 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9720019070 con 0x7f972c0c26b0 2024-09-10T08:38:52.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.962+0000 7f971affd640 1 --2- 172.21.15.103:0/3805352179 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f970c06be60 0x7f970c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:52.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.962+0000 7f971affd640 1 -- 172.21.15.103:0/3805352179 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f972008a9e0 con 0x7f972c0c26b0 2024-09-10T08:38:52.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.962+0000 7f972a59c640 1 --2- 172.21.15.103:0/3805352179 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f970c06be60 0x7f970c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:52.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.963+0000 7f972a59c640 1 --2- 172.21.15.103:0/3805352179 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f970c06be60 0x7f970c06e320 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f971c006fd0 tx=0x7f971c006da0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:52.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:52.969+0000 7f971affd640 1 -- 172.21.15.103:0/3805352179 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9720020020 con 0x7f972c0c26b0 2024-09-10T08:38:53.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:53.429+0000 7f9730b98640 1 -- 172.21.15.103:0/3805352179 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f972c0c7fc0 con 0x7f972c0c26b0 2024-09-10T08:38:53.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:53.430+0000 7f971affd640 1 -- 172.21.15.103:0/3805352179 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f9720058a10 con 0x7f972c0c26b0 2024-09-10T08:38:53.431 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":84,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:38:53.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:53.433+0000 7f9730b98640 1 -- 172.21.15.103:0/3805352179 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f970c06be60 msgr2=0x7f970c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:53.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:53.433+0000 7f9730b98640 1 --2- 172.21.15.103:0/3805352179 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f970c06be60 0x7f970c06e320 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f971c006fd0 tx=0x7f971c006da0 comp rx=0 tx=0).stop 2024-09-10T08:38:53.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:53.433+0000 7f9730b98640 1 -- 172.21.15.103:0/3805352179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f972c0c26b0 msgr2=0x7f972c1fd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:53.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:53.434+0000 7f9730b98640 1 --2- 172.21.15.103:0/3805352179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f972c0c26b0 0x7f972c1fd3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f972000b480 tx=0x7f972000b940 comp rx=0 tx=0).stop 2024-09-10T08:38:53.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:53.434+0000 7f9730b98640 1 -- 172.21.15.103:0/3805352179 shutdown_connections 2024-09-10T08:38:53.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:53.434+0000 7f9730b98640 1 --2- 172.21.15.103:0/3805352179 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f970c06be60 0x7f970c06e320 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:53.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:53.434+0000 7f9730b98640 1 --2- 172.21.15.103:0/3805352179 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c0c5940 0x7f972c1fd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:53.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:53.434+0000 7f9730b98640 1 --2- 172.21.15.103:0/3805352179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f972c0c26b0 0x7f972c1fd3c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:53.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:53.434+0000 7f9730b98640 1 --2- 172.21.15.103:0/3805352179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f972c08d440 0x7f972c0aab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:53.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:53.434+0000 7f9730b98640 1 -- 172.21.15.103:0/3805352179 >> 172.21.15.103:0/3805352179 conn(0x7f972c0c7a40 msgr2=0x7f972c06e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:53.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:53.434+0000 7f9730b98640 1 -- 172.21.15.103:0/3805352179 shutdown_connections 2024-09-10T08:38:53.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:53.434+0000 7f9730b98640 1 -- 172.21.15.103:0/3805352179 wait complete. 2024-09-10T08:38:56.452 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:38:56.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.604+0000 7fcb425c4640 1 Processor -- start 2024-09-10T08:38:56.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.604+0000 7fcb425c4640 1 -- start start 2024-09-10T08:38:56.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.605+0000 7fcb425c4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb34006a30 0x7fcb34006e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.605+0000 7fcb425c4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb3404a7c0 0x7fcb340d30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.606+0000 7fcb425c4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcb340d3630 0x7fcb340d92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.606+0000 7fcb425c4640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fcb340478c0 con 0x7fcb340d3630 2024-09-10T08:38:56.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.606+0000 7fcb425c4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fcb34045c30 con 0x7fcb3404a7c0 2024-09-10T08:38:56.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.606+0000 7fcb425c4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcb34046960 con 0x7fcb34006a30 2024-09-10T08:38:56.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.606+0000 7fcb40b61640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7fcb340d3630 msgr2=0x7fcb340d92a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:38:56.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.606+0000 7fcb40b61640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcb340d3630 0x7fcb340d92a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:38:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.606+0000 7fcb3bfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb34006a30 0x7fcb34006e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.606+0000 7fcb3bfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb34006a30 0x7fcb34006e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:55186/0 (socket says 172.21.15.103:55186) 2024-09-10T08:38:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.606+0000 7fcb3bfff640 1 -- 172.21.15.103:0/3975316253 learned_addr learned my addr 172.21.15.103:0/3975316253 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.606+0000 7fcb3b7fe640 1 --2- 172.21.15.103:0/3975316253 >> v2:172.21.15.154:3300/0 conn(0x7fcb3404a7c0 0x7fcb340d30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.607+0000 7fcb3bfff640 1 -- 172.21.15.103:0/3975316253 >> v2:172.21.15.154:3300/0 conn(0x7fcb3404a7c0 msgr2=0x7fcb340d30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.607+0000 7fcb3bfff640 1 --2- 172.21.15.103:0/3975316253 >> v2:172.21.15.154:3300/0 conn(0x7fcb3404a7c0 0x7fcb340d30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.607+0000 7fcb3bfff640 1 -- 172.21.15.103:0/3975316253 >> v2:172.21.15.103:3300/0 conn(0x7fcb340d3630 msgr2=0x7fcb340d92a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:38:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.607+0000 7fcb3bfff640 1 --2- 172.21.15.103:0/3975316253 >> v2:172.21.15.103:3300/0 conn(0x7fcb340d3630 0x7fcb340d92a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.607+0000 7fcb3bfff640 1 -- 172.21.15.103:0/3975316253 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb3404ad60 con 0x7fcb34006a30 2024-09-10T08:38:56.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.609+0000 7fcb3bfff640 1 --2- 172.21.15.103:0/3975316253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb34006a30 0x7fcb34006e10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcb34048ba0 tx=0x7fcb3002c5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53d7ec8dba7867a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.609+0000 7fcb3affd640 1 -- 172.21.15.103:0/3975316253 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3003a070 con 0x7fcb34006a30 2024-09-10T08:38:56.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.610+0000 7fcb3affd640 1 -- 172.21.15.103:0/3975316253 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb30035410 con 0x7fcb34006a30 2024-09-10T08:38:56.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.610+0000 7fcb3affd640 1 -- 172.21.15.103:0/3975316253 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb300357e0 con 0x7fcb34006a30 2024-09-10T08:38:56.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.610+0000 7fcb425c4640 1 -- 172.21.15.103:0/3975316253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb34006a30 msgr2=0x7fcb34006e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.610+0000 7fcb425c4640 1 --2- 172.21.15.103:0/3975316253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb34006a30 0x7fcb34006e10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcb34048ba0 tx=0x7fcb3002c5d0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.611+0000 7fcb425c4640 1 -- 172.21.15.103:0/3975316253 shutdown_connections 2024-09-10T08:38:56.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.611+0000 7fcb425c4640 1 --2- 172.21.15.103:0/3975316253 >> v2:172.21.15.154:3300/0 conn(0x7fcb3404a7c0 0x7fcb340d30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.611+0000 7fcb425c4640 1 --2- 172.21.15.103:0/3975316253 >> v2:172.21.15.103:3300/0 conn(0x7fcb340d3630 0x7fcb340d92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.611+0000 7fcb425c4640 1 --2- 172.21.15.103:0/3975316253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb34006a30 0x7fcb34006e10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.611+0000 7fcb425c4640 1 -- 172.21.15.103:0/3975316253 >> 172.21.15.103:0/3975316253 conn(0x7fcb34047d30 msgr2=0x7fcb34048140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:56.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.611+0000 7fcb425c4640 1 -- 172.21.15.103:0/3975316253 shutdown_connections 2024-09-10T08:38:56.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.611+0000 7fcb425c4640 1 -- 172.21.15.103:0/3975316253 wait complete. 2024-09-10T08:38:56.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.612+0000 7fcb425c4640 1 Processor -- start 2024-09-10T08:38:56.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.613+0000 7fcb425c4640 1 -- start start 2024-09-10T08:38:56.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.614+0000 7fcb425c4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb34006a30 0x7fcb34172bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.614+0000 7fcb425c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb3404a7c0 0x7fcb34035800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.614+0000 7fcb425c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb340d3630 0x7fcb340d26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.614+0000 7fcb425c4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcb34046440 con 0x7fcb340d3630 2024-09-10T08:38:56.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.614+0000 7fcb425c4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcb34046160 con 0x7fcb3404a7c0 2024-09-10T08:38:56.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.614+0000 7fcb425c4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fcb340491b0 con 0x7fcb34006a30 2024-09-10T08:38:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.614+0000 7fcb40b61640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb340d3630 msgr2=0x7fcb340d26d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:38:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.614+0000 7fcb40b61640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb340d3630 0x7fcb340d26d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:38:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.614+0000 7fcb3b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb3404a7c0 0x7fcb34035800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.614+0000 7fcb3b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb3404a7c0 0x7fcb34035800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:40766/0 (socket says 172.21.15.103:40766) 2024-09-10T08:38:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.614+0000 7fcb3b7fe640 1 -- 172.21.15.103:0/1806328806 learned_addr learned my addr 172.21.15.103:0/1806328806 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:38:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.615+0000 7fcb3bfff640 1 --2- 172.21.15.103:0/1806328806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb34006a30 0x7fcb34172bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.615+0000 7fcb3b7fe640 1 -- 172.21.15.103:0/1806328806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb34006a30 msgr2=0x7fcb34172bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.615+0000 7fcb3b7fe640 1 --2- 172.21.15.103:0/1806328806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb34006a30 0x7fcb34172bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.615+0000 7fcb3b7fe640 1 -- 172.21.15.103:0/1806328806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb340d3630 msgr2=0x7fcb340d26d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:38:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.615+0000 7fcb3b7fe640 1 --2- 172.21.15.103:0/1806328806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb340d3630 0x7fcb340d26d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.615+0000 7fcb3b7fe640 1 -- 172.21.15.103:0/1806328806 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb341734f0 con 0x7fcb3404a7c0 2024-09-10T08:38:56.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.616+0000 7fcb3b7fe640 1 --2- 172.21.15.103:0/1806328806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb3404a7c0 0x7fcb34035800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800d800 tx=0x7fcb2800dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.616+0000 7fcb38ff9640 1 -- 172.21.15.103:0/1806328806 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2800b6c0 con 0x7fcb3404a7c0 2024-09-10T08:38:56.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.616+0000 7fcb425c4640 1 -- 172.21.15.103:0/1806328806 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb341737d0 con 0x7fcb3404a7c0 2024-09-10T08:38:56.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.616+0000 7fcb425c4640 1 -- 172.21.15.103:0/1806328806 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb340d74a0 con 0x7fcb3404a7c0 2024-09-10T08:38:56.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.616+0000 7fcb38ff9640 1 -- 172.21.15.103:0/1806328806 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb28019070 con 0x7fcb3404a7c0 2024-09-10T08:38:56.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.616+0000 7fcb38ff9640 1 -- 172.21.15.103:0/1806328806 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2800ba60 con 0x7fcb3404a7c0 2024-09-10T08:38:56.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.617+0000 7fcb425c4640 1 -- 172.21.15.103:0/1806328806 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb1c005290 con 0x7fcb3404a7c0 2024-09-10T08:38:56.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.619+0000 7fcb38ff9640 1 -- 172.21.15.103:0/1806328806 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb2800bc00 con 0x7fcb3404a7c0 2024-09-10T08:38:56.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.620+0000 7fcb38ff9640 1 --2- 172.21.15.103:0/1806328806 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb2006bd90 0x7fcb2006e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.620+0000 7fcb3bfff640 1 --2- 172.21.15.103:0/1806328806 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb2006bd90 0x7fcb2006e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.621+0000 7fcb3bfff640 1 --2- 172.21.15.103:0/1806328806 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb2006bd90 0x7fcb2006e250 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcb30037000 tx=0x7fcb3000a040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.621+0000 7fcb38ff9640 1 -- 172.21.15.103:0/1806328806 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fcb2808c200 con 0x7fcb3404a7c0 2024-09-10T08:38:56.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:56.626+0000 7fcb38ff9640 1 -- 172.21.15.103:0/1806328806 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb28023020 con 0x7fcb3404a7c0 2024-09-10T08:38:57.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:57.082+0000 7fcb425c4640 1 -- 172.21.15.103:0/1806328806 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcb1c005580 con 0x7fcb3404a7c0 2024-09-10T08:38:57.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:57.083+0000 7fcb38ff9640 1 -- 172.21.15.103:0/1806328806 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fcb2805a800 con 0x7fcb3404a7c0 2024-09-10T08:38:57.084 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":84,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:38:57.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:57.087+0000 7fcb425c4640 1 -- 172.21.15.103:0/1806328806 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb2006bd90 msgr2=0x7fcb2006e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:57.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:57.087+0000 7fcb425c4640 1 --2- 172.21.15.103:0/1806328806 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb2006bd90 0x7fcb2006e250 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcb30037000 tx=0x7fcb3000a040 comp rx=0 tx=0).stop 2024-09-10T08:38:57.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:57.087+0000 7fcb425c4640 1 -- 172.21.15.103:0/1806328806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb3404a7c0 msgr2=0x7fcb34035800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:57.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:57.087+0000 7fcb425c4640 1 --2- 172.21.15.103:0/1806328806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb3404a7c0 0x7fcb34035800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800d800 tx=0x7fcb2800dcc0 comp rx=0 tx=0).stop 2024-09-10T08:38:57.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:57.087+0000 7fcb425c4640 1 -- 172.21.15.103:0/1806328806 shutdown_connections 2024-09-10T08:38:57.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:57.087+0000 7fcb425c4640 1 --2- 172.21.15.103:0/1806328806 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fcb2006bd90 0x7fcb2006e250 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:57.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:57.087+0000 7fcb425c4640 1 --2- 172.21.15.103:0/1806328806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb340d3630 0x7fcb340d26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:57.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:57.087+0000 7fcb425c4640 1 --2- 172.21.15.103:0/1806328806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb3404a7c0 0x7fcb34035800 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:57.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:57.087+0000 7fcb425c4640 1 --2- 172.21.15.103:0/1806328806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb34006a30 0x7fcb34172bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:57.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:57.087+0000 7fcb425c4640 1 -- 172.21.15.103:0/1806328806 >> 172.21.15.103:0/1806328806 conn(0x7fcb34047d30 msgr2=0x7fcb340d5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:57.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:57.087+0000 7fcb425c4640 1 -- 172.21.15.103:0/1806328806 shutdown_connections 2024-09-10T08:38:57.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:38:57.088+0000 7fcb425c4640 1 -- 172.21.15.103:0/1806328806 wait complete. 2024-09-10T08:39:00.106 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:39:00.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.272+0000 7ff285ac8640 1 Processor -- start 2024-09-10T08:39:00.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.272+0000 7ff285ac8640 1 -- start start 2024-09-10T08:39:00.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.273+0000 7ff285ac8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff27804dc50 0x7ff278005d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:00.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.273+0000 7ff285ac8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff278049fb0 0x7ff27804a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:00.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.273+0000 7ff285ac8640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2780da8b0 con 0x7ff2780d7880 2024-09-10T08:39:00.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.273+0000 7ff285ac8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7ff2780dab90 con 0x7ff278049fb0 2024-09-10T08:39:00.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.273+0000 7ff285ac8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff27804e320 con 0x7ff27804dc50 2024-09-10T08:39:00.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.273+0000 7ff2852c7640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7ff278049fb0 msgr2=0x7ff27804a440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:39:00.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.273+0000 7ff2852c7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff278049fb0 0x7ff27804a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:00.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.273+0000 7ff284ac6640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7ff2780d7880 legacy=0x7ff27804ee00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:39:00.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.273+0000 7ff27ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff27804dc50 0x7ff278005d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:00.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.273+0000 7ff27ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff27804dc50 0x7ff278005d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:55202/0 (socket says 172.21.15.103:55202) 2024-09-10T08:39:00.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.273+0000 7ff27ffff640 1 -- 172.21.15.103:0/2275748712 learned_addr learned my addr 172.21.15.103:0/2275748712 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:39:00.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.274+0000 7ff27ffff640 1 -- 172.21.15.103:0/2275748712 >> v2:172.21.15.103:3300/0 conn(0x7ff278049fb0 msgr2=0x7ff27804a440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:39:00.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.274+0000 7ff27ffff640 1 --2- 172.21.15.103:0/2275748712 >> v2:172.21.15.103:3300/0 conn(0x7ff278049fb0 0x7ff27804a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.274+0000 7ff27ffff640 1 -- 172.21.15.103:0/2275748712 >> v1:172.21.15.103:6789/0 conn(0x7ff2780d7880 legacy=0x7ff27804ee00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:39:00.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.274+0000 7ff27ffff640 1 -- 172.21.15.103:0/2275748712 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27804e600 con 0x7ff27804dc50 2024-09-10T08:39:00.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.275+0000 7ff27ffff640 1 --2- 172.21.15.103:0/2275748712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff27804dc50 0x7ff278005d20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff270009870 tx=0x7ff27002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee5bd90ce6a22b64 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:00.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.275+0000 7ff27f7fe640 1 -- 172.21.15.103:0/2275748712 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270037070 con 0x7ff27804dc50 2024-09-10T08:39:00.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.275+0000 7ff27f7fe640 1 -- 172.21.15.103:0/2275748712 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff270032440 con 0x7ff27804dc50 2024-09-10T08:39:00.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.275+0000 7ff27f7fe640 1 -- 172.21.15.103:0/2275748712 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270032810 con 0x7ff27804dc50 2024-09-10T08:39:00.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.276+0000 7ff285ac8640 1 -- 172.21.15.103:0/2275748712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff27804dc50 msgr2=0x7ff278005d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:00.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.276+0000 7ff285ac8640 1 --2- 172.21.15.103:0/2275748712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff27804dc50 0x7ff278005d20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff270009870 tx=0x7ff27002a180 comp rx=0 tx=0).stop 2024-09-10T08:39:00.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.277+0000 7ff285ac8640 1 -- 172.21.15.103:0/2275748712 shutdown_connections 2024-09-10T08:39:00.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.277+0000 7ff285ac8640 1 --2- 172.21.15.103:0/2275748712 >> v2:172.21.15.103:3300/0 conn(0x7ff278049fb0 0x7ff27804a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.277+0000 7ff285ac8640 1 --2- 172.21.15.103:0/2275748712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff27804dc50 0x7ff278005d20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.277+0000 7ff285ac8640 1 -- 172.21.15.103:0/2275748712 >> 172.21.15.103:0/2275748712 conn(0x7ff27804c0b0 msgr2=0x7ff27804c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:00.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.277+0000 7ff285ac8640 1 -- 172.21.15.103:0/2275748712 shutdown_connections 2024-09-10T08:39:00.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.277+0000 7ff285ac8640 1 -- 172.21.15.103:0/2275748712 wait complete. 2024-09-10T08:39:00.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.281+0000 7ff285ac8640 1 Processor -- start 2024-09-10T08:39:00.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.281+0000 7ff285ac8640 1 -- start start 2024-09-10T08:39:00.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.282+0000 7ff285ac8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff278049fb0 0x7ff278166e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:00.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.282+0000 7ff285ac8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff27804dc50 0x7ff2780d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:00.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.282+0000 7ff27ffff640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff27804dc50 msgr2=0x7ff2780d08c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:39:00.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.282+0000 7ff27ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff27804dc50 0x7ff2780d08c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:00.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.283+0000 7ff285ac8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2780d7880 0x7ff2780d0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:00.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.283+0000 7ff285ac8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff278042de0 con 0x7ff27804dc50 2024-09-10T08:39:00.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.283+0000 7ff285ac8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff27804a980 con 0x7ff2780d7880 2024-09-10T08:39:00.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.283+0000 7ff285ac8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff278042f60 con 0x7ff278049fb0 2024-09-10T08:39:00.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.283+0000 7ff284ac6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff278049fb0 0x7ff278166e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:00.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.283+0000 7ff284ac6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff278049fb0 0x7ff278166e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:55208/0 (socket says 172.21.15.103:55208) 2024-09-10T08:39:00.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.283+0000 7ff284ac6640 1 -- 172.21.15.103:0/3122512816 learned_addr learned my addr 172.21.15.103:0/3122512816 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:39:00.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.283+0000 7ff2852c7640 1 --2- 172.21.15.103:0/3122512816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2780d7880 0x7ff2780d0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:00.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.284+0000 7ff284ac6640 1 -- 172.21.15.103:0/3122512816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2780d7880 msgr2=0x7ff2780d0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:00.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.284+0000 7ff284ac6640 1 --2- 172.21.15.103:0/3122512816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2780d7880 0x7ff2780d0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.284+0000 7ff284ac6640 1 -- 172.21.15.103:0/3122512816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff27804dc50 msgr2=0x7ff2780d08c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:39:00.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.284+0000 7ff284ac6640 1 --2- 172.21.15.103:0/3122512816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff27804dc50 0x7ff2780d08c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.284+0000 7ff284ac6640 1 -- 172.21.15.103:0/3122512816 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff278046820 con 0x7ff278049fb0 2024-09-10T08:39:00.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.284+0000 7ff284ac6640 1 --2- 172.21.15.103:0/3122512816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff278049fb0 0x7ff278166e50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff27400b550 tx=0x7ff27400ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:00.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.284+0000 7ff27d7fa640 1 -- 172.21.15.103:0/3122512816 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff274003dc0 con 0x7ff278049fb0 2024-09-10T08:39:00.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.285+0000 7ff285ac8640 1 -- 172.21.15.103:0/3122512816 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff278049240 con 0x7ff278049fb0 2024-09-10T08:39:00.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.285+0000 7ff27d7fa640 1 -- 172.21.15.103:0/3122512816 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff274015070 con 0x7ff278049fb0 2024-09-10T08:39:00.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.285+0000 7ff27d7fa640 1 -- 172.21.15.103:0/3122512816 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff274005270 con 0x7ff278049fb0 2024-09-10T08:39:00.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.285+0000 7ff285ac8640 1 -- 172.21.15.103:0/3122512816 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff278167390 con 0x7ff278049fb0 2024-09-10T08:39:00.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.286+0000 7ff285ac8640 1 -- 172.21.15.103:0/3122512816 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff27804d530 con 0x7ff278049fb0 2024-09-10T08:39:00.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.288+0000 7ff27d7fa640 1 -- 172.21.15.103:0/3122512816 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff274005410 con 0x7ff278049fb0 2024-09-10T08:39:00.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.288+0000 7ff27d7fa640 1 --2- 172.21.15.103:0/3122512816 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff26c06bde0 0x7ff26c06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:00.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.289+0000 7ff27ffff640 1 --2- 172.21.15.103:0/3122512816 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff26c06bde0 0x7ff26c06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:00.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.289+0000 7ff27d7fa640 1 -- 172.21.15.103:0/3122512816 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7ff27408b280 con 0x7ff278049fb0 2024-09-10T08:39:00.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.290+0000 7ff27ffff640 1 --2- 172.21.15.103:0/3122512816 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff26c06bde0 0x7ff26c06e2a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff270034000 tx=0x7ff27002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:00.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.296+0000 7ff27d7fa640 1 -- 172.21.15.103:0/3122512816 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff274059880 con 0x7ff278049fb0 2024-09-10T08:39:00.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.777+0000 7ff285ac8640 1 -- 172.21.15.103:0/3122512816 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff27804ce30 con 0x7ff278049fb0 2024-09-10T08:39:00.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.778+0000 7ff27d7fa640 1 -- 172.21.15.103:0/3122512816 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7ff274059180 con 0x7ff278049fb0 2024-09-10T08:39:00.780 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":84,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:39:00.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.781+0000 7ff285ac8640 1 -- 172.21.15.103:0/3122512816 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff26c06bde0 msgr2=0x7ff26c06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:00.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.781+0000 7ff285ac8640 1 --2- 172.21.15.103:0/3122512816 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff26c06bde0 0x7ff26c06e2a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff270034000 tx=0x7ff27002e000 comp rx=0 tx=0).stop 2024-09-10T08:39:00.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.782+0000 7ff285ac8640 1 -- 172.21.15.103:0/3122512816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff278049fb0 msgr2=0x7ff278166e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:00.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.782+0000 7ff285ac8640 1 --2- 172.21.15.103:0/3122512816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff278049fb0 0x7ff278166e50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff27400b550 tx=0x7ff27400ba10 comp rx=0 tx=0).stop 2024-09-10T08:39:00.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.782+0000 7ff285ac8640 1 -- 172.21.15.103:0/3122512816 shutdown_connections 2024-09-10T08:39:00.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.782+0000 7ff285ac8640 1 --2- 172.21.15.103:0/3122512816 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff26c06bde0 0x7ff26c06e2a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.782+0000 7ff285ac8640 1 --2- 172.21.15.103:0/3122512816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2780d7880 0x7ff2780d0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.782+0000 7ff285ac8640 1 --2- 172.21.15.103:0/3122512816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff27804dc50 0x7ff2780d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.782+0000 7ff285ac8640 1 --2- 172.21.15.103:0/3122512816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff278049fb0 0x7ff278166e50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.782+0000 7ff285ac8640 1 -- 172.21.15.103:0/3122512816 >> 172.21.15.103:0/3122512816 conn(0x7ff27804c0b0 msgr2=0x7ff2781653c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:00.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.782+0000 7ff285ac8640 1 -- 172.21.15.103:0/3122512816 shutdown_connections 2024-09-10T08:39:00.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:00.782+0000 7ff285ac8640 1 -- 172.21.15.103:0/3122512816 wait complete. 2024-09-10T08:39:02.126 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:39:02.129 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:39:03.801 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:39:03.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:03.967+0000 7f3a9d43c640 1 Processor -- start 2024-09-10T08:39:03.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:03.967+0000 7f3a9d43c640 1 -- start start 2024-09-10T08:39:03.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:03.968+0000 7f3a9d43c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a98155d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:03.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:03.968+0000 7f3a9d43c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3a98074230 0x7f3a981562a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:03.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:03.969+0000 7f3a9d43c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a98152890 con 0x7f3a9814fa00 2024-09-10T08:39:03.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:03.969+0000 7f3a9d43c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f3a980bd0d0 con 0x7f3a98074230 2024-09-10T08:39:03.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:03.969+0000 7f3a977fe640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7f3a98074230 msgr2=0x7f3a981562a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:39:03.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:03.969+0000 7f3a9d43c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3a98152b70 con 0x7f3a98152320 2024-09-10T08:39:03.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:03.969+0000 7f3a977fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3a98074230 0x7f3a981562a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:03.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:03.969+0000 7f3a967fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a98155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:03.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:03.969+0000 7f3a967fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a98155d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:40796/0 (socket says 172.21.15.103:40796) 2024-09-10T08:39:03.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:03.969+0000 7f3a96ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3a9814fa00 0x7f3a9806e4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:39648/0 (socket says 172.21.15.103:39648) 2024-09-10T08:39:03.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:03.969+0000 7f3a967fc640 1 -- 172.21.15.103:0/3536011195 learned_addr learned my addr 172.21.15.103:0/3536011195 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:39:03.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:03.969+0000 7f3a967fc640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 msgr2=0x7f3a98155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:39:03.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:03.969+0000 7f3a967fc640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 msgr2=0x7f3a98155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:03.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:03.969+0000 7f3a967fc640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a98155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:03.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:03.969+0000 7f3a967fc640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a98155d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:04.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:04.170+0000 7f3a977fe640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.103:3300/0 conn(0x7f3a98074230 msgr2=0x7f3a981562a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:39:04.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:04.170+0000 7f3a977fe640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.103:3300/0 conn(0x7f3a98074230 0x7f3a981562a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:39:04.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:04.170+0000 7f3a967fc640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a98155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:04.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:04.170+0000 7f3a967fc640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 msgr2=0x7f3a98155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:39:04.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:04.170+0000 7f3a967fc640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 msgr2=0x7f3a98155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:04.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:04.170+0000 7f3a967fc640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a98155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:04.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:04.170+0000 7f3a967fc640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a98155d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:39:04.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:04.571+0000 7f3a977fe640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.103:3300/0 conn(0x7f3a98074230 msgr2=0x7f3a981562a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:39:04.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:04.571+0000 7f3a977fe640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.103:3300/0 conn(0x7f3a98074230 0x7f3a981562a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:39:04.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:04.571+0000 7f3a967fc640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a98155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:04.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:04.571+0000 7f3a967fc640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 msgr2=0x7f3a98155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:39:04.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:04.571+0000 7f3a967fc640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 msgr2=0x7f3a98155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:04.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:04.571+0000 7f3a967fc640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a98155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:04.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:04.571+0000 7f3a967fc640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a98155d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:39:05.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:05.372+0000 7f3a977fe640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.103:3300/0 conn(0x7f3a98074230 msgr2=0x7f3a981562a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:39:05.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:05.372+0000 7f3a977fe640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.103:3300/0 conn(0x7f3a98074230 0x7f3a981562a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:39:05.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:05.373+0000 7f3a967fc640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a98155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:05.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:05.374+0000 7f3a967fc640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 msgr2=0x7f3a98155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:39:05.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:05.374+0000 7f3a967fc640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 msgr2=0x7f3a98155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:05.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:05.374+0000 7f3a967fc640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a98155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:05.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:05.374+0000 7f3a967fc640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a98155d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:39:06.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:06.968+0000 7f3a94ff9640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 msgr2=0x7f3a98155d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:39:06.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:06.968+0000 7f3a94ff9640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a98155d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:06.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:06.969+0000 7f3a94ff9640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.103:3300/0 conn(0x7f3a98074230 msgr2=0x7f3a981562a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:39:06.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:06.969+0000 7f3a94ff9640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.103:3300/0 conn(0x7f3a98074230 0x7f3a981562a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:06.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:06.969+0000 7f3a94ff9640 1 -- 172.21.15.103:0/3536011195 >> v1:172.21.15.154:6789/0 conn(0x7f3a9814fa00 legacy=0x7f3a9806e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:06.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:06.969+0000 7f3a94ff9640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 0x7f3a84005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:06.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:06.969+0000 7f3a967fc640 1 -- 172.21.15.103:0/3536011195 >> v1:172.21.15.103:6789/0 conn(0x7f3a84006150 legacy=0x7f3a84008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:39:06.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:06.969+0000 7f3a94ff9640 1 -- 172.21.15.103:0/3536011195 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a98152e50 con 0x7f3a84006150 2024-09-10T08:39:06.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:06.969+0000 7f3a94ff9640 1 -- 172.21.15.103:0/3536011195 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3a98152b70 con 0x7f3a84003690 2024-09-10T08:39:06.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:06.969+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 0x7f3a84005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:06.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:06.969+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 msgr2=0x7f3a84005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:39:06.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:06.969+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 msgr2=0x7f3a84005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:06.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:06.969+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 0x7f3a84005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:06.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:06.969+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 0x7f3a84005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:07.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:07.170+0000 7f3a967fc640 1 -- 172.21.15.103:0/3536011195 >> v1:172.21.15.103:6789/0 conn(0x7f3a84006150 legacy=0x7f3a84008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:39:07.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:07.171+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 0x7f3a84005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:07.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:07.172+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 msgr2=0x7f3a84005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:39:07.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:07.172+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 msgr2=0x7f3a84005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:07.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:07.172+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 0x7f3a84005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:07.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:07.172+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 0x7f3a84005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:39:07.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:07.571+0000 7f3a967fc640 1 -- 172.21.15.103:0/3536011195 >> v1:172.21.15.103:6789/0 conn(0x7f3a84006150 legacy=0x7f3a84008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:39:07.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:07.574+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 0x7f3a84005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:07.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:07.574+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 msgr2=0x7f3a84005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:39:07.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:07.574+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 msgr2=0x7f3a84005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:07.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:07.574+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 0x7f3a84005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:07.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:07.574+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 0x7f3a84005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:39:08.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:08.372+0000 7f3a967fc640 1 -- 172.21.15.103:0/3536011195 >> v1:172.21.15.103:6789/0 conn(0x7f3a84006150 legacy=0x7f3a84008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:39:08.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:08.375+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 0x7f3a84005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:08.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:08.375+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 msgr2=0x7f3a84005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:39:08.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:08.375+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 msgr2=0x7f3a84005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:08.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:08.375+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 0x7f3a84005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:08.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:08.375+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 0x7f3a84005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:39:09.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:09.969+0000 7f3a94ff9640 1 -- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 msgr2=0x7f3a84005ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:39:09.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:09.969+0000 7f3a94ff9640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a84003690 0x7f3a84005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:09.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:09.969+0000 7f3a94ff9640 1 -- 172.21.15.103:0/3536011195 >> v1:172.21.15.103:6789/0 conn(0x7f3a84006150 legacy=0x7f3a84008610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:39:09.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:09.969+0000 7f3a94ff9640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a84009eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:09.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:09.969+0000 7f3a977fe640 1 -- 172.21.15.103:0/3536011195 reap_dead start 2024-09-10T08:39:09.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:09.969+0000 7f3a94ff9640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.103:3300/0 conn(0x7f3a8400a3f0 0x7f3a8400a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:09.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:09.969+0000 7f3a967fc640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.103:3300/0 conn(0x7f3a8400a3f0 msgr2=0x7f3a8400a810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:39:09.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:09.969+0000 7f3a967fc640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.103:3300/0 conn(0x7f3a8400a3f0 0x7f3a8400a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:09.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:09.970+0000 7f3a94ff9640 1 -- 172.21.15.103:0/3536011195 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a8400b010 con 0x7f3a84008610 2024-09-10T08:39:09.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:09.970+0000 7f3a94ff9640 1 -- 172.21.15.103:0/3536011195 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f3a98152b70 con 0x7f3a8400a3f0 2024-09-10T08:39:09.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:09.970+0000 7f3a94ff9640 1 -- 172.21.15.103:0/3536011195 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3a840094f0 con 0x7f3a98152320 2024-09-10T08:39:09.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:09.970+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a84009eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:09.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:09.971+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 msgr2=0x7f3a84009eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:39:09.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:09.971+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 msgr2=0x7f3a84009eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:09.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:09.971+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a84009eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:09.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:09.971+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a84009eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:10.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:10.170+0000 7f3a967fc640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.103:3300/0 conn(0x7f3a8400a3f0 msgr2=0x7f3a8400a810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:39:10.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:10.170+0000 7f3a967fc640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.103:3300/0 conn(0x7f3a8400a3f0 0x7f3a8400a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:39:10.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:10.172+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a84009eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:10.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:10.172+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 msgr2=0x7f3a84009eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:39:10.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:10.172+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 msgr2=0x7f3a84009eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:10.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:10.172+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a84009eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:10.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:10.172+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a84009eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:39:10.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:10.571+0000 7f3a967fc640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.103:3300/0 conn(0x7f3a8400a3f0 msgr2=0x7f3a8400a810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:39:10.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:10.571+0000 7f3a967fc640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.103:3300/0 conn(0x7f3a8400a3f0 0x7f3a8400a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:39:10.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:10.573+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a84009eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:10.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:10.573+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 msgr2=0x7f3a84009eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:39:10.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:10.573+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 msgr2=0x7f3a84009eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:10.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:10.573+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a84009eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:10.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:10.573+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a84009eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:39:11.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.372+0000 7f3a967fc640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.103:3300/0 conn(0x7f3a8400a3f0 msgr2=0x7f3a8400a810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:39:11.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.372+0000 7f3a967fc640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.103:3300/0 conn(0x7f3a8400a3f0 0x7f3a8400a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:39:11.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.375+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a84009eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:11.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.375+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 msgr2=0x7f3a84009eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:39:11.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.375+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 msgr2=0x7f3a84009eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:11.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.375+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a84009eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:11.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.375+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a84009eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:39:11.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.598+0000 7f3a95ffb640 1 -- 172.21.15.103:0/3536011195 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 328469727 0 0) 0x7f3a8400b010 con 0x7f3a84008610 2024-09-10T08:39:11.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.598+0000 7f3a95ffb640 1 -- 172.21.15.103:0/3536011195 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a80003520 con 0x7f3a84008610 2024-09-10T08:39:11.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.611+0000 7f3a95ffb640 1 -- 172.21.15.103:0/3536011195 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3878523998 0 0) 0x7f3a80003520 con 0x7f3a84008610 2024-09-10T08:39:11.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.612+0000 7f3a95ffb640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 msgr2=0x7f3a84009eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:39:11.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.612+0000 7f3a95ffb640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.154:3300/0 conn(0x7f3a98152320 0x7f3a84009eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:11.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.612+0000 7f3a95ffb640 1 -- 172.21.15.103:0/3536011195 >> v2:172.21.15.103:3300/0 conn(0x7f3a8400a3f0 msgr2=0x7f3a8400a810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:39:11.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.612+0000 7f3a95ffb640 1 --2- 172.21.15.103:0/3536011195 >> v2:172.21.15.103:3300/0 conn(0x7f3a8400a3f0 0x7f3a8400a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:11.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.612+0000 7f3a95ffb640 1 -- 172.21.15.103:0/3536011195 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a98152e50 con 0x7f3a84008610 2024-09-10T08:39:11.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.612+0000 7f3a95ffb640 1 -- 172.21.15.103:0/3536011195 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f3a900045c0 con 0x7f3a84008610 2024-09-10T08:39:11.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.612+0000 7f3a95ffb640 1 -- 172.21.15.103:0/3536011195 >> v1:172.21.15.154:6789/0 conn(0x7f3a84008610 legacy=0x7f3a84008de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:11.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.612+0000 7f3a95ffb640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a800039b0 0x7f3a80003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:11.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.612+0000 7f3a95ffb640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a80004800 0x7f3a80004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:11.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.612+0000 7f3a95ffb640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a80005210 0x7f3a8000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:11.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.612+0000 7f3a95ffb640 1 -- 172.21.15.103:0/3536011195 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3a98152b70 con 0x7f3a80004800 2024-09-10T08:39:11.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.612+0000 7f3a95ffb640 1 -- 172.21.15.103:0/3536011195 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3a840094f0 con 0x7f3a800039b0 2024-09-10T08:39:11.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.612+0000 7f3a95ffb640 1 -- 172.21.15.103:0/3536011195 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3a8000c1e0 con 0x7f3a80005210 2024-09-10T08:39:11.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.612+0000 7f3a967fc640 1 -- 172.21.15.103:0/3536011195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a80004800 msgr2=0x7f3a80004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:39:11.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.612+0000 7f3a967fc640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a80004800 0x7f3a80004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:11.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.612+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a800039b0 0x7f3a80003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:11.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.613+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a80005210 msgr2=0x7f3a8000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:11.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.613+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a80005210 0x7f3a8000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:11.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.613+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3536011195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a80004800 msgr2=0x7f3a80004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:39:11.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.613+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a80004800 0x7f3a80004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:11.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.613+0000 7f3a977fe640 1 -- 172.21.15.103:0/3536011195 reap_dead start 2024-09-10T08:39:11.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.613+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3536011195 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a80003520 con 0x7f3a800039b0 2024-09-10T08:39:11.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.614+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a800039b0 0x7f3a80003dd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3a980bf480 tx=0x7f3a80005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2eae5052317de0e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:11.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.616+0000 7f3a95ffb640 1 -- 172.21.15.103:0/3536011195 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c032070 con 0x7f3a800039b0 2024-09-10T08:39:11.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.616+0000 7f3a95ffb640 1 -- 172.21.15.103:0/3536011195 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a8c02c840 con 0x7f3a800039b0 2024-09-10T08:39:11.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.616+0000 7f3a95ffb640 1 -- 172.21.15.103:0/3536011195 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c032070 con 0x7f3a800039b0 2024-09-10T08:39:11.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.617+0000 7f3a9d43c640 1 -- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a800039b0 msgr2=0x7f3a80003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:11.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.617+0000 7f3a9d43c640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a800039b0 0x7f3a80003dd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3a980bf480 tx=0x7f3a80005830 comp rx=0 tx=0).stop 2024-09-10T08:39:11.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.617+0000 7f3a9d43c640 1 -- 172.21.15.103:0/3536011195 shutdown_connections 2024-09-10T08:39:11.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.617+0000 7f3a9d43c640 1 --2- 172.21.15.103:0/3536011195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a800039b0 0x7f3a80003dd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:11.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.617+0000 7f3a9d43c640 1 -- 172.21.15.103:0/3536011195 >> 172.21.15.103:0/3536011195 conn(0x7f3a980c4bb0 msgr2=0x7f3a980c4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:11.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.617+0000 7f3a9d43c640 1 -- 172.21.15.103:0/3536011195 shutdown_connections 2024-09-10T08:39:11.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.617+0000 7f3a9d43c640 1 -- 172.21.15.103:0/3536011195 wait complete. 2024-09-10T08:39:11.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.620+0000 7f3a9d43c640 1 Processor -- start 2024-09-10T08:39:11.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.621+0000 7f3a9d43c640 1 -- start start 2024-09-10T08:39:11.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.622+0000 7f3a9d43c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a800039b0 0x7f3a98154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:11.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.622+0000 7f3a9d43c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a98070fd0 0x7f3a980bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:11.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.623+0000 7f3a96ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a800039b0 0x7f3a98154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:11.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.623+0000 7f3a9d43c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a980c05b0 0x7f3a981e8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:11.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.623+0000 7f3a9d43c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3a980c58c0 con 0x7f3a980c05b0 2024-09-10T08:39:11.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.623+0000 7f3a9d43c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3a980c5740 con 0x7f3a800039b0 2024-09-10T08:39:11.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.623+0000 7f3a9d43c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3a98068f80 con 0x7f3a98070fd0 2024-09-10T08:39:11.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.623+0000 7f3a977fe640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a980c05b0 msgr2=0x7f3a981e8010 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:39:11.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.623+0000 7f3a96ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a800039b0 0x7f3a98154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:50450/0 (socket says 172.21.15.103:50450) 2024-09-10T08:39:11.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.623+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3923763229 learned_addr learned my addr 172.21.15.103:0/3923763229 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:39:11.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.623+0000 7f3a977fe640 1 --2- 172.21.15.103:0/3923763229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a980c05b0 0x7f3a981e8010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:11.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.623+0000 7f3a967fc640 1 --2- 172.21.15.103:0/3923763229 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a98070fd0 0x7f3a980bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:11.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.623+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3923763229 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a98070fd0 msgr2=0x7f3a980bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:11.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.623+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3923763229 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a98070fd0 0x7f3a980bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:11.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.623+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3923763229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a980c05b0 msgr2=0x7f3a981e8010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:39:11.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.623+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3923763229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a980c05b0 0x7f3a981e8010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:11.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.624+0000 7f3a96ffd640 1 -- 172.21.15.103:0/3923763229 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a981e8a90 con 0x7f3a800039b0 2024-09-10T08:39:11.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.624+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/3923763229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a800039b0 0x7f3a98154b50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c007c60 tx=0x7f3a8c001120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:11.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.625+0000 7f3a7f7fe640 1 -- 172.21.15.103:0/3923763229 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c043030 con 0x7f3a800039b0 2024-09-10T08:39:11.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.625+0000 7f3a7f7fe640 1 -- 172.21.15.103:0/3923763229 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a8c036a70 con 0x7f3a800039b0 2024-09-10T08:39:11.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.625+0000 7f3a7f7fe640 1 -- 172.21.15.103:0/3923763229 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c032070 con 0x7f3a800039b0 2024-09-10T08:39:11.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.625+0000 7f3a9d43c640 1 -- 172.21.15.103:0/3923763229 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a98154070 con 0x7f3a800039b0 2024-09-10T08:39:11.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.625+0000 7f3a9d43c640 1 -- 172.21.15.103:0/3923763229 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a980c0a60 con 0x7f3a800039b0 2024-09-10T08:39:11.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.627+0000 7f3a9d43c640 1 -- 172.21.15.103:0/3923763229 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a980bf130 con 0x7f3a800039b0 2024-09-10T08:39:11.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.629+0000 7f3a7f7fe640 1 -- 172.21.15.103:0/3923763229 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3a8c046070 con 0x7f3a800039b0 2024-09-10T08:39:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.631+0000 7f3a7f7fe640 1 --2- 172.21.15.103:0/3923763229 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3a8406d2b0 0x7f3a8406f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.631+0000 7f3a967fc640 1 --2- 172.21.15.103:0/3923763229 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3a8406d2b0 0x7f3a8406f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.632+0000 7f3a7f7fe640 1 -- 172.21.15.103:0/3923763229 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f3a8c0ac140 con 0x7f3a800039b0 2024-09-10T08:39:11.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.632+0000 7f3a967fc640 1 --2- 172.21.15.103:0/3923763229 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3a8406d2b0 0x7f3a8406f770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3a88006e00 tx=0x7f3a88014040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:11.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:11.638+0000 7f3a7f7fe640 1 -- 172.21.15.103:0/3923763229 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3a980bf130 con 0x7f3a800039b0 2024-09-10T08:39:12.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.115+0000 7f3a9d43c640 1 -- 172.21.15.103:0/3923763229 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3a9806df80 con 0x7f3a800039b0 2024-09-10T08:39:12.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.116+0000 7f3a7f7fe640 1 -- 172.21.15.103:0/3923763229 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7f3a8c07a770 con 0x7f3a800039b0 2024-09-10T08:39:12.117 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":88,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:39:12.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.119+0000 7f3a9d43c640 1 -- 172.21.15.103:0/3923763229 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3a8406d2b0 msgr2=0x7f3a8406f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:12.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.119+0000 7f3a9d43c640 1 --2- 172.21.15.103:0/3923763229 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3a8406d2b0 0x7f3a8406f770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3a88006e00 tx=0x7f3a88014040 comp rx=0 tx=0).stop 2024-09-10T08:39:12.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.119+0000 7f3a9d43c640 1 -- 172.21.15.103:0/3923763229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a800039b0 msgr2=0x7f3a98154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:12.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.119+0000 7f3a9d43c640 1 --2- 172.21.15.103:0/3923763229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a800039b0 0x7f3a98154b50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c007c60 tx=0x7f3a8c001120 comp rx=0 tx=0).stop 2024-09-10T08:39:12.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.119+0000 7f3a9d43c640 1 -- 172.21.15.103:0/3923763229 shutdown_connections 2024-09-10T08:39:12.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.119+0000 7f3a9d43c640 1 --2- 172.21.15.103:0/3923763229 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3a8406d2b0 0x7f3a8406f770 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.119+0000 7f3a9d43c640 1 --2- 172.21.15.103:0/3923763229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a980c05b0 0x7f3a981e8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.119+0000 7f3a9d43c640 1 --2- 172.21.15.103:0/3923763229 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a98070fd0 0x7f3a980bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.119+0000 7f3a9d43c640 1 --2- 172.21.15.103:0/3923763229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a800039b0 0x7f3a98154b50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.119+0000 7f3a9d43c640 1 -- 172.21.15.103:0/3923763229 >> 172.21.15.103:0/3923763229 conn(0x7f3a980c4bb0 msgr2=0x7f3a980c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:12.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.120+0000 7f3a9d43c640 1 -- 172.21.15.103:0/3923763229 shutdown_connections 2024-09-10T08:39:12.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.120+0000 7f3a9d43c640 1 -- 172.21.15.103:0/3923763229 wait complete. 2024-09-10T08:39:12.140 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-10T08:39:12.140 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-10T08:39:12.140 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:39:12.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.310+0000 7f365933a640 1 Processor -- start 2024-09-10T08:39:12.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.310+0000 7f365933a640 1 -- start start 2024-09-10T08:39:12.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.312+0000 7f365933a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f365406f1d0 0x7f36540c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:12.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.312+0000 7f36537fe640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7f36540c5940 legacy=0x7f3654152a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:39:12.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.312+0000 7f365933a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36540c7500 con 0x7f36540c5940 2024-09-10T08:39:12.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.312+0000 7f365933a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3654156300 con 0x7f365414fa90 2024-09-10T08:39:12.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.312+0000 7f365933a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f36540c72b0 con 0x7f365406f1d0 2024-09-10T08:39:12.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.312+0000 7f36527fc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f365406f1d0 0x7f36540c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:12.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.312+0000 7f36527fc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f365406f1d0 0x7f36540c2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:37922/0 (socket says 172.21.15.103:37922) 2024-09-10T08:39:12.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.312+0000 7f36527fc640 1 -- 172.21.15.103:0/535933005 learned_addr learned my addr 172.21.15.103:0/535933005 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:39:12.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.313+0000 7f36527fc640 1 -- 172.21.15.103:0/535933005 >> v1:172.21.15.154:6789/0 conn(0x7f365414fa90 legacy=0x7f36540c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:12.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.313+0000 7f36527fc640 1 -- 172.21.15.103:0/535933005 >> v1:172.21.15.103:6789/0 conn(0x7f36540c5940 legacy=0x7f3654152a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:39:12.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.314+0000 7f36527fc640 1 -- 172.21.15.103:0/535933005 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36541565e0 con 0x7f365406f1d0 2024-09-10T08:39:12.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.315+0000 7f36527fc640 1 --2- 172.21.15.103:0/535933005 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f365406f1d0 0x7f36540c2e50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f36480088a0 tx=0x7f364802c6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c023ae1bcc709b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:12.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.316+0000 7f3651ffb640 1 -- 172.21.15.103:0/535933005 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364803a070 con 0x7f365406f1d0 2024-09-10T08:39:12.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.316+0000 7f3651ffb640 1 -- 172.21.15.103:0/535933005 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3648032480 con 0x7f365406f1d0 2024-09-10T08:39:12.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.316+0000 7f3651ffb640 1 -- 172.21.15.103:0/535933005 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3648032850 con 0x7f365406f1d0 2024-09-10T08:39:12.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.317+0000 7f365933a640 1 -- 172.21.15.103:0/535933005 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f365406f1d0 msgr2=0x7f36540c2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:12.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.317+0000 7f365933a640 1 --2- 172.21.15.103:0/535933005 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f365406f1d0 0x7f36540c2e50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f36480088a0 tx=0x7f364802c6f0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.317+0000 7f365933a640 1 -- 172.21.15.103:0/535933005 shutdown_connections 2024-09-10T08:39:12.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.317+0000 7f365933a640 1 --2- 172.21.15.103:0/535933005 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f365406f1d0 0x7f36540c2e50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.317+0000 7f365933a640 1 -- 172.21.15.103:0/535933005 >> 172.21.15.103:0/535933005 conn(0x7f36540c7a40 msgr2=0x7f36540c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:12.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.317+0000 7f365933a640 1 -- 172.21.15.103:0/535933005 shutdown_connections 2024-09-10T08:39:12.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.317+0000 7f365933a640 1 -- 172.21.15.103:0/535933005 wait complete. 2024-09-10T08:39:12.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.320+0000 7f365933a640 1 Processor -- start 2024-09-10T08:39:12.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.321+0000 7f365933a640 1 -- start start 2024-09-10T08:39:12.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.322+0000 7f365933a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f365406f1d0 0x7f3654155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:12.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.322+0000 7f365933a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36540c5940 0x7f36540bdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:12.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.322+0000 7f365933a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f365414fa90 0x7f36541fc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:12.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.324+0000 7f3652ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f365406f1d0 0x7f3654155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:12.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.324+0000 7f36537fe640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f365414fa90 msgr2=0x7f36541fc100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:39:12.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.324+0000 7f36537fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f365414fa90 0x7f36541fc100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:12.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.324+0000 7f365933a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f365414fe70 con 0x7f365414fa90 2024-09-10T08:39:12.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.324+0000 7f365933a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3654152580 con 0x7f36540c5940 2024-09-10T08:39:12.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.324+0000 7f365933a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f36540c4be0 con 0x7f365406f1d0 2024-09-10T08:39:12.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.325+0000 7f36527fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36540c5940 0x7f36540bdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:12.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.325+0000 7f36527fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36540c5940 0x7f36540bdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:50464/0 (socket says 172.21.15.103:50464) 2024-09-10T08:39:12.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.325+0000 7f36527fc640 1 -- 172.21.15.103:0/1398358440 learned_addr learned my addr 172.21.15.103:0/1398358440 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:39:12.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.325+0000 7f36527fc640 1 -- 172.21.15.103:0/1398358440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f365406f1d0 msgr2=0x7f3654155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:12.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.325+0000 7f36527fc640 1 --2- 172.21.15.103:0/1398358440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f365406f1d0 0x7f3654155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.325+0000 7f36527fc640 1 -- 172.21.15.103:0/1398358440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f365414fa90 msgr2=0x7f36541fc100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:39:12.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.325+0000 7f36527fc640 1 --2- 172.21.15.103:0/1398358440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f365414fa90 0x7f36541fc100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.325+0000 7f36527fc640 1 -- 172.21.15.103:0/1398358440 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36540bd0e0 con 0x7f36540c5940 2024-09-10T08:39:12.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.326+0000 7f36527fc640 1 --2- 172.21.15.103:0/1398358440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36540c5940 0x7f36540bdbc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3648038040 tx=0x7f3648004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:12.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.326+0000 7f363b7fe640 1 -- 172.21.15.103:0/1398358440 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3648045070 con 0x7f36540c5940 2024-09-10T08:39:12.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.326+0000 7f365933a640 1 -- 172.21.15.103:0/1398358440 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36540c1a20 con 0x7f36540c5940 2024-09-10T08:39:12.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.326+0000 7f363b7fe640 1 -- 172.21.15.103:0/1398358440 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364800b0b0 con 0x7f36540c5940 2024-09-10T08:39:12.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.326+0000 7f365933a640 1 -- 172.21.15.103:0/1398358440 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36541555b0 con 0x7f36540c5940 2024-09-10T08:39:12.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.326+0000 7f363b7fe640 1 -- 172.21.15.103:0/1398358440 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364803a070 con 0x7f36540c5940 2024-09-10T08:39:12.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.328+0000 7f365933a640 1 --2- 172.21.15.103:0/1398358440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36540aa690 0x7f36541fc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:12.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.328+0000 7f365933a640 1 -- 172.21.15.103:0/1398358440 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3654155780 con 0x7f36540aa690 2024-09-10T08:39:12.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.328+0000 7f3652ffd640 1 --2- 172.21.15.103:0/1398358440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36540aa690 0x7f36541fc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:12.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.329+0000 7f3652ffd640 1 -- 172.21.15.103:0/1398358440 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f36540c8530 con 0x7f36540aa690 2024-09-10T08:39:12.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.329+0000 7f363b7fe640 1 -- 172.21.15.103:0/1398358440 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3648048070 con 0x7f36540c5940 2024-09-10T08:39:12.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.329+0000 7f3652ffd640 1 --2- 172.21.15.103:0/1398358440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36540aa690 0x7f36541fc640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f364400e370 tx=0x7f364400e830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:12.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.330+0000 7f363b7fe640 1 --2- 172.21.15.103:0/1398358440 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f364006be10 0x7f364006e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:12.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.330+0000 7f363b7fe640 1 -- 172.21.15.103:0/1398358440 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f36480ab3d0 con 0x7f36540c5940 2024-09-10T08:39:12.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.330+0000 7f36537fe640 1 --2- 172.21.15.103:0/1398358440 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f364006be10 0x7f364006e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:12.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.331+0000 7f363b7fe640 1 -- 172.21.15.103:0/1398358440 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644019070 con 0x7f36540aa690 2024-09-10T08:39:12.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.331+0000 7f363b7fe640 1 -- 172.21.15.103:0/1398358440 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f36440052e0 con 0x7f36540aa690 2024-09-10T08:39:12.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.331+0000 7f363b7fe640 1 -- 172.21.15.103:0/1398358440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36540aa690 msgr2=0x7f36541fc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:12.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.331+0000 7f363b7fe640 1 --2- 172.21.15.103:0/1398358440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36540aa690 0x7f36541fc640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f364400e370 tx=0x7f364400e830 comp rx=0 tx=0).stop 2024-09-10T08:39:12.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.331+0000 7f363b7fe640 1 -- 172.21.15.103:0/1398358440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36540aa690 msgr2=0x7f36541fc640 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:39:12.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.331+0000 7f363b7fe640 1 --2- 172.21.15.103:0/1398358440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36540aa690 0x7f36541fc640 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f364400e370 tx=0x7f364400e830 comp rx=0 tx=0).stop 2024-09-10T08:39:12.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.331+0000 7f36537fe640 1 --2- 172.21.15.103:0/1398358440 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f364006be10 0x7f364006e2d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f364c003cb0 tx=0x7f364c0091f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:12.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.343+0000 7f365933a640 1 --2- 172.21.15.103:0/1398358440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36540c09b0 0x7f36540c0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:12.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.343+0000 7f365933a640 1 -- 172.21.15.103:0/1398358440 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f36540bca60 con 0x7f36540c09b0 2024-09-10T08:39:12.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.344+0000 7f3652ffd640 1 --2- 172.21.15.103:0/1398358440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36540c09b0 0x7f36540c0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:12.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.344+0000 7f3652ffd640 1 -- 172.21.15.103:0/1398358440 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f36541fcdc0 con 0x7f36540c09b0 2024-09-10T08:39:12.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.345+0000 7f3652ffd640 1 --2- 172.21.15.103:0/1398358440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36540c09b0 0x7f36540c0dc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f364400e370 tx=0x7f3644000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:12.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.345+0000 7f363b7fe640 1 -- 172.21.15.103:0/1398358440 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644019040 con 0x7f36540c09b0 2024-09-10T08:39:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.346+0000 7f363b7fe640 1 -- 172.21.15.103:0/1398358440 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5044 (secure 0 0 0) 0x7f36440035f0 con 0x7f36540c09b0 2024-09-10T08:39:12.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.346+0000 7f363b7fe640 1 -- 172.21.15.103:0/1398358440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36540c09b0 msgr2=0x7f36540c0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:12.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.346+0000 7f363b7fe640 1 --2- 172.21.15.103:0/1398358440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36540c09b0 0x7f36540c0dc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f364400e370 tx=0x7f3644000ed0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.346+0000 7f363b7fe640 1 -- 172.21.15.103:0/1398358440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36540c09b0 msgr2=0x7f36540c0dc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:39:12.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.346+0000 7f363b7fe640 1 --2- 172.21.15.103:0/1398358440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36540c09b0 0x7f36540c0dc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.348 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:39:12.348 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:39:12.348 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:39:12.348 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:39:12.348 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 88, 2024-09-10T08:39:12.348 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 97371, 2024-09-10T08:39:12.348 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:39:12.349 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:39:12.349 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:39:12.349 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:12.349 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:39:12.349 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:39:12.349 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:39:12.349 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:39:12.349 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:39:12.349 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:39:12.349 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:39:12.349 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:39:12.349 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:39:12.349 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:39:12.350 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:39:12.350 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:39:12.350 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:39:12.350 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:39:12.350 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:39:12.350 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:12.350 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:39:12.350 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:39:12.350 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:39:12.350 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:39:12.350 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:39:12.350 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:39:12.350 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:39:12.350 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:39:12.351 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:39:12.351 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:39:12.351 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:39:12.351 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:39:12.351 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:39:12.351 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:12.351 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.351 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:39:12.351 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:39:12.351 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:39:12.351 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:39:12.351 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:39:12.351 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:39:12.352 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:39:12.352 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:39:12.352 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:39:12.352 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:39:12.352 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:39:12.352 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:39:12.352 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:39:12.352 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:39:12.352 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:39:12.352 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:39:12.352 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:39:12.352 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:39:12.352 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:39:12.352 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:39:12.353 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:39:12.353 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:39:12.353 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:39:12.353 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:39:12.353 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:39:12.353 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:39:12.353 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:39:12.353 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:39:12.353 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:12.353 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:39:12.353 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.353 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:39:12.353 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.354 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:39:12.354 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:39:12.354 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:39:12.354 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:39:12.354 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.354 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:39:12.354 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:39:12.354 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:12.354 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.354 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.354 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:39:12.354 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:39:12.354 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:12.354 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:12.355 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:12.355 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.355 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:39:12.355 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:39:12.355 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:39:12.355 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:39:12.355 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:39:12.355 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.355 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.355 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:39:12.355 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:39:12.355 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:39:12.355 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:39:12.356 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.356 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:39:12.356 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:39:12.356 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:12.356 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.356 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.356 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:39:12.356 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:39:12.356 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:12.356 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:12.356 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:12.356 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.357 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:39:12.357 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:39:12.357 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:39:12.357 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:39:12.357 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:39:12.357 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.357 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.357 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:39:12.357 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:39:12.357 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:39:12.357 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:39:12.357 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.357 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:39:12.358 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:39:12.358 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:12.358 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.358 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.358 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:39:12.358 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:39:12.358 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:12.358 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:12.358 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:12.358 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.358 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:39:12.358 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:39:12.358 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:39:12.358 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:39:12.359 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:39:12.359 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:12.359 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:12.359 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.359 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:39:12.359 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:39:12.359 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.359 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:39:12.359 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:39:12.359 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:39:12.359 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:12.359 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:12.359 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:39:12.359 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.360 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:39:12.360 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:39:12.360 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:39:12.360 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:12.360 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:12.360 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:39:12.360 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.360 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:39:12.360 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:39:12.360 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:39:12.360 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:12.360 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:12.361 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:39:12.361 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.361 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:39:12.361 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:39:12.361 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:39:12.361 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:12.361 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:12.361 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:39:12.361 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.361 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:39:12.361 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:39:12.361 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:39:12.361 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:12.361 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:12.362 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.362 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:39:12.362 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:39:12.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.347+0000 7f365933a640 1 -- 172.21.15.103:0/1398358440 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f364006be10 msgr2=0x7f364006e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:12.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.347+0000 7f365933a640 1 --2- 172.21.15.103:0/1398358440 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f364006be10 0x7f364006e2d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f364c003cb0 tx=0x7f364c0091f0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.347+0000 7f36537fe640 1 -- 172.21.15.103:0/1398358440 reap_dead start 2024-09-10T08:39:12.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.347+0000 7f365933a640 1 -- 172.21.15.103:0/1398358440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36540c5940 msgr2=0x7f36540bdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:12.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.347+0000 7f365933a640 1 --2- 172.21.15.103:0/1398358440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36540c5940 0x7f36540bdbc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3648038040 tx=0x7f3648004730 comp rx=0 tx=0).stop 2024-09-10T08:39:12.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.347+0000 7f365933a640 1 -- 172.21.15.103:0/1398358440 shutdown_connections 2024-09-10T08:39:12.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.347+0000 7f365933a640 1 --2- 172.21.15.103:0/1398358440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36540c5940 0x7f36540bdbc0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.347+0000 7f365933a640 1 -- 172.21.15.103:0/1398358440 >> 172.21.15.103:0/1398358440 conn(0x7f36540c7a40 msgr2=0x7f36540a8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:12.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.348+0000 7f365933a640 1 -- 172.21.15.103:0/1398358440 shutdown_connections 2024-09-10T08:39:12.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.348+0000 7f365933a640 1 -- 172.21.15.103:0/1398358440 wait complete. 2024-09-10T08:39:12.367 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:39:12.367 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-10T08:39:12.367 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:39:12.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.537+0000 7fca220d9640 1 Processor -- start 2024-09-10T08:39:12.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.537+0000 7fca220d9640 1 -- start start 2024-09-10T08:39:12.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.538+0000 7fca220d9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fca1c0adae0 0x7fca1c0c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:12.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.538+0000 7fca220d9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c0c7f80 0x7fca1c153b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:12.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.538+0000 7fca220d9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca1c0c8440 con 0x7fca1c1544a0 2024-09-10T08:39:12.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.538+0000 7fca220d9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fca1c0c8720 con 0x7fca1c0adae0 2024-09-10T08:39:12.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.538+0000 7fca220d9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fca1c0c6c20 con 0x7fca1c0c7f80 2024-09-10T08:39:12.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.539+0000 7fca1affd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c0c7f80 0x7fca1c153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:12.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.539+0000 7fca1affd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c0c7f80 0x7fca1c153b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:37940/0 (socket says 172.21.15.103:37940) 2024-09-10T08:39:12.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.539+0000 7fca1affd640 1 -- 172.21.15.103:0/2336917261 learned_addr learned my addr 172.21.15.103:0/2336917261 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:39:12.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.539+0000 7fca1b7fe640 1 --2- 172.21.15.103:0/2336917261 >> v2:172.21.15.154:3300/0 conn(0x7fca1c0adae0 0x7fca1c0c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:12.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.539+0000 7fca1affd640 1 -- 172.21.15.103:0/2336917261 >> v2:172.21.15.154:3300/0 conn(0x7fca1c0adae0 msgr2=0x7fca1c0c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:12.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.539+0000 7fca1affd640 1 --2- 172.21.15.103:0/2336917261 >> v2:172.21.15.154:3300/0 conn(0x7fca1c0adae0 0x7fca1c0c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.539+0000 7fca1affd640 1 -- 172.21.15.103:0/2336917261 >> v1:172.21.15.154:6789/0 conn(0x7fca1c1544a0 legacy=0x7fca1c0a7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:12.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.539+0000 7fca1affd640 1 -- 172.21.15.103:0/2336917261 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1c0c6f00 con 0x7fca1c0c7f80 2024-09-10T08:39:12.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.540+0000 7fca1affd640 1 --2- 172.21.15.103:0/2336917261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c0c7f80 0x7fca1c153b40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fca0400bb10 tx=0x7fca0402c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fb408caea8b1fe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:12.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.541+0000 7fca1a7fc640 1 -- 172.21.15.103:0/2336917261 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0403a070 con 0x7fca1c0c7f80 2024-09-10T08:39:12.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.541+0000 7fca1a7fc640 1 -- 172.21.15.103:0/2336917261 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca040326f0 con 0x7fca1c0c7f80 2024-09-10T08:39:12.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.541+0000 7fca1a7fc640 1 -- 172.21.15.103:0/2336917261 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca04032ac0 con 0x7fca1c0c7f80 2024-09-10T08:39:12.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.541+0000 7fca220d9640 1 -- 172.21.15.103:0/2336917261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c0c7f80 msgr2=0x7fca1c153b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:12.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.541+0000 7fca220d9640 1 --2- 172.21.15.103:0/2336917261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c0c7f80 0x7fca1c153b40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fca0400bb10 tx=0x7fca0402c830 comp rx=0 tx=0).stop 2024-09-10T08:39:12.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.542+0000 7fca220d9640 1 -- 172.21.15.103:0/2336917261 shutdown_connections 2024-09-10T08:39:12.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.542+0000 7fca220d9640 1 --2- 172.21.15.103:0/2336917261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c0c7f80 0x7fca1c153b40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.542+0000 7fca220d9640 1 --2- 172.21.15.103:0/2336917261 >> v2:172.21.15.154:3300/0 conn(0x7fca1c0adae0 0x7fca1c0c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.542+0000 7fca220d9640 1 -- 172.21.15.103:0/2336917261 >> 172.21.15.103:0/2336917261 conn(0x7fca1c0c8bf0 msgr2=0x7fca1c0c8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:12.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.542+0000 7fca220d9640 1 -- 172.21.15.103:0/2336917261 shutdown_connections 2024-09-10T08:39:12.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.542+0000 7fca220d9640 1 -- 172.21.15.103:0/2336917261 wait complete. 2024-09-10T08:39:12.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.543+0000 7fca220d9640 1 Processor -- start 2024-09-10T08:39:12.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.543+0000 7fca220d9640 1 -- start start 2024-09-10T08:39:12.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.544+0000 7fca220d9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c0adae0 0x7fca1c072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:12.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.545+0000 7fca220d9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca1c0c7f80 0x7fca1c0c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:12.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.545+0000 7fca220d9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1c1544a0 0x7fca1c0c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:12.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.545+0000 7fca220d9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c0adec0 con 0x7fca1c1544a0 2024-09-10T08:39:12.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.545+0000 7fca220d9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c0abea0 con 0x7fca1c0c7f80 2024-09-10T08:39:12.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.545+0000 7fca220d9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fca1c0ae040 con 0x7fca1c0adae0 2024-09-10T08:39:12.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.545+0000 7fca1bfff640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1c1544a0 msgr2=0x7fca1c0c4b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:39:12.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.545+0000 7fca1bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1c1544a0 0x7fca1c0c4b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:12.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.545+0000 7fca1affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca1c0c7f80 0x7fca1c0c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:12.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.545+0000 7fca1affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca1c0c7f80 0x7fca1c0c45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:50500/0 (socket says 172.21.15.103:50500) 2024-09-10T08:39:12.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.545+0000 7fca1affd640 1 -- 172.21.15.103:0/3022384872 learned_addr learned my addr 172.21.15.103:0/3022384872 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:39:12.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.545+0000 7fca1affd640 1 -- 172.21.15.103:0/3022384872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c0adae0 msgr2=0x7fca1c072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:12.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.545+0000 7fca1affd640 1 --2- 172.21.15.103:0/3022384872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c0adae0 0x7fca1c072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.545+0000 7fca1affd640 1 -- 172.21.15.103:0/3022384872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1c1544a0 msgr2=0x7fca1c0c4b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:39:12.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.545+0000 7fca1affd640 1 --2- 172.21.15.103:0/3022384872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca1c1544a0 0x7fca1c0c4b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.545+0000 7fca1affd640 1 -- 172.21.15.103:0/3022384872 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1c06f980 con 0x7fca1c0c7f80 2024-09-10T08:39:12.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.546+0000 7fca1affd640 1 --2- 172.21.15.103:0/3022384872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca1c0c7f80 0x7fca1c0c45e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca0402c870 tx=0x7fca04004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:12.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.546+0000 7fca13fff640 1 -- 172.21.15.103:0/3022384872 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca04045070 con 0x7fca1c0c7f80 2024-09-10T08:39:12.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.546+0000 7fca220d9640 1 -- 172.21.15.103:0/3022384872 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca1c06fc60 con 0x7fca1c0c7f80 2024-09-10T08:39:12.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.546+0000 7fca13fff640 1 -- 172.21.15.103:0/3022384872 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca04035690 con 0x7fca1c0c7f80 2024-09-10T08:39:12.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.546+0000 7fca13fff640 1 -- 172.21.15.103:0/3022384872 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0403a070 con 0x7fca1c0c7f80 2024-09-10T08:39:12.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.547+0000 7fca220d9640 1 -- 172.21.15.103:0/3022384872 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca1c0c33c0 con 0x7fca1c0c7f80 2024-09-10T08:39:12.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.548+0000 7fca220d9640 1 --2- 172.21.15.103:0/3022384872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c09daa0 0x7fca1c1eef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:12.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.548+0000 7fca220d9640 1 -- 172.21.15.103:0/3022384872 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fca1c1548d0 con 0x7fca1c09daa0 2024-09-10T08:39:12.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.548+0000 7fca1b7fe640 1 --2- 172.21.15.103:0/3022384872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c09daa0 0x7fca1c1eef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:12.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.549+0000 7fca1b7fe640 1 -- 172.21.15.103:0/3022384872 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca1c153f70 con 0x7fca1c09daa0 2024-09-10T08:39:12.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.549+0000 7fca1b7fe640 1 --2- 172.21.15.103:0/3022384872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c09daa0 0x7fca1c1eef50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fca0c007ce0 tx=0x7fca0c00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:12.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.549+0000 7fca13fff640 1 -- 172.21.15.103:0/3022384872 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca04048070 con 0x7fca1c0c7f80 2024-09-10T08:39:12.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.550+0000 7fca13fff640 1 --2- 172.21.15.103:0/3022384872 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca0006bde0 0x7fca0006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:12.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.550+0000 7fca13fff640 1 -- 172.21.15.103:0/3022384872 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fca040ab1b0 con 0x7fca1c0c7f80 2024-09-10T08:39:12.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.550+0000 7fca1bfff640 1 --2- 172.21.15.103:0/3022384872 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca0006bde0 0x7fca0006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:12.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.550+0000 7fca13fff640 1 -- 172.21.15.103:0/3022384872 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c00edf0 con 0x7fca1c09daa0 2024-09-10T08:39:12.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.550+0000 7fca13fff640 1 -- 172.21.15.103:0/3022384872 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fca0c003990 con 0x7fca1c09daa0 2024-09-10T08:39:12.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.550+0000 7fca13fff640 1 -- 172.21.15.103:0/3022384872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c09daa0 msgr2=0x7fca1c1eef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:12.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.550+0000 7fca13fff640 1 --2- 172.21.15.103:0/3022384872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c09daa0 0x7fca1c1eef50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fca0c007ce0 tx=0x7fca0c00e4b0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.550+0000 7fca13fff640 1 -- 172.21.15.103:0/3022384872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c09daa0 msgr2=0x7fca1c1eef50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:39:12.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.550+0000 7fca13fff640 1 --2- 172.21.15.103:0/3022384872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c09daa0 0x7fca1c1eef50 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fca0c007ce0 tx=0x7fca0c00e4b0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.551+0000 7fca1bfff640 1 --2- 172.21.15.103:0/3022384872 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca0006bde0 0x7fca0006e2a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fca1c1eca60 tx=0x7fca14007990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:12.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.567+0000 7fca220d9640 1 --2- 172.21.15.103:0/3022384872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c09ca00 0x7fca1c1ef490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:12.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.567+0000 7fca220d9640 1 -- 172.21.15.103:0/3022384872 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fca1c0ab940 con 0x7fca1c09ca00 2024-09-10T08:39:12.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.567+0000 7fca1b7fe640 1 --2- 172.21.15.103:0/3022384872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c09ca00 0x7fca1c1ef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:12.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.568+0000 7fca1b7fe640 1 -- 172.21.15.103:0/3022384872 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fca1c073470 con 0x7fca1c09ca00 2024-09-10T08:39:12.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.568+0000 7fca1b7fe640 1 --2- 172.21.15.103:0/3022384872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c09ca00 0x7fca1c1ef490 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fca0c017000 tx=0x7fca0c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:12.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.568+0000 7fca13fff640 1 -- 172.21.15.103:0/3022384872 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c027620 con 0x7fca1c09ca00 2024-09-10T08:39:12.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.569+0000 7fca13fff640 1 -- 172.21.15.103:0/3022384872 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5042 (secure 0 0 0) 0x7fca0c027620 con 0x7fca1c09ca00 2024-09-10T08:39:12.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.569+0000 7fca13fff640 1 -- 172.21.15.103:0/3022384872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c09ca00 msgr2=0x7fca1c1ef490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:12.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.569+0000 7fca13fff640 1 --2- 172.21.15.103:0/3022384872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c09ca00 0x7fca1c1ef490 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fca0c017000 tx=0x7fca0c004a40 comp rx=0 tx=0).stop 2024-09-10T08:39:12.570 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:39:12.570 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:39:12.570 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:39:12.570 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:39:12.571 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 88, 2024-09-10T08:39:12.571 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 45402, 2024-09-10T08:39:12.571 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:39:12.571 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:39:12.571 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:39:12.571 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:12.571 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:39:12.571 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:39:12.571 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:39:12.571 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:39:12.571 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:39:12.571 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:39:12.571 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:39:12.572 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:39:12.572 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:39:12.572 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:39:12.572 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:39:12.572 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:39:12.572 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:39:12.572 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:39:12.572 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:39:12.572 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:12.572 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:39:12.572 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:39:12.572 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:39:12.573 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:39:12.573 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:39:12.573 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:39:12.573 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:39:12.573 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:39:12.573 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:39:12.573 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:39:12.573 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:39:12.573 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:39:12.573 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:39:12.573 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:12.573 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.573 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:39:12.574 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:39:12.574 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:39:12.574 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:39:12.574 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:39:12.574 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:39:12.574 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:39:12.574 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:39:12.574 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:39:12.574 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:39:12.574 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:39:12.574 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:39:12.574 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:39:12.574 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:39:12.574 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:39:12.575 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:39:12.575 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:39:12.575 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:39:12.575 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:39:12.575 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:39:12.575 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:39:12.575 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:39:12.575 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:39:12.575 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:39:12.575 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:39:12.575 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:39:12.575 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:39:12.575 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:39:12.576 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:12.576 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:39:12.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.576 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:39:12.576 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.576 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:39:12.576 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:39:12.576 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:39:12.576 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:39:12.576 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.576 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:39:12.576 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:39:12.577 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:12.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.577 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.577 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:39:12.577 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:39:12.577 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:12.577 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:12.577 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:12.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.577 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:39:12.577 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:39:12.577 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:39:12.577 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:39:12.578 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:39:12.578 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.578 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.578 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:39:12.578 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:39:12.578 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:39:12.578 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:39:12.578 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.578 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:39:12.578 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:39:12.578 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:12.578 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.578 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.578 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:39:12.579 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:39:12.579 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:12.579 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:12.579 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:12.579 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.579 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:39:12.579 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:39:12.579 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:39:12.579 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:39:12.579 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:39:12.579 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.579 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.579 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:39:12.580 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:39:12.580 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:39:12.580 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:39:12.580 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.580 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:39:12.580 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:39:12.580 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:12.580 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.580 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.580 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:39:12.580 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:39:12.580 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:12.580 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:12.581 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:12.581 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.581 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:39:12.581 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:39:12.581 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:39:12.581 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:39:12.581 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:39:12.581 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:12.581 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:12.581 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.581 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:39:12.581 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:39:12.582 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.582 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:39:12.582 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:39:12.582 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:39:12.582 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:12.582 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:12.582 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:39:12.582 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.582 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:39:12.582 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:39:12.582 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:39:12.582 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:12.582 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:12.582 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:39:12.583 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.583 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:39:12.583 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:39:12.583 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:39:12.583 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:12.583 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:12.583 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:39:12.583 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.583 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:39:12.583 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:39:12.583 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:39:12.583 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:12.583 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:12.583 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:39:12.584 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:12.584 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:39:12.584 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:39:12.584 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:39:12.584 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:12.584 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:12.584 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:12.584 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:39:12.584 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:39:12.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.569+0000 7fca13fff640 1 -- 172.21.15.103:0/3022384872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c09ca00 msgr2=0x7fca1c1ef490 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:39:12.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.569+0000 7fca13fff640 1 --2- 172.21.15.103:0/3022384872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c09ca00 0x7fca1c1ef490 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fca0c017000 tx=0x7fca0c004a40 comp rx=0 tx=0).stop 2024-09-10T08:39:12.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.569+0000 7fca220d9640 1 -- 172.21.15.103:0/3022384872 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca0006bde0 msgr2=0x7fca0006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:12.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.569+0000 7fca220d9640 1 --2- 172.21.15.103:0/3022384872 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fca0006bde0 0x7fca0006e2a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fca1c1eca60 tx=0x7fca14007990 comp rx=0 tx=0).stop 2024-09-10T08:39:12.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.569+0000 7fca220d9640 1 -- 172.21.15.103:0/3022384872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca1c0c7f80 msgr2=0x7fca1c0c45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:12.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.569+0000 7fca220d9640 1 --2- 172.21.15.103:0/3022384872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca1c0c7f80 0x7fca1c0c45e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca0402c870 tx=0x7fca04004730 comp rx=0 tx=0).stop 2024-09-10T08:39:12.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.569+0000 7fca1bfff640 1 -- 172.21.15.103:0/3022384872 reap_dead start 2024-09-10T08:39:12.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.569+0000 7fca1bfff640 1 -- 172.21.15.103:0/3022384872 reap_dead start 2024-09-10T08:39:12.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.569+0000 7fca220d9640 1 -- 172.21.15.103:0/3022384872 shutdown_connections 2024-09-10T08:39:12.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.569+0000 7fca220d9640 1 -- 172.21.15.103:0/3022384872 >> 172.21.15.103:0/3022384872 conn(0x7fca1c0c8bf0 msgr2=0x7fca1c0c2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:12.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.570+0000 7fca220d9640 1 -- 172.21.15.103:0/3022384872 shutdown_connections 2024-09-10T08:39:12.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:12.570+0000 7fca220d9640 1 -- 172.21.15.103:0/3022384872 wait complete. 2024-09-10T08:39:12.587 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:39:12.587 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-10T08:39:32.289 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:39:32.292 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:39:32.588 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-10T08:39:32.589 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-10T08:39:32.589 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T08:39:32.589 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T08:39:32.592 INFO:tasks.ceph.mon.a:Started 2024-09-10T08:39:32.592 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:39:32.592 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:39:32.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.756+0000 7fdd87453640 1 Processor -- start 2024-09-10T08:39:32.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.756+0000 7fdd87453640 1 -- start start 2024-09-10T08:39:32.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.758+0000 7fdd87453640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd80151910 0x7fdd800c3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:32.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.758+0000 7fdd87453640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdd8006bbe0 0x7fdd8006c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:32.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.758+0000 7fdd87453640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd8006ca70 con 0x7fdd800a8170 2024-09-10T08:39:32.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.758+0000 7fdd87453640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fdd80154bf0 con 0x7fdd8006bbe0 2024-09-10T08:39:32.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.758+0000 7fdd87453640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fdd800c6a60 con 0x7fdd80151910 2024-09-10T08:39:32.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.759+0000 7fdd859f0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdd8006bbe0 0x7fdd8006c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:32.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.759+0000 7fdd859f0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdd8006bbe0 0x7fdd8006c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:37062/0 (socket says 172.21.15.103:37062) 2024-09-10T08:39:32.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.759+0000 7fdd859f0640 1 -- 172.21.15.103:0/1969551811 learned_addr learned my addr 172.21.15.103:0/1969551811 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:39:32.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.759+0000 7fdd851ef640 1 --2- 172.21.15.103:0/1969551811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd80151910 0x7fdd800c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:32.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.759+0000 7fdd859f0640 1 -- 172.21.15.103:0/1969551811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd80151910 msgr2=0x7fdd800c3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:32.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.759+0000 7fdd859f0640 1 --2- 172.21.15.103:0/1969551811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd80151910 0x7fdd800c3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.759+0000 7fdd859f0640 1 -- 172.21.15.103:0/1969551811 >> v1:172.21.15.154:6789/0 conn(0x7fdd800a8170 legacy=0x7fdd800c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:32.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.759+0000 7fdd859f0640 1 -- 172.21.15.103:0/1969551811 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd800c7c30 con 0x7fdd8006bbe0 2024-09-10T08:39:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.760+0000 7fdd859f0640 1 --2- 172.21.15.103:0/1969551811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd8006bbe0 0x7fdd8006c030 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009e50 tx=0x7fdd7802e9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57a97ceb91ebff17 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.761+0000 7fdd77fff640 1 -- 172.21.15.103:0/1969551811 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd78034670 con 0x7fdd8006bbe0 2024-09-10T08:39:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.761+0000 7fdd77fff640 1 -- 172.21.15.103:0/1969551811 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd78039070 con 0x7fdd8006bbe0 2024-09-10T08:39:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.761+0000 7fdd77fff640 1 -- 172.21.15.103:0/1969551811 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd78034670 con 0x7fdd8006bbe0 2024-09-10T08:39:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.762+0000 7fdd87453640 1 -- 172.21.15.103:0/1969551811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd8006bbe0 msgr2=0x7fdd8006c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.762+0000 7fdd87453640 1 --2- 172.21.15.103:0/1969551811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd8006bbe0 0x7fdd8006c030 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009e50 tx=0x7fdd7802e9c0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.762+0000 7fdd87453640 1 -- 172.21.15.103:0/1969551811 shutdown_connections 2024-09-10T08:39:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.762+0000 7fdd87453640 1 --2- 172.21.15.103:0/1969551811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd8006bbe0 0x7fdd8006c030 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.762+0000 7fdd87453640 1 --2- 172.21.15.103:0/1969551811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd80151910 0x7fdd800c3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.762+0000 7fdd87453640 1 -- 172.21.15.103:0/1969551811 >> 172.21.15.103:0/1969551811 conn(0x7fdd800c5660 msgr2=0x7fdd800c5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:32.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.765+0000 7fdd87453640 1 -- 172.21.15.103:0/1969551811 shutdown_connections 2024-09-10T08:39:32.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.765+0000 7fdd87453640 1 -- 172.21.15.103:0/1969551811 wait complete. 2024-09-10T08:39:32.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.767+0000 7fdd87453640 1 Processor -- start 2024-09-10T08:39:32.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.767+0000 7fdd87453640 1 -- start start 2024-09-10T08:39:32.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.768+0000 7fdd87453640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd8006bbe0 0x7fdd801f1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:32.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.768+0000 7fdd87453640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd800a8170 0x7fdd8014d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:32.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.768+0000 7fdd87453640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd80151910 0x7fdd8014cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:32.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.768+0000 7fdd87453640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdd800c7000 con 0x7fdd80151910 2024-09-10T08:39:32.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.768+0000 7fdd87453640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdd800c6d20 con 0x7fdd8006bbe0 2024-09-10T08:39:32.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.768+0000 7fdd87453640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fdd800c8800 con 0x7fdd800a8170 2024-09-10T08:39:32.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.768+0000 7fdd859f0640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd80151910 msgr2=0x7fdd8014cad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:39:32.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.768+0000 7fdd851ef640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd8006bbe0 0x7fdd801f1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:32.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.768+0000 7fdd851ef640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd8006bbe0 0x7fdd801f1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:37068/0 (socket says 172.21.15.103:37068) 2024-09-10T08:39:32.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.768+0000 7fdd851ef640 1 -- 172.21.15.103:0/4206775456 learned_addr learned my addr 172.21.15.103:0/4206775456 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:39:32.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.768+0000 7fdd849ee640 1 --2- 172.21.15.103:0/4206775456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd800a8170 0x7fdd8014d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:32.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.769+0000 7fdd859f0640 1 --2- 172.21.15.103:0/4206775456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd80151910 0x7fdd8014cad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:32.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.769+0000 7fdd851ef640 1 -- 172.21.15.103:0/4206775456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd800a8170 msgr2=0x7fdd8014d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:32.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.769+0000 7fdd851ef640 1 --2- 172.21.15.103:0/4206775456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd800a8170 0x7fdd8014d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.769+0000 7fdd851ef640 1 -- 172.21.15.103:0/4206775456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd80151910 msgr2=0x7fdd8014cad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:39:32.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.769+0000 7fdd851ef640 1 --2- 172.21.15.103:0/4206775456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd80151910 0x7fdd8014cad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.769+0000 7fdd851ef640 1 -- 172.21.15.103:0/4206775456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd80071d00 con 0x7fdd8006bbe0 2024-09-10T08:39:32.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.771+0000 7fdd851ef640 1 --2- 172.21.15.103:0/4206775456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd8006bbe0 0x7fdd801f1580 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c00d5d0 tx=0x7fdd7c00da90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:32.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.771+0000 7fdd75ffb640 1 -- 172.21.15.103:0/4206775456 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c0125f0 con 0x7fdd8006bbe0 2024-09-10T08:39:32.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.771+0000 7fdd87453640 1 -- 172.21.15.103:0/4206775456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd8014c310 con 0x7fdd8006bbe0 2024-09-10T08:39:32.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.772+0000 7fdd75ffb640 1 -- 172.21.15.103:0/4206775456 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd7c019070 con 0x7fdd8006bbe0 2024-09-10T08:39:32.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.772+0000 7fdd75ffb640 1 -- 172.21.15.103:0/4206775456 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c012990 con 0x7fdd8006bbe0 2024-09-10T08:39:32.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.772+0000 7fdd87453640 1 -- 172.21.15.103:0/4206775456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd800a73a0 con 0x7fdd8006bbe0 2024-09-10T08:39:32.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.773+0000 7fdd87453640 1 -- 172.21.15.103:0/4206775456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd60005290 con 0x7fdd8006bbe0 2024-09-10T08:39:32.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.774+0000 7fdd75ffb640 1 -- 172.21.15.103:0/4206775456 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd7c012b30 con 0x7fdd8006bbe0 2024-09-10T08:39:32.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.775+0000 7fdd75ffb640 1 --2- 172.21.15.103:0/4206775456 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdd6406bde0 0x7fdd6406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:32.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.775+0000 7fdd75ffb640 1 -- 172.21.15.103:0/4206775456 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fdd7c08b420 con 0x7fdd8006bbe0 2024-09-10T08:39:32.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.775+0000 7fdd849ee640 1 --2- 172.21.15.103:0/4206775456 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdd6406bde0 0x7fdd6406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:32.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.776+0000 7fdd849ee640 1 --2- 172.21.15.103:0/4206775456 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdd6406bde0 0x7fdd6406e2a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdd80073fa0 tx=0x7fdd70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:32.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:32.784+0000 7fdd75ffb640 1 -- 172.21.15.103:0/4206775456 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd7c024020 con 0x7fdd8006bbe0 2024-09-10T08:39:33.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:33.276+0000 7fdd87453640 1 -- 172.21.15.103:0/4206775456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdd60005580 con 0x7fdd8006bbe0 2024-09-10T08:39:33.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:33.278+0000 7fdd75ffb640 1 -- 172.21.15.103:0/4206775456 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7fdd7c0599a0 con 0x7fdd8006bbe0 2024-09-10T08:39:33.280 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":88,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:39:33.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:33.286+0000 7fdd87453640 1 -- 172.21.15.103:0/4206775456 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdd6406bde0 msgr2=0x7fdd6406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:33.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:33.286+0000 7fdd87453640 1 --2- 172.21.15.103:0/4206775456 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdd6406bde0 0x7fdd6406e2a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdd80073fa0 tx=0x7fdd70009040 comp rx=0 tx=0).stop 2024-09-10T08:39:33.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:33.286+0000 7fdd87453640 1 -- 172.21.15.103:0/4206775456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd8006bbe0 msgr2=0x7fdd801f1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:33.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:33.286+0000 7fdd87453640 1 --2- 172.21.15.103:0/4206775456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd8006bbe0 0x7fdd801f1580 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c00d5d0 tx=0x7fdd7c00da90 comp rx=0 tx=0).stop 2024-09-10T08:39:33.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:33.286+0000 7fdd87453640 1 -- 172.21.15.103:0/4206775456 shutdown_connections 2024-09-10T08:39:33.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:33.286+0000 7fdd87453640 1 --2- 172.21.15.103:0/4206775456 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdd6406bde0 0x7fdd6406e2a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:33.286+0000 7fdd87453640 1 --2- 172.21.15.103:0/4206775456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd80151910 0x7fdd8014cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:33.286+0000 7fdd87453640 1 --2- 172.21.15.103:0/4206775456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd800a8170 0x7fdd8014d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:33.286+0000 7fdd87453640 1 --2- 172.21.15.103:0/4206775456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd8006bbe0 0x7fdd801f1580 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:33.286+0000 7fdd87453640 1 -- 172.21.15.103:0/4206775456 >> 172.21.15.103:0/4206775456 conn(0x7fdd800c5660 msgr2=0x7fdd800a9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:33.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:33.287+0000 7fdd87453640 1 -- 172.21.15.103:0/4206775456 shutdown_connections 2024-09-10T08:39:33.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:33.287+0000 7fdd87453640 1 -- 172.21.15.103:0/4206775456 wait complete. 2024-09-10T08:39:36.307 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:39:36.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.480+0000 7f619758d640 1 Processor -- start 2024-09-10T08:39:36.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.482+0000 7f619758d640 1 -- start start 2024-09-10T08:39:36.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.483+0000 7f619758d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61900c2f40 0x7f6190156a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:36.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.483+0000 7f619758d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61900c3840 con 0x7f6190159970 2024-09-10T08:39:36.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.483+0000 7f6195b2a640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6190159970 0x7f6190159e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56310/0 (socket says 172.21.15.103:56310) 2024-09-10T08:39:36.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.483+0000 7f6195b2a640 1 -- 172.21.15.103:0/376980952 learned_addr learned my addr 172.21.15.103:0/376980952 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:39:36.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.483+0000 7f619758d640 1 -- 172.21.15.103:0/376980952 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61900c3b20 con 0x7f61900ad6d0 2024-09-10T08:39:36.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.483+0000 7f619758d640 1 -- 172.21.15.103:0/376980952 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f619015a510 con 0x7f61900c2f40 2024-09-10T08:39:36.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.484+0000 7f6194b28640 1 --2- 172.21.15.103:0/376980952 >> v2:172.21.15.154:3300/0 conn(0x7f61900c2f40 0x7f6190156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:36.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.486+0000 7f6194b28640 1 -- 172.21.15.103:0/376980952 >> v1:172.21.15.154:6789/0 conn(0x7f61900ad6d0 legacy=0x7f619006ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:36.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.486+0000 7f6194b28640 1 -- 172.21.15.103:0/376980952 >> v1:172.21.15.103:6789/0 conn(0x7f6190159970 legacy=0x7f6190159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:36.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.486+0000 7f6194b28640 1 -- 172.21.15.103:0/376980952 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61900c3e00 con 0x7f61900c2f40 2024-09-10T08:39:36.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.488+0000 7f6194b28640 1 --2- 172.21.15.103:0/376980952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61900c2f40 0x7f6190156a20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f61800097a0 tx=0x7f618002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c34a5d0c811fa3ec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:36.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.488+0000 7f6187fff640 1 -- 172.21.15.103:0/376980952 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6180037070 con 0x7f61900c2f40 2024-09-10T08:39:36.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.488+0000 7f6187fff640 1 -- 172.21.15.103:0/376980952 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6180032440 con 0x7f61900c2f40 2024-09-10T08:39:36.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.489+0000 7f6187fff640 1 -- 172.21.15.103:0/376980952 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6180032810 con 0x7f61900c2f40 2024-09-10T08:39:36.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.489+0000 7f619758d640 1 -- 172.21.15.103:0/376980952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61900c2f40 msgr2=0x7f6190156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:36.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.489+0000 7f619758d640 1 --2- 172.21.15.103:0/376980952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61900c2f40 0x7f6190156a20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f61800097a0 tx=0x7f618002a1a0 comp rx=0 tx=0).stop 2024-09-10T08:39:36.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.490+0000 7f619758d640 1 -- 172.21.15.103:0/376980952 shutdown_connections 2024-09-10T08:39:36.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.490+0000 7f619758d640 1 --2- 172.21.15.103:0/376980952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61900c2f40 0x7f6190156a20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:36.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.490+0000 7f619758d640 1 -- 172.21.15.103:0/376980952 >> 172.21.15.103:0/376980952 conn(0x7f61900a9530 msgr2=0x7f61900a9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:36.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.490+0000 7f619758d640 1 -- 172.21.15.103:0/376980952 shutdown_connections 2024-09-10T08:39:36.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.490+0000 7f619758d640 1 -- 172.21.15.103:0/376980952 wait complete. 2024-09-10T08:39:36.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.492+0000 7f619758d640 1 Processor -- start 2024-09-10T08:39:36.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.492+0000 7f619758d640 1 -- start start 2024-09-10T08:39:36.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.493+0000 7f619758d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61900ad6d0 0x7f61901ef3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:36.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.493+0000 7f619758d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61900c2f40 0x7f61900a8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:36.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.493+0000 7f619758d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6190159970 0x7f6190149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:36.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.493+0000 7f619758d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f619006d3e0 con 0x7f61900ad6d0 2024-09-10T08:39:36.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.493+0000 7f619758d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f619006d560 con 0x7f6190159970 2024-09-10T08:39:36.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.493+0000 7f619758d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6190161930 con 0x7f61900c2f40 2024-09-10T08:39:36.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.493+0000 7f6195b2a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6190159970 0x7f6190149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:36.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.493+0000 7f6195329640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61900ad6d0 0x7f61901ef3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:36.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.493+0000 7f6195329640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61900ad6d0 0x7f61901ef3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42090/0 (socket says 172.21.15.103:42090) 2024-09-10T08:39:36.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.493+0000 7f6195b2a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6190159970 0x7f6190149a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:42294/0 (socket says 172.21.15.103:42294) 2024-09-10T08:39:36.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.493+0000 7f6195329640 1 -- 172.21.15.103:0/1926083372 learned_addr learned my addr 172.21.15.103:0/1926083372 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:39:36.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.493+0000 7f6195329640 1 -- 172.21.15.103:0/1926083372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61900ad6d0 msgr2=0x7f61901ef3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-10T08:39:36.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.493+0000 7f6195329640 1 -- 172.21.15.103:0/1926083372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61900ad6d0 msgr2=0x7f61901ef3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:39:36.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.493+0000 7f6195329640 1 --2- 172.21.15.103:0/1926083372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61900ad6d0 0x7f61901ef3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:36.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.493+0000 7f6195329640 1 --2- 172.21.15.103:0/1926083372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61900ad6d0 0x7f61901ef3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:36.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.494+0000 7f6194b28640 1 --2- 172.21.15.103:0/1926083372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61900c2f40 0x7f61900a8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:36.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.494+0000 7f6195b2a640 1 -- 172.21.15.103:0/1926083372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61900c2f40 msgr2=0x7f61900a8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:36.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.494+0000 7f6195b2a640 1 --2- 172.21.15.103:0/1926083372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61900c2f40 0x7f61900a8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:36.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.494+0000 7f6195b2a640 1 -- 172.21.15.103:0/1926083372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61900ad6d0 msgr2=0x7f61901ef3e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:39:36.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.494+0000 7f6195b2a640 1 --2- 172.21.15.103:0/1926083372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61900ad6d0 0x7f61901ef3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:36.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.494+0000 7f6195b2a640 1 -- 172.21.15.103:0/1926083372 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61900a92e0 con 0x7f6190159970 2024-09-10T08:39:36.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.494+0000 7f6195b2a640 1 --2- 172.21.15.103:0/1926083372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6190159970 0x7f6190149a50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f618800cad0 tx=0x7f618800cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:36.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.495+0000 7f6185ffb640 1 -- 172.21.15.103:0/1926083372 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6188017070 con 0x7f6190159970 2024-09-10T08:39:36.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.495+0000 7f6185ffb640 1 -- 172.21.15.103:0/1926083372 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f618800ab70 con 0x7f6190159970 2024-09-10T08:39:36.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.495+0000 7f6185ffb640 1 -- 172.21.15.103:0/1926083372 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6188012400 con 0x7f6190159970 2024-09-10T08:39:36.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.496+0000 7f619758d640 1 -- 172.21.15.103:0/1926083372 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f619014e8e0 con 0x7f6190159970 2024-09-10T08:39:36.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.497+0000 7f619758d640 1 -- 172.21.15.103:0/1926083372 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61900a7e70 con 0x7f6190159970 2024-09-10T08:39:36.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.498+0000 7f619758d640 1 -- 172.21.15.103:0/1926083372 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6190156a20 con 0x7f6190159970 2024-09-10T08:39:36.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.499+0000 7f6185ffb640 1 -- 172.21.15.103:0/1926083372 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f618801a070 con 0x7f6190159970 2024-09-10T08:39:36.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.499+0000 7f6185ffb640 1 --2- 172.21.15.103:0/1926083372 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f617406bf00 0x7f617406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:36.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.499+0000 7f6185ffb640 1 -- 172.21.15.103:0/1926083372 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f618808ad10 con 0x7f6190159970 2024-09-10T08:39:36.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.499+0000 7f6195329640 1 --2- 172.21.15.103:0/1926083372 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f617406bf00 0x7f617406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:36.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.500+0000 7f6195329640 1 --2- 172.21.15.103:0/1926083372 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f617406bf00 0x7f617406e3c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f61900ab060 tx=0x7f618c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:36.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.507+0000 7f6185ffb640 1 -- 172.21.15.103:0/1926083372 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6188058d40 con 0x7f6190159970 2024-09-10T08:39:36.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.970+0000 7f619758d640 1 -- 172.21.15.103:0/1926083372 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f61900c2d20 con 0x7f6190159970 2024-09-10T08:39:36.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.972+0000 7f6185ffb640 1 -- 172.21.15.103:0/1926083372 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f618805d040 con 0x7f6190159970 2024-09-10T08:39:36.971 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":88,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:39:36.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.975+0000 7f619758d640 1 -- 172.21.15.103:0/1926083372 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f617406bf00 msgr2=0x7f617406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:36.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.975+0000 7f619758d640 1 --2- 172.21.15.103:0/1926083372 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f617406bf00 0x7f617406e3c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f61900ab060 tx=0x7f618c009040 comp rx=0 tx=0).stop 2024-09-10T08:39:36.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.975+0000 7f619758d640 1 -- 172.21.15.103:0/1926083372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6190159970 msgr2=0x7f6190149a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:36.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.975+0000 7f619758d640 1 --2- 172.21.15.103:0/1926083372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6190159970 0x7f6190149a50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f618800cad0 tx=0x7f618800cf90 comp rx=0 tx=0).stop 2024-09-10T08:39:36.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.975+0000 7f619758d640 1 -- 172.21.15.103:0/1926083372 shutdown_connections 2024-09-10T08:39:36.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.975+0000 7f619758d640 1 --2- 172.21.15.103:0/1926083372 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f617406bf00 0x7f617406e3c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:36.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.975+0000 7f619758d640 1 --2- 172.21.15.103:0/1926083372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6190159970 0x7f6190149a50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:36.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.975+0000 7f619758d640 1 --2- 172.21.15.103:0/1926083372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61900c2f40 0x7f61900a8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:36.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.975+0000 7f619758d640 1 --2- 172.21.15.103:0/1926083372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61900ad6d0 0x7f61901ef3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:36.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.975+0000 7f619758d640 1 -- 172.21.15.103:0/1926083372 >> 172.21.15.103:0/1926083372 conn(0x7f61900a9530 msgr2=0x7f61900a9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:36.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.975+0000 7f619758d640 1 -- 172.21.15.103:0/1926083372 shutdown_connections 2024-09-10T08:39:36.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:36.976+0000 7f619758d640 1 -- 172.21.15.103:0/1926083372 wait complete. 2024-09-10T08:39:39.999 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:39:40.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.169+0000 7f58d98ae640 1 Processor -- start 2024-09-10T08:39:40.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.169+0000 7f58d98ae640 1 -- start start 2024-09-10T08:39:40.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.170+0000 7f58d98ae640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58d406cd80 0x7f58d4153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:40.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.170+0000 7f58d98ae640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f58d415a4a0 0x7f58d4156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:40.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.170+0000 7f58d98ae640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d40c7070 con 0x7f58d40c8b10 2024-09-10T08:39:40.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.170+0000 7f58d98ae640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f58d406d210 con 0x7f58d415a4a0 2024-09-10T08:39:40.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.170+0000 7f58d98ae640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f58d40c69b0 con 0x7f58d406cd80 2024-09-10T08:39:40.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.171+0000 7f58d37fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f58d415a4a0 0x7f58d4156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:40.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.171+0000 7f58d2ffd640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f58d40c8b10 0x7f58d41534d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56320/0 (socket says 172.21.15.103:56320) 2024-09-10T08:39:40.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.171+0000 7f58d2ffd640 1 -- 172.21.15.103:0/1059486015 learned_addr learned my addr 172.21.15.103:0/1059486015 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:39:40.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.171+0000 7f58d27fc640 1 --2- 172.21.15.103:0/1059486015 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58d406cd80 0x7f58d4153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:40.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.171+0000 7f58d37fe640 1 -- 172.21.15.103:0/1059486015 >> v2:172.21.15.103:3300/0 conn(0x7f58d415a4a0 msgr2=0x7f58d4156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:39:40.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.171+0000 7f58d37fe640 1 -- 172.21.15.103:0/1059486015 >> v2:172.21.15.103:3300/0 conn(0x7f58d415a4a0 msgr2=0x7f58d4156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:40.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.171+0000 7f58d37fe640 1 --2- 172.21.15.103:0/1059486015 >> v2:172.21.15.103:3300/0 conn(0x7f58d415a4a0 0x7f58d4156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:40.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.171+0000 7f58d37fe640 1 --2- 172.21.15.103:0/1059486015 >> v2:172.21.15.103:3300/0 conn(0x7f58d415a4a0 0x7f58d4156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:40.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.171+0000 7f58d27fc640 1 -- 172.21.15.103:0/1059486015 >> v2:172.21.15.103:3300/0 conn(0x7f58d415a4a0 msgr2=0x7f58d4156660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:39:40.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.171+0000 7f58d27fc640 1 --2- 172.21.15.103:0/1059486015 >> v2:172.21.15.103:3300/0 conn(0x7f58d415a4a0 0x7f58d4156660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:40.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.171+0000 7f58d27fc640 1 -- 172.21.15.103:0/1059486015 >> v1:172.21.15.103:6789/0 conn(0x7f58d40c8b10 legacy=0x7f58d41534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:40.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.171+0000 7f58d27fc640 1 -- 172.21.15.103:0/1059486015 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d40c6c90 con 0x7f58d406cd80 2024-09-10T08:39:40.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.172+0000 7f58d27fc640 1 --2- 172.21.15.103:0/1059486015 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58d406cd80 0x7f58d4153be0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0097a0 tx=0x7f58bc02a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84d1d2adc378026f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:40.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.173+0000 7f58d1ffb640 1 -- 172.21.15.103:0/1059486015 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc037070 con 0x7f58d406cd80 2024-09-10T08:39:40.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.173+0000 7f58d1ffb640 1 -- 172.21.15.103:0/1059486015 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58bc02ae40 con 0x7f58d406cd80 2024-09-10T08:39:40.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.173+0000 7f58d1ffb640 1 -- 172.21.15.103:0/1059486015 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc032660 con 0x7f58d406cd80 2024-09-10T08:39:40.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.174+0000 7f58d98ae640 1 -- 172.21.15.103:0/1059486015 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58d406cd80 msgr2=0x7f58d4153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:40.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.174+0000 7f58d98ae640 1 --2- 172.21.15.103:0/1059486015 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58d406cd80 0x7f58d4153be0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0097a0 tx=0x7f58bc02a0f0 comp rx=0 tx=0).stop 2024-09-10T08:39:40.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.174+0000 7f58d98ae640 1 -- 172.21.15.103:0/1059486015 shutdown_connections 2024-09-10T08:39:40.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.174+0000 7f58d98ae640 1 --2- 172.21.15.103:0/1059486015 >> v2:172.21.15.103:3300/0 conn(0x7f58d415a4a0 0x7f58d4156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:40.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.174+0000 7f58d98ae640 1 --2- 172.21.15.103:0/1059486015 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58d406cd80 0x7f58d4153be0 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0097a0 tx=0x7f58bc02a0f0 comp rx=0 tx=0).stop 2024-09-10T08:39:40.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.174+0000 7f58d98ae640 1 -- 172.21.15.103:0/1059486015 >> 172.21.15.103:0/1059486015 conn(0x7f58d40adb80 msgr2=0x7f58d40adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:40.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.176+0000 7f58d98ae640 1 -- 172.21.15.103:0/1059486015 shutdown_connections 2024-09-10T08:39:40.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.177+0000 7f58d98ae640 1 -- 172.21.15.103:0/1059486015 wait complete. 2024-09-10T08:39:40.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.179+0000 7f58d98ae640 1 Processor -- start 2024-09-10T08:39:40.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.179+0000 7f58d98ae640 1 -- start start 2024-09-10T08:39:40.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.180+0000 7f58d98ae640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58d40c8b10 0x7f58d41e1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:40.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.180+0000 7f58d98ae640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58d415a4a0 0x7f58d4158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:40.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.180+0000 7f58d98ae640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58d414fb10 0x7f58d41f0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:40.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.181+0000 7f58d98ae640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f58d40c9070 con 0x7f58d40c8b10 2024-09-10T08:39:40.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.181+0000 7f58d98ae640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f58d40c8ef0 con 0x7f58d414fb10 2024-09-10T08:39:40.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.181+0000 7f58d98ae640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f58d4156ba0 con 0x7f58d415a4a0 2024-09-10T08:39:40.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.181+0000 7f58d37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58d414fb10 0x7f58d41f0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:40.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.181+0000 7f58d37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58d414fb10 0x7f58d41f0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:42316/0 (socket says 172.21.15.103:42316) 2024-09-10T08:39:40.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.181+0000 7f58d37fe640 1 -- 172.21.15.103:0/411403909 learned_addr learned my addr 172.21.15.103:0/411403909 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:39:40.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.181+0000 7f58d2ffd640 1 --2- 172.21.15.103:0/411403909 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58d40c8b10 0x7f58d41e1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:40.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.181+0000 7f58d2ffd640 1 -- 172.21.15.103:0/411403909 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58d40c8b10 msgr2=0x7f58d41e1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-10T08:39:40.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.181+0000 7f58d2ffd640 1 -- 172.21.15.103:0/411403909 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58d40c8b10 msgr2=0x7f58d41e1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:39:40.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.181+0000 7f58d2ffd640 1 --2- 172.21.15.103:0/411403909 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58d40c8b10 0x7f58d41e1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:40.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.181+0000 7f58d2ffd640 1 --2- 172.21.15.103:0/411403909 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58d40c8b10 0x7f58d41e1190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:40.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.182+0000 7f58d27fc640 1 --2- 172.21.15.103:0/411403909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58d415a4a0 0x7f58d4158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:40.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.183+0000 7f58d37fe640 1 -- 172.21.15.103:0/411403909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58d415a4a0 msgr2=0x7f58d4158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:40.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.183+0000 7f58d37fe640 1 --2- 172.21.15.103:0/411403909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58d415a4a0 0x7f58d4158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:40.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.183+0000 7f58d37fe640 1 -- 172.21.15.103:0/411403909 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58d40c8b10 msgr2=0x7f58d41e1190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:39:40.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.183+0000 7f58d37fe640 1 --2- 172.21.15.103:0/411403909 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58d40c8b10 0x7f58d41e1190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:40.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.184+0000 7f58d37fe640 1 -- 172.21.15.103:0/411403909 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d4150040 con 0x7f58d414fb10 2024-09-10T08:39:40.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.184+0000 7f58d37fe640 1 --2- 172.21.15.103:0/411403909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58d414fb10 0x7f58d41f0300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f58cc007ec0 tx=0x7f58cc00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:40.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.184+0000 7f58cbfff640 1 -- 172.21.15.103:0/411403909 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc014620 con 0x7f58d414fb10 2024-09-10T08:39:40.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.184+0000 7f58d98ae640 1 -- 172.21.15.103:0/411403909 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d41f4280 con 0x7f58d414fb10 2024-09-10T08:39:40.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.184+0000 7f58d98ae640 1 -- 172.21.15.103:0/411403909 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d41e2080 con 0x7f58d414fb10 2024-09-10T08:39:40.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.184+0000 7f58cbfff640 1 -- 172.21.15.103:0/411403909 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58cc019070 con 0x7f58d414fb10 2024-09-10T08:39:40.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.185+0000 7f58cbfff640 1 -- 172.21.15.103:0/411403909 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc0149c0 con 0x7f58d414fb10 2024-09-10T08:39:40.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.186+0000 7f58d98ae640 1 -- 172.21.15.103:0/411403909 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58b8005290 con 0x7f58d414fb10 2024-09-10T08:39:40.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.187+0000 7f58cbfff640 1 -- 172.21.15.103:0/411403909 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f58cc014c20 con 0x7f58d414fb10 2024-09-10T08:39:40.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.187+0000 7f58cbfff640 1 --2- 172.21.15.103:0/411403909 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f58b406be30 0x7f58b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:40.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.188+0000 7f58cbfff640 1 -- 172.21.15.103:0/411403909 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f58cc08bb20 con 0x7f58d414fb10 2024-09-10T08:39:40.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.188+0000 7f58d2ffd640 1 --2- 172.21.15.103:0/411403909 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f58b406be30 0x7f58b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:40.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.188+0000 7f58d2ffd640 1 --2- 172.21.15.103:0/411403909 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f58b406be30 0x7f58b406e2f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f58d40ad400 tx=0x7f58c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:40.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.196+0000 7f58cbfff640 1 -- 172.21.15.103:0/411403909 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f58cc05a0b0 con 0x7f58d414fb10 2024-09-10T08:39:40.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.681+0000 7f58d98ae640 1 -- 172.21.15.103:0/411403909 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f58b8005850 con 0x7f58d414fb10 2024-09-10T08:39:40.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.682+0000 7f58cbfff640 1 -- 172.21.15.103:0/411403909 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f58cc0599b0 con 0x7f58d414fb10 2024-09-10T08:39:40.682 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":88,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":29,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:39:40.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.686+0000 7f58d98ae640 1 -- 172.21.15.103:0/411403909 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f58b406be30 msgr2=0x7f58b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:40.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.686+0000 7f58d98ae640 1 --2- 172.21.15.103:0/411403909 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f58b406be30 0x7f58b406e2f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f58d40ad400 tx=0x7f58c4009040 comp rx=0 tx=0).stop 2024-09-10T08:39:40.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.686+0000 7f58d98ae640 1 -- 172.21.15.103:0/411403909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58d414fb10 msgr2=0x7f58d41f0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:40.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.686+0000 7f58d98ae640 1 --2- 172.21.15.103:0/411403909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58d414fb10 0x7f58d41f0300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f58cc007ec0 tx=0x7f58cc00e4b0 comp rx=0 tx=0).stop 2024-09-10T08:39:40.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.687+0000 7f58d98ae640 1 -- 172.21.15.103:0/411403909 shutdown_connections 2024-09-10T08:39:40.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.687+0000 7f58d98ae640 1 --2- 172.21.15.103:0/411403909 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f58b406be30 0x7f58b406e2f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:40.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.687+0000 7f58d98ae640 1 --2- 172.21.15.103:0/411403909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58d414fb10 0x7f58d41f0300 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:40.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.687+0000 7f58d98ae640 1 --2- 172.21.15.103:0/411403909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58d415a4a0 0x7f58d4158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:40.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.687+0000 7f58d98ae640 1 --2- 172.21.15.103:0/411403909 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58d40c8b10 0x7f58d41e1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:40.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.687+0000 7f58d98ae640 1 -- 172.21.15.103:0/411403909 >> 172.21.15.103:0/411403909 conn(0x7f58d40adb80 msgr2=0x7f58d40adf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:40.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.687+0000 7f58d98ae640 1 -- 172.21.15.103:0/411403909 shutdown_connections 2024-09-10T08:39:40.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:40.687+0000 7f58d98ae640 1 -- 172.21.15.103:0/411403909 wait complete. 2024-09-10T08:39:43.706 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:39:43.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.884+0000 7f979b59e640 1 Processor -- start 2024-09-10T08:39:43.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.884+0000 7f979b59e640 1 -- start start 2024-09-10T08:39:43.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.885+0000 7f979b59e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f979c153040 0x7f979c0c2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:43.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.887+0000 7f979b59e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f979c0c8350 0x7f979c15d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:43.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.887+0000 7f979b59e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f979c0c6310 con 0x7f979c0c68d0 2024-09-10T08:39:43.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.887+0000 7f979b59e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f979c0c2390 con 0x7f979c153040 2024-09-10T08:39:43.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.887+0000 7f979b59e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f979c0c7340 con 0x7f979c0c8350 2024-09-10T08:39:43.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.887+0000 7f979a59c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f979c153040 0x7f979c0c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:43.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.887+0000 7f979a59c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f979c153040 0x7f979c0c2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42110/0 (socket says 172.21.15.103:42110) 2024-09-10T08:39:43.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.887+0000 7f979a59c640 1 -- 172.21.15.103:0/2712863569 learned_addr learned my addr 172.21.15.103:0/2712863569 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:39:43.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.887+0000 7f979ad9d640 1 --2- 172.21.15.103:0/2712863569 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f979c0c8350 0x7f979c15d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:43.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.888+0000 7f979a59c640 1 -- 172.21.15.103:0/2712863569 >> v2:172.21.15.103:3300/0 conn(0x7f979c153040 msgr2=0x7f979c0c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:39:43.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.888+0000 7f979a59c640 1 -- 172.21.15.103:0/2712863569 >> v2:172.21.15.103:3300/0 conn(0x7f979c153040 msgr2=0x7f979c0c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:43.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.888+0000 7f979ad9d640 1 -- 172.21.15.103:0/2712863569 >> v2:172.21.15.103:3300/0 conn(0x7f979c153040 msgr2=0x7f979c0c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:43.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.888+0000 7f979a59c640 1 --2- 172.21.15.103:0/2712863569 >> v2:172.21.15.103:3300/0 conn(0x7f979c153040 0x7f979c0c2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:43.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.888+0000 7f979a59c640 1 --2- 172.21.15.103:0/2712863569 >> v2:172.21.15.103:3300/0 conn(0x7f979c153040 0x7f979c0c2820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:43.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.888+0000 7f979ad9d640 1 --2- 172.21.15.103:0/2712863569 >> v2:172.21.15.103:3300/0 conn(0x7f979c153040 0x7f979c0c2820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:43.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.888+0000 7f979ad9d640 1 -- 172.21.15.103:0/2712863569 >> v1:172.21.15.154:6789/0 conn(0x7f979c0c68d0 legacy=0x7f979c0c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:43.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.889+0000 7f979ad9d640 1 -- 172.21.15.103:0/2712863569 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979c0c7620 con 0x7f979c0c8350 2024-09-10T08:39:43.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.890+0000 7f979ad9d640 1 --2- 172.21.15.103:0/2712863569 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f979c0c8350 0x7f979c15d440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f979c0c8800 tx=0x7f979002a090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7e204570f913414 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:43.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.891+0000 7f979959a640 1 -- 172.21.15.103:0/2712863569 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9790037070 con 0x7f979c0c8350 2024-09-10T08:39:43.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.891+0000 7f979959a640 1 -- 172.21.15.103:0/2712863569 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f979002ada0 con 0x7f979c0c8350 2024-09-10T08:39:43.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.891+0000 7f979959a640 1 -- 172.21.15.103:0/2712863569 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9790032660 con 0x7f979c0c8350 2024-09-10T08:39:43.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.892+0000 7f979b59e640 1 -- 172.21.15.103:0/2712863569 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f979c0c8350 msgr2=0x7f979c15d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:43.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.892+0000 7f979b59e640 1 --2- 172.21.15.103:0/2712863569 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f979c0c8350 0x7f979c15d440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f979c0c8800 tx=0x7f979002a090 comp rx=0 tx=0).stop 2024-09-10T08:39:43.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.893+0000 7f979b59e640 1 -- 172.21.15.103:0/2712863569 shutdown_connections 2024-09-10T08:39:43.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.893+0000 7f979b59e640 1 --2- 172.21.15.103:0/2712863569 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f979c0c8350 0x7f979c15d440 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:43.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.893+0000 7f979b59e640 1 --2- 172.21.15.103:0/2712863569 >> v2:172.21.15.103:3300/0 conn(0x7f979c153040 0x7f979c0c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:43.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.893+0000 7f979b59e640 1 -- 172.21.15.103:0/2712863569 >> 172.21.15.103:0/2712863569 conn(0x7f979c0c7860 msgr2=0x7f979c0c7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:43.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.894+0000 7f979b59e640 1 -- 172.21.15.103:0/2712863569 shutdown_connections 2024-09-10T08:39:43.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.895+0000 7f979b59e640 1 -- 172.21.15.103:0/2712863569 wait complete. 2024-09-10T08:39:43.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.897+0000 7f979b59e640 1 Processor -- start 2024-09-10T08:39:43.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.897+0000 7f979b59e640 1 -- start start 2024-09-10T08:39:43.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.898+0000 7f979b59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f979c0c68d0 0x7f979c140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:43.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.898+0000 7f979b59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979c0c8350 0x7f979c165380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:43.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.899+0000 7f979b59e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f979c153040 0x7f979c1658c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:43.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.899+0000 7f979b59e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f979c0c4790 con 0x7f979c0c68d0 2024-09-10T08:39:43.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.899+0000 7f979b59e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f979c0a7160 con 0x7f979c0c8350 2024-09-10T08:39:43.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.899+0000 7f979b59e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f979c0c4910 con 0x7f979c153040 2024-09-10T08:39:43.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.899+0000 7f9799d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979c0c8350 0x7f979c165380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:43.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.899+0000 7f9799d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979c0c8350 0x7f979c165380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:42322/0 (socket says 172.21.15.103:42322) 2024-09-10T08:39:43.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.899+0000 7f9799d9b640 1 -- 172.21.15.103:0/3846858162 learned_addr learned my addr 172.21.15.103:0/3846858162 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:39:43.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.899+0000 7f979a59c640 1 --2- 172.21.15.103:0/3846858162 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f979c0c68d0 0x7f979c140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:43.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.900+0000 7f979a59c640 1 -- 172.21.15.103:0/3846858162 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f979c0c68d0 msgr2=0x7f979c140ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-10T08:39:43.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.900+0000 7f979a59c640 1 -- 172.21.15.103:0/3846858162 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f979c0c68d0 msgr2=0x7f979c140ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:39:43.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.900+0000 7f979a59c640 1 --2- 172.21.15.103:0/3846858162 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f979c0c68d0 0x7f979c140ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:43.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.900+0000 7f979a59c640 1 --2- 172.21.15.103:0/3846858162 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f979c0c68d0 0x7f979c140ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:43.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.902+0000 7f9799d9b640 1 -- 172.21.15.103:0/3846858162 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f979c153040 msgr2=0x7f979c1658c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:39:43.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.902+0000 7f9799d9b640 1 --2- 172.21.15.103:0/3846858162 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f979c153040 0x7f979c1658c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:43.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.902+0000 7f9799d9b640 1 -- 172.21.15.103:0/3846858162 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f979c0c68d0 msgr2=0x7f979c140ed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:39:43.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.902+0000 7f9799d9b640 1 --2- 172.21.15.103:0/3846858162 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f979c0c68d0 0x7f979c140ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:43.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.902+0000 7f9799d9b640 1 -- 172.21.15.103:0/3846858162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979c0ab9e0 con 0x7f979c0c8350 2024-09-10T08:39:43.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.902+0000 7f9799d9b640 1 --2- 172.21.15.103:0/3846858162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979c0c8350 0x7f979c165380 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f978c00c430 tx=0x7f978c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:43.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.902+0000 7f978affd640 1 -- 172.21.15.103:0/3846858162 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c011790 con 0x7f979c0c8350 2024-09-10T08:39:43.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.902+0000 7f978affd640 1 -- 172.21.15.103:0/3846858162 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f978c017070 con 0x7f979c0c8350 2024-09-10T08:39:43.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.902+0000 7f978affd640 1 -- 172.21.15.103:0/3846858162 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c011b90 con 0x7f979c0c8350 2024-09-10T08:39:43.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.903+0000 7f979b59e640 1 -- 172.21.15.103:0/3846858162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f979c0abcc0 con 0x7f979c0c8350 2024-09-10T08:39:43.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.903+0000 7f979b59e640 1 -- 172.21.15.103:0/3846858162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f979c0ac280 con 0x7f979c0c8350 2024-09-10T08:39:43.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.905+0000 7f978affd640 1 -- 172.21.15.103:0/3846858162 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f978c01c460 con 0x7f979c0c8350 2024-09-10T08:39:43.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.905+0000 7f979b59e640 1 -- 172.21.15.103:0/3846858162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f979c0ac480 con 0x7f979c0c8350 2024-09-10T08:39:43.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.907+0000 7f978affd640 1 --2- 172.21.15.103:0/3846858162 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f977c06be60 0x7f977c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:43.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.907+0000 7f978affd640 1 -- 172.21.15.103:0/3846858162 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f978c08aff0 con 0x7f979c0c8350 2024-09-10T08:39:43.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.908+0000 7f979a59c640 1 --2- 172.21.15.103:0/3846858162 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f977c06be60 0x7f977c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:43.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.909+0000 7f979a59c640 1 --2- 172.21.15.103:0/3846858162 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f977c06be60 0x7f977c06e320 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f97940096d0 tx=0x7f9794009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:43.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:43.916+0000 7f978affd640 1 -- 172.21.15.103:0/3846858162 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f979c0ac480 con 0x7f979c0c8350 2024-09-10T08:39:44.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:44.379+0000 7f979b59e640 1 -- 172.21.15.103:0/3846858162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f979c0c66b0 con 0x7f979c0c8350 2024-09-10T08:39:44.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:44.381+0000 7f978affd640 1 -- 172.21.15.103:0/3846858162 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f978c059610 con 0x7f979c0c8350 2024-09-10T08:39:44.382 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":88,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":32,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:39:44.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:44.385+0000 7f979b59e640 1 -- 172.21.15.103:0/3846858162 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f977c06be60 msgr2=0x7f977c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:44.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:44.385+0000 7f979b59e640 1 --2- 172.21.15.103:0/3846858162 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f977c06be60 0x7f977c06e320 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f97940096d0 tx=0x7f9794009040 comp rx=0 tx=0).stop 2024-09-10T08:39:44.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:44.385+0000 7f979b59e640 1 -- 172.21.15.103:0/3846858162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979c0c8350 msgr2=0x7f979c165380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:44.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:44.385+0000 7f979b59e640 1 --2- 172.21.15.103:0/3846858162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979c0c8350 0x7f979c165380 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f978c00c430 tx=0x7f978c00c8f0 comp rx=0 tx=0).stop 2024-09-10T08:39:44.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:44.386+0000 7f979b59e640 1 -- 172.21.15.103:0/3846858162 shutdown_connections 2024-09-10T08:39:44.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:44.386+0000 7f979b59e640 1 --2- 172.21.15.103:0/3846858162 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f977c06be60 0x7f977c06e320 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:44.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:44.386+0000 7f979b59e640 1 --2- 172.21.15.103:0/3846858162 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f979c153040 0x7f979c1658c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:44.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:44.386+0000 7f979b59e640 1 --2- 172.21.15.103:0/3846858162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f979c0c8350 0x7f979c165380 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f978c00c430 tx=0x7f978c00c8f0 comp rx=0 tx=0).stop 2024-09-10T08:39:44.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:44.386+0000 7f979b59e640 1 --2- 172.21.15.103:0/3846858162 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f979c0c68d0 0x7f979c140ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:44.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:44.386+0000 7f979b59e640 1 -- 172.21.15.103:0/3846858162 >> 172.21.15.103:0/3846858162 conn(0x7f979c0c7860 msgr2=0x7f979c1442a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:44.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:44.388+0000 7f979b59e640 1 -- 172.21.15.103:0/3846858162 shutdown_connections 2024-09-10T08:39:44.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:44.388+0000 7f979b59e640 1 -- 172.21.15.103:0/3846858162 wait complete. 2024-09-10T08:39:47.411 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:39:47.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.575+0000 7f9acc4d0640 1 Processor -- start 2024-09-10T08:39:47.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.575+0000 7f9acc4d0640 1 -- start start 2024-09-10T08:39:47.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.577+0000 7f9acc4d0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 0x7f9ac40c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:47.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.577+0000 7f9acc4d0640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 0x7f9ac406dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:47.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.577+0000 7f9acc4d0640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ac415a970 con 0x7f9ac40c5940 2024-09-10T08:39:47.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.577+0000 7f9acc4d0640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f9ac415ac50 con 0x7f9ac40c6010 2024-09-10T08:39:47.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.577+0000 7f9acc4d0640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9ac415af30 con 0x7f9ac40a6c10 2024-09-10T08:39:47.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.577+0000 7f9ac9a6b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 0x7f9ac406dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:47.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.577+0000 7f9ac9a6b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 0x7f9ac406dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44852/0 (socket says 172.21.15.103:44852) 2024-09-10T08:39:47.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.577+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 learned_addr learned my addr 172.21.15.103:0/430672935 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:39:47.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.577+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 0x7f9ac40c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:47.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.578+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 msgr2=0x7f9ac406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:39:47.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.578+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 msgr2=0x7f9ac406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:47.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.578+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 0x7f9ac406dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:47.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.578+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 0x7f9ac406dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:47.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.578+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 msgr2=0x7f9ac40c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:39:47.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.578+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 msgr2=0x7f9ac40c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:47.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.578+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 0x7f9ac40c2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:47.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.578+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 0x7f9ac40c2440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:47.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.779+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 0x7f9ac406dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:47.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.779+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 0x7f9ac40c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:47.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.779+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 msgr2=0x7f9ac406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:39:47.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.779+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 msgr2=0x7f9ac406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:47.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.779+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 0x7f9ac406dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:47.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.779+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 0x7f9ac406dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:39:47.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.779+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 msgr2=0x7f9ac40c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:39:47.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.779+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 msgr2=0x7f9ac40c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:47.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.779+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 0x7f9ac40c2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:47.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:47.779+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 0x7f9ac40c2440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:39:48.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.180+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 0x7f9ac406dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:48.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.180+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 0x7f9ac40c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:48.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.181+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 msgr2=0x7f9ac40c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:39:48.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.181+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 msgr2=0x7f9ac40c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:48.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.181+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 0x7f9ac40c2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:48.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.181+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 0x7f9ac40c2440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:39:48.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.181+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 msgr2=0x7f9ac406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:39:48.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.181+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 msgr2=0x7f9ac406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:48.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.181+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 0x7f9ac406dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:48.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.181+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 0x7f9ac406dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:39:48.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.545+0000 7f9acaa6d640 1 -- 172.21.15.103:0/430672935 >> v1:172.21.15.103:6789/0 conn(0x7f9ac40c5940 legacy=0x7f9ac406dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-09-10T08:39:48.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.545+0000 7f9acaa6d640 1 -- 172.21.15.103:0/430672935 >> v1:172.21.15.103:6789/0 conn(0x7f9ac40c5940 legacy=0x7f9ac406dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:39:48.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.545+0000 7f9acaa6d640 1 --1- 172.21.15.103:0/430672935 >> v1:172.21.15.103:6789/0 conn(0x7f9ac40c5940 0x7f9ac406dff0 :-1 s=OPENED pgs=30 cs=1 l=1).handle_message read tag failed 2024-09-10T08:39:48.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.545+0000 7f9acaa6d640 1 --1- 172.21.15.103:0/430672935 >> v1:172.21.15.103:6789/0 conn(0x7f9ac40c5940 0x7f9ac406dff0 :-1 s=OPENED pgs=30 cs=1 l=1).fault on lossy channel, failing 2024-09-10T08:39:48.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.982+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 0x7f9ac406dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:48.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.982+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 0x7f9ac40c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:48.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.982+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 msgr2=0x7f9ac406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:39:48.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.982+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 msgr2=0x7f9ac406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:48.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.982+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 0x7f9ac406dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:48.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.982+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 0x7f9ac406dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:39:48.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.982+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 msgr2=0x7f9ac40c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:39:48.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.982+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 msgr2=0x7f9ac40c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:48.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.982+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 0x7f9ac40c2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:48.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:48.982+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 0x7f9ac40c2440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:39:50.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:50.577+0000 7f9ab7fff640 1 -- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 msgr2=0x7f9ac40c2440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:39:50.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:50.577+0000 7f9ab7fff640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ac40a6c10 0x7f9ac40c2440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:50.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:50.577+0000 7f9ab7fff640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 msgr2=0x7f9ac406dab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:39:50.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:50.577+0000 7f9ab7fff640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9ac40c6010 0x7f9ac406dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:50.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:50.577+0000 7f9ab7fff640 1 -- 172.21.15.103:0/430672935 >> v1:172.21.15.103:6789/0 conn(0x7f9ac40c5940 legacy=0x7f9ac406dff0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:39:50.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:50.577+0000 7f9ab7fff640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 0x7f9aa8009740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:50.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:50.577+0000 7f9ab7fff640 1 -- 172.21.15.103:0/430672935 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ac415b210 con 0x7f9aa80035d0 2024-09-10T08:39:50.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:50.577+0000 7f9ab7fff640 1 -- 172.21.15.103:0/430672935 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9ac415ac50 con 0x7f9aa8007280 2024-09-10T08:39:50.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:50.577+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 0x7f9aa8009740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:50.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:50.577+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 msgr2=0x7f9aa8009740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:39:50.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:50.577+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 msgr2=0x7f9aa8009740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:50.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:50.577+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 0x7f9aa8009740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:50.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:50.577+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 0x7f9aa8009740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:50.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:50.778+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 0x7f9aa8009740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:50.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:50.778+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 msgr2=0x7f9aa8009740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:39:50.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:50.778+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 msgr2=0x7f9aa8009740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:50.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:50.778+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 0x7f9aa8009740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:50.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:50.778+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 0x7f9aa8009740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:39:51.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:51.180+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 0x7f9aa8009740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:51.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:51.180+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 msgr2=0x7f9aa8009740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:39:51.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:51.180+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 msgr2=0x7f9aa8009740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:51.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:51.180+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 0x7f9aa8009740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:51.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:51.180+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 0x7f9aa8009740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:39:51.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:51.201+0000 7f9ac926a640 1 -- 172.21.15.103:0/430672935 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2311994683 0 0) 0x7f9ac415b210 con 0x7f9aa80035d0 2024-09-10T08:39:51.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:51.201+0000 7f9ac926a640 1 -- 172.21.15.103:0/430672935 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ab0003520 con 0x7f9aa80035d0 2024-09-10T08:39:51.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:51.981+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 0x7f9aa8009740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:51.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:51.981+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 msgr2=0x7f9aa8009740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:39:51.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:51.981+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 msgr2=0x7f9aa8009740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:51.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:51.981+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 0x7f9aa8009740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:51.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:51.981+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 0x7f9aa8009740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:39:53.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.579+0000 7f9ab7fff640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 msgr2=0x7f9aa8009740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:39:53.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.579+0000 7f9ab7fff640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa8007280 0x7f9aa8009740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:53.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.579+0000 7f9ab7fff640 1 -- 172.21.15.103:0/430672935 >> v1:172.21.15.154:6789/0 conn(0x7f9aa80035d0 legacy=0x7f9aa8005a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:53.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.579+0000 7f9acaa6d640 1 -- 172.21.15.103:0/430672935 reap_dead start 2024-09-10T08:39:53.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.579+0000 7f9ab7fff640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 0x7f9aa8005a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:53.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.579+0000 7f9ab7fff640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 0x7f9aa800a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:53.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.579+0000 7f9ab7fff640 1 -- 172.21.15.103:0/430672935 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aa800ae50 con 0x7f9aa8006180 2024-09-10T08:39:53.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.579+0000 7f9ab7fff640 1 -- 172.21.15.103:0/430672935 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9ac415ac50 con 0x7f9aa800a2f0 2024-09-10T08:39:53.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.579+0000 7f9ab7fff640 1 -- 172.21.15.103:0/430672935 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9ac415af30 con 0x7f9aa8009f10 2024-09-10T08:39:53.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.579+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 0x7f9aa8005a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:53.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.579+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 msgr2=0x7f9aa8005a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:39:53.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.579+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 msgr2=0x7f9aa8005a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:53.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.579+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 0x7f9aa8005a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:53.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.579+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 0x7f9aa8005a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:53.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.580+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 0x7f9aa800a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:53.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.580+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 msgr2=0x7f9aa800a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:39:53.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.580+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 msgr2=0x7f9aa800a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:53.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.580+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 0x7f9aa800a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:53.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.580+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 0x7f9aa800a750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:53.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.780+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 0x7f9aa8005a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:53.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.780+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 msgr2=0x7f9aa8005a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:39:53.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.780+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 msgr2=0x7f9aa8005a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:53.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.780+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 0x7f9aa8005a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:53.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.780+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 0x7f9aa8005a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:39:53.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.781+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 0x7f9aa800a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:53.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.782+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 msgr2=0x7f9aa800a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:39:53.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.782+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 msgr2=0x7f9aa800a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:53.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.782+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 0x7f9aa800a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:53.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:53.782+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 0x7f9aa800a750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:39:54.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:54.181+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 0x7f9aa8005a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:54.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:54.182+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 msgr2=0x7f9aa8005a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:39:54.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:54.182+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 msgr2=0x7f9aa8005a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:54.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:54.182+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 0x7f9aa8005a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:54.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:54.183+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 0x7f9aa8005a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:39:54.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:54.183+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 0x7f9aa800a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:54.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:54.183+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 msgr2=0x7f9aa800a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:39:54.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:54.183+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 msgr2=0x7f9aa800a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:54.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:54.183+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 0x7f9aa800a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:54.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:54.183+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 0x7f9aa800a750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:39:54.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:54.984+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 0x7f9aa800a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:54.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:54.984+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 msgr2=0x7f9aa800a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:39:54.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:54.984+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 msgr2=0x7f9aa800a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:54.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:54.984+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 0x7f9aa800a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:54.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:54.984+0000 7f9ac9a6b640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 0x7f9aa800a750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:39:54.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:54.985+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 0x7f9aa8005a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:54.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:54.985+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 msgr2=0x7f9aa8005a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:39:54.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:54.985+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 msgr2=0x7f9aa8005a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:54.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:54.985+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 0x7f9aa8005a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:54.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:54.985+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 0x7f9aa8005a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:39:56.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:56.579+0000 7f9ab7fff640 1 -- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 msgr2=0x7f9aa8005a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:39:56.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:56.579+0000 7f9ab7fff640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 0x7f9aa8005a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:56.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:56.579+0000 7f9ab7fff640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 msgr2=0x7f9aa800a750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:39:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:56.579+0000 7f9ab7fff640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.154:3300/0 conn(0x7f9aa800a2f0 0x7f9aa800a750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:56.579+0000 7f9ab7fff640 1 -- 172.21.15.103:0/430672935 >> v1:172.21.15.154:6789/0 conn(0x7f9aa8006180 legacy=0x7f9aa8006630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:56.579+0000 7f9ab7fff640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 0x7f9aa8007cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:56.579+0000 7f9ab7fff640 1 -- 172.21.15.103:0/430672935 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aa8007000 con 0x7f9aa8008740 2024-09-10T08:39:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:56.579+0000 7f9ab7fff640 1 -- 172.21.15.103:0/430672935 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f9ac415ac50 con 0x7f9aa8007860 2024-09-10T08:39:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:56.580+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 0x7f9aa8007cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:56.580+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 msgr2=0x7f9aa8007cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:39:56.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:56.580+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 msgr2=0x7f9aa8007cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:56.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:56.580+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 0x7f9aa8007cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:56.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:56.580+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 0x7f9aa8007cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:39:56.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:56.782+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 0x7f9aa8007cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:56.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:56.782+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 msgr2=0x7f9aa8007cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:39:56.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:56.782+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 msgr2=0x7f9aa8007cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:56.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:56.782+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 0x7f9aa8007cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:56.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:56.782+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 0x7f9aa8007cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:39:57.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:57.183+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 0x7f9aa8007cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:57.183+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 msgr2=0x7f9aa8007cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:39:57.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:57.183+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 msgr2=0x7f9aa8007cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:57.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:57.183+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 0x7f9aa8007cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:57.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:57.183+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 0x7f9aa8007cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:39:57.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:57.984+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 0x7f9aa8007cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:57.985+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 msgr2=0x7f9aa8007cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:39:57.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:57.985+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 msgr2=0x7f9aa8007cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:39:57.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:57.985+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 0x7f9aa8007cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:39:57.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:57.985+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 0x7f9aa8007cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:39:59.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.002+0000 7f9ac926a640 1 -- 172.21.15.103:0/430672935 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3847716214 0 0) 0x7f9aa8007000 con 0x7f9aa8008740 2024-09-10T08:39:59.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.002+0000 7f9ac926a640 1 -- 172.21.15.103:0/430672935 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ab0003880 con 0x7f9aa8008740 2024-09-10T08:39:59.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.004+0000 7f9ac926a640 1 -- 172.21.15.103:0/430672935 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1432815614 0 0) 0x7f9ab0003880 con 0x7f9aa8008740 2024-09-10T08:39:59.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.004+0000 7f9ac926a640 1 -- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 msgr2=0x7f9aa8007cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:39:59.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.004+0000 7f9ac926a640 1 --2- 172.21.15.103:0/430672935 >> v2:172.21.15.103:3300/0 conn(0x7f9aa8007860 0x7f9aa8007cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.004+0000 7f9ac926a640 1 -- 172.21.15.103:0/430672935 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa8009300 con 0x7f9aa8008740 2024-09-10T08:39:59.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.004+0000 7f9ac926a640 1 -- 172.21.15.103:0/430672935 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f9ab800f040 con 0x7f9aa8008740 2024-09-10T08:39:59.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.004+0000 7f9ac926a640 1 -- 172.21.15.103:0/430672935 >> v1:172.21.15.103:6789/0 conn(0x7f9aa8008740 legacy=0x7f9aa8008bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.004+0000 7f9ac926a640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ab0003d30 0x7f9ab0004170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.004+0000 7f9ac926a640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ab00048d0 0x7f9ab0004d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.004+0000 7f9ac926a640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 0x7f9ab000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.004+0000 7f9ac926a640 1 -- 172.21.15.103:0/430672935 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac415ac50 con 0x7f9ab0003d30 2024-09-10T08:39:59.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.004+0000 7f9ac926a640 1 -- 172.21.15.103:0/430672935 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab000bf00 con 0x7f9ab00048d0 2024-09-10T08:39:59.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.004+0000 7f9ac926a640 1 -- 172.21.15.103:0/430672935 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9ab000c0d0 con 0x7f9aa8009f10 2024-09-10T08:39:59.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.004+0000 7f9acaa6d640 1 -- 172.21.15.103:0/430672935 reap_dead start 2024-09-10T08:39:59.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.004+0000 7f9acaa6d640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 0x7f9ab000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.005+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ab0003d30 0x7f9ab0004170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.005+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 msgr2=0x7f9ab000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:59.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.005+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 0x7f9ab000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.005+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ab00048d0 msgr2=0x7f9ab0004d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:59.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.005+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ab00048d0 0x7f9ab0004d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.005+0000 7f9aca26c640 1 -- 172.21.15.103:0/430672935 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa8009300 con 0x7f9ab0003d30 2024-09-10T08:39:59.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.006+0000 7f9aca26c640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ab0003d30 0x7f9ab0004170 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9abc017da0 tx=0x7f9ab0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bac873429100540 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:59.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.009+0000 7f9ac926a640 1 -- 172.21.15.103:0/430672935 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc035070 con 0x7f9ab0003d30 2024-09-10T08:39:59.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.009+0000 7f9ac926a640 1 -- 172.21.15.103:0/430672935 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9abc031450 con 0x7f9ab0003d30 2024-09-10T08:39:59.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.009+0000 7f9ac926a640 1 -- 172.21.15.103:0/430672935 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc035070 con 0x7f9ab0003d30 2024-09-10T08:39:59.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.010+0000 7f9acc4d0640 1 -- 172.21.15.103:0/430672935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ab0003d30 msgr2=0x7f9ab0004170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.010+0000 7f9acc4d0640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ab0003d30 0x7f9ab0004170 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9abc017da0 tx=0x7f9ab0005830 comp rx=0 tx=0).stop 2024-09-10T08:39:59.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.011+0000 7f9acc4d0640 1 -- 172.21.15.103:0/430672935 shutdown_connections 2024-09-10T08:39:59.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.011+0000 7f9acc4d0640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ab00048d0 0x7f9ab0004d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.011+0000 7f9acc4d0640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ab0003d30 0x7f9ab0004170 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.011+0000 7f9acc4d0640 1 --2- 172.21.15.103:0/430672935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa8009f10 0x7f9ab000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.011+0000 7f9acc4d0640 1 -- 172.21.15.103:0/430672935 >> 172.21.15.103:0/430672935 conn(0x7f9ac40c7a40 msgr2=0x7f9ac40c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:59.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.011+0000 7f9acc4d0640 1 -- 172.21.15.103:0/430672935 shutdown_connections 2024-09-10T08:39:59.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.011+0000 7f9acc4d0640 1 -- 172.21.15.103:0/430672935 wait complete. 2024-09-10T08:39:59.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.013+0000 7f9acc4d0640 1 Processor -- start 2024-09-10T08:39:59.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.013+0000 7f9acc4d0640 1 -- start start 2024-09-10T08:39:59.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.014+0000 7f9acc4d0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9aa8009f10 0x7f9ac41e5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.014+0000 7f9acc4d0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ab0003d30 0x7f9ac414a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.014+0000 7f9acc4d0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ab00048d0 0x7f9ac414ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.014+0000 7f9acc4d0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac40a7520 con 0x7f9ab00048d0 2024-09-10T08:39:59.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.014+0000 7f9acc4d0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac40a73a0 con 0x7f9aa8009f10 2024-09-10T08:39:59.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.014+0000 7f9acc4d0640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9ac40c2440 con 0x7f9ab0003d30 2024-09-10T08:39:59.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.014+0000 7f9ac9a6b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ab0003d30 0x7f9ac414a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.014+0000 7f9ac9a6b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ab0003d30 0x7f9ac414a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:51284/0 (socket says 172.21.15.103:51284) 2024-09-10T08:39:59.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.014+0000 7f9ac9a6b640 1 -- 172.21.15.103:0/2738843706 learned_addr learned my addr 172.21.15.103:0/2738843706 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:39:59.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.015+0000 7f9aca26c640 1 --2- 172.21.15.103:0/2738843706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9aa8009f10 0x7f9ac41e5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.015+0000 7f9acaa6d640 1 --2- 172.21.15.103:0/2738843706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ab00048d0 0x7f9ac414ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.016+0000 7f9acaa6d640 1 -- 172.21.15.103:0/2738843706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ab0003d30 msgr2=0x7f9ac414a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.016+0000 7f9acaa6d640 1 --2- 172.21.15.103:0/2738843706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ab0003d30 0x7f9ac414a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.016+0000 7f9acaa6d640 1 -- 172.21.15.103:0/2738843706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9aa8009f10 msgr2=0x7f9ac41e5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.016+0000 7f9acaa6d640 1 --2- 172.21.15.103:0/2738843706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9aa8009f10 0x7f9ac41e5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.016+0000 7f9acaa6d640 1 -- 172.21.15.103:0/2738843706 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac4151c20 con 0x7f9ab00048d0 2024-09-10T08:39:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.016+0000 7f9acaa6d640 1 --2- 172.21.15.103:0/2738843706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ab00048d0 0x7f9ac414ad10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40709e0 tx=0x7f9ac000fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.017+0000 7f9ab6ffd640 1 -- 172.21.15.103:0/2738843706 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0005b40 con 0x7f9ab00048d0 2024-09-10T08:39:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.017+0000 7f9ab6ffd640 1 -- 172.21.15.103:0/2738843706 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac0018070 con 0x7f9ab00048d0 2024-09-10T08:39:59.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.017+0000 7f9ab6ffd640 1 -- 172.21.15.103:0/2738843706 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac000d700 con 0x7f9ab00048d0 2024-09-10T08:39:59.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.019+0000 7f9acc4d0640 1 -- 172.21.15.103:0/2738843706 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac41508a0 con 0x7f9ab00048d0 2024-09-10T08:39:59.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.019+0000 7f9acc4d0640 1 -- 172.21.15.103:0/2738843706 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac4150e60 con 0x7f9ab00048d0 2024-09-10T08:39:59.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.021+0000 7f9acc4d0640 1 -- 172.21.15.103:0/2738843706 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ac40c8810 con 0x7f9ab00048d0 2024-09-10T08:39:59.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.022+0000 7f9ab6ffd640 1 -- 172.21.15.103:0/2738843706 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ac000d8a0 con 0x7f9ab00048d0 2024-09-10T08:39:59.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.022+0000 7f9ab6ffd640 1 --2- 172.21.15.103:0/2738843706 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9aa806dfd0 0x7f9aa8070490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.022+0000 7f9ab6ffd640 1 -- 172.21.15.103:0/2738843706 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f9ac008a980 con 0x7f9ab00048d0 2024-09-10T08:39:59.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.023+0000 7f9aca26c640 1 --2- 172.21.15.103:0/2738843706 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9aa806dfd0 0x7f9aa8070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.024+0000 7f9aca26c640 1 --2- 172.21.15.103:0/2738843706 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9aa806dfd0 0x7f9aa8070490 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9abc037000 tx=0x7f9abc03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:59.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.031+0000 7f9ab6ffd640 1 -- 172.21.15.103:0/2738843706 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ac40c8810 con 0x7f9ab00048d0 2024-09-10T08:39:59.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.488+0000 7f9acc4d0640 1 -- 172.21.15.103:0/2738843706 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9ac415af30 con 0x7f9ab00048d0 2024-09-10T08:39:59.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.488+0000 7f9ab6ffd640 1 -- 172.21.15.103:0/2738843706 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f9ac0059000 con 0x7f9ab00048d0 2024-09-10T08:39:59.489 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":98,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:39:59.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.492+0000 7f9acc4d0640 1 -- 172.21.15.103:0/2738843706 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9aa806dfd0 msgr2=0x7f9aa8070490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.492+0000 7f9acc4d0640 1 --2- 172.21.15.103:0/2738843706 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9aa806dfd0 0x7f9aa8070490 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9abc037000 tx=0x7f9abc03c040 comp rx=0 tx=0).stop 2024-09-10T08:39:59.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.492+0000 7f9acc4d0640 1 -- 172.21.15.103:0/2738843706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ab00048d0 msgr2=0x7f9ac414ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.492+0000 7f9acc4d0640 1 --2- 172.21.15.103:0/2738843706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ab00048d0 0x7f9ac414ad10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40709e0 tx=0x7f9ac000fc00 comp rx=0 tx=0).stop 2024-09-10T08:39:59.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.492+0000 7f9acc4d0640 1 -- 172.21.15.103:0/2738843706 shutdown_connections 2024-09-10T08:39:59.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.492+0000 7f9acc4d0640 1 --2- 172.21.15.103:0/2738843706 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9aa806dfd0 0x7f9aa8070490 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.492+0000 7f9acc4d0640 1 --2- 172.21.15.103:0/2738843706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ab00048d0 0x7f9ac414ad10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.492+0000 7f9acc4d0640 1 --2- 172.21.15.103:0/2738843706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ab0003d30 0x7f9ac414a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.492+0000 7f9acc4d0640 1 --2- 172.21.15.103:0/2738843706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9aa8009f10 0x7f9ac41e5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.492+0000 7f9acc4d0640 1 -- 172.21.15.103:0/2738843706 >> 172.21.15.103:0/2738843706 conn(0x7f9ac40c7a40 msgr2=0x7f9ac40a7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:59.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.492+0000 7f9acc4d0640 1 -- 172.21.15.103:0/2738843706 shutdown_connections 2024-09-10T08:39:59.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.492+0000 7f9acc4d0640 1 -- 172.21.15.103:0/2738843706 wait complete. 2024-09-10T08:39:59.511 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:39:59.511 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:39:59.512 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:39:59.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.678+0000 7fa21b5e4640 1 Processor -- start 2024-09-10T08:39:59.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.678+0000 7fa21b5e4640 1 -- start start 2024-09-10T08:39:59.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.679+0000 7fa21b5e4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2140c6cd0 0x7fa2141562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.679+0000 7fa21b5e4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa21406edd0 0x7fa214152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.680+0000 7fa21b5e4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2140c53f0 con 0x7fa2140c7230 2024-09-10T08:39:59.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.680+0000 7fa21b5e4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fa2140c2d60 con 0x7fa21406edd0 2024-09-10T08:39:59.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.680+0000 7fa21b5e4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa2140c3040 con 0x7fa2140c6cd0 2024-09-10T08:39:59.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.680+0000 7fa219b81640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa2140c7230 0x7fa21414f820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:53550/0 (socket says 172.21.15.103:53550) 2024-09-10T08:39:59.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.680+0000 7fa219b81640 1 -- 172.21.15.103:0/607393413 learned_addr learned my addr 172.21.15.103:0/607393413 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:39:59.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.680+0000 7fa219380640 1 --2- 172.21.15.103:0/607393413 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2140c6cd0 0x7fa2141562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.680+0000 7fa218b7f640 1 --2- 172.21.15.103:0/607393413 >> v2:172.21.15.154:3300/0 conn(0x7fa21406edd0 0x7fa214152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.681+0000 7fa219380640 1 -- 172.21.15.103:0/607393413 >> v2:172.21.15.154:3300/0 conn(0x7fa21406edd0 msgr2=0x7fa214152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:59.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.681+0000 7fa219380640 1 --2- 172.21.15.103:0/607393413 >> v2:172.21.15.154:3300/0 conn(0x7fa21406edd0 0x7fa214152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.681+0000 7fa219380640 1 -- 172.21.15.103:0/607393413 >> v1:172.21.15.103:6789/0 conn(0x7fa2140c7230 legacy=0x7fa21414f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:59.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.681+0000 7fa219380640 1 -- 172.21.15.103:0/607393413 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2141526a0 con 0x7fa2140c6cd0 2024-09-10T08:39:59.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.682+0000 7fa219380640 1 --2- 172.21.15.103:0/607393413 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2140c6cd0 0x7fa2141562d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa2100097a0 tx=0x7fa21002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f279a18254e2aba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:59.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.682+0000 7fa20bfff640 1 -- 172.21.15.103:0/607393413 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa210037070 con 0x7fa2140c6cd0 2024-09-10T08:39:59.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.682+0000 7fa20bfff640 1 -- 172.21.15.103:0/607393413 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa21002ae50 con 0x7fa2140c6cd0 2024-09-10T08:39:59.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.683+0000 7fa20bfff640 1 -- 172.21.15.103:0/607393413 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa210032660 con 0x7fa2140c6cd0 2024-09-10T08:39:59.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.684+0000 7fa21b5e4640 1 -- 172.21.15.103:0/607393413 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2140c6cd0 msgr2=0x7fa2141562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.684+0000 7fa21b5e4640 1 --2- 172.21.15.103:0/607393413 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2140c6cd0 0x7fa2141562d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa2100097a0 tx=0x7fa21002a100 comp rx=0 tx=0).stop 2024-09-10T08:39:59.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.684+0000 7fa21b5e4640 1 -- 172.21.15.103:0/607393413 shutdown_connections 2024-09-10T08:39:59.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.684+0000 7fa21b5e4640 1 --2- 172.21.15.103:0/607393413 >> v2:172.21.15.154:3300/0 conn(0x7fa21406edd0 0x7fa214152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.684+0000 7fa21b5e4640 1 --2- 172.21.15.103:0/607393413 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2140c6cd0 0x7fa2141562d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.684+0000 7fa21b5e4640 1 -- 172.21.15.103:0/607393413 >> 172.21.15.103:0/607393413 conn(0x7fa2140c7a40 msgr2=0x7fa2140c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:59.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.684+0000 7fa21b5e4640 1 -- 172.21.15.103:0/607393413 shutdown_connections 2024-09-10T08:39:59.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.684+0000 7fa21b5e4640 1 -- 172.21.15.103:0/607393413 wait complete. 2024-09-10T08:39:59.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.687+0000 7fa21b5e4640 1 Processor -- start 2024-09-10T08:39:59.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.687+0000 7fa21b5e4640 1 -- start start 2024-09-10T08:39:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.688+0000 7fa21b5e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa21406edd0 0x7fa2140a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.688+0000 7fa21b5e4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2140c7230 0x7fa214070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.688+0000 7fa21b5e4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2141fba10 0x7fa2141fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.688+0000 7fa21b5e4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa214153100 con 0x7fa2140c7230 2024-09-10T08:39:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.688+0000 7fa21b5e4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa214152350 con 0x7fa21406edd0 2024-09-10T08:39:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.688+0000 7fa21b5e4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa214153280 con 0x7fa2141fba10 2024-09-10T08:39:59.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.688+0000 7fa219380640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa21406edd0 0x7fa2140a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.689+0000 7fa219380640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa21406edd0 0x7fa2140a7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:54510/0 (socket says 172.21.15.103:54510) 2024-09-10T08:39:59.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.689+0000 7fa219380640 1 -- 172.21.15.103:0/1612715714 learned_addr learned my addr 172.21.15.103:0/1612715714 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:39:59.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.689+0000 7fa219b81640 1 --2- 172.21.15.103:0/1612715714 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2141fba10 0x7fa2141fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.689+0000 7fa218b7f640 1 --2- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2140c7230 0x7fa214070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.689+0000 7fa219380640 1 -- 172.21.15.103:0/1612715714 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2141fba10 msgr2=0x7fa2141fbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.689+0000 7fa219380640 1 --2- 172.21.15.103:0/1612715714 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2141fba10 0x7fa2141fbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.689+0000 7fa219380640 1 -- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2140c7230 msgr2=0x7fa214070c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.689+0000 7fa219380640 1 --2- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2140c7230 0x7fa214070c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.689+0000 7fa219380640 1 -- 172.21.15.103:0/1612715714 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2141f8420 con 0x7fa21406edd0 2024-09-10T08:39:59.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.689+0000 7fa218b7f640 1 --2- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2140c7230 0x7fa214070c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:39:59.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.689+0000 7fa219380640 1 --2- 172.21.15.103:0/1612715714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa21406edd0 0x7fa2140a7c30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa210000c00 tx=0x7fa2100046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:59.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.690+0000 7fa209ffb640 1 -- 172.21.15.103:0/1612715714 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa210041070 con 0x7fa21406edd0 2024-09-10T08:39:59.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.690+0000 7fa21b5e4640 1 -- 172.21.15.103:0/1612715714 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2140a8210 con 0x7fa21406edd0 2024-09-10T08:39:59.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.690+0000 7fa209ffb640 1 -- 172.21.15.103:0/1612715714 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa21003c670 con 0x7fa21406edd0 2024-09-10T08:39:59.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.690+0000 7fa209ffb640 1 -- 172.21.15.103:0/1612715714 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21004b060 con 0x7fa21406edd0 2024-09-10T08:39:59.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.691+0000 7fa21b5e4640 1 -- 172.21.15.103:0/1612715714 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2141f89c0 con 0x7fa21406edd0 2024-09-10T08:39:59.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.694+0000 7fa209ffb640 1 -- 172.21.15.103:0/1612715714 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa210044070 con 0x7fa21406edd0 2024-09-10T08:39:59.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.694+0000 7fa1ff7fe640 1 --2- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2140c6cd0 0x7fa214154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.694+0000 7fa1ff7fe640 1 -- 172.21.15.103:0/1612715714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa214072410 con 0x7fa2140c6cd0 2024-09-10T08:39:59.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.694+0000 7fa209ffb640 1 --2- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa1f806be60 0x7fa1f806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.695+0000 7fa219b81640 1 --2- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa1f806be60 0x7fa1f806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.695+0000 7fa209ffb640 1 -- 172.21.15.103:0/1612715714 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fa2100ab420 con 0x7fa21406edd0 2024-09-10T08:39:59.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.695+0000 7fa219b81640 1 --2- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa1f806be60 0x7fa1f806e320 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0012e0 tx=0x7fa20c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:59.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.696+0000 7fa218b7f640 1 --2- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2140c6cd0 0x7fa214154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.697+0000 7fa218b7f640 1 -- 172.21.15.103:0/1612715714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2140c87a0 con 0x7fa2140c6cd0 2024-09-10T08:39:59.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.697+0000 7fa218b7f640 1 --2- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2140c6cd0 0x7fa214154500 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa204006fd0 tx=0x7fa20400e5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:59.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.698+0000 7fa209ffb640 1 -- 172.21.15.103:0/1612715714 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa204018020 con 0x7fa2140c6cd0 2024-09-10T08:39:59.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.698+0000 7fa209ffb640 1 -- 172.21.15.103:0/1612715714 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa204010e70 con 0x7fa2140c6cd0 2024-09-10T08:39:59.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.698+0000 7fa209ffb640 1 -- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2140c6cd0 msgr2=0x7fa214154500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.698+0000 7fa209ffb640 1 --2- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2140c6cd0 0x7fa214154500 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa204006fd0 tx=0x7fa20400e5a0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.698+0000 7fa209ffb640 1 -- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2140c6cd0 msgr2=0x7fa214154500 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:39:59.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.698+0000 7fa209ffb640 1 --2- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2140c6cd0 0x7fa214154500 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa204006fd0 tx=0x7fa20400e5a0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.714+0000 7fa1ff7fe640 1 --2- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa214073ae0 0x7fa214073ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.714+0000 7fa1ff7fe640 1 -- 172.21.15.103:0/1612715714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa21414eb90 con 0x7fa214073ae0 2024-09-10T08:39:59.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.714+0000 7fa218b7f640 1 --2- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa214073ae0 0x7fa214073ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.715+0000 7fa218b7f640 1 -- 172.21.15.103:0/1612715714 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa2140711c0 con 0x7fa214073ae0 2024-09-10T08:39:59.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.715+0000 7fa218b7f640 1 --2- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa214073ae0 0x7fa214073ef0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa204006fd0 tx=0x7fa2040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:59.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.715+0000 7fa209ffb640 1 -- 172.21.15.103:0/1612715714 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa204018030 con 0x7fa214073ae0 2024-09-10T08:39:59.717 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:39:59.717 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:39:59.717 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:39:59.717 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:39:59.717 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 98, 2024-09-10T08:39:59.717 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 26180, 2024-09-10T08:39:59.717 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:39:59.717 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:39:59.717 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:39:59.717 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:39:59.717 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:59.718 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:39:59.718 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:39:59.718 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:39:59.718 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:39:59.718 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:39:59.718 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:39:59.718 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:39:59.718 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:39:59.718 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:39:59.718 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:39:59.718 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:39:59.718 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:39:59.718 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:39:59.718 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:39:59.719 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:39:59.719 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:59.719 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:39:59.719 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:39:59.719 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:39:59.719 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:39:59.719 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:39:59.719 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:39:59.719 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:39:59.719 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:39:59.719 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:39:59.719 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:39:59.719 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:39:59.720 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:39:59.720 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:39:59.720 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:59.720 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.720 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:39:59.720 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:39:59.720 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:39:59.720 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:39:59.720 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:39:59.720 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:39:59.720 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:39:59.720 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:39:59.721 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:39:59.721 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:39:59.721 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:39:59.721 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:39:59.721 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:39:59.721 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:39:59.721 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:39:59.721 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:39:59.721 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:39:59.721 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:39:59.721 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:39:59.721 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:39:59.721 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:39:59.722 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:39:59.722 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:39:59.722 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:39:59.722 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:39:59.722 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:39:59.722 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:39:59.722 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:39:59.722 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:59.722 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:39:59.722 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.722 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:39:59.722 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.722 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:39:59.723 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:39:59.723 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:39:59.723 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:39:59.723 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.723 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:39:59.723 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:39:59.723 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:59.723 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.723 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.723 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:39:59.723 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:39:59.723 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:59.723 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:59.723 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:59.724 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.724 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:39:59.724 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:39:59.724 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:39:59.724 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:39:59.724 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:39:59.724 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.724 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.724 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:39:59.724 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:39:59.724 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:39:59.724 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:39:59.724 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.725 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:39:59.725 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:39:59.725 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:59.725 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.725 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.725 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:39:59.725 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:39:59.725 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:59.725 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:59.725 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:59.725 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.725 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:39:59.725 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:39:59.725 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:39:59.725 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:39:59.726 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:39:59.726 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.726 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.726 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:39:59.726 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:39:59.726 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:39:59.726 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:39:59.726 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.726 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:39:59.726 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:39:59.726 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:59.726 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.726 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.726 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:39:59.727 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:39:59.727 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:59.727 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:59.727 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:59.727 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.727 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:39:59.727 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:39:59.727 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:39:59.727 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:39:59.727 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:39:59.727 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:59.727 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:59.727 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.727 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:39:59.728 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:39:59.728 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.728 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:39:59.728 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:39:59.728 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:39:59.728 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:59.728 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:59.728 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:39:59.728 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.728 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:39:59.728 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:39:59.728 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:39:59.729 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:59.729 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:59.729 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.729 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:39:59.729 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:39:59.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.715+0000 7fa209ffb640 1 -- 172.21.15.103:0/1612715714 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4554 (secure 0 0 0) 0x7fa204003610 con 0x7fa214073ae0 2024-09-10T08:39:59.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.715+0000 7fa209ffb640 1 -- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa214073ae0 msgr2=0x7fa214073ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.715+0000 7fa209ffb640 1 --2- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa214073ae0 0x7fa214073ef0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa204006fd0 tx=0x7fa2040046c0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.716+0000 7fa209ffb640 1 -- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa214073ae0 msgr2=0x7fa214073ef0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:39:59.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.716+0000 7fa209ffb640 1 --2- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa214073ae0 0x7fa214073ef0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.719+0000 7fa1ff7fe640 1 -- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa1f806be60 msgr2=0x7fa1f806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.719+0000 7fa1ff7fe640 1 --2- 172.21.15.103:0/1612715714 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa1f806be60 0x7fa1f806e320 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0012e0 tx=0x7fa20c008040 comp rx=0 tx=0).stop 2024-09-10T08:39:59.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.720+0000 7fa1ff7fe640 1 -- 172.21.15.103:0/1612715714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa21406edd0 msgr2=0x7fa2140a7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.720+0000 7fa1ff7fe640 1 --2- 172.21.15.103:0/1612715714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa21406edd0 0x7fa2140a7c30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa210000c00 tx=0x7fa2100046c0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.720+0000 7fa219b81640 1 -- 172.21.15.103:0/1612715714 reap_dead start 2024-09-10T08:39:59.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.720+0000 7fa219b81640 1 -- 172.21.15.103:0/1612715714 reap_dead start 2024-09-10T08:39:59.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.720+0000 7fa1ff7fe640 1 -- 172.21.15.103:0/1612715714 shutdown_connections 2024-09-10T08:39:59.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.720+0000 7fa1ff7fe640 1 -- 172.21.15.103:0/1612715714 >> 172.21.15.103:0/1612715714 conn(0x7fa2140c7a40 msgr2=0x7fa21414e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:59.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.722+0000 7fa1ff7fe640 1 -- 172.21.15.103:0/1612715714 shutdown_connections 2024-09-10T08:39:59.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.722+0000 7fa1ff7fe640 1 -- 172.21.15.103:0/1612715714 wait complete. 2024-09-10T08:39:59.739 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:39:59.739 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:39:59.739 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:39:59.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.913+0000 7fbd493c4640 1 Processor -- start 2024-09-10T08:39:59.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.913+0000 7fbd493c4640 1 -- start start 2024-09-10T08:39:59.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.915+0000 7fbd493c4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbd4414fa00 0x7fbd4406e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.915+0000 7fbd493c4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd44152890 con 0x7fbd4406e9f0 2024-09-10T08:39:59.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.915+0000 7fbd493c4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd44152b70 con 0x7fbd44152320 2024-09-10T08:39:59.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.915+0000 7fbd493c4640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fbd440bd0d0 con 0x7fbd4414fa00 2024-09-10T08:39:59.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.915+0000 7fbd427fc640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbd4406e9f0 0x7fbd44155d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:53556/0 (socket says 172.21.15.103:53556) 2024-09-10T08:39:59.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.915+0000 7fbd427fc640 1 -- 172.21.15.103:0/89715180 learned_addr learned my addr 172.21.15.103:0/89715180 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:39:59.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.916+0000 7fbd42ffd640 1 --2- 172.21.15.103:0/89715180 >> v2:172.21.15.103:3300/0 conn(0x7fbd4414fa00 0x7fbd4406e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.916+0000 7fbd42ffd640 1 -- 172.21.15.103:0/89715180 >> v1:172.21.15.154:6789/0 conn(0x7fbd44152320 legacy=0x7fbd4415cca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T08:39:59.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.916+0000 7fbd42ffd640 1 -- 172.21.15.103:0/89715180 >> v1:172.21.15.103:6789/0 conn(0x7fbd4406e9f0 legacy=0x7fbd44155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.916+0000 7fbd42ffd640 1 -- 172.21.15.103:0/89715180 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd44152e50 con 0x7fbd4414fa00 2024-09-10T08:39:59.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.917+0000 7fbd42ffd640 1 --2- 172.21.15.103:0/89715180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd4414fa00 0x7fbd4406e4b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbd34009a00 tx=0x7fbd3402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359052a25601c4b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:59.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.918+0000 7fbd41ffb640 1 -- 172.21.15.103:0/89715180 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd34037070 con 0x7fbd4414fa00 2024-09-10T08:39:59.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.918+0000 7fbd41ffb640 1 -- 172.21.15.103:0/89715180 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd3402ad20 con 0x7fbd4414fa00 2024-09-10T08:39:59.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.918+0000 7fbd41ffb640 1 -- 172.21.15.103:0/89715180 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd34032660 con 0x7fbd4414fa00 2024-09-10T08:39:59.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.919+0000 7fbd493c4640 1 -- 172.21.15.103:0/89715180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd4414fa00 msgr2=0x7fbd4406e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.919+0000 7fbd493c4640 1 --2- 172.21.15.103:0/89715180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd4414fa00 0x7fbd4406e4b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbd34009a00 tx=0x7fbd3402a2a0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.919+0000 7fbd493c4640 1 -- 172.21.15.103:0/89715180 shutdown_connections 2024-09-10T08:39:59.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.919+0000 7fbd493c4640 1 --2- 172.21.15.103:0/89715180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd4414fa00 0x7fbd4406e4b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.919+0000 7fbd493c4640 1 -- 172.21.15.103:0/89715180 >> 172.21.15.103:0/89715180 conn(0x7fbd440c4bb0 msgr2=0x7fbd440c4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:59.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.919+0000 7fbd493c4640 1 -- 172.21.15.103:0/89715180 shutdown_connections 2024-09-10T08:39:59.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.920+0000 7fbd493c4640 1 -- 172.21.15.103:0/89715180 wait complete. 2024-09-10T08:39:59.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.922+0000 7fbd493c4640 1 Processor -- start 2024-09-10T08:39:59.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.922+0000 7fbd493c4640 1 -- start start 2024-09-10T08:39:59.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.923+0000 7fbd493c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd4406e9f0 0x7fbd4414af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.923+0000 7fbd493c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd4414fa00 0x7fbd44154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.924+0000 7fbd42ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd4406e9f0 0x7fbd4414af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.924+0000 7fbd42ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd4406e9f0 0x7fbd4414af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:54520/0 (socket says 172.21.15.103:54520) 2024-09-10T08:39:59.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.924+0000 7fbd42ffd640 1 -- 172.21.15.103:0/1528275625 learned_addr learned my addr 172.21.15.103:0/1528275625 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:39:59.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.924+0000 7fbd427fc640 1 --2- 172.21.15.103:0/1528275625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd4414fa00 0x7fbd44154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.924+0000 7fbd493c4640 1 --2- 172.21.15.103:0/1528275625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd44152320 0x7fbd440acbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.924+0000 7fbd493c4640 1 -- 172.21.15.103:0/1528275625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbd440c58c0 con 0x7fbd4414fa00 2024-09-10T08:39:59.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.924+0000 7fbd493c4640 1 -- 172.21.15.103:0/1528275625 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbd440c5740 con 0x7fbd4406e9f0 2024-09-10T08:39:59.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.925+0000 7fbd493c4640 1 -- 172.21.15.103:0/1528275625 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fbd44068f80 con 0x7fbd44152320 2024-09-10T08:39:59.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.925+0000 7fbd42ffd640 1 -- 172.21.15.103:0/1528275625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd44152320 msgr2=0x7fbd440acbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.925+0000 7fbd42ffd640 1 --2- 172.21.15.103:0/1528275625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd44152320 0x7fbd440acbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.925+0000 7fbd42ffd640 1 -- 172.21.15.103:0/1528275625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd4414fa00 msgr2=0x7fbd44154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.925+0000 7fbd42ffd640 1 --2- 172.21.15.103:0/1528275625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd4414fa00 0x7fbd44154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.926+0000 7fbd42ffd640 1 -- 172.21.15.103:0/1528275625 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd440aa9e0 con 0x7fbd4406e9f0 2024-09-10T08:39:59.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.926+0000 7fbd427fc640 1 --2- 172.21.15.103:0/1528275625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd4414fa00 0x7fbd44154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:39:59.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.926+0000 7fbd42ffd640 1 --2- 172.21.15.103:0/1528275625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd4406e9f0 0x7fbd4414af40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbd34000c00 tx=0x7fbd340046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:59.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.926+0000 7fbd2b7fe640 1 -- 172.21.15.103:0/1528275625 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd34041020 con 0x7fbd4406e9f0 2024-09-10T08:39:59.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.926+0000 7fbd493c4640 1 -- 172.21.15.103:0/1528275625 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd4414bb90 con 0x7fbd4406e9f0 2024-09-10T08:39:59.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.927+0000 7fbd493c4640 1 -- 172.21.15.103:0/1528275625 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd4414b480 con 0x7fbd4406e9f0 2024-09-10T08:39:59.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.927+0000 7fbd2b7fe640 1 -- 172.21.15.103:0/1528275625 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd3403d470 con 0x7fbd4406e9f0 2024-09-10T08:39:59.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.927+0000 7fbd2b7fe640 1 -- 172.21.15.103:0/1528275625 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd34037040 con 0x7fbd4406e9f0 2024-09-10T08:39:59.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.928+0000 7fbd493c4640 1 --2- 172.21.15.103:0/1528275625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd24002a70 0x7fbd24004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.928+0000 7fbd493c4640 1 -- 172.21.15.103:0/1528275625 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbd24007ec0 con 0x7fbd24002a70 2024-09-10T08:39:59.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.931+0000 7fbd2b7fe640 1 -- 172.21.15.103:0/1528275625 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbd34044020 con 0x7fbd4406e9f0 2024-09-10T08:39:59.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.931+0000 7fbd2b7fe640 1 --2- 172.21.15.103:0/1528275625 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbd3006be30 0x7fbd3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.931+0000 7fbd427fc640 1 --2- 172.21.15.103:0/1528275625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd24002a70 0x7fbd24004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.932+0000 7fbd2b7fe640 1 -- 172.21.15.103:0/1528275625 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fbd340ab670 con 0x7fbd4406e9f0 2024-09-10T08:39:59.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.932+0000 7fbd437fe640 1 --2- 172.21.15.103:0/1528275625 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbd3006be30 0x7fbd3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.933+0000 7fbd437fe640 1 --2- 172.21.15.103:0/1528275625 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbd3006be30 0x7fbd3006e2f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbd440ac990 tx=0x7fbd38006ba0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:59.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.934+0000 7fbd427fc640 1 -- 172.21.15.103:0/1528275625 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd240080c0 con 0x7fbd24002a70 2024-09-10T08:39:59.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.936+0000 7fbd427fc640 1 --2- 172.21.15.103:0/1528275625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd24002a70 0x7fbd24004f30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbd44151b40 tx=0x7fbd3c00f5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:59.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.936+0000 7fbd2b7fe640 1 -- 172.21.15.103:0/1528275625 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c00fea0 con 0x7fbd24002a70 2024-09-10T08:39:59.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.937+0000 7fbd2b7fe640 1 -- 172.21.15.103:0/1528275625 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbd3c018070 con 0x7fbd24002a70 2024-09-10T08:39:59.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.937+0000 7fbd2b7fe640 1 -- 172.21.15.103:0/1528275625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd24002a70 msgr2=0x7fbd24004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.937+0000 7fbd2b7fe640 1 --2- 172.21.15.103:0/1528275625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd24002a70 0x7fbd24004f30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbd44151b40 tx=0x7fbd3c00f5a0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.937+0000 7fbd2b7fe640 1 -- 172.21.15.103:0/1528275625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd24002a70 msgr2=0x7fbd24004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:39:59.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.937+0000 7fbd2b7fe640 1 --2- 172.21.15.103:0/1528275625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd24002a70 0x7fbd24004f30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.950+0000 7fbd493c4640 1 --2- 172.21.15.103:0/1528275625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd24006ee0 0x7fbd24007370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.951+0000 7fbd493c4640 1 -- 172.21.15.103:0/1528275625 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2400a4a0 con 0x7fbd24006ee0 2024-09-10T08:39:59.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.951+0000 7fbd427fc640 1 --2- 172.21.15.103:0/1528275625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd24006ee0 0x7fbd24007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.951+0000 7fbd427fc640 1 -- 172.21.15.103:0/1528275625 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbd240078b0 con 0x7fbd24006ee0 2024-09-10T08:39:59.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.952+0000 7fbd427fc640 1 --2- 172.21.15.103:0/1528275625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd24006ee0 0x7fbd24007370 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbd4415e370 tx=0x7fbd3c0012c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:59.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.953+0000 7fbd2b7fe640 1 -- 172.21.15.103:0/1528275625 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c013c50 con 0x7fbd24006ee0 2024-09-10T08:39:59.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.953+0000 7fbd2b7fe640 1 -- 172.21.15.103:0/1528275625 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7fbd3c013df0 con 0x7fbd24006ee0 2024-09-10T08:39:59.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.953+0000 7fbd2b7fe640 1 -- 172.21.15.103:0/1528275625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd24006ee0 msgr2=0x7fbd24007370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.953+0000 7fbd2b7fe640 1 --2- 172.21.15.103:0/1528275625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd24006ee0 0x7fbd24007370 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbd4415e370 tx=0x7fbd3c0012c0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.953+0000 7fbd2b7fe640 1 -- 172.21.15.103:0/1528275625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd24006ee0 msgr2=0x7fbd24007370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:39:59.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.953+0000 7fbd2b7fe640 1 --2- 172.21.15.103:0/1528275625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd24006ee0 0x7fbd24007370 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbd4415e370 tx=0x7fbd3c0012c0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.955 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:39:59.955 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:39:59.955 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:39:59.955 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:39:59.956 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 98, 2024-09-10T08:39:59.956 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 144980, 2024-09-10T08:39:59.956 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:39:59.956 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:39:59.956 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:39:59.956 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:39:59.956 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:59.956 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:39:59.956 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:39:59.956 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:39:59.956 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:39:59.956 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:39:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:39:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:39:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:39:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:39:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:39:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:39:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:39:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:39:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:39:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:39:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:39:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:39:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:39:59.957 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.958 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:39:59.959 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:39:59.959 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:39:59.959 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:39:59.959 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:39:59.959 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:39:59.959 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:39:59.959 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:39:59.959 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:39:59.959 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:39:59.959 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:39:59.959 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:39:59.959 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:39:59.959 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:39:59.959 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:39:59.959 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:39:59.960 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:39:59.960 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:39:59.960 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:39:59.960 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:39:59.960 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:39:59.960 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:39:59.960 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:39:59.960 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:39:59.960 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:39:59.960 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:39:59.960 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:39:59.960 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:39:59.961 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:59.961 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:39:59.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.961 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:39:59.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.961 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:39:59.961 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:39:59.961 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:39:59.961 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:39:59.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.961 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:39:59.961 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:39:59.961 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:59.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.962 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:39:59.962 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:39:59.962 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:59.962 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:59.962 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:59.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.962 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:39:59.962 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:39:59.962 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:39:59.962 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:39:59.962 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:39:59.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.962 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:39:59.962 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:59.963 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:39:59.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.965 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:39:59.965 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:39:59.965 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:59.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.965 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.965 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:39:59.965 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:39:59.965 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:39:59.965 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:59.965 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:59.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.965 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:39:59.965 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:39:59.965 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:39:59.965 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:39:59.966 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:39:59.966 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:59.966 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:59.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.966 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:39:59.966 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:39:59.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.966 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:39:59.966 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:39:59.966 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:39:59.966 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:59.966 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:59.967 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:39:59.967 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.967 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:39:59.967 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:39:59.967 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:39:59.967 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:59.967 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:59.967 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:39:59.967 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.967 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:39:59.967 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:39:59.967 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:39:59.967 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:59.968 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:59.968 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:39:59.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.968 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:39:59.968 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:39:59.968 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:39:59.968 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:59.968 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:39:59.968 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:39:59.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:39:59.968 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:39:59.968 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:39:59.968 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:39:59.968 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:39:59.969 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:39:59.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:39:59.969 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:39:59.969 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:39:59.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.954+0000 7fbd493c4640 1 -- 172.21.15.103:0/1528275625 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbd3006be30 msgr2=0x7fbd3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.954+0000 7fbd493c4640 1 --2- 172.21.15.103:0/1528275625 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbd3006be30 0x7fbd3006e2f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbd440ac990 tx=0x7fbd38006ba0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.954+0000 7fbd493c4640 1 -- 172.21.15.103:0/1528275625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd4406e9f0 msgr2=0x7fbd4414af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.954+0000 7fbd493c4640 1 --2- 172.21.15.103:0/1528275625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd4406e9f0 0x7fbd4414af40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbd34000c00 tx=0x7fbd340046c0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.954+0000 7fbd437fe640 1 -- 172.21.15.103:0/1528275625 reap_dead start 2024-09-10T08:39:59.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.954+0000 7fbd437fe640 1 -- 172.21.15.103:0/1528275625 reap_dead start 2024-09-10T08:39:59.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.954+0000 7fbd493c4640 1 -- 172.21.15.103:0/1528275625 shutdown_connections 2024-09-10T08:39:59.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.954+0000 7fbd493c4640 1 -- 172.21.15.103:0/1528275625 >> 172.21.15.103:0/1528275625 conn(0x7fbd440c4bb0 msgr2=0x7fbd44155d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:59.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.955+0000 7fbd493c4640 1 -- 172.21.15.103:0/1528275625 shutdown_connections 2024-09-10T08:39:59.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:39:59.955+0000 7fbd493c4640 1 -- 172.21.15.103:0/1528275625 wait complete. 2024-09-10T08:39:59.972 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:39:59.972 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:39:59.972 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:40:00.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.148+0000 7f7ec618d640 1 Processor -- start 2024-09-10T08:40:00.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.148+0000 7f7ec618d640 1 -- start start 2024-09-10T08:40:00.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.149+0000 7f7ec618d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec00aba60 0x7f7ec0153390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:00.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.149+0000 7f7ec618d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7ec00c3d60 0x7f7ec014fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:00.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.149+0000 7f7ec618d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ec00c37a0 con 0x7f7ec00c2e30 2024-09-10T08:40:00.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.150+0000 7f7ebf7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec00aba60 0x7f7ec0153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:00.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.150+0000 7f7ebf7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec00aba60 0x7f7ec0153390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:51306/0 (socket says 172.21.15.103:51306) 2024-09-10T08:40:00.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.150+0000 7f7ec618d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f7ec00c3a80 con 0x7f7ec00c3d60 2024-09-10T08:40:00.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.150+0000 7f7ec618d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7ec0155fb0 con 0x7f7ec00aba60 2024-09-10T08:40:00.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.150+0000 7f7ebf7fe640 1 -- 172.21.15.103:0/14072312 learned_addr learned my addr 172.21.15.103:0/14072312 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:00.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.151+0000 7f7ebffff640 1 --2- 172.21.15.103:0/14072312 >> v2:172.21.15.103:3300/0 conn(0x7f7ec00c3d60 0x7f7ec014fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:00.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.151+0000 7f7ebffff640 1 -- 172.21.15.103:0/14072312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec00aba60 msgr2=0x7f7ec0153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:00.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.151+0000 7f7ebffff640 1 --2- 172.21.15.103:0/14072312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec00aba60 0x7f7ec0153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.151+0000 7f7ebffff640 1 -- 172.21.15.103:0/14072312 >> v1:172.21.15.154:6789/0 conn(0x7f7ec00c2e30 legacy=0x7f7ec01567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:00.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.151+0000 7f7ebffff640 1 -- 172.21.15.103:0/14072312 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec0156290 con 0x7f7ec00c3d60 2024-09-10T08:40:00.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.152+0000 7f7ebffff640 1 --2- 172.21.15.103:0/14072312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ec00c3d60 0x7f7ec014fba0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009d90 tx=0x7f7eb802a4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef81cc22a73af65 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:00.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.152+0000 7f7ebe7fc640 1 -- 172.21.15.103:0/14072312 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8007740 con 0x7f7ec00c3d60 2024-09-10T08:40:00.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.152+0000 7f7ebe7fc640 1 -- 172.21.15.103:0/14072312 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eb80078e0 con 0x7f7ec00c3d60 2024-09-10T08:40:00.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.152+0000 7f7ebe7fc640 1 -- 172.21.15.103:0/14072312 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8007cb0 con 0x7f7ec00c3d60 2024-09-10T08:40:00.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.153+0000 7f7ec618d640 1 -- 172.21.15.103:0/14072312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ec00c3d60 msgr2=0x7f7ec014fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:00.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.154+0000 7f7ec618d640 1 --2- 172.21.15.103:0/14072312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ec00c3d60 0x7f7ec014fba0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009d90 tx=0x7f7eb802a4e0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.154+0000 7f7ec618d640 1 -- 172.21.15.103:0/14072312 shutdown_connections 2024-09-10T08:40:00.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.154+0000 7f7ec618d640 1 --2- 172.21.15.103:0/14072312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ec00c3d60 0x7f7ec014fba0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.154+0000 7f7ec618d640 1 --2- 172.21.15.103:0/14072312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec00aba60 0x7f7ec0153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.154+0000 7f7ec618d640 1 -- 172.21.15.103:0/14072312 >> 172.21.15.103:0/14072312 conn(0x7f7ec00c8430 msgr2=0x7f7ec00c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:00.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.154+0000 7f7ec618d640 1 -- 172.21.15.103:0/14072312 shutdown_connections 2024-09-10T08:40:00.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.154+0000 7f7ec618d640 1 -- 172.21.15.103:0/14072312 wait complete. 2024-09-10T08:40:00.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.156+0000 7f7ec618d640 1 Processor -- start 2024-09-10T08:40:00.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.157+0000 7f7ec618d640 1 -- start start 2024-09-10T08:40:00.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.158+0000 7f7ec618d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ec00aba60 0x7f7ec014ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:00.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.158+0000 7f7ec618d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec00c2e30 0x7f7ec014b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:00.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.159+0000 7f7ebf7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ec00aba60 0x7f7ec014ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:00.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.159+0000 7f7ebf7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ec00aba60 0x7f7ec014ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:54544/0 (socket says 172.21.15.103:54544) 2024-09-10T08:40:00.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.159+0000 7f7ebf7fe640 1 -- 172.21.15.103:0/42777552 learned_addr learned my addr 172.21.15.103:0/42777552 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:00.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.159+0000 7f7ebeffd640 1 --2- 172.21.15.103:0/42777552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec00c2e30 0x7f7ec014b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:00.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.159+0000 7f7ec618d640 1 --2- 172.21.15.103:0/42777552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ec00c3d60 0x7f7ec0142820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:00.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.159+0000 7f7ebffff640 1 --2- 172.21.15.103:0/42777552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ec00c3d60 0x7f7ec0142820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:00.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.159+0000 7f7ec618d640 1 -- 172.21.15.103:0/42777552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec00c4310 con 0x7f7ec00c3d60 2024-09-10T08:40:00.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.159+0000 7f7ec618d640 1 -- 172.21.15.103:0/42777552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec00c4190 con 0x7f7ec00aba60 2024-09-10T08:40:00.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.159+0000 7f7ec618d640 1 -- 172.21.15.103:0/42777552 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7ec00c4490 con 0x7f7ec00c2e30 2024-09-10T08:40:00.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.160+0000 7f7ebffff640 1 -- 172.21.15.103:0/42777552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec00c2e30 msgr2=0x7f7ec014b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:00.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.160+0000 7f7ebffff640 1 --2- 172.21.15.103:0/42777552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec00c2e30 0x7f7ec014b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.160+0000 7f7ebffff640 1 -- 172.21.15.103:0/42777552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ec00aba60 msgr2=0x7f7ec014ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:00.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.160+0000 7f7ebffff640 1 --2- 172.21.15.103:0/42777552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ec00aba60 0x7f7ec014ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.160+0000 7f7ebffff640 1 -- 172.21.15.103:0/42777552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec014f3a0 con 0x7f7ec00c3d60 2024-09-10T08:40:00.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.160+0000 7f7ebf7fe640 1 --2- 172.21.15.103:0/42777552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ec00aba60 0x7f7ec014ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:40:00.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.164+0000 7f7ebffff640 1 --2- 172.21.15.103:0/42777552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ec00c3d60 0x7f7ec0142820 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8031000 tx=0x7f7eb8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:00.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.164+0000 7f7ea7fff640 1 -- 172.21.15.103:0/42777552 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb803f070 con 0x7f7ec00c3d60 2024-09-10T08:40:00.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.164+0000 7f7ea7fff640 1 -- 172.21.15.103:0/42777552 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eb8044460 con 0x7f7ec00c3d60 2024-09-10T08:40:00.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.164+0000 7f7ea7fff640 1 -- 172.21.15.103:0/42777552 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8009450 con 0x7f7ec00c3d60 2024-09-10T08:40:00.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.165+0000 7f7ec618d640 1 -- 172.21.15.103:0/42777552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ec00c6c30 con 0x7f7ec00c3d60 2024-09-10T08:40:00.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.165+0000 7f7ec618d640 1 -- 172.21.15.103:0/42777552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ec00c66b0 con 0x7f7ec00c3d60 2024-09-10T08:40:00.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.166+0000 7f7ec618d640 1 --2- 172.21.15.103:0/42777552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec014e040 0x7f7ec0142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:00.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.166+0000 7f7ec618d640 1 -- 172.21.15.103:0/42777552 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7ec00c6230 con 0x7f7ec014e040 2024-09-10T08:40:00.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.170+0000 7f7ebf7fe640 1 --2- 172.21.15.103:0/42777552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec014e040 0x7f7ec0142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:00.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.170+0000 7f7ea7fff640 1 -- 172.21.15.103:0/42777552 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7eb8044830 con 0x7f7ec00c3d60 2024-09-10T08:40:00.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.171+0000 7f7ea7fff640 1 --2- 172.21.15.103:0/42777552 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7eac06be30 0x7f7eac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:00.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.171+0000 7f7ea7fff640 1 -- 172.21.15.103:0/42777552 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f7eb80ac9e0 con 0x7f7ec00c3d60 2024-09-10T08:40:00.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.172+0000 7f7ebf7fe640 1 -- 172.21.15.103:0/42777552 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ec014fb80 con 0x7f7ec014e040 2024-09-10T08:40:00.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.172+0000 7f7ebeffd640 1 --2- 172.21.15.103:0/42777552 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7eac06be30 0x7f7eac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:00.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.173+0000 7f7ebf7fe640 1 --2- 172.21.15.103:0/42777552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec014e040 0x7f7ec0142d60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0010890 tx=0x7f7eb0010d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:00.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.173+0000 7f7ebeffd640 1 --2- 172.21.15.103:0/42777552 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7eac06be30 0x7f7eac06e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7ec014c0b0 tx=0x7f7eb4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:00.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.174+0000 7f7ea7fff640 1 -- 172.21.15.103:0/42777552 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb000b040 con 0x7f7ec014e040 2024-09-10T08:40:00.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.175+0000 7f7ea7fff640 1 -- 172.21.15.103:0/42777552 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7eb0010e80 con 0x7f7ec014e040 2024-09-10T08:40:00.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.175+0000 7f7ea7fff640 1 -- 172.21.15.103:0/42777552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec014e040 msgr2=0x7f7ec0142d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:00.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.175+0000 7f7ea7fff640 1 --2- 172.21.15.103:0/42777552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec014e040 0x7f7ec0142d60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0010890 tx=0x7f7eb0010d50 comp rx=0 tx=0).stop 2024-09-10T08:40:00.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.175+0000 7f7ea7fff640 1 -- 172.21.15.103:0/42777552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec014e040 msgr2=0x7f7ec0142d60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:40:00.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.175+0000 7f7ea7fff640 1 --2- 172.21.15.103:0/42777552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec014e040 0x7f7ec0142d60 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0010890 tx=0x7f7eb0010d50 comp rx=0 tx=0).stop 2024-09-10T08:40:00.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.194+0000 7f7ec618d640 1 --2- 172.21.15.103:0/42777552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec00c7780 0x7f7ec00c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:00.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.194+0000 7f7ec618d640 1 -- 172.21.15.103:0/42777552 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7ec00c74a0 con 0x7f7ec00c7780 2024-09-10T08:40:00.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.194+0000 7f7ebf7fe640 1 --2- 172.21.15.103:0/42777552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec00c7780 0x7f7ec00c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:00.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.197+0000 7f7ebf7fe640 1 -- 172.21.15.103:0/42777552 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7ec0152d60 con 0x7f7ec00c7780 2024-09-10T08:40:00.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.198+0000 7f7ebf7fe640 1 --2- 172.21.15.103:0/42777552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec00c7780 0x7f7ec00c7b60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0010890 tx=0x7f7eb00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:00.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.198+0000 7f7ea7fff640 1 -- 172.21.15.103:0/42777552 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0021040 con 0x7f7ec00c7780 2024-09-10T08:40:00.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.199+0000 7f7ea7fff640 1 -- 172.21.15.103:0/42777552 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5053 (secure 0 0 0) 0x7f7eb0021770 con 0x7f7ec00c7780 2024-09-10T08:40:00.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.199+0000 7f7ea7fff640 1 -- 172.21.15.103:0/42777552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec00c7780 msgr2=0x7f7ec00c7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:00.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.199+0000 7f7ea7fff640 1 --2- 172.21.15.103:0/42777552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec00c7780 0x7f7ec00c7b60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0010890 tx=0x7f7eb00046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.199+0000 7f7ea7fff640 1 -- 172.21.15.103:0/42777552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec00c7780 msgr2=0x7f7ec00c7b60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:40:00.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.199+0000 7f7ea7fff640 1 --2- 172.21.15.103:0/42777552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ec00c7780 0x7f7ec00c7b60 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0010890 tx=0x7f7eb00046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.201 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:40:00.201 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:40:00.201 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:40:00.201 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:40:00.201 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 98, 2024-09-10T08:40:00.201 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 93033, 2024-09-10T08:40:00.201 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:40:00.201 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:40:00.201 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:40:00.202 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:40:00.202 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:00.202 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 1, 2024-09-10T08:40:00.202 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:40:00.202 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:40:00.202 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:40:00.202 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:00.202 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:00.202 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:00.202 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:00.202 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:00.202 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:00.202 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:00.203 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:00.203 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:00.203 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:00.203 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:00.203 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:00.203 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:40:00.203 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:40:00.203 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:00.203 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:00.204 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:00.204 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:00.204 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:00.204 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:00.204 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:00.204 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:00.204 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:00.204 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:00.204 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:00.204 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:00.204 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:00.204 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:40:00.204 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:40:00.205 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:40:00.205 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:40:00.205 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:40:00.205 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:40:00.205 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:40:00.205 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:40:00.205 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:40:00.205 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:40:00.205 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:40:00.205 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:40:00.205 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:40:00.205 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:40:00.205 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:40:00.206 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:40:00.206 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:40:00.206 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:00.206 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:00.206 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:00.206 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:00.206 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:00.206 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:00.206 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:00.206 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:00.206 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:00.206 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:00.206 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:00.207 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:00.207 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:40:00.207 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:00.207 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:40:00.207 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:00.207 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:40:00.207 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:40:00.207 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:00.207 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:00.207 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:00.207 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:00.207 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:40:00.207 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:00.207 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:00.208 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:00.208 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:00.208 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:40:00.208 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:00.208 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:00.208 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:00.208 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:00.208 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:40:00.208 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:40:00.208 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:00.208 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:00.208 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:00.208 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:00.209 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:00.209 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:40:00.209 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:40:00.209 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:00.209 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:00.209 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:00.209 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:00.209 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:40:00.209 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:00.209 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:00.209 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:00.209 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:00.210 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:40:00.210 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:00.210 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:00.210 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:00.210 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:00.210 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:40:00.210 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:40:00.210 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:00.210 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:00.210 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:00.210 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:00.210 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:00.210 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:40:00.211 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:40:00.211 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:00.211 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:00.211 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:00.211 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:00.211 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:40:00.211 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:00.211 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:00.211 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:00.211 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:00.211 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:40:00.211 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:00.211 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:00.211 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:00.212 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:00.212 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:40:00.212 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:40:00.212 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:00.212 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:00.212 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:00.212 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:00.212 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:00.212 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:00.212 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:40:00.212 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:40:00.212 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:00.212 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:00.213 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:00.213 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:40:00.213 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:00.213 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:00.213 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:40:00.213 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:00.213 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:00.213 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:00.213 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:40:00.213 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:00.213 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:00.213 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:40:00.213 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:00.214 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:00.214 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:00.214 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:40:00.214 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:00.214 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:00.214 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:40:00.214 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:00.214 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:00.214 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:00.214 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:40:00.214 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:00.214 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:00.214 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:40:00.214 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:00.215 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:00.215 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:00.215 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:40:00.215 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:00.215 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:00.215 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:00.215 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:40:00.215 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:40:00.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.200+0000 7f7ec618d640 1 -- 172.21.15.103:0/42777552 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7eac06be30 msgr2=0x7f7eac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:00.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.200+0000 7f7ec618d640 1 --2- 172.21.15.103:0/42777552 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7eac06be30 0x7f7eac06e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7ec014c0b0 tx=0x7f7eb4009040 comp rx=0 tx=0).stop 2024-09-10T08:40:00.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.200+0000 7f7ec618d640 1 -- 172.21.15.103:0/42777552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ec00c3d60 msgr2=0x7f7ec0142820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:00.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.200+0000 7f7ec618d640 1 --2- 172.21.15.103:0/42777552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ec00c3d60 0x7f7ec0142820 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8031000 tx=0x7f7eb8004a40 comp rx=0 tx=0).stop 2024-09-10T08:40:00.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.200+0000 7f7ebffff640 1 -- 172.21.15.103:0/42777552 reap_dead start 2024-09-10T08:40:00.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.200+0000 7f7ebffff640 1 -- 172.21.15.103:0/42777552 reap_dead start 2024-09-10T08:40:00.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.201+0000 7f7ec618d640 1 -- 172.21.15.103:0/42777552 shutdown_connections 2024-09-10T08:40:00.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.201+0000 7f7ec618d640 1 -- 172.21.15.103:0/42777552 >> 172.21.15.103:0/42777552 conn(0x7f7ec00c8430 msgr2=0x7f7ec014c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:00.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.201+0000 7f7ec618d640 1 -- 172.21.15.103:0/42777552 shutdown_connections 2024-09-10T08:40:00.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.201+0000 7f7ec618d640 1 -- 172.21.15.103:0/42777552 wait complete. 2024-09-10T08:40:00.221 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:40:00.221 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-10T08:40:00.221 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-10T08:40:00.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.387+0000 7f12e2e5e640 1 Processor -- start 2024-09-10T08:40:00.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.388+0000 7f12e2e5e640 1 -- start start 2024-09-10T08:40:00.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.389+0000 7f12e2e5e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f12dc067bc0 0x7f12dc156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:00.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.389+0000 7f12e2e5e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12dc0ca010 0x7f12dc0ca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:00.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.389+0000 7f12e2e5e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12dc06d1c0 con 0x7f12dc0c6190 2024-09-10T08:40:00.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.389+0000 7f12e2e5e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f12dc06d460 con 0x7f12dc067bc0 2024-09-10T08:40:00.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.390+0000 7f12e13fb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12dc0ca010 0x7f12dc0ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:00.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.390+0000 7f12e13fb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12dc0ca010 0x7f12dc0ca430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:51344/0 (socket says 172.21.15.103:51344) 2024-09-10T08:40:00.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.390+0000 7f12e13fb640 1 -- 172.21.15.103:0/1857027492 learned_addr learned my addr 172.21.15.103:0/1857027492 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:00.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.390+0000 7f12e0bfa640 1 --2- 172.21.15.103:0/1857027492 >> v2:172.21.15.103:3300/0 conn(0x7f12dc067bc0 0x7f12dc156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:00.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.390+0000 7f12e2e5e640 1 -- 172.21.15.103:0/1857027492 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f12dc06d740 con 0x7f12dc0ca010 2024-09-10T08:40:00.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.390+0000 7f12e0bfa640 1 -- 172.21.15.103:0/1857027492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12dc0ca010 msgr2=0x7f12dc0ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:00.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.390+0000 7f12e0bfa640 1 --2- 172.21.15.103:0/1857027492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12dc0ca010 0x7f12dc0ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.390+0000 7f12e0bfa640 1 -- 172.21.15.103:0/1857027492 >> v1:172.21.15.154:6789/0 conn(0x7f12dc0c6190 legacy=0x7f12dc153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:00.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.390+0000 7f12e0bfa640 1 -- 172.21.15.103:0/1857027492 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12dc06da20 con 0x7f12dc067bc0 2024-09-10T08:40:00.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.393+0000 7f12e0bfa640 1 --2- 172.21.15.103:0/1857027492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12dc067bc0 0x7f12dc156cc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0cce30 tx=0x7f12d002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe902003d60f2469 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:00.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.394+0000 7f12db7fe640 1 -- 172.21.15.103:0/1857027492 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d0037070 con 0x7f12dc067bc0 2024-09-10T08:40:00.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.394+0000 7f12db7fe640 1 -- 172.21.15.103:0/1857027492 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12d002adc0 con 0x7f12dc067bc0 2024-09-10T08:40:00.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.394+0000 7f12db7fe640 1 -- 172.21.15.103:0/1857027492 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d0032660 con 0x7f12dc067bc0 2024-09-10T08:40:00.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.395+0000 7f12e2e5e640 1 -- 172.21.15.103:0/1857027492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12dc067bc0 msgr2=0x7f12dc156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:00.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.395+0000 7f12e2e5e640 1 --2- 172.21.15.103:0/1857027492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12dc067bc0 0x7f12dc156cc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0cce30 tx=0x7f12d002a0b0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.395+0000 7f12e2e5e640 1 -- 172.21.15.103:0/1857027492 shutdown_connections 2024-09-10T08:40:00.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.395+0000 7f12e2e5e640 1 --2- 172.21.15.103:0/1857027492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12dc0ca010 0x7f12dc0ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.395+0000 7f12e2e5e640 1 --2- 172.21.15.103:0/1857027492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12dc067bc0 0x7f12dc156cc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.395+0000 7f12e2e5e640 1 -- 172.21.15.103:0/1857027492 >> 172.21.15.103:0/1857027492 conn(0x7f12dc0c87f0 msgr2=0x7f12dc0c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:00.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.395+0000 7f12e2e5e640 1 -- 172.21.15.103:0/1857027492 shutdown_connections 2024-09-10T08:40:00.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.395+0000 7f12e2e5e640 1 -- 172.21.15.103:0/1857027492 wait complete. 2024-09-10T08:40:00.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.397+0000 7f12e2e5e640 1 Processor -- start 2024-09-10T08:40:00.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.398+0000 7f12e2e5e640 1 -- start start 2024-09-10T08:40:00.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.399+0000 7f12e2e5e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12dc067bc0 0x7f12dc14c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:00.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.399+0000 7f12e2e5e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12dc0c6190 0x7f12dc14de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:00.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.399+0000 7f12e2e5e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12dc0ca010 0x7f12dc1ebbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:00.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.399+0000 7f12e2e5e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc153ed0 con 0x7f12dc0c6190 2024-09-10T08:40:00.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.400+0000 7f12e2e5e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc153d50 con 0x7f12dc067bc0 2024-09-10T08:40:00.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.400+0000 7f12e13fb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12dc0ca010 0x7f12dc1ebbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:00.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.400+0000 7f12e13fb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12dc0ca010 0x7f12dc1ebbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:51354/0 (socket says 172.21.15.103:51354) 2024-09-10T08:40:00.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.400+0000 7f12e13fb640 1 -- 172.21.15.103:0/227710459 learned_addr learned my addr 172.21.15.103:0/227710459 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:00.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.400+0000 7f12e2e5e640 1 -- 172.21.15.103:0/227710459 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f12dc067fa0 con 0x7f12dc0ca010 2024-09-10T08:40:00.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.400+0000 7f12e0bfa640 1 --2- 172.21.15.103:0/227710459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12dc067bc0 0x7f12dc14c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:00.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.401+0000 7f12e0bfa640 1 -- 172.21.15.103:0/227710459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12dc0ca010 msgr2=0x7f12dc1ebbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:00.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.401+0000 7f12e0bfa640 1 --2- 172.21.15.103:0/227710459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12dc0ca010 0x7f12dc1ebbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.401+0000 7f12e0bfa640 1 -- 172.21.15.103:0/227710459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12dc0c6190 msgr2=0x7f12dc14de80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:40:00.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.401+0000 7f12e0bfa640 1 --2- 172.21.15.103:0/227710459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12dc0c6190 0x7f12dc14de80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.401+0000 7f12e0bfa640 1 -- 172.21.15.103:0/227710459 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12dc149ca0 con 0x7f12dc067bc0 2024-09-10T08:40:00.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.401+0000 7f12e13fb640 1 --2- 172.21.15.103:0/227710459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12dc0ca010 0x7f12dc1ebbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:40:00.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.402+0000 7f12e0bfa640 1 --2- 172.21.15.103:0/227710459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12dc067bc0 0x7f12dc14c160 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0ccdb0 tx=0x7f12d00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:00.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.402+0000 7f12d97fa640 1 -- 172.21.15.103:0/227710459 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d0037050 con 0x7f12dc067bc0 2024-09-10T08:40:00.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.402+0000 7f12e2e5e640 1 -- 172.21.15.103:0/227710459 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12dc149f80 con 0x7f12dc067bc0 2024-09-10T08:40:00.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.402+0000 7f12e2e5e640 1 -- 172.21.15.103:0/227710459 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12dc14e3c0 con 0x7f12dc067bc0 2024-09-10T08:40:00.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.403+0000 7f12d97fa640 1 -- 172.21.15.103:0/227710459 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12d0043070 con 0x7f12dc067bc0 2024-09-10T08:40:00.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.403+0000 7f12d97fa640 1 -- 172.21.15.103:0/227710459 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d003ca10 con 0x7f12dc067bc0 2024-09-10T08:40:00.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.404+0000 7f12e2e5e640 1 -- 172.21.15.103:0/227710459 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12dc068f80 con 0x7f12dc067bc0 2024-09-10T08:40:00.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.405+0000 7f12d97fa640 1 -- 172.21.15.103:0/227710459 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f12d003cbb0 con 0x7f12dc067bc0 2024-09-10T08:40:00.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.405+0000 7f12d97fa640 1 --2- 172.21.15.103:0/227710459 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f12c006be30 0x7f12c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:00.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.406+0000 7f12dbfff640 1 --2- 172.21.15.103:0/227710459 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f12c006be30 0x7f12c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:00.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.406+0000 7f12d97fa640 1 -- 172.21.15.103:0/227710459 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f12d00abc10 con 0x7f12dc067bc0 2024-09-10T08:40:00.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.407+0000 7f12dbfff640 1 --2- 172.21.15.103:0/227710459 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f12c006be30 0x7f12c006e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f12dc153cf0 tx=0x7f12c8006b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:00.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.415+0000 7f12d97fa640 1 -- 172.21.15.103:0/227710459 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f12d007a2b0 con 0x7f12dc067bc0 2024-09-10T08:40:00.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.878+0000 7f12e2e5e640 1 -- 172.21.15.103:0/227710459 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f12dc0c7480 con 0x7f12dc067bc0 2024-09-10T08:40:00.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.882+0000 7f12d97fa640 1 -- 172.21.15.103:0/227710459 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f12d0079bb0 con 0x7f12dc067bc0 2024-09-10T08:40:00.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.886+0000 7f12e2e5e640 1 -- 172.21.15.103:0/227710459 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f12c006be30 msgr2=0x7f12c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:00.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.886+0000 7f12e2e5e640 1 --2- 172.21.15.103:0/227710459 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f12c006be30 0x7f12c006e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f12dc153cf0 tx=0x7f12c8006b50 comp rx=0 tx=0).stop 2024-09-10T08:40:00.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.886+0000 7f12e2e5e640 1 -- 172.21.15.103:0/227710459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12dc067bc0 msgr2=0x7f12dc14c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:00.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.886+0000 7f12e2e5e640 1 --2- 172.21.15.103:0/227710459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12dc067bc0 0x7f12dc14c160 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0ccdb0 tx=0x7f12d00046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.886+0000 7f12e2e5e640 1 -- 172.21.15.103:0/227710459 shutdown_connections 2024-09-10T08:40:00.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.886+0000 7f12e2e5e640 1 --2- 172.21.15.103:0/227710459 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f12c006be30 0x7f12c006e2f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.886+0000 7f12e2e5e640 1 --2- 172.21.15.103:0/227710459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12dc0ca010 0x7f12dc1ebbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.886+0000 7f12e2e5e640 1 --2- 172.21.15.103:0/227710459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12dc0c6190 0x7f12dc14de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.886+0000 7f12e2e5e640 1 --2- 172.21.15.103:0/227710459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12dc067bc0 0x7f12dc14c160 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.886+0000 7f12e2e5e640 1 -- 172.21.15.103:0/227710459 >> 172.21.15.103:0/227710459 conn(0x7f12dc0c87f0 msgr2=0x7f12dc151820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:00.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.887+0000 7f12e2e5e640 1 -- 172.21.15.103:0/227710459 shutdown_connections 2024-09-10T08:40:00.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:00.889+0000 7f12e2e5e640 1 -- 172.21.15.103:0/227710459 wait complete. 2024-09-10T08:40:00.908 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-10T08:40:02.559 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:40:02.562 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:40:10.909 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:40:10.910 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:40:11.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.081+0000 7f841e3c4640 1 Processor -- start 2024-09-10T08:40:11.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.081+0000 7f841e3c4640 1 -- start start 2024-09-10T08:40:11.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.082+0000 7f841e3c4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f84180a9230 0x7f84180c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:11.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.082+0000 7f841e3c4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8418072b30 0x7f8418151610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:11.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.083+0000 7f841e3c4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8418070800 con 0x7f84180ca220 2024-09-10T08:40:11.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.083+0000 7f841e3c4640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f84180c99b0 con 0x7f84180a9230 2024-09-10T08:40:11.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.083+0000 7f841e3c4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f84180c93f0 con 0x7f8418072b30 2024-09-10T08:40:11.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.083+0000 7f84177fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f84180a9230 0x7f84180c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:11.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.083+0000 7f84177fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f84180a9230 0x7f84180c3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56732/0 (socket says 172.21.15.103:56732) 2024-09-10T08:40:11.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.083+0000 7f84177fe640 1 -- 172.21.15.103:0/3152139855 learned_addr learned my addr 172.21.15.103:0/3152139855 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:11.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.084+0000 7f841c961640 1 --2- 172.21.15.103:0/3152139855 >> v2:172.21.15.154:3300/0 conn(0x7f8418072b30 0x7f8418151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:11.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.084+0000 7f84177fe640 1 -- 172.21.15.103:0/3152139855 >> v2:172.21.15.154:3300/0 conn(0x7f8418072b30 msgr2=0x7f8418151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:11.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.084+0000 7f84177fe640 1 --2- 172.21.15.103:0/3152139855 >> v2:172.21.15.154:3300/0 conn(0x7f8418072b30 0x7f8418151610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.084+0000 7f84177fe640 1 -- 172.21.15.103:0/3152139855 >> v1:172.21.15.103:6789/0 conn(0x7f84180ca220 legacy=0x7f8418154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:11.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.084+0000 7f84177fe640 1 -- 172.21.15.103:0/3152139855 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84180c96d0 con 0x7f84180a9230 2024-09-10T08:40:11.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.086+0000 7f84177fe640 1 --2- 172.21.15.103:0/3152139855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84180a9230 0x7f84180c3f10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f841806f4f0 tx=0x7f840802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c67d72e292107910 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:11.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.086+0000 7f8416ffd640 1 -- 172.21.15.103:0/3152139855 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8408037070 con 0x7f84180a9230 2024-09-10T08:40:11.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.086+0000 7f8416ffd640 1 -- 172.21.15.103:0/3152139855 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8408032440 con 0x7f84180a9230 2024-09-10T08:40:11.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.086+0000 7f8416ffd640 1 -- 172.21.15.103:0/3152139855 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8408032810 con 0x7f84180a9230 2024-09-10T08:40:11.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.087+0000 7f841e3c4640 1 -- 172.21.15.103:0/3152139855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84180a9230 msgr2=0x7f84180c3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:11.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.087+0000 7f841e3c4640 1 --2- 172.21.15.103:0/3152139855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84180a9230 0x7f84180c3f10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f841806f4f0 tx=0x7f840802a1c0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.091+0000 7f841e3c4640 1 -- 172.21.15.103:0/3152139855 shutdown_connections 2024-09-10T08:40:11.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.091+0000 7f841e3c4640 1 --2- 172.21.15.103:0/3152139855 >> v2:172.21.15.154:3300/0 conn(0x7f8418072b30 0x7f8418151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.091+0000 7f841e3c4640 1 --2- 172.21.15.103:0/3152139855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84180a9230 0x7f84180c3f10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.091+0000 7f841e3c4640 1 -- 172.21.15.103:0/3152139855 >> 172.21.15.103:0/3152139855 conn(0x7f8418067b30 msgr2=0x7f8418067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:11.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.092+0000 7f841e3c4640 1 -- 172.21.15.103:0/3152139855 shutdown_connections 2024-09-10T08:40:11.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.092+0000 7f841e3c4640 1 -- 172.21.15.103:0/3152139855 wait complete. 2024-09-10T08:40:11.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.094+0000 7f841e3c4640 1 Processor -- start 2024-09-10T08:40:11.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.094+0000 7f841e3c4640 1 -- start start 2024-09-10T08:40:11.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.095+0000 7f841e3c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8418072b30 0x7f8418153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:11.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.095+0000 7f841e3c4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84180a9230 0x7f84180ac360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:11.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.095+0000 7f841e3c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84180ca220 0x7f84180ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:11.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.095+0000 7f841e3c4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8418072fc0 con 0x7f8418072b30 2024-09-10T08:40:11.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.095+0000 7f841e3c4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8418154660 con 0x7f84180ca220 2024-09-10T08:40:11.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.095+0000 7f841e3c4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f84180ca600 con 0x7f84180a9230 2024-09-10T08:40:11.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.096+0000 7f8417fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8418072b30 0x7f8418153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:11.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.096+0000 7f84177fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84180a9230 0x7f84180ac360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:11.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.096+0000 7f84177fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84180a9230 0x7f84180ac360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:38102/0 (socket says 172.21.15.103:38102) 2024-09-10T08:40:11.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.096+0000 7f84177fe640 1 -- 172.21.15.103:0/2544826326 learned_addr learned my addr 172.21.15.103:0/2544826326 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:11.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.096+0000 7f841c961640 1 --2- 172.21.15.103:0/2544826326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84180ca220 0x7f84180ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:11.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.096+0000 7f8417fff640 1 -- 172.21.15.103:0/2544826326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84180a9230 msgr2=0x7f84180ac360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:11.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.096+0000 7f8417fff640 1 --2- 172.21.15.103:0/2544826326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84180a9230 0x7f84180ac360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.096+0000 7f8417fff640 1 -- 172.21.15.103:0/2544826326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84180ca220 msgr2=0x7f84180ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:11.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.096+0000 7f8417fff640 1 --2- 172.21.15.103:0/2544826326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84180ca220 0x7f84180ac8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.096+0000 7f8417fff640 1 -- 172.21.15.103:0/2544826326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84180ae300 con 0x7f8418072b30 2024-09-10T08:40:11.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.096+0000 7f841c961640 1 --2- 172.21.15.103:0/2544826326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84180ca220 0x7f84180ac8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:40:11.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.097+0000 7f8417fff640 1 --2- 172.21.15.103:0/2544826326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8418072b30 0x7f8418153000 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f840c00c410 tx=0x7f840c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:11.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.097+0000 7f8414ff9640 1 -- 172.21.15.103:0/2544826326 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c017070 con 0x7f8418072b30 2024-09-10T08:40:11.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.097+0000 7f841e3c4640 1 -- 172.21.15.103:0/2544826326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84180adc60 con 0x7f8418072b30 2024-09-10T08:40:11.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.097+0000 7f841e3c4640 1 -- 172.21.15.103:0/2544826326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84181f4140 con 0x7f8418072b30 2024-09-10T08:40:11.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.097+0000 7f8414ff9640 1 -- 172.21.15.103:0/2544826326 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840c0035f0 con 0x7f8418072b30 2024-09-10T08:40:11.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.098+0000 7f8414ff9640 1 -- 172.21.15.103:0/2544826326 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c0039e0 con 0x7f8418072b30 2024-09-10T08:40:11.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.099+0000 7f841e3c4640 1 -- 172.21.15.103:0/2544826326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83f8005290 con 0x7f8418072b30 2024-09-10T08:40:11.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.100+0000 7f8414ff9640 1 -- 172.21.15.103:0/2544826326 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f840c01a070 con 0x7f8418072b30 2024-09-10T08:40:11.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.101+0000 7f8414ff9640 1 --2- 172.21.15.103:0/2544826326 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f840406bf00 0x7f840406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:11.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.101+0000 7f84177fe640 1 --2- 172.21.15.103:0/2544826326 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f840406bf00 0x7f840406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:11.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.101+0000 7f8414ff9640 1 -- 172.21.15.103:0/2544826326 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f840c08a490 con 0x7f8418072b30 2024-09-10T08:40:11.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.102+0000 7f84177fe640 1 --2- 172.21.15.103:0/2544826326 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f840406bf00 0x7f840406e3c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8418150e40 tx=0x7f840802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:11.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.109+0000 7f8414ff9640 1 -- 172.21.15.103:0/2544826326 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f840c058580 con 0x7f8418072b30 2024-09-10T08:40:11.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.586+0000 7f841e3c4640 1 -- 172.21.15.103:0/2544826326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f83f8005580 con 0x7f8418072b30 2024-09-10T08:40:11.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.587+0000 7f8414ff9640 1 -- 172.21.15.103:0/2544826326 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f840c05c880 con 0x7f8418072b30 2024-09-10T08:40:11.588 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":98,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:40:11.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.590+0000 7f841e3c4640 1 -- 172.21.15.103:0/2544826326 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f840406bf00 msgr2=0x7f840406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:11.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.590+0000 7f841e3c4640 1 --2- 172.21.15.103:0/2544826326 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f840406bf00 0x7f840406e3c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8418150e40 tx=0x7f840802e000 comp rx=0 tx=0).stop 2024-09-10T08:40:11.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.590+0000 7f841e3c4640 1 -- 172.21.15.103:0/2544826326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8418072b30 msgr2=0x7f8418153000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:11.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.590+0000 7f841e3c4640 1 --2- 172.21.15.103:0/2544826326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8418072b30 0x7f8418153000 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f840c00c410 tx=0x7f840c00c810 comp rx=0 tx=0).stop 2024-09-10T08:40:11.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.591+0000 7f841e3c4640 1 -- 172.21.15.103:0/2544826326 shutdown_connections 2024-09-10T08:40:11.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.591+0000 7f841e3c4640 1 --2- 172.21.15.103:0/2544826326 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f840406bf00 0x7f840406e3c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.591+0000 7f841e3c4640 1 --2- 172.21.15.103:0/2544826326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84180ca220 0x7f84180ac8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.591+0000 7f841e3c4640 1 --2- 172.21.15.103:0/2544826326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84180a9230 0x7f84180ac360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.591+0000 7f841e3c4640 1 --2- 172.21.15.103:0/2544826326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8418072b30 0x7f8418153000 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.591+0000 7f841e3c4640 1 -- 172.21.15.103:0/2544826326 >> 172.21.15.103:0/2544826326 conn(0x7f8418067b30 msgr2=0x7f8418067f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:11.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.592+0000 7f841e3c4640 1 -- 172.21.15.103:0/2544826326 shutdown_connections 2024-09-10T08:40:11.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.592+0000 7f841e3c4640 1 -- 172.21.15.103:0/2544826326 wait complete. 2024-09-10T08:40:11.610 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:40:11.610 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-10T08:40:11.610 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:40:11.610 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:40:11.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.780+0000 7f851a352640 1 Processor -- start 2024-09-10T08:40:11.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.780+0000 7f851a352640 1 -- start start 2024-09-10T08:40:11.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.781+0000 7f851a352640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8514153be0 0x7f85140c3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:11.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.782+0000 7f8513fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8514153be0 0x7f85140c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:11.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.782+0000 7f8513fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8514153be0 0x7f85140c3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56756/0 (socket says 172.21.15.103:56756) 2024-09-10T08:40:11.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.782+0000 7f85137fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f85140ac720 0x7f85140c7a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:53992/0 (socket says 172.21.15.103:53992) 2024-09-10T08:40:11.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.782+0000 7f8513fff640 1 -- 172.21.15.103:0/2173730476 learned_addr learned my addr 172.21.15.103:0/2173730476 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:11.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.782+0000 7f851a352640 1 -- 172.21.15.103:0/2173730476 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8514153fc0 con 0x7f85140ac720 2024-09-10T08:40:11.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.782+0000 7f851a352640 1 -- 172.21.15.103:0/2173730476 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85140a8030 con 0x7f85140c8180 2024-09-10T08:40:11.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.782+0000 7f851a352640 1 -- 172.21.15.103:0/2173730476 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f8514156db0 con 0x7f8514153be0 2024-09-10T08:40:11.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.783+0000 7f8512ffd640 1 -- 172.21.15.103:0/2173730476 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2684856418 0 0) 0x7f8500001110 con 0x7f85140ac720 2024-09-10T08:40:11.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.783+0000 7f8512ffd640 1 -- 172.21.15.103:0/2173730476 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84f8003520 con 0x7f85140ac720 2024-09-10T08:40:11.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.783+0000 7f8513fff640 1 -- 172.21.15.103:0/2173730476 >> v1:172.21.15.154:6789/0 conn(0x7f85140c8180 legacy=0x7f8514160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:11.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.783+0000 7f8513fff640 1 -- 172.21.15.103:0/2173730476 >> v1:172.21.15.103:6789/0 conn(0x7f85140ac720 legacy=0x7f85140c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:11.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.783+0000 7f8513fff640 1 -- 172.21.15.103:0/2173730476 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85140c86d0 con 0x7f8514153be0 2024-09-10T08:40:11.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.784+0000 7f8513fff640 1 --2- 172.21.15.103:0/2173730476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8514153be0 0x7f85140c3560 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f85040097f0 tx=0x7f850402a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51fdb140050a5733 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:11.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.784+0000 7f8512ffd640 1 -- 172.21.15.103:0/2173730476 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8504037070 con 0x7f8514153be0 2024-09-10T08:40:11.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.785+0000 7f8512ffd640 1 -- 172.21.15.103:0/2173730476 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f850402ad90 con 0x7f8514153be0 2024-09-10T08:40:11.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.785+0000 7f8512ffd640 1 -- 172.21.15.103:0/2173730476 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8504032640 con 0x7f8514153be0 2024-09-10T08:40:11.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.785+0000 7f851a352640 1 -- 172.21.15.103:0/2173730476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8514153be0 msgr2=0x7f85140c3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:11.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.785+0000 7f851a352640 1 --2- 172.21.15.103:0/2173730476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8514153be0 0x7f85140c3560 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f85040097f0 tx=0x7f850402a080 comp rx=0 tx=0).stop 2024-09-10T08:40:11.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.786+0000 7f851a352640 1 -- 172.21.15.103:0/2173730476 shutdown_connections 2024-09-10T08:40:11.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.786+0000 7f851a352640 1 --2- 172.21.15.103:0/2173730476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8514153be0 0x7f85140c3560 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.786+0000 7f851a352640 1 -- 172.21.15.103:0/2173730476 >> 172.21.15.103:0/2173730476 conn(0x7f85140c5660 msgr2=0x7f85140c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:11.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.786+0000 7f851a352640 1 -- 172.21.15.103:0/2173730476 shutdown_connections 2024-09-10T08:40:11.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.786+0000 7f851a352640 1 -- 172.21.15.103:0/2173730476 wait complete. 2024-09-10T08:40:11.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.788+0000 7f851a352640 1 Processor -- start 2024-09-10T08:40:11.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.788+0000 7f851a352640 1 -- start start 2024-09-10T08:40:11.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.789+0000 7f851a352640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85140ac720 0x7f8514155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:11.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.789+0000 7f851a352640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85140c8180 0x7f85141ef960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:11.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.789+0000 7f85137fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85140c8180 0x7f85141ef960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:11.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.789+0000 7f8513fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85140ac720 0x7f8514155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:11.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.789+0000 7f8513fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85140ac720 0x7f8514155200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:34116/0 (socket says 172.21.15.103:34116) 2024-09-10T08:40:11.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.789+0000 7f85137fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85140c8180 0x7f85141ef960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56766/0 (socket says 172.21.15.103:56766) 2024-09-10T08:40:11.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.790+0000 7f8513fff640 1 -- 172.21.15.103:0/749607324 learned_addr learned my addr 172.21.15.103:0/749607324 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:11.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.790+0000 7f851a352640 1 --2- 172.21.15.103:0/749607324 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8514155740 0x7f851414c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:11.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.790+0000 7f85188ef640 1 --2- 172.21.15.103:0/749607324 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8514155740 0x7f851414c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:11.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.790+0000 7f851a352640 1 -- 172.21.15.103:0/749607324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f85140ac370 con 0x7f85140c8180 2024-09-10T08:40:11.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.790+0000 7f851a352640 1 -- 172.21.15.103:0/749607324 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f85140a83e0 con 0x7f85140ac720 2024-09-10T08:40:11.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.790+0000 7f851a352640 1 -- 172.21.15.103:0/749607324 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f85140ac4f0 con 0x7f8514155740 2024-09-10T08:40:11.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.791+0000 7f85137fe640 1 -- 172.21.15.103:0/749607324 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8514155740 msgr2=0x7f851414c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:11.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.791+0000 7f85137fe640 1 --2- 172.21.15.103:0/749607324 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8514155740 0x7f851414c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.791+0000 7f85137fe640 1 -- 172.21.15.103:0/749607324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85140ac720 msgr2=0x7f8514155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:11.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.791+0000 7f85137fe640 1 --2- 172.21.15.103:0/749607324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85140ac720 0x7f8514155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.791+0000 7f85137fe640 1 -- 172.21.15.103:0/749607324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85141f0470 con 0x7f85140c8180 2024-09-10T08:40:11.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.791+0000 7f85137fe640 1 --2- 172.21.15.103:0/749607324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85140c8180 0x7f85141ef960 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f850000c730 tx=0x7f850000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:11.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.792+0000 7f8510ff9640 1 -- 172.21.15.103:0/749607324 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8500018070 con 0x7f85140c8180 2024-09-10T08:40:11.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.792+0000 7f8510ff9640 1 -- 172.21.15.103:0/749607324 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8500007070 con 0x7f85140c8180 2024-09-10T08:40:11.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.792+0000 7f8510ff9640 1 -- 172.21.15.103:0/749607324 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85000074a0 con 0x7f85140c8180 2024-09-10T08:40:11.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.792+0000 7f851a352640 1 -- 172.21.15.103:0/749607324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85141e01e0 con 0x7f85140c8180 2024-09-10T08:40:11.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.793+0000 7f851a352640 1 -- 172.21.15.103:0/749607324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85141dfca0 con 0x7f85140c8180 2024-09-10T08:40:11.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.794+0000 7f8510ff9640 1 -- 172.21.15.103:0/749607324 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f850001b070 con 0x7f85140c8180 2024-09-10T08:40:11.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.794+0000 7f851a352640 1 --2- 172.21.15.103:0/749607324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8514157450 0x7f851414ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:11.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.794+0000 7f851a352640 1 -- 172.21.15.103:0/749607324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8514154f20 con 0x7f8514157450 2024-09-10T08:40:11.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.795+0000 7f8510ff9640 1 --2- 172.21.15.103:0/749607324 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f84fc06beb0 0x7f84fc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:11.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.795+0000 7f8510ff9640 1 -- 172.21.15.103:0/749607324 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f850008a120 con 0x7f85140c8180 2024-09-10T08:40:11.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.795+0000 7f85188ef640 1 --2- 172.21.15.103:0/749607324 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f84fc06beb0 0x7f84fc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:11.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.796+0000 7f8513fff640 1 --2- 172.21.15.103:0/749607324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8514157450 0x7f851414ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:11.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.796+0000 7f8513fff640 1 -- 172.21.15.103:0/749607324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8514154d50 con 0x7f8514157450 2024-09-10T08:40:11.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.796+0000 7f85188ef640 1 --2- 172.21.15.103:0/749607324 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f84fc06beb0 0x7f84fc06e370 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f850c0012e0 tx=0x7f850c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:11.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.797+0000 7f8513fff640 1 --2- 172.21.15.103:0/749607324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8514157450 0x7f851414ced0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f85040090b0 tx=0x7f85040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:11.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.797+0000 7f8510ff9640 1 -- 172.21.15.103:0/749607324 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8504042070 con 0x7f8514157450 2024-09-10T08:40:11.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.797+0000 7f8510ff9640 1 -- 172.21.15.103:0/749607324 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8504009490 con 0x7f8514157450 2024-09-10T08:40:11.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.797+0000 7f8510ff9640 1 -- 172.21.15.103:0/749607324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8514157450 msgr2=0x7f851414ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:11.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.797+0000 7f8510ff9640 1 --2- 172.21.15.103:0/749607324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8514157450 0x7f851414ced0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f85040090b0 tx=0x7f85040046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.797+0000 7f8510ff9640 1 -- 172.21.15.103:0/749607324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8514157450 msgr2=0x7f851414ced0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:40:11.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.797+0000 7f8510ff9640 1 --2- 172.21.15.103:0/749607324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8514157450 0x7f851414ced0 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f85040090b0 tx=0x7f85040046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.808+0000 7f851a352640 1 --2- 172.21.15.103:0/749607324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85141efea0 0x7f851414d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:11.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.808+0000 7f851a352640 1 -- 172.21.15.103:0/749607324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f85140a9690 con 0x7f85141efea0 2024-09-10T08:40:11.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.809+0000 7f8513fff640 1 --2- 172.21.15.103:0/749607324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85141efea0 0x7f851414d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:11.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.809+0000 7f8513fff640 1 -- 172.21.15.103:0/749607324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f85140a93b0 con 0x7f85141efea0 2024-09-10T08:40:11.812 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:40:11.812 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:40:11.812 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:40:11.812 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:40:11.812 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 98, 2024-09-10T08:40:11.812 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 38275, 2024-09-10T08:40:11.812 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:40:11.813 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:40:11.813 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:40:11.813 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:40:11.813 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:11.813 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 12, 2024-09-10T08:40:11.813 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:40:11.813 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:40:11.813 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:40:11.813 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:11.813 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:11.813 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:11.813 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:11.814 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:11.814 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:11.814 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:11.814 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:11.814 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:11.814 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:11.814 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:11.814 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:11.814 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:40:11.814 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:40:11.814 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:11.814 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:11.814 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:11.815 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:11.815 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:11.815 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:11.815 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:11.815 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:11.815 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:11.815 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:11.815 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:11.815 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:11.815 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:11.815 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:40:11.815 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:40:11.815 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:40:11.816 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:40:11.816 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:40:11.816 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:40:11.816 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:40:11.816 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:40:11.816 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:40:11.816 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:40:11.816 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:40:11.816 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:40:11.816 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:40:11.817 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:40:11.817 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:40:11.817 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:40:11.817 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:40:11.817 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:11.817 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:11.817 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:11.817 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:11.817 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:11.817 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:11.817 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:11.818 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:11.818 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:11.818 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:11.818 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:11.818 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:11.818 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:40:11.818 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:11.818 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:40:11.818 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:11.818 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:40:11.818 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:40:11.818 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:11.818 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:11.819 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:11.819 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:11.819 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:40:11.819 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:11.819 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:11.819 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:11.819 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:11.819 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:40:11.819 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:11.819 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:11.819 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:11.819 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:11.819 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:40:11.819 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:40:11.819 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:11.820 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:11.820 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:11.820 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:11.820 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:11.820 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:40:11.820 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:40:11.820 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:11.820 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:11.820 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:11.820 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:11.820 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:40:11.820 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:11.821 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:11.821 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:11.821 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:11.821 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:40:11.821 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:11.821 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:11.821 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:11.821 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:11.821 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:40:11.821 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:40:11.821 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:11.821 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:11.822 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:11.822 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:11.822 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:11.822 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:40:11.822 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:40:11.822 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:11.822 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:11.822 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:11.822 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:11.822 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:40:11.822 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:11.822 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:11.823 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:11.823 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:11.823 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:40:11.823 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:11.823 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:11.823 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:11.823 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:11.823 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:40:11.823 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:40:11.823 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:11.823 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:11.823 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:11.824 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:11.824 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:11.824 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:11.824 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:40:11.824 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:40:11.824 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:11.824 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:11.824 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:11.824 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:40:11.824 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:11.824 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:11.824 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:40:11.824 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:11.825 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:11.825 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:11.825 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:40:11.825 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:11.825 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:11.825 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:11.825 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:40:11.825 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:40:11.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.810+0000 7f8513fff640 1 --2- 172.21.15.103:0/749607324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85141efea0 0x7f851414d410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f850402a0c0 tx=0x7f8504009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:11.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.810+0000 7f8510ff9640 1 -- 172.21.15.103:0/749607324 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8504037040 con 0x7f85141efea0 2024-09-10T08:40:11.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.811+0000 7f8510ff9640 1 -- 172.21.15.103:0/749607324 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4555 (secure 0 0 0) 0x7f8504047450 con 0x7f85141efea0 2024-09-10T08:40:11.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.811+0000 7f8510ff9640 1 -- 172.21.15.103:0/749607324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85141efea0 msgr2=0x7f851414d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:11.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.811+0000 7f8510ff9640 1 --2- 172.21.15.103:0/749607324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85141efea0 0x7f851414d410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f850402a0c0 tx=0x7f8504009240 comp rx=0 tx=0).stop 2024-09-10T08:40:11.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.811+0000 7f8510ff9640 1 -- 172.21.15.103:0/749607324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85141efea0 msgr2=0x7f851414d410 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:40:11.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.811+0000 7f8510ff9640 1 --2- 172.21.15.103:0/749607324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85141efea0 0x7f851414d410 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f850402a0c0 tx=0x7f8504009240 comp rx=0 tx=0).stop 2024-09-10T08:40:11.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.811+0000 7f851a352640 1 -- 172.21.15.103:0/749607324 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f84fc06beb0 msgr2=0x7f84fc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:11.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.811+0000 7f851a352640 1 --2- 172.21.15.103:0/749607324 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f84fc06beb0 0x7f84fc06e370 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f850c0012e0 tx=0x7f850c009040 comp rx=0 tx=0).stop 2024-09-10T08:40:11.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.811+0000 7f851a352640 1 -- 172.21.15.103:0/749607324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85140c8180 msgr2=0x7f85141ef960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:11.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.811+0000 7f851a352640 1 --2- 172.21.15.103:0/749607324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85140c8180 0x7f85141ef960 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f850000c730 tx=0x7f850000cbf0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.812+0000 7f85188ef640 1 -- 172.21.15.103:0/749607324 reap_dead start 2024-09-10T08:40:11.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.812+0000 7f85188ef640 1 -- 172.21.15.103:0/749607324 reap_dead start 2024-09-10T08:40:11.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.812+0000 7f851a352640 1 -- 172.21.15.103:0/749607324 shutdown_connections 2024-09-10T08:40:11.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.812+0000 7f851a352640 1 -- 172.21.15.103:0/749607324 >> 172.21.15.103:0/749607324 conn(0x7f85140c5660 msgr2=0x7f85140a8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:11.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.812+0000 7f851a352640 1 -- 172.21.15.103:0/749607324 shutdown_connections 2024-09-10T08:40:11.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:11.812+0000 7f851a352640 1 -- 172.21.15.103:0/749607324 wait complete. 2024-09-10T08:40:11.830 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:40:11.830 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:40:11.830 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:40:12.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.002+0000 7f308c2ac640 1 Processor -- start 2024-09-10T08:40:12.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.003+0000 7f308c2ac640 1 -- start start 2024-09-10T08:40:12.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.004+0000 7f308c2ac640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f30840a6c10 0x7f30840c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.004+0000 7f308c2ac640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f30840c6010 0x7f308406dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.004+0000 7f308c2ac640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30840c5940 0x7f308406dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.004+0000 7f308c2ac640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f308415a970 con 0x7f30840a6c10 2024-09-10T08:40:12.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.004+0000 7f308c2ac640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f308415ac50 con 0x7f30840c6010 2024-09-10T08:40:12.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.004+0000 7f308c2ac640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f308415af30 con 0x7f30840c5940 2024-09-10T08:40:12.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.004+0000 7f308a048640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f30840a6c10 0x7f30840c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:12.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.004+0000 7f308a048640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f30840a6c10 0x7f30840c2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56784/0 (socket says 172.21.15.103:56784) 2024-09-10T08:40:12.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.004+0000 7f308a048640 1 -- 172.21.15.103:0/3089558291 learned_addr learned my addr 172.21.15.103:0/3089558291 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:12.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.004+0000 7f308a849640 1 --2- 172.21.15.103:0/3089558291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30840c5940 0x7f308406dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:12.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.005+0000 7f308a048640 1 -- 172.21.15.103:0/3089558291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30840c5940 msgr2=0x7f308406dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:12.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.005+0000 7f308a048640 1 --2- 172.21.15.103:0/3089558291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30840c5940 0x7f308406dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.005+0000 7f308a048640 1 -- 172.21.15.103:0/3089558291 >> v2:172.21.15.154:3300/0 conn(0x7f30840c6010 msgr2=0x7f308406dab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:40:12.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.005+0000 7f308a048640 1 --2- 172.21.15.103:0/3089558291 >> v2:172.21.15.154:3300/0 conn(0x7f30840c6010 0x7f308406dab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.005+0000 7f308a048640 1 -- 172.21.15.103:0/3089558291 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f308415b210 con 0x7f30840a6c10 2024-09-10T08:40:12.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.006+0000 7f308a048640 1 --2- 172.21.15.103:0/3089558291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30840a6c10 0x7f30840c2440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f30840709e0 tx=0x7f308002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499d68d2542514cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:12.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.006+0000 7f3089046640 1 -- 172.21.15.103:0/3089558291 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3080037070 con 0x7f30840a6c10 2024-09-10T08:40:12.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.006+0000 7f3089046640 1 -- 172.21.15.103:0/3089558291 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3080032440 con 0x7f30840a6c10 2024-09-10T08:40:12.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.006+0000 7f3089046640 1 -- 172.21.15.103:0/3089558291 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3080032850 con 0x7f30840a6c10 2024-09-10T08:40:12.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.007+0000 7f308c2ac640 1 -- 172.21.15.103:0/3089558291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30840a6c10 msgr2=0x7f30840c2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:12.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.007+0000 7f308c2ac640 1 --2- 172.21.15.103:0/3089558291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30840a6c10 0x7f30840c2440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f30840709e0 tx=0x7f308002a180 comp rx=0 tx=0).stop 2024-09-10T08:40:12.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.008+0000 7f308c2ac640 1 -- 172.21.15.103:0/3089558291 shutdown_connections 2024-09-10T08:40:12.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.008+0000 7f308c2ac640 1 --2- 172.21.15.103:0/3089558291 >> v2:172.21.15.154:3300/0 conn(0x7f30840c6010 0x7f308406dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.008+0000 7f308c2ac640 1 --2- 172.21.15.103:0/3089558291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30840c5940 0x7f308406dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.008+0000 7f308c2ac640 1 --2- 172.21.15.103:0/3089558291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30840a6c10 0x7f30840c2440 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.008+0000 7f308c2ac640 1 -- 172.21.15.103:0/3089558291 >> 172.21.15.103:0/3089558291 conn(0x7f30840c7a40 msgr2=0x7f30840c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:12.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.009+0000 7f308c2ac640 1 -- 172.21.15.103:0/3089558291 shutdown_connections 2024-09-10T08:40:12.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.009+0000 7f308c2ac640 1 -- 172.21.15.103:0/3089558291 wait complete. 2024-09-10T08:40:12.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.011+0000 7f308c2ac640 1 Processor -- start 2024-09-10T08:40:12.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.012+0000 7f308c2ac640 1 -- start start 2024-09-10T08:40:12.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.013+0000 7f308c2ac640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30840a6c10 0x7f3084154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.013+0000 7f308c2ac640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30840c5940 0x7f3084156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.013+0000 7f308c2ac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30840c6010 0x7f30841566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.013+0000 7f308c2ac640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f30840a7520 con 0x7f30840a6c10 2024-09-10T08:40:12.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.013+0000 7f308c2ac640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30840a73a0 con 0x7f30840c6010 2024-09-10T08:40:12.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.013+0000 7f308c2ac640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f308406e530 con 0x7f30840c5940 2024-09-10T08:40:12.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.013+0000 7f308a048640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30840a6c10 0x7f3084154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:12.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.014+0000 7f308a048640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30840a6c10 0x7f3084154f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56788/0 (socket says 172.21.15.103:56788) 2024-09-10T08:40:12.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.014+0000 7f308a048640 1 -- 172.21.15.103:0/2701093982 learned_addr learned my addr 172.21.15.103:0/2701093982 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:12.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.014+0000 7f3089847640 1 --2- 172.21.15.103:0/2701093982 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30840c5940 0x7f3084156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:12.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.014+0000 7f308a849640 1 --2- 172.21.15.103:0/2701093982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30840c6010 0x7f30841566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:12.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.014+0000 7f308a048640 1 -- 172.21.15.103:0/2701093982 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30840c5940 msgr2=0x7f3084156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:12.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.014+0000 7f308a048640 1 --2- 172.21.15.103:0/2701093982 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30840c5940 0x7f3084156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.014+0000 7f308a048640 1 -- 172.21.15.103:0/2701093982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30840c6010 msgr2=0x7f30841566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:12.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.014+0000 7f308a048640 1 --2- 172.21.15.103:0/2701093982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30840c6010 0x7f30841566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.014+0000 7f308a048640 1 -- 172.21.15.103:0/2701093982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f308415c6f0 con 0x7f30840a6c10 2024-09-10T08:40:12.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.014+0000 7f308a849640 1 --2- 172.21.15.103:0/2701093982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30840c6010 0x7f30841566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:40:12.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.014+0000 7f308a048640 1 --2- 172.21.15.103:0/2701093982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30840a6c10 0x7f3084154f50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3080009960 tx=0x7f30800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:12.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.015+0000 7f307affd640 1 -- 172.21.15.103:0/2701093982 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3080037040 con 0x7f30840a6c10 2024-09-10T08:40:12.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.015+0000 7f307affd640 1 -- 172.21.15.103:0/2701093982 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3080042070 con 0x7f30840a6c10 2024-09-10T08:40:12.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.016+0000 7f308c2ac640 1 -- 172.21.15.103:0/2701093982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3084154050 con 0x7f30840a6c10 2024-09-10T08:40:12.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.016+0000 7f308c2ac640 1 -- 172.21.15.103:0/2701093982 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30840ad470 con 0x7f30840a6c10 2024-09-10T08:40:12.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.018+0000 7f308c2ac640 1 --2- 172.21.15.103:0/2701093982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3084155490 0x7f30841f3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.018+0000 7f308c2ac640 1 -- 172.21.15.103:0/2701093982 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3084156c10 con 0x7f3084155490 2024-09-10T08:40:12.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.018+0000 7f3089847640 1 --2- 172.21.15.103:0/2701093982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3084155490 0x7f30841f3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:12.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.020+0000 7f307affd640 1 -- 172.21.15.103:0/2701093982 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3080030860 con 0x7f30840a6c10 2024-09-10T08:40:12.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.020+0000 7f307affd640 1 -- 172.21.15.103:0/2701093982 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3080030a80 con 0x7f30840a6c10 2024-09-10T08:40:12.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.020+0000 7f3089847640 1 -- 172.21.15.103:0/2701093982 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f30840c2440 con 0x7f3084155490 2024-09-10T08:40:12.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.020+0000 7f3089847640 1 --2- 172.21.15.103:0/2701093982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3084155490 0x7f30841f3610 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3084154670 tx=0x7f307400ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:12.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.021+0000 7f307affd640 1 --2- 172.21.15.103:0/2701093982 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f306806bf60 0x7f306806e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.023+0000 7f307affd640 1 -- 172.21.15.103:0/2701093982 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f30800ab980 con 0x7f30840a6c10 2024-09-10T08:40:12.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.024+0000 7f307affd640 1 -- 172.21.15.103:0/2701093982 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074017070 con 0x7f3084155490 2024-09-10T08:40:12.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.024+0000 7f307affd640 1 -- 172.21.15.103:0/2701093982 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f307400c740 con 0x7f3084155490 2024-09-10T08:40:12.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.024+0000 7f307affd640 1 -- 172.21.15.103:0/2701093982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3084155490 msgr2=0x7f30841f3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:12.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.024+0000 7f307affd640 1 --2- 172.21.15.103:0/2701093982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3084155490 0x7f30841f3610 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3084154670 tx=0x7f307400ec00 comp rx=0 tx=0).stop 2024-09-10T08:40:12.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.024+0000 7f307affd640 1 -- 172.21.15.103:0/2701093982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3084155490 msgr2=0x7f30841f3610 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:40:12.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.024+0000 7f307affd640 1 --2- 172.21.15.103:0/2701093982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3084155490 0x7f30841f3610 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.024+0000 7f308a849640 1 --2- 172.21.15.103:0/2701093982 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f306806bf60 0x7f306806e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:12.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.031+0000 7f308a849640 1 --2- 172.21.15.103:0/2701093982 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f306806bf60 0x7f306806e420 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f307c0074c0 tx=0x7f307c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:12.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.042+0000 7f308c2ac640 1 --2- 172.21.15.103:0/2701093982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30840ad920 0x7f30841f3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.042+0000 7f308c2ac640 1 -- 172.21.15.103:0/2701093982 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30840acdb0 con 0x7f30840ad920 2024-09-10T08:40:12.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.042+0000 7f3089847640 1 --2- 172.21.15.103:0/2701093982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30840ad920 0x7f30841f3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:12.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.043+0000 7f3089847640 1 -- 172.21.15.103:0/2701093982 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3084155ab0 con 0x7f30840ad920 2024-09-10T08:40:12.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.044+0000 7f3089847640 1 --2- 172.21.15.103:0/2701093982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30840ad920 0x7f30841f3b50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3084154670 tx=0x7f30740046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.047+0000 7f307affd640 1 -- 172.21.15.103:0/2701093982 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074017040 con 0x7f30840ad920 2024-09-10T08:40:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.047+0000 7f307affd640 1 -- 172.21.15.103:0/2701093982 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f3074013df0 con 0x7f30840ad920 2024-09-10T08:40:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.047+0000 7f307affd640 1 -- 172.21.15.103:0/2701093982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30840ad920 msgr2=0x7f30841f3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.047+0000 7f307affd640 1 --2- 172.21.15.103:0/2701093982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30840ad920 0x7f30841f3b50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3084154670 tx=0x7f30740046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.047+0000 7f307affd640 1 -- 172.21.15.103:0/2701093982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30840ad920 msgr2=0x7f30841f3b50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:40:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.047+0000 7f307affd640 1 --2- 172.21.15.103:0/2701093982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30840ad920 0x7f30841f3b50 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3084154670 tx=0x7f30740046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.049 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:40:12.049 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:40:12.049 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:40:12.049 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:40:12.049 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 98, 2024-09-10T08:40:12.049 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 157071, 2024-09-10T08:40:12.050 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:40:12.050 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:40:12.050 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:40:12.050 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:40:12.050 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:12.050 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 13, 2024-09-10T08:40:12.050 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:40:12.050 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:40:12.050 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:40:12.050 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:12.050 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:12.050 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:12.050 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:12.051 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:12.051 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:12.051 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:12.051 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:12.051 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:12.051 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:12.051 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:12.051 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:12.051 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:40:12.051 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:40:12.051 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:12.051 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:12.051 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:12.051 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:12.052 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:12.052 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:12.052 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:12.052 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:12.052 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:12.052 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:12.052 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:12.052 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:12.052 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.052 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:40:12.052 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:40:12.052 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:40:12.052 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:40:12.053 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:40:12.053 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:40:12.053 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:40:12.053 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:40:12.053 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:40:12.053 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:40:12.053 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:40:12.053 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:40:12.053 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:40:12.053 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:40:12.053 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:40:12.053 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:40:12.053 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:40:12.054 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:12.054 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:12.054 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:12.054 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:12.054 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:12.054 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:12.054 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:12.054 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:12.054 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:12.054 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:12.054 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:12.054 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:12.054 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:40:12.054 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.055 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:40:12.055 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.055 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:40:12.055 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:40:12.055 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:12.055 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:12.055 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.055 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:12.055 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:40:12.055 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:12.055 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.055 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.055 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:12.055 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:40:12.056 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:12.056 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:12.056 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:12.056 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.056 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:40:12.056 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:40:12.056 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:12.056 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:12.056 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:12.056 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.056 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.056 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:40:12.056 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:40:12.056 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:12.057 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:12.057 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.057 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:12.057 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:40:12.057 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:12.057 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.060 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.060 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:12.061 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:40:12.061 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:12.061 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:12.061 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:12.061 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.061 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:40:12.061 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:40:12.061 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:12.061 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:12.061 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:12.061 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.061 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.061 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:40:12.061 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:40:12.062 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:12.062 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:12.062 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.062 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:12.062 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:40:12.062 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:12.062 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.062 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.062 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:12.062 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:40:12.062 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:12.062 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:12.062 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:12.062 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.063 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:40:12.063 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:40:12.063 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:12.063 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:12.063 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:12.063 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:12.063 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:12.063 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.063 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:40:12.063 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:40:12.063 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.063 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:12.063 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:12.063 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:40:12.064 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:12.064 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:12.064 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:40:12.064 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.064 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:12.064 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:12.064 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:40:12.064 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:12.064 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:12.064 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:40:12.064 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.064 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:12.064 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:12.064 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:40:12.065 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:12.065 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:12.065 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:40:12.065 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.065 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:12.065 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:12.065 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:40:12.065 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:12.065 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:12.065 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:40:12.065 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.065 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:12.065 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:12.066 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:40:12.066 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:12.066 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:12.066 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.066 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:40:12.066 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:40:12.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.050+0000 7f308c2ac640 1 -- 172.21.15.103:0/2701093982 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f306806bf60 msgr2=0x7f306806e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:12.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.050+0000 7f308c2ac640 1 --2- 172.21.15.103:0/2701093982 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f306806bf60 0x7f306806e420 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f307c0074c0 tx=0x7f307c00b040 comp rx=0 tx=0).stop 2024-09-10T08:40:12.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.050+0000 7f308c2ac640 1 -- 172.21.15.103:0/2701093982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30840a6c10 msgr2=0x7f3084154f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:12.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.050+0000 7f308c2ac640 1 --2- 172.21.15.103:0/2701093982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30840a6c10 0x7f3084154f50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3080009960 tx=0x7f30800046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.050+0000 7f308a849640 1 -- 172.21.15.103:0/2701093982 reap_dead start 2024-09-10T08:40:12.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.050+0000 7f308c2ac640 1 -- 172.21.15.103:0/2701093982 shutdown_connections 2024-09-10T08:40:12.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.050+0000 7f308c2ac640 1 --2- 172.21.15.103:0/2701093982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30840a6c10 0x7f3084154f50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.050+0000 7f308c2ac640 1 -- 172.21.15.103:0/2701093982 >> 172.21.15.103:0/2701093982 conn(0x7f30840c7a40 msgr2=0x7f30840c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:12.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.050+0000 7f308c2ac640 1 -- 172.21.15.103:0/2701093982 shutdown_connections 2024-09-10T08:40:12.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.050+0000 7f308c2ac640 1 -- 172.21.15.103:0/2701093982 wait complete. 2024-09-10T08:40:12.074 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:40:12.074 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:40:12.074 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:40:12.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.244+0000 7f60f316f640 1 Processor -- start 2024-09-10T08:40:12.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.244+0000 7f60f316f640 1 -- start start 2024-09-10T08:40:12.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.246+0000 7f60f316f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f60ec072ec0 0x7f60ec153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.246+0000 7f60f316f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60ec0afc60 0x7f60ec151380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.246+0000 7f60f316f640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60ec06efa0 con 0x7f60ec0c4ac0 2024-09-10T08:40:12.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.246+0000 7f60f316f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f60ec06f280 con 0x7f60ec072ec0 2024-09-10T08:40:12.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.246+0000 7f60f316f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f60ec06f560 con 0x7f60ec0afc60 2024-09-10T08:40:12.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.246+0000 7f60f0f0b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f60ec072ec0 0x7f60ec153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:12.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.246+0000 7f60ebfff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f60ec0c4ac0 0x7f60ec070040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:54000/0 (socket says 172.21.15.103:54000) 2024-09-10T08:40:12.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.246+0000 7f60ebfff640 1 -- 172.21.15.103:0/2930395506 learned_addr learned my addr 172.21.15.103:0/2930395506 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:40:12.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.246+0000 7f60f170c640 1 --2- 172.21.15.103:0/2930395506 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60ec0afc60 0x7f60ec151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.247+0000 7f60eb7fe640 1 -- 172.21.15.103:0/2930395506 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3855266382 0 0) 0x7f60ec06efa0 con 0x7f60ec0c4ac0 2024-09-10T08:40:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.247+0000 7f60eb7fe640 1 -- 172.21.15.103:0/2930395506 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60d4003520 con 0x7f60ec0c4ac0 2024-09-10T08:40:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.247+0000 7f60f170c640 1 -- 172.21.15.103:0/2930395506 >> v2:172.21.15.154:3300/0 conn(0x7f60ec072ec0 msgr2=0x7f60ec153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.247+0000 7f60f170c640 1 --2- 172.21.15.103:0/2930395506 >> v2:172.21.15.154:3300/0 conn(0x7f60ec072ec0 0x7f60ec153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.247+0000 7f60f170c640 1 -- 172.21.15.103:0/2930395506 >> v1:172.21.15.103:6789/0 conn(0x7f60ec0c4ac0 legacy=0x7f60ec070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:12.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.247+0000 7f60f170c640 1 -- 172.21.15.103:0/2930395506 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ec06f840 con 0x7f60ec0afc60 2024-09-10T08:40:12.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.248+0000 7f60f170c640 1 --2- 172.21.15.103:0/2930395506 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60ec0afc60 0x7f60ec151380 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0097a0 tx=0x7f60dc02a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cddf0d72a65ede42 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:12.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.249+0000 7f60eb7fe640 1 -- 172.21.15.103:0/2930395506 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc037070 con 0x7f60ec0afc60 2024-09-10T08:40:12.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.249+0000 7f60eb7fe640 1 -- 172.21.15.103:0/2930395506 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60dc02adb0 con 0x7f60ec0afc60 2024-09-10T08:40:12.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.249+0000 7f60eb7fe640 1 -- 172.21.15.103:0/2930395506 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc032660 con 0x7f60ec0afc60 2024-09-10T08:40:12.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.250+0000 7f60f316f640 1 -- 172.21.15.103:0/2930395506 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60ec0afc60 msgr2=0x7f60ec151380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:12.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.250+0000 7f60f316f640 1 --2- 172.21.15.103:0/2930395506 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60ec0afc60 0x7f60ec151380 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0097a0 tx=0x7f60dc02a060 comp rx=0 tx=0).stop 2024-09-10T08:40:12.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.250+0000 7f60f316f640 1 -- 172.21.15.103:0/2930395506 shutdown_connections 2024-09-10T08:40:12.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.250+0000 7f60f316f640 1 --2- 172.21.15.103:0/2930395506 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60ec0afc60 0x7f60ec151380 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.251+0000 7f60f316f640 1 --2- 172.21.15.103:0/2930395506 >> v2:172.21.15.154:3300/0 conn(0x7f60ec072ec0 0x7f60ec153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.251+0000 7f60f316f640 1 -- 172.21.15.103:0/2930395506 >> 172.21.15.103:0/2930395506 conn(0x7f60ec0c9d80 msgr2=0x7f60ec0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:12.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.251+0000 7f60f316f640 1 -- 172.21.15.103:0/2930395506 shutdown_connections 2024-09-10T08:40:12.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.252+0000 7f60f316f640 1 -- 172.21.15.103:0/2930395506 wait complete. 2024-09-10T08:40:12.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.253+0000 7f60f316f640 1 Processor -- start 2024-09-10T08:40:12.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.253+0000 7f60f316f640 1 -- start start 2024-09-10T08:40:12.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.254+0000 7f60f316f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60ec072ec0 0x7f60ec14f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.255+0000 7f60f316f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60ec0afc60 0x7f60ec06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.255+0000 7f60f316f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60ec0c4ac0 0x7f60ec1eb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.255+0000 7f60f316f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec070750 con 0x7f60ec072ec0 2024-09-10T08:40:12.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.255+0000 7f60f316f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec0c47f0 con 0x7f60ec0afc60 2024-09-10T08:40:12.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.255+0000 7f60f316f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f60ec0708d0 con 0x7f60ec0c4ac0 2024-09-10T08:40:12.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.255+0000 7f60f170c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60ec0c4ac0 0x7f60ec1eb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:12.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.255+0000 7f60f0f0b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60ec072ec0 0x7f60ec14f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:12.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.255+0000 7f60f0f0b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60ec072ec0 0x7f60ec14f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56798/0 (socket says 172.21.15.103:56798) 2024-09-10T08:40:12.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.255+0000 7f60f0f0b640 1 -- 172.21.15.103:0/4206484056 learned_addr learned my addr 172.21.15.103:0/4206484056 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:12.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.256+0000 7f60f0f0b640 1 -- 172.21.15.103:0/4206484056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60ec0c4ac0 msgr2=0x7f60ec1eb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:12.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.256+0000 7f60f0f0b640 1 --2- 172.21.15.103:0/4206484056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60ec0c4ac0 0x7f60ec1eb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.256+0000 7f60f0f0b640 1 -- 172.21.15.103:0/4206484056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60ec0afc60 msgr2=0x7f60ec06e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:12.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.256+0000 7f60f0f0b640 1 --2- 172.21.15.103:0/4206484056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60ec0afc60 0x7f60ec06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.256+0000 7f60f0f0b640 1 -- 172.21.15.103:0/4206484056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ec14d860 con 0x7f60ec072ec0 2024-09-10T08:40:12.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.256+0000 7f60f0f0b640 1 --2- 172.21.15.103:0/4206484056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60ec072ec0 0x7f60ec14f3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f60e400efc0 tx=0x7f60e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:12.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.257+0000 7f60e97fa640 1 -- 172.21.15.103:0/4206484056 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e4018020 con 0x7f60ec072ec0 2024-09-10T08:40:12.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.257+0000 7f60f316f640 1 -- 172.21.15.103:0/4206484056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60ec1506f0 con 0x7f60ec072ec0 2024-09-10T08:40:12.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.257+0000 7f60f316f640 1 -- 172.21.15.103:0/4206484056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60ec06e620 con 0x7f60ec072ec0 2024-09-10T08:40:12.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.258+0000 7f60e97fa640 1 -- 172.21.15.103:0/4206484056 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60e4014480 con 0x7f60ec072ec0 2024-09-10T08:40:12.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.258+0000 7f60e97fa640 1 -- 172.21.15.103:0/4206484056 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e4014850 con 0x7f60ec072ec0 2024-09-10T08:40:12.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.259+0000 7f60f316f640 1 --2- 172.21.15.103:0/4206484056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60cc002a70 0x7f60cc004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.259+0000 7f60f316f640 1 -- 172.21.15.103:0/4206484056 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f60cc007ec0 con 0x7f60cc002a70 2024-09-10T08:40:12.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.260+0000 7f60ebfff640 1 --2- 172.21.15.103:0/4206484056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60cc002a70 0x7f60cc004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:12.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.260+0000 7f60ebfff640 1 -- 172.21.15.103:0/4206484056 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f60cc0080c0 con 0x7f60cc002a70 2024-09-10T08:40:12.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.261+0000 7f60ebfff640 1 --2- 172.21.15.103:0/4206484056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60cc002a70 0x7f60cc004f30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f60ec06f010 tx=0x7f60e0001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:12.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.261+0000 7f60e97fa640 1 -- 172.21.15.103:0/4206484056 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e0005ce0 con 0x7f60cc002a70 2024-09-10T08:40:12.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.262+0000 7f60e97fa640 1 -- 172.21.15.103:0/4206484056 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f60e00070d0 con 0x7f60cc002a70 2024-09-10T08:40:12.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.262+0000 7f60e97fa640 1 -- 172.21.15.103:0/4206484056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60cc002a70 msgr2=0x7f60cc004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:12.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.262+0000 7f60e97fa640 1 --2- 172.21.15.103:0/4206484056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60cc002a70 0x7f60cc004f30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f60ec06f010 tx=0x7f60e0001e70 comp rx=0 tx=0).stop 2024-09-10T08:40:12.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.262+0000 7f60e97fa640 1 -- 172.21.15.103:0/4206484056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60cc002a70 msgr2=0x7f60cc004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:40:12.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.262+0000 7f60e97fa640 1 --2- 172.21.15.103:0/4206484056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60cc002a70 0x7f60cc004f30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.262+0000 7f60e97fa640 1 -- 172.21.15.103:0/4206484056 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f60e4005d10 con 0x7f60ec072ec0 2024-09-10T08:40:12.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.264+0000 7f60e97fa640 1 --2- 172.21.15.103:0/4206484056 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f60d806b8a0 0x7f60d806dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.264+0000 7f60e97fa640 1 -- 172.21.15.103:0/4206484056 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f60e408bf80 con 0x7f60ec072ec0 2024-09-10T08:40:12.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.265+0000 7f60ebfff640 1 --2- 172.21.15.103:0/4206484056 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f60d806b8a0 0x7f60d806dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:12.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.266+0000 7f60ebfff640 1 --2- 172.21.15.103:0/4206484056 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f60d806b8a0 0x7f60d806dd60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f60cc008090 tx=0x7f60e000a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:12.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.276+0000 7f60f316f640 1 --2- 172.21.15.103:0/4206484056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60cc006ee0 0x7f60cc007350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.278+0000 7f60f316f640 1 -- 172.21.15.103:0/4206484056 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f60cc00a4a0 con 0x7f60cc006ee0 2024-09-10T08:40:12.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.281+0000 7f60f170c640 1 --2- 172.21.15.103:0/4206484056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60cc006ee0 0x7f60cc007350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:12.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.282+0000 7f60f170c640 1 -- 172.21.15.103:0/4206484056 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f60cc007890 con 0x7f60cc006ee0 2024-09-10T08:40:12.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.282+0000 7f60f170c640 1 --2- 172.21.15.103:0/4206484056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60cc006ee0 0x7f60cc007350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f60ec074760 tx=0x7f60dc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:12.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.283+0000 7f60e97fa640 1 -- 172.21.15.103:0/4206484056 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc037040 con 0x7f60cc006ee0 2024-09-10T08:40:12.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.284+0000 7f60e97fa640 1 -- 172.21.15.103:0/4206484056 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f60dc0093c0 con 0x7f60cc006ee0 2024-09-10T08:40:12.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.284+0000 7f60e97fa640 1 -- 172.21.15.103:0/4206484056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60cc006ee0 msgr2=0x7f60cc007350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:12.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.284+0000 7f60e97fa640 1 --2- 172.21.15.103:0/4206484056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60cc006ee0 0x7f60cc007350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f60ec074760 tx=0x7f60dc0046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.284+0000 7f60e97fa640 1 -- 172.21.15.103:0/4206484056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60cc006ee0 msgr2=0x7f60cc007350 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:40:12.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.284+0000 7f60e97fa640 1 --2- 172.21.15.103:0/4206484056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60cc006ee0 0x7f60cc007350 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f60ec074760 tx=0x7f60dc0046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.286 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:40:12.286 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:40:12.287 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:40:12.287 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:40:12.287 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 98, 2024-09-10T08:40:12.287 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 105117, 2024-09-10T08:40:12.287 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:40:12.287 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:40:12.287 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:40:12.287 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:40:12.287 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:12.287 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 13, 2024-09-10T08:40:12.287 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:40:12.287 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:40:12.288 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:40:12.288 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:12.288 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:12.288 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:12.288 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:12.288 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:12.288 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:12.288 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:12.288 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:12.288 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:12.288 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:12.288 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:12.288 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:12.288 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:40:12.289 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:40:12.289 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:12.289 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:12.289 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:12.289 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:12.289 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:12.289 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:12.289 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:12.289 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:12.289 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:12.289 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:12.289 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:12.290 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:12.290 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.290 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:40:12.290 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:40:12.290 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:40:12.290 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:40:12.290 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:40:12.290 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:40:12.290 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:40:12.290 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:40:12.290 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:40:12.290 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:40:12.290 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:40:12.290 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:40:12.291 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:40:12.291 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:40:12.291 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:40:12.291 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:40:12.291 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:40:12.291 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:12.291 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:12.291 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:12.291 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:12.291 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:12.291 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:12.291 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:12.291 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:12.292 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:12.292 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:12.292 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:12.292 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:12.292 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:40:12.292 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.292 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:40:12.292 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.292 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:40:12.292 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:40:12.292 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:12.292 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:12.292 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.293 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:12.293 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:40:12.293 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:12.293 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.293 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.293 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:12.293 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:40:12.293 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:12.293 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:12.293 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:12.293 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.293 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:40:12.293 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:40:12.294 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:12.294 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:12.294 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:12.294 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.294 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.294 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:40:12.294 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:40:12.294 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:12.294 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:12.294 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.294 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:12.294 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:40:12.294 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:12.295 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.295 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.295 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:12.295 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:40:12.295 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:12.295 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:12.295 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:12.295 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.295 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:40:12.295 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:40:12.295 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:12.295 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:12.295 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:12.296 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.296 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.296 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:40:12.296 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:40:12.296 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:12.296 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:12.296 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.296 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:12.296 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:40:12.296 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:12.296 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.297 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.297 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:12.297 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:40:12.297 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:12.297 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:12.297 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:12.297 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.297 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:40:12.298 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:40:12.298 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:12.298 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:12.298 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:12.298 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:12.298 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:12.298 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.298 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:40:12.298 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:40:12.298 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.298 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:12.298 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:12.298 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:40:12.299 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:12.299 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:12.299 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:40:12.299 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.299 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:12.299 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:12.299 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:40:12.299 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:12.299 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:12.299 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:40:12.299 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.299 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:12.299 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:12.299 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:40:12.300 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:12.300 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:12.300 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:40:12.300 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.300 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:12.300 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:12.300 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:40:12.300 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:12.300 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:12.300 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:40:12.300 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:12.300 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:12.300 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:12.300 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:40:12.301 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:12.301 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:12.301 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:12.301 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:40:12.301 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:40:12.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.285+0000 7f60f316f640 1 -- 172.21.15.103:0/4206484056 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f60d806b8a0 msgr2=0x7f60d806dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:12.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.286+0000 7f60f316f640 1 --2- 172.21.15.103:0/4206484056 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f60d806b8a0 0x7f60d806dd60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f60cc008090 tx=0x7f60e000a000 comp rx=0 tx=0).stop 2024-09-10T08:40:12.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.286+0000 7f60f170c640 1 -- 172.21.15.103:0/4206484056 reap_dead start 2024-09-10T08:40:12.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.286+0000 7f60f316f640 1 -- 172.21.15.103:0/4206484056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60ec072ec0 msgr2=0x7f60ec14f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:12.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.286+0000 7f60f316f640 1 --2- 172.21.15.103:0/4206484056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60ec072ec0 0x7f60ec14f3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f60e400efc0 tx=0x7f60e400c490 comp rx=0 tx=0).stop 2024-09-10T08:40:12.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.287+0000 7f60f316f640 1 -- 172.21.15.103:0/4206484056 shutdown_connections 2024-09-10T08:40:12.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.287+0000 7f60f316f640 1 --2- 172.21.15.103:0/4206484056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60ec072ec0 0x7f60ec14f3f0 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f60e400efc0 tx=0x7f60e400c490 comp rx=0 tx=0).stop 2024-09-10T08:40:12.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.287+0000 7f60f316f640 1 -- 172.21.15.103:0/4206484056 >> 172.21.15.103:0/4206484056 conn(0x7f60ec0c9d80 msgr2=0x7f60ec152250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:12.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.288+0000 7f60f316f640 1 -- 172.21.15.103:0/4206484056 shutdown_connections 2024-09-10T08:40:12.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.289+0000 7f60f316f640 1 -- 172.21.15.103:0/4206484056 wait complete. 2024-09-10T08:40:12.309 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:40:12.309 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-09-10T08:40:12.309 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-10T08:40:12.309 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-10T08:40:12.309 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-10T08:40:12.310 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T08:40:12.310 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:40:12.327 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T08:40:12.328 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-10T08:40:12.328 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:40:12.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.495+0000 7f94e50af640 1 Processor -- start 2024-09-10T08:40:12.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.495+0000 7f94e50af640 1 -- start start 2024-09-10T08:40:12.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.496+0000 7f94e50af640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e0151780 0x7f94e0155560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.496+0000 7f94e50af640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f94e0154ac0 0x7f94e00708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.496+0000 7f94e50af640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94e0154ff0 con 0x7f94e00703b0 2024-09-10T08:40:12.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.496+0000 7f94e50af640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f94e006f5f0 con 0x7f94e0154ac0 2024-09-10T08:40:12.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.496+0000 7f94e50af640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f94e006f8d0 con 0x7f94e0151780 2024-09-10T08:40:12.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.497+0000 7f94df59e640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f94e00703b0 legacy=0x7f94e0157660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:40:12.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.497+0000 7f94d659c640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7f94e0154ac0 msgr2=0x7f94e00708a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:40:12.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.497+0000 7f94d659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f94e0154ac0 0x7f94e00708a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:40:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.497+0000 7f94ded9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e0151780 0x7f94e0155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.497+0000 7f94ded9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e0151780 0x7f94e0155560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:38192/0 (socket says 172.21.15.103:38192) 2024-09-10T08:40:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.497+0000 7f94ded9d640 1 -- 172.21.15.103:0/1856988060 learned_addr learned my addr 172.21.15.103:0/1856988060 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.498+0000 7f94ded9d640 1 -- 172.21.15.103:0/1856988060 >> v2:172.21.15.154:3300/0 conn(0x7f94e0154ac0 msgr2=0x7f94e00708a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:40:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.498+0000 7f94ded9d640 1 --2- 172.21.15.103:0/1856988060 >> v2:172.21.15.154:3300/0 conn(0x7f94e0154ac0 0x7f94e00708a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.498+0000 7f94ded9d640 1 -- 172.21.15.103:0/1856988060 >> v1:172.21.15.154:6789/0 conn(0x7f94e00703b0 legacy=0x7f94e0157660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:40:12.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.498+0000 7f94ded9d640 1 -- 172.21.15.103:0/1856988060 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e006fbb0 con 0x7f94e0151780 2024-09-10T08:40:12.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.499+0000 7f94ded9d640 1 --2- 172.21.15.103:0/1856988060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e0151780 0x7f94e0155560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009870 tx=0x7f94d002a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f60ab498999c9d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:12.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.500+0000 7f94de59c640 1 -- 172.21.15.103:0/1856988060 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d0037070 con 0x7f94e0151780 2024-09-10T08:40:12.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.500+0000 7f94de59c640 1 -- 172.21.15.103:0/1856988060 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d002ae20 con 0x7f94e0151780 2024-09-10T08:40:12.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.500+0000 7f94de59c640 1 -- 172.21.15.103:0/1856988060 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d0037070 con 0x7f94e0151780 2024-09-10T08:40:12.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.501+0000 7f94e50af640 1 -- 172.21.15.103:0/1856988060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e0151780 msgr2=0x7f94e0155560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:12.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.501+0000 7f94e50af640 1 --2- 172.21.15.103:0/1856988060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e0151780 0x7f94e0155560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009870 tx=0x7f94d002a110 comp rx=0 tx=0).stop 2024-09-10T08:40:12.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.501+0000 7f94e50af640 1 -- 172.21.15.103:0/1856988060 shutdown_connections 2024-09-10T08:40:12.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.501+0000 7f94e50af640 1 --2- 172.21.15.103:0/1856988060 >> v2:172.21.15.154:3300/0 conn(0x7f94e0154ac0 0x7f94e00708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.501+0000 7f94e50af640 1 --2- 172.21.15.103:0/1856988060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e0151780 0x7f94e0155560 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009870 tx=0x7f94d002a110 comp rx=0 tx=0).stop 2024-09-10T08:40:12.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.501+0000 7f94e50af640 1 -- 172.21.15.103:0/1856988060 >> 172.21.15.103:0/1856988060 conn(0x7f94e00c6980 msgr2=0x7f94e00c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:12.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.501+0000 7f94e50af640 1 -- 172.21.15.103:0/1856988060 shutdown_connections 2024-09-10T08:40:12.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.501+0000 7f94e50af640 1 -- 172.21.15.103:0/1856988060 wait complete. 2024-09-10T08:40:12.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.503+0000 7f94e50af640 1 Processor -- start 2024-09-10T08:40:12.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.504+0000 7f94e50af640 1 -- start start 2024-09-10T08:40:12.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.505+0000 7f94e50af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e00703b0 0x7f94e014d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.505+0000 7f94e50af640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94e0154ac0 0x7f94e014b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.505+0000 7f94e50af640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e014ebd0 0x7f94e014bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.506+0000 7f94d659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94e0154ac0 0x7f94e014b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:12.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.506+0000 7f94d659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94e0154ac0 0x7f94e014b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56814/0 (socket says 172.21.15.103:56814) 2024-09-10T08:40:12.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.506+0000 7f94d659c640 1 -- 172.21.15.103:0/2312777936 learned_addr learned my addr 172.21.15.103:0/2312777936 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:12.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.506+0000 7f94e50af640 1 -- 172.21.15.103:0/2312777936 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f94e00740b0 con 0x7f94e0154ac0 2024-09-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.506+0000 7f94e50af640 1 -- 172.21.15.103:0/2312777936 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f94e0073f30 con 0x7f94e00703b0 2024-09-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.506+0000 7f94e50af640 1 -- 172.21.15.103:0/2312777936 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f94e0155aa0 con 0x7f94e014ebd0 2024-09-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.506+0000 7f94d659c640 1 -- 172.21.15.103:0/2312777936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e014ebd0 msgr2=0x7f94e014bb40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.506+0000 7f94d659c640 1 --2- 172.21.15.103:0/2312777936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e014ebd0 0x7f94e014bb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.506+0000 7f94d659c640 1 -- 172.21.15.103:0/2312777936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e00703b0 msgr2=0x7f94e014d8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:40:12.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.506+0000 7f94d659c640 1 --2- 172.21.15.103:0/2312777936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e00703b0 0x7f94e014d8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.506+0000 7f94d659c640 1 -- 172.21.15.103:0/2312777936 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e006e320 con 0x7f94e0154ac0 2024-09-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.507+0000 7f94d659c640 1 --2- 172.21.15.103:0/2312777936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94e0154ac0 0x7f94e014b600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f94c800b710 tx=0x7f94c800bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.507+0000 7f94d7fff640 1 -- 172.21.15.103:0/2312777936 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c8003a90 con 0x7f94e0154ac0 2024-09-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.507+0000 7f94d7fff640 1 -- 172.21.15.103:0/2312777936 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94c8010070 con 0x7f94e0154ac0 2024-09-10T08:40:12.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.507+0000 7f94e50af640 1 -- 172.21.15.103:0/2312777936 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e006e600 con 0x7f94e0154ac0 2024-09-10T08:40:12.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.507+0000 7f94e50af640 1 -- 172.21.15.103:0/2312777936 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e014dde0 con 0x7f94e0154ac0 2024-09-10T08:40:12.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.508+0000 7f94d7fff640 1 -- 172.21.15.103:0/2312777936 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c8003e30 con 0x7f94e0154ac0 2024-09-10T08:40:12.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.509+0000 7f94e50af640 1 -- 172.21.15.103:0/2312777936 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b8005290 con 0x7f94e0154ac0 2024-09-10T08:40:12.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.515+0000 7f94d7fff640 1 -- 172.21.15.103:0/2312777936 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f94c8005070 con 0x7f94e0154ac0 2024-09-10T08:40:12.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.515+0000 7f94d7fff640 1 --2- 172.21.15.103:0/2312777936 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f94c406bf30 0x7f94c406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:12.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.516+0000 7f94d7fff640 1 -- 172.21.15.103:0/2312777936 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f94c808a890 con 0x7f94e0154ac0 2024-09-10T08:40:12.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.517+0000 7f94ded9d640 1 --2- 172.21.15.103:0/2312777936 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f94c406bf30 0x7f94c406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:12.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.518+0000 7f94ded9d640 1 --2- 172.21.15.103:0/2312777936 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f94c406bf30 0x7f94c406e3f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f94d0034000 tx=0x7f94d002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:12.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:12.518+0000 7f94d7fff640 1 -- 172.21.15.103:0/2312777936 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f94c8058f10 con 0x7f94e0154ac0 2024-09-10T08:40:13.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:13.009+0000 7f94e50af640 1 -- 172.21.15.103:0/2312777936 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f94b8005580 con 0x7f94e0154ac0 2024-09-10T08:40:13.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:13.009+0000 7f94d7fff640 1 -- 172.21.15.103:0/2312777936 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f94c8058810 con 0x7f94e0154ac0 2024-09-10T08:40:13.011 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":98,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:40:13.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:13.013+0000 7f94e50af640 1 -- 172.21.15.103:0/2312777936 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f94c406bf30 msgr2=0x7f94c406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:13.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:13.013+0000 7f94e50af640 1 --2- 172.21.15.103:0/2312777936 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f94c406bf30 0x7f94c406e3f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f94d0034000 tx=0x7f94d002e000 comp rx=0 tx=0).stop 2024-09-10T08:40:13.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:13.014+0000 7f94e50af640 1 -- 172.21.15.103:0/2312777936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94e0154ac0 msgr2=0x7f94e014b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:13.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:13.014+0000 7f94e50af640 1 --2- 172.21.15.103:0/2312777936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94e0154ac0 0x7f94e014b600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f94c800b710 tx=0x7f94c800bbd0 comp rx=0 tx=0).stop 2024-09-10T08:40:13.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:13.014+0000 7f94e50af640 1 -- 172.21.15.103:0/2312777936 shutdown_connections 2024-09-10T08:40:13.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:13.014+0000 7f94e50af640 1 --2- 172.21.15.103:0/2312777936 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f94c406bf30 0x7f94c406e3f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:13.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:13.014+0000 7f94e50af640 1 --2- 172.21.15.103:0/2312777936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94e014ebd0 0x7f94e014bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:13.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:13.014+0000 7f94e50af640 1 --2- 172.21.15.103:0/2312777936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94e0154ac0 0x7f94e014b600 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:13.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:13.014+0000 7f94e50af640 1 --2- 172.21.15.103:0/2312777936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94e00703b0 0x7f94e014d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:13.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:13.014+0000 7f94e50af640 1 -- 172.21.15.103:0/2312777936 >> 172.21.15.103:0/2312777936 conn(0x7f94e00c6980 msgr2=0x7f94e0155230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:13.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:13.014+0000 7f94e50af640 1 -- 172.21.15.103:0/2312777936 shutdown_connections 2024-09-10T08:40:13.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:13.014+0000 7f94e50af640 1 -- 172.21.15.103:0/2312777936 wait complete. 2024-09-10T08:40:16.039 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:40:16.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.220+0000 7f8bc6531640 1 Processor -- start 2024-09-10T08:40:16.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.220+0000 7f8bc6531640 1 -- start start 2024-09-10T08:40:16.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.221+0000 7f8bc6531640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bc00a6c10 0x7f8bc00c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:16.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.221+0000 7f8bc6531640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bc015a970 con 0x7f8bc00c5940 2024-09-10T08:40:16.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.221+0000 7f8bc6531640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bc015ac50 con 0x7f8bc00c6010 2024-09-10T08:40:16.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.221+0000 7f8bc6531640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc015af30 con 0x7f8bc00a6c10 2024-09-10T08:40:16.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.221+0000 7f8bbf7fe640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f8bc00c6010 legacy=0x7f8bc006dab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:40:16.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.222+0000 7f8bc4ace640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8bc00c5940 0x7f8bc006e1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:34950/0 (socket says 172.21.15.103:34950) 2024-09-10T08:40:16.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.222+0000 7f8bc4ace640 1 -- 172.21.15.103:0/1318948228 learned_addr learned my addr 172.21.15.103:0/1318948228 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:40:16.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.223+0000 7f8bbffff640 1 --2- 172.21.15.103:0/1318948228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bc00a6c10 0x7f8bc00c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:16.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.224+0000 7f8bbeffd640 1 -- 172.21.15.103:0/1318948228 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2105632947 0 0) 0x7f8bc015a970 con 0x7f8bc00c5940 2024-09-10T08:40:16.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.224+0000 7f8bbffff640 1 -- 172.21.15.103:0/1318948228 >> v1:172.21.15.154:6789/0 conn(0x7f8bc00c6010 legacy=0x7f8bc006dab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:40:16.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.224+0000 7f8bbffff640 1 -- 172.21.15.103:0/1318948228 >> v1:172.21.15.103:6789/0 conn(0x7f8bc00c5940 legacy=0x7f8bc006e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:16.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.224+0000 7f8bbffff640 1 -- 172.21.15.103:0/1318948228 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc015b210 con 0x7f8bc00a6c10 2024-09-10T08:40:16.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.226+0000 7f8bbffff640 1 --2- 172.21.15.103:0/1318948228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bc00a6c10 0x7f8bc00c2440 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009dc0 tx=0x7f8bb802a580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a245388c53f4b01b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:16.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.227+0000 7f8bbeffd640 1 -- 172.21.15.103:0/1318948228 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8007740 con 0x7f8bc00a6c10 2024-09-10T08:40:16.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.227+0000 7f8bbeffd640 1 -- 172.21.15.103:0/1318948228 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb80078e0 con 0x7f8bc00a6c10 2024-09-10T08:40:16.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.227+0000 7f8bbeffd640 1 -- 172.21.15.103:0/1318948228 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8007cf0 con 0x7f8bc00a6c10 2024-09-10T08:40:16.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.228+0000 7f8bc6531640 1 -- 172.21.15.103:0/1318948228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bc00a6c10 msgr2=0x7f8bc00c2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:16.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.228+0000 7f8bc6531640 1 --2- 172.21.15.103:0/1318948228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bc00a6c10 0x7f8bc00c2440 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009dc0 tx=0x7f8bb802a580 comp rx=0 tx=0).stop 2024-09-10T08:40:16.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.228+0000 7f8bc6531640 1 -- 172.21.15.103:0/1318948228 shutdown_connections 2024-09-10T08:40:16.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.228+0000 7f8bc6531640 1 --2- 172.21.15.103:0/1318948228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bc00a6c10 0x7f8bc00c2440 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:16.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.228+0000 7f8bc6531640 1 -- 172.21.15.103:0/1318948228 >> 172.21.15.103:0/1318948228 conn(0x7f8bc00c7a40 msgr2=0x7f8bc00c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:16.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.229+0000 7f8bc6531640 1 -- 172.21.15.103:0/1318948228 shutdown_connections 2024-09-10T08:40:16.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.229+0000 7f8bc6531640 1 -- 172.21.15.103:0/1318948228 wait complete. 2024-09-10T08:40:16.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.230+0000 7f8bc6531640 1 Processor -- start 2024-09-10T08:40:16.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.231+0000 7f8bc6531640 1 -- start start 2024-09-10T08:40:16.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.232+0000 7f8bc6531640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00a6c10 0x7f8bc0157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:16.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.232+0000 7f8bc6531640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bc00c5940 0x7f8bc00a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:16.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.232+0000 7f8bc6531640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bc00c6010 0x7f8bc00ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:16.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.232+0000 7f8bc6531640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc00a7520 con 0x7f8bc00a6c10 2024-09-10T08:40:16.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.232+0000 7f8bc6531640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc00a73a0 con 0x7f8bc00c6010 2024-09-10T08:40:16.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.232+0000 7f8bc6531640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc00c2980 con 0x7f8bc00c5940 2024-09-10T08:40:16.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.232+0000 7f8bbffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00a6c10 0x7f8bc0157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:16.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.232+0000 7f8bbffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00a6c10 0x7f8bc0157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57996/0 (socket says 172.21.15.103:57996) 2024-09-10T08:40:16.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.232+0000 7f8bbffff640 1 -- 172.21.15.103:0/4243557074 learned_addr learned my addr 172.21.15.103:0/4243557074 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:16.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.233+0000 7f8bc4ace640 1 -- 172.21.15.103:0/4243557074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bc00c6010 msgr2=0x7f8bc00ab8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:40:16.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.233+0000 7f8bc4ace640 1 --2- 172.21.15.103:0/4243557074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bc00c6010 0x7f8bc00ab8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:40:16.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.233+0000 7f8bbf7fe640 1 --2- 172.21.15.103:0/4243557074 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bc00c5940 0x7f8bc00a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:16.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.233+0000 7f8bbffff640 1 -- 172.21.15.103:0/4243557074 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bc00c5940 msgr2=0x7f8bc00a5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:16.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.233+0000 7f8bbffff640 1 --2- 172.21.15.103:0/4243557074 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bc00c5940 0x7f8bc00a5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:16.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.233+0000 7f8bbffff640 1 -- 172.21.15.103:0/4243557074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bc00c6010 msgr2=0x7f8bc00ab8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:40:16.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.233+0000 7f8bbffff640 1 --2- 172.21.15.103:0/4243557074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bc00c6010 0x7f8bc00ab8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:16.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.233+0000 7f8bbffff640 1 -- 172.21.15.103:0/4243557074 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc0157570 con 0x7f8bc00a6c10 2024-09-10T08:40:16.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.233+0000 7f8bbffff640 1 --2- 172.21.15.103:0/4243557074 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00a6c10 0x7f8bc0157030 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8000f80 tx=0x7f8bb8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:16.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.236+0000 7f8bbcff9640 1 -- 172.21.15.103:0/4243557074 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8040070 con 0x7f8bc00a6c10 2024-09-10T08:40:16.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.236+0000 7f8bbcff9640 1 -- 172.21.15.103:0/4243557074 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb8031c80 con 0x7f8bc00a6c10 2024-09-10T08:40:16.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.236+0000 7f8bbcff9640 1 -- 172.21.15.103:0/4243557074 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8045680 con 0x7f8bc00a6c10 2024-09-10T08:40:16.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.237+0000 7f8bc6531640 1 -- 172.21.15.103:0/4243557074 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc01f0b30 con 0x7f8bc00a6c10 2024-09-10T08:40:16.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.237+0000 7f8bc6531640 1 -- 172.21.15.103:0/4243557074 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc0157ed0 con 0x7f8bc00a6c10 2024-09-10T08:40:16.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.239+0000 7f8bbcff9640 1 -- 172.21.15.103:0/4243557074 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8bb8039040 con 0x7f8bc00a6c10 2024-09-10T08:40:16.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.240+0000 7f8bbcff9640 1 --2- 172.21.15.103:0/4243557074 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8bac06be30 0x7f8bac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:16.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.240+0000 7f8bbcff9640 1 -- 172.21.15.103:0/4243557074 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f8bb80ac200 con 0x7f8bc00a6c10 2024-09-10T08:40:16.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.241+0000 7f8bbf7fe640 1 --2- 172.21.15.103:0/4243557074 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8bac06be30 0x7f8bac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:16.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.242+0000 7f8bbf7fe640 1 --2- 172.21.15.103:0/4243557074 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8bac06be30 0x7f8bac06e2f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4006fd0 tx=0x7f8bb4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:16.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.243+0000 7f8bc6531640 1 -- 172.21.15.103:0/4243557074 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bc00c2440 con 0x7f8bc00a6c10 2024-09-10T08:40:16.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.252+0000 7f8bbcff9640 1 -- 172.21.15.103:0/4243557074 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8bb807a890 con 0x7f8bc00a6c10 2024-09-10T08:40:16.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.727+0000 7f8bc6531640 1 -- 172.21.15.103:0/4243557074 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8bc015db20 con 0x7f8bc00a6c10 2024-09-10T08:40:16.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.729+0000 7f8bbcff9640 1 -- 172.21.15.103:0/4243557074 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f8bb807a190 con 0x7f8bc00a6c10 2024-09-10T08:40:16.729 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":98,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:40:16.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.734+0000 7f8bc6531640 1 -- 172.21.15.103:0/4243557074 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8bac06be30 msgr2=0x7f8bac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:16.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.734+0000 7f8bc6531640 1 --2- 172.21.15.103:0/4243557074 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8bac06be30 0x7f8bac06e2f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4006fd0 tx=0x7f8bb4008040 comp rx=0 tx=0).stop 2024-09-10T08:40:16.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.734+0000 7f8bc6531640 1 -- 172.21.15.103:0/4243557074 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00a6c10 msgr2=0x7f8bc0157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:16.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.734+0000 7f8bc6531640 1 --2- 172.21.15.103:0/4243557074 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00a6c10 0x7f8bc0157030 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8000f80 tx=0x7f8bb8004a40 comp rx=0 tx=0).stop 2024-09-10T08:40:16.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.734+0000 7f8bc6531640 1 -- 172.21.15.103:0/4243557074 shutdown_connections 2024-09-10T08:40:16.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.735+0000 7f8bc6531640 1 --2- 172.21.15.103:0/4243557074 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8bac06be30 0x7f8bac06e2f0 secure :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4006fd0 tx=0x7f8bb4008040 comp rx=0 tx=0).stop 2024-09-10T08:40:16.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.735+0000 7f8bc6531640 1 --2- 172.21.15.103:0/4243557074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bc00c6010 0x7f8bc00ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:16.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.735+0000 7f8bc6531640 1 --2- 172.21.15.103:0/4243557074 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bc00c5940 0x7f8bc00a5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:16.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.735+0000 7f8bc6531640 1 --2- 172.21.15.103:0/4243557074 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bc00a6c10 0x7f8bc0157030 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:16.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.735+0000 7f8bc6531640 1 -- 172.21.15.103:0/4243557074 >> 172.21.15.103:0/4243557074 conn(0x7f8bc00c7a40 msgr2=0x7f8bc00c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:16.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.736+0000 7f8bc6531640 1 -- 172.21.15.103:0/4243557074 shutdown_connections 2024-09-10T08:40:16.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:16.736+0000 7f8bc6531640 1 -- 172.21.15.103:0/4243557074 wait complete. 2024-09-10T08:40:19.756 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:40:19.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.935+0000 7f42804d7640 1 Processor -- start 2024-09-10T08:40:19.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.936+0000 7f42804d7640 1 -- start start 2024-09-10T08:40:19.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.937+0000 7f42804d7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f427000af20 0x7f42700491b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:19.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.937+0000 7f42804d7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f42700465f0 0x7f42700d9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:19.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.937+0000 7f42804d7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4270007200 con 0x7f42700d6710 2024-09-10T08:40:19.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.937+0000 7f42804d7640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f427004a9b0 con 0x7f42700465f0 2024-09-10T08:40:19.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.937+0000 7f42804d7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f427004ac90 con 0x7f427000af20 2024-09-10T08:40:19.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.937+0000 7f427e273640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7f427000af20 msgr2=0x7f42700491b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:40:19.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.937+0000 7f427e273640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f427000af20 0x7f42700491b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:40:19.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.938+0000 7f427ea74640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f42700d6710 legacy=0x7f4270005a20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:40:19.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.938+0000 7f427da72640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f42700465f0 0x7f42700d9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:19.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.938+0000 7f427da72640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f42700465f0 0x7f42700d9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58012/0 (socket says 172.21.15.103:58012) 2024-09-10T08:40:19.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.938+0000 7f427da72640 1 -- 172.21.15.103:0/3195606116 learned_addr learned my addr 172.21.15.103:0/3195606116 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:19.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.938+0000 7f427da72640 1 -- 172.21.15.103:0/3195606116 >> v2:172.21.15.154:3300/0 conn(0x7f427000af20 msgr2=0x7f42700491b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:40:19.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.938+0000 7f427da72640 1 --2- 172.21.15.103:0/3195606116 >> v2:172.21.15.154:3300/0 conn(0x7f427000af20 0x7f42700491b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:19.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.938+0000 7f427da72640 1 -- 172.21.15.103:0/3195606116 >> v1:172.21.15.154:6789/0 conn(0x7f42700d6710 legacy=0x7f4270005a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:40:19.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.938+0000 7f427da72640 1 -- 172.21.15.103:0/3195606116 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427004af70 con 0x7f42700465f0 2024-09-10T08:40:19.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.940+0000 7f427da72640 1 --2- 172.21.15.103:0/3195606116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42700465f0 0x7f42700d9c40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4270030aa0 tx=0x7f426802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f01d5be66e9ac9e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.940+0000 7f427d271640 1 -- 172.21.15.103:0/3195606116 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4268037070 con 0x7f42700465f0 2024-09-10T08:40:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.940+0000 7f427d271640 1 -- 172.21.15.103:0/3195606116 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4268032440 con 0x7f42700465f0 2024-09-10T08:40:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.940+0000 7f427d271640 1 -- 172.21.15.103:0/3195606116 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4268032810 con 0x7f42700465f0 2024-09-10T08:40:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.941+0000 7f42804d7640 1 -- 172.21.15.103:0/3195606116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42700465f0 msgr2=0x7f42700d9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.941+0000 7f42804d7640 1 --2- 172.21.15.103:0/3195606116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42700465f0 0x7f42700d9c40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4270030aa0 tx=0x7f426802a1c0 comp rx=0 tx=0).stop 2024-09-10T08:40:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.942+0000 7f42804d7640 1 -- 172.21.15.103:0/3195606116 shutdown_connections 2024-09-10T08:40:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.942+0000 7f42804d7640 1 --2- 172.21.15.103:0/3195606116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42700465f0 0x7f42700d9c40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.942+0000 7f42804d7640 1 --2- 172.21.15.103:0/3195606116 >> v2:172.21.15.154:3300/0 conn(0x7f427000af20 0x7f42700491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.942+0000 7f42804d7640 1 -- 172.21.15.103:0/3195606116 >> 172.21.15.103:0/3195606116 conn(0x7f4270047d30 msgr2=0x7f4270048140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:19.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.942+0000 7f42804d7640 1 -- 172.21.15.103:0/3195606116 shutdown_connections 2024-09-10T08:40:19.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.942+0000 7f42804d7640 1 -- 172.21.15.103:0/3195606116 wait complete. 2024-09-10T08:40:19.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.944+0000 7f42804d7640 1 Processor -- start 2024-09-10T08:40:19.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.944+0000 7f42804d7640 1 -- start start 2024-09-10T08:40:19.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.945+0000 7f42804d7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427000af20 0x7f427003fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:19.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.945+0000 7f42804d7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42700d6710 0x7f4270040d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:19.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.946+0000 7f42804d7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4270041260 0x7f42700c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:19.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.946+0000 7f42804d7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4270046a30 con 0x7f42700d6710 2024-09-10T08:40:19.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.946+0000 7f42804d7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f42700d9720 con 0x7f4270041260 2024-09-10T08:40:19.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.946+0000 7f42804d7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f42700da180 con 0x7f427000af20 2024-09-10T08:40:19.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.946+0000 7f427ea74640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4270041260 msgr2=0x7f42700c75b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:40:19.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.946+0000 7f427ea74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4270041260 0x7f42700c75b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:40:19.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.946+0000 7f427e273640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427000af20 0x7f427003fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:19.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.946+0000 7f427e273640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427000af20 0x7f427003fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:56362/0 (socket says 172.21.15.103:56362) 2024-09-10T08:40:19.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.946+0000 7f427e273640 1 -- 172.21.15.103:0/1287118958 learned_addr learned my addr 172.21.15.103:0/1287118958 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:19.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.946+0000 7f427da72640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42700d6710 0x7f4270040d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:19.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.948+0000 7f427e273640 1 -- 172.21.15.103:0/1287118958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4270041260 msgr2=0x7f42700c75b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:40:19.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.948+0000 7f427e273640 1 --2- 172.21.15.103:0/1287118958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4270041260 0x7f42700c75b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:19.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.948+0000 7f427e273640 1 -- 172.21.15.103:0/1287118958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42700d6710 msgr2=0x7f4270040d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:19.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.948+0000 7f427e273640 1 --2- 172.21.15.103:0/1287118958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42700d6710 0x7f4270040d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:19.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.948+0000 7f427e273640 1 -- 172.21.15.103:0/1287118958 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42700301a0 con 0x7f427000af20 2024-09-10T08:40:19.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.948+0000 7f427e273640 1 --2- 172.21.15.103:0/1287118958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427000af20 0x7f427003fdb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f427807ca70 tx=0x7f42780699a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:19.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.949+0000 7f426effd640 1 -- 172.21.15.103:0/1287118958 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42780500f0 con 0x7f427000af20 2024-09-10T08:40:19.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.949+0000 7f42804d7640 1 -- 172.21.15.103:0/1287118958 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4270041a30 con 0x7f427000af20 2024-09-10T08:40:19.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.949+0000 7f42804d7640 1 -- 172.21.15.103:0/1287118958 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f427002f9a0 con 0x7f427000af20 2024-09-10T08:40:19.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.949+0000 7f426effd640 1 -- 172.21.15.103:0/1287118958 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4278092020 con 0x7f427000af20 2024-09-10T08:40:19.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.949+0000 7f426effd640 1 -- 172.21.15.103:0/1287118958 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42780741c0 con 0x7f427000af20 2024-09-10T08:40:19.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.955+0000 7f426effd640 1 -- 172.21.15.103:0/1287118958 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4278074440 con 0x7f427000af20 2024-09-10T08:40:19.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.955+0000 7f426effd640 1 --2- 172.21.15.103:0/1287118958 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f425c06bde0 0x7f425c06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:19.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.957+0000 7f42804d7640 1 -- 172.21.15.103:0/1287118958 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4260005290 con 0x7f427000af20 2024-09-10T08:40:19.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.957+0000 7f426effd640 1 -- 172.21.15.103:0/1287118958 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f4278107410 con 0x7f427000af20 2024-09-10T08:40:19.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.958+0000 7f427da72640 1 --2- 172.21.15.103:0/1287118958 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f425c06bde0 0x7f425c06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:19.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.959+0000 7f427da72640 1 --2- 172.21.15.103:0/1287118958 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f425c06bde0 0x7f425c06e2a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4268034000 tx=0x7f426802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:19.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:19.965+0000 7f426effd640 1 -- 172.21.15.103:0/1287118958 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f427809c030 con 0x7f427000af20 2024-09-10T08:40:20.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:20.444+0000 7f42804d7640 1 -- 172.21.15.103:0/1287118958 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4260005580 con 0x7f427000af20 2024-09-10T08:40:20.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:20.445+0000 7f426effd640 1 -- 172.21.15.103:0/1287118958 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f42780d5a30 con 0x7f427000af20 2024-09-10T08:40:20.447 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":98,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:40:20.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:20.452+0000 7f42804d7640 1 -- 172.21.15.103:0/1287118958 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f425c06bde0 msgr2=0x7f425c06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:20.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:20.452+0000 7f42804d7640 1 --2- 172.21.15.103:0/1287118958 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f425c06bde0 0x7f425c06e2a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4268034000 tx=0x7f426802e000 comp rx=0 tx=0).stop 2024-09-10T08:40:20.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:20.452+0000 7f42804d7640 1 -- 172.21.15.103:0/1287118958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427000af20 msgr2=0x7f427003fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:20.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:20.452+0000 7f42804d7640 1 --2- 172.21.15.103:0/1287118958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427000af20 0x7f427003fdb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f427807ca70 tx=0x7f42780699a0 comp rx=0 tx=0).stop 2024-09-10T08:40:20.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:20.452+0000 7f42804d7640 1 -- 172.21.15.103:0/1287118958 shutdown_connections 2024-09-10T08:40:20.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:20.452+0000 7f42804d7640 1 --2- 172.21.15.103:0/1287118958 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f425c06bde0 0x7f425c06e2a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:20.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:20.452+0000 7f42804d7640 1 --2- 172.21.15.103:0/1287118958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4270041260 0x7f42700c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:20.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:20.452+0000 7f42804d7640 1 --2- 172.21.15.103:0/1287118958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42700d6710 0x7f4270040d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:20.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:20.452+0000 7f42804d7640 1 --2- 172.21.15.103:0/1287118958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427000af20 0x7f427003fdb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:20.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:20.452+0000 7f42804d7640 1 -- 172.21.15.103:0/1287118958 >> 172.21.15.103:0/1287118958 conn(0x7f4270047d30 msgr2=0x7f42700d8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:20.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:20.452+0000 7f42804d7640 1 -- 172.21.15.103:0/1287118958 shutdown_connections 2024-09-10T08:40:20.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:20.452+0000 7f42804d7640 1 -- 172.21.15.103:0/1287118958 wait complete. 2024-09-10T08:40:23.470 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:40:23.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:23.637+0000 7fba80bfd640 1 Processor -- start 2024-09-10T08:40:23.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:23.637+0000 7fba80bfd640 1 -- start start 2024-09-10T08:40:23.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:23.638+0000 7fba80bfd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fba7c0c6190 0x7fba7c156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:23.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:23.638+0000 7fba80bfd640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba7c06d1c0 con 0x7fba7c0ca010 2024-09-10T08:40:23.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:23.638+0000 7fba80bfd640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba7c06d460 con 0x7fba7c067bc0 2024-09-10T08:40:23.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:23.638+0000 7fba80bfd640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fba7c06d740 con 0x7fba7c0c6190 2024-09-10T08:40:23.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:23.638+0000 7fba7a59c640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7fba7c067bc0 legacy=0x7fba7c153640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:40:23.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:23.638+0000 7fba79d9b640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7fba7c0c6190 msgr2=0x7fba7c156cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:40:23.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:23.638+0000 7fba79d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fba7c0c6190 0x7fba7c156cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:40:23.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:23.638+0000 7fba7ad9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fba7c0ca010 0x7fba7c0ca430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:34960/0 (socket says 172.21.15.103:34960) 2024-09-10T08:40:23.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:23.638+0000 7fba7ad9d640 1 -- 172.21.15.103:0/752498290 learned_addr learned my addr 172.21.15.103:0/752498290 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:40:23.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:23.839+0000 7fba79d9b640 1 -- 172.21.15.103:0/752498290 >> v2:172.21.15.154:3300/0 conn(0x7fba7c0c6190 msgr2=0x7fba7c156cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:40:23.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:23.839+0000 7fba79d9b640 1 --2- 172.21.15.103:0/752498290 >> v2:172.21.15.154:3300/0 conn(0x7fba7c0c6190 0x7fba7c156cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:40:23.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:23.839+0000 7fba7a59c640 1 -- 172.21.15.103:0/752498290 >> v1:172.21.15.154:6789/0 conn(0x7fba7c067bc0 legacy=0x7fba7c153640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:40:24.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:24.240+0000 7fba7a59c640 1 -- 172.21.15.103:0/752498290 >> v1:172.21.15.154:6789/0 conn(0x7fba7c067bc0 legacy=0x7fba7c153640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:40:24.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:24.240+0000 7fba79d9b640 1 -- 172.21.15.103:0/752498290 >> v2:172.21.15.154:3300/0 conn(0x7fba7c0c6190 msgr2=0x7fba7c156cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:40:24.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:24.240+0000 7fba79d9b640 1 --2- 172.21.15.103:0/752498290 >> v2:172.21.15.154:3300/0 conn(0x7fba7c0c6190 0x7fba7c156cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:40:25.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:25.041+0000 7fba7a59c640 1 -- 172.21.15.103:0/752498290 >> v1:172.21.15.154:6789/0 conn(0x7fba7c067bc0 legacy=0x7fba7c153640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:40:25.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:25.041+0000 7fba79d9b640 1 -- 172.21.15.103:0/752498290 >> v2:172.21.15.154:3300/0 conn(0x7fba7c0c6190 msgr2=0x7fba7c156cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:40:25.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:25.041+0000 7fba79d9b640 1 --2- 172.21.15.103:0/752498290 >> v2:172.21.15.154:3300/0 conn(0x7fba7c0c6190 0x7fba7c156cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:40:26.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.600+0000 7fba7959a640 1 -- 172.21.15.103:0/752498290 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2303030539 0 0) 0x7fba7c06d1c0 con 0x7fba7c0ca010 2024-09-10T08:40:26.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.600+0000 7fba7959a640 1 -- 172.21.15.103:0/752498290 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba68003520 con 0x7fba7c0ca010 2024-09-10T08:40:26.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.606+0000 7fba7959a640 1 -- 172.21.15.103:0/752498290 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1289347144 0 0) 0x7fba68003520 con 0x7fba7c0ca010 2024-09-10T08:40:26.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.606+0000 7fba7959a640 1 -- 172.21.15.103:0/752498290 >> v2:172.21.15.154:3300/0 conn(0x7fba7c0c6190 msgr2=0x7fba7c156cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:40:26.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.606+0000 7fba7959a640 1 --2- 172.21.15.103:0/752498290 >> v2:172.21.15.154:3300/0 conn(0x7fba7c0c6190 0x7fba7c156cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.606+0000 7fba7959a640 1 -- 172.21.15.103:0/752498290 >> v1:172.21.15.154:6789/0 conn(0x7fba7c067bc0 legacy=0x7fba7c153640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:40:26.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.607+0000 7fba7959a640 1 -- 172.21.15.103:0/752498290 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba7c06da20 con 0x7fba7c0ca010 2024-09-10T08:40:26.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.607+0000 7fba7959a640 1 -- 172.21.15.103:0/752498290 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7fba740018f0 con 0x7fba7c0ca010 2024-09-10T08:40:26.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.607+0000 7fba7959a640 1 -- 172.21.15.103:0/752498290 >> v1:172.21.15.103:6789/0 conn(0x7fba7c0ca010 legacy=0x7fba7c0ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:26.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.607+0000 7fba7959a640 1 --2- 172.21.15.103:0/752498290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba680039b0 0x7fba68003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.607+0000 7fba7959a640 1 --2- 172.21.15.103:0/752498290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba68004800 0x7fba68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.607+0000 7fba7959a640 1 --2- 172.21.15.103:0/752498290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba68005230 0x7fba6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.607+0000 7fba7959a640 1 -- 172.21.15.103:0/752498290 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fba7c06d740 con 0x7fba68004800 2024-09-10T08:40:26.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.607+0000 7fba7ad9d640 1 -- 172.21.15.103:0/752498290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba68005230 msgr2=0x7fba6800b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:40:26.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.607+0000 7fba7ad9d640 1 --2- 172.21.15.103:0/752498290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba68005230 0x7fba6800b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:40:26.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.607+0000 7fba7959a640 1 -- 172.21.15.103:0/752498290 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fba6800c190 con 0x7fba68005230 2024-09-10T08:40:26.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.607+0000 7fba7959a640 1 -- 172.21.15.103:0/752498290 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fba6800c390 con 0x7fba680039b0 2024-09-10T08:40:26.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.607+0000 7fba7a59c640 1 --2- 172.21.15.103:0/752498290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba680039b0 0x7fba68003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.608+0000 7fba79d9b640 1 --2- 172.21.15.103:0/752498290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba68004800 0x7fba68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.608+0000 7fba7a59c640 1 -- 172.21.15.103:0/752498290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba68005230 msgr2=0x7fba6800b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:40:26.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.608+0000 7fba7a59c640 1 --2- 172.21.15.103:0/752498290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba68005230 0x7fba6800b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.608+0000 7fba7a59c640 1 -- 172.21.15.103:0/752498290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba68004800 msgr2=0x7fba68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:26.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.608+0000 7fba7a59c640 1 --2- 172.21.15.103:0/752498290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba68004800 0x7fba68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.608+0000 7fba7a59c640 1 -- 172.21.15.103:0/752498290 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba68003520 con 0x7fba680039b0 2024-09-10T08:40:26.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.609+0000 7fba7ad9d640 1 -- 172.21.15.103:0/752498290 reap_dead start 2024-09-10T08:40:26.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.609+0000 7fba7a59c640 1 --2- 172.21.15.103:0/752498290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba680039b0 0x7fba68003db0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fba6c009df0 tx=0x7fba68005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5b843c1b1f35834 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:26.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.613+0000 7fba7959a640 1 -- 172.21.15.103:0/752498290 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6c036070 con 0x7fba680039b0 2024-09-10T08:40:26.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.613+0000 7fba7959a640 1 -- 172.21.15.103:0/752498290 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba6c0052d0 con 0x7fba680039b0 2024-09-10T08:40:26.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.613+0000 7fba7959a640 1 -- 172.21.15.103:0/752498290 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6c0099f0 con 0x7fba680039b0 2024-09-10T08:40:26.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.614+0000 7fba80bfd640 1 -- 172.21.15.103:0/752498290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba680039b0 msgr2=0x7fba68003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:26.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.614+0000 7fba80bfd640 1 --2- 172.21.15.103:0/752498290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba680039b0 0x7fba68003db0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fba6c009df0 tx=0x7fba68005830 comp rx=0 tx=0).stop 2024-09-10T08:40:26.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.614+0000 7fba80bfd640 1 -- 172.21.15.103:0/752498290 shutdown_connections 2024-09-10T08:40:26.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.614+0000 7fba80bfd640 1 --2- 172.21.15.103:0/752498290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba680039b0 0x7fba68003db0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.614+0000 7fba80bfd640 1 -- 172.21.15.103:0/752498290 >> 172.21.15.103:0/752498290 conn(0x7fba7c0c87f0 msgr2=0x7fba7c0c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:26.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.614+0000 7fba80bfd640 1 -- 172.21.15.103:0/752498290 shutdown_connections 2024-09-10T08:40:26.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.614+0000 7fba80bfd640 1 -- 172.21.15.103:0/752498290 wait complete. 2024-09-10T08:40:26.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.616+0000 7fba80bfd640 1 Processor -- start 2024-09-10T08:40:26.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.616+0000 7fba80bfd640 1 -- start start 2024-09-10T08:40:26.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.618+0000 7fba80bfd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba680039b0 0x7fba7c158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.618+0000 7fba80bfd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba7c0aeb90 0x7fba7c0ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.618+0000 7fba80bfd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba7c0ac7e0 0x7fba7c159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.618+0000 7fba80bfd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fba7c068120 con 0x7fba680039b0 2024-09-10T08:40:26.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.618+0000 7fba7ad9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba7c0ac7e0 0x7fba7c159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.618+0000 7fba7a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba680039b0 0x7fba7c158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.618+0000 7fba7a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba680039b0 0x7fba7c158ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48824/0 (socket says 172.21.15.103:48824) 2024-09-10T08:40:26.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.618+0000 7fba7a59c640 1 -- 172.21.15.103:0/4131925913 learned_addr learned my addr 172.21.15.103:0/4131925913 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:26.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.619+0000 7fba80bfd640 1 -- 172.21.15.103:0/4131925913 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fba7c067fa0 con 0x7fba7c0aeb90 2024-09-10T08:40:26.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.619+0000 7fba79d9b640 1 -- 172.21.15.103:0/4131925913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba7c0aeb90 msgr2=0x7fba7c0ac2a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:40:26.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.619+0000 7fba79d9b640 1 --2- 172.21.15.103:0/4131925913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba7c0aeb90 0x7fba7c0ac2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:40:26.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.619+0000 7fba80bfd640 1 -- 172.21.15.103:0/4131925913 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fba7c156cc0 con 0x7fba7c0ac7e0 2024-09-10T08:40:26.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.619+0000 7fba7a59c640 1 -- 172.21.15.103:0/4131925913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba7c0ac7e0 msgr2=0x7fba7c159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:26.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.619+0000 7fba7a59c640 1 --2- 172.21.15.103:0/4131925913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba7c0ac7e0 0x7fba7c159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.619+0000 7fba7a59c640 1 -- 172.21.15.103:0/4131925913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba7c0aeb90 msgr2=0x7fba7c0ac2a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:40:26.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.619+0000 7fba7a59c640 1 --2- 172.21.15.103:0/4131925913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba7c0aeb90 0x7fba7c0ac2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.619+0000 7fba7a59c640 1 -- 172.21.15.103:0/4131925913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba7c159420 con 0x7fba680039b0 2024-09-10T08:40:26.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.620+0000 7fba7a59c640 1 --2- 172.21.15.103:0/4131925913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba680039b0 0x7fba7c158ee0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fba6c003840 tx=0x7fba6c005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:26.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.620+0000 7fba7ad9d640 1 --2- 172.21.15.103:0/4131925913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba7c0ac7e0 0x7fba7c159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:40:26.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.620+0000 7fba72ffd640 1 -- 172.21.15.103:0/4131925913 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6c042020 con 0x7fba680039b0 2024-09-10T08:40:26.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.621+0000 7fba80bfd640 1 -- 172.21.15.103:0/4131925913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba7c1584a0 con 0x7fba680039b0 2024-09-10T08:40:26.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.621+0000 7fba80bfd640 1 -- 172.21.15.103:0/4131925913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba7c0ad330 con 0x7fba680039b0 2024-09-10T08:40:26.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.621+0000 7fba72ffd640 1 -- 172.21.15.103:0/4131925913 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba6c037040 con 0x7fba680039b0 2024-09-10T08:40:26.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.621+0000 7fba72ffd640 1 -- 172.21.15.103:0/4131925913 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6c036070 con 0x7fba680039b0 2024-09-10T08:40:26.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.622+0000 7fba80bfd640 1 -- 172.21.15.103:0/4131925913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba60005290 con 0x7fba680039b0 2024-09-10T08:40:26.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.632+0000 7fba72ffd640 1 -- 172.21.15.103:0/4131925913 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba6c045020 con 0x7fba680039b0 2024-09-10T08:40:26.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.633+0000 7fba72ffd640 1 --2- 172.21.15.103:0/4131925913 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fba5c06be30 0x7fba5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.633+0000 7fba72ffd640 1 -- 172.21.15.103:0/4131925913 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fba6c0ac290 con 0x7fba680039b0 2024-09-10T08:40:26.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.638+0000 7fba79d9b640 1 --2- 172.21.15.103:0/4131925913 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fba5c06be30 0x7fba5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.639+0000 7fba79d9b640 1 --2- 172.21.15.103:0/4131925913 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fba5c06be30 0x7fba5c06e2f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0ada70 tx=0x7fba64003910 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:26.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:26.640+0000 7fba72ffd640 1 -- 172.21.15.103:0/4131925913 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fba6c04c070 con 0x7fba680039b0 2024-09-10T08:40:27.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.118+0000 7fba80bfd640 1 -- 172.21.15.103:0/4131925913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fba60005580 con 0x7fba680039b0 2024-09-10T08:40:27.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.121+0000 7fba72ffd640 1 -- 172.21.15.103:0/4131925913 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7fba6c07a910 con 0x7fba680039b0 2024-09-10T08:40:27.121 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":102,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:40:27.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.127+0000 7fba80bfd640 1 -- 172.21.15.103:0/4131925913 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fba5c06be30 msgr2=0x7fba5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:27.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.127+0000 7fba80bfd640 1 --2- 172.21.15.103:0/4131925913 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fba5c06be30 0x7fba5c06e2f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0ada70 tx=0x7fba64003910 comp rx=0 tx=0).stop 2024-09-10T08:40:27.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.128+0000 7fba80bfd640 1 -- 172.21.15.103:0/4131925913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba680039b0 msgr2=0x7fba7c158ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:27.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.128+0000 7fba80bfd640 1 --2- 172.21.15.103:0/4131925913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba680039b0 0x7fba7c158ee0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fba6c003840 tx=0x7fba6c005c70 comp rx=0 tx=0).stop 2024-09-10T08:40:27.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.128+0000 7fba80bfd640 1 -- 172.21.15.103:0/4131925913 shutdown_connections 2024-09-10T08:40:27.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.128+0000 7fba80bfd640 1 --2- 172.21.15.103:0/4131925913 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fba5c06be30 0x7fba5c06e2f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.128+0000 7fba80bfd640 1 --2- 172.21.15.103:0/4131925913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba7c0ac7e0 0x7fba7c159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.128+0000 7fba80bfd640 1 --2- 172.21.15.103:0/4131925913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba7c0aeb90 0x7fba7c0ac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.128+0000 7fba80bfd640 1 --2- 172.21.15.103:0/4131925913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba680039b0 0x7fba7c158ee0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.128+0000 7fba80bfd640 1 -- 172.21.15.103:0/4131925913 >> 172.21.15.103:0/4131925913 conn(0x7fba7c0c87f0 msgr2=0x7fba7c0ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:27.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.129+0000 7fba80bfd640 1 -- 172.21.15.103:0/4131925913 shutdown_connections 2024-09-10T08:40:27.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.129+0000 7fba80bfd640 1 -- 172.21.15.103:0/4131925913 wait complete. 2024-09-10T08:40:27.151 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-10T08:40:27.151 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-10T08:40:27.151 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:40:27.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.322+0000 7f0f73723640 1 Processor -- start 2024-09-10T08:40:27.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.322+0000 7f0f73723640 1 -- start start 2024-09-10T08:40:27.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.323+0000 7f0f73723640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f6c0c5940 0x7f0f6c15aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.323+0000 7f0f73723640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f6c15e050 con 0x7f0f6c15af60 2024-09-10T08:40:27.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.323+0000 7f0f73723640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f6c15e330 con 0x7f0f6c157ff0 2024-09-10T08:40:27.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.323+0000 7f0f73723640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0f6c15e610 con 0x7f0f6c0c5940 2024-09-10T08:40:27.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.323+0000 7f0f714bf640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f0f6c157ff0 legacy=0x7f0f6c0c2440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:40:27.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.324+0000 7f0f71cc0640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0f6c15af60 0x7f0f6c164fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:59356/0 (socket says 172.21.15.103:59356) 2024-09-10T08:40:27.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.324+0000 7f0f71cc0640 1 -- 172.21.15.103:0/528528513 learned_addr learned my addr 172.21.15.103:0/528528513 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:40:27.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.324+0000 7f0f63fff640 1 -- 172.21.15.103:0/528528513 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3398745180 0 0) 0x7f0f6c15e050 con 0x7f0f6c15af60 2024-09-10T08:40:27.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.324+0000 7f0f63fff640 1 -- 172.21.15.103:0/528528513 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f58003520 con 0x7f0f6c15af60 2024-09-10T08:40:27.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.324+0000 7f0f70cbe640 1 --2- 172.21.15.103:0/528528513 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f6c0c5940 0x7f0f6c15aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:27.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.325+0000 7f0f63fff640 1 -- 172.21.15.103:0/528528513 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2698480489 0 0) 0x7f0f58003520 con 0x7f0f6c15af60 2024-09-10T08:40:27.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.325+0000 7f0f63fff640 1 -- 172.21.15.103:0/528528513 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f6c0c5940 msgr2=0x7f0f6c15aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:27.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.325+0000 7f0f63fff640 1 --2- 172.21.15.103:0/528528513 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f6c0c5940 0x7f0f6c15aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.325+0000 7f0f63fff640 1 -- 172.21.15.103:0/528528513 >> v1:172.21.15.154:6789/0 conn(0x7f0f6c157ff0 legacy=0x7f0f6c0c2440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:40:27.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.325+0000 7f0f63fff640 1 -- 172.21.15.103:0/528528513 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6c15e8f0 con 0x7f0f6c15af60 2024-09-10T08:40:27.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.325+0000 7f0f63fff640 1 -- 172.21.15.103:0/528528513 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f0f640019f0 con 0x7f0f6c15af60 2024-09-10T08:40:27.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.325+0000 7f0f63fff640 1 -- 172.21.15.103:0/528528513 >> v1:172.21.15.103:6789/0 conn(0x7f0f6c15af60 legacy=0x7f0f6c164fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:27.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.325+0000 7f0f63fff640 1 --2- 172.21.15.103:0/528528513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f580039e0 0x7f0f58003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.325+0000 7f0f63fff640 1 --2- 172.21.15.103:0/528528513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f58004800 0x7f0f58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.325+0000 7f0f63fff640 1 --2- 172.21.15.103:0/528528513 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f6c0c5940 0x7f0f58005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.325+0000 7f0f63fff640 1 -- 172.21.15.103:0/528528513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c15e610 con 0x7f0f580039e0 2024-09-10T08:40:27.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.325+0000 7f0f63fff640 1 -- 172.21.15.103:0/528528513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5800bb50 con 0x7f0f58004800 2024-09-10T08:40:27.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.325+0000 7f0f63fff640 1 -- 172.21.15.103:0/528528513 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0f5800bd20 con 0x7f0f6c0c5940 2024-09-10T08:40:27.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.325+0000 7f0f70cbe640 1 -- 172.21.15.103:0/528528513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f58004800 msgr2=0x7f0f58004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:40:27.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.325+0000 7f0f70cbe640 1 --2- 172.21.15.103:0/528528513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f58004800 0x7f0f58004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:40:27.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.325+0000 7f0f714bf640 1 --2- 172.21.15.103:0/528528513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f580039e0 0x7f0f58003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:27.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.325+0000 7f0f71cc0640 1 --2- 172.21.15.103:0/528528513 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f6c0c5940 0x7f0f58005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:27.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.326+0000 7f0f714bf640 1 -- 172.21.15.103:0/528528513 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f6c0c5940 msgr2=0x7f0f58005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:27.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.326+0000 7f0f714bf640 1 --2- 172.21.15.103:0/528528513 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f6c0c5940 0x7f0f58005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.326+0000 7f0f714bf640 1 -- 172.21.15.103:0/528528513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f58004800 msgr2=0x7f0f58004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:40:27.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.326+0000 7f0f714bf640 1 --2- 172.21.15.103:0/528528513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f58004800 0x7f0f58004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.326+0000 7f0f714bf640 1 -- 172.21.15.103:0/528528513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f58003520 con 0x7f0f580039e0 2024-09-10T08:40:27.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.327+0000 7f0f714bf640 1 --2- 172.21.15.103:0/528528513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f580039e0 0x7f0f58003de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0f68009930 tx=0x7f0f58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74bcc5add7baee49 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:27.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.327+0000 7f0f63fff640 1 -- 172.21.15.103:0/528528513 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68009500 con 0x7f0f580039e0 2024-09-10T08:40:27.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.327+0000 7f0f63fff640 1 -- 172.21.15.103:0/528528513 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6802e070 con 0x7f0f580039e0 2024-09-10T08:40:27.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.327+0000 7f0f63fff640 1 -- 172.21.15.103:0/528528513 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68003df0 con 0x7f0f580039e0 2024-09-10T08:40:27.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.328+0000 7f0f73723640 1 -- 172.21.15.103:0/528528513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f580039e0 msgr2=0x7f0f58003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:27.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.328+0000 7f0f73723640 1 --2- 172.21.15.103:0/528528513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f580039e0 0x7f0f58003de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0f68009930 tx=0x7f0f58005830 comp rx=0 tx=0).stop 2024-09-10T08:40:27.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.328+0000 7f0f71cc0640 1 -- 172.21.15.103:0/528528513 reap_dead start 2024-09-10T08:40:27.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.328+0000 7f0f73723640 1 -- 172.21.15.103:0/528528513 shutdown_connections 2024-09-10T08:40:27.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.328+0000 7f0f73723640 1 -- 172.21.15.103:0/528528513 >> 172.21.15.103:0/528528513 conn(0x7f0f6c0c7a40 msgr2=0x7f0f6c0c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:27.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.329+0000 7f0f73723640 1 -- 172.21.15.103:0/528528513 shutdown_connections 2024-09-10T08:40:27.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.329+0000 7f0f73723640 1 -- 172.21.15.103:0/528528513 wait complete. 2024-09-10T08:40:27.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.330+0000 7f0f73723640 1 Processor -- start 2024-09-10T08:40:27.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.331+0000 7f0f73723640 1 -- start start 2024-09-10T08:40:27.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.332+0000 7f0f73723640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f580039e0 0x7f0f6c154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.332+0000 7f0f73723640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f6c168020 0x7f0f6c1444c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.332+0000 7f0f73723640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f6c159d90 0x7f0f6c144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.332+0000 7f0f73723640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c15ddb0 con 0x7f0f6c159d90 2024-09-10T08:40:27.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.332+0000 7f0f73723640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c15dc30 con 0x7f0f6c168020 2024-09-10T08:40:27.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.332+0000 7f0f73723640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0f6c06f250 con 0x7f0f580039e0 2024-09-10T08:40:27.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.333+0000 7f0f70cbe640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f6c168020 msgr2=0x7f0f6c1444c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:40:27.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.333+0000 7f0f70cbe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f6c168020 0x7f0f6c1444c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:40:27.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.333+0000 7f0f71cc0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f6c159d90 0x7f0f6c144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:27.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.333+0000 7f0f71cc0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f6c159d90 0x7f0f6c144db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48852/0 (socket says 172.21.15.103:48852) 2024-09-10T08:40:27.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.333+0000 7f0f71cc0640 1 -- 172.21.15.103:0/1763073070 learned_addr learned my addr 172.21.15.103:0/1763073070 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:27.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.333+0000 7f0f71cc0640 1 -- 172.21.15.103:0/1763073070 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f580039e0 msgr2=0x7f0f6c154a70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:40:27.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.333+0000 7f0f71cc0640 1 --2- 172.21.15.103:0/1763073070 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f580039e0 0x7f0f6c154a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.333+0000 7f0f71cc0640 1 -- 172.21.15.103:0/1763073070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f6c168020 msgr2=0x7f0f6c1444c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:40:27.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.333+0000 7f0f71cc0640 1 --2- 172.21.15.103:0/1763073070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f6c168020 0x7f0f6c1444c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.333+0000 7f0f71cc0640 1 -- 172.21.15.103:0/1763073070 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6c140fa0 con 0x7f0f6c159d90 2024-09-10T08:40:27.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.334+0000 7f0f71cc0640 1 --2- 172.21.15.103:0/1763073070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f6c159d90 0x7f0f6c144db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0709c0 tx=0x7f0f6400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:27.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.336+0000 7f0f61ffb640 1 -- 172.21.15.103:0/1763073070 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64007aa0 con 0x7f0f6c159d90 2024-09-10T08:40:27.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.336+0000 7f0f73723640 1 -- 172.21.15.103:0/1763073070 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6c141240 con 0x7f0f6c159d90 2024-09-10T08:40:27.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.337+0000 7f0f73723640 1 -- 172.21.15.103:0/1763073070 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f6c1452f0 con 0x7f0f6c159d90 2024-09-10T08:40:27.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.337+0000 7f0f61ffb640 1 -- 172.21.15.103:0/1763073070 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6400ee20 con 0x7f0f6c159d90 2024-09-10T08:40:27.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.338+0000 7f0f61ffb640 1 -- 172.21.15.103:0/1763073070 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64014630 con 0x7f0f6c159d90 2024-09-10T08:40:27.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.340+0000 7f0f73723640 1 --2- 172.21.15.103:0/1763073070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4c002a70 0x7f0f4c004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.340+0000 7f0f73723640 1 -- 172.21.15.103:0/1763073070 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c007ec0 con 0x7f0f4c002a70 2024-09-10T08:40:27.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.341+0000 7f0f61ffb640 1 -- 172.21.15.103:0/1763073070 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f640147d0 con 0x7f0f6c159d90 2024-09-10T08:40:27.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.341+0000 7f0f714bf640 1 --2- 172.21.15.103:0/1763073070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4c002a70 0x7f0f4c004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:27.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.341+0000 7f0f61ffb640 1 --2- 172.21.15.103:0/1763073070 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0f5006be10 0x7f0f5006e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.342+0000 7f0f61ffb640 1 -- 172.21.15.103:0/1763073070 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f0f6408b090 con 0x7f0f6c159d90 2024-09-10T08:40:27.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.342+0000 7f0f70cbe640 1 --2- 172.21.15.103:0/1763073070 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0f5006be10 0x7f0f5006e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:27.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.343+0000 7f0f714bf640 1 -- 172.21.15.103:0/1763073070 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f4c0080c0 con 0x7f0f4c002a70 2024-09-10T08:40:27.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.343+0000 7f0f714bf640 1 --2- 172.21.15.103:0/1763073070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4c002a70 0x7f0f4c004f30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f68009900 tx=0x7f0f68005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:27.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.344+0000 7f0f70cbe640 1 --2- 172.21.15.103:0/1763073070 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0f5006be10 0x7f0f5006e2d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c15c920 tx=0x7f0f5c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:27.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.345+0000 7f0f61ffb640 1 -- 172.21.15.103:0/1763073070 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68005270 con 0x7f0f4c002a70 2024-09-10T08:40:27.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.345+0000 7f0f61ffb640 1 -- 172.21.15.103:0/1763073070 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0f6802e050 con 0x7f0f4c002a70 2024-09-10T08:40:27.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.345+0000 7f0f61ffb640 1 -- 172.21.15.103:0/1763073070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4c002a70 msgr2=0x7f0f4c004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:27.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.345+0000 7f0f61ffb640 1 --2- 172.21.15.103:0/1763073070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4c002a70 0x7f0f4c004f30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f68009900 tx=0x7f0f68005a10 comp rx=0 tx=0).stop 2024-09-10T08:40:27.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.345+0000 7f0f61ffb640 1 -- 172.21.15.103:0/1763073070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4c002a70 msgr2=0x7f0f4c004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:40:27.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.345+0000 7f0f61ffb640 1 --2- 172.21.15.103:0/1763073070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4c002a70 0x7f0f4c004f30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.359+0000 7f0f73723640 1 --2- 172.21.15.103:0/1763073070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4c006f40 0x7f0f4c0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.360+0000 7f0f714bf640 1 --2- 172.21.15.103:0/1763073070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4c006f40 0x7f0f4c0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:27.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.360+0000 7f0f73723640 1 -- 172.21.15.103:0/1763073070 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c00a4a0 con 0x7f0f4c006f40 2024-09-10T08:40:27.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.361+0000 7f0f714bf640 1 -- 172.21.15.103:0/1763073070 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0f4c007910 con 0x7f0f4c006f40 2024-09-10T08:40:27.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.361+0000 7f0f714bf640 1 --2- 172.21.15.103:0/1763073070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4c006f40 0x7f0f4c0073d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0f68009930 tx=0x7f0f680090e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:27.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.362+0000 7f0f61ffb640 1 -- 172.21.15.103:0/1763073070 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68048070 con 0x7f0f4c006f40 2024-09-10T08:40:27.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.362+0000 7f0f61ffb640 1 -- 172.21.15.103:0/1763073070 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4878 (secure 0 0 0) 0x7f0f680442b0 con 0x7f0f4c006f40 2024-09-10T08:40:27.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.362+0000 7f0f61ffb640 1 -- 172.21.15.103:0/1763073070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4c006f40 msgr2=0x7f0f4c0073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:27.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.362+0000 7f0f61ffb640 1 --2- 172.21.15.103:0/1763073070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4c006f40 0x7f0f4c0073d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0f68009930 tx=0x7f0f680090e0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.362+0000 7f0f61ffb640 1 -- 172.21.15.103:0/1763073070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4c006f40 msgr2=0x7f0f4c0073d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:40:27.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.362+0000 7f0f61ffb640 1 --2- 172.21.15.103:0/1763073070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4c006f40 0x7f0f4c0073d0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0f68009930 tx=0x7f0f680090e0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.363 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:40:27.364 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:40:27.364 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:40:27.364 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:40:27.364 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 102, 2024-09-10T08:40:27.364 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 53826, 2024-09-10T08:40:27.364 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:40:27.364 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:40:27.364 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:40:27.364 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:27.364 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:40:27.365 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:40:27.365 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:40:27.365 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:40:27.365 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:27.365 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:27.365 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:27.365 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:27.365 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:27.365 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:27.365 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:27.365 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:27.365 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:27.366 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:27.366 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:27.366 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:27.366 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:40:27.366 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:40:27.366 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:27.366 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:27.366 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:27.366 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:27.366 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:27.366 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:27.366 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:27.366 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:27.367 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:27.367 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:27.367 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:27.367 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:27.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.367 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:40:27.367 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:40:27.367 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:40:27.367 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:40:27.367 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:40:27.367 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:40:27.367 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:40:27.368 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:40:27.368 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:40:27.368 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:40:27.368 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:40:27.368 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:40:27.368 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:40:27.368 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:40:27.368 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:40:27.368 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:40:27.368 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:40:27.369 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:27.369 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:27.369 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:27.369 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:27.369 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:27.369 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:27.369 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:27.369 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:27.369 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:27.369 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:27.369 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:27.369 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:27.370 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:40:27.370 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.370 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:40:27.370 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.370 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:40:27.370 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:40:27.370 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:27.370 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:27.370 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.370 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:27.370 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:40:27.370 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:27.370 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.370 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.371 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:27.371 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:40:27.371 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:27.371 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:27.371 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:27.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.371 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:40:27.371 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:40:27.371 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:27.371 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:27.371 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:27.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.372 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.372 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:40:27.372 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:40:27.372 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:27.372 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:27.372 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.372 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:27.372 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:40:27.372 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:27.372 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.372 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.372 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:27.372 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:40:27.373 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:27.373 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:27.373 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:27.373 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.373 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:40:27.373 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:40:27.373 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:27.373 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:27.374 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:27.374 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.374 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.374 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:40:27.374 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:40:27.374 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:27.374 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:27.374 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.374 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:27.374 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:40:27.374 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:27.374 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.375 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.375 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:27.375 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:40:27.375 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:27.375 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:27.375 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:27.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.375 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:40:27.375 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:40:27.375 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:27.375 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:27.376 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:27.376 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:27.376 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:27.376 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.376 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:40:27.376 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:40:27.376 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.376 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:27.376 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:27.376 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:40:27.376 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:27.376 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:27.377 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:40:27.377 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.377 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:27.377 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:27.377 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:40:27.377 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:27.377 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:27.377 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:40:27.377 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.377 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:27.377 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:27.377 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:40:27.377 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:27.378 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:27.378 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:40:27.378 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.378 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:27.378 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:27.378 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:40:27.378 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:27.378 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:27.378 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.378 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:40:27.378 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:40:27.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.364+0000 7f0f577fe640 1 -- 172.21.15.103:0/1763073070 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0f5006be10 msgr2=0x7f0f5006e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:27.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.364+0000 7f0f577fe640 1 --2- 172.21.15.103:0/1763073070 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0f5006be10 0x7f0f5006e2d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c15c920 tx=0x7f0f5c009190 comp rx=0 tx=0).stop 2024-09-10T08:40:27.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.364+0000 7f0f577fe640 1 -- 172.21.15.103:0/1763073070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f6c159d90 msgr2=0x7f0f6c144db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:27.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.364+0000 7f0f577fe640 1 --2- 172.21.15.103:0/1763073070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f6c159d90 0x7f0f6c144db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0709c0 tx=0x7f0f6400e530 comp rx=0 tx=0).stop 2024-09-10T08:40:27.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.364+0000 7f0f71cc0640 1 -- 172.21.15.103:0/1763073070 reap_dead start 2024-09-10T08:40:27.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.364+0000 7f0f71cc0640 1 -- 172.21.15.103:0/1763073070 reap_dead start 2024-09-10T08:40:27.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.365+0000 7f0f577fe640 1 -- 172.21.15.103:0/1763073070 shutdown_connections 2024-09-10T08:40:27.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.365+0000 7f0f577fe640 1 -- 172.21.15.103:0/1763073070 >> 172.21.15.103:0/1763073070 conn(0x7f0f6c0c7a40 msgr2=0x7f0f6c0c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:27.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.366+0000 7f0f577fe640 1 -- 172.21.15.103:0/1763073070 shutdown_connections 2024-09-10T08:40:27.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.367+0000 7f0f577fe640 1 -- 172.21.15.103:0/1763073070 wait complete. 2024-09-10T08:40:27.384 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:40:27.384 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-10T08:40:27.384 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:40:27.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.570+0000 7f7b89ed7640 1 Processor -- start 2024-09-10T08:40:27.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.570+0000 7f7b89ed7640 1 -- start start 2024-09-10T08:40:27.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.571+0000 7f7b89ed7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7b840c5940 0x7f7b840c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.571+0000 7f7b89ed7640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b840c7500 con 0x7f7b8414fa90 2024-09-10T08:40:27.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.571+0000 7f7b89ed7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b84156300 con 0x7f7b8406f1d0 2024-09-10T08:40:27.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.571+0000 7f7b89ed7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f7b840c72b0 con 0x7f7b840c5940 2024-09-10T08:40:27.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.571+0000 7f7b83fff640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7f7b840c5940 msgr2=0x7f7b840c2e50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:40:27.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.571+0000 7f7b83fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7b840c5940 0x7f7b840c2e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:40:27.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.571+0000 7f7b82ffd640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f7b8406f1d0 legacy=0x7f7b84152a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:40:27.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.571+0000 7f7b837fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7b8414fa90 0x7f7b840c44d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:59362/0 (socket says 172.21.15.103:59362) 2024-09-10T08:40:27.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.571+0000 7f7b837fe640 1 -- 172.21.15.103:0/1819735684 learned_addr learned my addr 172.21.15.103:0/1819735684 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:40:27.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.571+0000 7f7b827fc640 1 -- 172.21.15.103:0/1819735684 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1681830866 0 0) 0x7f7b840c7500 con 0x7f7b8414fa90 2024-09-10T08:40:27.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.571+0000 7f7b827fc640 1 -- 172.21.15.103:0/1819735684 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b6c003500 con 0x7f7b8414fa90 2024-09-10T08:40:27.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.572+0000 7f7b827fc640 1 -- 172.21.15.103:0/1819735684 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2794686976 0 0) 0x7f7b6c003500 con 0x7f7b8414fa90 2024-09-10T08:40:27.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.572+0000 7f7b827fc640 1 -- 172.21.15.103:0/1819735684 >> v2:172.21.15.154:3300/0 conn(0x7f7b840c5940 msgr2=0x7f7b840c2e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:40:27.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.572+0000 7f7b827fc640 1 --2- 172.21.15.103:0/1819735684 >> v2:172.21.15.154:3300/0 conn(0x7f7b840c5940 0x7f7b840c2e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.572+0000 7f7b827fc640 1 -- 172.21.15.103:0/1819735684 >> v1:172.21.15.154:6789/0 conn(0x7f7b8406f1d0 legacy=0x7f7b84152a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:40:27.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.572+0000 7f7b827fc640 1 -- 172.21.15.103:0/1819735684 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b841565e0 con 0x7f7b8414fa90 2024-09-10T08:40:27.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.572+0000 7f7b827fc640 1 -- 172.21.15.103:0/1819735684 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f7b74001670 con 0x7f7b8414fa90 2024-09-10T08:40:27.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.572+0000 7f7b827fc640 1 -- 172.21.15.103:0/1819735684 >> v1:172.21.15.103:6789/0 conn(0x7f7b8414fa90 legacy=0x7f7b840c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:27.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.572+0000 7f7b827fc640 1 --2- 172.21.15.103:0/1819735684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b6c003b60 0x7f7b6c003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.572+0000 7f7b827fc640 1 --2- 172.21.15.103:0/1819735684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b6c008900 0x7f7b6c00ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.572+0000 7f7b827fc640 1 --2- 172.21.15.103:0/1819735684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b6c00b630 0x7f7b6c00daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.573+0000 7f7b827fc640 1 -- 172.21.15.103:0/1819735684 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7b840c72b0 con 0x7f7b6c008900 2024-09-10T08:40:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.573+0000 7f7b827fc640 1 -- 172.21.15.103:0/1819735684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6c00e3d0 con 0x7f7b6c003b60 2024-09-10T08:40:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.573+0000 7f7b827fc640 1 -- 172.21.15.103:0/1819735684 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7b6c00e5d0 con 0x7f7b6c00b630 2024-09-10T08:40:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.573+0000 7f7b82ffd640 1 --2- 172.21.15.103:0/1819735684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b6c008900 0x7f7b6c00ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.573+0000 7f7b837fe640 1 -- 172.21.15.103:0/1819735684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b6c003b60 msgr2=0x7f7b6c003f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:40:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.573+0000 7f7b837fe640 1 --2- 172.21.15.103:0/1819735684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b6c003b60 0x7f7b6c003f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:40:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.574+0000 7f7b83fff640 1 --2- 172.21.15.103:0/1819735684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b6c00b630 0x7f7b6c00daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.575+0000 7f7b82ffd640 1 -- 172.21.15.103:0/1819735684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b6c00b630 msgr2=0x7f7b6c00daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:27.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.575+0000 7f7b82ffd640 1 --2- 172.21.15.103:0/1819735684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b6c00b630 0x7f7b6c00daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.575+0000 7f7b82ffd640 1 -- 172.21.15.103:0/1819735684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b6c003b60 msgr2=0x7f7b6c003f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:40:27.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.575+0000 7f7b82ffd640 1 --2- 172.21.15.103:0/1819735684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b6c003b60 0x7f7b6c003f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.575+0000 7f7b82ffd640 1 -- 172.21.15.103:0/1819735684 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b841565e0 con 0x7f7b6c008900 2024-09-10T08:40:27.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.575+0000 7f7b83fff640 1 -- 172.21.15.103:0/1819735684 reap_dead start 2024-09-10T08:40:27.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.577+0000 7f7b82ffd640 1 --2- 172.21.15.103:0/1819735684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b6c008900 0x7f7b6c00ad90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7b78009900 tx=0x7f7b6c0037f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c588b4678dd87787 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:27.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.578+0000 7f7b827fc640 1 -- 172.21.15.103:0/1819735684 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b78009500 con 0x7f7b6c008900 2024-09-10T08:40:27.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.578+0000 7f7b827fc640 1 -- 172.21.15.103:0/1819735684 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7802e070 con 0x7f7b6c008900 2024-09-10T08:40:27.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.578+0000 7f7b827fc640 1 -- 172.21.15.103:0/1819735684 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b78003e10 con 0x7f7b6c008900 2024-09-10T08:40:27.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.579+0000 7f7b89ed7640 1 -- 172.21.15.103:0/1819735684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b6c008900 msgr2=0x7f7b6c00ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:27.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.579+0000 7f7b89ed7640 1 --2- 172.21.15.103:0/1819735684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b6c008900 0x7f7b6c00ad90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7b78009900 tx=0x7f7b6c0037f0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.579+0000 7f7b89ed7640 1 -- 172.21.15.103:0/1819735684 shutdown_connections 2024-09-10T08:40:27.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.579+0000 7f7b89ed7640 1 --2- 172.21.15.103:0/1819735684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b6c008900 0x7f7b6c00ad90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.579+0000 7f7b89ed7640 1 -- 172.21.15.103:0/1819735684 >> 172.21.15.103:0/1819735684 conn(0x7f7b840c7a40 msgr2=0x7f7b840c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:27.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.579+0000 7f7b89ed7640 1 -- 172.21.15.103:0/1819735684 shutdown_connections 2024-09-10T08:40:27.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.580+0000 7f7b89ed7640 1 -- 172.21.15.103:0/1819735684 wait complete. 2024-09-10T08:40:27.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.581+0000 7f7b89ed7640 1 Processor -- start 2024-09-10T08:40:27.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.582+0000 7f7b89ed7640 1 -- start start 2024-09-10T08:40:27.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.583+0000 7f7b89ed7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b6c008900 0x7f7b8406de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.583+0000 7f7b89ed7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b840745e0 0x7f7b8414ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.583+0000 7f7b89ed7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b8414f1a0 0x7f7b841ef8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.583+0000 7f7b89ed7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8414fe70 con 0x7f7b840745e0 2024-09-10T08:40:27.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.583+0000 7f7b89ed7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7b84152580 con 0x7f7b8414f1a0 2024-09-10T08:40:27.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.583+0000 7f7b89ed7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7b840c8530 con 0x7f7b6c008900 2024-09-10T08:40:27.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.584+0000 7f7b82ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b840745e0 0x7f7b8414ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:27.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.584+0000 7f7b82ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b840745e0 0x7f7b8414ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48872/0 (socket says 172.21.15.103:48872) 2024-09-10T08:40:27.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.584+0000 7f7b82ffd640 1 -- 172.21.15.103:0/3236173311 learned_addr learned my addr 172.21.15.103:0/3236173311 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:27.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.585+0000 7f7b82ffd640 1 -- 172.21.15.103:0/3236173311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b6c008900 msgr2=0x7f7b8406de40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:40:27.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.585+0000 7f7b82ffd640 1 --2- 172.21.15.103:0/3236173311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b6c008900 0x7f7b8406de40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.585+0000 7f7b82ffd640 1 -- 172.21.15.103:0/3236173311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b8414f1a0 msgr2=0x7f7b841ef8b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:40:27.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.585+0000 7f7b82ffd640 1 --2- 172.21.15.103:0/3236173311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b8414f1a0 0x7f7b841ef8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.585+0000 7f7b82ffd640 1 -- 172.21.15.103:0/3236173311 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b8414f620 con 0x7f7b840745e0 2024-09-10T08:40:27.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.585+0000 7f7b82ffd640 1 --2- 172.21.15.103:0/3236173311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b840745e0 0x7f7b8414ec60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7b78000ea0 tx=0x7f7b78005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:27.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.587+0000 7f7b6bfff640 1 -- 172.21.15.103:0/3236173311 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b78005270 con 0x7f7b840745e0 2024-09-10T08:40:27.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.587+0000 7f7b6bfff640 1 -- 172.21.15.103:0/3236173311 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b78042070 con 0x7f7b840745e0 2024-09-10T08:40:27.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.588+0000 7f7b6bfff640 1 -- 172.21.15.103:0/3236173311 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b78005610 con 0x7f7b840745e0 2024-09-10T08:40:27.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.588+0000 7f7b89ed7640 1 -- 172.21.15.103:0/3236173311 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b841533d0 con 0x7f7b840745e0 2024-09-10T08:40:27.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.588+0000 7f7b89ed7640 1 -- 172.21.15.103:0/3236173311 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b8406e380 con 0x7f7b840745e0 2024-09-10T08:40:27.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.590+0000 7f7b69ffb640 1 --2- 172.21.15.103:0/3236173311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b841f2c00 0x7f7b841f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.590+0000 7f7b69ffb640 1 -- 172.21.15.103:0/3236173311 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7b840c5e00 con 0x7f7b841f2c00 2024-09-10T08:40:27.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.592+0000 7f7b837fe640 1 --2- 172.21.15.103:0/3236173311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b841f2c00 0x7f7b841f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:27.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.595+0000 7f7b837fe640 1 -- 172.21.15.103:0/3236173311 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b841f05b0 con 0x7f7b841f2c00 2024-09-10T08:40:27.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.598+0000 7f7b6bfff640 1 -- 172.21.15.103:0/3236173311 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b7803b030 con 0x7f7b840745e0 2024-09-10T08:40:27.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.598+0000 7f7b6bfff640 1 --2- 172.21.15.103:0/3236173311 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7b7006bf30 0x7f7b7006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.598+0000 7f7b6bfff640 1 -- 172.21.15.103:0/3236173311 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f7b780aae60 con 0x7f7b840745e0 2024-09-10T08:40:27.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.599+0000 7f7b83fff640 1 --2- 172.21.15.103:0/3236173311 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7b7006bf30 0x7f7b7006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:27.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.600+0000 7f7b83fff640 1 --2- 172.21.15.103:0/3236173311 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7b7006bf30 0x7f7b7006e3f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7b840c52f0 tx=0x7f7b7c004340 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:27.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.601+0000 7f7b837fe640 1 --2- 172.21.15.103:0/3236173311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b841f2c00 0x7f7b841f2fe0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400c6f0 tx=0x7f7b7400cbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:27.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.601+0000 7f7b6bfff640 1 -- 172.21.15.103:0/3236173311 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b74017070 con 0x7f7b841f2c00 2024-09-10T08:40:27.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.602+0000 7f7b6bfff640 1 -- 172.21.15.103:0/3236173311 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7b740072d0 con 0x7f7b841f2c00 2024-09-10T08:40:27.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.602+0000 7f7b6bfff640 1 -- 172.21.15.103:0/3236173311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b841f2c00 msgr2=0x7f7b841f2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:27.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.602+0000 7f7b6bfff640 1 --2- 172.21.15.103:0/3236173311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b841f2c00 0x7f7b841f2fe0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400c6f0 tx=0x7f7b7400cbb0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.602+0000 7f7b6bfff640 1 -- 172.21.15.103:0/3236173311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b841f2c00 msgr2=0x7f7b841f2fe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:40:27.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.602+0000 7f7b6bfff640 1 --2- 172.21.15.103:0/3236173311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b841f2c00 0x7f7b841f2fe0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400c6f0 tx=0x7f7b7400cbb0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.620+0000 7f7b69ffb640 1 --2- 172.21.15.103:0/3236173311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b841f3520 0x7f7b840a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.621+0000 7f7b69ffb640 1 -- 172.21.15.103:0/3236173311 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7b840c2dd0 con 0x7f7b841f3520 2024-09-10T08:40:27.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.622+0000 7f7b837fe640 1 --2- 172.21.15.103:0/3236173311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b841f3520 0x7f7b840a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:27.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.622+0000 7f7b837fe640 1 -- 172.21.15.103:0/3236173311 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7b840764a0 con 0x7f7b841f3520 2024-09-10T08:40:27.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.623+0000 7f7b837fe640 1 --2- 172.21.15.103:0/3236173311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b841f3520 0x7f7b840a4a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7b74014000 tx=0x7f7b74000fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:27.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.623+0000 7f7b6bfff640 1 -- 172.21.15.103:0/3236173311 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b74017030 con 0x7f7b841f3520 2024-09-10T08:40:27.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.624+0000 7f7b6bfff640 1 -- 172.21.15.103:0/3236173311 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5044 (secure 0 0 0) 0x7f7b74018040 con 0x7f7b841f3520 2024-09-10T08:40:27.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.624+0000 7f7b6bfff640 1 -- 172.21.15.103:0/3236173311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b841f3520 msgr2=0x7f7b840a4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:27.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.624+0000 7f7b6bfff640 1 --2- 172.21.15.103:0/3236173311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b841f3520 0x7f7b840a4a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7b74014000 tx=0x7f7b74000fe0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.624+0000 7f7b6bfff640 1 -- 172.21.15.103:0/3236173311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b841f3520 msgr2=0x7f7b840a4a40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:40:27.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.624+0000 7f7b6bfff640 1 --2- 172.21.15.103:0/3236173311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b841f3520 0x7f7b840a4a40 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7b74014000 tx=0x7f7b74000fe0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.624 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:40:27.624 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:40:27.624 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:40:27.625 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:40:27.625 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 102, 2024-09-10T08:40:27.625 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 120456, 2024-09-10T08:40:27.625 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:40:27.625 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:40:27.625 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:40:27.625 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:27.625 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 1, 2024-09-10T08:40:27.625 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:40:27.625 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:40:27.625 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:40:27.625 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:27.625 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:27.626 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:27.626 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:27.626 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:27.626 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:27.626 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:27.626 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:27.626 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:27.626 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:27.626 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:27.626 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:27.626 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:40:27.626 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:40:27.626 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:27.626 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:27.627 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:27.627 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:27.627 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:27.627 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:27.627 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:27.627 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:27.627 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:27.627 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:27.627 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:27.627 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:27.627 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.627 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:40:27.627 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:40:27.627 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:40:27.628 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:40:27.628 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:40:27.628 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:40:27.628 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:40:27.628 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:40:27.628 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:40:27.628 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:40:27.628 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:40:27.628 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:40:27.628 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:40:27.628 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:40:27.628 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:40:27.629 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:40:27.629 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:40:27.629 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:27.629 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:27.629 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:27.629 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:27.629 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:27.629 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:27.629 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:27.629 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:27.629 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:27.629 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:27.629 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:27.630 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:27.630 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:40:27.630 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.630 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:40:27.630 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.630 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:40:27.630 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:40:27.630 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:27.630 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:27.630 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.630 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:27.630 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:40:27.630 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:27.630 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:40:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:40:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:40:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:40:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:40:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:40:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:40:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:40:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:40:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:40:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:40:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:40:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:40:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:40:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:40:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:40:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:40:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:40:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:40:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:40:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:40:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-10T08:40:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:40:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:40:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:40:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:27.638 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:40:27.638 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:27.638 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:27.638 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:27.638 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:40:27.638 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:40:27.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.624+0000 7f7b69ffb640 1 -- 172.21.15.103:0/3236173311 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7b7006bf30 msgr2=0x7f7b7006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:27.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.624+0000 7f7b69ffb640 1 --2- 172.21.15.103:0/3236173311 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7b7006bf30 0x7f7b7006e3f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7b840c52f0 tx=0x7f7b7c004340 comp rx=0 tx=0).stop 2024-09-10T08:40:27.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.624+0000 7f7b83fff640 1 -- 172.21.15.103:0/3236173311 reap_dead start 2024-09-10T08:40:27.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.624+0000 7f7b69ffb640 1 -- 172.21.15.103:0/3236173311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b840745e0 msgr2=0x7f7b8414ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:27.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.624+0000 7f7b69ffb640 1 --2- 172.21.15.103:0/3236173311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b840745e0 0x7f7b8414ec60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7b78000ea0 tx=0x7f7b78005a10 comp rx=0 tx=0).stop 2024-09-10T08:40:27.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.625+0000 7f7b69ffb640 1 -- 172.21.15.103:0/3236173311 shutdown_connections 2024-09-10T08:40:27.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.625+0000 7f7b69ffb640 1 --2- 172.21.15.103:0/3236173311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b840745e0 0x7f7b8414ec60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.625+0000 7f7b69ffb640 1 -- 172.21.15.103:0/3236173311 >> 172.21.15.103:0/3236173311 conn(0x7f7b840c7a40 msgr2=0x7f7b840a82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:27.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.625+0000 7f7b69ffb640 1 -- 172.21.15.103:0/3236173311 shutdown_connections 2024-09-10T08:40:27.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:27.625+0000 7f7b69ffb640 1 -- 172.21.15.103:0/3236173311 wait complete. 2024-09-10T08:40:27.641 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:40:27.641 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-10T08:40:32.899 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:40:32.904 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:40:47.641 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-10T08:40:47.642 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-10T08:40:47.642 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T08:40:47.642 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T08:40:47.646 INFO:tasks.ceph.mon.b:Started 2024-09-10T08:40:47.646 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:40:47.646 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:40:47.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.841+0000 7ff8216f8640 1 Processor -- start 2024-09-10T08:40:47.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.841+0000 7ff8216f8640 1 -- start start 2024-09-10T08:40:47.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.842+0000 7ff8216f8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff81c0c8530 0x7ff81c0c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:47.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.842+0000 7ff8216f8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff81c0c5940 0x7ff81c0c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:47.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.842+0000 7ff8216f8640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff81c14ff30 con 0x7ff81c06f1d0 2024-09-10T08:40:47.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.843+0000 7ff8216f8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7ff81c0c72b0 con 0x7ff81c0c8530 2024-09-10T08:40:47.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.843+0000 7ff8216f8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff81c152580 con 0x7ff81c0c5940 2024-09-10T08:40:47.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.843+0000 7ff81affd640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff81c06f1d0 0x7ff81c14f820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49764/0 (socket says 172.21.15.103:49764) 2024-09-10T08:40:47.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.843+0000 7ff81affd640 1 -- 172.21.15.103:0/393421600 learned_addr learned my addr 172.21.15.103:0/393421600 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:40:47.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.844+0000 7ff81b7fe640 1 --2- 172.21.15.103:0/393421600 >> v2:172.21.15.154:3300/0 conn(0x7ff81c0c5940 0x7ff81c0c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:47.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.844+0000 7ff81a7fc640 1 --2- 172.21.15.103:0/393421600 >> v2:172.21.15.103:3300/0 conn(0x7ff81c0c8530 0x7ff81c0c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:47.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.844+0000 7ff81b7fe640 1 -- 172.21.15.103:0/393421600 >> v2:172.21.15.154:3300/0 conn(0x7ff81c0c5940 msgr2=0x7ff81c0c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:40:47.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.844+0000 7ff81b7fe640 1 -- 172.21.15.103:0/393421600 >> v2:172.21.15.154:3300/0 conn(0x7ff81c0c5940 msgr2=0x7ff81c0c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:40:47.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.844+0000 7ff81b7fe640 1 --2- 172.21.15.103:0/393421600 >> v2:172.21.15.154:3300/0 conn(0x7ff81c0c5940 0x7ff81c0c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:40:47.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.844+0000 7ff81b7fe640 1 --2- 172.21.15.103:0/393421600 >> v2:172.21.15.154:3300/0 conn(0x7ff81c0c5940 0x7ff81c0c44d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:40:47.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.844+0000 7ff819ffb640 1 -- 172.21.15.103:0/393421600 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3037739212 0 0) 0x7ff81c14ff30 con 0x7ff81c06f1d0 2024-09-10T08:40:47.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.844+0000 7ff819ffb640 1 -- 172.21.15.103:0/393421600 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff804003520 con 0x7ff81c06f1d0 2024-09-10T08:40:47.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.845+0000 7ff81a7fc640 1 -- 172.21.15.103:0/393421600 >> v2:172.21.15.154:3300/0 conn(0x7ff81c0c5940 msgr2=0x7ff81c0c44d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:40:47.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.845+0000 7ff81a7fc640 1 --2- 172.21.15.103:0/393421600 >> v2:172.21.15.154:3300/0 conn(0x7ff81c0c5940 0x7ff81c0c44d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:47.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.845+0000 7ff81a7fc640 1 -- 172.21.15.103:0/393421600 >> v1:172.21.15.103:6789/0 conn(0x7ff81c06f1d0 legacy=0x7ff81c14f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:47.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.845+0000 7ff81a7fc640 1 -- 172.21.15.103:0/393421600 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81c156300 con 0x7ff81c0c8530 2024-09-10T08:40:47.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.846+0000 7ff81a7fc640 1 --2- 172.21.15.103:0/393421600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81c0c8530 0x7ff81c0c2e50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0709c0 tx=0x7ff80c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d527d1befdf46e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:47.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.846+0000 7ff819ffb640 1 -- 172.21.15.103:0/393421600 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80c037070 con 0x7ff81c0c8530 2024-09-10T08:40:47.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.847+0000 7ff819ffb640 1 -- 172.21.15.103:0/393421600 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff80c032440 con 0x7ff81c0c8530 2024-09-10T08:40:47.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.847+0000 7ff819ffb640 1 -- 172.21.15.103:0/393421600 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80c032810 con 0x7ff81c0c8530 2024-09-10T08:40:47.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.847+0000 7ff8216f8640 1 -- 172.21.15.103:0/393421600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81c0c8530 msgr2=0x7ff81c0c2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:47.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.847+0000 7ff8216f8640 1 --2- 172.21.15.103:0/393421600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81c0c8530 0x7ff81c0c2e50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0709c0 tx=0x7ff80c02a1a0 comp rx=0 tx=0).stop 2024-09-10T08:40:47.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.848+0000 7ff8216f8640 1 -- 172.21.15.103:0/393421600 shutdown_connections 2024-09-10T08:40:47.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.848+0000 7ff8216f8640 1 --2- 172.21.15.103:0/393421600 >> v2:172.21.15.154:3300/0 conn(0x7ff81c0c5940 0x7ff81c0c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:47.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.848+0000 7ff8216f8640 1 --2- 172.21.15.103:0/393421600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81c0c8530 0x7ff81c0c2e50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:47.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.848+0000 7ff8216f8640 1 -- 172.21.15.103:0/393421600 >> 172.21.15.103:0/393421600 conn(0x7ff81c0c7a40 msgr2=0x7ff81c0c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:47.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.850+0000 7ff8216f8640 1 -- 172.21.15.103:0/393421600 shutdown_connections 2024-09-10T08:40:47.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.850+0000 7ff8216f8640 1 -- 172.21.15.103:0/393421600 wait complete. 2024-09-10T08:40:47.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.852+0000 7ff8216f8640 1 Processor -- start 2024-09-10T08:40:47.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.852+0000 7ff8216f8640 1 -- start start 2024-09-10T08:40:47.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.853+0000 7ff8216f8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff81c06f1d0 0x7ff81c0bee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:47.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.853+0000 7ff8216f8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff81c0c5940 0x7ff81c070930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:47.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.853+0000 7ff8216f8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81c0bcec0 0x7ff81c0bd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:47.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.853+0000 7ff8216f8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c0c4a10 con 0x7ff81c0bcec0 2024-09-10T08:40:47.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.853+0000 7ff8216f8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c0c2b10 con 0x7ff81c0c5940 2024-09-10T08:40:47.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.853+0000 7ff8216f8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff81c0c4b90 con 0x7ff81c06f1d0 2024-09-10T08:40:47.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.855+0000 7ff81affd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff81c06f1d0 0x7ff81c0bee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:47.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.855+0000 7ff81b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81c0bcec0 0x7ff81c0bd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:47.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.855+0000 7ff81affd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff81c06f1d0 0x7ff81c0bee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:35244/0 (socket says 172.21.15.103:35244) 2024-09-10T08:40:47.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.855+0000 7ff81affd640 1 -- 172.21.15.103:0/2776381874 learned_addr learned my addr 172.21.15.103:0/2776381874 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:47.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.856+0000 7ff81b7fe640 1 -- 172.21.15.103:0/2776381874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff81c06f1d0 msgr2=0x7ff81c0bee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:47.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.856+0000 7ff81b7fe640 1 --2- 172.21.15.103:0/2776381874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff81c06f1d0 0x7ff81c0bee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:47.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.856+0000 7ff81b7fe640 1 -- 172.21.15.103:0/2776381874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff81c0c5940 msgr2=0x7ff81c070930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:47.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.856+0000 7ff81b7fe640 1 --2- 172.21.15.103:0/2776381874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff81c0c5940 0x7ff81c070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:47.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.856+0000 7ff81b7fe640 1 -- 172.21.15.103:0/2776381874 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81c073d10 con 0x7ff81c0bcec0 2024-09-10T08:40:47.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.856+0000 7ff81b7fe640 1 --2- 172.21.15.103:0/2776381874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81c0bcec0 0x7ff81c0bd890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff81000d7d0 tx=0x7ff81000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:47.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.857+0000 7ff8037fe640 1 -- 172.21.15.103:0/2776381874 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff810004020 con 0x7ff81c0bcec0 2024-09-10T08:40:47.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.857+0000 7ff8037fe640 1 -- 172.21.15.103:0/2776381874 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8100041e0 con 0x7ff81c0bcec0 2024-09-10T08:40:47.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.858+0000 7ff8037fe640 1 -- 172.21.15.103:0/2776381874 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8100043d0 con 0x7ff81c0bcec0 2024-09-10T08:40:47.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.858+0000 7ff8216f8640 1 -- 172.21.15.103:0/2776381874 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff81c0bd370 con 0x7ff81c0bcec0 2024-09-10T08:40:47.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.860+0000 7ff8216f8640 1 -- 172.21.15.103:0/2776381874 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff81c0725b0 con 0x7ff81c0bcec0 2024-09-10T08:40:47.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.860+0000 7ff8037fe640 1 -- 172.21.15.103:0/2776381874 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff81001b020 con 0x7ff81c0bcec0 2024-09-10T08:40:47.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.861+0000 7ff8037fe640 1 --2- 172.21.15.103:0/2776381874 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff80806be80 0x7ff80806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:47.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.861+0000 7ff8037fe640 1 -- 172.21.15.103:0/2776381874 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7ff81008a4d0 con 0x7ff81c0bcec0 2024-09-10T08:40:47.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.861+0000 7ff8216f8640 1 -- 172.21.15.103:0/2776381874 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff81c0c4670 con 0x7ff81c0bcec0 2024-09-10T08:40:47.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.862+0000 7ff81affd640 1 --2- 172.21.15.103:0/2776381874 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff80806be80 0x7ff80806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:47.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.862+0000 7ff81affd640 1 --2- 172.21.15.103:0/2776381874 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff80806be80 0x7ff80806e340 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff814001560 tx=0x7ff814009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:47.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:47.870+0000 7ff8037fe640 1 -- 172.21.15.103:0/2776381874 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff810058b60 con 0x7ff81c0bcec0 2024-09-10T08:40:48.356 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":102,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:40:48.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:48.354+0000 7ff8216f8640 1 -- 172.21.15.103:0/2776381874 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff81c0a7090 con 0x7ff81c0bcec0 2024-09-10T08:40:48.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:48.355+0000 7ff8037fe640 1 -- 172.21.15.103:0/2776381874 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7ff810058460 con 0x7ff81c0bcec0 2024-09-10T08:40:48.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:48.358+0000 7ff8216f8640 1 -- 172.21.15.103:0/2776381874 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff80806be80 msgr2=0x7ff80806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:48.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:48.358+0000 7ff8216f8640 1 --2- 172.21.15.103:0/2776381874 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff80806be80 0x7ff80806e340 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff814001560 tx=0x7ff814009040 comp rx=0 tx=0).stop 2024-09-10T08:40:48.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:48.358+0000 7ff8216f8640 1 -- 172.21.15.103:0/2776381874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81c0bcec0 msgr2=0x7ff81c0bd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:48.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:48.358+0000 7ff8216f8640 1 --2- 172.21.15.103:0/2776381874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81c0bcec0 0x7ff81c0bd890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff81000d7d0 tx=0x7ff81000dc90 comp rx=0 tx=0).stop 2024-09-10T08:40:48.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:48.359+0000 7ff8216f8640 1 -- 172.21.15.103:0/2776381874 shutdown_connections 2024-09-10T08:40:48.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:48.359+0000 7ff8216f8640 1 --2- 172.21.15.103:0/2776381874 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff80806be80 0x7ff80806e340 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:48.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:48.359+0000 7ff8216f8640 1 --2- 172.21.15.103:0/2776381874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81c0bcec0 0x7ff81c0bd890 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:48.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:48.359+0000 7ff8216f8640 1 --2- 172.21.15.103:0/2776381874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff81c0c5940 0x7ff81c070930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:48.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:48.359+0000 7ff8216f8640 1 --2- 172.21.15.103:0/2776381874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff81c06f1d0 0x7ff81c0bee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:48.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:48.359+0000 7ff8216f8640 1 -- 172.21.15.103:0/2776381874 >> 172.21.15.103:0/2776381874 conn(0x7ff81c0c7a40 msgr2=0x7ff81c06dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:48.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:48.359+0000 7ff8216f8640 1 -- 172.21.15.103:0/2776381874 shutdown_connections 2024-09-10T08:40:48.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:48.360+0000 7ff8216f8640 1 -- 172.21.15.103:0/2776381874 wait complete. 2024-09-10T08:40:51.383 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:40:51.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.564+0000 7fdaf48ec640 1 Processor -- start 2024-09-10T08:40:51.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.564+0000 7fdaf48ec640 1 -- start start 2024-09-10T08:40:51.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.566+0000 7fdaf48ec640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdaf0157e60 0x7fdaf00c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:51.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.566+0000 7fdaf48ec640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdaf00c5e30 0x7fdaf015a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:51.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.566+0000 7fdaf48ec640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaf00c2400 con 0x7fdaf00c82e0 2024-09-10T08:40:51.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.566+0000 7fdaf48ec640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fdaf00c6310 con 0x7fdaf0157e60 2024-09-10T08:40:51.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.566+0000 7fdaf48ec640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fdaf00c2ca0 con 0x7fdaf00c5e30 2024-09-10T08:40:51.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.566+0000 7fdaef59e640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdaf00c82e0 0x7fdaf015ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49778/0 (socket says 172.21.15.103:49778) 2024-09-10T08:40:51.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.566+0000 7fdaef59e640 1 -- 172.21.15.103:0/2466242865 learned_addr learned my addr 172.21.15.103:0/2466242865 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:40:51.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.566+0000 7fdaeed9d640 1 --2- 172.21.15.103:0/2466242865 >> v2:172.21.15.103:3300/0 conn(0x7fdaf0157e60 0x7fdaf00c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:51.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.566+0000 7fdaee59c640 1 --2- 172.21.15.103:0/2466242865 >> v2:172.21.15.154:3300/0 conn(0x7fdaf00c5e30 0x7fdaf015a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:51.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.567+0000 7fdaee59c640 1 -- 172.21.15.103:0/2466242865 >> v2:172.21.15.154:3300/0 conn(0x7fdaf00c5e30 msgr2=0x7fdaf015a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:40:51.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.567+0000 7fdaee59c640 1 -- 172.21.15.103:0/2466242865 >> v2:172.21.15.154:3300/0 conn(0x7fdaf00c5e30 msgr2=0x7fdaf015a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:40:51.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.567+0000 7fdaee59c640 1 --2- 172.21.15.103:0/2466242865 >> v2:172.21.15.154:3300/0 conn(0x7fdaf00c5e30 0x7fdaf015a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:40:51.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.567+0000 7fdaee59c640 1 --2- 172.21.15.103:0/2466242865 >> v2:172.21.15.154:3300/0 conn(0x7fdaf00c5e30 0x7fdaf015a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:40:51.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.567+0000 7fdaedd9b640 1 -- 172.21.15.103:0/2466242865 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 489311282 0 0) 0x7fdaf00c2400 con 0x7fdaf00c82e0 2024-09-10T08:40:51.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.567+0000 7fdaedd9b640 1 -- 172.21.15.103:0/2466242865 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdad8003520 con 0x7fdaf00c82e0 2024-09-10T08:40:51.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.567+0000 7fdaedd9b640 1 -- 172.21.15.103:0/2466242865 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3367416275 0 0) 0x7fdad8003520 con 0x7fdaf00c82e0 2024-09-10T08:40:51.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.567+0000 7fdaedd9b640 1 -- 172.21.15.103:0/2466242865 >> v2:172.21.15.154:3300/0 conn(0x7fdaf00c5e30 msgr2=0x7fdaf015a8a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:40:51.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.567+0000 7fdaedd9b640 1 --2- 172.21.15.103:0/2466242865 >> v2:172.21.15.154:3300/0 conn(0x7fdaf00c5e30 0x7fdaf015a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:51.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.568+0000 7fdaedd9b640 1 -- 172.21.15.103:0/2466242865 >> v2:172.21.15.103:3300/0 conn(0x7fdaf0157e60 msgr2=0x7fdaf00c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:51.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.568+0000 7fdaedd9b640 1 --2- 172.21.15.103:0/2466242865 >> v2:172.21.15.103:3300/0 conn(0x7fdaf0157e60 0x7fdaf00c7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:51.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.568+0000 7fdaedd9b640 1 -- 172.21.15.103:0/2466242865 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf00c26e0 con 0x7fdaf00c82e0 2024-09-10T08:40:51.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.568+0000 7fdaedd9b640 1 -- 172.21.15.103:0/2466242865 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7fdae80019f0 con 0x7fdaf00c82e0 2024-09-10T08:40:51.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.568+0000 7fdaedd9b640 1 -- 172.21.15.103:0/2466242865 >> v1:172.21.15.103:6789/0 conn(0x7fdaf00c82e0 legacy=0x7fdaf015ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:51.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.568+0000 7fdaedd9b640 1 --2- 172.21.15.103:0/2466242865 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdad8003a00 0x7fdad8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:51.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.568+0000 7fdaedd9b640 1 --2- 172.21.15.103:0/2466242865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdad8004800 0x7fdad8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:51.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.568+0000 7fdaedd9b640 1 --2- 172.21.15.103:0/2466242865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad80051c0 0x7fdad801c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:51.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.568+0000 7fdaedd9b640 1 -- 172.21.15.103:0/2466242865 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf00c2ca0 con 0x7fdad80051c0 2024-09-10T08:40:51.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.568+0000 7fdaedd9b640 1 -- 172.21.15.103:0/2466242865 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdad801d070 con 0x7fdad8004800 2024-09-10T08:40:51.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.568+0000 7fdaedd9b640 1 -- 172.21.15.103:0/2466242865 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fdad801d270 con 0x7fdad8003a00 2024-09-10T08:40:51.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.568+0000 7fdaef59e640 1 --2- 172.21.15.103:0/2466242865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad80051c0 0x7fdad801c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:51.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.568+0000 7fdaeed9d640 1 --2- 172.21.15.103:0/2466242865 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdad8003a00 0x7fdad8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:51.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.568+0000 7fdaef59e640 1 -- 172.21.15.103:0/2466242865 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdad8003a00 msgr2=0x7fdad8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:51.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.569+0000 7fdaef59e640 1 --2- 172.21.15.103:0/2466242865 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdad8003a00 0x7fdad8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:51.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.569+0000 7fdaef59e640 1 -- 172.21.15.103:0/2466242865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdad8004800 msgr2=0x7fdad8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:51.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.569+0000 7fdaef59e640 1 --2- 172.21.15.103:0/2466242865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdad8004800 0x7fdad8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:51.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.569+0000 7fdaef59e640 1 -- 172.21.15.103:0/2466242865 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdad8003520 con 0x7fdad80051c0 2024-09-10T08:40:51.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.570+0000 7fdaef59e640 1 --2- 172.21.15.103:0/2466242865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad80051c0 0x7fdad801c9d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdae800a7d0 tx=0x7fdad8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121e0cbf9d360217 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:51.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.570+0000 7fdaef59e640 1 -- 172.21.15.103:0/2466242865 reap_dead start 2024-09-10T08:40:51.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.570+0000 7fdaedd9b640 1 -- 172.21.15.103:0/2466242865 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae800a3f0 con 0x7fdad80051c0 2024-09-10T08:40:51.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.570+0000 7fdaedd9b640 1 -- 172.21.15.103:0/2466242865 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae802f070 con 0x7fdad80051c0 2024-09-10T08:40:51.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.571+0000 7fdaf48ec640 1 -- 172.21.15.103:0/2466242865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad80051c0 msgr2=0x7fdad801c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:51.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.571+0000 7fdaf48ec640 1 --2- 172.21.15.103:0/2466242865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad80051c0 0x7fdad801c9d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdae800a7d0 tx=0x7fdad8005830 comp rx=0 tx=0).stop 2024-09-10T08:40:51.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.573+0000 7fdaf48ec640 1 -- 172.21.15.103:0/2466242865 shutdown_connections 2024-09-10T08:40:51.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.573+0000 7fdaf48ec640 1 --2- 172.21.15.103:0/2466242865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad80051c0 0x7fdad801c9d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:51.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.573+0000 7fdaf48ec640 1 -- 172.21.15.103:0/2466242865 >> 172.21.15.103:0/2466242865 conn(0x7fdaf006c030 msgr2=0x7fdaf006c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:51.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.574+0000 7fdaf48ec640 1 -- 172.21.15.103:0/2466242865 shutdown_connections 2024-09-10T08:40:51.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.574+0000 7fdaf48ec640 1 -- 172.21.15.103:0/2466242865 wait complete. 2024-09-10T08:40:51.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.576+0000 7fdaf48ec640 1 Processor -- start 2024-09-10T08:40:51.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.576+0000 7fdaf48ec640 1 -- start start 2024-09-10T08:40:51.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.577+0000 7fdaf48ec640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad80051c0 0x7fdaf014f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:51.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.577+0000 7fdaf48ec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf015cc70 0x7fdaf014ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:51.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.577+0000 7fdaf48ec640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf014ef60 0x7fdaf0072b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:51.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.577+0000 7fdaf48ec640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf00c5aa0 con 0x7fdad80051c0 2024-09-10T08:40:51.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.577+0000 7fdaf48ec640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf00c5920 con 0x7fdaf015cc70 2024-09-10T08:40:51.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.577+0000 7fdaf48ec640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fdaf015e450 con 0x7fdaf014ef60 2024-09-10T08:40:51.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.578+0000 7fdaeed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad80051c0 0x7fdaf014f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:51.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.578+0000 7fdaeed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad80051c0 0x7fdaf014f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47984/0 (socket says 172.21.15.103:47984) 2024-09-10T08:40:51.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.578+0000 7fdaeed9d640 1 -- 172.21.15.103:0/757440836 learned_addr learned my addr 172.21.15.103:0/757440836 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:51.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.578+0000 7fdaef59e640 1 --2- 172.21.15.103:0/757440836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf014ef60 0x7fdaf0072b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:51.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.578+0000 7fdaeed9d640 1 -- 172.21.15.103:0/757440836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf014ef60 msgr2=0x7fdaf0072b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:51.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.578+0000 7fdaeed9d640 1 --2- 172.21.15.103:0/757440836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf014ef60 0x7fdaf0072b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:51.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.578+0000 7fdaeed9d640 1 -- 172.21.15.103:0/757440836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf015cc70 msgr2=0x7fdaf014ea20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:40:51.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.578+0000 7fdaeed9d640 1 --2- 172.21.15.103:0/757440836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf015cc70 0x7fdaf014ea20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:51.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.578+0000 7fdaeed9d640 1 -- 172.21.15.103:0/757440836 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf0073fe0 con 0x7fdad80051c0 2024-09-10T08:40:51.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.579+0000 7fdaeed9d640 1 --2- 172.21.15.103:0/757440836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad80051c0 0x7fdaf014f7f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdae4011600 tx=0x7fdae4011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:51.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.579+0000 7fdad77fe640 1 -- 172.21.15.103:0/757440836 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae400f8c0 con 0x7fdad80051c0 2024-09-10T08:40:51.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.580+0000 7fdaf48ec640 1 -- 172.21.15.103:0/757440836 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf00742c0 con 0x7fdad80051c0 2024-09-10T08:40:51.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.582+0000 7fdaf48ec640 1 -- 172.21.15.103:0/757440836 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf00745a0 con 0x7fdad80051c0 2024-09-10T08:40:51.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.583+0000 7fdad77fe640 1 -- 172.21.15.103:0/757440836 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae400fa60 con 0x7fdad80051c0 2024-09-10T08:40:51.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.584+0000 7fdad77fe640 1 -- 172.21.15.103:0/757440836 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae400fe10 con 0x7fdad80051c0 2024-09-10T08:40:51.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.584+0000 7fdad77fe640 1 -- 172.21.15.103:0/757440836 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdae4015460 con 0x7fdad80051c0 2024-09-10T08:40:51.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.584+0000 7fdad77fe640 1 --2- 172.21.15.103:0/757440836 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdadc06bf30 0x7fdadc06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:51.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.585+0000 7fdad77fe640 1 -- 172.21.15.103:0/757440836 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fdae408b270 con 0x7fdad80051c0 2024-09-10T08:40:51.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.586+0000 7fdaee59c640 1 --2- 172.21.15.103:0/757440836 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdadc06bf30 0x7fdadc06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:51.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.587+0000 7fdaf48ec640 1 -- 172.21.15.103:0/757440836 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdad0005290 con 0x7fdad80051c0 2024-09-10T08:40:51.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.587+0000 7fdaee59c640 1 --2- 172.21.15.103:0/757440836 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdadc06bf30 0x7fdadc06e3f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdae00047b0 tx=0x7fdae0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:51.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:51.595+0000 7fdad77fe640 1 -- 172.21.15.103:0/757440836 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdae4019030 con 0x7fdad80051c0 2024-09-10T08:40:52.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:52.078+0000 7fdaf48ec640 1 -- 172.21.15.103:0/757440836 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdad0005850 con 0x7fdad80051c0 2024-09-10T08:40:52.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:52.079+0000 7fdad77fe640 1 -- 172.21.15.103:0/757440836 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7fdae4059950 con 0x7fdad80051c0 2024-09-10T08:40:52.080 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":102,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:40:52.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:52.082+0000 7fdaf48ec640 1 -- 172.21.15.103:0/757440836 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdadc06bf30 msgr2=0x7fdadc06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:52.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:52.082+0000 7fdaf48ec640 1 --2- 172.21.15.103:0/757440836 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdadc06bf30 0x7fdadc06e3f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdae00047b0 tx=0x7fdae0008040 comp rx=0 tx=0).stop 2024-09-10T08:40:52.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:52.083+0000 7fdaf48ec640 1 -- 172.21.15.103:0/757440836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad80051c0 msgr2=0x7fdaf014f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:52.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:52.083+0000 7fdaf48ec640 1 --2- 172.21.15.103:0/757440836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad80051c0 0x7fdaf014f7f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdae4011600 tx=0x7fdae4011ac0 comp rx=0 tx=0).stop 2024-09-10T08:40:52.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:52.083+0000 7fdaf48ec640 1 -- 172.21.15.103:0/757440836 shutdown_connections 2024-09-10T08:40:52.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:52.083+0000 7fdaf48ec640 1 --2- 172.21.15.103:0/757440836 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdadc06bf30 0x7fdadc06e3f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:52.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:52.083+0000 7fdaf48ec640 1 --2- 172.21.15.103:0/757440836 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf014ef60 0x7fdaf0072b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:52.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:52.083+0000 7fdaf48ec640 1 --2- 172.21.15.103:0/757440836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf015cc70 0x7fdaf014ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:52.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:52.083+0000 7fdaf48ec640 1 --2- 172.21.15.103:0/757440836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdad80051c0 0x7fdaf014f7f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:52.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:52.083+0000 7fdaf48ec640 1 -- 172.21.15.103:0/757440836 >> 172.21.15.103:0/757440836 conn(0x7fdaf006c030 msgr2=0x7fdaf0156910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:52.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:52.083+0000 7fdaf48ec640 1 -- 172.21.15.103:0/757440836 shutdown_connections 2024-09-10T08:40:52.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:52.084+0000 7fdaf48ec640 1 -- 172.21.15.103:0/757440836 wait complete. 2024-09-10T08:40:55.109 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:40:55.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.284+0000 7fda069e4640 1 Processor -- start 2024-09-10T08:40:55.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.284+0000 7fda069e4640 1 -- start start 2024-09-10T08:40:55.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.285+0000 7fda069e4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fda0006edd0 0x7fda001562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:55.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.285+0000 7fda069e4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda000c7230 0x7fda00152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:55.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.285+0000 7fda069e4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda000c53f0 con 0x7fda0014f820 2024-09-10T08:40:55.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.285+0000 7fda069e4640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fda000c2d60 con 0x7fda0006edd0 2024-09-10T08:40:55.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.285+0000 7fda069e4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fda000c3040 con 0x7fda000c7230 2024-09-10T08:40:55.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.286+0000 7fd9fffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fda0006edd0 0x7fda001562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:55.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.286+0000 7fd9fffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fda0006edd0 0x7fda001562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40084/0 (socket says 172.21.15.103:40084) 2024-09-10T08:40:55.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.286+0000 7fd9fffff640 1 -- 172.21.15.103:0/435801443 learned_addr learned my addr 172.21.15.103:0/435801443 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:55.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.286+0000 7fd9fffff640 1 -- 172.21.15.103:0/435801443 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda000c7230 msgr2=0x7fda00152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:55.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.286+0000 7fd9fffff640 1 --2- 172.21.15.103:0/435801443 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda000c7230 0x7fda00152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:55.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.286+0000 7fd9fffff640 1 -- 172.21.15.103:0/435801443 >> v1:172.21.15.154:6789/0 conn(0x7fda0014f820 legacy=0x7fda000c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:55.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.286+0000 7fd9fffff640 1 -- 172.21.15.103:0/435801443 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda001526a0 con 0x7fda0006edd0 2024-09-10T08:40:55.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.290+0000 7fd9fffff640 1 --2- 172.21.15.103:0/435801443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda0006edd0 0x7fda001562d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009e50 tx=0x7fd9f802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e52336d9415f19e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:55.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.290+0000 7fd9feffd640 1 -- 172.21.15.103:0/435801443 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8036070 con 0x7fda0006edd0 2024-09-10T08:40:55.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.290+0000 7fd9feffd640 1 -- 172.21.15.103:0/435801443 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f8031600 con 0x7fda0006edd0 2024-09-10T08:40:55.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.290+0000 7fd9feffd640 1 -- 172.21.15.103:0/435801443 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80319d0 con 0x7fda0006edd0 2024-09-10T08:40:55.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.291+0000 7fda069e4640 1 -- 172.21.15.103:0/435801443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda0006edd0 msgr2=0x7fda001562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:55.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.291+0000 7fda069e4640 1 --2- 172.21.15.103:0/435801443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda0006edd0 0x7fda001562d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009e50 tx=0x7fd9f802a5f0 comp rx=0 tx=0).stop 2024-09-10T08:40:55.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.294+0000 7fda069e4640 1 -- 172.21.15.103:0/435801443 shutdown_connections 2024-09-10T08:40:55.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.294+0000 7fda069e4640 1 --2- 172.21.15.103:0/435801443 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda000c7230 0x7fda00152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:55.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.294+0000 7fda069e4640 1 --2- 172.21.15.103:0/435801443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda0006edd0 0x7fda001562d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:55.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.294+0000 7fda069e4640 1 -- 172.21.15.103:0/435801443 >> 172.21.15.103:0/435801443 conn(0x7fda000c7a40 msgr2=0x7fda000c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:55.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.297+0000 7fda069e4640 1 -- 172.21.15.103:0/435801443 shutdown_connections 2024-09-10T08:40:55.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.298+0000 7fda069e4640 1 -- 172.21.15.103:0/435801443 wait complete. 2024-09-10T08:40:55.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.300+0000 7fda069e4640 1 Processor -- start 2024-09-10T08:40:55.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.300+0000 7fda069e4640 1 -- start start 2024-09-10T08:40:55.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.301+0000 7fda069e4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda000c7230 0x7fda000a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:55.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.301+0000 7fda069e4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda0014f820 0x7fda000a8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:55.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.301+0000 7fda069e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda0014a520 0x7fda0014ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:55.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.302+0000 7fd9ff7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda0014f820 0x7fda000a8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:55.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.302+0000 7fd9fffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda000c7230 0x7fda000a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:55.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.302+0000 7fda069e4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fda000c5d70 con 0x7fda000c7230 2024-09-10T08:40:55.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.302+0000 7fd9fffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda000c7230 0x7fda000a9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40092/0 (socket says 172.21.15.103:40092) 2024-09-10T08:40:55.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.302+0000 7fd9fffff640 1 -- 172.21.15.103:0/2566290608 learned_addr learned my addr 172.21.15.103:0/2566290608 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:55.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.302+0000 7fda04f81640 1 --2- 172.21.15.103:0/2566290608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda0014a520 0x7fda0014ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:55.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.302+0000 7fda069e4640 1 -- 172.21.15.103:0/2566290608 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fda000c5bf0 con 0x7fda0014a520 2024-09-10T08:40:55.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.302+0000 7fda069e4640 1 -- 172.21.15.103:0/2566290608 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fda00153100 con 0x7fda0014f820 2024-09-10T08:40:55.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.304+0000 7fda04f81640 1 -- 172.21.15.103:0/2566290608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda0014a520 msgr2=0x7fda0014ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-10T08:40:55.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.304+0000 7fda04f81640 1 -- 172.21.15.103:0/2566290608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda0014a520 msgr2=0x7fda0014ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:40:55.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.304+0000 7fda04f81640 1 --2- 172.21.15.103:0/2566290608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda0014a520 0x7fda0014ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:40:55.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.304+0000 7fda04f81640 1 --2- 172.21.15.103:0/2566290608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda0014a520 0x7fda0014ec70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:40:55.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.304+0000 7fd9ff7fe640 1 -- 172.21.15.103:0/2566290608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda0014a520 msgr2=0x7fda0014ec70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:40:55.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.304+0000 7fd9ff7fe640 1 --2- 172.21.15.103:0/2566290608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda0014a520 0x7fda0014ec70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:55.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.304+0000 7fd9ff7fe640 1 -- 172.21.15.103:0/2566290608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda000c7230 msgr2=0x7fda000a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:55.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.304+0000 7fd9ff7fe640 1 --2- 172.21.15.103:0/2566290608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda000c7230 0x7fda000a9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:55.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.304+0000 7fd9ff7fe640 1 -- 172.21.15.103:0/2566290608 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda000a75e0 con 0x7fda0014f820 2024-09-10T08:40:55.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.304+0000 7fd9fffff640 1 --2- 172.21.15.103:0/2566290608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda000c7230 0x7fda000a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:40:55.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.305+0000 7fd9ff7fe640 1 --2- 172.21.15.103:0/2566290608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda0014f820 0x7fda000a8ac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400b420 tx=0x7fd9f400b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:55.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.305+0000 7fd9fcff9640 1 -- 172.21.15.103:0/2566290608 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4011830 con 0x7fda0014f820 2024-09-10T08:40:55.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.305+0000 7fda069e4640 1 -- 172.21.15.103:0/2566290608 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda000a78c0 con 0x7fda0014f820 2024-09-10T08:40:55.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.305+0000 7fd9fcff9640 1 -- 172.21.15.103:0/2566290608 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f4016070 con 0x7fda0014f820 2024-09-10T08:40:55.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.305+0000 7fd9fcff9640 1 -- 172.21.15.103:0/2566290608 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4011bd0 con 0x7fda0014f820 2024-09-10T08:40:55.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.305+0000 7fda069e4640 1 -- 172.21.15.103:0/2566290608 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fda000a7e80 con 0x7fda0014f820 2024-09-10T08:40:55.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.308+0000 7fd9fcff9640 1 -- 172.21.15.103:0/2566290608 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd9f401b460 con 0x7fda0014f820 2024-09-10T08:40:55.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.308+0000 7fda069e4640 1 -- 172.21.15.103:0/2566290608 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda0014fc90 con 0x7fda0014f820 2024-09-10T08:40:55.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.308+0000 7fd9fcff9640 1 --2- 172.21.15.103:0/2566290608 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd9ec06be60 0x7fd9ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:55.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.308+0000 7fd9fcff9640 1 -- 172.21.15.103:0/2566290608 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fd9f408af10 con 0x7fda0014f820 2024-09-10T08:40:55.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.309+0000 7fd9fffff640 1 --2- 172.21.15.103:0/2566290608 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd9ec06be60 0x7fd9ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:55.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.310+0000 7fd9fffff640 1 --2- 172.21.15.103:0/2566290608 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd9ec06be60 0x7fd9ec06e320 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd9f802a630 tx=0x7fd9f8009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:55.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.317+0000 7fd9fcff9640 1 -- 172.21.15.103:0/2566290608 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd9f40593f0 con 0x7fda0014f820 2024-09-10T08:40:55.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.789+0000 7fda069e4640 1 -- 172.21.15.103:0/2566290608 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fda00151500 con 0x7fda0014f820 2024-09-10T08:40:55.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.791+0000 7fd9fcff9640 1 -- 172.21.15.103:0/2566290608 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fd9f4058cf0 con 0x7fda0014f820 2024-09-10T08:40:55.791 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":104,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:40:55.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.794+0000 7fda069e4640 1 -- 172.21.15.103:0/2566290608 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd9ec06be60 msgr2=0x7fd9ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:55.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.794+0000 7fda069e4640 1 --2- 172.21.15.103:0/2566290608 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd9ec06be60 0x7fd9ec06e320 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd9f802a630 tx=0x7fd9f8009000 comp rx=0 tx=0).stop 2024-09-10T08:40:55.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.794+0000 7fda069e4640 1 -- 172.21.15.103:0/2566290608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda0014f820 msgr2=0x7fda000a8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:55.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.794+0000 7fda069e4640 1 --2- 172.21.15.103:0/2566290608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda0014f820 0x7fda000a8ac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400b420 tx=0x7fd9f400b8e0 comp rx=0 tx=0).stop 2024-09-10T08:40:55.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.795+0000 7fda069e4640 1 -- 172.21.15.103:0/2566290608 shutdown_connections 2024-09-10T08:40:55.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.795+0000 7fda069e4640 1 --2- 172.21.15.103:0/2566290608 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd9ec06be60 0x7fd9ec06e320 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:55.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.795+0000 7fda069e4640 1 --2- 172.21.15.103:0/2566290608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda0014a520 0x7fda0014ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:55.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.795+0000 7fda069e4640 1 --2- 172.21.15.103:0/2566290608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda0014f820 0x7fda000a8ac0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:55.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.795+0000 7fda069e4640 1 --2- 172.21.15.103:0/2566290608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda000c7230 0x7fda000a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:55.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.795+0000 7fda069e4640 1 -- 172.21.15.103:0/2566290608 >> 172.21.15.103:0/2566290608 conn(0x7fda000c7a40 msgr2=0x7fda000c1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:55.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.796+0000 7fda069e4640 1 -- 172.21.15.103:0/2566290608 shutdown_connections 2024-09-10T08:40:55.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:55.796+0000 7fda069e4640 1 -- 172.21.15.103:0/2566290608 wait complete. 2024-09-10T08:40:55.818 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:40:55.819 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:40:55.819 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:40:56.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.016+0000 7fe83a8cf640 1 Processor -- start 2024-09-10T08:40:56.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.017+0000 7fe83a8cf640 1 -- start start 2024-09-10T08:40:56.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.018+0000 7fe83a8cf640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe82c0d8170 0x7fe82c04a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:56.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.018+0000 7fe83a8cf640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe82c0072a0 0x7fe82c00b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:56.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.018+0000 7fe83a8cf640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe82c00b620 0x7fe82c0ddfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:56.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.018+0000 7fe83a8cf640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fe82c046d10 con 0x7fe82c00b620 2024-09-10T08:40:56.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.018+0000 7fe83a8cf640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe82c04b190 con 0x7fe82c0d8170 2024-09-10T08:40:56.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.018+0000 7fe83a8cf640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe82c04aeb0 con 0x7fe82c0072a0 2024-09-10T08:40:56.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.018+0000 7fe83a0ce640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe82c00b620 0x7fe82c0ddfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:56.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.018+0000 7fe83a0ce640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe82c00b620 0x7fe82c0ddfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40100/0 (socket says 172.21.15.103:40100) 2024-09-10T08:40:56.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.018+0000 7fe83a0ce640 1 -- 172.21.15.103:0/3613935782 learned_addr learned my addr 172.21.15.103:0/3613935782 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:56.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.019+0000 7fe8398cd640 1 --2- 172.21.15.103:0/3613935782 >> v2:172.21.15.154:3300/0 conn(0x7fe82c0d8170 0x7fe82c04a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:56.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.019+0000 7fe83a0ce640 1 -- 172.21.15.103:0/3613935782 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe82c0072a0 msgr2=0x7fe82c00b0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:40:56.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.019+0000 7fe83a0ce640 1 --2- 172.21.15.103:0/3613935782 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe82c0072a0 0x7fe82c00b0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:56.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.019+0000 7fe83a0ce640 1 -- 172.21.15.103:0/3613935782 >> v2:172.21.15.154:3300/0 conn(0x7fe82c0d8170 msgr2=0x7fe82c04a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:56.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.019+0000 7fe83a0ce640 1 --2- 172.21.15.103:0/3613935782 >> v2:172.21.15.154:3300/0 conn(0x7fe82c0d8170 0x7fe82c04a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:56.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.019+0000 7fe83a0ce640 1 -- 172.21.15.103:0/3613935782 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c0472d0 con 0x7fe82c00b620 2024-09-10T08:40:56.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.020+0000 7fe83a0ce640 1 --2- 172.21.15.103:0/3613935782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c00b620 0x7fe82c0ddfc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00d290 tx=0x7fe83002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1ef943ba83a138 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:56.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.021+0000 7fe8388cb640 1 -- 172.21.15.103:0/3613935782 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe830037070 con 0x7fe82c00b620 2024-09-10T08:40:56.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.021+0000 7fe8388cb640 1 -- 172.21.15.103:0/3613935782 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe830032440 con 0x7fe82c00b620 2024-09-10T08:40:56.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.022+0000 7fe83a8cf640 1 -- 172.21.15.103:0/3613935782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c00b620 msgr2=0x7fe82c0ddfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:56.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.022+0000 7fe83a8cf640 1 --2- 172.21.15.103:0/3613935782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c00b620 0x7fe82c0ddfc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00d290 tx=0x7fe83002a210 comp rx=0 tx=0).stop 2024-09-10T08:40:56.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.023+0000 7fe83a8cf640 1 -- 172.21.15.103:0/3613935782 shutdown_connections 2024-09-10T08:40:56.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.023+0000 7fe83a8cf640 1 --2- 172.21.15.103:0/3613935782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c00b620 0x7fe82c0ddfc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:56.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.023+0000 7fe83a8cf640 1 --2- 172.21.15.103:0/3613935782 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe82c0072a0 0x7fe82c00b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:56.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.023+0000 7fe83a8cf640 1 --2- 172.21.15.103:0/3613935782 >> v2:172.21.15.154:3300/0 conn(0x7fe82c0d8170 0x7fe82c04a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:56.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.023+0000 7fe83a8cf640 1 -- 172.21.15.103:0/3613935782 >> 172.21.15.103:0/3613935782 conn(0x7fe82c048160 msgr2=0x7fe82c048570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:56.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.025+0000 7fe83a8cf640 1 -- 172.21.15.103:0/3613935782 shutdown_connections 2024-09-10T08:40:56.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.025+0000 7fe83a8cf640 1 -- 172.21.15.103:0/3613935782 wait complete. 2024-09-10T08:40:56.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.027+0000 7fe83a8cf640 1 Processor -- start 2024-09-10T08:40:56.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.027+0000 7fe83a8cf640 1 -- start start 2024-09-10T08:40:56.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.029+0000 7fe83a8cf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe82c0072a0 0x7fe82c041df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:56.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.030+0000 7fe83a8cf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c00b620 0x7fe82c03ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:56.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.030+0000 7fe83a8cf640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe82c0d8170 0x7fe82c0404d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:56.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.030+0000 7fe83a8cf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c047db0 con 0x7fe82c00b620 2024-09-10T08:40:56.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.030+0000 7fe83a8cf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c047890 con 0x7fe82c0072a0 2024-09-10T08:40:56.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.030+0000 7fe83a8cf640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe82c047f30 con 0x7fe82c0d8170 2024-09-10T08:40:56.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.030+0000 7fe8390cc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c00b620 0x7fe82c03ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:56.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.030+0000 7fe8398cd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe82c0072a0 0x7fe82c041df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:56.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.030+0000 7fe8398cd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe82c0072a0 0x7fe82c041df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:50986/0 (socket says 172.21.15.103:50986) 2024-09-10T08:40:56.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.030+0000 7fe8398cd640 1 -- 172.21.15.103:0/1848090519 learned_addr learned my addr 172.21.15.103:0/1848090519 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:56.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.030+0000 7fe8390cc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c00b620 0x7fe82c03ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40108/0 (socket says 172.21.15.103:40108) 2024-09-10T08:40:56.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.030+0000 7fe8398cd640 1 -- 172.21.15.103:0/1848090519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe82c0072a0 msgr2=0x7fe82c041df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-10T08:40:56.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.030+0000 7fe8398cd640 1 -- 172.21.15.103:0/1848090519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe82c0072a0 msgr2=0x7fe82c041df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:40:56.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.030+0000 7fe8398cd640 1 --2- 172.21.15.103:0/1848090519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe82c0072a0 0x7fe82c041df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:40:56.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.030+0000 7fe8398cd640 1 --2- 172.21.15.103:0/1848090519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe82c0072a0 0x7fe82c041df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:40:56.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.030+0000 7fe83a0ce640 1 --2- 172.21.15.103:0/1848090519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe82c0d8170 0x7fe82c0404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:56.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.031+0000 7fe8390cc640 1 -- 172.21.15.103:0/1848090519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe82c0d8170 msgr2=0x7fe82c0404d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:56.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.031+0000 7fe8390cc640 1 --2- 172.21.15.103:0/1848090519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe82c0d8170 0x7fe82c0404d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:56.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.031+0000 7fe8390cc640 1 -- 172.21.15.103:0/1848090519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe82c0072a0 msgr2=0x7fe82c041df0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:40:56.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.031+0000 7fe8390cc640 1 --2- 172.21.15.103:0/1848090519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe82c0072a0 0x7fe82c041df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:56.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.031+0000 7fe8390cc640 1 -- 172.21.15.103:0/1848090519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c0db930 con 0x7fe82c00b620 2024-09-10T08:40:56.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.031+0000 7fe8390cc640 1 --2- 172.21.15.103:0/1848090519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c00b620 0x7fe82c03ff90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe824009fd0 tx=0x7fe82400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:56.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.033+0000 7fe82a7fc640 1 -- 172.21.15.103:0/1848090519 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824015020 con 0x7fe82c00b620 2024-09-10T08:40:56.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.034+0000 7fe82a7fc640 1 -- 172.21.15.103:0/1848090519 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe824011830 con 0x7fe82c00b620 2024-09-10T08:40:56.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.035+0000 7fe83a8cf640 1 -- 172.21.15.103:0/1848090519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe82c0deb00 con 0x7fe82c00b620 2024-09-10T08:40:56.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.035+0000 7fe83a8cf640 1 -- 172.21.15.103:0/1848090519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe82c17d200 con 0x7fe82c00b620 2024-09-10T08:40:56.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.035+0000 7fe82a7fc640 1 -- 172.21.15.103:0/1848090519 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824015020 con 0x7fe82c00b620 2024-09-10T08:40:56.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.036+0000 7fe83a8cf640 1 --2- 172.21.15.103:0/1848090519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c006e60 0x7fe82c0d3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:56.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.036+0000 7fe83a8cf640 1 -- 172.21.15.103:0/1848090519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c03f670 con 0x7fe82c006e60 2024-09-10T08:40:56.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.036+0000 7fe8398cd640 1 --2- 172.21.15.103:0/1848090519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c006e60 0x7fe82c0d3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:56.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.037+0000 7fe8398cd640 1 -- 172.21.15.103:0/1848090519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe82c00b0e0 con 0x7fe82c006e60 2024-09-10T08:40:56.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.037+0000 7fe8398cd640 1 --2- 172.21.15.103:0/1848090519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c006e60 0x7fe82c0d3900 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe83406b8c0 tx=0x7fe8340699a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:56.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.038+0000 7fe82a7fc640 1 -- 172.21.15.103:0/1848090519 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe834067950 con 0x7fe82c006e60 2024-09-10T08:40:56.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.038+0000 7fe82a7fc640 1 -- 172.21.15.103:0/1848090519 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe834067af0 con 0x7fe82c006e60 2024-09-10T08:40:56.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.038+0000 7fe82a7fc640 1 -- 172.21.15.103:0/1848090519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c006e60 msgr2=0x7fe82c0d3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:56.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.038+0000 7fe82a7fc640 1 --2- 172.21.15.103:0/1848090519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c006e60 0x7fe82c0d3900 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe83406b8c0 tx=0x7fe8340699a0 comp rx=0 tx=0).stop 2024-09-10T08:40:56.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.038+0000 7fe82a7fc640 1 -- 172.21.15.103:0/1848090519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c006e60 msgr2=0x7fe82c0d3900 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:40:56.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.038+0000 7fe82a7fc640 1 --2- 172.21.15.103:0/1848090519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c006e60 0x7fe82c0d3900 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe83406b8c0 tx=0x7fe8340699a0 comp rx=0 tx=0).stop 2024-09-10T08:40:56.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.042+0000 7fe82a7fc640 1 -- 172.21.15.103:0/1848090519 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe824018020 con 0x7fe82c00b620 2024-09-10T08:40:56.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.043+0000 7fe82a7fc640 1 --2- 172.21.15.103:0/1848090519 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe81806bc20 0x7fe81806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:56.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.044+0000 7fe82a7fc640 1 -- 172.21.15.103:0/1848090519 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fe824011630 con 0x7fe82c00b620 2024-09-10T08:40:56.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.049+0000 7fe8398cd640 1 --2- 172.21.15.103:0/1848090519 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe81806bc20 0x7fe81806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:56.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.049+0000 7fe8398cd640 1 --2- 172.21.15.103:0/1848090519 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe81806bc20 0x7fe81806e0e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe82c007270 tx=0x7fe83408f070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:56.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.052+0000 7fe83a8cf640 1 --2- 172.21.15.103:0/1848090519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c0dbe30 0x7fe82c0d3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:56.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.052+0000 7fe83a8cf640 1 -- 172.21.15.103:0/1848090519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c0d4380 con 0x7fe82c0dbe30 2024-09-10T08:40:56.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.053+0000 7fe83a0ce640 1 --2- 172.21.15.103:0/1848090519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c0dbe30 0x7fe82c0d3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:56.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.054+0000 7fe83a0ce640 1 -- 172.21.15.103:0/1848090519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe82c049c40 con 0x7fe82c0dbe30 2024-09-10T08:40:56.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.054+0000 7fe83a0ce640 1 --2- 172.21.15.103:0/1848090519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c0dbe30 0x7fe82c0d3e40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0df110 tx=0x7fe8300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:56.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.055+0000 7fe82a7fc640 1 -- 172.21.15.103:0/1848090519 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe830042070 con 0x7fe82c0dbe30 2024-09-10T08:40:56.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.057+0000 7fe82a7fc640 1 -- 172.21.15.103:0/1848090519 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4889 (secure 0 0 0) 0x7fe830032440 con 0x7fe82c0dbe30 2024-09-10T08:40:56.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.058+0000 7fe82a7fc640 1 -- 172.21.15.103:0/1848090519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c0dbe30 msgr2=0x7fe82c0d3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:56.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.058+0000 7fe82a7fc640 1 --2- 172.21.15.103:0/1848090519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c0dbe30 0x7fe82c0d3e40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0df110 tx=0x7fe8300046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:56.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.058+0000 7fe82a7fc640 1 -- 172.21.15.103:0/1848090519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c0dbe30 msgr2=0x7fe82c0d3e40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:40:56.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.058+0000 7fe82a7fc640 1 --2- 172.21.15.103:0/1848090519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c0dbe30 0x7fe82c0d3e40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:56.059 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:40:56.059 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:40:56.059 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:40:56.060 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:40:56.060 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 104, 2024-09-10T08:40:56.060 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 82520, 2024-09-10T08:40:56.060 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:40:56.060 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:40:56.060 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:40:56.060 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:40:56.060 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:56.060 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 3, 2024-09-10T08:40:56.060 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:40:56.060 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:40:56.060 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:40:56.060 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:56.061 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:56.061 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:56.061 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:56.061 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:56.061 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:56.061 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:56.061 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:56.061 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:56.061 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:56.061 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:56.061 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:56.062 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:40:56.062 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:40:56.062 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:56.062 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:56.062 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:56.062 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:56.062 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:56.062 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:56.062 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:56.062 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:56.062 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:56.062 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:56.063 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:56.063 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:56.063 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:56.063 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:40:56.063 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:40:56.063 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:40:56.063 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:40:56.063 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:40:56.063 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:40:56.063 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:40:56.063 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:40:56.063 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:40:56.063 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:40:56.063 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:40:56.064 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:40:56.064 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:40:56.064 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:40:56.064 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:40:56.064 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:40:56.064 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:40:56.064 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:56.064 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:56.064 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:56.064 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:56.064 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:56.064 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:56.064 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:56.065 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:56.065 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:56.065 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:56.065 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:56.065 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:56.065 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:40:56.065 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:56.065 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:40:56.065 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:56.065 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:40:56.065 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:40:56.065 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:56.065 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:56.065 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:56.066 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:56.066 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:40:56.066 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:56.066 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:56.066 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:56.066 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:56.066 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:40:56.066 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:56.066 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:56.066 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:56.066 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:56.066 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:40:56.066 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:40:56.067 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:56.067 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:56.067 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:56.067 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:56.067 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:56.067 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:40:56.067 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:40:56.067 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:56.067 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:56.067 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:56.067 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:56.067 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:40:56.067 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:56.067 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:56.068 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:56.068 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:56.068 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:40:56.068 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:56.068 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:56.068 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:56.068 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:56.068 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:40:56.068 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:40:56.068 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:56.068 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:56.068 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:56.068 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:56.068 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:56.069 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:40:56.069 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:40:56.069 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:56.069 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:56.069 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:56.069 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:56.069 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:40:56.069 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:56.069 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:56.069 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:56.069 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:56.069 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:40:56.070 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:56.070 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:56.070 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:56.070 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:56.070 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:40:56.070 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:40:56.070 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:56.070 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:56.070 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:56.070 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:56.070 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:56.070 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:56.070 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:40:56.070 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:40:56.071 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:56.071 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:56.071 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:56.071 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:40:56.071 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:56.071 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:56.071 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:40:56.071 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:56.071 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:56.071 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:56.071 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:40:56.071 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:56.071 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:56.072 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:40:56.072 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:56.072 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:56.072 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:56.072 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:40:56.072 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:56.072 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:56.072 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:40:56.072 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:56.072 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:56.072 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:56.072 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:40:56.072 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:56.072 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:56.073 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:56.073 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:40:56.073 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:40:56.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.061+0000 7fe83a8cf640 1 -- 172.21.15.103:0/1848090519 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe81806bc20 msgr2=0x7fe81806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:56.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.061+0000 7fe83a8cf640 1 --2- 172.21.15.103:0/1848090519 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe81806bc20 0x7fe81806e0e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe82c007270 tx=0x7fe83408f070 comp rx=0 tx=0).stop 2024-09-10T08:40:56.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.061+0000 7fe83a8cf640 1 -- 172.21.15.103:0/1848090519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c00b620 msgr2=0x7fe82c03ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:56.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.061+0000 7fe83a8cf640 1 --2- 172.21.15.103:0/1848090519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe82c00b620 0x7fe82c03ff90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe824009fd0 tx=0x7fe82400b870 comp rx=0 tx=0).stop 2024-09-10T08:40:56.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.061+0000 7fe83a0ce640 1 -- 172.21.15.103:0/1848090519 reap_dead start 2024-09-10T08:40:56.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.061+0000 7fe83a8cf640 1 -- 172.21.15.103:0/1848090519 shutdown_connections 2024-09-10T08:40:56.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.061+0000 7fe83a8cf640 1 -- 172.21.15.103:0/1848090519 >> 172.21.15.103:0/1848090519 conn(0x7fe82c048160 msgr2=0x7fe82c0d6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:56.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.061+0000 7fe83a8cf640 1 -- 172.21.15.103:0/1848090519 shutdown_connections 2024-09-10T08:40:56.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.061+0000 7fe83a8cf640 1 -- 172.21.15.103:0/1848090519 wait complete. 2024-09-10T08:40:56.090 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:40:56.091 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:40:56.091 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:40:56.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.267+0000 7f1d60cdd640 1 Processor -- start 2024-09-10T08:40:56.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.267+0000 7f1d60cdd640 1 -- start start 2024-09-10T08:40:56.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.268+0000 7f1d60cdd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1d5c0abc80 0x7f1d5c0c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:56.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.268+0000 7f1d60cdd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d5c0c4320 0x7f1d5c06e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:56.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.268+0000 7f1d60cdd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1d5c0c4760 0x7f1d5c06e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:56.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.268+0000 7f1d60cdd640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f1d5c0c3950 con 0x7f1d5c0c4760 2024-09-10T08:40:56.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.268+0000 7f1d60cdd640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1d5c0ac490 con 0x7f1d5c0abc80 2024-09-10T08:40:56.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.268+0000 7f1d60cdd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1d5c068010 con 0x7f1d5c0c4320 2024-09-10T08:40:56.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.269+0000 7f1d5a59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1d5c0abc80 0x7f1d5c0c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:56.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.269+0000 7f1d5ad9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1d5c0c4760 0x7f1d5c06e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:56.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.269+0000 7f1d5ad9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1d5c0c4760 0x7f1d5c06e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40142/0 (socket says 172.21.15.103:40142) 2024-09-10T08:40:56.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.269+0000 7f1d5ad9d640 1 -- 172.21.15.103:0/2869262136 learned_addr learned my addr 172.21.15.103:0/2869262136 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:56.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.270+0000 7f1d5a59c640 1 -- 172.21.15.103:0/2869262136 >> v2:172.21.15.154:3300/0 conn(0x7f1d5c0abc80 msgr2=0x7f1d5c0c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:40:56.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.270+0000 7f1d5a59c640 1 -- 172.21.15.103:0/2869262136 >> v2:172.21.15.154:3300/0 conn(0x7f1d5c0abc80 msgr2=0x7f1d5c0c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:40:56.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.270+0000 7f1d5a59c640 1 --2- 172.21.15.103:0/2869262136 >> v2:172.21.15.154:3300/0 conn(0x7f1d5c0abc80 0x7f1d5c0c3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:40:56.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.270+0000 7f1d5a59c640 1 --2- 172.21.15.103:0/2869262136 >> v2:172.21.15.154:3300/0 conn(0x7f1d5c0abc80 0x7f1d5c0c3de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:40:56.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.270+0000 7f1d5ad9d640 1 -- 172.21.15.103:0/2869262136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d5c0c4320 msgr2=0x7f1d5c06e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:56.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.270+0000 7f1d53fff640 1 --2- 172.21.15.103:0/2869262136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d5c0c4320 0x7f1d5c06e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:56.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.270+0000 7f1d5ad9d640 1 --2- 172.21.15.103:0/2869262136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d5c0c4320 0x7f1d5c06e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:56.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.270+0000 7f1d5ad9d640 1 -- 172.21.15.103:0/2869262136 >> v2:172.21.15.154:3300/0 conn(0x7f1d5c0abc80 msgr2=0x7f1d5c0c3de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:40:56.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.270+0000 7f1d5ad9d640 1 --2- 172.21.15.103:0/2869262136 >> v2:172.21.15.154:3300/0 conn(0x7f1d5c0abc80 0x7f1d5c0c3de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:56.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.270+0000 7f1d5ad9d640 1 -- 172.21.15.103:0/2869262136 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5c0ada30 con 0x7f1d5c0c4760 2024-09-10T08:40:56.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.271+0000 7f1d53fff640 1 --2- 172.21.15.103:0/2869262136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d5c0c4320 0x7f1d5c06e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:40:56.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.271+0000 7f1d5ad9d640 1 --2- 172.21.15.103:0/2869262136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5c0c4760 0x7f1d5c06e5a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c06f0e0 tx=0x7f1d5402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=342dcc0f04a96228 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:56.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.272+0000 7f1d59d9b640 1 -- 172.21.15.103:0/2869262136 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d54036070 con 0x7f1d5c0c4760 2024-09-10T08:40:56.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.272+0000 7f1d59d9b640 1 -- 172.21.15.103:0/2869262136 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d54031600 con 0x7f1d5c0c4760 2024-09-10T08:40:56.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.272+0000 7f1d59d9b640 1 -- 172.21.15.103:0/2869262136 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d54031a10 con 0x7f1d5c0c4760 2024-09-10T08:40:56.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.273+0000 7f1d60cdd640 1 -- 172.21.15.103:0/2869262136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5c0c4760 msgr2=0x7f1d5c06e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:56.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.273+0000 7f1d60cdd640 1 --2- 172.21.15.103:0/2869262136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5c0c4760 0x7f1d5c06e5a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c06f0e0 tx=0x7f1d5402a6f0 comp rx=0 tx=0).stop 2024-09-10T08:40:56.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.273+0000 7f1d60cdd640 1 -- 172.21.15.103:0/2869262136 shutdown_connections 2024-09-10T08:40:56.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.273+0000 7f1d60cdd640 1 --2- 172.21.15.103:0/2869262136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5c0c4760 0x7f1d5c06e5a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:56.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.273+0000 7f1d60cdd640 1 --2- 172.21.15.103:0/2869262136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d5c0c4320 0x7f1d5c06e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:56.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.273+0000 7f1d60cdd640 1 --2- 172.21.15.103:0/2869262136 >> v2:172.21.15.154:3300/0 conn(0x7f1d5c0abc80 0x7f1d5c0c3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:56.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.273+0000 7f1d60cdd640 1 -- 172.21.15.103:0/2869262136 >> 172.21.15.103:0/2869262136 conn(0x7f1d5c0c83a0 msgr2=0x7f1d5c0c8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:56.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.273+0000 7f1d60cdd640 1 -- 172.21.15.103:0/2869262136 shutdown_connections 2024-09-10T08:40:56.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.275+0000 7f1d60cdd640 1 -- 172.21.15.103:0/2869262136 wait complete. 2024-09-10T08:40:56.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.277+0000 7f1d60cdd640 1 Processor -- start 2024-09-10T08:40:56.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.278+0000 7f1d60cdd640 1 -- start start 2024-09-10T08:40:56.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.279+0000 7f1d60cdd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d5c0abc80 0x7f1d5c1f3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:56.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.279+0000 7f1d60cdd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5c0c4320 0x7f1d5c1f05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:56.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.279+0000 7f1d60cdd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d5c0c4760 0x7f1d5c071820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:56.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.279+0000 7f1d60cdd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c067d30 con 0x7f1d5c0c4320 2024-09-10T08:40:56.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.279+0000 7f1d60cdd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c0adcd0 con 0x7f1d5c0abc80 2024-09-10T08:40:56.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.279+0000 7f1d60cdd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1d5c06faa0 con 0x7f1d5c0c4760 2024-09-10T08:40:56.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.280+0000 7f1d53fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5c0c4320 0x7f1d5c1f05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:56.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.280+0000 7f1d5a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d5c0abc80 0x7f1d5c1f3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:56.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.280+0000 7f1d5a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d5c0abc80 0x7f1d5c1f3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:51008/0 (socket says 172.21.15.103:51008) 2024-09-10T08:40:56.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.280+0000 7f1d5a59c640 1 -- 172.21.15.103:0/883595776 learned_addr learned my addr 172.21.15.103:0/883595776 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:56.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.280+0000 7f1d5ad9d640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d5c0c4760 0x7f1d5c071820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:56.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.280+0000 7f1d5a59c640 1 -- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d5c0abc80 msgr2=0x7f1d5c1f3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-10T08:40:56.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.280+0000 7f1d5a59c640 1 -- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d5c0abc80 msgr2=0x7f1d5c1f3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:40:56.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.280+0000 7f1d5a59c640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d5c0abc80 0x7f1d5c1f3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:40:56.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.280+0000 7f1d5a59c640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d5c0abc80 0x7f1d5c1f3b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:40:56.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.281+0000 7f1d53fff640 1 -- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d5c0c4760 msgr2=0x7f1d5c071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:56.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.281+0000 7f1d53fff640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d5c0c4760 0x7f1d5c071820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:56.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.281+0000 7f1d53fff640 1 -- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d5c0abc80 msgr2=0x7f1d5c1f3b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:40:56.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.281+0000 7f1d53fff640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d5c0abc80 0x7f1d5c1f3b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:56.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.281+0000 7f1d53fff640 1 -- 172.21.15.103:0/883595776 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5c1f0b00 con 0x7f1d5c0c4320 2024-09-10T08:40:56.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.281+0000 7f1d53fff640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5c0c4320 0x7f1d5c1f05c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400c820 tx=0x7f1d4400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:56.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.282+0000 7f1d52ffd640 1 -- 172.21.15.103:0/883595776 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44015070 con 0x7f1d5c0c4320 2024-09-10T08:40:56.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.282+0000 7f1d60cdd640 1 -- 172.21.15.103:0/883595776 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d5c071d60 con 0x7f1d5c0c4320 2024-09-10T08:40:56.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.282+0000 7f1d60cdd640 1 -- 172.21.15.103:0/883595776 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d5c156330 con 0x7f1d5c0c4320 2024-09-10T08:40:56.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.282+0000 7f1d52ffd640 1 -- 172.21.15.103:0/883595776 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d44004220 con 0x7f1d5c0c4320 2024-09-10T08:40:56.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.283+0000 7f1d52ffd640 1 -- 172.21.15.103:0/883595776 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44015070 con 0x7f1d5c0c4320 2024-09-10T08:40:56.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.284+0000 7f1d60cdd640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 0x7f1d34004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:56.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.284+0000 7f1d60cdd640 1 -- 172.21.15.103:0/883595776 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1d34007ec0 con 0x7f1d34002a70 2024-09-10T08:40:56.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.285+0000 7f1d5a59c640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 0x7f1d34004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:56.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.285+0000 7f1d5a59c640 1 -- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 msgr2=0x7f1d34004f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-09-10T08:40:56.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.285+0000 7f1d5a59c640 1 -- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 msgr2=0x7f1d34004f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:40:56.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.285+0000 7f1d5a59c640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 0x7f1d34004f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:40:56.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.285+0000 7f1d5a59c640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 0x7f1d34004f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:40:56.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.286+0000 7f1d52ffd640 1 -- 172.21.15.103:0/883595776 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1d44007830 con 0x7f1d5c0c4320 2024-09-10T08:40:56.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.290+0000 7f1d52ffd640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1d4006c230 0x7f1d4006e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:56.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.290+0000 7f1d52ffd640 1 -- 172.21.15.103:0/883595776 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f1d44004020 con 0x7f1d5c0c4320 2024-09-10T08:40:56.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.293+0000 7f1d5ad9d640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1d4006c230 0x7f1d4006e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:56.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.294+0000 7f1d5ad9d640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1d4006c230 0x7f1d4006e6f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1d54033000 tx=0x7f1d54009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:56.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.486+0000 7f1d5a59c640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 0x7f1d34004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:56.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.486+0000 7f1d5a59c640 1 -- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 msgr2=0x7f1d34004f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-10T08:40:56.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.486+0000 7f1d5a59c640 1 -- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 msgr2=0x7f1d34004f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:40:56.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.486+0000 7f1d5a59c640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 0x7f1d34004f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:40:56.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.486+0000 7f1d5a59c640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 0x7f1d34004f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:40:56.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.887+0000 7f1d5a59c640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 0x7f1d34004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:56.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.887+0000 7f1d5a59c640 1 -- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 msgr2=0x7f1d34004f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-10T08:40:56.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.887+0000 7f1d5a59c640 1 -- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 msgr2=0x7f1d34004f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:40:56.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.887+0000 7f1d5a59c640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 0x7f1d34004f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:40:56.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:56.887+0000 7f1d5a59c640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 0x7f1d34004f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:40:57.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:57.690+0000 7f1d5a59c640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 0x7f1d34004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:57.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:57.691+0000 7f1d5a59c640 1 -- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 msgr2=0x7f1d34004f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-10T08:40:57.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:57.691+0000 7f1d5a59c640 1 -- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 msgr2=0x7f1d34004f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:40:57.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:57.691+0000 7f1d5a59c640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 0x7f1d34004f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:40:57.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:57.691+0000 7f1d5a59c640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 0x7f1d34004f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:40:59.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.293+0000 7f1d5a59c640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 0x7f1d34004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:59.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.293+0000 7f1d5a59c640 1 -- 172.21.15.103:0/883595776 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1d340080c0 con 0x7f1d34002a70 2024-09-10T08:40:59.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.294+0000 7f1d5a59c640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 0x7f1d34004f30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c013960 tx=0x7f1d4c013a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:59.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.294+0000 7f1d52ffd640 1 -- 172.21.15.103:0/883595776 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c023070 con 0x7f1d34002a70 2024-09-10T08:40:59.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.295+0000 7f1d52ffd640 1 -- 172.21.15.103:0/883595776 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1d4c012790 con 0x7f1d34002a70 2024-09-10T08:40:59.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.295+0000 7f1d52ffd640 1 -- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 msgr2=0x7f1d34004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:59.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.295+0000 7f1d52ffd640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 0x7f1d34004f30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c013960 tx=0x7f1d4c013a50 comp rx=0 tx=0).stop 2024-09-10T08:40:59.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.295+0000 7f1d52ffd640 1 -- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 msgr2=0x7f1d34004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:40:59.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.295+0000 7f1d52ffd640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34002a70 0x7f1d34004f30 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c013960 tx=0x7f1d4c013a50 comp rx=0 tx=0).stop 2024-09-10T08:40:59.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.306+0000 7f1d60cdd640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34006f00 0x7f1d34007370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:59.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.306+0000 7f1d60cdd640 1 -- 172.21.15.103:0/883595776 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3400a4a0 con 0x7f1d34006f00 2024-09-10T08:40:59.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.309+0000 7f1d5a59c640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34006f00 0x7f1d34007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:59.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.310+0000 7f1d5a59c640 1 -- 172.21.15.103:0/883595776 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1d340078b0 con 0x7f1d34006f00 2024-09-10T08:40:59.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.312+0000 7f1d5a59c640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34006f00 0x7f1d34007370 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c020000 tx=0x7f1d4c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:59.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.312+0000 7f1d52ffd640 1 -- 172.21.15.103:0/883595776 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c023070 con 0x7f1d34006f00 2024-09-10T08:40:59.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.313+0000 7f1d52ffd640 1 -- 172.21.15.103:0/883595776 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f1d4c015050 con 0x7f1d34006f00 2024-09-10T08:40:59.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.313+0000 7f1d52ffd640 1 -- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34006f00 msgr2=0x7f1d34007370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:59.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.313+0000 7f1d52ffd640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34006f00 0x7f1d34007370 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c020000 tx=0x7f1d4c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:59.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.313+0000 7f1d52ffd640 1 -- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34006f00 msgr2=0x7f1d34007370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:40:59.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.313+0000 7f1d52ffd640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d34006f00 0x7f1d34007370 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c020000 tx=0x7f1d4c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:59.314 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:40:59.314 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:40:59.314 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:40:59.315 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:40:59.315 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 104, 2024-09-10T08:40:59.315 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 11521, 2024-09-10T08:40:59.315 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:40:59.315 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:40:59.315 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:40:59.315 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:40:59.315 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:59.316 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 6, 2024-09-10T08:40:59.316 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:40:59.316 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:40:59.316 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:40:59.316 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:59.316 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:59.316 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:59.316 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:59.316 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:59.316 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:59.316 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:59.317 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:59.317 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:59.317 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:59.317 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:59.317 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:59.317 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:40:59.317 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:40:59.317 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:59.317 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:59.317 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:59.317 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:59.318 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:59.318 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:59.318 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:59.318 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:59.318 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:59.318 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:59.318 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:59.318 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:59.318 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.318 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:40:59.319 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:40:59.319 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:40:59.319 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:40:59.319 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:40:59.319 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:40:59.319 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:40:59.319 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:40:59.319 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:40:59.319 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:40:59.319 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:40:59.319 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:40:59.319 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:40:59.320 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:40:59.320 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:40:59.320 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:40:59.320 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:40:59.321 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:59.321 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:59.321 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:59.321 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:59.321 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:59.321 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:59.322 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:59.322 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:59.322 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:59.322 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:59.322 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:59.322 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:59.322 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:40:59.323 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.323 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:40:59.323 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.323 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:40:59.323 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:40:59.323 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:59.323 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:59.324 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.324 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:59.324 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:40:59.325 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:59.325 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.325 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.325 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:59.325 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:40:59.325 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:59.325 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:59.325 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:59.326 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.326 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:40:59.326 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:40:59.326 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:59.326 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:59.326 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:59.326 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.326 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.326 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:40:59.326 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:40:59.326 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:59.326 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:59.326 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.327 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:59.327 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:40:59.327 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:59.327 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.327 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.327 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:59.327 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:40:59.327 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:59.327 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:59.327 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:59.327 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.327 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:40:59.327 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:40:59.328 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:59.328 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:59.328 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:59.328 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.328 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.328 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:40:59.328 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:40:59.328 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:59.328 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:59.328 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.328 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:59.328 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:40:59.328 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:59.329 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.329 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.329 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:59.329 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:40:59.329 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:59.329 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:59.329 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:59.329 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.329 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:40:59.329 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:40:59.329 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:59.329 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:59.329 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:59.329 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:59.330 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:59.330 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.330 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:40:59.330 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:40:59.330 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.330 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:59.330 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:59.330 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:40:59.330 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:59.330 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:59.330 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:40:59.330 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.330 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:59.331 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:59.331 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:40:59.331 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:59.331 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:59.331 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.331 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:40:59.331 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:40:59.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.314+0000 7f1d50ff9640 1 -- 172.21.15.103:0/883595776 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1d4006c230 msgr2=0x7f1d4006e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:59.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.314+0000 7f1d50ff9640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1d4006c230 0x7f1d4006e6f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1d54033000 tx=0x7f1d54009000 comp rx=0 tx=0).stop 2024-09-10T08:40:59.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.314+0000 7f1d5ad9d640 1 -- 172.21.15.103:0/883595776 reap_dead start 2024-09-10T08:40:59.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.314+0000 7f1d50ff9640 1 -- 172.21.15.103:0/883595776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5c0c4320 msgr2=0x7f1d5c1f05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:59.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.314+0000 7f1d50ff9640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5c0c4320 0x7f1d5c1f05c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400c820 tx=0x7f1d4400cce0 comp rx=0 tx=0).stop 2024-09-10T08:40:59.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.314+0000 7f1d50ff9640 1 -- 172.21.15.103:0/883595776 shutdown_connections 2024-09-10T08:40:59.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.314+0000 7f1d50ff9640 1 --2- 172.21.15.103:0/883595776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d5c0c4320 0x7f1d5c1f05c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:59.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.314+0000 7f1d50ff9640 1 -- 172.21.15.103:0/883595776 >> 172.21.15.103:0/883595776 conn(0x7f1d5c0c83a0 msgr2=0x7f1d5c0c2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:59.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.315+0000 7f1d50ff9640 1 -- 172.21.15.103:0/883595776 shutdown_connections 2024-09-10T08:40:59.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.315+0000 7f1d50ff9640 1 -- 172.21.15.103:0/883595776 wait complete. 2024-09-10T08:40:59.335 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:40:59.335 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:40:59.335 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:40:59.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.523+0000 7fd913752640 1 Processor -- start 2024-09-10T08:40:59.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.523+0000 7fd913752640 1 -- start start 2024-09-10T08:40:59.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.525+0000 7fd913752640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd90c0adae0 0x7fd90c0c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:59.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.525+0000 7fd913752640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd90c153f90 con 0x7fd90c153b40 2024-09-10T08:40:59.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.525+0000 7fd913752640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd90c0c8440 con 0x7fd90c0c7f80 2024-09-10T08:40:59.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.525+0000 7fd913752640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd90c154bb0 con 0x7fd90c0adae0 2024-09-10T08:40:59.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.525+0000 7fd910ced640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd90c0c7f80 0x7fd90c1544a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:57184/0 (socket says 172.21.15.103:57184) 2024-09-10T08:40:59.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.525+0000 7fd910ced640 1 -- 172.21.15.103:0/1966075086 learned_addr learned my addr 172.21.15.103:0/1966075086 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:40:59.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.526+0000 7fd903fff640 1 -- 172.21.15.103:0/1966075086 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3185200269 0 0) 0x7fd90c0c8440 con 0x7fd90c0c7f80 2024-09-10T08:40:59.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.526+0000 7fd903fff640 1 -- 172.21.15.103:0/1966075086 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8f8005730 con 0x7fd90c0c7f80 2024-09-10T08:40:59.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.526+0000 7fd903fff640 1 -- 172.21.15.103:0/1966075086 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1966916703 0 0) 0x7fd90c153f90 con 0x7fd90c153b40 2024-09-10T08:40:59.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.526+0000 7fd903fff640 1 -- 172.21.15.103:0/1966075086 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd90c0c8440 con 0x7fd90c153b40 2024-09-10T08:40:59.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.527+0000 7fd903fff640 1 -- 172.21.15.103:0/1966075086 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3941250471 0 0) 0x7fd90c0c8440 con 0x7fd90c153b40 2024-09-10T08:40:59.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.527+0000 7fd903fff640 1 -- 172.21.15.103:0/1966075086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd90c0adae0 msgr2=0x7fd90c0c7700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T08:40:59.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.527+0000 7fd903fff640 1 --2- 172.21.15.103:0/1966075086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd90c0adae0 0x7fd90c0c7700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:59.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.527+0000 7fd903fff640 1 -- 172.21.15.103:0/1966075086 >> v1:172.21.15.154:6789/0 conn(0x7fd90c0c7f80 legacy=0x7fd90c1544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:59.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.527+0000 7fd903fff640 1 -- 172.21.15.103:0/1966075086 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90c0c6c20 con 0x7fd90c153b40 2024-09-10T08:40:59.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.527+0000 7fd903fff640 1 -- 172.21.15.103:0/1966075086 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7fd9040019f0 con 0x7fd90c153b40 2024-09-10T08:40:59.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.527+0000 7fd903fff640 1 -- 172.21.15.103:0/1966075086 >> v1:172.21.15.103:6789/0 conn(0x7fd90c153b40 legacy=0x7fd90c0a7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:59.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.527+0000 7fd903fff640 1 --2- 172.21.15.103:0/1966075086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8f8006de0 0x7fd8f80071e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:59.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.527+0000 7fd903fff640 1 --2- 172.21.15.103:0/1966075086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8f80059b0 0x7fd8f8005e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:59.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.527+0000 7fd903fff640 1 --2- 172.21.15.103:0/1966075086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8f8006370 0x7fd8f800ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:59.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.527+0000 7fd903fff640 1 -- 172.21.15.103:0/1966075086 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c154bb0 con 0x7fd8f8006370 2024-09-10T08:40:59.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.527+0000 7fd903fff640 1 -- 172.21.15.103:0/1966075086 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f80105f0 con 0x7fd8f80059b0 2024-09-10T08:40:59.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.527+0000 7fd903fff640 1 -- 172.21.15.103:0/1966075086 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f80107f0 con 0x7fd8f8006de0 2024-09-10T08:40:59.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.528+0000 7fd911cef640 1 --2- 172.21.15.103:0/1966075086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8f8006370 0x7fd8f800ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:59.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.528+0000 7fd9114ee640 1 --2- 172.21.15.103:0/1966075086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8f8006de0 0x7fd8f80071e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:59.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.529+0000 7fd911cef640 1 -- 172.21.15.103:0/1966075086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8f8006de0 msgr2=0x7fd8f80071e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:59.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.529+0000 7fd911cef640 1 --2- 172.21.15.103:0/1966075086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8f8006de0 0x7fd8f80071e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:59.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.529+0000 7fd911cef640 1 -- 172.21.15.103:0/1966075086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8f80059b0 msgr2=0x7fd8f8005e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T08:40:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.529+0000 7fd911cef640 1 --2- 172.21.15.103:0/1966075086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8f80059b0 0x7fd8f8005e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.529+0000 7fd911cef640 1 -- 172.21.15.103:0/1966075086 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90c0c6c20 con 0x7fd8f8006370 2024-09-10T08:40:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.531+0000 7fd911cef640 1 --2- 172.21.15.103:0/1966075086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8f8006370 0x7fd8f800ffd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd90400c510 tx=0x7fd8f8007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a7a7263902d0b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.531+0000 7fd903fff640 1 -- 172.21.15.103:0/1966075086 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90400c0e0 con 0x7fd8f8006370 2024-09-10T08:40:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.531+0000 7fd903fff640 1 -- 172.21.15.103:0/1966075086 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90402c620 con 0x7fd8f8006370 2024-09-10T08:40:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.532+0000 7fd913752640 1 -- 172.21.15.103:0/1966075086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8f8006370 msgr2=0x7fd8f800ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.532+0000 7fd913752640 1 --2- 172.21.15.103:0/1966075086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8f8006370 0x7fd8f800ffd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd90400c510 tx=0x7fd8f8007a40 comp rx=0 tx=0).stop 2024-09-10T08:40:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.532+0000 7fd911cef640 1 -- 172.21.15.103:0/1966075086 reap_dead start 2024-09-10T08:40:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.533+0000 7fd913752640 1 -- 172.21.15.103:0/1966075086 shutdown_connections 2024-09-10T08:40:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.533+0000 7fd913752640 1 -- 172.21.15.103:0/1966075086 >> 172.21.15.103:0/1966075086 conn(0x7fd90c0c8bf0 msgr2=0x7fd90c0c8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.535+0000 7fd913752640 1 -- 172.21.15.103:0/1966075086 shutdown_connections 2024-09-10T08:40:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.535+0000 7fd913752640 1 -- 172.21.15.103:0/1966075086 wait complete. 2024-09-10T08:40:59.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.537+0000 7fd913752640 1 Processor -- start 2024-09-10T08:40:59.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.537+0000 7fd913752640 1 -- start start 2024-09-10T08:40:59.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.538+0000 7fd913752640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8f8006370 0x7fd90c1f3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:59.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.538+0000 7fd913752640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd90c0a9980 0x7fd90c155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:59.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.538+0000 7fd913752640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90c1562c0 0x7fd90c0ab470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:59.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.539+0000 7fd913752640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c0c71e0 con 0x7fd90c0a9980 2024-09-10T08:40:59.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.539+0000 7fd913752640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c0c8720 con 0x7fd90c1562c0 2024-09-10T08:40:59.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.539+0000 7fd913752640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd90c0abea0 con 0x7fd8f8006370 2024-09-10T08:40:59.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.539+0000 7fd910ced640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd90c0a9980 0x7fd90c155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:59.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.539+0000 7fd910ced640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd90c0a9980 0x7fd90c155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40170/0 (socket says 172.21.15.103:40170) 2024-09-10T08:40:59.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.539+0000 7fd910ced640 1 -- 172.21.15.103:0/511494429 learned_addr learned my addr 172.21.15.103:0/511494429 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:59.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.540+0000 7fd910ced640 1 -- 172.21.15.103:0/511494429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8f8006370 msgr2=0x7fd90c1f3d00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:40:59.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.540+0000 7fd910ced640 1 --2- 172.21.15.103:0/511494429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8f8006370 0x7fd90c1f3d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:59.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.540+0000 7fd910ced640 1 -- 172.21.15.103:0/511494429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90c1562c0 msgr2=0x7fd90c0ab470 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:40:59.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.540+0000 7fd910ced640 1 --2- 172.21.15.103:0/511494429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90c1562c0 0x7fd90c0ab470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:59.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.540+0000 7fd910ced640 1 -- 172.21.15.103:0/511494429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90c0a7640 con 0x7fd90c0a9980 2024-09-10T08:40:59.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.540+0000 7fd910ced640 1 --2- 172.21.15.103:0/511494429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd90c0a9980 0x7fd90c155d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd90800c760 tx=0x7fd90800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:59.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.541+0000 7fd901ffb640 1 -- 172.21.15.103:0/511494429 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd908017070 con 0x7fd90c0a9980 2024-09-10T08:40:59.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.541+0000 7fd913752640 1 -- 172.21.15.103:0/511494429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd90c1f3220 con 0x7fd90c0a9980 2024-09-10T08:40:59.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.541+0000 7fd913752640 1 -- 172.21.15.103:0/511494429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd90c1f37e0 con 0x7fd90c0a9980 2024-09-10T08:40:59.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.542+0000 7fd913752640 1 --2- 172.21.15.103:0/511494429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd90c150620 0x7fd90c0a6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:59.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.543+0000 7fd913752640 1 -- 172.21.15.103:0/511494429 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd90c1f39e0 con 0x7fd90c150620 2024-09-10T08:40:59.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.543+0000 7fd9114ee640 1 --2- 172.21.15.103:0/511494429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd90c150620 0x7fd90c0a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:59.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.546+0000 7fd901ffb640 1 -- 172.21.15.103:0/511494429 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd908005a90 con 0x7fd90c0a9980 2024-09-10T08:40:59.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.546+0000 7fd901ffb640 1 -- 172.21.15.103:0/511494429 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd908005e60 con 0x7fd90c0a9980 2024-09-10T08:40:59.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.546+0000 7fd901ffb640 1 -- 172.21.15.103:0/511494429 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd90801a070 con 0x7fd90c0a9980 2024-09-10T08:40:59.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.547+0000 7fd901ffb640 1 --2- 172.21.15.103:0/511494429 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd8f006bf60 0x7fd8f006e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:59.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.547+0000 7fd901ffb640 1 -- 172.21.15.103:0/511494429 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fd90808a4b0 con 0x7fd90c0a9980 2024-09-10T08:40:59.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.548+0000 7fd911cef640 1 --2- 172.21.15.103:0/511494429 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd8f006bf60 0x7fd8f006e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:59.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.549+0000 7fd9114ee640 1 -- 172.21.15.103:0/511494429 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd90c0adec0 con 0x7fd90c150620 2024-09-10T08:40:59.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.550+0000 7fd9114ee640 1 --2- 172.21.15.103:0/511494429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd90c150620 0x7fd90c0a6530 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0c97c0 tx=0x7fd8fc00c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:59.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.550+0000 7fd901ffb640 1 -- 172.21.15.103:0/511494429 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc015070 con 0x7fd90c150620 2024-09-10T08:40:59.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.551+0000 7fd911cef640 1 --2- 172.21.15.103:0/511494429 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd8f006bf60 0x7fd8f006e420 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd904035000 tx=0x7fd904030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:59.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.551+0000 7fd901ffb640 1 -- 172.21.15.103:0/511494429 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd8fc011800 con 0x7fd90c150620 2024-09-10T08:40:59.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.551+0000 7fd901ffb640 1 -- 172.21.15.103:0/511494429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd90c150620 msgr2=0x7fd90c0a6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:59.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.551+0000 7fd901ffb640 1 --2- 172.21.15.103:0/511494429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd90c150620 0x7fd90c0a6530 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0c97c0 tx=0x7fd8fc00c810 comp rx=0 tx=0).stop 2024-09-10T08:40:59.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.551+0000 7fd901ffb640 1 -- 172.21.15.103:0/511494429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd90c150620 msgr2=0x7fd90c0a6530 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:40:59.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.551+0000 7fd901ffb640 1 --2- 172.21.15.103:0/511494429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd90c150620 0x7fd90c0a6530 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0c97c0 tx=0x7fd8fc00c810 comp rx=0 tx=0).stop 2024-09-10T08:40:59.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.564+0000 7fd913752640 1 --2- 172.21.15.103:0/511494429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd90c0ab9b0 0x7fd90c0a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:59.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.564+0000 7fd913752640 1 -- 172.21.15.103:0/511494429 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd90c0c7810 con 0x7fd90c0ab9b0 2024-09-10T08:40:59.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.565+0000 7fd9114ee640 1 --2- 172.21.15.103:0/511494429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd90c0ab9b0 0x7fd90c0a6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:59.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.567+0000 7fd9114ee640 1 -- 172.21.15.103:0/511494429 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd90c0a5520 con 0x7fd90c0ab9b0 2024-09-10T08:40:59.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.568+0000 7fd9114ee640 1 --2- 172.21.15.103:0/511494429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd90c0ab9b0 0x7fd90c0a6a70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0c97c0 tx=0x7fd8fc004700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:59.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.568+0000 7fd901ffb640 1 -- 172.21.15.103:0/511494429 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc0255f0 con 0x7fd90c0ab9b0 2024-09-10T08:40:59.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.568+0000 7fd901ffb640 1 -- 172.21.15.103:0/511494429 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7fd8fc024390 con 0x7fd90c0ab9b0 2024-09-10T08:40:59.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.569+0000 7fd901ffb640 1 -- 172.21.15.103:0/511494429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd90c0ab9b0 msgr2=0x7fd90c0a6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:59.570 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:40:59.570 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:40:59.570 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:40:59.570 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:40:59.570 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 104, 2024-09-10T08:40:59.570 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 152403, 2024-09-10T08:40:59.570 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:40:59.570 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:40:59.570 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:40:59.571 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:40:59.571 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:59.571 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 6, 2024-09-10T08:40:59.571 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:40:59.571 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:40:59.571 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:40:59.571 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:59.571 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:59.571 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:59.571 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:59.571 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:59.571 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:59.571 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:59.572 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:59.572 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:59.572 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:59.572 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:59.572 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:59.572 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:40:59.572 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:40:59.572 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:59.572 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:59.572 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:59.572 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:59.572 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:59.572 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:59.572 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:59.573 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:59.573 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:59.573 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:59.573 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:59.573 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:59.573 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.573 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:40:59.573 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:40:59.573 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:40:59.573 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:40:59.573 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:40:59.573 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:40:59.573 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:40:59.573 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:40:59.574 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:40:59.574 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:40:59.574 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:40:59.574 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:40:59.574 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:40:59.574 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:40:59.574 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:40:59.574 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:40:59.574 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:40:59.574 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:40:59.574 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:40:59.574 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:40:59.574 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:40:59.574 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:40:59.575 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:40:59.575 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:40:59.575 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:40:59.575 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:40:59.575 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:40:59.575 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:40:59.575 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:59.576 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:40:59.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.576 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:40:59.576 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.576 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:40:59.576 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:40:59.576 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:59.576 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:59.576 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.576 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:59.576 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:40:59.576 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:59.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.576 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.577 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:59.577 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:40:59.577 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:59.577 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:59.577 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:59.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.577 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:40:59.577 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:40:59.577 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:59.577 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:59.577 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:59.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.577 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.578 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:40:59.578 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:40:59.578 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:59.578 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:59.578 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.578 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:59.578 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:40:59.578 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:59.578 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.579 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.579 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:59.579 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:40:59.579 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:59.579 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:59.579 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:59.579 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.579 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:40:59.579 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:40:59.579 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:59.579 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:59.579 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:59.579 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.579 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.580 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:40:59.580 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:40:59.580 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:40:59.580 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:40:59.580 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.580 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:40:59.580 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:40:59.580 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:59.580 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.580 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.580 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:40:59.580 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:40:59.580 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:40:59.581 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:59.581 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:59.581 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.581 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:40:59.581 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:40:59.581 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:40:59.581 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:40:59.581 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:40:59.581 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:59.581 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:59.581 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.581 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:40:59.581 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:40:59.581 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.582 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:59.582 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:59.582 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:40:59.582 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:59.582 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:59.582 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:40:59.582 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.582 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:59.582 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:59.582 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:40:59.582 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:59.582 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:59.582 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:40:59.582 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.582 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:59.583 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:59.583 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-10T08:40:59.583 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:59.583 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:59.583 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:40:59.583 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.583 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:59.583 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:59.583 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:40:59.583 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:59.583 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:40:59.583 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:40:59.583 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:40:59.583 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:40:59.584 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:40:59.584 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:40:59.584 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:40:59.584 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:40:59.584 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:40:59.584 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:40:59.584 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:40:59.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.569+0000 7fd901ffb640 1 --2- 172.21.15.103:0/511494429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd90c0ab9b0 0x7fd90c0a6a70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0c97c0 tx=0x7fd8fc004700 comp rx=0 tx=0).stop 2024-09-10T08:40:59.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.569+0000 7fd901ffb640 1 -- 172.21.15.103:0/511494429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd90c0ab9b0 msgr2=0x7fd90c0a6a70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:40:59.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.569+0000 7fd901ffb640 1 --2- 172.21.15.103:0/511494429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd90c0ab9b0 0x7fd90c0a6a70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:59.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.569+0000 7fd913752640 1 -- 172.21.15.103:0/511494429 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd8f006bf60 msgr2=0x7fd8f006e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:59.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.569+0000 7fd913752640 1 --2- 172.21.15.103:0/511494429 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd8f006bf60 0x7fd8f006e420 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd904035000 tx=0x7fd904030000 comp rx=0 tx=0).stop 2024-09-10T08:40:59.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.569+0000 7fd913752640 1 -- 172.21.15.103:0/511494429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd90c0a9980 msgr2=0x7fd90c155d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:59.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.569+0000 7fd913752640 1 --2- 172.21.15.103:0/511494429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd90c0a9980 0x7fd90c155d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd90800c760 tx=0x7fd90800cc20 comp rx=0 tx=0).stop 2024-09-10T08:40:59.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.569+0000 7fd911cef640 1 -- 172.21.15.103:0/511494429 reap_dead start 2024-09-10T08:40:59.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.570+0000 7fd913752640 1 -- 172.21.15.103:0/511494429 shutdown_connections 2024-09-10T08:40:59.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.570+0000 7fd913752640 1 --2- 172.21.15.103:0/511494429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd90c0a9980 0x7fd90c155d80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:59.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.570+0000 7fd913752640 1 -- 172.21.15.103:0/511494429 >> 172.21.15.103:0/511494429 conn(0x7fd90c0c8bf0 msgr2=0x7fd90c06df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:59.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.570+0000 7fd913752640 1 -- 172.21.15.103:0/511494429 shutdown_connections 2024-09-10T08:40:59.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.570+0000 7fd913752640 1 -- 172.21.15.103:0/511494429 wait complete. 2024-09-10T08:40:59.592 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:40:59.592 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-10T08:40:59.592 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-10T08:40:59.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.775+0000 7fb18bf03640 1 Processor -- start 2024-09-10T08:40:59.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.776+0000 7fb18bf03640 1 -- start start 2024-09-10T08:40:59.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.777+0000 7fb18bf03640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb18406edd0 0x7fb1841562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:59.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.777+0000 7fb18bf03640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb18414f820 0x7fb18414fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:59.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.777+0000 7fb18bf03640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1840c2d60 con 0x7fb1840c7230 2024-09-10T08:40:59.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.777+0000 7fb18bf03640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fb1841532d0 con 0x7fb18414f820 2024-09-10T08:40:59.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.777+0000 7fb18bf03640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb1840c3040 con 0x7fb18406edd0 2024-09-10T08:40:59.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.777+0000 7fb189c9f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb18406edd0 0x7fb1841562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:59.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.777+0000 7fb189c9f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb18406edd0 0x7fb1841562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:59720/0 (socket says 172.21.15.103:59720) 2024-09-10T08:40:59.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.777+0000 7fb189c9f640 1 -- 172.21.15.103:0/3067444441 learned_addr learned my addr 172.21.15.103:0/3067444441 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:59.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.778+0000 7fb189c9f640 1 -- 172.21.15.103:0/3067444441 >> v2:172.21.15.103:3300/0 conn(0x7fb18414f820 msgr2=0x7fb18414fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:59.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.778+0000 7fb18a4a0640 1 --2- 172.21.15.103:0/3067444441 >> v2:172.21.15.103:3300/0 conn(0x7fb18414f820 0x7fb18414fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:59.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.778+0000 7fb189c9f640 1 --2- 172.21.15.103:0/3067444441 >> v2:172.21.15.103:3300/0 conn(0x7fb18414f820 0x7fb18414fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:59.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.778+0000 7fb189c9f640 1 -- 172.21.15.103:0/3067444441 >> v1:172.21.15.103:6789/0 conn(0x7fb1840c7230 legacy=0x7fb184152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:59.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.778+0000 7fb189c9f640 1 -- 172.21.15.103:0/3067444441 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1841526a0 con 0x7fb18406edd0 2024-09-10T08:40:59.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.778+0000 7fb18a4a0640 1 --2- 172.21.15.103:0/3067444441 >> v2:172.21.15.103:3300/0 conn(0x7fb18414f820 0x7fb18414fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:40:59.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.783+0000 7fb189c9f640 1 --2- 172.21.15.103:0/3067444441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb18406edd0 0x7fb1841562d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb174009870 tx=0x7fb17402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d5251add998687f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:59.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.783+0000 7fb188c9d640 1 -- 172.21.15.103:0/3067444441 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb174037070 con 0x7fb18406edd0 2024-09-10T08:40:59.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.783+0000 7fb188c9d640 1 -- 172.21.15.103:0/3067444441 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb174032440 con 0x7fb18406edd0 2024-09-10T08:40:59.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.783+0000 7fb188c9d640 1 -- 172.21.15.103:0/3067444441 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb174032810 con 0x7fb18406edd0 2024-09-10T08:40:59.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.785+0000 7fb18bf03640 1 -- 172.21.15.103:0/3067444441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb18406edd0 msgr2=0x7fb1841562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:59.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.785+0000 7fb18bf03640 1 --2- 172.21.15.103:0/3067444441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb18406edd0 0x7fb1841562d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb174009870 tx=0x7fb17402a180 comp rx=0 tx=0).stop 2024-09-10T08:40:59.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.785+0000 7fb18bf03640 1 -- 172.21.15.103:0/3067444441 shutdown_connections 2024-09-10T08:40:59.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.785+0000 7fb18bf03640 1 --2- 172.21.15.103:0/3067444441 >> v2:172.21.15.103:3300/0 conn(0x7fb18414f820 0x7fb18414fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:59.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.785+0000 7fb18bf03640 1 --2- 172.21.15.103:0/3067444441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb18406edd0 0x7fb1841562d0 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb174009870 tx=0x7fb17402a180 comp rx=0 tx=0).stop 2024-09-10T08:40:59.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.785+0000 7fb18bf03640 1 -- 172.21.15.103:0/3067444441 >> 172.21.15.103:0/3067444441 conn(0x7fb1840c7a40 msgr2=0x7fb1840c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:59.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.785+0000 7fb18bf03640 1 -- 172.21.15.103:0/3067444441 shutdown_connections 2024-09-10T08:40:59.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.785+0000 7fb18bf03640 1 -- 172.21.15.103:0/3067444441 wait complete. 2024-09-10T08:40:59.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.787+0000 7fb18bf03640 1 Processor -- start 2024-09-10T08:40:59.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.787+0000 7fb18bf03640 1 -- start start 2024-09-10T08:40:59.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.788+0000 7fb18bf03640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1840c7230 0x7fb184141f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:59.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.788+0000 7fb18bf03640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb18414f820 0x7fb18413d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:59.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.788+0000 7fb18bf03640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb184070a10 0x7fb18413dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:59.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.789+0000 7fb18bf03640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb1840c41e0 con 0x7fb184070a10 2024-09-10T08:40:59.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.789+0000 7fb18bf03640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb184152350 con 0x7fb18414f820 2024-09-10T08:40:59.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.789+0000 7fb18bf03640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb1840c4360 con 0x7fb1840c7230 2024-09-10T08:40:59.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.789+0000 7fb189c9f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1840c7230 0x7fb184141f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:59.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.789+0000 7fb189c9f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1840c7230 0x7fb184141f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:59726/0 (socket says 172.21.15.103:59726) 2024-09-10T08:40:59.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.789+0000 7fb189c9f640 1 -- 172.21.15.103:0/1815719001 learned_addr learned my addr 172.21.15.103:0/1815719001 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:40:59.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.789+0000 7fb18949e640 1 --2- 172.21.15.103:0/1815719001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb18414f820 0x7fb18413d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:59.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.789+0000 7fb18a4a0640 1 --2- 172.21.15.103:0/1815719001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb184070a10 0x7fb18413dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:59.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.789+0000 7fb189c9f640 1 -- 172.21.15.103:0/1815719001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb18414f820 msgr2=0x7fb18413d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:59.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.789+0000 7fb189c9f640 1 --2- 172.21.15.103:0/1815719001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb18414f820 0x7fb18413d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:59.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.789+0000 7fb189c9f640 1 -- 172.21.15.103:0/1815719001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb184070a10 msgr2=0x7fb18413dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:59.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.789+0000 7fb189c9f640 1 --2- 172.21.15.103:0/1815719001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb184070a10 0x7fb18413dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:59.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.789+0000 7fb189c9f640 1 -- 172.21.15.103:0/1815719001 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1841556f0 con 0x7fb1840c7230 2024-09-10T08:40:59.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.790+0000 7fb189c9f640 1 --2- 172.21.15.103:0/1815719001 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1840c7230 0x7fb184141f80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb17402a6f0 tx=0x7fb1740046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:59.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.790+0000 7fb17a7fc640 1 -- 172.21.15.103:0/1815719001 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb174037040 con 0x7fb1840c7230 2024-09-10T08:40:59.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.790+0000 7fb18bf03640 1 -- 172.21.15.103:0/1815719001 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1840746a0 con 0x7fb1840c7230 2024-09-10T08:40:59.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.790+0000 7fb17a7fc640 1 -- 172.21.15.103:0/1815719001 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb174042070 con 0x7fb1840c7230 2024-09-10T08:40:59.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.790+0000 7fb17a7fc640 1 -- 172.21.15.103:0/1815719001 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb174030b70 con 0x7fb1840c7230 2024-09-10T08:40:59.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.790+0000 7fb18bf03640 1 -- 172.21.15.103:0/1815719001 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb184140e70 con 0x7fb1840c7230 2024-09-10T08:40:59.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.792+0000 7fb18bf03640 1 -- 172.21.15.103:0/1815719001 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1840c3420 con 0x7fb1840c7230 2024-09-10T08:40:59.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.793+0000 7fb17a7fc640 1 -- 172.21.15.103:0/1815719001 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb174030d10 con 0x7fb1840c7230 2024-09-10T08:40:59.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.793+0000 7fb17a7fc640 1 --2- 172.21.15.103:0/1815719001 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb16806be30 0x7fb16806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:59.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.793+0000 7fb17a7fc640 1 -- 172.21.15.103:0/1815719001 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fb1740abaf0 con 0x7fb1840c7230 2024-09-10T08:40:59.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.793+0000 7fb18949e640 1 --2- 172.21.15.103:0/1815719001 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb16806be30 0x7fb16806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:59.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.794+0000 7fb18949e640 1 --2- 172.21.15.103:0/1815719001 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb16806be30 0x7fb16806e2f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb1840c1cb0 tx=0x7fb17c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:59.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:40:59.801+0000 7fb17a7fc640 1 -- 172.21.15.103:0/1815719001 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb1840c3420 con 0x7fb1840c7230 2024-09-10T08:41:00.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:00.287+0000 7fb18bf03640 1 -- 172.21.15.103:0/1815719001 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fb1840c4820 con 0x7fb1840c7230 2024-09-10T08:41:00.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:00.290+0000 7fb17a7fc640 1 -- 172.21.15.103:0/1815719001 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fb17404d020 con 0x7fb1840c7230 2024-09-10T08:41:00.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:00.297+0000 7fb18bf03640 1 -- 172.21.15.103:0/1815719001 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb16806be30 msgr2=0x7fb16806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:00.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:00.297+0000 7fb18bf03640 1 --2- 172.21.15.103:0/1815719001 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb16806be30 0x7fb16806e2f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb1840c1cb0 tx=0x7fb17c009040 comp rx=0 tx=0).stop 2024-09-10T08:41:00.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:00.297+0000 7fb18bf03640 1 -- 172.21.15.103:0/1815719001 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1840c7230 msgr2=0x7fb184141f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:00.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:00.297+0000 7fb18bf03640 1 --2- 172.21.15.103:0/1815719001 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1840c7230 0x7fb184141f80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb17402a6f0 tx=0x7fb1740046c0 comp rx=0 tx=0).stop 2024-09-10T08:41:00.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:00.297+0000 7fb18bf03640 1 -- 172.21.15.103:0/1815719001 shutdown_connections 2024-09-10T08:41:00.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:00.297+0000 7fb18bf03640 1 --2- 172.21.15.103:0/1815719001 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb16806be30 0x7fb16806e2f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:00.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:00.297+0000 7fb18bf03640 1 --2- 172.21.15.103:0/1815719001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb184070a10 0x7fb18413dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:00.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:00.297+0000 7fb18bf03640 1 --2- 172.21.15.103:0/1815719001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb18414f820 0x7fb18413d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:00.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:00.297+0000 7fb18bf03640 1 --2- 172.21.15.103:0/1815719001 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1840c7230 0x7fb184141f80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:00.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:00.297+0000 7fb18bf03640 1 -- 172.21.15.103:0/1815719001 >> 172.21.15.103:0/1815719001 conn(0x7fb1840c7a40 msgr2=0x7fb184152bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:00.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:00.298+0000 7fb18bf03640 1 -- 172.21.15.103:0/1815719001 shutdown_connections 2024-09-10T08:41:00.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:00.298+0000 7fb18bf03640 1 -- 172.21.15.103:0/1815719001 wait complete. 2024-09-10T08:41:00.325 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-10T08:41:03.238 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:41:03.242 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:41:10.325 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:41:10.326 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:41:10.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.503+0000 7f1ceceaf640 1 Processor -- start 2024-09-10T08:41:10.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.504+0000 7f1ceceaf640 1 -- start start 2024-09-10T08:41:10.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.505+0000 7f1ceceaf640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1ce00d7330 0x7f1ce00da640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:10.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.505+0000 7f1ceceaf640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ce00dab80 con 0x7f1ce0042d50 2024-09-10T08:41:10.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.505+0000 7f1ceceaf640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ce004a200 con 0x7f1ce00db0b0 2024-09-10T08:41:10.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.505+0000 7f1ceceaf640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f1ce004aaa0 con 0x7f1ce00d7330 2024-09-10T08:41:10.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.506+0000 7f1ce77fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1ce00d7330 0x7f1ce00da640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:10.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.506+0000 7f1ce77fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1ce00d7330 0x7f1ce00da640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53862/0 (socket says 172.21.15.103:53862) 2024-09-10T08:41:10.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.506+0000 7f1ce7fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1ce00db0b0 0x7f1ce000ee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:56998/0 (socket says 172.21.15.103:56998) 2024-09-10T08:41:10.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.506+0000 7f1ce77fe640 1 -- 172.21.15.103:0/3977363859 learned_addr learned my addr 172.21.15.103:0/3977363859 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:10.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.507+0000 7f1ce67fc640 1 -- 172.21.15.103:0/3977363859 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1497309298 0 0) 0x7f1cd4001110 con 0x7f1ce0042d50 2024-09-10T08:41:10.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.507+0000 7f1ce67fc640 1 -- 172.21.15.103:0/3977363859 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cd8003520 con 0x7f1ce0042d50 2024-09-10T08:41:10.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.507+0000 7f1ce77fe640 1 -- 172.21.15.103:0/3977363859 >> v1:172.21.15.154:6789/0 conn(0x7f1ce00db0b0 legacy=0x7f1ce000ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:10.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.507+0000 7f1ce77fe640 1 -- 172.21.15.103:0/3977363859 >> v1:172.21.15.103:6789/0 conn(0x7f1ce0042d50 legacy=0x7f1ce0006a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:10.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.507+0000 7f1ce77fe640 1 -- 172.21.15.103:0/3977363859 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce004a4e0 con 0x7f1ce00d7330 2024-09-10T08:41:10.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.509+0000 7f1ce77fe640 1 --2- 172.21.15.103:0/3977363859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce00d7330 0x7f1ce00da640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009870 tx=0x7f1cdc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee8caf18f28787 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:10.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.509+0000 7f1ce67fc640 1 -- 172.21.15.103:0/3977363859 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc037070 con 0x7f1ce00d7330 2024-09-10T08:41:10.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.509+0000 7f1ce67fc640 1 -- 172.21.15.103:0/3977363859 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cdc032440 con 0x7f1ce00d7330 2024-09-10T08:41:10.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.509+0000 7f1ce67fc640 1 -- 172.21.15.103:0/3977363859 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc032850 con 0x7f1ce00d7330 2024-09-10T08:41:10.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.510+0000 7f1ceceaf640 1 -- 172.21.15.103:0/3977363859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce00d7330 msgr2=0x7f1ce00da640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:10.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.510+0000 7f1ceceaf640 1 --2- 172.21.15.103:0/3977363859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce00d7330 0x7f1ce00da640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009870 tx=0x7f1cdc02a230 comp rx=0 tx=0).stop 2024-09-10T08:41:10.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.512+0000 7f1ceceaf640 1 -- 172.21.15.103:0/3977363859 shutdown_connections 2024-09-10T08:41:10.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.512+0000 7f1ceceaf640 1 --2- 172.21.15.103:0/3977363859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce00d7330 0x7f1ce00da640 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:10.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.512+0000 7f1ceceaf640 1 -- 172.21.15.103:0/3977363859 >> 172.21.15.103:0/3977363859 conn(0x7f1ce004c0b0 msgr2=0x7f1ce004c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:10.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.512+0000 7f1ceceaf640 1 -- 172.21.15.103:0/3977363859 shutdown_connections 2024-09-10T08:41:10.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.513+0000 7f1ceceaf640 1 -- 172.21.15.103:0/3977363859 wait complete. 2024-09-10T08:41:10.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.515+0000 7f1ceceaf640 1 Processor -- start 2024-09-10T08:41:10.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.515+0000 7f1ceceaf640 1 -- start start 2024-09-10T08:41:10.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.517+0000 7f1ceceaf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce0042d50 0x7f1ce00d6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:10.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.517+0000 7f1ceceaf640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ce00d7330 0x7f1ce00d0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:10.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.517+0000 7f1ceceaf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ce00db0b0 0x7f1ce00d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:10.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.517+0000 7f1ceceaf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce000e920 con 0x7f1ce0042d50 2024-09-10T08:41:10.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.517+0000 7f1ceceaf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce0049fb0 con 0x7f1ce00db0b0 2024-09-10T08:41:10.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.517+0000 7f1ceceaf640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce0007110 con 0x7f1ce00d7330 2024-09-10T08:41:10.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.517+0000 7f1ce6ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ce00d7330 0x7f1ce00d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:10.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.517+0000 7f1ce6ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ce00d7330 0x7f1ce00d0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:36760/0 (socket says 172.21.15.103:36760) 2024-09-10T08:41:10.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.517+0000 7f1ce6ffd640 1 -- 172.21.15.103:0/261419910 learned_addr learned my addr 172.21.15.103:0/261419910 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:10.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.518+0000 7f1ce7fff640 1 --2- 172.21.15.103:0/261419910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ce00db0b0 0x7f1ce00d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:10.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.518+0000 7f1ce6ffd640 1 -- 172.21.15.103:0/261419910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ce00db0b0 msgr2=0x7f1ce00d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:10.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.518+0000 7f1ce6ffd640 1 --2- 172.21.15.103:0/261419910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ce00db0b0 0x7f1ce00d0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:10.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.518+0000 7f1ce6ffd640 1 -- 172.21.15.103:0/261419910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce0042d50 msgr2=0x7f1ce00d6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:10.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.518+0000 7f1ce6ffd640 1 --2- 172.21.15.103:0/261419910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce0042d50 0x7f1ce00d6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:10.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.518+0000 7f1ce6ffd640 1 -- 172.21.15.103:0/261419910 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce0033200 con 0x7f1ce00d7330 2024-09-10T08:41:10.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.519+0000 7f1ce6ffd640 1 --2- 172.21.15.103:0/261419910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ce00d7330 0x7f1ce00d0750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400c730 tx=0x7f1cd400cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:10.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.519+0000 7f1cd3fff640 1 -- 172.21.15.103:0/261419910 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd40052d0 con 0x7f1ce00d7330 2024-09-10T08:41:10.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.520+0000 7f1cd3fff640 1 -- 172.21.15.103:0/261419910 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd4005470 con 0x7f1ce00d7330 2024-09-10T08:41:10.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.520+0000 7f1cd3fff640 1 -- 172.21.15.103:0/261419910 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd400a860 con 0x7f1ce00d7330 2024-09-10T08:41:10.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.520+0000 7f1ceceaf640 1 -- 172.21.15.103:0/261419910 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce00334a0 con 0x7f1ce00d7330 2024-09-10T08:41:10.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.520+0000 7f1ceceaf640 1 -- 172.21.15.103:0/261419910 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce0033a60 con 0x7f1ce00d7330 2024-09-10T08:41:10.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.522+0000 7f1ceceaf640 1 -- 172.21.15.103:0/261419910 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce00da640 con 0x7f1ce00d7330 2024-09-10T08:41:10.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.523+0000 7f1cd3fff640 1 -- 172.21.15.103:0/261419910 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1cd400aa00 con 0x7f1ce00d7330 2024-09-10T08:41:10.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.524+0000 7f1cd3fff640 1 --2- 172.21.15.103:0/261419910 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1ccc06bf00 0x7f1ccc06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:10.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.525+0000 7f1cd3fff640 1 -- 172.21.15.103:0/261419910 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f1cd408ae50 con 0x7f1ce00d7330 2024-09-10T08:41:10.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.525+0000 7f1ce77fe640 1 --2- 172.21.15.103:0/261419910 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1ccc06bf00 0x7f1ccc06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:10.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.528+0000 7f1ce77fe640 1 --2- 172.21.15.103:0/261419910 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1ccc06bf00 0x7f1ccc06e3c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc034000 tx=0x7f1cdc02c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:10.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:10.532+0000 7f1cd3fff640 1 -- 172.21.15.103:0/261419910 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1ce00dab80 con 0x7f1ce00d7330 2024-09-10T08:41:11.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.018+0000 7f1ceceaf640 1 -- 172.21.15.103:0/261419910 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1ce00d11d0 con 0x7f1ce00d7330 2024-09-10T08:41:11.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.019+0000 7f1cd3fff640 1 -- 172.21.15.103:0/261419910 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1570 (secure 0 0 0) 0x7f1cd408c080 con 0x7f1ce00d7330 2024-09-10T08:41:11.020 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":104,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:41:11.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.026+0000 7f1ceceaf640 1 -- 172.21.15.103:0/261419910 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1ccc06bf00 msgr2=0x7f1ccc06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.026+0000 7f1ceceaf640 1 --2- 172.21.15.103:0/261419910 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1ccc06bf00 0x7f1ccc06e3c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc034000 tx=0x7f1cdc02c000 comp rx=0 tx=0).stop 2024-09-10T08:41:11.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.026+0000 7f1ceceaf640 1 -- 172.21.15.103:0/261419910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ce00d7330 msgr2=0x7f1ce00d0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.026+0000 7f1ceceaf640 1 --2- 172.21.15.103:0/261419910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ce00d7330 0x7f1ce00d0750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400c730 tx=0x7f1cd400cbf0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.026+0000 7f1ceceaf640 1 -- 172.21.15.103:0/261419910 shutdown_connections 2024-09-10T08:41:11.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.026+0000 7f1ceceaf640 1 --2- 172.21.15.103:0/261419910 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1ccc06bf00 0x7f1ccc06e3c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.026+0000 7f1ceceaf640 1 --2- 172.21.15.103:0/261419910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ce00db0b0 0x7f1ce00d0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.026+0000 7f1ceceaf640 1 --2- 172.21.15.103:0/261419910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ce00d7330 0x7f1ce00d0750 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400c730 tx=0x7f1cd400cbf0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.026+0000 7f1ceceaf640 1 --2- 172.21.15.103:0/261419910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ce0042d50 0x7f1ce00d6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.026+0000 7f1ceceaf640 1 -- 172.21.15.103:0/261419910 >> 172.21.15.103:0/261419910 conn(0x7f1ce004c0b0 msgr2=0x7f1ce00d3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:11.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.027+0000 7f1ceceaf640 1 -- 172.21.15.103:0/261419910 shutdown_connections 2024-09-10T08:41:11.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.027+0000 7f1ceceaf640 1 -- 172.21.15.103:0/261419910 wait complete. 2024-09-10T08:41:11.055 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:41:11.055 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-10T08:41:11.055 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:41:11.055 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:41:11.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.254+0000 7fa8fb59e640 1 Processor -- start 2024-09-10T08:41:11.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.254+0000 7fa8fb59e640 1 -- start start 2024-09-10T08:41:11.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.256+0000 7fa8fb59e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa8f40d5230 0x7fa8f4049ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.256+0000 7fa8fb59e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8f404b3b0 0x7fa8f400c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.256+0000 7fa8fb59e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f40d8890 con 0x7fa8f4040b40 2024-09-10T08:41:11.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.256+0000 7fa8fb59e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa8f4047e30 con 0x7fa8f40d5230 2024-09-10T08:41:11.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.256+0000 7fa8fb59e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f4048080 con 0x7fa8f404b3b0 2024-09-10T08:41:11.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.256+0000 7fa8fa59c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa8f40d5230 0x7fa8f4049ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.256+0000 7fa8fad9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8f404b3b0 0x7fa8f400c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.256+0000 7fa8fad9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8f404b3b0 0x7fa8f400c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:36770/0 (socket says 172.21.15.103:36770) 2024-09-10T08:41:11.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.256+0000 7fa8fad9d640 1 -- 172.21.15.103:0/2386337466 learned_addr learned my addr 172.21.15.103:0/2386337466 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:11.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.257+0000 7fa8fa59c640 1 -- 172.21.15.103:0/2386337466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8f404b3b0 msgr2=0x7fa8f400c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:11.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.257+0000 7fa8fa59c640 1 --2- 172.21.15.103:0/2386337466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8f404b3b0 0x7fa8f400c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.257+0000 7fa8fa59c640 1 -- 172.21.15.103:0/2386337466 >> v1:172.21.15.154:6789/0 conn(0x7fa8f4040b40 legacy=0x7fa8f400c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.257+0000 7fa8fa59c640 1 -- 172.21.15.103:0/2386337466 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f4048360 con 0x7fa8f40d5230 2024-09-10T08:41:11.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.258+0000 7fa8fa59c640 1 --2- 172.21.15.103:0/2386337466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f40d5230 0x7fa8f4049ec0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc000b60 tx=0x7fa8fc0a6b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e32c465f53a8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:11.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.258+0000 7fa8f959a640 1 -- 172.21.15.103:0/2386337466 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0a87a0 con 0x7fa8f40d5230 2024-09-10T08:41:11.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.258+0000 7fa8f959a640 1 -- 172.21.15.103:0/2386337466 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8fc0a8980 con 0x7fa8f40d5230 2024-09-10T08:41:11.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.259+0000 7fa8f959a640 1 -- 172.21.15.103:0/2386337466 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0a87a0 con 0x7fa8f40d5230 2024-09-10T08:41:11.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.260+0000 7fa8fb59e640 1 -- 172.21.15.103:0/2386337466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f40d5230 msgr2=0x7fa8f4049ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.260+0000 7fa8fb59e640 1 --2- 172.21.15.103:0/2386337466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f40d5230 0x7fa8f4049ec0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc000b60 tx=0x7fa8fc0a6b80 comp rx=0 tx=0).stop 2024-09-10T08:41:11.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.261+0000 7fa8fb59e640 1 -- 172.21.15.103:0/2386337466 shutdown_connections 2024-09-10T08:41:11.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.261+0000 7fa8fb59e640 1 --2- 172.21.15.103:0/2386337466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8f404b3b0 0x7fa8f400c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.261+0000 7fa8fb59e640 1 --2- 172.21.15.103:0/2386337466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f40d5230 0x7fa8f4049ec0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.261+0000 7fa8fb59e640 1 -- 172.21.15.103:0/2386337466 >> 172.21.15.103:0/2386337466 conn(0x7fa8f402f060 msgr2=0x7fa8f402f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:11.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.261+0000 7fa8fb59e640 1 -- 172.21.15.103:0/2386337466 shutdown_connections 2024-09-10T08:41:11.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.261+0000 7fa8fb59e640 1 -- 172.21.15.103:0/2386337466 wait complete. 2024-09-10T08:41:11.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.263+0000 7fa8fb59e640 1 Processor -- start 2024-09-10T08:41:11.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.263+0000 7fa8fb59e640 1 -- start start 2024-09-10T08:41:11.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.264+0000 7fa8fb59e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8f4040b40 0x7fa8f40d4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.264+0000 7fa8fb59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f404b3b0 0x7fa8f4176fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.265+0000 7fa8fb59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8f40d5230 0x7fa8f4177520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.265+0000 7fa8fa59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8f4040b40 0x7fa8f40d4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.265+0000 7fa8fa59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8f4040b40 0x7fa8f40d4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:36778/0 (socket says 172.21.15.103:36778) 2024-09-10T08:41:11.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.265+0000 7fa8fa59c640 1 -- 172.21.15.103:0/1756999340 learned_addr learned my addr 172.21.15.103:0/1756999340 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:11.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.265+0000 7fa8fb59e640 1 -- 172.21.15.103:0/1756999340 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f40d84b0 con 0x7fa8f404b3b0 2024-09-10T08:41:11.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.265+0000 7fa8fb59e640 1 -- 172.21.15.103:0/1756999340 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f40d5610 con 0x7fa8f40d5230 2024-09-10T08:41:11.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.265+0000 7fa8fb59e640 1 -- 172.21.15.103:0/1756999340 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f40d8630 con 0x7fa8f4040b40 2024-09-10T08:41:11.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.265+0000 7fa8f9d9b640 1 --2- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f404b3b0 0x7fa8f4176fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.265+0000 7fa8fad9d640 1 --2- 172.21.15.103:0/1756999340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8f40d5230 0x7fa8f4177520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.266+0000 7fa8f9d9b640 1 -- 172.21.15.103:0/1756999340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8f4040b40 msgr2=0x7fa8f40d4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.266+0000 7fa8f9d9b640 1 --2- 172.21.15.103:0/1756999340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8f4040b40 0x7fa8f40d4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.266+0000 7fa8f9d9b640 1 -- 172.21.15.103:0/1756999340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8f40d5230 msgr2=0x7fa8f4177520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.266+0000 7fa8f9d9b640 1 --2- 172.21.15.103:0/1756999340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8f40d5230 0x7fa8f4177520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.266+0000 7fa8f9d9b640 1 -- 172.21.15.103:0/1756999340 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f40d5e90 con 0x7fa8f404b3b0 2024-09-10T08:41:11.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.266+0000 7fa8f9d9b640 1 --2- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f404b3b0 0x7fa8f4176fe0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000c390 tx=0x7fa8f000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:11.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.267+0000 7fa8eaffd640 1 -- 172.21.15.103:0/1756999340 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0017070 con 0x7fa8f404b3b0 2024-09-10T08:41:11.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.267+0000 7fa8eaffd640 1 -- 172.21.15.103:0/1756999340 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8f00052d0 con 0x7fa8f404b3b0 2024-09-10T08:41:11.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.267+0000 7fa8eaffd640 1 -- 172.21.15.103:0/1756999340 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0003830 con 0x7fa8f404b3b0 2024-09-10T08:41:11.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.268+0000 7fa8fb59e640 1 -- 172.21.15.103:0/1756999340 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f40d6170 con 0x7fa8f404b3b0 2024-09-10T08:41:11.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.268+0000 7fa8fb59e640 1 -- 172.21.15.103:0/1756999340 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f40d6730 con 0x7fa8f404b3b0 2024-09-10T08:41:11.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.272+0000 7fa8fb59e640 1 --2- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f4177a60 0x7fa8f40d6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.272+0000 7fa8fa59c640 1 --2- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f4177a60 0x7fa8f40d6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.273+0000 7fa8fb59e640 1 -- 172.21.15.103:0/1756999340 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f4008da0 con 0x7fa8f4177a60 2024-09-10T08:41:11.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.273+0000 7fa8eaffd640 1 -- 172.21.15.103:0/1756999340 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa8f001a070 con 0x7fa8f404b3b0 2024-09-10T08:41:11.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.273+0000 7fa8eaffd640 1 --2- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa8dc06bf00 0x7fa8dc06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.273+0000 7fa8eaffd640 1 -- 172.21.15.103:0/1756999340 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fa8f008a490 con 0x7fa8f404b3b0 2024-09-10T08:41:11.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.275+0000 7fa8fad9d640 1 --2- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa8dc06bf00 0x7fa8dc06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.276+0000 7fa8fad9d640 1 --2- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa8dc06bf00 0x7fa8dc06e3c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40cd660 tx=0x7fa8ec009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:11.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.277+0000 7fa8fa59c640 1 -- 172.21.15.103:0/1756999340 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa8f40d6a60 con 0x7fa8f4177a60 2024-09-10T08:41:11.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.277+0000 7fa8fa59c640 1 --2- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f4177a60 0x7fa8f40d6c50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc000b60 tx=0x7fa8fc069e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:11.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.278+0000 7fa8eaffd640 1 -- 172.21.15.103:0/1756999340 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0be070 con 0x7fa8f4177a60 2024-09-10T08:41:11.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.278+0000 7fa8eaffd640 1 -- 172.21.15.103:0/1756999340 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa8fc062840 con 0x7fa8f4177a60 2024-09-10T08:41:11.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.278+0000 7fa8eaffd640 1 -- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f4177a60 msgr2=0x7fa8f40d6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.278+0000 7fa8eaffd640 1 --2- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f4177a60 0x7fa8f40d6c50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc000b60 tx=0x7fa8fc069e30 comp rx=0 tx=0).stop 2024-09-10T08:41:11.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.278+0000 7fa8eaffd640 1 -- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f4177a60 msgr2=0x7fa8f40d6c50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:41:11.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.279+0000 7fa8eaffd640 1 --2- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f4177a60 0x7fa8f40d6c50 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc000b60 tx=0x7fa8fc069e30 comp rx=0 tx=0).stop 2024-09-10T08:41:11.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.292+0000 7fa8fb59e640 1 --2- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f40c6320 0x7fa8f40c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.293+0000 7fa8fa59c640 1 --2- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f40c6320 0x7fa8f40c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.293+0000 7fa8fb59e640 1 -- 172.21.15.103:0/1756999340 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f404a910 con 0x7fa8f40c6320 2024-09-10T08:41:11.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.294+0000 7fa8fa59c640 1 -- 172.21.15.103:0/1756999340 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa8f40d4950 con 0x7fa8f40c6320 2024-09-10T08:41:11.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.294+0000 7fa8fa59c640 1 --2- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f40c6320 0x7fa8f40c6700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc02dd50 tx=0x7fa8fc0ac000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:11.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.295+0000 7fa8eaffd640 1 -- 172.21.15.103:0/1756999340 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0a87a0 con 0x7fa8f40c6320 2024-09-10T08:41:11.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.296+0000 7fa8eaffd640 1 -- 172.21.15.103:0/1756999340 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4890 (secure 0 0 0) 0x7fa8fc0cc430 con 0x7fa8f40c6320 2024-09-10T08:41:11.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.296+0000 7fa8eaffd640 1 -- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f40c6320 msgr2=0x7fa8f40c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.296+0000 7fa8eaffd640 1 --2- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f40c6320 0x7fa8f40c6700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc02dd50 tx=0x7fa8fc0ac000 comp rx=0 tx=0).stop 2024-09-10T08:41:11.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.296+0000 7fa8eaffd640 1 -- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f40c6320 msgr2=0x7fa8f40c6700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:41:11.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.296+0000 7fa8eaffd640 1 --2- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f40c6320 0x7fa8f40c6700 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc02dd50 tx=0x7fa8fc0ac000 comp rx=0 tx=0).stop 2024-09-10T08:41:11.296 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:41:11.296 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:41:11.296 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:41:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:41:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 104, 2024-09-10T08:41:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 97760, 2024-09-10T08:41:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:41:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:41:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:41:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:41:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 18, 2024-09-10T08:41:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:41:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:41:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:41:11.297 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:41:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:41:11.298 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.299 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:41:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:41:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:41:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:41:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:41:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:41:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:41:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:41:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:41:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:41:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:41:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:41:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:41:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:41:11.300 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:41:11.301 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:41:11.301 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:41:11.301 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:11.301 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:11.301 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:11.301 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:11.301 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:11.301 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:11.301 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:11.301 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:11.301 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:11.301 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:11.301 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:11.302 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:11.302 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:41:11.302 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.302 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:41:11.302 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.302 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:41:11.302 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:41:11.302 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:11.302 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:11.302 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.302 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:11.302 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:41:11.303 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:11.303 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.303 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.303 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:11.303 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:41:11.303 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:11.303 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.303 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:11.303 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.303 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:41:11.303 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:41:11.304 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:11.304 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:11.304 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:11.304 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.304 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.304 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:41:11.304 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:41:11.304 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:11.304 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:11.304 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.304 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:11.304 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:41:11.304 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:11.305 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.305 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.305 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:11.305 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:41:11.305 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:11.305 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.305 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:11.305 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.305 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:41:11.305 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:41:11.305 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:11.305 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:11.305 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:11.306 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.306 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.306 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:41:11.306 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:41:11.306 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:11.306 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:11.306 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.306 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:11.306 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:41:11.306 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:11.306 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.306 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.306 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:11.306 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:41:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:41:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:41:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:41:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:41:11.307 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.308 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:11.308 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:11.308 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:41:11.308 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.308 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:11.308 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:41:11.308 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.308 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:11.308 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:11.308 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:41:11.308 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.308 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:11.308 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:41:11.309 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.309 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:11.309 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:11.309 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:41:11.309 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.309 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:11.309 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:41:11.309 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.309 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:11.309 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:11.309 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:41:11.309 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.310 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:11.310 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.310 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:41:11.310 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:41:11.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.297+0000 7fa8e8ff9640 1 -- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa8dc06bf00 msgr2=0x7fa8dc06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.297+0000 7fa8e8ff9640 1 --2- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa8dc06bf00 0x7fa8dc06e3c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40cd660 tx=0x7fa8ec009240 comp rx=0 tx=0).stop 2024-09-10T08:41:11.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.297+0000 7fa8fad9d640 1 -- 172.21.15.103:0/1756999340 reap_dead start 2024-09-10T08:41:11.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.297+0000 7fa8e8ff9640 1 -- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f404b3b0 msgr2=0x7fa8f4176fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.297+0000 7fa8e8ff9640 1 --2- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f404b3b0 0x7fa8f4176fe0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000c390 tx=0x7fa8f000c850 comp rx=0 tx=0).stop 2024-09-10T08:41:11.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.297+0000 7fa8e8ff9640 1 -- 172.21.15.103:0/1756999340 shutdown_connections 2024-09-10T08:41:11.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.297+0000 7fa8e8ff9640 1 --2- 172.21.15.103:0/1756999340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f404b3b0 0x7fa8f4176fe0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.297+0000 7fa8e8ff9640 1 -- 172.21.15.103:0/1756999340 >> 172.21.15.103:0/1756999340 conn(0x7fa8f402f060 msgr2=0x7fa8f402e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:11.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.298+0000 7fa8e8ff9640 1 -- 172.21.15.103:0/1756999340 shutdown_connections 2024-09-10T08:41:11.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.298+0000 7fa8e8ff9640 1 -- 172.21.15.103:0/1756999340 wait complete. 2024-09-10T08:41:11.319 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:41:11.319 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:41:11.320 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:41:11.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.495+0000 7f8bb4cba640 1 Processor -- start 2024-09-10T08:41:11.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.495+0000 7f8bb4cba640 1 -- start start 2024-09-10T08:41:11.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.496+0000 7f8bb4cba640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8bb006f1d0 0x7f8bb00c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.496+0000 7f8bb4cba640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8bb00c5940 0x7f8bb0152a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.496+0000 7f8bb4cba640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb00c7500 con 0x7f8bb014fa90 2024-09-10T08:41:11.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.496+0000 7f8bb4cba640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f8bb00c72b0 con 0x7f8bb006f1d0 2024-09-10T08:41:11.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.496+0000 7f8bb4cba640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8bb0152580 con 0x7f8bb00c5940 2024-09-10T08:41:11.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.496+0000 7f8bae59c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8bb014fa90 0x7f8bb00c44d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:59214/0 (socket says 172.21.15.103:59214) 2024-09-10T08:41:11.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.496+0000 7f8bae59c640 1 -- 172.21.15.103:0/1929990089 learned_addr learned my addr 172.21.15.103:0/1929990089 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:41:11.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.497+0000 7f8bad59a640 1 -- 172.21.15.103:0/1929990089 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1376133773 0 0) 0x7f8bb00c7500 con 0x7f8bb014fa90 2024-09-10T08:41:11.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.497+0000 7f8bad59a640 1 -- 172.21.15.103:0/1929990089 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b98003520 con 0x7f8bb014fa90 2024-09-10T08:41:11.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.497+0000 7f8bad59a640 1 -- 172.21.15.103:0/1929990089 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 344517692 0 0) 0x7f8b98003520 con 0x7f8bb014fa90 2024-09-10T08:41:11.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.497+0000 7f8bad59a640 1 -- 172.21.15.103:0/1929990089 >> v2:172.21.15.154:3300/0 conn(0x7f8bb00c5940 msgr2=0x7f8bb0152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:11.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.497+0000 7f8bad59a640 1 --2- 172.21.15.103:0/1929990089 >> v2:172.21.15.154:3300/0 conn(0x7f8bb00c5940 0x7f8bb0152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.497+0000 7f8bad59a640 1 -- 172.21.15.103:0/1929990089 >> v2:172.21.15.103:3300/0 conn(0x7f8bb006f1d0 msgr2=0x7f8bb00c2e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:41:11.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.498+0000 7f8bad59a640 1 --2- 172.21.15.103:0/1929990089 >> v2:172.21.15.103:3300/0 conn(0x7f8bb006f1d0 0x7f8bb00c2e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.498+0000 7f8bad59a640 1 -- 172.21.15.103:0/1929990089 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb0156300 con 0x7f8bb014fa90 2024-09-10T08:41:11.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.498+0000 7f8bad59a640 1 -- 172.21.15.103:0/1929990089 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f8ba0001670 con 0x7f8bb014fa90 2024-09-10T08:41:11.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.498+0000 7f8bad59a640 1 -- 172.21.15.103:0/1929990089 >> v1:172.21.15.103:6789/0 conn(0x7f8bb014fa90 legacy=0x7f8bb00c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.498+0000 7f8bad59a640 1 --2- 172.21.15.103:0/1929990089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b98003a00 0x7f8b98003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.498+0000 7f8bad59a640 1 --2- 172.21.15.103:0/1929990089 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b98004800 0x7f8b98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.498+0000 7f8bad59a640 1 --2- 172.21.15.103:0/1929990089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b980053c0 0x7f8b9800ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.498+0000 7f8bad59a640 1 -- 172.21.15.103:0/1929990089 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb00c72b0 con 0x7f8b98003a00 2024-09-10T08:41:11.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.498+0000 7f8bad59a640 1 -- 172.21.15.103:0/1929990089 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb0152580 con 0x7f8b980053c0 2024-09-10T08:41:11.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.498+0000 7f8bad59a640 1 -- 172.21.15.103:0/1929990089 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9800c360 con 0x7f8b98004800 2024-09-10T08:41:11.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.498+0000 7f8bae59c640 1 --2- 172.21.15.103:0/1929990089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b98003a00 0x7f8b98003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.498+0000 7f8baed9d640 1 --2- 172.21.15.103:0/1929990089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b980053c0 0x7f8b9800ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.498+0000 7f8badd9b640 1 --2- 172.21.15.103:0/1929990089 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b98004800 0x7f8b98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.499+0000 7f8baed9d640 1 -- 172.21.15.103:0/1929990089 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b98004800 msgr2=0x7f8b98004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:11.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.499+0000 7f8baed9d640 1 --2- 172.21.15.103:0/1929990089 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b98004800 0x7f8b98004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.499+0000 7f8baed9d640 1 -- 172.21.15.103:0/1929990089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b98003a00 msgr2=0x7f8b98003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:11.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.499+0000 7f8baed9d640 1 --2- 172.21.15.103:0/1929990089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b98003a00 0x7f8b98003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.499+0000 7f8baed9d640 1 -- 172.21.15.103:0/1929990089 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b98003520 con 0x7f8b980053c0 2024-09-10T08:41:11.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.500+0000 7f8baed9d640 1 -- 172.21.15.103:0/1929990089 reap_dead start 2024-09-10T08:41:11.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.500+0000 7f8baed9d640 1 --2- 172.21.15.103:0/1929990089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b980053c0 0x7f8b9800ba00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80099d0 tx=0x7f8b98005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b92a2720185b613 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:11.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.500+0000 7f8bad59a640 1 -- 172.21.15.103:0/1929990089 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8009a10 con 0x7f8b980053c0 2024-09-10T08:41:11.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.501+0000 7f8bad59a640 1 -- 172.21.15.103:0/1929990089 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba8006e50 con 0x7f8b980053c0 2024-09-10T08:41:11.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.501+0000 7f8bad59a640 1 -- 172.21.15.103:0/1929990089 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8003df0 con 0x7f8b980053c0 2024-09-10T08:41:11.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.502+0000 7f8bb4cba640 1 -- 172.21.15.103:0/1929990089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b980053c0 msgr2=0x7f8b9800ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.502+0000 7f8bb4cba640 1 --2- 172.21.15.103:0/1929990089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b980053c0 0x7f8b9800ba00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80099d0 tx=0x7f8b98005830 comp rx=0 tx=0).stop 2024-09-10T08:41:11.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.502+0000 7f8bb4cba640 1 -- 172.21.15.103:0/1929990089 shutdown_connections 2024-09-10T08:41:11.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.502+0000 7f8bb4cba640 1 --2- 172.21.15.103:0/1929990089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b980053c0 0x7f8b9800ba00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.502+0000 7f8bb4cba640 1 -- 172.21.15.103:0/1929990089 >> 172.21.15.103:0/1929990089 conn(0x7f8bb00c7a40 msgr2=0x7f8bb00c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:11.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.503+0000 7f8bb4cba640 1 -- 172.21.15.103:0/1929990089 shutdown_connections 2024-09-10T08:41:11.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.503+0000 7f8bb4cba640 1 -- 172.21.15.103:0/1929990089 wait complete. 2024-09-10T08:41:11.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.505+0000 7f8bb4cba640 1 Processor -- start 2024-09-10T08:41:11.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.506+0000 7f8bb4cba640 1 -- start start 2024-09-10T08:41:11.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.507+0000 7f8bb4cba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b980053c0 0x7f8bb0073bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.508+0000 7f8bb4cba640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bb00c1880 0x7f8bb00c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.508+0000 7f8bb4cba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bb014da30 0x7f8bb014deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.508+0000 7f8bb4cba640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb014fe70 con 0x7f8b980053c0 2024-09-10T08:41:11.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.508+0000 7f8bb4cba640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb00c2b10 con 0x7f8bb014da30 2024-09-10T08:41:11.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.508+0000 7f8bb4cba640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb00c8530 con 0x7f8bb00c1880 2024-09-10T08:41:11.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.508+0000 7f8bae59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b980053c0 0x7f8bb0073bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.508+0000 7f8bae59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b980053c0 0x7f8bb0073bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53918/0 (socket says 172.21.15.103:53918) 2024-09-10T08:41:11.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.508+0000 7f8bae59c640 1 -- 172.21.15.103:0/3169712992 learned_addr learned my addr 172.21.15.103:0/3169712992 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:11.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.508+0000 7f8baed9d640 1 --2- 172.21.15.103:0/3169712992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bb014da30 0x7f8bb014deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.508+0000 7f8badd9b640 1 --2- 172.21.15.103:0/3169712992 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bb00c1880 0x7f8bb00c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.508+0000 7f8bae59c640 1 -- 172.21.15.103:0/3169712992 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bb00c1880 msgr2=0x7f8bb00c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.508+0000 7f8bae59c640 1 --2- 172.21.15.103:0/3169712992 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bb00c1880 0x7f8bb00c1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.508+0000 7f8bae59c640 1 -- 172.21.15.103:0/3169712992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bb014da30 msgr2=0x7f8bb014deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.508+0000 7f8bae59c640 1 --2- 172.21.15.103:0/3169712992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bb014da30 0x7f8bb014deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.508+0000 7f8bae59c640 1 -- 172.21.15.103:0/3169712992 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb00ac130 con 0x7f8b980053c0 2024-09-10T08:41:11.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.508+0000 7f8badd9b640 1 --2- 172.21.15.103:0/3169712992 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bb00c1880 0x7f8bb00c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:41:11.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.509+0000 7f8bae59c640 1 --2- 172.21.15.103:0/3169712992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b980053c0 0x7f8bb0073bd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000bb30 tx=0x7f8ba0001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:11.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.509+0000 7f8b9effd640 1 -- 172.21.15.103:0/3169712992 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0015070 con 0x7f8b980053c0 2024-09-10T08:41:11.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.509+0000 7f8bb4cba640 1 -- 172.21.15.103:0/3169712992 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb00ac410 con 0x7f8b980053c0 2024-09-10T08:41:11.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.509+0000 7f8bb4cba640 1 -- 172.21.15.103:0/3169712992 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb00ac9d0 con 0x7f8b980053c0 2024-09-10T08:41:11.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.510+0000 7f8b9effd640 1 -- 172.21.15.103:0/3169712992 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba0009040 con 0x7f8b980053c0 2024-09-10T08:41:11.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.510+0000 7f8b9effd640 1 -- 172.21.15.103:0/3169712992 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba00113f0 con 0x7f8b980053c0 2024-09-10T08:41:11.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.512+0000 7f8b9cff9640 1 --2- 172.21.15.103:0/3169712992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b94002a70 0x7f8b94004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.512+0000 7f8b9cff9640 1 -- 172.21.15.103:0/3169712992 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b94007ec0 con 0x7f8b94002a70 2024-09-10T08:41:11.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.515+0000 7f8badd9b640 1 --2- 172.21.15.103:0/3169712992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b94002a70 0x7f8b94004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.516+0000 7f8b9effd640 1 -- 172.21.15.103:0/3169712992 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ba0011590 con 0x7f8b980053c0 2024-09-10T08:41:11.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.516+0000 7f8b9effd640 1 --2- 172.21.15.103:0/3169712992 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8b9006bf00 0x7f8b9006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.517+0000 7f8b9effd640 1 -- 172.21.15.103:0/3169712992 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f8ba008bd10 con 0x7f8b980053c0 2024-09-10T08:41:11.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.517+0000 7f8baed9d640 1 --2- 172.21.15.103:0/3169712992 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8b9006bf00 0x7f8b9006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.517+0000 7f8badd9b640 1 -- 172.21.15.103:0/3169712992 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b940080c0 con 0x7f8b94002a70 2024-09-10T08:41:11.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.518+0000 7f8badd9b640 1 --2- 172.21.15.103:0/3169712992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b94002a70 0x7f8b94004f30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4010590 tx=0x7f8ba4010a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:11.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.520+0000 7f8b9effd640 1 -- 172.21.15.103:0/3169712992 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba400f040 con 0x7f8b94002a70 2024-09-10T08:41:11.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.521+0000 7f8b9effd640 1 -- 172.21.15.103:0/3169712992 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8ba401c400 con 0x7f8b94002a70 2024-09-10T08:41:11.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.522+0000 7f8b9effd640 1 -- 172.21.15.103:0/3169712992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b94002a70 msgr2=0x7f8b94004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.522+0000 7f8b9effd640 1 --2- 172.21.15.103:0/3169712992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b94002a70 0x7f8b94004f30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4010590 tx=0x7f8ba4010a50 comp rx=0 tx=0).stop 2024-09-10T08:41:11.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.523+0000 7f8b9effd640 1 -- 172.21.15.103:0/3169712992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b94002a70 msgr2=0x7f8b94004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:41:11.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.523+0000 7f8b9effd640 1 --2- 172.21.15.103:0/3169712992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b94002a70 0x7f8b94004f30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.527+0000 7f8baed9d640 1 --2- 172.21.15.103:0/3169712992 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8b9006bf00 0x7f8b9006e3c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8b9800c330 tx=0x7f8ba800f040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:11.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.533+0000 7f8b9cff9640 1 --2- 172.21.15.103:0/3169712992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b94006f30 0x7f8b940073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.534+0000 7f8b9cff9640 1 -- 172.21.15.103:0/3169712992 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9400a4a0 con 0x7f8b94006f30 2024-09-10T08:41:11.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.534+0000 7f8badd9b640 1 --2- 172.21.15.103:0/3169712992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b94006f30 0x7f8b940073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.534+0000 7f8badd9b640 1 -- 172.21.15.103:0/3169712992 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8b94007900 con 0x7f8b94006f30 2024-09-10T08:41:11.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.535+0000 7f8badd9b640 1 --2- 172.21.15.103:0/3169712992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b94006f30 0x7f8b940073c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4010590 tx=0x7f8ba4004700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:11.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.536+0000 7f8b9effd640 1 -- 172.21.15.103:0/3169712992 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4006240 con 0x7f8b94006f30 2024-09-10T08:41:11.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.536+0000 7f8b9effd640 1 -- 172.21.15.103:0/3169712992 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4554 (secure 0 0 0) 0x7f8ba40063e0 con 0x7f8b94006f30 2024-09-10T08:41:11.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.536+0000 7f8b9effd640 1 -- 172.21.15.103:0/3169712992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b94006f30 msgr2=0x7f8b940073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.536+0000 7f8b9effd640 1 --2- 172.21.15.103:0/3169712992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b94006f30 0x7f8b940073c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4010590 tx=0x7f8ba4004700 comp rx=0 tx=0).stop 2024-09-10T08:41:11.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.536+0000 7f8b9effd640 1 -- 172.21.15.103:0/3169712992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b94006f30 msgr2=0x7f8b940073c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:41:11.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.536+0000 7f8b9effd640 1 --2- 172.21.15.103:0/3169712992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b94006f30 0x7f8b940073c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.537 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:41:11.537 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:41:11.537 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:41:11.537 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:41:11.537 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 104, 2024-09-10T08:41:11.537 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 23743, 2024-09-10T08:41:11.537 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:41:11.537 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:41:11.537 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:41:11.537 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:41:11.538 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:11.538 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 18, 2024-09-10T08:41:11.538 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:41:11.538 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:41:11.538 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:41:11.538 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:11.538 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:11.538 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:11.538 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:11.538 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:11.538 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:11.538 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:11.538 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:11.538 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:11.539 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:11.539 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:11.539 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:11.539 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:41:11.539 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:41:11.539 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:11.539 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:11.539 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:11.539 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:11.539 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:11.539 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:11.539 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:11.539 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:11.539 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:11.540 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:11.540 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:11.540 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:11.540 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.540 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:41:11.540 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:41:11.540 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:41:11.540 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:41:11.540 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:41:11.540 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:41:11.540 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:41:11.540 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:41:11.540 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:41:11.541 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:41:11.541 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:41:11.541 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:41:11.541 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:41:11.541 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:41:11.541 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:41:11.541 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:41:11.541 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:41:11.541 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:11.541 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:11.541 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:11.541 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:11.541 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:11.541 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:11.542 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:11.542 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:11.542 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:11.542 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:11.542 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:11.542 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:11.542 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:41:11.542 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.542 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:41:11.542 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.542 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:41:11.542 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:41:11.542 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:11.543 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:11.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.543 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:11.543 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:41:11.543 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:11.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.543 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:11.543 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:41:11.543 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:11.544 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.544 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:11.544 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.544 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:41:11.544 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:41:11.544 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:11.544 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:11.544 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:11.544 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.545 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.545 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:41:11.545 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:41:11.545 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:11.545 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:11.545 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.545 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:11.545 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:41:11.545 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:11.545 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.545 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.546 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:11.546 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:41:11.546 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:11.546 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.546 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:11.546 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.546 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:41:11.546 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:41:11.546 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:11.546 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:11.546 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:11.546 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.547 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.547 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:41:11.547 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:41:11.547 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:11.547 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:11.547 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.547 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:11.547 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:41:11.547 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:11.547 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.547 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.547 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:11.548 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:41:11.548 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:11.548 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.548 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:11.548 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.548 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:41:11.549 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:41:11.549 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:11.549 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:11.550 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:11.550 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.550 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:11.550 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.550 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:41:11.550 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:41:11.550 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.550 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:11.550 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:11.550 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:41:11.550 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.550 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:11.551 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:41:11.551 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.551 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:11.551 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:11.551 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:41:11.551 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.551 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:11.551 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.551 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:41:11.551 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:41:11.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.539+0000 7f8bb4cba640 1 -- 172.21.15.103:0/3169712992 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8b9006bf00 msgr2=0x7f8b9006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.539+0000 7f8bb4cba640 1 --2- 172.21.15.103:0/3169712992 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8b9006bf00 0x7f8b9006e3c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8b9800c330 tx=0x7f8ba800f040 comp rx=0 tx=0).stop 2024-09-10T08:41:11.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.540+0000 7f8bb4cba640 1 -- 172.21.15.103:0/3169712992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b980053c0 msgr2=0x7f8bb0073bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.540+0000 7f8bb4cba640 1 --2- 172.21.15.103:0/3169712992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b980053c0 0x7f8bb0073bd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000bb30 tx=0x7f8ba0001690 comp rx=0 tx=0).stop 2024-09-10T08:41:11.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.541+0000 7f8baed9d640 1 -- 172.21.15.103:0/3169712992 reap_dead start 2024-09-10T08:41:11.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.541+0000 7f8baed9d640 1 -- 172.21.15.103:0/3169712992 reap_dead start 2024-09-10T08:41:11.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.543+0000 7f8bb4cba640 1 -- 172.21.15.103:0/3169712992 shutdown_connections 2024-09-10T08:41:11.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.543+0000 7f8bb4cba640 1 -- 172.21.15.103:0/3169712992 >> 172.21.15.103:0/3169712992 conn(0x7f8bb00c7a40 msgr2=0x7f8bb00c4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:11.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.544+0000 7f8bb4cba640 1 -- 172.21.15.103:0/3169712992 shutdown_connections 2024-09-10T08:41:11.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.544+0000 7f8bb4cba640 1 -- 172.21.15.103:0/3169712992 wait complete. 2024-09-10T08:41:11.568 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:41:11.568 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:41:11.568 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:41:11.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.767+0000 7ffb120f0640 1 Processor -- start 2024-09-10T08:41:11.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.767+0000 7ffb120f0640 1 -- start start 2024-09-10T08:41:11.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.768+0000 7ffb120f0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb0c0aaa80 0x7ffb0c166ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.769+0000 7ffb120f0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffb0c0c4070 0x7ffb0c167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.769+0000 7ffb120f0640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb0c167550 con 0x7ffb0c06d750 2024-09-10T08:41:11.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.769+0000 7ffb120f0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ffb0c0c2520 con 0x7ffb0c0c4070 2024-09-10T08:41:11.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.769+0000 7ffb120f0640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ffb0c0c2800 con 0x7ffb0c0aaa80 2024-09-10T08:41:11.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.769+0000 7ffb108ed640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb0c0aaa80 0x7ffb0c166ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.769+0000 7ffb108ed640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb0c0aaa80 0x7ffb0c166ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:36800/0 (socket says 172.21.15.103:36800) 2024-09-10T08:41:11.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.769+0000 7ffb108ed640 1 -- 172.21.15.103:0/3860105040 learned_addr learned my addr 172.21.15.103:0/3860105040 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:11.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.770+0000 7ffb118ef640 1 --2- 172.21.15.103:0/3860105040 >> v2:172.21.15.154:3300/0 conn(0x7ffb0c0c4070 0x7ffb0c167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.770+0000 7ffb108ed640 1 -- 172.21.15.103:0/3860105040 >> v2:172.21.15.154:3300/0 conn(0x7ffb0c0c4070 msgr2=0x7ffb0c167010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:11.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.770+0000 7ffb108ed640 1 --2- 172.21.15.103:0/3860105040 >> v2:172.21.15.154:3300/0 conn(0x7ffb0c0c4070 0x7ffb0c167010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.770+0000 7ffb108ed640 1 -- 172.21.15.103:0/3860105040 >> v1:172.21.15.103:6789/0 conn(0x7ffb0c06d750 legacy=0x7ffb0c0c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.770+0000 7ffb108ed640 1 -- 172.21.15.103:0/3860105040 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb0c0c2ae0 con 0x7ffb0c0aaa80 2024-09-10T08:41:11.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.773+0000 7ffb108ed640 1 --2- 172.21.15.103:0/3860105040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb0c0aaa80 0x7ffb0c166ad0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffb04008ec0 tx=0x7ffb04033030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecfc83ebb88369cc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:11.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.774+0000 7ffb03fff640 1 -- 172.21.15.103:0/3860105040 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb04040070 con 0x7ffb0c0aaa80 2024-09-10T08:41:11.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.774+0000 7ffb03fff640 1 -- 172.21.15.103:0/3860105040 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb04033cc0 con 0x7ffb0c0aaa80 2024-09-10T08:41:11.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.775+0000 7ffb120f0640 1 -- 172.21.15.103:0/3860105040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb0c0aaa80 msgr2=0x7ffb0c166ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.775+0000 7ffb120f0640 1 --2- 172.21.15.103:0/3860105040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb0c0aaa80 0x7ffb0c166ad0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffb04008ec0 tx=0x7ffb04033030 comp rx=0 tx=0).stop 2024-09-10T08:41:11.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.775+0000 7ffb120f0640 1 -- 172.21.15.103:0/3860105040 shutdown_connections 2024-09-10T08:41:11.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.775+0000 7ffb120f0640 1 --2- 172.21.15.103:0/3860105040 >> v2:172.21.15.154:3300/0 conn(0x7ffb0c0c4070 0x7ffb0c167010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.775+0000 7ffb120f0640 1 --2- 172.21.15.103:0/3860105040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb0c0aaa80 0x7ffb0c166ad0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.775+0000 7ffb120f0640 1 -- 172.21.15.103:0/3860105040 >> 172.21.15.103:0/3860105040 conn(0x7ffb0c0a9780 msgr2=0x7ffb0c0a9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:11.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.775+0000 7ffb120f0640 1 -- 172.21.15.103:0/3860105040 shutdown_connections 2024-09-10T08:41:11.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.775+0000 7ffb120f0640 1 -- 172.21.15.103:0/3860105040 wait complete. 2024-09-10T08:41:11.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.777+0000 7ffb120f0640 1 Processor -- start 2024-09-10T08:41:11.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.777+0000 7ffb120f0640 1 -- start start 2024-09-10T08:41:11.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.778+0000 7ffb120f0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb0c06d750 0x7ffb0c161210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.778+0000 7ffb120f0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb0c0aaa80 0x7ffb0c08c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.778+0000 7ffb120f0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb0c0c4070 0x7ffb0c08cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.778+0000 7ffb120f0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0c0c71f0 con 0x7ffb0c06d750 2024-09-10T08:41:11.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.778+0000 7ffb120f0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0c0c65c0 con 0x7ffb0c0aaa80 2024-09-10T08:41:11.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.778+0000 7ffb120f0640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ffb0c0c7370 con 0x7ffb0c0c4070 2024-09-10T08:41:11.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.779+0000 7ffb110ee640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb0c06d750 0x7ffb0c161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.779+0000 7ffb110ee640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb0c06d750 0x7ffb0c161210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53926/0 (socket says 172.21.15.103:53926) 2024-09-10T08:41:11.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.779+0000 7ffb110ee640 1 -- 172.21.15.103:0/405993944 learned_addr learned my addr 172.21.15.103:0/405993944 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:11.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.779+0000 7ffb110ee640 1 -- 172.21.15.103:0/405993944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb0c0c4070 msgr2=0x7ffb0c08cc30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:41:11.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.779+0000 7ffb110ee640 1 --2- 172.21.15.103:0/405993944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb0c0c4070 0x7ffb0c08cc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.779+0000 7ffb110ee640 1 -- 172.21.15.103:0/405993944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb0c0aaa80 msgr2=0x7ffb0c08c6f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:41:11.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.779+0000 7ffb110ee640 1 --2- 172.21.15.103:0/405993944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb0c0aaa80 0x7ffb0c08c6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.779+0000 7ffb110ee640 1 -- 172.21.15.103:0/405993944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb0c08d170 con 0x7ffb0c06d750 2024-09-10T08:41:11.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.780+0000 7ffb110ee640 1 --2- 172.21.15.103:0/405993944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb0c06d750 0x7ffb0c161210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffb0800c8f0 tx=0x7ffb0800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:11.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.781+0000 7ffb01ffb640 1 -- 172.21.15.103:0/405993944 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08017070 con 0x7ffb0c06d750 2024-09-10T08:41:11.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.781+0000 7ffb120f0640 1 -- 172.21.15.103:0/405993944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb0c0a8140 con 0x7ffb0c06d750 2024-09-10T08:41:11.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.781+0000 7ffb120f0640 1 -- 172.21.15.103:0/405993944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb0c1fc380 con 0x7ffb0c06d750 2024-09-10T08:41:11.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.781+0000 7ffb01ffb640 1 -- 172.21.15.103:0/405993944 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb08005270 con 0x7ffb0c06d750 2024-09-10T08:41:11.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.781+0000 7ffb01ffb640 1 -- 172.21.15.103:0/405993944 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0800a640 con 0x7ffb0c06d750 2024-09-10T08:41:11.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.787+0000 7ffb120f0640 1 --2- 172.21.15.103:0/405993944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaec002a70 0x7ffaec004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.787+0000 7ffb120f0640 1 -- 172.21.15.103:0/405993944 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ffaec007ec0 con 0x7ffaec002a70 2024-09-10T08:41:11.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.788+0000 7ffb108ed640 1 --2- 172.21.15.103:0/405993944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaec002a70 0x7ffaec004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.788+0000 7ffb108ed640 1 -- 172.21.15.103:0/405993944 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffaec0080c0 con 0x7ffaec002a70 2024-09-10T08:41:11.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.788+0000 7ffb108ed640 1 --2- 172.21.15.103:0/405993944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaec002a70 0x7ffaec004f30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c0c8a90 tx=0x7ffb04004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:11.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.789+0000 7ffb01ffb640 1 -- 172.21.15.103:0/405993944 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0404a020 con 0x7ffaec002a70 2024-09-10T08:41:11.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.790+0000 7ffb01ffb640 1 -- 172.21.15.103:0/405993944 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ffb0403ba40 con 0x7ffaec002a70 2024-09-10T08:41:11.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.790+0000 7ffb01ffb640 1 -- 172.21.15.103:0/405993944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaec002a70 msgr2=0x7ffaec004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.791+0000 7ffb01ffb640 1 --2- 172.21.15.103:0/405993944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaec002a70 0x7ffaec004f30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c0c8a90 tx=0x7ffb04004a40 comp rx=0 tx=0).stop 2024-09-10T08:41:11.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.791+0000 7ffb01ffb640 1 -- 172.21.15.103:0/405993944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaec002a70 msgr2=0x7ffaec004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:41:11.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.791+0000 7ffb01ffb640 1 --2- 172.21.15.103:0/405993944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaec002a70 0x7ffaec004f30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.791+0000 7ffb01ffb640 1 -- 172.21.15.103:0/405993944 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb0801a070 con 0x7ffb0c06d750 2024-09-10T08:41:11.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.792+0000 7ffb01ffb640 1 --2- 172.21.15.103:0/405993944 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ffaf006b8c0 0x7ffaf006dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.793+0000 7ffb01ffb640 1 -- 172.21.15.103:0/405993944 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7ffb0808a550 con 0x7ffb0c06d750 2024-09-10T08:41:11.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.793+0000 7ffb108ed640 1 --2- 172.21.15.103:0/405993944 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ffaf006b8c0 0x7ffaf006dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.794+0000 7ffb108ed640 1 --2- 172.21.15.103:0/405993944 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ffaf006b8c0 0x7ffaf006dd80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ffaec008090 tx=0x7ffb04046000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:11.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.821+0000 7ffb120f0640 1 --2- 172.21.15.103:0/405993944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaec006f10 0x7ffaec0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:11.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.821+0000 7ffb120f0640 1 -- 172.21.15.103:0/405993944 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ffaec00a450 con 0x7ffaec006f10 2024-09-10T08:41:11.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.822+0000 7ffb118ef640 1 --2- 172.21.15.103:0/405993944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaec006f10 0x7ffaec0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:11.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.825+0000 7ffb118ef640 1 -- 172.21.15.103:0/405993944 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ffaec0078e0 con 0x7ffaec006f10 2024-09-10T08:41:11.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.829+0000 7ffb118ef640 1 --2- 172.21.15.103:0/405993944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaec006f10 0x7ffaec0073a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffafc00a360 tx=0x7ffafc00a820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:11.831 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:41:11.831 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:41:11.831 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:41:11.831 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:41:11.831 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 104, 2024-09-10T08:41:11.831 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 164662, 2024-09-10T08:41:11.832 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:41:11.832 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:41:11.832 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:41:11.832 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:41:11.832 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:11.832 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 18, 2024-09-10T08:41:11.832 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:41:11.832 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:41:11.832 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:41:11.832 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:11.832 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:11.832 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:11.833 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:11.833 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:11.833 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:11.833 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:11.833 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:11.833 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:11.833 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:11.833 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:11.833 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:11.833 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:41:11.833 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:41:11.833 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:11.833 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:11.834 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:11.834 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:11.834 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:11.834 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:11.834 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:11.834 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:11.834 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:11.834 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:11.834 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:11.834 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:11.834 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.834 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:41:11.834 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:41:11.835 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:41:11.835 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:41:11.835 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:41:11.835 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:41:11.835 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:41:11.835 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:41:11.835 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:41:11.835 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:41:11.835 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:41:11.835 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:41:11.835 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:41:11.835 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:41:11.835 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:41:11.835 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:41:11.836 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:41:11.836 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:11.836 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:11.836 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:11.836 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:11.836 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:11.836 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:11.836 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:11.836 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:11.836 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:11.836 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:11.836 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:11.837 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:11.837 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:41:11.837 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.837 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:41:11.837 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.837 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:41:11.837 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:41:11.837 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:11.837 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:11.837 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.837 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:11.837 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:41:11.837 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:11.838 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.838 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.838 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:11.838 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:41:11.838 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:11.838 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.838 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:11.838 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.838 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:41:11.838 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:41:11.838 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:11.838 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:11.838 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:11.839 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.839 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.839 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:41:11.839 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:41:11.839 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:11.839 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:11.839 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.839 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:11.839 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:41:11.839 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:11.839 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.839 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.839 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:11.840 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:41:11.840 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:11.840 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.840 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:11.840 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.840 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:41:11.840 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:41:11.840 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:11.840 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:11.840 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:11.840 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.840 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.840 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:41:11.841 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:41:11.841 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:11.841 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:11.841 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.841 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:11.841 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:41:11.841 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:11.841 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.841 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.841 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:11.841 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:41:11.841 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:11.841 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.842 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:11.842 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.842 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:41:11.842 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:41:11.842 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:11.842 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:11.842 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:11.842 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.842 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:11.842 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.842 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:41:11.842 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:41:11.842 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.842 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:11.843 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:11.843 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:41:11.843 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.843 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:11.843 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:41:11.843 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.843 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:11.843 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:11.843 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:41:11.843 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.843 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:11.843 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:41:11.843 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.844 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:11.844 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:11.844 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-10T08:41:11.844 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.844 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:11.844 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:41:11.844 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.844 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:11.844 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:11.844 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:41:11.844 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.844 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:11.844 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:41:11.844 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:11.845 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:11.845 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:11.845 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:41:11.845 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:11.845 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:11.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:11.845 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:41:11.845 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:41:11.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.831+0000 7ffb01ffb640 1 -- 172.21.15.103:0/405993944 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffafc019060 con 0x7ffaec006f10 2024-09-10T08:41:11.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.831+0000 7ffb01ffb640 1 -- 172.21.15.103:0/405993944 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5056 (secure 0 0 0) 0x7ffafc004220 con 0x7ffaec006f10 2024-09-10T08:41:11.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.831+0000 7ffb01ffb640 1 -- 172.21.15.103:0/405993944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaec006f10 msgr2=0x7ffaec0073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.831+0000 7ffb01ffb640 1 --2- 172.21.15.103:0/405993944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaec006f10 0x7ffaec0073a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffafc00a360 tx=0x7ffafc00a820 comp rx=0 tx=0).stop 2024-09-10T08:41:11.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.831+0000 7ffb01ffb640 1 -- 172.21.15.103:0/405993944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaec006f10 msgr2=0x7ffaec0073a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:41:11.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.831+0000 7ffb01ffb640 1 --2- 172.21.15.103:0/405993944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffaec006f10 0x7ffaec0073a0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffafc00a360 tx=0x7ffafc00a820 comp rx=0 tx=0).stop 2024-09-10T08:41:11.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.832+0000 7ffaf77fe640 1 -- 172.21.15.103:0/405993944 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ffaf006b8c0 msgr2=0x7ffaf006dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.832+0000 7ffaf77fe640 1 --2- 172.21.15.103:0/405993944 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ffaf006b8c0 0x7ffaf006dd80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ffaec008090 tx=0x7ffb04046000 comp rx=0 tx=0).stop 2024-09-10T08:41:11.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.832+0000 7ffb118ef640 1 -- 172.21.15.103:0/405993944 reap_dead start 2024-09-10T08:41:11.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.832+0000 7ffaf77fe640 1 -- 172.21.15.103:0/405993944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb0c06d750 msgr2=0x7ffb0c161210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:11.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.832+0000 7ffaf77fe640 1 --2- 172.21.15.103:0/405993944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb0c06d750 0x7ffb0c161210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffb0800c8f0 tx=0x7ffb0800cdb0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.832+0000 7ffaf77fe640 1 -- 172.21.15.103:0/405993944 shutdown_connections 2024-09-10T08:41:11.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.832+0000 7ffaf77fe640 1 --2- 172.21.15.103:0/405993944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb0c06d750 0x7ffb0c161210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:11.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.832+0000 7ffaf77fe640 1 -- 172.21.15.103:0/405993944 >> 172.21.15.103:0/405993944 conn(0x7ffb0c0a9780 msgr2=0x7ffb0c0a9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:11.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.834+0000 7ffaf77fe640 1 -- 172.21.15.103:0/405993944 shutdown_connections 2024-09-10T08:41:11.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:11.834+0000 7ffaf77fe640 1 -- 172.21.15.103:0/405993944 wait complete. 2024-09-10T08:41:11.873 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:41:11.873 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-09-10T08:41:11.873 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-10T08:41:11.873 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-10T08:41:11.873 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-10T08:41:11.873 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T08:41:11.874 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:41:11.892 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T08:41:11.892 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-10T08:41:11.892 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:41:12.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.126+0000 7f7768c3c640 1 Processor -- start 2024-09-10T08:41:12.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.126+0000 7f7768c3c640 1 -- start start 2024-09-10T08:41:12.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.128+0000 7f7768c3c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7764153be0 0x7f77640c3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:12.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.128+0000 7f7768c3c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77640ac720 0x7f77640c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:12.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.128+0000 7f7768c3c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77640c8460 con 0x7f77640c7fb0 2024-09-10T08:41:12.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.128+0000 7f7768c3c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f7764156db0 con 0x7f7764153be0 2024-09-10T08:41:12.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.128+0000 7f7768c3c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7764153fc0 con 0x7f77640ac720 2024-09-10T08:41:12.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.128+0000 7f775bfff640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77640ac720 msgr2=0x7f77640c7a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:41:12.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.128+0000 7f775bfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77640ac720 0x7f77640c7a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:41:12.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.128+0000 7f776259c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7764153be0 0x7f77640c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:12.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.128+0000 7f776259c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7764153be0 0x7f77640c3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:40130/0 (socket says 172.21.15.103:40130) 2024-09-10T08:41:12.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.128+0000 7f776259c640 1 -- 172.21.15.103:0/2431377142 learned_addr learned my addr 172.21.15.103:0/2431377142 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:12.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.129+0000 7f776259c640 1 -- 172.21.15.103:0/2431377142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77640ac720 msgr2=0x7f77640c7a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:41:12.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.129+0000 7f776259c640 1 --2- 172.21.15.103:0/2431377142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77640ac720 0x7f77640c7a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:12.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.129+0000 7f776259c640 1 -- 172.21.15.103:0/2431377142 >> v1:172.21.15.154:6789/0 conn(0x7f77640c7fb0 legacy=0x7f77641598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:12.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.129+0000 7f776259c640 1 -- 172.21.15.103:0/2431377142 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77640a8030 con 0x7f7764153be0 2024-09-10T08:41:12.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.132+0000 7f776259c640 1 --2- 172.21.15.103:0/2431377142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7764153be0 0x7f77640c3560 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7754009870 tx=0x7f775402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e81b81fdab7c0bff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:12.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.135+0000 7f7761d9b640 1 -- 172.21.15.103:0/2431377142 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7754037070 con 0x7f7764153be0 2024-09-10T08:41:12.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.135+0000 7f7761d9b640 1 -- 172.21.15.103:0/2431377142 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7754032440 con 0x7f7764153be0 2024-09-10T08:41:12.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.136+0000 7f7768c3c640 1 -- 172.21.15.103:0/2431377142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7764153be0 msgr2=0x7f77640c3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:12.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.136+0000 7f7761d9b640 1 -- 172.21.15.103:0/2431377142 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7754037070 con 0x7f7764153be0 2024-09-10T08:41:12.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.136+0000 7f7768c3c640 1 --2- 172.21.15.103:0/2431377142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7764153be0 0x7f77640c3560 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7754009870 tx=0x7f775402a180 comp rx=0 tx=0).stop 2024-09-10T08:41:12.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.136+0000 7f7768c3c640 1 -- 172.21.15.103:0/2431377142 shutdown_connections 2024-09-10T08:41:12.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.136+0000 7f7768c3c640 1 --2- 172.21.15.103:0/2431377142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77640ac720 0x7f77640c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:12.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.136+0000 7f7768c3c640 1 --2- 172.21.15.103:0/2431377142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7764153be0 0x7f77640c3560 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:12.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.136+0000 7f7768c3c640 1 -- 172.21.15.103:0/2431377142 >> 172.21.15.103:0/2431377142 conn(0x7f77640c5660 msgr2=0x7f77640c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:12.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.137+0000 7f7768c3c640 1 -- 172.21.15.103:0/2431377142 shutdown_connections 2024-09-10T08:41:12.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.137+0000 7f7768c3c640 1 -- 172.21.15.103:0/2431377142 wait complete. 2024-09-10T08:41:12.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.139+0000 7f7768c3c640 1 Processor -- start 2024-09-10T08:41:12.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.139+0000 7f7768c3c640 1 -- start start 2024-09-10T08:41:12.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.140+0000 7f7768c3c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77640ac720 0x7f77641e0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:12.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.140+0000 7f7768c3c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77640c7fb0 0x7f77641e11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:12.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.140+0000 7f7768c3c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7764153be0 0x7f77641f0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:12.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.140+0000 7f7768c3c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f77640a83e0 con 0x7f7764153be0 2024-09-10T08:41:12.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.140+0000 7f7768c3c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7764157240 con 0x7f77640c7fb0 2024-09-10T08:41:12.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.140+0000 7f7768c3c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f77640ac370 con 0x7f77640ac720 2024-09-10T08:41:12.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.140+0000 7f776259c640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77640ac720 msgr2=0x7f77641e0c80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:41:12.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.140+0000 7f776259c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77640ac720 0x7f77641e0c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:41:12.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.141+0000 7f7762d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7764153be0 0x7f77641f0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:12.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.141+0000 7f7762d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7764153be0 0x7f77641f0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54026/0 (socket says 172.21.15.103:54026) 2024-09-10T08:41:12.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.141+0000 7f7762d9d640 1 -- 172.21.15.103:0/386707148 learned_addr learned my addr 172.21.15.103:0/386707148 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:12.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.141+0000 7f775bfff640 1 --2- 172.21.15.103:0/386707148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77640c7fb0 0x7f77641e11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:12.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.142+0000 7f775bfff640 1 -- 172.21.15.103:0/386707148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77640ac720 msgr2=0x7f77641e0c80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:41:12.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.142+0000 7f775bfff640 1 --2- 172.21.15.103:0/386707148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77640ac720 0x7f77641e0c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:12.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.142+0000 7f775bfff640 1 -- 172.21.15.103:0/386707148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7764153be0 msgr2=0x7f77641f0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:12.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.142+0000 7f775bfff640 1 --2- 172.21.15.103:0/386707148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7764153be0 0x7f77641f0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.142+0000 7f775bfff640 1 -- 172.21.15.103:0/386707148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77640a92f0 con 0x7f77640c7fb0 2024-09-10T08:41:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.142+0000 7f7762d9d640 1 --2- 172.21.15.103:0/386707148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7764153be0 0x7f77641f0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:41:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.143+0000 7f775bfff640 1 --2- 172.21.15.103:0/386707148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77640c7fb0 0x7f77641e11c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f774c00b450 tx=0x7f774c00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.143+0000 7f775affd640 1 -- 172.21.15.103:0/386707148 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c003db0 con 0x7f77640c7fb0 2024-09-10T08:41:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.143+0000 7f7768c3c640 1 -- 172.21.15.103:0/386707148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77641e1700 con 0x7f77640c7fb0 2024-09-10T08:41:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.143+0000 7f7768c3c640 1 -- 172.21.15.103:0/386707148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77640a7910 con 0x7f77640c7fb0 2024-09-10T08:41:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.143+0000 7f775affd640 1 -- 172.21.15.103:0/386707148 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774c015070 con 0x7f77640c7fb0 2024-09-10T08:41:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.143+0000 7f775affd640 1 -- 172.21.15.103:0/386707148 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c0052b0 con 0x7f77640c7fb0 2024-09-10T08:41:12.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.145+0000 7f7768c3c640 1 -- 172.21.15.103:0/386707148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77640a9b70 con 0x7f77640c7fb0 2024-09-10T08:41:12.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.145+0000 7f775affd640 1 -- 172.21.15.103:0/386707148 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f774c00f070 con 0x7f77640c7fb0 2024-09-10T08:41:12.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.146+0000 7f775affd640 1 --2- 172.21.15.103:0/386707148 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f774406bde0 0x7f774406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:12.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.146+0000 7f775affd640 1 -- 172.21.15.103:0/386707148 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f774c08a8f0 con 0x7f77640c7fb0 2024-09-10T08:41:12.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.147+0000 7f776259c640 1 --2- 172.21.15.103:0/386707148 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f774406bde0 0x7f774406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:12.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.147+0000 7f776259c640 1 --2- 172.21.15.103:0/386707148 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f774406bde0 0x7f774406e2a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7754034000 tx=0x7f775402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:12.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.155+0000 7f775affd640 1 -- 172.21.15.103:0/386707148 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f774c00d040 con 0x7f77640c7fb0 2024-09-10T08:41:12.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.657+0000 7f7768c3c640 1 -- 172.21.15.103:0/386707148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f77641e2050 con 0x7f77640c7fb0 2024-09-10T08:41:12.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.660+0000 7f775affd640 1 -- 172.21.15.103:0/386707148 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1570 (secure 0 0 0) 0x7f774c058f90 con 0x7f77640c7fb0 2024-09-10T08:41:12.660 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":104,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:41:12.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.664+0000 7f7768c3c640 1 -- 172.21.15.103:0/386707148 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f774406bde0 msgr2=0x7f774406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:12.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.664+0000 7f7768c3c640 1 --2- 172.21.15.103:0/386707148 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f774406bde0 0x7f774406e2a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7754034000 tx=0x7f775402e000 comp rx=0 tx=0).stop 2024-09-10T08:41:12.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.664+0000 7f7768c3c640 1 -- 172.21.15.103:0/386707148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77640c7fb0 msgr2=0x7f77641e11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:12.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.664+0000 7f7768c3c640 1 --2- 172.21.15.103:0/386707148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77640c7fb0 0x7f77641e11c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f774c00b450 tx=0x7f774c00b910 comp rx=0 tx=0).stop 2024-09-10T08:41:12.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.665+0000 7f7768c3c640 1 -- 172.21.15.103:0/386707148 shutdown_connections 2024-09-10T08:41:12.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.665+0000 7f7768c3c640 1 --2- 172.21.15.103:0/386707148 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f774406bde0 0x7f774406e2a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:12.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.665+0000 7f7768c3c640 1 --2- 172.21.15.103:0/386707148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7764153be0 0x7f77641f0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:12.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.665+0000 7f7768c3c640 1 --2- 172.21.15.103:0/386707148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77640c7fb0 0x7f77641e11c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:12.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.665+0000 7f7768c3c640 1 --2- 172.21.15.103:0/386707148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77640ac720 0x7f77641e0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:12.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.665+0000 7f7768c3c640 1 -- 172.21.15.103:0/386707148 >> 172.21.15.103:0/386707148 conn(0x7f77640c5660 msgr2=0x7f77640aba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:12.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.665+0000 7f7768c3c640 1 -- 172.21.15.103:0/386707148 shutdown_connections 2024-09-10T08:41:12.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:12.665+0000 7f7768c3c640 1 -- 172.21.15.103:0/386707148 wait complete. 2024-09-10T08:41:15.684 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:41:15.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.868+0000 7fdb13053640 1 Processor -- start 2024-09-10T08:41:15.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.868+0000 7fdb13053640 1 -- start start 2024-09-10T08:41:15.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.870+0000 7fdb13053640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdb04048820 0x7fdb04049180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.870+0000 7fdb13053640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdb040d9c10 0x7fdb040d66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.870+0000 7fdb13053640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb040071d0 con 0x7fdb040465c0 2024-09-10T08:41:15.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.870+0000 7fdb13053640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fdb04046a50 con 0x7fdb04048820 2024-09-10T08:41:15.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.870+0000 7fdb13053640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fdb0404a980 con 0x7fdb040d9c10 2024-09-10T08:41:15.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.870+0000 7fdb115f0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdb040d9c10 0x7fdb040d66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.870+0000 7fdb115f0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdb040d9c10 0x7fdb040d66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:43418/0 (socket says 172.21.15.103:43418) 2024-09-10T08:41:15.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.870+0000 7fdb115f0640 1 -- 172.21.15.103:0/3600524628 learned_addr learned my addr 172.21.15.103:0/3600524628 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:15.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.871+0000 7fdb10def640 1 --2- 172.21.15.103:0/3600524628 >> v2:172.21.15.103:3300/0 conn(0x7fdb04048820 0x7fdb04049180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.872+0000 7fdb115f0640 1 -- 172.21.15.103:0/3600524628 >> v2:172.21.15.103:3300/0 conn(0x7fdb04048820 msgr2=0x7fdb04049180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:15.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.874+0000 7fdb115f0640 1 --2- 172.21.15.103:0/3600524628 >> v2:172.21.15.103:3300/0 conn(0x7fdb04048820 0x7fdb04049180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.874+0000 7fdb115f0640 1 -- 172.21.15.103:0/3600524628 >> v1:172.21.15.154:6789/0 conn(0x7fdb040465c0 legacy=0x7fdb0400aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:15.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.874+0000 7fdb115f0640 1 -- 172.21.15.103:0/3600524628 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0404ac60 con 0x7fdb040d9c10 2024-09-10T08:41:15.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.874+0000 7fdb10def640 1 --2- 172.21.15.103:0/3600524628 >> v2:172.21.15.103:3300/0 conn(0x7fdb04048820 0x7fdb04049180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:41:15.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.876+0000 7fdb115f0640 1 --2- 172.21.15.103:0/3600524628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb040d9c10 0x7fdb040d66e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c06b300 tx=0x7fdb0c0a6d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a091a712f2a15ab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:15.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.877+0000 7fdb0b7fe640 1 -- 172.21.15.103:0/3600524628 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c0b4070 con 0x7fdb040d9c10 2024-09-10T08:41:15.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.877+0000 7fdb0b7fe640 1 -- 172.21.15.103:0/3600524628 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb0c0a7b40 con 0x7fdb040d9c10 2024-09-10T08:41:15.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.877+0000 7fdb0b7fe640 1 -- 172.21.15.103:0/3600524628 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c0af440 con 0x7fdb040d9c10 2024-09-10T08:41:15.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.878+0000 7fdb13053640 1 -- 172.21.15.103:0/3600524628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb040d9c10 msgr2=0x7fdb040d66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:15.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.878+0000 7fdb13053640 1 --2- 172.21.15.103:0/3600524628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb040d9c10 0x7fdb040d66e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c06b300 tx=0x7fdb0c0a6d30 comp rx=0 tx=0).stop 2024-09-10T08:41:15.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.879+0000 7fdb13053640 1 -- 172.21.15.103:0/3600524628 shutdown_connections 2024-09-10T08:41:15.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.879+0000 7fdb13053640 1 --2- 172.21.15.103:0/3600524628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb040d9c10 0x7fdb040d66e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.879+0000 7fdb13053640 1 --2- 172.21.15.103:0/3600524628 >> v2:172.21.15.103:3300/0 conn(0x7fdb04048820 0x7fdb04049180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.879+0000 7fdb13053640 1 -- 172.21.15.103:0/3600524628 >> 172.21.15.103:0/3600524628 conn(0x7fdb04047d00 msgr2=0x7fdb04048110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:15.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.880+0000 7fdb13053640 1 -- 172.21.15.103:0/3600524628 shutdown_connections 2024-09-10T08:41:15.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.880+0000 7fdb13053640 1 -- 172.21.15.103:0/3600524628 wait complete. 2024-09-10T08:41:15.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.881+0000 7fdb13053640 1 Processor -- start 2024-09-10T08:41:15.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.881+0000 7fdb13053640 1 -- start start 2024-09-10T08:41:15.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.883+0000 7fdb13053640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb040465c0 0x7fdb040448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.883+0000 7fdb13053640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb04048820 0x7fdb0403f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.883+0000 7fdb10def640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb040465c0 0x7fdb040448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.883+0000 7fdb10def640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb040465c0 0x7fdb040448b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:43422/0 (socket says 172.21.15.103:43422) 2024-09-10T08:41:15.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.883+0000 7fdb0bfff640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb04048820 msgr2=0x7fdb0403f1e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:41:15.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.883+0000 7fdb0bfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb04048820 0x7fdb0403f1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:41:15.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.883+0000 7fdb10def640 1 -- 172.21.15.103:0/2361977565 learned_addr learned my addr 172.21.15.103:0/2361977565 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:15.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.883+0000 7fdb13053640 1 --2- 172.21.15.103:0/2361977565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb040d9c10 0x7fdb0416e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.883+0000 7fdb13053640 1 -- 172.21.15.103:0/2361977565 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdb040d96f0 con 0x7fdb040d9c10 2024-09-10T08:41:15.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.883+0000 7fdb13053640 1 -- 172.21.15.103:0/2361977565 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdb040d9410 con 0x7fdb040465c0 2024-09-10T08:41:15.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.883+0000 7fdb13053640 1 -- 172.21.15.103:0/2361977565 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fdb040478c0 con 0x7fdb04048820 2024-09-10T08:41:15.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.884+0000 7fdb115f0640 1 --2- 172.21.15.103:0/2361977565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb040d9c10 0x7fdb0416e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.885+0000 7fdb10def640 1 -- 172.21.15.103:0/2361977565 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb04048820 msgr2=0x7fdb0403f1e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:41:15.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.885+0000 7fdb10def640 1 --2- 172.21.15.103:0/2361977565 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb04048820 0x7fdb0403f1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.885+0000 7fdb10def640 1 -- 172.21.15.103:0/2361977565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb040d9c10 msgr2=0x7fdb0416e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:15.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.885+0000 7fdb10def640 1 --2- 172.21.15.103:0/2361977565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb040d9c10 0x7fdb0416e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.885+0000 7fdb10def640 1 -- 172.21.15.103:0/2361977565 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb040d2a30 con 0x7fdb040465c0 2024-09-10T08:41:15.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.886+0000 7fdb10def640 1 --2- 172.21.15.103:0/2361977565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb040465c0 0x7fdb040448b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdb000208d0 tx=0x7fdb00020d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:15.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.886+0000 7fdb097fa640 1 -- 172.21.15.103:0/2361977565 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0001f040 con 0x7fdb040465c0 2024-09-10T08:41:15.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.886+0000 7fdb13053640 1 -- 172.21.15.103:0/2361977565 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb04042f00 con 0x7fdb040465c0 2024-09-10T08:41:15.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.886+0000 7fdb13053640 1 -- 172.21.15.103:0/2361977565 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb040434c0 con 0x7fdb040465c0 2024-09-10T08:41:15.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.887+0000 7fdb097fa640 1 -- 172.21.15.103:0/2361977565 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb00004230 con 0x7fdb040465c0 2024-09-10T08:41:15.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.887+0000 7fdb097fa640 1 -- 172.21.15.103:0/2361977565 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0001e960 con 0x7fdb040465c0 2024-09-10T08:41:15.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.889+0000 7fdb097fa640 1 -- 172.21.15.103:0/2361977565 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb0001eb40 con 0x7fdb040465c0 2024-09-10T08:41:15.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.889+0000 7fdb097fa640 1 --2- 172.21.15.103:0/2361977565 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdafc06bf20 0x7fdafc06e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.890+0000 7fdb097fa640 1 -- 172.21.15.103:0/2361977565 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fdb0009c640 con 0x7fdb040465c0 2024-09-10T08:41:15.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.890+0000 7fdb0bfff640 1 --2- 172.21.15.103:0/2361977565 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdafc06bf20 0x7fdafc06e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.890+0000 7fdb13053640 1 -- 172.21.15.103:0/2361977565 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaec005290 con 0x7fdb040465c0 2024-09-10T08:41:15.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.891+0000 7fdb0bfff640 1 --2- 172.21.15.103:0/2361977565 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdafc06bf20 0x7fdafc06e3e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdb040d6690 tx=0x7fdaf80079d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:15.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:15.900+0000 7fdb097fa640 1 -- 172.21.15.103:0/2361977565 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdb0002a020 con 0x7fdb040465c0 2024-09-10T08:41:16.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:16.402+0000 7fdb13053640 1 -- 172.21.15.103:0/2361977565 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdaec005580 con 0x7fdb040465c0 2024-09-10T08:41:16.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:16.404+0000 7fdb097fa640 1 -- 172.21.15.103:0/2361977565 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1570 (secure 0 0 0) 0x7fdb0002a020 con 0x7fdb040465c0 2024-09-10T08:41:16.408 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":104,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:41:16.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:16.409+0000 7fdaf6ffd640 1 -- 172.21.15.103:0/2361977565 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdafc06bf20 msgr2=0x7fdafc06e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:16.409+0000 7fdaf6ffd640 1 --2- 172.21.15.103:0/2361977565 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdafc06bf20 0x7fdafc06e3e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdb040d6690 tx=0x7fdaf80079d0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:16.409+0000 7fdaf6ffd640 1 -- 172.21.15.103:0/2361977565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb040465c0 msgr2=0x7fdb040448b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:16.409+0000 7fdaf6ffd640 1 --2- 172.21.15.103:0/2361977565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb040465c0 0x7fdb040448b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdb000208d0 tx=0x7fdb00020d90 comp rx=0 tx=0).stop 2024-09-10T08:41:16.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:16.409+0000 7fdaf6ffd640 1 -- 172.21.15.103:0/2361977565 shutdown_connections 2024-09-10T08:41:16.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:16.409+0000 7fdaf6ffd640 1 --2- 172.21.15.103:0/2361977565 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdafc06bf20 0x7fdafc06e3e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:16.409+0000 7fdaf6ffd640 1 --2- 172.21.15.103:0/2361977565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb040d9c10 0x7fdb0416e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:16.409+0000 7fdaf6ffd640 1 --2- 172.21.15.103:0/2361977565 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb04048820 0x7fdb0403f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:16.409+0000 7fdaf6ffd640 1 --2- 172.21.15.103:0/2361977565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb040465c0 0x7fdb040448b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:16.409+0000 7fdaf6ffd640 1 -- 172.21.15.103:0/2361977565 >> 172.21.15.103:0/2361977565 conn(0x7fdb04047d00 msgr2=0x7fdb040480e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:16.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:16.410+0000 7fdaf6ffd640 1 -- 172.21.15.103:0/2361977565 shutdown_connections 2024-09-10T08:41:16.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:16.410+0000 7fdaf6ffd640 1 -- 172.21.15.103:0/2361977565 wait complete. 2024-09-10T08:41:19.430 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:41:19.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.612+0000 7f4ae1d8b640 1 Processor -- start 2024-09-10T08:41:19.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.612+0000 7f4ae1d8b640 1 -- start start 2024-09-10T08:41:19.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.614+0000 7f4ae1d8b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4adc0c8260 0x7f4adc0c8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:19.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.614+0000 7f4ae1d8b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4adc0c39d0 0x7f4adc1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:19.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.614+0000 7f4ae1d8b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4adc0c42f0 con 0x7f4adc0c2f50 2024-09-10T08:41:19.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.614+0000 7f4ae1d8b640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f4adc0ac9c0 con 0x7f4adc0c8260 2024-09-10T08:41:19.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.614+0000 7f4ae1d8b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4adc0ac370 con 0x7f4adc0c39d0 2024-09-10T08:41:19.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.614+0000 7f4ae158a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4adc0c39d0 0x7f4adc1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:19.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.615+0000 7f4ae158a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4adc0c39d0 0x7f4adc1529e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:43426/0 (socket says 172.21.15.103:43426) 2024-09-10T08:41:19.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.615+0000 7f4ae158a640 1 -- 172.21.15.103:0/1137778116 learned_addr learned my addr 172.21.15.103:0/1137778116 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:19.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.618+0000 7f4ae158a640 1 -- 172.21.15.103:0/1137778116 >> v2:172.21.15.103:3300/0 conn(0x7f4adc0c8260 msgr2=0x7f4adc0c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:19.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.618+0000 7f4ae158a640 1 --2- 172.21.15.103:0/1137778116 >> v2:172.21.15.103:3300/0 conn(0x7f4adc0c8260 0x7f4adc0c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.618+0000 7f4ae158a640 1 -- 172.21.15.103:0/1137778116 >> v1:172.21.15.154:6789/0 conn(0x7f4adc0c2f50 legacy=0x7f4adc1522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:19.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.618+0000 7f4ae158a640 1 -- 172.21.15.103:0/1137778116 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4adc0ac650 con 0x7f4adc0c39d0 2024-09-10T08:41:19.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.619+0000 7f4ae158a640 1 --2- 172.21.15.103:0/1137778116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4adc0c39d0 0x7f4adc1529e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0c2610 tx=0x7f4ad402bb60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d2e58cea6da059c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:19.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.620+0000 7f4adb7fe640 1 -- 172.21.15.103:0/1137778116 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad402d6b0 con 0x7f4adc0c39d0 2024-09-10T08:41:19.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.620+0000 7f4adb7fe640 1 -- 172.21.15.103:0/1137778116 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad402d850 con 0x7f4adc0c39d0 2024-09-10T08:41:19.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.621+0000 7f4ae1d8b640 1 -- 172.21.15.103:0/1137778116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4adc0c39d0 msgr2=0x7f4adc1529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:19.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.621+0000 7f4ae1d8b640 1 --2- 172.21.15.103:0/1137778116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4adc0c39d0 0x7f4adc1529e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0c2610 tx=0x7f4ad402bb60 comp rx=0 tx=0).stop 2024-09-10T08:41:19.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.621+0000 7f4ae1d8b640 1 -- 172.21.15.103:0/1137778116 shutdown_connections 2024-09-10T08:41:19.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.621+0000 7f4ae1d8b640 1 --2- 172.21.15.103:0/1137778116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4adc0c39d0 0x7f4adc1529e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.621+0000 7f4ae1d8b640 1 --2- 172.21.15.103:0/1137778116 >> v2:172.21.15.103:3300/0 conn(0x7f4adc0c8260 0x7f4adc0c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.622+0000 7f4ae1d8b640 1 -- 172.21.15.103:0/1137778116 >> 172.21.15.103:0/1137778116 conn(0x7f4adc06c210 msgr2=0x7f4adc0c7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:19.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.622+0000 7f4ae1d8b640 1 -- 172.21.15.103:0/1137778116 shutdown_connections 2024-09-10T08:41:19.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.625+0000 7f4ae1d8b640 1 -- 172.21.15.103:0/1137778116 wait complete. 2024-09-10T08:41:19.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.626+0000 7f4ae1d8b640 1 Processor -- start 2024-09-10T08:41:19.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.627+0000 7f4ae1d8b640 1 -- start start 2024-09-10T08:41:19.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.628+0000 7f4ae1d8b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4adc0c2f50 0x7f4adc151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:19.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.628+0000 7f4ae1d8b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4adc0c8260 0x7f4adc071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:19.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.628+0000 7f4ae1d8b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4adc1475b0 0x7f4adc14ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:19.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.628+0000 7f4ae1d8b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4adc0c3fa0 con 0x7f4adc1475b0 2024-09-10T08:41:19.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.628+0000 7f4ae1d8b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4adc152f20 con 0x7f4adc0c2f50 2024-09-10T08:41:19.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.628+0000 7f4ae1d8b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4adc14f9e0 con 0x7f4adc0c8260 2024-09-10T08:41:19.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.628+0000 7f4ae158a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4adc1475b0 0x7f4adc14ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:19.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.629+0000 7f4ae158a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4adc1475b0 0x7f4adc14ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57200/0 (socket says 172.21.15.103:57200) 2024-09-10T08:41:19.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.629+0000 7f4ae158a640 1 -- 172.21.15.103:0/2991457514 learned_addr learned my addr 172.21.15.103:0/2991457514 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:19.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.629+0000 7f4adbfff640 1 -- 172.21.15.103:0/2991457514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4adc0c8260 msgr2=0x7f4adc071070 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:41:19.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.629+0000 7f4adbfff640 1 --2- 172.21.15.103:0/2991457514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4adc0c8260 0x7f4adc071070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:41:19.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.629+0000 7f4ae0d89640 1 --2- 172.21.15.103:0/2991457514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4adc0c2f50 0x7f4adc151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:19.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.630+0000 7f4ae158a640 1 -- 172.21.15.103:0/2991457514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4adc0c8260 msgr2=0x7f4adc071070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:41:19.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.630+0000 7f4ae158a640 1 --2- 172.21.15.103:0/2991457514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4adc0c8260 0x7f4adc071070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.630+0000 7f4ae158a640 1 -- 172.21.15.103:0/2991457514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4adc0c2f50 msgr2=0x7f4adc151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:19.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.630+0000 7f4ae158a640 1 --2- 172.21.15.103:0/2991457514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4adc0c2f50 0x7f4adc151060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.630+0000 7f4ae158a640 1 -- 172.21.15.103:0/2991457514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4adc1468d0 con 0x7f4adc1475b0 2024-09-10T08:41:19.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.630+0000 7f4ae158a640 1 --2- 172.21.15.103:0/2991457514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4adc1475b0 0x7f4adc14ad80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4009c90 tx=0x7f4ad4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:19.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.631+0000 7f4ad97fa640 1 -- 172.21.15.103:0/2991457514 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4045070 con 0x7f4adc1475b0 2024-09-10T08:41:19.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.631+0000 7f4ad97fa640 1 -- 172.21.15.103:0/2991457514 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad4036690 con 0x7f4adc1475b0 2024-09-10T08:41:19.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.632+0000 7f4ad97fa640 1 -- 172.21.15.103:0/2991457514 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4045070 con 0x7f4adc1475b0 2024-09-10T08:41:19.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.632+0000 7f4ae1d8b640 1 -- 172.21.15.103:0/2991457514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4adc146630 con 0x7f4adc1475b0 2024-09-10T08:41:19.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.632+0000 7f4ae1d8b640 1 -- 172.21.15.103:0/2991457514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4adc14b7c0 con 0x7f4adc1475b0 2024-09-10T08:41:19.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.634+0000 7f4ae1d8b640 1 -- 172.21.15.103:0/2991457514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4adc0c39d0 con 0x7f4adc1475b0 2024-09-10T08:41:19.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.639+0000 7f4ad97fa640 1 -- 172.21.15.103:0/2991457514 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ad4036840 con 0x7f4adc1475b0 2024-09-10T08:41:19.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.639+0000 7f4ad97fa640 1 --2- 172.21.15.103:0/2991457514 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4ac406c330 0x7f4ac406e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:19.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.642+0000 7f4ae0d89640 1 --2- 172.21.15.103:0/2991457514 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4ac406c330 0x7f4ac406e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:19.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.642+0000 7f4ad97fa640 1 -- 172.21.15.103:0/2991457514 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f4ad403c030 con 0x7f4adc1475b0 2024-09-10T08:41:19.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.643+0000 7f4ae0d89640 1 --2- 172.21.15.103:0/2991457514 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4ac406c330 0x7f4ac406e7f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009990 tx=0x7f4acc009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:19.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:19.649+0000 7f4ad97fa640 1 -- 172.21.15.103:0/2991457514 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ad4079790 con 0x7f4adc1475b0 2024-09-10T08:41:20.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:20.154+0000 7f4ae1d8b640 1 -- 172.21.15.103:0/2991457514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4adc0c2d30 con 0x7f4adc1475b0 2024-09-10T08:41:20.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:20.155+0000 7f4ad97fa640 1 -- 172.21.15.103:0/2991457514 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1570 (secure 0 0 0) 0x7f4ad407da90 con 0x7f4adc1475b0 2024-09-10T08:41:20.157 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":104,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":27,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:41:20.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:20.163+0000 7f4ae1d8b640 1 -- 172.21.15.103:0/2991457514 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4ac406c330 msgr2=0x7f4ac406e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:20.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:20.164+0000 7f4ae1d8b640 1 --2- 172.21.15.103:0/2991457514 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4ac406c330 0x7f4ac406e7f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009990 tx=0x7f4acc009110 comp rx=0 tx=0).stop 2024-09-10T08:41:20.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:20.164+0000 7f4ae1d8b640 1 -- 172.21.15.103:0/2991457514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4adc1475b0 msgr2=0x7f4adc14ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:20.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:20.164+0000 7f4ae1d8b640 1 --2- 172.21.15.103:0/2991457514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4adc1475b0 0x7f4adc14ad80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4009c90 tx=0x7f4ad4004a40 comp rx=0 tx=0).stop 2024-09-10T08:41:20.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:20.169+0000 7f4ae1d8b640 1 -- 172.21.15.103:0/2991457514 shutdown_connections 2024-09-10T08:41:20.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:20.169+0000 7f4ae1d8b640 1 --2- 172.21.15.103:0/2991457514 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4ac406c330 0x7f4ac406e7f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:20.169+0000 7f4ae1d8b640 1 --2- 172.21.15.103:0/2991457514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4adc1475b0 0x7f4adc14ad80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:20.169+0000 7f4ae1d8b640 1 --2- 172.21.15.103:0/2991457514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4adc0c8260 0x7f4adc071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:20.169+0000 7f4ae1d8b640 1 --2- 172.21.15.103:0/2991457514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4adc0c2f50 0x7f4adc151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:20.169+0000 7f4ae1d8b640 1 -- 172.21.15.103:0/2991457514 >> 172.21.15.103:0/2991457514 conn(0x7f4adc06c210 msgr2=0x7f4adc14c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:20.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:20.170+0000 7f4ae1d8b640 1 -- 172.21.15.103:0/2991457514 shutdown_connections 2024-09-10T08:41:20.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:20.170+0000 7f4ae1d8b640 1 -- 172.21.15.103:0/2991457514 wait complete. 2024-09-10T08:41:23.199 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:41:23.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.391+0000 7f1fd7562640 1 Processor -- start 2024-09-10T08:41:23.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.393+0000 7f1fd7562640 1 -- start start 2024-09-10T08:41:23.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.394+0000 7f1fd7562640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 0x7f1fd00c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:23.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.394+0000 7f1fd7562640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd014f720 0x7f1fd006e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:23.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.394+0000 7f1fd7562640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fd0152e70 con 0x7f1fd006c7a0 2024-09-10T08:41:23.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.394+0000 7f1fd7562640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f1fd00c8850 con 0x7f1fd00c2340 2024-09-10T08:41:23.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.394+0000 7f1fd7562640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1fd0153150 con 0x7f1fd014f720 2024-09-10T08:41:23.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.395+0000 7f1fd6560640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1fd006c7a0 0x7f1fd01522f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:55876/0 (socket says 172.21.15.103:55876) 2024-09-10T08:41:23.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.395+0000 7f1fd6560640 1 -- 172.21.15.103:0/2820886480 learned_addr learned my addr 172.21.15.103:0/2820886480 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:41:23.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.395+0000 7f1fd5d5f640 1 --2- 172.21.15.103:0/2820886480 >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 0x7f1fd00c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:23.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.395+0000 7f1fd5d5f640 1 -- 172.21.15.103:0/2820886480 >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 msgr2=0x7f1fd00c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:41:23.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.395+0000 7f1fd5d5f640 1 -- 172.21.15.103:0/2820886480 >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 msgr2=0x7f1fd00c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:41:23.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.395+0000 7f1fd5d5f640 1 --2- 172.21.15.103:0/2820886480 >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 0x7f1fd00c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:41:23.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.395+0000 7f1fd5d5f640 1 --2- 172.21.15.103:0/2820886480 >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 0x7f1fd00c4d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:41:23.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.396+0000 7f1fd6d61640 1 -- 172.21.15.103:0/2820886480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd014f720 msgr2=0x7f1fd006e800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:41:23.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.396+0000 7f1fd6d61640 1 --2- 172.21.15.103:0/2820886480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd014f720 0x7f1fd006e800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:41:23.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.596+0000 7f1fd5d5f640 1 --2- 172.21.15.103:0/2820886480 >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 0x7f1fd00c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:23.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.596+0000 7f1fd5d5f640 1 -- 172.21.15.103:0/2820886480 >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 msgr2=0x7f1fd00c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:41:23.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.596+0000 7f1fd5d5f640 1 -- 172.21.15.103:0/2820886480 >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 msgr2=0x7f1fd00c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:41:23.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.596+0000 7f1fd5d5f640 1 --2- 172.21.15.103:0/2820886480 >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 0x7f1fd00c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:41:23.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.596+0000 7f1fd5d5f640 1 --2- 172.21.15.103:0/2820886480 >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 0x7f1fd00c4d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:41:23.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.598+0000 7f1fd6d61640 1 -- 172.21.15.103:0/2820886480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd014f720 msgr2=0x7f1fd006e800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:41:23.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.598+0000 7f1fd6d61640 1 --2- 172.21.15.103:0/2820886480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd014f720 0x7f1fd006e800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:41:23.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.997+0000 7f1fd5d5f640 1 --2- 172.21.15.103:0/2820886480 >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 0x7f1fd00c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:23.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.997+0000 7f1fd5d5f640 1 -- 172.21.15.103:0/2820886480 >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 msgr2=0x7f1fd00c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:41:23.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.997+0000 7f1fd5d5f640 1 -- 172.21.15.103:0/2820886480 >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 msgr2=0x7f1fd00c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:41:23.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.997+0000 7f1fd5d5f640 1 --2- 172.21.15.103:0/2820886480 >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 0x7f1fd00c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:41:23.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:23.997+0000 7f1fd5d5f640 1 --2- 172.21.15.103:0/2820886480 >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 0x7f1fd00c4d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:41:24.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:24.000+0000 7f1fd6d61640 1 -- 172.21.15.103:0/2820886480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd014f720 msgr2=0x7f1fd006e800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:41:24.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:24.000+0000 7f1fd6d61640 1 --2- 172.21.15.103:0/2820886480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd014f720 0x7f1fd006e800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:41:24.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:24.799+0000 7f1fd5d5f640 1 --2- 172.21.15.103:0/2820886480 >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 0x7f1fd00c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:24.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:24.799+0000 7f1fd5d5f640 1 -- 172.21.15.103:0/2820886480 >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 msgr2=0x7f1fd00c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:41:24.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:24.799+0000 7f1fd5d5f640 1 -- 172.21.15.103:0/2820886480 >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 msgr2=0x7f1fd00c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:41:24.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:24.799+0000 7f1fd5d5f640 1 --2- 172.21.15.103:0/2820886480 >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 0x7f1fd00c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:41:24.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:24.799+0000 7f1fd5d5f640 1 --2- 172.21.15.103:0/2820886480 >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 0x7f1fd00c4d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:41:24.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:24.801+0000 7f1fd6d61640 1 -- 172.21.15.103:0/2820886480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd014f720 msgr2=0x7f1fd006e800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:41:24.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:24.801+0000 7f1fd6d61640 1 --2- 172.21.15.103:0/2820886480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd014f720 0x7f1fd006e800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:41:26.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.394+0000 7f1fc7fff640 1 -- 172.21.15.103:0/2820886480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd014f720 msgr2=0x7f1fd006e800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:41:26.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.395+0000 7f1fc7fff640 1 --2- 172.21.15.103:0/2820886480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd014f720 0x7f1fd006e800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:26.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.395+0000 7f1fc7fff640 1 -- 172.21.15.103:0/2820886480 >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 msgr2=0x7f1fd00c4d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:41:26.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.395+0000 7f1fc7fff640 1 --2- 172.21.15.103:0/2820886480 >> v2:172.21.15.103:3300/0 conn(0x7f1fd00c2340 0x7f1fd00c4d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:26.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.395+0000 7f1fc7fff640 1 -- 172.21.15.103:0/2820886480 >> v1:172.21.15.154:6789/0 conn(0x7f1fd006c7a0 legacy=0x7f1fd01522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:26.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.395+0000 7f1fc7fff640 1 --2- 172.21.15.103:0/2820886480 >> v2:172.21.15.154:3300/0 conn(0x7f1fb40036a0 0x7f1fb4005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:26.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.395+0000 7f1fc7fff640 1 -- 172.21.15.103:0/2820886480 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fd00c3fd0 con 0x7f1fb4006170 2024-09-10T08:41:26.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.395+0000 7f1fc7fff640 1 -- 172.21.15.103:0/2820886480 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1fd00c8850 con 0x7f1fb40036a0 2024-09-10T08:41:26.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.395+0000 7f1fd6560640 1 --2- 172.21.15.103:0/2820886480 >> v2:172.21.15.154:3300/0 conn(0x7f1fb40036a0 0x7f1fb4005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:26.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.395+0000 7f1fd6560640 1 -- 172.21.15.103:0/2820886480 >> v2:172.21.15.154:3300/0 conn(0x7f1fb40036a0 msgr2=0x7f1fb4005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:41:26.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.395+0000 7f1fd6560640 1 -- 172.21.15.103:0/2820886480 >> v2:172.21.15.154:3300/0 conn(0x7f1fb40036a0 msgr2=0x7f1fb4005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:41:26.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.395+0000 7f1fd6560640 1 --2- 172.21.15.103:0/2820886480 >> v2:172.21.15.154:3300/0 conn(0x7f1fb40036a0 0x7f1fb4005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:41:26.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.395+0000 7f1fd6560640 1 --2- 172.21.15.103:0/2820886480 >> v2:172.21.15.154:3300/0 conn(0x7f1fb40036a0 0x7f1fb4005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:41:26.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.596+0000 7f1fd6560640 1 --2- 172.21.15.103:0/2820886480 >> v2:172.21.15.154:3300/0 conn(0x7f1fb40036a0 0x7f1fb4005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:26.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.596+0000 7f1fd6560640 1 -- 172.21.15.103:0/2820886480 >> v2:172.21.15.154:3300/0 conn(0x7f1fb40036a0 msgr2=0x7f1fb4005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:41:26.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.596+0000 7f1fd6560640 1 -- 172.21.15.103:0/2820886480 >> v2:172.21.15.154:3300/0 conn(0x7f1fb40036a0 msgr2=0x7f1fb4005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:41:26.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.596+0000 7f1fd6560640 1 --2- 172.21.15.103:0/2820886480 >> v2:172.21.15.154:3300/0 conn(0x7f1fb40036a0 0x7f1fb4005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:41:26.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.596+0000 7f1fd6560640 1 --2- 172.21.15.103:0/2820886480 >> v2:172.21.15.154:3300/0 conn(0x7f1fb40036a0 0x7f1fb4005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:41:26.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.800+0000 7f1fd555e640 1 -- 172.21.15.103:0/2820886480 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1699733743 0 0) 0x7f1fd00c3fd0 con 0x7f1fb4006170 2024-09-10T08:41:26.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.800+0000 7f1fd555e640 1 -- 172.21.15.103:0/2820886480 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fbc003520 con 0x7f1fb4006170 2024-09-10T08:41:26.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.809+0000 7f1fd555e640 1 -- 172.21.15.103:0/2820886480 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1846260201 0 0) 0x7f1fbc003520 con 0x7f1fb4006170 2024-09-10T08:41:26.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.809+0000 7f1fd555e640 1 -- 172.21.15.103:0/2820886480 >> v2:172.21.15.154:3300/0 conn(0x7f1fb40036a0 msgr2=0x7f1fb4005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:41:26.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.809+0000 7f1fd555e640 1 --2- 172.21.15.103:0/2820886480 >> v2:172.21.15.154:3300/0 conn(0x7f1fb40036a0 0x7f1fb4005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:26.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.809+0000 7f1fd555e640 1 -- 172.21.15.103:0/2820886480 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb400af70 con 0x7f1fb4006170 2024-09-10T08:41:26.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.809+0000 7f1fd555e640 1 -- 172.21.15.103:0/2820886480 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f1fc800b940 con 0x7f1fb4006170 2024-09-10T08:41:26.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.809+0000 7f1fd555e640 1 -- 172.21.15.103:0/2820886480 >> v1:172.21.15.103:6789/0 conn(0x7f1fb4006170 legacy=0x7f1fb4008630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:26.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.809+0000 7f1fd555e640 1 --2- 172.21.15.103:0/2820886480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd014f720 0x7f1fbc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:26.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.809+0000 7f1fd555e640 1 --2- 172.21.15.103:0/2820886480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fbc003fe0 0x7f1fbc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:26.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.809+0000 7f1fd6560640 1 -- 172.21.15.103:0/2820886480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd014f720 msgr2=0x7f1fbc0039b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:41:26.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.809+0000 7f1fd6560640 1 --2- 172.21.15.103:0/2820886480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd014f720 0x7f1fbc0039b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:41:26.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.809+0000 7f1fd555e640 1 --2- 172.21.15.103:0/2820886480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fbc004d40 0x7f1fbc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:26.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.809+0000 7f1fd555e640 1 -- 172.21.15.103:0/2820886480 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd00c8850 con 0x7f1fbc004d40 2024-09-10T08:41:26.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.809+0000 7f1fd555e640 1 -- 172.21.15.103:0/2820886480 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc00bbd0 con 0x7f1fbc003fe0 2024-09-10T08:41:26.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.809+0000 7f1fd555e640 1 -- 172.21.15.103:0/2820886480 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1fbc00bdd0 con 0x7f1fd014f720 2024-09-10T08:41:26.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.809+0000 7f1fd5d5f640 1 --2- 172.21.15.103:0/2820886480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fbc003fe0 0x7f1fbc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:26.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.810+0000 7f1fd6d61640 1 -- 172.21.15.103:0/2820886480 reap_dead start 2024-09-10T08:41:26.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.810+0000 7f1fd5d5f640 1 -- 172.21.15.103:0/2820886480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd014f720 msgr2=0x7f1fbc0039b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:41:26.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.810+0000 7f1fd5d5f640 1 --2- 172.21.15.103:0/2820886480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd014f720 0x7f1fbc0039b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:26.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.810+0000 7f1fd5d5f640 1 -- 172.21.15.103:0/2820886480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fbc004d40 msgr2=0x7f1fbc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:26.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.810+0000 7f1fd5d5f640 1 --2- 172.21.15.103:0/2820886480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fbc004d40 0x7f1fbc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:26.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.810+0000 7f1fd5d5f640 1 -- 172.21.15.103:0/2820886480 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fbc003520 con 0x7f1fbc003fe0 2024-09-10T08:41:26.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.812+0000 7f1fd5d5f640 1 --2- 172.21.15.103:0/2820886480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fbc003fe0 0x7f1fbc004800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800b710 tx=0x7f1fbc005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f62b5cbb590633a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:26.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.815+0000 7f1fd555e640 1 -- 172.21.15.103:0/2820886480 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8011730 con 0x7f1fbc003fe0 2024-09-10T08:41:26.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.815+0000 7f1fd555e640 1 -- 172.21.15.103:0/2820886480 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fc8003990 con 0x7f1fbc003fe0 2024-09-10T08:41:26.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.816+0000 7f1fd7562640 1 -- 172.21.15.103:0/2820886480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fbc003fe0 msgr2=0x7f1fbc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:26.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.816+0000 7f1fd7562640 1 --2- 172.21.15.103:0/2820886480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fbc003fe0 0x7f1fbc004800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800b710 tx=0x7f1fbc005830 comp rx=0 tx=0).stop 2024-09-10T08:41:26.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.817+0000 7f1fd7562640 1 -- 172.21.15.103:0/2820886480 shutdown_connections 2024-09-10T08:41:26.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.817+0000 7f1fd7562640 1 --2- 172.21.15.103:0/2820886480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fbc004d40 0x7f1fbc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:26.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.817+0000 7f1fd7562640 1 --2- 172.21.15.103:0/2820886480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fbc003fe0 0x7f1fbc004800 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:26.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.817+0000 7f1fd7562640 1 --2- 172.21.15.103:0/2820886480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fd014f720 0x7f1fbc0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:26.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.817+0000 7f1fd7562640 1 -- 172.21.15.103:0/2820886480 >> 172.21.15.103:0/2820886480 conn(0x7f1fd006bbe0 msgr2=0x7f1fd006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:26.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.817+0000 7f1fd7562640 1 -- 172.21.15.103:0/2820886480 shutdown_connections 2024-09-10T08:41:26.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.817+0000 7f1fd7562640 1 -- 172.21.15.103:0/2820886480 wait complete. 2024-09-10T08:41:26.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.819+0000 7f1fd7562640 1 Processor -- start 2024-09-10T08:41:26.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.819+0000 7f1fd7562640 1 -- start start 2024-09-10T08:41:26.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.820+0000 7f1fd7562640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fbc003fe0 0x7f1fd0154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:26.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.820+0000 7f1fd7562640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fbc004d40 0x7f1fd01501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:26.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.820+0000 7f1fd7562640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fd014f720 0x7f1fd00a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.820+0000 7f1fd7562640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd014fd10 con 0x7f1fbc004d40 2024-09-10T08:41:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.820+0000 7f1fd7562640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd014fb90 con 0x7f1fd014f720 2024-09-10T08:41:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.820+0000 7f1fd7562640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1fd01522f0 con 0x7f1fbc003fe0 2024-09-10T08:41:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.820+0000 7f1fd5d5f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fbc004d40 0x7f1fd01501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.820+0000 7f1fd5d5f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fbc004d40 0x7f1fd01501c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35190/0 (socket says 172.21.15.103:35190) 2024-09-10T08:41:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.820+0000 7f1fd5d5f640 1 -- 172.21.15.103:0/37663958 learned_addr learned my addr 172.21.15.103:0/37663958 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.821+0000 7f1fd6560640 1 -- 172.21.15.103:0/37663958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fbc003fe0 msgr2=0x7f1fd0154790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:41:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.821+0000 7f1fd6560640 1 --2- 172.21.15.103:0/37663958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fbc003fe0 0x7f1fd0154790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:41:26.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.822+0000 7f1fd5d5f640 1 -- 172.21.15.103:0/37663958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fbc003fe0 msgr2=0x7f1fd0154790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:41:26.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.822+0000 7f1fd5d5f640 1 --2- 172.21.15.103:0/37663958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fbc003fe0 0x7f1fd0154790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:26.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.822+0000 7f1fd5d5f640 1 -- 172.21.15.103:0/37663958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fd014f720 msgr2=0x7f1fd00a9d00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:41:26.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.822+0000 7f1fd5d5f640 1 --2- 172.21.15.103:0/37663958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fd014f720 0x7f1fd00a9d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:26.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.822+0000 7f1fd5d5f640 1 -- 172.21.15.103:0/37663958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd0156710 con 0x7f1fbc004d40 2024-09-10T08:41:26.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.822+0000 7f1fd5d5f640 1 --2- 172.21.15.103:0/37663958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fbc004d40 0x7f1fd01501c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8011b50 tx=0x7f1fc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:26.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.825+0000 7f1fc6ffd640 1 -- 172.21.15.103:0/37663958 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc80396a0 con 0x7f1fbc004d40 2024-09-10T08:41:26.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.825+0000 7f1fc6ffd640 1 -- 172.21.15.103:0/37663958 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fc8039840 con 0x7f1fbc004d40 2024-09-10T08:41:26.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.825+0000 7f1fc6ffd640 1 -- 172.21.15.103:0/37663958 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8039bf0 con 0x7f1fbc004d40 2024-09-10T08:41:26.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.826+0000 7f1fd7562640 1 -- 172.21.15.103:0/37663958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fd0156150 con 0x7f1fbc004d40 2024-09-10T08:41:26.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.826+0000 7f1fd7562640 1 -- 172.21.15.103:0/37663958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fd01534f0 con 0x7f1fbc004d40 2024-09-10T08:41:26.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.827+0000 7f1fd7562640 1 -- 172.21.15.103:0/37663958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fd0152680 con 0x7f1fbc004d40 2024-09-10T08:41:26.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.842+0000 7f1fc6ffd640 1 -- 172.21.15.103:0/37663958 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fc8048060 con 0x7f1fbc004d40 2024-09-10T08:41:26.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.843+0000 7f1fc6ffd640 1 --2- 172.21.15.103:0/37663958 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1fb406cbb0 0x7f1fb406f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:26.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.843+0000 7f1fd6560640 1 --2- 172.21.15.103:0/37663958 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1fb406cbb0 0x7f1fb406f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:26.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.843+0000 7f1fc6ffd640 1 -- 172.21.15.103:0/37663958 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f1fc8046070 con 0x7f1fbc004d40 2024-09-10T08:41:26.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.843+0000 7f1fc6ffd640 1 -- 172.21.15.103:0/37663958 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1fc80ab560 con 0x7f1fbc004d40 2024-09-10T08:41:26.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:26.844+0000 7f1fd6560640 1 --2- 172.21.15.103:0/37663958 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1fb406cbb0 0x7f1fb406f070 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1fd00c1d60 tx=0x7f1fcc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:27.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.353+0000 7f1fd7562640 1 -- 172.21.15.103:0/37663958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1fd00c6f10 con 0x7f1fbc004d40 2024-09-10T08:41:27.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.353+0000 7f1fc6ffd640 1 -- 172.21.15.103:0/37663958 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f1fc8079920 con 0x7f1fbc004d40 2024-09-10T08:41:27.356 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":108,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:41:27.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.357+0000 7f1fd7562640 1 -- 172.21.15.103:0/37663958 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1fb406cbb0 msgr2=0x7f1fb406f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.357+0000 7f1fd7562640 1 --2- 172.21.15.103:0/37663958 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1fb406cbb0 0x7f1fb406f070 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1fd00c1d60 tx=0x7f1fcc009040 comp rx=0 tx=0).stop 2024-09-10T08:41:27.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.357+0000 7f1fd7562640 1 -- 172.21.15.103:0/37663958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fbc004d40 msgr2=0x7f1fd01501c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.357+0000 7f1fd7562640 1 --2- 172.21.15.103:0/37663958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fbc004d40 0x7f1fd01501c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8011b50 tx=0x7f1fc8004a40 comp rx=0 tx=0).stop 2024-09-10T08:41:27.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.358+0000 7f1fd7562640 1 -- 172.21.15.103:0/37663958 shutdown_connections 2024-09-10T08:41:27.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.358+0000 7f1fd7562640 1 --2- 172.21.15.103:0/37663958 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f1fb406cbb0 0x7f1fb406f070 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.358+0000 7f1fd7562640 1 --2- 172.21.15.103:0/37663958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fd014f720 0x7f1fd00a9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.358+0000 7f1fd7562640 1 --2- 172.21.15.103:0/37663958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fbc004d40 0x7f1fd01501c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.358+0000 7f1fd7562640 1 --2- 172.21.15.103:0/37663958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1fbc003fe0 0x7f1fd0154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.358+0000 7f1fd7562640 1 -- 172.21.15.103:0/37663958 >> 172.21.15.103:0/37663958 conn(0x7f1fd006bbe0 msgr2=0x7f1fd01ef0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:27.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.358+0000 7f1fd7562640 1 -- 172.21.15.103:0/37663958 shutdown_connections 2024-09-10T08:41:27.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.359+0000 7f1fd7562640 1 -- 172.21.15.103:0/37663958 wait complete. 2024-09-10T08:41:27.377 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-10T08:41:27.377 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-10T08:41:27.377 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:41:27.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.570+0000 7fa08a896640 1 Processor -- start 2024-09-10T08:41:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.570+0000 7fa08a896640 1 -- start start 2024-09-10T08:41:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.571+0000 7fa08a896640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa07c0e2130 0x7fa07c005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.571+0000 7fa08a896640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa07c006f40 0x7fa07c006290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.571+0000 7fa08a896640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa07c047a50 con 0x7fa07c0dbad0 2024-09-10T08:41:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.571+0000 7fa08a896640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa07c0471b0 con 0x7fa07c0e2130 2024-09-10T08:41:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.571+0000 7fa08a896640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa07c047490 con 0x7fa07c006f40 2024-09-10T08:41:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.571+0000 7fa08a095640 1 -- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa07c006f40 msgr2=0x7fa07c006290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:41:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.571+0000 7fa08a095640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa07c006f40 0x7fa07c006290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:41:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.572+0000 7fa089894640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa07c0dbad0 0x7fa07c00ac90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:35364/0 (socket says 172.21.15.103:35364) 2024-09-10T08:41:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.572+0000 7fa089894640 1 -- 172.21.15.103:0/1381074208 learned_addr learned my addr 172.21.15.103:0/1381074208 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:41:27.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.572+0000 7fa089093640 1 --2- 172.21.15.103:0/1381074208 >> v2:172.21.15.103:3300/0 conn(0x7fa07c0e2130 0x7fa07c005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:27.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.573+0000 7fa089093640 1 -- 172.21.15.103:0/1381074208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa07c006f40 msgr2=0x7fa07c006290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:41:27.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.573+0000 7fa089093640 1 --2- 172.21.15.103:0/1381074208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa07c006f40 0x7fa07c006290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.573+0000 7fa089093640 1 -- 172.21.15.103:0/1381074208 >> v1:172.21.15.103:6789/0 conn(0x7fa07c0dbad0 legacy=0x7fa07c00ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.573+0000 7fa089093640 1 -- 172.21.15.103:0/1381074208 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07c047770 con 0x7fa07c0e2130 2024-09-10T08:41:27.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.577+0000 7fa089093640 1 --2- 172.21.15.103:0/1381074208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0e2130 0x7fa07c005d50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa0740097a0 tx=0x7fa07402a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81cde28e607477bc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:27.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.580+0000 7fa088892640 1 -- 172.21.15.103:0/1381074208 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074037070 con 0x7fa07c0e2130 2024-09-10T08:41:27.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.580+0000 7fa088892640 1 -- 172.21.15.103:0/1381074208 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa07402ac90 con 0x7fa07c0e2130 2024-09-10T08:41:27.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.580+0000 7fa088892640 1 -- 172.21.15.103:0/1381074208 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074032660 con 0x7fa07c0e2130 2024-09-10T08:41:27.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.582+0000 7fa08a896640 1 -- 172.21.15.103:0/1381074208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0e2130 msgr2=0x7fa07c005d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.582+0000 7fa08a896640 1 --2- 172.21.15.103:0/1381074208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0e2130 0x7fa07c005d50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa0740097a0 tx=0x7fa07402a000 comp rx=0 tx=0).stop 2024-09-10T08:41:27.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.583+0000 7fa08a896640 1 -- 172.21.15.103:0/1381074208 shutdown_connections 2024-09-10T08:41:27.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.583+0000 7fa08a896640 1 --2- 172.21.15.103:0/1381074208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa07c006f40 0x7fa07c006290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.583+0000 7fa08a896640 1 --2- 172.21.15.103:0/1381074208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0e2130 0x7fa07c005d50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.583+0000 7fa08a896640 1 -- 172.21.15.103:0/1381074208 >> 172.21.15.103:0/1381074208 conn(0x7fa07c047d10 msgr2=0x7fa07c048120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:27.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.585+0000 7fa08a896640 1 -- 172.21.15.103:0/1381074208 shutdown_connections 2024-09-10T08:41:27.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.585+0000 7fa08a896640 1 -- 172.21.15.103:0/1381074208 wait complete. 2024-09-10T08:41:27.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.587+0000 7fa08a896640 1 Processor -- start 2024-09-10T08:41:27.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.587+0000 7fa08a896640 1 -- start start 2024-09-10T08:41:27.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.589+0000 7fa08a896640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa07c006f40 0x7fa07c040fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:27.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.589+0000 7fa08a896640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0dbad0 0x7fa07c0d6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:27.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.589+0000 7fa089894640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa07c006f40 0x7fa07c040fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:27.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.589+0000 7fa089894640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa07c006f40 0x7fa07c040fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:56112/0 (socket says 172.21.15.103:56112) 2024-09-10T08:41:27.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.589+0000 7fa089894640 1 -- 172.21.15.103:0/714287046 learned_addr learned my addr 172.21.15.103:0/714287046 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:27.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.589+0000 7fa08a896640 1 --2- 172.21.15.103:0/714287046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa07c0e2130 0x7fa07c0d6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:27.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.589+0000 7fa08a095640 1 -- 172.21.15.103:0/714287046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa07c0e2130 msgr2=0x7fa07c0d6dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3301/0 2024-09-10T08:41:27.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.589+0000 7fa08a095640 1 --2- 172.21.15.103:0/714287046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa07c0e2130 0x7fa07c0d6dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:41:27.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.589+0000 7fa089093640 1 --2- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0dbad0 0x7fa07c0d6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:27.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.589+0000 7fa08a896640 1 -- 172.21.15.103:0/714287046 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c0067d0 con 0x7fa07c0dbad0 2024-09-10T08:41:27.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.589+0000 7fa08a896640 1 -- 172.21.15.103:0/714287046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c03e980 con 0x7fa07c006f40 2024-09-10T08:41:27.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.589+0000 7fa08a896640 1 -- 172.21.15.103:0/714287046 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa07c0452a0 con 0x7fa07c0e2130 2024-09-10T08:41:27.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.590+0000 7fa089093640 1 -- 172.21.15.103:0/714287046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa07c0e2130 msgr2=0x7fa07c0d6dc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:41:27.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.590+0000 7fa089093640 1 --2- 172.21.15.103:0/714287046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa07c0e2130 0x7fa07c0d6dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.590+0000 7fa089093640 1 -- 172.21.15.103:0/714287046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa07c006f40 msgr2=0x7fa07c040fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.590+0000 7fa089093640 1 --2- 172.21.15.103:0/714287046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa07c006f40 0x7fa07c040fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.590+0000 7fa089093640 1 -- 172.21.15.103:0/714287046 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07c0d8860 con 0x7fa07c0dbad0 2024-09-10T08:41:27.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.590+0000 7fa089894640 1 --2- 172.21.15.103:0/714287046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa07c006f40 0x7fa07c040fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:27.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.591+0000 7fa089093640 1 --2- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0dbad0 0x7fa07c0d6880 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa074031000 tx=0x7fa0740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:27.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.594+0000 7fa07a7fc640 1 -- 172.21.15.103:0/714287046 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074042020 con 0x7fa07c0dbad0 2024-09-10T08:41:27.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.595+0000 7fa07a7fc640 1 -- 172.21.15.103:0/714287046 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa07403d670 con 0x7fa07c0dbad0 2024-09-10T08:41:27.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.595+0000 7fa08a896640 1 -- 172.21.15.103:0/714287046 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa07c0d7c50 con 0x7fa07c0dbad0 2024-09-10T08:41:27.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.595+0000 7fa08a896640 1 -- 172.21.15.103:0/714287046 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa07c0d8210 con 0x7fa07c0dbad0 2024-09-10T08:41:27.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.596+0000 7fa07a7fc640 1 -- 172.21.15.103:0/714287046 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074037040 con 0x7fa07c0dbad0 2024-09-10T08:41:27.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.598+0000 7fa07a7fc640 1 -- 172.21.15.103:0/714287046 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa074045020 con 0x7fa07c0dbad0 2024-09-10T08:41:27.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.599+0000 7fa07a7fc640 1 --2- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa06806be60 0x7fa06806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:27.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.600+0000 7fa089894640 1 --2- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa06806be60 0x7fa06806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:27.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.600+0000 7fa067fff640 1 --2- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0d8e40 0x7fa07c0dc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:27.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.600+0000 7fa067fff640 1 -- 172.21.15.103:0/714287046 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c006950 con 0x7fa07c0d8e40 2024-09-10T08:41:27.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.601+0000 7fa07a7fc640 1 -- 172.21.15.103:0/714287046 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fa0740ab950 con 0x7fa07c0dbad0 2024-09-10T08:41:27.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.601+0000 7fa08a095640 1 --2- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0d8e40 0x7fa07c0dc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:27.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.602+0000 7fa08a095640 1 -- 172.21.15.103:0/714287046 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa07c0d7a00 con 0x7fa07c0d8e40 2024-09-10T08:41:27.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.602+0000 7fa089894640 1 --2- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa06806be60 0x7fa06806e320 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa08406b300 tx=0x7fa08408df90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:27.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.603+0000 7fa08a095640 1 --2- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0d8e40 0x7fa07c0dc780 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa080003930 tx=0x7fa08000bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:27.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.606+0000 7fa07a7fc640 1 -- 172.21.15.103:0/714287046 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa080003b60 con 0x7fa07c0d8e40 2024-09-10T08:41:27.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.606+0000 7fa07a7fc640 1 -- 172.21.15.103:0/714287046 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa080010070 con 0x7fa07c0d8e40 2024-09-10T08:41:27.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.606+0000 7fa07a7fc640 1 -- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0d8e40 msgr2=0x7fa07c0dc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.606+0000 7fa07a7fc640 1 --2- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0d8e40 0x7fa07c0dc780 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa080003930 tx=0x7fa08000bb10 comp rx=0 tx=0).stop 2024-09-10T08:41:27.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.606+0000 7fa07a7fc640 1 -- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0d8e40 msgr2=0x7fa07c0dc780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:41:27.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.606+0000 7fa07a7fc640 1 --2- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0d8e40 0x7fa07c0dc780 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.618+0000 7fa067fff640 1 --2- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0414f0 0x7fa07c0d9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:27.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.627+0000 7fa08a095640 1 --2- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0414f0 0x7fa07c0d9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:27.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.627+0000 7fa067fff640 1 -- 172.21.15.103:0/714287046 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c0d65a0 con 0x7fa07c0414f0 2024-09-10T08:41:27.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.627+0000 7fa08a095640 1 -- 172.21.15.103:0/714287046 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa07c00ac90 con 0x7fa07c0414f0 2024-09-10T08:41:27.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.628+0000 7fa08a095640 1 --2- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0414f0 0x7fa07c0d9a20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa080003930 tx=0x7fa080005980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:27.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.628+0000 7fa07a7fc640 1 -- 172.21.15.103:0/714287046 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08001a770 con 0x7fa07c0414f0 2024-09-10T08:41:27.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.628+0000 7fa07a7fc640 1 -- 172.21.15.103:0/714287046 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5046 (secure 0 0 0) 0x7fa08001a910 con 0x7fa07c0414f0 2024-09-10T08:41:27.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.629+0000 7fa07a7fc640 1 -- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0414f0 msgr2=0x7fa07c0d9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.629+0000 7fa07a7fc640 1 --2- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0414f0 0x7fa07c0d9a20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa080003930 tx=0x7fa080005980 comp rx=0 tx=0).stop 2024-09-10T08:41:27.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.629+0000 7fa07a7fc640 1 -- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0414f0 msgr2=0x7fa07c0d9a20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:41:27.630 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:41:27.630 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:41:27.630 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:41:27.630 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:41:27.630 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 108, 2024-09-10T08:41:27.630 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 114092, 2024-09-10T08:41:27.630 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:41:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:41:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: 1 2024-09-10T08:41:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:41:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:41:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:41:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:41:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:27.631 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:41:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:41:27.632 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.633 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:41:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:41:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:41:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:41:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:41:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:41:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:41:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:41:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:41:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:41:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:41:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:41:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:41:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:41:27.634 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:41:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:41:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:41:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:27.635 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:41:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:41:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:41:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:41:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:27.636 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:41:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:41:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:27.637 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:27.638 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.638 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:41:27.638 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:41:27.638 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:27.638 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:27.638 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:27.638 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.638 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.638 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:41:27.638 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:41:27.638 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:27.638 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:27.639 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.639 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:27.639 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:41:27.639 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:27.639 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.639 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.639 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:27.639 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:41:27.639 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:27.639 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:27.639 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:27.639 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.639 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:41:27.640 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:41:27.640 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:27.640 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:27.640 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:27.640 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.640 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.640 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:41:27.640 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:41:27.640 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:27.640 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:27.640 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.641 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:27.641 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:41:27.641 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:27.641 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.641 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.641 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:27.641 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:41:27.641 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:27.641 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:27.641 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:27.641 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.641 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:41:27.641 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:41:27.642 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:27.642 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:27.642 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:27.642 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:27.642 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:27.642 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.642 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:41:27.642 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:41:27.642 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.642 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:27.642 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:27.642 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:41:27.643 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:27.643 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:27.643 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:41:27.643 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.643 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:27.643 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:27.643 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:41:27.643 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:27.643 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:27.643 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:41:27.643 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.643 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:27.643 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:27.644 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:41:27.644 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:27.644 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:27.644 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:41:27.644 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.644 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:27.644 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:27.644 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:41:27.644 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:27.644 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:27.644 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:41:27.645 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.645 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:27.645 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:27.645 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:41:27.645 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:27.645 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:27.645 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.645 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:41:27.645 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:41:27.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.629+0000 7fa07a7fc640 1 --2- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0414f0 0x7fa07c0d9a20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.629+0000 7fa08a896640 1 -- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa06806be60 msgr2=0x7fa06806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.629+0000 7fa08a896640 1 --2- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa06806be60 0x7fa06806e320 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa08406b300 tx=0x7fa08408df90 comp rx=0 tx=0).stop 2024-09-10T08:41:27.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.629+0000 7fa08a896640 1 -- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0dbad0 msgr2=0x7fa07c0d6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.629+0000 7fa08a896640 1 --2- 172.21.15.103:0/714287046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa07c0dbad0 0x7fa07c0d6880 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa074031000 tx=0x7fa0740046c0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.630+0000 7fa08a095640 1 -- 172.21.15.103:0/714287046 reap_dead start 2024-09-10T08:41:27.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.630+0000 7fa08a896640 1 -- 172.21.15.103:0/714287046 shutdown_connections 2024-09-10T08:41:27.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.630+0000 7fa08a896640 1 -- 172.21.15.103:0/714287046 >> 172.21.15.103:0/714287046 conn(0x7fa07c047d10 msgr2=0x7fa07c005d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:27.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.630+0000 7fa08a896640 1 -- 172.21.15.103:0/714287046 shutdown_connections 2024-09-10T08:41:27.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.630+0000 7fa08a896640 1 -- 172.21.15.103:0/714287046 wait complete. 2024-09-10T08:41:27.648 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:41:27.648 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-10T08:41:27.649 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:41:27.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.836+0000 7fbde65a6640 1 Processor -- start 2024-09-10T08:41:27.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.836+0000 7fbde65a6640 1 -- start start 2024-09-10T08:41:27.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.837+0000 7fbde65a6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbdd80062c0 0x7fbdd8103250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:27.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.837+0000 7fbde65a6640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdd80f7b80 con 0x7fbdd8049190 2024-09-10T08:41:27.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.837+0000 7fbde65a6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdd80f7e60 con 0x7fbdd8049570 2024-09-10T08:41:27.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.837+0000 7fbde65a6640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fbdd80f8790 con 0x7fbdd80062c0 2024-09-10T08:41:27.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.838+0000 7fbde4b43640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbdd80062c0 0x7fbdd8103250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:27.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.838+0000 7fbde4b43640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbdd80062c0 0x7fbdd8103250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35232/0 (socket says 172.21.15.103:35232) 2024-09-10T08:41:27.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.838+0000 7fbde4b43640 1 -- 172.21.15.103:0/4207747546 learned_addr learned my addr 172.21.15.103:0/4207747546 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:27.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.839+0000 7fbde4b43640 1 -- 172.21.15.103:0/4207747546 >> v1:172.21.15.154:6789/0 conn(0x7fbdd8049570 legacy=0x7fbdd8005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:27.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.839+0000 7fbde4b43640 1 -- 172.21.15.103:0/4207747546 >> v1:172.21.15.103:6789/0 conn(0x7fbdd8049190 legacy=0x7fbdd800ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.839+0000 7fbde4b43640 1 -- 172.21.15.103:0/4207747546 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd80f8140 con 0x7fbdd80062c0 2024-09-10T08:41:27.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.840+0000 7fbde4b43640 1 --2- 172.21.15.103:0/4207747546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdd80062c0 0x7fbdd8103250 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbde0051790 tx=0x7fbde0095eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42fba330217b85a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:27.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.841+0000 7fbddeffd640 1 -- 172.21.15.103:0/4207747546 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde00a3070 con 0x7fbdd80062c0 2024-09-10T08:41:27.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.841+0000 7fbddeffd640 1 -- 172.21.15.103:0/4207747546 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbde0096c80 con 0x7fbdd80062c0 2024-09-10T08:41:27.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.841+0000 7fbddeffd640 1 -- 172.21.15.103:0/4207747546 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde009e640 con 0x7fbdd80062c0 2024-09-10T08:41:27.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.842+0000 7fbde65a6640 1 -- 172.21.15.103:0/4207747546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdd80062c0 msgr2=0x7fbdd8103250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.842+0000 7fbde65a6640 1 --2- 172.21.15.103:0/4207747546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdd80062c0 0x7fbdd8103250 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbde0051790 tx=0x7fbde0095eb0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.845+0000 7fbde65a6640 1 -- 172.21.15.103:0/4207747546 shutdown_connections 2024-09-10T08:41:27.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.845+0000 7fbde65a6640 1 --2- 172.21.15.103:0/4207747546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdd80062c0 0x7fbdd8103250 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.845+0000 7fbde65a6640 1 -- 172.21.15.103:0/4207747546 >> 172.21.15.103:0/4207747546 conn(0x7fbdd8047d10 msgr2=0x7fbdd8048120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:27.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.848+0000 7fbde65a6640 1 -- 172.21.15.103:0/4207747546 shutdown_connections 2024-09-10T08:41:27.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.848+0000 7fbde65a6640 1 -- 172.21.15.103:0/4207747546 wait complete. 2024-09-10T08:41:27.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.850+0000 7fbde65a6640 1 Processor -- start 2024-09-10T08:41:27.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.853+0000 7fbde65a6640 1 -- start start 2024-09-10T08:41:27.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.854+0000 7fbde65a6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdd80062c0 0x7fbdd81a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:27.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.854+0000 7fbde65a6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbdd8049190 0x7fbdd819b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:27.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.854+0000 7fbde65a6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdd8049570 0x7fbdd819bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:27.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.854+0000 7fbde65a6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd800b3a0 con 0x7fbdd80062c0 2024-09-10T08:41:27.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.854+0000 7fbde65a6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd8007210 con 0x7fbdd8049570 2024-09-10T08:41:27.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.854+0000 7fbde65a6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd80f3eb0 con 0x7fbdd8049190 2024-09-10T08:41:27.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.854+0000 7fbde4b43640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdd8049570 0x7fbdd819bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:27.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.854+0000 7fbde4b43640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdd8049570 0x7fbdd819bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:56128/0 (socket says 172.21.15.103:56128) 2024-09-10T08:41:27.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.854+0000 7fbde4b43640 1 -- 172.21.15.103:0/1978805552 learned_addr learned my addr 172.21.15.103:0/1978805552 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:27.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.854+0000 7fbddffff640 1 --2- 172.21.15.103:0/1978805552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdd80062c0 0x7fbdd81a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:27.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.855+0000 7fbde4b43640 1 -- 172.21.15.103:0/1978805552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbdd8049190 msgr2=0x7fbdd819b6a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:41:27.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.855+0000 7fbde4b43640 1 --2- 172.21.15.103:0/1978805552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbdd8049190 0x7fbdd819b6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.855+0000 7fbde4b43640 1 -- 172.21.15.103:0/1978805552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdd80062c0 msgr2=0x7fbdd81a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.855+0000 7fbde4b43640 1 --2- 172.21.15.103:0/1978805552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdd80062c0 0x7fbdd81a1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.855+0000 7fbde4b43640 1 -- 172.21.15.103:0/1978805552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd819c120 con 0x7fbdd8049570 2024-09-10T08:41:27.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.855+0000 7fbddffff640 1 --2- 172.21.15.103:0/1978805552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdd80062c0 0x7fbdd81a1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:41:27.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.855+0000 7fbde4b43640 1 --2- 172.21.15.103:0/1978805552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdd8049570 0x7fbdd819bbe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbde0077590 tx=0x7fbde0069d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:27.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.855+0000 7fbddcff9640 1 -- 172.21.15.103:0/1978805552 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde00ad070 con 0x7fbdd8049570 2024-09-10T08:41:27.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.856+0000 7fbde65a6640 1 -- 172.21.15.103:0/1978805552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd80f4100 con 0x7fbdd8049570 2024-09-10T08:41:27.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.856+0000 7fbde65a6640 1 -- 172.21.15.103:0/1978805552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd81a0440 con 0x7fbdd8049570 2024-09-10T08:41:27.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.856+0000 7fbddcff9640 1 -- 172.21.15.103:0/1978805552 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbde00a8870 con 0x7fbdd8049570 2024-09-10T08:41:27.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.856+0000 7fbddcff9640 1 -- 172.21.15.103:0/1978805552 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde00a3040 con 0x7fbdd8049570 2024-09-10T08:41:27.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.859+0000 7fbddcff9640 1 -- 172.21.15.103:0/1978805552 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbde00b0070 con 0x7fbdd8049570 2024-09-10T08:41:27.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.860+0000 7fbddcff9640 1 --2- 172.21.15.103:0/1978805552 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbdc406be60 0x7fbdc406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:27.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.860+0000 7fbddffff640 1 --2- 172.21.15.103:0/1978805552 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbdc406be60 0x7fbdc406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:27.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.860+0000 7fbddcff9640 1 -- 172.21.15.103:0/1978805552 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fbde0117a60 con 0x7fbdd8049570 2024-09-10T08:41:27.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.861+0000 7fbde65a6640 1 --2- 172.21.15.103:0/1978805552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdc0002a70 0x7fbdc0004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:27.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.861+0000 7fbde65a6640 1 -- 172.21.15.103:0/1978805552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc0007ec0 con 0x7fbdc0002a70 2024-09-10T08:41:27.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.861+0000 7fbddf7fe640 1 --2- 172.21.15.103:0/1978805552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdc0002a70 0x7fbdc0004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:27.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.862+0000 7fbddf7fe640 1 -- 172.21.15.103:0/1978805552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbdc00080c0 con 0x7fbdc0002a70 2024-09-10T08:41:27.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.862+0000 7fbddf7fe640 1 --2- 172.21.15.103:0/1978805552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdc0002a70 0x7fbdc0004f30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80ee000 tx=0x7fbdcc00c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:27.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.863+0000 7fbddffff640 1 --2- 172.21.15.103:0/1978805552 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbdc406be60 0x7fbdc406e320 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40017c0 tx=0x7fbdd4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:27.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.865+0000 7fbddcff9640 1 -- 172.21.15.103:0/1978805552 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc007020 con 0x7fbdc0002a70 2024-09-10T08:41:27.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.865+0000 7fbddcff9640 1 -- 172.21.15.103:0/1978805552 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbdcc0071c0 con 0x7fbdc0002a70 2024-09-10T08:41:27.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.865+0000 7fbddcff9640 1 -- 172.21.15.103:0/1978805552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdc0002a70 msgr2=0x7fbdc0004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.865+0000 7fbddcff9640 1 --2- 172.21.15.103:0/1978805552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdc0002a70 0x7fbdc0004f30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80ee000 tx=0x7fbdcc00c7a0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.866+0000 7fbddcff9640 1 -- 172.21.15.103:0/1978805552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdc0002a70 msgr2=0x7fbdc0004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:41:27.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.866+0000 7fbddcff9640 1 --2- 172.21.15.103:0/1978805552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdc0002a70 0x7fbdc0004f30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.889+0000 7fbde65a6640 1 --2- 172.21.15.103:0/1978805552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdc0006f30 0x7fbdc00073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:27.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.889+0000 7fbde65a6640 1 -- 172.21.15.103:0/1978805552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc000a4a0 con 0x7fbdc0006f30 2024-09-10T08:41:27.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.892+0000 7fbddf7fe640 1 --2- 172.21.15.103:0/1978805552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdc0006f30 0x7fbdc00073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:27.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.901+0000 7fbddf7fe640 1 -- 172.21.15.103:0/1978805552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbdc0007900 con 0x7fbdc0006f30 2024-09-10T08:41:27.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.905+0000 7fbddf7fe640 1 --2- 172.21.15.103:0/1978805552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdc0006f30 0x7fbdc00073c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8044d50 tx=0x7fbdcc000fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:27.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.907+0000 7fbddcff9640 1 -- 172.21.15.103:0/1978805552 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc01be20 con 0x7fbdc0006f30 2024-09-10T08:41:27.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.907+0000 7fbddcff9640 1 -- 172.21.15.103:0/1978805552 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7fbdcc01b110 con 0x7fbdc0006f30 2024-09-10T08:41:27.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.907+0000 7fbddcff9640 1 -- 172.21.15.103:0/1978805552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdc0006f30 msgr2=0x7fbdc00073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.907+0000 7fbddcff9640 1 --2- 172.21.15.103:0/1978805552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdc0006f30 0x7fbdc00073c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8044d50 tx=0x7fbdcc000fb0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.907+0000 7fbddcff9640 1 -- 172.21.15.103:0/1978805552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdc0006f30 msgr2=0x7fbdc00073c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:41:27.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.907+0000 7fbddcff9640 1 --2- 172.21.15.103:0/1978805552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdc0006f30 0x7fbdc00073c0 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8044d50 tx=0x7fbdcc000fb0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.907 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:41:27.908 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:41:27.908 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:41:27.908 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:41:27.908 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 108, 2024-09-10T08:41:27.908 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 40113, 2024-09-10T08:41:27.908 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:41:27.908 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:41:27.908 INFO:teuthology.orchestra.run.smithi103.stdout: 1 2024-09-10T08:41:27.908 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:27.908 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 1, 2024-09-10T08:41:27.908 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:41:27.908 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:41:27.909 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:41:27.909 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:27.909 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:27.909 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:27.909 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:27.909 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:27.909 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:27.909 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:27.909 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:27.909 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:27.909 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:27.909 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:27.909 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:27.910 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:41:27.910 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:41:27.910 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:27.910 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:27.910 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:27.910 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:27.910 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:27.910 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:27.910 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:27.910 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:27.910 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:27.910 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:27.910 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:27.910 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:27.911 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.911 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:41:27.911 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:41:27.911 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:41:27.911 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:41:27.911 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:41:27.911 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:41:27.911 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:41:27.911 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:41:27.911 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:41:27.911 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:41:27.911 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:41:27.911 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:41:27.912 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:41:27.912 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:41:27.912 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:41:27.912 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:41:27.912 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:41:27.912 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:27.912 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:27.912 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:27.912 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:27.912 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:27.912 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:27.912 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:27.912 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:27.913 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:27.913 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:27.913 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:27.913 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:27.913 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:41:27.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.913 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:41:27.913 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.913 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:41:27.913 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:41:27.913 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:27.913 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:27.913 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.914 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:27.914 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:41:27.914 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:27.914 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.914 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.914 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:27.914 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:41:27.914 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:27.914 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:27.914 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:27.914 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.914 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:41:27.914 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:41:27.915 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:27.915 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:27.915 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:27.915 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.915 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.915 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:41:27.915 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:41:27.915 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:27.915 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:27.915 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.915 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:27.915 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:41:27.915 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:27.915 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.916 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.916 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:27.916 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:41:27.916 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:27.916 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:27.916 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:27.916 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.916 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:41:27.916 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:41:27.916 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:27.916 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:27.916 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:27.916 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.917 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.917 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:41:27.917 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:41:27.917 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:27.917 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:27.917 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.917 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:27.917 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:41:27.917 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:27.917 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.917 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.917 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:27.917 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:41:27.917 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:27.918 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:27.918 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:27.918 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.918 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:41:27.918 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:41:27.918 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:27.918 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:27.918 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:27.918 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:27.918 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:27.918 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.918 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:41:27.918 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:41:27.919 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.919 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:27.919 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:27.919 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:41:27.919 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:27.919 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:27.919 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:41:27.919 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.919 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:27.919 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:27.919 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:41:27.919 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:27.919 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:27.919 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:41:27.920 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.920 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:27.920 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:27.920 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:41:27.920 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:27.920 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:27.920 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:41:27.920 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:27.920 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:27.920 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:27.920 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:41:27.920 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:27.920 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:27.920 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:27.921 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:41:27.921 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:41:27.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.909+0000 7fbde65a6640 1 -- 172.21.15.103:0/1978805552 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbdc406be60 msgr2=0x7fbdc406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.909+0000 7fbde65a6640 1 --2- 172.21.15.103:0/1978805552 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbdc406be60 0x7fbdc406e320 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40017c0 tx=0x7fbdd4009040 comp rx=0 tx=0).stop 2024-09-10T08:41:27.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.909+0000 7fbde65a6640 1 -- 172.21.15.103:0/1978805552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdd8049570 msgr2=0x7fbdd819bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.909+0000 7fbde65a6640 1 --2- 172.21.15.103:0/1978805552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdd8049570 0x7fbdd819bbe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbde0077590 tx=0x7fbde0069d60 comp rx=0 tx=0).stop 2024-09-10T08:41:27.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.909+0000 7fbde4b43640 1 -- 172.21.15.103:0/1978805552 reap_dead start 2024-09-10T08:41:27.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.909+0000 7fbde4b43640 1 -- 172.21.15.103:0/1978805552 reap_dead start 2024-09-10T08:41:27.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.909+0000 7fbde65a6640 1 -- 172.21.15.103:0/1978805552 shutdown_connections 2024-09-10T08:41:27.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.909+0000 7fbde65a6640 1 -- 172.21.15.103:0/1978805552 >> 172.21.15.103:0/1978805552 conn(0x7fbdd8047d10 msgr2=0x7fbdd80e99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:27.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.912+0000 7fbde65a6640 1 -- 172.21.15.103:0/1978805552 shutdown_connections 2024-09-10T08:41:27.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:27.913+0000 7fbde65a6640 1 -- 172.21.15.103:0/1978805552 wait complete. 2024-09-10T08:41:27.948 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:41:27.948 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-10T08:41:33.341 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:41:33.346 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:41:47.949 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-10T08:41:47.949 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-10T08:41:47.949 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T08:41:47.949 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T08:41:47.955 INFO:tasks.ceph.mon.c:Started 2024-09-10T08:41:47.955 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:41:47.955 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:41:48.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.132+0000 7f178dad7640 1 Processor -- start 2024-09-10T08:41:48.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.135+0000 7f178dad7640 1 -- start start 2024-09-10T08:41:48.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.136+0000 7f178dad7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1788157fe0 0x7f17880af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:48.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.137+0000 7f178dad7640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f178815b580 con 0x7f17880700a0 2024-09-10T08:41:48.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.137+0000 7f178dad7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f178815a7c0 con 0x7f1788157c00 2024-09-10T08:41:48.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.137+0000 7f178dad7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f17880afdf0 con 0x7f1788157fe0 2024-09-10T08:41:48.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.137+0000 7f1787fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f17880700a0 0x7f17880c4780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46552/0 (socket says 172.21.15.103:46552) 2024-09-10T08:41:48.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.137+0000 7f1787fff640 1 -- 172.21.15.103:0/1866358158 learned_addr learned my addr 172.21.15.103:0/1866358158 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:41:48.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.138+0000 7f17867fc640 1 -- 172.21.15.103:0/1866358158 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2422356073 0 0) 0x7f178815b580 con 0x7f17880700a0 2024-09-10T08:41:48.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.138+0000 7f17867fc640 1 -- 172.21.15.103:0/1866358158 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1770003520 con 0x7f17880700a0 2024-09-10T08:41:48.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.139+0000 7f17867fc640 1 -- 172.21.15.103:0/1866358158 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1219715398 0 0) 0x7f178815a7c0 con 0x7f1788157c00 2024-09-10T08:41:48.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.139+0000 7f17867fc640 1 -- 172.21.15.103:0/1866358158 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f178815b580 con 0x7f1788157c00 2024-09-10T08:41:48.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.139+0000 7f17867fc640 1 -- 172.21.15.103:0/1866358158 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2868466260 0 0) 0x7f1770003520 con 0x7f17880700a0 2024-09-10T08:41:48.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.139+0000 7f17867fc640 1 -- 172.21.15.103:0/1866358158 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1788157fe0 msgr2=0x7f17880af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:48.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.139+0000 7f17867fc640 1 --2- 172.21.15.103:0/1866358158 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1788157fe0 0x7f17880af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:48.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.139+0000 7f17867fc640 1 -- 172.21.15.103:0/1866358158 >> v1:172.21.15.154:6789/0 conn(0x7f1788157c00 legacy=0x7f17880c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:48.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.139+0000 7f17867fc640 1 -- 172.21.15.103:0/1866358158 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178815aaa0 con 0x7f17880700a0 2024-09-10T08:41:48.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.139+0000 7f17867fc640 1 -- 172.21.15.103:0/1866358158 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f177c001670 con 0x7f17880700a0 2024-09-10T08:41:48.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.139+0000 7f17867fc640 1 -- 172.21.15.103:0/1866358158 >> v1:172.21.15.103:6789/0 conn(0x7f17880700a0 legacy=0x7f17880c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:48.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.139+0000 7f17867fc640 1 --2- 172.21.15.103:0/1866358158 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1770003b70 0x7f1770003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:48.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.139+0000 7f17867fc640 1 --2- 172.21.15.103:0/1866358158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1770004800 0x7f1770004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:48.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.139+0000 7f17867fc640 1 --2- 172.21.15.103:0/1866358158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17700053c0 0x7f177000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:48.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.139+0000 7f17867fc640 1 -- 172.21.15.103:0/1866358158 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f177000c250 con 0x7f17700053c0 2024-09-10T08:41:48.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.139+0000 7f17867fc640 1 -- 172.21.15.103:0/1866358158 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f177000c400 con 0x7f1770004800 2024-09-10T08:41:48.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.139+0000 7f17867fc640 1 -- 172.21.15.103:0/1866358158 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f177000c600 con 0x7f1770003b70 2024-09-10T08:41:48.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.139+0000 7f1787fff640 1 --2- 172.21.15.103:0/1866358158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17700053c0 0x7f177000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:48.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.140+0000 7f1787fff640 1 -- 172.21.15.103:0/1866358158 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1770003b70 msgr2=0x7f1770003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:48.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.140+0000 7f1787fff640 1 --2- 172.21.15.103:0/1866358158 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1770003b70 0x7f1770003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:48.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.140+0000 7f1787fff640 1 -- 172.21.15.103:0/1866358158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1770004800 msgr2=0x7f1770004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:41:48.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.140+0000 7f1787fff640 1 --2- 172.21.15.103:0/1866358158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1770004800 0x7f1770004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:48.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.140+0000 7f1787fff640 1 -- 172.21.15.103:0/1866358158 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178815aaa0 con 0x7f17700053c0 2024-09-10T08:41:48.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.141+0000 7f1787fff640 1 --2- 172.21.15.103:0/1866358158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17700053c0 0x7f177000b9c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f177c01d4c0 tx=0x7f1770005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a457def57880c93b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:48.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.142+0000 7f17867fc640 1 -- 172.21.15.103:0/1866358158 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c042070 con 0x7f17700053c0 2024-09-10T08:41:48.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.142+0000 7f17867fc640 1 -- 172.21.15.103:0/1866358158 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177c016b00 con 0x7f17700053c0 2024-09-10T08:41:48.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.142+0000 7f17867fc640 1 -- 172.21.15.103:0/1866358158 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c018d80 con 0x7f17700053c0 2024-09-10T08:41:48.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.143+0000 7f178dad7640 1 -- 172.21.15.103:0/1866358158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17700053c0 msgr2=0x7f177000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:48.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.143+0000 7f178dad7640 1 --2- 172.21.15.103:0/1866358158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17700053c0 0x7f177000b9c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f177c01d4c0 tx=0x7f1770005830 comp rx=0 tx=0).stop 2024-09-10T08:41:48.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.143+0000 7f1787fff640 1 -- 172.21.15.103:0/1866358158 reap_dead start 2024-09-10T08:41:48.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.143+0000 7f178dad7640 1 -- 172.21.15.103:0/1866358158 shutdown_connections 2024-09-10T08:41:48.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.143+0000 7f178dad7640 1 -- 172.21.15.103:0/1866358158 >> 172.21.15.103:0/1866358158 conn(0x7f17880c9d80 msgr2=0x7f17880ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:48.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.148+0000 7f178dad7640 1 -- 172.21.15.103:0/1866358158 shutdown_connections 2024-09-10T08:41:48.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.149+0000 7f178dad7640 1 -- 172.21.15.103:0/1866358158 wait complete. 2024-09-10T08:41:48.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.150+0000 7f178dad7640 1 Processor -- start 2024-09-10T08:41:48.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.150+0000 7f178dad7640 1 -- start start 2024-09-10T08:41:48.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.151+0000 7f178dad7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17700053c0 0x7f17880c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:48.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.152+0000 7f178dad7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f178815cee0 0x7f178815d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:48.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.152+0000 7f178dad7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1788141db0 0x7f1788142230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:48.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.152+0000 7f178dad7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f17880c6510 con 0x7f178815cee0 2024-09-10T08:41:48.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.152+0000 7f178dad7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f178815b060 con 0x7f17700053c0 2024-09-10T08:41:48.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.152+0000 7f178dad7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f17880c6690 con 0x7f1788141db0 2024-09-10T08:41:48.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.152+0000 7f1786ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f178815cee0 0x7f178815d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:48.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.152+0000 7f1786ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f178815cee0 0x7f178815d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40542/0 (socket says 172.21.15.103:40542) 2024-09-10T08:41:48.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.152+0000 7f1786ffd640 1 -- 172.21.15.103:0/2406795340 learned_addr learned my addr 172.21.15.103:0/2406795340 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:48.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.152+0000 7f17877fe640 1 --2- 172.21.15.103:0/2406795340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17700053c0 0x7f17880c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:48.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.153+0000 7f17877fe640 1 -- 172.21.15.103:0/2406795340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1788141db0 msgr2=0x7f1788142230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:48.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.153+0000 7f17877fe640 1 --2- 172.21.15.103:0/2406795340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1788141db0 0x7f1788142230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:48.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.153+0000 7f17877fe640 1 -- 172.21.15.103:0/2406795340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f178815cee0 msgr2=0x7f178815d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:48.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.153+0000 7f17877fe640 1 --2- 172.21.15.103:0/2406795340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f178815cee0 0x7f178815d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:48.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.153+0000 7f17877fe640 1 -- 172.21.15.103:0/2406795340 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17881487e0 con 0x7f17700053c0 2024-09-10T08:41:48.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.153+0000 7f1786ffd640 1 --2- 172.21.15.103:0/2406795340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f178815cee0 0x7f178815d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:41:48.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.153+0000 7f17877fe640 1 --2- 172.21.15.103:0/2406795340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17700053c0 0x7f17880c8f70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f178000c7f0 tx=0x7f178000ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:48.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.155+0000 7f176ffff640 1 -- 172.21.15.103:0/2406795340 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1780003b70 con 0x7f17700053c0 2024-09-10T08:41:48.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.155+0000 7f176ffff640 1 -- 172.21.15.103:0/2406795340 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1780003d30 con 0x7f17700053c0 2024-09-10T08:41:48.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.155+0000 7f176ffff640 1 -- 172.21.15.103:0/2406795340 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178000aa90 con 0x7f17700053c0 2024-09-10T08:41:48.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.156+0000 7f178dad7640 1 -- 172.21.15.103:0/2406795340 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f178815de20 con 0x7f17700053c0 2024-09-10T08:41:48.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.156+0000 7f178dad7640 1 -- 172.21.15.103:0/2406795340 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17880c94b0 con 0x7f17700053c0 2024-09-10T08:41:48.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.160+0000 7f178dad7640 1 -- 172.21.15.103:0/2406795340 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f178804ffb0 con 0x7f17700053c0 2024-09-10T08:41:48.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.161+0000 7f176ffff640 1 -- 172.21.15.103:0/2406795340 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f178000ac30 con 0x7f17700053c0 2024-09-10T08:41:48.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.162+0000 7f176ffff640 1 --2- 172.21.15.103:0/2406795340 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f177406bf00 0x7f177406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:48.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.162+0000 7f176ffff640 1 -- 172.21.15.103:0/2406795340 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f178008b090 con 0x7f17700053c0 2024-09-10T08:41:48.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.163+0000 7f1786ffd640 1 --2- 172.21.15.103:0/2406795340 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f177406bf00 0x7f177406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:48.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.166+0000 7f1786ffd640 1 --2- 172.21.15.103:0/2406795340 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f177406bf00 0x7f177406e3c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f17880c40a0 tx=0x7f17780090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:48.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.170+0000 7f176ffff640 1 -- 172.21.15.103:0/2406795340 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f178804ffb0 con 0x7f17700053c0 2024-09-10T08:41:48.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.653+0000 7f178dad7640 1 -- 172.21.15.103:0/2406795340 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f178815a280 con 0x7f17700053c0 2024-09-10T08:41:48.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.654+0000 7f176ffff640 1 -- 172.21.15.103:0/2406795340 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f1780059710 con 0x7f17700053c0 2024-09-10T08:41:48.655 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":108,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:41:48.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.658+0000 7f176dffb640 1 -- 172.21.15.103:0/2406795340 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f177406bf00 msgr2=0x7f177406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:48.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.658+0000 7f176dffb640 1 --2- 172.21.15.103:0/2406795340 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f177406bf00 0x7f177406e3c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f17880c40a0 tx=0x7f17780090e0 comp rx=0 tx=0).stop 2024-09-10T08:41:48.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.658+0000 7f176dffb640 1 -- 172.21.15.103:0/2406795340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17700053c0 msgr2=0x7f17880c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:48.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.658+0000 7f176dffb640 1 --2- 172.21.15.103:0/2406795340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17700053c0 0x7f17880c8f70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f178000c7f0 tx=0x7f178000ccb0 comp rx=0 tx=0).stop 2024-09-10T08:41:48.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.658+0000 7f176dffb640 1 -- 172.21.15.103:0/2406795340 shutdown_connections 2024-09-10T08:41:48.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.658+0000 7f176dffb640 1 --2- 172.21.15.103:0/2406795340 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f177406bf00 0x7f177406e3c0 secure :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f17880c40a0 tx=0x7f17780090e0 comp rx=0 tx=0).stop 2024-09-10T08:41:48.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.658+0000 7f176dffb640 1 --2- 172.21.15.103:0/2406795340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1788141db0 0x7f1788142230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:48.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.658+0000 7f176dffb640 1 --2- 172.21.15.103:0/2406795340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f178815cee0 0x7f178815d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:48.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.658+0000 7f176dffb640 1 --2- 172.21.15.103:0/2406795340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17700053c0 0x7f17880c8f70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:48.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.658+0000 7f176dffb640 1 -- 172.21.15.103:0/2406795340 >> 172.21.15.103:0/2406795340 conn(0x7f17880c9d80 msgr2=0x7f1788072b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:48.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.658+0000 7f176dffb640 1 -- 172.21.15.103:0/2406795340 shutdown_connections 2024-09-10T08:41:48.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:48.658+0000 7f176dffb640 1 -- 172.21.15.103:0/2406795340 wait complete. 2024-09-10T08:41:51.680 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:41:51.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.856+0000 7fe13ee96640 1 Processor -- start 2024-09-10T08:41:51.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.857+0000 7fe13ee96640 1 -- start start 2024-09-10T08:41:51.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.858+0000 7fe13ee96640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe1380c5e40 0x7fe138157e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:51.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.858+0000 7fe13ee96640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe13815a6f0 con 0x7fe1380c59f0 2024-09-10T08:41:51.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.858+0000 7fe13ee96640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe13815a9d0 con 0x7fe13806e400 2024-09-10T08:41:51.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.858+0000 7fe13ee96640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fe1380c65b0 con 0x7fe1380c5e40 2024-09-10T08:41:51.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.858+0000 7fe137fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe1380c59f0 0x7fe138157730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46566/0 (socket says 172.21.15.103:46566) 2024-09-10T08:41:51.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.858+0000 7fe137fff640 1 -- 172.21.15.103:0/3440977085 learned_addr learned my addr 172.21.15.103:0/3440977085 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:41:51.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.859+0000 7fe13d433640 1 --2- 172.21.15.103:0/3440977085 >> v2:172.21.15.103:3300/0 conn(0x7fe1380c5e40 0x7fe138157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:51.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.860+0000 7fe13d433640 1 -- 172.21.15.103:0/3440977085 >> v1:172.21.15.154:6789/0 conn(0x7fe13806e400 legacy=0x7fe1380c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:51.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.860+0000 7fe13d433640 1 -- 172.21.15.103:0/3440977085 >> v1:172.21.15.103:6789/0 conn(0x7fe1380c59f0 legacy=0x7fe138157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:51.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.860+0000 7fe13d433640 1 -- 172.21.15.103:0/3440977085 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13815acb0 con 0x7fe1380c5e40 2024-09-10T08:41:51.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.862+0000 7fe13d433640 1 --2- 172.21.15.103:0/3440977085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1380c5e40 0x7fe138157e40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe1200097a0 tx=0x7fe12002a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3651687e5c01ab15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:51.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.862+0000 7fe1377fe640 1 -- 172.21.15.103:0/3440977085 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe120037070 con 0x7fe1380c5e40 2024-09-10T08:41:51.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.862+0000 7fe1377fe640 1 -- 172.21.15.103:0/3440977085 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe12002ad60 con 0x7fe1380c5e40 2024-09-10T08:41:51.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.862+0000 7fe1377fe640 1 -- 172.21.15.103:0/3440977085 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe120032660 con 0x7fe1380c5e40 2024-09-10T08:41:51.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.863+0000 7fe13ee96640 1 -- 172.21.15.103:0/3440977085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1380c5e40 msgr2=0x7fe138157e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:51.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.863+0000 7fe13ee96640 1 --2- 172.21.15.103:0/3440977085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1380c5e40 0x7fe138157e40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe1200097a0 tx=0x7fe12002a0d0 comp rx=0 tx=0).stop 2024-09-10T08:41:51.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.866+0000 7fe13ee96640 1 -- 172.21.15.103:0/3440977085 shutdown_connections 2024-09-10T08:41:51.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.866+0000 7fe13ee96640 1 --2- 172.21.15.103:0/3440977085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1380c5e40 0x7fe138157e40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:51.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.866+0000 7fe13ee96640 1 -- 172.21.15.103:0/3440977085 >> 172.21.15.103:0/3440977085 conn(0x7fe1380a9680 msgr2=0x7fe1380a9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:51.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.869+0000 7fe13ee96640 1 -- 172.21.15.103:0/3440977085 shutdown_connections 2024-09-10T08:41:51.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.869+0000 7fe13ee96640 1 -- 172.21.15.103:0/3440977085 wait complete. 2024-09-10T08:41:51.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.871+0000 7fe13ee96640 1 Processor -- start 2024-09-10T08:41:51.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.871+0000 7fe13ee96640 1 -- start start 2024-09-10T08:41:51.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.872+0000 7fe13ee96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe13806e400 0x7fe1381f0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:51.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.873+0000 7fe13ee96640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1380c59f0 0x7fe1381f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:51.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.873+0000 7fe137fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1380c59f0 0x7fe1381f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:51.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.873+0000 7fe137fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1380c59f0 0x7fe1381f4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40570/0 (socket says 172.21.15.103:40570) 2024-09-10T08:41:51.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.873+0000 7fe13cc32640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe13806e400 0x7fe1381f0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:51.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.873+0000 7fe137fff640 1 -- 172.21.15.103:0/4149601251 learned_addr learned my addr 172.21.15.103:0/4149601251 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:51.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.873+0000 7fe13ee96640 1 --2- 172.21.15.103:0/4149601251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1380c5e40 0x7fe1381e7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:51.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.873+0000 7fe13ee96640 1 -- 172.21.15.103:0/4149601251 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe1380c2ce0 con 0x7fe1380c59f0 2024-09-10T08:41:51.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.873+0000 7fe13ee96640 1 -- 172.21.15.103:0/4149601251 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe13806e7e0 con 0x7fe1380c5e40 2024-09-10T08:41:51.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.873+0000 7fe13ee96640 1 -- 172.21.15.103:0/4149601251 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe1380c2e60 con 0x7fe13806e400 2024-09-10T08:41:51.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.874+0000 7fe137fff640 1 -- 172.21.15.103:0/4149601251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe13806e400 msgr2=0x7fe1381f0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:51.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.874+0000 7fe137fff640 1 --2- 172.21.15.103:0/4149601251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe13806e400 0x7fe1381f0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:51.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.874+0000 7fe137fff640 1 -- 172.21.15.103:0/4149601251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1380c5e40 msgr2=0x7fe1381e7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:51.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.874+0000 7fe137fff640 1 --2- 172.21.15.103:0/4149601251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1380c5e40 0x7fe1381e7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:51.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.874+0000 7fe137fff640 1 -- 172.21.15.103:0/4149601251 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1380ad810 con 0x7fe1380c59f0 2024-09-10T08:41:51.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.875+0000 7fe137fff640 1 --2- 172.21.15.103:0/4149601251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1380c59f0 0x7fe1381f4280 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe13000cbe0 tx=0x7fe13000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:51.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.875+0000 7fe1357fa640 1 -- 172.21.15.103:0/4149601251 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130018070 con 0x7fe1380c59f0 2024-09-10T08:41:51.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.875+0000 7fe1357fa640 1 -- 172.21.15.103:0/4149601251 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe130004b60 con 0x7fe1380c59f0 2024-09-10T08:41:51.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.875+0000 7fe1357fa640 1 -- 172.21.15.103:0/4149601251 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130018070 con 0x7fe1380c59f0 2024-09-10T08:41:51.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.875+0000 7fe13ee96640 1 -- 172.21.15.103:0/4149601251 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe13815e1b0 con 0x7fe1380c59f0 2024-09-10T08:41:51.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.878+0000 7fe13ee96640 1 -- 172.21.15.103:0/4149601251 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1381f0690 con 0x7fe1380c59f0 2024-09-10T08:41:51.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.878+0000 7fe1357fa640 1 -- 172.21.15.103:0/4149601251 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe13000ab40 con 0x7fe1380c59f0 2024-09-10T08:41:51.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.879+0000 7fe1357fa640 1 --2- 172.21.15.103:0/4149601251 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe11806c230 0x7fe11806e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:51.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.879+0000 7fe1357fa640 1 -- 172.21.15.103:0/4149601251 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fe130004d10 con 0x7fe1380c59f0 2024-09-10T08:41:51.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.879+0000 7fe13cc32640 1 --2- 172.21.15.103:0/4149601251 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe11806c230 0x7fe11806e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:51.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.880+0000 7fe13cc32640 1 --2- 172.21.15.103:0/4149601251 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe11806c230 0x7fe11806e6f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe128007fd0 tx=0x7fe128009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:51.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.880+0000 7fe13ee96640 1 -- 172.21.15.103:0/4149601251 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1380c70d0 con 0x7fe1380c59f0 2024-09-10T08:41:51.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:51.889+0000 7fe1357fa640 1 -- 172.21.15.103:0/4149601251 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe130058a50 con 0x7fe1380c59f0 2024-09-10T08:41:52.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:52.386+0000 7fe13ee96640 1 -- 172.21.15.103:0/4149601251 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe1380c57d0 con 0x7fe1380c59f0 2024-09-10T08:41:52.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:52.387+0000 7fe1357fa640 1 -- 172.21.15.103:0/4149601251 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7fe130058350 con 0x7fe1380c59f0 2024-09-10T08:41:52.390 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":108,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:41:52.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:52.392+0000 7fe13ee96640 1 -- 172.21.15.103:0/4149601251 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe11806c230 msgr2=0x7fe11806e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:52.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:52.392+0000 7fe13ee96640 1 --2- 172.21.15.103:0/4149601251 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe11806c230 0x7fe11806e6f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe128007fd0 tx=0x7fe128009040 comp rx=0 tx=0).stop 2024-09-10T08:41:52.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:52.392+0000 7fe13ee96640 1 -- 172.21.15.103:0/4149601251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1380c59f0 msgr2=0x7fe1381f4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:52.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:52.392+0000 7fe13ee96640 1 --2- 172.21.15.103:0/4149601251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1380c59f0 0x7fe1381f4280 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe13000cbe0 tx=0x7fe13000a430 comp rx=0 tx=0).stop 2024-09-10T08:41:52.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:52.392+0000 7fe13ee96640 1 -- 172.21.15.103:0/4149601251 shutdown_connections 2024-09-10T08:41:52.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:52.392+0000 7fe13ee96640 1 --2- 172.21.15.103:0/4149601251 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe11806c230 0x7fe11806e6f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:52.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:52.392+0000 7fe13ee96640 1 --2- 172.21.15.103:0/4149601251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1380c5e40 0x7fe1381e7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:52.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:52.392+0000 7fe13ee96640 1 --2- 172.21.15.103:0/4149601251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1380c59f0 0x7fe1381f4280 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:52.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:52.392+0000 7fe13ee96640 1 --2- 172.21.15.103:0/4149601251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe13806e400 0x7fe1381f0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:52.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:52.392+0000 7fe13ee96640 1 -- 172.21.15.103:0/4149601251 >> 172.21.15.103:0/4149601251 conn(0x7fe1380a9680 msgr2=0x7fe1380a7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:52.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:52.392+0000 7fe13ee96640 1 -- 172.21.15.103:0/4149601251 shutdown_connections 2024-09-10T08:41:52.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:52.393+0000 7fe13ee96640 1 -- 172.21.15.103:0/4149601251 wait complete. 2024-09-10T08:41:55.413 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:41:55.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.580+0000 7f572385e640 1 Processor -- start 2024-09-10T08:41:55.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.580+0000 7f572385e640 1 -- start start 2024-09-10T08:41:55.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.582+0000 7f572385e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f571c15b130 0x7f571c165fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:55.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.582+0000 7f572385e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f571c15e050 con 0x7f571c157ff0 2024-09-10T08:41:55.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.582+0000 7f572385e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f571c15e330 con 0x7f571c0c5940 2024-09-10T08:41:55.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.582+0000 7f572385e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f571c15e610 con 0x7f571c15b130 2024-09-10T08:41:55.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.582+0000 7f5721dfb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f571c15b130 0x7f571c165fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:55.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.582+0000 7f5721dfb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f571c15b130 0x7f571c165fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:44168/0 (socket says 172.21.15.103:44168) 2024-09-10T08:41:55.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.582+0000 7f5721dfb640 1 -- 172.21.15.103:0/3169520603 learned_addr learned my addr 172.21.15.103:0/3169520603 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:55.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.583+0000 7f5721dfb640 1 -- 172.21.15.103:0/3169520603 >> v1:172.21.15.154:6789/0 conn(0x7f571c0c5940 legacy=0x7f571c15aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:55.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.583+0000 7f5721dfb640 1 -- 172.21.15.103:0/3169520603 >> v1:172.21.15.103:6789/0 conn(0x7f571c157ff0 legacy=0x7f571c0c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:55.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.584+0000 7f5721dfb640 1 -- 172.21.15.103:0/3169520603 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571c15e8f0 con 0x7f571c15b130 2024-09-10T08:41:55.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.590+0000 7f5721dfb640 1 --2- 172.21.15.103:0/3169520603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f571c15b130 0x7f571c165fd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5714009e50 tx=0x7f571402a690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4b5a5d1705f8dbc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:55.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.602+0000 7f5713fff640 1 -- 172.21.15.103:0/3169520603 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5714036070 con 0x7f571c15b130 2024-09-10T08:41:55.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.602+0000 7f5713fff640 1 -- 172.21.15.103:0/3169520603 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5714031600 con 0x7f571c15b130 2024-09-10T08:41:55.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.602+0000 7f5713fff640 1 -- 172.21.15.103:0/3169520603 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57140319d0 con 0x7f571c15b130 2024-09-10T08:41:55.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.603+0000 7f572385e640 1 -- 172.21.15.103:0/3169520603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f571c15b130 msgr2=0x7f571c165fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:55.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.603+0000 7f572385e640 1 --2- 172.21.15.103:0/3169520603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f571c15b130 0x7f571c165fd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5714009e50 tx=0x7f571402a690 comp rx=0 tx=0).stop 2024-09-10T08:41:55.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.604+0000 7f572385e640 1 -- 172.21.15.103:0/3169520603 shutdown_connections 2024-09-10T08:41:55.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.604+0000 7f572385e640 1 --2- 172.21.15.103:0/3169520603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f571c15b130 0x7f571c165fd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:55.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.604+0000 7f572385e640 1 -- 172.21.15.103:0/3169520603 >> 172.21.15.103:0/3169520603 conn(0x7f571c0c7a40 msgr2=0x7f571c0c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:55.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.604+0000 7f572385e640 1 -- 172.21.15.103:0/3169520603 shutdown_connections 2024-09-10T08:41:55.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.605+0000 7f572385e640 1 -- 172.21.15.103:0/3169520603 wait complete. 2024-09-10T08:41:55.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.606+0000 7f572385e640 1 Processor -- start 2024-09-10T08:41:55.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.607+0000 7f572385e640 1 -- start start 2024-09-10T08:41:55.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.608+0000 7f572385e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f571c0c5940 0x7f571c0c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:55.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.609+0000 7f572385e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f571c157ff0 0x7f571c1f16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:55.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.609+0000 7f572385e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f571c15b130 0x7f571c1f1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:55.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.609+0000 7f572385e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f571c0c2cd0 con 0x7f571c0c5940 2024-09-10T08:41:55.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.609+0000 7f572385e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f571c0c2b50 con 0x7f571c15b130 2024-09-10T08:41:55.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.609+0000 7f572385e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f571c15dc30 con 0x7f571c157ff0 2024-09-10T08:41:55.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.609+0000 7f57215fa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f571c0c5940 0x7f571c0c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:55.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.609+0000 7f57215fa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f571c0c5940 0x7f571c0c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41456/0 (socket says 172.21.15.103:41456) 2024-09-10T08:41:55.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.609+0000 7f57215fa640 1 -- 172.21.15.103:0/261890902 learned_addr learned my addr 172.21.15.103:0/261890902 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:55.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.609+0000 7f5720df9640 1 --2- 172.21.15.103:0/261890902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f571c157ff0 0x7f571c1f16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:55.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.610+0000 7f57215fa640 1 -- 172.21.15.103:0/261890902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f571c157ff0 msgr2=0x7f571c1f16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:55.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.610+0000 7f57215fa640 1 --2- 172.21.15.103:0/261890902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f571c157ff0 0x7f571c1f16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:55.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.610+0000 7f57215fa640 1 -- 172.21.15.103:0/261890902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f571c15b130 msgr2=0x7f571c1f1c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:41:55.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.610+0000 7f57215fa640 1 --2- 172.21.15.103:0/261890902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f571c15b130 0x7f571c1f1c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:55.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.610+0000 7f57215fa640 1 -- 172.21.15.103:0/261890902 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571c1f3810 con 0x7f571c0c5940 2024-09-10T08:41:55.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.610+0000 7f57215fa640 1 --2- 172.21.15.103:0/261890902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f571c0c5940 0x7f571c0c6b70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f570c01d760 tx=0x7f570c01dc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:55.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.611+0000 7f5711ffb640 1 -- 172.21.15.103:0/261890902 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c01dd50 con 0x7f571c0c5940 2024-09-10T08:41:55.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.611+0000 7f572385e640 1 -- 172.21.15.103:0/261890902 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571c1f3af0 con 0x7f571c0c5940 2024-09-10T08:41:55.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.611+0000 7f572385e640 1 -- 172.21.15.103:0/261890902 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f571c1f40b0 con 0x7f571c0c5940 2024-09-10T08:41:55.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.615+0000 7f5711ffb640 1 -- 172.21.15.103:0/261890902 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f570c0050d0 con 0x7f571c0c5940 2024-09-10T08:41:55.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.615+0000 7f572385e640 1 -- 172.21.15.103:0/261890902 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f571c06e610 con 0x7f571c0c5940 2024-09-10T08:41:55.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.625+0000 7f5711ffb640 1 -- 172.21.15.103:0/261890902 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c00a640 con 0x7f571c0c5940 2024-09-10T08:41:55.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.625+0000 7f5711ffb640 1 -- 172.21.15.103:0/261890902 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f570c00a860 con 0x7f571c0c5940 2024-09-10T08:41:55.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.625+0000 7f5711ffb640 1 --2- 172.21.15.103:0/261890902 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f570006bf30 0x7f570006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:55.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.626+0000 7f5711ffb640 1 -- 172.21.15.103:0/261890902 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f570c09ba10 con 0x7f571c0c5940 2024-09-10T08:41:55.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.637+0000 7f5720df9640 1 --2- 172.21.15.103:0/261890902 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f570006bf30 0x7f570006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:55.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.638+0000 7f5720df9640 1 --2- 172.21.15.103:0/261890902 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f570006bf30 0x7f570006e3f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f571c15a580 tx=0x7f5718009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:55.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:55.644+0000 7f5711ffb640 1 -- 172.21.15.103:0/261890902 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f570c06a090 con 0x7f571c0c5940 2024-09-10T08:41:56.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.139+0000 7f572385e640 1 -- 172.21.15.103:0/261890902 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f571c0c70b0 con 0x7f571c0c5940 2024-09-10T08:41:56.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.140+0000 7f5711ffb640 1 -- 172.21.15.103:0/261890902 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f570c069990 con 0x7f571c0c5940 2024-09-10T08:41:56.144 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":110,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:41:56.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.145+0000 7f572385e640 1 -- 172.21.15.103:0/261890902 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f570006bf30 msgr2=0x7f570006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:56.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.145+0000 7f572385e640 1 --2- 172.21.15.103:0/261890902 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f570006bf30 0x7f570006e3f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f571c15a580 tx=0x7f5718009040 comp rx=0 tx=0).stop 2024-09-10T08:41:56.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.145+0000 7f572385e640 1 -- 172.21.15.103:0/261890902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f571c0c5940 msgr2=0x7f571c0c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:56.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.145+0000 7f572385e640 1 --2- 172.21.15.103:0/261890902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f571c0c5940 0x7f571c0c6b70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f570c01d760 tx=0x7f570c01dc20 comp rx=0 tx=0).stop 2024-09-10T08:41:56.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.145+0000 7f572385e640 1 -- 172.21.15.103:0/261890902 shutdown_connections 2024-09-10T08:41:56.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.145+0000 7f572385e640 1 --2- 172.21.15.103:0/261890902 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f570006bf30 0x7f570006e3f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.145+0000 7f572385e640 1 --2- 172.21.15.103:0/261890902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f571c15b130 0x7f571c1f1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.145+0000 7f572385e640 1 --2- 172.21.15.103:0/261890902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f571c157ff0 0x7f571c1f16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.145+0000 7f572385e640 1 --2- 172.21.15.103:0/261890902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f571c0c5940 0x7f571c0c6b70 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f570c01d760 tx=0x7f570c01dc20 comp rx=0 tx=0).stop 2024-09-10T08:41:56.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.145+0000 7f572385e640 1 -- 172.21.15.103:0/261890902 >> 172.21.15.103:0/261890902 conn(0x7f571c0c7a40 msgr2=0x7f571c15a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:56.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.145+0000 7f572385e640 1 -- 172.21.15.103:0/261890902 shutdown_connections 2024-09-10T08:41:56.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.145+0000 7f572385e640 1 -- 172.21.15.103:0/261890902 wait complete. 2024-09-10T08:41:56.176 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:41:56.176 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:41:56.176 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:41:56.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.376+0000 7fdeeea5e640 1 Processor -- start 2024-09-10T08:41:56.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.377+0000 7fdeeea5e640 1 -- start start 2024-09-10T08:41:56.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.378+0000 7fdeeea5e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdee004a510 0x7fdee00491c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:56.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.378+0000 7fdeeea5e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdee004ad00 0x7fdee0049700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:56.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.378+0000 7fdeeea5e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee00de2d0 con 0x7fdee0006cb0 2024-09-10T08:41:56.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.378+0000 7fdeeea5e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fdee00de5b0 con 0x7fdee004a510 2024-09-10T08:41:56.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.378+0000 7fdeeea5e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fdee00de890 con 0x7fdee004ad00 2024-09-10T08:41:56.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.378+0000 7fdee77fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdee004a510 0x7fdee00491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:56.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.378+0000 7fdee77fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdee004a510 0x7fdee00491c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41460/0 (socket says 172.21.15.103:41460) 2024-09-10T08:41:56.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.378+0000 7fdee77fe640 1 -- 172.21.15.103:0/1334329179 learned_addr learned my addr 172.21.15.103:0/1334329179 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:56.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.378+0000 7fdeecffb640 1 --2- 172.21.15.103:0/1334329179 >> v2:172.21.15.154:3300/0 conn(0x7fdee004ad00 0x7fdee0049700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:56.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.379+0000 7fdee6ffd640 1 -- 172.21.15.103:0/1334329179 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3216482695 0 0) 0x7fdee00de2d0 con 0x7fdee0006cb0 2024-09-10T08:41:56.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.379+0000 7fdee6ffd640 1 -- 172.21.15.103:0/1334329179 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fded8003520 con 0x7fdee0006cb0 2024-09-10T08:41:56.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.379+0000 7fdee77fe640 1 -- 172.21.15.103:0/1334329179 >> v2:172.21.15.154:3300/0 conn(0x7fdee004ad00 msgr2=0x7fdee0049700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:56.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.379+0000 7fdee77fe640 1 --2- 172.21.15.103:0/1334329179 >> v2:172.21.15.154:3300/0 conn(0x7fdee004ad00 0x7fdee0049700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.379+0000 7fdee77fe640 1 -- 172.21.15.103:0/1334329179 >> v1:172.21.15.154:6789/0 conn(0x7fdee0006cb0 legacy=0x7fdee00db320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:56.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.379+0000 7fdee77fe640 1 -- 172.21.15.103:0/1334329179 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee00deb70 con 0x7fdee004a510 2024-09-10T08:41:56.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.380+0000 7fdee77fe640 1 --2- 172.21.15.103:0/1334329179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee004a510 0x7fdee00491c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdee806b300 tx=0x7fdee80a6c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de537398f861c17 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:56.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.381+0000 7fdee6ffd640 1 -- 172.21.15.103:0/1334329179 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee80b4070 con 0x7fdee004a510 2024-09-10T08:41:56.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.381+0000 7fdee6ffd640 1 -- 172.21.15.103:0/1334329179 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee80a7aa0 con 0x7fdee004a510 2024-09-10T08:41:56.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.381+0000 7fdee6ffd640 1 -- 172.21.15.103:0/1334329179 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee80af440 con 0x7fdee004a510 2024-09-10T08:41:56.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.384+0000 7fdeeea5e640 1 -- 172.21.15.103:0/1334329179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee004a510 msgr2=0x7fdee00491c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:56.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.384+0000 7fdeeea5e640 1 --2- 172.21.15.103:0/1334329179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee004a510 0x7fdee00491c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdee806b300 tx=0x7fdee80a6c70 comp rx=0 tx=0).stop 2024-09-10T08:41:56.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.385+0000 7fdeeea5e640 1 -- 172.21.15.103:0/1334329179 shutdown_connections 2024-09-10T08:41:56.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.385+0000 7fdeeea5e640 1 --2- 172.21.15.103:0/1334329179 >> v2:172.21.15.154:3300/0 conn(0x7fdee004ad00 0x7fdee0049700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.385+0000 7fdeeea5e640 1 --2- 172.21.15.103:0/1334329179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee004a510 0x7fdee00491c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.385+0000 7fdeeea5e640 1 -- 172.21.15.103:0/1334329179 >> 172.21.15.103:0/1334329179 conn(0x7fdee0047d40 msgr2=0x7fdee0048150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:56.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.385+0000 7fdeeea5e640 1 -- 172.21.15.103:0/1334329179 shutdown_connections 2024-09-10T08:41:56.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.385+0000 7fdeeea5e640 1 -- 172.21.15.103:0/1334329179 wait complete. 2024-09-10T08:41:56.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.387+0000 7fdeeea5e640 1 Processor -- start 2024-09-10T08:41:56.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.387+0000 7fdeeea5e640 1 -- start start 2024-09-10T08:41:56.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.388+0000 7fdeeea5e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee0006cb0 0x7fdee00447d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:56.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.388+0000 7fdeeea5e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee004a510 0x7fdee00f9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:56.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.388+0000 7fdeeea5e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee004ad00 0x7fdee00f9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:56.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.388+0000 7fdeeea5e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdee0007090 con 0x7fdee004ad00 2024-09-10T08:41:56.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.388+0000 7fdeeea5e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdee00ddf80 con 0x7fdee004a510 2024-09-10T08:41:56.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.388+0000 7fdeeea5e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fdee0007210 con 0x7fdee0006cb0 2024-09-10T08:41:56.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.388+0000 7fdee77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee004a510 0x7fdee00f9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:56.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.388+0000 7fdee7fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee0006cb0 0x7fdee00447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:56.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.388+0000 7fdee7fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee0006cb0 0x7fdee00447d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:36646/0 (socket says 172.21.15.103:36646) 2024-09-10T08:41:56.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.388+0000 7fdee7fff640 1 -- 172.21.15.103:0/1457920715 learned_addr learned my addr 172.21.15.103:0/1457920715 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:56.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.388+0000 7fdeecffb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee004ad00 0x7fdee00f9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:56.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.389+0000 7fdeecffb640 1 -- 172.21.15.103:0/1457920715 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee0006cb0 msgr2=0x7fdee00447d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:56.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.389+0000 7fdeecffb640 1 --2- 172.21.15.103:0/1457920715 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee0006cb0 0x7fdee00447d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.389+0000 7fdeecffb640 1 -- 172.21.15.103:0/1457920715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee004a510 msgr2=0x7fdee00f9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:56.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.389+0000 7fdeecffb640 1 --2- 172.21.15.103:0/1457920715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee004a510 0x7fdee00f9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.389+0000 7fdeecffb640 1 -- 172.21.15.103:0/1457920715 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee00dd920 con 0x7fdee004ad00 2024-09-10T08:41:56.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.389+0000 7fdeecffb640 1 --2- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee004ad00 0x7fdee00f9d70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fded400e7f0 tx=0x7fded400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:56.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.393+0000 7fdee4ff9640 1 -- 172.21.15.103:0/1457920715 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded4017070 con 0x7fdee004ad00 2024-09-10T08:41:56.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.393+0000 7fdee4ff9640 1 -- 172.21.15.103:0/1457920715 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded400c940 con 0x7fdee004ad00 2024-09-10T08:41:56.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.393+0000 7fdee4ff9640 1 -- 172.21.15.103:0/1457920715 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded400cd10 con 0x7fdee004ad00 2024-09-10T08:41:56.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.395+0000 7fdeeea5e640 1 -- 172.21.15.103:0/1457920715 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee00ddc00 con 0x7fdee004ad00 2024-09-10T08:41:56.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.395+0000 7fdeeea5e640 1 -- 172.21.15.103:0/1457920715 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee00e1450 con 0x7fdee004ad00 2024-09-10T08:41:56.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.399+0000 7fded27fc640 1 --2- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec8002a70 0x7fdec8004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:56.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.399+0000 7fded27fc640 1 -- 172.21.15.103:0/1457920715 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdec8007ec0 con 0x7fdec8002a70 2024-09-10T08:41:56.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.401+0000 7fdee4ff9640 1 -- 172.21.15.103:0/1457920715 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fded401a070 con 0x7fdee004ad00 2024-09-10T08:41:56.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.401+0000 7fdee4ff9640 1 --2- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdecc06bf00 0x7fdecc06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:56.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.401+0000 7fdee4ff9640 1 -- 172.21.15.103:0/1457920715 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fded408b4b0 con 0x7fdee004ad00 2024-09-10T08:41:56.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.402+0000 7fdee7fff640 1 --2- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec8002a70 0x7fdec8004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:56.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.403+0000 7fdee77fe640 1 --2- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdecc06bf00 0x7fdecc06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:56.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.404+0000 7fdee7fff640 1 -- 172.21.15.103:0/1457920715 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdec80080c0 con 0x7fdec8002a70 2024-09-10T08:41:56.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.405+0000 7fdee77fe640 1 --2- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdecc06bf00 0x7fdecc06e3c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdee00074e0 tx=0x7fdee80ab000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:56.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.405+0000 7fdee7fff640 1 --2- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec8002a70 0x7fdec8004f30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00e700 tx=0x7fdedc00ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:56.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.409+0000 7fdee4ff9640 1 -- 172.21.15.103:0/1457920715 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc00ee10 con 0x7fdec8002a70 2024-09-10T08:41:56.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.409+0000 7fdee4ff9640 1 -- 172.21.15.103:0/1457920715 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fdedc018070 con 0x7fdec8002a70 2024-09-10T08:41:56.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.409+0000 7fdee4ff9640 1 -- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec8002a70 msgr2=0x7fdec8004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:56.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.409+0000 7fdee4ff9640 1 --2- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec8002a70 0x7fdec8004f30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00e700 tx=0x7fdedc00ebc0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.416+0000 7fdee4ff9640 1 -- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec8002a70 msgr2=0x7fdec8004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:41:56.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.416+0000 7fdee4ff9640 1 --2- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec8002a70 0x7fdec8004f30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.439+0000 7fded27fc640 1 --2- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec8006f30 0x7fdec80073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:56.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.439+0000 7fded27fc640 1 -- 172.21.15.103:0/1457920715 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdec800a4a0 con 0x7fdec8006f30 2024-09-10T08:41:56.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.439+0000 7fdee7fff640 1 --2- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec8006f30 0x7fdec80073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:56.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.441+0000 7fdee7fff640 1 -- 172.21.15.103:0/1457920715 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdec8007900 con 0x7fdec8006f30 2024-09-10T08:41:56.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.441+0000 7fdee7fff640 1 --2- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec8006f30 0x7fdec80073c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00e700 tx=0x7fdedc001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:56.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.443+0000 7fdee4ff9640 1 -- 172.21.15.103:0/1457920715 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc00c6e0 con 0x7fdec8006f30 2024-09-10T08:41:56.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.443+0000 7fdee4ff9640 1 -- 172.21.15.103:0/1457920715 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5057 (secure 0 0 0) 0x7fdedc00c880 con 0x7fdec8006f30 2024-09-10T08:41:56.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.443+0000 7fdee4ff9640 1 -- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec8006f30 msgr2=0x7fdec80073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:56.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.443+0000 7fdee4ff9640 1 --2- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec8006f30 0x7fdec80073c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00e700 tx=0x7fdedc001150 comp rx=0 tx=0).stop 2024-09-10T08:41:56.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.443+0000 7fdee4ff9640 1 -- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec8006f30 msgr2=0x7fdec80073c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:41:56.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.443+0000 7fdee4ff9640 1 --2- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec8006f30 0x7fdec80073c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.444 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:41:56.444 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:41:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:41:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:41:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 110, 2024-09-10T08:41:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 142907, 2024-09-10T08:41:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:41:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:41:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:41:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:41:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 3, 2024-09-10T08:41:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:41:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:41:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:41:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:41:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:41:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:41:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:41:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:41:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:41:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:41:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:41:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:41:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:41:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:41:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:41:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:41:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:41:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:41:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:41:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:41:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:41:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:41:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:41:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:41:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:41:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:41:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:41:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:41:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:41:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:41:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:41:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:41:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:41:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:41:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:41:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:41:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:41:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:41:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:41:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:41:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:41:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:41:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:41:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:41:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:41:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:41:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:41:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:41:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:41:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:41:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:41:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:41:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:41:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:41:56.460 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:41:56.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.445+0000 7fded27fc640 1 -- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdecc06bf00 msgr2=0x7fdecc06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:56.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.445+0000 7fded27fc640 1 --2- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdecc06bf00 0x7fdecc06e3c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdee00074e0 tx=0x7fdee80ab000 comp rx=0 tx=0).stop 2024-09-10T08:41:56.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.445+0000 7fdeecffb640 1 -- 172.21.15.103:0/1457920715 reap_dead start 2024-09-10T08:41:56.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.446+0000 7fded27fc640 1 -- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee004ad00 msgr2=0x7fdee00f9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:56.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.446+0000 7fded27fc640 1 --2- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee004ad00 0x7fdee00f9d70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fded400e7f0 tx=0x7fded400ecb0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.446+0000 7fded27fc640 1 -- 172.21.15.103:0/1457920715 shutdown_connections 2024-09-10T08:41:56.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.446+0000 7fded27fc640 1 --2- 172.21.15.103:0/1457920715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdee004ad00 0x7fdee00f9d70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.446+0000 7fded27fc640 1 -- 172.21.15.103:0/1457920715 >> 172.21.15.103:0/1457920715 conn(0x7fdee0047d40 msgr2=0x7fdee00d9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:56.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.447+0000 7fded27fc640 1 -- 172.21.15.103:0/1457920715 shutdown_connections 2024-09-10T08:41:56.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.449+0000 7fded27fc640 1 -- 172.21.15.103:0/1457920715 wait complete. 2024-09-10T08:41:56.490 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:41:56.490 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:41:56.490 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:41:56.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.686+0000 7f0e3ac5e640 1 Processor -- start 2024-09-10T08:41:56.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.686+0000 7f0e3ac5e640 1 -- start start 2024-09-10T08:41:56.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.687+0000 7f0e3ac5e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e340a6c10 0x7f0e340c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:56.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.687+0000 7f0e3ac5e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0e340c5940 0x7f0e3406e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:56.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.687+0000 7f0e3ac5e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e3415a970 con 0x7f0e340c6010 2024-09-10T08:41:56.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.687+0000 7f0e3ac5e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f0e3415ac50 con 0x7f0e340c5940 2024-09-10T08:41:56.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.687+0000 7f0e3ac5e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0e3415af30 con 0x7f0e340a6c10 2024-09-10T08:41:56.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.688+0000 7f0e33fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0e340c6010 0x7f0e3406dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:35486/0 (socket says 172.21.15.103:35486) 2024-09-10T08:41:56.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.688+0000 7f0e33fff640 1 -- 172.21.15.103:0/2263423717 learned_addr learned my addr 172.21.15.103:0/2263423717 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:41:56.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.688+0000 7f0e389fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e340a6c10 0x7f0e340c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:56.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.689+0000 7f0e391fb640 1 --2- 172.21.15.103:0/2263423717 >> v2:172.21.15.154:3300/0 conn(0x7f0e340c5940 0x7f0e3406e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:56.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.689+0000 7f0e337fe640 1 -- 172.21.15.103:0/2263423717 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1105928616 0 0) 0x7f0e3415a970 con 0x7f0e340c6010 2024-09-10T08:41:56.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.689+0000 7f0e337fe640 1 -- 172.21.15.103:0/2263423717 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e24003520 con 0x7f0e340c6010 2024-09-10T08:41:56.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.689+0000 7f0e391fb640 1 -- 172.21.15.103:0/2263423717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e340a6c10 msgr2=0x7f0e340c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:56.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.689+0000 7f0e391fb640 1 --2- 172.21.15.103:0/2263423717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e340a6c10 0x7f0e340c2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.690+0000 7f0e391fb640 1 -- 172.21.15.103:0/2263423717 >> v1:172.21.15.154:6789/0 conn(0x7f0e340c6010 legacy=0x7f0e3406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:56.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.690+0000 7f0e391fb640 1 -- 172.21.15.103:0/2263423717 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3415b210 con 0x7f0e340c5940 2024-09-10T08:41:56.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.691+0000 7f0e391fb640 1 --2- 172.21.15.103:0/2263423717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e340c5940 0x7f0e3406e1c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c009d90 tx=0x7f0e2c02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2572f64c2744bfae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:56.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.692+0000 7f0e337fe640 1 -- 172.21.15.103:0/2263423717 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c007740 con 0x7f0e340c5940 2024-09-10T08:41:56.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.692+0000 7f0e337fe640 1 -- 172.21.15.103:0/2263423717 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e2c0078e0 con 0x7f0e340c5940 2024-09-10T08:41:56.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.692+0000 7f0e337fe640 1 -- 172.21.15.103:0/2263423717 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c007cf0 con 0x7f0e340c5940 2024-09-10T08:41:56.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.694+0000 7f0e3ac5e640 1 -- 172.21.15.103:0/2263423717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e340c5940 msgr2=0x7f0e3406e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:56.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.694+0000 7f0e3ac5e640 1 --2- 172.21.15.103:0/2263423717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e340c5940 0x7f0e3406e1c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c009d90 tx=0x7f0e2c02a5f0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.694+0000 7f0e3ac5e640 1 -- 172.21.15.103:0/2263423717 shutdown_connections 2024-09-10T08:41:56.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.694+0000 7f0e3ac5e640 1 --2- 172.21.15.103:0/2263423717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e340c5940 0x7f0e3406e1c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.694+0000 7f0e3ac5e640 1 --2- 172.21.15.103:0/2263423717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e340a6c10 0x7f0e340c2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.694+0000 7f0e3ac5e640 1 -- 172.21.15.103:0/2263423717 >> 172.21.15.103:0/2263423717 conn(0x7f0e340c7a40 msgr2=0x7f0e340c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:56.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.696+0000 7f0e3ac5e640 1 -- 172.21.15.103:0/2263423717 shutdown_connections 2024-09-10T08:41:56.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.696+0000 7f0e3ac5e640 1 -- 172.21.15.103:0/2263423717 wait complete. 2024-09-10T08:41:56.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.698+0000 7f0e3ac5e640 1 Processor -- start 2024-09-10T08:41:56.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.698+0000 7f0e3ac5e640 1 -- start start 2024-09-10T08:41:56.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.699+0000 7f0e3ac5e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e340a6c10 0x7f0e3415dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:56.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.699+0000 7f0e3ac5e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e340c5940 0x7f0e341fc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:56.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.699+0000 7f0e3ac5e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e340c6010 0x7f0e340abde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.699+0000 7f0e3ac5e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0e340a73a0 con 0x7f0e340a6c10 2024-09-10T08:41:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.699+0000 7f0e3ac5e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3415a620 con 0x7f0e340c5940 2024-09-10T08:41:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.699+0000 7f0e3ac5e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0e340a7520 con 0x7f0e340c6010 2024-09-10T08:41:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.700+0000 7f0e389fa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e340a6c10 0x7f0e3415dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.700+0000 7f0e389fa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e340a6c10 0x7f0e3415dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41502/0 (socket says 172.21.15.103:41502) 2024-09-10T08:41:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.700+0000 7f0e389fa640 1 -- 172.21.15.103:0/2579067321 learned_addr learned my addr 172.21.15.103:0/2579067321 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.700+0000 7f0e33fff640 1 --2- 172.21.15.103:0/2579067321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e340c5940 0x7f0e341fc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.700+0000 7f0e389fa640 1 -- 172.21.15.103:0/2579067321 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e340c6010 msgr2=0x7f0e340abde0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:41:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.700+0000 7f0e389fa640 1 --2- 172.21.15.103:0/2579067321 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e340c6010 0x7f0e340abde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.700+0000 7f0e389fa640 1 -- 172.21.15.103:0/2579067321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e340c5940 msgr2=0x7f0e341fc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.700+0000 7f0e389fa640 1 --2- 172.21.15.103:0/2579067321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e340c5940 0x7f0e341fc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.700+0000 7f0e389fa640 1 -- 172.21.15.103:0/2579067321 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e341fc9f0 con 0x7f0e340a6c10 2024-09-10T08:41:56.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.701+0000 7f0e389fa640 1 --2- 172.21.15.103:0/2579067321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e340a6c10 0x7f0e3415dff0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800d800 tx=0x7f0e2800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:56.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.701+0000 7f0e317fa640 1 -- 172.21.15.103:0/2579067321 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2800b640 con 0x7f0e340a6c10 2024-09-10T08:41:56.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.701+0000 7f0e317fa640 1 -- 172.21.15.103:0/2579067321 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e28019070 con 0x7f0e340a6c10 2024-09-10T08:41:56.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.701+0000 7f0e317fa640 1 -- 172.21.15.103:0/2579067321 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2800b9e0 con 0x7f0e340a6c10 2024-09-10T08:41:56.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.701+0000 7f0e3ac5e640 1 -- 172.21.15.103:0/2579067321 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e341fccd0 con 0x7f0e340a6c10 2024-09-10T08:41:56.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.701+0000 7f0e3ac5e640 1 -- 172.21.15.103:0/2579067321 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e3415dad0 con 0x7f0e340a6c10 2024-09-10T08:41:56.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.703+0000 7f0e3ac5e640 1 --2- 172.21.15.103:0/2579067321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14002a70 0x7f0e14004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:56.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.703+0000 7f0e3ac5e640 1 -- 172.21.15.103:0/2579067321 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0e14007ec0 con 0x7f0e14002a70 2024-09-10T08:41:56.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.704+0000 7f0e33fff640 1 --2- 172.21.15.103:0/2579067321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14002a70 0x7f0e14004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:56.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.704+0000 7f0e33fff640 1 -- 172.21.15.103:0/2579067321 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e140080c0 con 0x7f0e14002a70 2024-09-10T08:41:56.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.704+0000 7f0e317fa640 1 -- 172.21.15.103:0/2579067321 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e2800bb80 con 0x7f0e340a6c10 2024-09-10T08:41:56.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.705+0000 7f0e33fff640 1 --2- 172.21.15.103:0/2579067321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14002a70 0x7f0e14004f30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0e34050200 tx=0x7f0e2000e8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:56.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.705+0000 7f0e317fa640 1 --2- 172.21.15.103:0/2579067321 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0e1806be80 0x7f0e1806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:56.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.708+0000 7f0e391fb640 1 --2- 172.21.15.103:0/2579067321 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0e1806be80 0x7f0e1806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:56.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.709+0000 7f0e391fb640 1 --2- 172.21.15.103:0/2579067321 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0e1806be80 0x7f0e1806e340 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c034000 tx=0x7f0e2c02f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:56.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.710+0000 7f0e317fa640 1 -- 172.21.15.103:0/2579067321 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e20019070 con 0x7f0e14002a70 2024-09-10T08:41:56.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.713+0000 7f0e317fa640 1 -- 172.21.15.103:0/2579067321 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0e20005ac0 con 0x7f0e14002a70 2024-09-10T08:41:56.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.713+0000 7f0e317fa640 1 -- 172.21.15.103:0/2579067321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14002a70 msgr2=0x7f0e14004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:56.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.713+0000 7f0e317fa640 1 --2- 172.21.15.103:0/2579067321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14002a70 0x7f0e14004f30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0e34050200 tx=0x7f0e2000e8f0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.713+0000 7f0e317fa640 1 -- 172.21.15.103:0/2579067321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14002a70 msgr2=0x7f0e14004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:41:56.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.713+0000 7f0e317fa640 1 --2- 172.21.15.103:0/2579067321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14002a70 0x7f0e14004f30 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0e34050200 tx=0x7f0e2000e8f0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.714+0000 7f0e317fa640 1 -- 172.21.15.103:0/2579067321 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f0e28057830 con 0x7f0e340a6c10 2024-09-10T08:41:56.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.726+0000 7f0e3ac5e640 1 --2- 172.21.15.103:0/2579067321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14006fa0 0x7f0e14007430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:56.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.726+0000 7f0e3ac5e640 1 -- 172.21.15.103:0/2579067321 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1400a3e0 con 0x7f0e14006fa0 2024-09-10T08:41:56.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.727+0000 7f0e33fff640 1 --2- 172.21.15.103:0/2579067321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14006fa0 0x7f0e14007430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:56.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.728+0000 7f0e33fff640 1 -- 172.21.15.103:0/2579067321 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0e14007970 con 0x7f0e14006fa0 2024-09-10T08:41:56.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.728+0000 7f0e33fff640 1 --2- 172.21.15.103:0/2579067321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14006fa0 0x7f0e14007430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0e14008090 tx=0x7f0e20001150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:56.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.729+0000 7f0e317fa640 1 -- 172.21.15.103:0/2579067321 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e20019070 con 0x7f0e14006fa0 2024-09-10T08:41:56.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.729+0000 7f0e317fa640 1 -- 172.21.15.103:0/2579067321 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4887 (secure 0 0 0) 0x7f0e20007720 con 0x7f0e14006fa0 2024-09-10T08:41:56.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.729+0000 7f0e317fa640 1 -- 172.21.15.103:0/2579067321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14006fa0 msgr2=0x7f0e14007430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:56.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.729+0000 7f0e317fa640 1 --2- 172.21.15.103:0/2579067321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14006fa0 0x7f0e14007430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0e14008090 tx=0x7f0e20001150 comp rx=0 tx=0).stop 2024-09-10T08:41:56.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.729+0000 7f0e317fa640 1 -- 172.21.15.103:0/2579067321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14006fa0 msgr2=0x7f0e14007430 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:41:56.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.729+0000 7f0e317fa640 1 --2- 172.21.15.103:0/2579067321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14006fa0 0x7f0e14007430 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0e14008090 tx=0x7f0e20001150 comp rx=0 tx=0).stop 2024-09-10T08:41:56.731 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:41:56.731 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:41:56.731 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:41:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:41:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 110, 2024-09-10T08:41:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 68938, 2024-09-10T08:41:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:41:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:41:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:41:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:41:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 4, 2024-09-10T08:41:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:41:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:41:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:41:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:41:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:41:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:41:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:41:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:41:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:41:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:41:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:41:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:41:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:41:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:41:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:41:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:41:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:41:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:41:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:41:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:41:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:41:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:41:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:41:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:41:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:41:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:41:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:41:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:41:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:41:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:41:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:41:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:41:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:41:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:41:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:41:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:41:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:41:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:41:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:41:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:41:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:41:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:41:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:41:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:41:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:41:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:41:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:41:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:41:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:41:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:41:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:41:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:41:56.745 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:41:56.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.730+0000 7f0e3ac5e640 1 -- 172.21.15.103:0/2579067321 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0e1806be80 msgr2=0x7f0e1806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:56.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.730+0000 7f0e3ac5e640 1 --2- 172.21.15.103:0/2579067321 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0e1806be80 0x7f0e1806e340 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c034000 tx=0x7f0e2c02f000 comp rx=0 tx=0).stop 2024-09-10T08:41:56.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.730+0000 7f0e3ac5e640 1 -- 172.21.15.103:0/2579067321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e340a6c10 msgr2=0x7f0e3415dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:56.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.730+0000 7f0e3ac5e640 1 --2- 172.21.15.103:0/2579067321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e340a6c10 0x7f0e3415dff0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800d800 tx=0x7f0e2800dcc0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.730+0000 7f0e391fb640 1 -- 172.21.15.103:0/2579067321 reap_dead start 2024-09-10T08:41:56.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.730+0000 7f0e391fb640 1 -- 172.21.15.103:0/2579067321 reap_dead start 2024-09-10T08:41:56.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.730+0000 7f0e3ac5e640 1 -- 172.21.15.103:0/2579067321 shutdown_connections 2024-09-10T08:41:56.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.730+0000 7f0e3ac5e640 1 -- 172.21.15.103:0/2579067321 >> 172.21.15.103:0/2579067321 conn(0x7f0e340c7a40 msgr2=0x7f0e341e54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:56.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.731+0000 7f0e3ac5e640 1 -- 172.21.15.103:0/2579067321 shutdown_connections 2024-09-10T08:41:56.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.731+0000 7f0e3ac5e640 1 -- 172.21.15.103:0/2579067321 wait complete. 2024-09-10T08:41:56.748 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:41:56.748 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:41:56.748 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:41:56.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.951+0000 7f5cf6986640 1 Processor -- start 2024-09-10T08:41:56.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.951+0000 7f5cf6986640 1 -- start start 2024-09-10T08:41:56.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.952+0000 7f5cf6986640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5cf006d560 0x7f5cf00c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:56.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.952+0000 7f5cf6986640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cf0153a50 con 0x7f5cf01508d0 2024-09-10T08:41:56.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.952+0000 7f5cf6986640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cf006cd90 con 0x7f5cf006dd20 2024-09-10T08:41:56.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.952+0000 7f5cf6986640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f5cf006d070 con 0x7f5cf006d560 2024-09-10T08:41:56.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.955+0000 7f5cf5984640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5cf006dd20 0x7f5cf01501c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:35496/0 (socket says 172.21.15.103:35496) 2024-09-10T08:41:56.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.955+0000 7f5cf5984640 1 -- 172.21.15.103:0/3652792186 learned_addr learned my addr 172.21.15.103:0/3652792186 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:41:56.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.955+0000 7f5cf6185640 1 --2- 172.21.15.103:0/3652792186 >> v2:172.21.15.154:3300/0 conn(0x7f5cf006d560 0x7f5cf00c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:56.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.955+0000 7f5cf6185640 1 -- 172.21.15.103:0/3652792186 >> v1:172.21.15.154:6789/0 conn(0x7f5cf006dd20 legacy=0x7f5cf01501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:56.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.955+0000 7f5cf6185640 1 -- 172.21.15.103:0/3652792186 >> v1:172.21.15.103:6789/0 conn(0x7f5cf01508d0 legacy=0x7f5cf00c3d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:41:56.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.955+0000 7f5cf6185640 1 -- 172.21.15.103:0/3652792186 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf00c49c0 con 0x7f5cf006d560 2024-09-10T08:41:56.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.957+0000 7f5cf6185640 1 --2- 172.21.15.103:0/3652792186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cf006d560 0x7f5cf00c4480 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0097a0 tx=0x7f5cec02a160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d36e295e7d06ba2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:56.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.957+0000 7f5cf4982640 1 -- 172.21.15.103:0/3652792186 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec037070 con 0x7f5cf006d560 2024-09-10T08:41:56.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.957+0000 7f5cf4982640 1 -- 172.21.15.103:0/3652792186 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cec032440 con 0x7f5cf006d560 2024-09-10T08:41:56.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.958+0000 7f5cf6986640 1 -- 172.21.15.103:0/3652792186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cf006d560 msgr2=0x7f5cf00c4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:56.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.958+0000 7f5cf6986640 1 --2- 172.21.15.103:0/3652792186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cf006d560 0x7f5cf00c4480 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0097a0 tx=0x7f5cec02a160 comp rx=0 tx=0).stop 2024-09-10T08:41:56.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.960+0000 7f5cf6986640 1 -- 172.21.15.103:0/3652792186 shutdown_connections 2024-09-10T08:41:56.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.960+0000 7f5cf6986640 1 --2- 172.21.15.103:0/3652792186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cf006d560 0x7f5cf00c4480 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.960+0000 7f5cf6986640 1 -- 172.21.15.103:0/3652792186 >> 172.21.15.103:0/3652792186 conn(0x7f5cf00aa700 msgr2=0x7f5cf00aab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:56.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.960+0000 7f5cf6986640 1 -- 172.21.15.103:0/3652792186 shutdown_connections 2024-09-10T08:41:56.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.960+0000 7f5cf6986640 1 -- 172.21.15.103:0/3652792186 wait complete. 2024-09-10T08:41:56.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.962+0000 7f5cf6986640 1 Processor -- start 2024-09-10T08:41:56.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.962+0000 7f5cf6986640 1 -- start start 2024-09-10T08:41:56.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.963+0000 7f5cf6986640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cf006d560 0x7f5cf01496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:56.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.963+0000 7f5cf6986640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cf006dd20 0x7f5cf00ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:56.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.963+0000 7f5cf6986640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cf01508d0 0x7f5cf00ad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:56.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.963+0000 7f5cf6986640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf006e100 con 0x7f5cf006dd20 2024-09-10T08:41:56.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.963+0000 7f5cf6986640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf0153d30 con 0x7f5cf006d560 2024-09-10T08:41:56.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.963+0000 7f5cf6986640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf006e280 con 0x7f5cf01508d0 2024-09-10T08:41:56.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.964+0000 7f5cf5183640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cf006dd20 0x7f5cf00ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:56.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.964+0000 7f5cf5984640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cf006d560 0x7f5cf01496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:56.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.964+0000 7f5cf5183640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cf006dd20 0x7f5cf00ad150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41510/0 (socket says 172.21.15.103:41510) 2024-09-10T08:41:56.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.964+0000 7f5cf5183640 1 -- 172.21.15.103:0/1244198708 learned_addr learned my addr 172.21.15.103:0/1244198708 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:56.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.964+0000 7f5cf6185640 1 --2- 172.21.15.103:0/1244198708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cf01508d0 0x7f5cf00ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:56.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.964+0000 7f5cf6185640 1 -- 172.21.15.103:0/1244198708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cf006d560 msgr2=0x7f5cf01496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:56.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.964+0000 7f5cf6185640 1 --2- 172.21.15.103:0/1244198708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cf006d560 0x7f5cf01496c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.964+0000 7f5cf6185640 1 -- 172.21.15.103:0/1244198708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cf006dd20 msgr2=0x7f5cf00ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:56.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.964+0000 7f5cf6185640 1 --2- 172.21.15.103:0/1244198708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cf006dd20 0x7f5cf00ad150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.964+0000 7f5cf6185640 1 -- 172.21.15.103:0/1244198708 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf00adde0 con 0x7f5cf01508d0 2024-09-10T08:41:56.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.968+0000 7f5cf6185640 1 --2- 172.21.15.103:0/1244198708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cf01508d0 0x7f5cf00ad690 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5cec031000 tx=0x7f5cec0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:56.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.969+0000 7f5ce67fc640 1 -- 172.21.15.103:0/1244198708 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec037050 con 0x7f5cf01508d0 2024-09-10T08:41:56.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.969+0000 7f5cf6986640 1 -- 172.21.15.103:0/1244198708 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf0152cc0 con 0x7f5cf01508d0 2024-09-10T08:41:56.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.969+0000 7f5cf6986640 1 -- 172.21.15.103:0/1244198708 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf0149c00 con 0x7f5cf01508d0 2024-09-10T08:41:56.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.970+0000 7f5cf6986640 1 --2- 172.21.15.103:0/1244198708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cf00ae430 0x7f5cf01efe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:56.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.970+0000 7f5cf6986640 1 -- 172.21.15.103:0/1244198708 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf00adfb0 con 0x7f5cf00ae430 2024-09-10T08:41:56.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.971+0000 7f5ce67fc640 1 -- 172.21.15.103:0/1244198708 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cec043070 con 0x7f5cf01508d0 2024-09-10T08:41:56.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.971+0000 7f5ce67fc640 1 -- 172.21.15.103:0/1244198708 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec032a50 con 0x7f5cf01508d0 2024-09-10T08:41:56.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.975+0000 7f5cf5984640 1 --2- 172.21.15.103:0/1244198708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cf00ae430 0x7f5cf01efe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:56.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.976+0000 7f5cf5984640 1 -- 172.21.15.103:0/1244198708 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5cf00a9300 con 0x7f5cf00ae430 2024-09-10T08:41:56.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.977+0000 7f5ce67fc640 1 -- 172.21.15.103:0/1244198708 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5cec032bf0 con 0x7f5cf01508d0 2024-09-10T08:41:56.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.977+0000 7f5ce67fc640 1 --2- 172.21.15.103:0/1244198708 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5cd406bf00 0x7f5cd406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:56.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.977+0000 7f5cf5984640 1 --2- 172.21.15.103:0/1244198708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cf00ae430 0x7f5cf01efe30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80012e0 tx=0x7f5ce800d520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:56.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.977+0000 7f5ce67fc640 1 -- 172.21.15.103:0/1244198708 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f5cec0abf30 con 0x7f5cf01508d0 2024-09-10T08:41:56.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.978+0000 7f5ce67fc640 1 -- 172.21.15.103:0/1244198708 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce80020b0 con 0x7f5cf00ae430 2024-09-10T08:41:56.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.978+0000 7f5cf5183640 1 --2- 172.21.15.103:0/1244198708 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5cd406bf00 0x7f5cd406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:56.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.979+0000 7f5ce67fc640 1 -- 172.21.15.103:0/1244198708 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5ce8018070 con 0x7f5cf00ae430 2024-09-10T08:41:56.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.979+0000 7f5ce67fc640 1 -- 172.21.15.103:0/1244198708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cf00ae430 msgr2=0x7f5cf01efe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:56.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.979+0000 7f5ce67fc640 1 --2- 172.21.15.103:0/1244198708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cf00ae430 0x7f5cf01efe30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80012e0 tx=0x7f5ce800d520 comp rx=0 tx=0).stop 2024-09-10T08:41:56.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.979+0000 7f5ce67fc640 1 -- 172.21.15.103:0/1244198708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cf00ae430 msgr2=0x7f5cf01efe30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:41:56.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.979+0000 7f5ce67fc640 1 --2- 172.21.15.103:0/1244198708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cf00ae430 0x7f5cf01efe30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:56.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:56.979+0000 7f5cf5183640 1 --2- 172.21.15.103:0/1244198708 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5cd406bf00 0x7f5cd406e3c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00c3570 tx=0x7f5ce0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:57.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.017+0000 7f5cf6986640 1 --2- 172.21.15.103:0/1244198708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cf014aee0 0x7f5cf01f0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:57.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.017+0000 7f5cf6986640 1 -- 172.21.15.103:0/1244198708 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf01f08b0 con 0x7f5cf014aee0 2024-09-10T08:41:57.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.020+0000 7f5cf5984640 1 --2- 172.21.15.103:0/1244198708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cf014aee0 0x7f5cf01f0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:57.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.024+0000 7f5cf5984640 1 -- 172.21.15.103:0/1244198708 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5cf00c6ef0 con 0x7f5cf014aee0 2024-09-10T08:41:57.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.024+0000 7f5cf5984640 1 --2- 172.21.15.103:0/1244198708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cf014aee0 0x7f5cf01f0370 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80012e0 tx=0x7f5ce8005b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:57.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.024+0000 7f5ce67fc640 1 -- 172.21.15.103:0/1244198708 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce80076f0 con 0x7f5cf014aee0 2024-09-10T08:41:57.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.025+0000 7f5ce67fc640 1 -- 172.21.15.103:0/1244198708 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4552 (secure 0 0 0) 0x7f5ce80076f0 con 0x7f5cf014aee0 2024-09-10T08:41:57.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.025+0000 7f5ce67fc640 1 -- 172.21.15.103:0/1244198708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cf014aee0 msgr2=0x7f5cf01f0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:57.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.025+0000 7f5ce67fc640 1 --2- 172.21.15.103:0/1244198708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cf014aee0 0x7f5cf01f0370 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80012e0 tx=0x7f5ce8005b70 comp rx=0 tx=0).stop 2024-09-10T08:41:57.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.025+0000 7f5ce67fc640 1 -- 172.21.15.103:0/1244198708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cf014aee0 msgr2=0x7f5cf01f0370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:41:57.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.025+0000 7f5ce67fc640 1 --2- 172.21.15.103:0/1244198708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cf014aee0 0x7f5cf01f0370 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80012e0 tx=0x7f5ce8005b70 comp rx=0 tx=0).stop 2024-09-10T08:41:57.026 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:41:57.026 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:41:57.026 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:41:57.026 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:41:57.027 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 110, 2024-09-10T08:41:57.027 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 8926, 2024-09-10T08:41:57.027 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:41:57.027 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:41:57.027 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:41:57.027 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:41:57.027 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 4, 2024-09-10T08:41:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:41:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:41:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:41:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:41:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:41:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:41:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:41:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:41:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:41:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:41:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:41:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:41:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:41:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:41:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:41:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:41:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:41:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:41:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:41:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:41:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:41:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:41:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:41:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:41:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:41:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:41:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:41:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:41:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:41:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:41:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:41:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:41:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:41:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:41:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:41:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:41:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:41:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:41:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:41:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:41:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:41:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:41:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:41:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:41:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:41:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:41:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:41:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:41:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:41:57.037 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:41:57.037 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:41:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:41:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:41:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:41:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:41:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:41:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:41:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:41:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:41:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:41:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:41:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:41:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:41:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:41:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:41:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:41:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:41:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:41:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:41:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:41:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:41:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:41:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:41:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:41:57.040 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:41:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.028+0000 7f5cf6986640 1 -- 172.21.15.103:0/1244198708 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5cd406bf00 msgr2=0x7f5cd406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.028+0000 7f5cf6986640 1 --2- 172.21.15.103:0/1244198708 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5cd406bf00 0x7f5cd406e3c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00c3570 tx=0x7f5ce0009190 comp rx=0 tx=0).stop 2024-09-10T08:41:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.028+0000 7f5cf6185640 1 -- 172.21.15.103:0/1244198708 reap_dead start 2024-09-10T08:41:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.028+0000 7f5cf6986640 1 -- 172.21.15.103:0/1244198708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cf01508d0 msgr2=0x7f5cf00ad690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.028+0000 7f5cf6986640 1 --2- 172.21.15.103:0/1244198708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cf01508d0 0x7f5cf00ad690 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5cec031000 tx=0x7f5cec0046c0 comp rx=0 tx=0).stop 2024-09-10T08:41:57.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.028+0000 7f5cf6986640 1 -- 172.21.15.103:0/1244198708 shutdown_connections 2024-09-10T08:41:57.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.028+0000 7f5cf6986640 1 --2- 172.21.15.103:0/1244198708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cf01508d0 0x7f5cf00ad690 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:57.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.028+0000 7f5cf6986640 1 -- 172.21.15.103:0/1244198708 >> 172.21.15.103:0/1244198708 conn(0x7f5cf00aa700 msgr2=0x7f5cf01501a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:57.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.029+0000 7f5cf6986640 1 -- 172.21.15.103:0/1244198708 shutdown_connections 2024-09-10T08:41:57.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.029+0000 7f5cf6986640 1 -- 172.21.15.103:0/1244198708 wait complete. 2024-09-10T08:41:57.052 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:41:57.052 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-10T08:41:57.052 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-10T08:41:57.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.264+0000 7fecc9247640 1 Processor -- start 2024-09-10T08:41:57.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.265+0000 7fecc9247640 1 -- start start 2024-09-10T08:41:57.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.266+0000 7fecc9247640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fecc40a6c10 0x7fecc40c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:57.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.266+0000 7fecc9247640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc415a970 con 0x7fecc40c5940 2024-09-10T08:41:57.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.266+0000 7fecc9247640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc415ac50 con 0x7fecc40c6010 2024-09-10T08:41:57.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.266+0000 7fecc9247640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fecc415af30 con 0x7fecc40a6c10 2024-09-10T08:41:57.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.267+0000 7fecc359e640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fecc40c5940 0x7fecc406e1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:44554/0 (socket says 172.21.15.103:44554) 2024-09-10T08:41:57.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.267+0000 7fecc359e640 1 -- 172.21.15.103:0/3929361795 learned_addr learned my addr 172.21.15.103:0/3929361795 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:41:57.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.267+0000 7fecc1d9b640 1 -- 172.21.15.103:0/3929361795 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2921064737 0 0) 0x7fecc415a970 con 0x7fecc40c5940 2024-09-10T08:41:57.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.267+0000 7fecc1d9b640 1 -- 172.21.15.103:0/3929361795 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecac003520 con 0x7fecc40c5940 2024-09-10T08:41:57.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.268+0000 7fecc1d9b640 1 -- 172.21.15.103:0/3929361795 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1111182069 0 0) 0x7fecac003520 con 0x7fecc40c5940 2024-09-10T08:41:57.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.268+0000 7fecc1d9b640 1 -- 172.21.15.103:0/3929361795 >> v2:172.21.15.154:3300/0 conn(0x7fecc40a6c10 msgr2=0x7fecc40c2440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:41:57.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.268+0000 7fecc1d9b640 1 --2- 172.21.15.103:0/3929361795 >> v2:172.21.15.154:3300/0 conn(0x7fecc40a6c10 0x7fecc40c2440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:57.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.268+0000 7fecc1d9b640 1 -- 172.21.15.103:0/3929361795 >> v1:172.21.15.154:6789/0 conn(0x7fecc40c6010 legacy=0x7fecc406dab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:41:57.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.268+0000 7fecc1d9b640 1 -- 172.21.15.103:0/3929361795 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc415b210 con 0x7fecc40c5940 2024-09-10T08:41:57.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.268+0000 7fecc1d9b640 1 -- 172.21.15.103:0/3929361795 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7fecb8001650 con 0x7fecc40c5940 2024-09-10T08:41:57.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.268+0000 7fecc1d9b640 1 -- 172.21.15.103:0/3929361795 >> v1:172.21.15.103:6789/0 conn(0x7fecc40c5940 legacy=0x7fecc406e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:57.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.268+0000 7fecc1d9b640 1 --2- 172.21.15.103:0/3929361795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecac0039f0 0x7fecac003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:57.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.268+0000 7fecc1d9b640 1 --2- 172.21.15.103:0/3929361795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecac004800 0x7fecac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:57.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.268+0000 7fecc1d9b640 1 --2- 172.21.15.103:0/3929361795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecac0053f0 0x7fecac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:57.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.268+0000 7fecc1d9b640 1 -- 172.21.15.103:0/3929361795 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fecc415af30 con 0x7fecac004800 2024-09-10T08:41:57.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.268+0000 7fecc1d9b640 1 -- 172.21.15.103:0/3929361795 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fecac00c340 con 0x7fecac0053f0 2024-09-10T08:41:57.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.268+0000 7fecc1d9b640 1 -- 172.21.15.103:0/3929361795 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fecac00c540 con 0x7fecac0039f0 2024-09-10T08:41:57.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.268+0000 7fecc359e640 1 --2- 172.21.15.103:0/3929361795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecac0053f0 0x7fecac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:57.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.269+0000 7fecc359e640 1 -- 172.21.15.103:0/3929361795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecac0039f0 msgr2=0x7fecac003e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:41:57.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.269+0000 7fecc359e640 1 --2- 172.21.15.103:0/3929361795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecac0039f0 0x7fecac003e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:57.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.269+0000 7fecc259c640 1 --2- 172.21.15.103:0/3929361795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecac004800 0x7fecac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:57.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.269+0000 7fecc359e640 1 -- 172.21.15.103:0/3929361795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecac004800 msgr2=0x7fecac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:57.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.269+0000 7fecc359e640 1 --2- 172.21.15.103:0/3929361795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecac004800 0x7fecac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:57.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.269+0000 7fecc359e640 1 -- 172.21.15.103:0/3929361795 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc415b210 con 0x7fecac0053f0 2024-09-10T08:41:57.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.270+0000 7fecc259c640 1 --2- 172.21.15.103:0/3929361795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecac004800 0x7fecac004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:41:57.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.270+0000 7fecc359e640 1 -- 172.21.15.103:0/3929361795 reap_dead start 2024-09-10T08:41:57.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.273+0000 7fecc359e640 1 --2- 172.21.15.103:0/3929361795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecac0053f0 0x7fecac00ba60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fecc40c43f0 tx=0x7fecac005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86e5f1f6a94e7e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:57.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.275+0000 7fecc1d9b640 1 -- 172.21.15.103:0/3929361795 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb8036070 con 0x7fecac0053f0 2024-09-10T08:41:57.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.276+0000 7fecc1d9b640 1 -- 172.21.15.103:0/3929361795 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb8005ad0 con 0x7fecac0053f0 2024-09-10T08:41:57.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.276+0000 7fecc1d9b640 1 -- 172.21.15.103:0/3929361795 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb8036070 con 0x7fecac0053f0 2024-09-10T08:41:57.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.277+0000 7fecc9247640 1 -- 172.21.15.103:0/3929361795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecac0053f0 msgr2=0x7fecac00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:57.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.277+0000 7fecc9247640 1 --2- 172.21.15.103:0/3929361795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecac0053f0 0x7fecac00ba60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fecc40c43f0 tx=0x7fecac005830 comp rx=0 tx=0).stop 2024-09-10T08:41:57.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.279+0000 7fecc9247640 1 -- 172.21.15.103:0/3929361795 shutdown_connections 2024-09-10T08:41:57.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.279+0000 7fecc9247640 1 --2- 172.21.15.103:0/3929361795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecac0053f0 0x7fecac00ba60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:57.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.279+0000 7fecc9247640 1 -- 172.21.15.103:0/3929361795 >> 172.21.15.103:0/3929361795 conn(0x7fecc40c7a40 msgr2=0x7fecc40c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:57.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.280+0000 7fecc9247640 1 -- 172.21.15.103:0/3929361795 shutdown_connections 2024-09-10T08:41:57.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.280+0000 7fecc9247640 1 -- 172.21.15.103:0/3929361795 wait complete. 2024-09-10T08:41:57.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.282+0000 7fecc9247640 1 Processor -- start 2024-09-10T08:41:57.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.283+0000 7fecc9247640 1 -- start start 2024-09-10T08:41:57.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.284+0000 7fecc9247640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecac0053f0 0x7fecc415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:57.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.285+0000 7fecc9247640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecc415e4f0 0x7fecc41e6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:57.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.285+0000 7fecc9247640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecc414cbb0 0x7fecc414d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:57.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.285+0000 7fecc9247640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fecc40a7520 con 0x7fecac0053f0 2024-09-10T08:41:57.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.285+0000 7fecc259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecc415e4f0 0x7fecc41e6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:57.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.285+0000 7fecc259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecc415e4f0 0x7fecc41e6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:44250/0 (socket says 172.21.15.103:44250) 2024-09-10T08:41:57.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.285+0000 7fecc259c640 1 -- 172.21.15.103:0/1809452226 learned_addr learned my addr 172.21.15.103:0/1809452226 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:41:57.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.285+0000 7fecc9247640 1 -- 172.21.15.103:0/1809452226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fecc40a73a0 con 0x7fecc415e4f0 2024-09-10T08:41:57.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.285+0000 7fecc9247640 1 -- 172.21.15.103:0/1809452226 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fecc40c2440 con 0x7fecc414cbb0 2024-09-10T08:41:57.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.287+0000 7fecc2d9d640 1 --2- 172.21.15.103:0/1809452226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecac0053f0 0x7fecc415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:57.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.290+0000 7fecc359e640 1 --2- 172.21.15.103:0/1809452226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecc414cbb0 0x7fecc414d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:57.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.291+0000 7fecc259c640 1 -- 172.21.15.103:0/1809452226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecc414cbb0 msgr2=0x7fecc414d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:57.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.291+0000 7fecc259c640 1 --2- 172.21.15.103:0/1809452226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecc414cbb0 0x7fecc414d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:57.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.291+0000 7fecc259c640 1 -- 172.21.15.103:0/1809452226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecac0053f0 msgr2=0x7fecc415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:57.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.291+0000 7fecc259c640 1 --2- 172.21.15.103:0/1809452226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecac0053f0 0x7fecc415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:57.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.291+0000 7fecc259c640 1 -- 172.21.15.103:0/1809452226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc415ddb0 con 0x7fecc415e4f0 2024-09-10T08:41:57.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.291+0000 7fecc2d9d640 1 --2- 172.21.15.103:0/1809452226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecac0053f0 0x7fecc415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:57.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.291+0000 7fecc259c640 1 --2- 172.21.15.103:0/1809452226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecc415e4f0 0x7fecc41e6700 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00cde0 tx=0x7fecbc00a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:57.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.295+0000 7fecab7fe640 1 -- 172.21.15.103:0/1809452226 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc008040 con 0x7fecc415e4f0 2024-09-10T08:41:57.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.295+0000 7fecab7fe640 1 -- 172.21.15.103:0/1809452226 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecbc018400 con 0x7fecc415e4f0 2024-09-10T08:41:57.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.295+0000 7fecab7fe640 1 -- 172.21.15.103:0/1809452226 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc0187f0 con 0x7fecc415e4f0 2024-09-10T08:41:57.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.296+0000 7fecc9247640 1 -- 172.21.15.103:0/1809452226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc40a9600 con 0x7fecc415e4f0 2024-09-10T08:41:57.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.297+0000 7fecc9247640 1 -- 172.21.15.103:0/1809452226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc40a9bc0 con 0x7fecc415e4f0 2024-09-10T08:41:57.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.299+0000 7fecc9247640 1 -- 172.21.15.103:0/1809452226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecc40c27d0 con 0x7fecc415e4f0 2024-09-10T08:41:57.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.300+0000 7fecab7fe640 1 -- 172.21.15.103:0/1809452226 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fecbc00f400 con 0x7fecc415e4f0 2024-09-10T08:41:57.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.301+0000 7fecab7fe640 1 --2- 172.21.15.103:0/1809452226 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fecb006bf00 0x7fecb006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:57.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.301+0000 7fecab7fe640 1 -- 172.21.15.103:0/1809452226 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fecbc08b950 con 0x7fecc415e4f0 2024-09-10T08:41:57.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.304+0000 7fecc2d9d640 1 --2- 172.21.15.103:0/1809452226 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fecb006bf00 0x7fecb006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:57.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.305+0000 7fecc2d9d640 1 --2- 172.21.15.103:0/1809452226 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fecb006bf00 0x7fecb006e3c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fecc415d140 tx=0x7fecb4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:57.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.313+0000 7fecab7fe640 1 -- 172.21.15.103:0/1809452226 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fecbc014030 con 0x7fecc415e4f0 2024-09-10T08:41:57.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.815+0000 7fecc9247640 1 -- 172.21.15.103:0/1809452226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fecc41efdb0 con 0x7fecc415e4f0 2024-09-10T08:41:57.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.820+0000 7fecab7fe640 1 -- 172.21.15.103:0/1809452226 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fecc41efdb0 con 0x7fecc415e4f0 2024-09-10T08:41:57.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.824+0000 7fecc9247640 1 -- 172.21.15.103:0/1809452226 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fecb006bf00 msgr2=0x7fecb006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:57.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.824+0000 7fecc9247640 1 --2- 172.21.15.103:0/1809452226 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fecb006bf00 0x7fecb006e3c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fecc415d140 tx=0x7fecb4008040 comp rx=0 tx=0).stop 2024-09-10T08:41:57.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.824+0000 7fecc9247640 1 -- 172.21.15.103:0/1809452226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecc415e4f0 msgr2=0x7fecc41e6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:57.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.824+0000 7fecc9247640 1 --2- 172.21.15.103:0/1809452226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecc415e4f0 0x7fecc41e6700 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00cde0 tx=0x7fecbc00a5d0 comp rx=0 tx=0).stop 2024-09-10T08:41:57.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.824+0000 7fecc9247640 1 -- 172.21.15.103:0/1809452226 shutdown_connections 2024-09-10T08:41:57.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.824+0000 7fecc9247640 1 --2- 172.21.15.103:0/1809452226 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fecb006bf00 0x7fecb006e3c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:57.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.824+0000 7fecc9247640 1 --2- 172.21.15.103:0/1809452226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fecc414cbb0 0x7fecc414d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:57.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.824+0000 7fecc9247640 1 --2- 172.21.15.103:0/1809452226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecc415e4f0 0x7fecc41e6700 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:57.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.824+0000 7fecc9247640 1 --2- 172.21.15.103:0/1809452226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecac0053f0 0x7fecc415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:57.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.824+0000 7fecc9247640 1 -- 172.21.15.103:0/1809452226 >> 172.21.15.103:0/1809452226 conn(0x7fecc40c7a40 msgr2=0x7fecc40c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:57.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.824+0000 7fecc9247640 1 -- 172.21.15.103:0/1809452226 shutdown_connections 2024-09-10T08:41:57.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:41:57.824+0000 7fecc9247640 1 -- 172.21.15.103:0/1809452226 wait complete. 2024-09-10T08:41:57.858 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-10T08:42:03.632 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:42:03.636 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:42:07.859 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:42:07.859 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:42:08.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.044+0000 7f76e9b1f640 1 Processor -- start 2024-09-10T08:42:08.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.044+0000 7f76e9b1f640 1 -- start start 2024-09-10T08:42:08.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.047+0000 7f76e9b1f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f76e4068f80 0x7f76e40c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:08.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.047+0000 7f76e9b1f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76e406cb90 0x7f76e406d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:08.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.048+0000 7f76e9b1f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76e40ac480 con 0x7f76e414f630 2024-09-10T08:42:08.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.048+0000 7f76e9b1f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f76e40c3bb0 con 0x7f76e4068f80 2024-09-10T08:42:08.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.048+0000 7f76e9b1f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f76e40c3e90 con 0x7f76e406cb90 2024-09-10T08:42:08.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.048+0000 7f76e8b1d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f76e4068f80 0x7f76e40c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:08.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.048+0000 7f76e8b1d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f76e4068f80 0x7f76e40c28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:37990/0 (socket says 172.21.15.103:37990) 2024-09-10T08:42:08.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.048+0000 7f76e8b1d640 1 -- 172.21.15.103:0/1671105639 learned_addr learned my addr 172.21.15.103:0/1671105639 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:08.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.048+0000 7f76e931e640 1 --2- 172.21.15.103:0/1671105639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76e406cb90 0x7f76e406d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:08.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.049+0000 7f76e8b1d640 1 -- 172.21.15.103:0/1671105639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76e406cb90 msgr2=0x7f76e406d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:08.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.049+0000 7f76e8b1d640 1 --2- 172.21.15.103:0/1671105639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76e406cb90 0x7f76e406d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:08.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.049+0000 7f76e8b1d640 1 -- 172.21.15.103:0/1671105639 >> v1:172.21.15.154:6789/0 conn(0x7f76e414f630 legacy=0x7f76e4151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:08.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.049+0000 7f76e8b1d640 1 -- 172.21.15.103:0/1671105639 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e40c4170 con 0x7f76e4068f80 2024-09-10T08:42:08.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.050+0000 7f76e8b1d640 1 --2- 172.21.15.103:0/1671105639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76e4068f80 0x7f76e40c28c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009e50 tx=0x7f76dc02a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23ae7926186e1ee2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:08.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.050+0000 7f76e37fe640 1 -- 172.21.15.103:0/1671105639 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc036070 con 0x7f76e4068f80 2024-09-10T08:42:08.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.051+0000 7f76e37fe640 1 -- 172.21.15.103:0/1671105639 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76dc031600 con 0x7f76e4068f80 2024-09-10T08:42:08.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.051+0000 7f76e9b1f640 1 -- 172.21.15.103:0/1671105639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76e4068f80 msgr2=0x7f76e40c28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:08.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.051+0000 7f76e9b1f640 1 --2- 172.21.15.103:0/1671105639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76e4068f80 0x7f76e40c28c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009e50 tx=0x7f76dc02a710 comp rx=0 tx=0).stop 2024-09-10T08:42:08.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.052+0000 7f76e9b1f640 1 -- 172.21.15.103:0/1671105639 shutdown_connections 2024-09-10T08:42:08.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.052+0000 7f76e9b1f640 1 --2- 172.21.15.103:0/1671105639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76e406cb90 0x7f76e406d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:08.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.052+0000 7f76e9b1f640 1 --2- 172.21.15.103:0/1671105639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76e4068f80 0x7f76e40c28c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:08.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.052+0000 7f76e9b1f640 1 -- 172.21.15.103:0/1671105639 >> 172.21.15.103:0/1671105639 conn(0x7f76e406c210 msgr2=0x7f76e40c7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:08.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.052+0000 7f76e9b1f640 1 -- 172.21.15.103:0/1671105639 shutdown_connections 2024-09-10T08:42:08.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.054+0000 7f76e9b1f640 1 -- 172.21.15.103:0/1671105639 wait complete. 2024-09-10T08:42:08.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.056+0000 7f76e9b1f640 1 Processor -- start 2024-09-10T08:42:08.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.056+0000 7f76e9b1f640 1 -- start start 2024-09-10T08:42:08.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.059+0000 7f76e9b1f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76e4068f80 0x7f76e4073ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:08.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.059+0000 7f76e9b1f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76e406cb90 0x7f76e4141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:08.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.059+0000 7f76e9b1f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76e414f630 0x7f76e41418a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:08.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.059+0000 7f76e9b1f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f76e4152c10 con 0x7f76e414f630 2024-09-10T08:42:08.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.059+0000 7f76e9b1f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f76e40abe50 con 0x7f76e406cb90 2024-09-10T08:42:08.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.059+0000 7f76e9b1f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f76e4152d90 con 0x7f76e4068f80 2024-09-10T08:42:08.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.059+0000 7f76e3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76e406cb90 0x7f76e4141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:08.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.060+0000 7f76e8b1d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76e4068f80 0x7f76e4073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:08.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.060+0000 7f76e8b1d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76e4068f80 0x7f76e4073ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:33190/0 (socket says 172.21.15.103:33190) 2024-09-10T08:42:08.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.060+0000 7f76e8b1d640 1 -- 172.21.15.103:0/1050752218 learned_addr learned my addr 172.21.15.103:0/1050752218 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:08.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.060+0000 7f76e8b1d640 1 -- 172.21.15.103:0/1050752218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76e406cb90 msgr2=0x7f76e4141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:08.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.060+0000 7f76e8b1d640 1 --2- 172.21.15.103:0/1050752218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76e406cb90 0x7f76e4141360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:08.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.060+0000 7f76e8b1d640 1 -- 172.21.15.103:0/1050752218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76e414f630 msgr2=0x7f76e41418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:08.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.060+0000 7f76e8b1d640 1 --2- 172.21.15.103:0/1050752218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76e414f630 0x7f76e41418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:08.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.060+0000 7f76e8b1d640 1 -- 172.21.15.103:0/1050752218 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e4074180 con 0x7f76e4068f80 2024-09-10T08:42:08.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.061+0000 7f76e8b1d640 1 --2- 172.21.15.103:0/1050752218 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76e4068f80 0x7f76e4073ba0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009f70 tx=0x7f76dc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:08.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.064+0000 7f76e17fa640 1 -- 172.21.15.103:0/1050752218 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc041020 con 0x7f76e4068f80 2024-09-10T08:42:08.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.064+0000 7f76e17fa640 1 -- 172.21.15.103:0/1050752218 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76dc03c470 con 0x7f76e4068f80 2024-09-10T08:42:08.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.064+0000 7f76e17fa640 1 -- 172.21.15.103:0/1050752218 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc036040 con 0x7f76e4068f80 2024-09-10T08:42:08.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.072+0000 7f76e9b1f640 1 -- 172.21.15.103:0/1050752218 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76e4070ea0 con 0x7f76e4068f80 2024-09-10T08:42:08.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.072+0000 7f76e9b1f640 1 -- 172.21.15.103:0/1050752218 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f76e4163de0 con 0x7f76e4068f80 2024-09-10T08:42:08.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.074+0000 7f76e9b1f640 1 -- 172.21.15.103:0/1050752218 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76e4152780 con 0x7f76e4068f80 2024-09-10T08:42:08.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.077+0000 7f76e17fa640 1 -- 172.21.15.103:0/1050752218 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76dc044020 con 0x7f76e4068f80 2024-09-10T08:42:08.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.077+0000 7f76e17fa640 1 --2- 172.21.15.103:0/1050752218 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f76d006bf00 0x7f76d006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:08.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.078+0000 7f76e17fa640 1 -- 172.21.15.103:0/1050752218 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f76dc0ac770 con 0x7f76e4068f80 2024-09-10T08:42:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.081+0000 7f76e3fff640 1 --2- 172.21.15.103:0/1050752218 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f76d006bf00 0x7f76d006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:08.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.082+0000 7f76e3fff640 1 --2- 172.21.15.103:0/1050752218 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f76d006bf00 0x7f76d006e3c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f76e414e900 tx=0x7f76d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:08.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.085+0000 7f76e17fa640 1 -- 172.21.15.103:0/1050752218 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f76dc07adf0 con 0x7f76e4068f80 2024-09-10T08:42:08.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.583+0000 7f76e9b1f640 1 -- 172.21.15.103:0/1050752218 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f76e40c23d0 con 0x7f76e4068f80 2024-09-10T08:42:08.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.587+0000 7f76e17fa640 1 -- 172.21.15.103:0/1050752218 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1570 (secure 0 0 0) 0x7f76dc07a6f0 con 0x7f76e4068f80 2024-09-10T08:42:08.587 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":110,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:42:08.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.591+0000 7f76e9b1f640 1 -- 172.21.15.103:0/1050752218 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f76d006bf00 msgr2=0x7f76d006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:08.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.591+0000 7f76e9b1f640 1 --2- 172.21.15.103:0/1050752218 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f76d006bf00 0x7f76d006e3c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f76e414e900 tx=0x7f76d4009040 comp rx=0 tx=0).stop 2024-09-10T08:42:08.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.591+0000 7f76e9b1f640 1 -- 172.21.15.103:0/1050752218 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76e4068f80 msgr2=0x7f76e4073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:08.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.591+0000 7f76e9b1f640 1 --2- 172.21.15.103:0/1050752218 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76e4068f80 0x7f76e4073ba0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009f70 tx=0x7f76dc004a40 comp rx=0 tx=0).stop 2024-09-10T08:42:08.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.592+0000 7f76e9b1f640 1 -- 172.21.15.103:0/1050752218 shutdown_connections 2024-09-10T08:42:08.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.592+0000 7f76e9b1f640 1 --2- 172.21.15.103:0/1050752218 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f76d006bf00 0x7f76d006e3c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:08.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.592+0000 7f76e9b1f640 1 --2- 172.21.15.103:0/1050752218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76e414f630 0x7f76e41418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:08.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.592+0000 7f76e9b1f640 1 --2- 172.21.15.103:0/1050752218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76e406cb90 0x7f76e4141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:08.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.592+0000 7f76e9b1f640 1 --2- 172.21.15.103:0/1050752218 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76e4068f80 0x7f76e4073ba0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:08.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.592+0000 7f76e9b1f640 1 -- 172.21.15.103:0/1050752218 >> 172.21.15.103:0/1050752218 conn(0x7f76e406c210 msgr2=0x7f76e40c5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:08.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.592+0000 7f76e9b1f640 1 -- 172.21.15.103:0/1050752218 shutdown_connections 2024-09-10T08:42:08.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.592+0000 7f76e9b1f640 1 -- 172.21.15.103:0/1050752218 wait complete. 2024-09-10T08:42:08.610 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:42:08.610 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-10T08:42:08.610 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:42:08.611 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:42:08.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.806+0000 7fe861053640 1 Processor -- start 2024-09-10T08:42:08.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.806+0000 7fe861053640 1 -- start start 2024-09-10T08:42:08.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.807+0000 7fe861053640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe85c06f1d0 0x7fe85c0c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:08.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.807+0000 7fe861053640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe85c0c8530 0x7fe85c14fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:08.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.807+0000 7fe861053640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe85c0c5940 0x7fe85c0c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:08.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.807+0000 7fe861053640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fe85c0c72b0 con 0x7fe85c06f1d0 2024-09-10T08:42:08.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.807+0000 7fe861053640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe85c152580 con 0x7fe85c0c8530 2024-09-10T08:42:08.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.807+0000 7fe861053640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe85c14ff40 con 0x7fe85c0c5940 2024-09-10T08:42:08.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.808+0000 7fe85ad9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe85c06f1d0 0x7fe85c0c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:08.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.808+0000 7fe85ad9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe85c06f1d0 0x7fe85c0c2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53290/0 (socket says 172.21.15.103:53290) 2024-09-10T08:42:08.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.808+0000 7fe85ad9d640 1 -- 172.21.15.103:0/4068706940 learned_addr learned my addr 172.21.15.103:0/4068706940 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:08.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.808+0000 7fe85a59c640 1 --2- 172.21.15.103:0/4068706940 >> v2:172.21.15.154:3300/0 conn(0x7fe85c0c8530 0x7fe85c14fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:08.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.808+0000 7fe85b59e640 1 --2- 172.21.15.103:0/4068706940 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe85c0c5940 0x7fe85c0c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:08.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.808+0000 7fe85ad9d640 1 -- 172.21.15.103:0/4068706940 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe85c0c5940 msgr2=0x7fe85c0c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:08.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.808+0000 7fe85ad9d640 1 --2- 172.21.15.103:0/4068706940 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe85c0c5940 0x7fe85c0c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:08.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.808+0000 7fe85ad9d640 1 -- 172.21.15.103:0/4068706940 >> v2:172.21.15.154:3300/0 conn(0x7fe85c0c8530 msgr2=0x7fe85c14fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:08.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.808+0000 7fe85ad9d640 1 --2- 172.21.15.103:0/4068706940 >> v2:172.21.15.154:3300/0 conn(0x7fe85c0c8530 0x7fe85c14fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:08.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.808+0000 7fe85ad9d640 1 -- 172.21.15.103:0/4068706940 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85c0c7500 con 0x7fe85c06f1d0 2024-09-10T08:42:08.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.810+0000 7fe85ad9d640 1 --2- 172.21.15.103:0/4068706940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c06f1d0 0x7fe85c0c2e50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0aa8b0 tx=0x7fe85402a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621cbedd11fbefc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:08.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.810+0000 7fe85a59c640 1 --2- 172.21.15.103:0/4068706940 >> v2:172.21.15.154:3300/0 conn(0x7fe85c0c8530 0x7fe85c14fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:42:08.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.813+0000 7fe859d9b640 1 -- 172.21.15.103:0/4068706940 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe854037070 con 0x7fe85c06f1d0 2024-09-10T08:42:08.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.813+0000 7fe859d9b640 1 -- 172.21.15.103:0/4068706940 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe854032440 con 0x7fe85c06f1d0 2024-09-10T08:42:08.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.813+0000 7fe859d9b640 1 -- 172.21.15.103:0/4068706940 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8540327f0 con 0x7fe85c06f1d0 2024-09-10T08:42:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.817+0000 7fe861053640 1 -- 172.21.15.103:0/4068706940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c06f1d0 msgr2=0x7fe85c0c2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.817+0000 7fe861053640 1 --2- 172.21.15.103:0/4068706940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c06f1d0 0x7fe85c0c2e50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0aa8b0 tx=0x7fe85402a160 comp rx=0 tx=0).stop 2024-09-10T08:42:08.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.818+0000 7fe861053640 1 -- 172.21.15.103:0/4068706940 shutdown_connections 2024-09-10T08:42:08.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.818+0000 7fe861053640 1 --2- 172.21.15.103:0/4068706940 >> v2:172.21.15.154:3300/0 conn(0x7fe85c0c8530 0x7fe85c14fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:08.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.818+0000 7fe861053640 1 --2- 172.21.15.103:0/4068706940 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe85c0c5940 0x7fe85c0c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:08.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.818+0000 7fe861053640 1 --2- 172.21.15.103:0/4068706940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c06f1d0 0x7fe85c0c2e50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:08.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.818+0000 7fe861053640 1 -- 172.21.15.103:0/4068706940 >> 172.21.15.103:0/4068706940 conn(0x7fe85c0c7a40 msgr2=0x7fe85c0c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:08.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.818+0000 7fe861053640 1 -- 172.21.15.103:0/4068706940 shutdown_connections 2024-09-10T08:42:08.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.818+0000 7fe861053640 1 -- 172.21.15.103:0/4068706940 wait complete. 2024-09-10T08:42:08.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.820+0000 7fe861053640 1 Processor -- start 2024-09-10T08:42:08.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.820+0000 7fe861053640 1 -- start start 2024-09-10T08:42:08.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.821+0000 7fe861053640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c06f1d0 0x7fe85c14eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:08.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.821+0000 7fe861053640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe85c0c5940 0x7fe85c153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:08.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.821+0000 7fe861053640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe85c0c8530 0x7fe85c15f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:08.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.821+0000 7fe861053640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c0c2b10 con 0x7fe85c06f1d0 2024-09-10T08:42:08.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.821+0000 7fe861053640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c1565e0 con 0x7fe85c0c8530 2024-09-10T08:42:08.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.821+0000 7fe861053640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe85c0c4a10 con 0x7fe85c0c5940 2024-09-10T08:42:08.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.822+0000 7fe85a59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe85c0c5940 0x7fe85c153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:08.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.822+0000 7fe85b59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe85c0c8530 0x7fe85c15f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:08.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.822+0000 7fe85b59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe85c0c8530 0x7fe85c15f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:38026/0 (socket says 172.21.15.103:38026) 2024-09-10T08:42:08.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.822+0000 7fe85b59e640 1 -- 172.21.15.103:0/2729505727 learned_addr learned my addr 172.21.15.103:0/2729505727 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:08.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.822+0000 7fe85ad9d640 1 --2- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c06f1d0 0x7fe85c14eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:08.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.822+0000 7fe85ad9d640 1 -- 172.21.15.103:0/2729505727 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe85c0c5940 msgr2=0x7fe85c153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:08.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.822+0000 7fe85ad9d640 1 --2- 172.21.15.103:0/2729505727 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe85c0c5940 0x7fe85c153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:08.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.822+0000 7fe85ad9d640 1 -- 172.21.15.103:0/2729505727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe85c0c8530 msgr2=0x7fe85c15f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:08.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.822+0000 7fe85ad9d640 1 --2- 172.21.15.103:0/2729505727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe85c0c8530 0x7fe85c15f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:08.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.822+0000 7fe85ad9d640 1 -- 172.21.15.103:0/2729505727 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85c072310 con 0x7fe85c06f1d0 2024-09-10T08:42:08.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.823+0000 7fe85ad9d640 1 --2- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c06f1d0 0x7fe85c14eaa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe854031000 tx=0x7fe8540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:08.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.823+0000 7fe8537fe640 1 -- 172.21.15.103:0/2729505727 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe854037040 con 0x7fe85c06f1d0 2024-09-10T08:42:08.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.823+0000 7fe8537fe640 1 -- 172.21.15.103:0/2729505727 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe854042070 con 0x7fe85c06f1d0 2024-09-10T08:42:08.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.823+0000 7fe8537fe640 1 -- 172.21.15.103:0/2729505727 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8540327f0 con 0x7fe85c06f1d0 2024-09-10T08:42:08.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.823+0000 7fe861053640 1 -- 172.21.15.103:0/2729505727 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe85c1f3d40 con 0x7fe85c06f1d0 2024-09-10T08:42:08.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.823+0000 7fe861053640 1 -- 172.21.15.103:0/2729505727 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe85c1533f0 con 0x7fe85c06f1d0 2024-09-10T08:42:08.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.825+0000 7fe861053640 1 --2- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c070ba0 0x7fe85c0aae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:08.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.825+0000 7fe861053640 1 -- 172.21.15.103:0/2729505727 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c0720c0 con 0x7fe85c070ba0 2024-09-10T08:42:08.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.825+0000 7fe85a59c640 1 --2- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c070ba0 0x7fe85c0aae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:08.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.825+0000 7fe85a59c640 1 -- 172.21.15.103:0/2729505727 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe85c1f4260 con 0x7fe85c070ba0 2024-09-10T08:42:08.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.826+0000 7fe8537fe640 1 -- 172.21.15.103:0/2729505727 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe854032990 con 0x7fe85c06f1d0 2024-09-10T08:42:08.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.826+0000 7fe85a59c640 1 --2- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c070ba0 0x7fe85c0aae30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0ac970 tx=0x7fe844010c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:08.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.826+0000 7fe8537fe640 1 --2- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe83c06bf00 0x7fe83c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:08.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.826+0000 7fe8537fe640 1 -- 172.21.15.103:0/2729505727 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fe8540aba80 con 0x7fe85c06f1d0 2024-09-10T08:42:08.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.827+0000 7fe8537fe640 1 -- 172.21.15.103:0/2729505727 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe84400f040 con 0x7fe85c070ba0 2024-09-10T08:42:08.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.827+0000 7fe85b59e640 1 --2- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe83c06bf00 0x7fe83c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:08.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.827+0000 7fe8537fe640 1 -- 172.21.15.103:0/2729505727 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe844004220 con 0x7fe85c070ba0 2024-09-10T08:42:08.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.827+0000 7fe8537fe640 1 -- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c070ba0 msgr2=0x7fe85c0aae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:08.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.827+0000 7fe8537fe640 1 --2- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c070ba0 0x7fe85c0aae30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0ac970 tx=0x7fe844010c90 comp rx=0 tx=0).stop 2024-09-10T08:42:08.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.827+0000 7fe8537fe640 1 -- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c070ba0 msgr2=0x7fe85c0aae30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:42:08.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.827+0000 7fe8537fe640 1 --2- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c070ba0 0x7fe85c0aae30 secure :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0ac970 tx=0x7fe844010c90 comp rx=0 tx=0).stop 2024-09-10T08:42:08.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.829+0000 7fe85b59e640 1 --2- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe83c06bf00 0x7fe83c06e3c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0aca60 tx=0x7fe84c00d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:08.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.847+0000 7fe8517fa640 1 --2- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c070f80 0x7fe85c14da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:08.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.847+0000 7fe8517fa640 1 -- 172.21.15.103:0/2729505727 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c0c44d0 con 0x7fe85c070f80 2024-09-10T08:42:08.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.848+0000 7fe85a59c640 1 --2- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c070f80 0x7fe85c14da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:08.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.848+0000 7fe85a59c640 1 -- 172.21.15.103:0/2729505727 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe85c0ace20 con 0x7fe85c070f80 2024-09-10T08:42:08.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.849+0000 7fe85a59c640 1 --2- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c070f80 0x7fe85c14da00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0ac970 tx=0x7fe8440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:08.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.850+0000 7fe8537fe640 1 -- 172.21.15.103:0/2729505727 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe844003820 con 0x7fe85c070f80 2024-09-10T08:42:08.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.850+0000 7fe8537fe640 1 -- 172.21.15.103:0/2729505727 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5058 (secure 0 0 0) 0x7fe844003820 con 0x7fe85c070f80 2024-09-10T08:42:08.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.850+0000 7fe8537fe640 1 -- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c070f80 msgr2=0x7fe85c14da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:08.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.850+0000 7fe8537fe640 1 --2- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c070f80 0x7fe85c14da00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0ac970 tx=0x7fe8440046c0 comp rx=0 tx=0).stop 2024-09-10T08:42:08.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.850+0000 7fe8537fe640 1 -- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c070f80 msgr2=0x7fe85c14da00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:42:08.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.850+0000 7fe8537fe640 1 --2- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c070f80 0x7fe85c14da00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:08.850 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:42:08.851 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:42:08.851 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:42:08.851 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:42:08.851 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 110, 2024-09-10T08:42:08.851 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 155314, 2024-09-10T08:42:08.851 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:42:08.851 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:42:08.851 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:42:08.851 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:42:08.851 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:08.851 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 16, 2024-09-10T08:42:08.851 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:42:08.852 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:42:08.852 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:42:08.852 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:08.852 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:08.852 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:08.852 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:08.852 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:08.852 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:08.852 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:08.852 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:08.852 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:08.852 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:08.852 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:08.853 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:08.853 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:42:08.853 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:42:08.853 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:08.853 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:08.853 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:08.853 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:08.853 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:08.853 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:08.853 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:08.853 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:08.853 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:08.853 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:08.854 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:08.854 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:08.854 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:08.854 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:42:08.854 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:42:08.854 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:42:08.854 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:42:08.854 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:42:08.854 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:42:08.854 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:42:08.854 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:42:08.855 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:42:08.855 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:42:08.855 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:42:08.855 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:42:08.855 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:42:08.855 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:42:08.855 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:42:08.855 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:42:08.855 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:42:08.855 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:08.855 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:08.855 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:08.855 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:08.855 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:08.856 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:08.856 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:08.856 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:08.856 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:08.856 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:08.856 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:08.856 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:08.856 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:42:08.856 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:08.856 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:42:08.856 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:08.856 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:42:08.856 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:42:08.857 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:08.857 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:08.857 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:08.857 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:08.857 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:42:08.857 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:08.857 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:08.857 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:08.857 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:08.857 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:42:08.857 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:08.857 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:08.857 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:08.858 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:08.858 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:42:08.858 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:42:08.858 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:08.858 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:08.858 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:08.858 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:08.858 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:08.858 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:42:08.858 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:42:08.858 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:08.858 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:08.858 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:08.859 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:08.859 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:42:08.859 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:08.859 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:08.859 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:08.859 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:08.859 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:42:08.859 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:08.859 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:08.859 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:08.859 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:08.859 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:42:08.860 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:42:08.860 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:08.860 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:08.860 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:08.860 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:08.860 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:08.860 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:42:08.860 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:42:08.860 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:08.860 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:08.860 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:08.860 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:08.860 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:42:08.860 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:08.861 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:08.861 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:08.861 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:08.861 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:42:08.861 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:08.861 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:08.861 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:08.861 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:08.861 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:42:08.861 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:42:08.861 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:08.861 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:08.861 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:08.862 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:08.862 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:08.862 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:08.862 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:42:08.862 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:42:08.862 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:08.862 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:08.862 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:08.862 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:42:08.862 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:08.862 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:08.862 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:42:08.862 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:08.862 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:08.862 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:08.863 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:42:08.863 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:08.863 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:08.863 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:42:08.863 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:08.863 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:08.863 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:08.863 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:42:08.863 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:08.863 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:08.863 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:42:08.863 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:08.863 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:08.863 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:08.864 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:42:08.864 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:08.864 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:08.864 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:42:08.864 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:08.864 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:08.864 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:08.864 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:42:08.864 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:08.864 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:08.864 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:08.864 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:42:08.864 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:42:08.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.854+0000 7fe8517fa640 1 -- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe83c06bf00 msgr2=0x7fe83c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:08.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.854+0000 7fe8517fa640 1 --2- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe83c06bf00 0x7fe83c06e3c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0aca60 tx=0x7fe84c00d040 comp rx=0 tx=0).stop 2024-09-10T08:42:08.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.855+0000 7fe85b59e640 1 -- 172.21.15.103:0/2729505727 reap_dead start 2024-09-10T08:42:08.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.855+0000 7fe8517fa640 1 -- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c06f1d0 msgr2=0x7fe85c14eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:08.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.855+0000 7fe8517fa640 1 --2- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c06f1d0 0x7fe85c14eaa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe854031000 tx=0x7fe8540046c0 comp rx=0 tx=0).stop 2024-09-10T08:42:08.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.857+0000 7fe8517fa640 1 -- 172.21.15.103:0/2729505727 shutdown_connections 2024-09-10T08:42:08.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.857+0000 7fe8517fa640 1 --2- 172.21.15.103:0/2729505727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe85c06f1d0 0x7fe85c14eaa0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:08.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.857+0000 7fe8517fa640 1 -- 172.21.15.103:0/2729505727 >> 172.21.15.103:0/2729505727 conn(0x7fe85c0c7a40 msgr2=0x7fe85c0a75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:08.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.858+0000 7fe8517fa640 1 -- 172.21.15.103:0/2729505727 shutdown_connections 2024-09-10T08:42:08.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:08.860+0000 7fe8517fa640 1 -- 172.21.15.103:0/2729505727 wait complete. 2024-09-10T08:42:08.882 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:42:08.882 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:42:08.882 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:42:09.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.058+0000 7f903ae23640 1 Processor -- start 2024-09-10T08:42:09.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.058+0000 7f903ae23640 1 -- start start 2024-09-10T08:42:09.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.060+0000 7f903ae23640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f903406c650 0x7f90340c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:09.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.060+0000 7f903ae23640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f90340ca1c0 0x7f9034160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:09.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.060+0000 7f903ae23640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f903415a7c0 con 0x7f9034150480 2024-09-10T08:42:09.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.060+0000 7f903ae23640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f903406c240 con 0x7f90340ca1c0 2024-09-10T08:42:09.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.060+0000 7f903ae23640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f903415a330 con 0x7f903406c650 2024-09-10T08:42:09.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.060+0000 7f90393c0640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f90340ca1c0 0x7f9034160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:09.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.060+0000 7f90393c0640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f90340ca1c0 0x7f9034160bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53330/0 (socket says 172.21.15.103:53330) 2024-09-10T08:42:09.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.060+0000 7f90393c0640 1 -- 172.21.15.103:0/4189430931 learned_addr learned my addr 172.21.15.103:0/4189430931 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:09.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.060+0000 7f90393c0640 1 -- 172.21.15.103:0/4189430931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f903406c650 msgr2=0x7f90340c9c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T08:42:09.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.060+0000 7f90393c0640 1 --2- 172.21.15.103:0/4189430931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f903406c650 0x7f90340c9c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:09.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.060+0000 7f90393c0640 1 -- 172.21.15.103:0/4189430931 >> v1:172.21.15.103:6789/0 conn(0x7f9034150480 legacy=0x7f90340c7a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:42:09.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.060+0000 7f90393c0640 1 -- 172.21.15.103:0/4189430931 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9034159a00 con 0x7f90340ca1c0 2024-09-10T08:42:09.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.063+0000 7f90393c0640 1 --2- 172.21.15.103:0/4189430931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90340ca1c0 0x7f9034160bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f902c009e50 tx=0x7f902c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4074c74466a989 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:09.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.065+0000 7f90337fe640 1 -- 172.21.15.103:0/4189430931 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c036070 con 0x7f90340ca1c0 2024-09-10T08:42:09.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.065+0000 7f90337fe640 1 -- 172.21.15.103:0/4189430931 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f902c031600 con 0x7f90340ca1c0 2024-09-10T08:42:09.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.065+0000 7f90337fe640 1 -- 172.21.15.103:0/4189430931 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c0319d0 con 0x7f90340ca1c0 2024-09-10T08:42:09.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.066+0000 7f903ae23640 1 -- 172.21.15.103:0/4189430931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90340ca1c0 msgr2=0x7f9034160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:09.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.066+0000 7f903ae23640 1 --2- 172.21.15.103:0/4189430931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90340ca1c0 0x7f9034160bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f902c009e50 tx=0x7f902c02a6f0 comp rx=0 tx=0).stop 2024-09-10T08:42:09.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.066+0000 7f903ae23640 1 -- 172.21.15.103:0/4189430931 shutdown_connections 2024-09-10T08:42:09.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.066+0000 7f903ae23640 1 --2- 172.21.15.103:0/4189430931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90340ca1c0 0x7f9034160bf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:09.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.066+0000 7f903ae23640 1 --2- 172.21.15.103:0/4189430931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f903406c650 0x7f90340c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:09.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.066+0000 7f903ae23640 1 -- 172.21.15.103:0/4189430931 >> 172.21.15.103:0/4189430931 conn(0x7f9034068030 msgr2=0x7f9034073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:09.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.067+0000 7f903ae23640 1 -- 172.21.15.103:0/4189430931 shutdown_connections 2024-09-10T08:42:09.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.068+0000 7f903ae23640 1 -- 172.21.15.103:0/4189430931 wait complete. 2024-09-10T08:42:09.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.069+0000 7f903ae23640 1 Processor -- start 2024-09-10T08:42:09.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.069+0000 7f903ae23640 1 -- start start 2024-09-10T08:42:09.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.071+0000 7f903ae23640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f903406c650 0x7f9034158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:09.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.071+0000 7f903ae23640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90340ca1c0 0x7f90340aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:09.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.071+0000 7f903ae23640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9034150480 0x7f90340af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:09.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.071+0000 7f903ae23640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f90340ca670 con 0x7f9034150480 2024-09-10T08:42:09.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.071+0000 7f903ae23640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9034159fc0 con 0x7f90340ca1c0 2024-09-10T08:42:09.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.071+0000 7f903ae23640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f903406d270 con 0x7f903406c650 2024-09-10T08:42:09.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.071+0000 7f9033fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90340ca1c0 0x7f90340aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:09.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.071+0000 7f9033fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90340ca1c0 0x7f90340aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:38036/0 (socket says 172.21.15.103:38036) 2024-09-10T08:42:09.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.071+0000 7f9033fff640 1 -- 172.21.15.103:0/210481718 learned_addr learned my addr 172.21.15.103:0/210481718 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:09.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.071+0000 7f9038bbf640 1 --2- 172.21.15.103:0/210481718 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f903406c650 0x7f9034158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:09.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.071+0000 7f90393c0640 1 --2- 172.21.15.103:0/210481718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9034150480 0x7f90340af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:09.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.071+0000 7f9033fff640 1 -- 172.21.15.103:0/210481718 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f903406c650 msgr2=0x7f9034158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:09.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.071+0000 7f9033fff640 1 --2- 172.21.15.103:0/210481718 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f903406c650 0x7f9034158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:09.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.071+0000 7f9033fff640 1 -- 172.21.15.103:0/210481718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9034150480 msgr2=0x7f90340af4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:09.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.071+0000 7f9033fff640 1 --2- 172.21.15.103:0/210481718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9034150480 0x7f90340af4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:09.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.071+0000 7f9033fff640 1 -- 172.21.15.103:0/210481718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9034158890 con 0x7f90340ca1c0 2024-09-10T08:42:09.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.072+0000 7f90393c0640 1 --2- 172.21.15.103:0/210481718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9034150480 0x7f90340af4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:42:09.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.074+0000 7f9033fff640 1 --2- 172.21.15.103:0/210481718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90340ca1c0 0x7f90340aef70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f902800b3f0 tx=0x7f902800b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:09.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.074+0000 7f90317fa640 1 -- 172.21.15.103:0/210481718 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9028015020 con 0x7f90340ca1c0 2024-09-10T08:42:09.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.074+0000 7f903ae23640 1 -- 172.21.15.103:0/210481718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f903414e230 con 0x7f90340ca1c0 2024-09-10T08:42:09.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.074+0000 7f903ae23640 1 -- 172.21.15.103:0/210481718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90340ace70 con 0x7f90340ca1c0 2024-09-10T08:42:09.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.074+0000 7f90317fa640 1 -- 172.21.15.103:0/210481718 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9028011830 con 0x7f90340ca1c0 2024-09-10T08:42:09.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.074+0000 7f90317fa640 1 -- 172.21.15.103:0/210481718 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9028011c00 con 0x7f90340ca1c0 2024-09-10T08:42:09.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.078+0000 7f903ae23640 1 --2- 172.21.15.103:0/210481718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9014002a70 0x7f9014004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:09.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.078+0000 7f903ae23640 1 -- 172.21.15.103:0/210481718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9014007ec0 con 0x7f9014002a70 2024-09-10T08:42:09.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.079+0000 7f9038bbf640 1 --2- 172.21.15.103:0/210481718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9014002a70 0x7f9014004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:09.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.080+0000 7f9038bbf640 1 -- 172.21.15.103:0/210481718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f90140080c0 con 0x7f9014002a70 2024-09-10T08:42:09.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.080+0000 7f9038bbf640 1 --2- 172.21.15.103:0/210481718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9014002a70 0x7f9014004f30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9024006fd0 tx=0x7f902400ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:09.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.080+0000 7f90317fa640 1 -- 172.21.15.103:0/210481718 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9028018020 con 0x7f90340ca1c0 2024-09-10T08:42:09.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.081+0000 7f90317fa640 1 --2- 172.21.15.103:0/210481718 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f902006be30 0x7f902006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:09.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.081+0000 7f90317fa640 1 -- 172.21.15.103:0/210481718 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f902808afb0 con 0x7f90340ca1c0 2024-09-10T08:42:09.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.082+0000 7f90317fa640 1 -- 172.21.15.103:0/210481718 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9024017070 con 0x7f9014002a70 2024-09-10T08:42:09.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.082+0000 7f90317fa640 1 -- 172.21.15.103:0/210481718 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f902400c7a0 con 0x7f9014002a70 2024-09-10T08:42:09.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.082+0000 7f90317fa640 1 -- 172.21.15.103:0/210481718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9014002a70 msgr2=0x7f9014004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:09.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.082+0000 7f90317fa640 1 --2- 172.21.15.103:0/210481718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9014002a70 0x7f9014004f30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9024006fd0 tx=0x7f902400ec00 comp rx=0 tx=0).stop 2024-09-10T08:42:09.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.082+0000 7f90317fa640 1 -- 172.21.15.103:0/210481718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9014002a70 msgr2=0x7f9014004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:42:09.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.082+0000 7f90317fa640 1 --2- 172.21.15.103:0/210481718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9014002a70 0x7f9014004f30 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9024006fd0 tx=0x7f902400ec00 comp rx=0 tx=0).stop 2024-09-10T08:42:09.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.086+0000 7f90393c0640 1 --2- 172.21.15.103:0/210481718 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f902006be30 0x7f902006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:09.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.087+0000 7f90393c0640 1 --2- 172.21.15.103:0/210481718 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f902006be30 0x7f902006e2f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f902c033000 tx=0x7f902c009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:09.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.104+0000 7f903ae23640 1 --2- 172.21.15.103:0/210481718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9014006f00 0x7f9014007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:09.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.104+0000 7f903ae23640 1 -- 172.21.15.103:0/210481718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f901400a4a0 con 0x7f9014006f00 2024-09-10T08:42:09.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.104+0000 7f9038bbf640 1 --2- 172.21.15.103:0/210481718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9014006f00 0x7f9014007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:09.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.112+0000 7f9038bbf640 1 -- 172.21.15.103:0/210481718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f90140078d0 con 0x7f9014006f00 2024-09-10T08:42:09.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.113+0000 7f9038bbf640 1 --2- 172.21.15.103:0/210481718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9014006f00 0x7f9014007390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9024019000 tx=0x7f9024004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:09.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.113+0000 7f90317fa640 1 -- 172.21.15.103:0/210481718 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9024017070 con 0x7f9014006f00 2024-09-10T08:42:09.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.114+0000 7f90317fa640 1 -- 172.21.15.103:0/210481718 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4888 (secure 0 0 0) 0x7f9024006310 con 0x7f9014006f00 2024-09-10T08:42:09.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.114+0000 7f90317fa640 1 -- 172.21.15.103:0/210481718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9014006f00 msgr2=0x7f9014007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:09.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.114+0000 7f90317fa640 1 --2- 172.21.15.103:0/210481718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9014006f00 0x7f9014007390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9024019000 tx=0x7f9024004770 comp rx=0 tx=0).stop 2024-09-10T08:42:09.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.114+0000 7f90317fa640 1 -- 172.21.15.103:0/210481718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9014006f00 msgr2=0x7f9014007390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:42:09.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.114+0000 7f90317fa640 1 --2- 172.21.15.103:0/210481718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9014006f00 0x7f9014007390 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9024019000 tx=0x7f9024004770 comp rx=0 tx=0).stop 2024-09-10T08:42:09.115 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:42:09.115 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:42:09.115 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:42:09.115 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:42:09.115 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 110, 2024-09-10T08:42:09.115 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 81321, 2024-09-10T08:42:09.115 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:42:09.115 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:42:09.116 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:42:09.116 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:42:09.116 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:09.116 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 16, 2024-09-10T08:42:09.116 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:42:09.116 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:42:09.116 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:42:09.116 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:09.116 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:09.116 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:09.116 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:09.116 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:09.116 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:09.117 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:09.117 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:09.117 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:09.117 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:09.117 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:09.117 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:09.117 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:42:09.117 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:42:09.117 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:09.117 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:09.117 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:09.117 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:09.117 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:09.117 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:09.118 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:09.118 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:09.118 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:09.118 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:09.118 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:09.118 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:09.118 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.118 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:42:09.118 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:42:09.118 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:42:09.118 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:42:09.118 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:42:09.118 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:42:09.118 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:42:09.119 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:42:09.119 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:42:09.119 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:42:09.119 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:42:09.119 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:42:09.119 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:42:09.119 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:42:09.119 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:42:09.119 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:42:09.119 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:42:09.119 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:09.119 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:09.119 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:09.119 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:09.120 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:09.120 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:09.120 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:09.120 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:09.120 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:09.120 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:09.120 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:09.120 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:09.120 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:42:09.120 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.120 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:42:09.120 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.120 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:42:09.121 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:42:09.121 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:09.121 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:09.121 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.121 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:09.121 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:42:09.121 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:09.121 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.121 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.121 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:09.121 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:42:09.121 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:09.121 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:09.121 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:09.122 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.122 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:42:09.122 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:42:09.122 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:09.122 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:09.122 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:09.122 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.122 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.122 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:42:09.122 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:42:09.122 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:09.122 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:09.122 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.122 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:09.123 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:42:09.123 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:09.123 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.123 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.123 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:09.123 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:42:09.123 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:09.123 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:09.123 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:09.123 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.123 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:42:09.123 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:42:09.123 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:09.123 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:09.124 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:09.124 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.124 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.124 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:42:09.124 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:42:09.124 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:09.124 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:09.124 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.124 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:09.124 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:42:09.124 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:09.124 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.124 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.124 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:09.125 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:42:09.125 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:09.125 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:09.125 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:09.125 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.125 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:42:09.125 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:42:09.125 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:09.125 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:09.125 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:09.125 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:09.125 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:09.125 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.126 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:42:09.126 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:42:09.126 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.126 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:09.126 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:09.126 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:42:09.126 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:09.126 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:09.126 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:42:09.126 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.126 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:09.126 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:09.126 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:42:09.126 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:09.127 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:09.127 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:42:09.127 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.127 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:09.127 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:09.127 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:42:09.127 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:09.127 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:09.127 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:42:09.127 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.127 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:09.127 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:09.127 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:42:09.127 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:09.127 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:09.128 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.128 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:42:09.128 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:42:09.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.116+0000 7f903ae23640 1 -- 172.21.15.103:0/210481718 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f902006be30 msgr2=0x7f902006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:09.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.116+0000 7f903ae23640 1 --2- 172.21.15.103:0/210481718 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f902006be30 0x7f902006e2f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f902c033000 tx=0x7f902c009000 comp rx=0 tx=0).stop 2024-09-10T08:42:09.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.116+0000 7f903ae23640 1 -- 172.21.15.103:0/210481718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90340ca1c0 msgr2=0x7f90340aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:09.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.116+0000 7f903ae23640 1 --2- 172.21.15.103:0/210481718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90340ca1c0 0x7f90340aef70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f902800b3f0 tx=0x7f902800b8b0 comp rx=0 tx=0).stop 2024-09-10T08:42:09.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.116+0000 7f90393c0640 1 -- 172.21.15.103:0/210481718 reap_dead start 2024-09-10T08:42:09.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.116+0000 7f90393c0640 1 -- 172.21.15.103:0/210481718 reap_dead start 2024-09-10T08:42:09.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.117+0000 7f903ae23640 1 -- 172.21.15.103:0/210481718 shutdown_connections 2024-09-10T08:42:09.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.117+0000 7f903ae23640 1 -- 172.21.15.103:0/210481718 >> 172.21.15.103:0/210481718 conn(0x7f9034068030 msgr2=0x7f9034154bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:09.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.118+0000 7f903ae23640 1 -- 172.21.15.103:0/210481718 shutdown_connections 2024-09-10T08:42:09.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.118+0000 7f903ae23640 1 -- 172.21.15.103:0/210481718 wait complete. 2024-09-10T08:42:09.135 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:42:09.136 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:42:09.136 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:42:09.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.329+0000 7f00a27d6640 1 Processor -- start 2024-09-10T08:42:09.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.329+0000 7f00a27d6640 1 -- start start 2024-09-10T08:42:09.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.331+0000 7f00a27d6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f009c0c7230 0x7f009c1562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:09.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.331+0000 7f00a27d6640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f009c0c53f0 con 0x7f009c14fc00 2024-09-10T08:42:09.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.331+0000 7f00a27d6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f009c0c2d60 con 0x7f009c14f820 2024-09-10T08:42:09.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.331+0000 7f00a27d6640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f009c1532d0 con 0x7f009c0c7230 2024-09-10T08:42:09.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.331+0000 7f009b7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f009c0c7230 0x7f009c1562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:09.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.331+0000 7f009bfff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f009c14f820 0x7f009c152bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:39264/0 (socket says 172.21.15.103:39264) 2024-09-10T08:42:09.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.331+0000 7f009bfff640 1 -- 172.21.15.103:0/2532394561 learned_addr learned my addr 172.21.15.103:0/2532394561 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:42:09.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.331+0000 7f00a0d73640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f009c14fc00 0x7f009c0c41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:52130/0 (socket says 172.21.15.103:52130) 2024-09-10T08:42:09.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.332+0000 7f009b7fe640 1 -- 172.21.15.103:0/2532394561 >> v1:172.21.15.154:6789/0 conn(0x7f009c14f820 legacy=0x7f009c152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:09.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.332+0000 7f009b7fe640 1 -- 172.21.15.103:0/2532394561 >> v1:172.21.15.103:6789/0 conn(0x7f009c14fc00 legacy=0x7f009c0c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:09.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.332+0000 7f009b7fe640 1 -- 172.21.15.103:0/2532394561 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009c0c3040 con 0x7f009c0c7230 2024-09-10T08:42:09.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.334+0000 7f009b7fe640 1 --2- 172.21.15.103:0/2532394561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c0c7230 0x7f009c1562d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f008c009d90 tx=0x7f008c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5378a68b5e1ae30b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:09.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.334+0000 7f009affd640 1 -- 172.21.15.103:0/2532394561 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c031600 con 0x7f009c0c7230 2024-09-10T08:42:09.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.334+0000 7f009affd640 1 -- 172.21.15.103:0/2532394561 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f008c0317a0 con 0x7f009c0c7230 2024-09-10T08:42:09.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.335+0000 7f00a27d6640 1 -- 172.21.15.103:0/2532394561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c0c7230 msgr2=0x7f009c1562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:09.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.335+0000 7f009affd640 1 -- 172.21.15.103:0/2532394561 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c031600 con 0x7f009c0c7230 2024-09-10T08:42:09.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.335+0000 7f00a27d6640 1 --2- 172.21.15.103:0/2532394561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c0c7230 0x7f009c1562d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f008c009d90 tx=0x7f008c02a5d0 comp rx=0 tx=0).stop 2024-09-10T08:42:09.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.335+0000 7f00a27d6640 1 -- 172.21.15.103:0/2532394561 shutdown_connections 2024-09-10T08:42:09.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.335+0000 7f00a27d6640 1 --2- 172.21.15.103:0/2532394561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c0c7230 0x7f009c1562d0 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f008c009d90 tx=0x7f008c02a5d0 comp rx=0 tx=0).stop 2024-09-10T08:42:09.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.335+0000 7f00a27d6640 1 -- 172.21.15.103:0/2532394561 >> 172.21.15.103:0/2532394561 conn(0x7f009c0c7a40 msgr2=0x7f009c0c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:09.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.337+0000 7f00a27d6640 1 -- 172.21.15.103:0/2532394561 shutdown_connections 2024-09-10T08:42:09.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.337+0000 7f00a27d6640 1 -- 172.21.15.103:0/2532394561 wait complete. 2024-09-10T08:42:09.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.338+0000 7f00a27d6640 1 Processor -- start 2024-09-10T08:42:09.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.339+0000 7f00a27d6640 1 -- start start 2024-09-10T08:42:09.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.340+0000 7f00a27d6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c14f820 0x7f009c073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:09.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.340+0000 7f00a27d6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f009c14fc00 0x7f009c0a9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:09.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.340+0000 7f00a27d6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f009c071640 0x7f009c0722c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:09.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.340+0000 7f00a27d6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f009c152350 con 0x7f009c14f820 2024-09-10T08:42:09.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.340+0000 7f009b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f009c14fc00 0x7f009c0a9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:09.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.340+0000 7f009b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f009c14fc00 0x7f009c0a9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:38068/0 (socket says 172.21.15.103:38068) 2024-09-10T08:42:09.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.340+0000 7f009b7fe640 1 -- 172.21.15.103:0/4080471199 learned_addr learned my addr 172.21.15.103:0/4080471199 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:09.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.340+0000 7f00a27d6640 1 -- 172.21.15.103:0/4080471199 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f009c150010 con 0x7f009c14fc00 2024-09-10T08:42:09.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.341+0000 7f00a27d6640 1 -- 172.21.15.103:0/4080471199 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f009c0c5bf0 con 0x7f009c071640 2024-09-10T08:42:09.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.341+0000 7f00a0d73640 1 --2- 172.21.15.103:0/4080471199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f009c071640 0x7f009c0722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:09.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.341+0000 7f009bfff640 1 --2- 172.21.15.103:0/4080471199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c14f820 0x7f009c073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:09.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.342+0000 7f00a0d73640 1 -- 172.21.15.103:0/4080471199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f009c14fc00 msgr2=0x7f009c0a9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:09.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.342+0000 7f00a0d73640 1 --2- 172.21.15.103:0/4080471199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f009c14fc00 0x7f009c0a9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:09.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.342+0000 7f00a0d73640 1 -- 172.21.15.103:0/4080471199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c14f820 msgr2=0x7f009c073220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:09.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.342+0000 7f00a0d73640 1 --2- 172.21.15.103:0/4080471199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c14f820 0x7f009c073220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:09.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.342+0000 7f00a0d73640 1 -- 172.21.15.103:0/4080471199 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009c072d90 con 0x7f009c071640 2024-09-10T08:42:09.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.342+0000 7f009bfff640 1 --2- 172.21.15.103:0/4080471199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c14f820 0x7f009c073220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:09.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.343+0000 7f00a0d73640 1 --2- 172.21.15.103:0/4080471199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f009c071640 0x7f009c0722c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f008400c3c0 tx=0x7f008400c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:09.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.343+0000 7f0098ff9640 1 -- 172.21.15.103:0/4080471199 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00840075a0 con 0x7f009c071640 2024-09-10T08:42:09.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.344+0000 7f0098ff9640 1 -- 172.21.15.103:0/4080471199 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00840047e0 con 0x7f009c071640 2024-09-10T08:42:09.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.344+0000 7f0098ff9640 1 -- 172.21.15.103:0/4080471199 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084004bd0 con 0x7f009c071640 2024-09-10T08:42:09.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.344+0000 7f00a27d6640 1 -- 172.21.15.103:0/4080471199 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f009c070ab0 con 0x7f009c071640 2024-09-10T08:42:09.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.344+0000 7f00a27d6640 1 -- 172.21.15.103:0/4080471199 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f009c1554a0 con 0x7f009c071640 2024-09-10T08:42:09.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.345+0000 7f00a27d6640 1 --2- 172.21.15.103:0/4080471199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0080002a70 0x7f0080004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:09.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.345+0000 7f00a27d6640 1 -- 172.21.15.103:0/4080471199 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0080007ec0 con 0x7f0080002a70 2024-09-10T08:42:09.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.345+0000 7f009bfff640 1 --2- 172.21.15.103:0/4080471199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0080002a70 0x7f0080004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:09.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.346+0000 7f009bfff640 1 -- 172.21.15.103:0/4080471199 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f00800080c0 con 0x7f0080002a70 2024-09-10T08:42:09.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.346+0000 7f009bfff640 1 --2- 172.21.15.103:0/4080471199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0080002a70 0x7f0080004f30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0094000f60 tx=0x7f009400eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:09.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.347+0000 7f0098ff9640 1 -- 172.21.15.103:0/4080471199 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00940058b0 con 0x7f0080002a70 2024-09-10T08:42:09.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.347+0000 7f0098ff9640 1 -- 172.21.15.103:0/4080471199 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0094018070 con 0x7f0080002a70 2024-09-10T08:42:09.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.347+0000 7f0098ff9640 1 -- 172.21.15.103:0/4080471199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0080002a70 msgr2=0x7f0080004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:09.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.347+0000 7f0098ff9640 1 --2- 172.21.15.103:0/4080471199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0080002a70 0x7f0080004f30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0094000f60 tx=0x7f009400eb90 comp rx=0 tx=0).stop 2024-09-10T08:42:09.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.347+0000 7f0098ff9640 1 -- 172.21.15.103:0/4080471199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0080002a70 msgr2=0x7f0080004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:42:09.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.347+0000 7f0098ff9640 1 --2- 172.21.15.103:0/4080471199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0080002a70 0x7f0080004f30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:09.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.348+0000 7f0098ff9640 1 -- 172.21.15.103:0/4080471199 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f008401a020 con 0x7f009c071640 2024-09-10T08:42:09.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.349+0000 7f0098ff9640 1 --2- 172.21.15.103:0/4080471199 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f007c06b8f0 0x7f007c06ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:09.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.349+0000 7f0098ff9640 1 -- 172.21.15.103:0/4080471199 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f008408a7e0 con 0x7f009c071640 2024-09-10T08:42:09.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.349+0000 7f009bfff640 1 --2- 172.21.15.103:0/4080471199 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f007c06b8f0 0x7f007c06ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:09.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.350+0000 7f009bfff640 1 --2- 172.21.15.103:0/4080471199 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f007c06b8f0 0x7f007c06ddb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0094009010 tx=0x7f0094007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:09.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.360+0000 7f00a27d6640 1 --2- 172.21.15.103:0/4080471199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0080006ee0 0x7f0080007350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:09.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.360+0000 7f00a27d6640 1 -- 172.21.15.103:0/4080471199 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f008000a4a0 con 0x7f0080006ee0 2024-09-10T08:42:09.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.360+0000 7f009b7fe640 1 --2- 172.21.15.103:0/4080471199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0080006ee0 0x7f0080007350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:09.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.362+0000 7f009b7fe640 1 -- 172.21.15.103:0/4080471199 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0080007890 con 0x7f0080006ee0 2024-09-10T08:42:09.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.362+0000 7f009b7fe640 1 --2- 172.21.15.103:0/4080471199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0080006ee0 0x7f0080007350 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f009c148e20 tx=0x7f008c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:09.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.362+0000 7f0098ff9640 1 -- 172.21.15.103:0/4080471199 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c003da0 con 0x7f0080006ee0 2024-09-10T08:42:09.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.363+0000 7f0098ff9640 1 -- 172.21.15.103:0/4080471199 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4554 (secure 0 0 0) 0x7f008c041070 con 0x7f0080006ee0 2024-09-10T08:42:09.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.363+0000 7f0098ff9640 1 -- 172.21.15.103:0/4080471199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0080006ee0 msgr2=0x7f0080007350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:09.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.363+0000 7f0098ff9640 1 --2- 172.21.15.103:0/4080471199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0080006ee0 0x7f0080007350 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f009c148e20 tx=0x7f008c004a40 comp rx=0 tx=0).stop 2024-09-10T08:42:09.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.363+0000 7f0098ff9640 1 -- 172.21.15.103:0/4080471199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0080006ee0 msgr2=0x7f0080007350 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:42:09.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.363+0000 7f0098ff9640 1 --2- 172.21.15.103:0/4080471199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0080006ee0 0x7f0080007350 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:09.364 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:42:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:42:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:42:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:42:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 110, 2024-09-10T08:42:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 21263, 2024-09-10T08:42:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:42:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:42:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:42:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:42:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 16, 2024-09-10T08:42:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:42:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:42:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:42:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:42:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:42:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:42:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:42:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:42:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:42:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:42:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:42:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:42:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:42:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:42:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:42:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:42:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:42:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:42:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:42:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:42:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:42:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:42:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:42:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:42:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:42:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:42:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:42:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.372 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:09.372 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:42:09.372 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:09.372 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:09.372 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:09.372 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.372 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:42:09.373 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:42:09.373 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:09.373 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:09.373 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:09.373 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.373 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.373 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:42:09.373 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:42:09.373 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:09.374 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:09.374 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.374 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:09.374 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:42:09.374 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:09.374 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.374 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.374 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:09.374 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:42:09.374 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:09.374 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:09.374 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:09.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.375 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:42:09.375 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:42:09.375 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:09.375 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:09.375 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:09.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.375 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.375 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:42:09.375 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:42:09.375 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:09.375 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:09.375 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.376 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:09.376 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:42:09.376 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:09.376 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.376 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.376 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:09.376 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:42:09.376 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:09.376 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:09.376 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:09.376 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.376 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:42:09.377 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:42:09.377 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:09.377 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:09.377 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:09.377 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:09.377 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:09.377 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.377 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:42:09.377 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:42:09.377 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.377 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:09.378 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:09.378 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:42:09.378 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:09.378 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:09.378 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:42:09.378 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:09.378 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:09.378 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:09.378 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:42:09.378 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:09.378 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:09.378 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:09.379 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:42:09.379 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:42:09.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.366+0000 7f00a27d6640 1 -- 172.21.15.103:0/4080471199 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f007c06b8f0 msgr2=0x7f007c06ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:09.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.366+0000 7f00a27d6640 1 --2- 172.21.15.103:0/4080471199 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f007c06b8f0 0x7f007c06ddb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0094009010 tx=0x7f0094007000 comp rx=0 tx=0).stop 2024-09-10T08:42:09.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.366+0000 7f00a27d6640 1 -- 172.21.15.103:0/4080471199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f009c071640 msgr2=0x7f009c0722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:09.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.366+0000 7f00a27d6640 1 --2- 172.21.15.103:0/4080471199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f009c071640 0x7f009c0722c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f008400c3c0 tx=0x7f008400c7c0 comp rx=0 tx=0).stop 2024-09-10T08:42:09.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.366+0000 7f00a0d73640 1 -- 172.21.15.103:0/4080471199 reap_dead start 2024-09-10T08:42:09.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.366+0000 7f00a0d73640 1 -- 172.21.15.103:0/4080471199 reap_dead start 2024-09-10T08:42:09.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.366+0000 7f00a27d6640 1 -- 172.21.15.103:0/4080471199 shutdown_connections 2024-09-10T08:42:09.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.366+0000 7f00a27d6640 1 -- 172.21.15.103:0/4080471199 >> 172.21.15.103:0/4080471199 conn(0x7f009c0c7a40 msgr2=0x7f009c0c41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:09.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.366+0000 7f00a27d6640 1 -- 172.21.15.103:0/4080471199 shutdown_connections 2024-09-10T08:42:09.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.366+0000 7f00a27d6640 1 -- 172.21.15.103:0/4080471199 wait complete. 2024-09-10T08:42:09.384 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:42:09.384 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-09-10T08:42:09.384 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-10T08:42:09.384 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-10T08:42:09.384 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-10T08:42:09.385 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T08:42:09.385 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:42:09.402 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T08:42:09.403 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-10T08:42:09.403 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:42:09.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.577+0000 7fc37cbf8640 1 Processor -- start 2024-09-10T08:42:09.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.577+0000 7fc37cbf8640 1 -- start start 2024-09-10T08:42:09.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.579+0000 7fc37cbf8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc3780acd50 0x7fc37815af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:09.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.579+0000 7fc37cbf8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc37815b470 0x7fc3780729c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:09.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.579+0000 7fc37cbf8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc378072f00 0x7fc3780c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:09.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.579+0000 7fc37cbf8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fc378072270 con 0x7fc37815b470 2024-09-10T08:42:09.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.579+0000 7fc37cbf8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc378074660 con 0x7fc3780acd50 2024-09-10T08:42:09.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.579+0000 7fc37cbf8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc3780748b0 con 0x7fc378072f00 2024-09-10T08:42:09.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.579+0000 7fc375d9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc37815b470 0x7fc3780729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:09.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.579+0000 7fc375d9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc37815b470 0x7fc3780729c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53428/0 (socket says 172.21.15.103:53428) 2024-09-10T08:42:09.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.579+0000 7fc375d9b640 1 -- 172.21.15.103:0/2039896101 learned_addr learned my addr 172.21.15.103:0/2039896101 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:09.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.580+0000 7fc375d9b640 1 -- 172.21.15.103:0/2039896101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc378072f00 msgr2=0x7fc3780c7a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T08:42:09.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.580+0000 7fc375d9b640 1 --2- 172.21.15.103:0/2039896101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc378072f00 0x7fc3780c7a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:09.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.580+0000 7fc375d9b640 1 -- 172.21.15.103:0/2039896101 >> v2:172.21.15.154:3300/0 conn(0x7fc3780acd50 msgr2=0x7fc37815af30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:42:09.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.580+0000 7fc375d9b640 1 --2- 172.21.15.103:0/2039896101 >> v2:172.21.15.154:3300/0 conn(0x7fc3780acd50 0x7fc37815af30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:09.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.580+0000 7fc375d9b640 1 -- 172.21.15.103:0/2039896101 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3780c63f0 con 0x7fc37815b470 2024-09-10T08:42:09.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.580+0000 7fc375d9b640 1 --2- 172.21.15.103:0/2039896101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc37815b470 0x7fc3780729c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc3780758b0 tx=0x7fc36802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89bd22019914f1c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:09.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.581+0000 7fc37559a640 1 -- 172.21.15.103:0/2039896101 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368037070 con 0x7fc37815b470 2024-09-10T08:42:09.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.581+0000 7fc37559a640 1 -- 172.21.15.103:0/2039896101 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc368032440 con 0x7fc37815b470 2024-09-10T08:42:09.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.581+0000 7fc37559a640 1 -- 172.21.15.103:0/2039896101 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368032810 con 0x7fc37815b470 2024-09-10T08:42:09.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.583+0000 7fc37cbf8640 1 -- 172.21.15.103:0/2039896101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc37815b470 msgr2=0x7fc3780729c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:09.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.583+0000 7fc37cbf8640 1 --2- 172.21.15.103:0/2039896101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc37815b470 0x7fc3780729c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc3780758b0 tx=0x7fc36802a180 comp rx=0 tx=0).stop 2024-09-10T08:42:09.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.584+0000 7fc37cbf8640 1 -- 172.21.15.103:0/2039896101 shutdown_connections 2024-09-10T08:42:09.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.584+0000 7fc37cbf8640 1 --2- 172.21.15.103:0/2039896101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc378072f00 0x7fc3780c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:09.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.584+0000 7fc37cbf8640 1 --2- 172.21.15.103:0/2039896101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc37815b470 0x7fc3780729c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:09.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.584+0000 7fc37cbf8640 1 --2- 172.21.15.103:0/2039896101 >> v2:172.21.15.154:3300/0 conn(0x7fc3780acd50 0x7fc37815af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:09.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.584+0000 7fc37cbf8640 1 -- 172.21.15.103:0/2039896101 >> 172.21.15.103:0/2039896101 conn(0x7fc3780c5660 msgr2=0x7fc3780c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:09.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.586+0000 7fc37cbf8640 1 -- 172.21.15.103:0/2039896101 shutdown_connections 2024-09-10T08:42:09.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.588+0000 7fc37cbf8640 1 -- 172.21.15.103:0/2039896101 wait complete. 2024-09-10T08:42:09.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.590+0000 7fc37cbf8640 1 Processor -- start 2024-09-10T08:42:09.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.590+0000 7fc37cbf8640 1 -- start start 2024-09-10T08:42:09.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.591+0000 7fc37cbf8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc378072f00 0x7fc378159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:09.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.591+0000 7fc37cbf8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc37815b470 0x7fc3781f1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:09.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.592+0000 7fc37cbf8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3781e4540 0x7fc3781f1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:09.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.592+0000 7fc37cbf8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc378071d40 con 0x7fc3781e4540 2024-09-10T08:42:09.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.592+0000 7fc37cbf8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc3780724a0 con 0x7fc37815b470 2024-09-10T08:42:09.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.592+0000 7fc37cbf8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc3780abc10 con 0x7fc378072f00 2024-09-10T08:42:09.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.592+0000 7fc375d9b640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc37815b470 msgr2=0x7fc3781f1800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:42:09.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.592+0000 7fc375d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc37815b470 0x7fc3781f1800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:42:09.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.592+0000 7fc37659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc378072f00 0x7fc378159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:09.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.592+0000 7fc37659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc378072f00 0x7fc378159510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:33304/0 (socket says 172.21.15.103:33304) 2024-09-10T08:42:09.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.592+0000 7fc37659c640 1 -- 172.21.15.103:0/2328825376 learned_addr learned my addr 172.21.15.103:0/2328825376 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:09.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.592+0000 7fc376d9d640 1 --2- 172.21.15.103:0/2328825376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3781e4540 0x7fc3781f1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:09.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.592+0000 7fc37659c640 1 -- 172.21.15.103:0/2328825376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc37815b470 msgr2=0x7fc3781f1800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:42:09.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.592+0000 7fc37659c640 1 --2- 172.21.15.103:0/2328825376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc37815b470 0x7fc3781f1800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:09.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.592+0000 7fc37659c640 1 -- 172.21.15.103:0/2328825376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3781e4540 msgr2=0x7fc3781f1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:09.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.592+0000 7fc37659c640 1 --2- 172.21.15.103:0/2328825376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3781e4540 0x7fc3781f1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:09.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.592+0000 7fc37659c640 1 -- 172.21.15.103:0/2328825376 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37815cfb0 con 0x7fc378072f00 2024-09-10T08:42:09.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.593+0000 7fc376d9d640 1 --2- 172.21.15.103:0/2328825376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3781e4540 0x7fc3781f1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:09.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.593+0000 7fc37659c640 1 --2- 172.21.15.103:0/2328825376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc378072f00 0x7fc378159510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00b410 tx=0x7fc36c00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:09.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.593+0000 7fc366ffd640 1 -- 172.21.15.103:0/2328825376 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c015020 con 0x7fc378072f00 2024-09-10T08:42:09.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.593+0000 7fc37cbf8640 1 -- 172.21.15.103:0/2328825376 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc37815c400 con 0x7fc378072f00 2024-09-10T08:42:09.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.593+0000 7fc37cbf8640 1 -- 172.21.15.103:0/2328825376 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc37815c9c0 con 0x7fc378072f00 2024-09-10T08:42:09.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.594+0000 7fc366ffd640 1 -- 172.21.15.103:0/2328825376 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc36c011830 con 0x7fc378072f00 2024-09-10T08:42:09.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.594+0000 7fc366ffd640 1 -- 172.21.15.103:0/2328825376 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c011c20 con 0x7fc378072f00 2024-09-10T08:42:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.596+0000 7fc366ffd640 1 -- 172.21.15.103:0/2328825376 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc36c018020 con 0x7fc378072f00 2024-09-10T08:42:09.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.598+0000 7fc37cbf8640 1 -- 172.21.15.103:0/2328825376 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc35c005290 con 0x7fc378072f00 2024-09-10T08:42:09.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.599+0000 7fc366ffd640 1 --2- 172.21.15.103:0/2328825376 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc35806bde0 0x7fc35806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:09.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.599+0000 7fc366ffd640 1 -- 172.21.15.103:0/2328825376 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fc36c08ad30 con 0x7fc378072f00 2024-09-10T08:42:09.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.600+0000 7fc375d9b640 1 --2- 172.21.15.103:0/2328825376 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc35806bde0 0x7fc35806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:09.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.601+0000 7fc375d9b640 1 --2- 172.21.15.103:0/2328825376 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc35806bde0 0x7fc35806e2a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc368034000 tx=0x7fc36802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:09.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:09.610+0000 7fc366ffd640 1 -- 172.21.15.103:0/2328825376 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc36c01f030 con 0x7fc378072f00 2024-09-10T08:42:10.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:10.093+0000 7fc37cbf8640 1 -- 172.21.15.103:0/2328825376 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc35c005580 con 0x7fc378072f00 2024-09-10T08:42:10.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:10.093+0000 7fc366ffd640 1 -- 172.21.15.103:0/2328825376 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1570 (secure 0 0 0) 0x7fc36c0172c0 con 0x7fc378072f00 2024-09-10T08:42:10.094 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":110,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:42:10.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:10.098+0000 7fc37cbf8640 1 -- 172.21.15.103:0/2328825376 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc35806bde0 msgr2=0x7fc35806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:10.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:10.098+0000 7fc37cbf8640 1 --2- 172.21.15.103:0/2328825376 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc35806bde0 0x7fc35806e2a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc368034000 tx=0x7fc36802e000 comp rx=0 tx=0).stop 2024-09-10T08:42:10.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:10.098+0000 7fc37cbf8640 1 -- 172.21.15.103:0/2328825376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc378072f00 msgr2=0x7fc378159510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:10.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:10.098+0000 7fc37cbf8640 1 --2- 172.21.15.103:0/2328825376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc378072f00 0x7fc378159510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00b410 tx=0x7fc36c00b8d0 comp rx=0 tx=0).stop 2024-09-10T08:42:10.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:10.098+0000 7fc37cbf8640 1 -- 172.21.15.103:0/2328825376 shutdown_connections 2024-09-10T08:42:10.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:10.098+0000 7fc37cbf8640 1 --2- 172.21.15.103:0/2328825376 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc35806bde0 0x7fc35806e2a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:10.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:10.098+0000 7fc37cbf8640 1 --2- 172.21.15.103:0/2328825376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3781e4540 0x7fc3781f1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:10.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:10.098+0000 7fc37cbf8640 1 --2- 172.21.15.103:0/2328825376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc37815b470 0x7fc3781f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:10.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:10.098+0000 7fc37cbf8640 1 --2- 172.21.15.103:0/2328825376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc378072f00 0x7fc378159510 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:10.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:10.098+0000 7fc37cbf8640 1 -- 172.21.15.103:0/2328825376 >> 172.21.15.103:0/2328825376 conn(0x7fc3780c5660 msgr2=0x7fc3780c4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:10.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:10.104+0000 7fc37cbf8640 1 -- 172.21.15.103:0/2328825376 shutdown_connections 2024-09-10T08:42:10.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:10.104+0000 7fc37cbf8640 1 -- 172.21.15.103:0/2328825376 wait complete. 2024-09-10T08:42:10.109 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-10T08:42:13.124 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:42:13.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.317+0000 7fae6f270640 1 Processor -- start 2024-09-10T08:42:13.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.317+0000 7fae6f270640 1 -- start start 2024-09-10T08:42:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.318+0000 7fae6f270640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fae6814ce30 0x7fae681536a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.318+0000 7fae6f270640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae68071a40 0x7fae680c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.318+0000 7fae6f270640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae680c3fe0 con 0x7fae68073f50 2024-09-10T08:42:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.318+0000 7fae6f270640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fae680c8bd0 con 0x7fae6814ce30 2024-09-10T08:42:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.318+0000 7fae6f270640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fae680c4530 con 0x7fae68071a40 2024-09-10T08:42:13.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.320+0000 7fae6ea6f640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7fae68071a40 msgr2=0x7fae680c2f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:42:13.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.320+0000 7fae6ea6f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae68071a40 0x7fae680c2f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:42:13.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.320+0000 7fae6e26e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fae6814ce30 0x7fae681536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:13.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.320+0000 7fae6da6d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fae68073f50 0x7fae6806de90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:52136/0 (socket says 172.21.15.103:52136) 2024-09-10T08:42:13.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.320+0000 7fae6da6d640 1 -- 172.21.15.103:0/1001363094 learned_addr learned my addr 172.21.15.103:0/1001363094 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:42:13.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.321+0000 7fae6e26e640 1 -- 172.21.15.103:0/1001363094 >> v2:172.21.15.154:3300/0 conn(0x7fae68071a40 msgr2=0x7fae680c2f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:42:13.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.321+0000 7fae6e26e640 1 --2- 172.21.15.103:0/1001363094 >> v2:172.21.15.154:3300/0 conn(0x7fae68071a40 0x7fae680c2f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.321+0000 7fae6e26e640 1 -- 172.21.15.103:0/1001363094 >> v1:172.21.15.103:6789/0 conn(0x7fae68073f50 legacy=0x7fae6806de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:13.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.321+0000 7fae6e26e640 1 -- 172.21.15.103:0/1001363094 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae68153be0 con 0x7fae6814ce30 2024-09-10T08:42:13.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.322+0000 7fae6e26e640 1 --2- 172.21.15.103:0/1001363094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae6814ce30 0x7fae681536a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fae68068aa0 tx=0x7fae6402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0dc21faa507b41a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:13.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.323+0000 7fae6d26c640 1 -- 172.21.15.103:0/1001363094 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2693170584 0 0) 0x7fae680c3fe0 con 0x7fae68073f50 2024-09-10T08:42:13.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.323+0000 7fae6d26c640 1 -- 172.21.15.103:0/1001363094 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae64037070 con 0x7fae6814ce30 2024-09-10T08:42:13.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.323+0000 7fae6d26c640 1 -- 172.21.15.103:0/1001363094 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae64032440 con 0x7fae6814ce30 2024-09-10T08:42:13.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.323+0000 7fae6d26c640 1 -- 172.21.15.103:0/1001363094 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae64032810 con 0x7fae6814ce30 2024-09-10T08:42:13.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.324+0000 7fae6f270640 1 -- 172.21.15.103:0/1001363094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae6814ce30 msgr2=0x7fae681536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:13.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.324+0000 7fae6f270640 1 --2- 172.21.15.103:0/1001363094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae6814ce30 0x7fae681536a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fae68068aa0 tx=0x7fae6402a1c0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.324+0000 7fae6f270640 1 -- 172.21.15.103:0/1001363094 shutdown_connections 2024-09-10T08:42:13.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.324+0000 7fae6f270640 1 --2- 172.21.15.103:0/1001363094 >> v2:172.21.15.154:3300/0 conn(0x7fae68071a40 0x7fae680c2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.324+0000 7fae6f270640 1 --2- 172.21.15.103:0/1001363094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae6814ce30 0x7fae681536a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.324+0000 7fae6f270640 1 -- 172.21.15.103:0/1001363094 >> 172.21.15.103:0/1001363094 conn(0x7fae6806c210 msgr2=0x7fae680c7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:13.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.324+0000 7fae6f270640 1 -- 172.21.15.103:0/1001363094 shutdown_connections 2024-09-10T08:42:13.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.324+0000 7fae6f270640 1 -- 172.21.15.103:0/1001363094 wait complete. 2024-09-10T08:42:13.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.326+0000 7fae6f270640 1 Processor -- start 2024-09-10T08:42:13.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.326+0000 7fae6f270640 1 -- start start 2024-09-10T08:42:13.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.327+0000 7fae6f270640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae68071a40 0x7fae6813a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:13.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.327+0000 7fae6f270640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae68073f50 0x7fae680c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:13.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.327+0000 7fae6f270640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae6814ce30 0x7fae681ddfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:13.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.327+0000 7fae6f270640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fae6806e5a0 con 0x7fae68073f50 2024-09-10T08:42:13.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.327+0000 7fae6f270640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fae680c2790 con 0x7fae6814ce30 2024-09-10T08:42:13.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.327+0000 7fae6f270640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fae6806e720 con 0x7fae68071a40 2024-09-10T08:42:13.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.328+0000 7fae6da6d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae68073f50 0x7fae680c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:13.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.328+0000 7fae6da6d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae68073f50 0x7fae680c5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53448/0 (socket says 172.21.15.103:53448) 2024-09-10T08:42:13.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.328+0000 7fae6da6d640 1 -- 172.21.15.103:0/3790039564 learned_addr learned my addr 172.21.15.103:0/3790039564 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:13.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.328+0000 7fae6e26e640 1 --2- 172.21.15.103:0/3790039564 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae68071a40 0x7fae6813a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:13.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.329+0000 7fae6e26e640 1 -- 172.21.15.103:0/3790039564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae6814ce30 msgr2=0x7fae681ddfb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:42:13.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.329+0000 7fae6e26e640 1 --2- 172.21.15.103:0/3790039564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae6814ce30 0x7fae681ddfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.329+0000 7fae6e26e640 1 -- 172.21.15.103:0/3790039564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae68073f50 msgr2=0x7fae680c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:13.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.333+0000 7fae6e26e640 1 --2- 172.21.15.103:0/3790039564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae68073f50 0x7fae680c5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.333+0000 7fae6e26e640 1 -- 172.21.15.103:0/3790039564 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae681455d0 con 0x7fae68071a40 2024-09-10T08:42:13.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.333+0000 7fae6da6d640 1 --2- 172.21.15.103:0/3790039564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae68073f50 0x7fae680c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:42:13.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.336+0000 7fae6e26e640 1 --2- 172.21.15.103:0/3790039564 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae68071a40 0x7fae6813a000 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fae64031000 tx=0x7fae640046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:13.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.336+0000 7fae5effd640 1 -- 172.21.15.103:0/3790039564 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae64037040 con 0x7fae68071a40 2024-09-10T08:42:13.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.337+0000 7fae5effd640 1 -- 172.21.15.103:0/3790039564 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae64030750 con 0x7fae68071a40 2024-09-10T08:42:13.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.337+0000 7fae5effd640 1 -- 172.21.15.103:0/3790039564 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae64030b20 con 0x7fae68071a40 2024-09-10T08:42:13.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.337+0000 7fae6f270640 1 -- 172.21.15.103:0/3790039564 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae681dc640 con 0x7fae68071a40 2024-09-10T08:42:13.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.338+0000 7fae6f270640 1 -- 172.21.15.103:0/3790039564 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fae68139800 con 0x7fae68071a40 2024-09-10T08:42:13.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.343+0000 7fae5effd640 1 -- 172.21.15.103:0/3790039564 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae64051060 con 0x7fae68071a40 2024-09-10T08:42:13.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.341+0000 7fae6f270640 1 -- 172.21.15.103:0/3790039564 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae681dcb60 con 0x7fae68071a40 2024-09-10T08:42:13.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.344+0000 7fae5effd640 1 --2- 172.21.15.103:0/3790039564 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae4c06be30 0x7fae4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:13.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.344+0000 7fae5effd640 1 -- 172.21.15.103:0/3790039564 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fae640b3a90 con 0x7fae68071a40 2024-09-10T08:42:13.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.344+0000 7fae6da6d640 1 --2- 172.21.15.103:0/3790039564 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae4c06be30 0x7fae4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:13.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.346+0000 7fae6da6d640 1 --2- 172.21.15.103:0/3790039564 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae4c06be30 0x7fae4c06e2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fae681420c0 tx=0x7fae58007240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:13.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.354+0000 7fae5effd640 1 -- 172.21.15.103:0/3790039564 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae64045070 con 0x7fae68071a40 2024-09-10T08:42:13.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.902+0000 7fae6f270640 1 -- 172.21.15.103:0/3790039564 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fae680c3fe0 con 0x7fae68071a40 2024-09-10T08:42:13.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.904+0000 7fae5effd640 1 -- 172.21.15.103:0/3790039564 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1570 (secure 0 0 0) 0x7fae64082090 con 0x7fae68071a40 2024-09-10T08:42:13.913 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":110,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:42:13.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.919+0000 7fae6f270640 1 -- 172.21.15.103:0/3790039564 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae4c06be30 msgr2=0x7fae4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:13.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.919+0000 7fae6f270640 1 --2- 172.21.15.103:0/3790039564 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae4c06be30 0x7fae4c06e2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fae681420c0 tx=0x7fae58007240 comp rx=0 tx=0).stop 2024-09-10T08:42:13.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.919+0000 7fae6f270640 1 -- 172.21.15.103:0/3790039564 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae68071a40 msgr2=0x7fae6813a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:13.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.919+0000 7fae6f270640 1 --2- 172.21.15.103:0/3790039564 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae68071a40 0x7fae6813a000 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fae64031000 tx=0x7fae640046c0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.919+0000 7fae6f270640 1 -- 172.21.15.103:0/3790039564 shutdown_connections 2024-09-10T08:42:13.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.919+0000 7fae6f270640 1 --2- 172.21.15.103:0/3790039564 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fae4c06be30 0x7fae4c06e2f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.919+0000 7fae6f270640 1 --2- 172.21.15.103:0/3790039564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae6814ce30 0x7fae681ddfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.919+0000 7fae6f270640 1 --2- 172.21.15.103:0/3790039564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae68073f50 0x7fae680c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.919+0000 7fae6f270640 1 --2- 172.21.15.103:0/3790039564 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae68071a40 0x7fae6813a000 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fae64031000 tx=0x7fae640046c0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.919+0000 7fae6f270640 1 -- 172.21.15.103:0/3790039564 >> 172.21.15.103:0/3790039564 conn(0x7fae6806c210 msgr2=0x7fae680ab460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:13.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.921+0000 7fae6f270640 1 -- 172.21.15.103:0/3790039564 shutdown_connections 2024-09-10T08:42:13.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:13.921+0000 7fae6f270640 1 -- 172.21.15.103:0/3790039564 wait complete. 2024-09-10T08:42:16.722 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-10T08:42:16.946 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:42:17.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.144+0000 7f7016819640 1 Processor -- start 2024-09-10T08:42:17.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.144+0000 7f7016819640 1 -- start start 2024-09-10T08:42:17.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.146+0000 7f7016819640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7010068f80 0x7f701006cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:17.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.146+0000 7f7016819640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f701006d0d0 0x7f7010151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:17.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.146+0000 7f7016819640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f701014fc80 con 0x7f701014f8a0 2024-09-10T08:42:17.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.146+0000 7f7016819640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f70100ac1a0 con 0x7f701006d0d0 2024-09-10T08:42:17.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.146+0000 7f7016819640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f70100ac480 con 0x7f7010068f80 2024-09-10T08:42:17.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.146+0000 7f7015817640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f701014f8a0 legacy=0x7f70100c28c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:42:17.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.146+0000 7f7016018640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7f701006d0d0 msgr2=0x7f7010151fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:42:17.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.146+0000 7f7016018640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f701006d0d0 0x7f7010151fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:42:17.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.146+0000 7f7015016640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7010068f80 0x7f701006cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:17.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.146+0000 7f7015016640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7010068f80 0x7f701006cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:51324/0 (socket says 172.21.15.103:51324) 2024-09-10T08:42:17.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.146+0000 7f7015016640 1 -- 172.21.15.103:0/4258051719 learned_addr learned my addr 172.21.15.103:0/4258051719 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:17.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.147+0000 7f7015016640 1 -- 172.21.15.103:0/4258051719 >> v2:172.21.15.154:3300/0 conn(0x7f701006d0d0 msgr2=0x7f7010151fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:42:17.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.147+0000 7f7015016640 1 --2- 172.21.15.103:0/4258051719 >> v2:172.21.15.154:3300/0 conn(0x7f701006d0d0 0x7f7010151fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:17.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.147+0000 7f7015016640 1 -- 172.21.15.103:0/4258051719 >> v1:172.21.15.154:6789/0 conn(0x7f701014f8a0 legacy=0x7f70100c28c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:42:17.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.147+0000 7f7015016640 1 -- 172.21.15.103:0/4258051719 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70100c3bb0 con 0x7f7010068f80 2024-09-10T08:42:17.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.148+0000 7f7015016640 1 --2- 172.21.15.103:0/4258051719 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7010068f80 0x7f701006cb90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7004009e50 tx=0x7f700402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f235b8e18126a044 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:17.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.150+0000 7f7014815640 1 -- 172.21.15.103:0/4258051719 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7004036070 con 0x7f7010068f80 2024-09-10T08:42:17.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.150+0000 7f7014815640 1 -- 172.21.15.103:0/4258051719 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7004031600 con 0x7f7010068f80 2024-09-10T08:42:17.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.150+0000 7f7014815640 1 -- 172.21.15.103:0/4258051719 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70040319d0 con 0x7f7010068f80 2024-09-10T08:42:17.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.151+0000 7f7016819640 1 -- 172.21.15.103:0/4258051719 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7010068f80 msgr2=0x7f701006cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:17.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.151+0000 7f7016819640 1 --2- 172.21.15.103:0/4258051719 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7010068f80 0x7f701006cb90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7004009e50 tx=0x7f700402a660 comp rx=0 tx=0).stop 2024-09-10T08:42:17.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.151+0000 7f7016819640 1 -- 172.21.15.103:0/4258051719 shutdown_connections 2024-09-10T08:42:17.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.151+0000 7f7016819640 1 --2- 172.21.15.103:0/4258051719 >> v2:172.21.15.154:3300/0 conn(0x7f701006d0d0 0x7f7010151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:17.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.151+0000 7f7016819640 1 --2- 172.21.15.103:0/4258051719 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7010068f80 0x7f701006cb90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:17.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.151+0000 7f7016819640 1 -- 172.21.15.103:0/4258051719 >> 172.21.15.103:0/4258051719 conn(0x7f701006c210 msgr2=0x7f70100c7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:17.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.151+0000 7f7016819640 1 -- 172.21.15.103:0/4258051719 shutdown_connections 2024-09-10T08:42:17.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.151+0000 7f7016819640 1 -- 172.21.15.103:0/4258051719 wait complete. 2024-09-10T08:42:17.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.153+0000 7f7016819640 1 Processor -- start 2024-09-10T08:42:17.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.153+0000 7f7016819640 1 -- start start 2024-09-10T08:42:17.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.154+0000 7f7016819640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7010068f80 0x7f7010070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:17.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.154+0000 7f7016819640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f701006d0d0 0x7f70101f8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:17.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.154+0000 7f7016819640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f701014f8a0 0x7f70101f9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:17.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.154+0000 7f7016819640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f70100abe50 con 0x7f7010068f80 2024-09-10T08:42:17.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.154+0000 7f7016819640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70100c4170 con 0x7f701014f8a0 2024-09-10T08:42:17.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.154+0000 7f7016819640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7010152c10 con 0x7f701006d0d0 2024-09-10T08:42:17.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.155+0000 7f7016018640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f701014f8a0 msgr2=0x7f70101f9180 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:42:17.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.155+0000 7f7016018640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f701014f8a0 0x7f70101f9180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:42:17.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.155+0000 7f7015016640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f701006d0d0 0x7f70101f8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:17.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.155+0000 7f7015016640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f701006d0d0 0x7f70101f8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:51340/0 (socket says 172.21.15.103:51340) 2024-09-10T08:42:17.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.155+0000 7f7015016640 1 -- 172.21.15.103:0/3702326779 learned_addr learned my addr 172.21.15.103:0/3702326779 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:17.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.155+0000 7f7015817640 1 --2- 172.21.15.103:0/3702326779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7010068f80 0x7f7010070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:17.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.156+0000 7f7015817640 1 -- 172.21.15.103:0/3702326779 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f701006d0d0 msgr2=0x7f70101f8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:17.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.156+0000 7f7015817640 1 --2- 172.21.15.103:0/3702326779 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f701006d0d0 0x7f70101f8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:17.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.156+0000 7f7015817640 1 -- 172.21.15.103:0/3702326779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f701014f8a0 msgr2=0x7f70101f9180 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:42:17.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.156+0000 7f7015817640 1 --2- 172.21.15.103:0/3702326779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f701014f8a0 0x7f70101f9180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:17.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.156+0000 7f7015817640 1 -- 172.21.15.103:0/3702326779 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7010156170 con 0x7f7010068f80 2024-09-10T08:42:17.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.157+0000 7f7015817640 1 --2- 172.21.15.103:0/3702326779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7010068f80 0x7f7010070fe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc003930 tx=0x7f6ffc00b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:17.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.161+0000 7f700e7fc640 1 -- 172.21.15.103:0/3702326779 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc003dc0 con 0x7f7010068f80 2024-09-10T08:42:17.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.161+0000 7f700e7fc640 1 -- 172.21.15.103:0/3702326779 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ffc015070 con 0x7f7010068f80 2024-09-10T08:42:17.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.161+0000 7f700e7fc640 1 -- 172.21.15.103:0/3702326779 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc005290 con 0x7f7010068f80 2024-09-10T08:42:17.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.161+0000 7f7016819640 1 -- 172.21.15.103:0/3702326779 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7010073770 con 0x7f7010068f80 2024-09-10T08:42:17.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.161+0000 7f7016819640 1 -- 172.21.15.103:0/3702326779 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7010073d30 con 0x7f7010068f80 2024-09-10T08:42:17.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.164+0000 7f7016819640 1 -- 172.21.15.103:0/3702326779 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7010073f30 con 0x7f7010068f80 2024-09-10T08:42:17.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.166+0000 7f700e7fc640 1 -- 172.21.15.103:0/3702326779 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ffc00f070 con 0x7f7010068f80 2024-09-10T08:42:17.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.170+0000 7f700e7fc640 1 --2- 172.21.15.103:0/3702326779 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6ff406bde0 0x7f6ff406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:17.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.170+0000 7f700e7fc640 1 -- 172.21.15.103:0/3702326779 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f6ffc08a910 con 0x7f7010068f80 2024-09-10T08:42:17.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.171+0000 7f7015016640 1 --2- 172.21.15.103:0/3702326779 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6ff406bde0 0x7f6ff406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:17.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.172+0000 7f7015016640 1 --2- 172.21.15.103:0/3702326779 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6ff406bde0 0x7f6ff406e2a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f700402a6a0 tx=0x7f7004009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:17.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.175+0000 7f700e7fc640 1 -- 172.21.15.103:0/3702326779 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7010073f30 con 0x7f7010068f80 2024-09-10T08:42:17.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.745+0000 7f7016819640 1 -- 172.21.15.103:0/3702326779 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f701006d580 con 0x7f7010068f80 2024-09-10T08:42:17.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.746+0000 7f700e7fc640 1 -- 172.21.15.103:0/3702326779 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1570 (secure 0 0 0) 0x7f6ffc00d040 con 0x7f7010068f80 2024-09-10T08:42:17.746 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":110,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:42:17.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.752+0000 7f6ff3fff640 1 -- 172.21.15.103:0/3702326779 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6ff406bde0 msgr2=0x7f6ff406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:17.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.752+0000 7f6ff3fff640 1 --2- 172.21.15.103:0/3702326779 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6ff406bde0 0x7f6ff406e2a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f700402a6a0 tx=0x7f7004009000 comp rx=0 tx=0).stop 2024-09-10T08:42:17.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.752+0000 7f6ff3fff640 1 -- 172.21.15.103:0/3702326779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7010068f80 msgr2=0x7f7010070fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:17.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.752+0000 7f6ff3fff640 1 --2- 172.21.15.103:0/3702326779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7010068f80 0x7f7010070fe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc003930 tx=0x7f6ffc00b9b0 comp rx=0 tx=0).stop 2024-09-10T08:42:17.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.752+0000 7f6ff3fff640 1 -- 172.21.15.103:0/3702326779 shutdown_connections 2024-09-10T08:42:17.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.752+0000 7f6ff3fff640 1 --2- 172.21.15.103:0/3702326779 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6ff406bde0 0x7f6ff406e2a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:17.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.752+0000 7f6ff3fff640 1 --2- 172.21.15.103:0/3702326779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f701014f8a0 0x7f70101f9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:17.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.752+0000 7f6ff3fff640 1 --2- 172.21.15.103:0/3702326779 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f701006d0d0 0x7f70101f8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:17.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.752+0000 7f6ff3fff640 1 --2- 172.21.15.103:0/3702326779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7010068f80 0x7f7010070fe0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:17.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.752+0000 7f6ff3fff640 1 -- 172.21.15.103:0/3702326779 >> 172.21.15.103:0/3702326779 conn(0x7f701006c210 msgr2=0x7f7010152180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:17.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.752+0000 7f6ff3fff640 1 -- 172.21.15.103:0/3702326779 shutdown_connections 2024-09-10T08:42:17.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:17.753+0000 7f6ff3fff640 1 -- 172.21.15.103:0/3702326779 wait complete. 2024-09-10T08:42:20.774 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:42:20.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:20.964+0000 7f0454e29640 1 Processor -- start 2024-09-10T08:42:20.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:20.964+0000 7f0454e29640 1 -- start start 2024-09-10T08:42:20.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:20.965+0000 7f0454e29640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 0x7f04480d34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:20.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:20.965+0000 7f0454e29640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 0x7f0448006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:20.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:20.965+0000 7f0454e29640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04480d5d00 con 0x7f04480495e0 2024-09-10T08:42:20.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:20.965+0000 7f0454e29640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f04480d6bd0 con 0x7f04480499e0 2024-09-10T08:42:20.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:20.965+0000 7f0454e29640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f04480d5fc0 con 0x7f0448004b00 2024-09-10T08:42:20.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:20.966+0000 7f044effd640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7f04480495e0 legacy=0x7f044800b0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:42:20.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:20.966+0000 7f044f7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 0x7f04480d34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:20.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:20.966+0000 7f044ffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 0x7f0448006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:20.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:20.966+0000 7f044f7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 0x7f04480d34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:51354/0 (socket says 172.21.15.103:51354) 2024-09-10T08:42:20.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:20.966+0000 7f044ffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 0x7f0448006000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40844/0 (socket says 172.21.15.103:40844) 2024-09-10T08:42:20.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:20.966+0000 7f044f7fe640 1 -- 172.21.15.103:0/2615353339 learned_addr learned my addr 172.21.15.103:0/2615353339 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:20.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:20.966+0000 7f044ffff640 1 -- 172.21.15.103:0/2615353339 >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 msgr2=0x7f0448006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:42:20.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:20.966+0000 7f044ffff640 1 -- 172.21.15.103:0/2615353339 >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 msgr2=0x7f0448006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:42:20.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:20.966+0000 7f044ffff640 1 --2- 172.21.15.103:0/2615353339 >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 0x7f0448006000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:42:20.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:20.966+0000 7f044ffff640 1 --2- 172.21.15.103:0/2615353339 >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 0x7f0448006000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:42:20.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:20.967+0000 7f044f7fe640 1 -- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 msgr2=0x7f04480d34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:42:20.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:20.967+0000 7f044f7fe640 1 -- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 msgr2=0x7f04480d34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:42:20.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:20.967+0000 7f044f7fe640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 0x7f04480d34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:42:20.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:20.967+0000 7f044f7fe640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 0x7f04480d34e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:42:21.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:21.167+0000 7f044effd640 1 -- 172.21.15.103:0/2615353339 >> v1:172.21.15.154:6789/0 conn(0x7f04480495e0 legacy=0x7f044800b0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:42:21.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:21.167+0000 7f044ffff640 1 --2- 172.21.15.103:0/2615353339 >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 0x7f0448006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:21.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:21.167+0000 7f044ffff640 1 -- 172.21.15.103:0/2615353339 >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 msgr2=0x7f0448006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:42:21.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:21.168+0000 7f044ffff640 1 -- 172.21.15.103:0/2615353339 >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 msgr2=0x7f0448006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:42:21.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:21.168+0000 7f044ffff640 1 --2- 172.21.15.103:0/2615353339 >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 0x7f0448006000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:42:21.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:21.168+0000 7f044ffff640 1 --2- 172.21.15.103:0/2615353339 >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 0x7f0448006000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:42:21.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:21.168+0000 7f044f7fe640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 0x7f04480d34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:21.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:21.169+0000 7f044f7fe640 1 -- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 msgr2=0x7f04480d34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:42:21.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:21.169+0000 7f044f7fe640 1 -- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 msgr2=0x7f04480d34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:42:21.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:21.169+0000 7f044f7fe640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 0x7f04480d34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:42:21.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:21.169+0000 7f044f7fe640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 0x7f04480d34e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:42:21.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:21.568+0000 7f044effd640 1 -- 172.21.15.103:0/2615353339 >> v1:172.21.15.154:6789/0 conn(0x7f04480495e0 legacy=0x7f044800b0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:42:21.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:21.569+0000 7f044ffff640 1 --2- 172.21.15.103:0/2615353339 >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 0x7f0448006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:21.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:21.569+0000 7f044ffff640 1 -- 172.21.15.103:0/2615353339 >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 msgr2=0x7f0448006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:42:21.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:21.569+0000 7f044ffff640 1 -- 172.21.15.103:0/2615353339 >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 msgr2=0x7f0448006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:42:21.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:21.569+0000 7f044ffff640 1 --2- 172.21.15.103:0/2615353339 >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 0x7f0448006000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:42:21.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:21.569+0000 7f044ffff640 1 --2- 172.21.15.103:0/2615353339 >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 0x7f0448006000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:42:21.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:21.570+0000 7f044f7fe640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 0x7f04480d34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:21.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:21.570+0000 7f044f7fe640 1 -- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 msgr2=0x7f04480d34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:42:21.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:21.570+0000 7f044f7fe640 1 -- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 msgr2=0x7f04480d34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:42:21.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:21.570+0000 7f044f7fe640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 0x7f04480d34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:42:21.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:21.570+0000 7f044f7fe640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 0x7f04480d34e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:42:22.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:22.369+0000 7f044effd640 1 -- 172.21.15.103:0/2615353339 >> v1:172.21.15.154:6789/0 conn(0x7f04480495e0 legacy=0x7f044800b0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:42:22.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:22.371+0000 7f044f7fe640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 0x7f04480d34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:22.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:22.371+0000 7f044ffff640 1 --2- 172.21.15.103:0/2615353339 >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 0x7f0448006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:22.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:22.372+0000 7f044ffff640 1 -- 172.21.15.103:0/2615353339 >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 msgr2=0x7f0448006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:42:22.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:22.372+0000 7f044ffff640 1 -- 172.21.15.103:0/2615353339 >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 msgr2=0x7f0448006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:42:22.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:22.372+0000 7f044ffff640 1 --2- 172.21.15.103:0/2615353339 >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 0x7f0448006000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:42:22.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:22.372+0000 7f044ffff640 1 --2- 172.21.15.103:0/2615353339 >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 0x7f0448006000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:42:22.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:22.376+0000 7f044f7fe640 1 -- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 msgr2=0x7f04480d34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:42:22.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:22.376+0000 7f044f7fe640 1 -- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 msgr2=0x7f04480d34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:42:22.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:22.376+0000 7f044f7fe640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 0x7f04480d34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:42:22.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:22.376+0000 7f044f7fe640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 0x7f04480d34e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:42:23.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.967+0000 7f044d7fa640 1 -- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 msgr2=0x7f04480d34e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:42:23.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.967+0000 7f044d7fa640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 0x7f04480d34e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:23.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.967+0000 7f044d7fa640 1 -- 172.21.15.103:0/2615353339 >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 msgr2=0x7f0448006000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:42:23.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.967+0000 7f044d7fa640 1 --2- 172.21.15.103:0/2615353339 >> v2:172.21.15.103:3300/0 conn(0x7f04480499e0 0x7f0448006000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:23.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.967+0000 7f044d7fa640 1 -- 172.21.15.103:0/2615353339 >> v1:172.21.15.154:6789/0 conn(0x7f04480495e0 legacy=0x7f044800b0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:42:23.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.967+0000 7f044d7fa640 1 --2- 172.21.15.103:0/2615353339 >> v2:172.21.15.154:3300/0 conn(0x7f0434007400 0x7f04340098c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:23.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.967+0000 7f044d7fa640 1 -- 172.21.15.103:0/2615353339 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04480d62a0 con 0x7f04340036c0 2024-09-10T08:42:23.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.967+0000 7f044d7fa640 1 -- 172.21.15.103:0/2615353339 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f04480d6bd0 con 0x7f0434007400 2024-09-10T08:42:23.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.968+0000 7f044effd640 1 -- 172.21.15.103:0/2615353339 >> v2:172.21.15.154:3300/0 conn(0x7f0434007400 msgr2=0x7f04340098c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:42:23.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.968+0000 7f044effd640 1 --2- 172.21.15.103:0/2615353339 >> v2:172.21.15.154:3300/0 conn(0x7f0434007400 0x7f04340098c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:42:23.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.969+0000 7f044e7fc640 1 -- 172.21.15.103:0/2615353339 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1609761512 0 0) 0x7f04480d62a0 con 0x7f04340036c0 2024-09-10T08:42:23.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.969+0000 7f044e7fc640 1 -- 172.21.15.103:0/2615353339 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0440003520 con 0x7f04340036c0 2024-09-10T08:42:23.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.970+0000 7f044e7fc640 1 -- 172.21.15.103:0/2615353339 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2164589518 0 0) 0x7f0440003520 con 0x7f04340036c0 2024-09-10T08:42:23.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.970+0000 7f044e7fc640 1 -- 172.21.15.103:0/2615353339 >> v2:172.21.15.154:3300/0 conn(0x7f0434007400 msgr2=0x7f04340098c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:42:23.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.970+0000 7f044e7fc640 1 --2- 172.21.15.103:0/2615353339 >> v2:172.21.15.154:3300/0 conn(0x7f0434007400 0x7f04340098c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:23.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.970+0000 7f044e7fc640 1 -- 172.21.15.103:0/2615353339 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04480d5d00 con 0x7f04340036c0 2024-09-10T08:42:23.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.971+0000 7f044e7fc640 1 -- 172.21.15.103:0/2615353339 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f043c00f040 con 0x7f04340036c0 2024-09-10T08:42:23.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.971+0000 7f044e7fc640 1 -- 172.21.15.103:0/2615353339 >> v1:172.21.15.103:6789/0 conn(0x7f04340036c0 legacy=0x7f0434005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:23.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.971+0000 7f044e7fc640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 0x7f04400039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:23.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.971+0000 7f044e7fc640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04400040a0 0x7f0440004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:23.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.971+0000 7f044e7fc640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0440004d40 0x7f04400051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:23.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.971+0000 7f044effd640 1 -- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04400040a0 msgr2=0x7f0440004800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:42:23.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.971+0000 7f044effd640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04400040a0 0x7f0440004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:42:23.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.971+0000 7f044e7fc640 1 -- 172.21.15.103:0/2615353339 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f04480d6bd0 con 0x7f0440004d40 2024-09-10T08:42:23.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.971+0000 7f044e7fc640 1 -- 172.21.15.103:0/2615353339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f044000bbc0 con 0x7f04400040a0 2024-09-10T08:42:23.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.971+0000 7f044e7fc640 1 -- 172.21.15.103:0/2615353339 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f044000bdc0 con 0x7f0448004b00 2024-09-10T08:42:23.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.971+0000 7f044ffff640 1 -- 172.21.15.103:0/2615353339 reap_dead start 2024-09-10T08:42:23.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.972+0000 7f044f7fe640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 0x7f04400039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:23.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.972+0000 7f044ffff640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0440004d40 0x7f04400051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:23.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.973+0000 7f044ffff640 1 -- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 msgr2=0x7f04400039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:23.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.973+0000 7f044ffff640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 0x7f04400039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:23.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.973+0000 7f044ffff640 1 -- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04400040a0 msgr2=0x7f0440004800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:42:23.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.973+0000 7f044ffff640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04400040a0 0x7f0440004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:23.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.973+0000 7f044ffff640 1 -- 172.21.15.103:0/2615353339 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04480d5d00 con 0x7f0440004d40 2024-09-10T08:42:23.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.974+0000 7f044ffff640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0440004d40 0x7f04400051a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0434009e80 tx=0x7f0440005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57054f70df64f69 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:23.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.977+0000 7f044e7fc640 1 -- 172.21.15.103:0/2615353339 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0444031070 con 0x7f0440004d40 2024-09-10T08:42:23.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.977+0000 7f044e7fc640 1 -- 172.21.15.103:0/2615353339 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044402b5e0 con 0x7f0440004d40 2024-09-10T08:42:23.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.978+0000 7f0454e29640 1 -- 172.21.15.103:0/2615353339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0440004d40 msgr2=0x7f04400051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:23.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.978+0000 7f0454e29640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0440004d40 0x7f04400051a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0434009e80 tx=0x7f0440005830 comp rx=0 tx=0).stop 2024-09-10T08:42:23.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.978+0000 7f0454e29640 1 -- 172.21.15.103:0/2615353339 shutdown_connections 2024-09-10T08:42:23.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.978+0000 7f0454e29640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0440004d40 0x7f04400051a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:23.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.978+0000 7f0454e29640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04400040a0 0x7f0440004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:23.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.978+0000 7f0454e29640 1 --2- 172.21.15.103:0/2615353339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0448004b00 0x7f04400039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:23.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.978+0000 7f0454e29640 1 -- 172.21.15.103:0/2615353339 >> 172.21.15.103:0/2615353339 conn(0x7f0448048160 msgr2=0x7f0448048570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:23.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.978+0000 7f0454e29640 1 -- 172.21.15.103:0/2615353339 shutdown_connections 2024-09-10T08:42:23.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.978+0000 7f0454e29640 1 -- 172.21.15.103:0/2615353339 wait complete. 2024-09-10T08:42:23.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.980+0000 7f0454e29640 1 Processor -- start 2024-09-10T08:42:23.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.980+0000 7f0454e29640 1 -- start start 2024-09-10T08:42:23.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.981+0000 7f0454e29640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04400040a0 0x7f04480307f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:23.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.981+0000 7f0454e29640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0440004d40 0x7f04480dd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:23.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.982+0000 7f0454e29640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0448004b00 0x7f04480dde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:23.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.982+0000 7f0454e29640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0448007660 con 0x7f04400040a0 2024-09-10T08:42:23.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.982+0000 7f044effd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0440004d40 0x7f04480dd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:23.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.982+0000 7f044effd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0440004d40 0x7f04480dd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:51404/0 (socket says 172.21.15.103:51404) 2024-09-10T08:42:23.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.982+0000 7f044effd640 1 -- 172.21.15.103:0/1841983303 learned_addr learned my addr 172.21.15.103:0/1841983303 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:23.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.983+0000 7f044f7fe640 1 --2- 172.21.15.103:0/1841983303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04400040a0 0x7f04480307f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:23.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.983+0000 7f0454e29640 1 -- 172.21.15.103:0/1841983303 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f04480d6860 con 0x7f0448004b00 2024-09-10T08:42:23.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.983+0000 7f0454e29640 1 -- 172.21.15.103:0/1841983303 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f04480d34e0 con 0x7f0440004d40 2024-09-10T08:42:23.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.983+0000 7f044ffff640 1 -- 172.21.15.103:0/1841983303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0448004b00 msgr2=0x7f04480dde30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:42:23.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.983+0000 7f044ffff640 1 --2- 172.21.15.103:0/1841983303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0448004b00 0x7f04480dde30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:42:23.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.985+0000 7f044f7fe640 1 -- 172.21.15.103:0/1841983303 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0440004d40 msgr2=0x7f04480dd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:23.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.985+0000 7f044f7fe640 1 --2- 172.21.15.103:0/1841983303 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0440004d40 0x7f04480dd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:23.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.985+0000 7f044f7fe640 1 -- 172.21.15.103:0/1841983303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0448004b00 msgr2=0x7f04480dde30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:42:23.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.985+0000 7f044f7fe640 1 --2- 172.21.15.103:0/1841983303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0448004b00 0x7f04480dde30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:23.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.985+0000 7f044f7fe640 1 -- 172.21.15.103:0/1841983303 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04480c3780 con 0x7f04400040a0 2024-09-10T08:42:23.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.986+0000 7f044f7fe640 1 --2- 172.21.15.103:0/1841983303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04400040a0 0x7f04480307f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f043c001eb0 tx=0x7f043c016c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:23.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.986+0000 7f043bfff640 1 -- 172.21.15.103:0/1841983303 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c00f040 con 0x7f04400040a0 2024-09-10T08:42:23.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.986+0000 7f043bfff640 1 -- 172.21.15.103:0/1841983303 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f043c004460 con 0x7f04400040a0 2024-09-10T08:42:23.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.987+0000 7f0454e29640 1 -- 172.21.15.103:0/1841983303 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04480c3a60 con 0x7f04400040a0 2024-09-10T08:42:23.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.987+0000 7f0454e29640 1 -- 172.21.15.103:0/1841983303 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f044802e460 con 0x7f04400040a0 2024-09-10T08:42:23.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.988+0000 7f0439ffb640 1 -- 172.21.15.103:0/1841983303 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04480d5fc0 con 0x7f04400040a0 2024-09-10T08:42:23.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:23.990+0000 7f043bfff640 1 -- 172.21.15.103:0/1841983303 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c014b40 con 0x7f04400040a0 2024-09-10T08:42:24.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.001+0000 7f043bfff640 1 -- 172.21.15.103:0/1841983303 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f043c014ce0 con 0x7f04400040a0 2024-09-10T08:42:24.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.001+0000 7f043bfff640 1 --2- 172.21.15.103:0/1841983303 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f043406c8c0 0x7f043406ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:24.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.002+0000 7f044effd640 1 --2- 172.21.15.103:0/1841983303 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f043406c8c0 0x7f043406ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:24.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.002+0000 7f044effd640 1 --2- 172.21.15.103:0/1841983303 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f043406c8c0 0x7f043406ed80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0450076010 tx=0x7f0450069d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:24.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.003+0000 7f043bfff640 1 -- 172.21.15.103:0/1841983303 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f043c08c590 con 0x7f04400040a0 2024-09-10T08:42:24.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.003+0000 7f043bfff640 1 -- 172.21.15.103:0/1841983303 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f043c01c030 con 0x7f04400040a0 2024-09-10T08:42:24.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.501+0000 7f0439ffb640 1 -- 172.21.15.103:0/1841983303 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f04480d2ce0 con 0x7f04400040a0 2024-09-10T08:42:24.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.501+0000 7f043bfff640 1 -- 172.21.15.103:0/1841983303 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f043c05ac10 con 0x7f04400040a0 2024-09-10T08:42:24.503 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":114,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:42:24.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.506+0000 7f0439ffb640 1 -- 172.21.15.103:0/1841983303 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f043406c8c0 msgr2=0x7f043406ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:24.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.506+0000 7f0439ffb640 1 --2- 172.21.15.103:0/1841983303 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f043406c8c0 0x7f043406ed80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0450076010 tx=0x7f0450069d60 comp rx=0 tx=0).stop 2024-09-10T08:42:24.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.506+0000 7f0439ffb640 1 -- 172.21.15.103:0/1841983303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04400040a0 msgr2=0x7f04480307f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:24.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.506+0000 7f0439ffb640 1 --2- 172.21.15.103:0/1841983303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04400040a0 0x7f04480307f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f043c001eb0 tx=0x7f043c016c40 comp rx=0 tx=0).stop 2024-09-10T08:42:24.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.506+0000 7f0439ffb640 1 -- 172.21.15.103:0/1841983303 shutdown_connections 2024-09-10T08:42:24.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.506+0000 7f0439ffb640 1 --2- 172.21.15.103:0/1841983303 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f043406c8c0 0x7f043406ed80 secure :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0450076010 tx=0x7f0450069d60 comp rx=0 tx=0).stop 2024-09-10T08:42:24.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.506+0000 7f0439ffb640 1 --2- 172.21.15.103:0/1841983303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0448004b00 0x7f04480dde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:24.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.506+0000 7f0439ffb640 1 --2- 172.21.15.103:0/1841983303 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0440004d40 0x7f04480dd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:24.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.506+0000 7f0439ffb640 1 --2- 172.21.15.103:0/1841983303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04400040a0 0x7f04480307f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:24.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.506+0000 7f0439ffb640 1 -- 172.21.15.103:0/1841983303 >> 172.21.15.103:0/1841983303 conn(0x7f0448048160 msgr2=0x7f044804a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:24.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.512+0000 7f0439ffb640 1 -- 172.21.15.103:0/1841983303 shutdown_connections 2024-09-10T08:42:24.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.512+0000 7f0439ffb640 1 -- 172.21.15.103:0/1841983303 wait complete. 2024-09-10T08:42:24.536 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-10T08:42:24.536 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-10T08:42:24.536 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:42:24.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.732+0000 7ff0fe065640 1 Processor -- start 2024-09-10T08:42:24.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.732+0000 7ff0fe065640 1 -- start start 2024-09-10T08:42:24.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.734+0000 7ff0fe065640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0f003e260 0x7ff0f003e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:24.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.734+0000 7ff0fe065640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0f00498a0 0x7ff0f00e8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:24.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.734+0000 7ff0fe065640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0f000ba00 con 0x7ff0f004a570 2024-09-10T08:42:24.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.734+0000 7ff0fe065640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff0f00de9d0 con 0x7ff0f003e260 2024-09-10T08:42:24.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.734+0000 7ff0fe065640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f00de0a0 con 0x7ff0f00498a0 2024-09-10T08:42:24.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.735+0000 7ff0f6ffd640 1 -- >> v1:172.21.15.154:6789/0 conn(0x7ff0f004a570 legacy=0x7ff0f0049190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.154:6789/0 2024-09-10T08:42:24.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.735+0000 7ff0f7fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0f00498a0 0x7ff0f00e8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:24.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.735+0000 7ff0f77fe640 1 -- >> v2:172.21.15.154:3300/0 conn(0x7ff0f003e260 msgr2=0x7ff0f003e640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:42:24.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.735+0000 7ff0f77fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0f003e260 0x7ff0f003e640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:42:24.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.735+0000 7ff0f7fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0f00498a0 0x7ff0f00e8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:51414/0 (socket says 172.21.15.103:51414) 2024-09-10T08:42:24.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.735+0000 7ff0f7fff640 1 -- 172.21.15.103:0/574329192 learned_addr learned my addr 172.21.15.103:0/574329192 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:24.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.738+0000 7ff0f7fff640 1 -- 172.21.15.103:0/574329192 >> v2:172.21.15.154:3300/0 conn(0x7ff0f003e260 msgr2=0x7ff0f003e640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:42:24.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.738+0000 7ff0f7fff640 1 --2- 172.21.15.103:0/574329192 >> v2:172.21.15.154:3300/0 conn(0x7ff0f003e260 0x7ff0f003e640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:24.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.738+0000 7ff0f7fff640 1 -- 172.21.15.103:0/574329192 >> v1:172.21.15.154:6789/0 conn(0x7ff0f004a570 legacy=0x7ff0f0049190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:42:24.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.738+0000 7ff0f7fff640 1 -- 172.21.15.103:0/574329192 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f00de380 con 0x7ff0f00498a0 2024-09-10T08:42:24.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.742+0000 7ff0f7fff640 1 --2- 172.21.15.103:0/574329192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0f00498a0 0x7ff0f00e8910 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009870 tx=0x7ff0ec02a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33842590836c8569 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:24.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.743+0000 7ff0f67fc640 1 -- 172.21.15.103:0/574329192 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec037070 con 0x7ff0f00498a0 2024-09-10T08:42:24.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.743+0000 7ff0f67fc640 1 -- 172.21.15.103:0/574329192 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ec032440 con 0x7ff0f00498a0 2024-09-10T08:42:24.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.744+0000 7ff0fe065640 1 -- 172.21.15.103:0/574329192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0f00498a0 msgr2=0x7ff0f00e8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:24.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.744+0000 7ff0fe065640 1 --2- 172.21.15.103:0/574329192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0f00498a0 0x7ff0f00e8910 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009870 tx=0x7ff0ec02a230 comp rx=0 tx=0).stop 2024-09-10T08:42:24.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.744+0000 7ff0fe065640 1 -- 172.21.15.103:0/574329192 shutdown_connections 2024-09-10T08:42:24.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.744+0000 7ff0fe065640 1 --2- 172.21.15.103:0/574329192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0f00498a0 0x7ff0f00e8910 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:24.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.744+0000 7ff0fe065640 1 --2- 172.21.15.103:0/574329192 >> v2:172.21.15.154:3300/0 conn(0x7ff0f003e260 0x7ff0f003e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:24.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.744+0000 7ff0fe065640 1 -- 172.21.15.103:0/574329192 >> 172.21.15.103:0/574329192 conn(0x7ff0f0047d10 msgr2=0x7ff0f0048120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:24.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.746+0000 7ff0fe065640 1 -- 172.21.15.103:0/574329192 shutdown_connections 2024-09-10T08:42:24.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.746+0000 7ff0fe065640 1 -- 172.21.15.103:0/574329192 wait complete. 2024-09-10T08:42:24.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.748+0000 7ff0fe065640 1 Processor -- start 2024-09-10T08:42:24.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.748+0000 7ff0fe065640 1 -- start start 2024-09-10T08:42:24.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.749+0000 7ff0fe065640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0f003e260 0x7ff0f017fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:24.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.749+0000 7ff0fe065640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0f00498a0 0x7ff0f017ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:24.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.749+0000 7ff0fe065640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0f004a570 0x7ff0f017f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:24.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.749+0000 7ff0fe065640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f00dee60 con 0x7ff0f003e260 2024-09-10T08:42:24.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.749+0000 7ff0fe065640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f004b040 con 0x7ff0f00498a0 2024-09-10T08:42:24.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.749+0000 7ff0fe065640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f004acd0 con 0x7ff0f004a570 2024-09-10T08:42:24.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.749+0000 7ff0f6ffd640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0f00498a0 msgr2=0x7ff0f017ed30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:42:24.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.749+0000 7ff0f6ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0f00498a0 0x7ff0f017ed30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:42:24.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.749+0000 7ff0f7fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0f004a570 0x7ff0f017f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:24.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.749+0000 7ff0f7fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0f004a570 0x7ff0f017f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:51416/0 (socket says 172.21.15.103:51416) 2024-09-10T08:42:24.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.749+0000 7ff0f7fff640 1 -- 172.21.15.103:0/3508002956 learned_addr learned my addr 172.21.15.103:0/3508002956 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:24.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.749+0000 7ff0f77fe640 1 --2- 172.21.15.103:0/3508002956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0f003e260 0x7ff0f017fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:24.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.750+0000 7ff0f7fff640 1 -- 172.21.15.103:0/3508002956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0f00498a0 msgr2=0x7ff0f017ed30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:42:24.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.750+0000 7ff0f7fff640 1 --2- 172.21.15.103:0/3508002956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0f00498a0 0x7ff0f017ed30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:24.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.750+0000 7ff0f7fff640 1 -- 172.21.15.103:0/3508002956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0f003e260 msgr2=0x7ff0f017fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:24.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.750+0000 7ff0f7fff640 1 --2- 172.21.15.103:0/3508002956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0f003e260 0x7ff0f017fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:24.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.750+0000 7ff0f7fff640 1 -- 172.21.15.103:0/3508002956 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f016a060 con 0x7ff0f004a570 2024-09-10T08:42:24.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.750+0000 7ff0f7fff640 1 --2- 172.21.15.103:0/3508002956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0f004a570 0x7ff0f017f270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009990 tx=0x7ff0ec0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:24.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.752+0000 7ff0e3fff640 1 -- 172.21.15.103:0/3508002956 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec037040 con 0x7ff0f004a570 2024-09-10T08:42:24.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.752+0000 7ff0fe065640 1 -- 172.21.15.103:0/3508002956 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f016a340 con 0x7ff0f004a570 2024-09-10T08:42:24.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.752+0000 7ff0fe065640 1 -- 172.21.15.103:0/3508002956 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f00db730 con 0x7ff0f004a570 2024-09-10T08:42:24.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.753+0000 7ff0e3fff640 1 -- 172.21.15.103:0/3508002956 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ec042070 con 0x7ff0f004a570 2024-09-10T08:42:24.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.753+0000 7ff0e3fff640 1 -- 172.21.15.103:0/3508002956 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec030e10 con 0x7ff0f004a570 2024-09-10T08:42:24.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.761+0000 7ff0fe065640 1 --2- 172.21.15.103:0/3508002956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0d8002a70 0x7ff0d8004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:24.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.761+0000 7ff0f77fe640 1 --2- 172.21.15.103:0/3508002956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0d8002a70 0x7ff0d8004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:24.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.761+0000 7ff0fe065640 1 -- 172.21.15.103:0/3508002956 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d8007ec0 con 0x7ff0d8002a70 2024-09-10T08:42:24.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.761+0000 7ff0f77fe640 1 -- 172.21.15.103:0/3508002956 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0d80080c0 con 0x7ff0d8002a70 2024-09-10T08:42:24.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.762+0000 7ff0f77fe640 1 --2- 172.21.15.103:0/3508002956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0d8002a70 0x7ff0d8004f30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4003930 tx=0x7ff0e4009e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:24.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.763+0000 7ff0e3fff640 1 -- 172.21.15.103:0/3508002956 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4016070 con 0x7ff0d8002a70 2024-09-10T08:42:24.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.765+0000 7ff0e3fff640 1 -- 172.21.15.103:0/3508002956 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0ec032440 con 0x7ff0f004a570 2024-09-10T08:42:24.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.766+0000 7ff0e3fff640 1 --2- 172.21.15.103:0/3508002956 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff0dc06bd60 0x7ff0dc06e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:24.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.766+0000 7ff0e3fff640 1 -- 172.21.15.103:0/3508002956 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7ff0ec0abb90 con 0x7ff0f004a570 2024-09-10T08:42:24.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.766+0000 7ff0f6ffd640 1 --2- 172.21.15.103:0/3508002956 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff0dc06bd60 0x7ff0dc06e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:24.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.766+0000 7ff0e3fff640 1 -- 172.21.15.103:0/3508002956 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff0e400e720 con 0x7ff0d8002a70 2024-09-10T08:42:24.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.766+0000 7ff0e3fff640 1 -- 172.21.15.103:0/3508002956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0d8002a70 msgr2=0x7ff0d8004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:24.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.766+0000 7ff0e3fff640 1 --2- 172.21.15.103:0/3508002956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0d8002a70 0x7ff0d8004f30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4003930 tx=0x7ff0e4009e50 comp rx=0 tx=0).stop 2024-09-10T08:42:24.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.767+0000 7ff0e3fff640 1 -- 172.21.15.103:0/3508002956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0d8002a70 msgr2=0x7ff0d8004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:42:24.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.767+0000 7ff0e3fff640 1 --2- 172.21.15.103:0/3508002956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0d8002a70 0x7ff0d8004f30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:24.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.767+0000 7ff0f6ffd640 1 --2- 172.21.15.103:0/3508002956 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff0dc06bd60 0x7ff0dc06e220 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8065710 tx=0x7ff0f80659b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:24.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.785+0000 7ff0fe065640 1 --2- 172.21.15.103:0/3508002956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0d8006f70 0x7ff0d8007400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:24.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.785+0000 7ff0fe065640 1 -- 172.21.15.103:0/3508002956 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d800a4a0 con 0x7ff0d8006f70 2024-09-10T08:42:24.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.786+0000 7ff0f77fe640 1 --2- 172.21.15.103:0/3508002956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0d8006f70 0x7ff0d8007400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:24.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.788+0000 7ff0f77fe640 1 -- 172.21.15.103:0/3508002956 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff0d8007940 con 0x7ff0d8006f70 2024-09-10T08:42:24.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.789+0000 7ff0f77fe640 1 --2- 172.21.15.103:0/3508002956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0d8006f70 0x7ff0d8007400 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4003930 tx=0x7ff0e40059d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:24.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.798+0000 7ff0e3fff640 1 -- 172.21.15.103:0/3508002956 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4005c40 con 0x7ff0d8006f70 2024-09-10T08:42:24.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.799+0000 7ff0e3fff640 1 -- 172.21.15.103:0/3508002956 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5046 (secure 0 0 0) 0x7ff0e4005de0 con 0x7ff0d8006f70 2024-09-10T08:42:24.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.799+0000 7ff0e3fff640 1 -- 172.21.15.103:0/3508002956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0d8006f70 msgr2=0x7ff0d8007400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:24.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.799+0000 7ff0e3fff640 1 --2- 172.21.15.103:0/3508002956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0d8006f70 0x7ff0d8007400 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4003930 tx=0x7ff0e40059d0 comp rx=0 tx=0).stop 2024-09-10T08:42:24.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.799+0000 7ff0e3fff640 1 -- 172.21.15.103:0/3508002956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0d8006f70 msgr2=0x7ff0d8007400 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:42:24.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.799+0000 7ff0e3fff640 1 --2- 172.21.15.103:0/3508002956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0d8006f70 0x7ff0d8007400 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:24.801 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:42:24.801 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:42:24.801 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:42:24.802 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:42:24.802 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 114, 2024-09-10T08:42:24.802 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 171254, 2024-09-10T08:42:24.802 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:42:24.802 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:42:24.802 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:42:24.802 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:24.802 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:42:24.802 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:42:24.802 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:42:24.802 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:42:24.802 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:24.802 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:24.803 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:24.803 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:24.803 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:24.803 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:24.803 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:24.803 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:24.803 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:24.803 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:24.803 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:24.803 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:24.803 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:42:24.803 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:42:24.803 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:24.804 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:24.804 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:24.804 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:24.804 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:24.804 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:24.804 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:24.804 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:24.804 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:24.804 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:24.804 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:24.804 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:24.804 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:24.804 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:42:24.805 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:42:24.805 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:42:24.805 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:42:24.805 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:42:24.805 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:42:24.805 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:42:24.805 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:42:24.805 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:42:24.805 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:42:24.805 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:42:24.805 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:42:24.805 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:42:24.805 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:42:24.806 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:42:24.806 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:42:24.806 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:42:24.806 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:24.806 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:24.806 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:24.806 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:24.806 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:24.806 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:24.806 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:24.806 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:24.806 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:24.806 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:24.807 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:24.807 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:24.807 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:42:24.807 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:24.807 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:42:24.807 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:24.807 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:42:24.807 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:42:24.807 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:24.807 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:24.807 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:24.807 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:24.807 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:42:24.807 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:24.808 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:24.808 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:24.808 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:24.808 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:42:24.808 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:24.808 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:24.808 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:24.808 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:24.808 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:42:24.808 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:42:24.808 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:24.808 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:24.808 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:24.808 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:24.809 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:24.809 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:42:24.809 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:42:24.809 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:24.809 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:24.809 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:24.809 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:24.809 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:42:24.809 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:24.809 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:24.809 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:24.809 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:24.810 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:42:24.810 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:24.810 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:24.810 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:24.810 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:24.810 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:42:24.810 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:42:24.810 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:24.810 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:24.810 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:24.810 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:24.810 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:24.811 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:42:24.811 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:42:24.811 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:24.811 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:24.811 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:24.811 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:24.811 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:42:24.811 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:24.811 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:24.811 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:24.811 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:24.811 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:42:24.812 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:24.812 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:24.812 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:24.812 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:24.812 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:42:24.812 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:42:24.812 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:24.812 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:24.812 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:24.812 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:24.812 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:24.812 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:24.812 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:42:24.812 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:42:24.813 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:24.813 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:24.813 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:24.813 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:42:24.813 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:24.813 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:24.813 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:42:24.813 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:24.813 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:24.813 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:24.813 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:42:24.813 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:24.814 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:24.814 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:42:24.814 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:24.814 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:24.814 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:24.814 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:42:24.814 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:24.814 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:24.814 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:42:24.814 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:24.814 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:24.814 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:24.814 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-10T08:42:24.815 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:24.815 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:24.815 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:42:24.815 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:24.815 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:24.815 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:24.815 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:42:24.815 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:24.815 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:24.815 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:24.815 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:42:24.815 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:42:24.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.800+0000 7ff0fe065640 1 -- 172.21.15.103:0/3508002956 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff0dc06bd60 msgr2=0x7ff0dc06e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:24.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.800+0000 7ff0fe065640 1 --2- 172.21.15.103:0/3508002956 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7ff0dc06bd60 0x7ff0dc06e220 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8065710 tx=0x7ff0f80659b0 comp rx=0 tx=0).stop 2024-09-10T08:42:24.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.801+0000 7ff0fe065640 1 -- 172.21.15.103:0/3508002956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0f004a570 msgr2=0x7ff0f017f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:24.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.801+0000 7ff0fe065640 1 --2- 172.21.15.103:0/3508002956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0f004a570 0x7ff0f017f270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009990 tx=0x7ff0ec0046c0 comp rx=0 tx=0).stop 2024-09-10T08:42:24.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.802+0000 7ff0f7fff640 1 -- 172.21.15.103:0/3508002956 reap_dead start 2024-09-10T08:42:24.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.802+0000 7ff0f7fff640 1 -- 172.21.15.103:0/3508002956 reap_dead start 2024-09-10T08:42:24.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.804+0000 7ff0fe065640 1 -- 172.21.15.103:0/3508002956 shutdown_connections 2024-09-10T08:42:24.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.804+0000 7ff0fe065640 1 -- 172.21.15.103:0/3508002956 >> 172.21.15.103:0/3508002956 conn(0x7ff0f0047d10 msgr2=0x7ff0f0005940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:24.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.809+0000 7ff0fe065640 1 -- 172.21.15.103:0/3508002956 shutdown_connections 2024-09-10T08:42:24.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:24.809+0000 7ff0fe065640 1 -- 172.21.15.103:0/3508002956 wait complete. 2024-09-10T08:42:24.830 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:42:24.830 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-10T08:42:24.831 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:42:25.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.024+0000 7f566e2f1640 1 Processor -- start 2024-09-10T08:42:25.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.024+0000 7f566e2f1640 1 -- start start 2024-09-10T08:42:25.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.026+0000 7f566e2f1640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f56680acc30 0x7f56680c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:25.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.026+0000 7f566e2f1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56680c8180 0x7f566815dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:25.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.026+0000 7f566e2f1640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5668070590 con 0x7f56680c44b0 2024-09-10T08:42:25.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.026+0000 7f566e2f1640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f56680c4ea0 con 0x7f56680acc30 2024-09-10T08:42:25.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.026+0000 7f566e2f1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f56680a8220 con 0x7f56680c8180 2024-09-10T08:42:25.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.026+0000 7f566c88e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56680c8180 0x7f566815dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:25.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.026+0000 7f566c88e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56680c8180 0x7f566815dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:51418/0 (socket says 172.21.15.103:51418) 2024-09-10T08:42:25.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.026+0000 7f566c88e640 1 -- 172.21.15.103:0/3149581590 learned_addr learned my addr 172.21.15.103:0/3149581590 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:25.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.027+0000 7f566c88e640 1 -- 172.21.15.103:0/3149581590 >> v2:172.21.15.103:3300/0 conn(0x7f56680acc30 msgr2=0x7f56680c3f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:42:25.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.027+0000 7f566c88e640 1 --2- 172.21.15.103:0/3149581590 >> v2:172.21.15.103:3300/0 conn(0x7f56680acc30 0x7f56680c3f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.027+0000 7f566c88e640 1 -- 172.21.15.103:0/3149581590 >> v1:172.21.15.103:6789/0 conn(0x7f56680c44b0 legacy=0x7f56680c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:25.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.028+0000 7f566c88e640 1 -- 172.21.15.103:0/3149581590 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56680a84f0 con 0x7f56680c8180 2024-09-10T08:42:25.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.029+0000 7f566c88e640 1 --2- 172.21.15.103:0/3149581590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56680c8180 0x7f566815dd40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5660009e50 tx=0x7f566002a510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd66ae9b0b0b7f0b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:25.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.029+0000 7f5666ffd640 1 -- 172.21.15.103:0/3149581590 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5660036070 con 0x7f56680c8180 2024-09-10T08:42:25.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.030+0000 7f5666ffd640 1 -- 172.21.15.103:0/3149581590 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5660031600 con 0x7f56680c8180 2024-09-10T08:42:25.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.030+0000 7f5666ffd640 1 -- 172.21.15.103:0/3149581590 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56600319d0 con 0x7f56680c8180 2024-09-10T08:42:25.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.035+0000 7f566e2f1640 1 -- 172.21.15.103:0/3149581590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56680c8180 msgr2=0x7f566815dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:25.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.035+0000 7f566e2f1640 1 --2- 172.21.15.103:0/3149581590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56680c8180 0x7f566815dd40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5660009e50 tx=0x7f566002a510 comp rx=0 tx=0).stop 2024-09-10T08:42:25.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.036+0000 7f566e2f1640 1 -- 172.21.15.103:0/3149581590 shutdown_connections 2024-09-10T08:42:25.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.036+0000 7f566e2f1640 1 --2- 172.21.15.103:0/3149581590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56680c8180 0x7f566815dd40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.036+0000 7f566e2f1640 1 --2- 172.21.15.103:0/3149581590 >> v2:172.21.15.103:3300/0 conn(0x7f56680acc30 0x7f56680c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.036+0000 7f566e2f1640 1 -- 172.21.15.103:0/3149581590 >> 172.21.15.103:0/3149581590 conn(0x7f56680c5660 msgr2=0x7f56680c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:25.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.038+0000 7f566e2f1640 1 -- 172.21.15.103:0/3149581590 shutdown_connections 2024-09-10T08:42:25.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.038+0000 7f566e2f1640 1 -- 172.21.15.103:0/3149581590 wait complete. 2024-09-10T08:42:25.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.040+0000 7f566e2f1640 1 Processor -- start 2024-09-10T08:42:25.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.040+0000 7f566e2f1640 1 -- start start 2024-09-10T08:42:25.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.041+0000 7f566e2f1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56680acc30 0x7f56681f8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:25.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.041+0000 7f566e2f1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56680c44b0 0x7f5668072a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:25.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.041+0000 7f566e2f1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56680c8180 0x7f56681f5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:25.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.041+0000 7f566e2f1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f56680c5330 con 0x7f56680c8180 2024-09-10T08:42:25.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.041+0000 7f566e2f1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f56680702b0 con 0x7f56680c44b0 2024-09-10T08:42:25.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.041+0000 7f566e2f1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f56680c63f0 con 0x7f56680acc30 2024-09-10T08:42:25.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.041+0000 7f56677fe640 1 -- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56680c44b0 msgr2=0x7f5668072a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:3300/0 2024-09-10T08:42:25.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.041+0000 7f56677fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56680c44b0 0x7f5668072a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:42:25.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.042+0000 7f566c88e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56680c8180 0x7f56681f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:25.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.042+0000 7f566c88e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56680c8180 0x7f56681f5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40930/0 (socket says 172.21.15.103:40930) 2024-09-10T08:42:25.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.042+0000 7f566c88e640 1 -- 172.21.15.103:0/1246151264 learned_addr learned my addr 172.21.15.103:0/1246151264 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:25.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.042+0000 7f5667fff640 1 --2- 172.21.15.103:0/1246151264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56680acc30 0x7f56681f8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:25.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.043+0000 7f5667fff640 1 -- 172.21.15.103:0/1246151264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56680c44b0 msgr2=0x7f5668072a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:42:25.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.043+0000 7f5667fff640 1 --2- 172.21.15.103:0/1246151264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56680c44b0 0x7f5668072a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.043+0000 7f5667fff640 1 -- 172.21.15.103:0/1246151264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56680c8180 msgr2=0x7f56681f5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:25.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.043+0000 7f5667fff640 1 --2- 172.21.15.103:0/1246151264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56680c8180 0x7f56681f5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.043+0000 7f5667fff640 1 -- 172.21.15.103:0/1246151264 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5668157b20 con 0x7f56680acc30 2024-09-10T08:42:25.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.044+0000 7f5667fff640 1 --2- 172.21.15.103:0/1246151264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56680acc30 0x7f56681f8670 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f565c00b410 tx=0x7f565c00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:25.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.045+0000 7f5664ff9640 1 -- 172.21.15.103:0/1246151264 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c015020 con 0x7f56680acc30 2024-09-10T08:42:25.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.045+0000 7f5664ff9640 1 -- 172.21.15.103:0/1246151264 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565c011850 con 0x7f56680acc30 2024-09-10T08:42:25.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.045+0000 7f5664ff9640 1 -- 172.21.15.103:0/1246151264 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c011c40 con 0x7f56680acc30 2024-09-10T08:42:25.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.046+0000 7f566e2f1640 1 -- 172.21.15.103:0/1246151264 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56681fbc80 con 0x7f56680acc30 2024-09-10T08:42:25.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.046+0000 7f566e2f1640 1 -- 172.21.15.103:0/1246151264 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f56681fc240 con 0x7f56680acc30 2024-09-10T08:42:25.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.048+0000 7f566e2f1640 1 --2- 172.21.15.103:0/1246151264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5648002a70 0x7f5648004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:25.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.048+0000 7f566e2f1640 1 -- 172.21.15.103:0/1246151264 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5648007ec0 con 0x7f5648002a70 2024-09-10T08:42:25.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.049+0000 7f56677fe640 1 --2- 172.21.15.103:0/1246151264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5648002a70 0x7f5648004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:25.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.054+0000 7f5664ff9640 1 -- 172.21.15.103:0/1246151264 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f565c018020 con 0x7f56680acc30 2024-09-10T08:42:25.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.055+0000 7f5664ff9640 1 --2- 172.21.15.103:0/1246151264 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f565406be30 0x7f565406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:25.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.055+0000 7f56677fe640 1 -- 172.21.15.103:0/1246151264 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f56480080c0 con 0x7f5648002a70 2024-09-10T08:42:25.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.055+0000 7f5664ff9640 1 -- 172.21.15.103:0/1246151264 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f565c011de0 con 0x7f56680acc30 2024-09-10T08:42:25.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.055+0000 7f566c88e640 1 --2- 172.21.15.103:0/1246151264 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f565406be30 0x7f565406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:25.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.057+0000 7f566c88e640 1 --2- 172.21.15.103:0/1246151264 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f565406be30 0x7f565406e2f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f56600093e0 tx=0x7f5660009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:25.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.058+0000 7f56677fe640 1 --2- 172.21.15.103:0/1246151264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5648002a70 0x7f5648004f30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f56680c2f70 tx=0x7f565800cb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:25.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.059+0000 7f5664ff9640 1 -- 172.21.15.103:0/1246151264 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5658017070 con 0x7f5648002a70 2024-09-10T08:42:25.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.059+0000 7f5664ff9640 1 -- 172.21.15.103:0/1246151264 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f565800ce50 con 0x7f5648002a70 2024-09-10T08:42:25.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.059+0000 7f5664ff9640 1 -- 172.21.15.103:0/1246151264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5648002a70 msgr2=0x7f5648004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:25.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.059+0000 7f5664ff9640 1 --2- 172.21.15.103:0/1246151264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5648002a70 0x7f5648004f30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f56680c2f70 tx=0x7f565800cb10 comp rx=0 tx=0).stop 2024-09-10T08:42:25.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.059+0000 7f5664ff9640 1 -- 172.21.15.103:0/1246151264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5648002a70 msgr2=0x7f5648004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:42:25.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.059+0000 7f5664ff9640 1 --2- 172.21.15.103:0/1246151264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5648002a70 0x7f5648004f30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.072+0000 7f566e2f1640 1 --2- 172.21.15.103:0/1246151264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5648006f30 0x7f56480073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:25.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.072+0000 7f566e2f1640 1 -- 172.21.15.103:0/1246151264 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f564800a4a0 con 0x7f5648006f30 2024-09-10T08:42:25.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.075+0000 7f56677fe640 1 --2- 172.21.15.103:0/1246151264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5648006f30 0x7f56480073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:25.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.076+0000 7f56677fe640 1 -- 172.21.15.103:0/1246151264 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5648007900 con 0x7f5648006f30 2024-09-10T08:42:25.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.078+0000 7f56677fe640 1 --2- 172.21.15.103:0/1246151264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5648006f30 0x7f56480073c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5658001030 tx=0x7f5658001240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:25.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.080+0000 7f5664ff9640 1 -- 172.21.15.103:0/1246151264 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565801ab00 con 0x7f5648006f30 2024-09-10T08:42:25.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.081+0000 7f5664ff9640 1 -- 172.21.15.103:0/1246151264 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4876 (secure 0 0 0) 0x7f565800a680 con 0x7f5648006f30 2024-09-10T08:42:25.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.081+0000 7f5664ff9640 1 -- 172.21.15.103:0/1246151264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5648006f30 msgr2=0x7f56480073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:25.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.081+0000 7f5664ff9640 1 --2- 172.21.15.103:0/1246151264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5648006f30 0x7f56480073c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5658001030 tx=0x7f5658001240 comp rx=0 tx=0).stop 2024-09-10T08:42:25.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.081+0000 7f5664ff9640 1 -- 172.21.15.103:0/1246151264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5648006f30 msgr2=0x7f56480073c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:42:25.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.081+0000 7f5664ff9640 1 --2- 172.21.15.103:0/1246151264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5648006f30 0x7f56480073c0 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5658001030 tx=0x7f5658001240 comp rx=0 tx=0).stop 2024-09-10T08:42:25.083 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:42:25.083 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:42:25.083 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:42:25.083 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:42:25.083 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 114, 2024-09-10T08:42:25.083 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 36981, 2024-09-10T08:42:25.083 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:42:25.083 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:42:25.083 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:42:25.083 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:25.083 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 1, 2024-09-10T08:42:25.083 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:42:25.084 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:42:25.084 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:42:25.084 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:25.084 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:25.084 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:25.084 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:25.084 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:25.084 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:25.084 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:25.084 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:25.085 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:25.085 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:25.085 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:25.085 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:25.085 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:42:25.085 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:42:25.085 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:25.085 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:25.085 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:25.086 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:25.086 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:25.086 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:25.086 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:25.086 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:25.086 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:25.086 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:25.086 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:25.087 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:25.087 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:25.087 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:42:25.087 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:42:25.087 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:42:25.087 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:42:25.087 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:42:25.087 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:42:25.088 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:42:25.088 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:42:25.088 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:42:25.088 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:42:25.088 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:42:25.088 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:42:25.088 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:42:25.089 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:42:25.089 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:42:25.089 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:42:25.089 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:42:25.089 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:25.089 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:25.089 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:25.089 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:25.089 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:25.089 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:25.090 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:25.090 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:25.090 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:25.090 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:25.090 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:25.090 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:25.090 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:42:25.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:25.090 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:42:25.090 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:25.090 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:42:25.090 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:42:25.090 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:25.091 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:25.091 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:25.091 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:25.091 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:42:25.091 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:25.091 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:25.091 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:25.091 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:25.091 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:42:25.091 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:25.091 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:25.091 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:25.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:25.092 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:42:25.092 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:42:25.092 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:25.092 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:25.092 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:25.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:25.092 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:25.092 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:42:25.092 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:42:25.092 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:25.092 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:25.092 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:25.093 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:25.093 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:42:25.093 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:25.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:25.093 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:25.093 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:25.093 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:42:25.093 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:25.093 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:25.093 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:25.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:25.093 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:42:25.093 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:42:25.094 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:25.094 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:25.094 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:25.094 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:25.094 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:25.094 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:42:25.094 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:42:25.094 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:25.094 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:25.094 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:25.094 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:25.094 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:42:25.094 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:25.095 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:25.095 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:25.095 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:25.095 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:42:25.095 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:25.095 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:25.095 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:25.095 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:25.095 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:42:25.095 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:42:25.095 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:25.095 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:25.095 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:25.095 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:25.096 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:25.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:25.096 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:42:25.096 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:42:25.096 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:25.096 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:25.096 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:25.096 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:42:25.096 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:25.096 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:25.096 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:42:25.097 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:25.097 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:25.097 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:25.097 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:42:25.097 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:25.097 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:25.097 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:42:25.097 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:25.097 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:25.097 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:25.097 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:42:25.097 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:25.097 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:25.097 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:42:25.098 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:25.098 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:25.098 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:25.098 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:42:25.098 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:25.098 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:25.098 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:25.098 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:42:25.098 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:42:25.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.082+0000 7f566e2f1640 1 -- 172.21.15.103:0/1246151264 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f565406be30 msgr2=0x7f565406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:25.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.082+0000 7f566e2f1640 1 --2- 172.21.15.103:0/1246151264 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f565406be30 0x7f565406e2f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f56600093e0 tx=0x7f5660009000 comp rx=0 tx=0).stop 2024-09-10T08:42:25.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.082+0000 7f566e2f1640 1 -- 172.21.15.103:0/1246151264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56680acc30 msgr2=0x7f56681f8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:25.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.082+0000 7f566e2f1640 1 --2- 172.21.15.103:0/1246151264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56680acc30 0x7f56681f8670 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f565c00b410 tx=0x7f565c00b8d0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.082+0000 7f566c88e640 1 -- 172.21.15.103:0/1246151264 reap_dead start 2024-09-10T08:42:25.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.082+0000 7f566c88e640 1 -- 172.21.15.103:0/1246151264 reap_dead start 2024-09-10T08:42:25.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.082+0000 7f566e2f1640 1 -- 172.21.15.103:0/1246151264 shutdown_connections 2024-09-10T08:42:25.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.082+0000 7f566e2f1640 1 -- 172.21.15.103:0/1246151264 >> 172.21.15.103:0/1246151264 conn(0x7f56680c5660 msgr2=0x7f56681567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:25.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.082+0000 7f566e2f1640 1 -- 172.21.15.103:0/1246151264 shutdown_connections 2024-09-10T08:42:25.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:25.082+0000 7f566e2f1640 1 -- 172.21.15.103:0/1246151264 wait complete. 2024-09-10T08:42:25.106 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:42:25.106 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-10T08:42:33.998 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:42:34.005 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:42:45.107 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-10T08:42:45.107 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-10T08:42:45.107 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T08:42:45.107 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T08:42:45.112 INFO:tasks.ceph.mon.b:Started 2024-09-10T08:42:45.112 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:42:45.112 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:42:45.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.298+0000 7f010bc53640 1 Processor -- start 2024-09-10T08:42:45.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.299+0000 7f010bc53640 1 -- start start 2024-09-10T08:42:45.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.300+0000 7f010bc53640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f010406f1d0 0x7f01040c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:45.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.300+0000 7f010bc53640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f01040c5940 0x7f0104152a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:45.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.300+0000 7f010bc53640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01040c7500 con 0x7f010414fa90 2024-09-10T08:42:45.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.300+0000 7f010bc53640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f01040c72b0 con 0x7f01040c5940 2024-09-10T08:42:45.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.300+0000 7f010bc53640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0104152580 con 0x7f010406f1d0 2024-09-10T08:42:45.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.300+0000 7f01099ef640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f010414fa90 0x7f01040c44d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41906/0 (socket says 172.21.15.103:41906) 2024-09-10T08:42:45.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.300+0000 7f01099ef640 1 -- 172.21.15.103:0/1852101807 learned_addr learned my addr 172.21.15.103:0/1852101807 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:42:45.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.300+0000 7f01089ed640 1 -- 172.21.15.103:0/1852101807 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2719535855 0 0) 0x7f01040c7500 con 0x7f010414fa90 2024-09-10T08:42:45.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.301+0000 7f01089ed640 1 -- 172.21.15.103:0/1852101807 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00f0003520 con 0x7f010414fa90 2024-09-10T08:42:45.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.301+0000 7f01089ed640 1 -- 172.21.15.103:0/1852101807 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3677541233 0 0) 0x7f00f0003520 con 0x7f010414fa90 2024-09-10T08:42:45.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.301+0000 7f01089ed640 1 -- 172.21.15.103:0/1852101807 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f010406f1d0 msgr2=0x7f01040c2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:45.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.301+0000 7f01089ed640 1 --2- 172.21.15.103:0/1852101807 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f010406f1d0 0x7f01040c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.301+0000 7f01089ed640 1 -- 172.21.15.103:0/1852101807 >> v2:172.21.15.103:3300/0 conn(0x7f01040c5940 msgr2=0x7f0104152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.301+0000 7f01089ed640 1 --2- 172.21.15.103:0/1852101807 >> v2:172.21.15.103:3300/0 conn(0x7f01040c5940 0x7f0104152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.301+0000 7f01089ed640 1 -- 172.21.15.103:0/1852101807 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0104156300 con 0x7f010414fa90 2024-09-10T08:42:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.301+0000 7f01089ed640 1 -- 172.21.15.103:0/1852101807 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f00f4001670 con 0x7f010414fa90 2024-09-10T08:42:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.301+0000 7f01089ed640 1 -- 172.21.15.103:0/1852101807 >> v1:172.21.15.103:6789/0 conn(0x7f010414fa90 legacy=0x7f01040c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.301+0000 7f01089ed640 1 --2- 172.21.15.103:0/1852101807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00f0003a30 0x7f00f0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.301+0000 7f01089ed640 1 --2- 172.21.15.103:0/1852101807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00f0004800 0x7f00f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.301+0000 7f01089ed640 1 --2- 172.21.15.103:0/1852101807 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f010406f1d0 0x7f00f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.301+0000 7f01089ed640 1 -- 172.21.15.103:0/1852101807 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f01040c72b0 con 0x7f00f0003a30 2024-09-10T08:42:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.301+0000 7f01089ed640 1 -- 172.21.15.103:0/1852101807 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0104152580 con 0x7f00f0004800 2024-09-10T08:42:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.301+0000 7f01089ed640 1 -- 172.21.15.103:0/1852101807 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f00f0005660 con 0x7f010406f1d0 2024-09-10T08:42:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.301+0000 7f01099ef640 1 --2- 172.21.15.103:0/1852101807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00f0003a30 0x7f00f0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.302+0000 7f010a1f0640 1 --2- 172.21.15.103:0/1852101807 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f010406f1d0 0x7f00f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.302+0000 7f01091ee640 1 --2- 172.21.15.103:0/1852101807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00f0004800 0x7f00f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.303+0000 7f010a1f0640 1 -- 172.21.15.103:0/1852101807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00f0004800 msgr2=0x7f00f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.303+0000 7f010a1f0640 1 --2- 172.21.15.103:0/1852101807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00f0004800 0x7f00f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.303+0000 7f010a1f0640 1 -- 172.21.15.103:0/1852101807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00f0003a30 msgr2=0x7f00f0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.303+0000 7f010a1f0640 1 --2- 172.21.15.103:0/1852101807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00f0003a30 0x7f00f0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:45.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.303+0000 7f010a1f0640 1 -- 172.21.15.103:0/1852101807 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f0003520 con 0x7f010406f1d0 2024-09-10T08:42:45.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.306+0000 7f010a1f0640 1 --2- 172.21.15.103:0/1852101807 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f010406f1d0 0x7f00f000b9c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00be30 tx=0x7f00f0005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c014abe41a07b8a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:45.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.311+0000 7f01089ed640 1 -- 172.21.15.103:0/1852101807 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc00ba30 con 0x7f010406f1d0 2024-09-10T08:42:45.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.311+0000 7f01089ed640 1 -- 172.21.15.103:0/1852101807 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00fc006e50 con 0x7f010406f1d0 2024-09-10T08:42:45.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.312+0000 7f010bc53640 1 -- 172.21.15.103:0/1852101807 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f010406f1d0 msgr2=0x7f00f000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:45.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.312+0000 7f010bc53640 1 --2- 172.21.15.103:0/1852101807 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f010406f1d0 0x7f00f000b9c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00be30 tx=0x7f00f0005830 comp rx=0 tx=0).stop 2024-09-10T08:42:45.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.312+0000 7f010a1f0640 1 -- 172.21.15.103:0/1852101807 reap_dead start 2024-09-10T08:42:45.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.314+0000 7f010bc53640 1 -- 172.21.15.103:0/1852101807 shutdown_connections 2024-09-10T08:42:45.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.314+0000 7f010bc53640 1 -- 172.21.15.103:0/1852101807 >> 172.21.15.103:0/1852101807 conn(0x7f01040c7a40 msgr2=0x7f01040c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:45.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.314+0000 7f010bc53640 1 -- 172.21.15.103:0/1852101807 shutdown_connections 2024-09-10T08:42:45.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.315+0000 7f010bc53640 1 -- 172.21.15.103:0/1852101807 wait complete. 2024-09-10T08:42:45.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.316+0000 7f010bc53640 1 Processor -- start 2024-09-10T08:42:45.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.317+0000 7f010bc53640 1 -- start start 2024-09-10T08:42:45.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.318+0000 7f010bc53640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01041f3530 0x7f0104070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:45.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.318+0000 7f01099ef640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01041f3530 0x7f0104070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:45.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.318+0000 7f01099ef640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01041f3530 0x7f0104070bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55672/0 (socket says 172.21.15.103:55672) 2024-09-10T08:42:45.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.318+0000 7f01099ef640 1 -- 172.21.15.103:0/654079943 learned_addr learned my addr 172.21.15.103:0/654079943 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:45.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.318+0000 7f010bc53640 1 --2- 172.21.15.103:0/654079943 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0104155290 0x7f0104151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:45.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.318+0000 7f010bc53640 1 --2- 172.21.15.103:0/654079943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01041516c0 0x7f01040ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:45.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.318+0000 7f010bc53640 1 -- 172.21.15.103:0/654079943 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f010414fe70 con 0x7f01041f3530 2024-09-10T08:42:45.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.318+0000 7f010bc53640 1 -- 172.21.15.103:0/654079943 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f01040c2b10 con 0x7f01041516c0 2024-09-10T08:42:45.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.318+0000 7f010bc53640 1 -- 172.21.15.103:0/654079943 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f01040c4be0 con 0x7f0104155290 2024-09-10T08:42:45.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.319+0000 7f01099ef640 1 -- 172.21.15.103:0/654079943 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0104155290 msgr2=0x7f0104151180 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:42:45.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.319+0000 7f01099ef640 1 --2- 172.21.15.103:0/654079943 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0104155290 0x7f0104151180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:45.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.319+0000 7f01099ef640 1 -- 172.21.15.103:0/654079943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01041516c0 msgr2=0x7f01040ab9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:42:45.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.319+0000 7f01099ef640 1 --2- 172.21.15.103:0/654079943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01041516c0 0x7f01040ab9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:45.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.319+0000 7f01099ef640 1 -- 172.21.15.103:0/654079943 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01040acb20 con 0x7f01041f3530 2024-09-10T08:42:45.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.322+0000 7f01099ef640 1 --2- 172.21.15.103:0/654079943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01041f3530 0x7f0104070bc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f00f40067a0 tx=0x7f00f4006c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:45.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.322+0000 7f00fa7fc640 1 -- 172.21.15.103:0/654079943 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f4015070 con 0x7f01041f3530 2024-09-10T08:42:45.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.322+0000 7f00fa7fc640 1 -- 172.21.15.103:0/654079943 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f400fca0 con 0x7f01041f3530 2024-09-10T08:42:45.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.324+0000 7f00fa7fc640 1 -- 172.21.15.103:0/654079943 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f4011630 con 0x7f01041f3530 2024-09-10T08:42:45.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.324+0000 7f010bc53640 1 -- 172.21.15.103:0/654079943 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01040ace00 con 0x7f01041f3530 2024-09-10T08:42:45.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.324+0000 7f010bc53640 1 -- 172.21.15.103:0/654079943 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01041f4050 con 0x7f01041f3530 2024-09-10T08:42:45.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.325+0000 7f010bc53640 1 -- 172.21.15.103:0/654079943 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01040c8530 con 0x7f01041f3530 2024-09-10T08:42:45.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.327+0000 7f00fa7fc640 1 -- 172.21.15.103:0/654079943 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f00f4018070 con 0x7f01041f3530 2024-09-10T08:42:45.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.328+0000 7f00fa7fc640 1 --2- 172.21.15.103:0/654079943 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f00e806bf00 0x7f00e806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:45.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.328+0000 7f00fa7fc640 1 -- 172.21.15.103:0/654079943 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f00f408bba0 con 0x7f01041f3530 2024-09-10T08:42:45.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.331+0000 7f01091ee640 1 --2- 172.21.15.103:0/654079943 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f00e806bf00 0x7f00e806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:45.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.331+0000 7f01091ee640 1 --2- 172.21.15.103:0/654079943 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f00e806bf00 0x7f00e806e3c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0104151fd0 tx=0x7f010000f040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:45.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.335+0000 7f00fa7fc640 1 -- 172.21.15.103:0/654079943 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f00f405a220 con 0x7f01041f3530 2024-09-10T08:42:45.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.838+0000 7f010bc53640 1 -- 172.21.15.103:0/654079943 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f01040a7b50 con 0x7f01041f3530 2024-09-10T08:42:45.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.839+0000 7f00fa7fc640 1 -- 172.21.15.103:0/654079943 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f00f4059b20 con 0x7f01041f3530 2024-09-10T08:42:45.840 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":114,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:42:45.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.844+0000 7f010bc53640 1 -- 172.21.15.103:0/654079943 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f00e806bf00 msgr2=0x7f00e806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:45.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.844+0000 7f010bc53640 1 --2- 172.21.15.103:0/654079943 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f00e806bf00 0x7f00e806e3c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0104151fd0 tx=0x7f010000f040 comp rx=0 tx=0).stop 2024-09-10T08:42:45.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.844+0000 7f010bc53640 1 -- 172.21.15.103:0/654079943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01041f3530 msgr2=0x7f0104070bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:45.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.844+0000 7f010bc53640 1 --2- 172.21.15.103:0/654079943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01041f3530 0x7f0104070bc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f00f40067a0 tx=0x7f00f4006c60 comp rx=0 tx=0).stop 2024-09-10T08:42:45.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.845+0000 7f010bc53640 1 -- 172.21.15.103:0/654079943 shutdown_connections 2024-09-10T08:42:45.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.845+0000 7f010bc53640 1 --2- 172.21.15.103:0/654079943 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f00e806bf00 0x7f00e806e3c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:45.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.845+0000 7f010bc53640 1 --2- 172.21.15.103:0/654079943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01041516c0 0x7f01040ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:45.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.845+0000 7f010bc53640 1 --2- 172.21.15.103:0/654079943 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0104155290 0x7f0104151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:45.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.845+0000 7f010bc53640 1 --2- 172.21.15.103:0/654079943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01041f3530 0x7f0104070bc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:45.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.845+0000 7f010bc53640 1 -- 172.21.15.103:0/654079943 >> 172.21.15.103:0/654079943 conn(0x7f01040c7a40 msgr2=0x7f01041e6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:45.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.845+0000 7f010bc53640 1 -- 172.21.15.103:0/654079943 shutdown_connections 2024-09-10T08:42:45.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:45.845+0000 7f010bc53640 1 -- 172.21.15.103:0/654079943 wait complete. 2024-09-10T08:42:48.864 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:42:49.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.045+0000 7efdd7131640 1 Processor -- start 2024-09-10T08:42:49.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.045+0000 7efdd7131640 1 -- start start 2024-09-10T08:42:49.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.046+0000 7efdd7131640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efdd0157ff0 0x7efdd00c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:49.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.047+0000 7efdd7131640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efdd00c5940 0x7efdd015b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:49.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.047+0000 7efdd7131640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdd015e050 con 0x7efdd00c2980 2024-09-10T08:42:49.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.047+0000 7efdd4ecd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efdd0157ff0 0x7efdd00c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:49.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.047+0000 7efdd4ecd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efdd0157ff0 0x7efdd00c2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55674/0 (socket says 172.21.15.103:55674) 2024-09-10T08:42:49.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.047+0000 7efdd4ecd640 1 -- 172.21.15.103:0/3476254479 learned_addr learned my addr 172.21.15.103:0/3476254479 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:49.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.047+0000 7efdd7131640 1 -- 172.21.15.103:0/3476254479 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7efdd015b670 con 0x7efdd0157ff0 2024-09-10T08:42:49.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.047+0000 7efdd7131640 1 -- 172.21.15.103:0/3476254479 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7efdd015e330 con 0x7efdd00c5940 2024-09-10T08:42:49.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.048+0000 7efdd4ecd640 1 -- 172.21.15.103:0/3476254479 >> v2:172.21.15.154:3300/0 conn(0x7efdd00c5940 msgr2=0x7efdd015b130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:42:49.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.048+0000 7efdd4ecd640 1 --2- 172.21.15.103:0/3476254479 >> v2:172.21.15.154:3300/0 conn(0x7efdd00c5940 0x7efdd015b130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:49.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.048+0000 7efdd4ecd640 1 -- 172.21.15.103:0/3476254479 >> v1:172.21.15.154:6789/0 conn(0x7efdd00c2980 legacy=0x7efdd015aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:49.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.048+0000 7efdd4ecd640 1 -- 172.21.15.103:0/3476254479 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd015e610 con 0x7efdd0157ff0 2024-09-10T08:42:49.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.049+0000 7efdd4ecd640 1 --2- 172.21.15.103:0/3476254479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdd0157ff0 0x7efdd00c2440 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efdd00709c0 tx=0x7efdc802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c933497f6ace4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:49.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.050+0000 7efdcf7fe640 1 -- 172.21.15.103:0/3476254479 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8036070 con 0x7efdd0157ff0 2024-09-10T08:42:49.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.050+0000 7efdcf7fe640 1 -- 172.21.15.103:0/3476254479 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc8031600 con 0x7efdd0157ff0 2024-09-10T08:42:49.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.050+0000 7efdcf7fe640 1 -- 172.21.15.103:0/3476254479 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8031a10 con 0x7efdd0157ff0 2024-09-10T08:42:49.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.051+0000 7efdd7131640 1 -- 172.21.15.103:0/3476254479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdd0157ff0 msgr2=0x7efdd00c2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:49.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.051+0000 7efdd7131640 1 --2- 172.21.15.103:0/3476254479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdd0157ff0 0x7efdd00c2440 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efdd00709c0 tx=0x7efdc802a660 comp rx=0 tx=0).stop 2024-09-10T08:42:49.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.052+0000 7efdd7131640 1 -- 172.21.15.103:0/3476254479 shutdown_connections 2024-09-10T08:42:49.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.053+0000 7efdd7131640 1 --2- 172.21.15.103:0/3476254479 >> v2:172.21.15.154:3300/0 conn(0x7efdd00c5940 0x7efdd015b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:49.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.053+0000 7efdd7131640 1 --2- 172.21.15.103:0/3476254479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdd0157ff0 0x7efdd00c2440 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:49.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.053+0000 7efdd7131640 1 -- 172.21.15.103:0/3476254479 >> 172.21.15.103:0/3476254479 conn(0x7efdd00c7a40 msgr2=0x7efdd00c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:49.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.053+0000 7efdd7131640 1 -- 172.21.15.103:0/3476254479 shutdown_connections 2024-09-10T08:42:49.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.056+0000 7efdd7131640 1 -- 172.21.15.103:0/3476254479 wait complete. 2024-09-10T08:42:49.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.058+0000 7efdd7131640 1 Processor -- start 2024-09-10T08:42:49.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.058+0000 7efdd7131640 1 -- start start 2024-09-10T08:42:49.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.060+0000 7efdd7131640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdd00c2980 0x7efdd015cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:49.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.060+0000 7efdd7131640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd00c5940 0x7efdd014dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:49.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.060+0000 7efdd7131640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efdd0157ff0 0x7efdd014e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:49.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.060+0000 7efdd7131640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efdd015ddb0 con 0x7efdd00c2980 2024-09-10T08:42:49.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.060+0000 7efdd7131640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efdd015dc30 con 0x7efdd00c5940 2024-09-10T08:42:49.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.060+0000 7efdd4ecd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdd00c2980 0x7efdd015cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:49.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.060+0000 7efdd7131640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7efdd006f250 con 0x7efdd0157ff0 2024-09-10T08:42:49.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.060+0000 7efdd4ecd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdd00c2980 0x7efdd015cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55680/0 (socket says 172.21.15.103:55680) 2024-09-10T08:42:49.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.060+0000 7efdd4ecd640 1 -- 172.21.15.103:0/2409275224 learned_addr learned my addr 172.21.15.103:0/2409275224 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:49.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.060+0000 7efdcffff640 1 --2- 172.21.15.103:0/2409275224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd00c5940 0x7efdd014dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:49.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.060+0000 7efdd56ce640 1 --2- 172.21.15.103:0/2409275224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efdd0157ff0 0x7efdd014e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:49.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.060+0000 7efdcffff640 1 -- 172.21.15.103:0/2409275224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd00c5940 msgr2=0x7efdd014dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-10T08:42:49.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.060+0000 7efdcffff640 1 -- 172.21.15.103:0/2409275224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd00c5940 msgr2=0x7efdd014dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:42:49.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.060+0000 7efdcffff640 1 --2- 172.21.15.103:0/2409275224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd00c5940 0x7efdd014dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:42:49.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.061+0000 7efdcffff640 1 --2- 172.21.15.103:0/2409275224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd00c5940 0x7efdd014dca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:42:49.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.061+0000 7efdd4ecd640 1 -- 172.21.15.103:0/2409275224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efdd0157ff0 msgr2=0x7efdd014e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:49.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.061+0000 7efdd4ecd640 1 --2- 172.21.15.103:0/2409275224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efdd0157ff0 0x7efdd014e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:49.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.061+0000 7efdd4ecd640 1 -- 172.21.15.103:0/2409275224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd00c5940 msgr2=0x7efdd014dca0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:42:49.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.061+0000 7efdd4ecd640 1 --2- 172.21.15.103:0/2409275224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd00c5940 0x7efdd014dca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:49.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.061+0000 7efdd4ecd640 1 -- 172.21.15.103:0/2409275224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd00a9d60 con 0x7efdd00c2980 2024-09-10T08:42:49.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.062+0000 7efdd4ecd640 1 --2- 172.21.15.103:0/2409275224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdd00c2980 0x7efdd015cbb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009f40 tx=0x7efdc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:49.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.066+0000 7efdcd7fa640 1 -- 172.21.15.103:0/2409275224 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8041030 con 0x7efdd00c2980 2024-09-10T08:42:49.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.066+0000 7efdcd7fa640 1 -- 172.21.15.103:0/2409275224 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc8037040 con 0x7efdd00c2980 2024-09-10T08:42:49.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.066+0000 7efdcd7fa640 1 -- 172.21.15.103:0/2409275224 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8036070 con 0x7efdd00c2980 2024-09-10T08:42:49.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.067+0000 7efdd7131640 1 -- 172.21.15.103:0/2409275224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd01558f0 con 0x7efdd00c2980 2024-09-10T08:42:49.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.068+0000 7efdd7131640 1 -- 172.21.15.103:0/2409275224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd00a7a70 con 0x7efdd00c2980 2024-09-10T08:42:49.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.073+0000 7efdd7131640 1 -- 172.21.15.103:0/2409275224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd00c2440 con 0x7efdd00c2980 2024-09-10T08:42:49.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.073+0000 7efdcd7fa640 1 -- 172.21.15.103:0/2409275224 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efdc8044070 con 0x7efdd00c2980 2024-09-10T08:42:49.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.074+0000 7efdcd7fa640 1 --2- 172.21.15.103:0/2409275224 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efdbc06bf00 0x7efdbc06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:49.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.074+0000 7efdcffff640 1 --2- 172.21.15.103:0/2409275224 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efdbc06bf00 0x7efdbc06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:49.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.075+0000 7efdcffff640 1 --2- 172.21.15.103:0/2409275224 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efdbc06bf00 0x7efdbc06e3c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7efdd01e3de0 tx=0x7efdc4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:49.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.075+0000 7efdcd7fa640 1 -- 172.21.15.103:0/2409275224 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7efdc80abb60 con 0x7efdd00c2980 2024-09-10T08:42:49.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.093+0000 7efdcd7fa640 1 -- 172.21.15.103:0/2409275224 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efdc804b070 con 0x7efdd00c2980 2024-09-10T08:42:49.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.567+0000 7efdd7131640 1 -- 172.21.15.103:0/2409275224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7efdd006f030 con 0x7efdd00c2980 2024-09-10T08:42:49.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.569+0000 7efdcd7fa640 1 -- 172.21.15.103:0/2409275224 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7efdd00a9d60 con 0x7efdd00c2980 2024-09-10T08:42:49.578 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":114,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:42:49.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.581+0000 7efdd7131640 1 -- 172.21.15.103:0/2409275224 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efdbc06bf00 msgr2=0x7efdbc06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:49.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.581+0000 7efdd7131640 1 --2- 172.21.15.103:0/2409275224 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efdbc06bf00 0x7efdbc06e3c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7efdd01e3de0 tx=0x7efdc4009040 comp rx=0 tx=0).stop 2024-09-10T08:42:49.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.581+0000 7efdd7131640 1 -- 172.21.15.103:0/2409275224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdd00c2980 msgr2=0x7efdd015cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:49.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.581+0000 7efdd7131640 1 --2- 172.21.15.103:0/2409275224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdd00c2980 0x7efdd015cbb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009f40 tx=0x7efdc8004a40 comp rx=0 tx=0).stop 2024-09-10T08:42:49.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.581+0000 7efdd7131640 1 -- 172.21.15.103:0/2409275224 shutdown_connections 2024-09-10T08:42:49.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.581+0000 7efdd7131640 1 --2- 172.21.15.103:0/2409275224 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efdbc06bf00 0x7efdbc06e3c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:49.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.581+0000 7efdd7131640 1 --2- 172.21.15.103:0/2409275224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efdd0157ff0 0x7efdd014e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:49.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.581+0000 7efdd7131640 1 --2- 172.21.15.103:0/2409275224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdd00c5940 0x7efdd014dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:49.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.581+0000 7efdd7131640 1 --2- 172.21.15.103:0/2409275224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdd00c2980 0x7efdd015cbb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:49.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.581+0000 7efdd7131640 1 -- 172.21.15.103:0/2409275224 >> 172.21.15.103:0/2409275224 conn(0x7efdd00c7a40 msgr2=0x7efdd0156c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:49.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.582+0000 7efdd7131640 1 -- 172.21.15.103:0/2409275224 shutdown_connections 2024-09-10T08:42:49.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:49.582+0000 7efdd7131640 1 -- 172.21.15.103:0/2409275224 wait complete. 2024-09-10T08:42:52.603 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:42:52.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.809+0000 7f102cc2b640 1 Processor -- start 2024-09-10T08:42:52.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.809+0000 7f102cc2b640 1 -- start start 2024-09-10T08:42:52.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.810+0000 7f102cc2b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f102004ad70 0x7f1020046410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:52.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.811+0000 7f10277fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f10200d4230 0x7f1020006a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:41008/0 (socket says 172.21.15.103:41008) 2024-09-10T08:42:52.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.811+0000 7f102cc2b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1020047660 0x7f1020046950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:52.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.811+0000 7f102cc2b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f102002ea60 con 0x7f10200d4230 2024-09-10T08:42:52.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.811+0000 7f102cc2b640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f1020047440 con 0x7f102004ad70 2024-09-10T08:42:52.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.811+0000 7f1026ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f102004ad70 0x7f1020046410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:52.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.811+0000 7f102cc2b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f10200d7420 con 0x7f1020047660 2024-09-10T08:42:52.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.811+0000 7f1026ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f102004ad70 0x7f1020046410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55696/0 (socket says 172.21.15.103:55696) 2024-09-10T08:42:52.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.811+0000 7f1026ffd640 1 -- 172.21.15.103:0/2221679332 learned_addr learned my addr 172.21.15.103:0/2221679332 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:52.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.811+0000 7f1027fff640 1 --2- 172.21.15.103:0/2221679332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1020047660 0x7f1020046950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:52.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.811+0000 7f1026ffd640 1 -- 172.21.15.103:0/2221679332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1020047660 msgr2=0x7f1020046950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:52.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.811+0000 7f1026ffd640 1 --2- 172.21.15.103:0/2221679332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1020047660 0x7f1020046950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:52.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.811+0000 7f1026ffd640 1 -- 172.21.15.103:0/2221679332 >> v1:172.21.15.154:6789/0 conn(0x7f10200d4230 legacy=0x7f1020006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:52.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.811+0000 7f1026ffd640 1 -- 172.21.15.103:0/2221679332 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10200d7700 con 0x7f102004ad70 2024-09-10T08:42:52.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.813+0000 7f1026ffd640 1 --2- 172.21.15.103:0/2221679332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f102004ad70 0x7f1020046410 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f101c00bb10 tx=0x7f101c00b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ee6cb9b691042e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:52.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.814+0000 7f10267fc640 1 -- 172.21.15.103:0/2221679332 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c033710 con 0x7f102004ad70 2024-09-10T08:42:52.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.814+0000 7f10267fc640 1 -- 172.21.15.103:0/2221679332 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f101c0338b0 con 0x7f102004ad70 2024-09-10T08:42:52.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.814+0000 7f10267fc640 1 -- 172.21.15.103:0/2221679332 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c033c80 con 0x7f102004ad70 2024-09-10T08:42:52.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.815+0000 7f102cc2b640 1 -- 172.21.15.103:0/2221679332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f102004ad70 msgr2=0x7f1020046410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:52.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.815+0000 7f102cc2b640 1 --2- 172.21.15.103:0/2221679332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f102004ad70 0x7f1020046410 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f101c00bb10 tx=0x7f101c00b450 comp rx=0 tx=0).stop 2024-09-10T08:42:52.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.820+0000 7f102cc2b640 1 -- 172.21.15.103:0/2221679332 shutdown_connections 2024-09-10T08:42:52.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.820+0000 7f102cc2b640 1 --2- 172.21.15.103:0/2221679332 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1020047660 0x7f1020046950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:52.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.820+0000 7f102cc2b640 1 --2- 172.21.15.103:0/2221679332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f102004ad70 0x7f1020046410 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:52.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.820+0000 7f102cc2b640 1 -- 172.21.15.103:0/2221679332 >> 172.21.15.103:0/2221679332 conn(0x7f1020047d10 msgr2=0x7f1020048120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:52.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.821+0000 7f102cc2b640 1 -- 172.21.15.103:0/2221679332 shutdown_connections 2024-09-10T08:42:52.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.821+0000 7f102cc2b640 1 -- 172.21.15.103:0/2221679332 wait complete. 2024-09-10T08:42:52.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.823+0000 7f102cc2b640 1 Processor -- start 2024-09-10T08:42:52.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.823+0000 7f102cc2b640 1 -- start start 2024-09-10T08:42:52.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.824+0000 7f102cc2b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1020047660 0x7f1020042640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:52.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.824+0000 7f102cc2b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f102004ad70 0x7f10200cf620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:52.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.825+0000 7f102cc2b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10200d4230 0x7f10200d5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:52.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.825+0000 7f1026ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f102004ad70 0x7f10200cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:52.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.825+0000 7f1026ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f102004ad70 0x7f10200cf620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:59870/0 (socket says 172.21.15.103:59870) 2024-09-10T08:42:52.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.825+0000 7f1026ffd640 1 -- 172.21.15.103:0/2487317901 learned_addr learned my addr 172.21.15.103:0/2487317901 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:52.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.825+0000 7f1027fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10200d4230 0x7f10200d5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:52.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.825+0000 7f102cc2b640 1 -- 172.21.15.103:0/2487317901 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1020047130 con 0x7f10200d4230 2024-09-10T08:42:52.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.825+0000 7f102cc2b640 1 -- 172.21.15.103:0/2487317901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1020045ef0 con 0x7f102004ad70 2024-09-10T08:42:52.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.825+0000 7f102cc2b640 1 -- 172.21.15.103:0/2487317901 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f1020009a40 con 0x7f1020047660 2024-09-10T08:42:52.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.826+0000 7f10277fe640 1 --2- 172.21.15.103:0/2487317901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1020047660 0x7f1020042640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:52.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.826+0000 7f1026ffd640 1 -- 172.21.15.103:0/2487317901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1020047660 msgr2=0x7f1020042640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:52.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.826+0000 7f1026ffd640 1 --2- 172.21.15.103:0/2487317901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1020047660 0x7f1020042640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:52.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.826+0000 7f1026ffd640 1 -- 172.21.15.103:0/2487317901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10200d4230 msgr2=0x7f10200d5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:52.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.826+0000 7f1026ffd640 1 --2- 172.21.15.103:0/2487317901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10200d4230 0x7f10200d5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:52.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.826+0000 7f1026ffd640 1 -- 172.21.15.103:0/2487317901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f102016be90 con 0x7f102004ad70 2024-09-10T08:42:52.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.827+0000 7f10277fe640 1 --2- 172.21.15.103:0/2487317901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1020047660 0x7f1020042640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:42:52.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.827+0000 7f1027fff640 1 --2- 172.21.15.103:0/2487317901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10200d4230 0x7f10200d5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:42:52.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.827+0000 7f1026ffd640 1 --2- 172.21.15.103:0/2487317901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f102004ad70 0x7f10200cf620 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f101c00bc30 tx=0x7f101c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:52.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.829+0000 7f1013fff640 1 -- 172.21.15.103:0/2487317901 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c043030 con 0x7f102004ad70 2024-09-10T08:42:52.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.829+0000 7f1013fff640 1 -- 172.21.15.103:0/2487317901 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f101c035d40 con 0x7f102004ad70 2024-09-10T08:42:52.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.829+0000 7f102cc2b640 1 -- 172.21.15.103:0/2487317901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10200cc870 con 0x7f102004ad70 2024-09-10T08:42:52.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.829+0000 7f102cc2b640 1 -- 172.21.15.103:0/2487317901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10200d04a0 con 0x7f102004ad70 2024-09-10T08:42:52.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.832+0000 7f1013fff640 1 -- 172.21.15.103:0/2487317901 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c03f660 con 0x7f102004ad70 2024-09-10T08:42:52.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.832+0000 7f1011ffb640 1 -- 172.21.15.103:0/2487317901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f102002ac00 con 0x7f102004ad70 2024-09-10T08:42:52.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.832+0000 7f1013fff640 1 -- 172.21.15.103:0/2487317901 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f101c046030 con 0x7f102004ad70 2024-09-10T08:42:52.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.833+0000 7f1013fff640 1 --2- 172.21.15.103:0/2487317901 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f100c06bf00 0x7f100c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:52.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.834+0000 7f1013fff640 1 -- 172.21.15.103:0/2487317901 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f101c0b0110 con 0x7f102004ad70 2024-09-10T08:42:52.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.834+0000 7f10277fe640 1 --2- 172.21.15.103:0/2487317901 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f100c06bf00 0x7f100c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:52.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.836+0000 7f10277fe640 1 --2- 172.21.15.103:0/2487317901 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f100c06bf00 0x7f100c06e3c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1014000f60 tx=0x7f1014009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:52.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:52.842+0000 7f1013fff640 1 -- 172.21.15.103:0/2487317901 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f101c07e180 con 0x7f102004ad70 2024-09-10T08:42:53.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.355+0000 7f1011ffb640 1 -- 172.21.15.103:0/2487317901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1020031210 con 0x7f102004ad70 2024-09-10T08:42:53.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.356+0000 7f1013fff640 1 -- 172.21.15.103:0/2487317901 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f101c082480 con 0x7f102004ad70 2024-09-10T08:42:53.356 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":116,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:42:53.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.360+0000 7f1011ffb640 1 -- 172.21.15.103:0/2487317901 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f100c06bf00 msgr2=0x7f100c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:53.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.361+0000 7f1011ffb640 1 --2- 172.21.15.103:0/2487317901 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f100c06bf00 0x7f100c06e3c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1014000f60 tx=0x7f1014009040 comp rx=0 tx=0).stop 2024-09-10T08:42:53.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.361+0000 7f1011ffb640 1 -- 172.21.15.103:0/2487317901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f102004ad70 msgr2=0x7f10200cf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:53.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.361+0000 7f1011ffb640 1 --2- 172.21.15.103:0/2487317901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f102004ad70 0x7f10200cf620 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f101c00bc30 tx=0x7f101c004730 comp rx=0 tx=0).stop 2024-09-10T08:42:53.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.361+0000 7f1011ffb640 1 -- 172.21.15.103:0/2487317901 shutdown_connections 2024-09-10T08:42:53.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.361+0000 7f1011ffb640 1 --2- 172.21.15.103:0/2487317901 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f100c06bf00 0x7f100c06e3c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:53.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.361+0000 7f1011ffb640 1 --2- 172.21.15.103:0/2487317901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10200d4230 0x7f10200d5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:53.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.361+0000 7f1011ffb640 1 --2- 172.21.15.103:0/2487317901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f102004ad70 0x7f10200cf620 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:53.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.361+0000 7f1011ffb640 1 --2- 172.21.15.103:0/2487317901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1020047660 0x7f1020042640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:53.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.361+0000 7f1011ffb640 1 -- 172.21.15.103:0/2487317901 >> 172.21.15.103:0/2487317901 conn(0x7f1020047d10 msgr2=0x7f1020009ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:53.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.362+0000 7f1011ffb640 1 -- 172.21.15.103:0/2487317901 shutdown_connections 2024-09-10T08:42:53.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.362+0000 7f1011ffb640 1 -- 172.21.15.103:0/2487317901 wait complete. 2024-09-10T08:42:53.385 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:42:53.385 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:42:53.385 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:42:53.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.593+0000 7fc5c51f8640 1 Processor -- start 2024-09-10T08:42:53.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.593+0000 7fc5c51f8640 1 -- start start 2024-09-10T08:42:53.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.594+0000 7fc5c51f8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5c014fa00 0x7fc5c006e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:53.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.594+0000 7fc5c51f8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc5c0152320 0x7fc5c0156470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:53.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.594+0000 7fc5c51f8640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c0152890 con 0x7fc5c006e9f0 2024-09-10T08:42:53.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.594+0000 7fc5c51f8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc5c00bd0d0 con 0x7fc5c0152320 2024-09-10T08:42:53.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.594+0000 7fc5c51f8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc5c0152b70 con 0x7fc5c014fa00 2024-09-10T08:42:53.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.596+0000 7fc5bed9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5c014fa00 0x7fc5c006e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:53.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.596+0000 7fc5bf59e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc5c0152320 0x7fc5c0156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:53.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.596+0000 7fc5bed9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5c014fa00 0x7fc5c006e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:59818/0 (socket says 172.21.15.103:59818) 2024-09-10T08:42:53.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.596+0000 7fc5bed9d640 1 -- 172.21.15.103:0/1747668573 learned_addr learned my addr 172.21.15.103:0/1747668573 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:53.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.596+0000 7fc5bed9d640 1 -- 172.21.15.103:0/1747668573 >> v2:172.21.15.154:3300/0 conn(0x7fc5c0152320 msgr2=0x7fc5c0156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:53.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.596+0000 7fc5bed9d640 1 --2- 172.21.15.103:0/1747668573 >> v2:172.21.15.154:3300/0 conn(0x7fc5c0152320 0x7fc5c0156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:53.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.596+0000 7fc5bed9d640 1 -- 172.21.15.103:0/1747668573 >> v1:172.21.15.103:6789/0 conn(0x7fc5c006e9f0 legacy=0x7fc5c0155d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:42:53.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.597+0000 7fc5bed9d640 1 -- 172.21.15.103:0/1747668573 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c0152e50 con 0x7fc5c014fa00 2024-09-10T08:42:53.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.598+0000 7fc5bed9d640 1 --2- 172.21.15.103:0/1747668573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5c014fa00 0x7fc5c006e4b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc5b000b970 tx=0x7fc5b002a840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee7e389e87794016 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:53.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.600+0000 7fc5bdd9b640 1 -- 172.21.15.103:0/1747668573 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0039070 con 0x7fc5c014fa00 2024-09-10T08:42:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.600+0000 7fc5bdd9b640 1 -- 172.21.15.103:0/1747668573 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b0031670 con 0x7fc5c014fa00 2024-09-10T08:42:53.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.600+0000 7fc5bdd9b640 1 -- 172.21.15.103:0/1747668573 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0031a80 con 0x7fc5c014fa00 2024-09-10T08:42:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.601+0000 7fc5c51f8640 1 -- 172.21.15.103:0/1747668573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5c014fa00 msgr2=0x7fc5c006e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.601+0000 7fc5c51f8640 1 --2- 172.21.15.103:0/1747668573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5c014fa00 0x7fc5c006e4b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc5b000b970 tx=0x7fc5b002a840 comp rx=0 tx=0).stop 2024-09-10T08:42:53.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.602+0000 7fc5c51f8640 1 -- 172.21.15.103:0/1747668573 shutdown_connections 2024-09-10T08:42:53.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.602+0000 7fc5c51f8640 1 --2- 172.21.15.103:0/1747668573 >> v2:172.21.15.154:3300/0 conn(0x7fc5c0152320 0x7fc5c0156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:53.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.602+0000 7fc5c51f8640 1 --2- 172.21.15.103:0/1747668573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5c014fa00 0x7fc5c006e4b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:53.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.602+0000 7fc5c51f8640 1 -- 172.21.15.103:0/1747668573 >> 172.21.15.103:0/1747668573 conn(0x7fc5c00c4bb0 msgr2=0x7fc5c00c4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:53.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.608+0000 7fc5c51f8640 1 -- 172.21.15.103:0/1747668573 shutdown_connections 2024-09-10T08:42:53.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.611+0000 7fc5c51f8640 1 -- 172.21.15.103:0/1747668573 wait complete. 2024-09-10T08:42:53.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.614+0000 7fc5c51f8640 1 Processor -- start 2024-09-10T08:42:53.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.614+0000 7fc5c51f8640 1 -- start start 2024-09-10T08:42:53.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.615+0000 7fc5c51f8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5c006e9f0 0x7fc5c01de0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:53.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.615+0000 7fc5c51f8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5c014fa00 0x7fc5c00acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:53.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.615+0000 7fc5c51f8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5c0152320 0x7fc5c01f84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:53.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.615+0000 7fc5c51f8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c00c58c0 con 0x7fc5c014fa00 2024-09-10T08:42:53.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.615+0000 7fc5c51f8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c00c5740 con 0x7fc5c0152320 2024-09-10T08:42:53.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.615+0000 7fc5c51f8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc5c0068f80 con 0x7fc5c006e9f0 2024-09-10T08:42:53.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.616+0000 7fc5bf59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5c0152320 0x7fc5c01f84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:53.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.616+0000 7fc5bed9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5c006e9f0 0x7fc5c01de0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:53.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.616+0000 7fc5bf59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5c0152320 0x7fc5c01f84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:59888/0 (socket says 172.21.15.103:59888) 2024-09-10T08:42:53.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.616+0000 7fc5bf59e640 1 -- 172.21.15.103:0/1461552259 learned_addr learned my addr 172.21.15.103:0/1461552259 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:53.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.616+0000 7fc5be59c640 1 --2- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5c014fa00 0x7fc5c00acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:53.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.616+0000 7fc5be59c640 1 -- 172.21.15.103:0/1461552259 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5c006e9f0 msgr2=0x7fc5c01de0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:53.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.616+0000 7fc5be59c640 1 --2- 172.21.15.103:0/1461552259 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5c006e9f0 0x7fc5c01de0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:53.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.616+0000 7fc5be59c640 1 -- 172.21.15.103:0/1461552259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5c0152320 msgr2=0x7fc5c01f84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:53.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.616+0000 7fc5be59c640 1 --2- 172.21.15.103:0/1461552259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5c0152320 0x7fc5c01f84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:53.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.616+0000 7fc5be59c640 1 -- 172.21.15.103:0/1461552259 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c01f9ef0 con 0x7fc5c014fa00 2024-09-10T08:42:53.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.616+0000 7fc5bf59e640 1 --2- 172.21.15.103:0/1461552259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5c0152320 0x7fc5c01f84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:42:53.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.617+0000 7fc5be59c640 1 --2- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5c014fa00 0x7fc5c00acbf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800bdf0 tx=0x7fc5b8009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:53.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.618+0000 7fc5a77fe640 1 -- 172.21.15.103:0/1461552259 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8019070 con 0x7fc5c014fa00 2024-09-10T08:42:53.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.618+0000 7fc5c51f8640 1 -- 172.21.15.103:0/1461552259 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c00ac030 con 0x7fc5c014fa00 2024-09-10T08:42:53.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.618+0000 7fc5c51f8640 1 -- 172.21.15.103:0/1461552259 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c00ac5f0 con 0x7fc5c014fa00 2024-09-10T08:42:53.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.619+0000 7fc5a77fe640 1 -- 172.21.15.103:0/1461552259 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b8014440 con 0x7fc5c014fa00 2024-09-10T08:42:53.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.619+0000 7fc5a77fe640 1 -- 172.21.15.103:0/1461552259 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8014830 con 0x7fc5c014fa00 2024-09-10T08:42:53.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.620+0000 7fc5c51f8640 1 --2- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a0002a70 0x7fc5a0004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:53.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.620+0000 7fc5c51f8640 1 -- 172.21.15.103:0/1461552259 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a0007ec0 con 0x7fc5a0002a70 2024-09-10T08:42:53.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.623+0000 7fc5bed9d640 1 --2- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a0002a70 0x7fc5a0004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:53.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.624+0000 7fc5bed9d640 1 -- 172.21.15.103:0/1461552259 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc5a00080c0 con 0x7fc5a0002a70 2024-09-10T08:42:53.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.624+0000 7fc5bed9d640 1 --2- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a0002a70 0x7fc5a0004f30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00bf340 tx=0x7fc5b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:53.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.631+0000 7fc5a77fe640 1 -- 172.21.15.103:0/1461552259 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0045070 con 0x7fc5a0002a70 2024-09-10T08:42:53.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.631+0000 7fc5a77fe640 1 -- 172.21.15.103:0/1461552259 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc5b003e640 con 0x7fc5a0002a70 2024-09-10T08:42:53.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.631+0000 7fc5a77fe640 1 -- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a0002a70 msgr2=0x7fc5a0004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:53.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.631+0000 7fc5a77fe640 1 --2- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a0002a70 0x7fc5a0004f30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00bf340 tx=0x7fc5b00046c0 comp rx=0 tx=0).stop 2024-09-10T08:42:53.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.631+0000 7fc5a77fe640 1 -- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a0002a70 msgr2=0x7fc5a0004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:42:53.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.631+0000 7fc5a77fe640 1 --2- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a0002a70 0x7fc5a0004f30 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00bf340 tx=0x7fc5b00046c0 comp rx=0 tx=0).stop 2024-09-10T08:42:53.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.632+0000 7fc5a77fe640 1 -- 172.21.15.103:0/1461552259 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc5b801c360 con 0x7fc5c014fa00 2024-09-10T08:42:53.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.632+0000 7fc5a77fe640 1 --2- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc5ac06b960 0x7fc5ac06de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:53.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.632+0000 7fc5a77fe640 1 -- 172.21.15.103:0/1461552259 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fc5b808b080 con 0x7fc5c014fa00 2024-09-10T08:42:53.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.633+0000 7fc5bed9d640 1 --2- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc5ac06b960 0x7fc5ac06de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:53.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.634+0000 7fc5bed9d640 1 --2- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc5ac06b960 0x7fc5ac06de20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0008090 tx=0x7fc5b004b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:53.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.677+0000 7fc5c51f8640 1 --2- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a0006f00 0x7fc5a0007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:53.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.677+0000 7fc5c51f8640 1 -- 172.21.15.103:0/1461552259 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a000a4a0 con 0x7fc5a0006f00 2024-09-10T08:42:53.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.677+0000 7fc5bf59e640 1 --2- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a0006f00 0x7fc5a0007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:53.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.678+0000 7fc5bf59e640 1 -- 172.21.15.103:0/1461552259 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc5a00078d0 con 0x7fc5a0006f00 2024-09-10T08:42:53.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.678+0000 7fc5bf59e640 1 --2- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a0006f00 0x7fc5a0007390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc5b400deb0 tx=0x7fc5b400c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:53.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.680+0000 7fc5a77fe640 1 -- 172.21.15.103:0/1461552259 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b401b030 con 0x7fc5a0006f00 2024-09-10T08:42:53.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.680+0000 7fc5a77fe640 1 -- 172.21.15.103:0/1461552259 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5057 (secure 0 0 0) 0x7fc5b4017600 con 0x7fc5a0006f00 2024-09-10T08:42:53.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.680+0000 7fc5a77fe640 1 -- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a0006f00 msgr2=0x7fc5a0007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:53.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.680+0000 7fc5a77fe640 1 --2- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a0006f00 0x7fc5a0007390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc5b400deb0 tx=0x7fc5b400c790 comp rx=0 tx=0).stop 2024-09-10T08:42:53.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.680+0000 7fc5a77fe640 1 -- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a0006f00 msgr2=0x7fc5a0007390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:42:53.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.680+0000 7fc5a77fe640 1 --2- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a0006f00 0x7fc5a0007390 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:53.682 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:42:53.682 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:42:53.683 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:42:53.683 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:42:53.683 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 116, 2024-09-10T08:42:53.683 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 200143, 2024-09-10T08:42:53.684 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:42:53.684 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:42:53.684 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:42:53.684 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:42:53.685 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:53.685 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 3, 2024-09-10T08:42:53.685 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:42:53.685 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:42:53.685 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:42:53.685 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:53.685 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:53.685 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:53.686 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:53.686 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:53.686 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:53.686 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:53.686 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:53.686 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:53.686 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:53.686 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:53.686 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:53.686 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:42:53.687 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:42:53.687 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:53.687 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:53.687 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:53.687 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:53.687 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:53.687 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:53.687 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:53.687 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:53.687 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:53.688 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:53.688 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:53.688 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:53.688 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:53.688 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:42:53.688 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:42:53.688 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:42:53.689 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:42:53.689 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:42:53.689 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:42:53.689 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:42:53.689 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:42:53.689 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:42:53.690 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:42:53.690 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:42:53.690 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:42:53.690 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:42:53.690 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:42:53.690 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:42:53.691 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:42:53.691 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:42:53.691 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:53.691 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:53.691 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:53.691 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:53.692 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:53.692 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:53.692 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:53.692 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:53.692 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:53.692 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:53.693 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:53.693 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:53.693 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:42:53.693 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:53.693 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:42:53.693 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:53.694 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:42:53.694 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:42:53.694 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:53.694 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:53.694 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:53.694 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:53.694 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:42:53.695 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:53.695 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:53.695 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:53.695 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:53.695 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:42:53.695 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:53.696 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:53.696 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:53.696 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:53.696 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:42:53.696 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:42:53.696 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:53.697 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:53.697 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:53.697 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:53.697 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:53.697 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:42:53.698 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:42:53.698 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:53.698 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:53.698 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:53.698 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:53.698 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:42:53.698 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:53.699 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:53.699 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:53.699 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:53.699 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:42:53.699 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:53.699 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:53.700 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:53.700 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:53.700 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:42:53.700 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:42:53.700 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:53.700 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:53.700 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:53.701 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:53.701 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:53.701 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:42:53.701 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:42:53.701 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:53.701 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:53.702 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:53.702 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:53.702 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:42:53.702 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:53.702 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:53.702 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:53.702 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:53.702 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:42:53.702 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:53.702 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:53.702 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:53.702 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:53.703 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:42:53.703 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:42:53.703 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:53.703 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:53.703 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:53.703 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:53.703 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:53.704 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:53.704 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:42:53.704 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:42:53.704 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:53.704 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:53.704 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:53.704 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:42:53.704 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:53.704 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:53.704 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:42:53.704 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:53.704 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:53.705 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:53.705 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:42:53.705 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:53.705 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:53.705 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:42:53.705 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:53.705 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:53.705 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:53.705 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:42:53.705 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:53.705 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:53.705 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:42:53.705 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:53.706 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:53.706 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:53.706 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 8 2024-09-10T08:42:53.706 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:53.706 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:53.706 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:42:53.706 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:53.706 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:53.706 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:53.706 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:42:53.706 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:53.706 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:53.707 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:53.707 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:42:53.707 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:42:53.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.681+0000 7fc5c51f8640 1 -- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc5ac06b960 msgr2=0x7fc5ac06de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:53.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.681+0000 7fc5c51f8640 1 --2- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc5ac06b960 0x7fc5ac06de20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0008090 tx=0x7fc5b004b040 comp rx=0 tx=0).stop 2024-09-10T08:42:53.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.681+0000 7fc5bf59e640 1 -- 172.21.15.103:0/1461552259 reap_dead start 2024-09-10T08:42:53.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.681+0000 7fc5c51f8640 1 -- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5c014fa00 msgr2=0x7fc5c00acbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:53.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.681+0000 7fc5c51f8640 1 --2- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5c014fa00 0x7fc5c00acbf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800bdf0 tx=0x7fc5b8009f70 comp rx=0 tx=0).stop 2024-09-10T08:42:53.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.683+0000 7fc5c51f8640 1 -- 172.21.15.103:0/1461552259 shutdown_connections 2024-09-10T08:42:53.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.683+0000 7fc5c51f8640 1 --2- 172.21.15.103:0/1461552259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5c014fa00 0x7fc5c00acbf0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:53.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.683+0000 7fc5c51f8640 1 -- 172.21.15.103:0/1461552259 >> 172.21.15.103:0/1461552259 conn(0x7fc5c00c4bb0 msgr2=0x7fc5c00bdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:53.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.688+0000 7fc5c51f8640 1 -- 172.21.15.103:0/1461552259 shutdown_connections 2024-09-10T08:42:53.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.688+0000 7fc5c51f8640 1 -- 172.21.15.103:0/1461552259 wait complete. 2024-09-10T08:42:53.713 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:42:53.714 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:42:53.714 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:42:53.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.921+0000 7f444e4a8640 1 Processor -- start 2024-09-10T08:42:53.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.921+0000 7f444e4a8640 1 -- start start 2024-09-10T08:42:53.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.922+0000 7f444e4a8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4448153760 0x7f444806bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:53.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.922+0000 7f444e4a8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44480cc660 0x7f44480cad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:53.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.922+0000 7f444e4a8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f444815a160 con 0x7f44480cb5c0 2024-09-10T08:42:53.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.922+0000 7f444e4a8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f444815a440 con 0x7f4448153760 2024-09-10T08:42:53.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.922+0000 7f444e4a8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f44480c64f0 con 0x7f44480cc660 2024-09-10T08:42:53.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.923+0000 7f444dca7640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f44480cb5c0 0x7f4448159620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:41014/0 (socket says 172.21.15.103:41014) 2024-09-10T08:42:53.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.923+0000 7f444dca7640 1 -- 172.21.15.103:0/348984075 learned_addr learned my addr 172.21.15.103:0/348984075 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:42:53.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.923+0000 7f444cca5640 1 --2- 172.21.15.103:0/348984075 >> v2:172.21.15.154:3300/0 conn(0x7f44480cc660 0x7f44480cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:53.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.923+0000 7f444d4a6640 1 --2- 172.21.15.103:0/348984075 >> v2:172.21.15.103:3300/0 conn(0x7f4448153760 0x7f444806bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:53.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.923+0000 7f444d4a6640 1 -- 172.21.15.103:0/348984075 >> v2:172.21.15.154:3300/0 conn(0x7f44480cc660 msgr2=0x7f44480cad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:53.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.923+0000 7f444d4a6640 1 --2- 172.21.15.103:0/348984075 >> v2:172.21.15.154:3300/0 conn(0x7f44480cc660 0x7f44480cad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:53.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.923+0000 7f444d4a6640 1 -- 172.21.15.103:0/348984075 >> v1:172.21.15.154:6789/0 conn(0x7f44480cb5c0 legacy=0x7f4448159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:53.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.923+0000 7f444d4a6640 1 -- 172.21.15.103:0/348984075 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44480c67d0 con 0x7f4448153760 2024-09-10T08:42:53.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.929+0000 7f444d4a6640 1 --2- 172.21.15.103:0/348984075 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4448153760 0x7f444806bbe0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f44480c9e90 tx=0x7f444402a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf4d4fcfdc3b885 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:53.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.930+0000 7f443ffff640 1 -- 172.21.15.103:0/348984075 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4444037070 con 0x7f4448153760 2024-09-10T08:42:53.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.930+0000 7f443ffff640 1 -- 172.21.15.103:0/348984075 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f444402ade0 con 0x7f4448153760 2024-09-10T08:42:53.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.930+0000 7f443ffff640 1 -- 172.21.15.103:0/348984075 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4444032660 con 0x7f4448153760 2024-09-10T08:42:53.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.931+0000 7f444e4a8640 1 -- 172.21.15.103:0/348984075 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4448153760 msgr2=0x7f444806bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:53.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.931+0000 7f444e4a8640 1 --2- 172.21.15.103:0/348984075 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4448153760 0x7f444806bbe0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f44480c9e90 tx=0x7f444402a0d0 comp rx=0 tx=0).stop 2024-09-10T08:42:53.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.931+0000 7f444e4a8640 1 -- 172.21.15.103:0/348984075 shutdown_connections 2024-09-10T08:42:53.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.931+0000 7f444e4a8640 1 --2- 172.21.15.103:0/348984075 >> v2:172.21.15.154:3300/0 conn(0x7f44480cc660 0x7f44480cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:53.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.931+0000 7f444e4a8640 1 --2- 172.21.15.103:0/348984075 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4448153760 0x7f444806bbe0 secure :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f44480c9e90 tx=0x7f444402a0d0 comp rx=0 tx=0).stop 2024-09-10T08:42:53.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.931+0000 7f444e4a8640 1 -- 172.21.15.103:0/348984075 >> 172.21.15.103:0/348984075 conn(0x7f44480cbb70 msgr2=0x7f44480cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:53.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.934+0000 7f444e4a8640 1 -- 172.21.15.103:0/348984075 shutdown_connections 2024-09-10T08:42:53.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.934+0000 7f444e4a8640 1 -- 172.21.15.103:0/348984075 wait complete. 2024-09-10T08:42:53.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.936+0000 7f444e4a8640 1 Processor -- start 2024-09-10T08:42:53.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.936+0000 7f444e4a8640 1 -- start start 2024-09-10T08:42:53.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.937+0000 7f444e4a8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44480cb5c0 0x7f44481e02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:53.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.937+0000 7f444e4a8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44480cc660 0x7f44481e1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:53.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.937+0000 7f444e4a8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4448143610 0x7f44481e1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:53.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.937+0000 7f444e4a8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f44480c6c30 con 0x7f44480cc660 2024-09-10T08:42:53.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.937+0000 7f444e4a8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f44480c6ab0 con 0x7f4448143610 2024-09-10T08:42:53.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.938+0000 7f444e4a8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f44480c81c0 con 0x7f44480cb5c0 2024-09-10T08:42:53.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.938+0000 7f444cca5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44480cc660 0x7f44481e1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:53.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.938+0000 7f444cca5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44480cc660 0x7f44481e1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55768/0 (socket says 172.21.15.103:55768) 2024-09-10T08:42:53.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.938+0000 7f444cca5640 1 -- 172.21.15.103:0/3502251074 learned_addr learned my addr 172.21.15.103:0/3502251074 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:53.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.938+0000 7f444d4a6640 1 --2- 172.21.15.103:0/3502251074 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44480cb5c0 0x7f44481e02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:53.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.938+0000 7f444cca5640 1 -- 172.21.15.103:0/3502251074 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44480cb5c0 msgr2=0x7f44481e02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:53.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.938+0000 7f444cca5640 1 --2- 172.21.15.103:0/3502251074 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44480cb5c0 0x7f44481e02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:53.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.938+0000 7f444cca5640 1 -- 172.21.15.103:0/3502251074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4448143610 msgr2=0x7f44481e1d30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:42:53.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.938+0000 7f444cca5640 1 --2- 172.21.15.103:0/3502251074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4448143610 0x7f44481e1d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:53.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.938+0000 7f444cca5640 1 -- 172.21.15.103:0/3502251074 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44481ec8b0 con 0x7f44480cc660 2024-09-10T08:42:53.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.939+0000 7f444cca5640 1 --2- 172.21.15.103:0/3502251074 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44480cc660 0x7f44481e1050 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4440007e60 tx=0x7f444000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:53.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.939+0000 7f443dffb640 1 -- 172.21.15.103:0/3502251074 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4440014620 con 0x7f44480cc660 2024-09-10T08:42:53.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.939+0000 7f444e4a8640 1 -- 172.21.15.103:0/3502251074 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44481ecb90 con 0x7f44480cc660 2024-09-10T08:42:53.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.940+0000 7f444e4a8640 1 -- 172.21.15.103:0/3502251074 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44481dfaf0 con 0x7f44480cc660 2024-09-10T08:42:53.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.941+0000 7f443dffb640 1 -- 172.21.15.103:0/3502251074 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4440019070 con 0x7f44480cc660 2024-09-10T08:42:53.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.941+0000 7f443dffb640 1 -- 172.21.15.103:0/3502251074 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4440014a00 con 0x7f44480cc660 2024-09-10T08:42:53.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.943+0000 7f443dffb640 1 -- 172.21.15.103:0/3502251074 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4440014ba0 con 0x7f44480cc660 2024-09-10T08:42:53.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.944+0000 7f443dffb640 1 --2- 172.21.15.103:0/3502251074 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f442c06bf00 0x7f442c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:53.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.944+0000 7f443dffb640 1 -- 172.21.15.103:0/3502251074 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f444008b900 con 0x7f44480cc660 2024-09-10T08:42:53.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.944+0000 7f444e4a8640 1 --2- 172.21.15.103:0/3502251074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4428002a70 0x7f4428004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:53.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.944+0000 7f444e4a8640 1 -- 172.21.15.103:0/3502251074 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4428007ec0 con 0x7f4428002a70 2024-09-10T08:42:53.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.945+0000 7f444d4a6640 1 --2- 172.21.15.103:0/3502251074 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f442c06bf00 0x7f442c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:53.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.946+0000 7f444d4a6640 1 --2- 172.21.15.103:0/3502251074 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f442c06bf00 0x7f442c06e3c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4444034000 tx=0x7f444402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:53.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.956+0000 7f444dca7640 1 --2- 172.21.15.103:0/3502251074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4428002a70 0x7f4428004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:53.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.963+0000 7f444dca7640 1 -- 172.21.15.103:0/3502251074 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f44280080c0 con 0x7f4428002a70 2024-09-10T08:42:53.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.963+0000 7f444dca7640 1 --2- 172.21.15.103:0/3502251074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4428002a70 0x7f4428004f30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f443800c130 tx=0x7f443800c5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:53.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.966+0000 7f443dffb640 1 -- 172.21.15.103:0/3502251074 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4438017070 con 0x7f4428002a70 2024-09-10T08:42:53.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.966+0000 7f443dffb640 1 -- 172.21.15.103:0/3502251074 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f443800ce90 con 0x7f4428002a70 2024-09-10T08:42:53.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.966+0000 7f443dffb640 1 -- 172.21.15.103:0/3502251074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4428002a70 msgr2=0x7f4428004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:53.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.966+0000 7f443dffb640 1 --2- 172.21.15.103:0/3502251074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4428002a70 0x7f4428004f30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f443800c130 tx=0x7f443800c5f0 comp rx=0 tx=0).stop 2024-09-10T08:42:53.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.966+0000 7f443dffb640 1 -- 172.21.15.103:0/3502251074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4428002a70 msgr2=0x7f4428004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:42:53.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.966+0000 7f443dffb640 1 --2- 172.21.15.103:0/3502251074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4428002a70 0x7f4428004f30 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f443800c130 tx=0x7f443800c5f0 comp rx=0 tx=0).stop 2024-09-10T08:42:53.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:53.999+0000 7f444e4a8640 1 --2- 172.21.15.103:0/3502251074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4428006f00 0x7f4428007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:54.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.003+0000 7f444e4a8640 1 -- 172.21.15.103:0/3502251074 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f442800a4a0 con 0x7f4428006f00 2024-09-10T08:42:54.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.010+0000 7f444dca7640 1 --2- 172.21.15.103:0/3502251074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4428006f00 0x7f4428007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:54.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.012+0000 7f444dca7640 1 -- 172.21.15.103:0/3502251074 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f44280078d0 con 0x7f4428006f00 2024-09-10T08:42:54.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.012+0000 7f444dca7640 1 --2- 172.21.15.103:0/3502251074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4428006f00 0x7f4428007390 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f443800c130 tx=0x7f4438004940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:54.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.015+0000 7f443dffb640 1 -- 172.21.15.103:0/3502251074 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4438017040 con 0x7f4428006f00 2024-09-10T08:42:54.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.015+0000 7f443dffb640 1 -- 172.21.15.103:0/3502251074 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4552 (secure 0 0 0) 0x7f443801a8c0 con 0x7f4428006f00 2024-09-10T08:42:54.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.015+0000 7f443dffb640 1 -- 172.21.15.103:0/3502251074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4428006f00 msgr2=0x7f4428007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:54.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.015+0000 7f443dffb640 1 --2- 172.21.15.103:0/3502251074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4428006f00 0x7f4428007390 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f443800c130 tx=0x7f4438004940 comp rx=0 tx=0).stop 2024-09-10T08:42:54.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.015+0000 7f443dffb640 1 -- 172.21.15.103:0/3502251074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4428006f00 msgr2=0x7f4428007390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:42:54.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.015+0000 7f443dffb640 1 --2- 172.21.15.103:0/3502251074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4428006f00 0x7f4428007390 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:54.017 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:42:54.017 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:42:54.018 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:42:54.018 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:42:54.018 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 116, 2024-09-10T08:42:54.018 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 8749, 2024-09-10T08:42:54.018 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:42:54.018 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:42:54.018 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:42:54.018 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:42:54.018 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:54.018 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 3, 2024-09-10T08:42:54.019 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:42:54.019 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:42:54.019 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:42:54.019 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:54.019 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:54.019 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:54.019 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:54.019 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:54.019 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:54.019 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:54.019 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:54.019 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:54.019 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:54.019 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:54.020 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:54.020 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:42:54.020 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:42:54.020 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:54.020 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:54.020 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:54.020 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:54.020 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:54.020 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:54.020 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:54.020 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:54.021 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:54.021 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:54.021 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:54.021 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:54.021 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.021 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:42:54.021 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:42:54.021 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:42:54.021 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:42:54.021 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:42:54.021 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:42:54.021 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:42:54.022 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:42:54.022 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:42:54.022 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:42:54.022 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:42:54.022 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:42:54.022 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:42:54.022 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:42:54.022 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:42:54.022 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:42:54.022 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:42:54.022 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:54.022 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:54.022 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:54.022 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:54.023 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:54.023 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:54.023 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:54.023 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:54.023 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:54.023 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:54.023 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:54.023 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:54.023 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:42:54.023 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.023 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:42:54.023 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.023 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:42:54.024 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:42:54.024 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:54.024 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:54.024 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.024 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:54.024 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:42:54.024 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:54.024 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.024 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.024 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:54.024 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:42:54.024 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:54.024 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:54.025 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:54.025 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.025 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:42:54.025 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:42:54.025 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:54.025 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:54.025 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:54.025 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.025 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.025 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:42:54.025 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:42:54.025 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:54.025 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:54.026 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.026 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:54.026 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:42:54.026 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:54.026 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.026 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.026 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:54.026 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:42:54.026 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:54.026 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:54.026 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:54.027 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.027 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:42:54.027 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:42:54.027 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:54.027 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:54.027 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:54.027 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.027 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.027 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:42:54.027 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:42:54.027 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:54.027 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:54.027 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.027 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:54.028 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:42:54.028 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:54.028 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.028 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.028 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:54.028 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:42:54.028 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:54.028 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:54.028 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:54.028 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.029 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:42:54.029 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:42:54.029 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:54.029 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:54.029 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:54.029 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:54.029 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:54.029 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.029 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:42:54.029 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:42:54.029 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.029 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:54.030 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:54.030 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:42:54.030 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:54.030 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:54.030 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:42:54.030 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.030 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:54.030 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:54.030 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:42:54.030 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:54.030 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:54.030 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.030 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:42:54.031 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:42:54.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.019+0000 7f444e4a8640 1 -- 172.21.15.103:0/3502251074 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f442c06bf00 msgr2=0x7f442c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:54.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.019+0000 7f444e4a8640 1 --2- 172.21.15.103:0/3502251074 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f442c06bf00 0x7f442c06e3c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4444034000 tx=0x7f444402e000 comp rx=0 tx=0).stop 2024-09-10T08:42:54.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.019+0000 7f444e4a8640 1 -- 172.21.15.103:0/3502251074 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44480cc660 msgr2=0x7f44481e1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:54.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.019+0000 7f444e4a8640 1 --2- 172.21.15.103:0/3502251074 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44480cc660 0x7f44481e1050 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4440007e60 tx=0x7f444000e4b0 comp rx=0 tx=0).stop 2024-09-10T08:42:54.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.019+0000 7f444dca7640 1 -- 172.21.15.103:0/3502251074 reap_dead start 2024-09-10T08:42:54.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.020+0000 7f444e4a8640 1 -- 172.21.15.103:0/3502251074 shutdown_connections 2024-09-10T08:42:54.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.020+0000 7f444e4a8640 1 -- 172.21.15.103:0/3502251074 >> 172.21.15.103:0/3502251074 conn(0x7f44480cbb70 msgr2=0x7f44480ac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:54.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.020+0000 7f444e4a8640 1 -- 172.21.15.103:0/3502251074 shutdown_connections 2024-09-10T08:42:54.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.020+0000 7f444e4a8640 1 -- 172.21.15.103:0/3502251074 wait complete. 2024-09-10T08:42:54.037 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:42:54.037 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:42:54.038 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:42:54.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.238+0000 7f65b6976640 1 Processor -- start 2024-09-10T08:42:54.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.243+0000 7f65b6976640 1 -- start start 2024-09-10T08:42:54.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.244+0000 7f65b6976640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f65b0151780 0x7f65b006dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:54.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.244+0000 7f65b6976640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b00c26f0 0x7f65b0153e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:54.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.244+0000 7f65b6976640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b00c5440 con 0x7f65b006e4e0 2024-09-10T08:42:54.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.244+0000 7f65b6976640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f65b0072f30 con 0x7f65b0151780 2024-09-10T08:42:54.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.244+0000 7f65b6976640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f65b0073180 con 0x7f65b00c26f0 2024-09-10T08:42:54.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.244+0000 7f65b5173640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b00c26f0 0x7f65b0153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:54.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.244+0000 7f65b5173640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b00c26f0 0x7f65b0153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:59852/0 (socket says 172.21.15.103:59852) 2024-09-10T08:42:54.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.244+0000 7f65b5173640 1 -- 172.21.15.103:0/1278357469 learned_addr learned my addr 172.21.15.103:0/1278357469 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:54.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.251+0000 7f65b4972640 1 -- 172.21.15.103:0/1278357469 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 995398960 0 0) 0x7f65b00c5440 con 0x7f65b006e4e0 2024-09-10T08:42:54.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.251+0000 7f65b4972640 1 -- 172.21.15.103:0/1278357469 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f659c003520 con 0x7f65b006e4e0 2024-09-10T08:42:54.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.252+0000 7f65b4972640 1 -- 172.21.15.103:0/1278357469 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1069533175 0 0) 0x7f659c003520 con 0x7f65b006e4e0 2024-09-10T08:42:54.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.252+0000 7f65b4972640 1 -- 172.21.15.103:0/1278357469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b00c26f0 msgr2=0x7f65b0153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:54.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.252+0000 7f65b4972640 1 --2- 172.21.15.103:0/1278357469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b00c26f0 0x7f65b0153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:54.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.252+0000 7f65b4972640 1 -- 172.21.15.103:0/1278357469 >> v2:172.21.15.154:3300/0 conn(0x7f65b0151780 msgr2=0x7f65b006dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:54.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.252+0000 7f65b4972640 1 --2- 172.21.15.103:0/1278357469 >> v2:172.21.15.154:3300/0 conn(0x7f65b0151780 0x7f65b006dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:54.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.252+0000 7f65b4972640 1 -- 172.21.15.103:0/1278357469 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b0073460 con 0x7f65b006e4e0 2024-09-10T08:42:54.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.252+0000 7f65b4972640 1 -- 172.21.15.103:0/1278357469 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f65ac001650 con 0x7f65b006e4e0 2024-09-10T08:42:54.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.252+0000 7f65b4972640 1 -- 172.21.15.103:0/1278357469 >> v1:172.21.15.154:6789/0 conn(0x7f65b006e4e0 legacy=0x7f65b0154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:54.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.252+0000 7f65b4972640 1 --2- 172.21.15.103:0/1278357469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f659c003a10 0x7f659c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:54.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.252+0000 7f65b4972640 1 --2- 172.21.15.103:0/1278357469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f659c004800 0x7f659c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:54.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.252+0000 7f65b4972640 1 --2- 172.21.15.103:0/1278357469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f659c0051c0 0x7f659c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:54.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.252+0000 7f65b4972640 1 -- 172.21.15.103:0/1278357469 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f65b0072f30 con 0x7f659c004800 2024-09-10T08:42:54.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.252+0000 7f65b4972640 1 -- 172.21.15.103:0/1278357469 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65b0073180 con 0x7f659c003a10 2024-09-10T08:42:54.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.252+0000 7f65b4972640 1 -- 172.21.15.103:0/1278357469 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f659c00c0e0 con 0x7f659c0051c0 2024-09-10T08:42:54.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.252+0000 7f65b6175640 1 --2- 172.21.15.103:0/1278357469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f659c0051c0 0x7f659c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:54.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.252+0000 7f65b5173640 1 --2- 172.21.15.103:0/1278357469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f659c004800 0x7f659c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:54.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.253+0000 7f65b6175640 1 -- 172.21.15.103:0/1278357469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f659c003a10 msgr2=0x7f659c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:54.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.253+0000 7f65b5974640 1 --2- 172.21.15.103:0/1278357469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f659c003a10 0x7f659c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:54.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.253+0000 7f65b6175640 1 --2- 172.21.15.103:0/1278357469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f659c003a10 0x7f659c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:54.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.253+0000 7f65b6175640 1 -- 172.21.15.103:0/1278357469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f659c004800 msgr2=0x7f659c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:54.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.253+0000 7f65b6175640 1 --2- 172.21.15.103:0/1278357469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f659c004800 0x7f659c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:54.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.253+0000 7f65b6175640 1 -- 172.21.15.103:0/1278357469 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b0073460 con 0x7f659c0051c0 2024-09-10T08:42:54.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.254+0000 7f65b5974640 1 --2- 172.21.15.103:0/1278357469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f659c003a10 0x7f659c003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:42:54.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.254+0000 7f65b5173640 1 --2- 172.21.15.103:0/1278357469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f659c004800 0x7f659c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:42:54.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.261+0000 7f65b6175640 1 --2- 172.21.15.103:0/1278357469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f659c0051c0 0x7f659c00b9c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00c290 tx=0x7f659c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac3dca5a686b8b87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:54.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.262+0000 7f65b4972640 1 -- 172.21.15.103:0/1278357469 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac037070 con 0x7f659c0051c0 2024-09-10T08:42:54.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.262+0000 7f65b4972640 1 -- 172.21.15.103:0/1278357469 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ac032600 con 0x7f659c0051c0 2024-09-10T08:42:54.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.262+0000 7f65b4972640 1 -- 172.21.15.103:0/1278357469 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac037070 con 0x7f659c0051c0 2024-09-10T08:42:54.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.265+0000 7f65b6976640 1 -- 172.21.15.103:0/1278357469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f659c0051c0 msgr2=0x7f659c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:54.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.265+0000 7f65b6976640 1 --2- 172.21.15.103:0/1278357469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f659c0051c0 0x7f659c00b9c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00c290 tx=0x7f659c005830 comp rx=0 tx=0).stop 2024-09-10T08:42:54.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.265+0000 7f65b6175640 1 -- 172.21.15.103:0/1278357469 reap_dead start 2024-09-10T08:42:54.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.266+0000 7f65b6976640 1 -- 172.21.15.103:0/1278357469 shutdown_connections 2024-09-10T08:42:54.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.266+0000 7f65b6976640 1 -- 172.21.15.103:0/1278357469 >> 172.21.15.103:0/1278357469 conn(0x7f65b006ce30 msgr2=0x7f65b006d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:54.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.272+0000 7f65b6976640 1 -- 172.21.15.103:0/1278357469 shutdown_connections 2024-09-10T08:42:54.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.273+0000 7f65b6976640 1 -- 172.21.15.103:0/1278357469 wait complete. 2024-09-10T08:42:54.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.275+0000 7f65b6976640 1 Processor -- start 2024-09-10T08:42:54.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.276+0000 7f65b6976640 1 -- start start 2024-09-10T08:42:54.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.277+0000 7f65b6976640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65b00c7430 0x7f65b00c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:54.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.277+0000 7f65b6976640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65b00c7810 0x7f65b01efa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:54.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.277+0000 7f65b6976640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b01effa0 0x7f65b0140060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:54.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.277+0000 7f65b6976640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f65b00c4e80 con 0x7f65b00c7430 2024-09-10T08:42:54.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.277+0000 7f65b6976640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65b00ac9c0 con 0x7f65b00c7810 2024-09-10T08:42:54.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.277+0000 7f65b6976640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f65b00c5000 con 0x7f65b01effa0 2024-09-10T08:42:54.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.279+0000 7f65b5974640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65b00c7430 0x7f65b00c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:54.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.279+0000 7f65b5173640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65b00c7810 0x7f65b01efa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:54.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.279+0000 7f65b5173640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65b00c7810 0x7f65b01efa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:59944/0 (socket says 172.21.15.103:59944) 2024-09-10T08:42:54.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.279+0000 7f65b5173640 1 -- 172.21.15.103:0/1049189395 learned_addr learned my addr 172.21.15.103:0/1049189395 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:54.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.279+0000 7f65b5974640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65b00c7430 0x7f65b00c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55792/0 (socket says 172.21.15.103:55792) 2024-09-10T08:42:54.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.280+0000 7f65b5173640 1 -- 172.21.15.103:0/1049189395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b01effa0 msgr2=0x7f65b0140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:54.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.280+0000 7f65b5173640 1 --2- 172.21.15.103:0/1049189395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b01effa0 0x7f65b0140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:54.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.280+0000 7f65b5173640 1 -- 172.21.15.103:0/1049189395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65b00c7430 msgr2=0x7f65b00c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:54.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.280+0000 7f65b5173640 1 --2- 172.21.15.103:0/1049189395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65b00c7430 0x7f65b00c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:54.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.280+0000 7f65b5173640 1 -- 172.21.15.103:0/1049189395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b0146000 con 0x7f65b00c7810 2024-09-10T08:42:54.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.280+0000 7f65b5974640 1 --2- 172.21.15.103:0/1049189395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65b00c7430 0x7f65b00c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:42:54.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.291+0000 7f65b5173640 1 --2- 172.21.15.103:0/1049189395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65b00c7810 0x7f65b01efa60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f65a800f410 tx=0x7f65a800f8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:54.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.292+0000 7f65a67fc640 1 -- 172.21.15.103:0/1049189395 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a8019020 con 0x7f65b00c7810 2024-09-10T08:42:54.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.292+0000 7f65b6976640 1 -- 172.21.15.103:0/1049189395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65b01462e0 con 0x7f65b00c7810 2024-09-10T08:42:54.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.292+0000 7f65b6976640 1 -- 172.21.15.103:0/1049189395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65b01ef540 con 0x7f65b00c7810 2024-09-10T08:42:54.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.293+0000 7f65a67fc640 1 -- 172.21.15.103:0/1049189395 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a8009e30 con 0x7f65b00c7810 2024-09-10T08:42:54.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.293+0000 7f65a67fc640 1 -- 172.21.15.103:0/1049189395 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a8003bb0 con 0x7f65b00c7810 2024-09-10T08:42:54.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.294+0000 7f65b6976640 1 --2- 172.21.15.103:0/1049189395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b01405a0 0x7f65b0140980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:54.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.294+0000 7f65b6976640 1 -- 172.21.15.103:0/1049189395 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f65b00c2460 con 0x7f65b01405a0 2024-09-10T08:42:54.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.295+0000 7f65b5974640 1 --2- 172.21.15.103:0/1049189395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b01405a0 0x7f65b0140980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:54.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.296+0000 7f65a67fc640 1 -- 172.21.15.103:0/1049189395 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f65a801c020 con 0x7f65b00c7810 2024-09-10T08:42:54.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.296+0000 7f65a67fc640 1 --2- 172.21.15.103:0/1049189395 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f659406be80 0x7f659406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:54.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.298+0000 7f65b5974640 1 -- 172.21.15.103:0/1049189395 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f65b006cb10 con 0x7f65b01405a0 2024-09-10T08:42:54.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.300+0000 7f65b6175640 1 --2- 172.21.15.103:0/1049189395 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f659406be80 0x7f659406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:54.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.301+0000 7f65a67fc640 1 -- 172.21.15.103:0/1049189395 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f65a808bda0 con 0x7f65b00c7810 2024-09-10T08:42:54.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.301+0000 7f65b5974640 1 --2- 172.21.15.103:0/1049189395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b01405a0 0x7f65b0140980 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f65a000fba0 tx=0x7f65a000d590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:54.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.301+0000 7f65b6175640 1 --2- 172.21.15.103:0/1049189395 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f659406be80 0x7f659406e340 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f65ac034000 tx=0x7f65ac02f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:54.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.303+0000 7f65a67fc640 1 -- 172.21.15.103:0/1049189395 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a000fe90 con 0x7f65b01405a0 2024-09-10T08:42:54.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.303+0000 7f65a67fc640 1 -- 172.21.15.103:0/1049189395 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f65a0013440 con 0x7f65b01405a0 2024-09-10T08:42:54.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.303+0000 7f65a67fc640 1 -- 172.21.15.103:0/1049189395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b01405a0 msgr2=0x7f65b0140980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:54.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.303+0000 7f65a67fc640 1 --2- 172.21.15.103:0/1049189395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b01405a0 0x7f65b0140980 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f65a000fba0 tx=0x7f65a000d590 comp rx=0 tx=0).stop 2024-09-10T08:42:54.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.303+0000 7f65a67fc640 1 -- 172.21.15.103:0/1049189395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b01405a0 msgr2=0x7f65b0140980 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:42:54.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.303+0000 7f65a67fc640 1 --2- 172.21.15.103:0/1049189395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b01405a0 0x7f65b0140980 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f65a000fba0 tx=0x7f65a000d590 comp rx=0 tx=0).stop 2024-09-10T08:42:54.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.353+0000 7f65b6976640 1 --2- 172.21.15.103:0/1049189395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b0144d70 0x7f65b0145180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:54.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.353+0000 7f65b6976640 1 -- 172.21.15.103:0/1049189395 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f65b01ef740 con 0x7f65b0144d70 2024-09-10T08:42:54.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.357+0000 7f65b5974640 1 --2- 172.21.15.103:0/1049189395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b0144d70 0x7f65b0145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:54.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.364+0000 7f65b5974640 1 -- 172.21.15.103:0/1049189395 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f65b006dfa0 con 0x7f65b0144d70 2024-09-10T08:42:54.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.364+0000 7f65b5974640 1 --2- 172.21.15.103:0/1049189395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b0144d70 0x7f65b0145180 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f65a000fba0 tx=0x7f65a0004840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:54.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.366+0000 7f65a67fc640 1 -- 172.21.15.103:0/1049189395 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a0013d10 con 0x7f65b0144d70 2024-09-10T08:42:54.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.366+0000 7f65a67fc640 1 -- 172.21.15.103:0/1049189395 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4887 (secure 0 0 0) 0x7f65a0020570 con 0x7f65b0144d70 2024-09-10T08:42:54.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.366+0000 7f65a67fc640 1 -- 172.21.15.103:0/1049189395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b0144d70 msgr2=0x7f65b0145180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:54.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.366+0000 7f65a67fc640 1 --2- 172.21.15.103:0/1049189395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b0144d70 0x7f65b0145180 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f65a000fba0 tx=0x7f65a0004840 comp rx=0 tx=0).stop 2024-09-10T08:42:54.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.366+0000 7f65a67fc640 1 -- 172.21.15.103:0/1049189395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b0144d70 msgr2=0x7f65b0145180 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:42:54.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.366+0000 7f65a67fc640 1 --2- 172.21.15.103:0/1049189395 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65b0144d70 0x7f65b0145180 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f65a000fba0 tx=0x7f65a0004840 comp rx=0 tx=0).stop 2024-09-10T08:42:54.371 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:42:54.371 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:42:54.371 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:42:54.371 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:42:54.371 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 116, 2024-09-10T08:42:54.372 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 66265, 2024-09-10T08:42:54.372 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:42:54.372 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:42:54.372 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:42:54.372 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:42:54.372 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:54.372 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 4, 2024-09-10T08:42:54.372 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:42:54.372 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:42:54.372 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:42:54.372 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:54.373 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:54.373 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:54.373 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:54.373 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:54.373 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:54.373 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:54.373 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:54.373 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:54.373 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:54.373 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:54.373 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:54.374 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:42:54.374 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:42:54.374 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:54.374 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:54.374 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:54.374 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:54.374 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:54.374 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:54.374 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:54.374 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:54.374 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:54.374 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:54.374 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:54.374 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:54.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.375 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:42:54.375 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:42:54.375 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:42:54.375 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:42:54.375 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:42:54.375 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:42:54.375 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:42:54.375 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:42:54.375 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:42:54.375 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:42:54.376 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:42:54.376 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:42:54.376 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:42:54.376 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:42:54.376 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:42:54.376 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:42:54.376 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:42:54.376 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:42:54.376 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:42:54.376 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:42:54.376 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:42:54.376 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:42:54.376 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:42:54.377 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:42:54.377 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:42:54.377 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:42:54.377 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:42:54.377 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:42:54.377 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:54.377 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:42:54.377 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.377 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:42:54.377 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.377 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:42:54.377 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:42:54.377 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:54.378 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:54.378 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.378 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:54.378 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:42:54.378 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:54.378 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.378 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.378 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:54.378 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:42:54.378 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:54.378 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:54.378 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:54.378 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.379 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:42:54.379 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:42:54.379 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:54.379 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:54.379 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:54.379 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.379 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.379 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:42:54.379 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:42:54.379 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:54.379 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:54.379 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.379 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:54.380 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:42:54.380 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:54.380 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.380 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.380 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:54.380 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:42:54.380 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:54.380 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:54.380 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:54.380 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.380 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:42:54.380 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:42:54.380 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:54.381 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:54.381 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:54.381 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.381 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.381 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:42:54.381 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:42:54.381 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:42:54.381 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:42:54.381 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.381 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:42:54.381 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:42:54.381 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:54.381 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.382 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.382 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:42:54.382 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:42:54.382 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:42:54.382 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:54.382 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:54.382 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.382 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:42:54.382 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:42:54.382 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:42:54.382 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:42:54.382 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:42:54.382 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:54.382 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:54.383 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.383 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:42:54.383 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:42:54.383 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.383 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:54.383 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:54.383 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:42:54.383 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:54.383 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:54.383 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:42:54.383 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.383 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:54.383 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:54.383 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:42:54.384 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:54.384 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:54.384 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:42:54.384 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.384 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:54.384 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:54.384 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:42:54.384 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:54.384 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:42:54.385 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:42:54.385 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:42:54.385 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:42:54.385 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:42:54.385 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:42:54.385 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:42:54.385 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:42:54.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:42:54.385 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:42:54.385 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:42:54.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.371+0000 7f65b6976640 1 -- 172.21.15.103:0/1049189395 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f659406be80 msgr2=0x7f659406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:54.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.371+0000 7f65b6976640 1 --2- 172.21.15.103:0/1049189395 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f659406be80 0x7f659406e340 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f65ac034000 tx=0x7f65ac02f000 comp rx=0 tx=0).stop 2024-09-10T08:42:54.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.371+0000 7f65b6175640 1 -- 172.21.15.103:0/1049189395 reap_dead start 2024-09-10T08:42:54.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.372+0000 7f65b6976640 1 -- 172.21.15.103:0/1049189395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65b00c7810 msgr2=0x7f65b01efa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:54.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.372+0000 7f65b6976640 1 --2- 172.21.15.103:0/1049189395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65b00c7810 0x7f65b01efa60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f65a800f410 tx=0x7f65a800f8d0 comp rx=0 tx=0).stop 2024-09-10T08:42:54.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.372+0000 7f65b6976640 1 -- 172.21.15.103:0/1049189395 shutdown_connections 2024-09-10T08:42:54.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.372+0000 7f65b6976640 1 --2- 172.21.15.103:0/1049189395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65b00c7810 0x7f65b01efa60 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f65a800f410 tx=0x7f65a800f8d0 comp rx=0 tx=0).stop 2024-09-10T08:42:54.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.372+0000 7f65b6976640 1 -- 172.21.15.103:0/1049189395 >> 172.21.15.103:0/1049189395 conn(0x7f65b006ce30 msgr2=0x7f65b006c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:54.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.375+0000 7f65b6976640 1 -- 172.21.15.103:0/1049189395 shutdown_connections 2024-09-10T08:42:54.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.375+0000 7f65b6976640 1 -- 172.21.15.103:0/1049189395 wait complete. 2024-09-10T08:42:54.400 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:42:54.400 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-10T08:42:54.401 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-10T08:42:54.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.565+0000 7fee4268f640 1 Processor -- start 2024-09-10T08:42:54.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.566+0000 7fee4268f640 1 -- start start 2024-09-10T08:42:54.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.567+0000 7fee4268f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fee3c0c3610 0x7fee3c0a6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:54.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.567+0000 7fee4268f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee3c0c43d0 0x7fee3c0ab400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:54.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.567+0000 7fee4268f640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee3c0c2d50 con 0x7fee3c06ddc0 2024-09-10T08:42:54.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.567+0000 7fee4268f640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fee3c0c30a0 con 0x7fee3c0c3610 2024-09-10T08:42:54.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.567+0000 7fee4268f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fee3c0c40e0 con 0x7fee3c0c43d0 2024-09-10T08:42:54.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.567+0000 7fee4168d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fee3c0c3610 0x7fee3c0a6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:54.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.567+0000 7fee4168d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fee3c0c3610 0x7fee3c0a6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55806/0 (socket says 172.21.15.103:55806) 2024-09-10T08:42:54.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.567+0000 7fee4168d640 1 -- 172.21.15.103:0/123815700 learned_addr learned my addr 172.21.15.103:0/123815700 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:54.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.567+0000 7fee40e8c640 1 --2- 172.21.15.103:0/123815700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee3c0c43d0 0x7fee3c0ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:54.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.568+0000 7fee4168d640 1 -- 172.21.15.103:0/123815700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee3c0c43d0 msgr2=0x7fee3c0ab400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:54.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.568+0000 7fee4168d640 1 --2- 172.21.15.103:0/123815700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee3c0c43d0 0x7fee3c0ab400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:54.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.568+0000 7fee4168d640 1 -- 172.21.15.103:0/123815700 >> v1:172.21.15.103:6789/0 conn(0x7fee3c06ddc0 legacy=0x7fee3c0c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:54.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.568+0000 7fee4168d640 1 -- 172.21.15.103:0/123815700 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3c0aa980 con 0x7fee3c0c3610 2024-09-10T08:42:54.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.572+0000 7fee4168d640 1 --2- 172.21.15.103:0/123815700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee3c0c3610 0x7fee3c0a6f60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fee3800ffd0 tx=0x7fee38033260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0a97827299fcc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:54.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.575+0000 7fee33fff640 1 -- 172.21.15.103:0/123815700 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee38040070 con 0x7fee3c0c3610 2024-09-10T08:42:54.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.575+0000 7fee33fff640 1 -- 172.21.15.103:0/123815700 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee3803b440 con 0x7fee3c0c3610 2024-09-10T08:42:54.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.575+0000 7fee33fff640 1 -- 172.21.15.103:0/123815700 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3803b850 con 0x7fee3c0c3610 2024-09-10T08:42:54.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.576+0000 7fee4268f640 1 -- 172.21.15.103:0/123815700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee3c0c3610 msgr2=0x7fee3c0a6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:54.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.576+0000 7fee4268f640 1 --2- 172.21.15.103:0/123815700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee3c0c3610 0x7fee3c0a6f60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fee3800ffd0 tx=0x7fee38033260 comp rx=0 tx=0).stop 2024-09-10T08:42:54.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.576+0000 7fee4268f640 1 -- 172.21.15.103:0/123815700 shutdown_connections 2024-09-10T08:42:54.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.576+0000 7fee4268f640 1 --2- 172.21.15.103:0/123815700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee3c0c43d0 0x7fee3c0ab400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:54.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.576+0000 7fee4268f640 1 --2- 172.21.15.103:0/123815700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee3c0c3610 0x7fee3c0a6f60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:54.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.576+0000 7fee4268f640 1 -- 172.21.15.103:0/123815700 >> 172.21.15.103:0/123815700 conn(0x7fee3c0c7ae0 msgr2=0x7fee3c0c7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:54.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.579+0000 7fee4268f640 1 -- 172.21.15.103:0/123815700 shutdown_connections 2024-09-10T08:42:54.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.579+0000 7fee4268f640 1 -- 172.21.15.103:0/123815700 wait complete. 2024-09-10T08:42:54.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.581+0000 7fee4268f640 1 Processor -- start 2024-09-10T08:42:54.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.581+0000 7fee4268f640 1 -- start start 2024-09-10T08:42:54.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.582+0000 7fee4268f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee3c06ddc0 0x7fee3c071f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:54.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.582+0000 7fee4268f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee3c0c43d0 0x7fee3c14bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:54.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.582+0000 7fee4268f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee3c14c070 0x7fee3c1e7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:54.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.582+0000 7fee4268f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c0c3b70 con 0x7fee3c06ddc0 2024-09-10T08:42:54.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.582+0000 7fee4268f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c0c39f0 con 0x7fee3c0c43d0 2024-09-10T08:42:54.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.582+0000 7fee4268f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fee3c0c3cf0 con 0x7fee3c14c070 2024-09-10T08:42:54.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.582+0000 7fee41e8e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee3c14c070 0x7fee3c1e7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:54.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.582+0000 7fee41e8e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee3c14c070 0x7fee3c1e7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:59924/0 (socket says 172.21.15.103:59924) 2024-09-10T08:42:54.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.582+0000 7fee41e8e640 1 -- 172.21.15.103:0/243260442 learned_addr learned my addr 172.21.15.103:0/243260442 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:42:54.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.582+0000 7fee40e8c640 1 --2- 172.21.15.103:0/243260442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee3c0c43d0 0x7fee3c14bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:54.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.583+0000 7fee4168d640 1 --2- 172.21.15.103:0/243260442 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee3c06ddc0 0x7fee3c071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:54.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.583+0000 7fee40e8c640 1 -- 172.21.15.103:0/243260442 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee3c14c070 msgr2=0x7fee3c1e7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:54.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.583+0000 7fee40e8c640 1 --2- 172.21.15.103:0/243260442 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee3c14c070 0x7fee3c1e7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:54.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.583+0000 7fee40e8c640 1 -- 172.21.15.103:0/243260442 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee3c06ddc0 msgr2=0x7fee3c071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:54.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.583+0000 7fee40e8c640 1 --2- 172.21.15.103:0/243260442 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee3c06ddc0 0x7fee3c071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:54.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.583+0000 7fee40e8c640 1 -- 172.21.15.103:0/243260442 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3c156260 con 0x7fee3c0c43d0 2024-09-10T08:42:54.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.583+0000 7fee40e8c640 1 --2- 172.21.15.103:0/243260442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee3c0c43d0 0x7fee3c14bb30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fee34007db0 tx=0x7fee3400e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:54.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.586+0000 7fee31ffb640 1 -- 172.21.15.103:0/243260442 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee34014420 con 0x7fee3c0c43d0 2024-09-10T08:42:54.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.586+0000 7fee31ffb640 1 -- 172.21.15.103:0/243260442 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee34019070 con 0x7fee3c0c43d0 2024-09-10T08:42:54.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.586+0000 7fee31ffb640 1 -- 172.21.15.103:0/243260442 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee340147e0 con 0x7fee3c0c43d0 2024-09-10T08:42:54.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.587+0000 7fee4268f640 1 -- 172.21.15.103:0/243260442 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee3c14c500 con 0x7fee3c0c43d0 2024-09-10T08:42:54.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.587+0000 7fee4268f640 1 -- 172.21.15.103:0/243260442 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee3c1548f0 con 0x7fee3c0c43d0 2024-09-10T08:42:54.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.589+0000 7fee1f7fe640 1 -- 172.21.15.103:0/243260442 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee3c0a6f60 con 0x7fee3c0c43d0 2024-09-10T08:42:54.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.594+0000 7fee31ffb640 1 -- 172.21.15.103:0/243260442 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee34014980 con 0x7fee3c0c43d0 2024-09-10T08:42:54.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.594+0000 7fee31ffb640 1 --2- 172.21.15.103:0/243260442 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fee2006bf00 0x7fee2006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:54.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.594+0000 7fee31ffb640 1 -- 172.21.15.103:0/243260442 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fee3408b8e0 con 0x7fee3c0c43d0 2024-09-10T08:42:54.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.597+0000 7fee4168d640 1 --2- 172.21.15.103:0/243260442 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fee2006bf00 0x7fee2006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:54.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.597+0000 7fee4168d640 1 --2- 172.21.15.103:0/243260442 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fee2006bf00 0x7fee2006e3c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fee3803d000 tx=0x7fee38037000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:54.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:54.606+0000 7fee31ffb640 1 -- 172.21.15.103:0/243260442 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee34059f60 con 0x7fee3c0c43d0 2024-09-10T08:42:55.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:55.120+0000 7fee1f7fe640 1 -- 172.21.15.103:0/243260442 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fee3c0c6fd0 con 0x7fee3c0c43d0 2024-09-10T08:42:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:55.124+0000 7fee31ffb640 1 -- 172.21.15.103:0/243260442 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fee34059860 con 0x7fee3c0c43d0 2024-09-10T08:42:55.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:55.130+0000 7fee4268f640 1 -- 172.21.15.103:0/243260442 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fee2006bf00 msgr2=0x7fee2006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:55.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:55.130+0000 7fee4268f640 1 --2- 172.21.15.103:0/243260442 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fee2006bf00 0x7fee2006e3c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fee3803d000 tx=0x7fee38037000 comp rx=0 tx=0).stop 2024-09-10T08:42:55.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:55.130+0000 7fee4268f640 1 -- 172.21.15.103:0/243260442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee3c0c43d0 msgr2=0x7fee3c14bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:55.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:55.130+0000 7fee4268f640 1 --2- 172.21.15.103:0/243260442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee3c0c43d0 0x7fee3c14bb30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fee34007db0 tx=0x7fee3400e4b0 comp rx=0 tx=0).stop 2024-09-10T08:42:55.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:55.131+0000 7fee4268f640 1 -- 172.21.15.103:0/243260442 shutdown_connections 2024-09-10T08:42:55.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:55.131+0000 7fee4268f640 1 --2- 172.21.15.103:0/243260442 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fee2006bf00 0x7fee2006e3c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:55.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:55.131+0000 7fee4268f640 1 --2- 172.21.15.103:0/243260442 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee3c14c070 0x7fee3c1e7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:55.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:55.131+0000 7fee4268f640 1 --2- 172.21.15.103:0/243260442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee3c0c43d0 0x7fee3c14bb30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:55.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:55.131+0000 7fee4268f640 1 --2- 172.21.15.103:0/243260442 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee3c06ddc0 0x7fee3c071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:55.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:55.131+0000 7fee4268f640 1 -- 172.21.15.103:0/243260442 >> 172.21.15.103:0/243260442 conn(0x7fee3c0c7ae0 msgr2=0x7fee3c0c68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:55.133+0000 7fee4268f640 1 -- 172.21.15.103:0/243260442 shutdown_connections 2024-09-10T08:42:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:42:55.134+0000 7fee4268f640 1 -- 172.21.15.103:0/243260442 wait complete. 2024-09-10T08:42:55.152 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-10T08:43:04.318 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:43:04.326 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:43:05.154 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:43:05.154 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:43:05.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.349+0000 7f6772931640 1 Processor -- start 2024-09-10T08:43:05.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.351+0000 7f6772931640 1 -- start start 2024-09-10T08:43:05.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.352+0000 7f6772931640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f676c0c29e0 0x7f676c0c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:05.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.352+0000 7f6772931640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f676c153240 0x7f676c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:05.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.352+0000 7f6772931640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f676c0c6bc0 con 0x7f676c1564a0 2024-09-10T08:43:05.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.352+0000 7f6772931640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f676c1569a0 con 0x7f676c153240 2024-09-10T08:43:05.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.352+0000 7f6772931640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f676c0c6ea0 con 0x7f676c0c29e0 2024-09-10T08:43:05.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.352+0000 7f676b7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f676c1564a0 0x7f676c152b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:35636/0 (socket says 172.21.15.103:35636) 2024-09-10T08:43:05.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.352+0000 7f676b7fe640 1 -- 172.21.15.103:0/2354918441 learned_addr learned my addr 172.21.15.103:0/2354918441 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:43:05.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.352+0000 7f676bfff640 1 --2- 172.21.15.103:0/2354918441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f676c0c29e0 0x7f676c0c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:05.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.353+0000 7f676bfff640 1 -- 172.21.15.103:0/2354918441 >> v2:172.21.15.154:3300/0 conn(0x7f676c153240 msgr2=0x7f676c06d2b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:43:05.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.353+0000 7f676bfff640 1 --2- 172.21.15.103:0/2354918441 >> v2:172.21.15.154:3300/0 conn(0x7f676c153240 0x7f676c06d2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:05.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.353+0000 7f676bfff640 1 -- 172.21.15.103:0/2354918441 >> v1:172.21.15.154:6789/0 conn(0x7f676c1564a0 legacy=0x7f676c152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:05.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.353+0000 7f676bfff640 1 -- 172.21.15.103:0/2354918441 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f676c06cd90 con 0x7f676c0c29e0 2024-09-10T08:43:05.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.355+0000 7f676bfff640 1 --2- 172.21.15.103:0/2354918441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f676c0c29e0 0x7f676c0c2dc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f675c010ba0 tx=0x7f675c032920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccf293c6dfc0ef3d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:05.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.357+0000 7f676affd640 1 -- 172.21.15.103:0/2354918441 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c041070 con 0x7f676c0c29e0 2024-09-10T08:43:05.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.357+0000 7f676affd640 1 -- 172.21.15.103:0/2354918441 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f675c0396d0 con 0x7f676c0c29e0 2024-09-10T08:43:05.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.357+0000 7f676affd640 1 -- 172.21.15.103:0/2354918441 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c039aa0 con 0x7f676c0c29e0 2024-09-10T08:43:05.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.360+0000 7f6772931640 1 -- 172.21.15.103:0/2354918441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f676c0c29e0 msgr2=0x7f676c0c2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:05.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.360+0000 7f6772931640 1 --2- 172.21.15.103:0/2354918441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f676c0c29e0 0x7f676c0c2dc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f675c010ba0 tx=0x7f675c032920 comp rx=0 tx=0).stop 2024-09-10T08:43:05.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.364+0000 7f6772931640 1 -- 172.21.15.103:0/2354918441 shutdown_connections 2024-09-10T08:43:05.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.364+0000 7f6772931640 1 --2- 172.21.15.103:0/2354918441 >> v2:172.21.15.154:3300/0 conn(0x7f676c153240 0x7f676c06d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:05.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.364+0000 7f6772931640 1 --2- 172.21.15.103:0/2354918441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f676c0c29e0 0x7f676c0c2dc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:05.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.364+0000 7f6772931640 1 -- 172.21.15.103:0/2354918441 >> 172.21.15.103:0/2354918441 conn(0x7f676c0a9680 msgr2=0x7f676c0a9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:05.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.365+0000 7f6772931640 1 -- 172.21.15.103:0/2354918441 shutdown_connections 2024-09-10T08:43:05.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.366+0000 7f6772931640 1 -- 172.21.15.103:0/2354918441 wait complete. 2024-09-10T08:43:05.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.367+0000 7f6772931640 1 Processor -- start 2024-09-10T08:43:05.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.368+0000 7f6772931640 1 -- start start 2024-09-10T08:43:05.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.369+0000 7f6772931640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f676c0c29e0 0x7f676c0c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:05.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.369+0000 7f6772931640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f676c153240 0x7f676c1eabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:05.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.369+0000 7f6772931640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f676c1564a0 0x7f676c1eb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:05.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.369+0000 7f6772931640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f676c0ad120 con 0x7f676c1564a0 2024-09-10T08:43:05.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.369+0000 7f6772931640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f676c0aa3b0 con 0x7f676c153240 2024-09-10T08:43:05.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.369+0000 7f6772931640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f676c0ad2a0 con 0x7f676c0c29e0 2024-09-10T08:43:05.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.369+0000 7f676b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f676c153240 0x7f676c1eabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:05.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.369+0000 7f676b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f676c153240 0x7f676c1eabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:46470/0 (socket says 172.21.15.103:46470) 2024-09-10T08:43:05.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.369+0000 7f676b7fe640 1 -- 172.21.15.103:0/1811659518 learned_addr learned my addr 172.21.15.103:0/1811659518 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:05.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.370+0000 7f676bfff640 1 --2- 172.21.15.103:0/1811659518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f676c0c29e0 0x7f676c0c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:05.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.370+0000 7f676b7fe640 1 -- 172.21.15.103:0/1811659518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f676c0c29e0 msgr2=0x7f676c0c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:05.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.370+0000 7f676b7fe640 1 --2- 172.21.15.103:0/1811659518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f676c0c29e0 0x7f676c0c15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:05.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.370+0000 7f676b7fe640 1 -- 172.21.15.103:0/1811659518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f676c1564a0 msgr2=0x7f676c1eb100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:43:05.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.370+0000 7f676b7fe640 1 --2- 172.21.15.103:0/1811659518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f676c1564a0 0x7f676c1eb100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:05.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.370+0000 7f676b7fe640 1 -- 172.21.15.103:0/1811659518 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f676c072ac0 con 0x7f676c153240 2024-09-10T08:43:05.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.371+0000 7f676b7fe640 1 --2- 172.21.15.103:0/1811659518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f676c153240 0x7f676c1eabc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f676400bdf0 tx=0x7f676400bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:05.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.371+0000 7f6768ff9640 1 -- 172.21.15.103:0/1811659518 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6764015470 con 0x7f676c153240 2024-09-10T08:43:05.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.371+0000 7f6772931640 1 -- 172.21.15.103:0/1811659518 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f676c1eb640 con 0x7f676c153240 2024-09-10T08:43:05.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.372+0000 7f6772931640 1 -- 172.21.15.103:0/1811659518 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f676c0bcb40 con 0x7f676c153240 2024-09-10T08:43:05.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.372+0000 7f6768ff9640 1 -- 172.21.15.103:0/1811659518 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6764010070 con 0x7f676c153240 2024-09-10T08:43:05.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.374+0000 7f6772931640 1 -- 172.21.15.103:0/1811659518 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f676c0c2dc0 con 0x7f676c153240 2024-09-10T08:43:05.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.379+0000 7f6768ff9640 1 -- 172.21.15.103:0/1811659518 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6764015890 con 0x7f676c153240 2024-09-10T08:43:05.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.380+0000 7f6768ff9640 1 -- 172.21.15.103:0/1811659518 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6764015af0 con 0x7f676c153240 2024-09-10T08:43:05.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.381+0000 7f6768ff9640 1 --2- 172.21.15.103:0/1811659518 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f675806bf30 0x7f675806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:05.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.381+0000 7f6768ff9640 1 -- 172.21.15.103:0/1811659518 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f676408c1b0 con 0x7f676c153240 2024-09-10T08:43:05.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.382+0000 7f676bfff640 1 --2- 172.21.15.103:0/1811659518 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f675806bf30 0x7f675806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:05.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.383+0000 7f676bfff640 1 --2- 172.21.15.103:0/1811659518 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f675806bf30 0x7f675806e3f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f675c03e000 tx=0x7f675c037000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:05.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.384+0000 7f6768ff9640 1 -- 172.21.15.103:0/1811659518 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f676405a940 con 0x7f676c153240 2024-09-10T08:43:05.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.937+0000 7f6772931640 1 -- 172.21.15.103:0/1811659518 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f676c071220 con 0x7f676c153240 2024-09-10T08:43:05.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.941+0000 7f6768ff9640 1 -- 172.21.15.103:0/1811659518 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1570 (secure 0 0 0) 0x7f676405a240 con 0x7f676c153240 2024-09-10T08:43:05.944 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":116,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:43:05.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.944+0000 7f6772931640 1 -- 172.21.15.103:0/1811659518 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f675806bf30 msgr2=0x7f675806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:05.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.944+0000 7f6772931640 1 --2- 172.21.15.103:0/1811659518 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f675806bf30 0x7f675806e3f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f675c03e000 tx=0x7f675c037000 comp rx=0 tx=0).stop 2024-09-10T08:43:05.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.944+0000 7f6772931640 1 -- 172.21.15.103:0/1811659518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f676c153240 msgr2=0x7f676c1eabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:05.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.944+0000 7f6772931640 1 --2- 172.21.15.103:0/1811659518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f676c153240 0x7f676c1eabc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f676400bdf0 tx=0x7f676400bee0 comp rx=0 tx=0).stop 2024-09-10T08:43:05.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.944+0000 7f6772931640 1 -- 172.21.15.103:0/1811659518 shutdown_connections 2024-09-10T08:43:05.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.944+0000 7f6772931640 1 --2- 172.21.15.103:0/1811659518 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f675806bf30 0x7f675806e3f0 secure :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f675c03e000 tx=0x7f675c037000 comp rx=0 tx=0).stop 2024-09-10T08:43:05.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.944+0000 7f6772931640 1 --2- 172.21.15.103:0/1811659518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f676c1564a0 0x7f676c1eb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:05.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.944+0000 7f6772931640 1 --2- 172.21.15.103:0/1811659518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f676c153240 0x7f676c1eabc0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:05.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.944+0000 7f6772931640 1 --2- 172.21.15.103:0/1811659518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f676c0c29e0 0x7f676c0c15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:05.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.944+0000 7f6772931640 1 -- 172.21.15.103:0/1811659518 >> 172.21.15.103:0/1811659518 conn(0x7f676c0a9680 msgr2=0x7f676c0a9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:05.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.945+0000 7f6772931640 1 -- 172.21.15.103:0/1811659518 shutdown_connections 2024-09-10T08:43:05.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:05.945+0000 7f6772931640 1 -- 172.21.15.103:0/1811659518 wait complete. 2024-09-10T08:43:05.965 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:43:05.965 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-10T08:43:05.965 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:43:05.965 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:43:06.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.174+0000 7f5d371c4640 1 Processor -- start 2024-09-10T08:43:06.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.175+0000 7f5d371c4640 1 -- start start 2024-09-10T08:43:06.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.176+0000 7f5d371c4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5d301582b0 0x7f5d3015a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:06.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.176+0000 7f5d371c4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d3015ae80 con 0x7f5d3015dda0 2024-09-10T08:43:06.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.176+0000 7f5d371c4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d3015b160 con 0x7f5d30157ed0 2024-09-10T08:43:06.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.176+0000 7f5d371c4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f5d3015b440 con 0x7f5d301582b0 2024-09-10T08:43:06.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.177+0000 7f5d2ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5d301582b0 0x7f5d3015a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:06.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.177+0000 7f5d2ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5d301582b0 0x7f5d3015a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:46482/0 (socket says 172.21.15.103:46482) 2024-09-10T08:43:06.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.177+0000 7f5d2ffff640 1 -- 172.21.15.103:0/2613639615 learned_addr learned my addr 172.21.15.103:0/2613639615 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:06.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.177+0000 7f5d2ffff640 1 -- 172.21.15.103:0/2613639615 >> v1:172.21.15.154:6789/0 conn(0x7f5d30157ed0 legacy=0x7f5d3006e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:06.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.177+0000 7f5d2ffff640 1 -- 172.21.15.103:0/2613639615 >> v1:172.21.15.103:6789/0 conn(0x7f5d3015dda0 legacy=0x7f5d300be840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:43:06.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.177+0000 7f5d2ffff640 1 -- 172.21.15.103:0/2613639615 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3015b720 con 0x7f5d301582b0 2024-09-10T08:43:06.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.178+0000 7f5d2ffff640 1 --2- 172.21.15.103:0/2613639615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d301582b0 0x7f5d3015a830 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009870 tx=0x7f5d2402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=647ad6a1e7585e7e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:06.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.179+0000 7f5d2f7fe640 1 -- 172.21.15.103:0/2613639615 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24037070 con 0x7f5d301582b0 2024-09-10T08:43:06.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.179+0000 7f5d2f7fe640 1 -- 172.21.15.103:0/2613639615 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d24032440 con 0x7f5d301582b0 2024-09-10T08:43:06.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.180+0000 7f5d371c4640 1 -- 172.21.15.103:0/2613639615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d301582b0 msgr2=0x7f5d3015a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:06.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.180+0000 7f5d371c4640 1 --2- 172.21.15.103:0/2613639615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d301582b0 0x7f5d3015a830 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009870 tx=0x7f5d2402a210 comp rx=0 tx=0).stop 2024-09-10T08:43:06.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.180+0000 7f5d371c4640 1 -- 172.21.15.103:0/2613639615 shutdown_connections 2024-09-10T08:43:06.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.180+0000 7f5d371c4640 1 --2- 172.21.15.103:0/2613639615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d301582b0 0x7f5d3015a830 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:06.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.180+0000 7f5d371c4640 1 -- 172.21.15.103:0/2613639615 >> 172.21.15.103:0/2613639615 conn(0x7f5d300c4bb0 msgr2=0x7f5d300c4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:06.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.184+0000 7f5d371c4640 1 -- 172.21.15.103:0/2613639615 shutdown_connections 2024-09-10T08:43:06.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.184+0000 7f5d371c4640 1 -- 172.21.15.103:0/2613639615 wait complete. 2024-09-10T08:43:06.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.186+0000 7f5d371c4640 1 Processor -- start 2024-09-10T08:43:06.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.186+0000 7f5d371c4640 1 -- start start 2024-09-10T08:43:06.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.187+0000 7f5d371c4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d30157ed0 0x7f5d300aad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:06.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.187+0000 7f5d371c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d3015dda0 0x7f5d301569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:06.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.187+0000 7f5d371c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d3015d320 0x7f5d3015d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:06.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.187+0000 7f5d371c4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5d300a9620 con 0x7f5d3015d320 2024-09-10T08:43:06.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.187+0000 7f5d371c4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5d300744b0 con 0x7f5d3015dda0 2024-09-10T08:43:06.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.187+0000 7f5d371c4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5d3006ea50 con 0x7f5d30157ed0 2024-09-10T08:43:06.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.188+0000 7f5d2ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d3015dda0 0x7f5d301569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:06.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.188+0000 7f5d2ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d3015dda0 0x7f5d301569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:46484/0 (socket says 172.21.15.103:46484) 2024-09-10T08:43:06.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.188+0000 7f5d2ffff640 1 -- 172.21.15.103:0/2033416159 learned_addr learned my addr 172.21.15.103:0/2033416159 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:06.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.188+0000 7f5d34f60640 1 --2- 172.21.15.103:0/2033416159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d30157ed0 0x7f5d300aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:06.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.188+0000 7f5d2ffff640 1 -- 172.21.15.103:0/2033416159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d30157ed0 msgr2=0x7f5d300aad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:06.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.188+0000 7f5d2ffff640 1 --2- 172.21.15.103:0/2033416159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d30157ed0 0x7f5d300aad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:06.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.188+0000 7f5d2ffff640 1 -- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d3015d320 msgr2=0x7f5d3015d7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:43:06.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.189+0000 7f5d35761640 1 --2- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d3015d320 0x7f5d3015d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:06.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.189+0000 7f5d2ffff640 1 --2- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d3015d320 0x7f5d3015d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:06.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.189+0000 7f5d2ffff640 1 -- 172.21.15.103:0/2033416159 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d30157570 con 0x7f5d3015dda0 2024-09-10T08:43:06.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.189+0000 7f5d35761640 1 --2- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d3015d320 0x7f5d3015d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:43:06.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.189+0000 7f5d2ffff640 1 --2- 172.21.15.103:0/2033416159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d3015dda0 0x7f5d301569b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5d2402a250 tx=0x7f5d240046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:06.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.190+0000 7f5d2d7fa640 1 -- 172.21.15.103:0/2033416159 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24041020 con 0x7f5d3015dda0 2024-09-10T08:43:06.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.190+0000 7f5d371c4640 1 -- 172.21.15.103:0/2033416159 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d300c5ef0 con 0x7f5d3015dda0 2024-09-10T08:43:06.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.190+0000 7f5d371c4640 1 -- 172.21.15.103:0/2033416159 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d300c6410 con 0x7f5d3015dda0 2024-09-10T08:43:06.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.191+0000 7f5d2d7fa640 1 -- 172.21.15.103:0/2033416159 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d240325f0 con 0x7f5d3015dda0 2024-09-10T08:43:06.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.191+0000 7f5d2d7fa640 1 -- 172.21.15.103:0/2033416159 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24037040 con 0x7f5d3015dda0 2024-09-10T08:43:06.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.192+0000 7f5d371c4640 1 --2- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d10002a70 0x7f5d10004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:06.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.192+0000 7f5d371c4640 1 -- 172.21.15.103:0/2033416159 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5d10007ec0 con 0x7f5d10002a70 2024-09-10T08:43:06.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.196+0000 7f5d2d7fa640 1 -- 172.21.15.103:0/2033416159 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d24044020 con 0x7f5d3015dda0 2024-09-10T08:43:06.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.196+0000 7f5d2d7fa640 1 --2- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5d1406bf30 0x7f5d1406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:06.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.196+0000 7f5d2d7fa640 1 -- 172.21.15.103:0/2033416159 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f5d240aba20 con 0x7f5d3015dda0 2024-09-10T08:43:06.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.197+0000 7f5d34f60640 1 --2- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d10002a70 0x7f5d10004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:06.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.198+0000 7f5d34f60640 1 -- 172.21.15.103:0/2033416159 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d100080c0 con 0x7f5d10002a70 2024-09-10T08:43:06.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.198+0000 7f5d34f60640 1 --2- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d10002a70 0x7f5d10004f30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00f770 tx=0x7f5d1c00fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:06.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.198+0000 7f5d2d7fa640 1 -- 172.21.15.103:0/2033416159 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c00fe80 con 0x7f5d10002a70 2024-09-10T08:43:06.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.201+0000 7f5d2d7fa640 1 -- 172.21.15.103:0/2033416159 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5d1c018070 con 0x7f5d10002a70 2024-09-10T08:43:06.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.201+0000 7f5d35761640 1 --2- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5d1406bf30 0x7f5d1406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:06.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.201+0000 7f5d2d7fa640 1 -- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d10002a70 msgr2=0x7f5d10004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:06.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.201+0000 7f5d2d7fa640 1 --2- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d10002a70 0x7f5d10004f30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00f770 tx=0x7f5d1c00fc30 comp rx=0 tx=0).stop 2024-09-10T08:43:06.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.201+0000 7f5d2d7fa640 1 -- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d10002a70 msgr2=0x7f5d10004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:43:06.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.202+0000 7f5d2d7fa640 1 --2- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d10002a70 0x7f5d10004f30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:06.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.214+0000 7f5d35761640 1 --2- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5d1406bf30 0x7f5d1406e3f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5d28007e10 tx=0x7f5d28007320 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:06.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.215+0000 7f5d371c4640 1 --2- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d10006ee0 0x7f5d10007370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:06.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.215+0000 7f5d371c4640 1 -- 172.21.15.103:0/2033416159 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1000a4a0 con 0x7f5d10006ee0 2024-09-10T08:43:06.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.215+0000 7f5d34f60640 1 --2- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d10006ee0 0x7f5d10007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:06.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.217+0000 7f5d34f60640 1 -- 172.21.15.103:0/2033416159 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5d100078b0 con 0x7f5d10006ee0 2024-09-10T08:43:06.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.217+0000 7f5d34f60640 1 --2- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d10006ee0 0x7f5d10007370 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00f770 tx=0x7f5d1c001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:06.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.218+0000 7f5d2d7fa640 1 -- 172.21.15.103:0/2033416159 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c00d930 con 0x7f5d10006ee0 2024-09-10T08:43:06.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.218+0000 7f5d2d7fa640 1 -- 172.21.15.103:0/2033416159 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5058 (secure 0 0 0) 0x7f5d1c00dad0 con 0x7f5d10006ee0 2024-09-10T08:43:06.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.218+0000 7f5d2d7fa640 1 -- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d10006ee0 msgr2=0x7f5d10007370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:06.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.218+0000 7f5d2d7fa640 1 --2- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d10006ee0 0x7f5d10007370 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00f770 tx=0x7f5d1c001080 comp rx=0 tx=0).stop 2024-09-10T08:43:06.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.218+0000 7f5d2d7fa640 1 -- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d10006ee0 msgr2=0x7f5d10007370 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:43:06.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.218+0000 7f5d2d7fa640 1 --2- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d10006ee0 0x7f5d10007370 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:06.219 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:43:06.219 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:43:06.219 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:43:06.219 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:43:06.219 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 116, 2024-09-10T08:43:06.219 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 212682, 2024-09-10T08:43:06.219 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:43:06.219 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:43:06.219 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:43:06.220 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:43:06.220 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:06.220 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 15, 2024-09-10T08:43:06.220 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:43:06.220 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:43:06.220 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:43:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:43:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:43:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:43:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:43:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:43:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:43:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:43:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:43:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:43:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:43:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:43:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:43:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:43:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:43:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:43:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:43:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:43:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:43:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:43:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:43:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:43:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:43:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:43:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:43:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:43:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:43:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:43:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:43:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:43:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:43:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:43:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:43:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:43:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:43:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:43:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:43:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:43:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:43:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:43:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:43:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:43:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:43:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:43:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:43:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:43:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:43:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:43:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:43:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:43:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:43:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:43:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:43:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:06.227 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:43:06.227 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.227 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:43:06.227 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.227 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:43:06.227 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:43:06.227 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:43:06.227 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:43:06.227 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:43:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:43:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:43:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:43:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:43:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:43:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:43:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:43:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:43:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:43:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:43:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:43:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:43:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:43:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:43:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:43:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:43:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:43:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:43:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:43:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:43:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:43:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:43:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:43:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:43:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:43:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:43:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:43:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.233 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.233 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:43:06.233 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:43:06.233 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:06.233 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.233 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:06.233 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.234 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:43:06.234 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:43:06.234 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:43:06.234 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:43:06.234 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:43:06.234 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:43:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:43:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:43:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:43:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:43:06.236 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.236 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:06.236 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:43:06.237 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.237 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:43:06.237 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:43:06.237 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:43:06.237 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.237 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:06.237 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:43:06.237 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.237 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:43:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:43:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:43:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:43:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:43:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:43:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 7 2024-09-10T08:43:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:43:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.239 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:43:06.239 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:43:06.239 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:43:06.239 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.239 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:06.239 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.239 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:43:06.239 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:43:06.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.225+0000 7f5d371c4640 1 -- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5d1406bf30 msgr2=0x7f5d1406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:06.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.225+0000 7f5d371c4640 1 --2- 172.21.15.103:0/2033416159 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5d1406bf30 0x7f5d1406e3f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5d28007e10 tx=0x7f5d28007320 comp rx=0 tx=0).stop 2024-09-10T08:43:06.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.225+0000 7f5d371c4640 1 -- 172.21.15.103:0/2033416159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d3015dda0 msgr2=0x7f5d301569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:06.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.225+0000 7f5d371c4640 1 --2- 172.21.15.103:0/2033416159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d3015dda0 0x7f5d301569b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5d2402a250 tx=0x7f5d240046c0 comp rx=0 tx=0).stop 2024-09-10T08:43:06.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.225+0000 7f5d35761640 1 -- 172.21.15.103:0/2033416159 reap_dead start 2024-09-10T08:43:06.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.225+0000 7f5d35761640 1 -- 172.21.15.103:0/2033416159 reap_dead start 2024-09-10T08:43:06.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.225+0000 7f5d371c4640 1 -- 172.21.15.103:0/2033416159 shutdown_connections 2024-09-10T08:43:06.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.225+0000 7f5d371c4640 1 -- 172.21.15.103:0/2033416159 >> 172.21.15.103:0/2033416159 conn(0x7f5d300c4bb0 msgr2=0x7f5d300a97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:06.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.226+0000 7f5d371c4640 1 -- 172.21.15.103:0/2033416159 shutdown_connections 2024-09-10T08:43:06.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.226+0000 7f5d371c4640 1 -- 172.21.15.103:0/2033416159 wait complete. 2024-09-10T08:43:06.257 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:43:06.257 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:43:06.257 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:43:06.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.493+0000 7fc45ea17640 1 Processor -- start 2024-09-10T08:43:06.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.493+0000 7fc45ea17640 1 -- start start 2024-09-10T08:43:06.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.494+0000 7fc45ea17640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc4580c5820 0x7fc458158760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:06.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.494+0000 7fc45ea17640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc458067ea0 con 0x7fc45815b270 2024-09-10T08:43:06.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.494+0000 7fc45ea17640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc45815b6b0 con 0x7fc45806e640 2024-09-10T08:43:06.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.494+0000 7fc45ea17640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc45806f130 con 0x7fc4580c5820 2024-09-10T08:43:06.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.495+0000 7fc4577fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc45815b270 0x7fc4580c5110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:32826/0 (socket says 172.21.15.103:32826) 2024-09-10T08:43:06.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.495+0000 7fc4577fe640 1 -- 172.21.15.103:0/816902135 learned_addr learned my addr 172.21.15.103:0/816902135 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:43:06.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.501+0000 7fc45cfb4640 1 --2- 172.21.15.103:0/816902135 >> v2:172.21.15.154:3300/0 conn(0x7fc4580c5820 0x7fc458158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:06.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.501+0000 7fc456ffd640 1 -- 172.21.15.103:0/816902135 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2868492101 0 0) 0x7fc458067ea0 con 0x7fc45815b270 2024-09-10T08:43:06.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.501+0000 7fc456ffd640 1 -- 172.21.15.103:0/816902135 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc440003520 con 0x7fc45815b270 2024-09-10T08:43:06.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.501+0000 7fc45cfb4640 1 -- 172.21.15.103:0/816902135 >> v1:172.21.15.154:6789/0 conn(0x7fc45806e640 legacy=0x7fc45806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:06.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.501+0000 7fc45cfb4640 1 -- 172.21.15.103:0/816902135 >> v1:172.21.15.103:6789/0 conn(0x7fc45815b270 legacy=0x7fc4580c5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:06.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.501+0000 7fc45cfb4640 1 -- 172.21.15.103:0/816902135 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4580ad580 con 0x7fc4580c5820 2024-09-10T08:43:06.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.504+0000 7fc45cfb4640 1 --2- 172.21.15.103:0/816902135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4580c5820 0x7fc458158760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0097a0 tx=0x7fc44c02a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bacb0adbe5428463 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:06.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.505+0000 7fc456ffd640 1 -- 172.21.15.103:0/816902135 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c037070 con 0x7fc4580c5820 2024-09-10T08:43:06.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.505+0000 7fc456ffd640 1 -- 172.21.15.103:0/816902135 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc44c032440 con 0x7fc4580c5820 2024-09-10T08:43:06.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.506+0000 7fc45ea17640 1 -- 172.21.15.103:0/816902135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4580c5820 msgr2=0x7fc458158760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:06.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.506+0000 7fc45ea17640 1 --2- 172.21.15.103:0/816902135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4580c5820 0x7fc458158760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0097a0 tx=0x7fc44c02a200 comp rx=0 tx=0).stop 2024-09-10T08:43:06.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.508+0000 7fc45ea17640 1 -- 172.21.15.103:0/816902135 shutdown_connections 2024-09-10T08:43:06.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.508+0000 7fc45ea17640 1 --2- 172.21.15.103:0/816902135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4580c5820 0x7fc458158760 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:06.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.508+0000 7fc45ea17640 1 -- 172.21.15.103:0/816902135 >> 172.21.15.103:0/816902135 conn(0x7fc4580c8430 msgr2=0x7fc4580c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:06.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.508+0000 7fc45ea17640 1 -- 172.21.15.103:0/816902135 shutdown_connections 2024-09-10T08:43:06.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.508+0000 7fc45ea17640 1 -- 172.21.15.103:0/816902135 wait complete. 2024-09-10T08:43:06.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.510+0000 7fc45ea17640 1 Processor -- start 2024-09-10T08:43:06.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.510+0000 7fc45ea17640 1 -- start start 2024-09-10T08:43:06.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.511+0000 7fc45ea17640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45806e640 0x7fc4580a81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:06.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.511+0000 7fc45ea17640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4580c5820 0x7fc45815bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:06.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.511+0000 7fc45ea17640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc45815b270 0x7fc4581537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:06.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.511+0000 7fc45ea17640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc4580ab7c0 con 0x7fc4580c5820 2024-09-10T08:43:06.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.511+0000 7fc45ea17640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc4580ab4e0 con 0x7fc45806e640 2024-09-10T08:43:06.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.511+0000 7fc45ea17640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc4580ad250 con 0x7fc45815b270 2024-09-10T08:43:06.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.512+0000 7fc457fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45806e640 0x7fc4580a81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:06.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.512+0000 7fc457fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45806e640 0x7fc4580a81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:46510/0 (socket says 172.21.15.103:46510) 2024-09-10T08:43:06.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.512+0000 7fc457fff640 1 -- 172.21.15.103:0/3402485339 learned_addr learned my addr 172.21.15.103:0/3402485339 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:06.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.512+0000 7fc457fff640 1 -- 172.21.15.103:0/3402485339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc45815b270 msgr2=0x7fc4581537c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:43:06.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.512+0000 7fc457fff640 1 --2- 172.21.15.103:0/3402485339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc45815b270 0x7fc4581537c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:06.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.512+0000 7fc457fff640 1 -- 172.21.15.103:0/3402485339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4580c5820 msgr2=0x7fc45815bff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:43:06.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.512+0000 7fc457fff640 1 --2- 172.21.15.103:0/3402485339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4580c5820 0x7fc45815bff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:06.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.512+0000 7fc457fff640 1 -- 172.21.15.103:0/3402485339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4581fbad0 con 0x7fc45806e640 2024-09-10T08:43:06.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.513+0000 7fc457fff640 1 --2- 172.21.15.103:0/3402485339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45806e640 0x7fc4580a81d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc450001eb0 tx=0x7fc45000c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:06.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.513+0000 7fc454ff9640 1 -- 172.21.15.103:0/3402485339 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc450017070 con 0x7fc45806e640 2024-09-10T08:43:06.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.513+0000 7fc454ff9640 1 -- 172.21.15.103:0/3402485339 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4500052d0 con 0x7fc45806e640 2024-09-10T08:43:06.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.513+0000 7fc45ea17640 1 -- 172.21.15.103:0/3402485339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc458072630 con 0x7fc45806e640 2024-09-10T08:43:06.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.513+0000 7fc45ea17640 1 -- 172.21.15.103:0/3402485339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc45815c530 con 0x7fc45806e640 2024-09-10T08:43:06.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.516+0000 7fc454ff9640 1 -- 172.21.15.103:0/3402485339 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc450003810 con 0x7fc45806e640 2024-09-10T08:43:06.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.517+0000 7fc454ff9640 1 -- 172.21.15.103:0/3402485339 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc45001a070 con 0x7fc45806e640 2024-09-10T08:43:06.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.518+0000 7fc454ff9640 1 --2- 172.21.15.103:0/3402485339 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc44406be30 0x7fc44406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:06.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.519+0000 7fc454ff9640 1 -- 172.21.15.103:0/3402485339 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fc45008a570 con 0x7fc45806e640 2024-09-10T08:43:06.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.519+0000 7fc4577fe640 1 --2- 172.21.15.103:0/3402485339 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc44406be30 0x7fc44406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:06.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.520+0000 7fc4577fe640 1 --2- 172.21.15.103:0/3402485339 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc44406be30 0x7fc44406e2f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc4480012e0 tx=0x7fc448007cc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:06.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.520+0000 7fc45ea17640 1 --2- 172.21.15.103:0/3402485339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc438002a70 0x7fc438004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:06.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.520+0000 7fc45ea17640 1 -- 172.21.15.103:0/3402485339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc438007ec0 con 0x7fc438002a70 2024-09-10T08:43:06.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.521+0000 7fc45cfb4640 1 --2- 172.21.15.103:0/3402485339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc438002a70 0x7fc438004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:06.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.521+0000 7fc45cfb4640 1 -- 172.21.15.103:0/3402485339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4380080c0 con 0x7fc438002a70 2024-09-10T08:43:06.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.522+0000 7fc45cfb4640 1 --2- 172.21.15.103:0/3402485339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc438002a70 0x7fc438004f30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc458158630 tx=0x7fc44c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:06.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.525+0000 7fc454ff9640 1 -- 172.21.15.103:0/3402485339 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c041070 con 0x7fc438002a70 2024-09-10T08:43:06.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.525+0000 7fc454ff9640 1 -- 172.21.15.103:0/3402485339 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc44c0093a0 con 0x7fc438002a70 2024-09-10T08:43:06.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.526+0000 7fc454ff9640 1 -- 172.21.15.103:0/3402485339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc438002a70 msgr2=0x7fc438004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:06.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.526+0000 7fc454ff9640 1 --2- 172.21.15.103:0/3402485339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc438002a70 0x7fc438004f30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc458158630 tx=0x7fc44c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:43:06.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.526+0000 7fc454ff9640 1 -- 172.21.15.103:0/3402485339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc438002a70 msgr2=0x7fc438004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:43:06.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.526+0000 7fc454ff9640 1 --2- 172.21.15.103:0/3402485339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc438002a70 0x7fc438004f30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:06.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.542+0000 7fc45ea17640 1 --2- 172.21.15.103:0/3402485339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc438006f30 0x7fc4380073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:06.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.542+0000 7fc45ea17640 1 -- 172.21.15.103:0/3402485339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc43800a4a0 con 0x7fc438006f30 2024-09-10T08:43:06.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.543+0000 7fc45cfb4640 1 --2- 172.21.15.103:0/3402485339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc438006f30 0x7fc4380073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:06.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.543+0000 7fc45cfb4640 1 -- 172.21.15.103:0/3402485339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc438007900 con 0x7fc438006f30 2024-09-10T08:43:06.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.543+0000 7fc45cfb4640 1 --2- 172.21.15.103:0/3402485339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc438006f30 0x7fc4380073c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc438008090 tx=0x7fc44c009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:06.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.544+0000 7fc454ff9640 1 -- 172.21.15.103:0/3402485339 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c041040 con 0x7fc438006f30 2024-09-10T08:43:06.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.544+0000 7fc454ff9640 1 -- 172.21.15.103:0/3402485339 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4554 (secure 0 0 0) 0x7fc44c03b3f0 con 0x7fc438006f30 2024-09-10T08:43:06.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.544+0000 7fc454ff9640 1 -- 172.21.15.103:0/3402485339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc438006f30 msgr2=0x7fc4380073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:06.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.544+0000 7fc454ff9640 1 --2- 172.21.15.103:0/3402485339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc438006f30 0x7fc4380073c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc438008090 tx=0x7fc44c009190 comp rx=0 tx=0).stop 2024-09-10T08:43:06.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.544+0000 7fc454ff9640 1 -- 172.21.15.103:0/3402485339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc438006f30 msgr2=0x7fc4380073c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:43:06.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.544+0000 7fc454ff9640 1 --2- 172.21.15.103:0/3402485339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc438006f30 0x7fc4380073c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:06.545 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:43:06.545 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:43:06.546 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:43:06.546 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:43:06.546 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 116, 2024-09-10T08:43:06.546 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 21279, 2024-09-10T08:43:06.546 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:43:06.546 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:43:06.546 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:43:06.546 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:43:06.546 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:06.546 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 16, 2024-09-10T08:43:06.546 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:43:06.546 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:43:06.546 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:43:06.547 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:43:06.547 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:43:06.547 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:43:06.547 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:43:06.547 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:43:06.547 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:43:06.547 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:43:06.547 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:43:06.547 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:43:06.547 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:43:06.547 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:43:06.547 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:06.548 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:43:06.548 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:43:06.548 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:43:06.548 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:43:06.548 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:43:06.548 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:43:06.548 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:43:06.548 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:43:06.548 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:43:06.548 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:43:06.548 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:43:06.548 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:43:06.548 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:43:06.549 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:06.549 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.549 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:43:06.549 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:43:06.549 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:43:06.549 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:43:06.549 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:43:06.549 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:43:06.549 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:43:06.549 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:43:06.549 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:43:06.549 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:43:06.550 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:43:06.550 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:43:06.550 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:43:06.550 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:43:06.550 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:43:06.550 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:43:06.550 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:43:06.550 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:43:06.550 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:43:06.550 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:43:06.551 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:43:06.551 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:43:06.551 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:43:06.551 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:43:06.551 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:43:06.551 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:43:06.551 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:43:06.551 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:43:06.551 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:06.551 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:43:06.552 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.552 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:43:06.552 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.552 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:43:06.552 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:43:06.552 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:43:06.552 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:43:06.552 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.552 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:43:06.552 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:43:06.553 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:06.553 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.553 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.553 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:43:06.553 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:43:06.553 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:06.553 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.553 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:06.553 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.553 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:43:06.553 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:43:06.553 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:43:06.553 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:43:06.554 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:43:06.554 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.554 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.554 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:43:06.554 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:43:06.554 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:43:06.554 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:43:06.554 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.555 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:43:06.555 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:43:06.555 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:06.555 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.555 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.555 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:43:06.555 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:43:06.555 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:06.555 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.555 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:06.555 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.555 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:43:06.555 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:43:06.556 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:43:06.556 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:43:06.556 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:43:06.556 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.556 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.556 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:43:06.556 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:43:06.556 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:43:06.556 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:43:06.556 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.556 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:43:06.556 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:43:06.557 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:06.557 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.557 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.557 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:43:06.557 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:43:06.557 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:06.557 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.557 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:06.557 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.557 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:43:06.557 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:43:06.557 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:43:06.557 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:43:06.557 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:43:06.558 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.558 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:06.558 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.558 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:43:06.558 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:43:06.558 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.558 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:43:06.558 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:43:06.558 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:43:06.558 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.558 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:06.558 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:43:06.558 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.558 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:43:06.559 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:43:06.559 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:43:06.559 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.559 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:06.559 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.559 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:43:06.559 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:43:06.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.548+0000 7fc45ea17640 1 -- 172.21.15.103:0/3402485339 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc44406be30 msgr2=0x7fc44406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:06.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.548+0000 7fc45ea17640 1 --2- 172.21.15.103:0/3402485339 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc44406be30 0x7fc44406e2f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc4480012e0 tx=0x7fc448007cc0 comp rx=0 tx=0).stop 2024-09-10T08:43:06.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.548+0000 7fc45ea17640 1 -- 172.21.15.103:0/3402485339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45806e640 msgr2=0x7fc4580a81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:06.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.548+0000 7fc45ea17640 1 --2- 172.21.15.103:0/3402485339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc45806e640 0x7fc4580a81d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc450001eb0 tx=0x7fc45000c890 comp rx=0 tx=0).stop 2024-09-10T08:43:06.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.548+0000 7fc45cfb4640 1 -- 172.21.15.103:0/3402485339 reap_dead start 2024-09-10T08:43:06.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.549+0000 7fc45ea17640 1 -- 172.21.15.103:0/3402485339 shutdown_connections 2024-09-10T08:43:06.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.549+0000 7fc45ea17640 1 -- 172.21.15.103:0/3402485339 >> 172.21.15.103:0/3402485339 conn(0x7fc4580c8430 msgr2=0x7fc45806ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:06.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.549+0000 7fc45ea17640 1 -- 172.21.15.103:0/3402485339 shutdown_connections 2024-09-10T08:43:06.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.549+0000 7fc45ea17640 1 -- 172.21.15.103:0/3402485339 wait complete. 2024-09-10T08:43:06.572 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:43:06.572 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:43:06.572 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:43:06.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.778+0000 7f6396723640 1 Processor -- start 2024-09-10T08:43:06.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.778+0000 7f6396723640 1 -- start start 2024-09-10T08:43:06.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.779+0000 7f6396723640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6390157ff0 0x7f63900c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:06.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.779+0000 7f6396723640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f63900c2980 0x7f639015aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:06.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.779+0000 7f6396723640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f639015e050 con 0x7f63900c5940 2024-09-10T08:43:06.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.779+0000 7f6396723640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f639015b670 con 0x7f6390157ff0 2024-09-10T08:43:06.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.779+0000 7f6396723640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f639015e330 con 0x7f63900c2980 2024-09-10T08:43:06.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.780+0000 7f638ffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6390157ff0 0x7f63900c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:06.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.780+0000 7f638ffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6390157ff0 0x7f63900c2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38074/0 (socket says 172.21.15.103:38074) 2024-09-10T08:43:06.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.780+0000 7f638ffff640 1 -- 172.21.15.103:0/39309988 learned_addr learned my addr 172.21.15.103:0/39309988 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:06.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.780+0000 7f638f7fe640 1 --2- 172.21.15.103:0/39309988 >> v2:172.21.15.154:3300/0 conn(0x7f63900c2980 0x7f639015aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:06.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.781+0000 7f638ffff640 1 -- 172.21.15.103:0/39309988 >> v2:172.21.15.154:3300/0 conn(0x7f63900c2980 msgr2=0x7f639015aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:06.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.781+0000 7f638ffff640 1 --2- 172.21.15.103:0/39309988 >> v2:172.21.15.154:3300/0 conn(0x7f63900c2980 0x7f639015aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:06.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.781+0000 7f638ffff640 1 -- 172.21.15.103:0/39309988 >> v1:172.21.15.103:6789/0 conn(0x7f63900c5940 legacy=0x7f639015af60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:43:06.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.781+0000 7f638ffff640 1 -- 172.21.15.103:0/39309988 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639015e610 con 0x7f6390157ff0 2024-09-10T08:43:06.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.782+0000 7f638ffff640 1 --2- 172.21.15.103:0/39309988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6390157ff0 0x7f63900c2440 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f63900a76c0 tx=0x7f638802a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de4ad7088dc0a84 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:06.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.783+0000 7f638effd640 1 -- 172.21.15.103:0/39309988 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388037070 con 0x7f6390157ff0 2024-09-10T08:43:06.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.783+0000 7f638effd640 1 -- 172.21.15.103:0/39309988 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63880323f0 con 0x7f6390157ff0 2024-09-10T08:43:06.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.784+0000 7f6396723640 1 -- 172.21.15.103:0/39309988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6390157ff0 msgr2=0x7f63900c2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:06.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.784+0000 7f6396723640 1 --2- 172.21.15.103:0/39309988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6390157ff0 0x7f63900c2440 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f63900a76c0 tx=0x7f638802a840 comp rx=0 tx=0).stop 2024-09-10T08:43:06.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.784+0000 7f6396723640 1 -- 172.21.15.103:0/39309988 shutdown_connections 2024-09-10T08:43:06.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.784+0000 7f6396723640 1 --2- 172.21.15.103:0/39309988 >> v2:172.21.15.154:3300/0 conn(0x7f63900c2980 0x7f639015aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:06.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.784+0000 7f6396723640 1 --2- 172.21.15.103:0/39309988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6390157ff0 0x7f63900c2440 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:06.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.784+0000 7f6396723640 1 -- 172.21.15.103:0/39309988 >> 172.21.15.103:0/39309988 conn(0x7f63900c7a40 msgr2=0x7f63900c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:06.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.785+0000 7f6396723640 1 -- 172.21.15.103:0/39309988 shutdown_connections 2024-09-10T08:43:06.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.785+0000 7f6396723640 1 -- 172.21.15.103:0/39309988 wait complete. 2024-09-10T08:43:06.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.787+0000 7f6396723640 1 Processor -- start 2024-09-10T08:43:06.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.787+0000 7f6396723640 1 -- start start 2024-09-10T08:43:06.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.788+0000 7f6396723640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63900c2980 0x7f6390147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:06.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.788+0000 7f6396723640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63900c5940 0x7f63900a8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:06.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.788+0000 7f6396723640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6390165080 0x7f63900a8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:06.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.788+0000 7f6396723640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f639015ddb0 con 0x7f63900c2980 2024-09-10T08:43:06.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.788+0000 7f6396723640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f639015dc30 con 0x7f63900c5940 2024-09-10T08:43:06.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.788+0000 7f6396723640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f639006f250 con 0x7f6390165080 2024-09-10T08:43:06.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.789+0000 7f638ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63900c2980 0x7f6390147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:06.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.789+0000 7f638ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63900c2980 0x7f6390147ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38084/0 (socket says 172.21.15.103:38084) 2024-09-10T08:43:06.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.789+0000 7f638ffff640 1 -- 172.21.15.103:0/2894324765 learned_addr learned my addr 172.21.15.103:0/2894324765 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:06.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.789+0000 7f638f7fe640 1 --2- 172.21.15.103:0/2894324765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63900c5940 0x7f63900a8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:06.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.790+0000 7f638ffff640 1 -- 172.21.15.103:0/2894324765 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6390165080 msgr2=0x7f63900a8b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:43:06.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.790+0000 7f638ffff640 1 --2- 172.21.15.103:0/2894324765 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6390165080 0x7f63900a8b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:06.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.790+0000 7f638ffff640 1 -- 172.21.15.103:0/2894324765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63900c5940 msgr2=0x7f63900a8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:06.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.790+0000 7f638ffff640 1 --2- 172.21.15.103:0/2894324765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63900c5940 0x7f63900a8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:06.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.790+0000 7f638ffff640 1 -- 172.21.15.103:0/2894324765 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63900adb40 con 0x7f63900c2980 2024-09-10T08:43:06.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.791+0000 7f638ffff640 1 --2- 172.21.15.103:0/2894324765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63900c2980 0x7f6390147ef0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f638800b260 tx=0x7f6388004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:06.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.792+0000 7f638cff9640 1 -- 172.21.15.103:0/2894324765 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388032e60 con 0x7f63900c2980 2024-09-10T08:43:06.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.792+0000 7f6396723640 1 -- 172.21.15.103:0/2894324765 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63900ab180 con 0x7f63900c2980 2024-09-10T08:43:06.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.792+0000 7f6396723640 1 -- 172.21.15.103:0/2894324765 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63900ab650 con 0x7f63900c2980 2024-09-10T08:43:06.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.803+0000 7f638cff9640 1 -- 172.21.15.103:0/2894324765 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6388038040 con 0x7f63900c2980 2024-09-10T08:43:06.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.803+0000 7f638cff9640 1 -- 172.21.15.103:0/2894324765 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388037070 con 0x7f63900c2980 2024-09-10T08:43:06.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.803+0000 7f638cff9640 1 -- 172.21.15.103:0/2894324765 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6388004440 con 0x7f63900c2980 2024-09-10T08:43:06.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.804+0000 7f638cff9640 1 --2- 172.21.15.103:0/2894324765 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f637806c070 0x7f637806e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:06.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.804+0000 7f638cff9640 1 -- 172.21.15.103:0/2894324765 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f63880abb40 con 0x7f63900c2980 2024-09-10T08:43:06.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.804+0000 7f638f7fe640 1 --2- 172.21.15.103:0/2894324765 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f637806c070 0x7f637806e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:06.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.805+0000 7f63767fc640 1 --2- 172.21.15.103:0/2894324765 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f639008da70 0x7f63900ab930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:06.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.805+0000 7f63767fc640 1 -- 172.21.15.103:0/2894324765 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6390157ff0 con 0x7f639008da70 2024-09-10T08:43:06.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.805+0000 7f6394cc0640 1 --2- 172.21.15.103:0/2894324765 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f639008da70 0x7f63900ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:06.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.806+0000 7f638f7fe640 1 --2- 172.21.15.103:0/2894324765 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f637806c070 0x7f637806e530 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6390148890 tx=0x7f6380008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:06.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.807+0000 7f6394cc0640 1 -- 172.21.15.103:0/2894324765 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f639006f030 con 0x7f639008da70 2024-09-10T08:43:06.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.807+0000 7f6394cc0640 1 --2- 172.21.15.103:0/2894324765 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f639008da70 0x7f63900ab930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6384009310 tx=0x7f63840097d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.809+0000 7f638cff9640 1 -- 172.21.15.103:0/2894324765 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6384010790 con 0x7f639008da70 2024-09-10T08:43:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.809+0000 7f638cff9640 1 -- 172.21.15.103:0/2894324765 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6384016070 con 0x7f639008da70 2024-09-10T08:43:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.809+0000 7f638cff9640 1 -- 172.21.15.103:0/2894324765 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f639008da70 msgr2=0x7f63900ab930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.809+0000 7f638cff9640 1 --2- 172.21.15.103:0/2894324765 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f639008da70 0x7f63900ab930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6384009310 tx=0x7f63840097d0 comp rx=0 tx=0).stop 2024-09-10T08:43:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.809+0000 7f638cff9640 1 -- 172.21.15.103:0/2894324765 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f639008da70 msgr2=0x7f63900ab930 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:43:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.809+0000 7f638cff9640 1 --2- 172.21.15.103:0/2894324765 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f639008da70 0x7f63900ab930 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6384009310 tx=0x7f63840097d0 comp rx=0 tx=0).stop 2024-09-10T08:43:06.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.823+0000 7f63767fc640 1 --2- 172.21.15.103:0/2894324765 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63900aa8e0 0x7f63900a6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:06.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.823+0000 7f63767fc640 1 -- 172.21.15.103:0/2894324765 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f639015d4e0 con 0x7f63900aa8e0 2024-09-10T08:43:06.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.825+0000 7f6394cc0640 1 --2- 172.21.15.103:0/2894324765 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63900aa8e0 0x7f63900a6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:06.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.827+0000 7f6394cc0640 1 -- 172.21.15.103:0/2894324765 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f63900764a0 con 0x7f63900aa8e0 2024-09-10T08:43:06.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.834+0000 7f6394cc0640 1 --2- 172.21.15.103:0/2894324765 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63900aa8e0 0x7f63900a6ea0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6390075de0 tx=0x7f6384004650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:06.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.834+0000 7f638cff9640 1 -- 172.21.15.103:0/2894324765 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6384010da0 con 0x7f63900aa8e0 2024-09-10T08:43:06.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.835+0000 7f638cff9640 1 -- 172.21.15.103:0/2894324765 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4888 (secure 0 0 0) 0x7f6384010da0 con 0x7f63900aa8e0 2024-09-10T08:43:06.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.835+0000 7f638cff9640 1 -- 172.21.15.103:0/2894324765 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63900aa8e0 msgr2=0x7f63900a6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:06.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.835+0000 7f638cff9640 1 --2- 172.21.15.103:0/2894324765 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63900aa8e0 0x7f63900a6ea0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6390075de0 tx=0x7f6384004650 comp rx=0 tx=0).stop 2024-09-10T08:43:06.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.835+0000 7f638cff9640 1 -- 172.21.15.103:0/2894324765 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63900aa8e0 msgr2=0x7f63900a6ea0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:43:06.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.835+0000 7f638cff9640 1 --2- 172.21.15.103:0/2894324765 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63900aa8e0 0x7f63900a6ea0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6390075de0 tx=0x7f6384004650 comp rx=0 tx=0).stop 2024-09-10T08:43:06.838 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:43:06.838 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:43:06.838 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:43:06.838 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:43:06.838 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 116, 2024-09-10T08:43:06.838 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 78734, 2024-09-10T08:43:06.838 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:43:06.838 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:43:06.838 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:43:06.838 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:43:06.838 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:06.839 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 16, 2024-09-10T08:43:06.839 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:43:06.839 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:43:06.839 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:43:06.839 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:43:06.839 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:43:06.839 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:43:06.839 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:43:06.839 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:43:06.839 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:43:06.839 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:43:06.839 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:43:06.840 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:43:06.840 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:43:06.840 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:43:06.840 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:06.840 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:43:06.840 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:43:06.840 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:43:06.840 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:43:06.840 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:43:06.840 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:43:06.840 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:43:06.840 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:43:06.841 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:43:06.841 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:43:06.841 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:43:06.841 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:43:06.841 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:43:06.841 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:06.841 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.841 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:43:06.841 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:43:06.841 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:43:06.841 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:43:06.841 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:43:06.841 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:43:06.842 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:43:06.842 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:43:06.842 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:43:06.842 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:43:06.842 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:43:06.842 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:43:06.842 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:43:06.842 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:43:06.842 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:43:06.842 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:43:06.842 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:43:06.842 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:43:06.842 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:43:06.843 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:43:06.843 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:43:06.843 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:43:06.843 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:43:06.843 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:43:06.843 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:43:06.843 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:43:06.843 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:43:06.843 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:43:06.843 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:06.843 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:43:06.844 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.844 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:43:06.844 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.844 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:43:06.844 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:43:06.844 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:43:06.844 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:43:06.844 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.844 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:43:06.844 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:43:06.844 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:06.844 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:43:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:43:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:43:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:43:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:43:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:43:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:43:06.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.846 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.846 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:43:06.846 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:43:06.846 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:43:06.846 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:43:06.846 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.846 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:43:06.846 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:43:06.846 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:06.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.846 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.846 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:43:06.846 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:43:06.847 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:06.847 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.847 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:06.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.847 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:43:06.847 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:43:06.847 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:43:06.847 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:43:06.847 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:43:06.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.847 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.848 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:43:06.848 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:43:06.848 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:43:06.848 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:43:06.848 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.848 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:43:06.848 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:43:06.848 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:06.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.848 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.848 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:43:06.848 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:43:06.849 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:06.849 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.849 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:06.849 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.849 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:43:06.849 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:43:06.849 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:43:06.849 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:43:06.849 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:43:06.849 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.849 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:06.849 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.849 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:43:06.850 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:43:06.850 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.850 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:43:06.850 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:43:06.850 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:43:06.850 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.850 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:06.850 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:43:06.850 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.850 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:43:06.850 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:43:06.850 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:43:06.850 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.850 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:06.851 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:43:06.851 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.851 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:43:06.851 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:43:06.851 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4 2024-09-10T08:43:06.851 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.851 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:06.851 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:43:06.851 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:06.851 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:43:06.851 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:43:06.851 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:43:06.851 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:06.851 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:06.852 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:06.852 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:43:06.852 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:43:06.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.840+0000 7f63767fc640 1 -- 172.21.15.103:0/2894324765 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f637806c070 msgr2=0x7f637806e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:06.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.840+0000 7f63767fc640 1 --2- 172.21.15.103:0/2894324765 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f637806c070 0x7f637806e530 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6390148890 tx=0x7f6380008040 comp rx=0 tx=0).stop 2024-09-10T08:43:06.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.840+0000 7f6394cc0640 1 -- 172.21.15.103:0/2894324765 reap_dead start 2024-09-10T08:43:06.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.840+0000 7f63767fc640 1 -- 172.21.15.103:0/2894324765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63900c2980 msgr2=0x7f6390147ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:06.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.840+0000 7f63767fc640 1 --2- 172.21.15.103:0/2894324765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63900c2980 0x7f6390147ef0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f638800b260 tx=0x7f6388004a40 comp rx=0 tx=0).stop 2024-09-10T08:43:06.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.840+0000 7f63767fc640 1 -- 172.21.15.103:0/2894324765 shutdown_connections 2024-09-10T08:43:06.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.840+0000 7f63767fc640 1 --2- 172.21.15.103:0/2894324765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63900c2980 0x7f6390147ef0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:06.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.840+0000 7f63767fc640 1 -- 172.21.15.103:0/2894324765 >> 172.21.15.103:0/2894324765 conn(0x7f63900c7a40 msgr2=0x7f6390155b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:06.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.841+0000 7f63767fc640 1 -- 172.21.15.103:0/2894324765 shutdown_connections 2024-09-10T08:43:06.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:06.841+0000 7f63767fc640 1 -- 172.21.15.103:0/2894324765 wait complete. 2024-09-10T08:43:06.860 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:43:06.860 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-10T08:43:06.860 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-10T08:43:06.860 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-10T08:43:06.860 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-10T08:43:06.860 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T08:43:06.861 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:43:06.881 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T08:43:06.881 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-10T08:43:06.881 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:43:07.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.124+0000 7f6c45ac8640 1 Processor -- start 2024-09-10T08:43:07.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.124+0000 7f6c45ac8640 1 -- start start 2024-09-10T08:43:07.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.126+0000 7f6c45ac8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6c400c5df0 0x7f6c40067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:07.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.126+0000 7f6c45ac8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c400c80c0 0x7f6c4015a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:07.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.126+0000 7f6c45ac8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c400685b0 con 0x7f6c40067bc0 2024-09-10T08:43:07.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.126+0000 7f6c45ac8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f6c40159610 con 0x7f6c400c5df0 2024-09-10T08:43:07.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.126+0000 7f6c45ac8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6c4015a5a0 con 0x7f6c400c80c0 2024-09-10T08:43:07.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.126+0000 7f6c3ffff640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7f6c400c5df0 msgr2=0x7f6c40067fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:43:07.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.126+0000 7f6c3ffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6c400c5df0 0x7f6c40067fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:43:07.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.126+0000 7f6c452c7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c400c80c0 0x7f6c4015a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:07.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.127+0000 7f6c452c7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c400c80c0 0x7f6c4015a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:35662/0 (socket says 172.21.15.103:35662) 2024-09-10T08:43:07.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.127+0000 7f6c452c7640 1 -- 172.21.15.103:0/1938934512 learned_addr learned my addr 172.21.15.103:0/1938934512 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:07.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.128+0000 7f6c452c7640 1 -- 172.21.15.103:0/1938934512 >> v2:172.21.15.103:3300/0 conn(0x7f6c400c5df0 msgr2=0x7f6c40067fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:43:07.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.128+0000 7f6c452c7640 1 --2- 172.21.15.103:0/1938934512 >> v2:172.21.15.103:3300/0 conn(0x7f6c400c5df0 0x7f6c40067fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:07.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.128+0000 7f6c452c7640 1 -- 172.21.15.103:0/1938934512 >> v1:172.21.15.154:6789/0 conn(0x7f6c40067bc0 legacy=0x7f6c40156020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T08:43:07.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.128+0000 7f6c452c7640 1 -- 172.21.15.103:0/1938934512 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c40068890 con 0x7f6c400c80c0 2024-09-10T08:43:07.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.130+0000 7f6c452c7640 1 --2- 172.21.15.103:0/1938934512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c400c80c0 0x7f6c4015a060 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009870 tx=0x7f6c28032920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5653340387e9fff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:07.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.132+0000 7f6c3f7fe640 1 -- 172.21.15.103:0/1938934512 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c28035070 con 0x7f6c400c80c0 2024-09-10T08:43:07.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.132+0000 7f6c3f7fe640 1 -- 172.21.15.103:0/1938934512 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c2803e070 con 0x7f6c400c80c0 2024-09-10T08:43:07.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.132+0000 7f6c3f7fe640 1 -- 172.21.15.103:0/1938934512 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c28038a00 con 0x7f6c400c80c0 2024-09-10T08:43:07.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.133+0000 7f6c45ac8640 1 -- 172.21.15.103:0/1938934512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c400c80c0 msgr2=0x7f6c4015a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:07.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.133+0000 7f6c45ac8640 1 --2- 172.21.15.103:0/1938934512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c400c80c0 0x7f6c4015a060 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009870 tx=0x7f6c28032920 comp rx=0 tx=0).stop 2024-09-10T08:43:07.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.136+0000 7f6c45ac8640 1 -- 172.21.15.103:0/1938934512 shutdown_connections 2024-09-10T08:43:07.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.136+0000 7f6c45ac8640 1 --2- 172.21.15.103:0/1938934512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c400c80c0 0x7f6c4015a060 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:07.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.136+0000 7f6c45ac8640 1 --2- 172.21.15.103:0/1938934512 >> v2:172.21.15.103:3300/0 conn(0x7f6c400c5df0 0x7f6c40067fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:07.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.137+0000 7f6c45ac8640 1 -- 172.21.15.103:0/1938934512 >> 172.21.15.103:0/1938934512 conn(0x7f6c400c8670 msgr2=0x7f6c400c8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:07.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.145+0000 7f6c45ac8640 1 -- 172.21.15.103:0/1938934512 shutdown_connections 2024-09-10T08:43:07.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.145+0000 7f6c45ac8640 1 -- 172.21.15.103:0/1938934512 wait complete. 2024-09-10T08:43:07.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.147+0000 7f6c45ac8640 1 Processor -- start 2024-09-10T08:43:07.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.147+0000 7f6c45ac8640 1 -- start start 2024-09-10T08:43:07.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.148+0000 7f6c45ac8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c40067bc0 0x7f6c401e85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:07.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.148+0000 7f6c45ac8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c400c5df0 0x7f6c400ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:07.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.148+0000 7f6c45ac8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c400c80c0 0x7f6c400711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:07.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.148+0000 7f6c45ac8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6c40153410 con 0x7f6c400c80c0 2024-09-10T08:43:07.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.148+0000 7f6c45ac8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c40159b40 con 0x7f6c400c5df0 2024-09-10T08:43:07.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.148+0000 7f6c45ac8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6c40153590 con 0x7f6c40067bc0 2024-09-10T08:43:07.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.149+0000 7f6c452c7640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c400c80c0 msgr2=0x7f6c400711b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:43:07.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.149+0000 7f6c452c7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c400c80c0 0x7f6c400711b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:43:07.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.150+0000 7f6c3ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c400c5df0 0x7f6c400ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:07.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.150+0000 7f6c3ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c400c5df0 0x7f6c400ca080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:46562/0 (socket says 172.21.15.103:46562) 2024-09-10T08:43:07.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.150+0000 7f6c3ffff640 1 -- 172.21.15.103:0/308419190 learned_addr learned my addr 172.21.15.103:0/308419190 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:07.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.151+0000 7f6c44ac6640 1 --2- 172.21.15.103:0/308419190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c40067bc0 0x7f6c401e85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:07.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.153+0000 7f6c44ac6640 1 -- 172.21.15.103:0/308419190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c400c5df0 msgr2=0x7f6c400ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:07.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.153+0000 7f6c44ac6640 1 --2- 172.21.15.103:0/308419190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c400c5df0 0x7f6c400ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:07.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.154+0000 7f6c44ac6640 1 -- 172.21.15.103:0/308419190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c400c80c0 msgr2=0x7f6c400711b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:43:07.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.154+0000 7f6c44ac6640 1 --2- 172.21.15.103:0/308419190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c400c80c0 0x7f6c400711b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:07.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.154+0000 7f6c44ac6640 1 -- 172.21.15.103:0/308419190 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c40070d90 con 0x7f6c40067bc0 2024-09-10T08:43:07.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.155+0000 7f6c44ac6640 1 --2- 172.21.15.103:0/308419190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c40067bc0 0x7f6c401e85b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000be20 tx=0x7f6c30009f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:07.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.156+0000 7f6c3d7fa640 1 -- 172.21.15.103:0/308419190 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30019070 con 0x7f6c40067bc0 2024-09-10T08:43:07.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.156+0000 7f6c3d7fa640 1 -- 172.21.15.103:0/308419190 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c30014440 con 0x7f6c40067bc0 2024-09-10T08:43:07.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.156+0000 7f6c3d7fa640 1 -- 172.21.15.103:0/308419190 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30014830 con 0x7f6c40067bc0 2024-09-10T08:43:07.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.156+0000 7f6c45ac8640 1 -- 172.21.15.103:0/308419190 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c401e8af0 con 0x7f6c40067bc0 2024-09-10T08:43:07.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.157+0000 7f6c45ac8640 1 -- 172.21.15.103:0/308419190 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c4014e670 con 0x7f6c40067bc0 2024-09-10T08:43:07.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.162+0000 7f6c45ac8640 1 -- 172.21.15.103:0/308419190 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c24005290 con 0x7f6c40067bc0 2024-09-10T08:43:07.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.163+0000 7f6c3d7fa640 1 -- 172.21.15.103:0/308419190 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c3001c070 con 0x7f6c40067bc0 2024-09-10T08:43:07.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.163+0000 7f6c3d7fa640 1 --2- 172.21.15.103:0/308419190 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6c2006be30 0x7f6c2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:07.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.164+0000 7f6c3d7fa640 1 -- 172.21.15.103:0/308419190 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f6c3008b110 con 0x7f6c40067bc0 2024-09-10T08:43:07.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.166+0000 7f6c3ffff640 1 --2- 172.21.15.103:0/308419190 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6c2006be30 0x7f6c2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:07.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.166+0000 7f6c3ffff640 1 --2- 172.21.15.103:0/308419190 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6c2006be30 0x7f6c2006e2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6c40153070 tx=0x7f6c38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:07.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.173+0000 7f6c3d7fa640 1 -- 172.21.15.103:0/308419190 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6c30059790 con 0x7f6c40067bc0 2024-09-10T08:43:07.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.690+0000 7f6c45ac8640 1 -- 172.21.15.103:0/308419190 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6c24005580 con 0x7f6c40067bc0 2024-09-10T08:43:07.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.691+0000 7f6c3d7fa640 1 -- 172.21.15.103:0/308419190 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1570 (secure 0 0 0) 0x7f6c30059090 con 0x7f6c40067bc0 2024-09-10T08:43:07.691 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":116,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:43:07.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.698+0000 7f6c45ac8640 1 -- 172.21.15.103:0/308419190 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6c2006be30 msgr2=0x7f6c2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:07.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.698+0000 7f6c45ac8640 1 --2- 172.21.15.103:0/308419190 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6c2006be30 0x7f6c2006e2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6c40153070 tx=0x7f6c38008040 comp rx=0 tx=0).stop 2024-09-10T08:43:07.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.698+0000 7f6c45ac8640 1 -- 172.21.15.103:0/308419190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c40067bc0 msgr2=0x7f6c401e85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:07.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.698+0000 7f6c45ac8640 1 --2- 172.21.15.103:0/308419190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c40067bc0 0x7f6c401e85b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000be20 tx=0x7f6c30009f70 comp rx=0 tx=0).stop 2024-09-10T08:43:07.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.700+0000 7f6c45ac8640 1 -- 172.21.15.103:0/308419190 shutdown_connections 2024-09-10T08:43:07.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.700+0000 7f6c45ac8640 1 --2- 172.21.15.103:0/308419190 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6c2006be30 0x7f6c2006e2f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:07.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.700+0000 7f6c45ac8640 1 --2- 172.21.15.103:0/308419190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c400c80c0 0x7f6c400711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:07.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.700+0000 7f6c45ac8640 1 --2- 172.21.15.103:0/308419190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c400c5df0 0x7f6c400ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:07.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.700+0000 7f6c45ac8640 1 --2- 172.21.15.103:0/308419190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c40067bc0 0x7f6c401e85b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:07.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.700+0000 7f6c45ac8640 1 -- 172.21.15.103:0/308419190 >> 172.21.15.103:0/308419190 conn(0x7f6c400c8670 msgr2=0x7f6c400c8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.701+0000 7f6c45ac8640 1 -- 172.21.15.103:0/308419190 shutdown_connections 2024-09-10T08:43:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:07.701+0000 7f6c45ac8640 1 -- 172.21.15.103:0/308419190 wait complete. 2024-09-10T08:43:10.727 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:43:10.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.898+0000 7fed94128640 1 Processor -- start 2024-09-10T08:43:10.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.898+0000 7fed94128640 1 -- start start 2024-09-10T08:43:10.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.899+0000 7fed94128640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fed8c0c7230 0x7fed8c1562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:10.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.899+0000 7fed94128640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8c14fc00 0x7fed8c0c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:10.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.899+0000 7fed94128640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed8c0c53f0 con 0x7fed8c14f820 2024-09-10T08:43:10.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.899+0000 7fed94128640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fed8c1532d0 con 0x7fed8c0c7230 2024-09-10T08:43:10.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.899+0000 7fed94128640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fed8c0c2d60 con 0x7fed8c14fc00 2024-09-10T08:43:10.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.899+0000 7fed91ec4640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fed8c14f820 0x7fed8c152bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:35654/0 (socket says 172.21.15.103:35654) 2024-09-10T08:43:10.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.899+0000 7fed91ec4640 1 -- 172.21.15.103:0/1989013295 learned_addr learned my addr 172.21.15.103:0/1989013295 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:43:10.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.899+0000 7fed926c5640 1 --2- 172.21.15.103:0/1989013295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8c14fc00 0x7fed8c0c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:10.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.900+0000 7fed926c5640 1 -- 172.21.15.103:0/1989013295 >> v2:172.21.15.154:3300/0 conn(0x7fed8c0c7230 msgr2=0x7fed8c1562d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:43:10.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.900+0000 7fed926c5640 1 --2- 172.21.15.103:0/1989013295 >> v2:172.21.15.154:3300/0 conn(0x7fed8c0c7230 0x7fed8c1562d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:10.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.900+0000 7fed926c5640 1 -- 172.21.15.103:0/1989013295 >> v1:172.21.15.154:6789/0 conn(0x7fed8c14f820 legacy=0x7fed8c152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:10.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.900+0000 7fed926c5640 1 -- 172.21.15.103:0/1989013295 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed8c0c3040 con 0x7fed8c14fc00 2024-09-10T08:43:10.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.908+0000 7fed926c5640 1 --2- 172.21.15.103:0/1989013295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8c14fc00 0x7fed8c0c41e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fed8400d1e0 tx=0x7fed8402c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a56bff7214f9120 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.912+0000 7fed90ec2640 1 -- 172.21.15.103:0/1989013295 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed840337e0 con 0x7fed8c14fc00 2024-09-10T08:43:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.913+0000 7fed90ec2640 1 -- 172.21.15.103:0/1989013295 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed84039070 con 0x7fed8c14fc00 2024-09-10T08:43:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.913+0000 7fed90ec2640 1 -- 172.21.15.103:0/1989013295 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed84033ba0 con 0x7fed8c14fc00 2024-09-10T08:43:10.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.914+0000 7fed94128640 1 -- 172.21.15.103:0/1989013295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8c14fc00 msgr2=0x7fed8c0c41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:10.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.914+0000 7fed94128640 1 --2- 172.21.15.103:0/1989013295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8c14fc00 0x7fed8c0c41e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fed8400d1e0 tx=0x7fed8402c970 comp rx=0 tx=0).stop 2024-09-10T08:43:10.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.922+0000 7fed94128640 1 -- 172.21.15.103:0/1989013295 shutdown_connections 2024-09-10T08:43:10.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.922+0000 7fed94128640 1 --2- 172.21.15.103:0/1989013295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8c14fc00 0x7fed8c0c41e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:10.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.922+0000 7fed94128640 1 --2- 172.21.15.103:0/1989013295 >> v2:172.21.15.154:3300/0 conn(0x7fed8c0c7230 0x7fed8c1562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:10.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.922+0000 7fed94128640 1 -- 172.21.15.103:0/1989013295 >> 172.21.15.103:0/1989013295 conn(0x7fed8c0c7a40 msgr2=0x7fed8c0c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:10.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.922+0000 7fed94128640 1 -- 172.21.15.103:0/1989013295 shutdown_connections 2024-09-10T08:43:10.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.922+0000 7fed94128640 1 -- 172.21.15.103:0/1989013295 wait complete. 2024-09-10T08:43:10.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.924+0000 7fed94128640 1 Processor -- start 2024-09-10T08:43:10.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.924+0000 7fed94128640 1 -- start start 2024-09-10T08:43:10.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.925+0000 7fed94128640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8c0c7230 0x7fed8c0a8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:10.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.925+0000 7fed94128640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed8c14f820 0x7fed8c154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:10.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.925+0000 7fed94128640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8c14fc00 0x7fed8c153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:10.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.925+0000 7fed94128640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fed8c0c5bf0 con 0x7fed8c14fc00 2024-09-10T08:43:10.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.925+0000 7fed94128640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fed8c152350 con 0x7fed8c14f820 2024-09-10T08:43:10.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.925+0000 7fed94128640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fed8c0c5d70 con 0x7fed8c0c7230 2024-09-10T08:43:10.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.925+0000 7fed926c5640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8c14fc00 msgr2=0x7fed8c153d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:43:10.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.925+0000 7fed926c5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8c14fc00 0x7fed8c153d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:43:10.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.928+0000 7fed91ec4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8c0c7230 0x7fed8c0a8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:10.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.928+0000 7fed91ec4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8c0c7230 0x7fed8c0a8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:35686/0 (socket says 172.21.15.103:35686) 2024-09-10T08:43:10.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.928+0000 7fed916c3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed8c14f820 0x7fed8c154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:10.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.928+0000 7fed916c3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed8c14f820 0x7fed8c154960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:46572/0 (socket says 172.21.15.103:46572) 2024-09-10T08:43:10.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.928+0000 7fed91ec4640 1 -- 172.21.15.103:0/2854955860 learned_addr learned my addr 172.21.15.103:0/2854955860 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:10.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.932+0000 7fed91ec4640 1 -- 172.21.15.103:0/2854955860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed8c14f820 msgr2=0x7fed8c154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:10.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.932+0000 7fed91ec4640 1 --2- 172.21.15.103:0/2854955860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed8c14f820 0x7fed8c154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:10.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.932+0000 7fed91ec4640 1 -- 172.21.15.103:0/2854955860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8c14fc00 msgr2=0x7fed8c153d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:43:10.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.932+0000 7fed91ec4640 1 --2- 172.21.15.103:0/2854955860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8c14fc00 0x7fed8c153d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:10.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.932+0000 7fed91ec4640 1 -- 172.21.15.103:0/2854955860 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed8c1efe40 con 0x7fed8c0c7230 2024-09-10T08:43:10.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.932+0000 7fed916c3640 1 --2- 172.21.15.103:0/2854955860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed8c14f820 0x7fed8c154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:43:10.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.933+0000 7fed91ec4640 1 --2- 172.21.15.103:0/2854955860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8c0c7230 0x7fed8c0a8c50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00c400 tx=0x7fed7c00c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:10.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.936+0000 7fed827fc640 1 -- 172.21.15.103:0/2854955860 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c017070 con 0x7fed8c0c7230 2024-09-10T08:43:10.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.936+0000 7fed94128640 1 -- 172.21.15.103:0/2854955860 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed8c0aa4c0 con 0x7fed8c0c7230 2024-09-10T08:43:10.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.936+0000 7fed94128640 1 -- 172.21.15.103:0/2854955860 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fed8c154ea0 con 0x7fed8c0c7230 2024-09-10T08:43:10.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.937+0000 7fed827fc640 1 -- 172.21.15.103:0/2854955860 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed7c005ce0 con 0x7fed8c0c7230 2024-09-10T08:43:10.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.937+0000 7fed827fc640 1 -- 172.21.15.103:0/2854955860 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c0072f0 con 0x7fed8c0c7230 2024-09-10T08:43:10.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.939+0000 7fed77fff640 1 -- 172.21.15.103:0/2854955860 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed8c1f01c0 con 0x7fed8c0c7230 2024-09-10T08:43:10.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.940+0000 7fed827fc640 1 -- 172.21.15.103:0/2854955860 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed7c01a070 con 0x7fed8c0c7230 2024-09-10T08:43:10.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.941+0000 7fed827fc640 1 --2- 172.21.15.103:0/2854955860 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fed7006be30 0x7fed7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:10.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.941+0000 7fed827fc640 1 -- 172.21.15.103:0/2854955860 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fed7c08a5a0 con 0x7fed8c0c7230 2024-09-10T08:43:10.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.941+0000 7fed916c3640 1 --2- 172.21.15.103:0/2854955860 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fed7006be30 0x7fed7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:10.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.942+0000 7fed916c3640 1 --2- 172.21.15.103:0/2854955860 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fed7006be30 0x7fed7006e2f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fed8c14d4e0 tx=0x7fed88009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:10.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:10.954+0000 7fed827fc640 1 -- 172.21.15.103:0/2854955860 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fed7c058540 con 0x7fed8c0c7230 2024-09-10T08:43:11.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:11.451+0000 7fed77fff640 1 -- 172.21.15.103:0/2854955860 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fed8c150740 con 0x7fed8c0c7230 2024-09-10T08:43:11.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:11.452+0000 7fed827fc640 1 -- 172.21.15.103:0/2854955860 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1570 (secure 0 0 0) 0x7fed7c05c840 con 0x7fed8c0c7230 2024-09-10T08:43:11.454 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":116,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:43:11.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:11.461+0000 7fed77fff640 1 -- 172.21.15.103:0/2854955860 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fed7006be30 msgr2=0x7fed7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:11.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:11.461+0000 7fed77fff640 1 --2- 172.21.15.103:0/2854955860 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fed7006be30 0x7fed7006e2f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fed8c14d4e0 tx=0x7fed88009060 comp rx=0 tx=0).stop 2024-09-10T08:43:11.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:11.461+0000 7fed77fff640 1 -- 172.21.15.103:0/2854955860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8c0c7230 msgr2=0x7fed8c0a8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:11.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:11.461+0000 7fed77fff640 1 --2- 172.21.15.103:0/2854955860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8c0c7230 0x7fed8c0a8c50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00c400 tx=0x7fed7c00c8c0 comp rx=0 tx=0).stop 2024-09-10T08:43:11.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:11.461+0000 7fed77fff640 1 -- 172.21.15.103:0/2854955860 shutdown_connections 2024-09-10T08:43:11.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:11.461+0000 7fed77fff640 1 --2- 172.21.15.103:0/2854955860 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fed7006be30 0x7fed7006e2f0 secure :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fed8c14d4e0 tx=0x7fed88009060 comp rx=0 tx=0).stop 2024-09-10T08:43:11.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:11.461+0000 7fed77fff640 1 --2- 172.21.15.103:0/2854955860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8c14fc00 0x7fed8c153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:11.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:11.461+0000 7fed77fff640 1 --2- 172.21.15.103:0/2854955860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed8c14f820 0x7fed8c154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:11.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:11.461+0000 7fed77fff640 1 --2- 172.21.15.103:0/2854955860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8c0c7230 0x7fed8c0a8c50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:11.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:11.461+0000 7fed77fff640 1 -- 172.21.15.103:0/2854955860 >> 172.21.15.103:0/2854955860 conn(0x7fed8c0c7a40 msgr2=0x7fed8c0c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:11.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:11.465+0000 7fed77fff640 1 -- 172.21.15.103:0/2854955860 shutdown_connections 2024-09-10T08:43:11.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:11.465+0000 7fed77fff640 1 -- 172.21.15.103:0/2854955860 wait complete. 2024-09-10T08:43:14.486 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:43:14.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.638+0000 7f5a2b2af640 1 Processor -- start 2024-09-10T08:43:14.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.638+0000 7f5a2b2af640 1 -- start start 2024-09-10T08:43:14.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.639+0000 7f5a2b2af640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5a240c26b0 0x7f5a24166490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:14.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.639+0000 7f5a2b2af640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a2408d440 0x7f5a2408d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:14.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.639+0000 7f5a2b2af640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a2408ddb0 con 0x7f5a240c5940 2024-09-10T08:43:14.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.639+0000 7f5a2b2af640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f5a241630c0 con 0x7f5a240c26b0 2024-09-10T08:43:14.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.639+0000 7f5a2b2af640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f5a24166a70 con 0x7f5a2408d440 2024-09-10T08:43:14.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.639+0000 7f5a2904b640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7f5a240c26b0 msgr2=0x7f5a24166490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:43:14.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.639+0000 7f5a2904b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5a240c26b0 0x7f5a24166490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:43:14.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.639+0000 7f5a2884a640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5a240c5940 0x7f5a24163550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:35668/0 (socket says 172.21.15.103:35668) 2024-09-10T08:43:14.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.639+0000 7f5a2884a640 1 -- 172.21.15.103:0/4036518776 learned_addr learned my addr 172.21.15.103:0/4036518776 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:43:14.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.639+0000 7f5a2984c640 1 --2- 172.21.15.103:0/4036518776 >> v2:172.21.15.154:3300/0 conn(0x7f5a2408d440 0x7f5a2408d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:14.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.673+0000 7f5a2984c640 1 -- 172.21.15.103:0/4036518776 >> v2:172.21.15.103:3300/0 conn(0x7f5a240c26b0 msgr2=0x7f5a24166490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:43:14.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.673+0000 7f5a2984c640 1 --2- 172.21.15.103:0/4036518776 >> v2:172.21.15.103:3300/0 conn(0x7f5a240c26b0 0x7f5a24166490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.673+0000 7f5a2984c640 1 -- 172.21.15.103:0/4036518776 >> v1:172.21.15.154:6789/0 conn(0x7f5a240c5940 legacy=0x7f5a24163550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:14.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.674+0000 7f5a2984c640 1 -- 172.21.15.103:0/4036518776 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a24166d50 con 0x7f5a2408d440 2024-09-10T08:43:14.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.675+0000 7f5a2984c640 1 --2- 172.21.15.103:0/4036518776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a2408d440 0x7f5a2408d870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5a24162f40 tx=0x7f5a1c02c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d95434ce69605e9b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:14.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.675+0000 7f5a1bfff640 1 -- 172.21.15.103:0/4036518776 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c03b070 con 0x7f5a2408d440 2024-09-10T08:43:14.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.676+0000 7f5a1bfff640 1 -- 172.21.15.103:0/4036518776 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a1c031070 con 0x7f5a2408d440 2024-09-10T08:43:14.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.676+0000 7f5a1bfff640 1 -- 172.21.15.103:0/4036518776 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c033880 con 0x7f5a2408d440 2024-09-10T08:43:14.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.677+0000 7f5a2b2af640 1 -- 172.21.15.103:0/4036518776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a2408d440 msgr2=0x7f5a2408d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:14.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.677+0000 7f5a2b2af640 1 --2- 172.21.15.103:0/4036518776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a2408d440 0x7f5a2408d870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5a24162f40 tx=0x7f5a1c02c7f0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.677+0000 7f5a2b2af640 1 -- 172.21.15.103:0/4036518776 shutdown_connections 2024-09-10T08:43:14.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.677+0000 7f5a2b2af640 1 --2- 172.21.15.103:0/4036518776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a2408d440 0x7f5a2408d870 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.677+0000 7f5a2b2af640 1 --2- 172.21.15.103:0/4036518776 >> v2:172.21.15.103:3300/0 conn(0x7f5a240c26b0 0x7f5a24166490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.677+0000 7f5a2b2af640 1 -- 172.21.15.103:0/4036518776 >> 172.21.15.103:0/4036518776 conn(0x7f5a240c7a40 msgr2=0x7f5a240c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:14.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.677+0000 7f5a2b2af640 1 -- 172.21.15.103:0/4036518776 shutdown_connections 2024-09-10T08:43:14.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.677+0000 7f5a2b2af640 1 -- 172.21.15.103:0/4036518776 wait complete. 2024-09-10T08:43:14.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.679+0000 7f5a2b2af640 1 Processor -- start 2024-09-10T08:43:14.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.680+0000 7f5a2b2af640 1 -- start start 2024-09-10T08:43:14.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.685+0000 7f5a2b2af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a2408d440 0x7f5a240ac480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:14.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.685+0000 7f5a2b2af640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a240c26b0 0x7f5a24073f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:14.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.685+0000 7f5a2b2af640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a240c5940 0x7f5a240744b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:14.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.685+0000 7f5a2b2af640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5a2406f2e0 con 0x7f5a240c26b0 2024-09-10T08:43:14.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.685+0000 7f5a2b2af640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5a24167310 con 0x7f5a2408d440 2024-09-10T08:43:14.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.685+0000 7f5a2b2af640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5a2406f460 con 0x7f5a240c5940 2024-09-10T08:43:14.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.690+0000 7f5a2884a640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a240c26b0 msgr2=0x7f5a24073f70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:43:14.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.690+0000 7f5a2884a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a240c26b0 0x7f5a24073f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:43:14.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.691+0000 7f5a2984c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a240c5940 0x7f5a240744b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:14.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.692+0000 7f5a2984c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a240c5940 0x7f5a240744b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:35692/0 (socket says 172.21.15.103:35692) 2024-09-10T08:43:14.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.692+0000 7f5a2984c640 1 -- 172.21.15.103:0/1518929456 learned_addr learned my addr 172.21.15.103:0/1518929456 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:14.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.692+0000 7f5a2984c640 1 -- 172.21.15.103:0/1518929456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a2408d440 msgr2=0x7f5a240ac480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:14.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.692+0000 7f5a2984c640 1 --2- 172.21.15.103:0/1518929456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a2408d440 0x7f5a240ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.692+0000 7f5a2984c640 1 -- 172.21.15.103:0/1518929456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a240c26b0 msgr2=0x7f5a24073f70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:43:14.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.692+0000 7f5a2984c640 1 --2- 172.21.15.103:0/1518929456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a240c26b0 0x7f5a24073f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.692+0000 7f5a2984c640 1 -- 172.21.15.103:0/1518929456 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a241fac90 con 0x7f5a240c5940 2024-09-10T08:43:14.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.693+0000 7f5a2984c640 1 --2- 172.21.15.103:0/1518929456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a240c5940 0x7f5a240744b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c005df0 tx=0x7f5a1c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:14.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.698+0000 7f5a19ffb640 1 -- 172.21.15.103:0/1518929456 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c045070 con 0x7f5a240c5940 2024-09-10T08:43:14.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.698+0000 7f5a19ffb640 1 -- 172.21.15.103:0/1518929456 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a1c040930 con 0x7f5a240c5940 2024-09-10T08:43:14.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.698+0000 7f5a19ffb640 1 -- 172.21.15.103:0/1518929456 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c03b040 con 0x7f5a240c5940 2024-09-10T08:43:14.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.698+0000 7f5a2b2af640 1 -- 172.21.15.103:0/1518929456 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a241ecf50 con 0x7f5a240c5940 2024-09-10T08:43:14.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.698+0000 7f5a2b2af640 1 -- 172.21.15.103:0/1518929456 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a241ed510 con 0x7f5a240c5940 2024-09-10T08:43:14.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.702+0000 7f5a2b2af640 1 -- 172.21.15.103:0/1518929456 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a24069080 con 0x7f5a240c5940 2024-09-10T08:43:14.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.702+0000 7f5a19ffb640 1 -- 172.21.15.103:0/1518929456 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5a1c03e070 con 0x7f5a240c5940 2024-09-10T08:43:14.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.703+0000 7f5a19ffb640 1 --2- 172.21.15.103:0/1518929456 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5a0806be30 0x7f5a0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:14.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.703+0000 7f5a19ffb640 1 -- 172.21.15.103:0/1518929456 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f5a1c0ad590 con 0x7f5a240c5940 2024-09-10T08:43:14.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.703+0000 7f5a2904b640 1 --2- 172.21.15.103:0/1518929456 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5a0806be30 0x7f5a0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:14.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.704+0000 7f5a2904b640 1 --2- 172.21.15.103:0/1518929456 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5a0806be30 0x7f5a0806e2f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5a2408cda0 tx=0x7f5a20006cf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:14.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:14.718+0000 7f5a19ffb640 1 -- 172.21.15.103:0/1518929456 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5a1c04e020 con 0x7f5a240c5940 2024-09-10T08:43:15.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:15.230+0000 7f5a2b2af640 1 -- 172.21.15.103:0/1518929456 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5a241edbb0 con 0x7f5a240c5940 2024-09-10T08:43:15.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:15.237+0000 7f5a19ffb640 1 -- 172.21.15.103:0/1518929456 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1570 (secure 0 0 0) 0x7f5a1c033070 con 0x7f5a240c5940 2024-09-10T08:43:15.240 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":116,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:43:15.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:15.240+0000 7f5a077fe640 1 -- 172.21.15.103:0/1518929456 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5a0806be30 msgr2=0x7f5a0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:15.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:15.240+0000 7f5a077fe640 1 --2- 172.21.15.103:0/1518929456 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5a0806be30 0x7f5a0806e2f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5a2408cda0 tx=0x7f5a20006cf0 comp rx=0 tx=0).stop 2024-09-10T08:43:15.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:15.240+0000 7f5a077fe640 1 -- 172.21.15.103:0/1518929456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a240c5940 msgr2=0x7f5a240744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:15.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:15.240+0000 7f5a077fe640 1 --2- 172.21.15.103:0/1518929456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a240c5940 0x7f5a240744b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c005df0 tx=0x7f5a1c004a40 comp rx=0 tx=0).stop 2024-09-10T08:43:15.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:15.240+0000 7f5a077fe640 1 -- 172.21.15.103:0/1518929456 shutdown_connections 2024-09-10T08:43:15.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:15.240+0000 7f5a077fe640 1 --2- 172.21.15.103:0/1518929456 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5a0806be30 0x7f5a0806e2f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:15.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:15.240+0000 7f5a077fe640 1 --2- 172.21.15.103:0/1518929456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a240c5940 0x7f5a240744b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:15.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:15.240+0000 7f5a077fe640 1 --2- 172.21.15.103:0/1518929456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a240c26b0 0x7f5a24073f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:15.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:15.241+0000 7f5a077fe640 1 --2- 172.21.15.103:0/1518929456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a2408d440 0x7f5a240ac480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:15.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:15.241+0000 7f5a077fe640 1 -- 172.21.15.103:0/1518929456 >> 172.21.15.103:0/1518929456 conn(0x7f5a240c7a40 msgr2=0x7f5a240c6640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:15.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:15.242+0000 7f5a077fe640 1 -- 172.21.15.103:0/1518929456 shutdown_connections 2024-09-10T08:43:15.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:15.245+0000 7f5a077fe640 1 -- 172.21.15.103:0/1518929456 wait complete. 2024-09-10T08:43:18.269 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:43:18.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.500+0000 7f048e952640 1 Processor -- start 2024-09-10T08:43:18.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.503+0000 7f048e952640 1 -- start start 2024-09-10T08:43:18.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.504+0000 7f048e952640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 0x7f0488153390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:18.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.504+0000 7f048e952640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04880c3d60 0x7f048814fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:18.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.504+0000 7f048ceef640 1 -- >> v2:172.21.15.103:3300/0 conn(0x7f04880c3d60 msgr2=0x7f048814fba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:43:18.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.504+0000 7f048ceef640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04880c3d60 0x7f048814fba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:43:18.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.504+0000 7f04877fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 0x7f0488153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:18.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.505+0000 7f04877fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 0x7f0488153390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:45596/0 (socket says 172.21.15.103:45596) 2024-09-10T08:43:18.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.505+0000 7f04877fe640 1 -- 172.21.15.103:0/1171336623 learned_addr learned my addr 172.21.15.103:0/1171336623 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:18.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.505+0000 7f048e952640 1 -- 172.21.15.103:0/1171336623 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04880c37a0 con 0x7f04880aba60 2024-09-10T08:43:18.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.505+0000 7f048e952640 1 -- 172.21.15.103:0/1171336623 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f04880c3a80 con 0x7f04880c3d60 2024-09-10T08:43:18.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.505+0000 7f048e952640 1 -- 172.21.15.103:0/1171336623 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f0488155fb0 con 0x7f04880c2e30 2024-09-10T08:43:18.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.505+0000 7f0487fff640 1 -- 172.21.15.103:0/1171336623 >> v1:172.21.15.103:6789/0 conn(0x7f04880aba60 legacy=0x7f04881567b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:43:18.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.507+0000 7f04877fe640 1 -- 172.21.15.103:0/1171336623 >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 msgr2=0x7f0488153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:43:18.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.507+0000 7f04877fe640 1 -- 172.21.15.103:0/1171336623 >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 msgr2=0x7f0488153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:43:18.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.507+0000 7f04877fe640 1 --2- 172.21.15.103:0/1171336623 >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 0x7f0488153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:43:18.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.507+0000 7f04877fe640 1 --2- 172.21.15.103:0/1171336623 >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 0x7f0488153390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:43:18.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.705+0000 7f048ceef640 1 -- 172.21.15.103:0/1171336623 >> v2:172.21.15.103:3300/0 conn(0x7f04880c3d60 msgr2=0x7f048814fba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:43:18.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.705+0000 7f048ceef640 1 --2- 172.21.15.103:0/1171336623 >> v2:172.21.15.103:3300/0 conn(0x7f04880c3d60 0x7f048814fba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:43:18.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.706+0000 7f0487fff640 1 -- 172.21.15.103:0/1171336623 >> v1:172.21.15.103:6789/0 conn(0x7f04880aba60 legacy=0x7f04881567b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:43:18.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.708+0000 7f04877fe640 1 --2- 172.21.15.103:0/1171336623 >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 0x7f0488153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:18.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.708+0000 7f04877fe640 1 -- 172.21.15.103:0/1171336623 >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 msgr2=0x7f0488153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:43:18.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.708+0000 7f04877fe640 1 -- 172.21.15.103:0/1171336623 >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 msgr2=0x7f0488153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:43:18.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.708+0000 7f04877fe640 1 --2- 172.21.15.103:0/1171336623 >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 0x7f0488153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:43:18.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:18.708+0000 7f04877fe640 1 --2- 172.21.15.103:0/1171336623 >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 0x7f0488153390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:43:19.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:19.106+0000 7f048ceef640 1 -- 172.21.15.103:0/1171336623 >> v2:172.21.15.103:3300/0 conn(0x7f04880c3d60 msgr2=0x7f048814fba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:43:19.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:19.106+0000 7f048ceef640 1 --2- 172.21.15.103:0/1171336623 >> v2:172.21.15.103:3300/0 conn(0x7f04880c3d60 0x7f048814fba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:43:19.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:19.107+0000 7f0487fff640 1 -- 172.21.15.103:0/1171336623 >> v1:172.21.15.103:6789/0 conn(0x7f04880aba60 legacy=0x7f04881567b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:43:19.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:19.109+0000 7f04877fe640 1 --2- 172.21.15.103:0/1171336623 >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 0x7f0488153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:19.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:19.109+0000 7f04877fe640 1 -- 172.21.15.103:0/1171336623 >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 msgr2=0x7f0488153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:43:19.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:19.109+0000 7f04877fe640 1 -- 172.21.15.103:0/1171336623 >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 msgr2=0x7f0488153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:43:19.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:19.109+0000 7f04877fe640 1 --2- 172.21.15.103:0/1171336623 >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 0x7f0488153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:43:19.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:19.109+0000 7f04877fe640 1 --2- 172.21.15.103:0/1171336623 >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 0x7f0488153390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:43:19.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:19.907+0000 7f048ceef640 1 -- 172.21.15.103:0/1171336623 >> v2:172.21.15.103:3300/0 conn(0x7f04880c3d60 msgr2=0x7f048814fba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:43:19.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:19.907+0000 7f048ceef640 1 --2- 172.21.15.103:0/1171336623 >> v2:172.21.15.103:3300/0 conn(0x7f04880c3d60 0x7f048814fba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:43:19.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:19.908+0000 7f0487fff640 1 -- 172.21.15.103:0/1171336623 >> v1:172.21.15.103:6789/0 conn(0x7f04880aba60 legacy=0x7f04881567b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:43:19.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:19.910+0000 7f04877fe640 1 --2- 172.21.15.103:0/1171336623 >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 0x7f0488153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:19.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:19.911+0000 7f04877fe640 1 -- 172.21.15.103:0/1171336623 >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 msgr2=0x7f0488153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:43:19.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:19.911+0000 7f04877fe640 1 -- 172.21.15.103:0/1171336623 >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 msgr2=0x7f0488153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:43:19.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:19.911+0000 7f04877fe640 1 --2- 172.21.15.103:0/1171336623 >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 0x7f0488153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:43:19.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:19.911+0000 7f04877fe640 1 --2- 172.21.15.103:0/1171336623 >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 0x7f0488153390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:43:21.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.504+0000 7f0485ffb640 1 -- 172.21.15.103:0/1171336623 >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 msgr2=0x7f0488153390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:43:21.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.504+0000 7f0485ffb640 1 --2- 172.21.15.103:0/1171336623 >> v2:172.21.15.154:3300/0 conn(0x7f04880c2e30 0x7f0488153390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:21.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.504+0000 7f0485ffb640 1 -- 172.21.15.103:0/1171336623 >> v2:172.21.15.103:3300/0 conn(0x7f04880c3d60 msgr2=0x7f048814fba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:43:21.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.504+0000 7f0485ffb640 1 --2- 172.21.15.103:0/1171336623 >> v2:172.21.15.103:3300/0 conn(0x7f04880c3d60 0x7f048814fba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:21.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.504+0000 7f0485ffb640 1 -- 172.21.15.103:0/1171336623 >> v1:172.21.15.103:6789/0 conn(0x7f04880aba60 legacy=0x7f04881567b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:43:21.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.504+0000 7f0485ffb640 1 --2- 172.21.15.103:0/1171336623 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0474003670 0x7f0474005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:21.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.504+0000 7f0485ffb640 1 -- 172.21.15.103:0/1171336623 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0488156290 con 0x7f04740061a0 2024-09-10T08:43:21.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.504+0000 7f0485ffb640 1 -- 172.21.15.103:0/1171336623 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f04880c3a80 con 0x7f0474003670 2024-09-10T08:43:21.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.505+0000 7f0487fff640 1 --2- 172.21.15.103:0/1171336623 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0474003670 0x7f0474005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:21.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.505+0000 7f0487fff640 1 -- 172.21.15.103:0/1171336623 >> v1:172.21.15.154:6789/0 conn(0x7f04740061a0 legacy=0x7f0474008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:21.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.505+0000 7f0487fff640 1 -- 172.21.15.103:0/1171336623 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04880c37a0 con 0x7f0474003670 2024-09-10T08:43:21.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.507+0000 7f0487fff640 1 --2- 172.21.15.103:0/1171336623 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0474003670 0x7f0474005ac0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0478009d30 tx=0x7f047802a8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8413b8f045589865 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:21.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.507+0000 7f0486ffd640 1 -- 172.21.15.103:0/1171336623 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0478036070 con 0x7f0474003670 2024-09-10T08:43:21.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.507+0000 7f0486ffd640 1 -- 172.21.15.103:0/1171336623 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f047802d070 con 0x7f0474003670 2024-09-10T08:43:21.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.508+0000 7f048e952640 1 -- 172.21.15.103:0/1171336623 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0474003670 msgr2=0x7f0474005ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:21.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.508+0000 7f048e952640 1 --2- 172.21.15.103:0/1171336623 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0474003670 0x7f0474005ac0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0478009d30 tx=0x7f047802a8f0 comp rx=0 tx=0).stop 2024-09-10T08:43:21.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.508+0000 7f048ceef640 1 -- 172.21.15.103:0/1171336623 reap_dead start 2024-09-10T08:43:21.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.508+0000 7f048e952640 1 -- 172.21.15.103:0/1171336623 shutdown_connections 2024-09-10T08:43:21.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.508+0000 7f048e952640 1 -- 172.21.15.103:0/1171336623 >> 172.21.15.103:0/1171336623 conn(0x7f04880c8430 msgr2=0x7f04880c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:21.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.508+0000 7f048e952640 1 -- 172.21.15.103:0/1171336623 shutdown_connections 2024-09-10T08:43:21.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.509+0000 7f048e952640 1 -- 172.21.15.103:0/1171336623 wait complete. 2024-09-10T08:43:21.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.510+0000 7f048e952640 1 Processor -- start 2024-09-10T08:43:21.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.511+0000 7f048e952640 1 -- start start 2024-09-10T08:43:21.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.512+0000 7f048e952640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0474003670 0x7f048814a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:21.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.513+0000 7f048e952640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0488155340 0x7f0488154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:21.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.513+0000 7f048e952640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f048814d7e0 0x7f048814dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:21.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.513+0000 7f048e952640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f04880c42e0 con 0x7f048814d7e0 2024-09-10T08:43:21.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.513+0000 7f048e952640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f04880c4160 con 0x7f0474003670 2024-09-10T08:43:21.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.513+0000 7f048e952640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f04880c4460 con 0x7f0488155340 2024-09-10T08:43:21.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.514+0000 7f048ceef640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f048814d7e0 msgr2=0x7f048814dc60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:43:21.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.514+0000 7f048ceef640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f048814d7e0 0x7f048814dc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:43:21.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.514+0000 7f04877fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0488155340 0x7f0488154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:21.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.514+0000 7f04877fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0488155340 0x7f0488154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:45754/0 (socket says 172.21.15.103:45754) 2024-09-10T08:43:21.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.514+0000 7f04877fe640 1 -- 172.21.15.103:0/2980142902 learned_addr learned my addr 172.21.15.103:0/2980142902 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:21.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.515+0000 7f0487fff640 1 --2- 172.21.15.103:0/2980142902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0474003670 0x7f048814a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:21.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.521+0000 7f04877fe640 1 -- 172.21.15.103:0/2980142902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0474003670 msgr2=0x7f048814a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:21.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.521+0000 7f04877fe640 1 --2- 172.21.15.103:0/2980142902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0474003670 0x7f048814a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:21.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.521+0000 7f04877fe640 1 -- 172.21.15.103:0/2980142902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f048814d7e0 msgr2=0x7f048814dc60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:43:21.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.521+0000 7f04877fe640 1 --2- 172.21.15.103:0/2980142902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f048814d7e0 0x7f048814dc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:21.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.521+0000 7f04877fe640 1 -- 172.21.15.103:0/2980142902 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04880c6ce0 con 0x7f0488155340 2024-09-10T08:43:21.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.522+0000 7f04877fe640 1 --2- 172.21.15.103:0/2980142902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0488155340 0x7f0488154440 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0480011a80 tx=0x7f0480011f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:21.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.522+0000 7f0484ff9640 1 -- 172.21.15.103:0/2980142902 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0480007c20 con 0x7f0488155340 2024-09-10T08:43:21.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.522+0000 7f048e952640 1 -- 172.21.15.103:0/2980142902 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04880c6fe0 con 0x7f0488155340 2024-09-10T08:43:21.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.522+0000 7f0484ff9640 1 -- 172.21.15.103:0/2980142902 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0480007dc0 con 0x7f0488155340 2024-09-10T08:43:21.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.522+0000 7f0484ff9640 1 -- 172.21.15.103:0/2980142902 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0480003b90 con 0x7f0488155340 2024-09-10T08:43:21.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.522+0000 7f048e952640 1 -- 172.21.15.103:0/2980142902 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f04880c7820 con 0x7f0488155340 2024-09-10T08:43:21.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.525+0000 7f0484ff9640 1 -- 172.21.15.103:0/2980142902 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0480020020 con 0x7f0488155340 2024-09-10T08:43:21.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.526+0000 7f0484ff9640 1 --2- 172.21.15.103:0/2980142902 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f047406cad0 0x7f047406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:21.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.526+0000 7f0484ff9640 1 -- 172.21.15.103:0/2980142902 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f048008b0a0 con 0x7f0488155340 2024-09-10T08:43:21.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.526+0000 7f046e7fc640 1 -- 172.21.15.103:0/2980142902 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04880c7a20 con 0x7f0488155340 2024-09-10T08:43:21.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.527+0000 7f0487fff640 1 --2- 172.21.15.103:0/2980142902 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f047406cad0 0x7f047406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:21.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.528+0000 7f0487fff640 1 --2- 172.21.15.103:0/2980142902 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f047406cad0 0x7f047406ef90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0478033000 tx=0x7f047802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:21.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:21.538+0000 7f0484ff9640 1 -- 172.21.15.103:0/2980142902 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f04880c7a20 con 0x7f0488155340 2024-09-10T08:43:22.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.033+0000 7f046e7fc640 1 -- 172.21.15.103:0/2980142902 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f048814c560 con 0x7f0488155340 2024-09-10T08:43:22.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.036+0000 7f0484ff9640 1 -- 172.21.15.103:0/2980142902 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f048005b020 con 0x7f0488155340 2024-09-10T08:43:22.043 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":120,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:43:22.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.046+0000 7f046e7fc640 1 -- 172.21.15.103:0/2980142902 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f047406cad0 msgr2=0x7f047406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.046+0000 7f046e7fc640 1 --2- 172.21.15.103:0/2980142902 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f047406cad0 0x7f047406ef90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0478033000 tx=0x7f047802e000 comp rx=0 tx=0).stop 2024-09-10T08:43:22.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.046+0000 7f046e7fc640 1 -- 172.21.15.103:0/2980142902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0488155340 msgr2=0x7f0488154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.046+0000 7f046e7fc640 1 --2- 172.21.15.103:0/2980142902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0488155340 0x7f0488154440 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0480011a80 tx=0x7f0480011f40 comp rx=0 tx=0).stop 2024-09-10T08:43:22.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.047+0000 7f046e7fc640 1 -- 172.21.15.103:0/2980142902 shutdown_connections 2024-09-10T08:43:22.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.047+0000 7f046e7fc640 1 --2- 172.21.15.103:0/2980142902 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f047406cad0 0x7f047406ef90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.047+0000 7f046e7fc640 1 --2- 172.21.15.103:0/2980142902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f048814d7e0 0x7f048814dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.047+0000 7f046e7fc640 1 --2- 172.21.15.103:0/2980142902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0488155340 0x7f0488154440 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.047+0000 7f046e7fc640 1 --2- 172.21.15.103:0/2980142902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0474003670 0x7f048814a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.047+0000 7f046e7fc640 1 -- 172.21.15.103:0/2980142902 >> 172.21.15.103:0/2980142902 conn(0x7f04880c8430 msgr2=0x7f048814cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:22.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.051+0000 7f046e7fc640 1 -- 172.21.15.103:0/2980142902 shutdown_connections 2024-09-10T08:43:22.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.051+0000 7f046e7fc640 1 -- 172.21.15.103:0/2980142902 wait complete. 2024-09-10T08:43:22.076 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-10T08:43:22.077 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-10T08:43:22.078 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:43:22.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.297+0000 7f8f86549640 1 Processor -- start 2024-09-10T08:43:22.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.298+0000 7f8f86549640 1 -- start start 2024-09-10T08:43:22.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.299+0000 7f8f86549640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f800ca390 0x7f8f80161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.299+0000 7f8f86549640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f8015a7c0 con 0x7f8f80150480 2024-09-10T08:43:22.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.299+0000 7f8f86549640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f80159a00 con 0x7f8f8006c650 2024-09-10T08:43:22.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.299+0000 7f8f86549640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8f8006c240 con 0x7f8f800ca390 2024-09-10T08:43:22.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.300+0000 7f8f7ffff640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7f8f80150480 legacy=0x7f8f800c7a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:43:22.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.300+0000 7f8f7f7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8f8006c650 0x7f8f800c9c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:33352/0 (socket says 172.21.15.103:33352) 2024-09-10T08:43:22.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.300+0000 7f8f7f7fe640 1 -- 172.21.15.103:0/3706663913 learned_addr learned my addr 172.21.15.103:0/3706663913 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:43:22.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.301+0000 7f8f7effd640 1 -- 172.21.15.103:0/3706663913 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3248111341 0 0) 0x7f8f80159a00 con 0x7f8f8006c650 2024-09-10T08:43:22.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.301+0000 7f8f7effd640 1 -- 172.21.15.103:0/3706663913 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f68003520 con 0x7f8f8006c650 2024-09-10T08:43:22.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.302+0000 7f8f84ae6640 1 --2- 172.21.15.103:0/3706663913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f800ca390 0x7f8f80161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.306+0000 7f8f7effd640 1 -- 172.21.15.103:0/3706663913 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3561162735 0 0) 0x7f8f68003520 con 0x7f8f8006c650 2024-09-10T08:43:22.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.306+0000 7f8f7effd640 1 -- 172.21.15.103:0/3706663913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f800ca390 msgr2=0x7f8f80161c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:22.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.306+0000 7f8f7effd640 1 --2- 172.21.15.103:0/3706663913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f800ca390 0x7f8f80161c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.306+0000 7f8f7effd640 1 -- 172.21.15.103:0/3706663913 >> v1:172.21.15.103:6789/0 conn(0x7f8f80150480 legacy=0x7f8f800c7a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:43:22.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.306+0000 7f8f7effd640 1 -- 172.21.15.103:0/3706663913 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f80159ce0 con 0x7f8f8006c650 2024-09-10T08:43:22.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.306+0000 7f8f7effd640 1 -- 172.21.15.103:0/3706663913 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f8f780019f0 con 0x7f8f8006c650 2024-09-10T08:43:22.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.306+0000 7f8f7effd640 1 -- 172.21.15.103:0/3706663913 >> v1:172.21.15.154:6789/0 conn(0x7f8f8006c650 legacy=0x7f8f800c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.306+0000 7f8f7effd640 1 --2- 172.21.15.103:0/3706663913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f680039b0 0x7f8f68003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.306+0000 7f8f7effd640 1 --2- 172.21.15.103:0/3706663913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f68004380 0x7f8f68004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.306+0000 7f8f7effd640 1 --2- 172.21.15.103:0/3706663913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f68005060 0x7f8f6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.306+0000 7f8f7effd640 1 -- 172.21.15.103:0/3706663913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6800bf00 con 0x7f8f68004380 2024-09-10T08:43:22.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.306+0000 7f8f7effd640 1 -- 172.21.15.103:0/3706663913 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6800c0b0 con 0x7f8f680039b0 2024-09-10T08:43:22.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.306+0000 7f8f7effd640 1 -- 172.21.15.103:0/3706663913 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8f6800c2b0 con 0x7f8f68005060 2024-09-10T08:43:22.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.306+0000 7f8f84ae6640 1 --2- 172.21.15.103:0/3706663913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f800ca390 0x7f8f80161c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:43:22.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.306+0000 7f8f7f7fe640 1 -- 172.21.15.103:0/3706663913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f68004380 msgr2=0x7f8f68004860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:43:22.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.306+0000 7f8f7f7fe640 1 --2- 172.21.15.103:0/3706663913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f68004380 0x7f8f68004860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:43:22.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.307+0000 7f8f84ae6640 1 --2- 172.21.15.103:0/3706663913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f68005060 0x7f8f6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.307+0000 7f8f84ae6640 1 -- 172.21.15.103:0/3706663913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f680039b0 msgr2=0x7f8f68003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:22.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.307+0000 7f8f84ae6640 1 --2- 172.21.15.103:0/3706663913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f680039b0 0x7f8f68003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.307+0000 7f8f84ae6640 1 -- 172.21.15.103:0/3706663913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f68004380 msgr2=0x7f8f68004860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:43:22.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.307+0000 7f8f84ae6640 1 --2- 172.21.15.103:0/3706663913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f68004380 0x7f8f68004860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.307+0000 7f8f84ae6640 1 -- 172.21.15.103:0/3706663913 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f80159ce0 con 0x7f8f68005060 2024-09-10T08:43:22.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.309+0000 7f8f84ae6640 1 --2- 172.21.15.103:0/3706663913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f68005060 0x7f8f6800b9c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8f800ca770 tx=0x7f8f68005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edf3a7b8f745ecb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:22.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.310+0000 7f8f7effd640 1 -- 172.21.15.103:0/3706663913 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f70036070 con 0x7f8f68005060 2024-09-10T08:43:22.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.310+0000 7f8f7effd640 1 -- 172.21.15.103:0/3706663913 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f70004030 con 0x7f8f68005060 2024-09-10T08:43:22.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.310+0000 7f8f7effd640 1 -- 172.21.15.103:0/3706663913 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f700097f0 con 0x7f8f68005060 2024-09-10T08:43:22.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.311+0000 7f8f86549640 1 -- 172.21.15.103:0/3706663913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f68005060 msgr2=0x7f8f6800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.311+0000 7f8f86549640 1 --2- 172.21.15.103:0/3706663913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f68005060 0x7f8f6800b9c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8f800ca770 tx=0x7f8f68005830 comp rx=0 tx=0).stop 2024-09-10T08:43:22.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.316+0000 7f8f84ae6640 1 -- 172.21.15.103:0/3706663913 reap_dead start 2024-09-10T08:43:22.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.316+0000 7f8f86549640 1 -- 172.21.15.103:0/3706663913 shutdown_connections 2024-09-10T08:43:22.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.316+0000 7f8f86549640 1 -- 172.21.15.103:0/3706663913 >> 172.21.15.103:0/3706663913 conn(0x7f8f80068030 msgr2=0x7f8f80073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:22.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.317+0000 7f8f86549640 1 -- 172.21.15.103:0/3706663913 shutdown_connections 2024-09-10T08:43:22.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.317+0000 7f8f86549640 1 -- 172.21.15.103:0/3706663913 wait complete. 2024-09-10T08:43:22.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.319+0000 7f8f86549640 1 Processor -- start 2024-09-10T08:43:22.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.319+0000 7f8f86549640 1 -- start start 2024-09-10T08:43:22.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.321+0000 7f8f86549640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f80154f70 0x7f8f801e1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.322+0000 7f8f86549640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f800afaa0 0x7f8f801e2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.322+0000 7f8f86549640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f801eb830 0x7f8f801ebcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.322+0000 7f8f86549640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8006d270 con 0x7f8f801eb830 2024-09-10T08:43:22.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.322+0000 7f8f86549640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8015a330 con 0x7f8f80154f70 2024-09-10T08:43:22.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.322+0000 7f8f86549640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8f800c81a0 con 0x7f8f800afaa0 2024-09-10T08:43:22.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.322+0000 7f8f84ae6640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f801eb830 msgr2=0x7f8f801ebcb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:43:22.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.323+0000 7f8f84ae6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f801eb830 0x7f8f801ebcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:43:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.326+0000 7f8f7f7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f800afaa0 0x7f8f801e2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.326+0000 7f8f7f7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f800afaa0 0x7f8f801e2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:45798/0 (socket says 172.21.15.103:45798) 2024-09-10T08:43:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.326+0000 7f8f7f7fe640 1 -- 172.21.15.103:0/491014252 learned_addr learned my addr 172.21.15.103:0/491014252 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:22.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.327+0000 7f8f7ffff640 1 --2- 172.21.15.103:0/491014252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f80154f70 0x7f8f801e1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.331+0000 7f8f7f7fe640 1 -- 172.21.15.103:0/491014252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f80154f70 msgr2=0x7f8f801e1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.331+0000 7f8f7f7fe640 1 --2- 172.21.15.103:0/491014252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f80154f70 0x7f8f801e1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.331+0000 7f8f7f7fe640 1 -- 172.21.15.103:0/491014252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f801eb830 msgr2=0x7f8f801ebcb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:43:22.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.331+0000 7f8f7f7fe640 1 --2- 172.21.15.103:0/491014252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f801eb830 0x7f8f801ebcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.331+0000 7f8f7f7fe640 1 -- 172.21.15.103:0/491014252 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f80159380 con 0x7f8f800afaa0 2024-09-10T08:43:22.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.331+0000 7f8f7f7fe640 1 --2- 172.21.15.103:0/491014252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f800afaa0 0x7f8f801e2060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8f78001d10 tx=0x7f8f7800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:22.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.331+0000 7f8f7cff9640 1 -- 172.21.15.103:0/491014252 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f78018070 con 0x7f8f800afaa0 2024-09-10T08:43:22.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.332+0000 7f8f7cff9640 1 -- 172.21.15.103:0/491014252 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f78004d60 con 0x7f8f800afaa0 2024-09-10T08:43:22.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.332+0000 7f8f7cff9640 1 -- 172.21.15.103:0/491014252 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7800ad80 con 0x7f8f800afaa0 2024-09-10T08:43:22.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.335+0000 7f8f86549640 1 -- 172.21.15.103:0/491014252 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f8014c1f0 con 0x7f8f800afaa0 2024-09-10T08:43:22.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.335+0000 7f8f86549640 1 -- 172.21.15.103:0/491014252 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f80155dc0 con 0x7f8f800afaa0 2024-09-10T08:43:22.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.337+0000 7f8f667fc640 1 --2- 172.21.15.103:0/491014252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f801ec1f0 0x7f8f8014b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.337+0000 7f8f667fc640 1 -- 172.21.15.103:0/491014252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8f800cc1c0 con 0x7f8f801ec1f0 2024-09-10T08:43:22.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.340+0000 7f8f7ffff640 1 --2- 172.21.15.103:0/491014252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f801ec1f0 0x7f8f8014b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.343+0000 7f8f7cff9640 1 -- 172.21.15.103:0/491014252 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f780070d0 con 0x7f8f800afaa0 2024-09-10T08:43:22.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.344+0000 7f8f7ffff640 1 -- 172.21.15.103:0/491014252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8f8014bfe0 con 0x7f8f801ec1f0 2024-09-10T08:43:22.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.344+0000 7f8f7ffff640 1 --2- 172.21.15.103:0/491014252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f801ec1f0 0x7f8f8014b280 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8f800b0cf0 tx=0x7f8f7400db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:22.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.345+0000 7f8f7cff9640 1 --2- 172.21.15.103:0/491014252 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8f6c06bde0 0x7f8f6c06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.345+0000 7f8f7cff9640 1 -- 172.21.15.103:0/491014252 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f8f7808ab90 con 0x7f8f800afaa0 2024-09-10T08:43:22.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.345+0000 7f8f7cff9640 1 -- 172.21.15.103:0/491014252 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f74016020 con 0x7f8f801ec1f0 2024-09-10T08:43:22.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.347+0000 7f8f7cff9640 1 -- 172.21.15.103:0/491014252 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8f740039b0 con 0x7f8f801ec1f0 2024-09-10T08:43:22.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.347+0000 7f8f7cff9640 1 -- 172.21.15.103:0/491014252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f801ec1f0 msgr2=0x7f8f8014b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.347+0000 7f8f7cff9640 1 --2- 172.21.15.103:0/491014252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f801ec1f0 0x7f8f8014b280 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8f800b0cf0 tx=0x7f8f7400db90 comp rx=0 tx=0).stop 2024-09-10T08:43:22.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.347+0000 7f8f7cff9640 1 -- 172.21.15.103:0/491014252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f801ec1f0 msgr2=0x7f8f8014b280 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:43:22.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.347+0000 7f8f7cff9640 1 --2- 172.21.15.103:0/491014252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f801ec1f0 0x7f8f8014b280 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.347+0000 7f8f84ae6640 1 --2- 172.21.15.103:0/491014252 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8f6c06bde0 0x7f8f6c06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.352+0000 7f8f84ae6640 1 --2- 172.21.15.103:0/491014252 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8f6c06bde0 0x7f8f6c06e2a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8f70033000 tx=0x7f8f70008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:22.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.360+0000 7f8f667fc640 1 --2- 172.21.15.103:0/491014252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f800cb040 0x7f8f800cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.361+0000 7f8f667fc640 1 -- 172.21.15.103:0/491014252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8f80159550 con 0x7f8f800cb040 2024-09-10T08:43:22.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.362+0000 7f8f7ffff640 1 --2- 172.21.15.103:0/491014252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f800cb040 0x7f8f800cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.364+0000 7f8f7ffff640 1 -- 172.21.15.103:0/491014252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8f80159a00 con 0x7f8f800cb040 2024-09-10T08:43:22.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.373+0000 7f8f7ffff640 1 --2- 172.21.15.103:0/491014252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f800cb040 0x7f8f800cb450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8f800b0cf0 tx=0x7f8f74005a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:22.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.375+0000 7f8f7cff9640 1 -- 172.21.15.103:0/491014252 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f74016030 con 0x7f8f800cb040 2024-09-10T08:43:22.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.375+0000 7f8f7cff9640 1 -- 172.21.15.103:0/491014252 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4878 (secure 0 0 0) 0x7f8f7401de30 con 0x7f8f800cb040 2024-09-10T08:43:22.376 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:43:22.376 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:43:22.376 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:43:22.377 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:43:22.377 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 120, 2024-09-10T08:43:22.377 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 37110, 2024-09-10T08:43:22.377 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:43:22.377 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:43:22.377 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:43:22.377 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:22.377 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 0, 2024-09-10T08:43:22.377 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:43:22.377 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:43:22.377 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:43:22.377 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:43:22.377 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:43:22.378 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:43:22.378 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:43:22.378 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:43:22.378 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:43:22.378 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:43:22.378 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:43:22.378 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:43:22.378 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:43:22.378 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:43:22.378 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:22.378 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:43:22.378 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:43:22.378 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:43:22.378 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:43:22.379 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:43:22.379 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:43:22.379 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:43:22.379 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:43:22.379 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:43:22.379 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:43:22.379 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:43:22.379 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:43:22.379 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:43:22.379 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:22.379 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.379 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:43:22.379 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:43:22.379 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:43:22.380 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:43:22.380 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:43:22.380 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:43:22.380 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:43:22.380 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:43:22.380 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:43:22.380 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:43:22.380 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:43:22.380 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:43:22.380 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:43:22.380 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:43:22.380 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:43:22.380 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:43:22.381 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:43:22.381 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:43:22.381 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:43:22.381 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:43:22.381 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:43:22.381 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:43:22.381 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:43:22.381 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:43:22.381 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:43:22.381 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:43:22.381 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:43:22.381 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:43:22.381 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:22.382 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:43:22.382 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.382 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:43:22.382 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.382 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:43:22.382 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:43:22.382 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:43:22.382 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:43:22.382 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.382 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:43:22.382 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:43:22.382 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:22.382 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.382 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.383 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:43:22.383 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:43:22.383 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:22.383 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:22.383 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:22.383 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.383 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:43:22.383 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:43:22.383 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:43:22.383 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:43:22.384 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:43:22.384 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.384 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.384 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:43:22.384 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:43:22.384 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:43:22.384 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:43:22.384 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.384 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:43:22.384 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:43:22.384 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:22.384 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.384 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.385 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:43:22.385 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:43:22.385 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:22.385 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:22.385 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:22.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.385 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:43:22.385 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:43:22.385 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:43:22.385 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:43:22.385 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:43:22.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.385 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.386 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:43:22.386 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:43:22.386 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:43:22.386 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:43:22.386 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.386 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:43:22.386 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:43:22.386 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:22.386 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.386 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.386 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:43:22.386 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:43:22.386 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:22.387 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:22.387 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:22.387 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.387 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:43:22.387 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:43:22.387 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:43:22.387 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:43:22.387 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:43:22.387 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:22.387 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:22.387 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.387 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:43:22.387 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:43:22.387 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.388 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:43:22.388 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:43:22.388 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:43:22.388 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:22.388 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:22.388 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:43:22.388 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.388 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:43:22.388 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:43:22.388 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:43:22.388 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:22.388 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:22.389 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:43:22.389 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.389 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:43:22.389 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:43:22.389 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:43:22.389 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:22.389 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:22.389 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:43:22.390 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.390 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:43:22.390 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:43:22.390 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:43:22.390 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:22.390 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:22.390 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.390 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:43:22.390 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:43:22.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.375+0000 7f8f7cff9640 1 -- 172.21.15.103:0/491014252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f800cb040 msgr2=0x7f8f800cb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.375+0000 7f8f7cff9640 1 --2- 172.21.15.103:0/491014252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f800cb040 0x7f8f800cb450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8f800b0cf0 tx=0x7f8f74005a10 comp rx=0 tx=0).stop 2024-09-10T08:43:22.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.375+0000 7f8f7cff9640 1 -- 172.21.15.103:0/491014252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f800cb040 msgr2=0x7f8f800cb450 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:43:22.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.375+0000 7f8f7cff9640 1 --2- 172.21.15.103:0/491014252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f800cb040 0x7f8f800cb450 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.375+0000 7f8f86549640 1 -- 172.21.15.103:0/491014252 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8f6c06bde0 msgr2=0x7f8f6c06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.375+0000 7f8f86549640 1 --2- 172.21.15.103:0/491014252 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8f6c06bde0 0x7f8f6c06e2a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8f70033000 tx=0x7f8f70008030 comp rx=0 tx=0).stop 2024-09-10T08:43:22.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.375+0000 7f8f86549640 1 -- 172.21.15.103:0/491014252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f800afaa0 msgr2=0x7f8f801e2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.375+0000 7f8f86549640 1 --2- 172.21.15.103:0/491014252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f800afaa0 0x7f8f801e2060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8f78001d10 tx=0x7f8f7800a430 comp rx=0 tx=0).stop 2024-09-10T08:43:22.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.378+0000 7f8f84ae6640 1 -- 172.21.15.103:0/491014252 reap_dead start 2024-09-10T08:43:22.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.378+0000 7f8f84ae6640 1 -- 172.21.15.103:0/491014252 reap_dead start 2024-09-10T08:43:22.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.378+0000 7f8f86549640 1 -- 172.21.15.103:0/491014252 shutdown_connections 2024-09-10T08:43:22.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.378+0000 7f8f86549640 1 -- 172.21.15.103:0/491014252 >> 172.21.15.103:0/491014252 conn(0x7f8f80068030 msgr2=0x7f8f800c9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:22.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.378+0000 7f8f86549640 1 -- 172.21.15.103:0/491014252 shutdown_connections 2024-09-10T08:43:22.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.378+0000 7f8f86549640 1 -- 172.21.15.103:0/491014252 wait complete. 2024-09-10T08:43:22.396 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:43:22.396 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-10T08:43:22.396 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:43:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.569+0000 7fb73ed9b640 1 Processor -- start 2024-09-10T08:43:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.569+0000 7fb73ed9b640 1 -- start start 2024-09-10T08:43:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.570+0000 7fb73ed9b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7380c0e00 0x7fb7380c11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.570+0000 7fb73ed9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7380c7340 0x7fb738160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.570+0000 7fb73ed9b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb73815a520 con 0x7fb7380a7290 2024-09-10T08:43:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.570+0000 7fb73ed9b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb73806edf0 con 0x7fb7380c7340 2024-09-10T08:43:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.570+0000 7fb73ed9b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb7380c19a0 con 0x7fb7380c0e00 2024-09-10T08:43:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.571+0000 7fb73d598640 1 -- >> v1:172.21.15.103:6789/0 conn(0x7fb7380a7290 legacy=0x7fb738156850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.103:6789/0 2024-09-10T08:43:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.571+0000 7fb73e59a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7380c7340 0x7fb738160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.571+0000 7fb73e59a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7380c7340 0x7fb738160ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:45672/0 (socket says 172.21.15.103:45672) 2024-09-10T08:43:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.571+0000 7fb73e59a640 1 -- 172.21.15.103:0/1944234211 learned_addr learned my addr 172.21.15.103:0/1944234211 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.571+0000 7fb73dd99640 1 --2- 172.21.15.103:0/1944234211 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7380c0e00 0x7fb7380c11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.571+0000 7fb73e59a640 1 -- 172.21.15.103:0/1944234211 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7380c0e00 msgr2=0x7fb7380c11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:22.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.571+0000 7fb73e59a640 1 --2- 172.21.15.103:0/1944234211 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7380c0e00 0x7fb7380c11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.571+0000 7fb73e59a640 1 -- 172.21.15.103:0/1944234211 >> v1:172.21.15.103:6789/0 conn(0x7fb7380a7290 legacy=0x7fb738156850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:43:22.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.571+0000 7fb73e59a640 1 -- 172.21.15.103:0/1944234211 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7380c1c80 con 0x7fb7380c7340 2024-09-10T08:43:22.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.572+0000 7fb73e59a640 1 --2- 172.21.15.103:0/1944234211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7380c7340 0x7fb738160ac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009e50 tx=0x7fb72c02a630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba69456540f3cc3e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:22.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.573+0000 7fb73cd97640 1 -- 172.21.15.103:0/1944234211 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c036070 con 0x7fb7380c7340 2024-09-10T08:43:22.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.573+0000 7fb73cd97640 1 -- 172.21.15.103:0/1944234211 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb72c031600 con 0x7fb7380c7340 2024-09-10T08:43:22.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.573+0000 7fb73cd97640 1 -- 172.21.15.103:0/1944234211 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0319d0 con 0x7fb7380c7340 2024-09-10T08:43:22.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.574+0000 7fb73ed9b640 1 -- 172.21.15.103:0/1944234211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7380c7340 msgr2=0x7fb738160ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.574+0000 7fb73ed9b640 1 --2- 172.21.15.103:0/1944234211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7380c7340 0x7fb738160ac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009e50 tx=0x7fb72c02a630 comp rx=0 tx=0).stop 2024-09-10T08:43:22.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.574+0000 7fb73ed9b640 1 -- 172.21.15.103:0/1944234211 shutdown_connections 2024-09-10T08:43:22.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.574+0000 7fb73ed9b640 1 --2- 172.21.15.103:0/1944234211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7380c7340 0x7fb738160ac0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.574+0000 7fb73ed9b640 1 --2- 172.21.15.103:0/1944234211 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7380c0e00 0x7fb7380c11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.574+0000 7fb73ed9b640 1 -- 172.21.15.103:0/1944234211 >> 172.21.15.103:0/1944234211 conn(0x7fb7380a9780 msgr2=0x7fb7380a9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:22.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.574+0000 7fb73ed9b640 1 -- 172.21.15.103:0/1944234211 shutdown_connections 2024-09-10T08:43:22.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.574+0000 7fb73ed9b640 1 -- 172.21.15.103:0/1944234211 wait complete. 2024-09-10T08:43:22.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.576+0000 7fb73ed9b640 1 Processor -- start 2024-09-10T08:43:22.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.576+0000 7fb73ed9b640 1 -- start start 2024-09-10T08:43:22.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.577+0000 7fb73ed9b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7380a7290 0x7fb7381ef2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.577+0000 7fb73ed9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7380c0e00 0x7fb7380ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.577+0000 7fb73ed9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7380c7340 0x7fb7380ad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.577+0000 7fb73ed9b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb738153e10 con 0x7fb7380c0e00 2024-09-10T08:43:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.577+0000 7fb73ed9b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb738153c90 con 0x7fb7380c7340 2024-09-10T08:43:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.577+0000 7fb73ed9b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb73815a140 con 0x7fb7380a7290 2024-09-10T08:43:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.577+0000 7fb73d598640 1 -- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7380c0e00 msgr2=0x7fb7380ace90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:3300/0 2024-09-10T08:43:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.577+0000 7fb73d598640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7380c0e00 0x7fb7380ace90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:43:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.577+0000 7fb73dd99640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7380a7290 0x7fb7381ef2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.577+0000 7fb73e59a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7380c7340 0x7fb7380ad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.577+0000 7fb73dd99640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7380a7290 0x7fb7381ef2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:45826/0 (socket says 172.21.15.103:45826) 2024-09-10T08:43:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.577+0000 7fb73dd99640 1 -- 172.21.15.103:0/4033826406 learned_addr learned my addr 172.21.15.103:0/4033826406 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.577+0000 7fb73e59a640 1 -- 172.21.15.103:0/4033826406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7380a7290 msgr2=0x7fb7381ef2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.577+0000 7fb73e59a640 1 --2- 172.21.15.103:0/4033826406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7380a7290 0x7fb7381ef2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.577+0000 7fb73e59a640 1 -- 172.21.15.103:0/4033826406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7380c0e00 msgr2=0x7fb7380ace90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:43:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.577+0000 7fb73e59a640 1 --2- 172.21.15.103:0/4033826406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7380c0e00 0x7fb7380ace90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.578+0000 7fb73e59a640 1 -- 172.21.15.103:0/4033826406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb738152a30 con 0x7fb7380c7340 2024-09-10T08:43:22.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.578+0000 7fb73e59a640 1 --2- 172.21.15.103:0/4033826406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7380c7340 0x7fb7380ad3d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb738075eb0 tx=0x7fb72c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:22.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.578+0000 7fb7367fc640 1 -- 172.21.15.103:0/4033826406 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c041020 con 0x7fb7380c7340 2024-09-10T08:43:22.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.578+0000 7fb73ed9b640 1 -- 172.21.15.103:0/4033826406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7380a8100 con 0x7fb7380c7340 2024-09-10T08:43:22.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.578+0000 7fb7367fc640 1 -- 172.21.15.103:0/4033826406 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb72c0086b0 con 0x7fb7380c7340 2024-09-10T08:43:22.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.578+0000 7fb7367fc640 1 -- 172.21.15.103:0/4033826406 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c041020 con 0x7fb7380c7340 2024-09-10T08:43:22.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.579+0000 7fb73ed9b640 1 -- 172.21.15.103:0/4033826406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7380aac90 con 0x7fb7380c7340 2024-09-10T08:43:22.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.580+0000 7fb73ed9b640 1 --2- 172.21.15.103:0/4033826406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb738152c80 0x7fb7380ab470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.580+0000 7fb73ed9b640 1 -- 172.21.15.103:0/4033826406 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb7381efc80 con 0x7fb738152c80 2024-09-10T08:43:22.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.580+0000 7fb73dd99640 1 --2- 172.21.15.103:0/4033826406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb738152c80 0x7fb7380ab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.581+0000 7fb73dd99640 1 -- 172.21.15.103:0/4033826406 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb7381eff40 con 0x7fb738152c80 2024-09-10T08:43:22.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.581+0000 7fb7367fc640 1 -- 172.21.15.103:0/4033826406 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb72c044020 con 0x7fb7380c7340 2024-09-10T08:43:22.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.581+0000 7fb73dd99640 1 --2- 172.21.15.103:0/4033826406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb738152c80 0x7fb7380ab470 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb7380ada50 tx=0x7fb730010cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:22.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.582+0000 7fb7367fc640 1 --2- 172.21.15.103:0/4033826406 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb71c06c1e0 0x7fb71c06e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.582+0000 7fb7367fc640 1 -- 172.21.15.103:0/4033826406 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fb72c031400 con 0x7fb7380c7340 2024-09-10T08:43:22.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.582+0000 7fb7367fc640 1 -- 172.21.15.103:0/4033826406 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb730018070 con 0x7fb738152c80 2024-09-10T08:43:22.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.582+0000 7fb73d598640 1 --2- 172.21.15.103:0/4033826406 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb71c06c1e0 0x7fb71c06e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.582+0000 7fb7367fc640 1 -- 172.21.15.103:0/4033826406 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb73000ea00 con 0x7fb738152c80 2024-09-10T08:43:22.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.582+0000 7fb7367fc640 1 -- 172.21.15.103:0/4033826406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb738152c80 msgr2=0x7fb7380ab470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.582+0000 7fb7367fc640 1 --2- 172.21.15.103:0/4033826406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb738152c80 0x7fb7380ab470 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb7380ada50 tx=0x7fb730010cf0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.582+0000 7fb7367fc640 1 -- 172.21.15.103:0/4033826406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb738152c80 msgr2=0x7fb7380ab470 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:43:22.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.582+0000 7fb73d598640 1 --2- 172.21.15.103:0/4033826406 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb71c06c1e0 0x7fb71c06e6a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb724006fd0 tx=0x7fb724006d00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:22.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.583+0000 7fb7367fc640 1 --2- 172.21.15.103:0/4033826406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb738152c80 0x7fb7380ab470 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.596+0000 7fb73ed9b640 1 --2- 172.21.15.103:0/4033826406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7380ab9b0 0x7fb7380abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.596+0000 7fb73ed9b640 1 -- 172.21.15.103:0/4033826406 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fb7380ac300 con 0x7fb7380ab9b0 2024-09-10T08:43:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.596+0000 7fb73dd99640 1 --2- 172.21.15.103:0/4033826406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7380ab9b0 0x7fb7380abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.597+0000 7fb73dd99640 1 -- 172.21.15.103:0/4033826406 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb7380c68e0 con 0x7fb7380ab9b0 2024-09-10T08:43:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.597+0000 7fb73dd99640 1 --2- 172.21.15.103:0/4033826406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7380ab9b0 0x7fb7380abdc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb7380ada50 tx=0x7fb7300046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.598+0000 7fb7367fc640 1 -- 172.21.15.103:0/4033826406 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb730003c30 con 0x7fb7380ab9b0 2024-09-10T08:43:22.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.598+0000 7fb7367fc640 1 -- 172.21.15.103:0/4033826406 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5043 (secure 0 0 0) 0x7fb730003dd0 con 0x7fb7380ab9b0 2024-09-10T08:43:22.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.598+0000 7fb7367fc640 1 -- 172.21.15.103:0/4033826406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7380ab9b0 msgr2=0x7fb7380abdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.598+0000 7fb7367fc640 1 --2- 172.21.15.103:0/4033826406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7380ab9b0 0x7fb7380abdc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb7380ada50 tx=0x7fb7300046c0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.598+0000 7fb7367fc640 1 -- 172.21.15.103:0/4033826406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7380ab9b0 msgr2=0x7fb7380abdc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:43:22.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.598+0000 7fb7367fc640 1 --2- 172.21.15.103:0/4033826406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7380ab9b0 0x7fb7380abdc0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb7380ada50 tx=0x7fb7300046c0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.599 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:43:22.600 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:43:22.600 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:43:22.600 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:43:22.600 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 120, 2024-09-10T08:43:22.600 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 94499, 2024-09-10T08:43:22.600 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:43:22.600 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:43:22.600 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:43:22.600 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:22.600 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 1, 2024-09-10T08:43:22.600 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:43:22.600 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:43:22.601 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:43:22.601 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:43:22.601 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:43:22.601 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:43:22.601 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:43:22.601 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:43:22.601 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:43:22.601 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:43:22.601 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:43:22.601 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:43:22.601 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:43:22.601 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:43:22.601 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:22.602 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:43:22.602 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:43:22.602 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:43:22.602 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:43:22.602 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:43:22.602 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:43:22.602 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:43:22.602 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:43:22.602 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:43:22.602 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:43:22.602 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:43:22.602 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:43:22.602 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:43:22.603 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:22.603 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.603 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:43:22.603 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:43:22.603 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:43:22.603 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:43:22.603 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:43:22.603 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:43:22.603 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:43:22.603 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:43:22.603 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:43:22.603 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:43:22.603 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:43:22.604 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:43:22.604 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:43:22.604 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:43:22.604 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:43:22.604 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:43:22.604 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:43:22.604 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:43:22.604 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:43:22.604 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:43:22.604 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:43:22.604 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:43:22.604 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:43:22.604 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:43:22.605 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:43:22.605 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:43:22.605 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:43:22.605 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:43:22.605 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:22.605 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:43:22.605 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.605 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:43:22.605 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.605 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:43:22.605 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:43:22.605 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:43:22.605 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:43:22.606 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.606 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:43:22.606 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:43:22.606 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:22.606 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.606 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.606 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:43:22.606 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:43:22.606 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:22.606 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:22.607 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:22.607 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.607 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:43:22.607 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:43:22.607 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:43:22.607 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:43:22.607 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:43:22.607 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.607 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.607 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:43:22.607 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:43:22.607 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:43:22.607 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:43:22.608 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.608 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:43:22.608 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:43:22.608 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:22.608 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.608 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.608 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:43:22.608 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:43:22.608 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:22.608 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:22.608 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:22.608 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.608 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:43:22.609 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:43:22.609 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:43:22.609 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:43:22.609 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:43:22.609 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.609 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.609 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:43:22.609 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:43:22.609 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:43:22.609 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:43:22.609 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.609 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:43:22.609 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:43:22.610 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:22.610 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.610 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.610 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:43:22.610 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:43:22.610 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:43:22.610 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:22.610 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:22.610 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.610 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:43:22.610 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:43:22.610 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:43:22.610 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:43:22.611 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:43:22.611 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:22.611 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:22.611 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.611 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:43:22.611 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:43:22.611 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.611 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:43:22.611 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:43:22.611 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:43:22.611 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:22.611 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:22.611 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:43:22.612 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.612 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:43:22.612 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:43:22.612 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:43:22.612 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:22.612 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:22.612 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:43:22.612 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.612 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:43:22.612 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:43:22.612 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:43:22.612 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:22.612 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:22.612 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:43:22.613 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.613 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:43:22.613 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:43:22.613 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:43:22.613 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:22.613 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:43:22.613 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:43:22.613 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:43:22.613 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:43:22.613 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:43:22.613 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:43:22.613 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:43:22.613 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:43:22.614 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:43:22.614 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:43:22.614 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:43:22.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.599+0000 7fb73ed9b640 1 -- 172.21.15.103:0/4033826406 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb71c06c1e0 msgr2=0x7fb71c06e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.599+0000 7fb73ed9b640 1 --2- 172.21.15.103:0/4033826406 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fb71c06c1e0 0x7fb71c06e6a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb724006fd0 tx=0x7fb724006d00 comp rx=0 tx=0).stop 2024-09-10T08:43:22.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.599+0000 7fb73e59a640 1 -- 172.21.15.103:0/4033826406 reap_dead start 2024-09-10T08:43:22.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.599+0000 7fb73ed9b640 1 -- 172.21.15.103:0/4033826406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7380c7340 msgr2=0x7fb7380ad3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.599+0000 7fb73ed9b640 1 --2- 172.21.15.103:0/4033826406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7380c7340 0x7fb7380ad3d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb738075eb0 tx=0x7fb72c004a40 comp rx=0 tx=0).stop 2024-09-10T08:43:22.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.599+0000 7fb73ed9b640 1 -- 172.21.15.103:0/4033826406 shutdown_connections 2024-09-10T08:43:22.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.599+0000 7fb73ed9b640 1 --2- 172.21.15.103:0/4033826406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7380c7340 0x7fb7380ad3d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.599+0000 7fb73ed9b640 1 -- 172.21.15.103:0/4033826406 >> 172.21.15.103:0/4033826406 conn(0x7fb7380a9780 msgr2=0x7fb738075030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:22.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.603+0000 7fb73ed9b640 1 -- 172.21.15.103:0/4033826406 shutdown_connections 2024-09-10T08:43:22.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:22.605+0000 7fb73ed9b640 1 -- 172.21.15.103:0/4033826406 wait complete. 2024-09-10T08:43:22.626 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-10T08:43:22.626 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-10T08:43:25.094 INFO:tasks.workunit.client.1.smithi154.stdout:Syncing()...2 sec 2024-09-10T08:43:25.094 INFO:tasks.workunit.client.1.smithi154.stdout:FFSB benchmark finished at: Tue Sep 10 08:43:25 2024 2024-09-10T08:43:25.094 INFO:tasks.workunit.client.1.smithi154.stdout: 2024-09-10T08:43:25.094 INFO:tasks.workunit.client.1.smithi154.stdout:Results: 2024-09-10T08:43:25.095 INFO:tasks.workunit.client.1.smithi154.stdout:Benchmark took 308.20 sec 2024-09-10T08:43:25.095 INFO:tasks.workunit.client.1.smithi154.stdout: 2024-09-10T08:43:25.095 INFO:tasks.workunit.client.1.smithi154.stdout:Total Results 2024-09-10T08:43:25.095 INFO:tasks.workunit.client.1.smithi154.stdout:=============== 2024-09-10T08:43:25.095 INFO:tasks.workunit.client.1.smithi154.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-09-10T08:43:25.095 INFO:tasks.workunit.client.1.smithi154.stdout: ======= ============ ========= ======= =========== ========== 2024-09-10T08:43:25.095 INFO:tasks.workunit.client.1.smithi154.stdout: write : 1515520 4917.29 100.000% 100.000% 19.2MB/sec 2024-09-10T08:43:25.095 INFO:tasks.workunit.client.1.smithi154.stdout:- 2024-09-10T08:43:25.095 INFO:tasks.workunit.client.1.smithi154.stdout:4917.29 Transactions per Second 2024-09-10T08:43:25.095 INFO:tasks.workunit.client.1.smithi154.stdout: 2024-09-10T08:43:25.095 INFO:tasks.workunit.client.1.smithi154.stdout:Throughput Results 2024-09-10T08:43:25.095 INFO:tasks.workunit.client.1.smithi154.stdout:=================== 2024-09-10T08:43:25.095 INFO:tasks.workunit.client.1.smithi154.stdout:Write Throughput: 19.2MB/sec 2024-09-10T08:43:25.102 INFO:tasks.workunit.client.1.smithi154.stdout: 2024-09-10T08:43:25.103 INFO:tasks.workunit.client.1.smithi154.stdout:System Call Latency statistics in millisecs 2024-09-10T08:43:25.103 INFO:tasks.workunit.client.1.smithi154.stdout:===== 2024-09-10T08:43:25.103 INFO:tasks.workunit.client.1.smithi154.stdout: Min Avg Max Total Calls 2024-09-10T08:43:25.103 INFO:tasks.workunit.client.1.smithi154.stdout: ======== ======== ======== ============ 2024-09-10T08:43:25.103 INFO:tasks.workunit.client.1.smithi154.stdout:[ open] 0.483000 79.740973 5135.041992 1184 2024-09-10T08:43:25.104 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[0] 5000.000000 - 10000.000000 : 1 2024-09-10T08:43:25.104 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[1] 2000.000000 - 5000.000000 : 13 2024-09-10T08:43:25.104 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[2] 1000.000000 - 2000.000000 : 11 2024-09-10T08:43:25.104 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[3] 500.000000 - 1000.000000 : 5 2024-09-10T08:43:25.104 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[4] 200.000000 - 500.000000 : 7 2024-09-10T08:43:25.104 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[5] 100.000000 - 200.000000 : 8 2024-09-10T08:43:25.105 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[6] 50.000000 - 100.000000 : 36 2024-09-10T08:43:25.105 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[7] 20.000000 - 50.000000 : 381 2024-09-10T08:43:25.105 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[8] 10.000000 - 20.000000 : 487 2024-09-10T08:43:25.105 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[9] 5.000000 - 10.000000 : 155 2024-09-10T08:43:25.105 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[10] 2.000000 - 5.000000 : 50 2024-09-10T08:43:25.105 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[11] 1.000000 - 2.000000 : 23 2024-09-10T08:43:25.106 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[12] 0.500000 - 1.000000 : 6 2024-09-10T08:43:25.106 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[13] 0.200000 - 0.500000 : 1 2024-09-10T08:43:25.106 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[14] 0.100000 - 0.200000 : 0 2024-09-10T08:43:25.106 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2024-09-10T08:43:25.106 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-09-10T08:43:25.106 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-09-10T08:43:25.107 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-10T08:43:25.107 INFO:tasks.workunit.client.1.smithi154.stdout: 2024-09-10T08:43:25.107 INFO:tasks.workunit.client.1.smithi154.stdout:[ write] 0.090000 6.324995 806.661011 1515520 2024-09-10T08:43:25.107 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-10T08:43:25.107 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-10T08:43:25.107 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-10T08:43:25.108 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[3] 500.000000 - 1000.000000 : 9 2024-09-10T08:43:25.108 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[4] 200.000000 - 500.000000 : 20 2024-09-10T08:43:25.108 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[5] 100.000000 - 200.000000 : 369 2024-09-10T08:43:25.108 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[6] 50.000000 - 100.000000 : 8279 2024-09-10T08:43:25.108 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[7] 20.000000 - 50.000000 : 88180 2024-09-10T08:43:25.108 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[8] 10.000000 - 20.000000 : 196318 2024-09-10T08:43:25.108 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[9] 5.000000 - 10.000000 : 306971 2024-09-10T08:43:25.109 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[10] 2.000000 - 5.000000 : 350277 2024-09-10T08:43:25.109 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[11] 1.000000 - 2.000000 : 139170 2024-09-10T08:43:25.109 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[12] 0.500000 - 1.000000 : 118692 2024-09-10T08:43:25.109 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[13] 0.200000 - 0.500000 : 194209 2024-09-10T08:43:25.109 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[14] 0.100000 - 0.200000 : 112876 2024-09-10T08:43:25.109 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[15] 0.050000 - 0.100000 : 150 2024-09-10T08:43:25.110 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-09-10T08:43:25.110 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-09-10T08:43:25.110 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-10T08:43:25.110 INFO:tasks.workunit.client.1.smithi154.stdout: 2024-09-10T08:43:25.111 INFO:tasks.workunit.client.1.smithi154.stdout:[ lseek] 0.000000 0.000912 6.375000 1515520 2024-09-10T08:43:25.111 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-10T08:43:25.111 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-10T08:43:25.111 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-10T08:43:25.111 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-10T08:43:25.111 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-10T08:43:25.112 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-10T08:43:25.112 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-10T08:43:25.112 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-09-10T08:43:25.112 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-09-10T08:43:25.112 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[9] 5.000000 - 10.000000 : 1 2024-09-10T08:43:25.113 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[10] 2.000000 - 5.000000 : 1 2024-09-10T08:43:25.113 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[11] 1.000000 - 2.000000 : 2 2024-09-10T08:43:25.113 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[12] 0.500000 - 1.000000 : 3 2024-09-10T08:43:25.113 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[13] 0.200000 - 0.500000 : 9 2024-09-10T08:43:25.113 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[14] 0.100000 - 0.200000 : 32 2024-09-10T08:43:25.113 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[15] 0.050000 - 0.100000 : 11 2024-09-10T08:43:25.114 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[16] 0.020000 - 0.050000 : 241 2024-09-10T08:43:25.114 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[17] 0.010000 - 0.020000 : 1062 2024-09-10T08:43:25.114 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[18] 0.000000 - 0.010000 : 1514158 2024-09-10T08:43:25.114 INFO:tasks.workunit.client.1.smithi154.stdout: 2024-09-10T08:43:25.114 INFO:tasks.workunit.client.1.smithi154.stdout:[ close] 0.024000 3.332584 80.033997 1184 2024-09-10T08:43:25.115 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-10T08:43:25.115 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-10T08:43:25.115 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-10T08:43:25.115 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-10T08:43:25.116 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-10T08:43:25.116 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-10T08:43:25.116 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[6] 50.000000 - 100.000000 : 4 2024-09-10T08:43:25.117 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[7] 20.000000 - 50.000000 : 46 2024-09-10T08:43:25.117 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[8] 10.000000 - 20.000000 : 65 2024-09-10T08:43:25.117 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[9] 5.000000 - 10.000000 : 93 2024-09-10T08:43:25.117 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[10] 2.000000 - 5.000000 : 164 2024-09-10T08:43:25.118 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[11] 1.000000 - 2.000000 : 108 2024-09-10T08:43:25.118 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[12] 0.500000 - 1.000000 : 85 2024-09-10T08:43:25.118 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[13] 0.200000 - 0.500000 : 144 2024-09-10T08:43:25.119 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[14] 0.100000 - 0.200000 : 135 2024-09-10T08:43:25.119 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[15] 0.050000 - 0.100000 : 93 2024-09-10T08:43:25.119 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[16] 0.020000 - 0.050000 : 247 2024-09-10T08:43:25.119 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-09-10T08:43:25.119 INFO:tasks.workunit.client.1.smithi154.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-10T08:43:25.119 INFO:tasks.workunit.client.1.smithi154.stdout: 2024-09-10T08:43:25.120 INFO:tasks.workunit.client.1.smithi154.stdout: 2024-09-10T08:43:25.120 INFO:tasks.workunit.client.1.smithi154.stdout: 2024-09-10T08:43:25.120 INFO:tasks.workunit.client.1.smithi154.stdout: 2024-09-10T08:43:25.120 INFO:tasks.workunit.client.1.smithi154.stdout:0.9% User Time 2024-09-10T08:43:25.121 INFO:tasks.workunit.client.1.smithi154.stdout:34.4% System Time 2024-09-10T08:43:25.121 INFO:tasks.workunit.client.1.smithi154.stdout:35.3% CPU Utilization 2024-09-10T08:43:25.122 INFO:tasks.workunit.client.1.smithi154.stderr:+ cd .. 2024-09-10T08:43:25.131 INFO:tasks.workunit.client.1.smithi154.stderr:+ rm -r tmp ffsb 2024-09-10T08:43:29.615 INFO:tasks.workunit.client.0.smithi103.stdout:Syncing()...2 sec 2024-09-10T08:43:29.615 INFO:tasks.workunit.client.0.smithi103.stdout:FFSB benchmark finished at: Tue Sep 10 08:43:29 2024 2024-09-10T08:43:29.615 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-10T08:43:29.616 INFO:tasks.workunit.client.0.smithi103.stdout:Results: 2024-09-10T08:43:29.616 INFO:tasks.workunit.client.0.smithi103.stdout:Benchmark took 306.26 sec 2024-09-10T08:43:29.616 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-10T08:43:29.616 INFO:tasks.workunit.client.0.smithi103.stdout:Total Results 2024-09-10T08:43:29.616 INFO:tasks.workunit.client.0.smithi103.stdout:=============== 2024-09-10T08:43:29.616 INFO:tasks.workunit.client.0.smithi103.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-09-10T08:43:29.616 INFO:tasks.workunit.client.0.smithi103.stdout: ======= ============ ========= ======= =========== ========== 2024-09-10T08:43:29.616 INFO:tasks.workunit.client.0.smithi103.stdout: write : 1573120 5136.59 100.000% 100.000% 20.1MB/sec 2024-09-10T08:43:29.616 INFO:tasks.workunit.client.0.smithi103.stdout:- 2024-09-10T08:43:29.616 INFO:tasks.workunit.client.0.smithi103.stdout:5136.59 Transactions per Second 2024-09-10T08:43:29.616 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-10T08:43:29.616 INFO:tasks.workunit.client.0.smithi103.stdout:Throughput Results 2024-09-10T08:43:29.616 INFO:tasks.workunit.client.0.smithi103.stdout:=================== 2024-09-10T08:43:29.617 INFO:tasks.workunit.client.0.smithi103.stdout:Write Throughput: 20.1MB/sec 2024-09-10T08:43:29.623 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-10T08:43:29.623 INFO:tasks.workunit.client.0.smithi103.stdout:System Call Latency statistics in millisecs 2024-09-10T08:43:29.623 INFO:tasks.workunit.client.0.smithi103.stdout:===== 2024-09-10T08:43:29.623 INFO:tasks.workunit.client.0.smithi103.stdout: Min Avg Max Total Calls 2024-09-10T08:43:29.623 INFO:tasks.workunit.client.0.smithi103.stdout: ======== ======== ======== ============ 2024-09-10T08:43:29.623 INFO:tasks.workunit.client.0.smithi103.stdout:[ open] 0.452000 65.335631 5134.307129 1229 2024-09-10T08:43:29.623 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[0] 5000.000000 - 10000.000000 : 1 2024-09-10T08:43:29.623 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[1] 2000.000000 - 5000.000000 : 8 2024-09-10T08:43:29.624 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[2] 1000.000000 - 2000.000000 : 11 2024-09-10T08:43:29.624 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[3] 500.000000 - 1000.000000 : 8 2024-09-10T08:43:29.624 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[4] 200.000000 - 500.000000 : 8 2024-09-10T08:43:29.624 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[5] 100.000000 - 200.000000 : 9 2024-09-10T08:43:29.624 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[6] 50.000000 - 100.000000 : 30 2024-09-10T08:43:29.624 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[7] 20.000000 - 50.000000 : 453 2024-09-10T08:43:29.624 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[8] 10.000000 - 20.000000 : 476 2024-09-10T08:43:29.624 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[9] 5.000000 - 10.000000 : 157 2024-09-10T08:43:29.624 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[10] 2.000000 - 5.000000 : 45 2024-09-10T08:43:29.624 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[11] 1.000000 - 2.000000 : 19 2024-09-10T08:43:29.624 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[12] 0.500000 - 1.000000 : 3 2024-09-10T08:43:29.624 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[13] 0.200000 - 0.500000 : 1 2024-09-10T08:43:29.625 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[14] 0.100000 - 0.200000 : 0 2024-09-10T08:43:29.625 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2024-09-10T08:43:29.625 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-09-10T08:43:29.625 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-09-10T08:43:29.625 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-10T08:43:29.625 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-10T08:43:29.625 INFO:tasks.workunit.client.0.smithi103.stdout:[ write] 0.087000 6.091136 792.125000 1573120 2024-09-10T08:43:29.625 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-10T08:43:29.625 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-10T08:43:29.625 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-10T08:43:29.625 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[3] 500.000000 - 1000.000000 : 4 2024-09-10T08:43:29.625 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[4] 200.000000 - 500.000000 : 20 2024-09-10T08:43:29.625 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[5] 100.000000 - 200.000000 : 265 2024-09-10T08:43:29.625 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[6] 50.000000 - 100.000000 : 4913 2024-09-10T08:43:29.626 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[7] 20.000000 - 50.000000 : 81478 2024-09-10T08:43:29.626 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[8] 10.000000 - 20.000000 : 208446 2024-09-10T08:43:29.626 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[9] 5.000000 - 10.000000 : 344985 2024-09-10T08:43:29.626 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[10] 2.000000 - 5.000000 : 372723 2024-09-10T08:43:29.626 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[11] 1.000000 - 2.000000 : 125071 2024-09-10T08:43:29.626 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[12] 0.500000 - 1.000000 : 89114 2024-09-10T08:43:29.626 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[13] 0.200000 - 0.500000 : 199656 2024-09-10T08:43:29.626 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[14] 0.100000 - 0.200000 : 145790 2024-09-10T08:43:29.626 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[15] 0.050000 - 0.100000 : 655 2024-09-10T08:43:29.626 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-09-10T08:43:29.626 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-09-10T08:43:29.626 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-10T08:43:29.626 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-10T08:43:29.626 INFO:tasks.workunit.client.0.smithi103.stdout:[ lseek] 0.000000 0.000879 2.320000 1573120 2024-09-10T08:43:29.627 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-10T08:43:29.627 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-10T08:43:29.627 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-10T08:43:29.627 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-10T08:43:29.627 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-10T08:43:29.627 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-10T08:43:29.627 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-10T08:43:29.627 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-09-10T08:43:29.627 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-09-10T08:43:29.627 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[9] 5.000000 - 10.000000 : 0 2024-09-10T08:43:29.627 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[10] 2.000000 - 5.000000 : 1 2024-09-10T08:43:29.627 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[11] 1.000000 - 2.000000 : 1 2024-09-10T08:43:29.627 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[12] 0.500000 - 1.000000 : 2 2024-09-10T08:43:29.627 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[13] 0.200000 - 0.500000 : 3 2024-09-10T08:43:29.628 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[14] 0.100000 - 0.200000 : 16 2024-09-10T08:43:29.628 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[15] 0.050000 - 0.100000 : 10 2024-09-10T08:43:29.628 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[16] 0.020000 - 0.050000 : 177 2024-09-10T08:43:29.628 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[17] 0.010000 - 0.020000 : 1060 2024-09-10T08:43:29.628 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[18] 0.000000 - 0.010000 : 1571850 2024-09-10T08:43:29.628 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-10T08:43:29.628 INFO:tasks.workunit.client.0.smithi103.stdout:[ close] 0.022000 2.770118 65.950996 1229 2024-09-10T08:43:29.628 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-10T08:43:29.628 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-10T08:43:29.628 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-10T08:43:29.628 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-10T08:43:29.628 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-10T08:43:29.628 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-10T08:43:29.629 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[6] 50.000000 - 100.000000 : 2 2024-09-10T08:43:29.629 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[7] 20.000000 - 50.000000 : 36 2024-09-10T08:43:29.629 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[8] 10.000000 - 20.000000 : 55 2024-09-10T08:43:29.629 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[9] 5.000000 - 10.000000 : 88 2024-09-10T08:43:29.629 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[10] 2.000000 - 5.000000 : 173 2024-09-10T08:43:29.629 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[11] 1.000000 - 2.000000 : 132 2024-09-10T08:43:29.629 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[12] 0.500000 - 1.000000 : 64 2024-09-10T08:43:29.629 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[13] 0.200000 - 0.500000 : 106 2024-09-10T08:43:29.629 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[14] 0.100000 - 0.200000 : 145 2024-09-10T08:43:29.629 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[15] 0.050000 - 0.100000 : 112 2024-09-10T08:43:29.629 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[16] 0.020000 - 0.050000 : 316 2024-09-10T08:43:29.629 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-09-10T08:43:29.629 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-10T08:43:29.629 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-10T08:43:29.630 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-10T08:43:29.630 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-10T08:43:29.630 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-10T08:43:29.630 INFO:tasks.workunit.client.0.smithi103.stdout:1.0% User Time 2024-09-10T08:43:29.630 INFO:tasks.workunit.client.0.smithi103.stdout:28.0% System Time 2024-09-10T08:43:29.630 INFO:tasks.workunit.client.0.smithi103.stdout:29.0% CPU Utilization 2024-09-10T08:43:29.642 INFO:tasks.workunit.client.0.smithi103.stderr:+ cd .. 2024-09-10T08:43:30.360 INFO:tasks.workunit.client.0.smithi103.stderr:+ rm -r tmp ffsb 2024-09-10T08:43:33.233 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T08:43:33.233 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-10T08:43:33.264 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.1... 2024-09-10T08:43:33.265 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-10T08:43:33.605 DEBUG:teuthology.parallel:result is None 2024-09-10T08:43:34.718 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:43:34.721 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:43:35.369 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T08:43:35.369 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T08:43:35.420 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-09-10T08:43:35.420 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-10T08:43:35.746 DEBUG:teuthology.parallel:result is None 2024-09-10T08:43:35.746 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T08:43:35.777 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T08:43:35.777 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-10T08:43:35.808 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-10T08:43:35.808 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-09-10T08:43:35.819 INFO:tasks.mon_thrash:joining mon_thrasher 2024-09-10T08:43:42.626 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-10T08:43:42.627 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-10T08:43:42.627 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T08:43:42.627 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T08:43:42.630 INFO:tasks.ceph.mon.a:Started 2024-09-10T08:43:42.630 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:43:42.630 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:43:42.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.764+0000 7efc1b81e640 1 Processor -- start 2024-09-10T08:43:42.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.765+0000 7efc1b81e640 1 -- start start 2024-09-10T08:43:42.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.765+0000 7efc1b81e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efc140c8b10 0x7efc1415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:42.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.765+0000 7efc1b81e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc140c7070 con 0x7efc14153be0 2024-09-10T08:43:42.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.765+0000 7efc1b81e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc1406d210 con 0x7efc1406cd80 2024-09-10T08:43:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.765+0000 7efc1b81e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7efc140c69b0 con 0x7efc140c8b10 2024-09-10T08:43:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc195ba640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efc140c8b10 0x7efc1415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc19dbb640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7efc14153be0 0x7efc14156660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:50536/0 (socket says 172.21.15.103:50536) 2024-09-10T08:43:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc19dbb640 1 -- 172.21.15.103:0/3400463732 learned_addr learned my addr 172.21.15.103:0/3400463732 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:43:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc195ba640 1 -- 172.21.15.103:0/3400463732 >> v2:172.21.15.103:3300/0 conn(0x7efc140c8b10 msgr2=0x7efc1415a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:43:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc195ba640 1 -- 172.21.15.103:0/3400463732 >> v2:172.21.15.103:3300/0 conn(0x7efc140c8b10 msgr2=0x7efc1415a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:43:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc195ba640 1 --2- 172.21.15.103:0/3400463732 >> v2:172.21.15.103:3300/0 conn(0x7efc140c8b10 0x7efc1415a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:43:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc195ba640 1 --2- 172.21.15.103:0/3400463732 >> v2:172.21.15.103:3300/0 conn(0x7efc140c8b10 0x7efc1415a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:43:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc0bfff640 1 -- 172.21.15.103:0/3400463732 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4170695142 0 0) 0x7efc1406d210 con 0x7efc1406cd80 2024-09-10T08:43:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc0bfff640 1 -- 172.21.15.103:0/3400463732 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc00003520 con 0x7efc1406cd80 2024-09-10T08:43:42.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc0bfff640 1 -- 172.21.15.103:0/3400463732 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1820756834 0 0) 0x7efc00003520 con 0x7efc1406cd80 2024-09-10T08:43:42.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc0bfff640 1 -- 172.21.15.103:0/3400463732 >> v2:172.21.15.103:3300/0 conn(0x7efc140c8b10 msgr2=0x7efc1415a4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:43:42.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc0bfff640 1 --2- 172.21.15.103:0/3400463732 >> v2:172.21.15.103:3300/0 conn(0x7efc140c8b10 0x7efc1415a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:42.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc0bfff640 1 -- 172.21.15.103:0/3400463732 >> v1:172.21.15.103:6789/0 conn(0x7efc14153be0 legacy=0x7efc14156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:42.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc0bfff640 1 -- 172.21.15.103:0/3400463732 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc140c6c90 con 0x7efc1406cd80 2024-09-10T08:43:42.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc0bfff640 1 -- 172.21.15.103:0/3400463732 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7efc04001670 con 0x7efc1406cd80 2024-09-10T08:43:42.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc0bfff640 1 -- 172.21.15.103:0/3400463732 >> v1:172.21.15.154:6789/0 conn(0x7efc1406cd80 legacy=0x7efc141534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:42.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc0bfff640 1 --2- 172.21.15.103:0/3400463732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc000039b0 0x7efc00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:42.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc0bfff640 1 --2- 172.21.15.103:0/3400463732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc00004800 0x7efc00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:42.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc0bfff640 1 --2- 172.21.15.103:0/3400463732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efc000052e0 0x7efc0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:42.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc0bfff640 1 -- 172.21.15.103:0/3400463732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efc140c69b0 con 0x7efc00004800 2024-09-10T08:43:42.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc0bfff640 1 -- 172.21.15.103:0/3400463732 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efc0000c1b0 con 0x7efc000039b0 2024-09-10T08:43:42.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc0bfff640 1 -- 172.21.15.103:0/3400463732 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7efc0000c3b0 con 0x7efc000052e0 2024-09-10T08:43:42.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc18db9640 1 --2- 172.21.15.103:0/3400463732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc00004800 0x7efc00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc195ba640 1 --2- 172.21.15.103:0/3400463732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc000039b0 0x7efc00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.766+0000 7efc19dbb640 1 --2- 172.21.15.103:0/3400463732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efc000052e0 0x7efc0000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.767+0000 7efc18db9640 1 -- 172.21.15.103:0/3400463732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efc000052e0 msgr2=0x7efc0000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.767+0000 7efc18db9640 1 --2- 172.21.15.103:0/3400463732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efc000052e0 0x7efc0000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.767+0000 7efc18db9640 1 -- 172.21.15.103:0/3400463732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc000039b0 msgr2=0x7efc00003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.767+0000 7efc18db9640 1 --2- 172.21.15.103:0/3400463732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc000039b0 0x7efc00003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.767+0000 7efc18db9640 1 -- 172.21.15.103:0/3400463732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc00003520 con 0x7efc00004800 2024-09-10T08:43:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.767+0000 7efc19dbb640 1 -- 172.21.15.103:0/3400463732 reap_dead start 2024-09-10T08:43:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.767+0000 7efc18db9640 1 --2- 172.21.15.103:0/3400463732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc00004800 0x7efc00004c80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efc04007fd0 tx=0x7efc00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec2cdc3739bdc66 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.768+0000 7efc0bfff640 1 -- 172.21.15.103:0/3400463732 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc04036070 con 0x7efc00004800 2024-09-10T08:43:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.768+0000 7efc0bfff640 1 -- 172.21.15.103:0/3400463732 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc04031620 con 0x7efc00004800 2024-09-10T08:43:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.768+0000 7efc0bfff640 1 -- 172.21.15.103:0/3400463732 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc04007c20 con 0x7efc00004800 2024-09-10T08:43:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.768+0000 7efc1b81e640 1 -- 172.21.15.103:0/3400463732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc00004800 msgr2=0x7efc00004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:42.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.768+0000 7efc1b81e640 1 --2- 172.21.15.103:0/3400463732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc00004800 0x7efc00004c80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efc04007fd0 tx=0x7efc00005830 comp rx=0 tx=0).stop 2024-09-10T08:43:42.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.768+0000 7efc1b81e640 1 -- 172.21.15.103:0/3400463732 shutdown_connections 2024-09-10T08:43:42.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.768+0000 7efc1b81e640 1 --2- 172.21.15.103:0/3400463732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc00004800 0x7efc00004c80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:42.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.768+0000 7efc1b81e640 1 -- 172.21.15.103:0/3400463732 >> 172.21.15.103:0/3400463732 conn(0x7efc140adb80 msgr2=0x7efc140adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:42.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.768+0000 7efc1b81e640 1 -- 172.21.15.103:0/3400463732 shutdown_connections 2024-09-10T08:43:42.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.768+0000 7efc1b81e640 1 -- 172.21.15.103:0/3400463732 wait complete. 2024-09-10T08:43:42.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.769+0000 7efc1b81e640 1 Processor -- start 2024-09-10T08:43:42.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.769+0000 7efc1b81e640 1 -- start start 2024-09-10T08:43:42.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.770+0000 7efc1b81e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc00004800 0x7efc14158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:42.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.770+0000 7efc1b81e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc1414be00 0x7efc14149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:42.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.770+0000 7efc1b81e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efc1414a090 0x7efc1414ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:42.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.770+0000 7efc1b81e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efc140c9070 con 0x7efc1414be00 2024-09-10T08:43:42.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.770+0000 7efc1b81e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efc140c8ef0 con 0x7efc00004800 2024-09-10T08:43:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.770+0000 7efc1b81e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7efc1415a4a0 con 0x7efc1414a090 2024-09-10T08:43:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.770+0000 7efc18db9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc1414be00 0x7efc14149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.770+0000 7efc195ba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc00004800 0x7efc14158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.770+0000 7efc18db9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc1414be00 0x7efc14149b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40590/0 (socket says 172.21.15.103:40590) 2024-09-10T08:43:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.770+0000 7efc18db9640 1 -- 172.21.15.103:0/3357739194 learned_addr learned my addr 172.21.15.103:0/3357739194 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.770+0000 7efc195ba640 1 --2- 172.21.15.103:0/3357739194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc00004800 0x7efc14158150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:39804/0 (socket says 172.21.15.103:39804) 2024-09-10T08:43:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.770+0000 7efc19dbb640 1 --2- 172.21.15.103:0/3357739194 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efc1414a090 0x7efc1414ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.770+0000 7efc18db9640 1 -- 172.21.15.103:0/3357739194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc1414be00 msgr2=0x7efc14149b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-10T08:43:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.770+0000 7efc18db9640 1 -- 172.21.15.103:0/3357739194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc1414be00 msgr2=0x7efc14149b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:43:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.770+0000 7efc18db9640 1 --2- 172.21.15.103:0/3357739194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc1414be00 0x7efc14149b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:43:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.770+0000 7efc18db9640 1 --2- 172.21.15.103:0/3357739194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc1414be00 0x7efc14149b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:43:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.771+0000 7efc195ba640 1 -- 172.21.15.103:0/3357739194 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efc1414a090 msgr2=0x7efc1414ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:42.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.771+0000 7efc195ba640 1 --2- 172.21.15.103:0/3357739194 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efc1414a090 0x7efc1414ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:42.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.771+0000 7efc195ba640 1 -- 172.21.15.103:0/3357739194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc1414be00 msgr2=0x7efc14149b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:43:42.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.771+0000 7efc195ba640 1 --2- 172.21.15.103:0/3357739194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc1414be00 0x7efc14149b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:42.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.771+0000 7efc195ba640 1 -- 172.21.15.103:0/3357739194 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc14158690 con 0x7efc00004800 2024-09-10T08:43:42.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.771+0000 7efc195ba640 1 --2- 172.21.15.103:0/3357739194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc00004800 0x7efc14158150 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efc10010920 tx=0x7efc10010d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:42.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.771+0000 7efc09ffb640 1 -- 172.21.15.103:0/3357739194 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1001a020 con 0x7efc00004800 2024-09-10T08:43:42.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.771+0000 7efc09ffb640 1 -- 172.21.15.103:0/3357739194 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc1000e9c0 con 0x7efc00004800 2024-09-10T08:43:42.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.771+0000 7efc09ffb640 1 -- 172.21.15.103:0/3357739194 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1000edb0 con 0x7efc00004800 2024-09-10T08:43:42.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.771+0000 7efc1b81e640 1 -- 172.21.15.103:0/3357739194 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc14159ad0 con 0x7efc00004800 2024-09-10T08:43:42.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.771+0000 7efc1b81e640 1 -- 172.21.15.103:0/3357739194 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc141597f0 con 0x7efc00004800 2024-09-10T08:43:42.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.772+0000 7efc1b81e640 1 -- 172.21.15.103:0/3357739194 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc1415aa90 con 0x7efc00004800 2024-09-10T08:43:42.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.773+0000 7efc09ffb640 1 -- 172.21.15.103:0/3357739194 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc1001d020 con 0x7efc00004800 2024-09-10T08:43:42.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.773+0000 7efc09ffb640 1 --2- 172.21.15.103:0/3357739194 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efbf806be30 0x7efbf806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:42.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.773+0000 7efc09ffb640 1 -- 172.21.15.103:0/3357739194 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7efc1008baf0 con 0x7efc00004800 2024-09-10T08:43:42.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.773+0000 7efc18db9640 1 --2- 172.21.15.103:0/3357739194 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efbf806be30 0x7efbf806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:42.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.773+0000 7efc18db9640 1 --2- 172.21.15.103:0/3357739194 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efbf806be30 0x7efbf806e2f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7efc04000c00 tx=0x7efc04005040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:42.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:42.778+0000 7efc09ffb640 1 -- 172.21.15.103:0/3357739194 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc1415aa90 con 0x7efc00004800 2024-09-10T08:43:43.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:43.071+0000 7efc1b81e640 1 -- 172.21.15.103:0/3357739194 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7efc1415a830 con 0x7efc00004800 2024-09-10T08:43:43.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:43.071+0000 7efc09ffb640 1 -- 172.21.15.103:0/3357739194 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7efc10024020 con 0x7efc00004800 2024-09-10T08:43:43.073 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":120,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:43:43.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:43.074+0000 7efc1b81e640 1 -- 172.21.15.103:0/3357739194 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efbf806be30 msgr2=0x7efbf806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:43.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:43.074+0000 7efc1b81e640 1 --2- 172.21.15.103:0/3357739194 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efbf806be30 0x7efbf806e2f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7efc04000c00 tx=0x7efc04005040 comp rx=0 tx=0).stop 2024-09-10T08:43:43.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:43.074+0000 7efc1b81e640 1 -- 172.21.15.103:0/3357739194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc00004800 msgr2=0x7efc14158150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:43.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:43.074+0000 7efc1b81e640 1 --2- 172.21.15.103:0/3357739194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc00004800 0x7efc14158150 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efc10010920 tx=0x7efc10010d20 comp rx=0 tx=0).stop 2024-09-10T08:43:43.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:43.074+0000 7efc1b81e640 1 -- 172.21.15.103:0/3357739194 shutdown_connections 2024-09-10T08:43:43.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:43.074+0000 7efc1b81e640 1 --2- 172.21.15.103:0/3357739194 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7efbf806be30 0x7efbf806e2f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:43.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:43.074+0000 7efc1b81e640 1 --2- 172.21.15.103:0/3357739194 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efc1414a090 0x7efc1414ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:43.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:43.074+0000 7efc1b81e640 1 --2- 172.21.15.103:0/3357739194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc1414be00 0x7efc14149b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:43.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:43.074+0000 7efc1b81e640 1 --2- 172.21.15.103:0/3357739194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc00004800 0x7efc14158150 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:43.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:43.074+0000 7efc1b81e640 1 -- 172.21.15.103:0/3357739194 >> 172.21.15.103:0/3357739194 conn(0x7efc140adb80 msgr2=0x7efc14156d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:43.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:43.074+0000 7efc1b81e640 1 -- 172.21.15.103:0/3357739194 shutdown_connections 2024-09-10T08:43:43.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:43.074+0000 7efc1b81e640 1 -- 172.21.15.103:0/3357739194 wait complete. 2024-09-10T08:43:46.087 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:43:46.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.188+0000 7f2cbffe8640 1 Processor -- start 2024-09-10T08:43:46.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.188+0000 7f2cbffe8640 1 -- start start 2024-09-10T08:43:46.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.189+0000 7f2cbffe8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb80c56e0 0x7f2cb806ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:46.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.189+0000 7f2cbffe8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2cb80708f0 0x7f2cb8159e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:46.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.189+0000 7f2cbffe8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb806e5f0 con 0x7f2cb815a3b0 2024-09-10T08:43:46.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.189+0000 7f2cbffe8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f2cb8159700 con 0x7f2cb80708f0 2024-09-10T08:43:46.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.189+0000 7f2cbffe8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb80702c0 con 0x7f2cb80c56e0 2024-09-10T08:43:46.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.189+0000 7f2cbd583640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2cb80708f0 0x7f2cb8159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:46.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.189+0000 7f2cbd583640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2cb80708f0 0x7f2cb8159e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33078/0 (socket says 172.21.15.103:33078) 2024-09-10T08:43:46.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.189+0000 7f2cbd583640 1 -- 172.21.15.103:0/176225684 learned_addr learned my addr 172.21.15.103:0/176225684 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:46.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.189+0000 7f2cbd583640 1 -- 172.21.15.103:0/176225684 >> v2:172.21.15.103:3300/0 conn(0x7f2cb80708f0 msgr2=0x7f2cb8159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:43:46.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.189+0000 7f2cbd583640 1 -- 172.21.15.103:0/176225684 >> v2:172.21.15.103:3300/0 conn(0x7f2cb80708f0 msgr2=0x7f2cb8159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:43:46.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.189+0000 7f2cbd583640 1 --2- 172.21.15.103:0/176225684 >> v2:172.21.15.103:3300/0 conn(0x7f2cb80708f0 0x7f2cb8159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:43:46.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.189+0000 7f2cbd583640 1 --2- 172.21.15.103:0/176225684 >> v2:172.21.15.103:3300/0 conn(0x7f2cb80708f0 0x7f2cb8159e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:43:46.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.189+0000 7f2cbdd84640 1 --2- 172.21.15.103:0/176225684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb80c56e0 0x7f2cb806ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:46.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.190+0000 7f2cbcd82640 1 -- 172.21.15.103:0/176225684 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1165859416 0 0) 0x7f2cb806e5f0 con 0x7f2cb815a3b0 2024-09-10T08:43:46.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.190+0000 7f2cbdd84640 1 -- 172.21.15.103:0/176225684 >> v2:172.21.15.103:3300/0 conn(0x7f2cb80708f0 msgr2=0x7f2cb8159e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:43:46.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.190+0000 7f2cbdd84640 1 --2- 172.21.15.103:0/176225684 >> v2:172.21.15.103:3300/0 conn(0x7f2cb80708f0 0x7f2cb8159e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:46.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.190+0000 7f2cbdd84640 1 -- 172.21.15.103:0/176225684 >> v1:172.21.15.154:6789/0 conn(0x7f2cb815a3b0 legacy=0x7f2cb8153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:46.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.190+0000 7f2cbdd84640 1 -- 172.21.15.103:0/176225684 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb80705a0 con 0x7f2cb80c56e0 2024-09-10T08:43:46.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.190+0000 7f2cbdd84640 1 --2- 172.21.15.103:0/176225684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb80c56e0 0x7f2cb806ebe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009d90 tx=0x7f2ca802a530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcfbd515bed94d86 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:46.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.191+0000 7f2cbcd82640 1 -- 172.21.15.103:0/176225684 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8007740 con 0x7f2cb80c56e0 2024-09-10T08:43:46.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.191+0000 7f2cbcd82640 1 -- 172.21.15.103:0/176225684 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca80078e0 con 0x7f2cb80c56e0 2024-09-10T08:43:46.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.191+0000 7f2cbcd82640 1 -- 172.21.15.103:0/176225684 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8007cb0 con 0x7f2cb80c56e0 2024-09-10T08:43:46.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.191+0000 7f2cbffe8640 1 -- 172.21.15.103:0/176225684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb80c56e0 msgr2=0x7f2cb806ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:46.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.191+0000 7f2cbffe8640 1 --2- 172.21.15.103:0/176225684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb80c56e0 0x7f2cb806ebe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009d90 tx=0x7f2ca802a530 comp rx=0 tx=0).stop 2024-09-10T08:43:46.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.191+0000 7f2cbffe8640 1 -- 172.21.15.103:0/176225684 shutdown_connections 2024-09-10T08:43:46.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.191+0000 7f2cbffe8640 1 --2- 172.21.15.103:0/176225684 >> v2:172.21.15.103:3300/0 conn(0x7f2cb80708f0 0x7f2cb8159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:46.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.191+0000 7f2cbffe8640 1 --2- 172.21.15.103:0/176225684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb80c56e0 0x7f2cb806ebe0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:46.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.191+0000 7f2cbffe8640 1 -- 172.21.15.103:0/176225684 >> 172.21.15.103:0/176225684 conn(0x7f2cb80c9d80 msgr2=0x7f2cb80ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:46.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.191+0000 7f2cbffe8640 1 -- 172.21.15.103:0/176225684 shutdown_connections 2024-09-10T08:43:46.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.191+0000 7f2cbffe8640 1 -- 172.21.15.103:0/176225684 wait complete. 2024-09-10T08:43:46.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.192+0000 7f2cbffe8640 1 Processor -- start 2024-09-10T08:43:46.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.192+0000 7f2cbffe8640 1 -- start start 2024-09-10T08:43:46.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.193+0000 7f2cbffe8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cb80708f0 0x7f2cb81542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:46.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.193+0000 7f2cbffe8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cb80c56e0 0x7f2cb814ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:46.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.193+0000 7f2cbffe8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb80c9760 0x7f2cb8141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:46.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.193+0000 7f2cbffe8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb8153c60 con 0x7f2cb80708f0 2024-09-10T08:43:46.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.193+0000 7f2cbffe8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb806e2f0 con 0x7f2cb80c56e0 2024-09-10T08:43:46.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.193+0000 7f2cbffe8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb8153de0 con 0x7f2cb80c9760 2024-09-10T08:43:46.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.193+0000 7f2cbdd84640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cb80708f0 0x7f2cb81542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:46.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.193+0000 7f2cbdd84640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cb80708f0 0x7f2cb81542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33088/0 (socket says 172.21.15.103:33088) 2024-09-10T08:43:46.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.193+0000 7f2cbdd84640 1 -- 172.21.15.103:0/3014595199 learned_addr learned my addr 172.21.15.103:0/3014595199 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:46.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.193+0000 7f2cbd583640 1 --2- 172.21.15.103:0/3014595199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cb80c56e0 0x7f2cb814ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:46.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.193+0000 7f2cbe585640 1 --2- 172.21.15.103:0/3014595199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb80c9760 0x7f2cb8141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:46.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.193+0000 7f2cbdd84640 1 -- 172.21.15.103:0/3014595199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cb80708f0 msgr2=0x7f2cb81542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-10T08:43:46.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.193+0000 7f2cbdd84640 1 -- 172.21.15.103:0/3014595199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cb80708f0 msgr2=0x7f2cb81542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:43:46.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.193+0000 7f2cbdd84640 1 --2- 172.21.15.103:0/3014595199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cb80708f0 0x7f2cb81542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:43:46.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.193+0000 7f2cbdd84640 1 --2- 172.21.15.103:0/3014595199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cb80708f0 0x7f2cb81542c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:43:46.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.194+0000 7f2cbe585640 1 -- 172.21.15.103:0/3014595199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cb80c56e0 msgr2=0x7f2cb814ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:46.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.194+0000 7f2cbe585640 1 --2- 172.21.15.103:0/3014595199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cb80c56e0 0x7f2cb814ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:46.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.194+0000 7f2cbe585640 1 -- 172.21.15.103:0/3014595199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cb80708f0 msgr2=0x7f2cb81542c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:43:46.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.194+0000 7f2cbe585640 1 --2- 172.21.15.103:0/3014595199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cb80708f0 0x7f2cb81542c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:46.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.194+0000 7f2cbe585640 1 -- 172.21.15.103:0/3014595199 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb8142000 con 0x7f2cb80c9760 2024-09-10T08:43:46.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.194+0000 7f2cbd583640 1 --2- 172.21.15.103:0/3014595199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cb80c56e0 0x7f2cb814ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:43:46.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.194+0000 7f2cbe585640 1 --2- 172.21.15.103:0/3014595199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb80c9760 0x7f2cb8141310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2cb000c410 tx=0x7f2cb000c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:46.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.194+0000 7f2cb67fc640 1 -- 172.21.15.103:0/3014595199 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0017070 con 0x7f2cb80c9760 2024-09-10T08:43:46.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.194+0000 7f2cb67fc640 1 -- 172.21.15.103:0/3014595199 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb00035f0 con 0x7f2cb80c9760 2024-09-10T08:43:46.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.194+0000 7f2cb67fc640 1 -- 172.21.15.103:0/3014595199 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb00039e0 con 0x7f2cb80c9760 2024-09-10T08:43:46.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.194+0000 7f2cbffe8640 1 -- 172.21.15.103:0/3014595199 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb81ef9f0 con 0x7f2cb80c9760 2024-09-10T08:43:46.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.194+0000 7f2cbffe8640 1 -- 172.21.15.103:0/3014595199 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb8154800 con 0x7f2cb80c9760 2024-09-10T08:43:46.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.195+0000 7f2cbffe8640 1 -- 172.21.15.103:0/3014595199 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cb80c5ac0 con 0x7f2cb80c9760 2024-09-10T08:43:46.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.196+0000 7f2cb67fc640 1 -- 172.21.15.103:0/3014595199 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2cb001a070 con 0x7f2cb80c9760 2024-09-10T08:43:46.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.196+0000 7f2cb67fc640 1 --2- 172.21.15.103:0/3014595199 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2ca406be30 0x7f2ca406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:46.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.196+0000 7f2cb67fc640 1 -- 172.21.15.103:0/3014595199 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f2cb008a300 con 0x7f2cb80c9760 2024-09-10T08:43:46.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.196+0000 7f2cbdd84640 1 --2- 172.21.15.103:0/3014595199 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2ca406be30 0x7f2ca406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:46.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.196+0000 7f2cbdd84640 1 --2- 172.21.15.103:0/3014595199 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2ca406be30 0x7f2ca406e2f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8000f80 tx=0x7f2ca802f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:46.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.201+0000 7f2cb67fc640 1 -- 172.21.15.103:0/3014595199 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2cb0058410 con 0x7f2cb80c9760 2024-09-10T08:43:46.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.430+0000 7f2cbffe8640 1 -- 172.21.15.103:0/3014595199 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2cb81591e0 con 0x7f2cb80c9760 2024-09-10T08:43:46.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.431+0000 7f2cb67fc640 1 -- 172.21.15.103:0/3014595199 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f2cb005c710 con 0x7f2cb80c9760 2024-09-10T08:43:46.431 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":120,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:43:46.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.433+0000 7f2cbffe8640 1 -- 172.21.15.103:0/3014595199 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2ca406be30 msgr2=0x7f2ca406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:46.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.433+0000 7f2cbffe8640 1 --2- 172.21.15.103:0/3014595199 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2ca406be30 0x7f2ca406e2f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8000f80 tx=0x7f2ca802f000 comp rx=0 tx=0).stop 2024-09-10T08:43:46.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.433+0000 7f2cbffe8640 1 -- 172.21.15.103:0/3014595199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb80c9760 msgr2=0x7f2cb8141310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:46.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.433+0000 7f2cbffe8640 1 --2- 172.21.15.103:0/3014595199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb80c9760 0x7f2cb8141310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2cb000c410 tx=0x7f2cb000c8d0 comp rx=0 tx=0).stop 2024-09-10T08:43:46.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.433+0000 7f2cbffe8640 1 -- 172.21.15.103:0/3014595199 shutdown_connections 2024-09-10T08:43:46.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.433+0000 7f2cbffe8640 1 --2- 172.21.15.103:0/3014595199 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2ca406be30 0x7f2ca406e2f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:46.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.433+0000 7f2cbffe8640 1 --2- 172.21.15.103:0/3014595199 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb80c9760 0x7f2cb8141310 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:46.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.433+0000 7f2cbffe8640 1 --2- 172.21.15.103:0/3014595199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cb80c56e0 0x7f2cb814ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:46.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.433+0000 7f2cbffe8640 1 --2- 172.21.15.103:0/3014595199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cb80708f0 0x7f2cb81542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:46.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.433+0000 7f2cbffe8640 1 -- 172.21.15.103:0/3014595199 >> 172.21.15.103:0/3014595199 conn(0x7f2cb80c9d80 msgr2=0x7f2cb8153530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:46.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.433+0000 7f2cbffe8640 1 -- 172.21.15.103:0/3014595199 shutdown_connections 2024-09-10T08:43:46.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:46.433+0000 7f2cbffe8640 1 -- 172.21.15.103:0/3014595199 wait complete. 2024-09-10T08:43:49.445 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:43:49.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.556+0000 7f22b23d6640 1 Processor -- start 2024-09-10T08:43:49.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.556+0000 7f22b23d6640 1 -- start start 2024-09-10T08:43:49.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.557+0000 7f22b23d6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22ac1505f0 0x7f22ac153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:49.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.557+0000 7f22b23d6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f22ac0c42b0 0x7f22ac0c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:49.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.557+0000 7f22b23d6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22ac0c5940 con 0x7f22ac0c69c0 2024-09-10T08:43:49.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.557+0000 7f22b23d6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f22ac0c7860 con 0x7f22ac0c42b0 2024-09-10T08:43:49.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.557+0000 7f22b23d6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f22ac0c5c00 con 0x7f22ac1505f0 2024-09-10T08:43:49.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.557+0000 7f22abfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22ac1505f0 0x7f22ac153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:49.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.557+0000 7f22b0973640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f22ac0c42b0 0x7f22ac0c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:49.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.557+0000 7f22abfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22ac1505f0 0x7f22ac153910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:52690/0 (socket says 172.21.15.103:52690) 2024-09-10T08:43:49.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.557+0000 7f22abfff640 1 -- 172.21.15.103:0/1677740524 learned_addr learned my addr 172.21.15.103:0/1677740524 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:49.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.558+0000 7f22abfff640 1 -- 172.21.15.103:0/1677740524 >> v2:172.21.15.154:3300/0 conn(0x7f22ac0c42b0 msgr2=0x7f22ac0c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:49.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.558+0000 7f22abfff640 1 --2- 172.21.15.103:0/1677740524 >> v2:172.21.15.154:3300/0 conn(0x7f22ac0c42b0 0x7f22ac0c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:49.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.558+0000 7f22abfff640 1 -- 172.21.15.103:0/1677740524 >> v1:172.21.15.154:6789/0 conn(0x7f22ac0c69c0 legacy=0x7f22ac0c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:49.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.558+0000 7f22abfff640 1 -- 172.21.15.103:0/1677740524 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ac0c5ee0 con 0x7f22ac1505f0 2024-09-10T08:43:49.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.558+0000 7f22b0973640 1 --2- 172.21.15.103:0/1677740524 >> v2:172.21.15.154:3300/0 conn(0x7f22ac0c42b0 0x7f22ac0c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:43:49.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.559+0000 7f22abfff640 1 --2- 172.21.15.103:0/1677740524 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22ac1505f0 0x7f22ac153910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f229c009870 tx=0x7f229c02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73b4d552fb70e1ec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.559+0000 7f22aaffd640 1 -- 172.21.15.103:0/1677740524 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c037070 con 0x7f22ac1505f0 2024-09-10T08:43:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.559+0000 7f22aaffd640 1 -- 172.21.15.103:0/1677740524 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f229c032440 con 0x7f22ac1505f0 2024-09-10T08:43:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.559+0000 7f22aaffd640 1 -- 172.21.15.103:0/1677740524 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c032810 con 0x7f22ac1505f0 2024-09-10T08:43:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.559+0000 7f22b23d6640 1 -- 172.21.15.103:0/1677740524 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22ac1505f0 msgr2=0x7f22ac153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.559+0000 7f22b23d6640 1 --2- 172.21.15.103:0/1677740524 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22ac1505f0 0x7f22ac153910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f229c009870 tx=0x7f229c02a1c0 comp rx=0 tx=0).stop 2024-09-10T08:43:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.559+0000 7f22b23d6640 1 -- 172.21.15.103:0/1677740524 shutdown_connections 2024-09-10T08:43:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.559+0000 7f22b23d6640 1 --2- 172.21.15.103:0/1677740524 >> v2:172.21.15.154:3300/0 conn(0x7f22ac0c42b0 0x7f22ac0c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.559+0000 7f22b23d6640 1 --2- 172.21.15.103:0/1677740524 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22ac1505f0 0x7f22ac153910 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.559+0000 7f22b23d6640 1 -- 172.21.15.103:0/1677740524 >> 172.21.15.103:0/1677740524 conn(0x7f22ac0c7a40 msgr2=0x7f22ac0c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.559+0000 7f22b23d6640 1 -- 172.21.15.103:0/1677740524 shutdown_connections 2024-09-10T08:43:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.559+0000 7f22b23d6640 1 -- 172.21.15.103:0/1677740524 wait complete. 2024-09-10T08:43:49.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.561+0000 7f22b23d6640 1 Processor -- start 2024-09-10T08:43:49.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.561+0000 7f22b23d6640 1 -- start start 2024-09-10T08:43:49.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.561+0000 7f22b23d6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22ac0c42b0 0x7f22ac14e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:49.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.561+0000 7f22b23d6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22ac1505f0 0x7f22ac14aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:49.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.561+0000 7f22b23d6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22ac14cf30 0x7f22ac14d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:49.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.561+0000 7f22b23d6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac1509d0 con 0x7f22ac1505f0 2024-09-10T08:43:49.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.561+0000 7f22b23d6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac0c64a0 con 0x7f22ac14cf30 2024-09-10T08:43:49.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.561+0000 7f22b23d6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f22ac150b50 con 0x7f22ac0c42b0 2024-09-10T08:43:49.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.562+0000 7f22ab7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22ac1505f0 0x7f22ac14aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:49.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.562+0000 7f22ab7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22ac1505f0 0x7f22ac14aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33104/0 (socket says 172.21.15.103:33104) 2024-09-10T08:43:49.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.562+0000 7f22ab7fe640 1 -- 172.21.15.103:0/2148322709 learned_addr learned my addr 172.21.15.103:0/2148322709 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:49.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.562+0000 7f22ab7fe640 1 -- 172.21.15.103:0/2148322709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22ac1505f0 msgr2=0x7f22ac14aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-10T08:43:49.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.562+0000 7f22ab7fe640 1 -- 172.21.15.103:0/2148322709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22ac1505f0 msgr2=0x7f22ac14aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:43:49.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.562+0000 7f22ab7fe640 1 --2- 172.21.15.103:0/2148322709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22ac1505f0 0x7f22ac14aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:43:49.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.562+0000 7f22ab7fe640 1 --2- 172.21.15.103:0/2148322709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22ac1505f0 0x7f22ac14aaf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:43:49.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.562+0000 7f22abfff640 1 --2- 172.21.15.103:0/2148322709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22ac0c42b0 0x7f22ac14e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:49.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.562+0000 7f22b0973640 1 --2- 172.21.15.103:0/2148322709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22ac14cf30 0x7f22ac14d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:49.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.562+0000 7f22abfff640 1 -- 172.21.15.103:0/2148322709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22ac14cf30 msgr2=0x7f22ac14d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:49.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.562+0000 7f22abfff640 1 --2- 172.21.15.103:0/2148322709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22ac14cf30 0x7f22ac14d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:49.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.562+0000 7f22abfff640 1 -- 172.21.15.103:0/2148322709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22ac1505f0 msgr2=0x7f22ac14aaf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:43:49.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.562+0000 7f22abfff640 1 --2- 172.21.15.103:0/2148322709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22ac1505f0 0x7f22ac14aaf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.562+0000 7f22abfff640 1 -- 172.21.15.103:0/2148322709 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ac145810 con 0x7f22ac0c42b0 2024-09-10T08:43:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.562+0000 7f22b0973640 1 --2- 172.21.15.103:0/2148322709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22ac14cf30 0x7f22ac14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:43:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.562+0000 7f22abfff640 1 --2- 172.21.15.103:0/2148322709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22ac0c42b0 0x7f22ac14e680 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f229c031000 tx=0x7f229c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.563+0000 7f22a8ff9640 1 -- 172.21.15.103:0/2148322709 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c037040 con 0x7f22ac0c42b0 2024-09-10T08:43:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.563+0000 7f22a8ff9640 1 -- 172.21.15.103:0/2148322709 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f229c042070 con 0x7f22ac0c42b0 2024-09-10T08:43:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.563+0000 7f22b23d6640 1 -- 172.21.15.103:0/2148322709 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22ac0acea0 con 0x7f22ac0c42b0 2024-09-10T08:43:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.563+0000 7f22a8ff9640 1 -- 172.21.15.103:0/2148322709 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c030900 con 0x7f22ac0c42b0 2024-09-10T08:43:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.563+0000 7f22b23d6640 1 -- 172.21.15.103:0/2148322709 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f22ac151080 con 0x7f22ac0c42b0 2024-09-10T08:43:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.564+0000 7f22b23d6640 1 -- 172.21.15.103:0/2148322709 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22ac153910 con 0x7f22ac0c42b0 2024-09-10T08:43:49.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.564+0000 7f22a8ff9640 1 -- 172.21.15.103:0/2148322709 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f229c02ad10 con 0x7f22ac0c42b0 2024-09-10T08:43:49.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.565+0000 7f22a8ff9640 1 --2- 172.21.15.103:0/2148322709 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f229806be30 0x7f229806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:49.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.565+0000 7f22a8ff9640 1 -- 172.21.15.103:0/2148322709 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f229c0ab930 con 0x7f22ac0c42b0 2024-09-10T08:43:49.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.565+0000 7f22ab7fe640 1 --2- 172.21.15.103:0/2148322709 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f229806be30 0x7f229806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:49.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.565+0000 7f22ab7fe640 1 --2- 172.21.15.103:0/2148322709 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f229806be30 0x7f229806e2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0c26c0 tx=0x7f22a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:49.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.569+0000 7f22a8ff9640 1 -- 172.21.15.103:0/2148322709 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f229c079fb0 con 0x7f22ac0c42b0 2024-09-10T08:43:49.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.800+0000 7f22b23d6640 1 -- 172.21.15.103:0/2148322709 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f22ac0c8340 con 0x7f22ac0c42b0 2024-09-10T08:43:49.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.801+0000 7f22a8ff9640 1 -- 172.21.15.103:0/2148322709 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f229c0798b0 con 0x7f22ac0c42b0 2024-09-10T08:43:49.801 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":120,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":28,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:43:49.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.803+0000 7f22b23d6640 1 -- 172.21.15.103:0/2148322709 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f229806be30 msgr2=0x7f229806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:49.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.803+0000 7f22b23d6640 1 --2- 172.21.15.103:0/2148322709 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f229806be30 0x7f229806e2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0c26c0 tx=0x7f22a0009040 comp rx=0 tx=0).stop 2024-09-10T08:43:49.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.803+0000 7f22b23d6640 1 -- 172.21.15.103:0/2148322709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22ac0c42b0 msgr2=0x7f22ac14e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:49.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.803+0000 7f22b23d6640 1 --2- 172.21.15.103:0/2148322709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22ac0c42b0 0x7f22ac14e680 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f229c031000 tx=0x7f229c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:43:49.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.803+0000 7f22b23d6640 1 -- 172.21.15.103:0/2148322709 shutdown_connections 2024-09-10T08:43:49.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.803+0000 7f22b23d6640 1 --2- 172.21.15.103:0/2148322709 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f229806be30 0x7f229806e2f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:49.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.803+0000 7f22b23d6640 1 --2- 172.21.15.103:0/2148322709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22ac14cf30 0x7f22ac14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:49.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.803+0000 7f22b23d6640 1 --2- 172.21.15.103:0/2148322709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22ac1505f0 0x7f22ac14aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:49.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.803+0000 7f22b23d6640 1 --2- 172.21.15.103:0/2148322709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22ac0c42b0 0x7f22ac14e680 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:49.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.803+0000 7f22b23d6640 1 -- 172.21.15.103:0/2148322709 >> 172.21.15.103:0/2148322709 conn(0x7f22ac0c7a40 msgr2=0x7f22ac0c3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:49.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.803+0000 7f22b23d6640 1 -- 172.21.15.103:0/2148322709 shutdown_connections 2024-09-10T08:43:49.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:49.803+0000 7f22b23d6640 1 -- 172.21.15.103:0/2148322709 wait complete. 2024-09-10T08:43:52.815 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:43:52.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.927+0000 7f57d9482640 1 Processor -- start 2024-09-10T08:43:52.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.927+0000 7f57d9482640 1 -- start start 2024-09-10T08:43:52.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.927+0000 7f57d9482640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f57d40c8b10 0x7f57d415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:52.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.927+0000 7f57d9482640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57d406cd80 0x7f57d41534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:52.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.927+0000 7f57d9482640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57d40c7070 con 0x7f57d4153a10 2024-09-10T08:43:52.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.927+0000 7f57d9482640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f57d406d210 con 0x7f57d40c8b10 2024-09-10T08:43:52.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.927+0000 7f57d9482640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f57d40c69b0 con 0x7f57d406cd80 2024-09-10T08:43:52.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.928+0000 7f57d37fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f57d4153a10 0x7f57d4156660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:45784/0 (socket says 172.21.15.103:45784) 2024-09-10T08:43:52.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.928+0000 7f57d37fe640 1 -- 172.21.15.103:0/3588336937 learned_addr learned my addr 172.21.15.103:0/3588336937 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:43:52.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.928+0000 7f57d27fc640 1 --2- 172.21.15.103:0/3588336937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57d406cd80 0x7f57d41534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:52.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.928+0000 7f57d2ffd640 1 --2- 172.21.15.103:0/3588336937 >> v2:172.21.15.154:3300/0 conn(0x7f57d40c8b10 0x7f57d415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:52.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.928+0000 7f57d27fc640 1 -- 172.21.15.103:0/3588336937 >> v2:172.21.15.154:3300/0 conn(0x7f57d40c8b10 msgr2=0x7f57d415a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:52.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.928+0000 7f57d27fc640 1 --2- 172.21.15.103:0/3588336937 >> v2:172.21.15.154:3300/0 conn(0x7f57d40c8b10 0x7f57d415a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:52.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.928+0000 7f57d27fc640 1 -- 172.21.15.103:0/3588336937 >> v1:172.21.15.103:6789/0 conn(0x7f57d4153a10 legacy=0x7f57d4156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:52.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.928+0000 7f57d27fc640 1 -- 172.21.15.103:0/3588336937 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d40c6c90 con 0x7f57d406cd80 2024-09-10T08:43:52.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.928+0000 7f57d2ffd640 1 --2- 172.21.15.103:0/3588336937 >> v2:172.21.15.154:3300/0 conn(0x7f57d40c8b10 0x7f57d415a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:43:52.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.929+0000 7f57d27fc640 1 --2- 172.21.15.103:0/3588336937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57d406cd80 0x7f57d41534d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f57bc0097a0 tx=0x7f57bc02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=945e73fab8a95b4a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:52.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.929+0000 7f57d1ffb640 1 -- 172.21.15.103:0/3588336937 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57bc037070 con 0x7f57d406cd80 2024-09-10T08:43:52.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.929+0000 7f57d1ffb640 1 -- 172.21.15.103:0/3588336937 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57bc02ae50 con 0x7f57d406cd80 2024-09-10T08:43:52.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.929+0000 7f57d1ffb640 1 -- 172.21.15.103:0/3588336937 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57bc032660 con 0x7f57d406cd80 2024-09-10T08:43:52.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.930+0000 7f57d9482640 1 -- 172.21.15.103:0/3588336937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57d406cd80 msgr2=0x7f57d41534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:52.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.930+0000 7f57d9482640 1 --2- 172.21.15.103:0/3588336937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57d406cd80 0x7f57d41534d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f57bc0097a0 tx=0x7f57bc02a100 comp rx=0 tx=0).stop 2024-09-10T08:43:52.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.930+0000 7f57d9482640 1 -- 172.21.15.103:0/3588336937 shutdown_connections 2024-09-10T08:43:52.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.930+0000 7f57d9482640 1 --2- 172.21.15.103:0/3588336937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57d406cd80 0x7f57d41534d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:52.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.930+0000 7f57d9482640 1 --2- 172.21.15.103:0/3588336937 >> v2:172.21.15.154:3300/0 conn(0x7f57d40c8b10 0x7f57d415a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:52.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.930+0000 7f57d9482640 1 -- 172.21.15.103:0/3588336937 >> 172.21.15.103:0/3588336937 conn(0x7f57d40adb80 msgr2=0x7f57d40adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:52.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.930+0000 7f57d9482640 1 -- 172.21.15.103:0/3588336937 shutdown_connections 2024-09-10T08:43:52.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.930+0000 7f57d9482640 1 -- 172.21.15.103:0/3588336937 wait complete. 2024-09-10T08:43:52.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.931+0000 7f57d9482640 1 Processor -- start 2024-09-10T08:43:52.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.931+0000 7f57d9482640 1 -- start start 2024-09-10T08:43:52.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.932+0000 7f57d9482640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57d40c8b10 0x7f57d41e14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:52.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.932+0000 7f57d9482640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57d4153a10 0x7f57d40acc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:52.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.932+0000 7f57d9482640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57d40ad150 0x7f57d4148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:52.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.932+0000 7f57d9482640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f57d4154020 con 0x7f57d40c8b10 2024-09-10T08:43:52.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.932+0000 7f57d9482640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f57d4153ea0 con 0x7f57d40ad150 2024-09-10T08:43:52.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.932+0000 7f57d9482640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f57d40c8ef0 con 0x7f57d4153a10 2024-09-10T08:43:52.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.932+0000 7f57d2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57d40c8b10 0x7f57d41e14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:52.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.932+0000 7f57d2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57d40c8b10 0x7f57d41e14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33110/0 (socket says 172.21.15.103:33110) 2024-09-10T08:43:52.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.932+0000 7f57d2ffd640 1 -- 172.21.15.103:0/2441659690 learned_addr learned my addr 172.21.15.103:0/2441659690 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:52.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.932+0000 7f57d2ffd640 1 -- 172.21.15.103:0/2441659690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57d40c8b10 msgr2=0x7f57d41e14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-10T08:43:52.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.932+0000 7f57d2ffd640 1 -- 172.21.15.103:0/2441659690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57d40c8b10 msgr2=0x7f57d41e14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:43:52.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.932+0000 7f57d2ffd640 1 --2- 172.21.15.103:0/2441659690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57d40c8b10 0x7f57d41e14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:43:52.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.932+0000 7f57d2ffd640 1 --2- 172.21.15.103:0/2441659690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57d40c8b10 0x7f57d41e14a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:43:52.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.932+0000 7f57d27fc640 1 --2- 172.21.15.103:0/2441659690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57d4153a10 0x7f57d40acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:52.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.932+0000 7f57d37fe640 1 --2- 172.21.15.103:0/2441659690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57d40ad150 0x7f57d4148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:52.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.933+0000 7f57d27fc640 1 -- 172.21.15.103:0/2441659690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57d40ad150 msgr2=0x7f57d4148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:52.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.933+0000 7f57d27fc640 1 --2- 172.21.15.103:0/2441659690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57d40ad150 0x7f57d4148d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:52.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.933+0000 7f57d27fc640 1 -- 172.21.15.103:0/2441659690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57d40c8b10 msgr2=0x7f57d41e14a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:43:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.933+0000 7f57d27fc640 1 --2- 172.21.15.103:0/2441659690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57d40c8b10 0x7f57d41e14a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.933+0000 7f57d27fc640 1 -- 172.21.15.103:0/2441659690 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d41eef40 con 0x7f57d4153a10 2024-09-10T08:43:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.933+0000 7f57d37fe640 1 --2- 172.21.15.103:0/2441659690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57d40ad150 0x7f57d4148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:43:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.933+0000 7f57d27fc640 1 --2- 172.21.15.103:0/2441659690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57d4153a10 0x7f57d40acc10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f57bc031000 tx=0x7f57bc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.933+0000 7f57cb7fe640 1 -- 172.21.15.103:0/2441659690 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57bc041070 con 0x7f57d4153a10 2024-09-10T08:43:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.933+0000 7f57cb7fe640 1 -- 172.21.15.103:0/2441659690 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57bc032e20 con 0x7f57d4153a10 2024-09-10T08:43:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.933+0000 7f57d9482640 1 -- 172.21.15.103:0/2441659690 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57d41ef220 con 0x7f57d4153a10 2024-09-10T08:43:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.933+0000 7f57cb7fe640 1 -- 172.21.15.103:0/2441659690 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57bc037040 con 0x7f57d4153a10 2024-09-10T08:43:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.933+0000 7f57d9482640 1 -- 172.21.15.103:0/2441659690 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f57d41ef7e0 con 0x7f57d4153a10 2024-09-10T08:43:52.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.934+0000 7f57d9482640 1 -- 172.21.15.103:0/2441659690 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57d41efb10 con 0x7f57d4153a10 2024-09-10T08:43:52.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.935+0000 7f57cb7fe640 1 -- 172.21.15.103:0/2441659690 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f57bc03a070 con 0x7f57d4153a10 2024-09-10T08:43:52.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.935+0000 7f57cb7fe640 1 --2- 172.21.15.103:0/2441659690 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f57b406be60 0x7f57b406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:52.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.935+0000 7f57cb7fe640 1 -- 172.21.15.103:0/2441659690 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f57bc0ab2d0 con 0x7f57d4153a10 2024-09-10T08:43:52.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.935+0000 7f57d2ffd640 1 --2- 172.21.15.103:0/2441659690 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f57b406be60 0x7f57b406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:52.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.936+0000 7f57d2ffd640 1 --2- 172.21.15.103:0/2441659690 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f57b406be60 0x7f57b406e320 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f57c4009fd0 tx=0x7f57c400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:52.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:52.940+0000 7f57cb7fe640 1 -- 172.21.15.103:0/2441659690 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f57bc079320 con 0x7f57d4153a10 2024-09-10T08:43:53.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:53.170+0000 7f57d9482640 1 -- 172.21.15.103:0/2441659690 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f57d41534d0 con 0x7f57d4153a10 2024-09-10T08:43:53.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:53.171+0000 7f57cb7fe640 1 -- 172.21.15.103:0/2441659690 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f57bc07d620 con 0x7f57d4153a10 2024-09-10T08:43:53.171 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":120,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":31,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:43:53.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:53.173+0000 7f57d9482640 1 -- 172.21.15.103:0/2441659690 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f57b406be60 msgr2=0x7f57b406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:53.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:53.173+0000 7f57d9482640 1 --2- 172.21.15.103:0/2441659690 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f57b406be60 0x7f57b406e320 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f57c4009fd0 tx=0x7f57c400b040 comp rx=0 tx=0).stop 2024-09-10T08:43:53.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:53.173+0000 7f57d9482640 1 -- 172.21.15.103:0/2441659690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57d4153a10 msgr2=0x7f57d40acc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:53.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:53.173+0000 7f57d9482640 1 --2- 172.21.15.103:0/2441659690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57d4153a10 0x7f57d40acc10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f57bc031000 tx=0x7f57bc0046c0 comp rx=0 tx=0).stop 2024-09-10T08:43:53.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:53.173+0000 7f57d9482640 1 -- 172.21.15.103:0/2441659690 shutdown_connections 2024-09-10T08:43:53.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:53.173+0000 7f57d9482640 1 --2- 172.21.15.103:0/2441659690 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f57b406be60 0x7f57b406e320 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:53.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:53.173+0000 7f57d9482640 1 --2- 172.21.15.103:0/2441659690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57d40ad150 0x7f57d4148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:53.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:53.173+0000 7f57d9482640 1 --2- 172.21.15.103:0/2441659690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57d4153a10 0x7f57d40acc10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:53.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:53.173+0000 7f57d9482640 1 --2- 172.21.15.103:0/2441659690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57d40c8b10 0x7f57d41e14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:53.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:53.173+0000 7f57d9482640 1 -- 172.21.15.103:0/2441659690 >> 172.21.15.103:0/2441659690 conn(0x7f57d40adb80 msgr2=0x7f57d40ca1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:53.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:53.173+0000 7f57d9482640 1 -- 172.21.15.103:0/2441659690 shutdown_connections 2024-09-10T08:43:53.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:53.173+0000 7f57d9482640 1 -- 172.21.15.103:0/2441659690 wait complete. 2024-09-10T08:43:56.184 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:43:56.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.295+0000 7f7b3cb78640 1 Processor -- start 2024-09-10T08:43:56.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.295+0000 7f7b3cb78640 1 -- start start 2024-09-10T08:43:56.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.296+0000 7f7b3cb78640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7b38153b10 0x7f7b380a9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:56.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.296+0000 7f7b3cb78640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b38074590 0x7f7b3806cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:56.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.296+0000 7f7b3cb78640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b38156dd0 con 0x7f7b380a7de0 2024-09-10T08:43:56.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.296+0000 7f7b3cb78640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f7b38157350 con 0x7f7b38153b10 2024-09-10T08:43:56.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.296+0000 7f7b3cb78640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7b38159e50 con 0x7f7b38074590 2024-09-10T08:43:56.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.296+0000 7f7b36d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b38074590 0x7f7b3806cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:56.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.296+0000 7f7b3659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7b38153b10 0x7f7b380a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:56.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.296+0000 7f7b36d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b38074590 0x7f7b3806cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:49382/0 (socket says 172.21.15.103:49382) 2024-09-10T08:43:56.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.296+0000 7f7b36d9d640 1 -- 172.21.15.103:0/2535408797 learned_addr learned my addr 172.21.15.103:0/2535408797 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:56.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.296+0000 7f7b35d9b640 1 --1- 172.21.15.103:0/2535408797 >> v1:172.21.15.154:6789/0 conn(0x7f7b380a7de0 0x7f7b3815a2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:55234/0 (socket says 172.21.15.103:55234) 2024-09-10T08:43:56.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.297+0000 7f7b36d9d640 1 -- 172.21.15.103:0/2535408797 >> v2:172.21.15.154:3300/0 conn(0x7f7b38153b10 msgr2=0x7f7b380a9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:56.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.297+0000 7f7b36d9d640 1 --2- 172.21.15.103:0/2535408797 >> v2:172.21.15.154:3300/0 conn(0x7f7b38153b10 0x7f7b380a9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:56.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.297+0000 7f7b36d9d640 1 -- 172.21.15.103:0/2535408797 >> v1:172.21.15.154:6789/0 conn(0x7f7b380a7de0 legacy=0x7f7b3815a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:56.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.297+0000 7f7b36d9d640 1 -- 172.21.15.103:0/2535408797 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b38157070 con 0x7f7b38074590 2024-09-10T08:43:56.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.297+0000 7f7b3659c640 1 --2- 172.21.15.103:0/2535408797 >> v2:172.21.15.154:3300/0 conn(0x7f7b38153b10 0x7f7b380a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:43:56.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.297+0000 7f7b36d9d640 1 --2- 172.21.15.103:0/2535408797 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b38074590 0x7f7b3806cf40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009e50 tx=0x7f7b3002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55df55421b30c9c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:56.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.298+0000 7f7b3559a640 1 -- 172.21.15.103:0/2535408797 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b30036070 con 0x7f7b38074590 2024-09-10T08:43:56.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.298+0000 7f7b3559a640 1 -- 172.21.15.103:0/2535408797 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b30031600 con 0x7f7b38074590 2024-09-10T08:43:56.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.298+0000 7f7b3559a640 1 -- 172.21.15.103:0/2535408797 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b300319d0 con 0x7f7b38074590 2024-09-10T08:43:56.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.298+0000 7f7b3cb78640 1 -- 172.21.15.103:0/2535408797 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b38074590 msgr2=0x7f7b3806cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:56.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.298+0000 7f7b3cb78640 1 --2- 172.21.15.103:0/2535408797 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b38074590 0x7f7b3806cf40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009e50 tx=0x7f7b3002a710 comp rx=0 tx=0).stop 2024-09-10T08:43:56.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.298+0000 7f7b3cb78640 1 -- 172.21.15.103:0/2535408797 shutdown_connections 2024-09-10T08:43:56.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.298+0000 7f7b3cb78640 1 --2- 172.21.15.103:0/2535408797 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b38074590 0x7f7b3806cf40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:56.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.298+0000 7f7b3cb78640 1 --2- 172.21.15.103:0/2535408797 >> v2:172.21.15.154:3300/0 conn(0x7f7b38153b10 0x7f7b380a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:56.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.298+0000 7f7b3cb78640 1 -- 172.21.15.103:0/2535408797 >> 172.21.15.103:0/2535408797 conn(0x7f7b380c4fa0 msgr2=0x7f7b380c5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:56.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.298+0000 7f7b3cb78640 1 -- 172.21.15.103:0/2535408797 shutdown_connections 2024-09-10T08:43:56.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.298+0000 7f7b3cb78640 1 -- 172.21.15.103:0/2535408797 wait complete. 2024-09-10T08:43:56.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.300+0000 7f7b3cb78640 1 Processor -- start 2024-09-10T08:43:56.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.300+0000 7f7b3cb78640 1 -- start start 2024-09-10T08:43:56.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.300+0000 7f7b3cb78640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b38074590 0x7f7b38158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:56.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.300+0000 7f7b3cb78640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b380a7de0 0x7f7b381e1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:56.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.300+0000 7f7b3cb78640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b38153b10 0x7f7b381e2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:56.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.300+0000 7f7b3cb78640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7b38153ef0 con 0x7f7b38153b10 2024-09-10T08:43:56.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.300+0000 7f7b3cb78640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7b380a9c40 con 0x7f7b380a7de0 2024-09-10T08:43:56.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.300+0000 7f7b3cb78640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f7b3806db80 con 0x7f7b38074590 2024-09-10T08:43:56.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.300+0000 7f7b36d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b38153b10 0x7f7b381e2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:56.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.300+0000 7f7b36d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b38153b10 0x7f7b381e2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48436/0 (socket says 172.21.15.103:48436) 2024-09-10T08:43:56.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.300+0000 7f7b36d9d640 1 -- 172.21.15.103:0/3096877481 learned_addr learned my addr 172.21.15.103:0/3096877481 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:56.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.301+0000 7f7b36d9d640 1 -- 172.21.15.103:0/3096877481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b38153b10 msgr2=0x7f7b381e2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-10T08:43:56.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.301+0000 7f7b36d9d640 1 -- 172.21.15.103:0/3096877481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b38153b10 msgr2=0x7f7b381e2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:43:56.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.301+0000 7f7b36d9d640 1 --2- 172.21.15.103:0/3096877481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b38153b10 0x7f7b381e2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:43:56.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.301+0000 7f7b3659c640 1 --2- 172.21.15.103:0/3096877481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b38074590 0x7f7b38158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:56.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.301+0000 7f7b36d9d640 1 --2- 172.21.15.103:0/3096877481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b38153b10 0x7f7b381e2260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:43:56.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.301+0000 7f7b35d9b640 1 --2- 172.21.15.103:0/3096877481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b380a7de0 0x7f7b381e1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:56.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.301+0000 7f7b3659c640 1 -- 172.21.15.103:0/3096877481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b380a7de0 msgr2=0x7f7b381e1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:56.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.301+0000 7f7b3659c640 1 --2- 172.21.15.103:0/3096877481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b380a7de0 0x7f7b381e1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:56.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.301+0000 7f7b3659c640 1 -- 172.21.15.103:0/3096877481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b38153b10 msgr2=0x7f7b381e2260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:43:56.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.301+0000 7f7b3659c640 1 --2- 172.21.15.103:0/3096877481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b38153b10 0x7f7b381e2260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:56.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.301+0000 7f7b3659c640 1 -- 172.21.15.103:0/3096877481 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b38149840 con 0x7f7b38074590 2024-09-10T08:43:56.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.301+0000 7f7b3659c640 1 --2- 172.21.15.103:0/3096877481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b38074590 0x7f7b38158d30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7b2800e900 tx=0x7f7b2800edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:56.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.301+0000 7f7b26ffd640 1 -- 172.21.15.103:0/3096877481 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b28017070 con 0x7f7b38074590 2024-09-10T08:43:56.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.301+0000 7f7b26ffd640 1 -- 172.21.15.103:0/3096877481 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b2800ca00 con 0x7f7b38074590 2024-09-10T08:43:56.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.301+0000 7f7b3cb78640 1 -- 172.21.15.103:0/3096877481 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b38149fb0 con 0x7f7b38074590 2024-09-10T08:43:56.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.301+0000 7f7b26ffd640 1 -- 172.21.15.103:0/3096877481 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b2800cdf0 con 0x7f7b38074590 2024-09-10T08:43:56.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.301+0000 7f7b3cb78640 1 -- 172.21.15.103:0/3096877481 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b381ef750 con 0x7f7b38074590 2024-09-10T08:43:56.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.302+0000 7f7b3cb78640 1 -- 172.21.15.103:0/3096877481 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b380a9700 con 0x7f7b38074590 2024-09-10T08:43:56.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.303+0000 7f7b26ffd640 1 -- 172.21.15.103:0/3096877481 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b2801a070 con 0x7f7b38074590 2024-09-10T08:43:56.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.303+0000 7f7b26ffd640 1 --2- 172.21.15.103:0/3096877481 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7b1806be30 0x7f7b1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:56.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.304+0000 7f7b26ffd640 1 -- 172.21.15.103:0/3096877481 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f7b2808afc0 con 0x7f7b38074590 2024-09-10T08:43:56.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.304+0000 7f7b35d9b640 1 --2- 172.21.15.103:0/3096877481 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7b1806be30 0x7f7b1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:56.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.304+0000 7f7b35d9b640 1 --2- 172.21.15.103:0/3096877481 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7b1806be30 0x7f7b1806e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7b38149c60 tx=0x7f7b2c007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:56.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.308+0000 7f7b26ffd640 1 -- 172.21.15.103:0/3096877481 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b28058ff0 con 0x7f7b38074590 2024-09-10T08:43:56.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.538+0000 7f7b3cb78640 1 -- 172.21.15.103:0/3096877481 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7b38067bb0 con 0x7f7b38074590 2024-09-10T08:43:56.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.539+0000 7f7b26ffd640 1 -- 172.21.15.103:0/3096877481 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f7b2805d2f0 con 0x7f7b38074590 2024-09-10T08:43:56.539 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":120,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":35,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:43:56.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.541+0000 7f7b3cb78640 1 -- 172.21.15.103:0/3096877481 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7b1806be30 msgr2=0x7f7b1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:56.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.541+0000 7f7b3cb78640 1 --2- 172.21.15.103:0/3096877481 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7b1806be30 0x7f7b1806e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7b38149c60 tx=0x7f7b2c007e80 comp rx=0 tx=0).stop 2024-09-10T08:43:56.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.541+0000 7f7b3cb78640 1 -- 172.21.15.103:0/3096877481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b38074590 msgr2=0x7f7b38158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:56.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.541+0000 7f7b3cb78640 1 --2- 172.21.15.103:0/3096877481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b38074590 0x7f7b38158d30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7b2800e900 tx=0x7f7b2800edc0 comp rx=0 tx=0).stop 2024-09-10T08:43:56.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.541+0000 7f7b3cb78640 1 -- 172.21.15.103:0/3096877481 shutdown_connections 2024-09-10T08:43:56.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.541+0000 7f7b3cb78640 1 --2- 172.21.15.103:0/3096877481 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f7b1806be30 0x7f7b1806e2f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:56.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.541+0000 7f7b3cb78640 1 --2- 172.21.15.103:0/3096877481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b38153b10 0x7f7b381e2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:56.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.541+0000 7f7b3cb78640 1 --2- 172.21.15.103:0/3096877481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b380a7de0 0x7f7b381e1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:56.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.541+0000 7f7b3cb78640 1 --2- 172.21.15.103:0/3096877481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b38074590 0x7f7b38158d30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:56.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.541+0000 7f7b3cb78640 1 -- 172.21.15.103:0/3096877481 >> 172.21.15.103:0/3096877481 conn(0x7f7b380c4fa0 msgr2=0x7f7b3806d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:56.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.541+0000 7f7b3cb78640 1 -- 172.21.15.103:0/3096877481 shutdown_connections 2024-09-10T08:43:56.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:56.541+0000 7f7b3cb78640 1 -- 172.21.15.103:0/3096877481 wait complete. 2024-09-10T08:43:59.552 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:43:59.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.663+0000 7f65ad978640 1 Processor -- start 2024-09-10T08:43:59.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.663+0000 7f65ad978640 1 -- start start 2024-09-10T08:43:59.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.664+0000 7f65ad978640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f65a80c56e0 0x7f65a806ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:59.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.664+0000 7f65ad978640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f65a80c4c40 0x7f65a8153550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:59.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.664+0000 7f65ad978640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65a815a580 con 0x7f65a80708f0 2024-09-10T08:43:59.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.664+0000 7f65ad978640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f65a8159700 con 0x7f65a80c4c40 2024-09-10T08:43:59.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.664+0000 7f65ad978640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f65a806e5f0 con 0x7f65a80c56e0 2024-09-10T08:43:59.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.664+0000 7f65a77fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f65a80c4c40 0x7f65a8153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:59.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.664+0000 7f659ffff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f65a80708f0 0x7f65a8159e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:35266/0 (socket says 172.21.15.103:35266) 2024-09-10T08:43:59.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.664+0000 7f659ffff640 1 -- 172.21.15.103:0/1696435382 learned_addr learned my addr 172.21.15.103:0/1696435382 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:43:59.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.664+0000 7f65a77fe640 1 -- 172.21.15.103:0/1696435382 >> v2:172.21.15.103:3300/0 conn(0x7f65a80c4c40 msgr2=0x7f65a8153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:43:59.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.664+0000 7f65a77fe640 1 -- 172.21.15.103:0/1696435382 >> v2:172.21.15.103:3300/0 conn(0x7f65a80c4c40 msgr2=0x7f65a8153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:43:59.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.664+0000 7f65a77fe640 1 --2- 172.21.15.103:0/1696435382 >> v2:172.21.15.103:3300/0 conn(0x7f65a80c4c40 0x7f65a8153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:43:59.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.664+0000 7f65a77fe640 1 --2- 172.21.15.103:0/1696435382 >> v2:172.21.15.103:3300/0 conn(0x7f65a80c4c40 0x7f65a8153550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:43:59.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.664+0000 7f65a6ffd640 1 --2- 172.21.15.103:0/1696435382 >> v2:172.21.15.154:3300/0 conn(0x7f65a80c56e0 0x7f65a806ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:59.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.664+0000 7f65a6ffd640 1 -- 172.21.15.103:0/1696435382 >> v2:172.21.15.103:3300/0 conn(0x7f65a80c4c40 msgr2=0x7f65a8153550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:43:59.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.664+0000 7f65a6ffd640 1 --2- 172.21.15.103:0/1696435382 >> v2:172.21.15.103:3300/0 conn(0x7f65a80c4c40 0x7f65a8153550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:59.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.664+0000 7f65a6ffd640 1 -- 172.21.15.103:0/1696435382 >> v1:172.21.15.103:6789/0 conn(0x7f65a80708f0 legacy=0x7f65a8159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:59.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.664+0000 7f65a6ffd640 1 -- 172.21.15.103:0/1696435382 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a80702c0 con 0x7f65a80c56e0 2024-09-10T08:43:59.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.665+0000 7f65a6ffd640 1 --2- 172.21.15.103:0/1696435382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65a80c56e0 0x7f65a806ebe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f65a80c6850 tx=0x7f659802a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1e5b99c9a66141e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:59.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.665+0000 7f65a67fc640 1 -- 172.21.15.103:0/1696435382 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6598037070 con 0x7f65a80c56e0 2024-09-10T08:43:59.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.665+0000 7f65a67fc640 1 -- 172.21.15.103:0/1696435382 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f659802add0 con 0x7f65a80c56e0 2024-09-10T08:43:59.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.665+0000 7f65a67fc640 1 -- 172.21.15.103:0/1696435382 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6598032660 con 0x7f65a80c56e0 2024-09-10T08:43:59.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.666+0000 7f65ad978640 1 -- 172.21.15.103:0/1696435382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65a80c56e0 msgr2=0x7f65a806ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:59.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.666+0000 7f65ad978640 1 --2- 172.21.15.103:0/1696435382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65a80c56e0 0x7f65a806ebe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f65a80c6850 tx=0x7f659802a080 comp rx=0 tx=0).stop 2024-09-10T08:43:59.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.666+0000 7f65ad978640 1 -- 172.21.15.103:0/1696435382 shutdown_connections 2024-09-10T08:43:59.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.666+0000 7f65ad978640 1 --2- 172.21.15.103:0/1696435382 >> v2:172.21.15.103:3300/0 conn(0x7f65a80c4c40 0x7f65a8153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:59.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.666+0000 7f65ad978640 1 --2- 172.21.15.103:0/1696435382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65a80c56e0 0x7f65a806ebe0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:59.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.666+0000 7f65ad978640 1 -- 172.21.15.103:0/1696435382 >> 172.21.15.103:0/1696435382 conn(0x7f65a80c9d80 msgr2=0x7f65a80ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:59.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.666+0000 7f65ad978640 1 -- 172.21.15.103:0/1696435382 shutdown_connections 2024-09-10T08:43:59.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.666+0000 7f65ad978640 1 -- 172.21.15.103:0/1696435382 wait complete. 2024-09-10T08:43:59.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.667+0000 7f65ad978640 1 Processor -- start 2024-09-10T08:43:59.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.667+0000 7f65ad978640 1 -- start start 2024-09-10T08:43:59.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.668+0000 7f65ad978640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65a80708f0 0x7f65a8156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:59.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.668+0000 7f65ad978640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65a80c4c40 0x7f65a8150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:59.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.668+0000 7f65ad978640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65a80c56e0 0x7f65a80c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:59.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.668+0000 7f65ad978640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f65a806e2f0 con 0x7f65a80c56e0 2024-09-10T08:43:59.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.668+0000 7f65ad978640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65a8159950 con 0x7f65a80708f0 2024-09-10T08:43:59.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.668+0000 7f65ad978640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f65a80c5ac0 con 0x7f65a80c4c40 2024-09-10T08:43:59.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.668+0000 7f65a77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65a80c56e0 0x7f65a80c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:59.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.668+0000 7f65a77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65a80c56e0 0x7f65a80c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48452/0 (socket says 172.21.15.103:48452) 2024-09-10T08:43:59.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.668+0000 7f65a77fe640 1 -- 172.21.15.103:0/3529515980 learned_addr learned my addr 172.21.15.103:0/3529515980 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:43:59.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.668+0000 7f65a6ffd640 1 --2- 172.21.15.103:0/3529515980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65a80708f0 0x7f65a8156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:59.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.668+0000 7f659ffff640 1 --2- 172.21.15.103:0/3529515980 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65a80c4c40 0x7f65a8150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:59.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.668+0000 7f65a77fe640 1 -- 172.21.15.103:0/3529515980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65a80c56e0 msgr2=0x7f65a80c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-10T08:43:59.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.668+0000 7f65a77fe640 1 -- 172.21.15.103:0/3529515980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65a80c56e0 msgr2=0x7f65a80c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:43:59.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.668+0000 7f65a77fe640 1 --2- 172.21.15.103:0/3529515980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65a80c56e0 0x7f65a80c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:43:59.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.668+0000 7f65a77fe640 1 --2- 172.21.15.103:0/3529515980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65a80c56e0 0x7f65a80c8590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:43:59.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.669+0000 7f659ffff640 1 -- 172.21.15.103:0/3529515980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65a80708f0 msgr2=0x7f65a8156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.669+0000 7f659ffff640 1 --2- 172.21.15.103:0/3529515980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65a80708f0 0x7f65a8156510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.669+0000 7f659ffff640 1 -- 172.21.15.103:0/3529515980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65a80c56e0 msgr2=0x7f65a80c8590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:43:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.669+0000 7f659ffff640 1 --2- 172.21.15.103:0/3529515980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65a80c56e0 0x7f65a80c8590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.669+0000 7f659ffff640 1 -- 172.21.15.103:0/3529515980 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a8156a50 con 0x7f65a80c4c40 2024-09-10T08:43:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.669+0000 7f65a6ffd640 1 --2- 172.21.15.103:0/3529515980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65a80708f0 0x7f65a8156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:43:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.669+0000 7f659ffff640 1 --2- 172.21.15.103:0/3529515980 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65a80c4c40 0x7f65a8150480 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6590000f60 tx=0x7f659000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.669+0000 7f65a4ff9640 1 -- 172.21.15.103:0/3529515980 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590017070 con 0x7f65a80c4c40 2024-09-10T08:43:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.669+0000 7f65a4ff9640 1 -- 172.21.15.103:0/3529515980 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6590005ce0 con 0x7f65a80c4c40 2024-09-10T08:43:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.669+0000 7f65ad978640 1 -- 172.21.15.103:0/3529515980 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a8151680 con 0x7f65a80c4c40 2024-09-10T08:43:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.669+0000 7f65a4ff9640 1 -- 172.21.15.103:0/3529515980 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590007310 con 0x7f65a80c4c40 2024-09-10T08:43:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.669+0000 7f65ad978640 1 -- 172.21.15.103:0/3529515980 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a814e330 con 0x7f65a80c4c40 2024-09-10T08:43:59.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.670+0000 7f65ad978640 1 -- 172.21.15.103:0/3529515980 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a80695d0 con 0x7f65a80c4c40 2024-09-10T08:43:59.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.671+0000 7f65a4ff9640 1 -- 172.21.15.103:0/3529515980 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f659001a070 con 0x7f65a80c4c40 2024-09-10T08:43:59.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.671+0000 7f65a4ff9640 1 --2- 172.21.15.103:0/3529515980 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f658806be30 0x7f658806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:59.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.671+0000 7f65a6ffd640 1 --2- 172.21.15.103:0/3529515980 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f658806be30 0x7f658806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:59.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.671+0000 7f65a4ff9640 1 -- 172.21.15.103:0/3529515980 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f659008a440 con 0x7f65a80c4c40 2024-09-10T08:43:59.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.672+0000 7f65a6ffd640 1 --2- 172.21.15.103:0/3529515980 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f658806be30 0x7f658806e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6598034000 tx=0x7f659802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:59.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.676+0000 7f65a4ff9640 1 -- 172.21.15.103:0/3529515980 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f65a80695d0 con 0x7f65a80c4c40 2024-09-10T08:43:59.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.915+0000 7f65ad978640 1 -- 172.21.15.103:0/3529515980 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f65a806ebe0 con 0x7f65a80c4c40 2024-09-10T08:43:59.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.916+0000 7f65a4ff9640 1 -- 172.21.15.103:0/3529515980 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f65a8156a50 con 0x7f65a80c4c40 2024-09-10T08:43:59.915 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":120,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":38,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:43:59.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.918+0000 7f65ad978640 1 -- 172.21.15.103:0/3529515980 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f658806be30 msgr2=0x7f658806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:59.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.918+0000 7f65ad978640 1 --2- 172.21.15.103:0/3529515980 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f658806be30 0x7f658806e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6598034000 tx=0x7f659802e000 comp rx=0 tx=0).stop 2024-09-10T08:43:59.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.918+0000 7f65ad978640 1 -- 172.21.15.103:0/3529515980 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65a80c4c40 msgr2=0x7f65a8150480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:59.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.918+0000 7f65ad978640 1 --2- 172.21.15.103:0/3529515980 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65a80c4c40 0x7f65a8150480 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6590000f60 tx=0x7f659000c800 comp rx=0 tx=0).stop 2024-09-10T08:43:59.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.918+0000 7f65ad978640 1 -- 172.21.15.103:0/3529515980 shutdown_connections 2024-09-10T08:43:59.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.918+0000 7f65ad978640 1 --2- 172.21.15.103:0/3529515980 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f658806be30 0x7f658806e2f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:59.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.918+0000 7f65ad978640 1 --2- 172.21.15.103:0/3529515980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65a80c56e0 0x7f65a80c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:59.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.918+0000 7f65ad978640 1 --2- 172.21.15.103:0/3529515980 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65a80c4c40 0x7f65a8150480 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:59.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.918+0000 7f65ad978640 1 --2- 172.21.15.103:0/3529515980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65a80708f0 0x7f65a8156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:59.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.918+0000 7f65ad978640 1 -- 172.21.15.103:0/3529515980 >> 172.21.15.103:0/3529515980 conn(0x7f65a80c9d80 msgr2=0x7f65a806d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:59.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.918+0000 7f65ad978640 1 -- 172.21.15.103:0/3529515980 shutdown_connections 2024-09-10T08:43:59.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:43:59.918+0000 7f65ad978640 1 -- 172.21.15.103:0/3529515980 wait complete. 2024-09-10T08:44:02.930 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:44:03.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.041+0000 7fce23918640 1 Processor -- start 2024-09-10T08:44:03.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.041+0000 7fce23918640 1 -- start start 2024-09-10T08:44:03.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.042+0000 7fce23918640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fce1c0cc2d0 0x7fce1c15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:03.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.042+0000 7fce23918640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fce1c156d90 0x7fce1c157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:03.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.042+0000 7fce23918640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce1c06c5b0 con 0x7fce1c0c7a90 2024-09-10T08:44:03.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.042+0000 7fce23918640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fce1c06c890 con 0x7fce1c0cc2d0 2024-09-10T08:44:03.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.042+0000 7fce23918640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fce1c159900 con 0x7fce1c156d90 2024-09-10T08:44:03.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.042+0000 7fce216b4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fce1c0cc2d0 0x7fce1c15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:03.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.042+0000 7fce216b4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fce1c0cc2d0 0x7fce1c15a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48462/0 (socket says 172.21.15.103:48462) 2024-09-10T08:44:03.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.042+0000 7fce21eb5640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fce1c0c7a90 0x7fce1c0c8790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:35270/0 (socket says 172.21.15.103:35270) 2024-09-10T08:44:03.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.042+0000 7fce216b4640 1 -- 172.21.15.103:0/3570138540 learned_addr learned my addr 172.21.15.103:0/3570138540 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:03.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.042+0000 7fce216b4640 1 -- 172.21.15.103:0/3570138540 >> v2:172.21.15.103:3300/0 conn(0x7fce1c0cc2d0 msgr2=0x7fce1c15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:44:03.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.042+0000 7fce216b4640 1 -- 172.21.15.103:0/3570138540 >> v2:172.21.15.103:3300/0 conn(0x7fce1c0cc2d0 msgr2=0x7fce1c15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:44:03.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.042+0000 7fce216b4640 1 --2- 172.21.15.103:0/3570138540 >> v2:172.21.15.103:3300/0 conn(0x7fce1c0cc2d0 0x7fce1c15a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:44:03.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.042+0000 7fce20eb3640 1 --2- 172.21.15.103:0/3570138540 >> v2:172.21.15.154:3300/0 conn(0x7fce1c156d90 0x7fce1c157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:03.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.042+0000 7fce216b4640 1 --2- 172.21.15.103:0/3570138540 >> v2:172.21.15.103:3300/0 conn(0x7fce1c0cc2d0 0x7fce1c15a3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:44:03.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.043+0000 7fce20eb3640 1 -- 172.21.15.103:0/3570138540 >> v2:172.21.15.103:3300/0 conn(0x7fce1c0cc2d0 msgr2=0x7fce1c15a3e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:44:03.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.043+0000 7fce20eb3640 1 --2- 172.21.15.103:0/3570138540 >> v2:172.21.15.103:3300/0 conn(0x7fce1c0cc2d0 0x7fce1c15a3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:03.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.043+0000 7fce20eb3640 1 -- 172.21.15.103:0/3570138540 >> v1:172.21.15.103:6789/0 conn(0x7fce1c0c7a90 legacy=0x7fce1c0c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:03.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.043+0000 7fce20eb3640 1 -- 172.21.15.103:0/3570138540 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1c159be0 con 0x7fce1c156d90 2024-09-10T08:44:03.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.043+0000 7fce20eb3640 1 --2- 172.21.15.103:0/3570138540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce1c156d90 0x7fce1c157800 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fce1c14d370 tx=0x7fce0c02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5655e8f6eb41ef3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:03.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.044+0000 7fce13fff640 1 -- 172.21.15.103:0/3570138540 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c037070 con 0x7fce1c156d90 2024-09-10T08:44:03.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.044+0000 7fce13fff640 1 -- 172.21.15.103:0/3570138540 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce0c032440 con 0x7fce1c156d90 2024-09-10T08:44:03.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.044+0000 7fce13fff640 1 -- 172.21.15.103:0/3570138540 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c032810 con 0x7fce1c156d90 2024-09-10T08:44:03.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.044+0000 7fce23918640 1 -- 172.21.15.103:0/3570138540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce1c156d90 msgr2=0x7fce1c157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:03.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.044+0000 7fce23918640 1 --2- 172.21.15.103:0/3570138540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce1c156d90 0x7fce1c157800 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fce1c14d370 tx=0x7fce0c02a1a0 comp rx=0 tx=0).stop 2024-09-10T08:44:03.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.044+0000 7fce23918640 1 -- 172.21.15.103:0/3570138540 shutdown_connections 2024-09-10T08:44:03.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.044+0000 7fce23918640 1 --2- 172.21.15.103:0/3570138540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce1c156d90 0x7fce1c157800 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:03.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.044+0000 7fce23918640 1 --2- 172.21.15.103:0/3570138540 >> v2:172.21.15.103:3300/0 conn(0x7fce1c0cc2d0 0x7fce1c15a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:03.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.044+0000 7fce23918640 1 -- 172.21.15.103:0/3570138540 >> 172.21.15.103:0/3570138540 conn(0x7fce1c067fe0 msgr2=0x7fce1c073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:03.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.044+0000 7fce23918640 1 -- 172.21.15.103:0/3570138540 shutdown_connections 2024-09-10T08:44:03.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.044+0000 7fce23918640 1 -- 172.21.15.103:0/3570138540 wait complete. 2024-09-10T08:44:03.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.045+0000 7fce23918640 1 Processor -- start 2024-09-10T08:44:03.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.046+0000 7fce23918640 1 -- start start 2024-09-10T08:44:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.046+0000 7fce23918640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce1c0c7a90 0x7fce1c152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.046+0000 7fce23918640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce1c0cc2d0 0x7fce1c155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.046+0000 7fce23918640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce1c156d90 0x7fce1c1e1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.046+0000 7fce23918640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c06d2c0 con 0x7fce1c156d90 2024-09-10T08:44:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.046+0000 7fce23918640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c1571f0 con 0x7fce1c0cc2d0 2024-09-10T08:44:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.046+0000 7fce23918640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fce1c06c1d0 con 0x7fce1c0c7a90 2024-09-10T08:44:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.046+0000 7fce21eb5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce1c156d90 0x7fce1c1e1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.046+0000 7fce21eb5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce1c156d90 0x7fce1c1e1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48476/0 (socket says 172.21.15.103:48476) 2024-09-10T08:44:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.046+0000 7fce21eb5640 1 -- 172.21.15.103:0/1568396770 learned_addr learned my addr 172.21.15.103:0/1568396770 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.046+0000 7fce21eb5640 1 -- 172.21.15.103:0/1568396770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce1c156d90 msgr2=0x7fce1c1e1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-10T08:44:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.046+0000 7fce21eb5640 1 -- 172.21.15.103:0/1568396770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce1c156d90 msgr2=0x7fce1c1e1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:44:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.046+0000 7fce21eb5640 1 --2- 172.21.15.103:0/1568396770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce1c156d90 0x7fce1c1e1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:44:03.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.046+0000 7fce20eb3640 1 --2- 172.21.15.103:0/1568396770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce1c0cc2d0 0x7fce1c155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.046+0000 7fce21eb5640 1 --2- 172.21.15.103:0/1568396770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce1c156d90 0x7fce1c1e1470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:44:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.046+0000 7fce216b4640 1 --2- 172.21.15.103:0/1568396770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce1c0c7a90 0x7fce1c152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.047+0000 7fce20eb3640 1 -- 172.21.15.103:0/1568396770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce1c0c7a90 msgr2=0x7fce1c152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.047+0000 7fce20eb3640 1 --2- 172.21.15.103:0/1568396770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce1c0c7a90 0x7fce1c152970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.047+0000 7fce20eb3640 1 -- 172.21.15.103:0/1568396770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce1c156d90 msgr2=0x7fce1c1e1470 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:44:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.047+0000 7fce20eb3640 1 --2- 172.21.15.103:0/1568396770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce1c156d90 0x7fce1c1e1470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.047+0000 7fce20eb3640 1 -- 172.21.15.103:0/1568396770 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1c152690 con 0x7fce1c0cc2d0 2024-09-10T08:44:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.047+0000 7fce20eb3640 1 --2- 172.21.15.103:0/1568396770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce1c0cc2d0 0x7fce1c155440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fce1c159a80 tx=0x7fce0c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.047+0000 7fce11ffb640 1 -- 172.21.15.103:0/1568396770 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c037040 con 0x7fce1c0cc2d0 2024-09-10T08:44:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.047+0000 7fce11ffb640 1 -- 172.21.15.103:0/1568396770 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce0c030770 con 0x7fce1c0cc2d0 2024-09-10T08:44:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.047+0000 7fce11ffb640 1 -- 172.21.15.103:0/1568396770 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c030b80 con 0x7fce1c0cc2d0 2024-09-10T08:44:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.047+0000 7fce23918640 1 -- 172.21.15.103:0/1568396770 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce1c1eca90 con 0x7fce1c0cc2d0 2024-09-10T08:44:03.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.048+0000 7fce23918640 1 -- 172.21.15.103:0/1568396770 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce1c155980 con 0x7fce1c0cc2d0 2024-09-10T08:44:03.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.048+0000 7fce23918640 1 -- 172.21.15.103:0/1568396770 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce1c15a3e0 con 0x7fce1c0cc2d0 2024-09-10T08:44:03.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.049+0000 7fce11ffb640 1 -- 172.21.15.103:0/1568396770 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce0c044020 con 0x7fce1c0cc2d0 2024-09-10T08:44:03.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.050+0000 7fce11ffb640 1 --2- 172.21.15.103:0/1568396770 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fce0006be30 0x7fce0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:03.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.050+0000 7fce216b4640 1 --2- 172.21.15.103:0/1568396770 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fce0006be30 0x7fce0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:03.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.050+0000 7fce11ffb640 1 -- 172.21.15.103:0/1568396770 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fce0c0ab6a0 con 0x7fce1c0cc2d0 2024-09-10T08:44:03.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.050+0000 7fce216b4640 1 --2- 172.21.15.103:0/1568396770 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fce0006be30 0x7fce0006e2f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fce18009100 tx=0x7fce18008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:03.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.054+0000 7fce11ffb640 1 -- 172.21.15.103:0/1568396770 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce0c079c20 con 0x7fce1c0cc2d0 2024-09-10T08:44:03.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.284+0000 7fce23918640 1 -- 172.21.15.103:0/1568396770 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fce1c0b11f0 con 0x7fce1c0cc2d0 2024-09-10T08:44:03.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.285+0000 7fce11ffb640 1 -- 172.21.15.103:0/1568396770 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7fce0c079520 con 0x7fce1c0cc2d0 2024-09-10T08:44:03.285 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":120,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":41,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:44:03.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.287+0000 7fce23918640 1 -- 172.21.15.103:0/1568396770 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fce0006be30 msgr2=0x7fce0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:03.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.287+0000 7fce23918640 1 --2- 172.21.15.103:0/1568396770 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fce0006be30 0x7fce0006e2f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fce18009100 tx=0x7fce18008040 comp rx=0 tx=0).stop 2024-09-10T08:44:03.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.287+0000 7fce23918640 1 -- 172.21.15.103:0/1568396770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce1c0cc2d0 msgr2=0x7fce1c155440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:03.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.287+0000 7fce23918640 1 --2- 172.21.15.103:0/1568396770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce1c0cc2d0 0x7fce1c155440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fce1c159a80 tx=0x7fce0c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:44:03.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.287+0000 7fce23918640 1 -- 172.21.15.103:0/1568396770 shutdown_connections 2024-09-10T08:44:03.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.287+0000 7fce23918640 1 --2- 172.21.15.103:0/1568396770 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fce0006be30 0x7fce0006e2f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:03.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.287+0000 7fce23918640 1 --2- 172.21.15.103:0/1568396770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce1c156d90 0x7fce1c1e1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:03.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.287+0000 7fce23918640 1 --2- 172.21.15.103:0/1568396770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce1c0cc2d0 0x7fce1c155440 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:03.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.287+0000 7fce23918640 1 --2- 172.21.15.103:0/1568396770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce1c0c7a90 0x7fce1c152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:03.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.287+0000 7fce23918640 1 -- 172.21.15.103:0/1568396770 >> 172.21.15.103:0/1568396770 conn(0x7fce1c067fe0 msgr2=0x7fce1c0c9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:03.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.287+0000 7fce23918640 1 -- 172.21.15.103:0/1568396770 shutdown_connections 2024-09-10T08:44:03.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:03.287+0000 7fce23918640 1 -- 172.21.15.103:0/1568396770 wait complete. 2024-09-10T08:44:04.870 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:44:04.873 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:44:06.298 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:44:06.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.408+0000 7fa9feb26640 1 Processor -- start 2024-09-10T08:44:06.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.408+0000 7fa9feb26640 1 -- start start 2024-09-10T08:44:06.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.408+0000 7fa9feb26640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa9f80c69c0 0x7fa9f8153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:06.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.408+0000 7fa9feb26640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa9f80c42b0 0x7fa9f80c4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:06.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.408+0000 7fa9feb26640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f80c5940 con 0x7fa9f81505f0 2024-09-10T08:44:06.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.408+0000 7fa9feb26640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f80c7860 con 0x7fa9f80c69c0 2024-09-10T08:44:06.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.408+0000 7fa9feb26640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f80c5c00 con 0x7fa9f80c42b0 2024-09-10T08:44:06.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.409+0000 7fa9f7fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa9f80c69c0 0x7fa9f8153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:06.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.409+0000 7fa9f7fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa9f80c69c0 0x7fa9f8153910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47926/0 (socket says 172.21.15.103:47926) 2024-09-10T08:44:06.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.409+0000 7fa9f7fff640 1 -- 172.21.15.103:0/3870942931 learned_addr learned my addr 172.21.15.103:0/3870942931 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:06.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.409+0000 7fa9f7fff640 1 -- 172.21.15.103:0/3870942931 >> v2:172.21.15.103:3300/0 conn(0x7fa9f80c69c0 msgr2=0x7fa9f8153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:44:06.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.409+0000 7fa9f7fff640 1 -- 172.21.15.103:0/3870942931 >> v2:172.21.15.103:3300/0 conn(0x7fa9f80c69c0 msgr2=0x7fa9f8153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:44:06.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.409+0000 7fa9f7fff640 1 --2- 172.21.15.103:0/3870942931 >> v2:172.21.15.103:3300/0 conn(0x7fa9f80c69c0 0x7fa9f8153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:44:06.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.409+0000 7fa9f7fff640 1 --2- 172.21.15.103:0/3870942931 >> v2:172.21.15.103:3300/0 conn(0x7fa9f80c69c0 0x7fa9f8153910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:44:06.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.409+0000 7fa9fd0c3640 1 --2- 172.21.15.103:0/3870942931 >> v2:172.21.15.154:3300/0 conn(0x7fa9f80c42b0 0x7fa9f80c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:06.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.409+0000 7fa9fd0c3640 1 -- 172.21.15.103:0/3870942931 >> v2:172.21.15.103:3300/0 conn(0x7fa9f80c69c0 msgr2=0x7fa9f8153910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:44:06.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.409+0000 7fa9fd0c3640 1 --2- 172.21.15.103:0/3870942931 >> v2:172.21.15.103:3300/0 conn(0x7fa9f80c69c0 0x7fa9f8153910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:06.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.409+0000 7fa9fd0c3640 1 -- 172.21.15.103:0/3870942931 >> v1:172.21.15.154:6789/0 conn(0x7fa9f81505f0 legacy=0x7fa9f80c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:06.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.409+0000 7fa9fd0c3640 1 -- 172.21.15.103:0/3870942931 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f80c5ee0 con 0x7fa9f80c42b0 2024-09-10T08:44:06.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.409+0000 7fa9f77fe640 1 -- 172.21.15.103:0/3870942931 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3364794787 0 0) 0x7fa9f80c5940 con 0x7fa9f81505f0 2024-09-10T08:44:06.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.410+0000 7fa9fd0c3640 1 --2- 172.21.15.103:0/3870942931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9f80c42b0 0x7fa9f80c4700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa9f80ab190 tx=0x7fa9f002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29e112cf47b00b17 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:06.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.410+0000 7fa9f77fe640 1 -- 172.21.15.103:0/3870942931 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0007740 con 0x7fa9f80c42b0 2024-09-10T08:44:06.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.410+0000 7fa9f77fe640 1 -- 172.21.15.103:0/3870942931 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f00078e0 con 0x7fa9f80c42b0 2024-09-10T08:44:06.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.410+0000 7fa9f77fe640 1 -- 172.21.15.103:0/3870942931 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0007cb0 con 0x7fa9f80c42b0 2024-09-10T08:44:06.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.411+0000 7fa9feb26640 1 -- 172.21.15.103:0/3870942931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9f80c42b0 msgr2=0x7fa9f80c4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:06.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.411+0000 7fa9feb26640 1 --2- 172.21.15.103:0/3870942931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9f80c42b0 0x7fa9f80c4700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa9f80ab190 tx=0x7fa9f002a5f0 comp rx=0 tx=0).stop 2024-09-10T08:44:06.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.411+0000 7fa9feb26640 1 -- 172.21.15.103:0/3870942931 shutdown_connections 2024-09-10T08:44:06.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.411+0000 7fa9feb26640 1 --2- 172.21.15.103:0/3870942931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9f80c42b0 0x7fa9f80c4700 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:06.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.411+0000 7fa9feb26640 1 --2- 172.21.15.103:0/3870942931 >> v2:172.21.15.103:3300/0 conn(0x7fa9f80c69c0 0x7fa9f8153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:06.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.411+0000 7fa9feb26640 1 -- 172.21.15.103:0/3870942931 >> 172.21.15.103:0/3870942931 conn(0x7fa9f80c7a40 msgr2=0x7fa9f80c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:06.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.411+0000 7fa9feb26640 1 -- 172.21.15.103:0/3870942931 shutdown_connections 2024-09-10T08:44:06.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.411+0000 7fa9feb26640 1 -- 172.21.15.103:0/3870942931 wait complete. 2024-09-10T08:44:06.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.412+0000 7fa9feb26640 1 Processor -- start 2024-09-10T08:44:06.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.412+0000 7fa9feb26640 1 -- start start 2024-09-10T08:44:06.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.413+0000 7fa9feb26640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9f80c42b0 0x7fa9f81514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:06.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.413+0000 7fa9feb26640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9f81505f0 0x7fa9f80c10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:06.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.413+0000 7fa9feb26640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9f80aca10 0x7fa9f81ef230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:06.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.413+0000 7fa9feb26640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f81509d0 con 0x7fa9f80aca10 2024-09-10T08:44:06.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.413+0000 7fa9feb26640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f80c64a0 con 0x7fa9f81505f0 2024-09-10T08:44:06.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.413+0000 7fa9feb26640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f8150b50 con 0x7fa9f80c42b0 2024-09-10T08:44:06.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.413+0000 7fa9fd0c3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9f80aca10 0x7fa9f81ef230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:06.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.413+0000 7fa9fd0c3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9f80aca10 0x7fa9f81ef230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47934/0 (socket says 172.21.15.103:47934) 2024-09-10T08:44:06.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.413+0000 7fa9fd0c3640 1 -- 172.21.15.103:0/3193643448 learned_addr learned my addr 172.21.15.103:0/3193643448 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:06.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.413+0000 7fa9f7fff640 1 --2- 172.21.15.103:0/3193643448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9f81505f0 0x7fa9f80c10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:06.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.413+0000 7fa9fd0c3640 1 -- 172.21.15.103:0/3193643448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9f80aca10 msgr2=0x7fa9f81ef230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-10T08:44:06.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.413+0000 7fa9fd0c3640 1 -- 172.21.15.103:0/3193643448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9f80aca10 msgr2=0x7fa9f81ef230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:44:06.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.413+0000 7fa9fd0c3640 1 --2- 172.21.15.103:0/3193643448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9f80aca10 0x7fa9f81ef230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:44:06.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.413+0000 7fa9fd0c3640 1 --2- 172.21.15.103:0/3193643448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9f80aca10 0x7fa9f81ef230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:44:06.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.413+0000 7fa9fc8c2640 1 --2- 172.21.15.103:0/3193643448 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9f80c42b0 0x7fa9f81514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:06.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.413+0000 7fa9f7fff640 1 -- 172.21.15.103:0/3193643448 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9f80c42b0 msgr2=0x7fa9f81514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:06.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.413+0000 7fa9f7fff640 1 --2- 172.21.15.103:0/3193643448 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9f80c42b0 0x7fa9f81514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:06.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.413+0000 7fa9f7fff640 1 -- 172.21.15.103:0/3193643448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9f80aca10 msgr2=0x7fa9f81ef230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:44:06.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.413+0000 7fa9f7fff640 1 --2- 172.21.15.103:0/3193643448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9f80aca10 0x7fa9f81ef230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:06.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.413+0000 7fa9f7fff640 1 -- 172.21.15.103:0/3193643448 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f80ad580 con 0x7fa9f81505f0 2024-09-10T08:44:06.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.414+0000 7fa9f7fff640 1 --2- 172.21.15.103:0/3193643448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9f81505f0 0x7fa9f80c10e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000e810 tx=0x7fa9e000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:06.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.414+0000 7fa9f57fa640 1 -- 172.21.15.103:0/3193643448 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0017070 con 0x7fa9f81505f0 2024-09-10T08:44:06.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.414+0000 7fa9f57fa640 1 -- 172.21.15.103:0/3193643448 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e0004020 con 0x7fa9f81505f0 2024-09-10T08:44:06.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.414+0000 7fa9feb26640 1 -- 172.21.15.103:0/3193643448 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9f80ad860 con 0x7fa9f81505f0 2024-09-10T08:44:06.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.414+0000 7fa9f57fa640 1 -- 172.21.15.103:0/3193643448 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e000f040 con 0x7fa9f81505f0 2024-09-10T08:44:06.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.414+0000 7fa9feb26640 1 -- 172.21.15.103:0/3193643448 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9f80c1620 con 0x7fa9f81505f0 2024-09-10T08:44:06.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.415+0000 7fa9feb26640 1 -- 172.21.15.103:0/3193643448 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9f8150d00 con 0x7fa9f81505f0 2024-09-10T08:44:06.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.415+0000 7fa9f57fa640 1 -- 172.21.15.103:0/3193643448 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa9e000c6d0 con 0x7fa9f81505f0 2024-09-10T08:44:06.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.416+0000 7fa9f57fa640 1 --2- 172.21.15.103:0/3193643448 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa9d806be60 0x7fa9d806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:06.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.416+0000 7fa9f57fa640 1 -- 172.21.15.103:0/3193643448 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fa9e008aba0 con 0x7fa9f81505f0 2024-09-10T08:44:06.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.416+0000 7fa9fc8c2640 1 --2- 172.21.15.103:0/3193643448 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa9d806be60 0x7fa9d806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:06.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.416+0000 7fa9fc8c2640 1 --2- 172.21.15.103:0/3193643448 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa9d806be60 0x7fa9d806e320 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8000f60 tx=0x7fa9e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:06.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.421+0000 7fa9f57fa640 1 -- 172.21.15.103:0/3193643448 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa9e0058bf0 con 0x7fa9f81505f0 2024-09-10T08:44:06.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.649+0000 7fa9feb26640 1 -- 172.21.15.103:0/3193643448 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa9f8153910 con 0x7fa9f81505f0 2024-09-10T08:44:06.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.650+0000 7fa9f57fa640 1 -- 172.21.15.103:0/3193643448 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7fa9e005cef0 con 0x7fa9f81505f0 2024-09-10T08:44:06.651 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":120,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":45,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:44:06.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.652+0000 7fa9feb26640 1 -- 172.21.15.103:0/3193643448 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa9d806be60 msgr2=0x7fa9d806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:06.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.652+0000 7fa9feb26640 1 --2- 172.21.15.103:0/3193643448 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa9d806be60 0x7fa9d806e320 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8000f60 tx=0x7fa9e8009040 comp rx=0 tx=0).stop 2024-09-10T08:44:06.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.652+0000 7fa9feb26640 1 -- 172.21.15.103:0/3193643448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9f81505f0 msgr2=0x7fa9f80c10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:06.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.652+0000 7fa9feb26640 1 --2- 172.21.15.103:0/3193643448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9f81505f0 0x7fa9f80c10e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000e810 tx=0x7fa9e000ecd0 comp rx=0 tx=0).stop 2024-09-10T08:44:06.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.652+0000 7fa9feb26640 1 -- 172.21.15.103:0/3193643448 shutdown_connections 2024-09-10T08:44:06.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.652+0000 7fa9feb26640 1 --2- 172.21.15.103:0/3193643448 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa9d806be60 0x7fa9d806e320 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:06.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.652+0000 7fa9feb26640 1 --2- 172.21.15.103:0/3193643448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9f80aca10 0x7fa9f81ef230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:06.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.652+0000 7fa9feb26640 1 --2- 172.21.15.103:0/3193643448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9f81505f0 0x7fa9f80c10e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:06.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.652+0000 7fa9feb26640 1 --2- 172.21.15.103:0/3193643448 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9f80c42b0 0x7fa9f81514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:06.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.652+0000 7fa9feb26640 1 -- 172.21.15.103:0/3193643448 >> 172.21.15.103:0/3193643448 conn(0x7fa9f80c7a40 msgr2=0x7fa9f80c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:06.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.652+0000 7fa9feb26640 1 -- 172.21.15.103:0/3193643448 shutdown_connections 2024-09-10T08:44:06.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:06.652+0000 7fa9feb26640 1 -- 172.21.15.103:0/3193643448 wait complete. 2024-09-10T08:44:09.664 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:44:09.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.774+0000 7fc0fad9f640 1 Processor -- start 2024-09-10T08:44:09.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.774+0000 7fc0fad9f640 1 -- start start 2024-09-10T08:44:09.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.775+0000 7fc0fad9f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0f40caa80 0x7fc0f40cae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:09.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.775+0000 7fc0fad9f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc0f406c8c0 0x7fc0f40cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:09.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.775+0000 7fc0fad9f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0f4156cd0 con 0x7fc0f406d550 2024-09-10T08:44:09.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.775+0000 7fc0fad9f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc0f4159dc0 con 0x7fc0f406c8c0 2024-09-10T08:44:09.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.775+0000 7fc0fad9f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc0f4159770 con 0x7fc0f40caa80 2024-09-10T08:44:09.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.775+0000 7fc0f959c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc0f406c8c0 0x7fc0f40cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:09.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.775+0000 7fc0f9d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0f40caa80 0x7fc0f40cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:09.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.775+0000 7fc0f959c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc0f406c8c0 0x7fc0f40cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:41580/0 (socket says 172.21.15.103:41580) 2024-09-10T08:44:09.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.775+0000 7fc0f959c640 1 -- 172.21.15.103:0/614016662 learned_addr learned my addr 172.21.15.103:0/614016662 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:09.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.775+0000 7fc0f9d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0f40caa80 0x7fc0f40cae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:33664/0 (socket says 172.21.15.103:33664) 2024-09-10T08:44:09.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.776+0000 7fc0f959c640 1 -- 172.21.15.103:0/614016662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0f40caa80 msgr2=0x7fc0f40cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:09.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.776+0000 7fc0f959c640 1 --2- 172.21.15.103:0/614016662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0f40caa80 0x7fc0f40cae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:09.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.776+0000 7fc0f959c640 1 -- 172.21.15.103:0/614016662 >> v1:172.21.15.154:6789/0 conn(0x7fc0f406d550 legacy=0x7fc0f40c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:09.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.776+0000 7fc0f959c640 1 -- 172.21.15.103:0/614016662 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f4159a50 con 0x7fc0f406c8c0 2024-09-10T08:44:09.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.776+0000 7fc0f9d9d640 1 --2- 172.21.15.103:0/614016662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0f40caa80 0x7fc0f40cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:44:09.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.777+0000 7fc0f959c640 1 --2- 172.21.15.103:0/614016662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f406c8c0 0x7fc0f40cba60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009870 tx=0x7fc0e402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acfe46411f76506d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:09.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.777+0000 7fc0f8d9b640 1 -- 172.21.15.103:0/614016662 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4037070 con 0x7fc0f406c8c0 2024-09-10T08:44:09.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.777+0000 7fc0f8d9b640 1 -- 172.21.15.103:0/614016662 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0e4032440 con 0x7fc0f406c8c0 2024-09-10T08:44:09.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.777+0000 7fc0f8d9b640 1 -- 172.21.15.103:0/614016662 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4032810 con 0x7fc0f406c8c0 2024-09-10T08:44:09.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.777+0000 7fc0fad9f640 1 -- 172.21.15.103:0/614016662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f406c8c0 msgr2=0x7fc0f40cba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:09.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.777+0000 7fc0fad9f640 1 --2- 172.21.15.103:0/614016662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f406c8c0 0x7fc0f40cba60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009870 tx=0x7fc0e402a270 comp rx=0 tx=0).stop 2024-09-10T08:44:09.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.777+0000 7fc0fad9f640 1 -- 172.21.15.103:0/614016662 shutdown_connections 2024-09-10T08:44:09.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.777+0000 7fc0fad9f640 1 --2- 172.21.15.103:0/614016662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f406c8c0 0x7fc0f40cba60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:09.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.777+0000 7fc0fad9f640 1 --2- 172.21.15.103:0/614016662 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0f40caa80 0x7fc0f40cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:09.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.777+0000 7fc0fad9f640 1 -- 172.21.15.103:0/614016662 >> 172.21.15.103:0/614016662 conn(0x7fc0f4073310 msgr2=0x7fc0f40736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:09.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.777+0000 7fc0fad9f640 1 -- 172.21.15.103:0/614016662 shutdown_connections 2024-09-10T08:44:09.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.777+0000 7fc0fad9f640 1 -- 172.21.15.103:0/614016662 wait complete. 2024-09-10T08:44:09.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.779+0000 7fc0fad9f640 1 Processor -- start 2024-09-10T08:44:09.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.779+0000 7fc0fad9f640 1 -- start start 2024-09-10T08:44:09.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.779+0000 7fc0fad9f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0f406c8c0 0x7fc0f40c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:09.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.779+0000 7fc0fad9f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0f406d550 0x7fc0f41ed450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:09.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.779+0000 7fc0fad9f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f40caa80 0x7fc0f41ed990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:09.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.779+0000 7fc0fad9f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f40c8e90 con 0x7fc0f406d550 2024-09-10T08:44:09.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.779+0000 7fc0fad9f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f40c8d10 con 0x7fc0f40caa80 2024-09-10T08:44:09.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.779+0000 7fc0fad9f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc0f415a250 con 0x7fc0f406c8c0 2024-09-10T08:44:09.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.779+0000 7fc0f959c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0f406d550 0x7fc0f41ed450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:09.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.780+0000 7fc0f959c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0f406d550 0x7fc0f41ed450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47950/0 (socket says 172.21.15.103:47950) 2024-09-10T08:44:09.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.780+0000 7fc0f959c640 1 -- 172.21.15.103:0/1982515922 learned_addr learned my addr 172.21.15.103:0/1982515922 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:09.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.780+0000 7fc0f9d9d640 1 --2- 172.21.15.103:0/1982515922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0f406c8c0 0x7fc0f40c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:09.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.780+0000 7fc0fa59e640 1 --2- 172.21.15.103:0/1982515922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f40caa80 0x7fc0f41ed990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:09.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.780+0000 7fc0f959c640 1 -- 172.21.15.103:0/1982515922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0f406c8c0 msgr2=0x7fc0f40c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:09.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.780+0000 7fc0f959c640 1 --2- 172.21.15.103:0/1982515922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0f406c8c0 0x7fc0f40c7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:09.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.780+0000 7fc0f959c640 1 -- 172.21.15.103:0/1982515922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f40caa80 msgr2=0x7fc0f41ed990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:09.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.780+0000 7fc0f959c640 1 --2- 172.21.15.103:0/1982515922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f40caa80 0x7fc0f41ed990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:09.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.780+0000 7fc0f959c640 1 -- 172.21.15.103:0/1982515922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f4150f20 con 0x7fc0f406d550 2024-09-10T08:44:09.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.780+0000 7fc0f959c640 1 --2- 172.21.15.103:0/1982515922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0f406d550 0x7fc0f41ed450 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4000c00 tx=0x7fc0e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:09.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.780+0000 7fc0ea7fc640 1 -- 172.21.15.103:0/1982515922 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4037040 con 0x7fc0f406d550 2024-09-10T08:44:09.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.780+0000 7fc0ea7fc640 1 -- 172.21.15.103:0/1982515922 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0e4042070 con 0x7fc0f406d550 2024-09-10T08:44:09.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.780+0000 7fc0fad9f640 1 -- 172.21.15.103:0/1982515922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0f41524f0 con 0x7fc0f406d550 2024-09-10T08:44:09.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.780+0000 7fc0ea7fc640 1 -- 172.21.15.103:0/1982515922 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4030880 con 0x7fc0f406d550 2024-09-10T08:44:09.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.780+0000 7fc0fad9f640 1 -- 172.21.15.103:0/1982515922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0f4153700 con 0x7fc0f406d550 2024-09-10T08:44:09.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.781+0000 7fc0fad9f640 1 -- 172.21.15.103:0/1982515922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0f40cae60 con 0x7fc0f406d550 2024-09-10T08:44:09.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.782+0000 7fc0ea7fc640 1 -- 172.21.15.103:0/1982515922 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc0e4030a20 con 0x7fc0f406d550 2024-09-10T08:44:09.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.782+0000 7fc0ea7fc640 1 --2- 172.21.15.103:0/1982515922 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc0d806be30 0x7fc0d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:09.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.782+0000 7fc0ea7fc640 1 -- 172.21.15.103:0/1982515922 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fc0e40ab850 con 0x7fc0f406d550 2024-09-10T08:44:09.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.782+0000 7fc0f9d9d640 1 --2- 172.21.15.103:0/1982515922 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc0d806be30 0x7fc0d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:09.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.783+0000 7fc0f9d9d640 1 --2- 172.21.15.103:0/1982515922 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc0d806be30 0x7fc0d806e2f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009560 tx=0x7fc0f0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:09.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:09.787+0000 7fc0ea7fc640 1 -- 172.21.15.103:0/1982515922 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc0e40798a0 con 0x7fc0f406d550 2024-09-10T08:44:10.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.017+0000 7fc0fad9f640 1 -- 172.21.15.103:0/1982515922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc0f406c6a0 con 0x7fc0f406d550 2024-09-10T08:44:10.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.017+0000 7fc0ea7fc640 1 -- 172.21.15.103:0/1982515922 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fc0e407dba0 con 0x7fc0f406d550 2024-09-10T08:44:10.017 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":124,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:44:10.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.019+0000 7fc0fad9f640 1 -- 172.21.15.103:0/1982515922 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc0d806be30 msgr2=0x7fc0d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.019+0000 7fc0fad9f640 1 --2- 172.21.15.103:0/1982515922 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc0d806be30 0x7fc0d806e2f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009560 tx=0x7fc0f0009190 comp rx=0 tx=0).stop 2024-09-10T08:44:10.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.019+0000 7fc0fad9f640 1 -- 172.21.15.103:0/1982515922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0f406d550 msgr2=0x7fc0f41ed450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.019+0000 7fc0fad9f640 1 --2- 172.21.15.103:0/1982515922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0f406d550 0x7fc0f41ed450 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4000c00 tx=0x7fc0e40046c0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.020+0000 7fc0fad9f640 1 -- 172.21.15.103:0/1982515922 shutdown_connections 2024-09-10T08:44:10.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.020+0000 7fc0fad9f640 1 --2- 172.21.15.103:0/1982515922 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc0d806be30 0x7fc0d806e2f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.020+0000 7fc0fad9f640 1 --2- 172.21.15.103:0/1982515922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0f40caa80 0x7fc0f41ed990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.020+0000 7fc0fad9f640 1 --2- 172.21.15.103:0/1982515922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0f406d550 0x7fc0f41ed450 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.020+0000 7fc0fad9f640 1 --2- 172.21.15.103:0/1982515922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0f406c8c0 0x7fc0f40c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.020+0000 7fc0fad9f640 1 -- 172.21.15.103:0/1982515922 >> 172.21.15.103:0/1982515922 conn(0x7fc0f4073310 msgr2=0x7fc0f406ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:10.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.020+0000 7fc0fad9f640 1 -- 172.21.15.103:0/1982515922 shutdown_connections 2024-09-10T08:44:10.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.020+0000 7fc0fad9f640 1 -- 172.21.15.103:0/1982515922 wait complete. 2024-09-10T08:44:10.031 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:44:10.031 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-10T08:44:10.031 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T08:44:10.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.129+0000 7f6aac6d7640 1 Processor -- start 2024-09-10T08:44:10.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.129+0000 7f6aac6d7640 1 -- start start 2024-09-10T08:44:10.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.130+0000 7f6aac6d7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6aa4151840 0x7f6aa40ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.130+0000 7f6aac6d7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6aa40ad340 0x7f6aa40c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.130+0000 7f6aac6d7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6aa4154330 con 0x7f6aa40c3830 2024-09-10T08:44:10.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.130+0000 7f6aac6d7640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f6aa41550f0 con 0x7f6aa40ad340 2024-09-10T08:44:10.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.130+0000 7f6aac6d7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f6aa4154610 con 0x7f6aa4151840 2024-09-10T08:44:10.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.130+0000 7f6aa9c72640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6aa40ad340 0x7f6aa40c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.130+0000 7f6aa9c72640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6aa40ad340 0x7f6aa40c32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47952/0 (socket says 172.21.15.103:47952) 2024-09-10T08:44:10.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.130+0000 7f6aa9c72640 1 -- 172.21.15.103:0/1982911574 learned_addr learned my addr 172.21.15.103:0/1982911574 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:10.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.130+0000 7f6aa9c72640 1 -- 172.21.15.103:0/1982911574 >> v2:172.21.15.154:3300/0 conn(0x7f6aa4151840 msgr2=0x7f6aa40ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:10.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.130+0000 7f6aa9c72640 1 --2- 172.21.15.103:0/1982911574 >> v2:172.21.15.154:3300/0 conn(0x7f6aa4151840 0x7f6aa40ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.130+0000 7f6aa9c72640 1 -- 172.21.15.103:0/1982911574 >> v1:172.21.15.154:6789/0 conn(0x7f6aa40c3830 legacy=0x7f6aa40c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:10.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.130+0000 7f6aa9c72640 1 -- 172.21.15.103:0/1982911574 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa41548f0 con 0x7f6aa40ad340 2024-09-10T08:44:10.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.131+0000 7f6aa9c72640 1 --2- 172.21.15.103:0/1982911574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa40ad340 0x7f6aa40c32f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40c8810 tx=0x7f6a9802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f357eefa56d4c1b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:10.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.131+0000 7f6aa9471640 1 -- 172.21.15.103:0/1982911574 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a98037070 con 0x7f6aa40ad340 2024-09-10T08:44:10.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.131+0000 7f6aa9471640 1 -- 172.21.15.103:0/1982911574 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a98032440 con 0x7f6aa40ad340 2024-09-10T08:44:10.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.131+0000 7f6aa9471640 1 -- 172.21.15.103:0/1982911574 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a98032810 con 0x7f6aa40ad340 2024-09-10T08:44:10.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.132+0000 7f6aac6d7640 1 -- 172.21.15.103:0/1982911574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa40ad340 msgr2=0x7f6aa40c32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.132+0000 7f6aac6d7640 1 --2- 172.21.15.103:0/1982911574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa40ad340 0x7f6aa40c32f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40c8810 tx=0x7f6a9802a230 comp rx=0 tx=0).stop 2024-09-10T08:44:10.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.132+0000 7f6aac6d7640 1 -- 172.21.15.103:0/1982911574 shutdown_connections 2024-09-10T08:44:10.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.132+0000 7f6aac6d7640 1 --2- 172.21.15.103:0/1982911574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa40ad340 0x7f6aa40c32f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.132+0000 7f6aac6d7640 1 --2- 172.21.15.103:0/1982911574 >> v2:172.21.15.154:3300/0 conn(0x7f6aa4151840 0x7f6aa40ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.132+0000 7f6aac6d7640 1 -- 172.21.15.103:0/1982911574 >> 172.21.15.103:0/1982911574 conn(0x7f6aa40c7a40 msgr2=0x7f6aa40c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:10.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.132+0000 7f6aac6d7640 1 -- 172.21.15.103:0/1982911574 shutdown_connections 2024-09-10T08:44:10.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.132+0000 7f6aac6d7640 1 -- 172.21.15.103:0/1982911574 wait complete. 2024-09-10T08:44:10.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.133+0000 7f6aac6d7640 1 Processor -- start 2024-09-10T08:44:10.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.133+0000 7f6aac6d7640 1 -- start start 2024-09-10T08:44:10.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aac6d7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6aa40ad340 0x7f6aa41dd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aac6d7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa40c3830 0x7f6aa414ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aac6d7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6aa4151840 0x7f6aa4147db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aac6d7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa406e030 con 0x7f6aa40c3830 2024-09-10T08:44:10.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aac6d7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa406dda0 con 0x7f6aa4151840 2024-09-10T08:44:10.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aac6d7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6aa406e1b0 con 0x7f6aa40ad340 2024-09-10T08:44:10.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aa9c72640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa40c3830 0x7f6aa414ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aa9c72640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa40c3830 0x7f6aa414ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47964/0 (socket says 172.21.15.103:47964) 2024-09-10T08:44:10.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aa9c72640 1 -- 172.21.15.103:0/1393201439 learned_addr learned my addr 172.21.15.103:0/1393201439 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:10.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aaac74640 1 --2- 172.21.15.103:0/1393201439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6aa4151840 0x7f6aa4147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aaa473640 1 --2- 172.21.15.103:0/1393201439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6aa40ad340 0x7f6aa41dd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aa9c72640 1 -- 172.21.15.103:0/1393201439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6aa40ad340 msgr2=0x7f6aa41dd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aa9c72640 1 --2- 172.21.15.103:0/1393201439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6aa40ad340 0x7f6aa41dd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aa9c72640 1 -- 172.21.15.103:0/1393201439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6aa4151840 msgr2=0x7f6aa4147db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aa9c72640 1 --2- 172.21.15.103:0/1393201439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6aa4151840 0x7f6aa4147db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aa9c72640 1 -- 172.21.15.103:0/1393201439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa41e0110 con 0x7f6aa40c3830 2024-09-10T08:44:10.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aaac74640 1 --2- 172.21.15.103:0/1393201439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6aa4151840 0x7f6aa4147db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:44:10.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aaa473640 1 --2- 172.21.15.103:0/1393201439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6aa40ad340 0x7f6aa41dd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:44:10.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aa9c72640 1 --2- 172.21.15.103:0/1393201439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa40c3830 0x7f6aa414ec30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6a98000c00 tx=0x7f6a980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:10.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aa2ffd640 1 -- 172.21.15.103:0/1393201439 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a98041070 con 0x7f6aa40c3830 2024-09-10T08:44:10.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aa2ffd640 1 -- 172.21.15.103:0/1393201439 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a9803c870 con 0x7f6aa40c3830 2024-09-10T08:44:10.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aa2ffd640 1 -- 172.21.15.103:0/1393201439 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a98037040 con 0x7f6aa40c3830 2024-09-10T08:44:10.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aac6d7640 1 -- 172.21.15.103:0/1393201439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aa41540c0 con 0x7f6aa40c3830 2024-09-10T08:44:10.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.134+0000 7f6aac6d7640 1 -- 172.21.15.103:0/1393201439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aa414ad50 con 0x7f6aa40c3830 2024-09-10T08:44:10.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.135+0000 7f6aac6d7640 1 --2- 172.21.15.103:0/1393201439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa414f170 0x7f6aa41482f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.135+0000 7f6aac6d7640 1 -- 172.21.15.103:0/1393201439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa4151c20 con 0x7f6aa414f170 2024-09-10T08:44:10.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.135+0000 7f6aaa473640 1 --2- 172.21.15.103:0/1393201439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa414f170 0x7f6aa41482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.136+0000 7f6aaa473640 1 -- 172.21.15.103:0/1393201439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6aa414af20 con 0x7f6aa414f170 2024-09-10T08:44:10.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.136+0000 7f6aaa473640 1 --2- 172.21.15.103:0/1393201439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa414f170 0x7f6aa41482f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6a9400cd20 tx=0x7f6a9400a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:10.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.136+0000 7f6aa2ffd640 1 -- 172.21.15.103:0/1393201439 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a98044070 con 0x7f6aa40c3830 2024-09-10T08:44:10.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.136+0000 7f6aa2ffd640 1 --2- 172.21.15.103:0/1393201439 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6a9006be30 0x7f6a9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.136+0000 7f6aa2ffd640 1 -- 172.21.15.103:0/1393201439 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9400f640 con 0x7f6aa414f170 2024-09-10T08:44:10.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.136+0000 7f6aa2ffd640 1 -- 172.21.15.103:0/1393201439 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f6a980abf40 con 0x7f6aa40c3830 2024-09-10T08:44:10.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.136+0000 7f6aaac74640 1 --2- 172.21.15.103:0/1393201439 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6a9006be30 0x7f6a9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.136+0000 7f6aa2ffd640 1 -- 172.21.15.103:0/1393201439 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6a9400f7e0 con 0x7f6aa414f170 2024-09-10T08:44:10.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.136+0000 7f6aa2ffd640 1 -- 172.21.15.103:0/1393201439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa414f170 msgr2=0x7f6aa41482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.136+0000 7f6aa2ffd640 1 --2- 172.21.15.103:0/1393201439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa414f170 0x7f6aa41482f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6a9400cd20 tx=0x7f6a9400a610 comp rx=0 tx=0).stop 2024-09-10T08:44:10.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.136+0000 7f6aa2ffd640 1 -- 172.21.15.103:0/1393201439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa414f170 msgr2=0x7f6aa41482f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:44:10.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.136+0000 7f6aa2ffd640 1 --2- 172.21.15.103:0/1393201439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa414f170 0x7f6aa41482f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.137+0000 7f6aaac74640 1 --2- 172.21.15.103:0/1393201439 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6a9006be30 0x7f6a9006e2f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c007fd0 tx=0x7f6a9c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:10.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.143+0000 7f6aac6d7640 1 --2- 172.21.15.103:0/1393201439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa414b270 0x7f6aa4155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.143+0000 7f6aac6d7640 1 -- 172.21.15.103:0/1393201439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa4157b00 con 0x7f6aa414b270 2024-09-10T08:44:10.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.143+0000 7f6aaa473640 1 --2- 172.21.15.103:0/1393201439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa414b270 0x7f6aa4155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.143+0000 7f6aaa473640 1 -- 172.21.15.103:0/1393201439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6aa406edc0 con 0x7f6aa414b270 2024-09-10T08:44:10.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.143+0000 7f6aaa473640 1 --2- 172.21.15.103:0/1393201439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa414b270 0x7f6aa4155970 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6a9400cd20 tx=0x7f6a94004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:10.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.143+0000 7f6aa2ffd640 1 -- 172.21.15.103:0/1393201439 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9401dca0 con 0x7f6aa414b270 2024-09-10T08:44:10.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.143+0000 7f6aa2ffd640 1 -- 172.21.15.103:0/1393201439 <== mon.0 v2:172.21.15.103:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4555 (secure 0 0 0) 0x7f6a9401dca0 con 0x7f6aa414b270 2024-09-10T08:44:10.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.143+0000 7f6aa2ffd640 1 -- 172.21.15.103:0/1393201439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa414b270 msgr2=0x7f6aa4155970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.143+0000 7f6aa2ffd640 1 --2- 172.21.15.103:0/1393201439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa414b270 0x7f6aa4155970 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6a9400cd20 tx=0x7f6a94004ab0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.143+0000 7f6aa2ffd640 1 -- 172.21.15.103:0/1393201439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa414b270 msgr2=0x7f6aa4155970 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:44:10.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.143+0000 7f6aa2ffd640 1 --2- 172.21.15.103:0/1393201439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa414b270 0x7f6aa4155970 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.146 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:44:10.146 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:44:10.146 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:44:10.146 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "leader", 2024-09-10T08:44:10.146 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 124, 2024-09-10T08:44:10.146 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 27402, 2024-09-10T08:44:10.146 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:44:10.147 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:44:10.147 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:44:10.147 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:44:10.147 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:44:10.147 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 1, 2024-09-10T08:44:10.147 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:44:10.147 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:44:10.147 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:44:10.147 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:44:10.147 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:44:10.148 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:44:10.148 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:44:10.148 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:44:10.148 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:44:10.148 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:44:10.148 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:44:10.148 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:44:10.148 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:44:10.148 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:44:10.148 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:44:10.148 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:44:10.149 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:44:10.149 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:44:10.149 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:44:10.149 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:44:10.149 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:44:10.149 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:44:10.149 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:44:10.149 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:44:10.149 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:44:10.149 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:44:10.150 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:44:10.150 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:44:10.150 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:44:10.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.150 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:44:10.150 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:44:10.150 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:44:10.150 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:44:10.150 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:44:10.150 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:44:10.150 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:44:10.150 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:44:10.150 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:44:10.151 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:44:10.151 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:44:10.151 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:44:10.151 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:44:10.151 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:44:10.151 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:44:10.151 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:44:10.151 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:44:10.151 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:44:10.151 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:44:10.151 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:44:10.152 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:44:10.152 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:44:10.152 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:44:10.152 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:44:10.152 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:44:10.152 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:44:10.152 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:44:10.152 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:44:10.152 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:44:10.152 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:44:10.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.152 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:44:10.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.153 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:44:10.153 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:44:10.153 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:44:10.153 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:44:10.153 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.153 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:44:10.153 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:44:10.153 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:44:10.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.154 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.154 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:44:10.154 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:44:10.154 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:44:10.154 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.154 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:44:10.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.154 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:44:10.155 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:44:10.155 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:44:10.155 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:44:10.155 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:44:10.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.155 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.155 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:44:10.155 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:44:10.155 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:44:10.155 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:44:10.155 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.156 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:44:10.156 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:44:10.156 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:44:10.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.156 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.156 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:44:10.156 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:44:10.156 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:44:10.156 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.156 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:44:10.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.156 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:44:10.156 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:44:10.156 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:44:10.157 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:44:10.157 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:44:10.157 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.157 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.157 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:44:10.157 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:44:10.157 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:44:10.157 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:44:10.157 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.157 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:44:10.157 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:44:10.157 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:44:10.157 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.157 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.158 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:44:10.158 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:44:10.158 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:44:10.158 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.158 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:44:10.158 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.158 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:44:10.158 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:44:10.158 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:44:10.158 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:44:10.158 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:44:10.158 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.158 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:44:10.158 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.159 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:44:10.159 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:44:10.159 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.159 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:44:10.159 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:44:10.159 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:44:10.159 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.159 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:44:10.159 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:44:10.159 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.159 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:44:10.159 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:44:10.159 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:44:10.159 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.160 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:44:10.160 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.160 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:44:10.160 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:44:10.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.144+0000 7f6aac6d7640 1 -- 172.21.15.103:0/1393201439 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6a9006be30 msgr2=0x7f6a9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.144+0000 7f6aac6d7640 1 --2- 172.21.15.103:0/1393201439 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6a9006be30 0x7f6a9006e2f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c007fd0 tx=0x7f6a9c009040 comp rx=0 tx=0).stop 2024-09-10T08:44:10.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.144+0000 7f6aac6d7640 1 -- 172.21.15.103:0/1393201439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa40c3830 msgr2=0x7f6aa414ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.144+0000 7f6aac6d7640 1 --2- 172.21.15.103:0/1393201439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6aa40c3830 0x7f6aa414ec30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6a98000c00 tx=0x7f6a980046c0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.144+0000 7f6aaac74640 1 -- 172.21.15.103:0/1393201439 reap_dead start 2024-09-10T08:44:10.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.144+0000 7f6aaac74640 1 -- 172.21.15.103:0/1393201439 reap_dead start 2024-09-10T08:44:10.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.144+0000 7f6aac6d7640 1 -- 172.21.15.103:0/1393201439 shutdown_connections 2024-09-10T08:44:10.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.144+0000 7f6aac6d7640 1 -- 172.21.15.103:0/1393201439 >> 172.21.15.103:0/1393201439 conn(0x7f6aa40c7a40 msgr2=0x7f6aa40c1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:10.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.144+0000 7f6aac6d7640 1 -- 172.21.15.103:0/1393201439 shutdown_connections 2024-09-10T08:44:10.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.144+0000 7f6aac6d7640 1 -- 172.21.15.103:0/1393201439 wait complete. 2024-09-10T08:44:10.164 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:44:10.164 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-10T08:44:10.164 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T08:44:10.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.264+0000 7f9def677640 1 Processor -- start 2024-09-10T08:44:10.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.264+0000 7f9def677640 1 -- start start 2024-09-10T08:44:10.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.265+0000 7f9def677640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9de8073ae0 0x7f9de8153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.265+0000 7f9def677640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9de806dd50 con 0x7f9de8156f50 2024-09-10T08:44:10.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.265+0000 7f9def677640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9de806e030 con 0x7f9de80733d0 2024-09-10T08:44:10.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.265+0000 7f9def677640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9de806e310 con 0x7f9de8073ae0 2024-09-10T08:44:10.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.265+0000 7f9dedc14640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9de8156f50 0x7f9de8160b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:35898/0 (socket says 172.21.15.103:35898) 2024-09-10T08:44:10.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.265+0000 7f9dedc14640 1 -- 172.21.15.103:0/1246072924 learned_addr learned my addr 172.21.15.103:0/1246072924 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:44:10.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.265+0000 7f9ded413640 1 --2- 172.21.15.103:0/1246072924 >> v2:172.21.15.154:3300/0 conn(0x7f9de8073ae0 0x7f9de8153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.265+0000 7f9ddffff640 1 -- 172.21.15.103:0/1246072924 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1485298420 0 0) 0x7f9de806dd50 con 0x7f9de8156f50 2024-09-10T08:44:10.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.265+0000 7f9ddffff640 1 -- 172.21.15.103:0/1246072924 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dd4003520 con 0x7f9de8156f50 2024-09-10T08:44:10.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.265+0000 7f9ddffff640 1 -- 172.21.15.103:0/1246072924 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 960823211 0 0) 0x7f9dd4003520 con 0x7f9de8156f50 2024-09-10T08:44:10.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.265+0000 7f9ddffff640 1 -- 172.21.15.103:0/1246072924 >> v2:172.21.15.154:3300/0 conn(0x7f9de8073ae0 msgr2=0x7f9de8153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:10.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.265+0000 7f9ddffff640 1 --2- 172.21.15.103:0/1246072924 >> v2:172.21.15.154:3300/0 conn(0x7f9de8073ae0 0x7f9de8153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.266+0000 7f9ddffff640 1 -- 172.21.15.103:0/1246072924 >> v1:172.21.15.154:6789/0 conn(0x7f9de80733d0 legacy=0x7f9de8156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.266+0000 7f9ddffff640 1 -- 172.21.15.103:0/1246072924 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de806e5f0 con 0x7f9de8156f50 2024-09-10T08:44:10.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.266+0000 7f9ddffff640 1 -- 172.21.15.103:0/1246072924 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f9de00019f0 con 0x7f9de8156f50 2024-09-10T08:44:10.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.266+0000 7f9ddffff640 1 -- 172.21.15.103:0/1246072924 >> v1:172.21.15.103:6789/0 conn(0x7f9de8156f50 legacy=0x7f9de8160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.266+0000 7f9ddffff640 1 --2- 172.21.15.103:0/1246072924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd40039b0 0x7f9dd4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.266+0000 7f9ddffff640 1 --2- 172.21.15.103:0/1246072924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd4004800 0x7f9dd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.266+0000 7f9ddffff640 1 --2- 172.21.15.103:0/1246072924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dd40051c0 0x7f9dd400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.266+0000 7f9ddffff640 1 -- 172.21.15.103:0/1246072924 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9de806e310 con 0x7f9dd4004800 2024-09-10T08:44:10.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.266+0000 7f9ddffff640 1 -- 172.21.15.103:0/1246072924 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd400c060 con 0x7f9dd40039b0 2024-09-10T08:44:10.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.266+0000 7f9ddffff640 1 -- 172.21.15.103:0/1246072924 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd400c260 con 0x7f9dd40051c0 2024-09-10T08:44:10.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.266+0000 7f9decc12640 1 --2- 172.21.15.103:0/1246072924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd4004800 0x7f9dd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.266+0000 7f9ded413640 1 --2- 172.21.15.103:0/1246072924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd40039b0 0x7f9dd4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.266+0000 7f9dedc14640 1 --2- 172.21.15.103:0/1246072924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dd40051c0 0x7f9dd400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.266+0000 7f9decc12640 1 -- 172.21.15.103:0/1246072924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dd40051c0 msgr2=0x7f9dd400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:10.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.266+0000 7f9decc12640 1 --2- 172.21.15.103:0/1246072924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9dd40051c0 0x7f9dd400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.266+0000 7f9decc12640 1 -- 172.21.15.103:0/1246072924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd40039b0 msgr2=0x7f9dd4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:10.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.266+0000 7f9decc12640 1 --2- 172.21.15.103:0/1246072924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd40039b0 0x7f9dd4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.266+0000 7f9decc12640 1 -- 172.21.15.103:0/1246072924 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd4003520 con 0x7f9dd4004800 2024-09-10T08:44:10.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.266+0000 7f9ded413640 1 --2- 172.21.15.103:0/1246072924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9dd40039b0 0x7f9dd4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:44:10.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.266+0000 7f9dedc14640 1 -- 172.21.15.103:0/1246072924 reap_dead start 2024-09-10T08:44:10.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.267+0000 7f9decc12640 1 --2- 172.21.15.103:0/1246072924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd4004800 0x7f9dd4004c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8001720 tx=0x7f9dd4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f366a207e0a029f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:10.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.267+0000 7f9ddffff640 1 -- 172.21.15.103:0/1246072924 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8001370 con 0x7f9dd4004800 2024-09-10T08:44:10.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.267+0000 7f9ddffff640 1 -- 172.21.15.103:0/1246072924 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd80052d0 con 0x7f9dd4004800 2024-09-10T08:44:10.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.267+0000 7f9ddffff640 1 -- 172.21.15.103:0/1246072924 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd802ab90 con 0x7f9dd4004800 2024-09-10T08:44:10.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.267+0000 7f9def677640 1 -- 172.21.15.103:0/1246072924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd4004800 msgr2=0x7f9dd4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.267+0000 7f9def677640 1 --2- 172.21.15.103:0/1246072924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd4004800 0x7f9dd4004c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8001720 tx=0x7f9dd4005830 comp rx=0 tx=0).stop 2024-09-10T08:44:10.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.267+0000 7f9def677640 1 -- 172.21.15.103:0/1246072924 shutdown_connections 2024-09-10T08:44:10.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.267+0000 7f9def677640 1 --2- 172.21.15.103:0/1246072924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd4004800 0x7f9dd4004c80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.267+0000 7f9def677640 1 -- 172.21.15.103:0/1246072924 >> 172.21.15.103:0/1246072924 conn(0x7f9de80c9d80 msgr2=0x7f9de80ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:10.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.267+0000 7f9def677640 1 -- 172.21.15.103:0/1246072924 shutdown_connections 2024-09-10T08:44:10.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.267+0000 7f9def677640 1 -- 172.21.15.103:0/1246072924 wait complete. 2024-09-10T08:44:10.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.268+0000 7f9def677640 1 Processor -- start 2024-09-10T08:44:10.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.269+0000 7f9def677640 1 -- start start 2024-09-10T08:44:10.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.269+0000 7f9def677640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd4004800 0x7f9de8152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.269+0000 7f9def677640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9de8158dd0 0x7f9de8159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.269+0000 7f9def677640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de81510e0 0x7f9de81eeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.269+0000 7f9def677640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9de806edd0 con 0x7f9dd4004800 2024-09-10T08:44:10.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.269+0000 7f9def677640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9de806ec50 con 0x7f9de81510e0 2024-09-10T08:44:10.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.269+0000 7f9def677640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f9de8073ec0 con 0x7f9de8158dd0 2024-09-10T08:44:10.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.269+0000 7f9ded413640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd4004800 0x7f9de8152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.269+0000 7f9ded413640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd4004800 0x7f9de8152520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48002/0 (socket says 172.21.15.103:48002) 2024-09-10T08:44:10.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.269+0000 7f9ded413640 1 -- 172.21.15.103:0/12694901 learned_addr learned my addr 172.21.15.103:0/12694901 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:10.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.269+0000 7f9decc12640 1 --2- 172.21.15.103:0/12694901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9de8158dd0 0x7f9de8159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.269+0000 7f9dedc14640 1 --2- 172.21.15.103:0/12694901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de81510e0 0x7f9de81eeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.270+0000 7f9ded413640 1 -- 172.21.15.103:0/12694901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9de8158dd0 msgr2=0x7f9de8159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.270+0000 7f9ded413640 1 --2- 172.21.15.103:0/12694901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9de8158dd0 0x7f9de8159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.270+0000 7f9ded413640 1 -- 172.21.15.103:0/12694901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de81510e0 msgr2=0x7f9de81eeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.270+0000 7f9ded413640 1 --2- 172.21.15.103:0/12694901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de81510e0 0x7f9de81eeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.270+0000 7f9ded413640 1 -- 172.21.15.103:0/12694901 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de81595c0 con 0x7f9dd4004800 2024-09-10T08:44:10.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.270+0000 7f9ded413640 1 --2- 172.21.15.103:0/12694901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd4004800 0x7f9de8152520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9de4011730 tx=0x7f9de4011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:10.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.270+0000 7f9dddffb640 1 -- 172.21.15.103:0/12694901 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de400f9d0 con 0x7f9dd4004800 2024-09-10T08:44:10.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.270+0000 7f9dddffb640 1 -- 172.21.15.103:0/12694901 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de400fb70 con 0x7f9dd4004800 2024-09-10T08:44:10.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.270+0000 7f9dddffb640 1 -- 172.21.15.103:0/12694901 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de4015460 con 0x7f9dd4004800 2024-09-10T08:44:10.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.270+0000 7f9def677640 1 -- 172.21.15.103:0/12694901 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9de815a590 con 0x7f9dd4004800 2024-09-10T08:44:10.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.270+0000 7f9def677640 1 -- 172.21.15.103:0/12694901 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9de8158060 con 0x7f9dd4004800 2024-09-10T08:44:10.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.271+0000 7f9def677640 1 --2- 172.21.15.103:0/12694901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de81514c0 0x7f9de81ef430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.271+0000 7f9def677640 1 -- 172.21.15.103:0/12694901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9de8158230 con 0x7f9de81514c0 2024-09-10T08:44:10.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.271+0000 7f9decc12640 1 --2- 172.21.15.103:0/12694901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de81514c0 0x7f9de81ef430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.271+0000 7f9dddffb640 1 -- 172.21.15.103:0/12694901 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9de4015600 con 0x7f9dd4004800 2024-09-10T08:44:10.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.272+0000 7f9decc12640 1 -- 172.21.15.103:0/12694901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9de806d850 con 0x7f9de81514c0 2024-09-10T08:44:10.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.272+0000 7f9decc12640 1 --2- 172.21.15.103:0/12694901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de81514c0 0x7f9de81ef430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9de80cae40 tx=0x7f9dd8001120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:10.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.272+0000 7f9dddffb640 1 --2- 172.21.15.103:0/12694901 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9dcc06be30 0x7f9dcc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.272+0000 7f9dedc14640 1 --2- 172.21.15.103:0/12694901 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9dcc06be30 0x7f9dcc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.272+0000 7f9dddffb640 1 -- 172.21.15.103:0/12694901 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f9de408bb30 con 0x7f9dd4004800 2024-09-10T08:44:10.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.272+0000 7f9dddffb640 1 -- 172.21.15.103:0/12694901 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8040070 con 0x7f9de81514c0 2024-09-10T08:44:10.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.272+0000 7f9dddffb640 1 -- 172.21.15.103:0/12694901 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9dd80035f0 con 0x7f9de81514c0 2024-09-10T08:44:10.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.272+0000 7f9dddffb640 1 -- 172.21.15.103:0/12694901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de81514c0 msgr2=0x7f9de81ef430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.272+0000 7f9dddffb640 1 --2- 172.21.15.103:0/12694901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de81514c0 0x7f9de81ef430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9de80cae40 tx=0x7f9dd8001120 comp rx=0 tx=0).stop 2024-09-10T08:44:10.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.272+0000 7f9dddffb640 1 -- 172.21.15.103:0/12694901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de81514c0 msgr2=0x7f9de81ef430 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:44:10.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.272+0000 7f9dddffb640 1 --2- 172.21.15.103:0/12694901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de81514c0 0x7f9de81ef430 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.272+0000 7f9dedc14640 1 --2- 172.21.15.103:0/12694901 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9dcc06be30 0x7f9dcc06e2f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9de8156210 tx=0x7f9de0002130 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:10.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.278+0000 7f9def677640 1 --2- 172.21.15.103:0/12694901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de81ef970 0x7f9de814d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.278+0000 7f9def677640 1 -- 172.21.15.103:0/12694901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9de8150b60 con 0x7f9de81ef970 2024-09-10T08:44:10.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.279+0000 7f9decc12640 1 --2- 172.21.15.103:0/12694901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de81ef970 0x7f9de814d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.279+0000 7f9decc12640 1 -- 172.21.15.103:0/12694901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9de8157e10 con 0x7f9de81ef970 2024-09-10T08:44:10.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.279+0000 7f9decc12640 1 --2- 172.21.15.103:0/12694901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de81ef970 0x7f9de814d990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8001720 tx=0x7f9dd8009030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:10.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.279+0000 7f9dddffb640 1 -- 172.21.15.103:0/12694901 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8040040 con 0x7f9de81ef970 2024-09-10T08:44:10.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.280+0000 7f9dddffb640 1 -- 172.21.15.103:0/12694901 <== mon.1 v2:172.21.15.154:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4887 (secure 0 0 0) 0x7f9dd8003bb0 con 0x7f9de81ef970 2024-09-10T08:44:10.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.280+0000 7f9dddffb640 1 -- 172.21.15.103:0/12694901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de81ef970 msgr2=0x7f9de814d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.280+0000 7f9dddffb640 1 --2- 172.21.15.103:0/12694901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de81ef970 0x7f9de814d990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8001720 tx=0x7f9dd8009030 comp rx=0 tx=0).stop 2024-09-10T08:44:10.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.280+0000 7f9dddffb640 1 -- 172.21.15.103:0/12694901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de81ef970 msgr2=0x7f9de814d990 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:44:10.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.280+0000 7f9dddffb640 1 --2- 172.21.15.103:0/12694901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9de81ef970 0x7f9de814d990 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8001720 tx=0x7f9dd8009030 comp rx=0 tx=0).stop 2024-09-10T08:44:10.282 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:44:10.282 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:44:10.282 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:44:10.282 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:44:10.283 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 124, 2024-09-10T08:44:10.283 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 85016, 2024-09-10T08:44:10.283 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:44:10.283 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:44:10.283 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:44:10.283 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:44:10.283 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:44:10.283 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 2, 2024-09-10T08:44:10.283 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:44:10.283 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:44:10.284 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:44:10.284 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:44:10.284 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:44:10.284 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:44:10.284 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:44:10.284 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:44:10.284 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:44:10.284 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:44:10.284 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:44:10.284 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:44:10.285 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:44:10.285 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:44:10.285 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:44:10.285 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:44:10.285 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:44:10.285 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:44:10.285 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:44:10.285 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:44:10.285 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:44:10.285 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:44:10.285 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:44:10.286 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:44:10.286 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:44:10.286 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:44:10.286 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:44:10.286 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:44:10.286 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:44:10.286 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.286 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:44:10.286 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:44:10.286 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:44:10.286 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:44:10.286 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:44:10.287 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:44:10.287 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:44:10.287 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:44:10.287 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:44:10.287 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:44:10.287 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:44:10.287 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:44:10.287 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:44:10.287 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:44:10.288 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:44:10.288 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:44:10.288 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:44:10.288 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:44:10.288 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:44:10.288 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:44:10.288 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:44:10.288 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:44:10.288 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:44:10.288 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:44:10.288 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:44:10.289 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:44:10.289 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:44:10.289 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:44:10.289 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:44:10.289 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:44:10.289 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.289 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:44:10.289 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.289 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:44:10.290 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:44:10.290 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:44:10.290 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:44:10.290 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.290 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:44:10.290 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:44:10.290 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:44:10.290 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.290 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.291 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:44:10.291 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:44:10.291 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:44:10.291 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.291 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:44:10.291 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.291 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:44:10.291 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:44:10.291 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:44:10.292 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:44:10.292 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:44:10.292 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.292 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.292 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:44:10.292 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:44:10.292 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:44:10.293 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:44:10.293 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.293 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:44:10.293 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:44:10.293 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:44:10.293 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.293 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.293 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:44:10.293 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:44:10.293 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:44:10.293 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.294 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:44:10.294 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.294 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:44:10.294 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:44:10.294 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:44:10.294 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:44:10.294 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:44:10.294 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.294 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.294 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:44:10.294 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:44:10.294 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:44:10.295 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:44:10.295 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.295 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:44:10.295 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:44:10.295 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:44:10.295 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.295 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.295 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:44:10.295 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:44:10.295 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:44:10.295 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.295 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:44:10.296 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.296 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:44:10.296 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:44:10.296 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:44:10.296 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:44:10.296 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:44:10.296 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.296 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:44:10.296 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.296 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:44:10.296 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:44:10.296 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.297 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:44:10.297 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:44:10.297 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:44:10.297 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.297 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:44:10.297 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:44:10.297 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.297 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:44:10.297 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:44:10.297 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:44:10.297 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.297 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:44:10.297 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:44:10.297 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.298 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:44:10.298 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:44:10.298 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:44:10.298 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.298 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:44:10.298 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:44:10.298 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.298 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:44:10.298 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:44:10.298 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:44:10.298 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.298 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:44:10.299 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.299 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:44:10.299 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:44:10.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.280+0000 7f9def677640 1 -- 172.21.15.103:0/12694901 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9dcc06be30 msgr2=0x7f9dcc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.280+0000 7f9def677640 1 --2- 172.21.15.103:0/12694901 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f9dcc06be30 0x7f9dcc06e2f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9de8156210 tx=0x7f9de0002130 comp rx=0 tx=0).stop 2024-09-10T08:44:10.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.280+0000 7f9def677640 1 -- 172.21.15.103:0/12694901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd4004800 msgr2=0x7f9de8152520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.280+0000 7f9def677640 1 --2- 172.21.15.103:0/12694901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd4004800 0x7f9de8152520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9de4011730 tx=0x7f9de4011bf0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.280+0000 7f9dedc14640 1 -- 172.21.15.103:0/12694901 reap_dead start 2024-09-10T08:44:10.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.280+0000 7f9dedc14640 1 -- 172.21.15.103:0/12694901 reap_dead start 2024-09-10T08:44:10.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.280+0000 7f9def677640 1 -- 172.21.15.103:0/12694901 shutdown_connections 2024-09-10T08:44:10.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.280+0000 7f9def677640 1 -- 172.21.15.103:0/12694901 >> 172.21.15.103:0/12694901 conn(0x7f9de80c9d80 msgr2=0x7f9de80c4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:10.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.280+0000 7f9def677640 1 -- 172.21.15.103:0/12694901 shutdown_connections 2024-09-10T08:44:10.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.280+0000 7f9def677640 1 -- 172.21.15.103:0/12694901 wait complete. 2024-09-10T08:44:10.301 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:44:10.301 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-10T08:44:10.302 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T08:44:10.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.401+0000 7f0e55b1a640 1 Processor -- start 2024-09-10T08:44:10.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.401+0000 7f0e55b1a640 1 -- start start 2024-09-10T08:44:10.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.401+0000 7f0e55b1a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0e500733d0 0x7f0e50156840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.401+0000 7f0e55b1a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0e5006d850 0x7f0e50156d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.401+0000 7f0e55b1a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e5006dd50 con 0x7f0e50073ae0 2024-09-10T08:44:10.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.401+0000 7f0e55b1a640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f0e5006e030 con 0x7f0e500733d0 2024-09-10T08:44:10.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.401+0000 7f0e55b1a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f0e5006e310 con 0x7f0e5006d850 2024-09-10T08:44:10.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.402+0000 7f0e4effd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0e500733d0 0x7f0e50156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.402+0000 7f0e4effd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0e500733d0 0x7f0e50156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48012/0 (socket says 172.21.15.103:48012) 2024-09-10T08:44:10.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.402+0000 7f0e4effd640 1 -- 172.21.15.103:0/710462923 learned_addr learned my addr 172.21.15.103:0/710462923 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:10.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.402+0000 7f0e4ffff640 1 --2- 172.21.15.103:0/710462923 >> v2:172.21.15.154:3300/0 conn(0x7f0e5006d850 0x7f0e50156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.402+0000 7f0e4effd640 1 -- 172.21.15.103:0/710462923 >> v2:172.21.15.154:3300/0 conn(0x7f0e5006d850 msgr2=0x7f0e50156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:10.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.402+0000 7f0e4effd640 1 --2- 172.21.15.103:0/710462923 >> v2:172.21.15.154:3300/0 conn(0x7f0e5006d850 0x7f0e50156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.402+0000 7f0e4effd640 1 -- 172.21.15.103:0/710462923 >> v1:172.21.15.154:6789/0 conn(0x7f0e50073ae0 legacy=0x7f0e50153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:10.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.402+0000 7f0e4effd640 1 -- 172.21.15.103:0/710462923 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e5006e5f0 con 0x7f0e500733d0 2024-09-10T08:44:10.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.403+0000 7f0e4effd640 1 --2- 172.21.15.103:0/710462923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e500733d0 0x7f0e50156840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0e500b0110 tx=0x7f0e3802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2980b940e14262 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:10.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.403+0000 7f0e4e7fc640 1 -- 172.21.15.103:0/710462923 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e38037070 con 0x7f0e500733d0 2024-09-10T08:44:10.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.403+0000 7f0e4e7fc640 1 -- 172.21.15.103:0/710462923 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e38032440 con 0x7f0e500733d0 2024-09-10T08:44:10.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.403+0000 7f0e4e7fc640 1 -- 172.21.15.103:0/710462923 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e38032810 con 0x7f0e500733d0 2024-09-10T08:44:10.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.403+0000 7f0e55b1a640 1 -- 172.21.15.103:0/710462923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e500733d0 msgr2=0x7f0e50156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.403+0000 7f0e55b1a640 1 --2- 172.21.15.103:0/710462923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e500733d0 0x7f0e50156840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0e500b0110 tx=0x7f0e3802a1a0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.403+0000 7f0e55b1a640 1 -- 172.21.15.103:0/710462923 shutdown_connections 2024-09-10T08:44:10.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.403+0000 7f0e55b1a640 1 --2- 172.21.15.103:0/710462923 >> v2:172.21.15.154:3300/0 conn(0x7f0e5006d850 0x7f0e50156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.403+0000 7f0e55b1a640 1 --2- 172.21.15.103:0/710462923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e500733d0 0x7f0e50156840 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.403+0000 7f0e55b1a640 1 -- 172.21.15.103:0/710462923 >> 172.21.15.103:0/710462923 conn(0x7f0e500c9d80 msgr2=0x7f0e500ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:10.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.403+0000 7f0e55b1a640 1 -- 172.21.15.103:0/710462923 shutdown_connections 2024-09-10T08:44:10.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.403+0000 7f0e55b1a640 1 -- 172.21.15.103:0/710462923 wait complete. 2024-09-10T08:44:10.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.404+0000 7f0e55b1a640 1 Processor -- start 2024-09-10T08:44:10.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.405+0000 7f0e55b1a640 1 -- start start 2024-09-10T08:44:10.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.405+0000 7f0e55b1a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e5006d850 0x7f0e50145c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.405+0000 7f0e55b1a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e500733d0 0x7f0e501ec7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.405+0000 7f0e55b1a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e50073ae0 0x7f0e50157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.405+0000 7f0e55b1a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5006edd0 con 0x7f0e5006d850 2024-09-10T08:44:10.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.405+0000 7f0e55b1a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5006ec50 con 0x7f0e500733d0 2024-09-10T08:44:10.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.405+0000 7f0e55b1a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0e50153a90 con 0x7f0e50073ae0 2024-09-10T08:44:10.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.405+0000 7f0e4f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e5006d850 0x7f0e50145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.405+0000 7f0e4f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e5006d850 0x7f0e50145c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48024/0 (socket says 172.21.15.103:48024) 2024-09-10T08:44:10.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.405+0000 7f0e4f7fe640 1 -- 172.21.15.103:0/1088688856 learned_addr learned my addr 172.21.15.103:0/1088688856 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:10.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.405+0000 7f0e4ffff640 1 --2- 172.21.15.103:0/1088688856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e50073ae0 0x7f0e50157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.405+0000 7f0e4effd640 1 --2- 172.21.15.103:0/1088688856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e500733d0 0x7f0e501ec7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.406+0000 7f0e4f7fe640 1 -- 172.21.15.103:0/1088688856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e50073ae0 msgr2=0x7f0e50157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.406+0000 7f0e4f7fe640 1 --2- 172.21.15.103:0/1088688856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e50073ae0 0x7f0e50157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.406+0000 7f0e4f7fe640 1 -- 172.21.15.103:0/1088688856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e500733d0 msgr2=0x7f0e501ec7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.406+0000 7f0e4f7fe640 1 --2- 172.21.15.103:0/1088688856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e500733d0 0x7f0e501ec7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.406+0000 7f0e4f7fe640 1 -- 172.21.15.103:0/1088688856 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e50150150 con 0x7f0e5006d850 2024-09-10T08:44:10.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.406+0000 7f0e4f7fe640 1 --2- 172.21.15.103:0/1088688856 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e5006d850 0x7f0e50145c30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000b3f0 tx=0x7f0e4000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:10.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.406+0000 7f0e47fff640 1 -- 172.21.15.103:0/1088688856 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e40015020 con 0x7f0e5006d850 2024-09-10T08:44:10.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.406+0000 7f0e47fff640 1 -- 172.21.15.103:0/1088688856 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e40011830 con 0x7f0e5006d850 2024-09-10T08:44:10.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.406+0000 7f0e55b1a640 1 -- 172.21.15.103:0/1088688856 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e50152950 con 0x7f0e5006d850 2024-09-10T08:44:10.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.406+0000 7f0e47fff640 1 -- 172.21.15.103:0/1088688856 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e40011c20 con 0x7f0e5006d850 2024-09-10T08:44:10.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.406+0000 7f0e55b1a640 1 -- 172.21.15.103:0/1088688856 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e5014d9a0 con 0x7f0e5006d850 2024-09-10T08:44:10.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.407+0000 7f0e55b1a640 1 --2- 172.21.15.103:0/1088688856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e5014dbe0 0x7f0e501585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.407+0000 7f0e55b1a640 1 -- 172.21.15.103:0/1088688856 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0e501ecd30 con 0x7f0e5014dbe0 2024-09-10T08:44:10.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.407+0000 7f0e4effd640 1 --2- 172.21.15.103:0/1088688856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e5014dbe0 0x7f0e501585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.407+0000 7f0e47fff640 1 -- 172.21.15.103:0/1088688856 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e40018020 con 0x7f0e5006d850 2024-09-10T08:44:10.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.407+0000 7f0e4effd640 1 -- 172.21.15.103:0/1088688856 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e500695d0 con 0x7f0e5014dbe0 2024-09-10T08:44:10.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.408+0000 7f0e4effd640 1 --2- 172.21.15.103:0/1088688856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e5014dbe0 0x7f0e501585c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0e50076720 tx=0x7f0e380046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:10.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.408+0000 7f0e47fff640 1 --2- 172.21.15.103:0/1088688856 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0e3006be30 0x7f0e3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.408+0000 7f0e4ffff640 1 --2- 172.21.15.103:0/1088688856 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0e3006be30 0x7f0e3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.408+0000 7f0e47fff640 1 -- 172.21.15.103:0/1088688856 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f0e4008ad60 con 0x7f0e5006d850 2024-09-10T08:44:10.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.408+0000 7f0e47fff640 1 -- 172.21.15.103:0/1088688856 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e38037040 con 0x7f0e5014dbe0 2024-09-10T08:44:10.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.408+0000 7f0e47fff640 1 -- 172.21.15.103:0/1088688856 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0e3803c850 con 0x7f0e5014dbe0 2024-09-10T08:44:10.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.408+0000 7f0e47fff640 1 -- 172.21.15.103:0/1088688856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e5014dbe0 msgr2=0x7f0e501585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.408+0000 7f0e47fff640 1 --2- 172.21.15.103:0/1088688856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e5014dbe0 0x7f0e501585c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0e50076720 tx=0x7f0e380046c0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.408+0000 7f0e47fff640 1 -- 172.21.15.103:0/1088688856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e5014dbe0 msgr2=0x7f0e501585c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:44:10.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.408+0000 7f0e47fff640 1 --2- 172.21.15.103:0/1088688856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e5014dbe0 0x7f0e501585c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.408+0000 7f0e4ffff640 1 --2- 172.21.15.103:0/1088688856 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0e3006be30 0x7f0e3006e2f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0e5006dc80 tx=0x7f0e48009820 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:10.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.414+0000 7f0e55b1a640 1 --2- 172.21.15.103:0/1088688856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e50158b00 0x7f0e5014f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.414+0000 7f0e55b1a640 1 -- 172.21.15.103:0/1088688856 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0e50073ec0 con 0x7f0e50158b00 2024-09-10T08:44:10.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.414+0000 7f0e4effd640 1 --2- 172.21.15.103:0/1088688856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e50158b00 0x7f0e5014f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.415+0000 7f0e4effd640 1 -- 172.21.15.103:0/1088688856 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0e50158050 con 0x7f0e50158b00 2024-09-10T08:44:10.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.415+0000 7f0e4effd640 1 --2- 172.21.15.103:0/1088688856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e50158b00 0x7f0e5014f250 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0e38000c00 tx=0x7f0e38008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:10.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.415+0000 7f0e47fff640 1 -- 172.21.15.103:0/1088688856 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e38003d70 con 0x7f0e50158b00 2024-09-10T08:44:10.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.415+0000 7f0e47fff640 1 -- 172.21.15.103:0/1088688856 <== mon.2 v2:172.21.15.154:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f0e38009490 con 0x7f0e50158b00 2024-09-10T08:44:10.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.415+0000 7f0e47fff640 1 -- 172.21.15.103:0/1088688856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e50158b00 msgr2=0x7f0e5014f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.415+0000 7f0e47fff640 1 --2- 172.21.15.103:0/1088688856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e50158b00 0x7f0e5014f250 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0e38000c00 tx=0x7f0e38008030 comp rx=0 tx=0).stop 2024-09-10T08:44:10.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.415+0000 7f0e47fff640 1 -- 172.21.15.103:0/1088688856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e50158b00 msgr2=0x7f0e5014f250 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T08:44:10.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.415+0000 7f0e47fff640 1 --2- 172.21.15.103:0/1088688856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e50158b00 0x7f0e5014f250 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.417 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:44:10.417 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:44:10.417 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:44:10.417 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "peon", 2024-09-10T08:44:10.417 INFO:teuthology.orchestra.run.smithi103.stdout: "election_epoch": 124, 2024-09-10T08:44:10.417 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 142317, 2024-09-10T08:44:10.417 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum": [ 2024-09-10T08:44:10.418 INFO:teuthology.orchestra.run.smithi103.stdout: 0, 2024-09-10T08:44:10.418 INFO:teuthology.orchestra.run.smithi103.stdout: 1, 2024-09-10T08:44:10.418 INFO:teuthology.orchestra.run.smithi103.stdout: 2 2024-09-10T08:44:10.418 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:44:10.418 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_age": 2, 2024-09-10T08:44:10.418 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:44:10.418 INFO:teuthology.orchestra.run.smithi103.stdout: "required_con": "2450521708007866372", 2024-09-10T08:44:10.418 INFO:teuthology.orchestra.run.smithi103.stdout: "required_mon": [ 2024-09-10T08:44:10.418 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:44:10.418 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:44:10.418 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:44:10.418 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:44:10.418 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:44:10.419 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:44:10.419 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:44:10.419 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:44:10.419 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:44:10.419 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:44:10.419 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:44:10.419 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:44:10.419 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_con": "4540701547738038271", 2024-09-10T08:44:10.419 INFO:teuthology.orchestra.run.smithi103.stdout: "quorum_mon": [ 2024-09-10T08:44:10.419 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:44:10.419 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:44:10.419 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:44:10.419 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:44:10.420 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:44:10.420 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:44:10.420 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:44:10.420 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:44:10.420 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:44:10.420 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:44:10.420 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:44:10.420 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:44:10.420 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.420 INFO:teuthology.orchestra.run.smithi103.stdout: "outside_quorum": [], 2024-09-10T08:44:10.420 INFO:teuthology.orchestra.run.smithi103.stdout: "extra_probe_peers": [], 2024-09-10T08:44:10.420 INFO:teuthology.orchestra.run.smithi103.stdout: "sync_provider": [], 2024-09-10T08:44:10.420 INFO:teuthology.orchestra.run.smithi103.stdout: "monmap": { 2024-09-10T08:44:10.421 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 1, 2024-09-10T08:44:10.421 INFO:teuthology.orchestra.run.smithi103.stdout: "fsid": "4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5", 2024-09-10T08:44:10.421 INFO:teuthology.orchestra.run.smithi103.stdout: "modified": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:44:10.421 INFO:teuthology.orchestra.run.smithi103.stdout: "created": "2024-09-10T08:27:30.229267Z", 2024-09-10T08:44:10.421 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release": 19, 2024-09-10T08:44:10.421 INFO:teuthology.orchestra.run.smithi103.stdout: "min_mon_release_name": "squid", 2024-09-10T08:44:10.421 INFO:teuthology.orchestra.run.smithi103.stdout: "election_strategy": 1, 2024-09-10T08:44:10.421 INFO:teuthology.orchestra.run.smithi103.stdout: "disallowed_leaders: ": "", 2024-09-10T08:44:10.421 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false, 2024-09-10T08:44:10.421 INFO:teuthology.orchestra.run.smithi103.stdout: "tiebreaker_mon": "", 2024-09-10T08:44:10.421 INFO:teuthology.orchestra.run.smithi103.stdout: "removed_ranks: ": "", 2024-09-10T08:44:10.421 INFO:teuthology.orchestra.run.smithi103.stdout: "features": { 2024-09-10T08:44:10.421 INFO:teuthology.orchestra.run.smithi103.stdout: "persistent": [ 2024-09-10T08:44:10.421 INFO:teuthology.orchestra.run.smithi103.stdout: "kraken", 2024-09-10T08:44:10.422 INFO:teuthology.orchestra.run.smithi103.stdout: "luminous", 2024-09-10T08:44:10.422 INFO:teuthology.orchestra.run.smithi103.stdout: "mimic", 2024-09-10T08:44:10.422 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap-prune", 2024-09-10T08:44:10.422 INFO:teuthology.orchestra.run.smithi103.stdout: "nautilus", 2024-09-10T08:44:10.422 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus", 2024-09-10T08:44:10.422 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific", 2024-09-10T08:44:10.422 INFO:teuthology.orchestra.run.smithi103.stdout: "elector-pinging", 2024-09-10T08:44:10.422 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy", 2024-09-10T08:44:10.422 INFO:teuthology.orchestra.run.smithi103.stdout: "reef", 2024-09-10T08:44:10.422 INFO:teuthology.orchestra.run.smithi103.stdout: "squid" 2024-09-10T08:44:10.422 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:44:10.422 INFO:teuthology.orchestra.run.smithi103.stdout: "optional": [] 2024-09-10T08:44:10.422 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.423 INFO:teuthology.orchestra.run.smithi103.stdout: "mons": [ 2024-09-10T08:44:10.423 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.423 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 0, 2024-09-10T08:44:10.423 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "a", 2024-09-10T08:44:10.423 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:44:10.423 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:44:10.423 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.423 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:44:10.423 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:3300", 2024-09-10T08:44:10.423 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:44:10.424 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.424 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.424 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:44:10.424 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789", 2024-09-10T08:44:10.424 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:44:10.424 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.424 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:44:10.424 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.424 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6789/0", 2024-09-10T08:44:10.424 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.103:6789/0", 2024-09-10T08:44:10.424 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:44:10.424 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:44:10.424 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:44:10.424 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.425 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.425 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 1, 2024-09-10T08:44:10.425 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "b", 2024-09-10T08:44:10.425 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:44:10.425 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:44:10.425 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.425 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:44:10.425 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3300", 2024-09-10T08:44:10.425 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:44:10.425 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.426 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.426 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:44:10.426 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789", 2024-09-10T08:44:10.426 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:44:10.426 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.426 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:44:10.426 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.426 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6789/0", 2024-09-10T08:44:10.426 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6789/0", 2024-09-10T08:44:10.426 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:44:10.427 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:44:10.427 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:44:10.427 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.427 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.427 INFO:teuthology.orchestra.run.smithi103.stdout: "rank": 2, 2024-09-10T08:44:10.427 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "c", 2024-09-10T08:44:10.427 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addrs": { 2024-09-10T08:44:10.427 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-10T08:44:10.428 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.428 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-10T08:44:10.428 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:3301", 2024-09-10T08:44:10.428 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:44:10.428 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.428 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.428 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-10T08:44:10.428 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790", 2024-09-10T08:44:10.428 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 0 2024-09-10T08:44:10.428 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.428 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:44:10.428 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.429 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.154:6790/0", 2024-09-10T08:44:10.429 INFO:teuthology.orchestra.run.smithi103.stdout: "public_addr": "172.21.15.154:6790/0", 2024-09-10T08:44:10.429 INFO:teuthology.orchestra.run.smithi103.stdout: "priority": 0, 2024-09-10T08:44:10.429 INFO:teuthology.orchestra.run.smithi103.stdout: "weight": 0, 2024-09-10T08:44:10.430 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_location": "{}" 2024-09-10T08:44:10.430 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.430 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:44:10.430 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.430 INFO:teuthology.orchestra.run.smithi103.stdout: "feature_map": { 2024-09-10T08:44:10.430 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": [ 2024-09-10T08:44:10.430 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.430 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:44:10.430 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:44:10.430 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 1 2024-09-10T08:44:10.431 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.431 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:44:10.431 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": [ 2024-09-10T08:44:10.431 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.431 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:44:10.431 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:44:10.431 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 3 2024-09-10T08:44:10.431 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.432 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:44:10.432 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": [ 2024-09-10T08:44:10.432 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.432 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:44:10.432 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:44:10.432 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 6 2024-09-10T08:44:10.432 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.432 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:44:10.432 INFO:teuthology.orchestra.run.smithi103.stdout: "client": [ 2024-09-10T08:44:10.433 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.433 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:44:10.433 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:44:10.433 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5 2024-09-10T08:44:10.433 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.433 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-10T08:44:10.433 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": [ 2024-09-10T08:44:10.433 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-10T08:44:10.433 INFO:teuthology.orchestra.run.smithi103.stdout: "features": "0x3f03cffffffdffff", 2024-09-10T08:44:10.433 INFO:teuthology.orchestra.run.smithi103.stdout: "release": "squid", 2024-09-10T08:44:10.433 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 2 2024-09-10T08:44:10.434 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-10T08:44:10.434 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-10T08:44:10.434 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-10T08:44:10.434 INFO:teuthology.orchestra.run.smithi103.stdout: "stretch_mode": false 2024-09-10T08:44:10.434 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:44:10.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.416+0000 7f0e55b1a640 1 -- 172.21.15.103:0/1088688856 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0e3006be30 msgr2=0x7f0e3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.416+0000 7f0e55b1a640 1 --2- 172.21.15.103:0/1088688856 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0e3006be30 0x7f0e3006e2f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0e5006dc80 tx=0x7f0e48009820 comp rx=0 tx=0).stop 2024-09-10T08:44:10.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.416+0000 7f0e55b1a640 1 -- 172.21.15.103:0/1088688856 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e5006d850 msgr2=0x7f0e50145c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.416+0000 7f0e55b1a640 1 --2- 172.21.15.103:0/1088688856 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e5006d850 0x7f0e50145c30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000b3f0 tx=0x7f0e4000b8b0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.416+0000 7f0e4ffff640 1 -- 172.21.15.103:0/1088688856 reap_dead start 2024-09-10T08:44:10.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.416+0000 7f0e4ffff640 1 -- 172.21.15.103:0/1088688856 reap_dead start 2024-09-10T08:44:10.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.416+0000 7f0e55b1a640 1 -- 172.21.15.103:0/1088688856 shutdown_connections 2024-09-10T08:44:10.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.416+0000 7f0e55b1a640 1 -- 172.21.15.103:0/1088688856 >> 172.21.15.103:0/1088688856 conn(0x7f0e500c9d80 msgr2=0x7f0e500c4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:10.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.416+0000 7f0e55b1a640 1 -- 172.21.15.103:0/1088688856 shutdown_connections 2024-09-10T08:44:10.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.416+0000 7f0e55b1a640 1 -- 172.21.15.103:0/1088688856 wait complete. 2024-09-10T08:44:10.437 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-10T08:44:10.437 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-10T08:44:10.437 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-10T08:44:10.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.535+0000 7fe9dba5e640 1 Processor -- start 2024-09-10T08:44:10.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.535+0000 7fe9dba5e640 1 -- start start 2024-09-10T08:44:10.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.536+0000 7fe9dba5e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe9d4157c90 0x7fe9d40c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.536+0000 7fe9dba5e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9d40741e0 con 0x7fe9d40c9860 2024-09-10T08:44:10.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.536+0000 7fe9dba5e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9d40c4820 con 0x7fe9d41578b0 2024-09-10T08:44:10.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.536+0000 7fe9dba5e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe9d4073f90 con 0x7fe9d4157c90 2024-09-10T08:44:10.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.536+0000 7fe9d8ff9640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe9d40c9860 0x7fe9d40c8840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:35900/0 (socket says 172.21.15.103:35900) 2024-09-10T08:44:10.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.536+0000 7fe9d8ff9640 1 -- 172.21.15.103:0/4053682911 learned_addr learned my addr 172.21.15.103:0/4053682911 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:44:10.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.536+0000 7fe9d9ffb640 1 --2- 172.21.15.103:0/4053682911 >> v2:172.21.15.154:3300/0 conn(0x7fe9d4157c90 0x7fe9d40c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.536+0000 7fe9cbfff640 1 -- 172.21.15.103:0/4053682911 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3011242121 0 0) 0x7fe9d40741e0 con 0x7fe9d40c9860 2024-09-10T08:44:10.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.536+0000 7fe9cbfff640 1 -- 172.21.15.103:0/4053682911 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9c0003520 con 0x7fe9d40c9860 2024-09-10T08:44:10.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.536+0000 7fe9cbfff640 1 -- 172.21.15.103:0/4053682911 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2992620714 0 0) 0x7fe9c0003520 con 0x7fe9d40c9860 2024-09-10T08:44:10.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.537+0000 7fe9cbfff640 1 -- 172.21.15.103:0/4053682911 >> v2:172.21.15.154:3300/0 conn(0x7fe9d4157c90 msgr2=0x7fe9d40c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:10.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.537+0000 7fe9cbfff640 1 --2- 172.21.15.103:0/4053682911 >> v2:172.21.15.154:3300/0 conn(0x7fe9d4157c90 0x7fe9d40c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.537+0000 7fe9cbfff640 1 -- 172.21.15.103:0/4053682911 >> v1:172.21.15.154:6789/0 conn(0x7fe9d41578b0 legacy=0x7fe9d41513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.537+0000 7fe9cbfff640 1 -- 172.21.15.103:0/4053682911 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d40c9490 con 0x7fe9d40c9860 2024-09-10T08:44:10.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.537+0000 7fe9cbfff640 1 -- 172.21.15.103:0/4053682911 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7fe9c4001670 con 0x7fe9d40c9860 2024-09-10T08:44:10.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.537+0000 7fe9cbfff640 1 -- 172.21.15.103:0/4053682911 >> v1:172.21.15.103:6789/0 conn(0x7fe9d40c9860 legacy=0x7fe9d40c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.537+0000 7fe9cbfff640 1 --2- 172.21.15.103:0/4053682911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9c00039b0 0x7fe9c0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.537+0000 7fe9cbfff640 1 --2- 172.21.15.103:0/4053682911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9c0004800 0x7fe9c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.537+0000 7fe9cbfff640 1 --2- 172.21.15.103:0/4053682911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9c00052e0 0x7fe9c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.537+0000 7fe9cbfff640 1 -- 172.21.15.103:0/4053682911 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d4073f90 con 0x7fe9c00052e0 2024-09-10T08:44:10.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.537+0000 7fe9cbfff640 1 -- 172.21.15.103:0/4053682911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c000c1b0 con 0x7fe9c00039b0 2024-09-10T08:44:10.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.537+0000 7fe9cbfff640 1 -- 172.21.15.103:0/4053682911 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c000c3b0 con 0x7fe9c0004800 2024-09-10T08:44:10.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.537+0000 7fe9d9ffb640 1 --2- 172.21.15.103:0/4053682911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9c00052e0 0x7fe9c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.537+0000 7fe9d97fa640 1 --2- 172.21.15.103:0/4053682911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9c00039b0 0x7fe9c0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.537+0000 7fe9d8ff9640 1 --2- 172.21.15.103:0/4053682911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9c0004800 0x7fe9c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.537+0000 7fe9d9ffb640 1 -- 172.21.15.103:0/4053682911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9c0004800 msgr2=0x7fe9c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:10.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.537+0000 7fe9d9ffb640 1 --2- 172.21.15.103:0/4053682911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9c0004800 0x7fe9c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.537+0000 7fe9d9ffb640 1 -- 172.21.15.103:0/4053682911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9c00039b0 msgr2=0x7fe9c0003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:10.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.537+0000 7fe9d9ffb640 1 --2- 172.21.15.103:0/4053682911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9c00039b0 0x7fe9c0003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.537+0000 7fe9d9ffb640 1 -- 172.21.15.103:0/4053682911 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c0003520 con 0x7fe9c00052e0 2024-09-10T08:44:10.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.537+0000 7fe9d8ff9640 1 --2- 172.21.15.103:0/4053682911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9c0004800 0x7fe9c0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:44:10.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.538+0000 7fe9d9ffb640 1 -- 172.21.15.103:0/4053682911 reap_dead start 2024-09-10T08:44:10.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.538+0000 7fe9d9ffb640 1 --2- 172.21.15.103:0/4053682911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9c00052e0 0x7fe9c000b9c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc009fc0 tx=0x7fe9c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc4c0149d2c1060 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:10.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.538+0000 7fe9cbfff640 1 -- 172.21.15.103:0/4053682911 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc035020 con 0x7fe9c00052e0 2024-09-10T08:44:10.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.538+0000 7fe9cbfff640 1 -- 172.21.15.103:0/4053682911 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9cc003b90 con 0x7fe9c00052e0 2024-09-10T08:44:10.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.538+0000 7fe9cbfff640 1 -- 172.21.15.103:0/4053682911 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc009c10 con 0x7fe9c00052e0 2024-09-10T08:44:10.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.538+0000 7fe9dba5e640 1 -- 172.21.15.103:0/4053682911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9c00052e0 msgr2=0x7fe9c000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.538+0000 7fe9dba5e640 1 --2- 172.21.15.103:0/4053682911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9c00052e0 0x7fe9c000b9c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc009fc0 tx=0x7fe9c0005830 comp rx=0 tx=0).stop 2024-09-10T08:44:10.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.538+0000 7fe9dba5e640 1 -- 172.21.15.103:0/4053682911 shutdown_connections 2024-09-10T08:44:10.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.538+0000 7fe9dba5e640 1 --2- 172.21.15.103:0/4053682911 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9c00052e0 0x7fe9c000b9c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.538+0000 7fe9dba5e640 1 -- 172.21.15.103:0/4053682911 >> 172.21.15.103:0/4053682911 conn(0x7fe9d40c6880 msgr2=0x7fe9d40c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:10.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.539+0000 7fe9dba5e640 1 -- 172.21.15.103:0/4053682911 shutdown_connections 2024-09-10T08:44:10.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.539+0000 7fe9dba5e640 1 -- 172.21.15.103:0/4053682911 wait complete. 2024-09-10T08:44:10.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.540+0000 7fe9dba5e640 1 Processor -- start 2024-09-10T08:44:10.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.540+0000 7fe9dba5e640 1 -- start start 2024-09-10T08:44:10.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.540+0000 7fe9dba5e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9c00052e0 0x7fe9d4154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.540+0000 7fe9dba5e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9d40c5650 0x7fe9d414d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.540+0000 7fe9dba5e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9d4156140 0x7fe9d41565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.540+0000 7fe9dba5e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d40afd30 con 0x7fe9d4156140 2024-09-10T08:44:10.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.540+0000 7fe9dba5e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d4158280 con 0x7fe9d40c5650 2024-09-10T08:44:10.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.540+0000 7fe9dba5e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe9d40afeb0 con 0x7fe9c00052e0 2024-09-10T08:44:10.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.540+0000 7fe9d9ffb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9d4156140 0x7fe9d41565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.541+0000 7fe9d9ffb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9d4156140 0x7fe9d41565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48044/0 (socket says 172.21.15.103:48044) 2024-09-10T08:44:10.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.541+0000 7fe9d9ffb640 1 -- 172.21.15.103:0/3669137673 learned_addr learned my addr 172.21.15.103:0/3669137673 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:10.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.541+0000 7fe9d97fa640 1 --2- 172.21.15.103:0/3669137673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9c00052e0 0x7fe9d4154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.541+0000 7fe9d8ff9640 1 --2- 172.21.15.103:0/3669137673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9d40c5650 0x7fe9d414d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.541+0000 7fe9d9ffb640 1 -- 172.21.15.103:0/3669137673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9c00052e0 msgr2=0x7fe9d4154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.541+0000 7fe9d9ffb640 1 --2- 172.21.15.103:0/3669137673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9c00052e0 0x7fe9d4154190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.541+0000 7fe9d9ffb640 1 -- 172.21.15.103:0/3669137673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9d40c5650 msgr2=0x7fe9d414d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.541+0000 7fe9d9ffb640 1 --2- 172.21.15.103:0/3669137673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9d40c5650 0x7fe9d414d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.541+0000 7fe9d9ffb640 1 -- 172.21.15.103:0/3669137673 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d414e8e0 con 0x7fe9d4156140 2024-09-10T08:44:10.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.541+0000 7fe9d8ff9640 1 --2- 172.21.15.103:0/3669137673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9d40c5650 0x7fe9d414d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:44:10.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.541+0000 7fe9d9ffb640 1 --2- 172.21.15.103:0/3669137673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9d4156140 0x7fe9d41565c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc02af10 tx=0x7fe9cc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:10.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.541+0000 7fe9c9ffb640 1 -- 172.21.15.103:0/3669137673 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc03f030 con 0x7fe9d4156140 2024-09-10T08:44:10.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.541+0000 7fe9c9ffb640 1 -- 172.21.15.103:0/3669137673 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9cc003990 con 0x7fe9d4156140 2024-09-10T08:44:10.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.541+0000 7fe9dba5e640 1 -- 172.21.15.103:0/3669137673 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9d41528d0 con 0x7fe9d4156140 2024-09-10T08:44:10.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.541+0000 7fe9c9ffb640 1 -- 172.21.15.103:0/3669137673 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc035070 con 0x7fe9d4156140 2024-09-10T08:44:10.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.541+0000 7fe9dba5e640 1 -- 172.21.15.103:0/3669137673 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9d414e600 con 0x7fe9d4156140 2024-09-10T08:44:10.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.542+0000 7fe9dba5e640 1 -- 172.21.15.103:0/3669137673 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9d40c7550 con 0x7fe9d4156140 2024-09-10T08:44:10.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.543+0000 7fe9c9ffb640 1 -- 172.21.15.103:0/3669137673 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe9cc042030 con 0x7fe9d4156140 2024-09-10T08:44:10.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.543+0000 7fe9c9ffb640 1 --2- 172.21.15.103:0/3669137673 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe9b806be60 0x7fe9b806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:10.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.543+0000 7fe9c9ffb640 1 -- 172.21.15.103:0/3669137673 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fe9cc0ab950 con 0x7fe9d4156140 2024-09-10T08:44:10.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.543+0000 7fe9d97fa640 1 --2- 172.21.15.103:0/3669137673 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe9b806be60 0x7fe9b806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:10.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.544+0000 7fe9d97fa640 1 --2- 172.21.15.103:0/3669137673 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe9b806be60 0x7fe9b806e320 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0001760 tx=0x7fe9d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:10.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.548+0000 7fe9c9ffb640 1 -- 172.21.15.103:0/3669137673 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe9d414e8e0 con 0x7fe9d4156140 2024-09-10T08:44:10.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.781+0000 7fe9dba5e640 1 -- 172.21.15.103:0/3669137673 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fe9d40c4510 con 0x7fe9d4156140 2024-09-10T08:44:10.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.781+0000 7fe9c9ffb640 1 -- 172.21.15.103:0/3669137673 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fe9cc0799a0 con 0x7fe9d4156140 2024-09-10T08:44:10.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.784+0000 7fe9dba5e640 1 -- 172.21.15.103:0/3669137673 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe9b806be60 msgr2=0x7fe9b806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.784+0000 7fe9dba5e640 1 --2- 172.21.15.103:0/3669137673 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe9b806be60 0x7fe9b806e320 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0001760 tx=0x7fe9d0009040 comp rx=0 tx=0).stop 2024-09-10T08:44:10.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.784+0000 7fe9dba5e640 1 -- 172.21.15.103:0/3669137673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9d4156140 msgr2=0x7fe9d41565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:10.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.784+0000 7fe9dba5e640 1 --2- 172.21.15.103:0/3669137673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9d4156140 0x7fe9d41565c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc02af10 tx=0x7fe9cc009750 comp rx=0 tx=0).stop 2024-09-10T08:44:10.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.784+0000 7fe9dba5e640 1 -- 172.21.15.103:0/3669137673 shutdown_connections 2024-09-10T08:44:10.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.784+0000 7fe9dba5e640 1 --2- 172.21.15.103:0/3669137673 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe9b806be60 0x7fe9b806e320 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.784+0000 7fe9dba5e640 1 --2- 172.21.15.103:0/3669137673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9d4156140 0x7fe9d41565c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.784+0000 7fe9dba5e640 1 --2- 172.21.15.103:0/3669137673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9d40c5650 0x7fe9d414d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.784+0000 7fe9dba5e640 1 --2- 172.21.15.103:0/3669137673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9c00052e0 0x7fe9d4154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:10.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.784+0000 7fe9dba5e640 1 -- 172.21.15.103:0/3669137673 >> 172.21.15.103:0/3669137673 conn(0x7fe9d40c6880 msgr2=0x7fe9d406ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:10.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.784+0000 7fe9dba5e640 1 -- 172.21.15.103:0/3669137673 shutdown_connections 2024-09-10T08:44:10.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:10.784+0000 7fe9dba5e640 1 -- 172.21.15.103:0/3669137673 wait complete. 2024-09-10T08:44:10.796 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-10T08:44:20.797 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:44:20.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.909+0000 7f3f87766640 1 Processor -- start 2024-09-10T08:44:20.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.909+0000 7f3f87766640 1 -- start start 2024-09-10T08:44:20.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.910+0000 7f3f87766640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f8015a450 0x7f3f800c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:20.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.910+0000 7f3f87766640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3f800c3fd0 0x7f3f8006e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:20.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.910+0000 7f3f87766640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f8015a830 con 0x7f3f800c84e0 2024-09-10T08:44:20.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.910+0000 7f3f87766640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3f8006e240 con 0x7f3f800c3fd0 2024-09-10T08:44:20.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.910+0000 7f3f87766640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3f800c7490 con 0x7f3f8015a450 2024-09-10T08:44:20.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.910+0000 7f3f84d01640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3f800c3fd0 0x7f3f8006e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:20.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.910+0000 7f3f85502640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f8015a450 0x7f3f800c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:20.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.910+0000 7f3f85502640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f8015a450 0x7f3f800c3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:60920/0 (socket says 172.21.15.103:60920) 2024-09-10T08:44:20.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.910+0000 7f3f84d01640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3f800c3fd0 0x7f3f8006e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:39074/0 (socket says 172.21.15.103:39074) 2024-09-10T08:44:20.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.910+0000 7f3f85502640 1 -- 172.21.15.103:0/1249923598 learned_addr learned my addr 172.21.15.103:0/1249923598 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:20.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.910+0000 7f3f84d01640 1 -- 172.21.15.103:0/1249923598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f8015a450 msgr2=0x7f3f800c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:20.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.910+0000 7f3f84d01640 1 --2- 172.21.15.103:0/1249923598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f8015a450 0x7f3f800c3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:20.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.910+0000 7f3f84d01640 1 -- 172.21.15.103:0/1249923598 >> v1:172.21.15.154:6789/0 conn(0x7f3f800c84e0 legacy=0x7f3f8006ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:20.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.910+0000 7f3f84d01640 1 -- 172.21.15.103:0/1249923598 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f800c7770 con 0x7f3f800c3fd0 2024-09-10T08:44:20.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.910+0000 7f3f85502640 1 --2- 172.21.15.103:0/1249923598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f8015a450 0x7f3f800c3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:44:20.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.911+0000 7f3f84d01640 1 --2- 172.21.15.103:0/1249923598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f800c3fd0 0x7f3f8006e6d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f700097a0 tx=0x7f3f7002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c0e38ada31e2d33 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:20.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.911+0000 7f3f77fff640 1 -- 172.21.15.103:0/1249923598 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f70037070 con 0x7f3f800c3fd0 2024-09-10T08:44:20.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.911+0000 7f3f77fff640 1 -- 172.21.15.103:0/1249923598 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f70032440 con 0x7f3f800c3fd0 2024-09-10T08:44:20.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.911+0000 7f3f77fff640 1 -- 172.21.15.103:0/1249923598 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f70032810 con 0x7f3f800c3fd0 2024-09-10T08:44:20.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.912+0000 7f3f87766640 1 -- 172.21.15.103:0/1249923598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f800c3fd0 msgr2=0x7f3f8006e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:20.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.912+0000 7f3f87766640 1 --2- 172.21.15.103:0/1249923598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f800c3fd0 0x7f3f8006e6d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f700097a0 tx=0x7f3f7002a180 comp rx=0 tx=0).stop 2024-09-10T08:44:20.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.912+0000 7f3f87766640 1 -- 172.21.15.103:0/1249923598 shutdown_connections 2024-09-10T08:44:20.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.912+0000 7f3f87766640 1 --2- 172.21.15.103:0/1249923598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f800c3fd0 0x7f3f8006e6d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:20.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.912+0000 7f3f87766640 1 --2- 172.21.15.103:0/1249923598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f8015a450 0x7f3f800c3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:20.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.912+0000 7f3f87766640 1 -- 172.21.15.103:0/1249923598 >> 172.21.15.103:0/1249923598 conn(0x7f3f800c5660 msgr2=0x7f3f800c5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:20.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.912+0000 7f3f87766640 1 -- 172.21.15.103:0/1249923598 shutdown_connections 2024-09-10T08:44:20.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.912+0000 7f3f87766640 1 -- 172.21.15.103:0/1249923598 wait complete. 2024-09-10T08:44:20.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.913+0000 7f3f87766640 1 Processor -- start 2024-09-10T08:44:20.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.913+0000 7f3f87766640 1 -- start start 2024-09-10T08:44:20.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.914+0000 7f3f87766640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f800c3fd0 0x7f3f8009cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.914+0000 7f3f87766640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f800c84e0 0x7f3f800ad790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.914+0000 7f3f87766640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f8015a450 0x7f3f800adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.914+0000 7f3f87766640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8006f320 con 0x7f3f800c3fd0 2024-09-10T08:44:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.914+0000 7f3f87766640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3f800c7d30 con 0x7f3f8015a450 2024-09-10T08:44:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.914+0000 7f3f87766640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3f800c70d0 con 0x7f3f800c84e0 2024-09-10T08:44:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.914+0000 7f3f85502640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f800c3fd0 0x7f3f8009cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.914+0000 7f3f85502640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f800c3fd0 0x7f3f8009cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50404/0 (socket says 172.21.15.103:50404) 2024-09-10T08:44:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.914+0000 7f3f85502640 1 -- 172.21.15.103:0/971378272 learned_addr learned my addr 172.21.15.103:0/971378272 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.914+0000 7f3f84d01640 1 --2- 172.21.15.103:0/971378272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f800c84e0 0x7f3f800ad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.914+0000 7f3f85d03640 1 --2- 172.21.15.103:0/971378272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f8015a450 0x7f3f800adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.914+0000 7f3f85502640 1 -- 172.21.15.103:0/971378272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f800c84e0 msgr2=0x7f3f800ad790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.914+0000 7f3f85502640 1 --2- 172.21.15.103:0/971378272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f800c84e0 0x7f3f800ad790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:20.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.914+0000 7f3f85502640 1 -- 172.21.15.103:0/971378272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f8015a450 msgr2=0x7f3f800adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:20.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.914+0000 7f3f85502640 1 --2- 172.21.15.103:0/971378272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f8015a450 0x7f3f800adcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:20.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.914+0000 7f3f85502640 1 -- 172.21.15.103:0/971378272 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f80157420 con 0x7f3f800c3fd0 2024-09-10T08:44:20.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.915+0000 7f3f85502640 1 --2- 172.21.15.103:0/971378272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f800c3fd0 0x7f3f8009cc70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00e9b0 tx=0x7f3f7c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:20.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.915+0000 7f3f75ffb640 1 -- 172.21.15.103:0/971378272 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c017070 con 0x7f3f800c3fd0 2024-09-10T08:44:20.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.915+0000 7f3f75ffb640 1 -- 172.21.15.103:0/971378272 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f7c00c9a0 con 0x7f3f800c3fd0 2024-09-10T08:44:20.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.915+0000 7f3f75ffb640 1 -- 172.21.15.103:0/971378272 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c00cd50 con 0x7f3f800c3fd0 2024-09-10T08:44:20.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.915+0000 7f3f87766640 1 -- 172.21.15.103:0/971378272 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f801ec330 con 0x7f3f800c3fd0 2024-09-10T08:44:20.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.915+0000 7f3f87766640 1 -- 172.21.15.103:0/971378272 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f801ec040 con 0x7f3f800c3fd0 2024-09-10T08:44:20.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.916+0000 7f3f87766640 1 -- 172.21.15.103:0/971378272 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f8006c5c0 con 0x7f3f800c3fd0 2024-09-10T08:44:20.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.917+0000 7f3f75ffb640 1 -- 172.21.15.103:0/971378272 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f7c01a070 con 0x7f3f800c3fd0 2024-09-10T08:44:20.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.917+0000 7f3f75ffb640 1 --2- 172.21.15.103:0/971378272 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3f6406be30 0x7f3f6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:20.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.917+0000 7f3f75ffb640 1 -- 172.21.15.103:0/971378272 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f3f7c08b3a0 con 0x7f3f800c3fd0 2024-09-10T08:44:20.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.917+0000 7f3f84d01640 1 --2- 172.21.15.103:0/971378272 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3f6406be30 0x7f3f6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:20.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.918+0000 7f3f84d01640 1 --2- 172.21.15.103:0/971378272 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3f6406be30 0x7f3f6406e2f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3f70034000 tx=0x7f3f7002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:20.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:20.922+0000 7f3f75ffb640 1 -- 172.21.15.103:0/971378272 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3f7c059370 con 0x7f3f800c3fd0 2024-09-10T08:44:21.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.120+0000 7f3f87766640 1 -- 172.21.15.103:0/971378272 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f801eca30 con 0x7f3f800c3fd0 2024-09-10T08:44:21.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.121+0000 7f3f75ffb640 1 -- 172.21.15.103:0/971378272 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6536 (secure 0 0 0) 0x7f3f7c05d670 con 0x7f3f800c3fd0 2024-09-10T08:44:21.122 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:44:21.122 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":11,"btime":"2024-09-10T08:28:50:632324+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3378269214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3378269214},{"type":"v1","addr":"172.21.15.154:6833","nonce":3378269214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2141115327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2141115327},{"type":"v1","addr":"172.21.15.154:6835","nonce":2141115327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:34.885455+0000","modified":"2024-09-10T08:28:37.905202+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/3032037784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":3032037784},{"type":"v1","addr":"172.21.15.103:6837","nonce":3032037784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:46.949092+0000","modified":"2024-09-10T08:28:49.966725+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.103:6836/2250136134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2250136134},{"type":"v1","addr":"172.21.15.103:6836","nonce":2250136134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":2}]} 2024-09-10T08:44:21.122 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 11 2024-09-10T08:44:21.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.123+0000 7f3f87766640 1 -- 172.21.15.103:0/971378272 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3f6406be30 msgr2=0x7f3f6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:21.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.123+0000 7f3f87766640 1 --2- 172.21.15.103:0/971378272 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3f6406be30 0x7f3f6406e2f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3f70034000 tx=0x7f3f7002e000 comp rx=0 tx=0).stop 2024-09-10T08:44:21.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.123+0000 7f3f87766640 1 -- 172.21.15.103:0/971378272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f800c3fd0 msgr2=0x7f3f8009cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:21.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.123+0000 7f3f87766640 1 --2- 172.21.15.103:0/971378272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f800c3fd0 0x7f3f8009cc70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00e9b0 tx=0x7f3f7c00ee70 comp rx=0 tx=0).stop 2024-09-10T08:44:21.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.123+0000 7f3f87766640 1 -- 172.21.15.103:0/971378272 shutdown_connections 2024-09-10T08:44:21.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.123+0000 7f3f87766640 1 --2- 172.21.15.103:0/971378272 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3f6406be30 0x7f3f6406e2f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.123+0000 7f3f87766640 1 --2- 172.21.15.103:0/971378272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f8015a450 0x7f3f800adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.123+0000 7f3f87766640 1 --2- 172.21.15.103:0/971378272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3f800c84e0 0x7f3f800ad790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.123+0000 7f3f87766640 1 --2- 172.21.15.103:0/971378272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f800c3fd0 0x7f3f8009cc70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.123+0000 7f3f87766640 1 -- 172.21.15.103:0/971378272 >> 172.21.15.103:0/971378272 conn(0x7f3f800c5660 msgr2=0x7f3f8006f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:21.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.123+0000 7f3f87766640 1 -- 172.21.15.103:0/971378272 shutdown_connections 2024-09-10T08:44:21.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.123+0000 7f3f87766640 1 -- 172.21.15.103:0/971378272 wait complete. 2024-09-10T08:44:21.135 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-10T08:44:21.136 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T08:44:21.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.233+0000 7fc3fac2e640 1 Processor -- start 2024-09-10T08:44:21.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.233+0000 7fc3fac2e640 1 -- start start 2024-09-10T08:44:21.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.233+0000 7fc3fac2e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3f40a7de0 0x7fc3f415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:21.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.233+0000 7fc3fac2e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc3f4074590 0x7fc3f406cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:21.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.233+0000 7fc3fac2e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3f4156dd0 con 0x7fc3f4153b10 2024-09-10T08:44:21.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.233+0000 7fc3fac2e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fc3f4157350 con 0x7fc3f4074590 2024-09-10T08:44:21.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.233+0000 7fc3fac2e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc3f4159e50 con 0x7fc3f40a7de0 2024-09-10T08:44:21.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.234+0000 7fc3f91cb640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc3f4074590 0x7fc3f406cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:21.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.234+0000 7fc3f89ca640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc3f4153b10 0x7fc3f40a9700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46436/0 (socket says 172.21.15.103:46436) 2024-09-10T08:44:21.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.234+0000 7fc3f89ca640 1 -- 172.21.15.103:0/1775936391 learned_addr learned my addr 172.21.15.103:0/1775936391 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:44:21.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.234+0000 7fc3f3fff640 1 --2- 172.21.15.103:0/1775936391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3f40a7de0 0x7fc3f415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:21.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.234+0000 7fc3f91cb640 1 -- 172.21.15.103:0/1775936391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3f40a7de0 msgr2=0x7fc3f415a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:21.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.234+0000 7fc3f91cb640 1 --2- 172.21.15.103:0/1775936391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3f40a7de0 0x7fc3f415a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.234+0000 7fc3f91cb640 1 -- 172.21.15.103:0/1775936391 >> v1:172.21.15.103:6789/0 conn(0x7fc3f4153b10 legacy=0x7fc3f40a9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:21.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.234+0000 7fc3f91cb640 1 -- 172.21.15.103:0/1775936391 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f4157070 con 0x7fc3f4074590 2024-09-10T08:44:21.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.234+0000 7fc3f37fe640 1 -- 172.21.15.103:0/1775936391 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4213113402 0 0) 0x7fc3f4156dd0 con 0x7fc3f4153b10 2024-09-10T08:44:21.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.234+0000 7fc3f3fff640 1 --2- 172.21.15.103:0/1775936391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3f40a7de0 0x7fc3f415a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:44:21.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.235+0000 7fc3f91cb640 1 --2- 172.21.15.103:0/1775936391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3f4074590 0x7fc3f406cf40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0097d0 tx=0x7fc3dc02a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b617dd98d96742c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:21.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.235+0000 7fc3f37fe640 1 -- 172.21.15.103:0/1775936391 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc037070 con 0x7fc3f4074590 2024-09-10T08:44:21.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.235+0000 7fc3f37fe640 1 -- 172.21.15.103:0/1775936391 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3dc02adb0 con 0x7fc3f4074590 2024-09-10T08:44:21.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.235+0000 7fc3f37fe640 1 -- 172.21.15.103:0/1775936391 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc032660 con 0x7fc3f4074590 2024-09-10T08:44:21.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.235+0000 7fc3fac2e640 1 -- 172.21.15.103:0/1775936391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3f4074590 msgr2=0x7fc3f406cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:21.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.235+0000 7fc3fac2e640 1 --2- 172.21.15.103:0/1775936391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3f4074590 0x7fc3f406cf40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0097d0 tx=0x7fc3dc02a0a0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.235+0000 7fc3fac2e640 1 -- 172.21.15.103:0/1775936391 shutdown_connections 2024-09-10T08:44:21.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.235+0000 7fc3fac2e640 1 --2- 172.21.15.103:0/1775936391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3f4074590 0x7fc3f406cf40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.235+0000 7fc3fac2e640 1 --2- 172.21.15.103:0/1775936391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3f40a7de0 0x7fc3f415a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.235+0000 7fc3fac2e640 1 -- 172.21.15.103:0/1775936391 >> 172.21.15.103:0/1775936391 conn(0x7fc3f40c4fa0 msgr2=0x7fc3f40c5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:21.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.235+0000 7fc3fac2e640 1 -- 172.21.15.103:0/1775936391 shutdown_connections 2024-09-10T08:44:21.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.235+0000 7fc3fac2e640 1 -- 172.21.15.103:0/1775936391 wait complete. 2024-09-10T08:44:21.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.236+0000 7fc3fac2e640 1 Processor -- start 2024-09-10T08:44:21.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.236+0000 7fc3fac2e640 1 -- start start 2024-09-10T08:44:21.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.237+0000 7fc3fac2e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3f4074590 0x7fc3f4149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:21.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.237+0000 7fc3fac2e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3f40a7de0 0x7fc3f41e1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:21.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.237+0000 7fc3fac2e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3f4153b10 0x7fc3f40c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:21.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.237+0000 7fc3fac2e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f4153ef0 con 0x7fc3f4074590 2024-09-10T08:44:21.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.237+0000 7fc3fac2e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f415a820 con 0x7fc3f4153b10 2024-09-10T08:44:21.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.237+0000 7fc3fac2e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fc3f406db80 con 0x7fc3f40a7de0 2024-09-10T08:44:21.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.237+0000 7fc3f89ca640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3f4074590 0x7fc3f4149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:21.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.237+0000 7fc3f89ca640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3f4074590 0x7fc3f4149840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50434/0 (socket says 172.21.15.103:50434) 2024-09-10T08:44:21.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.237+0000 7fc3f89ca640 1 -- 172.21.15.103:0/3548982033 learned_addr learned my addr 172.21.15.103:0/3548982033 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:21.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.238+0000 7fc3f91cb640 1 --2- 172.21.15.103:0/3548982033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3f4153b10 0x7fc3f40c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:21.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.238+0000 7fc3f3fff640 1 --2- 172.21.15.103:0/3548982033 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3f40a7de0 0x7fc3f41e1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:21.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.238+0000 7fc3f89ca640 1 -- 172.21.15.103:0/3548982033 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3f40a7de0 msgr2=0x7fc3f41e1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:21.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.238+0000 7fc3f89ca640 1 --2- 172.21.15.103:0/3548982033 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3f40a7de0 0x7fc3f41e1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.238+0000 7fc3f89ca640 1 -- 172.21.15.103:0/3548982033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3f4153b10 msgr2=0x7fc3f40c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:21.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.238+0000 7fc3f89ca640 1 --2- 172.21.15.103:0/3548982033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3f4153b10 0x7fc3f40c7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.238+0000 7fc3f89ca640 1 -- 172.21.15.103:0/3548982033 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f41ef390 con 0x7fc3f4074590 2024-09-10T08:44:21.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.238+0000 7fc3f89ca640 1 --2- 172.21.15.103:0/3548982033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3f4074590 0x7fc3f4149840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00c430 tx=0x7fc3ec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:21.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.238+0000 7fc3f17fa640 1 -- 172.21.15.103:0/3548982033 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec0074e0 con 0x7fc3f4074590 2024-09-10T08:44:21.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.238+0000 7fc3f17fa640 1 -- 172.21.15.103:0/3548982033 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3ec0047e0 con 0x7fc3f4074590 2024-09-10T08:44:21.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.238+0000 7fc3fac2e640 1 -- 172.21.15.103:0/3548982033 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3f41ef670 con 0x7fc3f4074590 2024-09-10T08:44:21.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.238+0000 7fc3f17fa640 1 -- 172.21.15.103:0/3548982033 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec004bd0 con 0x7fc3f4074590 2024-09-10T08:44:21.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.238+0000 7fc3fac2e640 1 -- 172.21.15.103:0/3548982033 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3f41efc30 con 0x7fc3f4074590 2024-09-10T08:44:21.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.239+0000 7fc3fac2e640 1 -- 172.21.15.103:0/3548982033 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3f41511f0 con 0x7fc3f4074590 2024-09-10T08:44:21.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.239+0000 7fc3f17fa640 1 -- 172.21.15.103:0/3548982033 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc3ec011070 con 0x7fc3f4074590 2024-09-10T08:44:21.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.240+0000 7fc3f17fa640 1 --2- 172.21.15.103:0/3548982033 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc3d406be30 0x7fc3d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:21.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.240+0000 7fc3f17fa640 1 -- 172.21.15.103:0/3548982033 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fc3ec08ae30 con 0x7fc3f4074590 2024-09-10T08:44:21.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.240+0000 7fc3f3fff640 1 --2- 172.21.15.103:0/3548982033 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc3d406be30 0x7fc3d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:21.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.240+0000 7fc3f3fff640 1 --2- 172.21.15.103:0/3548982033 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc3d406be30 0x7fc3d406e2f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4155f50 tx=0x7fc3e40039f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:21.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.244+0000 7fc3f17fa640 1 -- 172.21.15.103:0/3548982033 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc3ec00e280 con 0x7fc3f4074590 2024-09-10T08:44:21.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.474+0000 7fc3fac2e640 1 -- 172.21.15.103:0/3548982033 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc3f4067bb0 con 0x7fc3f4074590 2024-09-10T08:44:21.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.474+0000 7fc3f17fa640 1 -- 172.21.15.103:0/3548982033 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1570 (secure 0 0 0) 0x7fc3ec0594d0 con 0x7fc3f4074590 2024-09-10T08:44:21.475 INFO:teuthology.orchestra.run.smithi103.stdout:{"election_epoch":124,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","modified":"2024-09-10T08:27:30.229267Z","created":"2024-09-10T08:27:30.229267Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T08:44:21.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.476+0000 7fc3fac2e640 1 -- 172.21.15.103:0/3548982033 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc3d406be30 msgr2=0x7fc3d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:21.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.476+0000 7fc3fac2e640 1 --2- 172.21.15.103:0/3548982033 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc3d406be30 0x7fc3d406e2f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4155f50 tx=0x7fc3e40039f0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.476+0000 7fc3fac2e640 1 -- 172.21.15.103:0/3548982033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3f4074590 msgr2=0x7fc3f4149840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:21.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.476+0000 7fc3fac2e640 1 --2- 172.21.15.103:0/3548982033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3f4074590 0x7fc3f4149840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00c430 tx=0x7fc3ec00c8f0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.476+0000 7fc3fac2e640 1 -- 172.21.15.103:0/3548982033 shutdown_connections 2024-09-10T08:44:21.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.476+0000 7fc3fac2e640 1 --2- 172.21.15.103:0/3548982033 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fc3d406be30 0x7fc3d406e2f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.476+0000 7fc3fac2e640 1 --2- 172.21.15.103:0/3548982033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3f4153b10 0x7fc3f40c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.476+0000 7fc3fac2e640 1 --2- 172.21.15.103:0/3548982033 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3f40a7de0 0x7fc3f41e1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.476+0000 7fc3fac2e640 1 --2- 172.21.15.103:0/3548982033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3f4074590 0x7fc3f4149840 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.476+0000 7fc3fac2e640 1 -- 172.21.15.103:0/3548982033 >> 172.21.15.103:0/3548982033 conn(0x7fc3f40c4fa0 msgr2=0x7fc3f41541c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:21.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.476+0000 7fc3fac2e640 1 -- 172.21.15.103:0/3548982033 shutdown_connections 2024-09-10T08:44:21.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.476+0000 7fc3fac2e640 1 -- 172.21.15.103:0/3548982033 wait complete. 2024-09-10T08:44:21.488 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-10T08:44:21.488 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-10T08:44:21.498 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-10T08:44:21.498 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:44:21.498 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:44:21.521 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:44:21.521 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:44:21.578 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:44:21.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.717+0000 7f5d60fd8640 1 Processor -- start 2024-09-10T08:44:21.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.717+0000 7f5d60fd8640 1 -- start start 2024-09-10T08:44:21.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.718+0000 7f5d60fd8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d5c151840 0x7f5d5c0ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:21.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.718+0000 7f5d60fd8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5d5c0ad340 0x7f5d5c0c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:21.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.718+0000 7f5d60fd8640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d5c154330 con 0x7f5d5c0c3830 2024-09-10T08:44:21.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.718+0000 7f5d60fd8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f5d5c1550f0 con 0x7f5d5c0ad340 2024-09-10T08:44:21.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.718+0000 7f5d60fd8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5d5c154610 con 0x7f5d5c151840 2024-09-10T08:44:21.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.718+0000 7f5d53fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5d5c0ad340 0x7f5d5c0c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:21.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.718+0000 7f5d53fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5d5c0ad340 0x7f5d5c0c32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50448/0 (socket says 172.21.15.103:50448) 2024-09-10T08:44:21.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.718+0000 7f5d5ad9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5d5c0c3830 0x7f5d5c0c44d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46444/0 (socket says 172.21.15.103:46444) 2024-09-10T08:44:21.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.718+0000 7f5d53fff640 1 -- 172.21.15.103:0/186784376 learned_addr learned my addr 172.21.15.103:0/186784376 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:21.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.718+0000 7f5d5a59c640 1 --2- 172.21.15.103:0/186784376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d5c151840 0x7f5d5c0ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:21.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.718+0000 7f5d53fff640 1 -- 172.21.15.103:0/186784376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d5c151840 msgr2=0x7f5d5c0ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:21.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.718+0000 7f5d53fff640 1 --2- 172.21.15.103:0/186784376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d5c151840 0x7f5d5c0ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.718+0000 7f5d53fff640 1 -- 172.21.15.103:0/186784376 >> v1:172.21.15.103:6789/0 conn(0x7f5d5c0c3830 legacy=0x7f5d5c0c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:21.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.718+0000 7f5d53fff640 1 -- 172.21.15.103:0/186784376 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d5c1548f0 con 0x7f5d5c0ad340 2024-09-10T08:44:21.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.718+0000 7f5d59d9b640 1 -- 172.21.15.103:0/186784376 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2237307461 0 0) 0x7f5d5c154330 con 0x7f5d5c0c3830 2024-09-10T08:44:21.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.719+0000 7f5d53fff640 1 --2- 172.21.15.103:0/186784376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d5c0ad340 0x7f5d5c0c32f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009870 tx=0x7f5d4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af5b51ea6b5a5ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:21.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.719+0000 7f5d59d9b640 1 -- 172.21.15.103:0/186784376 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d44037070 con 0x7f5d5c0ad340 2024-09-10T08:44:21.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.719+0000 7f5d59d9b640 1 -- 172.21.15.103:0/186784376 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d44032440 con 0x7f5d5c0ad340 2024-09-10T08:44:21.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.719+0000 7f5d59d9b640 1 -- 172.21.15.103:0/186784376 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d44032810 con 0x7f5d5c0ad340 2024-09-10T08:44:21.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.719+0000 7f5d60fd8640 1 -- 172.21.15.103:0/186784376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d5c0ad340 msgr2=0x7f5d5c0c32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:21.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.719+0000 7f5d60fd8640 1 --2- 172.21.15.103:0/186784376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d5c0ad340 0x7f5d5c0c32f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009870 tx=0x7f5d4402a270 comp rx=0 tx=0).stop 2024-09-10T08:44:21.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.720+0000 7f5d60fd8640 1 -- 172.21.15.103:0/186784376 shutdown_connections 2024-09-10T08:44:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.720+0000 7f5d60fd8640 1 --2- 172.21.15.103:0/186784376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d5c0ad340 0x7f5d5c0c32f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.720+0000 7f5d60fd8640 1 --2- 172.21.15.103:0/186784376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d5c151840 0x7f5d5c0ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.720+0000 7f5d60fd8640 1 -- 172.21.15.103:0/186784376 >> 172.21.15.103:0/186784376 conn(0x7f5d5c0c7a40 msgr2=0x7f5d5c0c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.720+0000 7f5d60fd8640 1 -- 172.21.15.103:0/186784376 shutdown_connections 2024-09-10T08:44:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.720+0000 7f5d60fd8640 1 -- 172.21.15.103:0/186784376 wait complete. 2024-09-10T08:44:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.721+0000 7f5d60fd8640 1 Processor -- start 2024-09-10T08:44:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.721+0000 7f5d60fd8640 1 -- start start 2024-09-10T08:44:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.721+0000 7f5d60fd8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d5c0ad340 0x7f5d5c0c10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.721+0000 7f5d60fd8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d5c0c3830 0x7f5d5c1ebf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.721+0000 7f5d60fd8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d5c151840 0x7f5d5c1ec460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.721+0000 7f5d60fd8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5d5c06e030 con 0x7f5d5c0ad340 2024-09-10T08:44:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.721+0000 7f5d60fd8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5d5c06dda0 con 0x7f5d5c0c3830 2024-09-10T08:44:21.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.721+0000 7f5d60fd8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5d5c06e1b0 con 0x7f5d5c151840 2024-09-10T08:44:21.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.722+0000 7f5d5a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d5c0ad340 0x7f5d5c0c10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:21.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.722+0000 7f5d5a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d5c0ad340 0x7f5d5c0c10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50452/0 (socket says 172.21.15.103:50452) 2024-09-10T08:44:21.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.722+0000 7f5d5a59c640 1 -- 172.21.15.103:0/3882715587 learned_addr learned my addr 172.21.15.103:0/3882715587 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:21.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.722+0000 7f5d53fff640 1 --2- 172.21.15.103:0/3882715587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d5c0c3830 0x7f5d5c1ebf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:21.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.722+0000 7f5d5ad9d640 1 --2- 172.21.15.103:0/3882715587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d5c151840 0x7f5d5c1ec460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:21.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.722+0000 7f5d5a59c640 1 -- 172.21.15.103:0/3882715587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d5c151840 msgr2=0x7f5d5c1ec460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:21.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.722+0000 7f5d5a59c640 1 --2- 172.21.15.103:0/3882715587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d5c151840 0x7f5d5c1ec460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.722+0000 7f5d5a59c640 1 -- 172.21.15.103:0/3882715587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d5c0c3830 msgr2=0x7f5d5c1ebf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:21.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.722+0000 7f5d5a59c640 1 --2- 172.21.15.103:0/3882715587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d5c0c3830 0x7f5d5c1ebf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.722+0000 7f5d5a59c640 1 -- 172.21.15.103:0/3882715587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d5c1f0390 con 0x7f5d5c0ad340 2024-09-10T08:44:21.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.722+0000 7f5d5a59c640 1 --2- 172.21.15.103:0/3882715587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d5c0ad340 0x7f5d5c0c10e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c00d5f0 tx=0x7f5d4c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:21.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.722+0000 7f5d52ffd640 1 -- 172.21.15.103:0/3882715587 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c0125f0 con 0x7f5d5c0ad340 2024-09-10T08:44:21.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.722+0000 7f5d52ffd640 1 -- 172.21.15.103:0/3882715587 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d4c019070 con 0x7f5d5c0ad340 2024-09-10T08:44:21.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.722+0000 7f5d60fd8640 1 -- 172.21.15.103:0/3882715587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d5c147f00 con 0x7f5d5c0ad340 2024-09-10T08:44:21.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.722+0000 7f5d52ffd640 1 -- 172.21.15.103:0/3882715587 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c0129d0 con 0x7f5d5c0ad340 2024-09-10T08:44:21.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.722+0000 7f5d60fd8640 1 -- 172.21.15.103:0/3882715587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d5c0c1620 con 0x7f5d5c0ad340 2024-09-10T08:44:21.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.723+0000 7f5d60fd8640 1 -- 172.21.15.103:0/3882715587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d5c1efea0 con 0x7f5d5c0ad340 2024-09-10T08:44:21.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.724+0000 7f5d52ffd640 1 -- 172.21.15.103:0/3882715587 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d4c012b70 con 0x7f5d5c0ad340 2024-09-10T08:44:21.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.724+0000 7f5d52ffd640 1 --2- 172.21.15.103:0/3882715587 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5d3c06be30 0x7f5d3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:21.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.724+0000 7f5d52ffd640 1 -- 172.21.15.103:0/3882715587 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f5d4c08b560 con 0x7f5d5c0ad340 2024-09-10T08:44:21.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.724+0000 7f5d53fff640 1 --2- 172.21.15.103:0/3882715587 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5d3c06be30 0x7f5d3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:21.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.724+0000 7f5d53fff640 1 --2- 172.21.15.103:0/3882715587 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5d3c06be30 0x7f5d3c06e2f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5d44034000 tx=0x7f5d4402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:21.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.728+0000 7f5d52ffd640 1 -- 172.21.15.103:0/3882715587 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5d4c059c00 con 0x7f5d5c0ad340 2024-09-10T08:44:21.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.905+0000 7f5d60fd8640 1 -- 172.21.15.103:0/3882715587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5d5c151c20 con 0x7f5d5c0ad340 2024-09-10T08:44:21.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.905+0000 7f5d52ffd640 1 -- 172.21.15.103:0/3882715587 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f5d4c059500 con 0x7f5d5c0ad340 2024-09-10T08:44:21.906 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-10T08:44:21.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.907+0000 7f5d60fd8640 1 -- 172.21.15.103:0/3882715587 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5d3c06be30 msgr2=0x7f5d3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:21.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.907+0000 7f5d60fd8640 1 --2- 172.21.15.103:0/3882715587 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5d3c06be30 0x7f5d3c06e2f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5d44034000 tx=0x7f5d4402e000 comp rx=0 tx=0).stop 2024-09-10T08:44:21.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.907+0000 7f5d60fd8640 1 -- 172.21.15.103:0/3882715587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d5c0ad340 msgr2=0x7f5d5c0c10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:21.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.907+0000 7f5d60fd8640 1 --2- 172.21.15.103:0/3882715587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d5c0ad340 0x7f5d5c0c10e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c00d5f0 tx=0x7f5d4c00dab0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.907+0000 7f5d60fd8640 1 -- 172.21.15.103:0/3882715587 shutdown_connections 2024-09-10T08:44:21.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.907+0000 7f5d60fd8640 1 --2- 172.21.15.103:0/3882715587 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5d3c06be30 0x7f5d3c06e2f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.907+0000 7f5d60fd8640 1 --2- 172.21.15.103:0/3882715587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d5c151840 0x7f5d5c1ec460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.907+0000 7f5d60fd8640 1 --2- 172.21.15.103:0/3882715587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d5c0c3830 0x7f5d5c1ebf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.907+0000 7f5d60fd8640 1 --2- 172.21.15.103:0/3882715587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d5c0ad340 0x7f5d5c0c10e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:21.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.907+0000 7f5d60fd8640 1 -- 172.21.15.103:0/3882715587 >> 172.21.15.103:0/3882715587 conn(0x7f5d5c0c7a40 msgr2=0x7f5d5c0c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:21.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.908+0000 7f5d60fd8640 1 -- 172.21.15.103:0/3882715587 shutdown_connections 2024-09-10T08:44:21.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:21.908+0000 7f5d60fd8640 1 -- 172.21.15.103:0/3882715587 wait complete. 2024-09-10T08:44:21.920 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-10T08:44:21.920 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:44:21.936 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:44:22.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.075+0000 7f20dafbd640 1 Processor -- start 2024-09-10T08:44:22.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.075+0000 7f20dafbd640 1 -- start start 2024-09-10T08:44:22.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.076+0000 7f20dafbd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f20d4157c90 0x7f20d40c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:22.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.076+0000 7f20dafbd640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d40741e0 con 0x7f20d40c9860 2024-09-10T08:44:22.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.076+0000 7f20dafbd640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d40c4820 con 0x7f20d41578b0 2024-09-10T08:44:22.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.076+0000 7f20dafbd640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f20d4073f90 con 0x7f20d4157c90 2024-09-10T08:44:22.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.076+0000 7f20cbfff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f20d40c9860 0x7f20d40c8840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:46446/0 (socket says 172.21.15.103:46446) 2024-09-10T08:44:22.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.076+0000 7f20cbfff640 1 -- 172.21.15.103:0/4007434153 learned_addr learned my addr 172.21.15.103:0/4007434153 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:44:22.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.076+0000 7f20d955a640 1 --2- 172.21.15.103:0/4007434153 >> v2:172.21.15.154:3300/0 conn(0x7f20d4157c90 0x7f20d40c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:22.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.076+0000 7f20cb7fe640 1 -- 172.21.15.103:0/4007434153 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 983284371 0 0) 0x7f20d40741e0 con 0x7f20d40c9860 2024-09-10T08:44:22.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.076+0000 7f20cb7fe640 1 -- 172.21.15.103:0/4007434153 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20bc003520 con 0x7f20d40c9860 2024-09-10T08:44:22.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.076+0000 7f20cb7fe640 1 -- 172.21.15.103:0/4007434153 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2241723229 0 0) 0x7f20bc003520 con 0x7f20d40c9860 2024-09-10T08:44:22.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.076+0000 7f20cb7fe640 1 -- 172.21.15.103:0/4007434153 >> v2:172.21.15.154:3300/0 conn(0x7f20d4157c90 msgr2=0x7f20d40c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:22.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.076+0000 7f20cb7fe640 1 --2- 172.21.15.103:0/4007434153 >> v2:172.21.15.154:3300/0 conn(0x7f20d4157c90 0x7f20d40c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:22.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.077+0000 7f20cb7fe640 1 -- 172.21.15.103:0/4007434153 >> v1:172.21.15.154:6789/0 conn(0x7f20d41578b0 legacy=0x7f20d41513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:22.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.077+0000 7f20cb7fe640 1 -- 172.21.15.103:0/4007434153 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d40c9490 con 0x7f20d40c9860 2024-09-10T08:44:22.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.077+0000 7f20cb7fe640 1 -- 172.21.15.103:0/4007434153 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f20c4001670 con 0x7f20d40c9860 2024-09-10T08:44:22.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.077+0000 7f20cb7fe640 1 -- 172.21.15.103:0/4007434153 >> v1:172.21.15.103:6789/0 conn(0x7f20d40c9860 legacy=0x7f20d40c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:22.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.077+0000 7f20cb7fe640 1 --2- 172.21.15.103:0/4007434153 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20bc0039b0 0x7f20bc003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:22.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.077+0000 7f20cb7fe640 1 --2- 172.21.15.103:0/4007434153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20bc004800 0x7f20bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:22.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.077+0000 7f20cb7fe640 1 --2- 172.21.15.103:0/4007434153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20bc0052e0 0x7f20bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:22.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.077+0000 7f20cb7fe640 1 -- 172.21.15.103:0/4007434153 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f20d4073f90 con 0x7f20bc004800 2024-09-10T08:44:22.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.077+0000 7f20cb7fe640 1 -- 172.21.15.103:0/4007434153 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc00c1b0 con 0x7f20bc0052e0 2024-09-10T08:44:22.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.077+0000 7f20cb7fe640 1 -- 172.21.15.103:0/4007434153 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f20bc00c3b0 con 0x7f20bc0039b0 2024-09-10T08:44:22.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.077+0000 7f20cbfff640 1 --2- 172.21.15.103:0/4007434153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20bc004800 0x7f20bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:22.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.077+0000 7f20d955a640 1 --2- 172.21.15.103:0/4007434153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20bc0052e0 0x7f20bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:22.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.077+0000 7f20d8d59640 1 --2- 172.21.15.103:0/4007434153 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20bc0039b0 0x7f20bc003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:22.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.077+0000 7f20cbfff640 1 -- 172.21.15.103:0/4007434153 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20bc0039b0 msgr2=0x7f20bc003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:22.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.077+0000 7f20cbfff640 1 --2- 172.21.15.103:0/4007434153 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20bc0039b0 0x7f20bc003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:22.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.077+0000 7f20cbfff640 1 -- 172.21.15.103:0/4007434153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20bc0052e0 msgr2=0x7f20bc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:22.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.077+0000 7f20cbfff640 1 --2- 172.21.15.103:0/4007434153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20bc0052e0 0x7f20bc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:22.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.077+0000 7f20cbfff640 1 -- 172.21.15.103:0/4007434153 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20bc003520 con 0x7f20bc004800 2024-09-10T08:44:22.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.077+0000 7f20d955a640 1 --2- 172.21.15.103:0/4007434153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20bc0052e0 0x7f20bc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:44:22.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.077+0000 7f20d955a640 1 -- 172.21.15.103:0/4007434153 reap_dead start 2024-09-10T08:44:22.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.078+0000 7f20cbfff640 1 --2- 172.21.15.103:0/4007434153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20bc004800 0x7f20bc004c80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f20c400c240 tx=0x7f20bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab60e5dc1fc595a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:22.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.078+0000 7f20cb7fe640 1 -- 172.21.15.103:0/4007434153 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c4007d10 con 0x7f20bc004800 2024-09-10T08:44:22.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.078+0000 7f20cb7fe640 1 -- 172.21.15.103:0/4007434153 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c40058d0 con 0x7f20bc004800 2024-09-10T08:44:22.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.078+0000 7f20cb7fe640 1 -- 172.21.15.103:0/4007434153 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c4005d40 con 0x7f20bc004800 2024-09-10T08:44:22.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.078+0000 7f20dafbd640 1 -- 172.21.15.103:0/4007434153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20bc004800 msgr2=0x7f20bc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:22.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.078+0000 7f20dafbd640 1 --2- 172.21.15.103:0/4007434153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20bc004800 0x7f20bc004c80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f20c400c240 tx=0x7f20bc005830 comp rx=0 tx=0).stop 2024-09-10T08:44:22.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.078+0000 7f20dafbd640 1 -- 172.21.15.103:0/4007434153 shutdown_connections 2024-09-10T08:44:22.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.078+0000 7f20dafbd640 1 --2- 172.21.15.103:0/4007434153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20bc004800 0x7f20bc004c80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:22.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.078+0000 7f20dafbd640 1 -- 172.21.15.103:0/4007434153 >> 172.21.15.103:0/4007434153 conn(0x7f20d40c6880 msgr2=0x7f20d40c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:22.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.078+0000 7f20dafbd640 1 -- 172.21.15.103:0/4007434153 shutdown_connections 2024-09-10T08:44:22.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.078+0000 7f20dafbd640 1 -- 172.21.15.103:0/4007434153 wait complete. 2024-09-10T08:44:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.080+0000 7f20dafbd640 1 Processor -- start 2024-09-10T08:44:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.080+0000 7f20dafbd640 1 -- start start 2024-09-10T08:44:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.080+0000 7f20dafbd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20bc004800 0x7f20d41564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.080+0000 7f20dafbd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20d4154c10 0x7f20d414bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.080+0000 7f20dafbd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20d40af360 0x7f20d414c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.080+0000 7f20dafbd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f20d40afd30 con 0x7f20bc004800 2024-09-10T08:44:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.080+0000 7f20dafbd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f20d4158280 con 0x7f20d4154c10 2024-09-10T08:44:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.080+0000 7f20dafbd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f20d40afeb0 con 0x7f20d40af360 2024-09-10T08:44:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.081+0000 7f20d8d59640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20bc004800 0x7f20d41564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.081+0000 7f20d8d59640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20bc004800 0x7f20d41564d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50480/0 (socket says 172.21.15.103:50480) 2024-09-10T08:44:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.081+0000 7f20d8d59640 1 -- 172.21.15.103:0/136811525 learned_addr learned my addr 172.21.15.103:0/136811525 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.081+0000 7f20d955a640 1 --2- 172.21.15.103:0/136811525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20d40af360 0x7f20d414c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:22.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.081+0000 7f20cbfff640 1 --2- 172.21.15.103:0/136811525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20d4154c10 0x7f20d414bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:22.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.081+0000 7f20d8d59640 1 -- 172.21.15.103:0/136811525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20d40af360 msgr2=0x7f20d414c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:22.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.081+0000 7f20d8d59640 1 --2- 172.21.15.103:0/136811525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20d40af360 0x7f20d414c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:22.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.081+0000 7f20d8d59640 1 -- 172.21.15.103:0/136811525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20d4154c10 msgr2=0x7f20d414bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:22.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.081+0000 7f20d8d59640 1 --2- 172.21.15.103:0/136811525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20d4154c10 0x7f20d414bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:22.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.081+0000 7f20d8d59640 1 -- 172.21.15.103:0/136811525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d41eab40 con 0x7f20bc004800 2024-09-10T08:44:22.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.081+0000 7f20d955a640 1 --2- 172.21.15.103:0/136811525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20d40af360 0x7f20d414c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:44:22.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.081+0000 7f20d8d59640 1 --2- 172.21.15.103:0/136811525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20bc004800 0x7f20d41564d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f20d000e870 tx=0x7f20d000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:22.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.081+0000 7f20c97fa640 1 -- 172.21.15.103:0/136811525 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0003b80 con 0x7f20bc004800 2024-09-10T08:44:22.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.081+0000 7f20c97fa640 1 -- 172.21.15.103:0/136811525 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20d0018070 con 0x7f20bc004800 2024-09-10T08:44:22.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.081+0000 7f20c97fa640 1 -- 172.21.15.103:0/136811525 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d00050d0 con 0x7f20bc004800 2024-09-10T08:44:22.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.081+0000 7f20dafbd640 1 -- 172.21.15.103:0/136811525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d414e460 con 0x7f20bc004800 2024-09-10T08:44:22.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.081+0000 7f20dafbd640 1 -- 172.21.15.103:0/136811525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d41ea830 con 0x7f20bc004800 2024-09-10T08:44:22.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.082+0000 7f20dafbd640 1 -- 172.21.15.103:0/136811525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d4158790 con 0x7f20bc004800 2024-09-10T08:44:22.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.083+0000 7f20c97fa640 1 -- 172.21.15.103:0/136811525 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f20d0005270 con 0x7f20bc004800 2024-09-10T08:44:22.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.083+0000 7f20c97fa640 1 --2- 172.21.15.103:0/136811525 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f20c006be60 0x7f20c006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:22.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.083+0000 7f20c97fa640 1 -- 172.21.15.103:0/136811525 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f20d008b2c0 con 0x7f20bc004800 2024-09-10T08:44:22.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.083+0000 7f20cbfff640 1 --2- 172.21.15.103:0/136811525 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f20c006be60 0x7f20c006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:22.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.084+0000 7f20cbfff640 1 --2- 172.21.15.103:0/136811525 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f20c006be60 0x7f20c006e320 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f20c4033000 tx=0x7f20c402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:22.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.087+0000 7f20c97fa640 1 -- 172.21.15.103:0/136811525 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f20d4158790 con 0x7f20bc004800 2024-09-10T08:44:22.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.265+0000 7f20dafbd640 1 -- 172.21.15.103:0/136811525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f20d40c7550 con 0x7f20bc004800 2024-09-10T08:44:22.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.266+0000 7f20c97fa640 1 -- 172.21.15.103:0/136811525 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f20d001a310 con 0x7f20bc004800 2024-09-10T08:44:22.267 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-10T08:44:22.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.267+0000 7f20dafbd640 1 -- 172.21.15.103:0/136811525 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f20c006be60 msgr2=0x7f20c006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:22.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.267+0000 7f20dafbd640 1 --2- 172.21.15.103:0/136811525 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f20c006be60 0x7f20c006e320 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f20c4033000 tx=0x7f20c402e000 comp rx=0 tx=0).stop 2024-09-10T08:44:22.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.267+0000 7f20dafbd640 1 -- 172.21.15.103:0/136811525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20bc004800 msgr2=0x7f20d41564d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:22.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.267+0000 7f20dafbd640 1 --2- 172.21.15.103:0/136811525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20bc004800 0x7f20d41564d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f20d000e870 tx=0x7f20d000ed30 comp rx=0 tx=0).stop 2024-09-10T08:44:22.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.268+0000 7f20dafbd640 1 -- 172.21.15.103:0/136811525 shutdown_connections 2024-09-10T08:44:22.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.268+0000 7f20dafbd640 1 --2- 172.21.15.103:0/136811525 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f20c006be60 0x7f20c006e320 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:22.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.268+0000 7f20dafbd640 1 --2- 172.21.15.103:0/136811525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20d40af360 0x7f20d414c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:22.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.268+0000 7f20dafbd640 1 --2- 172.21.15.103:0/136811525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20d4154c10 0x7f20d414bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:22.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.268+0000 7f20dafbd640 1 --2- 172.21.15.103:0/136811525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20bc004800 0x7f20d41564d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:22.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.268+0000 7f20dafbd640 1 -- 172.21.15.103:0/136811525 >> 172.21.15.103:0/136811525 conn(0x7f20d40c6880 msgr2=0x7f20d40704d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:22.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.268+0000 7f20dafbd640 1 -- 172.21.15.103:0/136811525 shutdown_connections 2024-09-10T08:44:22.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:22.268+0000 7f20dafbd640 1 -- 172.21.15.103:0/136811525 wait complete. 2024-09-10T08:44:22.280 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2024-09-10T08:44:22.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:44:22.281 DEBUG:teuthology.orchestra.run.smithi103:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T08:44:22.338 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:44:22.340 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[45534]: fuse finished with error 0 and tester_r 0 2024-09-10T08:44:28.441 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T08:44:28.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:44:28.441 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T08:44:28.461 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:44:28.462 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:44:28.494 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:44:28.494 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:44:28.553 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:44:28.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.664+0000 7fd5d7e53640 1 Processor -- start 2024-09-10T08:44:28.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.664+0000 7fd5d7e53640 1 -- start start 2024-09-10T08:44:28.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.665+0000 7fd5d7e53640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd5d01500a0 0x7fd5d00c3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:28.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.665+0000 7fd5d7e53640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d006e650 0x7fd5d0150930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:28.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.665+0000 7fd5d7e53640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5d00ad5c0 con 0x7fd5d00c3e00 2024-09-10T08:44:28.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.665+0000 7fd5d7e53640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fd5d006ef50 con 0x7fd5d01500a0 2024-09-10T08:44:28.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.665+0000 7fd5d7e53640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd5d00ad860 con 0x7fd5d006e650 2024-09-10T08:44:28.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.665+0000 7fd5d5bef640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd5d01500a0 0x7fd5d00c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:28.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.665+0000 7fd5d5bef640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd5d01500a0 0x7fd5d00c3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42620/0 (socket says 172.21.15.103:42620) 2024-09-10T08:44:28.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.665+0000 7fd5d5bef640 1 -- 172.21.15.103:0/3101475798 learned_addr learned my addr 172.21.15.103:0/3101475798 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:28.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.665+0000 7fd5d53ee640 1 --2- 172.21.15.103:0/3101475798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d006e650 0x7fd5d0150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:28.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.665+0000 7fd5d5bef640 1 -- 172.21.15.103:0/3101475798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d006e650 msgr2=0x7fd5d0150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:28.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.666+0000 7fd5d5bef640 1 --2- 172.21.15.103:0/3101475798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d006e650 0x7fd5d0150930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:28.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.666+0000 7fd5d5bef640 1 -- 172.21.15.103:0/3101475798 >> v1:172.21.15.154:6789/0 conn(0x7fd5d00c3e00 legacy=0x7fd5d006dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:28.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.666+0000 7fd5d5bef640 1 -- 172.21.15.103:0/3101475798 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d006ec70 con 0x7fd5d01500a0 2024-09-10T08:44:28.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.666+0000 7fd5d53ee640 1 --2- 172.21.15.103:0/3101475798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d006e650 0x7fd5d0150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:44:28.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.666+0000 7fd5d5bef640 1 --2- 172.21.15.103:0/3101475798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5d01500a0 0x7fd5d00c3000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009e50 tx=0x7fd5cc02a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5163987c7dd32392 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:28.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.666+0000 7fd5d4bed640 1 -- 172.21.15.103:0/3101475798 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc036070 con 0x7fd5d01500a0 2024-09-10T08:44:28.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.666+0000 7fd5d4bed640 1 -- 172.21.15.103:0/3101475798 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5cc031600 con 0x7fd5d01500a0 2024-09-10T08:44:28.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.666+0000 7fd5d4bed640 1 -- 172.21.15.103:0/3101475798 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc0319d0 con 0x7fd5d01500a0 2024-09-10T08:44:28.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.667+0000 7fd5d7e53640 1 -- 172.21.15.103:0/3101475798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5d01500a0 msgr2=0x7fd5d00c3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:28.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.667+0000 7fd5d7e53640 1 --2- 172.21.15.103:0/3101475798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5d01500a0 0x7fd5d00c3000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009e50 tx=0x7fd5cc02a630 comp rx=0 tx=0).stop 2024-09-10T08:44:28.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.667+0000 7fd5d7e53640 1 -- 172.21.15.103:0/3101475798 shutdown_connections 2024-09-10T08:44:28.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.667+0000 7fd5d7e53640 1 --2- 172.21.15.103:0/3101475798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d006e650 0x7fd5d0150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:28.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.667+0000 7fd5d7e53640 1 --2- 172.21.15.103:0/3101475798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5d01500a0 0x7fd5d00c3000 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:28.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.667+0000 7fd5d7e53640 1 -- 172.21.15.103:0/3101475798 >> 172.21.15.103:0/3101475798 conn(0x7fd5d00c7a40 msgr2=0x7fd5d00c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:28.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.667+0000 7fd5d7e53640 1 -- 172.21.15.103:0/3101475798 shutdown_connections 2024-09-10T08:44:28.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.667+0000 7fd5d7e53640 1 -- 172.21.15.103:0/3101475798 wait complete. 2024-09-10T08:44:28.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.668+0000 7fd5d7e53640 1 Processor -- start 2024-09-10T08:44:28.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.668+0000 7fd5d7e53640 1 -- start start 2024-09-10T08:44:28.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.669+0000 7fd5d7e53640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5d006e650 0x7fd5d01edc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:28.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.669+0000 7fd5d7e53640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d00c3e00 0x7fd5d0146330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:28.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.669+0000 7fd5d7e53640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d01500a0 0x7fd5d0142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:28.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.669+0000 7fd5d7e53640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d0150e70 con 0x7fd5d006e650 2024-09-10T08:44:28.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.669+0000 7fd5d7e53640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d00c3540 con 0x7fd5d00c3e00 2024-09-10T08:44:28.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.669+0000 7fd5d7e53640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fd5d00adb10 con 0x7fd5d01500a0 2024-09-10T08:44:28.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.669+0000 7fd5d5bef640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5d006e650 0x7fd5d01edc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:28.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.669+0000 7fd5d5bef640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5d006e650 0x7fd5d01edc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42624/0 (socket says 172.21.15.103:42624) 2024-09-10T08:44:28.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.669+0000 7fd5d5bef640 1 -- 172.21.15.103:0/106114214 learned_addr learned my addr 172.21.15.103:0/106114214 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:28.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.669+0000 7fd5d53ee640 1 --2- 172.21.15.103:0/106114214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d00c3e00 0x7fd5d0146330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:28.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.669+0000 7fd5d63f0640 1 --2- 172.21.15.103:0/106114214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d01500a0 0x7fd5d0142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:28.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.669+0000 7fd5d5bef640 1 -- 172.21.15.103:0/106114214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d01500a0 msgr2=0x7fd5d0142750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:28.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.669+0000 7fd5d5bef640 1 --2- 172.21.15.103:0/106114214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d01500a0 0x7fd5d0142750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:28.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.669+0000 7fd5d5bef640 1 -- 172.21.15.103:0/106114214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d00c3e00 msgr2=0x7fd5d0146330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:28.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.669+0000 7fd5d5bef640 1 --2- 172.21.15.103:0/106114214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d00c3e00 0x7fd5d0146330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:28.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.669+0000 7fd5d5bef640 1 -- 172.21.15.103:0/106114214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d015f0e0 con 0x7fd5d006e650 2024-09-10T08:44:28.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.670+0000 7fd5d5bef640 1 --2- 172.21.15.103:0/106114214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5d006e650 0x7fd5d01edc30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc034040 tx=0x7fd5cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:28.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.670+0000 7fd5c67fc640 1 -- 172.21.15.103:0/106114214 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc041020 con 0x7fd5d006e650 2024-09-10T08:44:28.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.670+0000 7fd5c67fc640 1 -- 172.21.15.103:0/106114214 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5cc007820 con 0x7fd5d006e650 2024-09-10T08:44:28.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.670+0000 7fd5d7e53640 1 -- 172.21.15.103:0/106114214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d015e840 con 0x7fd5d006e650 2024-09-10T08:44:28.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.670+0000 7fd5c67fc640 1 -- 172.21.15.103:0/106114214 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc036040 con 0x7fd5d006e650 2024-09-10T08:44:28.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.670+0000 7fd5d7e53640 1 -- 172.21.15.103:0/106114214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d015ee00 con 0x7fd5d006e650 2024-09-10T08:44:28.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.671+0000 7fd5d7e53640 1 -- 172.21.15.103:0/106114214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5d00aa6d0 con 0x7fd5d006e650 2024-09-10T08:44:28.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.671+0000 7fd5c67fc640 1 -- 172.21.15.103:0/106114214 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd5cc044020 con 0x7fd5d006e650 2024-09-10T08:44:28.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.672+0000 7fd5c67fc640 1 --2- 172.21.15.103:0/106114214 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd5b406be30 0x7fd5b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:28.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.672+0000 7fd5c67fc640 1 -- 172.21.15.103:0/106114214 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fd5cc0abe00 con 0x7fd5d006e650 2024-09-10T08:44:28.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.672+0000 7fd5d53ee640 1 --2- 172.21.15.103:0/106114214 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd5b406be30 0x7fd5b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:28.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.672+0000 7fd5d53ee640 1 --2- 172.21.15.103:0/106114214 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd5b406be30 0x7fd5b406e2f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd5d00c3450 tx=0x7fd5c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:28.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.676+0000 7fd5c67fc640 1 -- 172.21.15.103:0/106114214 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd5d00aa6d0 con 0x7fd5d006e650 2024-09-10T08:44:28.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.852+0000 7fd5d7e53640 1 -- 172.21.15.103:0/106114214 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd5d0150480 con 0x7fd5d006e650 2024-09-10T08:44:28.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.852+0000 7fd5c67fc640 1 -- 172.21.15.103:0/106114214 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fd5cc04b030 con 0x7fd5d006e650 2024-09-10T08:44:28.853 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-10T08:44:28.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.854+0000 7fd5d7e53640 1 -- 172.21.15.103:0/106114214 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd5b406be30 msgr2=0x7fd5b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:28.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.854+0000 7fd5d7e53640 1 --2- 172.21.15.103:0/106114214 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd5b406be30 0x7fd5b406e2f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd5d00c3450 tx=0x7fd5c0008040 comp rx=0 tx=0).stop 2024-09-10T08:44:28.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.854+0000 7fd5d7e53640 1 -- 172.21.15.103:0/106114214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5d006e650 msgr2=0x7fd5d01edc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:28.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.854+0000 7fd5d7e53640 1 --2- 172.21.15.103:0/106114214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5d006e650 0x7fd5d01edc30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc034040 tx=0x7fd5cc004a40 comp rx=0 tx=0).stop 2024-09-10T08:44:28.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.854+0000 7fd5d7e53640 1 -- 172.21.15.103:0/106114214 shutdown_connections 2024-09-10T08:44:28.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.854+0000 7fd5d7e53640 1 --2- 172.21.15.103:0/106114214 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fd5b406be30 0x7fd5b406e2f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:28.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.854+0000 7fd5d7e53640 1 --2- 172.21.15.103:0/106114214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d01500a0 0x7fd5d0142750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:28.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.854+0000 7fd5d7e53640 1 --2- 172.21.15.103:0/106114214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d00c3e00 0x7fd5d0146330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:28.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.854+0000 7fd5d7e53640 1 --2- 172.21.15.103:0/106114214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5d006e650 0x7fd5d01edc30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:28.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.854+0000 7fd5d7e53640 1 -- 172.21.15.103:0/106114214 >> 172.21.15.103:0/106114214 conn(0x7fd5d00c7a40 msgr2=0x7fd5d014f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:28.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.854+0000 7fd5d7e53640 1 -- 172.21.15.103:0/106114214 shutdown_connections 2024-09-10T08:44:28.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.854+0000 7fd5d7e53640 1 -- 172.21.15.103:0/106114214 wait complete. 2024-09-10T08:44:28.866 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T08:44:28.866 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:44:28.885 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:44:28.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.983+0000 7f66dec1e640 1 Processor -- start 2024-09-10T08:44:28.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.983+0000 7f66dec1e640 1 -- start start 2024-09-10T08:44:28.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.984+0000 7f66dec1e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f66d80acc30 0x7f66d80c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:28.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.984+0000 7f66dec1e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66d8070590 con 0x7f66d80c44b0 2024-09-10T08:44:28.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.984+0000 7f66dec1e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66d80a8220 con 0x7f66d80c8180 2024-09-10T08:44:28.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.984+0000 7f66dec1e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f66d80c4ea0 con 0x7f66d80acc30 2024-09-10T08:44:28.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.984+0000 7f66d7fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f66d80c44b0 0x7f66d80c7a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:41312/0 (socket says 172.21.15.103:41312) 2024-09-10T08:44:28.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.984+0000 7f66d7fff640 1 -- 172.21.15.103:0/1336152259 learned_addr learned my addr 172.21.15.103:0/1336152259 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:44:28.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66d77fe640 1 -- 172.21.15.103:0/1336152259 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3525294688 0 0) 0x7f66d8070590 con 0x7f66d80c44b0 2024-09-10T08:44:28.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66d77fe640 1 -- 172.21.15.103:0/1336152259 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66c4003520 con 0x7f66d80c44b0 2024-09-10T08:44:28.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66dc9ba640 1 --2- 172.21.15.103:0/1336152259 >> v2:172.21.15.154:3300/0 conn(0x7f66d80acc30 0x7f66d80c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:28.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66d77fe640 1 -- 172.21.15.103:0/1336152259 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2749510969 0 0) 0x7f66c4003520 con 0x7f66d80c44b0 2024-09-10T08:44:28.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66d77fe640 1 -- 172.21.15.103:0/1336152259 >> v2:172.21.15.154:3300/0 conn(0x7f66d80acc30 msgr2=0x7f66d80c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:28.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66d77fe640 1 --2- 172.21.15.103:0/1336152259 >> v2:172.21.15.154:3300/0 conn(0x7f66d80acc30 0x7f66d80c3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:28.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66d77fe640 1 -- 172.21.15.103:0/1336152259 >> v1:172.21.15.154:6789/0 conn(0x7f66d80c8180 legacy=0x7f66d815dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:28.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66d77fe640 1 -- 172.21.15.103:0/1336152259 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d80a84f0 con 0x7f66d80c44b0 2024-09-10T08:44:28.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66d77fe640 1 -- 172.21.15.103:0/1336152259 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f66c0001670 con 0x7f66d80c44b0 2024-09-10T08:44:28.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66d77fe640 1 -- 172.21.15.103:0/1336152259 >> v1:172.21.15.103:6789/0 conn(0x7f66d80c44b0 legacy=0x7f66d80c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:28.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66d77fe640 1 --2- 172.21.15.103:0/1336152259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66c40039b0 0x7f66c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:28.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66d77fe640 1 --2- 172.21.15.103:0/1336152259 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66c4004800 0x7f66c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:28.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66d77fe640 1 --2- 172.21.15.103:0/1336152259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66c40052e0 0x7f66c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:28.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66d77fe640 1 -- 172.21.15.103:0/1336152259 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f66c400c180 con 0x7f66c40039b0 2024-09-10T08:44:28.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66d77fe640 1 -- 172.21.15.103:0/1336152259 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f66c400c330 con 0x7f66c40052e0 2024-09-10T08:44:28.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66d77fe640 1 -- 172.21.15.103:0/1336152259 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f66c400c530 con 0x7f66c4004800 2024-09-10T08:44:28.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66dc9ba640 1 --2- 172.21.15.103:0/1336152259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66c40039b0 0x7f66c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:28.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66dd1bb640 1 --2- 172.21.15.103:0/1336152259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66c40052e0 0x7f66c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:28.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66d7fff640 1 --2- 172.21.15.103:0/1336152259 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66c4004800 0x7f66c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:28.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66dc9ba640 1 -- 172.21.15.103:0/1336152259 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66c4004800 msgr2=0x7f66c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:28.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66dc9ba640 1 --2- 172.21.15.103:0/1336152259 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66c4004800 0x7f66c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:28.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66dc9ba640 1 -- 172.21.15.103:0/1336152259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66c40052e0 msgr2=0x7f66c400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:28.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66dc9ba640 1 --2- 172.21.15.103:0/1336152259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66c40052e0 0x7f66c400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:28.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66dc9ba640 1 -- 172.21.15.103:0/1336152259 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c4003520 con 0x7f66c40039b0 2024-09-10T08:44:28.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.985+0000 7f66dd1bb640 1 -- 172.21.15.103:0/1336152259 reap_dead start 2024-09-10T08:44:28.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.986+0000 7f66dc9ba640 1 --2- 172.21.15.103:0/1336152259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66c40039b0 0x7f66c4003dd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009f90 tx=0x7f66c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f414395ce74a341 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:28.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.986+0000 7f66d77fe640 1 -- 172.21.15.103:0/1336152259 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c8009c10 con 0x7f66c40039b0 2024-09-10T08:44:28.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.986+0000 7f66d77fe640 1 -- 172.21.15.103:0/1336152259 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c8036070 con 0x7f66c40039b0 2024-09-10T08:44:28.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.986+0000 7f66d77fe640 1 -- 172.21.15.103:0/1336152259 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c8031850 con 0x7f66c40039b0 2024-09-10T08:44:28.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.987+0000 7f66dec1e640 1 -- 172.21.15.103:0/1336152259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66c40039b0 msgr2=0x7f66c4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:28.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.987+0000 7f66dec1e640 1 --2- 172.21.15.103:0/1336152259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66c40039b0 0x7f66c4003dd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009f90 tx=0x7f66c4005830 comp rx=0 tx=0).stop 2024-09-10T08:44:28.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.987+0000 7f66dec1e640 1 -- 172.21.15.103:0/1336152259 shutdown_connections 2024-09-10T08:44:28.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.987+0000 7f66dec1e640 1 --2- 172.21.15.103:0/1336152259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66c40039b0 0x7f66c4003dd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:28.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.987+0000 7f66dec1e640 1 -- 172.21.15.103:0/1336152259 >> 172.21.15.103:0/1336152259 conn(0x7f66d80c5660 msgr2=0x7f66d80c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:28.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.987+0000 7f66dec1e640 1 -- 172.21.15.103:0/1336152259 shutdown_connections 2024-09-10T08:44:28.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.987+0000 7f66dec1e640 1 -- 172.21.15.103:0/1336152259 wait complete. 2024-09-10T08:44:28.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.988+0000 7f66dec1e640 1 Processor -- start 2024-09-10T08:44:28.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.988+0000 7f66dec1e640 1 -- start start 2024-09-10T08:44:28.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.989+0000 7f66dec1e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66c40039b0 0x7f66d806d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:28.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.989+0000 7f66dec1e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66d81df9c0 0x7f66d81544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:28.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.989+0000 7f66dec1e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66d81549f0 0x7f66d81eefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:28.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.989+0000 7f66dec1e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f66d80c5330 con 0x7f66d81549f0 2024-09-10T08:44:28.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.989+0000 7f66dec1e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f66d80702b0 con 0x7f66d81df9c0 2024-09-10T08:44:28.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.989+0000 7f66dec1e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f66d80c63f0 con 0x7f66c40039b0 2024-09-10T08:44:28.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.989+0000 7f66dd1bb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66d81549f0 0x7f66d81eefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:28.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.989+0000 7f66dd1bb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66d81549f0 0x7f66d81eefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:42632/0 (socket says 172.21.15.103:42632) 2024-09-10T08:44:28.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.989+0000 7f66dd1bb640 1 -- 172.21.15.103:0/991679703 learned_addr learned my addr 172.21.15.103:0/991679703 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:28.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.989+0000 7f66dc9ba640 1 --2- 172.21.15.103:0/991679703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66c40039b0 0x7f66d806d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:28.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.989+0000 7f66d7fff640 1 --2- 172.21.15.103:0/991679703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66d81df9c0 0x7f66d81544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:28.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.989+0000 7f66dd1bb640 1 -- 172.21.15.103:0/991679703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66c40039b0 msgr2=0x7f66d806d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:28.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.989+0000 7f66dd1bb640 1 --2- 172.21.15.103:0/991679703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66c40039b0 0x7f66d806d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:28.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.989+0000 7f66dd1bb640 1 -- 172.21.15.103:0/991679703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66d81df9c0 msgr2=0x7f66d81544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:28.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.989+0000 7f66dd1bb640 1 --2- 172.21.15.103:0/991679703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66d81df9c0 0x7f66d81544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:28.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.989+0000 7f66dd1bb640 1 -- 172.21.15.103:0/991679703 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d806ed80 con 0x7f66d81549f0 2024-09-10T08:44:28.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.989+0000 7f66dd1bb640 1 --2- 172.21.15.103:0/991679703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66d81549f0 0x7f66d81eefa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f66d80adbc0 tx=0x7f66d000e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:28.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.989+0000 7f66d57fa640 1 -- 172.21.15.103:0/991679703 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0019070 con 0x7f66d81549f0 2024-09-10T08:44:28.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.989+0000 7f66d57fa640 1 -- 172.21.15.103:0/991679703 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d00050d0 con 0x7f66d81549f0 2024-09-10T08:44:28.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.989+0000 7f66dec1e640 1 -- 172.21.15.103:0/991679703 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d81554a0 con 0x7f66d81549f0 2024-09-10T08:44:28.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.989+0000 7f66d57fa640 1 -- 172.21.15.103:0/991679703 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d00035f0 con 0x7f66d81549f0 2024-09-10T08:44:28.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.990+0000 7f66dec1e640 1 -- 172.21.15.103:0/991679703 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d80c7400 con 0x7f66d81549f0 2024-09-10T08:44:28.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.991+0000 7f66dec1e640 1 -- 172.21.15.103:0/991679703 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66d80abc10 con 0x7f66d81549f0 2024-09-10T08:44:28.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.991+0000 7f66d57fa640 1 -- 172.21.15.103:0/991679703 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f66d001c070 con 0x7f66d81549f0 2024-09-10T08:44:28.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.991+0000 7f66d57fa640 1 --2- 172.21.15.103:0/991679703 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f66b806be30 0x7f66b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:28.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.991+0000 7f66d57fa640 1 -- 172.21.15.103:0/991679703 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f66d008a480 con 0x7f66d81549f0 2024-09-10T08:44:28.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.991+0000 7f66dc9ba640 1 --2- 172.21.15.103:0/991679703 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f66b806be30 0x7f66b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:28.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.992+0000 7f66dc9ba640 1 --2- 172.21.15.103:0/991679703 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f66b806be30 0x7f66b806e2f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f66c8035000 tx=0x7f66c802f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:28.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:28.996+0000 7f66d57fa640 1 -- 172.21.15.103:0/991679703 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f66d0058b20 con 0x7f66d81549f0 2024-09-10T08:44:29.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:29.173+0000 7f66dec1e640 1 -- 172.21.15.103:0/991679703 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f66d81df590 con 0x7f66d81549f0 2024-09-10T08:44:29.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:29.173+0000 7f66d57fa640 1 -- 172.21.15.103:0/991679703 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f66d0058420 con 0x7f66d81549f0 2024-09-10T08:44:29.174 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-09-10T08:44:29.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:29.175+0000 7f66dec1e640 1 -- 172.21.15.103:0/991679703 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f66b806be30 msgr2=0x7f66b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:29.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:29.175+0000 7f66dec1e640 1 --2- 172.21.15.103:0/991679703 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f66b806be30 0x7f66b806e2f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f66c8035000 tx=0x7f66c802f000 comp rx=0 tx=0).stop 2024-09-10T08:44:29.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:29.175+0000 7f66dec1e640 1 -- 172.21.15.103:0/991679703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66d81549f0 msgr2=0x7f66d81eefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:29.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:29.175+0000 7f66dec1e640 1 --2- 172.21.15.103:0/991679703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66d81549f0 0x7f66d81eefa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f66d80adbc0 tx=0x7f66d000e610 comp rx=0 tx=0).stop 2024-09-10T08:44:29.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:29.176+0000 7f66dec1e640 1 -- 172.21.15.103:0/991679703 shutdown_connections 2024-09-10T08:44:29.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:29.176+0000 7f66dec1e640 1 --2- 172.21.15.103:0/991679703 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f66b806be30 0x7f66b806e2f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:29.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:29.176+0000 7f66dec1e640 1 --2- 172.21.15.103:0/991679703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66d81549f0 0x7f66d81eefa0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:29.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:29.176+0000 7f66dec1e640 1 --2- 172.21.15.103:0/991679703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66d81df9c0 0x7f66d81544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:29.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:29.176+0000 7f66dec1e640 1 --2- 172.21.15.103:0/991679703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66c40039b0 0x7f66d806d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:29.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:29.176+0000 7f66dec1e640 1 -- 172.21.15.103:0/991679703 >> 172.21.15.103:0/991679703 conn(0x7f66d80c5660 msgr2=0x7f66d80c1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:29.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:29.176+0000 7f66dec1e640 1 -- 172.21.15.103:0/991679703 shutdown_connections 2024-09-10T08:44:29.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:29.176+0000 7f66dec1e640 1 -- 172.21.15.103:0/991679703 wait complete. 2024-09-10T08:44:29.187 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi154.front.sepia.ceph.com... 2024-09-10T08:44:29.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:44:29.188 DEBUG:teuthology.orchestra.run.smithi154:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-10T08:44:29.241 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:44:29.245 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi154.stderr:ceph-fuse[42674]: fuse finished with error 0 and tester_r 0 2024-09-10T08:44:34.999 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:44:35.003 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:44:35.342 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T08:44:35.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:44:35.343 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T08:44:35.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:44:35.363 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-10T08:44:35.401 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T08:44:35.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:44:35.401 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:44:35.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:44:35.473 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link delete ceph-brx 2024-09-10T08:44:35.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:44:35.570 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-09-10T08:44:35.599 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T08:44:35.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:44:35.600 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T08:44:35.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:44:35.670 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2024-09-10T08:44:35.775 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-10T08:44:35.792 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:44:35.792 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:44:35.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.900+0000 7f4e9db78640 1 Processor -- start 2024-09-10T08:44:35.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.900+0000 7f4e9db78640 1 -- start start 2024-09-10T08:44:35.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.901+0000 7f4e9db78640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e980c69c0 0x7f4e98153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:35.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.901+0000 7f4e9db78640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4e980c42b0 0x7f4e980c4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:35.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.901+0000 7f4e9db78640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e980c5940 con 0x7f4e981505f0 2024-09-10T08:44:35.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.901+0000 7f4e9db78640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f4e980c7860 con 0x7f4e980c42b0 2024-09-10T08:44:35.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.901+0000 7f4e9db78640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4e980c5c00 con 0x7f4e980c69c0 2024-09-10T08:44:35.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.901+0000 7f4e97fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4e980c42b0 0x7f4e980c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:35.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.901+0000 7f4e977fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4e981505f0 0x7f4e980c2440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40846/0 (socket says 172.21.15.103:40846) 2024-09-10T08:44:35.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.901+0000 7f4e977fe640 1 -- 172.21.15.103:0/1765306401 learned_addr learned my addr 172.21.15.103:0/1765306401 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:44:35.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.901+0000 7f4e97fff640 1 -- 172.21.15.103:0/1765306401 >> v2:172.21.15.154:3300/0 conn(0x7f4e980c69c0 msgr2=0x7f4e98153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:35.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.901+0000 7f4e97fff640 1 --2- 172.21.15.103:0/1765306401 >> v2:172.21.15.154:3300/0 conn(0x7f4e980c69c0 0x7f4e98153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:35.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.901+0000 7f4e97fff640 1 -- 172.21.15.103:0/1765306401 >> v1:172.21.15.103:6789/0 conn(0x7f4e981505f0 legacy=0x7f4e980c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:35.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.901+0000 7f4e97fff640 1 -- 172.21.15.103:0/1765306401 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e980c5ee0 con 0x7f4e980c42b0 2024-09-10T08:44:35.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.901+0000 7f4e967fc640 1 -- 172.21.15.103:0/1765306401 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 899770900 0 0) 0x7f4e980c5940 con 0x7f4e981505f0 2024-09-10T08:44:35.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.902+0000 7f4e97fff640 1 --2- 172.21.15.103:0/1765306401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e980c42b0 0x7f4e980c4700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4e980c5580 tx=0x7f4e9002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c57d9e885f51f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:35.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.902+0000 7f4e967fc640 1 -- 172.21.15.103:0/1765306401 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90007740 con 0x7f4e980c42b0 2024-09-10T08:44:35.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.902+0000 7f4e967fc640 1 -- 172.21.15.103:0/1765306401 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e900078e0 con 0x7f4e980c42b0 2024-09-10T08:44:35.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.902+0000 7f4e967fc640 1 -- 172.21.15.103:0/1765306401 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90007cb0 con 0x7f4e980c42b0 2024-09-10T08:44:35.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.903+0000 7f4e9db78640 1 -- 172.21.15.103:0/1765306401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e980c42b0 msgr2=0x7f4e980c4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:35.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.903+0000 7f4e9db78640 1 --2- 172.21.15.103:0/1765306401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e980c42b0 0x7f4e980c4700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4e980c5580 tx=0x7f4e9002a5f0 comp rx=0 tx=0).stop 2024-09-10T08:44:35.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.903+0000 7f4e9db78640 1 -- 172.21.15.103:0/1765306401 shutdown_connections 2024-09-10T08:44:35.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.903+0000 7f4e9db78640 1 --2- 172.21.15.103:0/1765306401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e980c42b0 0x7f4e980c4700 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:35.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.903+0000 7f4e9db78640 1 --2- 172.21.15.103:0/1765306401 >> v2:172.21.15.154:3300/0 conn(0x7f4e980c69c0 0x7f4e98153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:35.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.903+0000 7f4e9db78640 1 -- 172.21.15.103:0/1765306401 >> 172.21.15.103:0/1765306401 conn(0x7f4e980c7a40 msgr2=0x7f4e980c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:35.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.903+0000 7f4e9db78640 1 -- 172.21.15.103:0/1765306401 shutdown_connections 2024-09-10T08:44:35.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.903+0000 7f4e9db78640 1 -- 172.21.15.103:0/1765306401 wait complete. 2024-09-10T08:44:35.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.904+0000 7f4e9db78640 1 Processor -- start 2024-09-10T08:44:35.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.904+0000 7f4e9db78640 1 -- start start 2024-09-10T08:44:35.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.905+0000 7f4e9db78640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e980c42b0 0x7f4e981efd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:35.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.905+0000 7f4e9db78640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e981505f0 0x7f4e9814af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:35.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.905+0000 7f4e9db78640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e98156f90 0x7f4e981ebb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:35.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.905+0000 7f4e9db78640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4e981509d0 con 0x7f4e981505f0 2024-09-10T08:44:35.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.905+0000 7f4e9db78640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4e980c64a0 con 0x7f4e98156f90 2024-09-10T08:44:35.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.905+0000 7f4e9db78640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4e98150b50 con 0x7f4e980c42b0 2024-09-10T08:44:35.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.905+0000 7f4e96ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e981505f0 0x7f4e9814af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:35.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.905+0000 7f4e96ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e981505f0 0x7f4e9814af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60544/0 (socket says 172.21.15.103:60544) 2024-09-10T08:44:35.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.905+0000 7f4e96ffd640 1 -- 172.21.15.103:0/1264655235 learned_addr learned my addr 172.21.15.103:0/1264655235 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:35.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.905+0000 7f4e977fe640 1 --2- 172.21.15.103:0/1264655235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e980c42b0 0x7f4e981efd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:35.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.905+0000 7f4e97fff640 1 --2- 172.21.15.103:0/1264655235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e98156f90 0x7f4e981ebb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:35.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.905+0000 7f4e96ffd640 1 -- 172.21.15.103:0/1264655235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e980c42b0 msgr2=0x7f4e981efd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:35.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.905+0000 7f4e96ffd640 1 --2- 172.21.15.103:0/1264655235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e980c42b0 0x7f4e981efd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:35.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.905+0000 7f4e96ffd640 1 -- 172.21.15.103:0/1264655235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e98156f90 msgr2=0x7f4e981ebb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:35.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.905+0000 7f4e96ffd640 1 --2- 172.21.15.103:0/1264655235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e98156f90 0x7f4e981ebb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:35.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.905+0000 7f4e96ffd640 1 -- 172.21.15.103:0/1264655235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e981541f0 con 0x7f4e981505f0 2024-09-10T08:44:35.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.905+0000 7f4e96ffd640 1 --2- 172.21.15.103:0/1264655235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e981505f0 0x7f4e9814af60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00b4a0 tx=0x7f4e8c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:35.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.905+0000 7f4e7ffff640 1 -- 172.21.15.103:0/1264655235 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c014070 con 0x7f4e981505f0 2024-09-10T08:44:35.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.905+0000 7f4e7ffff640 1 -- 172.21.15.103:0/1264655235 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e8c010610 con 0x7f4e981505f0 2024-09-10T08:44:35.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.905+0000 7f4e9db78640 1 -- 172.21.15.103:0/1264655235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e981ef260 con 0x7f4e981505f0 2024-09-10T08:44:35.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.905+0000 7f4e7ffff640 1 -- 172.21.15.103:0/1264655235 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c010a00 con 0x7f4e981505f0 2024-09-10T08:44:35.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.905+0000 7f4e9db78640 1 -- 172.21.15.103:0/1264655235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e981ef820 con 0x7f4e981505f0 2024-09-10T08:44:35.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.906+0000 7f4e9db78640 1 -- 172.21.15.103:0/1264655235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e981efa20 con 0x7f4e981505f0 2024-09-10T08:44:35.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.907+0000 7f4e7ffff640 1 -- 172.21.15.103:0/1264655235 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e8c017070 con 0x7f4e981505f0 2024-09-10T08:44:35.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.907+0000 7f4e7ffff640 1 --2- 172.21.15.103:0/1264655235 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4e8406be30 0x7f4e8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:35.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.907+0000 7f4e7ffff640 1 -- 172.21.15.103:0/1264655235 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f4e8c08abf0 con 0x7f4e981505f0 2024-09-10T08:44:35.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.907+0000 7f4e977fe640 1 --2- 172.21.15.103:0/1264655235 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4e8406be30 0x7f4e8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:35.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.908+0000 7f4e977fe640 1 --2- 172.21.15.103:0/1264655235 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4e8406be30 0x7f4e8406e2f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4e88000f60 tx=0x7f4e88009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:35.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:35.912+0000 7f4e7ffff640 1 -- 172.21.15.103:0/1264655235 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4e981efa20 con 0x7f4e981505f0 2024-09-10T08:44:36.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.076+0000 7f4e9db78640 1 -- 172.21.15.103:0/1264655235 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4e98153910 con 0x7f4e8406be30 2024-09-10T08:44:36.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.087+0000 7f4e7ffff640 1 -- 172.21.15.103:0/1264655235 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+493688 (secure 0 0 0) 0x7f4e98153910 con 0x7f4e8406be30 2024-09-10T08:44:36.097 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:44:36.101 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T08:44:36.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.092+0000 7f4e9db78640 1 -- 172.21.15.103:0/1264655235 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4e8406be30 msgr2=0x7f4e8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:36.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.092+0000 7f4e9db78640 1 --2- 172.21.15.103:0/1264655235 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4e8406be30 0x7f4e8406e2f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4e88000f60 tx=0x7f4e88009040 comp rx=0 tx=0).stop 2024-09-10T08:44:36.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.092+0000 7f4e9db78640 1 -- 172.21.15.103:0/1264655235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e981505f0 msgr2=0x7f4e9814af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:36.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.092+0000 7f4e9db78640 1 --2- 172.21.15.103:0/1264655235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e981505f0 0x7f4e9814af60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00b4a0 tx=0x7f4e8c00b960 comp rx=0 tx=0).stop 2024-09-10T08:44:36.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.092+0000 7f4e9db78640 1 -- 172.21.15.103:0/1264655235 shutdown_connections 2024-09-10T08:44:36.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.092+0000 7f4e9db78640 1 --2- 172.21.15.103:0/1264655235 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4e8406be30 0x7f4e8406e2f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.092+0000 7f4e9db78640 1 --2- 172.21.15.103:0/1264655235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e98156f90 0x7f4e981ebb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.092+0000 7f4e9db78640 1 --2- 172.21.15.103:0/1264655235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e981505f0 0x7f4e9814af60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.092+0000 7f4e9db78640 1 --2- 172.21.15.103:0/1264655235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e980c42b0 0x7f4e981efd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.092+0000 7f4e9db78640 1 -- 172.21.15.103:0/1264655235 >> 172.21.15.103:0/1264655235 conn(0x7f4e980c7a40 msgr2=0x7f4e9814eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:36.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.092+0000 7f4e9db78640 1 -- 172.21.15.103:0/1264655235 shutdown_connections 2024-09-10T08:44:36.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.092+0000 7f4e9db78640 1 -- 172.21.15.103:0/1264655235 wait complete. 2024-09-10T08:44:36.105 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":506,"stamp":"2024-09-10T08:44:35.061987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36141476,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":225,"num_read_kb":350,"num_write":3080803,"num_write_kb":38573613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":595349,"ondisk_log_size":595349,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7717728,"kb_used_data":72928,"kb_used_omap":12,"kb_used_meta":7644659,"kb_avail":747256992,"statfs":{"total":773094113280,"available":765191159808,"internally_reserved":0,"allocated":74678272,"data_stored":73201928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":7828131379},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":498,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003383"},"pg_stats":[{"pgid":"5.18","version":"27'4501","reported_seq":4523,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.380600+0000","last_change":"2024-09-10T08:28:47.627476+0000","last_active":"2024-09-10T08:44:29.380600+0000","last_peered":"2024-09-10T08:44:29.380600+0000","last_clean":"2024-09-10T08:44:29.380600+0000","last_became_active":"2024-09-10T08:28:47.627217+0000","last_became_peered":"2024-09-10T08:28:47.627217+0000","last_unstale":"2024-09-10T08:44:29.380600+0000","last_undegraded":"2024-09-10T08:44:29.380600+0000","last_fullsized":"2024-09-10T08:44:29.380600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":0,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:25.152836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23743,"num_write_kb":296073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"27'672","reported_seq":705,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:32.511067+0000","last_change":"2024-09-10T08:28:34.564816+0000","last_active":"2024-09-10T08:43:32.511067+0000","last_peered":"2024-09-10T08:43:32.511067+0000","last_clean":"2024-09-10T08:43:32.511067+0000","last_became_active":"2024-09-10T08:28:34.564545+0000","last_became_peered":"2024-09-10T08:28:34.564545+0000","last_unstale":"2024-09-10T08:43:32.511067+0000","last_undegraded":"2024-09-10T08:43:32.511067+0000","last_fullsized":"2024-09-10T08:43:32.511067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:34.365104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":670,"num_write_kb":4473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5460","reported_seq":5491,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.446984+0000","last_change":"2024-09-10T08:28:35.575267+0000","last_active":"2024-09-10T08:44:22.446984+0000","last_peered":"2024-09-10T08:44:22.446984+0000","last_clean":"2024-09-10T08:44:22.446984+0000","last_became_active":"2024-09-10T08:28:35.575019+0000","last_became_peered":"2024-09-10T08:28:35.575019+0000","last_unstale":"2024-09-10T08:44:22.446984+0000","last_undegraded":"2024-09-10T08:44:22.446984+0000","last_fullsized":"2024-09-10T08:44:22.446984+0000","mapping_epoch":19,"log_start":"27'200","ondisk_log_start":"27'200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5260,"log_dups_size":0,"ondisk_log_size":5260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:00.810645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28693,"num_write_kb":332310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:16.827314+0000","last_change":"2024-09-10T08:28:46.620227+0000","last_active":"2024-09-10T08:43:16.827314+0000","last_peered":"2024-09-10T08:43:16.827314+0000","last_clean":"2024-09-10T08:43:16.827314+0000","last_became_active":"2024-09-10T08:28:46.619540+0000","last_became_peered":"2024-09-10T08:28:46.619540+0000","last_unstale":"2024-09-10T08:43:16.827314+0000","last_undegraded":"2024-09-10T08:43:16.827314+0000","last_fullsized":"2024-09-10T08:43:16.827314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:13.402155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"27'5259","reported_seq":5281,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.450085+0000","last_change":"2024-09-10T08:28:47.633586+0000","last_active":"2024-09-10T08:44:29.450085+0000","last_peered":"2024-09-10T08:44:29.450085+0000","last_clean":"2024-09-10T08:44:29.450085+0000","last_became_active":"2024-09-10T08:28:47.633292+0000","last_became_peered":"2024-09-10T08:28:47.633292+0000","last_unstale":"2024-09-10T08:44:29.450085+0000","last_undegraded":"2024-09-10T08:44:29.450085+0000","last_fullsized":"2024-09-10T08:44:29.450085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5259,"log_dups_size":0,"ondisk_log_size":5259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:19.473028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27465,"num_write_kb":347758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"27'8","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.983363+0000","last_change":"2024-09-10T08:28:34.561691+0000","last_active":"2024-09-10T08:43:47.983363+0000","last_peered":"2024-09-10T08:43:47.983363+0000","last_clean":"2024-09-10T08:43:47.983363+0000","last_became_active":"2024-09-10T08:28:34.561410+0000","last_became_peered":"2024-09-10T08:28:34.561410+0000","last_unstale":"2024-09-10T08:43:47.983363+0000","last_undegraded":"2024-09-10T08:43:47.983363+0000","last_fullsized":"2024-09-10T08:43:47.983363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.629982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'5545","reported_seq":5576,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.505223+0000","last_change":"2024-09-10T08:28:35.579033+0000","last_active":"2024-09-10T08:44:22.505223+0000","last_peered":"2024-09-10T08:44:22.505223+0000","last_clean":"2024-09-10T08:44:22.505223+0000","last_became_active":"2024-09-10T08:28:35.578333+0000","last_became_peered":"2024-09-10T08:28:35.578333+0000","last_unstale":"2024-09-10T08:44:22.505223+0000","last_undegraded":"2024-09-10T08:44:22.505223+0000","last_fullsized":"2024-09-10T08:44:22.505223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5545,"log_dups_size":0,"ondisk_log_size":5545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:58.779491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29606,"num_write_kb":364444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:31.334990+0000","last_change":"2024-09-10T08:28:46.617317+0000","last_active":"2024-09-10T08:43:31.334990+0000","last_peered":"2024-09-10T08:43:31.334990+0000","last_clean":"2024-09-10T08:43:31.334990+0000","last_became_active":"2024-09-10T08:28:46.616806+0000","last_became_peered":"2024-09-10T08:28:46.616806+0000","last_unstale":"2024-09-10T08:43:31.334990+0000","last_undegraded":"2024-09-10T08:43:31.334990+0000","last_fullsized":"2024-09-10T08:43:31.334990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:46.916848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"27'4143","reported_seq":4165,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.444464+0000","last_change":"2024-09-10T08:28:47.633194+0000","last_active":"2024-09-10T08:44:29.444464+0000","last_peered":"2024-09-10T08:44:29.444464+0000","last_clean":"2024-09-10T08:44:29.444464+0000","last_became_active":"2024-09-10T08:28:47.632772+0000","last_became_peered":"2024-09-10T08:28:47.632772+0000","last_unstale":"2024-09-10T08:44:29.444464+0000","last_undegraded":"2024-09-10T08:44:29.444464+0000","last_fullsized":"2024-09-10T08:44:29.444464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4143,"log_dups_size":0,"ondisk_log_size":4143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:59.228438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21394,"num_write_kb":261850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"27'11","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.989437+0000","last_change":"2024-09-10T08:28:34.571965+0000","last_active":"2024-09-10T08:43:47.989437+0000","last_peered":"2024-09-10T08:43:47.989437+0000","last_clean":"2024-09-10T08:43:47.989437+0000","last_became_active":"2024-09-10T08:28:34.571640+0000","last_became_peered":"2024-09-10T08:28:34.571640+0000","last_unstale":"2024-09-10T08:43:47.989437+0000","last_undegraded":"2024-09-10T08:43:47.989437+0000","last_fullsized":"2024-09-10T08:43:47.989437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:53.047030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'3192","reported_seq":3222,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.520724+0000","last_change":"2024-09-10T08:28:35.562132+0000","last_active":"2024-09-10T08:44:22.520724+0000","last_peered":"2024-09-10T08:44:22.520724+0000","last_clean":"2024-09-10T08:44:22.520724+0000","last_became_active":"2024-09-10T08:28:35.561842+0000","last_became_peered":"2024-09-10T08:28:35.561842+0000","last_unstale":"2024-09-10T08:44:22.520724+0000","last_undegraded":"2024-09-10T08:44:22.520724+0000","last_fullsized":"2024-09-10T08:44:22.520724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3192,"log_dups_size":0,"ondisk_log_size":3192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:48.810258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15765,"num_write_kb":210601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'613","reported_seq":637,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:30.437035+0000","last_change":"2024-09-10T08:28:46.621093+0000","last_active":"2024-09-10T08:43:30.437035+0000","last_peered":"2024-09-10T08:43:30.437035+0000","last_clean":"2024-09-10T08:43:30.437035+0000","last_became_active":"2024-09-10T08:28:46.620794+0000","last_became_peered":"2024-09-10T08:28:46.620794+0000","last_unstale":"2024-09-10T08:43:30.437035+0000","last_undegraded":"2024-09-10T08:43:30.437035+0000","last_fullsized":"2024-09-10T08:43:30.437035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:20.501262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":611,"num_write_kb":4232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"27'3484","reported_seq":3506,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.377089+0000","last_change":"2024-09-10T08:28:47.627756+0000","last_active":"2024-09-10T08:44:29.377089+0000","last_peered":"2024-09-10T08:44:29.377089+0000","last_clean":"2024-09-10T08:44:29.377089+0000","last_became_active":"2024-09-10T08:28:47.627476+0000","last_became_peered":"2024-09-10T08:28:47.627476+0000","last_unstale":"2024-09-10T08:44:29.377089+0000","last_undegraded":"2024-09-10T08:44:29.377089+0000","last_fullsized":"2024-09-10T08:44:29.377089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:25.945793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18057,"num_write_kb":232111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"27'3","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:38.481193+0000","last_change":"2024-09-10T08:28:34.566560+0000","last_active":"2024-09-10T08:43:38.481193+0000","last_peered":"2024-09-10T08:43:38.481193+0000","last_clean":"2024-09-10T08:43:38.481193+0000","last_became_active":"2024-09-10T08:28:34.566275+0000","last_became_peered":"2024-09-10T08:28:34.566275+0000","last_unstale":"2024-09-10T08:43:38.481193+0000","last_undegraded":"2024-09-10T08:43:38.481193+0000","last_fullsized":"2024-09-10T08:43:38.481193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:03.507683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'5826","reported_seq":5841,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.521297+0000","last_change":"2024-09-10T08:29:35.097937+0000","last_active":"2024-09-10T08:44:22.521297+0000","last_peered":"2024-09-10T08:44:22.521297+0000","last_clean":"2024-09-10T08:44:22.521297+0000","last_became_active":"2024-09-10T08:29:35.097553+0000","last_became_peered":"2024-09-10T08:29:35.097553+0000","last_unstale":"2024-09-10T08:44:22.521297+0000","last_undegraded":"2024-09-10T08:44:22.521297+0000","last_fullsized":"2024-09-10T08:44:22.521297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5826,"log_dups_size":0,"ondisk_log_size":5826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:02.685992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30231,"num_write_kb":366977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"27'66","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.247916+0000","last_change":"2024-09-10T08:28:46.620162+0000","last_active":"2024-09-10T08:44:29.247916+0000","last_peered":"2024-09-10T08:44:29.247916+0000","last_clean":"2024-09-10T08:44:29.247916+0000","last_became_active":"2024-09-10T08:28:46.619889+0000","last_became_peered":"2024-09-10T08:28:46.619889+0000","last_unstale":"2024-09-10T08:44:29.247916+0000","last_undegraded":"2024-09-10T08:44:29.247916+0000","last_fullsized":"2024-09-10T08:44:29.247916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:13.820143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":755904,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"27'4988","reported_seq":5010,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.392676+0000","last_change":"2024-09-10T08:28:47.631094+0000","last_active":"2024-09-10T08:44:29.392676+0000","last_peered":"2024-09-10T08:44:29.392676+0000","last_clean":"2024-09-10T08:44:29.392676+0000","last_became_active":"2024-09-10T08:28:47.630787+0000","last_became_peered":"2024-09-10T08:28:47.630787+0000","last_unstale":"2024-09-10T08:44:29.392676+0000","last_undegraded":"2024-09-10T08:44:29.392676+0000","last_fullsized":"2024-09-10T08:44:29.392676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4988,"log_dups_size":0,"ondisk_log_size":4988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:06.277094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26081,"num_write_kb":317657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"27'4088","reported_seq":4119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.452804+0000","last_change":"2024-09-10T08:28:35.572478+0000","last_active":"2024-09-10T08:44:22.452804+0000","last_peered":"2024-09-10T08:44:22.452804+0000","last_clean":"2024-09-10T08:44:22.452804+0000","last_became_active":"2024-09-10T08:28:35.572215+0000","last_became_peered":"2024-09-10T08:28:35.572215+0000","last_unstale":"2024-09-10T08:44:22.452804+0000","last_undegraded":"2024-09-10T08:44:22.452804+0000","last_fullsized":"2024-09-10T08:44:22.452804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4088,"log_dups_size":0,"ondisk_log_size":4088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:40.397318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21444,"num_write_kb":270258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'1129","reported_seq":1162,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.009048+0000","last_change":"2024-09-10T08:28:34.569235+0000","last_active":"2024-09-10T08:43:48.009048+0000","last_peered":"2024-09-10T08:43:48.009048+0000","last_clean":"2024-09-10T08:43:48.009048+0000","last_became_active":"2024-09-10T08:28:34.568899+0000","last_became_peered":"2024-09-10T08:28:34.568899+0000","last_unstale":"2024-09-10T08:43:48.009048+0000","last_undegraded":"2024-09-10T08:43:48.009048+0000","last_fullsized":"2024-09-10T08:43:48.009048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1129,"log_dups_size":0,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:21.927656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:30.440512+0000","last_change":"2024-09-10T08:28:46.618502+0000","last_active":"2024-09-10T08:43:30.440512+0000","last_peered":"2024-09-10T08:43:30.440512+0000","last_clean":"2024-09-10T08:43:30.440512+0000","last_became_active":"2024-09-10T08:28:46.616824+0000","last_became_peered":"2024-09-10T08:28:46.616824+0000","last_unstale":"2024-09-10T08:43:30.440512+0000","last_undegraded":"2024-09-10T08:43:30.440512+0000","last_fullsized":"2024-09-10T08:43:30.440512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:06.554102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"27'4540","reported_seq":4563,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.406451+0000","last_change":"2024-09-10T08:28:47.627138+0000","last_active":"2024-09-10T08:44:29.406451+0000","last_peered":"2024-09-10T08:44:29.406451+0000","last_clean":"2024-09-10T08:44:29.406451+0000","last_became_active":"2024-09-10T08:28:47.626871+0000","last_became_peered":"2024-09-10T08:28:47.626871+0000","last_unstale":"2024-09-10T08:44:29.406451+0000","last_undegraded":"2024-09-10T08:44:29.406451+0000","last_fullsized":"2024-09-10T08:44:29.406451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4540,"log_dups_size":0,"ondisk_log_size":4540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:10.927283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23818,"num_write_kb":300351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"27'4200","reported_seq":4231,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.491988+0000","last_change":"2024-09-10T08:28:35.577024+0000","last_active":"2024-09-10T08:44:22.491988+0000","last_peered":"2024-09-10T08:44:22.491988+0000","last_clean":"2024-09-10T08:44:22.491988+0000","last_became_active":"2024-09-10T08:28:35.576771+0000","last_became_peered":"2024-09-10T08:28:35.576771+0000","last_unstale":"2024-09-10T08:44:22.491988+0000","last_undegraded":"2024-09-10T08:44:22.491988+0000","last_fullsized":"2024-09-10T08:44:22.491988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4200,"log_dups_size":0,"ondisk_log_size":4200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:07.162941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21158,"num_write_kb":256901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.001370+0000","last_change":"2024-09-10T08:28:34.561324+0000","last_active":"2024-09-10T08:43:48.001370+0000","last_peered":"2024-09-10T08:43:48.001370+0000","last_clean":"2024-09-10T08:43:48.001370+0000","last_became_active":"2024-09-10T08:28:34.560974+0000","last_became_peered":"2024-09-10T08:28:34.560974+0000","last_unstale":"2024-09-10T08:43:48.001370+0000","last_undegraded":"2024-09-10T08:43:48.001370+0000","last_fullsized":"2024-09-10T08:43:48.001370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:18.790965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.763262+0000","last_change":"2024-09-10T08:28:46.620411+0000","last_active":"2024-09-10T08:43:37.763262+0000","last_peered":"2024-09-10T08:43:37.763262+0000","last_clean":"2024-09-10T08:43:37.763262+0000","last_became_active":"2024-09-10T08:28:46.619553+0000","last_became_peered":"2024-09-10T08:28:46.619553+0000","last_unstale":"2024-09-10T08:43:37.763262+0000","last_undegraded":"2024-09-10T08:43:37.763262+0000","last_fullsized":"2024-09-10T08:43:37.763262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:04.414048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"27'4215","reported_seq":4237,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.402749+0000","last_change":"2024-09-10T08:28:47.628563+0000","last_active":"2024-09-10T08:44:29.402749+0000","last_peered":"2024-09-10T08:44:29.402749+0000","last_clean":"2024-09-10T08:44:29.402749+0000","last_became_active":"2024-09-10T08:28:47.628290+0000","last_became_peered":"2024-09-10T08:28:47.628290+0000","last_unstale":"2024-09-10T08:44:29.402749+0000","last_undegraded":"2024-09-10T08:44:29.402749+0000","last_fullsized":"2024-09-10T08:44:29.402749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:15.652718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21334,"num_write_kb":282217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'4711","reported_seq":4742,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.503605+0000","last_change":"2024-09-10T08:28:35.572363+0000","last_active":"2024-09-10T08:44:22.503605+0000","last_peered":"2024-09-10T08:44:22.503605+0000","last_clean":"2024-09-10T08:44:22.503605+0000","last_became_active":"2024-09-10T08:28:35.572108+0000","last_became_peered":"2024-09-10T08:28:35.572108+0000","last_unstale":"2024-09-10T08:44:22.503605+0000","last_undegraded":"2024-09-10T08:44:22.503605+0000","last_fullsized":"2024-09-10T08:44:22.503605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4711,"log_dups_size":0,"ondisk_log_size":4711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:48.358634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24668,"num_write_kb":303691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.969574+0000","last_change":"2024-09-10T08:28:34.564813+0000","last_active":"2024-09-10T08:43:47.969574+0000","last_peered":"2024-09-10T08:43:47.969574+0000","last_clean":"2024-09-10T08:43:47.969574+0000","last_became_active":"2024-09-10T08:28:34.564557+0000","last_became_peered":"2024-09-10T08:28:34.564557+0000","last_unstale":"2024-09-10T08:43:47.969574+0000","last_undegraded":"2024-09-10T08:43:47.969574+0000","last_fullsized":"2024-09-10T08:43:47.969574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:48.356069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.846008+0000","last_change":"2024-09-10T08:28:46.625346+0000","last_active":"2024-09-10T08:43:37.846008+0000","last_peered":"2024-09-10T08:43:37.846008+0000","last_clean":"2024-09-10T08:43:37.846008+0000","last_became_active":"2024-09-10T08:28:46.625059+0000","last_became_peered":"2024-09-10T08:28:46.625059+0000","last_unstale":"2024-09-10T08:43:37.846008+0000","last_undegraded":"2024-09-10T08:43:37.846008+0000","last_fullsized":"2024-09-10T08:43:37.846008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:44.512285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"27'5035","reported_seq":5057,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.447853+0000","last_change":"2024-09-10T08:28:47.621307+0000","last_active":"2024-09-10T08:44:29.447853+0000","last_peered":"2024-09-10T08:44:29.447853+0000","last_clean":"2024-09-10T08:44:29.447853+0000","last_became_active":"2024-09-10T08:28:47.621043+0000","last_became_peered":"2024-09-10T08:28:47.621043+0000","last_unstale":"2024-09-10T08:44:29.447853+0000","last_undegraded":"2024-09-10T08:44:29.447853+0000","last_fullsized":"2024-09-10T08:44:29.447853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5035,"log_dups_size":0,"ondisk_log_size":5035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:30.300108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25734,"num_write_kb":340789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"27'4207","reported_seq":4238,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.428180+0000","last_change":"2024-09-10T08:28:35.569938+0000","last_active":"2024-09-10T08:44:22.428180+0000","last_peered":"2024-09-10T08:44:22.428180+0000","last_clean":"2024-09-10T08:44:22.428180+0000","last_became_active":"2024-09-10T08:28:35.569109+0000","last_became_peered":"2024-09-10T08:28:35.569109+0000","last_unstale":"2024-09-10T08:44:22.428180+0000","last_undegraded":"2024-09-10T08:44:22.428180+0000","last_fullsized":"2024-09-10T08:44:22.428180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4207,"log_dups_size":0,"ondisk_log_size":4207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:51.680564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21000,"num_write_kb":276623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.000341+0000","last_change":"2024-09-10T08:28:34.571069+0000","last_active":"2024-09-10T08:43:48.000341+0000","last_peered":"2024-09-10T08:43:48.000341+0000","last_clean":"2024-09-10T08:43:48.000341+0000","last_became_active":"2024-09-10T08:28:34.570766+0000","last_became_peered":"2024-09-10T08:28:34.570766+0000","last_unstale":"2024-09-10T08:43:48.000341+0000","last_undegraded":"2024-09-10T08:43:48.000341+0000","last_fullsized":"2024-09-10T08:43:48.000341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:47.458195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.830412+0000","last_change":"2024-09-10T08:28:46.616531+0000","last_active":"2024-09-10T08:43:37.830412+0000","last_peered":"2024-09-10T08:43:37.830412+0000","last_clean":"2024-09-10T08:43:37.830412+0000","last_became_active":"2024-09-10T08:28:46.616254+0000","last_became_peered":"2024-09-10T08:28:46.616254+0000","last_unstale":"2024-09-10T08:43:37.830412+0000","last_undegraded":"2024-09-10T08:43:37.830412+0000","last_fullsized":"2024-09-10T08:43:37.830412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:44.162368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"27'4342","reported_seq":4365,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.372206+0000","last_change":"2024-09-10T08:28:47.628177+0000","last_active":"2024-09-10T08:44:29.372206+0000","last_peered":"2024-09-10T08:44:29.372206+0000","last_clean":"2024-09-10T08:44:29.372206+0000","last_became_active":"2024-09-10T08:28:47.627869+0000","last_became_peered":"2024-09-10T08:28:47.627869+0000","last_unstale":"2024-09-10T08:44:29.372206+0000","last_undegraded":"2024-09-10T08:44:29.372206+0000","last_fullsized":"2024-09-10T08:44:29.372206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:19.075558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23056,"num_write_kb":285008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"27'4228","reported_seq":4259,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.456227+0000","last_change":"2024-09-10T08:28:35.575106+0000","last_active":"2024-09-10T08:44:22.456227+0000","last_peered":"2024-09-10T08:44:22.456227+0000","last_clean":"2024-09-10T08:44:22.456227+0000","last_became_active":"2024-09-10T08:28:35.574815+0000","last_became_peered":"2024-09-10T08:28:35.574815+0000","last_unstale":"2024-09-10T08:44:22.456227+0000","last_undegraded":"2024-09-10T08:44:22.456227+0000","last_fullsized":"2024-09-10T08:44:22.456227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4228,"log_dups_size":0,"ondisk_log_size":4228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:26.512181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21299,"num_write_kb":257333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.990461+0000","last_change":"2024-09-10T08:28:34.564865+0000","last_active":"2024-09-10T08:43:47.990461+0000","last_peered":"2024-09-10T08:43:47.990461+0000","last_clean":"2024-09-10T08:43:47.990461+0000","last_became_active":"2024-09-10T08:28:34.564549+0000","last_became_peered":"2024-09-10T08:28:34.564549+0000","last_unstale":"2024-09-10T08:43:47.990461+0000","last_undegraded":"2024-09-10T08:43:47.990461+0000","last_fullsized":"2024-09-10T08:43:47.990461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:05.523637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'53","reported_seq":129,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:43.064352+0000","last_change":"2024-09-10T08:28:46.622505+0000","last_active":"2024-09-10T08:43:43.064352+0000","last_peered":"2024-09-10T08:43:43.064352+0000","last_clean":"2024-09-10T08:43:43.064352+0000","last_became_active":"2024-09-10T08:28:46.621052+0000","last_became_peered":"2024-09-10T08:28:46.621052+0000","last_unstale":"2024-09-10T08:43:43.064352+0000","last_undegraded":"2024-09-10T08:43:43.064352+0000","last_fullsized":"2024-09-10T08:43:43.064352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:37.411404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":121,"num_write":51,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"27'4494","reported_seq":4517,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.358623+0000","last_change":"2024-09-10T08:28:47.624919+0000","last_active":"2024-09-10T08:44:29.358623+0000","last_peered":"2024-09-10T08:44:29.358623+0000","last_clean":"2024-09-10T08:44:29.358623+0000","last_became_active":"2024-09-10T08:28:47.624651+0000","last_became_peered":"2024-09-10T08:28:47.624651+0000","last_unstale":"2024-09-10T08:44:29.358623+0000","last_undegraded":"2024-09-10T08:44:29.358623+0000","last_fullsized":"2024-09-10T08:44:29.358623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4494,"log_dups_size":0,"ondisk_log_size":4494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:11.049160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23585,"num_write_kb":291272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'4460","reported_seq":4491,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.508365+0000","last_change":"2024-09-10T08:28:35.574107+0000","last_active":"2024-09-10T08:44:22.508365+0000","last_peered":"2024-09-10T08:44:22.508365+0000","last_clean":"2024-09-10T08:44:22.508365+0000","last_became_active":"2024-09-10T08:28:35.573851+0000","last_became_peered":"2024-09-10T08:28:35.573851+0000","last_unstale":"2024-09-10T08:44:22.508365+0000","last_undegraded":"2024-09-10T08:44:22.508365+0000","last_fullsized":"2024-09-10T08:44:22.508365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4460,"log_dups_size":0,"ondisk_log_size":4460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:53.240223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22566,"num_write_kb":290967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'599","reported_seq":632,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.994651+0000","last_change":"2024-09-10T08:28:34.563451+0000","last_active":"2024-09-10T08:43:47.994651+0000","last_peered":"2024-09-10T08:43:47.994651+0000","last_clean":"2024-09-10T08:43:47.994651+0000","last_became_active":"2024-09-10T08:28:34.563259+0000","last_became_peered":"2024-09-10T08:28:34.563259+0000","last_unstale":"2024-09-10T08:43:47.994651+0000","last_undegraded":"2024-09-10T08:43:47.994651+0000","last_fullsized":"2024-09-10T08:43:47.994651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:44.899351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1430,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.807587+0000","last_change":"2024-09-10T08:28:46.623396+0000","last_active":"2024-09-10T08:43:37.807587+0000","last_peered":"2024-09-10T08:43:37.807587+0000","last_clean":"2024-09-10T08:43:37.807587+0000","last_became_active":"2024-09-10T08:28:46.623139+0000","last_became_peered":"2024-09-10T08:28:46.623139+0000","last_unstale":"2024-09-10T08:43:37.807587+0000","last_undegraded":"2024-09-10T08:43:37.807587+0000","last_fullsized":"2024-09-10T08:43:37.807587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:00.210413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"27'4787","reported_seq":4810,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.341999+0000","last_change":"2024-09-10T08:28:47.634754+0000","last_active":"2024-09-10T08:44:29.341999+0000","last_peered":"2024-09-10T08:44:29.341999+0000","last_clean":"2024-09-10T08:44:29.341999+0000","last_became_active":"2024-09-10T08:28:47.634382+0000","last_became_peered":"2024-09-10T08:28:47.634382+0000","last_unstale":"2024-09-10T08:44:29.341999+0000","last_undegraded":"2024-09-10T08:44:29.341999+0000","last_fullsized":"2024-09-10T08:44:29.341999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4787,"log_dups_size":0,"ondisk_log_size":4787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:23.489596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24922,"num_write_kb":313092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"27'4927","reported_seq":4958,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.461013+0000","last_change":"2024-09-10T08:28:35.567481+0000","last_active":"2024-09-10T08:44:22.461013+0000","last_peered":"2024-09-10T08:44:22.461013+0000","last_clean":"2024-09-10T08:44:22.461013+0000","last_became_active":"2024-09-10T08:28:35.567167+0000","last_became_peered":"2024-09-10T08:28:35.567167+0000","last_unstale":"2024-09-10T08:44:22.461013+0000","last_undegraded":"2024-09-10T08:44:22.461013+0000","last_fullsized":"2024-09-10T08:44:22.461013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4927,"log_dups_size":0,"ondisk_log_size":4927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:44.110012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25981,"num_write_kb":313006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.989517+0000","last_change":"2024-09-10T08:28:34.571283+0000","last_active":"2024-09-10T08:43:47.989517+0000","last_peered":"2024-09-10T08:43:47.989517+0000","last_clean":"2024-09-10T08:43:47.989517+0000","last_became_active":"2024-09-10T08:28:34.570791+0000","last_became_peered":"2024-09-10T08:28:34.570791+0000","last_unstale":"2024-09-10T08:43:47.989517+0000","last_undegraded":"2024-09-10T08:43:47.989517+0000","last_fullsized":"2024-09-10T08:43:47.989517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:17.427597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:41:21.022972+0000","last_change":"2024-09-10T08:28:46.630983+0000","last_active":"2024-09-10T08:41:21.022972+0000","last_peered":"2024-09-10T08:41:21.022972+0000","last_clean":"2024-09-10T08:41:21.022972+0000","last_became_active":"2024-09-10T08:28:46.630658+0000","last_became_peered":"2024-09-10T08:28:46.630658+0000","last_unstale":"2024-09-10T08:41:21.022972+0000","last_undegraded":"2024-09-10T08:41:21.022972+0000","last_fullsized":"2024-09-10T08:41:21.022972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:11.219022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"27'4308","reported_seq":4331,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.418231+0000","last_change":"2024-09-10T08:28:47.625475+0000","last_active":"2024-09-10T08:44:29.418231+0000","last_peered":"2024-09-10T08:44:29.418231+0000","last_clean":"2024-09-10T08:44:29.418231+0000","last_became_active":"2024-09-10T08:28:47.625186+0000","last_became_peered":"2024-09-10T08:28:47.625186+0000","last_unstale":"2024-09-10T08:44:29.418231+0000","last_undegraded":"2024-09-10T08:44:29.418231+0000","last_fullsized":"2024-09-10T08:44:29.418231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4308,"log_dups_size":0,"ondisk_log_size":4308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:15.932769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23330,"num_write_kb":286070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'4301","reported_seq":4332,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.444485+0000","last_change":"2024-09-10T08:28:35.576280+0000","last_active":"2024-09-10T08:44:22.444485+0000","last_peered":"2024-09-10T08:44:22.444485+0000","last_clean":"2024-09-10T08:44:22.444485+0000","last_became_active":"2024-09-10T08:28:35.576002+0000","last_became_peered":"2024-09-10T08:28:35.576002+0000","last_unstale":"2024-09-10T08:44:22.444485+0000","last_undegraded":"2024-09-10T08:44:22.444485+0000","last_fullsized":"2024-09-10T08:44:22.444485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4301,"log_dups_size":0,"ondisk_log_size":4301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:46.278441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22897,"num_write_kb":271992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.974079+0000","last_change":"2024-09-10T08:28:34.555212+0000","last_active":"2024-09-10T08:43:47.974079+0000","last_peered":"2024-09-10T08:43:47.974079+0000","last_clean":"2024-09-10T08:43:47.974079+0000","last_became_active":"2024-09-10T08:28:34.554922+0000","last_became_peered":"2024-09-10T08:28:34.554922+0000","last_unstale":"2024-09-10T08:43:47.974079+0000","last_undegraded":"2024-09-10T08:43:47.974079+0000","last_fullsized":"2024-09-10T08:43:47.974079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.824479+0000","last_change":"2024-09-10T08:28:46.624886+0000","last_active":"2024-09-10T08:43:37.824479+0000","last_peered":"2024-09-10T08:43:37.824479+0000","last_clean":"2024-09-10T08:43:37.824479+0000","last_became_active":"2024-09-10T08:28:46.624690+0000","last_became_peered":"2024-09-10T08:28:46.624690+0000","last_unstale":"2024-09-10T08:43:37.824479+0000","last_undegraded":"2024-09-10T08:43:37.824479+0000","last_fullsized":"2024-09-10T08:43:37.824479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:15.023379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"27'4253","reported_seq":4276,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.376801+0000","last_change":"2024-09-10T08:28:47.634161+0000","last_active":"2024-09-10T08:44:29.376801+0000","last_peered":"2024-09-10T08:44:29.376801+0000","last_clean":"2024-09-10T08:44:29.376801+0000","last_became_active":"2024-09-10T08:28:47.633893+0000","last_became_peered":"2024-09-10T08:28:47.633893+0000","last_unstale":"2024-09-10T08:44:29.376801+0000","last_undegraded":"2024-09-10T08:44:29.376801+0000","last_fullsized":"2024-09-10T08:44:29.376801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4253,"log_dups_size":0,"ondisk_log_size":4253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:37.072370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22807,"num_write_kb":271856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'4548","reported_seq":4579,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.464810+0000","last_change":"2024-09-10T08:28:35.577978+0000","last_active":"2024-09-10T08:44:22.464810+0000","last_peered":"2024-09-10T08:44:22.464810+0000","last_clean":"2024-09-10T08:44:22.464810+0000","last_became_active":"2024-09-10T08:28:35.577718+0000","last_became_peered":"2024-09-10T08:28:35.577718+0000","last_unstale":"2024-09-10T08:44:22.464810+0000","last_undegraded":"2024-09-10T08:44:22.464810+0000","last_fullsized":"2024-09-10T08:44:22.464810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4548,"log_dups_size":0,"ondisk_log_size":4548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:01:57.257817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24326,"num_write_kb":290026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.003029+0000","last_change":"2024-09-10T08:28:34.553983+0000","last_active":"2024-09-10T08:43:48.003029+0000","last_peered":"2024-09-10T08:43:48.003029+0000","last_clean":"2024-09-10T08:43:48.003029+0000","last_became_active":"2024-09-10T08:28:34.553693+0000","last_became_peered":"2024-09-10T08:28:34.553693+0000","last_unstale":"2024-09-10T08:43:48.003029+0000","last_undegraded":"2024-09-10T08:43:48.003029+0000","last_fullsized":"2024-09-10T08:43:48.003029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:40.001685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.780271+0000","last_change":"2024-09-10T08:28:46.620165+0000","last_active":"2024-09-10T08:43:37.780271+0000","last_peered":"2024-09-10T08:43:37.780271+0000","last_clean":"2024-09-10T08:43:37.780271+0000","last_became_active":"2024-09-10T08:28:46.619853+0000","last_became_peered":"2024-09-10T08:28:46.619853+0000","last_unstale":"2024-09-10T08:43:37.780271+0000","last_undegraded":"2024-09-10T08:43:37.780271+0000","last_fullsized":"2024-09-10T08:43:37.780271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:36.006532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'3675","reported_seq":3698,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.383338+0000","last_change":"2024-09-10T08:28:47.621588+0000","last_active":"2024-09-10T08:44:29.383338+0000","last_peered":"2024-09-10T08:44:29.383338+0000","last_clean":"2024-09-10T08:44:29.383338+0000","last_became_active":"2024-09-10T08:28:47.621122+0000","last_became_peered":"2024-09-10T08:28:47.621122+0000","last_unstale":"2024-09-10T08:44:29.383338+0000","last_undegraded":"2024-09-10T08:44:29.383338+0000","last_fullsized":"2024-09-10T08:44:29.383338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3675,"log_dups_size":0,"ondisk_log_size":3675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:11.250838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18710,"num_write_kb":246893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'4629","reported_seq":4660,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.445596+0000","last_change":"2024-09-10T08:28:35.566745+0000","last_active":"2024-09-10T08:44:22.445596+0000","last_peered":"2024-09-10T08:44:22.445596+0000","last_clean":"2024-09-10T08:44:22.445596+0000","last_became_active":"2024-09-10T08:28:35.566444+0000","last_became_peered":"2024-09-10T08:28:35.566444+0000","last_unstale":"2024-09-10T08:44:22.445596+0000","last_undegraded":"2024-09-10T08:44:22.445596+0000","last_fullsized":"2024-09-10T08:44:22.445596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4629,"log_dups_size":0,"ondisk_log_size":4629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:52.735296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24423,"num_write_kb":290556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'60","reported_seq":151,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:38.178514+0000","last_change":"2024-09-10T08:28:34.560745+0000","last_active":"2024-09-10T08:43:38.178514+0000","last_peered":"2024-09-10T08:43:38.178514+0000","last_clean":"2024-09-10T08:43:38.178514+0000","last_became_active":"2024-09-10T08:28:34.559911+0000","last_became_peered":"2024-09-10T08:28:34.559911+0000","last_unstale":"2024-09-10T08:43:38.178514+0000","last_undegraded":"2024-09-10T08:43:38.178514+0000","last_fullsized":"2024-09-10T08:43:38.178514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:00.234067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":129,"num_write":58,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.785296+0000","last_change":"2024-09-10T08:28:46.623886+0000","last_active":"2024-09-10T08:43:37.785296+0000","last_peered":"2024-09-10T08:43:37.785296+0000","last_clean":"2024-09-10T08:43:37.785296+0000","last_became_active":"2024-09-10T08:28:46.622790+0000","last_became_peered":"2024-09-10T08:28:46.622790+0000","last_unstale":"2024-09-10T08:43:37.785296+0000","last_undegraded":"2024-09-10T08:43:37.785296+0000","last_fullsized":"2024-09-10T08:43:37.785296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:06:32.333116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"27'4388","reported_seq":4411,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.440297+0000","last_change":"2024-09-10T08:28:47.634500+0000","last_active":"2024-09-10T08:44:29.440297+0000","last_peered":"2024-09-10T08:44:29.440297+0000","last_clean":"2024-09-10T08:44:29.440297+0000","last_became_active":"2024-09-10T08:28:47.634219+0000","last_became_peered":"2024-09-10T08:28:47.634219+0000","last_unstale":"2024-09-10T08:44:29.440297+0000","last_undegraded":"2024-09-10T08:44:29.440297+0000","last_fullsized":"2024-09-10T08:44:29.440297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4388,"log_dups_size":0,"ondisk_log_size":4388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:59.689554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22741,"num_write_kb":291819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"27'4638","reported_seq":4669,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.452749+0000","last_change":"2024-09-10T08:28:35.576360+0000","last_active":"2024-09-10T08:44:22.452749+0000","last_peered":"2024-09-10T08:44:22.452749+0000","last_clean":"2024-09-10T08:44:22.452749+0000","last_became_active":"2024-09-10T08:28:35.576096+0000","last_became_peered":"2024-09-10T08:28:35.576096+0000","last_unstale":"2024-09-10T08:44:22.452749+0000","last_undegraded":"2024-09-10T08:44:22.452749+0000","last_fullsized":"2024-09-10T08:44:22.452749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4638,"log_dups_size":0,"ondisk_log_size":4638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:34.159275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24206,"num_write_kb":293700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.002633+0000","last_change":"2024-09-10T08:28:34.568477+0000","last_active":"2024-09-10T08:43:48.002633+0000","last_peered":"2024-09-10T08:43:48.002633+0000","last_clean":"2024-09-10T08:43:48.002633+0000","last_became_active":"2024-09-10T08:28:34.568249+0000","last_became_peered":"2024-09-10T08:28:34.568249+0000","last_unstale":"2024-09-10T08:43:48.002633+0000","last_undegraded":"2024-09-10T08:43:48.002633+0000","last_fullsized":"2024-09-10T08:43:48.002633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:08.640043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'605","reported_seq":630,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:42.810957+0000","last_change":"2024-09-10T08:28:46.621567+0000","last_active":"2024-09-10T08:43:42.810957+0000","last_peered":"2024-09-10T08:43:42.810957+0000","last_clean":"2024-09-10T08:43:42.810957+0000","last_became_active":"2024-09-10T08:28:46.621272+0000","last_became_peered":"2024-09-10T08:28:46.621272+0000","last_unstale":"2024-09-10T08:43:42.810957+0000","last_undegraded":"2024-09-10T08:43:42.810957+0000","last_fullsized":"2024-09-10T08:43:42.810957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:37:34.936213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1451,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"27'4536","reported_seq":4559,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.455805+0000","last_change":"2024-09-10T08:28:47.631621+0000","last_active":"2024-09-10T08:44:29.455805+0000","last_peered":"2024-09-10T08:44:29.455805+0000","last_clean":"2024-09-10T08:44:29.455805+0000","last_became_active":"2024-09-10T08:28:47.631337+0000","last_became_peered":"2024-09-10T08:28:47.631337+0000","last_unstale":"2024-09-10T08:44:29.455805+0000","last_undegraded":"2024-09-10T08:44:29.455805+0000","last_fullsized":"2024-09-10T08:44:29.455805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4536,"log_dups_size":0,"ondisk_log_size":4536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:04.196705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23763,"num_write_kb":304142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"27'4950","reported_seq":4981,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.485120+0000","last_change":"2024-09-10T08:28:35.572658+0000","last_active":"2024-09-10T08:44:22.485120+0000","last_peered":"2024-09-10T08:44:22.485120+0000","last_clean":"2024-09-10T08:44:22.485120+0000","last_became_active":"2024-09-10T08:28:35.571611+0000","last_became_peered":"2024-09-10T08:28:35.571611+0000","last_unstale":"2024-09-10T08:44:22.485120+0000","last_undegraded":"2024-09-10T08:44:22.485120+0000","last_fullsized":"2024-09-10T08:44:22.485120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4950,"log_dups_size":0,"ondisk_log_size":4950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:42.726996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25652,"num_write_kb":316024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:41:05.971983+0000","last_change":"2024-09-10T08:28:34.555587+0000","last_active":"2024-09-10T08:41:05.971983+0000","last_peered":"2024-09-10T08:41:05.971983+0000","last_clean":"2024-09-10T08:41:05.971983+0000","last_became_active":"2024-09-10T08:28:34.555269+0000","last_became_peered":"2024-09-10T08:28:34.555269+0000","last_unstale":"2024-09-10T08:41:05.971983+0000","last_undegraded":"2024-09-10T08:41:05.971983+0000","last_fullsized":"2024-09-10T08:41:05.971983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:19.499870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":190,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:42:26.593595+0000","last_change":"2024-09-10T08:28:26.724394+0000","last_active":"2024-09-10T08:42:26.593595+0000","last_peered":"2024-09-10T08:42:26.593595+0000","last_clean":"2024-09-10T08:42:26.593595+0000","last_became_active":"2024-09-10T08:28:26.723452+0000","last_became_peered":"2024-09-10T08:28:26.723452+0000","last_unstale":"2024-09-10T08:42:26.593595+0000","last_undegraded":"2024-09-10T08:42:26.593595+0000","last_fullsized":"2024-09-10T08:42:26.593595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_clean_scrub_stamp":"2024-09-10T08:28:25.445753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:00.811505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.779193+0000","last_change":"2024-09-10T08:28:46.622048+0000","last_active":"2024-09-10T08:43:37.779193+0000","last_peered":"2024-09-10T08:43:37.779193+0000","last_clean":"2024-09-10T08:43:37.779193+0000","last_became_active":"2024-09-10T08:28:46.621770+0000","last_became_peered":"2024-09-10T08:28:46.621770+0000","last_unstale":"2024-09-10T08:43:37.779193+0000","last_undegraded":"2024-09-10T08:43:37.779193+0000","last_fullsized":"2024-09-10T08:43:37.779193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:51.430760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"27'3353","reported_seq":3376,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.382825+0000","last_change":"2024-09-10T08:28:47.620746+0000","last_active":"2024-09-10T08:44:29.382825+0000","last_peered":"2024-09-10T08:44:29.382825+0000","last_clean":"2024-09-10T08:44:29.382825+0000","last_became_active":"2024-09-10T08:28:47.620492+0000","last_became_peered":"2024-09-10T08:28:47.620492+0000","last_unstale":"2024-09-10T08:44:29.382825+0000","last_undegraded":"2024-09-10T08:44:29.382825+0000","last_fullsized":"2024-09-10T08:44:29.382825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3353,"log_dups_size":0,"ondisk_log_size":3353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:40.117978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16947,"num_write_kb":239873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'4450","reported_seq":4481,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.537803+0000","last_change":"2024-09-10T08:28:35.574532+0000","last_active":"2024-09-10T08:44:22.537803+0000","last_peered":"2024-09-10T08:44:22.537803+0000","last_clean":"2024-09-10T08:44:22.537803+0000","last_became_active":"2024-09-10T08:28:35.574215+0000","last_became_peered":"2024-09-10T08:28:35.574215+0000","last_unstale":"2024-09-10T08:44:22.537803+0000","last_undegraded":"2024-09-10T08:44:22.537803+0000","last_fullsized":"2024-09-10T08:44:22.537803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4450,"log_dups_size":0,"ondisk_log_size":4450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:28.455653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23087,"num_write_kb":297343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:35.033572+0000","last_change":"2024-09-10T08:28:34.559911+0000","last_active":"2024-09-10T08:43:35.033572+0000","last_peered":"2024-09-10T08:43:35.033572+0000","last_clean":"2024-09-10T08:43:35.033572+0000","last_became_active":"2024-09-10T08:28:34.559635+0000","last_became_peered":"2024-09-10T08:28:34.559635+0000","last_unstale":"2024-09-10T08:43:35.033572+0000","last_undegraded":"2024-09-10T08:43:35.033572+0000","last_fullsized":"2024-09-10T08:43:35.033572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:40.892609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.843424+0000","last_change":"2024-09-10T08:28:46.620352+0000","last_active":"2024-09-10T08:43:37.843424+0000","last_peered":"2024-09-10T08:43:37.843424+0000","last_clean":"2024-09-10T08:43:37.843424+0000","last_became_active":"2024-09-10T08:28:46.620064+0000","last_became_peered":"2024-09-10T08:28:46.620064+0000","last_unstale":"2024-09-10T08:43:37.843424+0000","last_undegraded":"2024-09-10T08:43:37.843424+0000","last_fullsized":"2024-09-10T08:43:37.843424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:59.333579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"27'3678","reported_seq":3701,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.377144+0000","last_change":"2024-09-10T08:28:47.620305+0000","last_active":"2024-09-10T08:44:29.377144+0000","last_peered":"2024-09-10T08:44:29.377144+0000","last_clean":"2024-09-10T08:44:29.377144+0000","last_became_active":"2024-09-10T08:28:47.620014+0000","last_became_peered":"2024-09-10T08:28:47.620014+0000","last_unstale":"2024-09-10T08:44:29.377144+0000","last_undegraded":"2024-09-10T08:44:29.377144+0000","last_fullsized":"2024-09-10T08:44:29.377144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3678,"log_dups_size":0,"ondisk_log_size":3678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:44.916136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19171,"num_write_kb":261286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'5065","reported_seq":5096,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.514606+0000","last_change":"2024-09-10T08:28:35.577124+0000","last_active":"2024-09-10T08:44:22.514606+0000","last_peered":"2024-09-10T08:44:22.514606+0000","last_clean":"2024-09-10T08:44:22.514606+0000","last_became_active":"2024-09-10T08:28:35.576655+0000","last_became_peered":"2024-09-10T08:28:35.576655+0000","last_unstale":"2024-09-10T08:44:22.514606+0000","last_undegraded":"2024-09-10T08:44:22.514606+0000","last_fullsized":"2024-09-10T08:44:22.514606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5065,"log_dups_size":0,"ondisk_log_size":5065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:29.878600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26367,"num_write_kb":318681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:35.039309+0000","last_change":"2024-09-10T08:28:34.560694+0000","last_active":"2024-09-10T08:43:35.039309+0000","last_peered":"2024-09-10T08:43:35.039309+0000","last_clean":"2024-09-10T08:43:35.039309+0000","last_became_active":"2024-09-10T08:28:34.560429+0000","last_became_peered":"2024-09-10T08:28:34.560429+0000","last_unstale":"2024-09-10T08:43:35.039309+0000","last_undegraded":"2024-09-10T08:43:35.039309+0000","last_fullsized":"2024-09-10T08:43:35.039309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:54.514467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'1099","reported_seq":1123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.786510+0000","last_change":"2024-09-10T08:28:46.622232+0000","last_active":"2024-09-10T08:43:37.786510+0000","last_peered":"2024-09-10T08:43:37.786510+0000","last_clean":"2024-09-10T08:43:37.786510+0000","last_became_active":"2024-09-10T08:28:46.621966+0000","last_became_peered":"2024-09-10T08:28:46.621966+0000","last_unstale":"2024-09-10T08:43:37.786510+0000","last_undegraded":"2024-09-10T08:43:37.786510+0000","last_fullsized":"2024-09-10T08:43:37.786510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1099,"log_dups_size":0,"ondisk_log_size":1099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:28.897045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1090,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"27'4366","reported_seq":4389,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.312771+0000","last_change":"2024-09-10T08:28:47.630602+0000","last_active":"2024-09-10T08:44:29.312771+0000","last_peered":"2024-09-10T08:44:29.312771+0000","last_clean":"2024-09-10T08:44:29.312771+0000","last_became_active":"2024-09-10T08:28:47.630234+0000","last_became_peered":"2024-09-10T08:28:47.630234+0000","last_unstale":"2024-09-10T08:44:29.312771+0000","last_undegraded":"2024-09-10T08:44:29.312771+0000","last_fullsized":"2024-09-10T08:44:29.312771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4366,"log_dups_size":0,"ondisk_log_size":4366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:03.808098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22466,"num_write_kb":282639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"27'5771","reported_seq":5802,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.572787+0000","last_change":"2024-09-10T08:28:35.577577+0000","last_active":"2024-09-10T08:44:22.572787+0000","last_peered":"2024-09-10T08:44:22.572787+0000","last_clean":"2024-09-10T08:44:22.572787+0000","last_became_active":"2024-09-10T08:28:35.576686+0000","last_became_peered":"2024-09-10T08:28:35.576686+0000","last_unstale":"2024-09-10T08:44:22.572787+0000","last_undegraded":"2024-09-10T08:44:22.572787+0000","last_fullsized":"2024-09-10T08:44:22.572787+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5671,"log_dups_size":0,"ondisk_log_size":5671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:36.334494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29457,"num_write_kb":355657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'6","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.996141+0000","last_change":"2024-09-10T08:28:34.560313+0000","last_active":"2024-09-10T08:43:47.996141+0000","last_peered":"2024-09-10T08:43:47.996141+0000","last_clean":"2024-09-10T08:43:47.996141+0000","last_became_active":"2024-09-10T08:28:34.560035+0000","last_became_peered":"2024-09-10T08:28:34.560035+0000","last_unstale":"2024-09-10T08:43:47.996141+0000","last_undegraded":"2024-09-10T08:43:47.996141+0000","last_fullsized":"2024-09-10T08:43:47.996141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:56.945537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.793333+0000","last_change":"2024-09-10T08:28:46.623371+0000","last_active":"2024-09-10T08:43:37.793333+0000","last_peered":"2024-09-10T08:43:37.793333+0000","last_clean":"2024-09-10T08:43:37.793333+0000","last_became_active":"2024-09-10T08:28:46.623092+0000","last_became_peered":"2024-09-10T08:28:46.623092+0000","last_unstale":"2024-09-10T08:43:37.793333+0000","last_undegraded":"2024-09-10T08:43:37.793333+0000","last_fullsized":"2024-09-10T08:43:37.793333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:36.359127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"27'4470","reported_seq":4493,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.335120+0000","last_change":"2024-09-10T08:28:47.619805+0000","last_active":"2024-09-10T08:44:29.335120+0000","last_peered":"2024-09-10T08:44:29.335120+0000","last_clean":"2024-09-10T08:44:29.335120+0000","last_became_active":"2024-09-10T08:28:47.619452+0000","last_became_peered":"2024-09-10T08:28:47.619452+0000","last_unstale":"2024-09-10T08:44:29.335120+0000","last_undegraded":"2024-09-10T08:44:29.335120+0000","last_fullsized":"2024-09-10T08:44:29.335120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4470,"log_dups_size":0,"ondisk_log_size":4470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:20.052707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23926,"num_write_kb":300839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"27'4014","reported_seq":4045,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.536870+0000","last_change":"2024-09-10T08:28:35.577476+0000","last_active":"2024-09-10T08:44:22.536870+0000","last_peered":"2024-09-10T08:44:22.536870+0000","last_clean":"2024-09-10T08:44:22.536870+0000","last_became_active":"2024-09-10T08:28:35.576786+0000","last_became_peered":"2024-09-10T08:28:35.576786+0000","last_unstale":"2024-09-10T08:44:22.536870+0000","last_undegraded":"2024-09-10T08:44:22.536870+0000","last_fullsized":"2024-09-10T08:44:22.536870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4014,"log_dups_size":0,"ondisk_log_size":4014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:46.914074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19823,"num_write_kb":276089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.005418+0000","last_change":"2024-09-10T08:28:34.551102+0000","last_active":"2024-09-10T08:43:48.005418+0000","last_peered":"2024-09-10T08:43:48.005418+0000","last_clean":"2024-09-10T08:43:48.005418+0000","last_became_active":"2024-09-10T08:28:34.550773+0000","last_became_peered":"2024-09-10T08:28:34.550773+0000","last_unstale":"2024-09-10T08:43:48.005418+0000","last_undegraded":"2024-09-10T08:43:48.005418+0000","last_fullsized":"2024-09-10T08:43:48.005418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:35.393695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.815410+0000","last_change":"2024-09-10T08:28:46.619639+0000","last_active":"2024-09-10T08:43:37.815410+0000","last_peered":"2024-09-10T08:43:37.815410+0000","last_clean":"2024-09-10T08:43:37.815410+0000","last_became_active":"2024-09-10T08:28:46.619330+0000","last_became_peered":"2024-09-10T08:28:46.619330+0000","last_unstale":"2024-09-10T08:43:37.815410+0000","last_undegraded":"2024-09-10T08:43:37.815410+0000","last_fullsized":"2024-09-10T08:43:37.815410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:10.371693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"27'3797","reported_seq":3819,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.367348+0000","last_change":"2024-09-10T08:28:47.633627+0000","last_active":"2024-09-10T08:44:29.367348+0000","last_peered":"2024-09-10T08:44:29.367348+0000","last_clean":"2024-09-10T08:44:29.367348+0000","last_became_active":"2024-09-10T08:28:47.633362+0000","last_became_peered":"2024-09-10T08:28:47.633362+0000","last_unstale":"2024-09-10T08:44:29.367348+0000","last_undegraded":"2024-09-10T08:44:29.367348+0000","last_fullsized":"2024-09-10T08:44:29.367348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3797,"log_dups_size":0,"ondisk_log_size":3797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:19.473028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19693,"num_write_kb":255099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"27'4998","reported_seq":5028,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.499387+0000","last_change":"2024-09-10T08:28:35.575307+0000","last_active":"2024-09-10T08:44:22.499387+0000","last_peered":"2024-09-10T08:44:22.499387+0000","last_clean":"2024-09-10T08:44:22.499387+0000","last_became_active":"2024-09-10T08:28:35.575038+0000","last_became_peered":"2024-09-10T08:28:35.575038+0000","last_unstale":"2024-09-10T08:44:22.499387+0000","last_undegraded":"2024-09-10T08:44:22.499387+0000","last_fullsized":"2024-09-10T08:44:22.499387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4998,"log_dups_size":0,"ondisk_log_size":4998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:36.478822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25962,"num_write_kb":304804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'11","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.948250+0000","last_change":"2024-09-10T08:28:34.555542+0000","last_active":"2024-09-10T08:43:47.948250+0000","last_peered":"2024-09-10T08:43:47.948250+0000","last_clean":"2024-09-10T08:43:47.948250+0000","last_became_active":"2024-09-10T08:28:34.555179+0000","last_became_peered":"2024-09-10T08:28:34.555179+0000","last_unstale":"2024-09-10T08:43:47.948250+0000","last_undegraded":"2024-09-10T08:43:47.948250+0000","last_fullsized":"2024-09-10T08:43:47.948250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:53.313161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.799350+0000","last_change":"2024-09-10T08:28:46.618615+0000","last_active":"2024-09-10T08:43:37.799350+0000","last_peered":"2024-09-10T08:43:37.799350+0000","last_clean":"2024-09-10T08:43:37.799350+0000","last_became_active":"2024-09-10T08:28:46.618318+0000","last_became_peered":"2024-09-10T08:28:46.618318+0000","last_unstale":"2024-09-10T08:43:37.799350+0000","last_undegraded":"2024-09-10T08:43:37.799350+0000","last_fullsized":"2024-09-10T08:43:37.799350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:44:08.185748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"27'4510","reported_seq":4532,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.460057+0000","last_change":"2024-09-10T08:28:47.625025+0000","last_active":"2024-09-10T08:44:29.460057+0000","last_peered":"2024-09-10T08:44:29.460057+0000","last_clean":"2024-09-10T08:44:29.460057+0000","last_became_active":"2024-09-10T08:28:47.624230+0000","last_became_peered":"2024-09-10T08:28:47.624230+0000","last_unstale":"2024-09-10T08:44:29.460057+0000","last_undegraded":"2024-09-10T08:44:29.460057+0000","last_fullsized":"2024-09-10T08:44:29.460057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4510,"log_dups_size":0,"ondisk_log_size":4510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:25.530264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23053,"num_write_kb":297434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'5001","reported_seq":5031,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.475930+0000","last_change":"2024-09-10T08:28:35.578892+0000","last_active":"2024-09-10T08:44:22.475930+0000","last_peered":"2024-09-10T08:44:22.475930+0000","last_clean":"2024-09-10T08:44:22.475930+0000","last_became_active":"2024-09-10T08:28:35.578299+0000","last_became_peered":"2024-09-10T08:28:35.578299+0000","last_unstale":"2024-09-10T08:44:22.475930+0000","last_undegraded":"2024-09-10T08:44:22.475930+0000","last_fullsized":"2024-09-10T08:44:22.475930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5001,"log_dups_size":0,"ondisk_log_size":5001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:27.485392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25723,"num_write_kb":320130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'6","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.992918+0000","last_change":"2024-09-10T08:28:34.560444+0000","last_active":"2024-09-10T08:43:47.992918+0000","last_peered":"2024-09-10T08:43:47.992918+0000","last_clean":"2024-09-10T08:43:47.992918+0000","last_became_active":"2024-09-10T08:28:34.560188+0000","last_became_peered":"2024-09-10T08:28:34.560188+0000","last_unstale":"2024-09-10T08:43:47.992918+0000","last_undegraded":"2024-09-10T08:43:47.992918+0000","last_fullsized":"2024-09-10T08:43:47.992918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:15.727780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:16.827380+0000","last_change":"2024-09-10T08:28:46.623483+0000","last_active":"2024-09-10T08:43:16.827380+0000","last_peered":"2024-09-10T08:43:16.827380+0000","last_clean":"2024-09-10T08:43:16.827380+0000","last_became_active":"2024-09-10T08:28:46.623211+0000","last_became_peered":"2024-09-10T08:28:46.623211+0000","last_unstale":"2024-09-10T08:43:16.827380+0000","last_undegraded":"2024-09-10T08:43:16.827380+0000","last_fullsized":"2024-09-10T08:43:16.827380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:24.611015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"27'4287","reported_seq":4309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.418397+0000","last_change":"2024-09-10T08:28:47.635185+0000","last_active":"2024-09-10T08:44:29.418397+0000","last_peered":"2024-09-10T08:44:29.418397+0000","last_clean":"2024-09-10T08:44:29.418397+0000","last_became_active":"2024-09-10T08:28:47.634782+0000","last_became_peered":"2024-09-10T08:28:47.634782+0000","last_unstale":"2024-09-10T08:44:29.418397+0000","last_undegraded":"2024-09-10T08:44:29.418397+0000","last_fullsized":"2024-09-10T08:44:29.418397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4287,"log_dups_size":0,"ondisk_log_size":4287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:05.512645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22519,"num_write_kb":282718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'5007","reported_seq":5037,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.563134+0000","last_change":"2024-09-10T08:28:35.575788+0000","last_active":"2024-09-10T08:44:22.563134+0000","last_peered":"2024-09-10T08:44:22.563134+0000","last_clean":"2024-09-10T08:44:22.563134+0000","last_became_active":"2024-09-10T08:28:35.575333+0000","last_became_peered":"2024-09-10T08:28:35.575333+0000","last_unstale":"2024-09-10T08:44:22.563134+0000","last_undegraded":"2024-09-10T08:44:22.563134+0000","last_fullsized":"2024-09-10T08:44:22.563134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5007,"log_dups_size":0,"ondisk_log_size":5007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:39.756390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25404,"num_write_kb":331142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.009202+0000","last_change":"2024-09-10T08:28:34.560699+0000","last_active":"2024-09-10T08:43:48.009202+0000","last_peered":"2024-09-10T08:43:48.009202+0000","last_clean":"2024-09-10T08:43:48.009202+0000","last_became_active":"2024-09-10T08:28:34.560376+0000","last_became_peered":"2024-09-10T08:28:34.560376+0000","last_unstale":"2024-09-10T08:43:48.009202+0000","last_undegraded":"2024-09-10T08:43:48.009202+0000","last_fullsized":"2024-09-10T08:43:48.009202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:09.981216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'327","reported_seq":351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.842658+0000","last_change":"2024-09-10T08:28:46.620745+0000","last_active":"2024-09-10T08:43:37.842658+0000","last_peered":"2024-09-10T08:43:37.842658+0000","last_clean":"2024-09-10T08:43:37.842658+0000","last_became_active":"2024-09-10T08:28:46.619030+0000","last_became_peered":"2024-09-10T08:28:46.619030+0000","last_unstale":"2024-09-10T08:43:37.842658+0000","last_undegraded":"2024-09-10T08:43:37.842658+0000","last_fullsized":"2024-09-10T08:43:37.842658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:07.653226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":4249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"27'6390","reported_seq":6412,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.443881+0000","last_change":"2024-09-10T08:28:47.626648+0000","last_active":"2024-09-10T08:44:29.443881+0000","last_peered":"2024-09-10T08:44:29.443881+0000","last_clean":"2024-09-10T08:44:29.443881+0000","last_became_active":"2024-09-10T08:28:47.626330+0000","last_became_peered":"2024-09-10T08:28:47.626330+0000","last_unstale":"2024-09-10T08:44:29.443881+0000","last_undegraded":"2024-09-10T08:44:29.443881+0000","last_fullsized":"2024-09-10T08:44:29.443881+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5190,"log_dups_size":0,"ondisk_log_size":5190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:02.346881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33857,"num_write_kb":406580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'4502","reported_seq":4532,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.486058+0000","last_change":"2024-09-10T08:28:35.574810+0000","last_active":"2024-09-10T08:44:22.486058+0000","last_peered":"2024-09-10T08:44:22.486058+0000","last_clean":"2024-09-10T08:44:22.486058+0000","last_became_active":"2024-09-10T08:28:35.574567+0000","last_became_peered":"2024-09-10T08:28:35.574567+0000","last_unstale":"2024-09-10T08:44:22.486058+0000","last_undegraded":"2024-09-10T08:44:22.486058+0000","last_fullsized":"2024-09-10T08:44:22.486058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4502,"log_dups_size":0,"ondisk_log_size":4502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:29.315833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23284,"num_write_kb":285817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'8","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.989573+0000","last_change":"2024-09-10T08:28:34.553556+0000","last_active":"2024-09-10T08:43:47.989573+0000","last_peered":"2024-09-10T08:43:47.989573+0000","last_clean":"2024-09-10T08:43:47.989573+0000","last_became_active":"2024-09-10T08:28:34.553275+0000","last_became_peered":"2024-09-10T08:28:34.553275+0000","last_unstale":"2024-09-10T08:43:47.989573+0000","last_undegraded":"2024-09-10T08:43:47.989573+0000","last_fullsized":"2024-09-10T08:43:47.989573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:45.957635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'29","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.870711+0000","last_change":"2024-09-10T08:28:46.619760+0000","last_active":"2024-09-10T08:43:37.870711+0000","last_peered":"2024-09-10T08:43:37.870711+0000","last_clean":"2024-09-10T08:43:37.870711+0000","last_became_active":"2024-09-10T08:28:46.619165+0000","last_became_peered":"2024-09-10T08:28:46.619165+0000","last_unstale":"2024-09-10T08:43:37.870711+0000","last_undegraded":"2024-09-10T08:43:37.870711+0000","last_fullsized":"2024-09-10T08:43:37.870711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:27.691197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"27'5339","reported_seq":5361,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.399784+0000","last_change":"2024-09-10T08:28:47.620135+0000","last_active":"2024-09-10T08:44:29.399784+0000","last_peered":"2024-09-10T08:44:29.399784+0000","last_clean":"2024-09-10T08:44:29.399784+0000","last_became_active":"2024-09-10T08:28:47.619661+0000","last_became_peered":"2024-09-10T08:28:47.619661+0000","last_unstale":"2024-09-10T08:44:29.399784+0000","last_undegraded":"2024-09-10T08:44:29.399784+0000","last_fullsized":"2024-09-10T08:44:29.399784+0000","mapping_epoch":23,"log_start":"27'100","ondisk_log_start":"27'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:34.815426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27578,"num_write_kb":340014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'4089","reported_seq":4119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.533296+0000","last_change":"2024-09-10T08:28:35.582473+0000","last_active":"2024-09-10T08:44:22.533296+0000","last_peered":"2024-09-10T08:44:22.533296+0000","last_clean":"2024-09-10T08:44:22.533296+0000","last_became_active":"2024-09-10T08:28:35.582205+0000","last_became_peered":"2024-09-10T08:28:35.582205+0000","last_unstale":"2024-09-10T08:44:22.533296+0000","last_undegraded":"2024-09-10T08:44:22.533296+0000","last_fullsized":"2024-09-10T08:44:22.533296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4089,"log_dups_size":0,"ondisk_log_size":4089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:11.200963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21083,"num_write_kb":276854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'305","reported_seq":337,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.000513+0000","last_change":"2024-09-10T08:28:34.559823+0000","last_active":"2024-09-10T08:43:48.000513+0000","last_peered":"2024-09-10T08:43:48.000513+0000","last_clean":"2024-09-10T08:43:48.000513+0000","last_became_active":"2024-09-10T08:28:34.559560+0000","last_became_peered":"2024-09-10T08:28:34.559560+0000","last_unstale":"2024-09-10T08:43:48.000513+0000","last_undegraded":"2024-09-10T08:43:48.000513+0000","last_fullsized":"2024-09-10T08:43:48.000513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:53.724382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":301,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'5","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.840086+0000","last_change":"2024-09-10T08:28:46.628040+0000","last_active":"2024-09-10T08:43:37.840086+0000","last_peered":"2024-09-10T08:43:37.840086+0000","last_clean":"2024-09-10T08:43:37.840086+0000","last_became_active":"2024-09-10T08:28:46.627819+0000","last_became_peered":"2024-09-10T08:28:46.627819+0000","last_unstale":"2024-09-10T08:43:37.840086+0000","last_undegraded":"2024-09-10T08:43:37.840086+0000","last_fullsized":"2024-09-10T08:43:37.840086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:29.467540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"27'3973","reported_seq":3995,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456273+0000","last_change":"2024-09-10T08:28:47.628067+0000","last_active":"2024-09-10T08:44:29.456273+0000","last_peered":"2024-09-10T08:44:29.456273+0000","last_clean":"2024-09-10T08:44:29.456273+0000","last_became_active":"2024-09-10T08:28:47.627775+0000","last_became_peered":"2024-09-10T08:28:47.627775+0000","last_unstale":"2024-09-10T08:44:29.456273+0000","last_undegraded":"2024-09-10T08:44:29.456273+0000","last_fullsized":"2024-09-10T08:44:29.456273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3973,"log_dups_size":0,"ondisk_log_size":3973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:43.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20759,"num_write_kb":275665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'6218","reported_seq":6248,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.501495+0000","last_change":"2024-09-10T08:28:35.571262+0000","last_active":"2024-09-10T08:44:22.501495+0000","last_peered":"2024-09-10T08:44:22.501495+0000","last_clean":"2024-09-10T08:44:22.501495+0000","last_became_active":"2024-09-10T08:28:35.570711+0000","last_became_peered":"2024-09-10T08:28:35.570711+0000","last_unstale":"2024-09-10T08:44:22.501495+0000","last_undegraded":"2024-09-10T08:44:22.501495+0000","last_fullsized":"2024-09-10T08:44:22.501495+0000","mapping_epoch":19,"log_start":"27'700","ondisk_log_start":"27'700","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5518,"log_dups_size":0,"ondisk_log_size":5518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:29.116422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31535,"num_write_kb":397056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'35","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.003205+0000","last_change":"2024-09-10T08:28:34.557352+0000","last_active":"2024-09-10T08:43:48.003205+0000","last_peered":"2024-09-10T08:43:48.003205+0000","last_clean":"2024-09-10T08:43:48.003205+0000","last_became_active":"2024-09-10T08:28:34.557076+0000","last_became_peered":"2024-09-10T08:28:34.557076+0000","last_unstale":"2024-09-10T08:43:48.003205+0000","last_undegraded":"2024-09-10T08:43:48.003205+0000","last_fullsized":"2024-09-10T08:43:48.003205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:04.957739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'8","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.822684+0000","last_change":"2024-09-10T08:28:46.615923+0000","last_active":"2024-09-10T08:43:37.822684+0000","last_peered":"2024-09-10T08:43:37.822684+0000","last_clean":"2024-09-10T08:43:37.822684+0000","last_became_active":"2024-09-10T08:28:46.615451+0000","last_became_peered":"2024-09-10T08:28:46.615451+0000","last_unstale":"2024-09-10T08:43:37.822684+0000","last_undegraded":"2024-09-10T08:43:37.822684+0000","last_fullsized":"2024-09-10T08:43:37.822684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:22.612001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"27'4284","reported_seq":4306,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456315+0000","last_change":"2024-09-10T08:28:47.623223+0000","last_active":"2024-09-10T08:44:29.456315+0000","last_peered":"2024-09-10T08:44:29.456315+0000","last_clean":"2024-09-10T08:44:29.456315+0000","last_became_active":"2024-09-10T08:28:47.622961+0000","last_became_peered":"2024-09-10T08:28:47.622961+0000","last_unstale":"2024-09-10T08:44:29.456315+0000","last_undegraded":"2024-09-10T08:44:29.456315+0000","last_fullsized":"2024-09-10T08:44:29.456315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4284,"log_dups_size":0,"ondisk_log_size":4284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:30.979580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23423,"num_write_kb":294728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"27'3896","reported_seq":3926,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.505094+0000","last_change":"2024-09-10T08:28:35.577913+0000","last_active":"2024-09-10T08:44:22.505094+0000","last_peered":"2024-09-10T08:44:22.505094+0000","last_clean":"2024-09-10T08:44:22.505094+0000","last_became_active":"2024-09-10T08:28:35.577255+0000","last_became_peered":"2024-09-10T08:28:35.577255+0000","last_unstale":"2024-09-10T08:44:22.505094+0000","last_undegraded":"2024-09-10T08:44:22.505094+0000","last_fullsized":"2024-09-10T08:44:22.505094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3896,"log_dups_size":0,"ondisk_log_size":3896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:17.413525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19770,"num_write_kb":255291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'2","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.988679+0000","last_change":"2024-09-10T08:28:34.564571+0000","last_active":"2024-09-10T08:43:47.988679+0000","last_peered":"2024-09-10T08:43:47.988679+0000","last_clean":"2024-09-10T08:43:47.988679+0000","last_became_active":"2024-09-10T08:28:34.564189+0000","last_became_peered":"2024-09-10T08:28:34.564189+0000","last_unstale":"2024-09-10T08:43:47.988679+0000","last_undegraded":"2024-09-10T08:43:47.988679+0000","last_fullsized":"2024-09-10T08:43:47.988679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:46.055510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'12","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.816926+0000","last_change":"2024-09-10T08:28:46.618917+0000","last_active":"2024-09-10T08:43:37.816926+0000","last_peered":"2024-09-10T08:43:37.816926+0000","last_clean":"2024-09-10T08:43:37.816926+0000","last_became_active":"2024-09-10T08:28:46.618625+0000","last_became_peered":"2024-09-10T08:28:46.618625+0000","last_unstale":"2024-09-10T08:43:37.816926+0000","last_undegraded":"2024-09-10T08:43:37.816926+0000","last_fullsized":"2024-09-10T08:43:37.816926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:19.431857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"27'4685","reported_seq":4707,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.447574+0000","last_change":"2024-09-10T08:28:47.630243+0000","last_active":"2024-09-10T08:44:29.447574+0000","last_peered":"2024-09-10T08:44:29.447574+0000","last_clean":"2024-09-10T08:44:29.447574+0000","last_became_active":"2024-09-10T08:28:47.629869+0000","last_became_peered":"2024-09-10T08:28:47.629869+0000","last_unstale":"2024-09-10T08:44:29.447574+0000","last_undegraded":"2024-09-10T08:44:29.447574+0000","last_fullsized":"2024-09-10T08:44:29.447574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4685,"log_dups_size":0,"ondisk_log_size":4685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:58.696156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24572,"num_write_kb":315590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'4682","reported_seq":4712,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.546974+0000","last_change":"2024-09-10T08:28:35.572944+0000","last_active":"2024-09-10T08:44:22.546974+0000","last_peered":"2024-09-10T08:44:22.546974+0000","last_clean":"2024-09-10T08:44:22.546974+0000","last_became_active":"2024-09-10T08:28:35.572620+0000","last_became_peered":"2024-09-10T08:28:35.572620+0000","last_unstale":"2024-09-10T08:44:22.546974+0000","last_undegraded":"2024-09-10T08:44:22.546974+0000","last_fullsized":"2024-09-10T08:44:22.546974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4682,"log_dups_size":0,"ondisk_log_size":4682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:04.524048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24219,"num_write_kb":302042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'2","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:04.444745+0000","last_change":"2024-09-10T08:28:34.562935+0000","last_active":"2024-09-10T08:43:04.444745+0000","last_peered":"2024-09-10T08:43:04.444745+0000","last_clean":"2024-09-10T08:43:04.444745+0000","last_became_active":"2024-09-10T08:28:34.562647+0000","last_became_peered":"2024-09-10T08:28:34.562647+0000","last_unstale":"2024-09-10T08:43:04.444745+0000","last_undegraded":"2024-09-10T08:43:04.444745+0000","last_fullsized":"2024-09-10T08:43:04.444745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:47.492281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'6","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.806115+0000","last_change":"2024-09-10T08:28:46.621472+0000","last_active":"2024-09-10T08:43:37.806115+0000","last_peered":"2024-09-10T08:43:37.806115+0000","last_clean":"2024-09-10T08:43:37.806115+0000","last_became_active":"2024-09-10T08:28:46.621157+0000","last_became_peered":"2024-09-10T08:28:46.621157+0000","last_unstale":"2024-09-10T08:43:37.806115+0000","last_undegraded":"2024-09-10T08:43:37.806115+0000","last_fullsized":"2024-09-10T08:43:37.806115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:44.166068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"27'5768","reported_seq":5791,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.460342+0000","last_change":"2024-09-10T08:28:47.627750+0000","last_active":"2024-09-10T08:44:29.460342+0000","last_peered":"2024-09-10T08:44:29.460342+0000","last_clean":"2024-09-10T08:44:29.460342+0000","last_became_active":"2024-09-10T08:28:47.627481+0000","last_became_peered":"2024-09-10T08:28:47.627481+0000","last_unstale":"2024-09-10T08:44:29.460342+0000","last_undegraded":"2024-09-10T08:44:29.460342+0000","last_fullsized":"2024-09-10T08:44:29.460342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5768,"log_dups_size":0,"ondisk_log_size":5768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:01.105133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30773,"num_write_kb":369268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.796648+0000","last_change":"2024-09-10T08:28:46.620162+0000","last_active":"2024-09-10T08:43:37.796648+0000","last_peered":"2024-09-10T08:43:37.796648+0000","last_clean":"2024-09-10T08:43:37.796648+0000","last_became_active":"2024-09-10T08:28:46.619843+0000","last_became_peered":"2024-09-10T08:28:46.619843+0000","last_unstale":"2024-09-10T08:43:37.796648+0000","last_undegraded":"2024-09-10T08:43:37.796648+0000","last_fullsized":"2024-09-10T08:43:37.796648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:21.376123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'5404","reported_seq":5434,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.528764+0000","last_change":"2024-09-10T08:28:35.572803+0000","last_active":"2024-09-10T08:44:22.528764+0000","last_peered":"2024-09-10T08:44:22.528764+0000","last_clean":"2024-09-10T08:44:22.528764+0000","last_became_active":"2024-09-10T08:28:35.572219+0000","last_became_peered":"2024-09-10T08:28:35.572219+0000","last_unstale":"2024-09-10T08:44:22.528764+0000","last_undegraded":"2024-09-10T08:44:22.528764+0000","last_fullsized":"2024-09-10T08:44:22.528764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5404,"log_dups_size":0,"ondisk_log_size":5404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:45.920218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27626,"num_write_kb":348430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:35.055986+0000","last_change":"2024-09-10T08:28:34.554346+0000","last_active":"2024-09-10T08:43:35.055986+0000","last_peered":"2024-09-10T08:43:35.055986+0000","last_clean":"2024-09-10T08:43:35.055986+0000","last_became_active":"2024-09-10T08:28:34.553933+0000","last_became_peered":"2024-09-10T08:28:34.553933+0000","last_unstale":"2024-09-10T08:43:35.055986+0000","last_undegraded":"2024-09-10T08:43:35.055986+0000","last_fullsized":"2024-09-10T08:43:35.055986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:07.639671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"27'4656","reported_seq":4679,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.353791+0000","last_change":"2024-09-10T08:28:47.629468+0000","last_active":"2024-09-10T08:44:29.353791+0000","last_peered":"2024-09-10T08:44:29.353791+0000","last_clean":"2024-09-10T08:44:29.353791+0000","last_became_active":"2024-09-10T08:28:47.629177+0000","last_became_peered":"2024-09-10T08:28:47.629177+0000","last_unstale":"2024-09-10T08:44:29.353791+0000","last_undegraded":"2024-09-10T08:44:29.353791+0000","last_fullsized":"2024-09-10T08:44:29.353791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4656,"log_dups_size":0,"ondisk_log_size":4656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:10.443235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24729,"num_write_kb":316330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"27'630","reported_seq":655,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:28.449319+0000","last_change":"2024-09-10T08:28:46.630904+0000","last_active":"2024-09-10T08:43:28.449319+0000","last_peered":"2024-09-10T08:43:28.449319+0000","last_clean":"2024-09-10T08:43:28.449319+0000","last_became_active":"2024-09-10T08:28:46.630530+0000","last_became_peered":"2024-09-10T08:28:46.630530+0000","last_unstale":"2024-09-10T08:43:28.449319+0000","last_undegraded":"2024-09-10T08:43:28.449319+0000","last_fullsized":"2024-09-10T08:43:28.449319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:33.599739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":4465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'4762","reported_seq":4792,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.510821+0000","last_change":"2024-09-10T08:28:35.580244+0000","last_active":"2024-09-10T08:44:22.510821+0000","last_peered":"2024-09-10T08:44:22.510821+0000","last_clean":"2024-09-10T08:44:22.510821+0000","last_became_active":"2024-09-10T08:28:35.579975+0000","last_became_peered":"2024-09-10T08:28:35.579975+0000","last_unstale":"2024-09-10T08:44:22.510821+0000","last_undegraded":"2024-09-10T08:44:22.510821+0000","last_fullsized":"2024-09-10T08:44:22.510821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4762,"log_dups_size":0,"ondisk_log_size":4762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:16.498045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24500,"num_write_kb":298921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:06.786232+0000","last_change":"2024-09-10T08:28:34.564751+0000","last_active":"2024-09-10T08:43:06.786232+0000","last_peered":"2024-09-10T08:43:06.786232+0000","last_clean":"2024-09-10T08:43:06.786232+0000","last_became_active":"2024-09-10T08:28:34.564479+0000","last_became_peered":"2024-09-10T08:28:34.564479+0000","last_unstale":"2024-09-10T08:43:06.786232+0000","last_undegraded":"2024-09-10T08:43:06.786232+0000","last_fullsized":"2024-09-10T08:43:06.786232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:29.618224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"27'5070","reported_seq":5092,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.463937+0000","last_change":"2024-09-10T08:28:47.627041+0000","last_active":"2024-09-10T08:44:29.463937+0000","last_peered":"2024-09-10T08:44:29.463937+0000","last_clean":"2024-09-10T08:44:29.463937+0000","last_became_active":"2024-09-10T08:28:47.626692+0000","last_became_peered":"2024-09-10T08:28:47.626692+0000","last_unstale":"2024-09-10T08:44:29.463937+0000","last_undegraded":"2024-09-10T08:44:29.463937+0000","last_fullsized":"2024-09-10T08:44:29.463937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5070,"log_dups_size":0,"ondisk_log_size":5070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:57.666849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26421,"num_write_kb":351729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"27'90","reported_seq":122,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.343291+0000","last_change":"2024-09-10T08:28:34.561906+0000","last_active":"2024-09-10T08:44:22.343291+0000","last_peered":"2024-09-10T08:44:22.343291+0000","last_clean":"2024-09-10T08:44:22.343291+0000","last_became_active":"2024-09-10T08:28:34.561613+0000","last_became_peered":"2024-09-10T08:28:34.561613+0000","last_unstale":"2024-09-10T08:44:22.343291+0000","last_undegraded":"2024-09-10T08:44:22.343291+0000","last_fullsized":"2024-09-10T08:44:22.343291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:56.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061672,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":1094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'3916","reported_seq":3946,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.533790+0000","last_change":"2024-09-10T08:28:35.576406+0000","last_active":"2024-09-10T08:44:22.533790+0000","last_peered":"2024-09-10T08:44:22.533790+0000","last_clean":"2024-09-10T08:44:22.533790+0000","last_became_active":"2024-09-10T08:28:35.576145+0000","last_became_peered":"2024-09-10T08:28:35.576145+0000","last_unstale":"2024-09-10T08:44:22.533790+0000","last_undegraded":"2024-09-10T08:44:22.533790+0000","last_fullsized":"2024-09-10T08:44:22.533790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3916,"log_dups_size":0,"ondisk_log_size":3916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:57.667098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19526,"num_write_kb":237971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.846532+0000","last_change":"2024-09-10T08:28:46.622395+0000","last_active":"2024-09-10T08:43:37.846532+0000","last_peered":"2024-09-10T08:43:37.846532+0000","last_clean":"2024-09-10T08:43:37.846532+0000","last_became_active":"2024-09-10T08:28:46.621941+0000","last_became_peered":"2024-09-10T08:28:46.621941+0000","last_unstale":"2024-09-10T08:43:37.846532+0000","last_undegraded":"2024-09-10T08:43:37.846532+0000","last_fullsized":"2024-09-10T08:43:37.846532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:54.928969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"27'3193","reported_seq":3215,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.434312+0000","last_change":"2024-09-10T08:28:47.626495+0000","last_active":"2024-09-10T08:44:29.434312+0000","last_peered":"2024-09-10T08:44:29.434312+0000","last_clean":"2024-09-10T08:44:29.434312+0000","last_became_active":"2024-09-10T08:28:47.625258+0000","last_became_peered":"2024-09-10T08:28:47.625258+0000","last_unstale":"2024-09-10T08:44:29.434312+0000","last_undegraded":"2024-09-10T08:44:29.434312+0000","last_fullsized":"2024-09-10T08:44:29.434312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3193,"log_dups_size":0,"ondisk_log_size":3193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:00.101586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16183,"num_write_kb":212369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'622","reported_seq":654,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:35.040191+0000","last_change":"2024-09-10T08:28:34.566606+0000","last_active":"2024-09-10T08:43:35.040191+0000","last_peered":"2024-09-10T08:43:35.040191+0000","last_clean":"2024-09-10T08:43:35.040191+0000","last_became_active":"2024-09-10T08:28:34.566388+0000","last_became_peered":"2024-09-10T08:28:34.566388+0000","last_unstale":"2024-09-10T08:43:35.040191+0000","last_undegraded":"2024-09-10T08:43:35.040191+0000","last_fullsized":"2024-09-10T08:43:35.040191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:33.528801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":620,"num_write_kb":4248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'4051","reported_seq":4081,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.448831+0000","last_change":"2024-09-10T08:28:35.559371+0000","last_active":"2024-09-10T08:44:22.448831+0000","last_peered":"2024-09-10T08:44:22.448831+0000","last_clean":"2024-09-10T08:44:22.448831+0000","last_became_active":"2024-09-10T08:28:35.559145+0000","last_became_peered":"2024-09-10T08:28:35.559145+0000","last_unstale":"2024-09-10T08:44:22.448831+0000","last_undegraded":"2024-09-10T08:44:22.448831+0000","last_fullsized":"2024-09-10T08:44:22.448831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4051,"log_dups_size":0,"ondisk_log_size":4051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:57.339318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20269,"num_write_kb":257190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'11","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.853770+0000","last_change":"2024-09-10T08:28:46.620231+0000","last_active":"2024-09-10T08:43:37.853770+0000","last_peered":"2024-09-10T08:43:37.853770+0000","last_clean":"2024-09-10T08:43:37.853770+0000","last_became_active":"2024-09-10T08:28:46.619403+0000","last_became_peered":"2024-09-10T08:28:46.619403+0000","last_unstale":"2024-09-10T08:43:37.853770+0000","last_undegraded":"2024-09-10T08:43:37.853770+0000","last_fullsized":"2024-09-10T08:43:37.853770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:26.308749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"27'4023","reported_seq":4046,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.453630+0000","last_change":"2024-09-10T08:28:47.627135+0000","last_active":"2024-09-10T08:44:29.453630+0000","last_peered":"2024-09-10T08:44:29.453630+0000","last_clean":"2024-09-10T08:44:29.453630+0000","last_became_active":"2024-09-10T08:28:47.626791+0000","last_became_peered":"2024-09-10T08:28:47.626791+0000","last_unstale":"2024-09-10T08:44:29.453630+0000","last_undegraded":"2024-09-10T08:44:29.453630+0000","last_fullsized":"2024-09-10T08:44:29.453630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4023,"log_dups_size":0,"ondisk_log_size":4023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:43.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21172,"num_write_kb":269680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'5985","reported_seq":6016,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.506685+0000","last_change":"2024-09-10T08:28:35.579106+0000","last_active":"2024-09-10T08:44:22.506685+0000","last_peered":"2024-09-10T08:44:22.506685+0000","last_clean":"2024-09-10T08:44:22.506685+0000","last_became_active":"2024-09-10T08:28:35.578631+0000","last_became_peered":"2024-09-10T08:28:35.578631+0000","last_unstale":"2024-09-10T08:44:22.506685+0000","last_undegraded":"2024-09-10T08:44:22.506685+0000","last_fullsized":"2024-09-10T08:44:22.506685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5985,"log_dups_size":0,"ondisk_log_size":5985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:31.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30721,"num_write_kb":377078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"27'5461","reported_seq":5484,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.347960+0000","last_change":"2024-09-10T08:28:47.632052+0000","last_active":"2024-09-10T08:44:29.347960+0000","last_peered":"2024-09-10T08:44:29.347960+0000","last_clean":"2024-09-10T08:44:29.347960+0000","last_became_active":"2024-09-10T08:28:47.631578+0000","last_became_peered":"2024-09-10T08:28:47.631578+0000","last_unstale":"2024-09-10T08:44:29.347960+0000","last_undegraded":"2024-09-10T08:44:29.347960+0000","last_fullsized":"2024-09-10T08:44:29.347960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5461,"log_dups_size":0,"ondisk_log_size":5461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:24.570729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28495,"num_write_kb":351882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"27'5419","reported_seq":5455,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.513489+0000","last_change":"2024-09-10T08:29:36.030138+0000","last_active":"2024-09-10T08:44:22.513489+0000","last_peered":"2024-09-10T08:44:22.513489+0000","last_clean":"2024-09-10T08:44:22.513489+0000","last_became_active":"2024-09-10T08:29:36.029789+0000","last_became_peered":"2024-09-10T08:29:36.029789+0000","last_unstale":"2024-09-10T08:44:22.513489+0000","last_undegraded":"2024-09-10T08:44:22.513489+0000","last_fullsized":"2024-09-10T08:44:22.513489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5419,"log_dups_size":0,"ondisk_log_size":5419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:56:49.067000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28175,"num_write_kb":329998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"27'4342","reported_seq":4365,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456079+0000","last_change":"2024-09-10T08:28:47.629148+0000","last_active":"2024-09-10T08:44:29.456079+0000","last_peered":"2024-09-10T08:44:29.456079+0000","last_clean":"2024-09-10T08:44:29.456079+0000","last_became_active":"2024-09-10T08:28:47.628741+0000","last_became_peered":"2024-09-10T08:28:47.628741+0000","last_unstale":"2024-09-10T08:44:29.456079+0000","last_undegraded":"2024-09-10T08:44:29.456079+0000","last_fullsized":"2024-09-10T08:44:29.456079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:48.950503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22591,"num_write_kb":275032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"27'5933","reported_seq":5964,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.508630+0000","last_change":"2024-09-10T08:28:35.578735+0000","last_active":"2024-09-10T08:44:22.508630+0000","last_peered":"2024-09-10T08:44:22.508630+0000","last_clean":"2024-09-10T08:44:22.508630+0000","last_became_active":"2024-09-10T08:28:35.577995+0000","last_became_peered":"2024-09-10T08:28:35.577995+0000","last_unstale":"2024-09-10T08:44:22.508630+0000","last_undegraded":"2024-09-10T08:44:22.508630+0000","last_fullsized":"2024-09-10T08:44:22.508630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5933,"log_dups_size":0,"ondisk_log_size":5933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:11.033441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30577,"num_write_kb":368306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"27'4476","reported_seq":4499,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.461540+0000","last_change":"2024-09-10T08:28:47.628639+0000","last_active":"2024-09-10T08:44:29.461540+0000","last_peered":"2024-09-10T08:44:29.461540+0000","last_clean":"2024-09-10T08:44:29.461540+0000","last_became_active":"2024-09-10T08:28:47.628317+0000","last_became_peered":"2024-09-10T08:28:47.628317+0000","last_unstale":"2024-09-10T08:44:29.461540+0000","last_undegraded":"2024-09-10T08:44:29.461540+0000","last_fullsized":"2024-09-10T08:44:29.461540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4476,"log_dups_size":0,"ondisk_log_size":4476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:50.314678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23867,"num_write_kb":312797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"27'4232","reported_seq":4263,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.522252+0000","last_change":"2024-09-10T08:28:35.577852+0000","last_active":"2024-09-10T08:44:22.522252+0000","last_peered":"2024-09-10T08:44:22.522252+0000","last_clean":"2024-09-10T08:44:22.522252+0000","last_became_active":"2024-09-10T08:28:35.577571+0000","last_became_peered":"2024-09-10T08:28:35.577571+0000","last_unstale":"2024-09-10T08:44:22.522252+0000","last_undegraded":"2024-09-10T08:44:22.522252+0000","last_fullsized":"2024-09-10T08:44:22.522252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4232,"log_dups_size":0,"ondisk_log_size":4232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:22.713732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21938,"num_write_kb":263982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"27'5518","reported_seq":5541,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.374526+0000","last_change":"2024-09-10T08:28:47.629931+0000","last_active":"2024-09-10T08:44:29.374526+0000","last_peered":"2024-09-10T08:44:29.374526+0000","last_clean":"2024-09-10T08:44:29.374526+0000","last_became_active":"2024-09-10T08:28:47.629634+0000","last_became_peered":"2024-09-10T08:28:47.629634+0000","last_unstale":"2024-09-10T08:44:29.374526+0000","last_undegraded":"2024-09-10T08:44:29.374526+0000","last_fullsized":"2024-09-10T08:44:29.374526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5518,"log_dups_size":0,"ondisk_log_size":5518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:57.964208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28611,"num_write_kb":360382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"27'3937","reported_seq":3968,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.454987+0000","last_change":"2024-09-10T08:28:35.574676+0000","last_active":"2024-09-10T08:44:22.454987+0000","last_peered":"2024-09-10T08:44:22.454987+0000","last_clean":"2024-09-10T08:44:22.454987+0000","last_became_active":"2024-09-10T08:28:35.574437+0000","last_became_peered":"2024-09-10T08:28:35.574437+0000","last_unstale":"2024-09-10T08:44:22.454987+0000","last_undegraded":"2024-09-10T08:44:22.454987+0000","last_fullsized":"2024-09-10T08:44:22.454987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3937,"log_dups_size":0,"ondisk_log_size":3937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:45.422506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20167,"num_write_kb":265112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"27'3790","reported_seq":3813,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456016+0000","last_change":"2024-09-10T08:28:47.624178+0000","last_active":"2024-09-10T08:44:29.456016+0000","last_peered":"2024-09-10T08:44:29.456016+0000","last_clean":"2024-09-10T08:44:29.456016+0000","last_became_active":"2024-09-10T08:28:47.623671+0000","last_became_peered":"2024-09-10T08:28:47.623671+0000","last_unstale":"2024-09-10T08:44:29.456016+0000","last_undegraded":"2024-09-10T08:44:29.456016+0000","last_fullsized":"2024-09-10T08:44:29.456016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3790,"log_dups_size":0,"ondisk_log_size":3790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:48.613870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19891,"num_write_kb":255782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"27'4956","reported_seq":4987,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.486306+0000","last_change":"2024-09-10T08:28:35.572550+0000","last_active":"2024-09-10T08:44:22.486306+0000","last_peered":"2024-09-10T08:44:22.486306+0000","last_clean":"2024-09-10T08:44:22.486306+0000","last_became_active":"2024-09-10T08:28:35.572184+0000","last_became_peered":"2024-09-10T08:28:35.572184+0000","last_unstale":"2024-09-10T08:44:22.486306+0000","last_undegraded":"2024-09-10T08:44:22.486306+0000","last_fullsized":"2024-09-10T08:44:22.486306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4956,"log_dups_size":0,"ondisk_log_size":4956,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:08.490734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26295,"num_write_kb":322461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"27'5495","reported_seq":5518,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.478950+0000","last_change":"2024-09-10T08:28:47.630214+0000","last_active":"2024-09-10T08:44:29.478950+0000","last_peered":"2024-09-10T08:44:29.478950+0000","last_clean":"2024-09-10T08:44:29.478950+0000","last_became_active":"2024-09-10T08:28:47.629512+0000","last_became_peered":"2024-09-10T08:28:47.629512+0000","last_unstale":"2024-09-10T08:44:29.478950+0000","last_undegraded":"2024-09-10T08:44:29.478950+0000","last_fullsized":"2024-09-10T08:44:29.478950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5495,"log_dups_size":0,"ondisk_log_size":5495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:35.692107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29037,"num_write_kb":370350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"27'4400","reported_seq":4431,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.553518+0000","last_change":"2024-09-10T08:28:35.573217+0000","last_active":"2024-09-10T08:44:22.553518+0000","last_peered":"2024-09-10T08:44:22.553518+0000","last_clean":"2024-09-10T08:44:22.553518+0000","last_became_active":"2024-09-10T08:28:35.572955+0000","last_became_peered":"2024-09-10T08:28:35.572955+0000","last_unstale":"2024-09-10T08:44:22.553518+0000","last_undegraded":"2024-09-10T08:44:22.553518+0000","last_fullsized":"2024-09-10T08:44:22.553518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4400,"log_dups_size":0,"ondisk_log_size":4400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:24.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22665,"num_write_kb":275496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"27'4608","reported_seq":4631,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.438440+0000","last_change":"2024-09-10T08:28:47.623365+0000","last_active":"2024-09-10T08:44:29.438440+0000","last_peered":"2024-09-10T08:44:29.438440+0000","last_clean":"2024-09-10T08:44:29.438440+0000","last_became_active":"2024-09-10T08:28:47.623082+0000","last_became_peered":"2024-09-10T08:28:47.623082+0000","last_unstale":"2024-09-10T08:44:29.438440+0000","last_undegraded":"2024-09-10T08:44:29.438440+0000","last_fullsized":"2024-09-10T08:44:29.438440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:20.558484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24193,"num_write_kb":313982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'6039","reported_seq":6070,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.401543+0000","last_change":"2024-09-10T08:28:35.575902+0000","last_active":"2024-09-10T08:44:22.401543+0000","last_peered":"2024-09-10T08:44:22.401543+0000","last_clean":"2024-09-10T08:44:22.401543+0000","last_became_active":"2024-09-10T08:28:35.575614+0000","last_became_peered":"2024-09-10T08:28:35.575614+0000","last_unstale":"2024-09-10T08:44:22.401543+0000","last_undegraded":"2024-09-10T08:44:22.401543+0000","last_fullsized":"2024-09-10T08:44:22.401543+0000","mapping_epoch":19,"log_start":"27'800","ondisk_log_start":"27'800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:11.277682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31129,"num_write_kb":362414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"27'3524","reported_seq":3546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.429365+0000","last_change":"2024-09-10T08:28:47.629795+0000","last_active":"2024-09-10T08:44:29.429365+0000","last_peered":"2024-09-10T08:44:29.429365+0000","last_clean":"2024-09-10T08:44:29.429365+0000","last_became_active":"2024-09-10T08:28:47.628861+0000","last_became_peered":"2024-09-10T08:28:47.628861+0000","last_unstale":"2024-09-10T08:44:29.429365+0000","last_undegraded":"2024-09-10T08:44:29.429365+0000","last_fullsized":"2024-09-10T08:44:29.429365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3524,"log_dups_size":0,"ondisk_log_size":3524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:06.277094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18277,"num_write_kb":237112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'4470","reported_seq":4501,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.481878+0000","last_change":"2024-09-10T08:28:35.578285+0000","last_active":"2024-09-10T08:44:22.481878+0000","last_peered":"2024-09-10T08:44:22.481878+0000","last_clean":"2024-09-10T08:44:22.481878+0000","last_became_active":"2024-09-10T08:28:35.576805+0000","last_became_peered":"2024-09-10T08:28:35.576805+0000","last_unstale":"2024-09-10T08:44:22.481878+0000","last_undegraded":"2024-09-10T08:44:22.481878+0000","last_fullsized":"2024-09-10T08:44:22.481878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4470,"log_dups_size":0,"ondisk_log_size":4470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:46.203320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22783,"num_write_kb":271507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"27'5536","reported_seq":5558,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.409088+0000","last_change":"2024-09-10T08:28:47.635713+0000","last_active":"2024-09-10T08:44:29.409088+0000","last_peered":"2024-09-10T08:44:29.409088+0000","last_clean":"2024-09-10T08:44:29.409088+0000","last_became_active":"2024-09-10T08:28:47.635381+0000","last_became_peered":"2024-09-10T08:28:47.635381+0000","last_unstale":"2024-09-10T08:44:29.409088+0000","last_undegraded":"2024-09-10T08:44:29.409088+0000","last_fullsized":"2024-09-10T08:44:29.409088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5536,"log_dups_size":0,"ondisk_log_size":5536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:39.419510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28458,"num_write_kb":359914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"27'4347","reported_seq":4363,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.499781+0000","last_change":"2024-09-10T08:29:35.097545+0000","last_active":"2024-09-10T08:44:22.499781+0000","last_peered":"2024-09-10T08:44:22.499781+0000","last_clean":"2024-09-10T08:44:22.499781+0000","last_became_active":"2024-09-10T08:29:35.097273+0000","last_became_peered":"2024-09-10T08:29:35.097273+0000","last_unstale":"2024-09-10T08:44:22.499781+0000","last_undegraded":"2024-09-10T08:44:22.499781+0000","last_fullsized":"2024-09-10T08:44:22.499781+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4347,"log_dups_size":0,"ondisk_log_size":4347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:40.058249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22114,"num_write_kb":289250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2c","version":"27'4653","reported_seq":4676,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.447481+0000","last_change":"2024-09-10T08:28:47.619863+0000","last_active":"2024-09-10T08:44:29.447481+0000","last_peered":"2024-09-10T08:44:29.447481+0000","last_clean":"2024-09-10T08:44:29.447481+0000","last_became_active":"2024-09-10T08:28:47.619525+0000","last_became_peered":"2024-09-10T08:28:47.619525+0000","last_unstale":"2024-09-10T08:44:29.447481+0000","last_undegraded":"2024-09-10T08:44:29.447481+0000","last_fullsized":"2024-09-10T08:44:29.447481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4653,"log_dups_size":0,"ondisk_log_size":4653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:49.591318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24519,"num_write_kb":299145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"27'5080","reported_seq":5111,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.544103+0000","last_change":"2024-09-10T08:28:35.568044+0000","last_active":"2024-09-10T08:44:22.544103+0000","last_peered":"2024-09-10T08:44:22.544103+0000","last_clean":"2024-09-10T08:44:22.544103+0000","last_became_active":"2024-09-10T08:28:35.567744+0000","last_became_peered":"2024-09-10T08:28:35.567744+0000","last_unstale":"2024-09-10T08:44:22.544103+0000","last_undegraded":"2024-09-10T08:44:22.544103+0000","last_fullsized":"2024-09-10T08:44:22.544103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5080,"log_dups_size":0,"ondisk_log_size":5080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:19.081138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26557,"num_write_kb":327659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"27'4432","reported_seq":4454,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.395035+0000","last_change":"2024-09-10T08:28:47.629417+0000","last_active":"2024-09-10T08:44:29.395035+0000","last_peered":"2024-09-10T08:44:29.395035+0000","last_clean":"2024-09-10T08:44:29.395035+0000","last_became_active":"2024-09-10T08:28:47.629095+0000","last_became_peered":"2024-09-10T08:28:47.629095+0000","last_unstale":"2024-09-10T08:44:29.395035+0000","last_undegraded":"2024-09-10T08:44:29.395035+0000","last_fullsized":"2024-09-10T08:44:29.395035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4432,"log_dups_size":0,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:05.606381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22331,"num_write_kb":294288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"27'4801","reported_seq":4832,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.544316+0000","last_change":"2024-09-10T08:28:35.575802+0000","last_active":"2024-09-10T08:44:22.544316+0000","last_peered":"2024-09-10T08:44:22.544316+0000","last_clean":"2024-09-10T08:44:22.544316+0000","last_became_active":"2024-09-10T08:28:35.575388+0000","last_became_peered":"2024-09-10T08:28:35.575388+0000","last_unstale":"2024-09-10T08:44:22.544316+0000","last_undegraded":"2024-09-10T08:44:22.544316+0000","last_fullsized":"2024-09-10T08:44:22.544316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4801,"log_dups_size":0,"ondisk_log_size":4801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:01.424265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24675,"num_write_kb":307760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"27'4608","reported_seq":4630,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.451461+0000","last_change":"2024-09-10T08:28:47.624305+0000","last_active":"2024-09-10T08:44:29.451461+0000","last_peered":"2024-09-10T08:44:29.451461+0000","last_clean":"2024-09-10T08:44:29.451461+0000","last_became_active":"2024-09-10T08:28:47.624026+0000","last_became_peered":"2024-09-10T08:28:47.624026+0000","last_unstale":"2024-09-10T08:44:29.451461+0000","last_undegraded":"2024-09-10T08:44:29.451461+0000","last_fullsized":"2024-09-10T08:44:29.451461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:01.194271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24388,"num_write_kb":319015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'4484","reported_seq":4515,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.485515+0000","last_change":"2024-09-10T08:28:35.574499+0000","last_active":"2024-09-10T08:44:22.485515+0000","last_peered":"2024-09-10T08:44:22.485515+0000","last_clean":"2024-09-10T08:44:22.485515+0000","last_became_active":"2024-09-10T08:28:35.574249+0000","last_became_peered":"2024-09-10T08:28:35.574249+0000","last_unstale":"2024-09-10T08:44:22.485515+0000","last_undegraded":"2024-09-10T08:44:22.485515+0000","last_fullsized":"2024-09-10T08:44:22.485515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4484,"log_dups_size":0,"ondisk_log_size":4484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:55.952307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23126,"num_write_kb":293453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"27'4466","reported_seq":4488,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456346+0000","last_change":"2024-09-10T08:28:47.629525+0000","last_active":"2024-09-10T08:44:29.456346+0000","last_peered":"2024-09-10T08:44:29.456346+0000","last_clean":"2024-09-10T08:44:29.456346+0000","last_became_active":"2024-09-10T08:28:47.629259+0000","last_became_peered":"2024-09-10T08:28:47.629259+0000","last_unstale":"2024-09-10T08:44:29.456346+0000","last_undegraded":"2024-09-10T08:44:29.456346+0000","last_fullsized":"2024-09-10T08:44:29.456346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4466,"log_dups_size":0,"ondisk_log_size":4466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:11.864322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23096,"num_write_kb":301452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"27'4995","reported_seq":5026,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.537572+0000","last_change":"2024-09-10T08:28:35.572709+0000","last_active":"2024-09-10T08:44:22.537572+0000","last_peered":"2024-09-10T08:44:22.537572+0000","last_clean":"2024-09-10T08:44:22.537572+0000","last_became_active":"2024-09-10T08:28:35.572392+0000","last_became_peered":"2024-09-10T08:28:35.572392+0000","last_unstale":"2024-09-10T08:44:22.537572+0000","last_undegraded":"2024-09-10T08:44:22.537572+0000","last_fullsized":"2024-09-10T08:44:22.537572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4995,"log_dups_size":0,"ondisk_log_size":4995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:42.636299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25177,"num_write_kb":305700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"27'4176","reported_seq":4199,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.350264+0000","last_change":"2024-09-10T08:28:47.623285+0000","last_active":"2024-09-10T08:44:29.350264+0000","last_peered":"2024-09-10T08:44:29.350264+0000","last_clean":"2024-09-10T08:44:29.350264+0000","last_became_active":"2024-09-10T08:28:47.621776+0000","last_became_peered":"2024-09-10T08:28:47.621776+0000","last_unstale":"2024-09-10T08:44:29.350264+0000","last_undegraded":"2024-09-10T08:44:29.350264+0000","last_fullsized":"2024-09-10T08:44:29.350264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:32.543418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21718,"num_write_kb":267375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'3678","reported_seq":3708,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.498693+0000","last_change":"2024-09-10T08:28:35.574438+0000","last_active":"2024-09-10T08:44:22.498693+0000","last_peered":"2024-09-10T08:44:22.498693+0000","last_clean":"2024-09-10T08:44:22.498693+0000","last_became_active":"2024-09-10T08:28:35.574175+0000","last_became_peered":"2024-09-10T08:28:35.574175+0000","last_unstale":"2024-09-10T08:44:22.498693+0000","last_undegraded":"2024-09-10T08:44:22.498693+0000","last_fullsized":"2024-09-10T08:44:22.498693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3678,"log_dups_size":0,"ondisk_log_size":3678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:55.808543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18345,"num_write_kb":237300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"27'4228","reported_seq":4250,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.395548+0000","last_change":"2024-09-10T08:28:47.629092+0000","last_active":"2024-09-10T08:44:29.395548+0000","last_peered":"2024-09-10T08:44:29.395548+0000","last_clean":"2024-09-10T08:44:29.395548+0000","last_became_active":"2024-09-10T08:28:47.628806+0000","last_became_peered":"2024-09-10T08:28:47.628806+0000","last_unstale":"2024-09-10T08:44:29.395548+0000","last_undegraded":"2024-09-10T08:44:29.395548+0000","last_fullsized":"2024-09-10T08:44:29.395548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4228,"log_dups_size":0,"ondisk_log_size":4228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:46.440290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21732,"num_write_kb":287874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"27'5344","reported_seq":5360,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.508645+0000","last_change":"2024-09-10T08:29:35.107021+0000","last_active":"2024-09-10T08:44:22.508645+0000","last_peered":"2024-09-10T08:44:22.508645+0000","last_clean":"2024-09-10T08:44:22.508645+0000","last_became_active":"2024-09-10T08:29:35.106806+0000","last_became_peered":"2024-09-10T08:29:35.106806+0000","last_unstale":"2024-09-10T08:44:22.508645+0000","last_undegraded":"2024-09-10T08:44:22.508645+0000","last_fullsized":"2024-09-10T08:44:22.508645+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5344,"log_dups_size":0,"ondisk_log_size":5344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:20.234687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27047,"num_write_kb":354198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"27'5319","reported_seq":5341,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.401144+0000","last_change":"2024-09-10T08:28:47.631797+0000","last_active":"2024-09-10T08:44:29.401144+0000","last_peered":"2024-09-10T08:44:29.401144+0000","last_clean":"2024-09-10T08:44:29.401144+0000","last_became_active":"2024-09-10T08:28:47.631523+0000","last_became_peered":"2024-09-10T08:28:47.631523+0000","last_unstale":"2024-09-10T08:44:29.401144+0000","last_undegraded":"2024-09-10T08:44:29.401144+0000","last_fullsized":"2024-09-10T08:44:29.401144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5319,"log_dups_size":0,"ondisk_log_size":5319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:05.829116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28163,"num_write_kb":342261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'4477","reported_seq":4507,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.480254+0000","last_change":"2024-09-10T08:28:35.570249+0000","last_active":"2024-09-10T08:44:22.480254+0000","last_peered":"2024-09-10T08:44:22.480254+0000","last_clean":"2024-09-10T08:44:22.480254+0000","last_became_active":"2024-09-10T08:28:35.569960+0000","last_became_peered":"2024-09-10T08:28:35.569960+0000","last_unstale":"2024-09-10T08:44:22.480254+0000","last_undegraded":"2024-09-10T08:44:22.480254+0000","last_fullsized":"2024-09-10T08:44:22.480254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4477,"log_dups_size":0,"ondisk_log_size":4477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:29.787554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23485,"num_write_kb":274341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"27'5295","reported_seq":5317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.481069+0000","last_change":"2024-09-10T08:28:47.633644+0000","last_active":"2024-09-10T08:44:29.481069+0000","last_peered":"2024-09-10T08:44:29.481069+0000","last_clean":"2024-09-10T08:44:29.481069+0000","last_became_active":"2024-09-10T08:28:47.633315+0000","last_became_peered":"2024-09-10T08:28:47.633315+0000","last_unstale":"2024-09-10T08:44:29.481069+0000","last_undegraded":"2024-09-10T08:44:29.481069+0000","last_fullsized":"2024-09-10T08:44:29.481069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5295,"log_dups_size":0,"ondisk_log_size":5295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:45:55.827386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28671,"num_write_kb":360707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"27'4645","reported_seq":4675,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.519615+0000","last_change":"2024-09-10T08:28:35.560693+0000","last_active":"2024-09-10T08:44:22.519615+0000","last_peered":"2024-09-10T08:44:22.519615+0000","last_clean":"2024-09-10T08:44:22.519615+0000","last_became_active":"2024-09-10T08:28:35.560409+0000","last_became_peered":"2024-09-10T08:28:35.560409+0000","last_unstale":"2024-09-10T08:44:22.519615+0000","last_undegraded":"2024-09-10T08:44:22.519615+0000","last_fullsized":"2024-09-10T08:44:22.519615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4645,"log_dups_size":0,"ondisk_log_size":4645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:10.597654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23495,"num_write_kb":303194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"27'3828","reported_seq":3850,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.453763+0000","last_change":"2024-09-10T08:28:47.622614+0000","last_active":"2024-09-10T08:44:29.453763+0000","last_peered":"2024-09-10T08:44:29.453763+0000","last_clean":"2024-09-10T08:44:29.453763+0000","last_became_active":"2024-09-10T08:28:47.622205+0000","last_became_peered":"2024-09-10T08:28:47.622205+0000","last_unstale":"2024-09-10T08:44:29.453763+0000","last_undegraded":"2024-09-10T08:44:29.453763+0000","last_fullsized":"2024-09-10T08:44:29.453763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3828,"log_dups_size":0,"ondisk_log_size":3828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:47.090782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19475,"num_write_kb":250147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'5239","reported_seq":5269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.476534+0000","last_change":"2024-09-10T08:28:35.574551+0000","last_active":"2024-09-10T08:44:22.476534+0000","last_peered":"2024-09-10T08:44:22.476534+0000","last_clean":"2024-09-10T08:44:22.476534+0000","last_became_active":"2024-09-10T08:28:35.574256+0000","last_became_peered":"2024-09-10T08:28:35.574256+0000","last_unstale":"2024-09-10T08:44:22.476534+0000","last_undegraded":"2024-09-10T08:44:22.476534+0000","last_fullsized":"2024-09-10T08:44:22.476534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:43.401552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27760,"num_write_kb":320273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"27'4221","reported_seq":4243,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.396030+0000","last_change":"2024-09-10T08:28:47.633476+0000","last_active":"2024-09-10T08:44:29.396030+0000","last_peered":"2024-09-10T08:44:29.396030+0000","last_clean":"2024-09-10T08:44:29.396030+0000","last_became_active":"2024-09-10T08:28:47.633189+0000","last_became_peered":"2024-09-10T08:28:47.633189+0000","last_unstale":"2024-09-10T08:44:29.396030+0000","last_undegraded":"2024-09-10T08:44:29.396030+0000","last_fullsized":"2024-09-10T08:44:29.396030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4221,"log_dups_size":0,"ondisk_log_size":4221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:46.175490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21808,"num_write_kb":284043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"27'4276","reported_seq":4306,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.491121+0000","last_change":"2024-09-10T08:28:35.573330+0000","last_active":"2024-09-10T08:44:22.491121+0000","last_peered":"2024-09-10T08:44:22.491121+0000","last_clean":"2024-09-10T08:44:22.491121+0000","last_became_active":"2024-09-10T08:28:35.572992+0000","last_became_peered":"2024-09-10T08:28:35.572992+0000","last_unstale":"2024-09-10T08:44:22.491121+0000","last_undegraded":"2024-09-10T08:44:22.491121+0000","last_fullsized":"2024-09-10T08:44:22.491121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4276,"log_dups_size":0,"ondisk_log_size":4276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:15.412219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22251,"num_write_kb":273423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"27'4525","reported_seq":4547,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.372686+0000","last_change":"2024-09-10T08:28:47.630733+0000","last_active":"2024-09-10T08:44:29.372686+0000","last_peered":"2024-09-10T08:44:29.372686+0000","last_clean":"2024-09-10T08:44:29.372686+0000","last_became_active":"2024-09-10T08:28:47.630447+0000","last_became_peered":"2024-09-10T08:28:47.630447+0000","last_unstale":"2024-09-10T08:44:29.372686+0000","last_undegraded":"2024-09-10T08:44:29.372686+0000","last_fullsized":"2024-09-10T08:44:29.372686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4525,"log_dups_size":0,"ondisk_log_size":4525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:08.797818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23690,"num_write_kb":303969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'4030","reported_seq":4060,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.496908+0000","last_change":"2024-09-10T08:28:35.566574+0000","last_active":"2024-09-10T08:44:22.496908+0000","last_peered":"2024-09-10T08:44:22.496908+0000","last_clean":"2024-09-10T08:44:22.496908+0000","last_became_active":"2024-09-10T08:28:35.566205+0000","last_became_peered":"2024-09-10T08:28:35.566205+0000","last_unstale":"2024-09-10T08:44:22.496908+0000","last_undegraded":"2024-09-10T08:44:22.496908+0000","last_fullsized":"2024-09-10T08:44:22.496908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4030,"log_dups_size":0,"ondisk_log_size":4030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:49.876773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20014,"num_write_kb":252379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"27'4167","reported_seq":4189,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.339294+0000","last_change":"2024-09-10T08:28:47.628051+0000","last_active":"2024-09-10T08:44:29.339294+0000","last_peered":"2024-09-10T08:44:29.339294+0000","last_clean":"2024-09-10T08:44:29.339294+0000","last_became_active":"2024-09-10T08:28:47.627747+0000","last_became_peered":"2024-09-10T08:28:47.627747+0000","last_unstale":"2024-09-10T08:44:29.339294+0000","last_undegraded":"2024-09-10T08:44:29.339294+0000","last_fullsized":"2024-09-10T08:44:29.339294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4167,"log_dups_size":0,"ondisk_log_size":4167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:54.210449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22015,"num_write_kb":272523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"27'4068","reported_seq":4098,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.450841+0000","last_change":"2024-09-10T08:28:35.565023+0000","last_active":"2024-09-10T08:44:22.450841+0000","last_peered":"2024-09-10T08:44:22.450841+0000","last_clean":"2024-09-10T08:44:22.450841+0000","last_became_active":"2024-09-10T08:28:35.564747+0000","last_became_peered":"2024-09-10T08:28:35.564747+0000","last_unstale":"2024-09-10T08:44:22.450841+0000","last_undegraded":"2024-09-10T08:44:22.450841+0000","last_fullsized":"2024-09-10T08:44:22.450841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4068,"log_dups_size":0,"ondisk_log_size":4068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:32.419621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20848,"num_write_kb":280067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"27'3614","reported_seq":3636,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.473598+0000","last_change":"2024-09-10T08:28:47.631047+0000","last_active":"2024-09-10T08:44:29.473598+0000","last_peered":"2024-09-10T08:44:29.473598+0000","last_clean":"2024-09-10T08:44:29.473598+0000","last_became_active":"2024-09-10T08:28:47.630617+0000","last_became_peered":"2024-09-10T08:28:47.630617+0000","last_unstale":"2024-09-10T08:44:29.473598+0000","last_undegraded":"2024-09-10T08:44:29.473598+0000","last_fullsized":"2024-09-10T08:44:29.473598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3614,"log_dups_size":0,"ondisk_log_size":3614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:29.867640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19300,"num_write_kb":257617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'4938","reported_seq":4968,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.528147+0000","last_change":"2024-09-10T08:28:35.570619+0000","last_active":"2024-09-10T08:44:22.528147+0000","last_peered":"2024-09-10T08:44:22.528147+0000","last_clean":"2024-09-10T08:44:22.528147+0000","last_became_active":"2024-09-10T08:28:35.570351+0000","last_became_peered":"2024-09-10T08:28:35.570351+0000","last_unstale":"2024-09-10T08:44:22.528147+0000","last_undegraded":"2024-09-10T08:44:22.528147+0000","last_fullsized":"2024-09-10T08:44:22.528147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4938,"log_dups_size":0,"ondisk_log_size":4938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:35.161279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26047,"num_write_kb":333713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"27'4403","reported_seq":4425,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.439522+0000","last_change":"2024-09-10T08:28:47.626191+0000","last_active":"2024-09-10T08:44:29.439522+0000","last_peered":"2024-09-10T08:44:29.439522+0000","last_clean":"2024-09-10T08:44:29.439522+0000","last_became_active":"2024-09-10T08:28:47.625781+0000","last_became_peered":"2024-09-10T08:28:47.625781+0000","last_unstale":"2024-09-10T08:44:29.439522+0000","last_undegraded":"2024-09-10T08:44:29.439522+0000","last_fullsized":"2024-09-10T08:44:29.439522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4403,"log_dups_size":0,"ondisk_log_size":4403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:36:38.651973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22837,"num_write_kb":300422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"27'5731","reported_seq":5761,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.570796+0000","last_change":"2024-09-10T08:28:35.577345+0000","last_active":"2024-09-10T08:44:22.570796+0000","last_peered":"2024-09-10T08:44:22.570796+0000","last_clean":"2024-09-10T08:44:22.570796+0000","last_became_active":"2024-09-10T08:28:35.576191+0000","last_became_peered":"2024-09-10T08:28:35.576191+0000","last_unstale":"2024-09-10T08:44:22.570796+0000","last_undegraded":"2024-09-10T08:44:22.570796+0000","last_fullsized":"2024-09-10T08:44:22.570796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5731,"log_dups_size":0,"ondisk_log_size":5731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:29.218797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30251,"num_write_kb":366959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"27'5875","reported_seq":5898,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.422514+0000","last_change":"2024-09-10T08:28:47.623129+0000","last_active":"2024-09-10T08:44:29.422514+0000","last_peered":"2024-09-10T08:44:29.422514+0000","last_clean":"2024-09-10T08:44:29.422514+0000","last_became_active":"2024-09-10T08:28:47.622851+0000","last_became_peered":"2024-09-10T08:28:47.622851+0000","last_unstale":"2024-09-10T08:44:29.422514+0000","last_undegraded":"2024-09-10T08:44:29.422514+0000","last_fullsized":"2024-09-10T08:44:29.422514+0000","mapping_epoch":23,"log_start":"27'700","ondisk_log_start":"27'700","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5175,"log_dups_size":0,"ondisk_log_size":5175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:16.045213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31498,"num_write_kb":384432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"27'4833","reported_seq":4863,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.512670+0000","last_change":"2024-09-10T08:28:35.575275+0000","last_active":"2024-09-10T08:44:22.512670+0000","last_peered":"2024-09-10T08:44:22.512670+0000","last_clean":"2024-09-10T08:44:22.512670+0000","last_became_active":"2024-09-10T08:28:35.575052+0000","last_became_peered":"2024-09-10T08:28:35.575052+0000","last_unstale":"2024-09-10T08:44:22.512670+0000","last_undegraded":"2024-09-10T08:44:22.512670+0000","last_fullsized":"2024-09-10T08:44:22.512670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4833,"log_dups_size":0,"ondisk_log_size":4833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:24.313017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24290,"num_write_kb":318500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"27'3897","reported_seq":3920,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.448047+0000","last_change":"2024-09-10T08:28:47.628651+0000","last_active":"2024-09-10T08:44:29.448047+0000","last_peered":"2024-09-10T08:44:29.448047+0000","last_clean":"2024-09-10T08:44:29.448047+0000","last_became_active":"2024-09-10T08:28:47.628343+0000","last_became_peered":"2024-09-10T08:28:47.628343+0000","last_unstale":"2024-09-10T08:44:29.448047+0000","last_undegraded":"2024-09-10T08:44:29.448047+0000","last_fullsized":"2024-09-10T08:44:29.448047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3897,"log_dups_size":0,"ondisk_log_size":3897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:05.848341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20646,"num_write_kb":258901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"27'4919","reported_seq":4949,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.470476+0000","last_change":"2024-09-10T08:28:35.578664+0000","last_active":"2024-09-10T08:44:22.470476+0000","last_peered":"2024-09-10T08:44:22.470476+0000","last_clean":"2024-09-10T08:44:22.470476+0000","last_became_active":"2024-09-10T08:28:35.578384+0000","last_became_peered":"2024-09-10T08:28:35.578384+0000","last_unstale":"2024-09-10T08:44:22.470476+0000","last_undegraded":"2024-09-10T08:44:22.470476+0000","last_fullsized":"2024-09-10T08:44:22.470476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4919,"log_dups_size":0,"ondisk_log_size":4919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:44.278718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25865,"num_write_kb":300415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"27'4164","reported_seq":4187,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.421617+0000","last_change":"2024-09-10T08:28:47.627593+0000","last_active":"2024-09-10T08:44:29.421617+0000","last_peered":"2024-09-10T08:44:29.421617+0000","last_clean":"2024-09-10T08:44:29.421617+0000","last_became_active":"2024-09-10T08:28:47.627237+0000","last_became_peered":"2024-09-10T08:28:47.627237+0000","last_unstale":"2024-09-10T08:44:29.421617+0000","last_undegraded":"2024-09-10T08:44:29.421617+0000","last_fullsized":"2024-09-10T08:44:29.421617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4164,"log_dups_size":0,"ondisk_log_size":4164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:16.045213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22780,"num_write_kb":275817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'3973","reported_seq":4003,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.535798+0000","last_change":"2024-09-10T08:28:35.578978+0000","last_active":"2024-09-10T08:44:22.535798+0000","last_peered":"2024-09-10T08:44:22.535798+0000","last_clean":"2024-09-10T08:44:22.535798+0000","last_became_active":"2024-09-10T08:28:35.578475+0000","last_became_peered":"2024-09-10T08:28:35.578475+0000","last_unstale":"2024-09-10T08:44:22.535798+0000","last_undegraded":"2024-09-10T08:44:22.535798+0000","last_fullsized":"2024-09-10T08:44:22.535798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3973,"log_dups_size":0,"ondisk_log_size":3973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:08.520314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20258,"num_write_kb":257321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"27'4520","reported_seq":4543,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.418567+0000","last_change":"2024-09-10T08:28:47.634072+0000","last_active":"2024-09-10T08:44:29.418567+0000","last_peered":"2024-09-10T08:44:29.418567+0000","last_clean":"2024-09-10T08:44:29.418567+0000","last_became_active":"2024-09-10T08:28:47.633776+0000","last_became_peered":"2024-09-10T08:28:47.633776+0000","last_unstale":"2024-09-10T08:44:29.418567+0000","last_undegraded":"2024-09-10T08:44:29.418567+0000","last_fullsized":"2024-09-10T08:44:29.418567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4520,"log_dups_size":0,"ondisk_log_size":4520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:30.690202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23464,"num_write_kb":303031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'5689","reported_seq":5719,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.552561+0000","last_change":"2024-09-10T08:28:35.572112+0000","last_active":"2024-09-10T08:44:22.552561+0000","last_peered":"2024-09-10T08:44:22.552561+0000","last_clean":"2024-09-10T08:44:22.552561+0000","last_became_active":"2024-09-10T08:28:35.571803+0000","last_became_peered":"2024-09-10T08:28:35.571803+0000","last_unstale":"2024-09-10T08:44:22.552561+0000","last_undegraded":"2024-09-10T08:44:22.552561+0000","last_fullsized":"2024-09-10T08:44:22.552561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5689,"log_dups_size":0,"ondisk_log_size":5689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:29.969987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28713,"num_write_kb":356779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"27'3638","reported_seq":3660,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456832+0000","last_change":"2024-09-10T08:28:47.620523+0000","last_active":"2024-09-10T08:44:29.456832+0000","last_peered":"2024-09-10T08:44:29.456832+0000","last_clean":"2024-09-10T08:44:29.456832+0000","last_became_active":"2024-09-10T08:28:47.620220+0000","last_became_peered":"2024-09-10T08:28:47.620220+0000","last_unstale":"2024-09-10T08:44:29.456832+0000","last_undegraded":"2024-09-10T08:44:29.456832+0000","last_fullsized":"2024-09-10T08:44:29.456832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3638,"log_dups_size":0,"ondisk_log_size":3638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:14.405210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18717,"num_write_kb":251073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"27'4254","reported_seq":4285,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.514815+0000","last_change":"2024-09-10T08:28:35.578961+0000","last_active":"2024-09-10T08:44:22.514815+0000","last_peered":"2024-09-10T08:44:22.514815+0000","last_clean":"2024-09-10T08:44:22.514815+0000","last_became_active":"2024-09-10T08:28:35.578680+0000","last_became_peered":"2024-09-10T08:28:35.578680+0000","last_unstale":"2024-09-10T08:44:22.514815+0000","last_undegraded":"2024-09-10T08:44:22.514815+0000","last_fullsized":"2024-09-10T08:44:22.514815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4254,"log_dups_size":0,"ondisk_log_size":4254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:53.737412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22529,"num_write_kb":274609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"27'5728","reported_seq":5750,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.335399+0000","last_change":"2024-09-10T08:28:47.624859+0000","last_active":"2024-09-10T08:44:29.335399+0000","last_peered":"2024-09-10T08:44:29.335399+0000","last_clean":"2024-09-10T08:44:29.335399+0000","last_became_active":"2024-09-10T08:28:47.624585+0000","last_became_peered":"2024-09-10T08:28:47.624585+0000","last_unstale":"2024-09-10T08:44:29.335399+0000","last_undegraded":"2024-09-10T08:44:29.335399+0000","last_fullsized":"2024-09-10T08:44:29.335399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5728,"log_dups_size":0,"ondisk_log_size":5728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:00.956870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28703,"num_write_kb":356727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'4780","reported_seq":4811,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.475999+0000","last_change":"2024-09-10T08:28:35.573918+0000","last_active":"2024-09-10T08:44:22.475999+0000","last_peered":"2024-09-10T08:44:22.475999+0000","last_clean":"2024-09-10T08:44:22.475999+0000","last_became_active":"2024-09-10T08:28:35.573646+0000","last_became_peered":"2024-09-10T08:28:35.573646+0000","last_unstale":"2024-09-10T08:44:22.475999+0000","last_undegraded":"2024-09-10T08:44:22.475999+0000","last_fullsized":"2024-09-10T08:44:22.475999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4780,"log_dups_size":0,"ondisk_log_size":4780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:24.295630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24418,"num_write_kb":306743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"27'4700","reported_seq":4722,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.478952+0000","last_change":"2024-09-10T08:28:47.631802+0000","last_active":"2024-09-10T08:44:29.478952+0000","last_peered":"2024-09-10T08:44:29.478952+0000","last_clean":"2024-09-10T08:44:29.478952+0000","last_became_active":"2024-09-10T08:28:47.631456+0000","last_became_peered":"2024-09-10T08:28:47.631456+0000","last_unstale":"2024-09-10T08:44:29.478952+0000","last_undegraded":"2024-09-10T08:44:29.478952+0000","last_fullsized":"2024-09-10T08:44:29.478952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4700,"log_dups_size":0,"ondisk_log_size":4700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:56.571659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23620,"num_write_kb":315928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'5816","reported_seq":5847,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.453619+0000","last_change":"2024-09-10T08:28:35.578197+0000","last_active":"2024-09-10T08:44:22.453619+0000","last_peered":"2024-09-10T08:44:22.453619+0000","last_clean":"2024-09-10T08:44:22.453619+0000","last_became_active":"2024-09-10T08:28:35.577852+0000","last_became_peered":"2024-09-10T08:28:35.577852+0000","last_unstale":"2024-09-10T08:44:22.453619+0000","last_undegraded":"2024-09-10T08:44:22.453619+0000","last_fullsized":"2024-09-10T08:44:22.453619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5816,"log_dups_size":0,"ondisk_log_size":5816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:44.348299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30528,"num_write_kb":380548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"27'4272","reported_seq":4294,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.370484+0000","last_change":"2024-09-10T08:28:47.629993+0000","last_active":"2024-09-10T08:44:29.370484+0000","last_peered":"2024-09-10T08:44:29.370484+0000","last_clean":"2024-09-10T08:44:29.370484+0000","last_became_active":"2024-09-10T08:28:47.629713+0000","last_became_peered":"2024-09-10T08:28:47.629713+0000","last_unstale":"2024-09-10T08:44:29.370484+0000","last_undegraded":"2024-09-10T08:44:29.370484+0000","last_fullsized":"2024-09-10T08:44:29.370484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4272,"log_dups_size":0,"ondisk_log_size":4272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:56.640722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22513,"num_write_kb":287067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"27'4101","reported_seq":4132,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.558949+0000","last_change":"2024-09-10T08:28:35.571065+0000","last_active":"2024-09-10T08:44:22.558949+0000","last_peered":"2024-09-10T08:44:22.558949+0000","last_clean":"2024-09-10T08:44:22.558949+0000","last_became_active":"2024-09-10T08:28:35.570749+0000","last_became_peered":"2024-09-10T08:28:35.570749+0000","last_unstale":"2024-09-10T08:44:22.558949+0000","last_undegraded":"2024-09-10T08:44:22.558949+0000","last_fullsized":"2024-09-10T08:44:22.558949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4101,"log_dups_size":0,"ondisk_log_size":4101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:04.628661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21304,"num_write_kb":261525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1506886,"num_write_kb":19151846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":286269,"ondisk_log_size":286269,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":17622670,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":51,"num_read_kb":121,"num_write":4293,"num_write_kb":18856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":35307520,"data_stored":35245340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3534,"ondisk_log_size":3534,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1565097,"num_write_kb":19381290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":301805,"ondisk_log_size":301805,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":17928438,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":58,"num_read_kb":129,"num_write":4368,"num_write_kb":19205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":35921920,"data_stored":35856876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3624,"ondisk_log_size":3624,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509637,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1140720,"kb_used_data":13152,"kb_used_omap":1,"kb_used_meta":1127550,"kb_avail":93231120,"statfs":{"total":96636764160,"available":95468666880,"internally_reserved":0,"allocated":13467648,"data_stored":13288824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1154611659},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509636,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1037512,"kb_used_data":4472,"kb_used_omap":1,"kb_used_meta":1033022,"kb_avail":93334328,"statfs":{"total":96636764160,"available":95574351872,"internally_reserved":0,"allocated":4579328,"data_stored":4398018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1057814981},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509638,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1082628,"kb_used_data":10356,"kb_used_omap":1,"kb_used_meta":1072254,"kb_avail":93289212,"statfs":{"total":96636764160,"available":95528153088,"internally_reserved":0,"allocated":10604544,"data_stored":10409366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1097988549},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509639,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1151860,"kb_used_data":17508,"kb_used_omap":1,"kb_used_meta":1134334,"kb_avail":93219980,"statfs":{"total":96636764160,"available":95457259520,"internally_reserved":0,"allocated":17928192,"data_stored":17737438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1161558471},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509638,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":892856,"kb_used_data":8488,"kb_used_omap":1,"kb_used_meta":884350,"kb_avail":93478984,"statfs":{"total":96636764160,"available":95722479616,"internally_reserved":0,"allocated":8691712,"data_stored":8504334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":905574853},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509637,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":911348,"kb_used_data":9060,"kb_used_omap":1,"kb_used_meta":902270,"kb_avail":93460492,"statfs":{"total":96636764160,"available":95703543808,"internally_reserved":0,"allocated":9277440,"data_stored":9094486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":923924933},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575044,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":775044,"kb_used_data":9524,"kb_used_omap":1,"kb_used_meta":765502,"kb_avail":93596796,"statfs":{"total":96636764160,"available":95843119104,"internally_reserved":0,"allocated":9752576,"data_stored":9566440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":783874503},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575047,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":725760,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":725374,"kb_avail":93646080,"statfs":{"total":96636764160,"available":95893585920,"internally_reserved":0,"allocated":376832,"data_stored":203022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":742783430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":88080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8477360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5271552,"data_stored":5256102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5267456,"data_stored":5256648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9158656,"data_stored":9145206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5050368,"data_stored":5038392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4292608,"data_stored":4283056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:44:36.114 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:44:36.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.243+0000 7fe41a67b640 1 Processor -- start 2024-09-10T08:44:36.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.243+0000 7fe41a67b640 1 -- start start 2024-09-10T08:44:36.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.244+0000 7fe41a67b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe4140c9860 0x7fe4140c8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:36.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.244+0000 7fe41a67b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe414157c90 0x7fe4140c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:36.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.244+0000 7fe41a67b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4140741e0 con 0x7fe4141578b0 2024-09-10T08:44:36.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.244+0000 7fe41a67b640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fe414073f90 con 0x7fe414157c90 2024-09-10T08:44:36.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.244+0000 7fe41a67b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe414158280 con 0x7fe4140c9860 2024-09-10T08:44:36.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.244+0000 7fe418c18640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe414157c90 0x7fe4140c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:36.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.244+0000 7fe418c18640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe414157c90 0x7fe4140c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60548/0 (socket says 172.21.15.103:60548) 2024-09-10T08:44:36.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.244+0000 7fe418c18640 1 -- 172.21.15.103:0/953339624 learned_addr learned my addr 172.21.15.103:0/953339624 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:36.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.244+0000 7fe418c18640 1 -- 172.21.15.103:0/953339624 >> v2:172.21.15.154:3300/0 conn(0x7fe4140c9860 msgr2=0x7fe4140c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:36.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.244+0000 7fe4137fe640 1 --2- 172.21.15.103:0/953339624 >> v2:172.21.15.154:3300/0 conn(0x7fe4140c9860 0x7fe4140c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:36.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.244+0000 7fe418c18640 1 --2- 172.21.15.103:0/953339624 >> v2:172.21.15.154:3300/0 conn(0x7fe4140c9860 0x7fe4140c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.244+0000 7fe418c18640 1 -- 172.21.15.103:0/953339624 >> v1:172.21.15.154:6789/0 conn(0x7fe4141578b0 legacy=0x7fe4141513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:36.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.244+0000 7fe418c18640 1 -- 172.21.15.103:0/953339624 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4140c4820 con 0x7fe414157c90 2024-09-10T08:44:36.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.245+0000 7fe418c18640 1 --2- 172.21.15.103:0/953339624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe414157c90 0x7fe4140c8d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe414068be0 tx=0x7fe40c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e5fa7431a56d2b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:36.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.245+0000 7fe412ffd640 1 -- 172.21.15.103:0/953339624 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c036070 con 0x7fe414157c90 2024-09-10T08:44:36.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.245+0000 7fe412ffd640 1 -- 172.21.15.103:0/953339624 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe40c031600 con 0x7fe414157c90 2024-09-10T08:44:36.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.245+0000 7fe412ffd640 1 -- 172.21.15.103:0/953339624 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c0319d0 con 0x7fe414157c90 2024-09-10T08:44:36.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.246+0000 7fe41a67b640 1 -- 172.21.15.103:0/953339624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe414157c90 msgr2=0x7fe4140c8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:36.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.246+0000 7fe41a67b640 1 --2- 172.21.15.103:0/953339624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe414157c90 0x7fe4140c8d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe414068be0 tx=0x7fe40c02a5d0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.246+0000 7fe41a67b640 1 -- 172.21.15.103:0/953339624 shutdown_connections 2024-09-10T08:44:36.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.246+0000 7fe41a67b640 1 --2- 172.21.15.103:0/953339624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe414157c90 0x7fe4140c8d80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.246+0000 7fe41a67b640 1 --2- 172.21.15.103:0/953339624 >> v2:172.21.15.154:3300/0 conn(0x7fe4140c9860 0x7fe4140c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.246+0000 7fe41a67b640 1 -- 172.21.15.103:0/953339624 >> 172.21.15.103:0/953339624 conn(0x7fe4140c6880 msgr2=0x7fe4140c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:36.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.246+0000 7fe41a67b640 1 -- 172.21.15.103:0/953339624 shutdown_connections 2024-09-10T08:44:36.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.246+0000 7fe41a67b640 1 -- 172.21.15.103:0/953339624 wait complete. 2024-09-10T08:44:36.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.247+0000 7fe41a67b640 1 Processor -- start 2024-09-10T08:44:36.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.247+0000 7fe41a67b640 1 -- start start 2024-09-10T08:44:36.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.248+0000 7fe41a67b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4140c9860 0x7fe414156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:36.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.248+0000 7fe41a67b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4141578b0 0x7fe4141ec180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:36.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.248+0000 7fe41a67b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe414157c90 0x7fe4141ec6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:36.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.248+0000 7fe41a67b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe4140afeb0 con 0x7fe414157c90 2024-09-10T08:44:36.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.248+0000 7fe41a67b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe4140afd30 con 0x7fe4140c9860 2024-09-10T08:44:36.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.248+0000 7fe41a67b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe4140c7550 con 0x7fe4141578b0 2024-09-10T08:44:36.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.248+0000 7fe418c18640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe414157c90 0x7fe4141ec6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:36.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.248+0000 7fe418c18640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe414157c90 0x7fe4141ec6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60552/0 (socket says 172.21.15.103:60552) 2024-09-10T08:44:36.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.248+0000 7fe418c18640 1 -- 172.21.15.103:0/2620316389 learned_addr learned my addr 172.21.15.103:0/2620316389 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:36.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.248+0000 7fe418c18640 1 -- 172.21.15.103:0/2620316389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4141578b0 msgr2=0x7fe4141ec180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:36.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.248+0000 7fe418c18640 1 --2- 172.21.15.103:0/2620316389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4141578b0 0x7fe4141ec180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.248+0000 7fe418c18640 1 -- 172.21.15.103:0/2620316389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4140c9860 msgr2=0x7fe414156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:36.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.248+0000 7fe413fff640 1 --2- 172.21.15.103:0/2620316389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4140c9860 0x7fe414156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:36.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.248+0000 7fe418c18640 1 --2- 172.21.15.103:0/2620316389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4140c9860 0x7fe414156240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.248+0000 7fe418c18640 1 -- 172.21.15.103:0/2620316389 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe414155af0 con 0x7fe414157c90 2024-09-10T08:44:36.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.248+0000 7fe418c18640 1 --2- 172.21.15.103:0/2620316389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe414157c90 0x7fe4141ec6c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe40c009f40 tx=0x7fe40c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:36.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.249+0000 7fe410ff9640 1 -- 172.21.15.103:0/2620316389 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c036050 con 0x7fe414157c90 2024-09-10T08:44:36.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.249+0000 7fe410ff9640 1 -- 172.21.15.103:0/2620316389 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe40c042070 con 0x7fe414157c90 2024-09-10T08:44:36.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.249+0000 7fe41a67b640 1 -- 172.21.15.103:0/2620316389 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4141ef820 con 0x7fe414157c90 2024-09-10T08:44:36.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.249+0000 7fe410ff9640 1 -- 172.21.15.103:0/2620316389 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c009510 con 0x7fe414157c90 2024-09-10T08:44:36.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.249+0000 7fe41a67b640 1 -- 172.21.15.103:0/2620316389 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe414156780 con 0x7fe414157c90 2024-09-10T08:44:36.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.250+0000 7fe41a67b640 1 -- 172.21.15.103:0/2620316389 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4141513f0 con 0x7fe414157c90 2024-09-10T08:44:36.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.250+0000 7fe410ff9640 1 -- 172.21.15.103:0/2620316389 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe40c007bd0 con 0x7fe414157c90 2024-09-10T08:44:36.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.251+0000 7fe410ff9640 1 --2- 172.21.15.103:0/2620316389 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe40006be60 0x7fe40006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:36.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.251+0000 7fe410ff9640 1 -- 172.21.15.103:0/2620316389 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fe40c0ac140 con 0x7fe414157c90 2024-09-10T08:44:36.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.251+0000 7fe413fff640 1 --2- 172.21.15.103:0/2620316389 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe40006be60 0x7fe40006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:36.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.251+0000 7fe413fff640 1 --2- 172.21.15.103:0/2620316389 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe40006be60 0x7fe40006e320 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe4040015d0 tx=0x7fe404009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:36.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.255+0000 7fe410ff9640 1 -- 172.21.15.103:0/2620316389 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe40c07a7e0 con 0x7fe414157c90 2024-09-10T08:44:36.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.421+0000 7fe41a67b640 1 -- 172.21.15.103:0/2620316389 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe414155dd0 con 0x7fe40006be60 2024-09-10T08:44:36.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.431+0000 7fe410ff9640 1 -- 172.21.15.103:0/2620316389 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+493688 (secure 0 0 0) 0x7fe414155dd0 con 0x7fe40006be60 2024-09-10T08:44:36.438 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:44:36.441 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T08:44:36.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.436+0000 7fe41a67b640 1 -- 172.21.15.103:0/2620316389 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe40006be60 msgr2=0x7fe40006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:36.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.436+0000 7fe41a67b640 1 --2- 172.21.15.103:0/2620316389 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe40006be60 0x7fe40006e320 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe4040015d0 tx=0x7fe404009040 comp rx=0 tx=0).stop 2024-09-10T08:44:36.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.436+0000 7fe41a67b640 1 -- 172.21.15.103:0/2620316389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe414157c90 msgr2=0x7fe4141ec6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:36.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.436+0000 7fe41a67b640 1 --2- 172.21.15.103:0/2620316389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe414157c90 0x7fe4141ec6c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe40c009f40 tx=0x7fe40c004a40 comp rx=0 tx=0).stop 2024-09-10T08:44:36.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.436+0000 7fe41a67b640 1 -- 172.21.15.103:0/2620316389 shutdown_connections 2024-09-10T08:44:36.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.436+0000 7fe41a67b640 1 --2- 172.21.15.103:0/2620316389 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe40006be60 0x7fe40006e320 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.436+0000 7fe41a67b640 1 --2- 172.21.15.103:0/2620316389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe414157c90 0x7fe4141ec6c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.436+0000 7fe41a67b640 1 --2- 172.21.15.103:0/2620316389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4141578b0 0x7fe4141ec180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.436+0000 7fe41a67b640 1 --2- 172.21.15.103:0/2620316389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4140c9860 0x7fe414156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.436+0000 7fe41a67b640 1 -- 172.21.15.103:0/2620316389 >> 172.21.15.103:0/2620316389 conn(0x7fe4140c6880 msgr2=0x7fe41406ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:36.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.436+0000 7fe41a67b640 1 -- 172.21.15.103:0/2620316389 shutdown_connections 2024-09-10T08:44:36.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.436+0000 7fe41a67b640 1 -- 172.21.15.103:0/2620316389 wait complete. 2024-09-10T08:44:36.448 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":506,"stamp":"2024-09-10T08:44:35.061987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36141476,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":225,"num_read_kb":350,"num_write":3080803,"num_write_kb":38573613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":595349,"ondisk_log_size":595349,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7717728,"kb_used_data":72928,"kb_used_omap":12,"kb_used_meta":7644659,"kb_avail":747256992,"statfs":{"total":773094113280,"available":765191159808,"internally_reserved":0,"allocated":74678272,"data_stored":73201928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":7828131379},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":498,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003383"},"pg_stats":[{"pgid":"5.18","version":"27'4501","reported_seq":4523,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.380600+0000","last_change":"2024-09-10T08:28:47.627476+0000","last_active":"2024-09-10T08:44:29.380600+0000","last_peered":"2024-09-10T08:44:29.380600+0000","last_clean":"2024-09-10T08:44:29.380600+0000","last_became_active":"2024-09-10T08:28:47.627217+0000","last_became_peered":"2024-09-10T08:28:47.627217+0000","last_unstale":"2024-09-10T08:44:29.380600+0000","last_undegraded":"2024-09-10T08:44:29.380600+0000","last_fullsized":"2024-09-10T08:44:29.380600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":0,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:25.152836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23743,"num_write_kb":296073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"27'672","reported_seq":705,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:32.511067+0000","last_change":"2024-09-10T08:28:34.564816+0000","last_active":"2024-09-10T08:43:32.511067+0000","last_peered":"2024-09-10T08:43:32.511067+0000","last_clean":"2024-09-10T08:43:32.511067+0000","last_became_active":"2024-09-10T08:28:34.564545+0000","last_became_peered":"2024-09-10T08:28:34.564545+0000","last_unstale":"2024-09-10T08:43:32.511067+0000","last_undegraded":"2024-09-10T08:43:32.511067+0000","last_fullsized":"2024-09-10T08:43:32.511067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:34.365104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":670,"num_write_kb":4473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5460","reported_seq":5491,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.446984+0000","last_change":"2024-09-10T08:28:35.575267+0000","last_active":"2024-09-10T08:44:22.446984+0000","last_peered":"2024-09-10T08:44:22.446984+0000","last_clean":"2024-09-10T08:44:22.446984+0000","last_became_active":"2024-09-10T08:28:35.575019+0000","last_became_peered":"2024-09-10T08:28:35.575019+0000","last_unstale":"2024-09-10T08:44:22.446984+0000","last_undegraded":"2024-09-10T08:44:22.446984+0000","last_fullsized":"2024-09-10T08:44:22.446984+0000","mapping_epoch":19,"log_start":"27'200","ondisk_log_start":"27'200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5260,"log_dups_size":0,"ondisk_log_size":5260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:00.810645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28693,"num_write_kb":332310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:16.827314+0000","last_change":"2024-09-10T08:28:46.620227+0000","last_active":"2024-09-10T08:43:16.827314+0000","last_peered":"2024-09-10T08:43:16.827314+0000","last_clean":"2024-09-10T08:43:16.827314+0000","last_became_active":"2024-09-10T08:28:46.619540+0000","last_became_peered":"2024-09-10T08:28:46.619540+0000","last_unstale":"2024-09-10T08:43:16.827314+0000","last_undegraded":"2024-09-10T08:43:16.827314+0000","last_fullsized":"2024-09-10T08:43:16.827314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:13.402155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"27'5259","reported_seq":5281,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.450085+0000","last_change":"2024-09-10T08:28:47.633586+0000","last_active":"2024-09-10T08:44:29.450085+0000","last_peered":"2024-09-10T08:44:29.450085+0000","last_clean":"2024-09-10T08:44:29.450085+0000","last_became_active":"2024-09-10T08:28:47.633292+0000","last_became_peered":"2024-09-10T08:28:47.633292+0000","last_unstale":"2024-09-10T08:44:29.450085+0000","last_undegraded":"2024-09-10T08:44:29.450085+0000","last_fullsized":"2024-09-10T08:44:29.450085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5259,"log_dups_size":0,"ondisk_log_size":5259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:19.473028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27465,"num_write_kb":347758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"27'8","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.983363+0000","last_change":"2024-09-10T08:28:34.561691+0000","last_active":"2024-09-10T08:43:47.983363+0000","last_peered":"2024-09-10T08:43:47.983363+0000","last_clean":"2024-09-10T08:43:47.983363+0000","last_became_active":"2024-09-10T08:28:34.561410+0000","last_became_peered":"2024-09-10T08:28:34.561410+0000","last_unstale":"2024-09-10T08:43:47.983363+0000","last_undegraded":"2024-09-10T08:43:47.983363+0000","last_fullsized":"2024-09-10T08:43:47.983363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.629982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'5545","reported_seq":5576,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.505223+0000","last_change":"2024-09-10T08:28:35.579033+0000","last_active":"2024-09-10T08:44:22.505223+0000","last_peered":"2024-09-10T08:44:22.505223+0000","last_clean":"2024-09-10T08:44:22.505223+0000","last_became_active":"2024-09-10T08:28:35.578333+0000","last_became_peered":"2024-09-10T08:28:35.578333+0000","last_unstale":"2024-09-10T08:44:22.505223+0000","last_undegraded":"2024-09-10T08:44:22.505223+0000","last_fullsized":"2024-09-10T08:44:22.505223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5545,"log_dups_size":0,"ondisk_log_size":5545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:58.779491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29606,"num_write_kb":364444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:31.334990+0000","last_change":"2024-09-10T08:28:46.617317+0000","last_active":"2024-09-10T08:43:31.334990+0000","last_peered":"2024-09-10T08:43:31.334990+0000","last_clean":"2024-09-10T08:43:31.334990+0000","last_became_active":"2024-09-10T08:28:46.616806+0000","last_became_peered":"2024-09-10T08:28:46.616806+0000","last_unstale":"2024-09-10T08:43:31.334990+0000","last_undegraded":"2024-09-10T08:43:31.334990+0000","last_fullsized":"2024-09-10T08:43:31.334990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:46.916848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"27'4143","reported_seq":4165,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.444464+0000","last_change":"2024-09-10T08:28:47.633194+0000","last_active":"2024-09-10T08:44:29.444464+0000","last_peered":"2024-09-10T08:44:29.444464+0000","last_clean":"2024-09-10T08:44:29.444464+0000","last_became_active":"2024-09-10T08:28:47.632772+0000","last_became_peered":"2024-09-10T08:28:47.632772+0000","last_unstale":"2024-09-10T08:44:29.444464+0000","last_undegraded":"2024-09-10T08:44:29.444464+0000","last_fullsized":"2024-09-10T08:44:29.444464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4143,"log_dups_size":0,"ondisk_log_size":4143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:59.228438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21394,"num_write_kb":261850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"27'11","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.989437+0000","last_change":"2024-09-10T08:28:34.571965+0000","last_active":"2024-09-10T08:43:47.989437+0000","last_peered":"2024-09-10T08:43:47.989437+0000","last_clean":"2024-09-10T08:43:47.989437+0000","last_became_active":"2024-09-10T08:28:34.571640+0000","last_became_peered":"2024-09-10T08:28:34.571640+0000","last_unstale":"2024-09-10T08:43:47.989437+0000","last_undegraded":"2024-09-10T08:43:47.989437+0000","last_fullsized":"2024-09-10T08:43:47.989437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:53.047030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'3192","reported_seq":3222,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.520724+0000","last_change":"2024-09-10T08:28:35.562132+0000","last_active":"2024-09-10T08:44:22.520724+0000","last_peered":"2024-09-10T08:44:22.520724+0000","last_clean":"2024-09-10T08:44:22.520724+0000","last_became_active":"2024-09-10T08:28:35.561842+0000","last_became_peered":"2024-09-10T08:28:35.561842+0000","last_unstale":"2024-09-10T08:44:22.520724+0000","last_undegraded":"2024-09-10T08:44:22.520724+0000","last_fullsized":"2024-09-10T08:44:22.520724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3192,"log_dups_size":0,"ondisk_log_size":3192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:48.810258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15765,"num_write_kb":210601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'613","reported_seq":637,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:30.437035+0000","last_change":"2024-09-10T08:28:46.621093+0000","last_active":"2024-09-10T08:43:30.437035+0000","last_peered":"2024-09-10T08:43:30.437035+0000","last_clean":"2024-09-10T08:43:30.437035+0000","last_became_active":"2024-09-10T08:28:46.620794+0000","last_became_peered":"2024-09-10T08:28:46.620794+0000","last_unstale":"2024-09-10T08:43:30.437035+0000","last_undegraded":"2024-09-10T08:43:30.437035+0000","last_fullsized":"2024-09-10T08:43:30.437035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:20.501262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":611,"num_write_kb":4232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"27'3484","reported_seq":3506,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.377089+0000","last_change":"2024-09-10T08:28:47.627756+0000","last_active":"2024-09-10T08:44:29.377089+0000","last_peered":"2024-09-10T08:44:29.377089+0000","last_clean":"2024-09-10T08:44:29.377089+0000","last_became_active":"2024-09-10T08:28:47.627476+0000","last_became_peered":"2024-09-10T08:28:47.627476+0000","last_unstale":"2024-09-10T08:44:29.377089+0000","last_undegraded":"2024-09-10T08:44:29.377089+0000","last_fullsized":"2024-09-10T08:44:29.377089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:25.945793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18057,"num_write_kb":232111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"27'3","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:38.481193+0000","last_change":"2024-09-10T08:28:34.566560+0000","last_active":"2024-09-10T08:43:38.481193+0000","last_peered":"2024-09-10T08:43:38.481193+0000","last_clean":"2024-09-10T08:43:38.481193+0000","last_became_active":"2024-09-10T08:28:34.566275+0000","last_became_peered":"2024-09-10T08:28:34.566275+0000","last_unstale":"2024-09-10T08:43:38.481193+0000","last_undegraded":"2024-09-10T08:43:38.481193+0000","last_fullsized":"2024-09-10T08:43:38.481193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:03.507683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'5826","reported_seq":5841,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.521297+0000","last_change":"2024-09-10T08:29:35.097937+0000","last_active":"2024-09-10T08:44:22.521297+0000","last_peered":"2024-09-10T08:44:22.521297+0000","last_clean":"2024-09-10T08:44:22.521297+0000","last_became_active":"2024-09-10T08:29:35.097553+0000","last_became_peered":"2024-09-10T08:29:35.097553+0000","last_unstale":"2024-09-10T08:44:22.521297+0000","last_undegraded":"2024-09-10T08:44:22.521297+0000","last_fullsized":"2024-09-10T08:44:22.521297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5826,"log_dups_size":0,"ondisk_log_size":5826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:02.685992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30231,"num_write_kb":366977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"27'66","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.247916+0000","last_change":"2024-09-10T08:28:46.620162+0000","last_active":"2024-09-10T08:44:29.247916+0000","last_peered":"2024-09-10T08:44:29.247916+0000","last_clean":"2024-09-10T08:44:29.247916+0000","last_became_active":"2024-09-10T08:28:46.619889+0000","last_became_peered":"2024-09-10T08:28:46.619889+0000","last_unstale":"2024-09-10T08:44:29.247916+0000","last_undegraded":"2024-09-10T08:44:29.247916+0000","last_fullsized":"2024-09-10T08:44:29.247916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:13.820143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":755904,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"27'4988","reported_seq":5010,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.392676+0000","last_change":"2024-09-10T08:28:47.631094+0000","last_active":"2024-09-10T08:44:29.392676+0000","last_peered":"2024-09-10T08:44:29.392676+0000","last_clean":"2024-09-10T08:44:29.392676+0000","last_became_active":"2024-09-10T08:28:47.630787+0000","last_became_peered":"2024-09-10T08:28:47.630787+0000","last_unstale":"2024-09-10T08:44:29.392676+0000","last_undegraded":"2024-09-10T08:44:29.392676+0000","last_fullsized":"2024-09-10T08:44:29.392676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4988,"log_dups_size":0,"ondisk_log_size":4988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:06.277094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26081,"num_write_kb":317657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"27'4088","reported_seq":4119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.452804+0000","last_change":"2024-09-10T08:28:35.572478+0000","last_active":"2024-09-10T08:44:22.452804+0000","last_peered":"2024-09-10T08:44:22.452804+0000","last_clean":"2024-09-10T08:44:22.452804+0000","last_became_active":"2024-09-10T08:28:35.572215+0000","last_became_peered":"2024-09-10T08:28:35.572215+0000","last_unstale":"2024-09-10T08:44:22.452804+0000","last_undegraded":"2024-09-10T08:44:22.452804+0000","last_fullsized":"2024-09-10T08:44:22.452804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4088,"log_dups_size":0,"ondisk_log_size":4088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:40.397318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21444,"num_write_kb":270258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'1129","reported_seq":1162,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.009048+0000","last_change":"2024-09-10T08:28:34.569235+0000","last_active":"2024-09-10T08:43:48.009048+0000","last_peered":"2024-09-10T08:43:48.009048+0000","last_clean":"2024-09-10T08:43:48.009048+0000","last_became_active":"2024-09-10T08:28:34.568899+0000","last_became_peered":"2024-09-10T08:28:34.568899+0000","last_unstale":"2024-09-10T08:43:48.009048+0000","last_undegraded":"2024-09-10T08:43:48.009048+0000","last_fullsized":"2024-09-10T08:43:48.009048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1129,"log_dups_size":0,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:21.927656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:30.440512+0000","last_change":"2024-09-10T08:28:46.618502+0000","last_active":"2024-09-10T08:43:30.440512+0000","last_peered":"2024-09-10T08:43:30.440512+0000","last_clean":"2024-09-10T08:43:30.440512+0000","last_became_active":"2024-09-10T08:28:46.616824+0000","last_became_peered":"2024-09-10T08:28:46.616824+0000","last_unstale":"2024-09-10T08:43:30.440512+0000","last_undegraded":"2024-09-10T08:43:30.440512+0000","last_fullsized":"2024-09-10T08:43:30.440512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:06.554102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"27'4540","reported_seq":4563,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.406451+0000","last_change":"2024-09-10T08:28:47.627138+0000","last_active":"2024-09-10T08:44:29.406451+0000","last_peered":"2024-09-10T08:44:29.406451+0000","last_clean":"2024-09-10T08:44:29.406451+0000","last_became_active":"2024-09-10T08:28:47.626871+0000","last_became_peered":"2024-09-10T08:28:47.626871+0000","last_unstale":"2024-09-10T08:44:29.406451+0000","last_undegraded":"2024-09-10T08:44:29.406451+0000","last_fullsized":"2024-09-10T08:44:29.406451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4540,"log_dups_size":0,"ondisk_log_size":4540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:10.927283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23818,"num_write_kb":300351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"27'4200","reported_seq":4231,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.491988+0000","last_change":"2024-09-10T08:28:35.577024+0000","last_active":"2024-09-10T08:44:22.491988+0000","last_peered":"2024-09-10T08:44:22.491988+0000","last_clean":"2024-09-10T08:44:22.491988+0000","last_became_active":"2024-09-10T08:28:35.576771+0000","last_became_peered":"2024-09-10T08:28:35.576771+0000","last_unstale":"2024-09-10T08:44:22.491988+0000","last_undegraded":"2024-09-10T08:44:22.491988+0000","last_fullsized":"2024-09-10T08:44:22.491988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4200,"log_dups_size":0,"ondisk_log_size":4200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:07.162941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21158,"num_write_kb":256901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.001370+0000","last_change":"2024-09-10T08:28:34.561324+0000","last_active":"2024-09-10T08:43:48.001370+0000","last_peered":"2024-09-10T08:43:48.001370+0000","last_clean":"2024-09-10T08:43:48.001370+0000","last_became_active":"2024-09-10T08:28:34.560974+0000","last_became_peered":"2024-09-10T08:28:34.560974+0000","last_unstale":"2024-09-10T08:43:48.001370+0000","last_undegraded":"2024-09-10T08:43:48.001370+0000","last_fullsized":"2024-09-10T08:43:48.001370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:18.790965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.763262+0000","last_change":"2024-09-10T08:28:46.620411+0000","last_active":"2024-09-10T08:43:37.763262+0000","last_peered":"2024-09-10T08:43:37.763262+0000","last_clean":"2024-09-10T08:43:37.763262+0000","last_became_active":"2024-09-10T08:28:46.619553+0000","last_became_peered":"2024-09-10T08:28:46.619553+0000","last_unstale":"2024-09-10T08:43:37.763262+0000","last_undegraded":"2024-09-10T08:43:37.763262+0000","last_fullsized":"2024-09-10T08:43:37.763262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:04.414048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"27'4215","reported_seq":4237,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.402749+0000","last_change":"2024-09-10T08:28:47.628563+0000","last_active":"2024-09-10T08:44:29.402749+0000","last_peered":"2024-09-10T08:44:29.402749+0000","last_clean":"2024-09-10T08:44:29.402749+0000","last_became_active":"2024-09-10T08:28:47.628290+0000","last_became_peered":"2024-09-10T08:28:47.628290+0000","last_unstale":"2024-09-10T08:44:29.402749+0000","last_undegraded":"2024-09-10T08:44:29.402749+0000","last_fullsized":"2024-09-10T08:44:29.402749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:15.652718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21334,"num_write_kb":282217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'4711","reported_seq":4742,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.503605+0000","last_change":"2024-09-10T08:28:35.572363+0000","last_active":"2024-09-10T08:44:22.503605+0000","last_peered":"2024-09-10T08:44:22.503605+0000","last_clean":"2024-09-10T08:44:22.503605+0000","last_became_active":"2024-09-10T08:28:35.572108+0000","last_became_peered":"2024-09-10T08:28:35.572108+0000","last_unstale":"2024-09-10T08:44:22.503605+0000","last_undegraded":"2024-09-10T08:44:22.503605+0000","last_fullsized":"2024-09-10T08:44:22.503605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4711,"log_dups_size":0,"ondisk_log_size":4711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:48.358634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24668,"num_write_kb":303691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.969574+0000","last_change":"2024-09-10T08:28:34.564813+0000","last_active":"2024-09-10T08:43:47.969574+0000","last_peered":"2024-09-10T08:43:47.969574+0000","last_clean":"2024-09-10T08:43:47.969574+0000","last_became_active":"2024-09-10T08:28:34.564557+0000","last_became_peered":"2024-09-10T08:28:34.564557+0000","last_unstale":"2024-09-10T08:43:47.969574+0000","last_undegraded":"2024-09-10T08:43:47.969574+0000","last_fullsized":"2024-09-10T08:43:47.969574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:48.356069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.846008+0000","last_change":"2024-09-10T08:28:46.625346+0000","last_active":"2024-09-10T08:43:37.846008+0000","last_peered":"2024-09-10T08:43:37.846008+0000","last_clean":"2024-09-10T08:43:37.846008+0000","last_became_active":"2024-09-10T08:28:46.625059+0000","last_became_peered":"2024-09-10T08:28:46.625059+0000","last_unstale":"2024-09-10T08:43:37.846008+0000","last_undegraded":"2024-09-10T08:43:37.846008+0000","last_fullsized":"2024-09-10T08:43:37.846008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:44.512285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"27'5035","reported_seq":5057,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.447853+0000","last_change":"2024-09-10T08:28:47.621307+0000","last_active":"2024-09-10T08:44:29.447853+0000","last_peered":"2024-09-10T08:44:29.447853+0000","last_clean":"2024-09-10T08:44:29.447853+0000","last_became_active":"2024-09-10T08:28:47.621043+0000","last_became_peered":"2024-09-10T08:28:47.621043+0000","last_unstale":"2024-09-10T08:44:29.447853+0000","last_undegraded":"2024-09-10T08:44:29.447853+0000","last_fullsized":"2024-09-10T08:44:29.447853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5035,"log_dups_size":0,"ondisk_log_size":5035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:30.300108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25734,"num_write_kb":340789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"27'4207","reported_seq":4238,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.428180+0000","last_change":"2024-09-10T08:28:35.569938+0000","last_active":"2024-09-10T08:44:22.428180+0000","last_peered":"2024-09-10T08:44:22.428180+0000","last_clean":"2024-09-10T08:44:22.428180+0000","last_became_active":"2024-09-10T08:28:35.569109+0000","last_became_peered":"2024-09-10T08:28:35.569109+0000","last_unstale":"2024-09-10T08:44:22.428180+0000","last_undegraded":"2024-09-10T08:44:22.428180+0000","last_fullsized":"2024-09-10T08:44:22.428180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4207,"log_dups_size":0,"ondisk_log_size":4207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:51.680564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21000,"num_write_kb":276623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.000341+0000","last_change":"2024-09-10T08:28:34.571069+0000","last_active":"2024-09-10T08:43:48.000341+0000","last_peered":"2024-09-10T08:43:48.000341+0000","last_clean":"2024-09-10T08:43:48.000341+0000","last_became_active":"2024-09-10T08:28:34.570766+0000","last_became_peered":"2024-09-10T08:28:34.570766+0000","last_unstale":"2024-09-10T08:43:48.000341+0000","last_undegraded":"2024-09-10T08:43:48.000341+0000","last_fullsized":"2024-09-10T08:43:48.000341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:47.458195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.830412+0000","last_change":"2024-09-10T08:28:46.616531+0000","last_active":"2024-09-10T08:43:37.830412+0000","last_peered":"2024-09-10T08:43:37.830412+0000","last_clean":"2024-09-10T08:43:37.830412+0000","last_became_active":"2024-09-10T08:28:46.616254+0000","last_became_peered":"2024-09-10T08:28:46.616254+0000","last_unstale":"2024-09-10T08:43:37.830412+0000","last_undegraded":"2024-09-10T08:43:37.830412+0000","last_fullsized":"2024-09-10T08:43:37.830412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:44.162368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"27'4342","reported_seq":4365,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.372206+0000","last_change":"2024-09-10T08:28:47.628177+0000","last_active":"2024-09-10T08:44:29.372206+0000","last_peered":"2024-09-10T08:44:29.372206+0000","last_clean":"2024-09-10T08:44:29.372206+0000","last_became_active":"2024-09-10T08:28:47.627869+0000","last_became_peered":"2024-09-10T08:28:47.627869+0000","last_unstale":"2024-09-10T08:44:29.372206+0000","last_undegraded":"2024-09-10T08:44:29.372206+0000","last_fullsized":"2024-09-10T08:44:29.372206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:19.075558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23056,"num_write_kb":285008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"27'4228","reported_seq":4259,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.456227+0000","last_change":"2024-09-10T08:28:35.575106+0000","last_active":"2024-09-10T08:44:22.456227+0000","last_peered":"2024-09-10T08:44:22.456227+0000","last_clean":"2024-09-10T08:44:22.456227+0000","last_became_active":"2024-09-10T08:28:35.574815+0000","last_became_peered":"2024-09-10T08:28:35.574815+0000","last_unstale":"2024-09-10T08:44:22.456227+0000","last_undegraded":"2024-09-10T08:44:22.456227+0000","last_fullsized":"2024-09-10T08:44:22.456227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4228,"log_dups_size":0,"ondisk_log_size":4228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:26.512181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21299,"num_write_kb":257333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.990461+0000","last_change":"2024-09-10T08:28:34.564865+0000","last_active":"2024-09-10T08:43:47.990461+0000","last_peered":"2024-09-10T08:43:47.990461+0000","last_clean":"2024-09-10T08:43:47.990461+0000","last_became_active":"2024-09-10T08:28:34.564549+0000","last_became_peered":"2024-09-10T08:28:34.564549+0000","last_unstale":"2024-09-10T08:43:47.990461+0000","last_undegraded":"2024-09-10T08:43:47.990461+0000","last_fullsized":"2024-09-10T08:43:47.990461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:05.523637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'53","reported_seq":129,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:43.064352+0000","last_change":"2024-09-10T08:28:46.622505+0000","last_active":"2024-09-10T08:43:43.064352+0000","last_peered":"2024-09-10T08:43:43.064352+0000","last_clean":"2024-09-10T08:43:43.064352+0000","last_became_active":"2024-09-10T08:28:46.621052+0000","last_became_peered":"2024-09-10T08:28:46.621052+0000","last_unstale":"2024-09-10T08:43:43.064352+0000","last_undegraded":"2024-09-10T08:43:43.064352+0000","last_fullsized":"2024-09-10T08:43:43.064352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:37.411404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":121,"num_write":51,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"27'4494","reported_seq":4517,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.358623+0000","last_change":"2024-09-10T08:28:47.624919+0000","last_active":"2024-09-10T08:44:29.358623+0000","last_peered":"2024-09-10T08:44:29.358623+0000","last_clean":"2024-09-10T08:44:29.358623+0000","last_became_active":"2024-09-10T08:28:47.624651+0000","last_became_peered":"2024-09-10T08:28:47.624651+0000","last_unstale":"2024-09-10T08:44:29.358623+0000","last_undegraded":"2024-09-10T08:44:29.358623+0000","last_fullsized":"2024-09-10T08:44:29.358623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4494,"log_dups_size":0,"ondisk_log_size":4494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:11.049160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23585,"num_write_kb":291272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'4460","reported_seq":4491,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.508365+0000","last_change":"2024-09-10T08:28:35.574107+0000","last_active":"2024-09-10T08:44:22.508365+0000","last_peered":"2024-09-10T08:44:22.508365+0000","last_clean":"2024-09-10T08:44:22.508365+0000","last_became_active":"2024-09-10T08:28:35.573851+0000","last_became_peered":"2024-09-10T08:28:35.573851+0000","last_unstale":"2024-09-10T08:44:22.508365+0000","last_undegraded":"2024-09-10T08:44:22.508365+0000","last_fullsized":"2024-09-10T08:44:22.508365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4460,"log_dups_size":0,"ondisk_log_size":4460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:53.240223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22566,"num_write_kb":290967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'599","reported_seq":632,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.994651+0000","last_change":"2024-09-10T08:28:34.563451+0000","last_active":"2024-09-10T08:43:47.994651+0000","last_peered":"2024-09-10T08:43:47.994651+0000","last_clean":"2024-09-10T08:43:47.994651+0000","last_became_active":"2024-09-10T08:28:34.563259+0000","last_became_peered":"2024-09-10T08:28:34.563259+0000","last_unstale":"2024-09-10T08:43:47.994651+0000","last_undegraded":"2024-09-10T08:43:47.994651+0000","last_fullsized":"2024-09-10T08:43:47.994651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:44.899351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1430,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.807587+0000","last_change":"2024-09-10T08:28:46.623396+0000","last_active":"2024-09-10T08:43:37.807587+0000","last_peered":"2024-09-10T08:43:37.807587+0000","last_clean":"2024-09-10T08:43:37.807587+0000","last_became_active":"2024-09-10T08:28:46.623139+0000","last_became_peered":"2024-09-10T08:28:46.623139+0000","last_unstale":"2024-09-10T08:43:37.807587+0000","last_undegraded":"2024-09-10T08:43:37.807587+0000","last_fullsized":"2024-09-10T08:43:37.807587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:00.210413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"27'4787","reported_seq":4810,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.341999+0000","last_change":"2024-09-10T08:28:47.634754+0000","last_active":"2024-09-10T08:44:29.341999+0000","last_peered":"2024-09-10T08:44:29.341999+0000","last_clean":"2024-09-10T08:44:29.341999+0000","last_became_active":"2024-09-10T08:28:47.634382+0000","last_became_peered":"2024-09-10T08:28:47.634382+0000","last_unstale":"2024-09-10T08:44:29.341999+0000","last_undegraded":"2024-09-10T08:44:29.341999+0000","last_fullsized":"2024-09-10T08:44:29.341999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4787,"log_dups_size":0,"ondisk_log_size":4787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:23.489596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24922,"num_write_kb":313092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"27'4927","reported_seq":4958,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.461013+0000","last_change":"2024-09-10T08:28:35.567481+0000","last_active":"2024-09-10T08:44:22.461013+0000","last_peered":"2024-09-10T08:44:22.461013+0000","last_clean":"2024-09-10T08:44:22.461013+0000","last_became_active":"2024-09-10T08:28:35.567167+0000","last_became_peered":"2024-09-10T08:28:35.567167+0000","last_unstale":"2024-09-10T08:44:22.461013+0000","last_undegraded":"2024-09-10T08:44:22.461013+0000","last_fullsized":"2024-09-10T08:44:22.461013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4927,"log_dups_size":0,"ondisk_log_size":4927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:44.110012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25981,"num_write_kb":313006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.989517+0000","last_change":"2024-09-10T08:28:34.571283+0000","last_active":"2024-09-10T08:43:47.989517+0000","last_peered":"2024-09-10T08:43:47.989517+0000","last_clean":"2024-09-10T08:43:47.989517+0000","last_became_active":"2024-09-10T08:28:34.570791+0000","last_became_peered":"2024-09-10T08:28:34.570791+0000","last_unstale":"2024-09-10T08:43:47.989517+0000","last_undegraded":"2024-09-10T08:43:47.989517+0000","last_fullsized":"2024-09-10T08:43:47.989517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:17.427597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:41:21.022972+0000","last_change":"2024-09-10T08:28:46.630983+0000","last_active":"2024-09-10T08:41:21.022972+0000","last_peered":"2024-09-10T08:41:21.022972+0000","last_clean":"2024-09-10T08:41:21.022972+0000","last_became_active":"2024-09-10T08:28:46.630658+0000","last_became_peered":"2024-09-10T08:28:46.630658+0000","last_unstale":"2024-09-10T08:41:21.022972+0000","last_undegraded":"2024-09-10T08:41:21.022972+0000","last_fullsized":"2024-09-10T08:41:21.022972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:11.219022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"27'4308","reported_seq":4331,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.418231+0000","last_change":"2024-09-10T08:28:47.625475+0000","last_active":"2024-09-10T08:44:29.418231+0000","last_peered":"2024-09-10T08:44:29.418231+0000","last_clean":"2024-09-10T08:44:29.418231+0000","last_became_active":"2024-09-10T08:28:47.625186+0000","last_became_peered":"2024-09-10T08:28:47.625186+0000","last_unstale":"2024-09-10T08:44:29.418231+0000","last_undegraded":"2024-09-10T08:44:29.418231+0000","last_fullsized":"2024-09-10T08:44:29.418231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4308,"log_dups_size":0,"ondisk_log_size":4308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:15.932769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23330,"num_write_kb":286070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'4301","reported_seq":4332,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.444485+0000","last_change":"2024-09-10T08:28:35.576280+0000","last_active":"2024-09-10T08:44:22.444485+0000","last_peered":"2024-09-10T08:44:22.444485+0000","last_clean":"2024-09-10T08:44:22.444485+0000","last_became_active":"2024-09-10T08:28:35.576002+0000","last_became_peered":"2024-09-10T08:28:35.576002+0000","last_unstale":"2024-09-10T08:44:22.444485+0000","last_undegraded":"2024-09-10T08:44:22.444485+0000","last_fullsized":"2024-09-10T08:44:22.444485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4301,"log_dups_size":0,"ondisk_log_size":4301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:46.278441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22897,"num_write_kb":271992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.974079+0000","last_change":"2024-09-10T08:28:34.555212+0000","last_active":"2024-09-10T08:43:47.974079+0000","last_peered":"2024-09-10T08:43:47.974079+0000","last_clean":"2024-09-10T08:43:47.974079+0000","last_became_active":"2024-09-10T08:28:34.554922+0000","last_became_peered":"2024-09-10T08:28:34.554922+0000","last_unstale":"2024-09-10T08:43:47.974079+0000","last_undegraded":"2024-09-10T08:43:47.974079+0000","last_fullsized":"2024-09-10T08:43:47.974079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.824479+0000","last_change":"2024-09-10T08:28:46.624886+0000","last_active":"2024-09-10T08:43:37.824479+0000","last_peered":"2024-09-10T08:43:37.824479+0000","last_clean":"2024-09-10T08:43:37.824479+0000","last_became_active":"2024-09-10T08:28:46.624690+0000","last_became_peered":"2024-09-10T08:28:46.624690+0000","last_unstale":"2024-09-10T08:43:37.824479+0000","last_undegraded":"2024-09-10T08:43:37.824479+0000","last_fullsized":"2024-09-10T08:43:37.824479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:15.023379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"27'4253","reported_seq":4276,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.376801+0000","last_change":"2024-09-10T08:28:47.634161+0000","last_active":"2024-09-10T08:44:29.376801+0000","last_peered":"2024-09-10T08:44:29.376801+0000","last_clean":"2024-09-10T08:44:29.376801+0000","last_became_active":"2024-09-10T08:28:47.633893+0000","last_became_peered":"2024-09-10T08:28:47.633893+0000","last_unstale":"2024-09-10T08:44:29.376801+0000","last_undegraded":"2024-09-10T08:44:29.376801+0000","last_fullsized":"2024-09-10T08:44:29.376801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4253,"log_dups_size":0,"ondisk_log_size":4253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:37.072370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22807,"num_write_kb":271856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'4548","reported_seq":4579,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.464810+0000","last_change":"2024-09-10T08:28:35.577978+0000","last_active":"2024-09-10T08:44:22.464810+0000","last_peered":"2024-09-10T08:44:22.464810+0000","last_clean":"2024-09-10T08:44:22.464810+0000","last_became_active":"2024-09-10T08:28:35.577718+0000","last_became_peered":"2024-09-10T08:28:35.577718+0000","last_unstale":"2024-09-10T08:44:22.464810+0000","last_undegraded":"2024-09-10T08:44:22.464810+0000","last_fullsized":"2024-09-10T08:44:22.464810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4548,"log_dups_size":0,"ondisk_log_size":4548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:01:57.257817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24326,"num_write_kb":290026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.003029+0000","last_change":"2024-09-10T08:28:34.553983+0000","last_active":"2024-09-10T08:43:48.003029+0000","last_peered":"2024-09-10T08:43:48.003029+0000","last_clean":"2024-09-10T08:43:48.003029+0000","last_became_active":"2024-09-10T08:28:34.553693+0000","last_became_peered":"2024-09-10T08:28:34.553693+0000","last_unstale":"2024-09-10T08:43:48.003029+0000","last_undegraded":"2024-09-10T08:43:48.003029+0000","last_fullsized":"2024-09-10T08:43:48.003029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:40.001685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.780271+0000","last_change":"2024-09-10T08:28:46.620165+0000","last_active":"2024-09-10T08:43:37.780271+0000","last_peered":"2024-09-10T08:43:37.780271+0000","last_clean":"2024-09-10T08:43:37.780271+0000","last_became_active":"2024-09-10T08:28:46.619853+0000","last_became_peered":"2024-09-10T08:28:46.619853+0000","last_unstale":"2024-09-10T08:43:37.780271+0000","last_undegraded":"2024-09-10T08:43:37.780271+0000","last_fullsized":"2024-09-10T08:43:37.780271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:36.006532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'3675","reported_seq":3698,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.383338+0000","last_change":"2024-09-10T08:28:47.621588+0000","last_active":"2024-09-10T08:44:29.383338+0000","last_peered":"2024-09-10T08:44:29.383338+0000","last_clean":"2024-09-10T08:44:29.383338+0000","last_became_active":"2024-09-10T08:28:47.621122+0000","last_became_peered":"2024-09-10T08:28:47.621122+0000","last_unstale":"2024-09-10T08:44:29.383338+0000","last_undegraded":"2024-09-10T08:44:29.383338+0000","last_fullsized":"2024-09-10T08:44:29.383338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3675,"log_dups_size":0,"ondisk_log_size":3675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:11.250838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18710,"num_write_kb":246893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'4629","reported_seq":4660,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.445596+0000","last_change":"2024-09-10T08:28:35.566745+0000","last_active":"2024-09-10T08:44:22.445596+0000","last_peered":"2024-09-10T08:44:22.445596+0000","last_clean":"2024-09-10T08:44:22.445596+0000","last_became_active":"2024-09-10T08:28:35.566444+0000","last_became_peered":"2024-09-10T08:28:35.566444+0000","last_unstale":"2024-09-10T08:44:22.445596+0000","last_undegraded":"2024-09-10T08:44:22.445596+0000","last_fullsized":"2024-09-10T08:44:22.445596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4629,"log_dups_size":0,"ondisk_log_size":4629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:52.735296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24423,"num_write_kb":290556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'60","reported_seq":151,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:38.178514+0000","last_change":"2024-09-10T08:28:34.560745+0000","last_active":"2024-09-10T08:43:38.178514+0000","last_peered":"2024-09-10T08:43:38.178514+0000","last_clean":"2024-09-10T08:43:38.178514+0000","last_became_active":"2024-09-10T08:28:34.559911+0000","last_became_peered":"2024-09-10T08:28:34.559911+0000","last_unstale":"2024-09-10T08:43:38.178514+0000","last_undegraded":"2024-09-10T08:43:38.178514+0000","last_fullsized":"2024-09-10T08:43:38.178514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:00.234067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":129,"num_write":58,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.785296+0000","last_change":"2024-09-10T08:28:46.623886+0000","last_active":"2024-09-10T08:43:37.785296+0000","last_peered":"2024-09-10T08:43:37.785296+0000","last_clean":"2024-09-10T08:43:37.785296+0000","last_became_active":"2024-09-10T08:28:46.622790+0000","last_became_peered":"2024-09-10T08:28:46.622790+0000","last_unstale":"2024-09-10T08:43:37.785296+0000","last_undegraded":"2024-09-10T08:43:37.785296+0000","last_fullsized":"2024-09-10T08:43:37.785296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:06:32.333116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"27'4388","reported_seq":4411,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.440297+0000","last_change":"2024-09-10T08:28:47.634500+0000","last_active":"2024-09-10T08:44:29.440297+0000","last_peered":"2024-09-10T08:44:29.440297+0000","last_clean":"2024-09-10T08:44:29.440297+0000","last_became_active":"2024-09-10T08:28:47.634219+0000","last_became_peered":"2024-09-10T08:28:47.634219+0000","last_unstale":"2024-09-10T08:44:29.440297+0000","last_undegraded":"2024-09-10T08:44:29.440297+0000","last_fullsized":"2024-09-10T08:44:29.440297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4388,"log_dups_size":0,"ondisk_log_size":4388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:59.689554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22741,"num_write_kb":291819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"27'4638","reported_seq":4669,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.452749+0000","last_change":"2024-09-10T08:28:35.576360+0000","last_active":"2024-09-10T08:44:22.452749+0000","last_peered":"2024-09-10T08:44:22.452749+0000","last_clean":"2024-09-10T08:44:22.452749+0000","last_became_active":"2024-09-10T08:28:35.576096+0000","last_became_peered":"2024-09-10T08:28:35.576096+0000","last_unstale":"2024-09-10T08:44:22.452749+0000","last_undegraded":"2024-09-10T08:44:22.452749+0000","last_fullsized":"2024-09-10T08:44:22.452749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4638,"log_dups_size":0,"ondisk_log_size":4638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:34.159275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24206,"num_write_kb":293700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.002633+0000","last_change":"2024-09-10T08:28:34.568477+0000","last_active":"2024-09-10T08:43:48.002633+0000","last_peered":"2024-09-10T08:43:48.002633+0000","last_clean":"2024-09-10T08:43:48.002633+0000","last_became_active":"2024-09-10T08:28:34.568249+0000","last_became_peered":"2024-09-10T08:28:34.568249+0000","last_unstale":"2024-09-10T08:43:48.002633+0000","last_undegraded":"2024-09-10T08:43:48.002633+0000","last_fullsized":"2024-09-10T08:43:48.002633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:08.640043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'605","reported_seq":630,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:42.810957+0000","last_change":"2024-09-10T08:28:46.621567+0000","last_active":"2024-09-10T08:43:42.810957+0000","last_peered":"2024-09-10T08:43:42.810957+0000","last_clean":"2024-09-10T08:43:42.810957+0000","last_became_active":"2024-09-10T08:28:46.621272+0000","last_became_peered":"2024-09-10T08:28:46.621272+0000","last_unstale":"2024-09-10T08:43:42.810957+0000","last_undegraded":"2024-09-10T08:43:42.810957+0000","last_fullsized":"2024-09-10T08:43:42.810957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:37:34.936213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1451,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"27'4536","reported_seq":4559,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.455805+0000","last_change":"2024-09-10T08:28:47.631621+0000","last_active":"2024-09-10T08:44:29.455805+0000","last_peered":"2024-09-10T08:44:29.455805+0000","last_clean":"2024-09-10T08:44:29.455805+0000","last_became_active":"2024-09-10T08:28:47.631337+0000","last_became_peered":"2024-09-10T08:28:47.631337+0000","last_unstale":"2024-09-10T08:44:29.455805+0000","last_undegraded":"2024-09-10T08:44:29.455805+0000","last_fullsized":"2024-09-10T08:44:29.455805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4536,"log_dups_size":0,"ondisk_log_size":4536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:04.196705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23763,"num_write_kb":304142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"27'4950","reported_seq":4981,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.485120+0000","last_change":"2024-09-10T08:28:35.572658+0000","last_active":"2024-09-10T08:44:22.485120+0000","last_peered":"2024-09-10T08:44:22.485120+0000","last_clean":"2024-09-10T08:44:22.485120+0000","last_became_active":"2024-09-10T08:28:35.571611+0000","last_became_peered":"2024-09-10T08:28:35.571611+0000","last_unstale":"2024-09-10T08:44:22.485120+0000","last_undegraded":"2024-09-10T08:44:22.485120+0000","last_fullsized":"2024-09-10T08:44:22.485120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4950,"log_dups_size":0,"ondisk_log_size":4950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:42.726996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25652,"num_write_kb":316024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:41:05.971983+0000","last_change":"2024-09-10T08:28:34.555587+0000","last_active":"2024-09-10T08:41:05.971983+0000","last_peered":"2024-09-10T08:41:05.971983+0000","last_clean":"2024-09-10T08:41:05.971983+0000","last_became_active":"2024-09-10T08:28:34.555269+0000","last_became_peered":"2024-09-10T08:28:34.555269+0000","last_unstale":"2024-09-10T08:41:05.971983+0000","last_undegraded":"2024-09-10T08:41:05.971983+0000","last_fullsized":"2024-09-10T08:41:05.971983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:19.499870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":190,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:42:26.593595+0000","last_change":"2024-09-10T08:28:26.724394+0000","last_active":"2024-09-10T08:42:26.593595+0000","last_peered":"2024-09-10T08:42:26.593595+0000","last_clean":"2024-09-10T08:42:26.593595+0000","last_became_active":"2024-09-10T08:28:26.723452+0000","last_became_peered":"2024-09-10T08:28:26.723452+0000","last_unstale":"2024-09-10T08:42:26.593595+0000","last_undegraded":"2024-09-10T08:42:26.593595+0000","last_fullsized":"2024-09-10T08:42:26.593595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_clean_scrub_stamp":"2024-09-10T08:28:25.445753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:00.811505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.779193+0000","last_change":"2024-09-10T08:28:46.622048+0000","last_active":"2024-09-10T08:43:37.779193+0000","last_peered":"2024-09-10T08:43:37.779193+0000","last_clean":"2024-09-10T08:43:37.779193+0000","last_became_active":"2024-09-10T08:28:46.621770+0000","last_became_peered":"2024-09-10T08:28:46.621770+0000","last_unstale":"2024-09-10T08:43:37.779193+0000","last_undegraded":"2024-09-10T08:43:37.779193+0000","last_fullsized":"2024-09-10T08:43:37.779193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:51.430760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"27'3353","reported_seq":3376,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.382825+0000","last_change":"2024-09-10T08:28:47.620746+0000","last_active":"2024-09-10T08:44:29.382825+0000","last_peered":"2024-09-10T08:44:29.382825+0000","last_clean":"2024-09-10T08:44:29.382825+0000","last_became_active":"2024-09-10T08:28:47.620492+0000","last_became_peered":"2024-09-10T08:28:47.620492+0000","last_unstale":"2024-09-10T08:44:29.382825+0000","last_undegraded":"2024-09-10T08:44:29.382825+0000","last_fullsized":"2024-09-10T08:44:29.382825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3353,"log_dups_size":0,"ondisk_log_size":3353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:40.117978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16947,"num_write_kb":239873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'4450","reported_seq":4481,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.537803+0000","last_change":"2024-09-10T08:28:35.574532+0000","last_active":"2024-09-10T08:44:22.537803+0000","last_peered":"2024-09-10T08:44:22.537803+0000","last_clean":"2024-09-10T08:44:22.537803+0000","last_became_active":"2024-09-10T08:28:35.574215+0000","last_became_peered":"2024-09-10T08:28:35.574215+0000","last_unstale":"2024-09-10T08:44:22.537803+0000","last_undegraded":"2024-09-10T08:44:22.537803+0000","last_fullsized":"2024-09-10T08:44:22.537803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4450,"log_dups_size":0,"ondisk_log_size":4450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:28.455653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23087,"num_write_kb":297343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:35.033572+0000","last_change":"2024-09-10T08:28:34.559911+0000","last_active":"2024-09-10T08:43:35.033572+0000","last_peered":"2024-09-10T08:43:35.033572+0000","last_clean":"2024-09-10T08:43:35.033572+0000","last_became_active":"2024-09-10T08:28:34.559635+0000","last_became_peered":"2024-09-10T08:28:34.559635+0000","last_unstale":"2024-09-10T08:43:35.033572+0000","last_undegraded":"2024-09-10T08:43:35.033572+0000","last_fullsized":"2024-09-10T08:43:35.033572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:40.892609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.843424+0000","last_change":"2024-09-10T08:28:46.620352+0000","last_active":"2024-09-10T08:43:37.843424+0000","last_peered":"2024-09-10T08:43:37.843424+0000","last_clean":"2024-09-10T08:43:37.843424+0000","last_became_active":"2024-09-10T08:28:46.620064+0000","last_became_peered":"2024-09-10T08:28:46.620064+0000","last_unstale":"2024-09-10T08:43:37.843424+0000","last_undegraded":"2024-09-10T08:43:37.843424+0000","last_fullsized":"2024-09-10T08:43:37.843424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:59.333579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"27'3678","reported_seq":3701,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.377144+0000","last_change":"2024-09-10T08:28:47.620305+0000","last_active":"2024-09-10T08:44:29.377144+0000","last_peered":"2024-09-10T08:44:29.377144+0000","last_clean":"2024-09-10T08:44:29.377144+0000","last_became_active":"2024-09-10T08:28:47.620014+0000","last_became_peered":"2024-09-10T08:28:47.620014+0000","last_unstale":"2024-09-10T08:44:29.377144+0000","last_undegraded":"2024-09-10T08:44:29.377144+0000","last_fullsized":"2024-09-10T08:44:29.377144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3678,"log_dups_size":0,"ondisk_log_size":3678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:44.916136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19171,"num_write_kb":261286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'5065","reported_seq":5096,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.514606+0000","last_change":"2024-09-10T08:28:35.577124+0000","last_active":"2024-09-10T08:44:22.514606+0000","last_peered":"2024-09-10T08:44:22.514606+0000","last_clean":"2024-09-10T08:44:22.514606+0000","last_became_active":"2024-09-10T08:28:35.576655+0000","last_became_peered":"2024-09-10T08:28:35.576655+0000","last_unstale":"2024-09-10T08:44:22.514606+0000","last_undegraded":"2024-09-10T08:44:22.514606+0000","last_fullsized":"2024-09-10T08:44:22.514606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5065,"log_dups_size":0,"ondisk_log_size":5065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:29.878600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26367,"num_write_kb":318681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:35.039309+0000","last_change":"2024-09-10T08:28:34.560694+0000","last_active":"2024-09-10T08:43:35.039309+0000","last_peered":"2024-09-10T08:43:35.039309+0000","last_clean":"2024-09-10T08:43:35.039309+0000","last_became_active":"2024-09-10T08:28:34.560429+0000","last_became_peered":"2024-09-10T08:28:34.560429+0000","last_unstale":"2024-09-10T08:43:35.039309+0000","last_undegraded":"2024-09-10T08:43:35.039309+0000","last_fullsized":"2024-09-10T08:43:35.039309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:54.514467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'1099","reported_seq":1123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.786510+0000","last_change":"2024-09-10T08:28:46.622232+0000","last_active":"2024-09-10T08:43:37.786510+0000","last_peered":"2024-09-10T08:43:37.786510+0000","last_clean":"2024-09-10T08:43:37.786510+0000","last_became_active":"2024-09-10T08:28:46.621966+0000","last_became_peered":"2024-09-10T08:28:46.621966+0000","last_unstale":"2024-09-10T08:43:37.786510+0000","last_undegraded":"2024-09-10T08:43:37.786510+0000","last_fullsized":"2024-09-10T08:43:37.786510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1099,"log_dups_size":0,"ondisk_log_size":1099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:28.897045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1090,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"27'4366","reported_seq":4389,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.312771+0000","last_change":"2024-09-10T08:28:47.630602+0000","last_active":"2024-09-10T08:44:29.312771+0000","last_peered":"2024-09-10T08:44:29.312771+0000","last_clean":"2024-09-10T08:44:29.312771+0000","last_became_active":"2024-09-10T08:28:47.630234+0000","last_became_peered":"2024-09-10T08:28:47.630234+0000","last_unstale":"2024-09-10T08:44:29.312771+0000","last_undegraded":"2024-09-10T08:44:29.312771+0000","last_fullsized":"2024-09-10T08:44:29.312771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4366,"log_dups_size":0,"ondisk_log_size":4366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:03.808098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22466,"num_write_kb":282639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"27'5771","reported_seq":5802,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.572787+0000","last_change":"2024-09-10T08:28:35.577577+0000","last_active":"2024-09-10T08:44:22.572787+0000","last_peered":"2024-09-10T08:44:22.572787+0000","last_clean":"2024-09-10T08:44:22.572787+0000","last_became_active":"2024-09-10T08:28:35.576686+0000","last_became_peered":"2024-09-10T08:28:35.576686+0000","last_unstale":"2024-09-10T08:44:22.572787+0000","last_undegraded":"2024-09-10T08:44:22.572787+0000","last_fullsized":"2024-09-10T08:44:22.572787+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5671,"log_dups_size":0,"ondisk_log_size":5671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:36.334494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29457,"num_write_kb":355657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'6","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.996141+0000","last_change":"2024-09-10T08:28:34.560313+0000","last_active":"2024-09-10T08:43:47.996141+0000","last_peered":"2024-09-10T08:43:47.996141+0000","last_clean":"2024-09-10T08:43:47.996141+0000","last_became_active":"2024-09-10T08:28:34.560035+0000","last_became_peered":"2024-09-10T08:28:34.560035+0000","last_unstale":"2024-09-10T08:43:47.996141+0000","last_undegraded":"2024-09-10T08:43:47.996141+0000","last_fullsized":"2024-09-10T08:43:47.996141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:56.945537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.793333+0000","last_change":"2024-09-10T08:28:46.623371+0000","last_active":"2024-09-10T08:43:37.793333+0000","last_peered":"2024-09-10T08:43:37.793333+0000","last_clean":"2024-09-10T08:43:37.793333+0000","last_became_active":"2024-09-10T08:28:46.623092+0000","last_became_peered":"2024-09-10T08:28:46.623092+0000","last_unstale":"2024-09-10T08:43:37.793333+0000","last_undegraded":"2024-09-10T08:43:37.793333+0000","last_fullsized":"2024-09-10T08:43:37.793333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:36.359127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"27'4470","reported_seq":4493,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.335120+0000","last_change":"2024-09-10T08:28:47.619805+0000","last_active":"2024-09-10T08:44:29.335120+0000","last_peered":"2024-09-10T08:44:29.335120+0000","last_clean":"2024-09-10T08:44:29.335120+0000","last_became_active":"2024-09-10T08:28:47.619452+0000","last_became_peered":"2024-09-10T08:28:47.619452+0000","last_unstale":"2024-09-10T08:44:29.335120+0000","last_undegraded":"2024-09-10T08:44:29.335120+0000","last_fullsized":"2024-09-10T08:44:29.335120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4470,"log_dups_size":0,"ondisk_log_size":4470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:20.052707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23926,"num_write_kb":300839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"27'4014","reported_seq":4045,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.536870+0000","last_change":"2024-09-10T08:28:35.577476+0000","last_active":"2024-09-10T08:44:22.536870+0000","last_peered":"2024-09-10T08:44:22.536870+0000","last_clean":"2024-09-10T08:44:22.536870+0000","last_became_active":"2024-09-10T08:28:35.576786+0000","last_became_peered":"2024-09-10T08:28:35.576786+0000","last_unstale":"2024-09-10T08:44:22.536870+0000","last_undegraded":"2024-09-10T08:44:22.536870+0000","last_fullsized":"2024-09-10T08:44:22.536870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4014,"log_dups_size":0,"ondisk_log_size":4014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:46.914074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19823,"num_write_kb":276089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.005418+0000","last_change":"2024-09-10T08:28:34.551102+0000","last_active":"2024-09-10T08:43:48.005418+0000","last_peered":"2024-09-10T08:43:48.005418+0000","last_clean":"2024-09-10T08:43:48.005418+0000","last_became_active":"2024-09-10T08:28:34.550773+0000","last_became_peered":"2024-09-10T08:28:34.550773+0000","last_unstale":"2024-09-10T08:43:48.005418+0000","last_undegraded":"2024-09-10T08:43:48.005418+0000","last_fullsized":"2024-09-10T08:43:48.005418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:35.393695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.815410+0000","last_change":"2024-09-10T08:28:46.619639+0000","last_active":"2024-09-10T08:43:37.815410+0000","last_peered":"2024-09-10T08:43:37.815410+0000","last_clean":"2024-09-10T08:43:37.815410+0000","last_became_active":"2024-09-10T08:28:46.619330+0000","last_became_peered":"2024-09-10T08:28:46.619330+0000","last_unstale":"2024-09-10T08:43:37.815410+0000","last_undegraded":"2024-09-10T08:43:37.815410+0000","last_fullsized":"2024-09-10T08:43:37.815410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:10.371693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"27'3797","reported_seq":3819,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.367348+0000","last_change":"2024-09-10T08:28:47.633627+0000","last_active":"2024-09-10T08:44:29.367348+0000","last_peered":"2024-09-10T08:44:29.367348+0000","last_clean":"2024-09-10T08:44:29.367348+0000","last_became_active":"2024-09-10T08:28:47.633362+0000","last_became_peered":"2024-09-10T08:28:47.633362+0000","last_unstale":"2024-09-10T08:44:29.367348+0000","last_undegraded":"2024-09-10T08:44:29.367348+0000","last_fullsized":"2024-09-10T08:44:29.367348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3797,"log_dups_size":0,"ondisk_log_size":3797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:19.473028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19693,"num_write_kb":255099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"27'4998","reported_seq":5028,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.499387+0000","last_change":"2024-09-10T08:28:35.575307+0000","last_active":"2024-09-10T08:44:22.499387+0000","last_peered":"2024-09-10T08:44:22.499387+0000","last_clean":"2024-09-10T08:44:22.499387+0000","last_became_active":"2024-09-10T08:28:35.575038+0000","last_became_peered":"2024-09-10T08:28:35.575038+0000","last_unstale":"2024-09-10T08:44:22.499387+0000","last_undegraded":"2024-09-10T08:44:22.499387+0000","last_fullsized":"2024-09-10T08:44:22.499387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4998,"log_dups_size":0,"ondisk_log_size":4998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:36.478822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25962,"num_write_kb":304804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'11","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.948250+0000","last_change":"2024-09-10T08:28:34.555542+0000","last_active":"2024-09-10T08:43:47.948250+0000","last_peered":"2024-09-10T08:43:47.948250+0000","last_clean":"2024-09-10T08:43:47.948250+0000","last_became_active":"2024-09-10T08:28:34.555179+0000","last_became_peered":"2024-09-10T08:28:34.555179+0000","last_unstale":"2024-09-10T08:43:47.948250+0000","last_undegraded":"2024-09-10T08:43:47.948250+0000","last_fullsized":"2024-09-10T08:43:47.948250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:53.313161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.799350+0000","last_change":"2024-09-10T08:28:46.618615+0000","last_active":"2024-09-10T08:43:37.799350+0000","last_peered":"2024-09-10T08:43:37.799350+0000","last_clean":"2024-09-10T08:43:37.799350+0000","last_became_active":"2024-09-10T08:28:46.618318+0000","last_became_peered":"2024-09-10T08:28:46.618318+0000","last_unstale":"2024-09-10T08:43:37.799350+0000","last_undegraded":"2024-09-10T08:43:37.799350+0000","last_fullsized":"2024-09-10T08:43:37.799350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:44:08.185748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"27'4510","reported_seq":4532,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.460057+0000","last_change":"2024-09-10T08:28:47.625025+0000","last_active":"2024-09-10T08:44:29.460057+0000","last_peered":"2024-09-10T08:44:29.460057+0000","last_clean":"2024-09-10T08:44:29.460057+0000","last_became_active":"2024-09-10T08:28:47.624230+0000","last_became_peered":"2024-09-10T08:28:47.624230+0000","last_unstale":"2024-09-10T08:44:29.460057+0000","last_undegraded":"2024-09-10T08:44:29.460057+0000","last_fullsized":"2024-09-10T08:44:29.460057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4510,"log_dups_size":0,"ondisk_log_size":4510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:25.530264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23053,"num_write_kb":297434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'5001","reported_seq":5031,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.475930+0000","last_change":"2024-09-10T08:28:35.578892+0000","last_active":"2024-09-10T08:44:22.475930+0000","last_peered":"2024-09-10T08:44:22.475930+0000","last_clean":"2024-09-10T08:44:22.475930+0000","last_became_active":"2024-09-10T08:28:35.578299+0000","last_became_peered":"2024-09-10T08:28:35.578299+0000","last_unstale":"2024-09-10T08:44:22.475930+0000","last_undegraded":"2024-09-10T08:44:22.475930+0000","last_fullsized":"2024-09-10T08:44:22.475930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5001,"log_dups_size":0,"ondisk_log_size":5001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:27.485392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25723,"num_write_kb":320130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'6","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.992918+0000","last_change":"2024-09-10T08:28:34.560444+0000","last_active":"2024-09-10T08:43:47.992918+0000","last_peered":"2024-09-10T08:43:47.992918+0000","last_clean":"2024-09-10T08:43:47.992918+0000","last_became_active":"2024-09-10T08:28:34.560188+0000","last_became_peered":"2024-09-10T08:28:34.560188+0000","last_unstale":"2024-09-10T08:43:47.992918+0000","last_undegraded":"2024-09-10T08:43:47.992918+0000","last_fullsized":"2024-09-10T08:43:47.992918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:15.727780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:16.827380+0000","last_change":"2024-09-10T08:28:46.623483+0000","last_active":"2024-09-10T08:43:16.827380+0000","last_peered":"2024-09-10T08:43:16.827380+0000","last_clean":"2024-09-10T08:43:16.827380+0000","last_became_active":"2024-09-10T08:28:46.623211+0000","last_became_peered":"2024-09-10T08:28:46.623211+0000","last_unstale":"2024-09-10T08:43:16.827380+0000","last_undegraded":"2024-09-10T08:43:16.827380+0000","last_fullsized":"2024-09-10T08:43:16.827380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:24.611015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"27'4287","reported_seq":4309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.418397+0000","last_change":"2024-09-10T08:28:47.635185+0000","last_active":"2024-09-10T08:44:29.418397+0000","last_peered":"2024-09-10T08:44:29.418397+0000","last_clean":"2024-09-10T08:44:29.418397+0000","last_became_active":"2024-09-10T08:28:47.634782+0000","last_became_peered":"2024-09-10T08:28:47.634782+0000","last_unstale":"2024-09-10T08:44:29.418397+0000","last_undegraded":"2024-09-10T08:44:29.418397+0000","last_fullsized":"2024-09-10T08:44:29.418397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4287,"log_dups_size":0,"ondisk_log_size":4287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:05.512645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22519,"num_write_kb":282718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'5007","reported_seq":5037,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.563134+0000","last_change":"2024-09-10T08:28:35.575788+0000","last_active":"2024-09-10T08:44:22.563134+0000","last_peered":"2024-09-10T08:44:22.563134+0000","last_clean":"2024-09-10T08:44:22.563134+0000","last_became_active":"2024-09-10T08:28:35.575333+0000","last_became_peered":"2024-09-10T08:28:35.575333+0000","last_unstale":"2024-09-10T08:44:22.563134+0000","last_undegraded":"2024-09-10T08:44:22.563134+0000","last_fullsized":"2024-09-10T08:44:22.563134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5007,"log_dups_size":0,"ondisk_log_size":5007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:39.756390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25404,"num_write_kb":331142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.009202+0000","last_change":"2024-09-10T08:28:34.560699+0000","last_active":"2024-09-10T08:43:48.009202+0000","last_peered":"2024-09-10T08:43:48.009202+0000","last_clean":"2024-09-10T08:43:48.009202+0000","last_became_active":"2024-09-10T08:28:34.560376+0000","last_became_peered":"2024-09-10T08:28:34.560376+0000","last_unstale":"2024-09-10T08:43:48.009202+0000","last_undegraded":"2024-09-10T08:43:48.009202+0000","last_fullsized":"2024-09-10T08:43:48.009202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:09.981216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'327","reported_seq":351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.842658+0000","last_change":"2024-09-10T08:28:46.620745+0000","last_active":"2024-09-10T08:43:37.842658+0000","last_peered":"2024-09-10T08:43:37.842658+0000","last_clean":"2024-09-10T08:43:37.842658+0000","last_became_active":"2024-09-10T08:28:46.619030+0000","last_became_peered":"2024-09-10T08:28:46.619030+0000","last_unstale":"2024-09-10T08:43:37.842658+0000","last_undegraded":"2024-09-10T08:43:37.842658+0000","last_fullsized":"2024-09-10T08:43:37.842658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:07.653226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":4249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"27'6390","reported_seq":6412,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.443881+0000","last_change":"2024-09-10T08:28:47.626648+0000","last_active":"2024-09-10T08:44:29.443881+0000","last_peered":"2024-09-10T08:44:29.443881+0000","last_clean":"2024-09-10T08:44:29.443881+0000","last_became_active":"2024-09-10T08:28:47.626330+0000","last_became_peered":"2024-09-10T08:28:47.626330+0000","last_unstale":"2024-09-10T08:44:29.443881+0000","last_undegraded":"2024-09-10T08:44:29.443881+0000","last_fullsized":"2024-09-10T08:44:29.443881+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5190,"log_dups_size":0,"ondisk_log_size":5190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:02.346881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33857,"num_write_kb":406580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'4502","reported_seq":4532,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.486058+0000","last_change":"2024-09-10T08:28:35.574810+0000","last_active":"2024-09-10T08:44:22.486058+0000","last_peered":"2024-09-10T08:44:22.486058+0000","last_clean":"2024-09-10T08:44:22.486058+0000","last_became_active":"2024-09-10T08:28:35.574567+0000","last_became_peered":"2024-09-10T08:28:35.574567+0000","last_unstale":"2024-09-10T08:44:22.486058+0000","last_undegraded":"2024-09-10T08:44:22.486058+0000","last_fullsized":"2024-09-10T08:44:22.486058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4502,"log_dups_size":0,"ondisk_log_size":4502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:29.315833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23284,"num_write_kb":285817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'8","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.989573+0000","last_change":"2024-09-10T08:28:34.553556+0000","last_active":"2024-09-10T08:43:47.989573+0000","last_peered":"2024-09-10T08:43:47.989573+0000","last_clean":"2024-09-10T08:43:47.989573+0000","last_became_active":"2024-09-10T08:28:34.553275+0000","last_became_peered":"2024-09-10T08:28:34.553275+0000","last_unstale":"2024-09-10T08:43:47.989573+0000","last_undegraded":"2024-09-10T08:43:47.989573+0000","last_fullsized":"2024-09-10T08:43:47.989573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:45.957635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'29","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.870711+0000","last_change":"2024-09-10T08:28:46.619760+0000","last_active":"2024-09-10T08:43:37.870711+0000","last_peered":"2024-09-10T08:43:37.870711+0000","last_clean":"2024-09-10T08:43:37.870711+0000","last_became_active":"2024-09-10T08:28:46.619165+0000","last_became_peered":"2024-09-10T08:28:46.619165+0000","last_unstale":"2024-09-10T08:43:37.870711+0000","last_undegraded":"2024-09-10T08:43:37.870711+0000","last_fullsized":"2024-09-10T08:43:37.870711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:27.691197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"27'5339","reported_seq":5361,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.399784+0000","last_change":"2024-09-10T08:28:47.620135+0000","last_active":"2024-09-10T08:44:29.399784+0000","last_peered":"2024-09-10T08:44:29.399784+0000","last_clean":"2024-09-10T08:44:29.399784+0000","last_became_active":"2024-09-10T08:28:47.619661+0000","last_became_peered":"2024-09-10T08:28:47.619661+0000","last_unstale":"2024-09-10T08:44:29.399784+0000","last_undegraded":"2024-09-10T08:44:29.399784+0000","last_fullsized":"2024-09-10T08:44:29.399784+0000","mapping_epoch":23,"log_start":"27'100","ondisk_log_start":"27'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:34.815426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27578,"num_write_kb":340014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'4089","reported_seq":4119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.533296+0000","last_change":"2024-09-10T08:28:35.582473+0000","last_active":"2024-09-10T08:44:22.533296+0000","last_peered":"2024-09-10T08:44:22.533296+0000","last_clean":"2024-09-10T08:44:22.533296+0000","last_became_active":"2024-09-10T08:28:35.582205+0000","last_became_peered":"2024-09-10T08:28:35.582205+0000","last_unstale":"2024-09-10T08:44:22.533296+0000","last_undegraded":"2024-09-10T08:44:22.533296+0000","last_fullsized":"2024-09-10T08:44:22.533296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4089,"log_dups_size":0,"ondisk_log_size":4089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:11.200963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21083,"num_write_kb":276854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'305","reported_seq":337,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.000513+0000","last_change":"2024-09-10T08:28:34.559823+0000","last_active":"2024-09-10T08:43:48.000513+0000","last_peered":"2024-09-10T08:43:48.000513+0000","last_clean":"2024-09-10T08:43:48.000513+0000","last_became_active":"2024-09-10T08:28:34.559560+0000","last_became_peered":"2024-09-10T08:28:34.559560+0000","last_unstale":"2024-09-10T08:43:48.000513+0000","last_undegraded":"2024-09-10T08:43:48.000513+0000","last_fullsized":"2024-09-10T08:43:48.000513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:53.724382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":301,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'5","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.840086+0000","last_change":"2024-09-10T08:28:46.628040+0000","last_active":"2024-09-10T08:43:37.840086+0000","last_peered":"2024-09-10T08:43:37.840086+0000","last_clean":"2024-09-10T08:43:37.840086+0000","last_became_active":"2024-09-10T08:28:46.627819+0000","last_became_peered":"2024-09-10T08:28:46.627819+0000","last_unstale":"2024-09-10T08:43:37.840086+0000","last_undegraded":"2024-09-10T08:43:37.840086+0000","last_fullsized":"2024-09-10T08:43:37.840086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:29.467540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"27'3973","reported_seq":3995,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456273+0000","last_change":"2024-09-10T08:28:47.628067+0000","last_active":"2024-09-10T08:44:29.456273+0000","last_peered":"2024-09-10T08:44:29.456273+0000","last_clean":"2024-09-10T08:44:29.456273+0000","last_became_active":"2024-09-10T08:28:47.627775+0000","last_became_peered":"2024-09-10T08:28:47.627775+0000","last_unstale":"2024-09-10T08:44:29.456273+0000","last_undegraded":"2024-09-10T08:44:29.456273+0000","last_fullsized":"2024-09-10T08:44:29.456273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3973,"log_dups_size":0,"ondisk_log_size":3973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:43.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20759,"num_write_kb":275665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'6218","reported_seq":6248,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.501495+0000","last_change":"2024-09-10T08:28:35.571262+0000","last_active":"2024-09-10T08:44:22.501495+0000","last_peered":"2024-09-10T08:44:22.501495+0000","last_clean":"2024-09-10T08:44:22.501495+0000","last_became_active":"2024-09-10T08:28:35.570711+0000","last_became_peered":"2024-09-10T08:28:35.570711+0000","last_unstale":"2024-09-10T08:44:22.501495+0000","last_undegraded":"2024-09-10T08:44:22.501495+0000","last_fullsized":"2024-09-10T08:44:22.501495+0000","mapping_epoch":19,"log_start":"27'700","ondisk_log_start":"27'700","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5518,"log_dups_size":0,"ondisk_log_size":5518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:29.116422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31535,"num_write_kb":397056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'35","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.003205+0000","last_change":"2024-09-10T08:28:34.557352+0000","last_active":"2024-09-10T08:43:48.003205+0000","last_peered":"2024-09-10T08:43:48.003205+0000","last_clean":"2024-09-10T08:43:48.003205+0000","last_became_active":"2024-09-10T08:28:34.557076+0000","last_became_peered":"2024-09-10T08:28:34.557076+0000","last_unstale":"2024-09-10T08:43:48.003205+0000","last_undegraded":"2024-09-10T08:43:48.003205+0000","last_fullsized":"2024-09-10T08:43:48.003205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:04.957739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'8","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.822684+0000","last_change":"2024-09-10T08:28:46.615923+0000","last_active":"2024-09-10T08:43:37.822684+0000","last_peered":"2024-09-10T08:43:37.822684+0000","last_clean":"2024-09-10T08:43:37.822684+0000","last_became_active":"2024-09-10T08:28:46.615451+0000","last_became_peered":"2024-09-10T08:28:46.615451+0000","last_unstale":"2024-09-10T08:43:37.822684+0000","last_undegraded":"2024-09-10T08:43:37.822684+0000","last_fullsized":"2024-09-10T08:43:37.822684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:22.612001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"27'4284","reported_seq":4306,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456315+0000","last_change":"2024-09-10T08:28:47.623223+0000","last_active":"2024-09-10T08:44:29.456315+0000","last_peered":"2024-09-10T08:44:29.456315+0000","last_clean":"2024-09-10T08:44:29.456315+0000","last_became_active":"2024-09-10T08:28:47.622961+0000","last_became_peered":"2024-09-10T08:28:47.622961+0000","last_unstale":"2024-09-10T08:44:29.456315+0000","last_undegraded":"2024-09-10T08:44:29.456315+0000","last_fullsized":"2024-09-10T08:44:29.456315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4284,"log_dups_size":0,"ondisk_log_size":4284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:30.979580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23423,"num_write_kb":294728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"27'3896","reported_seq":3926,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.505094+0000","last_change":"2024-09-10T08:28:35.577913+0000","last_active":"2024-09-10T08:44:22.505094+0000","last_peered":"2024-09-10T08:44:22.505094+0000","last_clean":"2024-09-10T08:44:22.505094+0000","last_became_active":"2024-09-10T08:28:35.577255+0000","last_became_peered":"2024-09-10T08:28:35.577255+0000","last_unstale":"2024-09-10T08:44:22.505094+0000","last_undegraded":"2024-09-10T08:44:22.505094+0000","last_fullsized":"2024-09-10T08:44:22.505094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3896,"log_dups_size":0,"ondisk_log_size":3896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:17.413525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19770,"num_write_kb":255291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'2","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.988679+0000","last_change":"2024-09-10T08:28:34.564571+0000","last_active":"2024-09-10T08:43:47.988679+0000","last_peered":"2024-09-10T08:43:47.988679+0000","last_clean":"2024-09-10T08:43:47.988679+0000","last_became_active":"2024-09-10T08:28:34.564189+0000","last_became_peered":"2024-09-10T08:28:34.564189+0000","last_unstale":"2024-09-10T08:43:47.988679+0000","last_undegraded":"2024-09-10T08:43:47.988679+0000","last_fullsized":"2024-09-10T08:43:47.988679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:46.055510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'12","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.816926+0000","last_change":"2024-09-10T08:28:46.618917+0000","last_active":"2024-09-10T08:43:37.816926+0000","last_peered":"2024-09-10T08:43:37.816926+0000","last_clean":"2024-09-10T08:43:37.816926+0000","last_became_active":"2024-09-10T08:28:46.618625+0000","last_became_peered":"2024-09-10T08:28:46.618625+0000","last_unstale":"2024-09-10T08:43:37.816926+0000","last_undegraded":"2024-09-10T08:43:37.816926+0000","last_fullsized":"2024-09-10T08:43:37.816926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:19.431857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"27'4685","reported_seq":4707,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.447574+0000","last_change":"2024-09-10T08:28:47.630243+0000","last_active":"2024-09-10T08:44:29.447574+0000","last_peered":"2024-09-10T08:44:29.447574+0000","last_clean":"2024-09-10T08:44:29.447574+0000","last_became_active":"2024-09-10T08:28:47.629869+0000","last_became_peered":"2024-09-10T08:28:47.629869+0000","last_unstale":"2024-09-10T08:44:29.447574+0000","last_undegraded":"2024-09-10T08:44:29.447574+0000","last_fullsized":"2024-09-10T08:44:29.447574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4685,"log_dups_size":0,"ondisk_log_size":4685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:58.696156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24572,"num_write_kb":315590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'4682","reported_seq":4712,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.546974+0000","last_change":"2024-09-10T08:28:35.572944+0000","last_active":"2024-09-10T08:44:22.546974+0000","last_peered":"2024-09-10T08:44:22.546974+0000","last_clean":"2024-09-10T08:44:22.546974+0000","last_became_active":"2024-09-10T08:28:35.572620+0000","last_became_peered":"2024-09-10T08:28:35.572620+0000","last_unstale":"2024-09-10T08:44:22.546974+0000","last_undegraded":"2024-09-10T08:44:22.546974+0000","last_fullsized":"2024-09-10T08:44:22.546974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4682,"log_dups_size":0,"ondisk_log_size":4682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:04.524048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24219,"num_write_kb":302042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'2","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:04.444745+0000","last_change":"2024-09-10T08:28:34.562935+0000","last_active":"2024-09-10T08:43:04.444745+0000","last_peered":"2024-09-10T08:43:04.444745+0000","last_clean":"2024-09-10T08:43:04.444745+0000","last_became_active":"2024-09-10T08:28:34.562647+0000","last_became_peered":"2024-09-10T08:28:34.562647+0000","last_unstale":"2024-09-10T08:43:04.444745+0000","last_undegraded":"2024-09-10T08:43:04.444745+0000","last_fullsized":"2024-09-10T08:43:04.444745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:47.492281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'6","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.806115+0000","last_change":"2024-09-10T08:28:46.621472+0000","last_active":"2024-09-10T08:43:37.806115+0000","last_peered":"2024-09-10T08:43:37.806115+0000","last_clean":"2024-09-10T08:43:37.806115+0000","last_became_active":"2024-09-10T08:28:46.621157+0000","last_became_peered":"2024-09-10T08:28:46.621157+0000","last_unstale":"2024-09-10T08:43:37.806115+0000","last_undegraded":"2024-09-10T08:43:37.806115+0000","last_fullsized":"2024-09-10T08:43:37.806115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:44.166068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"27'5768","reported_seq":5791,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.460342+0000","last_change":"2024-09-10T08:28:47.627750+0000","last_active":"2024-09-10T08:44:29.460342+0000","last_peered":"2024-09-10T08:44:29.460342+0000","last_clean":"2024-09-10T08:44:29.460342+0000","last_became_active":"2024-09-10T08:28:47.627481+0000","last_became_peered":"2024-09-10T08:28:47.627481+0000","last_unstale":"2024-09-10T08:44:29.460342+0000","last_undegraded":"2024-09-10T08:44:29.460342+0000","last_fullsized":"2024-09-10T08:44:29.460342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5768,"log_dups_size":0,"ondisk_log_size":5768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:01.105133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30773,"num_write_kb":369268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.796648+0000","last_change":"2024-09-10T08:28:46.620162+0000","last_active":"2024-09-10T08:43:37.796648+0000","last_peered":"2024-09-10T08:43:37.796648+0000","last_clean":"2024-09-10T08:43:37.796648+0000","last_became_active":"2024-09-10T08:28:46.619843+0000","last_became_peered":"2024-09-10T08:28:46.619843+0000","last_unstale":"2024-09-10T08:43:37.796648+0000","last_undegraded":"2024-09-10T08:43:37.796648+0000","last_fullsized":"2024-09-10T08:43:37.796648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:21.376123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'5404","reported_seq":5434,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.528764+0000","last_change":"2024-09-10T08:28:35.572803+0000","last_active":"2024-09-10T08:44:22.528764+0000","last_peered":"2024-09-10T08:44:22.528764+0000","last_clean":"2024-09-10T08:44:22.528764+0000","last_became_active":"2024-09-10T08:28:35.572219+0000","last_became_peered":"2024-09-10T08:28:35.572219+0000","last_unstale":"2024-09-10T08:44:22.528764+0000","last_undegraded":"2024-09-10T08:44:22.528764+0000","last_fullsized":"2024-09-10T08:44:22.528764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5404,"log_dups_size":0,"ondisk_log_size":5404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:45.920218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27626,"num_write_kb":348430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:35.055986+0000","last_change":"2024-09-10T08:28:34.554346+0000","last_active":"2024-09-10T08:43:35.055986+0000","last_peered":"2024-09-10T08:43:35.055986+0000","last_clean":"2024-09-10T08:43:35.055986+0000","last_became_active":"2024-09-10T08:28:34.553933+0000","last_became_peered":"2024-09-10T08:28:34.553933+0000","last_unstale":"2024-09-10T08:43:35.055986+0000","last_undegraded":"2024-09-10T08:43:35.055986+0000","last_fullsized":"2024-09-10T08:43:35.055986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:07.639671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"27'4656","reported_seq":4679,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.353791+0000","last_change":"2024-09-10T08:28:47.629468+0000","last_active":"2024-09-10T08:44:29.353791+0000","last_peered":"2024-09-10T08:44:29.353791+0000","last_clean":"2024-09-10T08:44:29.353791+0000","last_became_active":"2024-09-10T08:28:47.629177+0000","last_became_peered":"2024-09-10T08:28:47.629177+0000","last_unstale":"2024-09-10T08:44:29.353791+0000","last_undegraded":"2024-09-10T08:44:29.353791+0000","last_fullsized":"2024-09-10T08:44:29.353791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4656,"log_dups_size":0,"ondisk_log_size":4656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:10.443235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24729,"num_write_kb":316330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"27'630","reported_seq":655,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:28.449319+0000","last_change":"2024-09-10T08:28:46.630904+0000","last_active":"2024-09-10T08:43:28.449319+0000","last_peered":"2024-09-10T08:43:28.449319+0000","last_clean":"2024-09-10T08:43:28.449319+0000","last_became_active":"2024-09-10T08:28:46.630530+0000","last_became_peered":"2024-09-10T08:28:46.630530+0000","last_unstale":"2024-09-10T08:43:28.449319+0000","last_undegraded":"2024-09-10T08:43:28.449319+0000","last_fullsized":"2024-09-10T08:43:28.449319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:33.599739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":4465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'4762","reported_seq":4792,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.510821+0000","last_change":"2024-09-10T08:28:35.580244+0000","last_active":"2024-09-10T08:44:22.510821+0000","last_peered":"2024-09-10T08:44:22.510821+0000","last_clean":"2024-09-10T08:44:22.510821+0000","last_became_active":"2024-09-10T08:28:35.579975+0000","last_became_peered":"2024-09-10T08:28:35.579975+0000","last_unstale":"2024-09-10T08:44:22.510821+0000","last_undegraded":"2024-09-10T08:44:22.510821+0000","last_fullsized":"2024-09-10T08:44:22.510821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4762,"log_dups_size":0,"ondisk_log_size":4762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:16.498045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24500,"num_write_kb":298921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:06.786232+0000","last_change":"2024-09-10T08:28:34.564751+0000","last_active":"2024-09-10T08:43:06.786232+0000","last_peered":"2024-09-10T08:43:06.786232+0000","last_clean":"2024-09-10T08:43:06.786232+0000","last_became_active":"2024-09-10T08:28:34.564479+0000","last_became_peered":"2024-09-10T08:28:34.564479+0000","last_unstale":"2024-09-10T08:43:06.786232+0000","last_undegraded":"2024-09-10T08:43:06.786232+0000","last_fullsized":"2024-09-10T08:43:06.786232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:29.618224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"27'5070","reported_seq":5092,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.463937+0000","last_change":"2024-09-10T08:28:47.627041+0000","last_active":"2024-09-10T08:44:29.463937+0000","last_peered":"2024-09-10T08:44:29.463937+0000","last_clean":"2024-09-10T08:44:29.463937+0000","last_became_active":"2024-09-10T08:28:47.626692+0000","last_became_peered":"2024-09-10T08:28:47.626692+0000","last_unstale":"2024-09-10T08:44:29.463937+0000","last_undegraded":"2024-09-10T08:44:29.463937+0000","last_fullsized":"2024-09-10T08:44:29.463937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5070,"log_dups_size":0,"ondisk_log_size":5070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:57.666849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26421,"num_write_kb":351729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"27'90","reported_seq":122,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.343291+0000","last_change":"2024-09-10T08:28:34.561906+0000","last_active":"2024-09-10T08:44:22.343291+0000","last_peered":"2024-09-10T08:44:22.343291+0000","last_clean":"2024-09-10T08:44:22.343291+0000","last_became_active":"2024-09-10T08:28:34.561613+0000","last_became_peered":"2024-09-10T08:28:34.561613+0000","last_unstale":"2024-09-10T08:44:22.343291+0000","last_undegraded":"2024-09-10T08:44:22.343291+0000","last_fullsized":"2024-09-10T08:44:22.343291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:56.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061672,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":1094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'3916","reported_seq":3946,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.533790+0000","last_change":"2024-09-10T08:28:35.576406+0000","last_active":"2024-09-10T08:44:22.533790+0000","last_peered":"2024-09-10T08:44:22.533790+0000","last_clean":"2024-09-10T08:44:22.533790+0000","last_became_active":"2024-09-10T08:28:35.576145+0000","last_became_peered":"2024-09-10T08:28:35.576145+0000","last_unstale":"2024-09-10T08:44:22.533790+0000","last_undegraded":"2024-09-10T08:44:22.533790+0000","last_fullsized":"2024-09-10T08:44:22.533790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3916,"log_dups_size":0,"ondisk_log_size":3916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:57.667098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19526,"num_write_kb":237971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.846532+0000","last_change":"2024-09-10T08:28:46.622395+0000","last_active":"2024-09-10T08:43:37.846532+0000","last_peered":"2024-09-10T08:43:37.846532+0000","last_clean":"2024-09-10T08:43:37.846532+0000","last_became_active":"2024-09-10T08:28:46.621941+0000","last_became_peered":"2024-09-10T08:28:46.621941+0000","last_unstale":"2024-09-10T08:43:37.846532+0000","last_undegraded":"2024-09-10T08:43:37.846532+0000","last_fullsized":"2024-09-10T08:43:37.846532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:54.928969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"27'3193","reported_seq":3215,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.434312+0000","last_change":"2024-09-10T08:28:47.626495+0000","last_active":"2024-09-10T08:44:29.434312+0000","last_peered":"2024-09-10T08:44:29.434312+0000","last_clean":"2024-09-10T08:44:29.434312+0000","last_became_active":"2024-09-10T08:28:47.625258+0000","last_became_peered":"2024-09-10T08:28:47.625258+0000","last_unstale":"2024-09-10T08:44:29.434312+0000","last_undegraded":"2024-09-10T08:44:29.434312+0000","last_fullsized":"2024-09-10T08:44:29.434312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3193,"log_dups_size":0,"ondisk_log_size":3193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:00.101586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16183,"num_write_kb":212369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'622","reported_seq":654,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:35.040191+0000","last_change":"2024-09-10T08:28:34.566606+0000","last_active":"2024-09-10T08:43:35.040191+0000","last_peered":"2024-09-10T08:43:35.040191+0000","last_clean":"2024-09-10T08:43:35.040191+0000","last_became_active":"2024-09-10T08:28:34.566388+0000","last_became_peered":"2024-09-10T08:28:34.566388+0000","last_unstale":"2024-09-10T08:43:35.040191+0000","last_undegraded":"2024-09-10T08:43:35.040191+0000","last_fullsized":"2024-09-10T08:43:35.040191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:33.528801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":620,"num_write_kb":4248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'4051","reported_seq":4081,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.448831+0000","last_change":"2024-09-10T08:28:35.559371+0000","last_active":"2024-09-10T08:44:22.448831+0000","last_peered":"2024-09-10T08:44:22.448831+0000","last_clean":"2024-09-10T08:44:22.448831+0000","last_became_active":"2024-09-10T08:28:35.559145+0000","last_became_peered":"2024-09-10T08:28:35.559145+0000","last_unstale":"2024-09-10T08:44:22.448831+0000","last_undegraded":"2024-09-10T08:44:22.448831+0000","last_fullsized":"2024-09-10T08:44:22.448831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4051,"log_dups_size":0,"ondisk_log_size":4051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:57.339318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20269,"num_write_kb":257190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'11","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.853770+0000","last_change":"2024-09-10T08:28:46.620231+0000","last_active":"2024-09-10T08:43:37.853770+0000","last_peered":"2024-09-10T08:43:37.853770+0000","last_clean":"2024-09-10T08:43:37.853770+0000","last_became_active":"2024-09-10T08:28:46.619403+0000","last_became_peered":"2024-09-10T08:28:46.619403+0000","last_unstale":"2024-09-10T08:43:37.853770+0000","last_undegraded":"2024-09-10T08:43:37.853770+0000","last_fullsized":"2024-09-10T08:43:37.853770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:26.308749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"27'4023","reported_seq":4046,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.453630+0000","last_change":"2024-09-10T08:28:47.627135+0000","last_active":"2024-09-10T08:44:29.453630+0000","last_peered":"2024-09-10T08:44:29.453630+0000","last_clean":"2024-09-10T08:44:29.453630+0000","last_became_active":"2024-09-10T08:28:47.626791+0000","last_became_peered":"2024-09-10T08:28:47.626791+0000","last_unstale":"2024-09-10T08:44:29.453630+0000","last_undegraded":"2024-09-10T08:44:29.453630+0000","last_fullsized":"2024-09-10T08:44:29.453630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4023,"log_dups_size":0,"ondisk_log_size":4023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:43.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21172,"num_write_kb":269680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'5985","reported_seq":6016,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.506685+0000","last_change":"2024-09-10T08:28:35.579106+0000","last_active":"2024-09-10T08:44:22.506685+0000","last_peered":"2024-09-10T08:44:22.506685+0000","last_clean":"2024-09-10T08:44:22.506685+0000","last_became_active":"2024-09-10T08:28:35.578631+0000","last_became_peered":"2024-09-10T08:28:35.578631+0000","last_unstale":"2024-09-10T08:44:22.506685+0000","last_undegraded":"2024-09-10T08:44:22.506685+0000","last_fullsized":"2024-09-10T08:44:22.506685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5985,"log_dups_size":0,"ondisk_log_size":5985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:31.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30721,"num_write_kb":377078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"27'5461","reported_seq":5484,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.347960+0000","last_change":"2024-09-10T08:28:47.632052+0000","last_active":"2024-09-10T08:44:29.347960+0000","last_peered":"2024-09-10T08:44:29.347960+0000","last_clean":"2024-09-10T08:44:29.347960+0000","last_became_active":"2024-09-10T08:28:47.631578+0000","last_became_peered":"2024-09-10T08:28:47.631578+0000","last_unstale":"2024-09-10T08:44:29.347960+0000","last_undegraded":"2024-09-10T08:44:29.347960+0000","last_fullsized":"2024-09-10T08:44:29.347960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5461,"log_dups_size":0,"ondisk_log_size":5461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:24.570729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28495,"num_write_kb":351882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"27'5419","reported_seq":5455,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.513489+0000","last_change":"2024-09-10T08:29:36.030138+0000","last_active":"2024-09-10T08:44:22.513489+0000","last_peered":"2024-09-10T08:44:22.513489+0000","last_clean":"2024-09-10T08:44:22.513489+0000","last_became_active":"2024-09-10T08:29:36.029789+0000","last_became_peered":"2024-09-10T08:29:36.029789+0000","last_unstale":"2024-09-10T08:44:22.513489+0000","last_undegraded":"2024-09-10T08:44:22.513489+0000","last_fullsized":"2024-09-10T08:44:22.513489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5419,"log_dups_size":0,"ondisk_log_size":5419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:56:49.067000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28175,"num_write_kb":329998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"27'4342","reported_seq":4365,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456079+0000","last_change":"2024-09-10T08:28:47.629148+0000","last_active":"2024-09-10T08:44:29.456079+0000","last_peered":"2024-09-10T08:44:29.456079+0000","last_clean":"2024-09-10T08:44:29.456079+0000","last_became_active":"2024-09-10T08:28:47.628741+0000","last_became_peered":"2024-09-10T08:28:47.628741+0000","last_unstale":"2024-09-10T08:44:29.456079+0000","last_undegraded":"2024-09-10T08:44:29.456079+0000","last_fullsized":"2024-09-10T08:44:29.456079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:48.950503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22591,"num_write_kb":275032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"27'5933","reported_seq":5964,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.508630+0000","last_change":"2024-09-10T08:28:35.578735+0000","last_active":"2024-09-10T08:44:22.508630+0000","last_peered":"2024-09-10T08:44:22.508630+0000","last_clean":"2024-09-10T08:44:22.508630+0000","last_became_active":"2024-09-10T08:28:35.577995+0000","last_became_peered":"2024-09-10T08:28:35.577995+0000","last_unstale":"2024-09-10T08:44:22.508630+0000","last_undegraded":"2024-09-10T08:44:22.508630+0000","last_fullsized":"2024-09-10T08:44:22.508630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5933,"log_dups_size":0,"ondisk_log_size":5933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:11.033441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30577,"num_write_kb":368306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"27'4476","reported_seq":4499,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.461540+0000","last_change":"2024-09-10T08:28:47.628639+0000","last_active":"2024-09-10T08:44:29.461540+0000","last_peered":"2024-09-10T08:44:29.461540+0000","last_clean":"2024-09-10T08:44:29.461540+0000","last_became_active":"2024-09-10T08:28:47.628317+0000","last_became_peered":"2024-09-10T08:28:47.628317+0000","last_unstale":"2024-09-10T08:44:29.461540+0000","last_undegraded":"2024-09-10T08:44:29.461540+0000","last_fullsized":"2024-09-10T08:44:29.461540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4476,"log_dups_size":0,"ondisk_log_size":4476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:50.314678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23867,"num_write_kb":312797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"27'4232","reported_seq":4263,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.522252+0000","last_change":"2024-09-10T08:28:35.577852+0000","last_active":"2024-09-10T08:44:22.522252+0000","last_peered":"2024-09-10T08:44:22.522252+0000","last_clean":"2024-09-10T08:44:22.522252+0000","last_became_active":"2024-09-10T08:28:35.577571+0000","last_became_peered":"2024-09-10T08:28:35.577571+0000","last_unstale":"2024-09-10T08:44:22.522252+0000","last_undegraded":"2024-09-10T08:44:22.522252+0000","last_fullsized":"2024-09-10T08:44:22.522252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4232,"log_dups_size":0,"ondisk_log_size":4232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:22.713732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21938,"num_write_kb":263982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"27'5518","reported_seq":5541,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.374526+0000","last_change":"2024-09-10T08:28:47.629931+0000","last_active":"2024-09-10T08:44:29.374526+0000","last_peered":"2024-09-10T08:44:29.374526+0000","last_clean":"2024-09-10T08:44:29.374526+0000","last_became_active":"2024-09-10T08:28:47.629634+0000","last_became_peered":"2024-09-10T08:28:47.629634+0000","last_unstale":"2024-09-10T08:44:29.374526+0000","last_undegraded":"2024-09-10T08:44:29.374526+0000","last_fullsized":"2024-09-10T08:44:29.374526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5518,"log_dups_size":0,"ondisk_log_size":5518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:57.964208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28611,"num_write_kb":360382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"27'3937","reported_seq":3968,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.454987+0000","last_change":"2024-09-10T08:28:35.574676+0000","last_active":"2024-09-10T08:44:22.454987+0000","last_peered":"2024-09-10T08:44:22.454987+0000","last_clean":"2024-09-10T08:44:22.454987+0000","last_became_active":"2024-09-10T08:28:35.574437+0000","last_became_peered":"2024-09-10T08:28:35.574437+0000","last_unstale":"2024-09-10T08:44:22.454987+0000","last_undegraded":"2024-09-10T08:44:22.454987+0000","last_fullsized":"2024-09-10T08:44:22.454987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3937,"log_dups_size":0,"ondisk_log_size":3937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:45.422506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20167,"num_write_kb":265112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"27'3790","reported_seq":3813,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456016+0000","last_change":"2024-09-10T08:28:47.624178+0000","last_active":"2024-09-10T08:44:29.456016+0000","last_peered":"2024-09-10T08:44:29.456016+0000","last_clean":"2024-09-10T08:44:29.456016+0000","last_became_active":"2024-09-10T08:28:47.623671+0000","last_became_peered":"2024-09-10T08:28:47.623671+0000","last_unstale":"2024-09-10T08:44:29.456016+0000","last_undegraded":"2024-09-10T08:44:29.456016+0000","last_fullsized":"2024-09-10T08:44:29.456016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3790,"log_dups_size":0,"ondisk_log_size":3790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:48.613870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19891,"num_write_kb":255782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"27'4956","reported_seq":4987,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.486306+0000","last_change":"2024-09-10T08:28:35.572550+0000","last_active":"2024-09-10T08:44:22.486306+0000","last_peered":"2024-09-10T08:44:22.486306+0000","last_clean":"2024-09-10T08:44:22.486306+0000","last_became_active":"2024-09-10T08:28:35.572184+0000","last_became_peered":"2024-09-10T08:28:35.572184+0000","last_unstale":"2024-09-10T08:44:22.486306+0000","last_undegraded":"2024-09-10T08:44:22.486306+0000","last_fullsized":"2024-09-10T08:44:22.486306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4956,"log_dups_size":0,"ondisk_log_size":4956,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:08.490734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26295,"num_write_kb":322461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"27'5495","reported_seq":5518,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.478950+0000","last_change":"2024-09-10T08:28:47.630214+0000","last_active":"2024-09-10T08:44:29.478950+0000","last_peered":"2024-09-10T08:44:29.478950+0000","last_clean":"2024-09-10T08:44:29.478950+0000","last_became_active":"2024-09-10T08:28:47.629512+0000","last_became_peered":"2024-09-10T08:28:47.629512+0000","last_unstale":"2024-09-10T08:44:29.478950+0000","last_undegraded":"2024-09-10T08:44:29.478950+0000","last_fullsized":"2024-09-10T08:44:29.478950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5495,"log_dups_size":0,"ondisk_log_size":5495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:35.692107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29037,"num_write_kb":370350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"27'4400","reported_seq":4431,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.553518+0000","last_change":"2024-09-10T08:28:35.573217+0000","last_active":"2024-09-10T08:44:22.553518+0000","last_peered":"2024-09-10T08:44:22.553518+0000","last_clean":"2024-09-10T08:44:22.553518+0000","last_became_active":"2024-09-10T08:28:35.572955+0000","last_became_peered":"2024-09-10T08:28:35.572955+0000","last_unstale":"2024-09-10T08:44:22.553518+0000","last_undegraded":"2024-09-10T08:44:22.553518+0000","last_fullsized":"2024-09-10T08:44:22.553518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4400,"log_dups_size":0,"ondisk_log_size":4400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:24.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22665,"num_write_kb":275496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"27'4608","reported_seq":4631,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.438440+0000","last_change":"2024-09-10T08:28:47.623365+0000","last_active":"2024-09-10T08:44:29.438440+0000","last_peered":"2024-09-10T08:44:29.438440+0000","last_clean":"2024-09-10T08:44:29.438440+0000","last_became_active":"2024-09-10T08:28:47.623082+0000","last_became_peered":"2024-09-10T08:28:47.623082+0000","last_unstale":"2024-09-10T08:44:29.438440+0000","last_undegraded":"2024-09-10T08:44:29.438440+0000","last_fullsized":"2024-09-10T08:44:29.438440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:20.558484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24193,"num_write_kb":313982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'6039","reported_seq":6070,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.401543+0000","last_change":"2024-09-10T08:28:35.575902+0000","last_active":"2024-09-10T08:44:22.401543+0000","last_peered":"2024-09-10T08:44:22.401543+0000","last_clean":"2024-09-10T08:44:22.401543+0000","last_became_active":"2024-09-10T08:28:35.575614+0000","last_became_peered":"2024-09-10T08:28:35.575614+0000","last_unstale":"2024-09-10T08:44:22.401543+0000","last_undegraded":"2024-09-10T08:44:22.401543+0000","last_fullsized":"2024-09-10T08:44:22.401543+0000","mapping_epoch":19,"log_start":"27'800","ondisk_log_start":"27'800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:11.277682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31129,"num_write_kb":362414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"27'3524","reported_seq":3546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.429365+0000","last_change":"2024-09-10T08:28:47.629795+0000","last_active":"2024-09-10T08:44:29.429365+0000","last_peered":"2024-09-10T08:44:29.429365+0000","last_clean":"2024-09-10T08:44:29.429365+0000","last_became_active":"2024-09-10T08:28:47.628861+0000","last_became_peered":"2024-09-10T08:28:47.628861+0000","last_unstale":"2024-09-10T08:44:29.429365+0000","last_undegraded":"2024-09-10T08:44:29.429365+0000","last_fullsized":"2024-09-10T08:44:29.429365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3524,"log_dups_size":0,"ondisk_log_size":3524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:06.277094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18277,"num_write_kb":237112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'4470","reported_seq":4501,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.481878+0000","last_change":"2024-09-10T08:28:35.578285+0000","last_active":"2024-09-10T08:44:22.481878+0000","last_peered":"2024-09-10T08:44:22.481878+0000","last_clean":"2024-09-10T08:44:22.481878+0000","last_became_active":"2024-09-10T08:28:35.576805+0000","last_became_peered":"2024-09-10T08:28:35.576805+0000","last_unstale":"2024-09-10T08:44:22.481878+0000","last_undegraded":"2024-09-10T08:44:22.481878+0000","last_fullsized":"2024-09-10T08:44:22.481878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4470,"log_dups_size":0,"ondisk_log_size":4470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:46.203320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22783,"num_write_kb":271507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"27'5536","reported_seq":5558,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.409088+0000","last_change":"2024-09-10T08:28:47.635713+0000","last_active":"2024-09-10T08:44:29.409088+0000","last_peered":"2024-09-10T08:44:29.409088+0000","last_clean":"2024-09-10T08:44:29.409088+0000","last_became_active":"2024-09-10T08:28:47.635381+0000","last_became_peered":"2024-09-10T08:28:47.635381+0000","last_unstale":"2024-09-10T08:44:29.409088+0000","last_undegraded":"2024-09-10T08:44:29.409088+0000","last_fullsized":"2024-09-10T08:44:29.409088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5536,"log_dups_size":0,"ondisk_log_size":5536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:39.419510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28458,"num_write_kb":359914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"27'4347","reported_seq":4363,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.499781+0000","last_change":"2024-09-10T08:29:35.097545+0000","last_active":"2024-09-10T08:44:22.499781+0000","last_peered":"2024-09-10T08:44:22.499781+0000","last_clean":"2024-09-10T08:44:22.499781+0000","last_became_active":"2024-09-10T08:29:35.097273+0000","last_became_peered":"2024-09-10T08:29:35.097273+0000","last_unstale":"2024-09-10T08:44:22.499781+0000","last_undegraded":"2024-09-10T08:44:22.499781+0000","last_fullsized":"2024-09-10T08:44:22.499781+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4347,"log_dups_size":0,"ondisk_log_size":4347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:40.058249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22114,"num_write_kb":289250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2c","version":"27'4653","reported_seq":4676,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.447481+0000","last_change":"2024-09-10T08:28:47.619863+0000","last_active":"2024-09-10T08:44:29.447481+0000","last_peered":"2024-09-10T08:44:29.447481+0000","last_clean":"2024-09-10T08:44:29.447481+0000","last_became_active":"2024-09-10T08:28:47.619525+0000","last_became_peered":"2024-09-10T08:28:47.619525+0000","last_unstale":"2024-09-10T08:44:29.447481+0000","last_undegraded":"2024-09-10T08:44:29.447481+0000","last_fullsized":"2024-09-10T08:44:29.447481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4653,"log_dups_size":0,"ondisk_log_size":4653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:49.591318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24519,"num_write_kb":299145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"27'5080","reported_seq":5111,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.544103+0000","last_change":"2024-09-10T08:28:35.568044+0000","last_active":"2024-09-10T08:44:22.544103+0000","last_peered":"2024-09-10T08:44:22.544103+0000","last_clean":"2024-09-10T08:44:22.544103+0000","last_became_active":"2024-09-10T08:28:35.567744+0000","last_became_peered":"2024-09-10T08:28:35.567744+0000","last_unstale":"2024-09-10T08:44:22.544103+0000","last_undegraded":"2024-09-10T08:44:22.544103+0000","last_fullsized":"2024-09-10T08:44:22.544103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5080,"log_dups_size":0,"ondisk_log_size":5080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:19.081138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26557,"num_write_kb":327659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"27'4432","reported_seq":4454,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.395035+0000","last_change":"2024-09-10T08:28:47.629417+0000","last_active":"2024-09-10T08:44:29.395035+0000","last_peered":"2024-09-10T08:44:29.395035+0000","last_clean":"2024-09-10T08:44:29.395035+0000","last_became_active":"2024-09-10T08:28:47.629095+0000","last_became_peered":"2024-09-10T08:28:47.629095+0000","last_unstale":"2024-09-10T08:44:29.395035+0000","last_undegraded":"2024-09-10T08:44:29.395035+0000","last_fullsized":"2024-09-10T08:44:29.395035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4432,"log_dups_size":0,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:05.606381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22331,"num_write_kb":294288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"27'4801","reported_seq":4832,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.544316+0000","last_change":"2024-09-10T08:28:35.575802+0000","last_active":"2024-09-10T08:44:22.544316+0000","last_peered":"2024-09-10T08:44:22.544316+0000","last_clean":"2024-09-10T08:44:22.544316+0000","last_became_active":"2024-09-10T08:28:35.575388+0000","last_became_peered":"2024-09-10T08:28:35.575388+0000","last_unstale":"2024-09-10T08:44:22.544316+0000","last_undegraded":"2024-09-10T08:44:22.544316+0000","last_fullsized":"2024-09-10T08:44:22.544316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4801,"log_dups_size":0,"ondisk_log_size":4801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:01.424265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24675,"num_write_kb":307760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"27'4608","reported_seq":4630,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.451461+0000","last_change":"2024-09-10T08:28:47.624305+0000","last_active":"2024-09-10T08:44:29.451461+0000","last_peered":"2024-09-10T08:44:29.451461+0000","last_clean":"2024-09-10T08:44:29.451461+0000","last_became_active":"2024-09-10T08:28:47.624026+0000","last_became_peered":"2024-09-10T08:28:47.624026+0000","last_unstale":"2024-09-10T08:44:29.451461+0000","last_undegraded":"2024-09-10T08:44:29.451461+0000","last_fullsized":"2024-09-10T08:44:29.451461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:01.194271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24388,"num_write_kb":319015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'4484","reported_seq":4515,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.485515+0000","last_change":"2024-09-10T08:28:35.574499+0000","last_active":"2024-09-10T08:44:22.485515+0000","last_peered":"2024-09-10T08:44:22.485515+0000","last_clean":"2024-09-10T08:44:22.485515+0000","last_became_active":"2024-09-10T08:28:35.574249+0000","last_became_peered":"2024-09-10T08:28:35.574249+0000","last_unstale":"2024-09-10T08:44:22.485515+0000","last_undegraded":"2024-09-10T08:44:22.485515+0000","last_fullsized":"2024-09-10T08:44:22.485515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4484,"log_dups_size":0,"ondisk_log_size":4484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:55.952307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23126,"num_write_kb":293453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"27'4466","reported_seq":4488,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456346+0000","last_change":"2024-09-10T08:28:47.629525+0000","last_active":"2024-09-10T08:44:29.456346+0000","last_peered":"2024-09-10T08:44:29.456346+0000","last_clean":"2024-09-10T08:44:29.456346+0000","last_became_active":"2024-09-10T08:28:47.629259+0000","last_became_peered":"2024-09-10T08:28:47.629259+0000","last_unstale":"2024-09-10T08:44:29.456346+0000","last_undegraded":"2024-09-10T08:44:29.456346+0000","last_fullsized":"2024-09-10T08:44:29.456346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4466,"log_dups_size":0,"ondisk_log_size":4466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:11.864322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23096,"num_write_kb":301452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"27'4995","reported_seq":5026,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.537572+0000","last_change":"2024-09-10T08:28:35.572709+0000","last_active":"2024-09-10T08:44:22.537572+0000","last_peered":"2024-09-10T08:44:22.537572+0000","last_clean":"2024-09-10T08:44:22.537572+0000","last_became_active":"2024-09-10T08:28:35.572392+0000","last_became_peered":"2024-09-10T08:28:35.572392+0000","last_unstale":"2024-09-10T08:44:22.537572+0000","last_undegraded":"2024-09-10T08:44:22.537572+0000","last_fullsized":"2024-09-10T08:44:22.537572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4995,"log_dups_size":0,"ondisk_log_size":4995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:42.636299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25177,"num_write_kb":305700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"27'4176","reported_seq":4199,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.350264+0000","last_change":"2024-09-10T08:28:47.623285+0000","last_active":"2024-09-10T08:44:29.350264+0000","last_peered":"2024-09-10T08:44:29.350264+0000","last_clean":"2024-09-10T08:44:29.350264+0000","last_became_active":"2024-09-10T08:28:47.621776+0000","last_became_peered":"2024-09-10T08:28:47.621776+0000","last_unstale":"2024-09-10T08:44:29.350264+0000","last_undegraded":"2024-09-10T08:44:29.350264+0000","last_fullsized":"2024-09-10T08:44:29.350264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:32.543418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21718,"num_write_kb":267375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'3678","reported_seq":3708,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.498693+0000","last_change":"2024-09-10T08:28:35.574438+0000","last_active":"2024-09-10T08:44:22.498693+0000","last_peered":"2024-09-10T08:44:22.498693+0000","last_clean":"2024-09-10T08:44:22.498693+0000","last_became_active":"2024-09-10T08:28:35.574175+0000","last_became_peered":"2024-09-10T08:28:35.574175+0000","last_unstale":"2024-09-10T08:44:22.498693+0000","last_undegraded":"2024-09-10T08:44:22.498693+0000","last_fullsized":"2024-09-10T08:44:22.498693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3678,"log_dups_size":0,"ondisk_log_size":3678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:55.808543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18345,"num_write_kb":237300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"27'4228","reported_seq":4250,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.395548+0000","last_change":"2024-09-10T08:28:47.629092+0000","last_active":"2024-09-10T08:44:29.395548+0000","last_peered":"2024-09-10T08:44:29.395548+0000","last_clean":"2024-09-10T08:44:29.395548+0000","last_became_active":"2024-09-10T08:28:47.628806+0000","last_became_peered":"2024-09-10T08:28:47.628806+0000","last_unstale":"2024-09-10T08:44:29.395548+0000","last_undegraded":"2024-09-10T08:44:29.395548+0000","last_fullsized":"2024-09-10T08:44:29.395548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4228,"log_dups_size":0,"ondisk_log_size":4228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:46.440290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21732,"num_write_kb":287874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"27'5344","reported_seq":5360,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.508645+0000","last_change":"2024-09-10T08:29:35.107021+0000","last_active":"2024-09-10T08:44:22.508645+0000","last_peered":"2024-09-10T08:44:22.508645+0000","last_clean":"2024-09-10T08:44:22.508645+0000","last_became_active":"2024-09-10T08:29:35.106806+0000","last_became_peered":"2024-09-10T08:29:35.106806+0000","last_unstale":"2024-09-10T08:44:22.508645+0000","last_undegraded":"2024-09-10T08:44:22.508645+0000","last_fullsized":"2024-09-10T08:44:22.508645+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5344,"log_dups_size":0,"ondisk_log_size":5344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:20.234687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27047,"num_write_kb":354198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"27'5319","reported_seq":5341,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.401144+0000","last_change":"2024-09-10T08:28:47.631797+0000","last_active":"2024-09-10T08:44:29.401144+0000","last_peered":"2024-09-10T08:44:29.401144+0000","last_clean":"2024-09-10T08:44:29.401144+0000","last_became_active":"2024-09-10T08:28:47.631523+0000","last_became_peered":"2024-09-10T08:28:47.631523+0000","last_unstale":"2024-09-10T08:44:29.401144+0000","last_undegraded":"2024-09-10T08:44:29.401144+0000","last_fullsized":"2024-09-10T08:44:29.401144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5319,"log_dups_size":0,"ondisk_log_size":5319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:05.829116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28163,"num_write_kb":342261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'4477","reported_seq":4507,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.480254+0000","last_change":"2024-09-10T08:28:35.570249+0000","last_active":"2024-09-10T08:44:22.480254+0000","last_peered":"2024-09-10T08:44:22.480254+0000","last_clean":"2024-09-10T08:44:22.480254+0000","last_became_active":"2024-09-10T08:28:35.569960+0000","last_became_peered":"2024-09-10T08:28:35.569960+0000","last_unstale":"2024-09-10T08:44:22.480254+0000","last_undegraded":"2024-09-10T08:44:22.480254+0000","last_fullsized":"2024-09-10T08:44:22.480254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4477,"log_dups_size":0,"ondisk_log_size":4477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:29.787554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23485,"num_write_kb":274341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"27'5295","reported_seq":5317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.481069+0000","last_change":"2024-09-10T08:28:47.633644+0000","last_active":"2024-09-10T08:44:29.481069+0000","last_peered":"2024-09-10T08:44:29.481069+0000","last_clean":"2024-09-10T08:44:29.481069+0000","last_became_active":"2024-09-10T08:28:47.633315+0000","last_became_peered":"2024-09-10T08:28:47.633315+0000","last_unstale":"2024-09-10T08:44:29.481069+0000","last_undegraded":"2024-09-10T08:44:29.481069+0000","last_fullsized":"2024-09-10T08:44:29.481069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5295,"log_dups_size":0,"ondisk_log_size":5295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:45:55.827386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28671,"num_write_kb":360707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"27'4645","reported_seq":4675,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.519615+0000","last_change":"2024-09-10T08:28:35.560693+0000","last_active":"2024-09-10T08:44:22.519615+0000","last_peered":"2024-09-10T08:44:22.519615+0000","last_clean":"2024-09-10T08:44:22.519615+0000","last_became_active":"2024-09-10T08:28:35.560409+0000","last_became_peered":"2024-09-10T08:28:35.560409+0000","last_unstale":"2024-09-10T08:44:22.519615+0000","last_undegraded":"2024-09-10T08:44:22.519615+0000","last_fullsized":"2024-09-10T08:44:22.519615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4645,"log_dups_size":0,"ondisk_log_size":4645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:10.597654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23495,"num_write_kb":303194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"27'3828","reported_seq":3850,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.453763+0000","last_change":"2024-09-10T08:28:47.622614+0000","last_active":"2024-09-10T08:44:29.453763+0000","last_peered":"2024-09-10T08:44:29.453763+0000","last_clean":"2024-09-10T08:44:29.453763+0000","last_became_active":"2024-09-10T08:28:47.622205+0000","last_became_peered":"2024-09-10T08:28:47.622205+0000","last_unstale":"2024-09-10T08:44:29.453763+0000","last_undegraded":"2024-09-10T08:44:29.453763+0000","last_fullsized":"2024-09-10T08:44:29.453763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3828,"log_dups_size":0,"ondisk_log_size":3828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:47.090782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19475,"num_write_kb":250147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'5239","reported_seq":5269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.476534+0000","last_change":"2024-09-10T08:28:35.574551+0000","last_active":"2024-09-10T08:44:22.476534+0000","last_peered":"2024-09-10T08:44:22.476534+0000","last_clean":"2024-09-10T08:44:22.476534+0000","last_became_active":"2024-09-10T08:28:35.574256+0000","last_became_peered":"2024-09-10T08:28:35.574256+0000","last_unstale":"2024-09-10T08:44:22.476534+0000","last_undegraded":"2024-09-10T08:44:22.476534+0000","last_fullsized":"2024-09-10T08:44:22.476534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:43.401552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27760,"num_write_kb":320273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"27'4221","reported_seq":4243,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.396030+0000","last_change":"2024-09-10T08:28:47.633476+0000","last_active":"2024-09-10T08:44:29.396030+0000","last_peered":"2024-09-10T08:44:29.396030+0000","last_clean":"2024-09-10T08:44:29.396030+0000","last_became_active":"2024-09-10T08:28:47.633189+0000","last_became_peered":"2024-09-10T08:28:47.633189+0000","last_unstale":"2024-09-10T08:44:29.396030+0000","last_undegraded":"2024-09-10T08:44:29.396030+0000","last_fullsized":"2024-09-10T08:44:29.396030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4221,"log_dups_size":0,"ondisk_log_size":4221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:46.175490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21808,"num_write_kb":284043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"27'4276","reported_seq":4306,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.491121+0000","last_change":"2024-09-10T08:28:35.573330+0000","last_active":"2024-09-10T08:44:22.491121+0000","last_peered":"2024-09-10T08:44:22.491121+0000","last_clean":"2024-09-10T08:44:22.491121+0000","last_became_active":"2024-09-10T08:28:35.572992+0000","last_became_peered":"2024-09-10T08:28:35.572992+0000","last_unstale":"2024-09-10T08:44:22.491121+0000","last_undegraded":"2024-09-10T08:44:22.491121+0000","last_fullsized":"2024-09-10T08:44:22.491121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4276,"log_dups_size":0,"ondisk_log_size":4276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:15.412219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22251,"num_write_kb":273423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"27'4525","reported_seq":4547,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.372686+0000","last_change":"2024-09-10T08:28:47.630733+0000","last_active":"2024-09-10T08:44:29.372686+0000","last_peered":"2024-09-10T08:44:29.372686+0000","last_clean":"2024-09-10T08:44:29.372686+0000","last_became_active":"2024-09-10T08:28:47.630447+0000","last_became_peered":"2024-09-10T08:28:47.630447+0000","last_unstale":"2024-09-10T08:44:29.372686+0000","last_undegraded":"2024-09-10T08:44:29.372686+0000","last_fullsized":"2024-09-10T08:44:29.372686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4525,"log_dups_size":0,"ondisk_log_size":4525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:08.797818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23690,"num_write_kb":303969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'4030","reported_seq":4060,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.496908+0000","last_change":"2024-09-10T08:28:35.566574+0000","last_active":"2024-09-10T08:44:22.496908+0000","last_peered":"2024-09-10T08:44:22.496908+0000","last_clean":"2024-09-10T08:44:22.496908+0000","last_became_active":"2024-09-10T08:28:35.566205+0000","last_became_peered":"2024-09-10T08:28:35.566205+0000","last_unstale":"2024-09-10T08:44:22.496908+0000","last_undegraded":"2024-09-10T08:44:22.496908+0000","last_fullsized":"2024-09-10T08:44:22.496908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4030,"log_dups_size":0,"ondisk_log_size":4030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:49.876773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20014,"num_write_kb":252379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"27'4167","reported_seq":4189,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.339294+0000","last_change":"2024-09-10T08:28:47.628051+0000","last_active":"2024-09-10T08:44:29.339294+0000","last_peered":"2024-09-10T08:44:29.339294+0000","last_clean":"2024-09-10T08:44:29.339294+0000","last_became_active":"2024-09-10T08:28:47.627747+0000","last_became_peered":"2024-09-10T08:28:47.627747+0000","last_unstale":"2024-09-10T08:44:29.339294+0000","last_undegraded":"2024-09-10T08:44:29.339294+0000","last_fullsized":"2024-09-10T08:44:29.339294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4167,"log_dups_size":0,"ondisk_log_size":4167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:54.210449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22015,"num_write_kb":272523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"27'4068","reported_seq":4098,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.450841+0000","last_change":"2024-09-10T08:28:35.565023+0000","last_active":"2024-09-10T08:44:22.450841+0000","last_peered":"2024-09-10T08:44:22.450841+0000","last_clean":"2024-09-10T08:44:22.450841+0000","last_became_active":"2024-09-10T08:28:35.564747+0000","last_became_peered":"2024-09-10T08:28:35.564747+0000","last_unstale":"2024-09-10T08:44:22.450841+0000","last_undegraded":"2024-09-10T08:44:22.450841+0000","last_fullsized":"2024-09-10T08:44:22.450841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4068,"log_dups_size":0,"ondisk_log_size":4068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:32.419621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20848,"num_write_kb":280067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"27'3614","reported_seq":3636,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.473598+0000","last_change":"2024-09-10T08:28:47.631047+0000","last_active":"2024-09-10T08:44:29.473598+0000","last_peered":"2024-09-10T08:44:29.473598+0000","last_clean":"2024-09-10T08:44:29.473598+0000","last_became_active":"2024-09-10T08:28:47.630617+0000","last_became_peered":"2024-09-10T08:28:47.630617+0000","last_unstale":"2024-09-10T08:44:29.473598+0000","last_undegraded":"2024-09-10T08:44:29.473598+0000","last_fullsized":"2024-09-10T08:44:29.473598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3614,"log_dups_size":0,"ondisk_log_size":3614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:29.867640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19300,"num_write_kb":257617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'4938","reported_seq":4968,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.528147+0000","last_change":"2024-09-10T08:28:35.570619+0000","last_active":"2024-09-10T08:44:22.528147+0000","last_peered":"2024-09-10T08:44:22.528147+0000","last_clean":"2024-09-10T08:44:22.528147+0000","last_became_active":"2024-09-10T08:28:35.570351+0000","last_became_peered":"2024-09-10T08:28:35.570351+0000","last_unstale":"2024-09-10T08:44:22.528147+0000","last_undegraded":"2024-09-10T08:44:22.528147+0000","last_fullsized":"2024-09-10T08:44:22.528147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4938,"log_dups_size":0,"ondisk_log_size":4938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:35.161279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26047,"num_write_kb":333713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"27'4403","reported_seq":4425,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.439522+0000","last_change":"2024-09-10T08:28:47.626191+0000","last_active":"2024-09-10T08:44:29.439522+0000","last_peered":"2024-09-10T08:44:29.439522+0000","last_clean":"2024-09-10T08:44:29.439522+0000","last_became_active":"2024-09-10T08:28:47.625781+0000","last_became_peered":"2024-09-10T08:28:47.625781+0000","last_unstale":"2024-09-10T08:44:29.439522+0000","last_undegraded":"2024-09-10T08:44:29.439522+0000","last_fullsized":"2024-09-10T08:44:29.439522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4403,"log_dups_size":0,"ondisk_log_size":4403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:36:38.651973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22837,"num_write_kb":300422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"27'5731","reported_seq":5761,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.570796+0000","last_change":"2024-09-10T08:28:35.577345+0000","last_active":"2024-09-10T08:44:22.570796+0000","last_peered":"2024-09-10T08:44:22.570796+0000","last_clean":"2024-09-10T08:44:22.570796+0000","last_became_active":"2024-09-10T08:28:35.576191+0000","last_became_peered":"2024-09-10T08:28:35.576191+0000","last_unstale":"2024-09-10T08:44:22.570796+0000","last_undegraded":"2024-09-10T08:44:22.570796+0000","last_fullsized":"2024-09-10T08:44:22.570796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5731,"log_dups_size":0,"ondisk_log_size":5731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:29.218797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30251,"num_write_kb":366959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"27'5875","reported_seq":5898,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.422514+0000","last_change":"2024-09-10T08:28:47.623129+0000","last_active":"2024-09-10T08:44:29.422514+0000","last_peered":"2024-09-10T08:44:29.422514+0000","last_clean":"2024-09-10T08:44:29.422514+0000","last_became_active":"2024-09-10T08:28:47.622851+0000","last_became_peered":"2024-09-10T08:28:47.622851+0000","last_unstale":"2024-09-10T08:44:29.422514+0000","last_undegraded":"2024-09-10T08:44:29.422514+0000","last_fullsized":"2024-09-10T08:44:29.422514+0000","mapping_epoch":23,"log_start":"27'700","ondisk_log_start":"27'700","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5175,"log_dups_size":0,"ondisk_log_size":5175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:16.045213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31498,"num_write_kb":384432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"27'4833","reported_seq":4863,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.512670+0000","last_change":"2024-09-10T08:28:35.575275+0000","last_active":"2024-09-10T08:44:22.512670+0000","last_peered":"2024-09-10T08:44:22.512670+0000","last_clean":"2024-09-10T08:44:22.512670+0000","last_became_active":"2024-09-10T08:28:35.575052+0000","last_became_peered":"2024-09-10T08:28:35.575052+0000","last_unstale":"2024-09-10T08:44:22.512670+0000","last_undegraded":"2024-09-10T08:44:22.512670+0000","last_fullsized":"2024-09-10T08:44:22.512670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4833,"log_dups_size":0,"ondisk_log_size":4833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:24.313017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24290,"num_write_kb":318500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"27'3897","reported_seq":3920,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.448047+0000","last_change":"2024-09-10T08:28:47.628651+0000","last_active":"2024-09-10T08:44:29.448047+0000","last_peered":"2024-09-10T08:44:29.448047+0000","last_clean":"2024-09-10T08:44:29.448047+0000","last_became_active":"2024-09-10T08:28:47.628343+0000","last_became_peered":"2024-09-10T08:28:47.628343+0000","last_unstale":"2024-09-10T08:44:29.448047+0000","last_undegraded":"2024-09-10T08:44:29.448047+0000","last_fullsized":"2024-09-10T08:44:29.448047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3897,"log_dups_size":0,"ondisk_log_size":3897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:05.848341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20646,"num_write_kb":258901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"27'4919","reported_seq":4949,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.470476+0000","last_change":"2024-09-10T08:28:35.578664+0000","last_active":"2024-09-10T08:44:22.470476+0000","last_peered":"2024-09-10T08:44:22.470476+0000","last_clean":"2024-09-10T08:44:22.470476+0000","last_became_active":"2024-09-10T08:28:35.578384+0000","last_became_peered":"2024-09-10T08:28:35.578384+0000","last_unstale":"2024-09-10T08:44:22.470476+0000","last_undegraded":"2024-09-10T08:44:22.470476+0000","last_fullsized":"2024-09-10T08:44:22.470476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4919,"log_dups_size":0,"ondisk_log_size":4919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:44.278718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25865,"num_write_kb":300415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"27'4164","reported_seq":4187,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.421617+0000","last_change":"2024-09-10T08:28:47.627593+0000","last_active":"2024-09-10T08:44:29.421617+0000","last_peered":"2024-09-10T08:44:29.421617+0000","last_clean":"2024-09-10T08:44:29.421617+0000","last_became_active":"2024-09-10T08:28:47.627237+0000","last_became_peered":"2024-09-10T08:28:47.627237+0000","last_unstale":"2024-09-10T08:44:29.421617+0000","last_undegraded":"2024-09-10T08:44:29.421617+0000","last_fullsized":"2024-09-10T08:44:29.421617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4164,"log_dups_size":0,"ondisk_log_size":4164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:16.045213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22780,"num_write_kb":275817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'3973","reported_seq":4003,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.535798+0000","last_change":"2024-09-10T08:28:35.578978+0000","last_active":"2024-09-10T08:44:22.535798+0000","last_peered":"2024-09-10T08:44:22.535798+0000","last_clean":"2024-09-10T08:44:22.535798+0000","last_became_active":"2024-09-10T08:28:35.578475+0000","last_became_peered":"2024-09-10T08:28:35.578475+0000","last_unstale":"2024-09-10T08:44:22.535798+0000","last_undegraded":"2024-09-10T08:44:22.535798+0000","last_fullsized":"2024-09-10T08:44:22.535798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3973,"log_dups_size":0,"ondisk_log_size":3973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:08.520314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20258,"num_write_kb":257321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"27'4520","reported_seq":4543,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.418567+0000","last_change":"2024-09-10T08:28:47.634072+0000","last_active":"2024-09-10T08:44:29.418567+0000","last_peered":"2024-09-10T08:44:29.418567+0000","last_clean":"2024-09-10T08:44:29.418567+0000","last_became_active":"2024-09-10T08:28:47.633776+0000","last_became_peered":"2024-09-10T08:28:47.633776+0000","last_unstale":"2024-09-10T08:44:29.418567+0000","last_undegraded":"2024-09-10T08:44:29.418567+0000","last_fullsized":"2024-09-10T08:44:29.418567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4520,"log_dups_size":0,"ondisk_log_size":4520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:30.690202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23464,"num_write_kb":303031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'5689","reported_seq":5719,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.552561+0000","last_change":"2024-09-10T08:28:35.572112+0000","last_active":"2024-09-10T08:44:22.552561+0000","last_peered":"2024-09-10T08:44:22.552561+0000","last_clean":"2024-09-10T08:44:22.552561+0000","last_became_active":"2024-09-10T08:28:35.571803+0000","last_became_peered":"2024-09-10T08:28:35.571803+0000","last_unstale":"2024-09-10T08:44:22.552561+0000","last_undegraded":"2024-09-10T08:44:22.552561+0000","last_fullsized":"2024-09-10T08:44:22.552561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5689,"log_dups_size":0,"ondisk_log_size":5689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:29.969987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28713,"num_write_kb":356779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"27'3638","reported_seq":3660,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456832+0000","last_change":"2024-09-10T08:28:47.620523+0000","last_active":"2024-09-10T08:44:29.456832+0000","last_peered":"2024-09-10T08:44:29.456832+0000","last_clean":"2024-09-10T08:44:29.456832+0000","last_became_active":"2024-09-10T08:28:47.620220+0000","last_became_peered":"2024-09-10T08:28:47.620220+0000","last_unstale":"2024-09-10T08:44:29.456832+0000","last_undegraded":"2024-09-10T08:44:29.456832+0000","last_fullsized":"2024-09-10T08:44:29.456832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3638,"log_dups_size":0,"ondisk_log_size":3638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:14.405210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18717,"num_write_kb":251073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"27'4254","reported_seq":4285,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.514815+0000","last_change":"2024-09-10T08:28:35.578961+0000","last_active":"2024-09-10T08:44:22.514815+0000","last_peered":"2024-09-10T08:44:22.514815+0000","last_clean":"2024-09-10T08:44:22.514815+0000","last_became_active":"2024-09-10T08:28:35.578680+0000","last_became_peered":"2024-09-10T08:28:35.578680+0000","last_unstale":"2024-09-10T08:44:22.514815+0000","last_undegraded":"2024-09-10T08:44:22.514815+0000","last_fullsized":"2024-09-10T08:44:22.514815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4254,"log_dups_size":0,"ondisk_log_size":4254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:53.737412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22529,"num_write_kb":274609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"27'5728","reported_seq":5750,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.335399+0000","last_change":"2024-09-10T08:28:47.624859+0000","last_active":"2024-09-10T08:44:29.335399+0000","last_peered":"2024-09-10T08:44:29.335399+0000","last_clean":"2024-09-10T08:44:29.335399+0000","last_became_active":"2024-09-10T08:28:47.624585+0000","last_became_peered":"2024-09-10T08:28:47.624585+0000","last_unstale":"2024-09-10T08:44:29.335399+0000","last_undegraded":"2024-09-10T08:44:29.335399+0000","last_fullsized":"2024-09-10T08:44:29.335399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5728,"log_dups_size":0,"ondisk_log_size":5728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:00.956870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28703,"num_write_kb":356727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'4780","reported_seq":4811,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.475999+0000","last_change":"2024-09-10T08:28:35.573918+0000","last_active":"2024-09-10T08:44:22.475999+0000","last_peered":"2024-09-10T08:44:22.475999+0000","last_clean":"2024-09-10T08:44:22.475999+0000","last_became_active":"2024-09-10T08:28:35.573646+0000","last_became_peered":"2024-09-10T08:28:35.573646+0000","last_unstale":"2024-09-10T08:44:22.475999+0000","last_undegraded":"2024-09-10T08:44:22.475999+0000","last_fullsized":"2024-09-10T08:44:22.475999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4780,"log_dups_size":0,"ondisk_log_size":4780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:24.295630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24418,"num_write_kb":306743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"27'4700","reported_seq":4722,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.478952+0000","last_change":"2024-09-10T08:28:47.631802+0000","last_active":"2024-09-10T08:44:29.478952+0000","last_peered":"2024-09-10T08:44:29.478952+0000","last_clean":"2024-09-10T08:44:29.478952+0000","last_became_active":"2024-09-10T08:28:47.631456+0000","last_became_peered":"2024-09-10T08:28:47.631456+0000","last_unstale":"2024-09-10T08:44:29.478952+0000","last_undegraded":"2024-09-10T08:44:29.478952+0000","last_fullsized":"2024-09-10T08:44:29.478952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4700,"log_dups_size":0,"ondisk_log_size":4700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:56.571659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23620,"num_write_kb":315928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'5816","reported_seq":5847,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.453619+0000","last_change":"2024-09-10T08:28:35.578197+0000","last_active":"2024-09-10T08:44:22.453619+0000","last_peered":"2024-09-10T08:44:22.453619+0000","last_clean":"2024-09-10T08:44:22.453619+0000","last_became_active":"2024-09-10T08:28:35.577852+0000","last_became_peered":"2024-09-10T08:28:35.577852+0000","last_unstale":"2024-09-10T08:44:22.453619+0000","last_undegraded":"2024-09-10T08:44:22.453619+0000","last_fullsized":"2024-09-10T08:44:22.453619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5816,"log_dups_size":0,"ondisk_log_size":5816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:44.348299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30528,"num_write_kb":380548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"27'4272","reported_seq":4294,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.370484+0000","last_change":"2024-09-10T08:28:47.629993+0000","last_active":"2024-09-10T08:44:29.370484+0000","last_peered":"2024-09-10T08:44:29.370484+0000","last_clean":"2024-09-10T08:44:29.370484+0000","last_became_active":"2024-09-10T08:28:47.629713+0000","last_became_peered":"2024-09-10T08:28:47.629713+0000","last_unstale":"2024-09-10T08:44:29.370484+0000","last_undegraded":"2024-09-10T08:44:29.370484+0000","last_fullsized":"2024-09-10T08:44:29.370484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4272,"log_dups_size":0,"ondisk_log_size":4272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:56.640722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22513,"num_write_kb":287067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"27'4101","reported_seq":4132,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.558949+0000","last_change":"2024-09-10T08:28:35.571065+0000","last_active":"2024-09-10T08:44:22.558949+0000","last_peered":"2024-09-10T08:44:22.558949+0000","last_clean":"2024-09-10T08:44:22.558949+0000","last_became_active":"2024-09-10T08:28:35.570749+0000","last_became_peered":"2024-09-10T08:28:35.570749+0000","last_unstale":"2024-09-10T08:44:22.558949+0000","last_undegraded":"2024-09-10T08:44:22.558949+0000","last_fullsized":"2024-09-10T08:44:22.558949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4101,"log_dups_size":0,"ondisk_log_size":4101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:04.628661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21304,"num_write_kb":261525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1506886,"num_write_kb":19151846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":286269,"ondisk_log_size":286269,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":17622670,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":51,"num_read_kb":121,"num_write":4293,"num_write_kb":18856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":35307520,"data_stored":35245340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3534,"ondisk_log_size":3534,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1565097,"num_write_kb":19381290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":301805,"ondisk_log_size":301805,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":17928438,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":58,"num_read_kb":129,"num_write":4368,"num_write_kb":19205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":35921920,"data_stored":35856876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3624,"ondisk_log_size":3624,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509637,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1140720,"kb_used_data":13152,"kb_used_omap":1,"kb_used_meta":1127550,"kb_avail":93231120,"statfs":{"total":96636764160,"available":95468666880,"internally_reserved":0,"allocated":13467648,"data_stored":13288824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1154611659},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509636,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1037512,"kb_used_data":4472,"kb_used_omap":1,"kb_used_meta":1033022,"kb_avail":93334328,"statfs":{"total":96636764160,"available":95574351872,"internally_reserved":0,"allocated":4579328,"data_stored":4398018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1057814981},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509638,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1082628,"kb_used_data":10356,"kb_used_omap":1,"kb_used_meta":1072254,"kb_avail":93289212,"statfs":{"total":96636764160,"available":95528153088,"internally_reserved":0,"allocated":10604544,"data_stored":10409366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1097988549},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509639,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1151860,"kb_used_data":17508,"kb_used_omap":1,"kb_used_meta":1134334,"kb_avail":93219980,"statfs":{"total":96636764160,"available":95457259520,"internally_reserved":0,"allocated":17928192,"data_stored":17737438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1161558471},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509638,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":892856,"kb_used_data":8488,"kb_used_omap":1,"kb_used_meta":884350,"kb_avail":93478984,"statfs":{"total":96636764160,"available":95722479616,"internally_reserved":0,"allocated":8691712,"data_stored":8504334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":905574853},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509637,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":911348,"kb_used_data":9060,"kb_used_omap":1,"kb_used_meta":902270,"kb_avail":93460492,"statfs":{"total":96636764160,"available":95703543808,"internally_reserved":0,"allocated":9277440,"data_stored":9094486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":923924933},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575044,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":775044,"kb_used_data":9524,"kb_used_omap":1,"kb_used_meta":765502,"kb_avail":93596796,"statfs":{"total":96636764160,"available":95843119104,"internally_reserved":0,"allocated":9752576,"data_stored":9566440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":783874503},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575047,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":725760,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":725374,"kb_avail":93646080,"statfs":{"total":96636764160,"available":95893585920,"internally_reserved":0,"allocated":376832,"data_stored":203022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":742783430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":88080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8477360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5271552,"data_stored":5256102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5267456,"data_stored":5256648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9158656,"data_stored":9145206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5050368,"data_stored":5038392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4292608,"data_stored":4283056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:44:36.455 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:44:36.455 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:44:36.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.587+0000 7f0f5b865640 1 Processor -- start 2024-09-10T08:44:36.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.587+0000 7f0f5b865640 1 -- start start 2024-09-10T08:44:36.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.588+0000 7f0f5b865640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0f541505f0 0x7f0f54153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:36.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.588+0000 7f0f5b865640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f540c5940 con 0x7f0f540c69c0 2024-09-10T08:44:36.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.588+0000 7f0f5b865640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f540c5c00 con 0x7f0f540c42b0 2024-09-10T08:44:36.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.588+0000 7f0f5b865640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f0f540c7860 con 0x7f0f541505f0 2024-09-10T08:44:36.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.588+0000 7f0f58e00640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0f540c69c0 0x7f0f540c2440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40852/0 (socket says 172.21.15.103:40852) 2024-09-10T08:44:36.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.588+0000 7f0f58e00640 1 -- 172.21.15.103:0/581300495 learned_addr learned my addr 172.21.15.103:0/581300495 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:44:36.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.588+0000 7f0f59601640 1 --2- 172.21.15.103:0/581300495 >> v2:172.21.15.103:3300/0 conn(0x7f0f541505f0 0x7f0f54153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:36.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.588+0000 7f0f4bfff640 1 -- 172.21.15.103:0/581300495 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 538863986 0 0) 0x7f0f540c5940 con 0x7f0f540c69c0 2024-09-10T08:44:36.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.588+0000 7f0f4bfff640 1 -- 172.21.15.103:0/581300495 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f40003520 con 0x7f0f540c69c0 2024-09-10T08:44:36.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.589+0000 7f0f59601640 1 -- 172.21.15.103:0/581300495 >> v1:172.21.15.154:6789/0 conn(0x7f0f540c42b0 legacy=0x7f0f540c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:36.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.589+0000 7f0f59601640 1 -- 172.21.15.103:0/581300495 >> v1:172.21.15.103:6789/0 conn(0x7f0f540c69c0 legacy=0x7f0f540c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:36.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.589+0000 7f0f59601640 1 -- 172.21.15.103:0/581300495 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f540c5ee0 con 0x7f0f541505f0 2024-09-10T08:44:36.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.589+0000 7f0f59601640 1 --2- 172.21.15.103:0/581300495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f541505f0 0x7f0f54153910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0f50009d90 tx=0x7f0f5002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef11df2b407172b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:36.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.589+0000 7f0f4bfff640 1 -- 172.21.15.103:0/581300495 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f50007740 con 0x7f0f541505f0 2024-09-10T08:44:36.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.589+0000 7f0f4bfff640 1 -- 172.21.15.103:0/581300495 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f500078e0 con 0x7f0f541505f0 2024-09-10T08:44:36.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.589+0000 7f0f4bfff640 1 -- 172.21.15.103:0/581300495 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f50007cb0 con 0x7f0f541505f0 2024-09-10T08:44:36.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.590+0000 7f0f5b865640 1 -- 172.21.15.103:0/581300495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f541505f0 msgr2=0x7f0f54153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:36.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.590+0000 7f0f5b865640 1 --2- 172.21.15.103:0/581300495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f541505f0 0x7f0f54153910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0f50009d90 tx=0x7f0f5002a660 comp rx=0 tx=0).stop 2024-09-10T08:44:36.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.590+0000 7f0f5b865640 1 -- 172.21.15.103:0/581300495 shutdown_connections 2024-09-10T08:44:36.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.590+0000 7f0f5b865640 1 --2- 172.21.15.103:0/581300495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f541505f0 0x7f0f54153910 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.590+0000 7f0f5b865640 1 -- 172.21.15.103:0/581300495 >> 172.21.15.103:0/581300495 conn(0x7f0f540c7a40 msgr2=0x7f0f540c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:36.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.590+0000 7f0f5b865640 1 -- 172.21.15.103:0/581300495 shutdown_connections 2024-09-10T08:44:36.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.590+0000 7f0f5b865640 1 -- 172.21.15.103:0/581300495 wait complete. 2024-09-10T08:44:36.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.591+0000 7f0f5b865640 1 Processor -- start 2024-09-10T08:44:36.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.591+0000 7f0f5b865640 1 -- start start 2024-09-10T08:44:36.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.592+0000 7f0f5b865640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f540c42b0 0x7f0f54148930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:36.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.592+0000 7f0f5b865640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f541505f0 0x7f0f54159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:36.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.592+0000 7f0f5b865640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f541efd80 0x7f0f5415a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:36.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.592+0000 7f0f5b865640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0f541509d0 con 0x7f0f541505f0 2024-09-10T08:44:36.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.592+0000 7f0f5b865640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0f540c64a0 con 0x7f0f540c42b0 2024-09-10T08:44:36.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.592+0000 7f0f5b865640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0f54150b50 con 0x7f0f541efd80 2024-09-10T08:44:36.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.592+0000 7f0f58e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f541505f0 0x7f0f54159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:36.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.592+0000 7f0f58e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f541505f0 0x7f0f54159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60570/0 (socket says 172.21.15.103:60570) 2024-09-10T08:44:36.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.592+0000 7f0f58e00640 1 -- 172.21.15.103:0/2707019279 learned_addr learned my addr 172.21.15.103:0/2707019279 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:36.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.592+0000 7f0f59601640 1 --2- 172.21.15.103:0/2707019279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f540c42b0 0x7f0f54148930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:36.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.592+0000 7f0f58e00640 1 -- 172.21.15.103:0/2707019279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f541efd80 msgr2=0x7f0f5415a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:36.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.592+0000 7f0f59e02640 1 --2- 172.21.15.103:0/2707019279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f541efd80 0x7f0f5415a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:36.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.592+0000 7f0f58e00640 1 --2- 172.21.15.103:0/2707019279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f541efd80 0x7f0f5415a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.592+0000 7f0f58e00640 1 -- 172.21.15.103:0/2707019279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f540c42b0 msgr2=0x7f0f54148930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:36.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.592+0000 7f0f58e00640 1 --2- 172.21.15.103:0/2707019279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f540c42b0 0x7f0f54148930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.592+0000 7f0f58e00640 1 -- 172.21.15.103:0/2707019279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f540abcf0 con 0x7f0f541505f0 2024-09-10T08:44:36.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.592+0000 7f0f59601640 1 --2- 172.21.15.103:0/2707019279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f540c42b0 0x7f0f54148930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:44:36.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.592+0000 7f0f59e02640 1 --2- 172.21.15.103:0/2707019279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f541efd80 0x7f0f5415a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:44:36.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.593+0000 7f0f58e00640 1 --2- 172.21.15.103:0/2707019279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f541505f0 0x7f0f54159db0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400c500 tx=0x7f0f4400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:36.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.593+0000 7f0f49ffb640 1 -- 172.21.15.103:0/2707019279 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44017070 con 0x7f0f541505f0 2024-09-10T08:44:36.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.593+0000 7f0f49ffb640 1 -- 172.21.15.103:0/2707019279 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f44005ce0 con 0x7f0f541505f0 2024-09-10T08:44:36.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.593+0000 7f0f5b865640 1 -- 172.21.15.103:0/2707019279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f540abfd0 con 0x7f0f541505f0 2024-09-10T08:44:36.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.593+0000 7f0f49ffb640 1 -- 172.21.15.103:0/2707019279 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44007330 con 0x7f0f541505f0 2024-09-10T08:44:36.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.593+0000 7f0f5b865640 1 -- 172.21.15.103:0/2707019279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f54148e70 con 0x7f0f541505f0 2024-09-10T08:44:36.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.594+0000 7f0f5b865640 1 -- 172.21.15.103:0/2707019279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f54157870 con 0x7f0f541505f0 2024-09-10T08:44:36.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.594+0000 7f0f49ffb640 1 -- 172.21.15.103:0/2707019279 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f4401a070 con 0x7f0f541505f0 2024-09-10T08:44:36.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.595+0000 7f0f49ffb640 1 --2- 172.21.15.103:0/2707019279 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0f3806be30 0x7f0f3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:36.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.595+0000 7f0f59601640 1 --2- 172.21.15.103:0/2707019279 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0f3806be30 0x7f0f3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:36.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.595+0000 7f0f49ffb640 1 -- 172.21.15.103:0/2707019279 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f0f4408a5b0 con 0x7f0f541505f0 2024-09-10T08:44:36.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.595+0000 7f0f59601640 1 --2- 172.21.15.103:0/2707019279 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0f3806be30 0x7f0f3806e2f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0f50034000 tx=0x7f0f50033040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:36.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.599+0000 7f0f49ffb640 1 -- 172.21.15.103:0/2707019279 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f54157870 con 0x7f0f541505f0 2024-09-10T08:44:36.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.762+0000 7f0f5b865640 1 -- 172.21.15.103:0/2707019279 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f54159900 con 0x7f0f3806be30 2024-09-10T08:44:36.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.773+0000 7f0f49ffb640 1 -- 172.21.15.103:0/2707019279 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+493688 (secure 0 0 0) 0x7f0f54159900 con 0x7f0f3806be30 2024-09-10T08:44:36.780 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:44:36.783 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T08:44:36.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.777+0000 7f0f5b865640 1 -- 172.21.15.103:0/2707019279 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0f3806be30 msgr2=0x7f0f3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:36.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.777+0000 7f0f5b865640 1 --2- 172.21.15.103:0/2707019279 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0f3806be30 0x7f0f3806e2f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0f50034000 tx=0x7f0f50033040 comp rx=0 tx=0).stop 2024-09-10T08:44:36.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.777+0000 7f0f5b865640 1 -- 172.21.15.103:0/2707019279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f541505f0 msgr2=0x7f0f54159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:36.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.777+0000 7f0f5b865640 1 --2- 172.21.15.103:0/2707019279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f541505f0 0x7f0f54159db0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400c500 tx=0x7f0f4400c9c0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.778+0000 7f0f5b865640 1 -- 172.21.15.103:0/2707019279 shutdown_connections 2024-09-10T08:44:36.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.778+0000 7f0f5b865640 1 --2- 172.21.15.103:0/2707019279 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0f3806be30 0x7f0f3806e2f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.778+0000 7f0f5b865640 1 --2- 172.21.15.103:0/2707019279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f541efd80 0x7f0f5415a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.778+0000 7f0f5b865640 1 --2- 172.21.15.103:0/2707019279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f541505f0 0x7f0f54159db0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.778+0000 7f0f5b865640 1 --2- 172.21.15.103:0/2707019279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f540c42b0 0x7f0f54148930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.778+0000 7f0f5b865640 1 -- 172.21.15.103:0/2707019279 >> 172.21.15.103:0/2707019279 conn(0x7f0f540c7a40 msgr2=0x7f0f540c4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:36.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.778+0000 7f0f5b865640 1 -- 172.21.15.103:0/2707019279 shutdown_connections 2024-09-10T08:44:36.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.778+0000 7f0f5b865640 1 -- 172.21.15.103:0/2707019279 wait complete. 2024-09-10T08:44:36.790 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":506,"stamp":"2024-09-10T08:44:35.061987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36141476,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":225,"num_read_kb":350,"num_write":3080803,"num_write_kb":38573613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":595349,"ondisk_log_size":595349,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7717728,"kb_used_data":72928,"kb_used_omap":12,"kb_used_meta":7644659,"kb_avail":747256992,"statfs":{"total":773094113280,"available":765191159808,"internally_reserved":0,"allocated":74678272,"data_stored":73201928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":7828131379},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":498,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003383"},"pg_stats":[{"pgid":"5.18","version":"27'4501","reported_seq":4523,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.380600+0000","last_change":"2024-09-10T08:28:47.627476+0000","last_active":"2024-09-10T08:44:29.380600+0000","last_peered":"2024-09-10T08:44:29.380600+0000","last_clean":"2024-09-10T08:44:29.380600+0000","last_became_active":"2024-09-10T08:28:47.627217+0000","last_became_peered":"2024-09-10T08:28:47.627217+0000","last_unstale":"2024-09-10T08:44:29.380600+0000","last_undegraded":"2024-09-10T08:44:29.380600+0000","last_fullsized":"2024-09-10T08:44:29.380600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":0,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:25.152836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23743,"num_write_kb":296073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"27'672","reported_seq":705,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:32.511067+0000","last_change":"2024-09-10T08:28:34.564816+0000","last_active":"2024-09-10T08:43:32.511067+0000","last_peered":"2024-09-10T08:43:32.511067+0000","last_clean":"2024-09-10T08:43:32.511067+0000","last_became_active":"2024-09-10T08:28:34.564545+0000","last_became_peered":"2024-09-10T08:28:34.564545+0000","last_unstale":"2024-09-10T08:43:32.511067+0000","last_undegraded":"2024-09-10T08:43:32.511067+0000","last_fullsized":"2024-09-10T08:43:32.511067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:34.365104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":670,"num_write_kb":4473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5460","reported_seq":5491,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.446984+0000","last_change":"2024-09-10T08:28:35.575267+0000","last_active":"2024-09-10T08:44:22.446984+0000","last_peered":"2024-09-10T08:44:22.446984+0000","last_clean":"2024-09-10T08:44:22.446984+0000","last_became_active":"2024-09-10T08:28:35.575019+0000","last_became_peered":"2024-09-10T08:28:35.575019+0000","last_unstale":"2024-09-10T08:44:22.446984+0000","last_undegraded":"2024-09-10T08:44:22.446984+0000","last_fullsized":"2024-09-10T08:44:22.446984+0000","mapping_epoch":19,"log_start":"27'200","ondisk_log_start":"27'200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5260,"log_dups_size":0,"ondisk_log_size":5260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:00.810645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28693,"num_write_kb":332310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:16.827314+0000","last_change":"2024-09-10T08:28:46.620227+0000","last_active":"2024-09-10T08:43:16.827314+0000","last_peered":"2024-09-10T08:43:16.827314+0000","last_clean":"2024-09-10T08:43:16.827314+0000","last_became_active":"2024-09-10T08:28:46.619540+0000","last_became_peered":"2024-09-10T08:28:46.619540+0000","last_unstale":"2024-09-10T08:43:16.827314+0000","last_undegraded":"2024-09-10T08:43:16.827314+0000","last_fullsized":"2024-09-10T08:43:16.827314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:13.402155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"27'5259","reported_seq":5281,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.450085+0000","last_change":"2024-09-10T08:28:47.633586+0000","last_active":"2024-09-10T08:44:29.450085+0000","last_peered":"2024-09-10T08:44:29.450085+0000","last_clean":"2024-09-10T08:44:29.450085+0000","last_became_active":"2024-09-10T08:28:47.633292+0000","last_became_peered":"2024-09-10T08:28:47.633292+0000","last_unstale":"2024-09-10T08:44:29.450085+0000","last_undegraded":"2024-09-10T08:44:29.450085+0000","last_fullsized":"2024-09-10T08:44:29.450085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5259,"log_dups_size":0,"ondisk_log_size":5259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:19.473028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27465,"num_write_kb":347758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"27'8","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.983363+0000","last_change":"2024-09-10T08:28:34.561691+0000","last_active":"2024-09-10T08:43:47.983363+0000","last_peered":"2024-09-10T08:43:47.983363+0000","last_clean":"2024-09-10T08:43:47.983363+0000","last_became_active":"2024-09-10T08:28:34.561410+0000","last_became_peered":"2024-09-10T08:28:34.561410+0000","last_unstale":"2024-09-10T08:43:47.983363+0000","last_undegraded":"2024-09-10T08:43:47.983363+0000","last_fullsized":"2024-09-10T08:43:47.983363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.629982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'5545","reported_seq":5576,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.505223+0000","last_change":"2024-09-10T08:28:35.579033+0000","last_active":"2024-09-10T08:44:22.505223+0000","last_peered":"2024-09-10T08:44:22.505223+0000","last_clean":"2024-09-10T08:44:22.505223+0000","last_became_active":"2024-09-10T08:28:35.578333+0000","last_became_peered":"2024-09-10T08:28:35.578333+0000","last_unstale":"2024-09-10T08:44:22.505223+0000","last_undegraded":"2024-09-10T08:44:22.505223+0000","last_fullsized":"2024-09-10T08:44:22.505223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5545,"log_dups_size":0,"ondisk_log_size":5545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:58.779491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29606,"num_write_kb":364444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:31.334990+0000","last_change":"2024-09-10T08:28:46.617317+0000","last_active":"2024-09-10T08:43:31.334990+0000","last_peered":"2024-09-10T08:43:31.334990+0000","last_clean":"2024-09-10T08:43:31.334990+0000","last_became_active":"2024-09-10T08:28:46.616806+0000","last_became_peered":"2024-09-10T08:28:46.616806+0000","last_unstale":"2024-09-10T08:43:31.334990+0000","last_undegraded":"2024-09-10T08:43:31.334990+0000","last_fullsized":"2024-09-10T08:43:31.334990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:46.916848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"27'4143","reported_seq":4165,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.444464+0000","last_change":"2024-09-10T08:28:47.633194+0000","last_active":"2024-09-10T08:44:29.444464+0000","last_peered":"2024-09-10T08:44:29.444464+0000","last_clean":"2024-09-10T08:44:29.444464+0000","last_became_active":"2024-09-10T08:28:47.632772+0000","last_became_peered":"2024-09-10T08:28:47.632772+0000","last_unstale":"2024-09-10T08:44:29.444464+0000","last_undegraded":"2024-09-10T08:44:29.444464+0000","last_fullsized":"2024-09-10T08:44:29.444464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4143,"log_dups_size":0,"ondisk_log_size":4143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:59.228438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21394,"num_write_kb":261850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"27'11","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.989437+0000","last_change":"2024-09-10T08:28:34.571965+0000","last_active":"2024-09-10T08:43:47.989437+0000","last_peered":"2024-09-10T08:43:47.989437+0000","last_clean":"2024-09-10T08:43:47.989437+0000","last_became_active":"2024-09-10T08:28:34.571640+0000","last_became_peered":"2024-09-10T08:28:34.571640+0000","last_unstale":"2024-09-10T08:43:47.989437+0000","last_undegraded":"2024-09-10T08:43:47.989437+0000","last_fullsized":"2024-09-10T08:43:47.989437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:53.047030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'3192","reported_seq":3222,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.520724+0000","last_change":"2024-09-10T08:28:35.562132+0000","last_active":"2024-09-10T08:44:22.520724+0000","last_peered":"2024-09-10T08:44:22.520724+0000","last_clean":"2024-09-10T08:44:22.520724+0000","last_became_active":"2024-09-10T08:28:35.561842+0000","last_became_peered":"2024-09-10T08:28:35.561842+0000","last_unstale":"2024-09-10T08:44:22.520724+0000","last_undegraded":"2024-09-10T08:44:22.520724+0000","last_fullsized":"2024-09-10T08:44:22.520724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3192,"log_dups_size":0,"ondisk_log_size":3192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:48.810258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15765,"num_write_kb":210601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'613","reported_seq":637,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:30.437035+0000","last_change":"2024-09-10T08:28:46.621093+0000","last_active":"2024-09-10T08:43:30.437035+0000","last_peered":"2024-09-10T08:43:30.437035+0000","last_clean":"2024-09-10T08:43:30.437035+0000","last_became_active":"2024-09-10T08:28:46.620794+0000","last_became_peered":"2024-09-10T08:28:46.620794+0000","last_unstale":"2024-09-10T08:43:30.437035+0000","last_undegraded":"2024-09-10T08:43:30.437035+0000","last_fullsized":"2024-09-10T08:43:30.437035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:20.501262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":611,"num_write_kb":4232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"27'3484","reported_seq":3506,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.377089+0000","last_change":"2024-09-10T08:28:47.627756+0000","last_active":"2024-09-10T08:44:29.377089+0000","last_peered":"2024-09-10T08:44:29.377089+0000","last_clean":"2024-09-10T08:44:29.377089+0000","last_became_active":"2024-09-10T08:28:47.627476+0000","last_became_peered":"2024-09-10T08:28:47.627476+0000","last_unstale":"2024-09-10T08:44:29.377089+0000","last_undegraded":"2024-09-10T08:44:29.377089+0000","last_fullsized":"2024-09-10T08:44:29.377089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:25.945793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18057,"num_write_kb":232111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"27'3","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:38.481193+0000","last_change":"2024-09-10T08:28:34.566560+0000","last_active":"2024-09-10T08:43:38.481193+0000","last_peered":"2024-09-10T08:43:38.481193+0000","last_clean":"2024-09-10T08:43:38.481193+0000","last_became_active":"2024-09-10T08:28:34.566275+0000","last_became_peered":"2024-09-10T08:28:34.566275+0000","last_unstale":"2024-09-10T08:43:38.481193+0000","last_undegraded":"2024-09-10T08:43:38.481193+0000","last_fullsized":"2024-09-10T08:43:38.481193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:03.507683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'5826","reported_seq":5841,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.521297+0000","last_change":"2024-09-10T08:29:35.097937+0000","last_active":"2024-09-10T08:44:22.521297+0000","last_peered":"2024-09-10T08:44:22.521297+0000","last_clean":"2024-09-10T08:44:22.521297+0000","last_became_active":"2024-09-10T08:29:35.097553+0000","last_became_peered":"2024-09-10T08:29:35.097553+0000","last_unstale":"2024-09-10T08:44:22.521297+0000","last_undegraded":"2024-09-10T08:44:22.521297+0000","last_fullsized":"2024-09-10T08:44:22.521297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5826,"log_dups_size":0,"ondisk_log_size":5826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:02.685992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30231,"num_write_kb":366977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"27'66","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.247916+0000","last_change":"2024-09-10T08:28:46.620162+0000","last_active":"2024-09-10T08:44:29.247916+0000","last_peered":"2024-09-10T08:44:29.247916+0000","last_clean":"2024-09-10T08:44:29.247916+0000","last_became_active":"2024-09-10T08:28:46.619889+0000","last_became_peered":"2024-09-10T08:28:46.619889+0000","last_unstale":"2024-09-10T08:44:29.247916+0000","last_undegraded":"2024-09-10T08:44:29.247916+0000","last_fullsized":"2024-09-10T08:44:29.247916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:13.820143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":755904,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"27'4988","reported_seq":5010,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.392676+0000","last_change":"2024-09-10T08:28:47.631094+0000","last_active":"2024-09-10T08:44:29.392676+0000","last_peered":"2024-09-10T08:44:29.392676+0000","last_clean":"2024-09-10T08:44:29.392676+0000","last_became_active":"2024-09-10T08:28:47.630787+0000","last_became_peered":"2024-09-10T08:28:47.630787+0000","last_unstale":"2024-09-10T08:44:29.392676+0000","last_undegraded":"2024-09-10T08:44:29.392676+0000","last_fullsized":"2024-09-10T08:44:29.392676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4988,"log_dups_size":0,"ondisk_log_size":4988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:06.277094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26081,"num_write_kb":317657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"27'4088","reported_seq":4119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.452804+0000","last_change":"2024-09-10T08:28:35.572478+0000","last_active":"2024-09-10T08:44:22.452804+0000","last_peered":"2024-09-10T08:44:22.452804+0000","last_clean":"2024-09-10T08:44:22.452804+0000","last_became_active":"2024-09-10T08:28:35.572215+0000","last_became_peered":"2024-09-10T08:28:35.572215+0000","last_unstale":"2024-09-10T08:44:22.452804+0000","last_undegraded":"2024-09-10T08:44:22.452804+0000","last_fullsized":"2024-09-10T08:44:22.452804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4088,"log_dups_size":0,"ondisk_log_size":4088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:40.397318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21444,"num_write_kb":270258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'1129","reported_seq":1162,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.009048+0000","last_change":"2024-09-10T08:28:34.569235+0000","last_active":"2024-09-10T08:43:48.009048+0000","last_peered":"2024-09-10T08:43:48.009048+0000","last_clean":"2024-09-10T08:43:48.009048+0000","last_became_active":"2024-09-10T08:28:34.568899+0000","last_became_peered":"2024-09-10T08:28:34.568899+0000","last_unstale":"2024-09-10T08:43:48.009048+0000","last_undegraded":"2024-09-10T08:43:48.009048+0000","last_fullsized":"2024-09-10T08:43:48.009048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1129,"log_dups_size":0,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:21.927656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:30.440512+0000","last_change":"2024-09-10T08:28:46.618502+0000","last_active":"2024-09-10T08:43:30.440512+0000","last_peered":"2024-09-10T08:43:30.440512+0000","last_clean":"2024-09-10T08:43:30.440512+0000","last_became_active":"2024-09-10T08:28:46.616824+0000","last_became_peered":"2024-09-10T08:28:46.616824+0000","last_unstale":"2024-09-10T08:43:30.440512+0000","last_undegraded":"2024-09-10T08:43:30.440512+0000","last_fullsized":"2024-09-10T08:43:30.440512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:06.554102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"27'4540","reported_seq":4563,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.406451+0000","last_change":"2024-09-10T08:28:47.627138+0000","last_active":"2024-09-10T08:44:29.406451+0000","last_peered":"2024-09-10T08:44:29.406451+0000","last_clean":"2024-09-10T08:44:29.406451+0000","last_became_active":"2024-09-10T08:28:47.626871+0000","last_became_peered":"2024-09-10T08:28:47.626871+0000","last_unstale":"2024-09-10T08:44:29.406451+0000","last_undegraded":"2024-09-10T08:44:29.406451+0000","last_fullsized":"2024-09-10T08:44:29.406451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4540,"log_dups_size":0,"ondisk_log_size":4540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:10.927283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23818,"num_write_kb":300351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"27'4200","reported_seq":4231,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.491988+0000","last_change":"2024-09-10T08:28:35.577024+0000","last_active":"2024-09-10T08:44:22.491988+0000","last_peered":"2024-09-10T08:44:22.491988+0000","last_clean":"2024-09-10T08:44:22.491988+0000","last_became_active":"2024-09-10T08:28:35.576771+0000","last_became_peered":"2024-09-10T08:28:35.576771+0000","last_unstale":"2024-09-10T08:44:22.491988+0000","last_undegraded":"2024-09-10T08:44:22.491988+0000","last_fullsized":"2024-09-10T08:44:22.491988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4200,"log_dups_size":0,"ondisk_log_size":4200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:07.162941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21158,"num_write_kb":256901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.001370+0000","last_change":"2024-09-10T08:28:34.561324+0000","last_active":"2024-09-10T08:43:48.001370+0000","last_peered":"2024-09-10T08:43:48.001370+0000","last_clean":"2024-09-10T08:43:48.001370+0000","last_became_active":"2024-09-10T08:28:34.560974+0000","last_became_peered":"2024-09-10T08:28:34.560974+0000","last_unstale":"2024-09-10T08:43:48.001370+0000","last_undegraded":"2024-09-10T08:43:48.001370+0000","last_fullsized":"2024-09-10T08:43:48.001370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:18.790965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.763262+0000","last_change":"2024-09-10T08:28:46.620411+0000","last_active":"2024-09-10T08:43:37.763262+0000","last_peered":"2024-09-10T08:43:37.763262+0000","last_clean":"2024-09-10T08:43:37.763262+0000","last_became_active":"2024-09-10T08:28:46.619553+0000","last_became_peered":"2024-09-10T08:28:46.619553+0000","last_unstale":"2024-09-10T08:43:37.763262+0000","last_undegraded":"2024-09-10T08:43:37.763262+0000","last_fullsized":"2024-09-10T08:43:37.763262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:04.414048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"27'4215","reported_seq":4237,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.402749+0000","last_change":"2024-09-10T08:28:47.628563+0000","last_active":"2024-09-10T08:44:29.402749+0000","last_peered":"2024-09-10T08:44:29.402749+0000","last_clean":"2024-09-10T08:44:29.402749+0000","last_became_active":"2024-09-10T08:28:47.628290+0000","last_became_peered":"2024-09-10T08:28:47.628290+0000","last_unstale":"2024-09-10T08:44:29.402749+0000","last_undegraded":"2024-09-10T08:44:29.402749+0000","last_fullsized":"2024-09-10T08:44:29.402749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:15.652718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21334,"num_write_kb":282217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'4711","reported_seq":4742,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.503605+0000","last_change":"2024-09-10T08:28:35.572363+0000","last_active":"2024-09-10T08:44:22.503605+0000","last_peered":"2024-09-10T08:44:22.503605+0000","last_clean":"2024-09-10T08:44:22.503605+0000","last_became_active":"2024-09-10T08:28:35.572108+0000","last_became_peered":"2024-09-10T08:28:35.572108+0000","last_unstale":"2024-09-10T08:44:22.503605+0000","last_undegraded":"2024-09-10T08:44:22.503605+0000","last_fullsized":"2024-09-10T08:44:22.503605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4711,"log_dups_size":0,"ondisk_log_size":4711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:48.358634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24668,"num_write_kb":303691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.969574+0000","last_change":"2024-09-10T08:28:34.564813+0000","last_active":"2024-09-10T08:43:47.969574+0000","last_peered":"2024-09-10T08:43:47.969574+0000","last_clean":"2024-09-10T08:43:47.969574+0000","last_became_active":"2024-09-10T08:28:34.564557+0000","last_became_peered":"2024-09-10T08:28:34.564557+0000","last_unstale":"2024-09-10T08:43:47.969574+0000","last_undegraded":"2024-09-10T08:43:47.969574+0000","last_fullsized":"2024-09-10T08:43:47.969574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:48.356069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.846008+0000","last_change":"2024-09-10T08:28:46.625346+0000","last_active":"2024-09-10T08:43:37.846008+0000","last_peered":"2024-09-10T08:43:37.846008+0000","last_clean":"2024-09-10T08:43:37.846008+0000","last_became_active":"2024-09-10T08:28:46.625059+0000","last_became_peered":"2024-09-10T08:28:46.625059+0000","last_unstale":"2024-09-10T08:43:37.846008+0000","last_undegraded":"2024-09-10T08:43:37.846008+0000","last_fullsized":"2024-09-10T08:43:37.846008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:44.512285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"27'5035","reported_seq":5057,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.447853+0000","last_change":"2024-09-10T08:28:47.621307+0000","last_active":"2024-09-10T08:44:29.447853+0000","last_peered":"2024-09-10T08:44:29.447853+0000","last_clean":"2024-09-10T08:44:29.447853+0000","last_became_active":"2024-09-10T08:28:47.621043+0000","last_became_peered":"2024-09-10T08:28:47.621043+0000","last_unstale":"2024-09-10T08:44:29.447853+0000","last_undegraded":"2024-09-10T08:44:29.447853+0000","last_fullsized":"2024-09-10T08:44:29.447853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5035,"log_dups_size":0,"ondisk_log_size":5035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:30.300108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25734,"num_write_kb":340789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"27'4207","reported_seq":4238,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.428180+0000","last_change":"2024-09-10T08:28:35.569938+0000","last_active":"2024-09-10T08:44:22.428180+0000","last_peered":"2024-09-10T08:44:22.428180+0000","last_clean":"2024-09-10T08:44:22.428180+0000","last_became_active":"2024-09-10T08:28:35.569109+0000","last_became_peered":"2024-09-10T08:28:35.569109+0000","last_unstale":"2024-09-10T08:44:22.428180+0000","last_undegraded":"2024-09-10T08:44:22.428180+0000","last_fullsized":"2024-09-10T08:44:22.428180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4207,"log_dups_size":0,"ondisk_log_size":4207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:51.680564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21000,"num_write_kb":276623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.000341+0000","last_change":"2024-09-10T08:28:34.571069+0000","last_active":"2024-09-10T08:43:48.000341+0000","last_peered":"2024-09-10T08:43:48.000341+0000","last_clean":"2024-09-10T08:43:48.000341+0000","last_became_active":"2024-09-10T08:28:34.570766+0000","last_became_peered":"2024-09-10T08:28:34.570766+0000","last_unstale":"2024-09-10T08:43:48.000341+0000","last_undegraded":"2024-09-10T08:43:48.000341+0000","last_fullsized":"2024-09-10T08:43:48.000341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:47.458195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.830412+0000","last_change":"2024-09-10T08:28:46.616531+0000","last_active":"2024-09-10T08:43:37.830412+0000","last_peered":"2024-09-10T08:43:37.830412+0000","last_clean":"2024-09-10T08:43:37.830412+0000","last_became_active":"2024-09-10T08:28:46.616254+0000","last_became_peered":"2024-09-10T08:28:46.616254+0000","last_unstale":"2024-09-10T08:43:37.830412+0000","last_undegraded":"2024-09-10T08:43:37.830412+0000","last_fullsized":"2024-09-10T08:43:37.830412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:44.162368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"27'4342","reported_seq":4365,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.372206+0000","last_change":"2024-09-10T08:28:47.628177+0000","last_active":"2024-09-10T08:44:29.372206+0000","last_peered":"2024-09-10T08:44:29.372206+0000","last_clean":"2024-09-10T08:44:29.372206+0000","last_became_active":"2024-09-10T08:28:47.627869+0000","last_became_peered":"2024-09-10T08:28:47.627869+0000","last_unstale":"2024-09-10T08:44:29.372206+0000","last_undegraded":"2024-09-10T08:44:29.372206+0000","last_fullsized":"2024-09-10T08:44:29.372206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:19.075558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23056,"num_write_kb":285008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"27'4228","reported_seq":4259,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.456227+0000","last_change":"2024-09-10T08:28:35.575106+0000","last_active":"2024-09-10T08:44:22.456227+0000","last_peered":"2024-09-10T08:44:22.456227+0000","last_clean":"2024-09-10T08:44:22.456227+0000","last_became_active":"2024-09-10T08:28:35.574815+0000","last_became_peered":"2024-09-10T08:28:35.574815+0000","last_unstale":"2024-09-10T08:44:22.456227+0000","last_undegraded":"2024-09-10T08:44:22.456227+0000","last_fullsized":"2024-09-10T08:44:22.456227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4228,"log_dups_size":0,"ondisk_log_size":4228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:21:26.512181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21299,"num_write_kb":257333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.990461+0000","last_change":"2024-09-10T08:28:34.564865+0000","last_active":"2024-09-10T08:43:47.990461+0000","last_peered":"2024-09-10T08:43:47.990461+0000","last_clean":"2024-09-10T08:43:47.990461+0000","last_became_active":"2024-09-10T08:28:34.564549+0000","last_became_peered":"2024-09-10T08:28:34.564549+0000","last_unstale":"2024-09-10T08:43:47.990461+0000","last_undegraded":"2024-09-10T08:43:47.990461+0000","last_fullsized":"2024-09-10T08:43:47.990461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:05.523637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'53","reported_seq":129,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:43.064352+0000","last_change":"2024-09-10T08:28:46.622505+0000","last_active":"2024-09-10T08:43:43.064352+0000","last_peered":"2024-09-10T08:43:43.064352+0000","last_clean":"2024-09-10T08:43:43.064352+0000","last_became_active":"2024-09-10T08:28:46.621052+0000","last_became_peered":"2024-09-10T08:28:46.621052+0000","last_unstale":"2024-09-10T08:43:43.064352+0000","last_undegraded":"2024-09-10T08:43:43.064352+0000","last_fullsized":"2024-09-10T08:43:43.064352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:37.411404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":121,"num_write":51,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"27'4494","reported_seq":4517,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.358623+0000","last_change":"2024-09-10T08:28:47.624919+0000","last_active":"2024-09-10T08:44:29.358623+0000","last_peered":"2024-09-10T08:44:29.358623+0000","last_clean":"2024-09-10T08:44:29.358623+0000","last_became_active":"2024-09-10T08:28:47.624651+0000","last_became_peered":"2024-09-10T08:28:47.624651+0000","last_unstale":"2024-09-10T08:44:29.358623+0000","last_undegraded":"2024-09-10T08:44:29.358623+0000","last_fullsized":"2024-09-10T08:44:29.358623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4494,"log_dups_size":0,"ondisk_log_size":4494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:11.049160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23585,"num_write_kb":291272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'4460","reported_seq":4491,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.508365+0000","last_change":"2024-09-10T08:28:35.574107+0000","last_active":"2024-09-10T08:44:22.508365+0000","last_peered":"2024-09-10T08:44:22.508365+0000","last_clean":"2024-09-10T08:44:22.508365+0000","last_became_active":"2024-09-10T08:28:35.573851+0000","last_became_peered":"2024-09-10T08:28:35.573851+0000","last_unstale":"2024-09-10T08:44:22.508365+0000","last_undegraded":"2024-09-10T08:44:22.508365+0000","last_fullsized":"2024-09-10T08:44:22.508365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4460,"log_dups_size":0,"ondisk_log_size":4460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:53.240223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22566,"num_write_kb":290967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'599","reported_seq":632,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.994651+0000","last_change":"2024-09-10T08:28:34.563451+0000","last_active":"2024-09-10T08:43:47.994651+0000","last_peered":"2024-09-10T08:43:47.994651+0000","last_clean":"2024-09-10T08:43:47.994651+0000","last_became_active":"2024-09-10T08:28:34.563259+0000","last_became_peered":"2024-09-10T08:28:34.563259+0000","last_unstale":"2024-09-10T08:43:47.994651+0000","last_undegraded":"2024-09-10T08:43:47.994651+0000","last_fullsized":"2024-09-10T08:43:47.994651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:44.899351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1430,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.807587+0000","last_change":"2024-09-10T08:28:46.623396+0000","last_active":"2024-09-10T08:43:37.807587+0000","last_peered":"2024-09-10T08:43:37.807587+0000","last_clean":"2024-09-10T08:43:37.807587+0000","last_became_active":"2024-09-10T08:28:46.623139+0000","last_became_peered":"2024-09-10T08:28:46.623139+0000","last_unstale":"2024-09-10T08:43:37.807587+0000","last_undegraded":"2024-09-10T08:43:37.807587+0000","last_fullsized":"2024-09-10T08:43:37.807587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:00.210413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"27'4787","reported_seq":4810,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.341999+0000","last_change":"2024-09-10T08:28:47.634754+0000","last_active":"2024-09-10T08:44:29.341999+0000","last_peered":"2024-09-10T08:44:29.341999+0000","last_clean":"2024-09-10T08:44:29.341999+0000","last_became_active":"2024-09-10T08:28:47.634382+0000","last_became_peered":"2024-09-10T08:28:47.634382+0000","last_unstale":"2024-09-10T08:44:29.341999+0000","last_undegraded":"2024-09-10T08:44:29.341999+0000","last_fullsized":"2024-09-10T08:44:29.341999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4787,"log_dups_size":0,"ondisk_log_size":4787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:23.489596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24922,"num_write_kb":313092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"27'4927","reported_seq":4958,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.461013+0000","last_change":"2024-09-10T08:28:35.567481+0000","last_active":"2024-09-10T08:44:22.461013+0000","last_peered":"2024-09-10T08:44:22.461013+0000","last_clean":"2024-09-10T08:44:22.461013+0000","last_became_active":"2024-09-10T08:28:35.567167+0000","last_became_peered":"2024-09-10T08:28:35.567167+0000","last_unstale":"2024-09-10T08:44:22.461013+0000","last_undegraded":"2024-09-10T08:44:22.461013+0000","last_fullsized":"2024-09-10T08:44:22.461013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4927,"log_dups_size":0,"ondisk_log_size":4927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:44.110012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25981,"num_write_kb":313006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.989517+0000","last_change":"2024-09-10T08:28:34.571283+0000","last_active":"2024-09-10T08:43:47.989517+0000","last_peered":"2024-09-10T08:43:47.989517+0000","last_clean":"2024-09-10T08:43:47.989517+0000","last_became_active":"2024-09-10T08:28:34.570791+0000","last_became_peered":"2024-09-10T08:28:34.570791+0000","last_unstale":"2024-09-10T08:43:47.989517+0000","last_undegraded":"2024-09-10T08:43:47.989517+0000","last_fullsized":"2024-09-10T08:43:47.989517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:17.427597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'1","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:41:21.022972+0000","last_change":"2024-09-10T08:28:46.630983+0000","last_active":"2024-09-10T08:41:21.022972+0000","last_peered":"2024-09-10T08:41:21.022972+0000","last_clean":"2024-09-10T08:41:21.022972+0000","last_became_active":"2024-09-10T08:28:46.630658+0000","last_became_peered":"2024-09-10T08:28:46.630658+0000","last_unstale":"2024-09-10T08:41:21.022972+0000","last_undegraded":"2024-09-10T08:41:21.022972+0000","last_fullsized":"2024-09-10T08:41:21.022972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:11.219022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"27'4308","reported_seq":4331,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.418231+0000","last_change":"2024-09-10T08:28:47.625475+0000","last_active":"2024-09-10T08:44:29.418231+0000","last_peered":"2024-09-10T08:44:29.418231+0000","last_clean":"2024-09-10T08:44:29.418231+0000","last_became_active":"2024-09-10T08:28:47.625186+0000","last_became_peered":"2024-09-10T08:28:47.625186+0000","last_unstale":"2024-09-10T08:44:29.418231+0000","last_undegraded":"2024-09-10T08:44:29.418231+0000","last_fullsized":"2024-09-10T08:44:29.418231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4308,"log_dups_size":0,"ondisk_log_size":4308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:15.932769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23330,"num_write_kb":286070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'4301","reported_seq":4332,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.444485+0000","last_change":"2024-09-10T08:28:35.576280+0000","last_active":"2024-09-10T08:44:22.444485+0000","last_peered":"2024-09-10T08:44:22.444485+0000","last_clean":"2024-09-10T08:44:22.444485+0000","last_became_active":"2024-09-10T08:28:35.576002+0000","last_became_peered":"2024-09-10T08:28:35.576002+0000","last_unstale":"2024-09-10T08:44:22.444485+0000","last_undegraded":"2024-09-10T08:44:22.444485+0000","last_fullsized":"2024-09-10T08:44:22.444485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4301,"log_dups_size":0,"ondisk_log_size":4301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:46.278441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22897,"num_write_kb":271992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.974079+0000","last_change":"2024-09-10T08:28:34.555212+0000","last_active":"2024-09-10T08:43:47.974079+0000","last_peered":"2024-09-10T08:43:47.974079+0000","last_clean":"2024-09-10T08:43:47.974079+0000","last_became_active":"2024-09-10T08:28:34.554922+0000","last_became_peered":"2024-09-10T08:28:34.554922+0000","last_unstale":"2024-09-10T08:43:47.974079+0000","last_undegraded":"2024-09-10T08:43:47.974079+0000","last_fullsized":"2024-09-10T08:43:47.974079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.824479+0000","last_change":"2024-09-10T08:28:46.624886+0000","last_active":"2024-09-10T08:43:37.824479+0000","last_peered":"2024-09-10T08:43:37.824479+0000","last_clean":"2024-09-10T08:43:37.824479+0000","last_became_active":"2024-09-10T08:28:46.624690+0000","last_became_peered":"2024-09-10T08:28:46.624690+0000","last_unstale":"2024-09-10T08:43:37.824479+0000","last_undegraded":"2024-09-10T08:43:37.824479+0000","last_fullsized":"2024-09-10T08:43:37.824479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:15.023379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"27'4253","reported_seq":4276,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.376801+0000","last_change":"2024-09-10T08:28:47.634161+0000","last_active":"2024-09-10T08:44:29.376801+0000","last_peered":"2024-09-10T08:44:29.376801+0000","last_clean":"2024-09-10T08:44:29.376801+0000","last_became_active":"2024-09-10T08:28:47.633893+0000","last_became_peered":"2024-09-10T08:28:47.633893+0000","last_unstale":"2024-09-10T08:44:29.376801+0000","last_undegraded":"2024-09-10T08:44:29.376801+0000","last_fullsized":"2024-09-10T08:44:29.376801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4253,"log_dups_size":0,"ondisk_log_size":4253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:37.072370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22807,"num_write_kb":271856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'4548","reported_seq":4579,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.464810+0000","last_change":"2024-09-10T08:28:35.577978+0000","last_active":"2024-09-10T08:44:22.464810+0000","last_peered":"2024-09-10T08:44:22.464810+0000","last_clean":"2024-09-10T08:44:22.464810+0000","last_became_active":"2024-09-10T08:28:35.577718+0000","last_became_peered":"2024-09-10T08:28:35.577718+0000","last_unstale":"2024-09-10T08:44:22.464810+0000","last_undegraded":"2024-09-10T08:44:22.464810+0000","last_fullsized":"2024-09-10T08:44:22.464810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4548,"log_dups_size":0,"ondisk_log_size":4548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:01:57.257817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24326,"num_write_kb":290026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.003029+0000","last_change":"2024-09-10T08:28:34.553983+0000","last_active":"2024-09-10T08:43:48.003029+0000","last_peered":"2024-09-10T08:43:48.003029+0000","last_clean":"2024-09-10T08:43:48.003029+0000","last_became_active":"2024-09-10T08:28:34.553693+0000","last_became_peered":"2024-09-10T08:28:34.553693+0000","last_unstale":"2024-09-10T08:43:48.003029+0000","last_undegraded":"2024-09-10T08:43:48.003029+0000","last_fullsized":"2024-09-10T08:43:48.003029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:40.001685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.780271+0000","last_change":"2024-09-10T08:28:46.620165+0000","last_active":"2024-09-10T08:43:37.780271+0000","last_peered":"2024-09-10T08:43:37.780271+0000","last_clean":"2024-09-10T08:43:37.780271+0000","last_became_active":"2024-09-10T08:28:46.619853+0000","last_became_peered":"2024-09-10T08:28:46.619853+0000","last_unstale":"2024-09-10T08:43:37.780271+0000","last_undegraded":"2024-09-10T08:43:37.780271+0000","last_fullsized":"2024-09-10T08:43:37.780271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:36.006532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'3675","reported_seq":3698,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.383338+0000","last_change":"2024-09-10T08:28:47.621588+0000","last_active":"2024-09-10T08:44:29.383338+0000","last_peered":"2024-09-10T08:44:29.383338+0000","last_clean":"2024-09-10T08:44:29.383338+0000","last_became_active":"2024-09-10T08:28:47.621122+0000","last_became_peered":"2024-09-10T08:28:47.621122+0000","last_unstale":"2024-09-10T08:44:29.383338+0000","last_undegraded":"2024-09-10T08:44:29.383338+0000","last_fullsized":"2024-09-10T08:44:29.383338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3675,"log_dups_size":0,"ondisk_log_size":3675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:11.250838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18710,"num_write_kb":246893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'4629","reported_seq":4660,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.445596+0000","last_change":"2024-09-10T08:28:35.566745+0000","last_active":"2024-09-10T08:44:22.445596+0000","last_peered":"2024-09-10T08:44:22.445596+0000","last_clean":"2024-09-10T08:44:22.445596+0000","last_became_active":"2024-09-10T08:28:35.566444+0000","last_became_peered":"2024-09-10T08:28:35.566444+0000","last_unstale":"2024-09-10T08:44:22.445596+0000","last_undegraded":"2024-09-10T08:44:22.445596+0000","last_fullsized":"2024-09-10T08:44:22.445596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4629,"log_dups_size":0,"ondisk_log_size":4629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:52.735296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24423,"num_write_kb":290556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'60","reported_seq":151,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:38.178514+0000","last_change":"2024-09-10T08:28:34.560745+0000","last_active":"2024-09-10T08:43:38.178514+0000","last_peered":"2024-09-10T08:43:38.178514+0000","last_clean":"2024-09-10T08:43:38.178514+0000","last_became_active":"2024-09-10T08:28:34.559911+0000","last_became_peered":"2024-09-10T08:28:34.559911+0000","last_unstale":"2024-09-10T08:43:38.178514+0000","last_undegraded":"2024-09-10T08:43:38.178514+0000","last_fullsized":"2024-09-10T08:43:38.178514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:00.234067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":129,"num_write":58,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.785296+0000","last_change":"2024-09-10T08:28:46.623886+0000","last_active":"2024-09-10T08:43:37.785296+0000","last_peered":"2024-09-10T08:43:37.785296+0000","last_clean":"2024-09-10T08:43:37.785296+0000","last_became_active":"2024-09-10T08:28:46.622790+0000","last_became_peered":"2024-09-10T08:28:46.622790+0000","last_unstale":"2024-09-10T08:43:37.785296+0000","last_undegraded":"2024-09-10T08:43:37.785296+0000","last_fullsized":"2024-09-10T08:43:37.785296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:06:32.333116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"27'4388","reported_seq":4411,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.440297+0000","last_change":"2024-09-10T08:28:47.634500+0000","last_active":"2024-09-10T08:44:29.440297+0000","last_peered":"2024-09-10T08:44:29.440297+0000","last_clean":"2024-09-10T08:44:29.440297+0000","last_became_active":"2024-09-10T08:28:47.634219+0000","last_became_peered":"2024-09-10T08:28:47.634219+0000","last_unstale":"2024-09-10T08:44:29.440297+0000","last_undegraded":"2024-09-10T08:44:29.440297+0000","last_fullsized":"2024-09-10T08:44:29.440297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4388,"log_dups_size":0,"ondisk_log_size":4388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:59.689554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22741,"num_write_kb":291819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"27'4638","reported_seq":4669,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.452749+0000","last_change":"2024-09-10T08:28:35.576360+0000","last_active":"2024-09-10T08:44:22.452749+0000","last_peered":"2024-09-10T08:44:22.452749+0000","last_clean":"2024-09-10T08:44:22.452749+0000","last_became_active":"2024-09-10T08:28:35.576096+0000","last_became_peered":"2024-09-10T08:28:35.576096+0000","last_unstale":"2024-09-10T08:44:22.452749+0000","last_undegraded":"2024-09-10T08:44:22.452749+0000","last_fullsized":"2024-09-10T08:44:22.452749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4638,"log_dups_size":0,"ondisk_log_size":4638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:34.159275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24206,"num_write_kb":293700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.002633+0000","last_change":"2024-09-10T08:28:34.568477+0000","last_active":"2024-09-10T08:43:48.002633+0000","last_peered":"2024-09-10T08:43:48.002633+0000","last_clean":"2024-09-10T08:43:48.002633+0000","last_became_active":"2024-09-10T08:28:34.568249+0000","last_became_peered":"2024-09-10T08:28:34.568249+0000","last_unstale":"2024-09-10T08:43:48.002633+0000","last_undegraded":"2024-09-10T08:43:48.002633+0000","last_fullsized":"2024-09-10T08:43:48.002633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:08.640043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'605","reported_seq":630,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:42.810957+0000","last_change":"2024-09-10T08:28:46.621567+0000","last_active":"2024-09-10T08:43:42.810957+0000","last_peered":"2024-09-10T08:43:42.810957+0000","last_clean":"2024-09-10T08:43:42.810957+0000","last_became_active":"2024-09-10T08:28:46.621272+0000","last_became_peered":"2024-09-10T08:28:46.621272+0000","last_unstale":"2024-09-10T08:43:42.810957+0000","last_undegraded":"2024-09-10T08:43:42.810957+0000","last_fullsized":"2024-09-10T08:43:42.810957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:37:34.936213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1451,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"27'4536","reported_seq":4559,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.455805+0000","last_change":"2024-09-10T08:28:47.631621+0000","last_active":"2024-09-10T08:44:29.455805+0000","last_peered":"2024-09-10T08:44:29.455805+0000","last_clean":"2024-09-10T08:44:29.455805+0000","last_became_active":"2024-09-10T08:28:47.631337+0000","last_became_peered":"2024-09-10T08:28:47.631337+0000","last_unstale":"2024-09-10T08:44:29.455805+0000","last_undegraded":"2024-09-10T08:44:29.455805+0000","last_fullsized":"2024-09-10T08:44:29.455805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4536,"log_dups_size":0,"ondisk_log_size":4536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:04.196705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23763,"num_write_kb":304142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"27'4950","reported_seq":4981,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.485120+0000","last_change":"2024-09-10T08:28:35.572658+0000","last_active":"2024-09-10T08:44:22.485120+0000","last_peered":"2024-09-10T08:44:22.485120+0000","last_clean":"2024-09-10T08:44:22.485120+0000","last_became_active":"2024-09-10T08:28:35.571611+0000","last_became_peered":"2024-09-10T08:28:35.571611+0000","last_unstale":"2024-09-10T08:44:22.485120+0000","last_undegraded":"2024-09-10T08:44:22.485120+0000","last_fullsized":"2024-09-10T08:44:22.485120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4950,"log_dups_size":0,"ondisk_log_size":4950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:42.726996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25652,"num_write_kb":316024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:41:05.971983+0000","last_change":"2024-09-10T08:28:34.555587+0000","last_active":"2024-09-10T08:41:05.971983+0000","last_peered":"2024-09-10T08:41:05.971983+0000","last_clean":"2024-09-10T08:41:05.971983+0000","last_became_active":"2024-09-10T08:28:34.555269+0000","last_became_peered":"2024-09-10T08:28:34.555269+0000","last_unstale":"2024-09-10T08:41:05.971983+0000","last_undegraded":"2024-09-10T08:41:05.971983+0000","last_fullsized":"2024-09-10T08:41:05.971983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:19.499870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":190,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:42:26.593595+0000","last_change":"2024-09-10T08:28:26.724394+0000","last_active":"2024-09-10T08:42:26.593595+0000","last_peered":"2024-09-10T08:42:26.593595+0000","last_clean":"2024-09-10T08:42:26.593595+0000","last_became_active":"2024-09-10T08:28:26.723452+0000","last_became_peered":"2024-09-10T08:28:26.723452+0000","last_unstale":"2024-09-10T08:42:26.593595+0000","last_undegraded":"2024-09-10T08:42:26.593595+0000","last_fullsized":"2024-09-10T08:42:26.593595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_clean_scrub_stamp":"2024-09-10T08:28:25.445753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:00.811505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.779193+0000","last_change":"2024-09-10T08:28:46.622048+0000","last_active":"2024-09-10T08:43:37.779193+0000","last_peered":"2024-09-10T08:43:37.779193+0000","last_clean":"2024-09-10T08:43:37.779193+0000","last_became_active":"2024-09-10T08:28:46.621770+0000","last_became_peered":"2024-09-10T08:28:46.621770+0000","last_unstale":"2024-09-10T08:43:37.779193+0000","last_undegraded":"2024-09-10T08:43:37.779193+0000","last_fullsized":"2024-09-10T08:43:37.779193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:51.430760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"27'3353","reported_seq":3376,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.382825+0000","last_change":"2024-09-10T08:28:47.620746+0000","last_active":"2024-09-10T08:44:29.382825+0000","last_peered":"2024-09-10T08:44:29.382825+0000","last_clean":"2024-09-10T08:44:29.382825+0000","last_became_active":"2024-09-10T08:28:47.620492+0000","last_became_peered":"2024-09-10T08:28:47.620492+0000","last_unstale":"2024-09-10T08:44:29.382825+0000","last_undegraded":"2024-09-10T08:44:29.382825+0000","last_fullsized":"2024-09-10T08:44:29.382825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3353,"log_dups_size":0,"ondisk_log_size":3353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:40.117978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16947,"num_write_kb":239873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'4450","reported_seq":4481,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.537803+0000","last_change":"2024-09-10T08:28:35.574532+0000","last_active":"2024-09-10T08:44:22.537803+0000","last_peered":"2024-09-10T08:44:22.537803+0000","last_clean":"2024-09-10T08:44:22.537803+0000","last_became_active":"2024-09-10T08:28:35.574215+0000","last_became_peered":"2024-09-10T08:28:35.574215+0000","last_unstale":"2024-09-10T08:44:22.537803+0000","last_undegraded":"2024-09-10T08:44:22.537803+0000","last_fullsized":"2024-09-10T08:44:22.537803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4450,"log_dups_size":0,"ondisk_log_size":4450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:28.455653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23087,"num_write_kb":297343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:35.033572+0000","last_change":"2024-09-10T08:28:34.559911+0000","last_active":"2024-09-10T08:43:35.033572+0000","last_peered":"2024-09-10T08:43:35.033572+0000","last_clean":"2024-09-10T08:43:35.033572+0000","last_became_active":"2024-09-10T08:28:34.559635+0000","last_became_peered":"2024-09-10T08:28:34.559635+0000","last_unstale":"2024-09-10T08:43:35.033572+0000","last_undegraded":"2024-09-10T08:43:35.033572+0000","last_fullsized":"2024-09-10T08:43:35.033572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:40.892609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.843424+0000","last_change":"2024-09-10T08:28:46.620352+0000","last_active":"2024-09-10T08:43:37.843424+0000","last_peered":"2024-09-10T08:43:37.843424+0000","last_clean":"2024-09-10T08:43:37.843424+0000","last_became_active":"2024-09-10T08:28:46.620064+0000","last_became_peered":"2024-09-10T08:28:46.620064+0000","last_unstale":"2024-09-10T08:43:37.843424+0000","last_undegraded":"2024-09-10T08:43:37.843424+0000","last_fullsized":"2024-09-10T08:43:37.843424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:59.333579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"27'3678","reported_seq":3701,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.377144+0000","last_change":"2024-09-10T08:28:47.620305+0000","last_active":"2024-09-10T08:44:29.377144+0000","last_peered":"2024-09-10T08:44:29.377144+0000","last_clean":"2024-09-10T08:44:29.377144+0000","last_became_active":"2024-09-10T08:28:47.620014+0000","last_became_peered":"2024-09-10T08:28:47.620014+0000","last_unstale":"2024-09-10T08:44:29.377144+0000","last_undegraded":"2024-09-10T08:44:29.377144+0000","last_fullsized":"2024-09-10T08:44:29.377144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3678,"log_dups_size":0,"ondisk_log_size":3678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:44.916136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19171,"num_write_kb":261286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'5065","reported_seq":5096,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.514606+0000","last_change":"2024-09-10T08:28:35.577124+0000","last_active":"2024-09-10T08:44:22.514606+0000","last_peered":"2024-09-10T08:44:22.514606+0000","last_clean":"2024-09-10T08:44:22.514606+0000","last_became_active":"2024-09-10T08:28:35.576655+0000","last_became_peered":"2024-09-10T08:28:35.576655+0000","last_unstale":"2024-09-10T08:44:22.514606+0000","last_undegraded":"2024-09-10T08:44:22.514606+0000","last_fullsized":"2024-09-10T08:44:22.514606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5065,"log_dups_size":0,"ondisk_log_size":5065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:29.878600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26367,"num_write_kb":318681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:35.039309+0000","last_change":"2024-09-10T08:28:34.560694+0000","last_active":"2024-09-10T08:43:35.039309+0000","last_peered":"2024-09-10T08:43:35.039309+0000","last_clean":"2024-09-10T08:43:35.039309+0000","last_became_active":"2024-09-10T08:28:34.560429+0000","last_became_peered":"2024-09-10T08:28:34.560429+0000","last_unstale":"2024-09-10T08:43:35.039309+0000","last_undegraded":"2024-09-10T08:43:35.039309+0000","last_fullsized":"2024-09-10T08:43:35.039309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:54.514467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'1099","reported_seq":1123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.786510+0000","last_change":"2024-09-10T08:28:46.622232+0000","last_active":"2024-09-10T08:43:37.786510+0000","last_peered":"2024-09-10T08:43:37.786510+0000","last_clean":"2024-09-10T08:43:37.786510+0000","last_became_active":"2024-09-10T08:28:46.621966+0000","last_became_peered":"2024-09-10T08:28:46.621966+0000","last_unstale":"2024-09-10T08:43:37.786510+0000","last_undegraded":"2024-09-10T08:43:37.786510+0000","last_fullsized":"2024-09-10T08:43:37.786510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1099,"log_dups_size":0,"ondisk_log_size":1099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:28.897045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1090,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"27'4366","reported_seq":4389,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.312771+0000","last_change":"2024-09-10T08:28:47.630602+0000","last_active":"2024-09-10T08:44:29.312771+0000","last_peered":"2024-09-10T08:44:29.312771+0000","last_clean":"2024-09-10T08:44:29.312771+0000","last_became_active":"2024-09-10T08:28:47.630234+0000","last_became_peered":"2024-09-10T08:28:47.630234+0000","last_unstale":"2024-09-10T08:44:29.312771+0000","last_undegraded":"2024-09-10T08:44:29.312771+0000","last_fullsized":"2024-09-10T08:44:29.312771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4366,"log_dups_size":0,"ondisk_log_size":4366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:03.808098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22466,"num_write_kb":282639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"27'5771","reported_seq":5802,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.572787+0000","last_change":"2024-09-10T08:28:35.577577+0000","last_active":"2024-09-10T08:44:22.572787+0000","last_peered":"2024-09-10T08:44:22.572787+0000","last_clean":"2024-09-10T08:44:22.572787+0000","last_became_active":"2024-09-10T08:28:35.576686+0000","last_became_peered":"2024-09-10T08:28:35.576686+0000","last_unstale":"2024-09-10T08:44:22.572787+0000","last_undegraded":"2024-09-10T08:44:22.572787+0000","last_fullsized":"2024-09-10T08:44:22.572787+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5671,"log_dups_size":0,"ondisk_log_size":5671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:36.334494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29457,"num_write_kb":355657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'6","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.996141+0000","last_change":"2024-09-10T08:28:34.560313+0000","last_active":"2024-09-10T08:43:47.996141+0000","last_peered":"2024-09-10T08:43:47.996141+0000","last_clean":"2024-09-10T08:43:47.996141+0000","last_became_active":"2024-09-10T08:28:34.560035+0000","last_became_peered":"2024-09-10T08:28:34.560035+0000","last_unstale":"2024-09-10T08:43:47.996141+0000","last_undegraded":"2024-09-10T08:43:47.996141+0000","last_fullsized":"2024-09-10T08:43:47.996141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:56.945537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.793333+0000","last_change":"2024-09-10T08:28:46.623371+0000","last_active":"2024-09-10T08:43:37.793333+0000","last_peered":"2024-09-10T08:43:37.793333+0000","last_clean":"2024-09-10T08:43:37.793333+0000","last_became_active":"2024-09-10T08:28:46.623092+0000","last_became_peered":"2024-09-10T08:28:46.623092+0000","last_unstale":"2024-09-10T08:43:37.793333+0000","last_undegraded":"2024-09-10T08:43:37.793333+0000","last_fullsized":"2024-09-10T08:43:37.793333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:36.359127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"27'4470","reported_seq":4493,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.335120+0000","last_change":"2024-09-10T08:28:47.619805+0000","last_active":"2024-09-10T08:44:29.335120+0000","last_peered":"2024-09-10T08:44:29.335120+0000","last_clean":"2024-09-10T08:44:29.335120+0000","last_became_active":"2024-09-10T08:28:47.619452+0000","last_became_peered":"2024-09-10T08:28:47.619452+0000","last_unstale":"2024-09-10T08:44:29.335120+0000","last_undegraded":"2024-09-10T08:44:29.335120+0000","last_fullsized":"2024-09-10T08:44:29.335120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4470,"log_dups_size":0,"ondisk_log_size":4470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:20.052707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23926,"num_write_kb":300839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"27'4014","reported_seq":4045,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.536870+0000","last_change":"2024-09-10T08:28:35.577476+0000","last_active":"2024-09-10T08:44:22.536870+0000","last_peered":"2024-09-10T08:44:22.536870+0000","last_clean":"2024-09-10T08:44:22.536870+0000","last_became_active":"2024-09-10T08:28:35.576786+0000","last_became_peered":"2024-09-10T08:28:35.576786+0000","last_unstale":"2024-09-10T08:44:22.536870+0000","last_undegraded":"2024-09-10T08:44:22.536870+0000","last_fullsized":"2024-09-10T08:44:22.536870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4014,"log_dups_size":0,"ondisk_log_size":4014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:46.914074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19823,"num_write_kb":276089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.005418+0000","last_change":"2024-09-10T08:28:34.551102+0000","last_active":"2024-09-10T08:43:48.005418+0000","last_peered":"2024-09-10T08:43:48.005418+0000","last_clean":"2024-09-10T08:43:48.005418+0000","last_became_active":"2024-09-10T08:28:34.550773+0000","last_became_peered":"2024-09-10T08:28:34.550773+0000","last_unstale":"2024-09-10T08:43:48.005418+0000","last_undegraded":"2024-09-10T08:43:48.005418+0000","last_fullsized":"2024-09-10T08:43:48.005418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:35.393695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.815410+0000","last_change":"2024-09-10T08:28:46.619639+0000","last_active":"2024-09-10T08:43:37.815410+0000","last_peered":"2024-09-10T08:43:37.815410+0000","last_clean":"2024-09-10T08:43:37.815410+0000","last_became_active":"2024-09-10T08:28:46.619330+0000","last_became_peered":"2024-09-10T08:28:46.619330+0000","last_unstale":"2024-09-10T08:43:37.815410+0000","last_undegraded":"2024-09-10T08:43:37.815410+0000","last_fullsized":"2024-09-10T08:43:37.815410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:10.371693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"27'3797","reported_seq":3819,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.367348+0000","last_change":"2024-09-10T08:28:47.633627+0000","last_active":"2024-09-10T08:44:29.367348+0000","last_peered":"2024-09-10T08:44:29.367348+0000","last_clean":"2024-09-10T08:44:29.367348+0000","last_became_active":"2024-09-10T08:28:47.633362+0000","last_became_peered":"2024-09-10T08:28:47.633362+0000","last_unstale":"2024-09-10T08:44:29.367348+0000","last_undegraded":"2024-09-10T08:44:29.367348+0000","last_fullsized":"2024-09-10T08:44:29.367348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3797,"log_dups_size":0,"ondisk_log_size":3797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:19.473028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19693,"num_write_kb":255099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"27'4998","reported_seq":5028,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.499387+0000","last_change":"2024-09-10T08:28:35.575307+0000","last_active":"2024-09-10T08:44:22.499387+0000","last_peered":"2024-09-10T08:44:22.499387+0000","last_clean":"2024-09-10T08:44:22.499387+0000","last_became_active":"2024-09-10T08:28:35.575038+0000","last_became_peered":"2024-09-10T08:28:35.575038+0000","last_unstale":"2024-09-10T08:44:22.499387+0000","last_undegraded":"2024-09-10T08:44:22.499387+0000","last_fullsized":"2024-09-10T08:44:22.499387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4998,"log_dups_size":0,"ondisk_log_size":4998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:36.478822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25962,"num_write_kb":304804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'11","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.948250+0000","last_change":"2024-09-10T08:28:34.555542+0000","last_active":"2024-09-10T08:43:47.948250+0000","last_peered":"2024-09-10T08:43:47.948250+0000","last_clean":"2024-09-10T08:43:47.948250+0000","last_became_active":"2024-09-10T08:28:34.555179+0000","last_became_peered":"2024-09-10T08:28:34.555179+0000","last_unstale":"2024-09-10T08:43:47.948250+0000","last_undegraded":"2024-09-10T08:43:47.948250+0000","last_fullsized":"2024-09-10T08:43:47.948250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:53.313161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.799350+0000","last_change":"2024-09-10T08:28:46.618615+0000","last_active":"2024-09-10T08:43:37.799350+0000","last_peered":"2024-09-10T08:43:37.799350+0000","last_clean":"2024-09-10T08:43:37.799350+0000","last_became_active":"2024-09-10T08:28:46.618318+0000","last_became_peered":"2024-09-10T08:28:46.618318+0000","last_unstale":"2024-09-10T08:43:37.799350+0000","last_undegraded":"2024-09-10T08:43:37.799350+0000","last_fullsized":"2024-09-10T08:43:37.799350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:44:08.185748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"27'4510","reported_seq":4532,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.460057+0000","last_change":"2024-09-10T08:28:47.625025+0000","last_active":"2024-09-10T08:44:29.460057+0000","last_peered":"2024-09-10T08:44:29.460057+0000","last_clean":"2024-09-10T08:44:29.460057+0000","last_became_active":"2024-09-10T08:28:47.624230+0000","last_became_peered":"2024-09-10T08:28:47.624230+0000","last_unstale":"2024-09-10T08:44:29.460057+0000","last_undegraded":"2024-09-10T08:44:29.460057+0000","last_fullsized":"2024-09-10T08:44:29.460057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4510,"log_dups_size":0,"ondisk_log_size":4510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:25.530264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23053,"num_write_kb":297434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'5001","reported_seq":5031,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.475930+0000","last_change":"2024-09-10T08:28:35.578892+0000","last_active":"2024-09-10T08:44:22.475930+0000","last_peered":"2024-09-10T08:44:22.475930+0000","last_clean":"2024-09-10T08:44:22.475930+0000","last_became_active":"2024-09-10T08:28:35.578299+0000","last_became_peered":"2024-09-10T08:28:35.578299+0000","last_unstale":"2024-09-10T08:44:22.475930+0000","last_undegraded":"2024-09-10T08:44:22.475930+0000","last_fullsized":"2024-09-10T08:44:22.475930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5001,"log_dups_size":0,"ondisk_log_size":5001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:27.485392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25723,"num_write_kb":320130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'6","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.992918+0000","last_change":"2024-09-10T08:28:34.560444+0000","last_active":"2024-09-10T08:43:47.992918+0000","last_peered":"2024-09-10T08:43:47.992918+0000","last_clean":"2024-09-10T08:43:47.992918+0000","last_became_active":"2024-09-10T08:28:34.560188+0000","last_became_peered":"2024-09-10T08:28:34.560188+0000","last_unstale":"2024-09-10T08:43:47.992918+0000","last_undegraded":"2024-09-10T08:43:47.992918+0000","last_fullsized":"2024-09-10T08:43:47.992918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:15.727780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:16.827380+0000","last_change":"2024-09-10T08:28:46.623483+0000","last_active":"2024-09-10T08:43:16.827380+0000","last_peered":"2024-09-10T08:43:16.827380+0000","last_clean":"2024-09-10T08:43:16.827380+0000","last_became_active":"2024-09-10T08:28:46.623211+0000","last_became_peered":"2024-09-10T08:28:46.623211+0000","last_unstale":"2024-09-10T08:43:16.827380+0000","last_undegraded":"2024-09-10T08:43:16.827380+0000","last_fullsized":"2024-09-10T08:43:16.827380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:24.611015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"27'4287","reported_seq":4309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.418397+0000","last_change":"2024-09-10T08:28:47.635185+0000","last_active":"2024-09-10T08:44:29.418397+0000","last_peered":"2024-09-10T08:44:29.418397+0000","last_clean":"2024-09-10T08:44:29.418397+0000","last_became_active":"2024-09-10T08:28:47.634782+0000","last_became_peered":"2024-09-10T08:28:47.634782+0000","last_unstale":"2024-09-10T08:44:29.418397+0000","last_undegraded":"2024-09-10T08:44:29.418397+0000","last_fullsized":"2024-09-10T08:44:29.418397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4287,"log_dups_size":0,"ondisk_log_size":4287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:05.512645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22519,"num_write_kb":282718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'5007","reported_seq":5037,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.563134+0000","last_change":"2024-09-10T08:28:35.575788+0000","last_active":"2024-09-10T08:44:22.563134+0000","last_peered":"2024-09-10T08:44:22.563134+0000","last_clean":"2024-09-10T08:44:22.563134+0000","last_became_active":"2024-09-10T08:28:35.575333+0000","last_became_peered":"2024-09-10T08:28:35.575333+0000","last_unstale":"2024-09-10T08:44:22.563134+0000","last_undegraded":"2024-09-10T08:44:22.563134+0000","last_fullsized":"2024-09-10T08:44:22.563134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5007,"log_dups_size":0,"ondisk_log_size":5007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:39.756390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25404,"num_write_kb":331142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.009202+0000","last_change":"2024-09-10T08:28:34.560699+0000","last_active":"2024-09-10T08:43:48.009202+0000","last_peered":"2024-09-10T08:43:48.009202+0000","last_clean":"2024-09-10T08:43:48.009202+0000","last_became_active":"2024-09-10T08:28:34.560376+0000","last_became_peered":"2024-09-10T08:28:34.560376+0000","last_unstale":"2024-09-10T08:43:48.009202+0000","last_undegraded":"2024-09-10T08:43:48.009202+0000","last_fullsized":"2024-09-10T08:43:48.009202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:09.981216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'327","reported_seq":351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.842658+0000","last_change":"2024-09-10T08:28:46.620745+0000","last_active":"2024-09-10T08:43:37.842658+0000","last_peered":"2024-09-10T08:43:37.842658+0000","last_clean":"2024-09-10T08:43:37.842658+0000","last_became_active":"2024-09-10T08:28:46.619030+0000","last_became_peered":"2024-09-10T08:28:46.619030+0000","last_unstale":"2024-09-10T08:43:37.842658+0000","last_undegraded":"2024-09-10T08:43:37.842658+0000","last_fullsized":"2024-09-10T08:43:37.842658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:07.653226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":4249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"27'6390","reported_seq":6412,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.443881+0000","last_change":"2024-09-10T08:28:47.626648+0000","last_active":"2024-09-10T08:44:29.443881+0000","last_peered":"2024-09-10T08:44:29.443881+0000","last_clean":"2024-09-10T08:44:29.443881+0000","last_became_active":"2024-09-10T08:28:47.626330+0000","last_became_peered":"2024-09-10T08:28:47.626330+0000","last_unstale":"2024-09-10T08:44:29.443881+0000","last_undegraded":"2024-09-10T08:44:29.443881+0000","last_fullsized":"2024-09-10T08:44:29.443881+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5190,"log_dups_size":0,"ondisk_log_size":5190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:02.346881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33857,"num_write_kb":406580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'4502","reported_seq":4532,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.486058+0000","last_change":"2024-09-10T08:28:35.574810+0000","last_active":"2024-09-10T08:44:22.486058+0000","last_peered":"2024-09-10T08:44:22.486058+0000","last_clean":"2024-09-10T08:44:22.486058+0000","last_became_active":"2024-09-10T08:28:35.574567+0000","last_became_peered":"2024-09-10T08:28:35.574567+0000","last_unstale":"2024-09-10T08:44:22.486058+0000","last_undegraded":"2024-09-10T08:44:22.486058+0000","last_fullsized":"2024-09-10T08:44:22.486058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4502,"log_dups_size":0,"ondisk_log_size":4502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:29.315833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23284,"num_write_kb":285817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'8","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.989573+0000","last_change":"2024-09-10T08:28:34.553556+0000","last_active":"2024-09-10T08:43:47.989573+0000","last_peered":"2024-09-10T08:43:47.989573+0000","last_clean":"2024-09-10T08:43:47.989573+0000","last_became_active":"2024-09-10T08:28:34.553275+0000","last_became_peered":"2024-09-10T08:28:34.553275+0000","last_unstale":"2024-09-10T08:43:47.989573+0000","last_undegraded":"2024-09-10T08:43:47.989573+0000","last_fullsized":"2024-09-10T08:43:47.989573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:45.957635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'29","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.870711+0000","last_change":"2024-09-10T08:28:46.619760+0000","last_active":"2024-09-10T08:43:37.870711+0000","last_peered":"2024-09-10T08:43:37.870711+0000","last_clean":"2024-09-10T08:43:37.870711+0000","last_became_active":"2024-09-10T08:28:46.619165+0000","last_became_peered":"2024-09-10T08:28:46.619165+0000","last_unstale":"2024-09-10T08:43:37.870711+0000","last_undegraded":"2024-09-10T08:43:37.870711+0000","last_fullsized":"2024-09-10T08:43:37.870711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:27.691197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"27'5339","reported_seq":5361,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.399784+0000","last_change":"2024-09-10T08:28:47.620135+0000","last_active":"2024-09-10T08:44:29.399784+0000","last_peered":"2024-09-10T08:44:29.399784+0000","last_clean":"2024-09-10T08:44:29.399784+0000","last_became_active":"2024-09-10T08:28:47.619661+0000","last_became_peered":"2024-09-10T08:28:47.619661+0000","last_unstale":"2024-09-10T08:44:29.399784+0000","last_undegraded":"2024-09-10T08:44:29.399784+0000","last_fullsized":"2024-09-10T08:44:29.399784+0000","mapping_epoch":23,"log_start":"27'100","ondisk_log_start":"27'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:34.815426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27578,"num_write_kb":340014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'4089","reported_seq":4119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.533296+0000","last_change":"2024-09-10T08:28:35.582473+0000","last_active":"2024-09-10T08:44:22.533296+0000","last_peered":"2024-09-10T08:44:22.533296+0000","last_clean":"2024-09-10T08:44:22.533296+0000","last_became_active":"2024-09-10T08:28:35.582205+0000","last_became_peered":"2024-09-10T08:28:35.582205+0000","last_unstale":"2024-09-10T08:44:22.533296+0000","last_undegraded":"2024-09-10T08:44:22.533296+0000","last_fullsized":"2024-09-10T08:44:22.533296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4089,"log_dups_size":0,"ondisk_log_size":4089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:11.200963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21083,"num_write_kb":276854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'305","reported_seq":337,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.000513+0000","last_change":"2024-09-10T08:28:34.559823+0000","last_active":"2024-09-10T08:43:48.000513+0000","last_peered":"2024-09-10T08:43:48.000513+0000","last_clean":"2024-09-10T08:43:48.000513+0000","last_became_active":"2024-09-10T08:28:34.559560+0000","last_became_peered":"2024-09-10T08:28:34.559560+0000","last_unstale":"2024-09-10T08:43:48.000513+0000","last_undegraded":"2024-09-10T08:43:48.000513+0000","last_fullsized":"2024-09-10T08:43:48.000513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:53.724382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":301,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'5","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.840086+0000","last_change":"2024-09-10T08:28:46.628040+0000","last_active":"2024-09-10T08:43:37.840086+0000","last_peered":"2024-09-10T08:43:37.840086+0000","last_clean":"2024-09-10T08:43:37.840086+0000","last_became_active":"2024-09-10T08:28:46.627819+0000","last_became_peered":"2024-09-10T08:28:46.627819+0000","last_unstale":"2024-09-10T08:43:37.840086+0000","last_undegraded":"2024-09-10T08:43:37.840086+0000","last_fullsized":"2024-09-10T08:43:37.840086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:29.467540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"27'3973","reported_seq":3995,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456273+0000","last_change":"2024-09-10T08:28:47.628067+0000","last_active":"2024-09-10T08:44:29.456273+0000","last_peered":"2024-09-10T08:44:29.456273+0000","last_clean":"2024-09-10T08:44:29.456273+0000","last_became_active":"2024-09-10T08:28:47.627775+0000","last_became_peered":"2024-09-10T08:28:47.627775+0000","last_unstale":"2024-09-10T08:44:29.456273+0000","last_undegraded":"2024-09-10T08:44:29.456273+0000","last_fullsized":"2024-09-10T08:44:29.456273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3973,"log_dups_size":0,"ondisk_log_size":3973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:43.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20759,"num_write_kb":275665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'6218","reported_seq":6248,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.501495+0000","last_change":"2024-09-10T08:28:35.571262+0000","last_active":"2024-09-10T08:44:22.501495+0000","last_peered":"2024-09-10T08:44:22.501495+0000","last_clean":"2024-09-10T08:44:22.501495+0000","last_became_active":"2024-09-10T08:28:35.570711+0000","last_became_peered":"2024-09-10T08:28:35.570711+0000","last_unstale":"2024-09-10T08:44:22.501495+0000","last_undegraded":"2024-09-10T08:44:22.501495+0000","last_fullsized":"2024-09-10T08:44:22.501495+0000","mapping_epoch":19,"log_start":"27'700","ondisk_log_start":"27'700","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5518,"log_dups_size":0,"ondisk_log_size":5518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:29.116422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31535,"num_write_kb":397056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'35","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.003205+0000","last_change":"2024-09-10T08:28:34.557352+0000","last_active":"2024-09-10T08:43:48.003205+0000","last_peered":"2024-09-10T08:43:48.003205+0000","last_clean":"2024-09-10T08:43:48.003205+0000","last_became_active":"2024-09-10T08:28:34.557076+0000","last_became_peered":"2024-09-10T08:28:34.557076+0000","last_unstale":"2024-09-10T08:43:48.003205+0000","last_undegraded":"2024-09-10T08:43:48.003205+0000","last_fullsized":"2024-09-10T08:43:48.003205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:04.957739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'8","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.822684+0000","last_change":"2024-09-10T08:28:46.615923+0000","last_active":"2024-09-10T08:43:37.822684+0000","last_peered":"2024-09-10T08:43:37.822684+0000","last_clean":"2024-09-10T08:43:37.822684+0000","last_became_active":"2024-09-10T08:28:46.615451+0000","last_became_peered":"2024-09-10T08:28:46.615451+0000","last_unstale":"2024-09-10T08:43:37.822684+0000","last_undegraded":"2024-09-10T08:43:37.822684+0000","last_fullsized":"2024-09-10T08:43:37.822684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:22.612001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"27'4284","reported_seq":4306,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456315+0000","last_change":"2024-09-10T08:28:47.623223+0000","last_active":"2024-09-10T08:44:29.456315+0000","last_peered":"2024-09-10T08:44:29.456315+0000","last_clean":"2024-09-10T08:44:29.456315+0000","last_became_active":"2024-09-10T08:28:47.622961+0000","last_became_peered":"2024-09-10T08:28:47.622961+0000","last_unstale":"2024-09-10T08:44:29.456315+0000","last_undegraded":"2024-09-10T08:44:29.456315+0000","last_fullsized":"2024-09-10T08:44:29.456315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4284,"log_dups_size":0,"ondisk_log_size":4284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:30.979580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23423,"num_write_kb":294728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"27'3896","reported_seq":3926,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.505094+0000","last_change":"2024-09-10T08:28:35.577913+0000","last_active":"2024-09-10T08:44:22.505094+0000","last_peered":"2024-09-10T08:44:22.505094+0000","last_clean":"2024-09-10T08:44:22.505094+0000","last_became_active":"2024-09-10T08:28:35.577255+0000","last_became_peered":"2024-09-10T08:28:35.577255+0000","last_unstale":"2024-09-10T08:44:22.505094+0000","last_undegraded":"2024-09-10T08:44:22.505094+0000","last_fullsized":"2024-09-10T08:44:22.505094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3896,"log_dups_size":0,"ondisk_log_size":3896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:17.413525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19770,"num_write_kb":255291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'2","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.988679+0000","last_change":"2024-09-10T08:28:34.564571+0000","last_active":"2024-09-10T08:43:47.988679+0000","last_peered":"2024-09-10T08:43:47.988679+0000","last_clean":"2024-09-10T08:43:47.988679+0000","last_became_active":"2024-09-10T08:28:34.564189+0000","last_became_peered":"2024-09-10T08:28:34.564189+0000","last_unstale":"2024-09-10T08:43:47.988679+0000","last_undegraded":"2024-09-10T08:43:47.988679+0000","last_fullsized":"2024-09-10T08:43:47.988679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:46.055510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'12","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.816926+0000","last_change":"2024-09-10T08:28:46.618917+0000","last_active":"2024-09-10T08:43:37.816926+0000","last_peered":"2024-09-10T08:43:37.816926+0000","last_clean":"2024-09-10T08:43:37.816926+0000","last_became_active":"2024-09-10T08:28:46.618625+0000","last_became_peered":"2024-09-10T08:28:46.618625+0000","last_unstale":"2024-09-10T08:43:37.816926+0000","last_undegraded":"2024-09-10T08:43:37.816926+0000","last_fullsized":"2024-09-10T08:43:37.816926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:19.431857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"27'4685","reported_seq":4707,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.447574+0000","last_change":"2024-09-10T08:28:47.630243+0000","last_active":"2024-09-10T08:44:29.447574+0000","last_peered":"2024-09-10T08:44:29.447574+0000","last_clean":"2024-09-10T08:44:29.447574+0000","last_became_active":"2024-09-10T08:28:47.629869+0000","last_became_peered":"2024-09-10T08:28:47.629869+0000","last_unstale":"2024-09-10T08:44:29.447574+0000","last_undegraded":"2024-09-10T08:44:29.447574+0000","last_fullsized":"2024-09-10T08:44:29.447574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4685,"log_dups_size":0,"ondisk_log_size":4685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:58.696156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24572,"num_write_kb":315590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'4682","reported_seq":4712,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.546974+0000","last_change":"2024-09-10T08:28:35.572944+0000","last_active":"2024-09-10T08:44:22.546974+0000","last_peered":"2024-09-10T08:44:22.546974+0000","last_clean":"2024-09-10T08:44:22.546974+0000","last_became_active":"2024-09-10T08:28:35.572620+0000","last_became_peered":"2024-09-10T08:28:35.572620+0000","last_unstale":"2024-09-10T08:44:22.546974+0000","last_undegraded":"2024-09-10T08:44:22.546974+0000","last_fullsized":"2024-09-10T08:44:22.546974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4682,"log_dups_size":0,"ondisk_log_size":4682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:04.524048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24219,"num_write_kb":302042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'2","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:04.444745+0000","last_change":"2024-09-10T08:28:34.562935+0000","last_active":"2024-09-10T08:43:04.444745+0000","last_peered":"2024-09-10T08:43:04.444745+0000","last_clean":"2024-09-10T08:43:04.444745+0000","last_became_active":"2024-09-10T08:28:34.562647+0000","last_became_peered":"2024-09-10T08:28:34.562647+0000","last_unstale":"2024-09-10T08:43:04.444745+0000","last_undegraded":"2024-09-10T08:43:04.444745+0000","last_fullsized":"2024-09-10T08:43:04.444745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:47.492281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'6","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.806115+0000","last_change":"2024-09-10T08:28:46.621472+0000","last_active":"2024-09-10T08:43:37.806115+0000","last_peered":"2024-09-10T08:43:37.806115+0000","last_clean":"2024-09-10T08:43:37.806115+0000","last_became_active":"2024-09-10T08:28:46.621157+0000","last_became_peered":"2024-09-10T08:28:46.621157+0000","last_unstale":"2024-09-10T08:43:37.806115+0000","last_undegraded":"2024-09-10T08:43:37.806115+0000","last_fullsized":"2024-09-10T08:43:37.806115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:44.166068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"27'5768","reported_seq":5791,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.460342+0000","last_change":"2024-09-10T08:28:47.627750+0000","last_active":"2024-09-10T08:44:29.460342+0000","last_peered":"2024-09-10T08:44:29.460342+0000","last_clean":"2024-09-10T08:44:29.460342+0000","last_became_active":"2024-09-10T08:28:47.627481+0000","last_became_peered":"2024-09-10T08:28:47.627481+0000","last_unstale":"2024-09-10T08:44:29.460342+0000","last_undegraded":"2024-09-10T08:44:29.460342+0000","last_fullsized":"2024-09-10T08:44:29.460342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5768,"log_dups_size":0,"ondisk_log_size":5768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:01.105133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30773,"num_write_kb":369268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.796648+0000","last_change":"2024-09-10T08:28:46.620162+0000","last_active":"2024-09-10T08:43:37.796648+0000","last_peered":"2024-09-10T08:43:37.796648+0000","last_clean":"2024-09-10T08:43:37.796648+0000","last_became_active":"2024-09-10T08:28:46.619843+0000","last_became_peered":"2024-09-10T08:28:46.619843+0000","last_unstale":"2024-09-10T08:43:37.796648+0000","last_undegraded":"2024-09-10T08:43:37.796648+0000","last_fullsized":"2024-09-10T08:43:37.796648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:21.376123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'5404","reported_seq":5434,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.528764+0000","last_change":"2024-09-10T08:28:35.572803+0000","last_active":"2024-09-10T08:44:22.528764+0000","last_peered":"2024-09-10T08:44:22.528764+0000","last_clean":"2024-09-10T08:44:22.528764+0000","last_became_active":"2024-09-10T08:28:35.572219+0000","last_became_peered":"2024-09-10T08:28:35.572219+0000","last_unstale":"2024-09-10T08:44:22.528764+0000","last_undegraded":"2024-09-10T08:44:22.528764+0000","last_fullsized":"2024-09-10T08:44:22.528764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5404,"log_dups_size":0,"ondisk_log_size":5404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:45.920218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27626,"num_write_kb":348430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:35.055986+0000","last_change":"2024-09-10T08:28:34.554346+0000","last_active":"2024-09-10T08:43:35.055986+0000","last_peered":"2024-09-10T08:43:35.055986+0000","last_clean":"2024-09-10T08:43:35.055986+0000","last_became_active":"2024-09-10T08:28:34.553933+0000","last_became_peered":"2024-09-10T08:28:34.553933+0000","last_unstale":"2024-09-10T08:43:35.055986+0000","last_undegraded":"2024-09-10T08:43:35.055986+0000","last_fullsized":"2024-09-10T08:43:35.055986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:07.639671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"27'4656","reported_seq":4679,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.353791+0000","last_change":"2024-09-10T08:28:47.629468+0000","last_active":"2024-09-10T08:44:29.353791+0000","last_peered":"2024-09-10T08:44:29.353791+0000","last_clean":"2024-09-10T08:44:29.353791+0000","last_became_active":"2024-09-10T08:28:47.629177+0000","last_became_peered":"2024-09-10T08:28:47.629177+0000","last_unstale":"2024-09-10T08:44:29.353791+0000","last_undegraded":"2024-09-10T08:44:29.353791+0000","last_fullsized":"2024-09-10T08:44:29.353791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4656,"log_dups_size":0,"ondisk_log_size":4656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:10.443235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24729,"num_write_kb":316330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"27'630","reported_seq":655,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:28.449319+0000","last_change":"2024-09-10T08:28:46.630904+0000","last_active":"2024-09-10T08:43:28.449319+0000","last_peered":"2024-09-10T08:43:28.449319+0000","last_clean":"2024-09-10T08:43:28.449319+0000","last_became_active":"2024-09-10T08:28:46.630530+0000","last_became_peered":"2024-09-10T08:28:46.630530+0000","last_unstale":"2024-09-10T08:43:28.449319+0000","last_undegraded":"2024-09-10T08:43:28.449319+0000","last_fullsized":"2024-09-10T08:43:28.449319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:33.599739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":4465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'4762","reported_seq":4792,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.510821+0000","last_change":"2024-09-10T08:28:35.580244+0000","last_active":"2024-09-10T08:44:22.510821+0000","last_peered":"2024-09-10T08:44:22.510821+0000","last_clean":"2024-09-10T08:44:22.510821+0000","last_became_active":"2024-09-10T08:28:35.579975+0000","last_became_peered":"2024-09-10T08:28:35.579975+0000","last_unstale":"2024-09-10T08:44:22.510821+0000","last_undegraded":"2024-09-10T08:44:22.510821+0000","last_fullsized":"2024-09-10T08:44:22.510821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4762,"log_dups_size":0,"ondisk_log_size":4762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:16.498045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24500,"num_write_kb":298921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:06.786232+0000","last_change":"2024-09-10T08:28:34.564751+0000","last_active":"2024-09-10T08:43:06.786232+0000","last_peered":"2024-09-10T08:43:06.786232+0000","last_clean":"2024-09-10T08:43:06.786232+0000","last_became_active":"2024-09-10T08:28:34.564479+0000","last_became_peered":"2024-09-10T08:28:34.564479+0000","last_unstale":"2024-09-10T08:43:06.786232+0000","last_undegraded":"2024-09-10T08:43:06.786232+0000","last_fullsized":"2024-09-10T08:43:06.786232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:29.618224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"27'5070","reported_seq":5092,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.463937+0000","last_change":"2024-09-10T08:28:47.627041+0000","last_active":"2024-09-10T08:44:29.463937+0000","last_peered":"2024-09-10T08:44:29.463937+0000","last_clean":"2024-09-10T08:44:29.463937+0000","last_became_active":"2024-09-10T08:28:47.626692+0000","last_became_peered":"2024-09-10T08:28:47.626692+0000","last_unstale":"2024-09-10T08:44:29.463937+0000","last_undegraded":"2024-09-10T08:44:29.463937+0000","last_fullsized":"2024-09-10T08:44:29.463937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5070,"log_dups_size":0,"ondisk_log_size":5070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:57.666849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26421,"num_write_kb":351729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"27'90","reported_seq":122,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.343291+0000","last_change":"2024-09-10T08:28:34.561906+0000","last_active":"2024-09-10T08:44:22.343291+0000","last_peered":"2024-09-10T08:44:22.343291+0000","last_clean":"2024-09-10T08:44:22.343291+0000","last_became_active":"2024-09-10T08:28:34.561613+0000","last_became_peered":"2024-09-10T08:28:34.561613+0000","last_unstale":"2024-09-10T08:44:22.343291+0000","last_undegraded":"2024-09-10T08:44:22.343291+0000","last_fullsized":"2024-09-10T08:44:22.343291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:56.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061672,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":1094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'3916","reported_seq":3946,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.533790+0000","last_change":"2024-09-10T08:28:35.576406+0000","last_active":"2024-09-10T08:44:22.533790+0000","last_peered":"2024-09-10T08:44:22.533790+0000","last_clean":"2024-09-10T08:44:22.533790+0000","last_became_active":"2024-09-10T08:28:35.576145+0000","last_became_peered":"2024-09-10T08:28:35.576145+0000","last_unstale":"2024-09-10T08:44:22.533790+0000","last_undegraded":"2024-09-10T08:44:22.533790+0000","last_fullsized":"2024-09-10T08:44:22.533790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3916,"log_dups_size":0,"ondisk_log_size":3916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:57.667098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19526,"num_write_kb":237971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.846532+0000","last_change":"2024-09-10T08:28:46.622395+0000","last_active":"2024-09-10T08:43:37.846532+0000","last_peered":"2024-09-10T08:43:37.846532+0000","last_clean":"2024-09-10T08:43:37.846532+0000","last_became_active":"2024-09-10T08:28:46.621941+0000","last_became_peered":"2024-09-10T08:28:46.621941+0000","last_unstale":"2024-09-10T08:43:37.846532+0000","last_undegraded":"2024-09-10T08:43:37.846532+0000","last_fullsized":"2024-09-10T08:43:37.846532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:54.928969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"27'3193","reported_seq":3215,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.434312+0000","last_change":"2024-09-10T08:28:47.626495+0000","last_active":"2024-09-10T08:44:29.434312+0000","last_peered":"2024-09-10T08:44:29.434312+0000","last_clean":"2024-09-10T08:44:29.434312+0000","last_became_active":"2024-09-10T08:28:47.625258+0000","last_became_peered":"2024-09-10T08:28:47.625258+0000","last_unstale":"2024-09-10T08:44:29.434312+0000","last_undegraded":"2024-09-10T08:44:29.434312+0000","last_fullsized":"2024-09-10T08:44:29.434312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3193,"log_dups_size":0,"ondisk_log_size":3193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:00.101586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16183,"num_write_kb":212369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'622","reported_seq":654,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:35.040191+0000","last_change":"2024-09-10T08:28:34.566606+0000","last_active":"2024-09-10T08:43:35.040191+0000","last_peered":"2024-09-10T08:43:35.040191+0000","last_clean":"2024-09-10T08:43:35.040191+0000","last_became_active":"2024-09-10T08:28:34.566388+0000","last_became_peered":"2024-09-10T08:28:34.566388+0000","last_unstale":"2024-09-10T08:43:35.040191+0000","last_undegraded":"2024-09-10T08:43:35.040191+0000","last_fullsized":"2024-09-10T08:43:35.040191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:33.528801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":620,"num_write_kb":4248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'4051","reported_seq":4081,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.448831+0000","last_change":"2024-09-10T08:28:35.559371+0000","last_active":"2024-09-10T08:44:22.448831+0000","last_peered":"2024-09-10T08:44:22.448831+0000","last_clean":"2024-09-10T08:44:22.448831+0000","last_became_active":"2024-09-10T08:28:35.559145+0000","last_became_peered":"2024-09-10T08:28:35.559145+0000","last_unstale":"2024-09-10T08:44:22.448831+0000","last_undegraded":"2024-09-10T08:44:22.448831+0000","last_fullsized":"2024-09-10T08:44:22.448831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4051,"log_dups_size":0,"ondisk_log_size":4051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:57.339318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20269,"num_write_kb":257190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'11","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.853770+0000","last_change":"2024-09-10T08:28:46.620231+0000","last_active":"2024-09-10T08:43:37.853770+0000","last_peered":"2024-09-10T08:43:37.853770+0000","last_clean":"2024-09-10T08:43:37.853770+0000","last_became_active":"2024-09-10T08:28:46.619403+0000","last_became_peered":"2024-09-10T08:28:46.619403+0000","last_unstale":"2024-09-10T08:43:37.853770+0000","last_undegraded":"2024-09-10T08:43:37.853770+0000","last_fullsized":"2024-09-10T08:43:37.853770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:26.308749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"27'4023","reported_seq":4046,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.453630+0000","last_change":"2024-09-10T08:28:47.627135+0000","last_active":"2024-09-10T08:44:29.453630+0000","last_peered":"2024-09-10T08:44:29.453630+0000","last_clean":"2024-09-10T08:44:29.453630+0000","last_became_active":"2024-09-10T08:28:47.626791+0000","last_became_peered":"2024-09-10T08:28:47.626791+0000","last_unstale":"2024-09-10T08:44:29.453630+0000","last_undegraded":"2024-09-10T08:44:29.453630+0000","last_fullsized":"2024-09-10T08:44:29.453630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4023,"log_dups_size":0,"ondisk_log_size":4023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:43.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21172,"num_write_kb":269680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'5985","reported_seq":6016,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.506685+0000","last_change":"2024-09-10T08:28:35.579106+0000","last_active":"2024-09-10T08:44:22.506685+0000","last_peered":"2024-09-10T08:44:22.506685+0000","last_clean":"2024-09-10T08:44:22.506685+0000","last_became_active":"2024-09-10T08:28:35.578631+0000","last_became_peered":"2024-09-10T08:28:35.578631+0000","last_unstale":"2024-09-10T08:44:22.506685+0000","last_undegraded":"2024-09-10T08:44:22.506685+0000","last_fullsized":"2024-09-10T08:44:22.506685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5985,"log_dups_size":0,"ondisk_log_size":5985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:31.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30721,"num_write_kb":377078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"27'5461","reported_seq":5484,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.347960+0000","last_change":"2024-09-10T08:28:47.632052+0000","last_active":"2024-09-10T08:44:29.347960+0000","last_peered":"2024-09-10T08:44:29.347960+0000","last_clean":"2024-09-10T08:44:29.347960+0000","last_became_active":"2024-09-10T08:28:47.631578+0000","last_became_peered":"2024-09-10T08:28:47.631578+0000","last_unstale":"2024-09-10T08:44:29.347960+0000","last_undegraded":"2024-09-10T08:44:29.347960+0000","last_fullsized":"2024-09-10T08:44:29.347960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5461,"log_dups_size":0,"ondisk_log_size":5461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:24.570729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28495,"num_write_kb":351882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"27'5419","reported_seq":5455,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.513489+0000","last_change":"2024-09-10T08:29:36.030138+0000","last_active":"2024-09-10T08:44:22.513489+0000","last_peered":"2024-09-10T08:44:22.513489+0000","last_clean":"2024-09-10T08:44:22.513489+0000","last_became_active":"2024-09-10T08:29:36.029789+0000","last_became_peered":"2024-09-10T08:29:36.029789+0000","last_unstale":"2024-09-10T08:44:22.513489+0000","last_undegraded":"2024-09-10T08:44:22.513489+0000","last_fullsized":"2024-09-10T08:44:22.513489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5419,"log_dups_size":0,"ondisk_log_size":5419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:56:49.067000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28175,"num_write_kb":329998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"27'4342","reported_seq":4365,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456079+0000","last_change":"2024-09-10T08:28:47.629148+0000","last_active":"2024-09-10T08:44:29.456079+0000","last_peered":"2024-09-10T08:44:29.456079+0000","last_clean":"2024-09-10T08:44:29.456079+0000","last_became_active":"2024-09-10T08:28:47.628741+0000","last_became_peered":"2024-09-10T08:28:47.628741+0000","last_unstale":"2024-09-10T08:44:29.456079+0000","last_undegraded":"2024-09-10T08:44:29.456079+0000","last_fullsized":"2024-09-10T08:44:29.456079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:48.950503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22591,"num_write_kb":275032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"27'5933","reported_seq":5964,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.508630+0000","last_change":"2024-09-10T08:28:35.578735+0000","last_active":"2024-09-10T08:44:22.508630+0000","last_peered":"2024-09-10T08:44:22.508630+0000","last_clean":"2024-09-10T08:44:22.508630+0000","last_became_active":"2024-09-10T08:28:35.577995+0000","last_became_peered":"2024-09-10T08:28:35.577995+0000","last_unstale":"2024-09-10T08:44:22.508630+0000","last_undegraded":"2024-09-10T08:44:22.508630+0000","last_fullsized":"2024-09-10T08:44:22.508630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5933,"log_dups_size":0,"ondisk_log_size":5933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:11.033441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30577,"num_write_kb":368306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"27'4476","reported_seq":4499,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.461540+0000","last_change":"2024-09-10T08:28:47.628639+0000","last_active":"2024-09-10T08:44:29.461540+0000","last_peered":"2024-09-10T08:44:29.461540+0000","last_clean":"2024-09-10T08:44:29.461540+0000","last_became_active":"2024-09-10T08:28:47.628317+0000","last_became_peered":"2024-09-10T08:28:47.628317+0000","last_unstale":"2024-09-10T08:44:29.461540+0000","last_undegraded":"2024-09-10T08:44:29.461540+0000","last_fullsized":"2024-09-10T08:44:29.461540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4476,"log_dups_size":0,"ondisk_log_size":4476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:50.314678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23867,"num_write_kb":312797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"27'4232","reported_seq":4263,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.522252+0000","last_change":"2024-09-10T08:28:35.577852+0000","last_active":"2024-09-10T08:44:22.522252+0000","last_peered":"2024-09-10T08:44:22.522252+0000","last_clean":"2024-09-10T08:44:22.522252+0000","last_became_active":"2024-09-10T08:28:35.577571+0000","last_became_peered":"2024-09-10T08:28:35.577571+0000","last_unstale":"2024-09-10T08:44:22.522252+0000","last_undegraded":"2024-09-10T08:44:22.522252+0000","last_fullsized":"2024-09-10T08:44:22.522252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4232,"log_dups_size":0,"ondisk_log_size":4232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:22.713732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21938,"num_write_kb":263982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"27'5518","reported_seq":5541,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.374526+0000","last_change":"2024-09-10T08:28:47.629931+0000","last_active":"2024-09-10T08:44:29.374526+0000","last_peered":"2024-09-10T08:44:29.374526+0000","last_clean":"2024-09-10T08:44:29.374526+0000","last_became_active":"2024-09-10T08:28:47.629634+0000","last_became_peered":"2024-09-10T08:28:47.629634+0000","last_unstale":"2024-09-10T08:44:29.374526+0000","last_undegraded":"2024-09-10T08:44:29.374526+0000","last_fullsized":"2024-09-10T08:44:29.374526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5518,"log_dups_size":0,"ondisk_log_size":5518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:57.964208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28611,"num_write_kb":360382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"27'3937","reported_seq":3968,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.454987+0000","last_change":"2024-09-10T08:28:35.574676+0000","last_active":"2024-09-10T08:44:22.454987+0000","last_peered":"2024-09-10T08:44:22.454987+0000","last_clean":"2024-09-10T08:44:22.454987+0000","last_became_active":"2024-09-10T08:28:35.574437+0000","last_became_peered":"2024-09-10T08:28:35.574437+0000","last_unstale":"2024-09-10T08:44:22.454987+0000","last_undegraded":"2024-09-10T08:44:22.454987+0000","last_fullsized":"2024-09-10T08:44:22.454987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3937,"log_dups_size":0,"ondisk_log_size":3937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:45.422506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20167,"num_write_kb":265112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"27'3790","reported_seq":3813,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456016+0000","last_change":"2024-09-10T08:28:47.624178+0000","last_active":"2024-09-10T08:44:29.456016+0000","last_peered":"2024-09-10T08:44:29.456016+0000","last_clean":"2024-09-10T08:44:29.456016+0000","last_became_active":"2024-09-10T08:28:47.623671+0000","last_became_peered":"2024-09-10T08:28:47.623671+0000","last_unstale":"2024-09-10T08:44:29.456016+0000","last_undegraded":"2024-09-10T08:44:29.456016+0000","last_fullsized":"2024-09-10T08:44:29.456016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3790,"log_dups_size":0,"ondisk_log_size":3790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:48.613870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19891,"num_write_kb":255782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"27'4956","reported_seq":4987,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.486306+0000","last_change":"2024-09-10T08:28:35.572550+0000","last_active":"2024-09-10T08:44:22.486306+0000","last_peered":"2024-09-10T08:44:22.486306+0000","last_clean":"2024-09-10T08:44:22.486306+0000","last_became_active":"2024-09-10T08:28:35.572184+0000","last_became_peered":"2024-09-10T08:28:35.572184+0000","last_unstale":"2024-09-10T08:44:22.486306+0000","last_undegraded":"2024-09-10T08:44:22.486306+0000","last_fullsized":"2024-09-10T08:44:22.486306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4956,"log_dups_size":0,"ondisk_log_size":4956,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:08.490734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26295,"num_write_kb":322461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"27'5495","reported_seq":5518,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.478950+0000","last_change":"2024-09-10T08:28:47.630214+0000","last_active":"2024-09-10T08:44:29.478950+0000","last_peered":"2024-09-10T08:44:29.478950+0000","last_clean":"2024-09-10T08:44:29.478950+0000","last_became_active":"2024-09-10T08:28:47.629512+0000","last_became_peered":"2024-09-10T08:28:47.629512+0000","last_unstale":"2024-09-10T08:44:29.478950+0000","last_undegraded":"2024-09-10T08:44:29.478950+0000","last_fullsized":"2024-09-10T08:44:29.478950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5495,"log_dups_size":0,"ondisk_log_size":5495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:35.692107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29037,"num_write_kb":370350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"27'4400","reported_seq":4431,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.553518+0000","last_change":"2024-09-10T08:28:35.573217+0000","last_active":"2024-09-10T08:44:22.553518+0000","last_peered":"2024-09-10T08:44:22.553518+0000","last_clean":"2024-09-10T08:44:22.553518+0000","last_became_active":"2024-09-10T08:28:35.572955+0000","last_became_peered":"2024-09-10T08:28:35.572955+0000","last_unstale":"2024-09-10T08:44:22.553518+0000","last_undegraded":"2024-09-10T08:44:22.553518+0000","last_fullsized":"2024-09-10T08:44:22.553518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4400,"log_dups_size":0,"ondisk_log_size":4400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:24.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22665,"num_write_kb":275496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"27'4608","reported_seq":4631,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.438440+0000","last_change":"2024-09-10T08:28:47.623365+0000","last_active":"2024-09-10T08:44:29.438440+0000","last_peered":"2024-09-10T08:44:29.438440+0000","last_clean":"2024-09-10T08:44:29.438440+0000","last_became_active":"2024-09-10T08:28:47.623082+0000","last_became_peered":"2024-09-10T08:28:47.623082+0000","last_unstale":"2024-09-10T08:44:29.438440+0000","last_undegraded":"2024-09-10T08:44:29.438440+0000","last_fullsized":"2024-09-10T08:44:29.438440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:20.558484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24193,"num_write_kb":313982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'6039","reported_seq":6070,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.401543+0000","last_change":"2024-09-10T08:28:35.575902+0000","last_active":"2024-09-10T08:44:22.401543+0000","last_peered":"2024-09-10T08:44:22.401543+0000","last_clean":"2024-09-10T08:44:22.401543+0000","last_became_active":"2024-09-10T08:28:35.575614+0000","last_became_peered":"2024-09-10T08:28:35.575614+0000","last_unstale":"2024-09-10T08:44:22.401543+0000","last_undegraded":"2024-09-10T08:44:22.401543+0000","last_fullsized":"2024-09-10T08:44:22.401543+0000","mapping_epoch":19,"log_start":"27'800","ondisk_log_start":"27'800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:11.277682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31129,"num_write_kb":362414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"27'3524","reported_seq":3546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.429365+0000","last_change":"2024-09-10T08:28:47.629795+0000","last_active":"2024-09-10T08:44:29.429365+0000","last_peered":"2024-09-10T08:44:29.429365+0000","last_clean":"2024-09-10T08:44:29.429365+0000","last_became_active":"2024-09-10T08:28:47.628861+0000","last_became_peered":"2024-09-10T08:28:47.628861+0000","last_unstale":"2024-09-10T08:44:29.429365+0000","last_undegraded":"2024-09-10T08:44:29.429365+0000","last_fullsized":"2024-09-10T08:44:29.429365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3524,"log_dups_size":0,"ondisk_log_size":3524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:06.277094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18277,"num_write_kb":237112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'4470","reported_seq":4501,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.481878+0000","last_change":"2024-09-10T08:28:35.578285+0000","last_active":"2024-09-10T08:44:22.481878+0000","last_peered":"2024-09-10T08:44:22.481878+0000","last_clean":"2024-09-10T08:44:22.481878+0000","last_became_active":"2024-09-10T08:28:35.576805+0000","last_became_peered":"2024-09-10T08:28:35.576805+0000","last_unstale":"2024-09-10T08:44:22.481878+0000","last_undegraded":"2024-09-10T08:44:22.481878+0000","last_fullsized":"2024-09-10T08:44:22.481878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4470,"log_dups_size":0,"ondisk_log_size":4470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:46.203320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22783,"num_write_kb":271507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"27'5536","reported_seq":5558,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.409088+0000","last_change":"2024-09-10T08:28:47.635713+0000","last_active":"2024-09-10T08:44:29.409088+0000","last_peered":"2024-09-10T08:44:29.409088+0000","last_clean":"2024-09-10T08:44:29.409088+0000","last_became_active":"2024-09-10T08:28:47.635381+0000","last_became_peered":"2024-09-10T08:28:47.635381+0000","last_unstale":"2024-09-10T08:44:29.409088+0000","last_undegraded":"2024-09-10T08:44:29.409088+0000","last_fullsized":"2024-09-10T08:44:29.409088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5536,"log_dups_size":0,"ondisk_log_size":5536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:39.419510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28458,"num_write_kb":359914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"27'4347","reported_seq":4363,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.499781+0000","last_change":"2024-09-10T08:29:35.097545+0000","last_active":"2024-09-10T08:44:22.499781+0000","last_peered":"2024-09-10T08:44:22.499781+0000","last_clean":"2024-09-10T08:44:22.499781+0000","last_became_active":"2024-09-10T08:29:35.097273+0000","last_became_peered":"2024-09-10T08:29:35.097273+0000","last_unstale":"2024-09-10T08:44:22.499781+0000","last_undegraded":"2024-09-10T08:44:22.499781+0000","last_fullsized":"2024-09-10T08:44:22.499781+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4347,"log_dups_size":0,"ondisk_log_size":4347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:40.058249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22114,"num_write_kb":289250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2c","version":"27'4653","reported_seq":4676,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.447481+0000","last_change":"2024-09-10T08:28:47.619863+0000","last_active":"2024-09-10T08:44:29.447481+0000","last_peered":"2024-09-10T08:44:29.447481+0000","last_clean":"2024-09-10T08:44:29.447481+0000","last_became_active":"2024-09-10T08:28:47.619525+0000","last_became_peered":"2024-09-10T08:28:47.619525+0000","last_unstale":"2024-09-10T08:44:29.447481+0000","last_undegraded":"2024-09-10T08:44:29.447481+0000","last_fullsized":"2024-09-10T08:44:29.447481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4653,"log_dups_size":0,"ondisk_log_size":4653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:49.591318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24519,"num_write_kb":299145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"27'5080","reported_seq":5111,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.544103+0000","last_change":"2024-09-10T08:28:35.568044+0000","last_active":"2024-09-10T08:44:22.544103+0000","last_peered":"2024-09-10T08:44:22.544103+0000","last_clean":"2024-09-10T08:44:22.544103+0000","last_became_active":"2024-09-10T08:28:35.567744+0000","last_became_peered":"2024-09-10T08:28:35.567744+0000","last_unstale":"2024-09-10T08:44:22.544103+0000","last_undegraded":"2024-09-10T08:44:22.544103+0000","last_fullsized":"2024-09-10T08:44:22.544103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5080,"log_dups_size":0,"ondisk_log_size":5080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:19.081138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26557,"num_write_kb":327659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"27'4432","reported_seq":4454,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.395035+0000","last_change":"2024-09-10T08:28:47.629417+0000","last_active":"2024-09-10T08:44:29.395035+0000","last_peered":"2024-09-10T08:44:29.395035+0000","last_clean":"2024-09-10T08:44:29.395035+0000","last_became_active":"2024-09-10T08:28:47.629095+0000","last_became_peered":"2024-09-10T08:28:47.629095+0000","last_unstale":"2024-09-10T08:44:29.395035+0000","last_undegraded":"2024-09-10T08:44:29.395035+0000","last_fullsized":"2024-09-10T08:44:29.395035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4432,"log_dups_size":0,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:05.606381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22331,"num_write_kb":294288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"27'4801","reported_seq":4832,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.544316+0000","last_change":"2024-09-10T08:28:35.575802+0000","last_active":"2024-09-10T08:44:22.544316+0000","last_peered":"2024-09-10T08:44:22.544316+0000","last_clean":"2024-09-10T08:44:22.544316+0000","last_became_active":"2024-09-10T08:28:35.575388+0000","last_became_peered":"2024-09-10T08:28:35.575388+0000","last_unstale":"2024-09-10T08:44:22.544316+0000","last_undegraded":"2024-09-10T08:44:22.544316+0000","last_fullsized":"2024-09-10T08:44:22.544316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4801,"log_dups_size":0,"ondisk_log_size":4801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:01.424265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24675,"num_write_kb":307760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"27'4608","reported_seq":4630,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.451461+0000","last_change":"2024-09-10T08:28:47.624305+0000","last_active":"2024-09-10T08:44:29.451461+0000","last_peered":"2024-09-10T08:44:29.451461+0000","last_clean":"2024-09-10T08:44:29.451461+0000","last_became_active":"2024-09-10T08:28:47.624026+0000","last_became_peered":"2024-09-10T08:28:47.624026+0000","last_unstale":"2024-09-10T08:44:29.451461+0000","last_undegraded":"2024-09-10T08:44:29.451461+0000","last_fullsized":"2024-09-10T08:44:29.451461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:01.194271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24388,"num_write_kb":319015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'4484","reported_seq":4515,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.485515+0000","last_change":"2024-09-10T08:28:35.574499+0000","last_active":"2024-09-10T08:44:22.485515+0000","last_peered":"2024-09-10T08:44:22.485515+0000","last_clean":"2024-09-10T08:44:22.485515+0000","last_became_active":"2024-09-10T08:28:35.574249+0000","last_became_peered":"2024-09-10T08:28:35.574249+0000","last_unstale":"2024-09-10T08:44:22.485515+0000","last_undegraded":"2024-09-10T08:44:22.485515+0000","last_fullsized":"2024-09-10T08:44:22.485515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4484,"log_dups_size":0,"ondisk_log_size":4484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:55.952307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23126,"num_write_kb":293453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"27'4466","reported_seq":4488,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456346+0000","last_change":"2024-09-10T08:28:47.629525+0000","last_active":"2024-09-10T08:44:29.456346+0000","last_peered":"2024-09-10T08:44:29.456346+0000","last_clean":"2024-09-10T08:44:29.456346+0000","last_became_active":"2024-09-10T08:28:47.629259+0000","last_became_peered":"2024-09-10T08:28:47.629259+0000","last_unstale":"2024-09-10T08:44:29.456346+0000","last_undegraded":"2024-09-10T08:44:29.456346+0000","last_fullsized":"2024-09-10T08:44:29.456346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4466,"log_dups_size":0,"ondisk_log_size":4466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:11.864322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23096,"num_write_kb":301452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"27'4995","reported_seq":5026,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.537572+0000","last_change":"2024-09-10T08:28:35.572709+0000","last_active":"2024-09-10T08:44:22.537572+0000","last_peered":"2024-09-10T08:44:22.537572+0000","last_clean":"2024-09-10T08:44:22.537572+0000","last_became_active":"2024-09-10T08:28:35.572392+0000","last_became_peered":"2024-09-10T08:28:35.572392+0000","last_unstale":"2024-09-10T08:44:22.537572+0000","last_undegraded":"2024-09-10T08:44:22.537572+0000","last_fullsized":"2024-09-10T08:44:22.537572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4995,"log_dups_size":0,"ondisk_log_size":4995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:42.636299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25177,"num_write_kb":305700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"27'4176","reported_seq":4199,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.350264+0000","last_change":"2024-09-10T08:28:47.623285+0000","last_active":"2024-09-10T08:44:29.350264+0000","last_peered":"2024-09-10T08:44:29.350264+0000","last_clean":"2024-09-10T08:44:29.350264+0000","last_became_active":"2024-09-10T08:28:47.621776+0000","last_became_peered":"2024-09-10T08:28:47.621776+0000","last_unstale":"2024-09-10T08:44:29.350264+0000","last_undegraded":"2024-09-10T08:44:29.350264+0000","last_fullsized":"2024-09-10T08:44:29.350264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:32.543418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21718,"num_write_kb":267375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'3678","reported_seq":3708,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.498693+0000","last_change":"2024-09-10T08:28:35.574438+0000","last_active":"2024-09-10T08:44:22.498693+0000","last_peered":"2024-09-10T08:44:22.498693+0000","last_clean":"2024-09-10T08:44:22.498693+0000","last_became_active":"2024-09-10T08:28:35.574175+0000","last_became_peered":"2024-09-10T08:28:35.574175+0000","last_unstale":"2024-09-10T08:44:22.498693+0000","last_undegraded":"2024-09-10T08:44:22.498693+0000","last_fullsized":"2024-09-10T08:44:22.498693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3678,"log_dups_size":0,"ondisk_log_size":3678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:55.808543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18345,"num_write_kb":237300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"27'4228","reported_seq":4250,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.395548+0000","last_change":"2024-09-10T08:28:47.629092+0000","last_active":"2024-09-10T08:44:29.395548+0000","last_peered":"2024-09-10T08:44:29.395548+0000","last_clean":"2024-09-10T08:44:29.395548+0000","last_became_active":"2024-09-10T08:28:47.628806+0000","last_became_peered":"2024-09-10T08:28:47.628806+0000","last_unstale":"2024-09-10T08:44:29.395548+0000","last_undegraded":"2024-09-10T08:44:29.395548+0000","last_fullsized":"2024-09-10T08:44:29.395548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4228,"log_dups_size":0,"ondisk_log_size":4228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:46.440290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21732,"num_write_kb":287874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"27'5344","reported_seq":5360,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.508645+0000","last_change":"2024-09-10T08:29:35.107021+0000","last_active":"2024-09-10T08:44:22.508645+0000","last_peered":"2024-09-10T08:44:22.508645+0000","last_clean":"2024-09-10T08:44:22.508645+0000","last_became_active":"2024-09-10T08:29:35.106806+0000","last_became_peered":"2024-09-10T08:29:35.106806+0000","last_unstale":"2024-09-10T08:44:22.508645+0000","last_undegraded":"2024-09-10T08:44:22.508645+0000","last_fullsized":"2024-09-10T08:44:22.508645+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5344,"log_dups_size":0,"ondisk_log_size":5344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:20.234687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27047,"num_write_kb":354198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"27'5319","reported_seq":5341,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.401144+0000","last_change":"2024-09-10T08:28:47.631797+0000","last_active":"2024-09-10T08:44:29.401144+0000","last_peered":"2024-09-10T08:44:29.401144+0000","last_clean":"2024-09-10T08:44:29.401144+0000","last_became_active":"2024-09-10T08:28:47.631523+0000","last_became_peered":"2024-09-10T08:28:47.631523+0000","last_unstale":"2024-09-10T08:44:29.401144+0000","last_undegraded":"2024-09-10T08:44:29.401144+0000","last_fullsized":"2024-09-10T08:44:29.401144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5319,"log_dups_size":0,"ondisk_log_size":5319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:05.829116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28163,"num_write_kb":342261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'4477","reported_seq":4507,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.480254+0000","last_change":"2024-09-10T08:28:35.570249+0000","last_active":"2024-09-10T08:44:22.480254+0000","last_peered":"2024-09-10T08:44:22.480254+0000","last_clean":"2024-09-10T08:44:22.480254+0000","last_became_active":"2024-09-10T08:28:35.569960+0000","last_became_peered":"2024-09-10T08:28:35.569960+0000","last_unstale":"2024-09-10T08:44:22.480254+0000","last_undegraded":"2024-09-10T08:44:22.480254+0000","last_fullsized":"2024-09-10T08:44:22.480254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4477,"log_dups_size":0,"ondisk_log_size":4477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:29.787554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23485,"num_write_kb":274341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"27'5295","reported_seq":5317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.481069+0000","last_change":"2024-09-10T08:28:47.633644+0000","last_active":"2024-09-10T08:44:29.481069+0000","last_peered":"2024-09-10T08:44:29.481069+0000","last_clean":"2024-09-10T08:44:29.481069+0000","last_became_active":"2024-09-10T08:28:47.633315+0000","last_became_peered":"2024-09-10T08:28:47.633315+0000","last_unstale":"2024-09-10T08:44:29.481069+0000","last_undegraded":"2024-09-10T08:44:29.481069+0000","last_fullsized":"2024-09-10T08:44:29.481069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5295,"log_dups_size":0,"ondisk_log_size":5295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:45:55.827386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28671,"num_write_kb":360707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"27'4645","reported_seq":4675,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.519615+0000","last_change":"2024-09-10T08:28:35.560693+0000","last_active":"2024-09-10T08:44:22.519615+0000","last_peered":"2024-09-10T08:44:22.519615+0000","last_clean":"2024-09-10T08:44:22.519615+0000","last_became_active":"2024-09-10T08:28:35.560409+0000","last_became_peered":"2024-09-10T08:28:35.560409+0000","last_unstale":"2024-09-10T08:44:22.519615+0000","last_undegraded":"2024-09-10T08:44:22.519615+0000","last_fullsized":"2024-09-10T08:44:22.519615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4645,"log_dups_size":0,"ondisk_log_size":4645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:10.597654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23495,"num_write_kb":303194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"27'3828","reported_seq":3850,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.453763+0000","last_change":"2024-09-10T08:28:47.622614+0000","last_active":"2024-09-10T08:44:29.453763+0000","last_peered":"2024-09-10T08:44:29.453763+0000","last_clean":"2024-09-10T08:44:29.453763+0000","last_became_active":"2024-09-10T08:28:47.622205+0000","last_became_peered":"2024-09-10T08:28:47.622205+0000","last_unstale":"2024-09-10T08:44:29.453763+0000","last_undegraded":"2024-09-10T08:44:29.453763+0000","last_fullsized":"2024-09-10T08:44:29.453763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3828,"log_dups_size":0,"ondisk_log_size":3828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:47.090782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19475,"num_write_kb":250147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'5239","reported_seq":5269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.476534+0000","last_change":"2024-09-10T08:28:35.574551+0000","last_active":"2024-09-10T08:44:22.476534+0000","last_peered":"2024-09-10T08:44:22.476534+0000","last_clean":"2024-09-10T08:44:22.476534+0000","last_became_active":"2024-09-10T08:28:35.574256+0000","last_became_peered":"2024-09-10T08:28:35.574256+0000","last_unstale":"2024-09-10T08:44:22.476534+0000","last_undegraded":"2024-09-10T08:44:22.476534+0000","last_fullsized":"2024-09-10T08:44:22.476534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:43.401552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27760,"num_write_kb":320273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"27'4221","reported_seq":4243,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.396030+0000","last_change":"2024-09-10T08:28:47.633476+0000","last_active":"2024-09-10T08:44:29.396030+0000","last_peered":"2024-09-10T08:44:29.396030+0000","last_clean":"2024-09-10T08:44:29.396030+0000","last_became_active":"2024-09-10T08:28:47.633189+0000","last_became_peered":"2024-09-10T08:28:47.633189+0000","last_unstale":"2024-09-10T08:44:29.396030+0000","last_undegraded":"2024-09-10T08:44:29.396030+0000","last_fullsized":"2024-09-10T08:44:29.396030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4221,"log_dups_size":0,"ondisk_log_size":4221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:46.175490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21808,"num_write_kb":284043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"27'4276","reported_seq":4306,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.491121+0000","last_change":"2024-09-10T08:28:35.573330+0000","last_active":"2024-09-10T08:44:22.491121+0000","last_peered":"2024-09-10T08:44:22.491121+0000","last_clean":"2024-09-10T08:44:22.491121+0000","last_became_active":"2024-09-10T08:28:35.572992+0000","last_became_peered":"2024-09-10T08:28:35.572992+0000","last_unstale":"2024-09-10T08:44:22.491121+0000","last_undegraded":"2024-09-10T08:44:22.491121+0000","last_fullsized":"2024-09-10T08:44:22.491121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4276,"log_dups_size":0,"ondisk_log_size":4276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:15.412219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22251,"num_write_kb":273423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"27'4525","reported_seq":4547,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.372686+0000","last_change":"2024-09-10T08:28:47.630733+0000","last_active":"2024-09-10T08:44:29.372686+0000","last_peered":"2024-09-10T08:44:29.372686+0000","last_clean":"2024-09-10T08:44:29.372686+0000","last_became_active":"2024-09-10T08:28:47.630447+0000","last_became_peered":"2024-09-10T08:28:47.630447+0000","last_unstale":"2024-09-10T08:44:29.372686+0000","last_undegraded":"2024-09-10T08:44:29.372686+0000","last_fullsized":"2024-09-10T08:44:29.372686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4525,"log_dups_size":0,"ondisk_log_size":4525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:08.797818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23690,"num_write_kb":303969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'4030","reported_seq":4060,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.496908+0000","last_change":"2024-09-10T08:28:35.566574+0000","last_active":"2024-09-10T08:44:22.496908+0000","last_peered":"2024-09-10T08:44:22.496908+0000","last_clean":"2024-09-10T08:44:22.496908+0000","last_became_active":"2024-09-10T08:28:35.566205+0000","last_became_peered":"2024-09-10T08:28:35.566205+0000","last_unstale":"2024-09-10T08:44:22.496908+0000","last_undegraded":"2024-09-10T08:44:22.496908+0000","last_fullsized":"2024-09-10T08:44:22.496908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4030,"log_dups_size":0,"ondisk_log_size":4030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:49.876773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20014,"num_write_kb":252379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"27'4167","reported_seq":4189,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.339294+0000","last_change":"2024-09-10T08:28:47.628051+0000","last_active":"2024-09-10T08:44:29.339294+0000","last_peered":"2024-09-10T08:44:29.339294+0000","last_clean":"2024-09-10T08:44:29.339294+0000","last_became_active":"2024-09-10T08:28:47.627747+0000","last_became_peered":"2024-09-10T08:28:47.627747+0000","last_unstale":"2024-09-10T08:44:29.339294+0000","last_undegraded":"2024-09-10T08:44:29.339294+0000","last_fullsized":"2024-09-10T08:44:29.339294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4167,"log_dups_size":0,"ondisk_log_size":4167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:54.210449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22015,"num_write_kb":272523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"27'4068","reported_seq":4098,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.450841+0000","last_change":"2024-09-10T08:28:35.565023+0000","last_active":"2024-09-10T08:44:22.450841+0000","last_peered":"2024-09-10T08:44:22.450841+0000","last_clean":"2024-09-10T08:44:22.450841+0000","last_became_active":"2024-09-10T08:28:35.564747+0000","last_became_peered":"2024-09-10T08:28:35.564747+0000","last_unstale":"2024-09-10T08:44:22.450841+0000","last_undegraded":"2024-09-10T08:44:22.450841+0000","last_fullsized":"2024-09-10T08:44:22.450841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4068,"log_dups_size":0,"ondisk_log_size":4068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:32.419621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20848,"num_write_kb":280067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"27'3614","reported_seq":3636,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.473598+0000","last_change":"2024-09-10T08:28:47.631047+0000","last_active":"2024-09-10T08:44:29.473598+0000","last_peered":"2024-09-10T08:44:29.473598+0000","last_clean":"2024-09-10T08:44:29.473598+0000","last_became_active":"2024-09-10T08:28:47.630617+0000","last_became_peered":"2024-09-10T08:28:47.630617+0000","last_unstale":"2024-09-10T08:44:29.473598+0000","last_undegraded":"2024-09-10T08:44:29.473598+0000","last_fullsized":"2024-09-10T08:44:29.473598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3614,"log_dups_size":0,"ondisk_log_size":3614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:29.867640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19300,"num_write_kb":257617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'4938","reported_seq":4968,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.528147+0000","last_change":"2024-09-10T08:28:35.570619+0000","last_active":"2024-09-10T08:44:22.528147+0000","last_peered":"2024-09-10T08:44:22.528147+0000","last_clean":"2024-09-10T08:44:22.528147+0000","last_became_active":"2024-09-10T08:28:35.570351+0000","last_became_peered":"2024-09-10T08:28:35.570351+0000","last_unstale":"2024-09-10T08:44:22.528147+0000","last_undegraded":"2024-09-10T08:44:22.528147+0000","last_fullsized":"2024-09-10T08:44:22.528147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4938,"log_dups_size":0,"ondisk_log_size":4938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:35.161279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26047,"num_write_kb":333713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"27'4403","reported_seq":4425,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.439522+0000","last_change":"2024-09-10T08:28:47.626191+0000","last_active":"2024-09-10T08:44:29.439522+0000","last_peered":"2024-09-10T08:44:29.439522+0000","last_clean":"2024-09-10T08:44:29.439522+0000","last_became_active":"2024-09-10T08:28:47.625781+0000","last_became_peered":"2024-09-10T08:28:47.625781+0000","last_unstale":"2024-09-10T08:44:29.439522+0000","last_undegraded":"2024-09-10T08:44:29.439522+0000","last_fullsized":"2024-09-10T08:44:29.439522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4403,"log_dups_size":0,"ondisk_log_size":4403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:36:38.651973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22837,"num_write_kb":300422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"27'5731","reported_seq":5761,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.570796+0000","last_change":"2024-09-10T08:28:35.577345+0000","last_active":"2024-09-10T08:44:22.570796+0000","last_peered":"2024-09-10T08:44:22.570796+0000","last_clean":"2024-09-10T08:44:22.570796+0000","last_became_active":"2024-09-10T08:28:35.576191+0000","last_became_peered":"2024-09-10T08:28:35.576191+0000","last_unstale":"2024-09-10T08:44:22.570796+0000","last_undegraded":"2024-09-10T08:44:22.570796+0000","last_fullsized":"2024-09-10T08:44:22.570796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5731,"log_dups_size":0,"ondisk_log_size":5731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:29.218797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30251,"num_write_kb":366959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"27'5875","reported_seq":5898,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.422514+0000","last_change":"2024-09-10T08:28:47.623129+0000","last_active":"2024-09-10T08:44:29.422514+0000","last_peered":"2024-09-10T08:44:29.422514+0000","last_clean":"2024-09-10T08:44:29.422514+0000","last_became_active":"2024-09-10T08:28:47.622851+0000","last_became_peered":"2024-09-10T08:28:47.622851+0000","last_unstale":"2024-09-10T08:44:29.422514+0000","last_undegraded":"2024-09-10T08:44:29.422514+0000","last_fullsized":"2024-09-10T08:44:29.422514+0000","mapping_epoch":23,"log_start":"27'700","ondisk_log_start":"27'700","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5175,"log_dups_size":0,"ondisk_log_size":5175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:16.045213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31498,"num_write_kb":384432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"27'4833","reported_seq":4863,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.512670+0000","last_change":"2024-09-10T08:28:35.575275+0000","last_active":"2024-09-10T08:44:22.512670+0000","last_peered":"2024-09-10T08:44:22.512670+0000","last_clean":"2024-09-10T08:44:22.512670+0000","last_became_active":"2024-09-10T08:28:35.575052+0000","last_became_peered":"2024-09-10T08:28:35.575052+0000","last_unstale":"2024-09-10T08:44:22.512670+0000","last_undegraded":"2024-09-10T08:44:22.512670+0000","last_fullsized":"2024-09-10T08:44:22.512670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4833,"log_dups_size":0,"ondisk_log_size":4833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:24.313017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24290,"num_write_kb":318500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"27'3897","reported_seq":3920,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.448047+0000","last_change":"2024-09-10T08:28:47.628651+0000","last_active":"2024-09-10T08:44:29.448047+0000","last_peered":"2024-09-10T08:44:29.448047+0000","last_clean":"2024-09-10T08:44:29.448047+0000","last_became_active":"2024-09-10T08:28:47.628343+0000","last_became_peered":"2024-09-10T08:28:47.628343+0000","last_unstale":"2024-09-10T08:44:29.448047+0000","last_undegraded":"2024-09-10T08:44:29.448047+0000","last_fullsized":"2024-09-10T08:44:29.448047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3897,"log_dups_size":0,"ondisk_log_size":3897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:05.848341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20646,"num_write_kb":258901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"27'4919","reported_seq":4949,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.470476+0000","last_change":"2024-09-10T08:28:35.578664+0000","last_active":"2024-09-10T08:44:22.470476+0000","last_peered":"2024-09-10T08:44:22.470476+0000","last_clean":"2024-09-10T08:44:22.470476+0000","last_became_active":"2024-09-10T08:28:35.578384+0000","last_became_peered":"2024-09-10T08:28:35.578384+0000","last_unstale":"2024-09-10T08:44:22.470476+0000","last_undegraded":"2024-09-10T08:44:22.470476+0000","last_fullsized":"2024-09-10T08:44:22.470476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4919,"log_dups_size":0,"ondisk_log_size":4919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:44.278718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25865,"num_write_kb":300415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"27'4164","reported_seq":4187,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.421617+0000","last_change":"2024-09-10T08:28:47.627593+0000","last_active":"2024-09-10T08:44:29.421617+0000","last_peered":"2024-09-10T08:44:29.421617+0000","last_clean":"2024-09-10T08:44:29.421617+0000","last_became_active":"2024-09-10T08:28:47.627237+0000","last_became_peered":"2024-09-10T08:28:47.627237+0000","last_unstale":"2024-09-10T08:44:29.421617+0000","last_undegraded":"2024-09-10T08:44:29.421617+0000","last_fullsized":"2024-09-10T08:44:29.421617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4164,"log_dups_size":0,"ondisk_log_size":4164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:16.045213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22780,"num_write_kb":275817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'3973","reported_seq":4003,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.535798+0000","last_change":"2024-09-10T08:28:35.578978+0000","last_active":"2024-09-10T08:44:22.535798+0000","last_peered":"2024-09-10T08:44:22.535798+0000","last_clean":"2024-09-10T08:44:22.535798+0000","last_became_active":"2024-09-10T08:28:35.578475+0000","last_became_peered":"2024-09-10T08:28:35.578475+0000","last_unstale":"2024-09-10T08:44:22.535798+0000","last_undegraded":"2024-09-10T08:44:22.535798+0000","last_fullsized":"2024-09-10T08:44:22.535798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3973,"log_dups_size":0,"ondisk_log_size":3973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:08.520314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20258,"num_write_kb":257321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"27'4520","reported_seq":4543,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.418567+0000","last_change":"2024-09-10T08:28:47.634072+0000","last_active":"2024-09-10T08:44:29.418567+0000","last_peered":"2024-09-10T08:44:29.418567+0000","last_clean":"2024-09-10T08:44:29.418567+0000","last_became_active":"2024-09-10T08:28:47.633776+0000","last_became_peered":"2024-09-10T08:28:47.633776+0000","last_unstale":"2024-09-10T08:44:29.418567+0000","last_undegraded":"2024-09-10T08:44:29.418567+0000","last_fullsized":"2024-09-10T08:44:29.418567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4520,"log_dups_size":0,"ondisk_log_size":4520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:30.690202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23464,"num_write_kb":303031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'5689","reported_seq":5719,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.552561+0000","last_change":"2024-09-10T08:28:35.572112+0000","last_active":"2024-09-10T08:44:22.552561+0000","last_peered":"2024-09-10T08:44:22.552561+0000","last_clean":"2024-09-10T08:44:22.552561+0000","last_became_active":"2024-09-10T08:28:35.571803+0000","last_became_peered":"2024-09-10T08:28:35.571803+0000","last_unstale":"2024-09-10T08:44:22.552561+0000","last_undegraded":"2024-09-10T08:44:22.552561+0000","last_fullsized":"2024-09-10T08:44:22.552561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5689,"log_dups_size":0,"ondisk_log_size":5689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:29.969987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28713,"num_write_kb":356779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"27'3638","reported_seq":3660,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456832+0000","last_change":"2024-09-10T08:28:47.620523+0000","last_active":"2024-09-10T08:44:29.456832+0000","last_peered":"2024-09-10T08:44:29.456832+0000","last_clean":"2024-09-10T08:44:29.456832+0000","last_became_active":"2024-09-10T08:28:47.620220+0000","last_became_peered":"2024-09-10T08:28:47.620220+0000","last_unstale":"2024-09-10T08:44:29.456832+0000","last_undegraded":"2024-09-10T08:44:29.456832+0000","last_fullsized":"2024-09-10T08:44:29.456832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3638,"log_dups_size":0,"ondisk_log_size":3638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:14.405210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18717,"num_write_kb":251073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"27'4254","reported_seq":4285,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.514815+0000","last_change":"2024-09-10T08:28:35.578961+0000","last_active":"2024-09-10T08:44:22.514815+0000","last_peered":"2024-09-10T08:44:22.514815+0000","last_clean":"2024-09-10T08:44:22.514815+0000","last_became_active":"2024-09-10T08:28:35.578680+0000","last_became_peered":"2024-09-10T08:28:35.578680+0000","last_unstale":"2024-09-10T08:44:22.514815+0000","last_undegraded":"2024-09-10T08:44:22.514815+0000","last_fullsized":"2024-09-10T08:44:22.514815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4254,"log_dups_size":0,"ondisk_log_size":4254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:53.737412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22529,"num_write_kb":274609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"27'5728","reported_seq":5750,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.335399+0000","last_change":"2024-09-10T08:28:47.624859+0000","last_active":"2024-09-10T08:44:29.335399+0000","last_peered":"2024-09-10T08:44:29.335399+0000","last_clean":"2024-09-10T08:44:29.335399+0000","last_became_active":"2024-09-10T08:28:47.624585+0000","last_became_peered":"2024-09-10T08:28:47.624585+0000","last_unstale":"2024-09-10T08:44:29.335399+0000","last_undegraded":"2024-09-10T08:44:29.335399+0000","last_fullsized":"2024-09-10T08:44:29.335399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5728,"log_dups_size":0,"ondisk_log_size":5728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:00.956870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28703,"num_write_kb":356727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'4780","reported_seq":4811,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.475999+0000","last_change":"2024-09-10T08:28:35.573918+0000","last_active":"2024-09-10T08:44:22.475999+0000","last_peered":"2024-09-10T08:44:22.475999+0000","last_clean":"2024-09-10T08:44:22.475999+0000","last_became_active":"2024-09-10T08:28:35.573646+0000","last_became_peered":"2024-09-10T08:28:35.573646+0000","last_unstale":"2024-09-10T08:44:22.475999+0000","last_undegraded":"2024-09-10T08:44:22.475999+0000","last_fullsized":"2024-09-10T08:44:22.475999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4780,"log_dups_size":0,"ondisk_log_size":4780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:24.295630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24418,"num_write_kb":306743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"27'4700","reported_seq":4722,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.478952+0000","last_change":"2024-09-10T08:28:47.631802+0000","last_active":"2024-09-10T08:44:29.478952+0000","last_peered":"2024-09-10T08:44:29.478952+0000","last_clean":"2024-09-10T08:44:29.478952+0000","last_became_active":"2024-09-10T08:28:47.631456+0000","last_became_peered":"2024-09-10T08:28:47.631456+0000","last_unstale":"2024-09-10T08:44:29.478952+0000","last_undegraded":"2024-09-10T08:44:29.478952+0000","last_fullsized":"2024-09-10T08:44:29.478952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4700,"log_dups_size":0,"ondisk_log_size":4700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:56.571659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23620,"num_write_kb":315928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'5816","reported_seq":5847,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.453619+0000","last_change":"2024-09-10T08:28:35.578197+0000","last_active":"2024-09-10T08:44:22.453619+0000","last_peered":"2024-09-10T08:44:22.453619+0000","last_clean":"2024-09-10T08:44:22.453619+0000","last_became_active":"2024-09-10T08:28:35.577852+0000","last_became_peered":"2024-09-10T08:28:35.577852+0000","last_unstale":"2024-09-10T08:44:22.453619+0000","last_undegraded":"2024-09-10T08:44:22.453619+0000","last_fullsized":"2024-09-10T08:44:22.453619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5816,"log_dups_size":0,"ondisk_log_size":5816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:44.348299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30528,"num_write_kb":380548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"27'4272","reported_seq":4294,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.370484+0000","last_change":"2024-09-10T08:28:47.629993+0000","last_active":"2024-09-10T08:44:29.370484+0000","last_peered":"2024-09-10T08:44:29.370484+0000","last_clean":"2024-09-10T08:44:29.370484+0000","last_became_active":"2024-09-10T08:28:47.629713+0000","last_became_peered":"2024-09-10T08:28:47.629713+0000","last_unstale":"2024-09-10T08:44:29.370484+0000","last_undegraded":"2024-09-10T08:44:29.370484+0000","last_fullsized":"2024-09-10T08:44:29.370484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4272,"log_dups_size":0,"ondisk_log_size":4272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:56.640722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22513,"num_write_kb":287067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"27'4101","reported_seq":4132,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.558949+0000","last_change":"2024-09-10T08:28:35.571065+0000","last_active":"2024-09-10T08:44:22.558949+0000","last_peered":"2024-09-10T08:44:22.558949+0000","last_clean":"2024-09-10T08:44:22.558949+0000","last_became_active":"2024-09-10T08:28:35.570749+0000","last_became_peered":"2024-09-10T08:28:35.570749+0000","last_unstale":"2024-09-10T08:44:22.558949+0000","last_undegraded":"2024-09-10T08:44:22.558949+0000","last_fullsized":"2024-09-10T08:44:22.558949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4101,"log_dups_size":0,"ondisk_log_size":4101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:04.628661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21304,"num_write_kb":261525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1506886,"num_write_kb":19151846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":286269,"ondisk_log_size":286269,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":17622670,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":51,"num_read_kb":121,"num_write":4293,"num_write_kb":18856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":35307520,"data_stored":35245340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3534,"ondisk_log_size":3534,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1565097,"num_write_kb":19381290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":301805,"ondisk_log_size":301805,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":17928438,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":58,"num_read_kb":129,"num_write":4368,"num_write_kb":19205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":35921920,"data_stored":35856876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3624,"ondisk_log_size":3624,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509637,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1140720,"kb_used_data":13152,"kb_used_omap":1,"kb_used_meta":1127550,"kb_avail":93231120,"statfs":{"total":96636764160,"available":95468666880,"internally_reserved":0,"allocated":13467648,"data_stored":13288824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1154611659},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509636,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1037512,"kb_used_data":4472,"kb_used_omap":1,"kb_used_meta":1033022,"kb_avail":93334328,"statfs":{"total":96636764160,"available":95574351872,"internally_reserved":0,"allocated":4579328,"data_stored":4398018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1057814981},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509638,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1082628,"kb_used_data":10356,"kb_used_omap":1,"kb_used_meta":1072254,"kb_avail":93289212,"statfs":{"total":96636764160,"available":95528153088,"internally_reserved":0,"allocated":10604544,"data_stored":10409366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1097988549},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509639,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1151860,"kb_used_data":17508,"kb_used_omap":1,"kb_used_meta":1134334,"kb_avail":93219980,"statfs":{"total":96636764160,"available":95457259520,"internally_reserved":0,"allocated":17928192,"data_stored":17737438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1161558471},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509638,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":892856,"kb_used_data":8488,"kb_used_omap":1,"kb_used_meta":884350,"kb_avail":93478984,"statfs":{"total":96636764160,"available":95722479616,"internally_reserved":0,"allocated":8691712,"data_stored":8504334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":905574853},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509637,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":911348,"kb_used_data":9060,"kb_used_omap":1,"kb_used_meta":902270,"kb_avail":93460492,"statfs":{"total":96636764160,"available":95703543808,"internally_reserved":0,"allocated":9277440,"data_stored":9094486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":923924933},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575044,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":775044,"kb_used_data":9524,"kb_used_omap":1,"kb_used_meta":765502,"kb_avail":93596796,"statfs":{"total":96636764160,"available":95843119104,"internally_reserved":0,"allocated":9752576,"data_stored":9566440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":783874503},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575047,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":725760,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":725374,"kb_avail":93646080,"statfs":{"total":96636764160,"available":95893585920,"internally_reserved":0,"allocated":376832,"data_stored":203022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":742783430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":88080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8477360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5271552,"data_stored":5256102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5267456,"data_stored":5256648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9158656,"data_stored":9145206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5050368,"data_stored":5038392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4292608,"data_stored":4283056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:44:36.797 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:44:36.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.929+0000 7f3aa33f6640 1 Processor -- start 2024-09-10T08:44:36.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.929+0000 7f3aa33f6640 1 -- start start 2024-09-10T08:44:36.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.930+0000 7f3aa33f6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3a9c074590 0x7f3a9c06cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:36.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.930+0000 7f3aa33f6640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a9c156dd0 con 0x7f3a9c153b10 2024-09-10T08:44:36.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.930+0000 7f3aa33f6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a9c157070 con 0x7f3a9c0a7de0 2024-09-10T08:44:36.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.930+0000 7f3aa33f6640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f3a9c157350 con 0x7f3a9c074590 2024-09-10T08:44:36.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.930+0000 7f3aa1993640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3a9c074590 0x7f3a9c06cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:36.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.930+0000 7f3aa1993640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3a9c074590 0x7f3a9c06cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60586/0 (socket says 172.21.15.103:60586) 2024-09-10T08:44:36.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.930+0000 7f3aa1993640 1 -- 172.21.15.103:0/2694119607 learned_addr learned my addr 172.21.15.103:0/2694119607 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:36.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.930+0000 7f3aa1192640 1 --1- 172.21.15.103:0/2694119607 >> v1:172.21.15.103:6789/0 conn(0x7f3a9c153b10 0x7f3a9c0a9700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40866/0 (socket says 172.21.15.103:40866) 2024-09-10T08:44:36.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.930+0000 7f3aa1993640 1 -- 172.21.15.103:0/2694119607 >> v1:172.21.15.154:6789/0 conn(0x7f3a9c0a7de0 legacy=0x7f3a9c15a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:36.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.930+0000 7f3aa1993640 1 -- 172.21.15.103:0/2694119607 >> v1:172.21.15.103:6789/0 conn(0x7f3a9c153b10 legacy=0x7f3a9c0a9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:36.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.930+0000 7f3aa1993640 1 -- 172.21.15.103:0/2694119607 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9c159ae0 con 0x7f3a9c074590 2024-09-10T08:44:36.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.931+0000 7f3aa1993640 1 --2- 172.21.15.103:0/2694119607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a9c074590 0x7f3a9c06cf40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3a94009e50 tx=0x7f3a9402a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466cc1498259ca95 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:36.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.931+0000 7f3a8ffff640 1 -- 172.21.15.103:0/2694119607 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a94036070 con 0x7f3a9c074590 2024-09-10T08:44:36.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.931+0000 7f3a8ffff640 1 -- 172.21.15.103:0/2694119607 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a94031600 con 0x7f3a9c074590 2024-09-10T08:44:36.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.931+0000 7f3a8ffff640 1 -- 172.21.15.103:0/2694119607 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a940319d0 con 0x7f3a9c074590 2024-09-10T08:44:36.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.932+0000 7f3aa33f6640 1 -- 172.21.15.103:0/2694119607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a9c074590 msgr2=0x7f3a9c06cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:36.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.932+0000 7f3aa33f6640 1 --2- 172.21.15.103:0/2694119607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a9c074590 0x7f3a9c06cf40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3a94009e50 tx=0x7f3a9402a640 comp rx=0 tx=0).stop 2024-09-10T08:44:36.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.932+0000 7f3aa33f6640 1 -- 172.21.15.103:0/2694119607 shutdown_connections 2024-09-10T08:44:36.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.932+0000 7f3aa33f6640 1 --2- 172.21.15.103:0/2694119607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a9c074590 0x7f3a9c06cf40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.932+0000 7f3aa33f6640 1 -- 172.21.15.103:0/2694119607 >> 172.21.15.103:0/2694119607 conn(0x7f3a9c0c4fa0 msgr2=0x7f3a9c0c5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:36.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.932+0000 7f3aa33f6640 1 -- 172.21.15.103:0/2694119607 shutdown_connections 2024-09-10T08:44:36.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.932+0000 7f3aa33f6640 1 -- 172.21.15.103:0/2694119607 wait complete. 2024-09-10T08:44:36.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.933+0000 7f3aa33f6640 1 Processor -- start 2024-09-10T08:44:36.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.933+0000 7f3aa33f6640 1 -- start start 2024-09-10T08:44:36.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.933+0000 7f3aa33f6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a9c074590 0x7f3a9c1ecde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:36.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.933+0000 7f3aa33f6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a9c0a7de0 0x7f3a9c0c4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:36.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.933+0000 7f3aa33f6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a9c153b10 0x7f3a9c149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:36.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.933+0000 7f3aa33f6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c06db80 con 0x7f3a9c153b10 2024-09-10T08:44:36.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.933+0000 7f3aa33f6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c159e50 con 0x7f3a9c074590 2024-09-10T08:44:36.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.933+0000 7f3aa33f6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f3a9c06dd00 con 0x7f3a9c0a7de0 2024-09-10T08:44:36.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.934+0000 7f3aa1993640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a9c153b10 0x7f3a9c149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:36.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.934+0000 7f3aa1993640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a9c153b10 0x7f3a9c149660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60600/0 (socket says 172.21.15.103:60600) 2024-09-10T08:44:36.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.934+0000 7f3aa1993640 1 -- 172.21.15.103:0/2363771302 learned_addr learned my addr 172.21.15.103:0/2363771302 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:36.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.934+0000 7f3aa0991640 1 --2- 172.21.15.103:0/2363771302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a9c0a7de0 0x7f3a9c0c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:36.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.934+0000 7f3aa1192640 1 --2- 172.21.15.103:0/2363771302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a9c074590 0x7f3a9c1ecde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:36.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.934+0000 7f3aa1993640 1 -- 172.21.15.103:0/2363771302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a9c0a7de0 msgr2=0x7f3a9c0c4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:36.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.934+0000 7f3aa1993640 1 --2- 172.21.15.103:0/2363771302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a9c0a7de0 0x7f3a9c0c4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.934+0000 7f3aa1993640 1 -- 172.21.15.103:0/2363771302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a9c074590 msgr2=0x7f3a9c1ecde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:36.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.934+0000 7f3aa1993640 1 --2- 172.21.15.103:0/2363771302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a9c074590 0x7f3a9c1ecde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:36.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.934+0000 7f3aa1993640 1 -- 172.21.15.103:0/2363771302 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9c0c7b20 con 0x7f3a9c153b10 2024-09-10T08:44:36.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.934+0000 7f3aa1192640 1 --2- 172.21.15.103:0/2363771302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a9c074590 0x7f3a9c1ecde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:44:36.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.934+0000 7f3aa1993640 1 --2- 172.21.15.103:0/2363771302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a9c153b10 0x7f3a9c149660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3a94009f70 tx=0x7f3a94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:36.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.934+0000 7f3a8dffb640 1 -- 172.21.15.103:0/2363771302 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a94041020 con 0x7f3a9c153b10 2024-09-10T08:44:36.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.934+0000 7f3a8dffb640 1 -- 172.21.15.103:0/2363771302 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a94007780 con 0x7f3a9c153b10 2024-09-10T08:44:36.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.934+0000 7f3aa33f6640 1 -- 172.21.15.103:0/2363771302 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a9c0c7e00 con 0x7f3a9c153b10 2024-09-10T08:44:36.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.934+0000 7f3a8dffb640 1 -- 172.21.15.103:0/2363771302 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a94036040 con 0x7f3a9c153b10 2024-09-10T08:44:36.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.934+0000 7f3aa33f6640 1 -- 172.21.15.103:0/2363771302 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a9c158f30 con 0x7f3a9c153b10 2024-09-10T08:44:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.935+0000 7f3aa33f6640 1 -- 172.21.15.103:0/2363771302 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a9c1514c0 con 0x7f3a9c153b10 2024-09-10T08:44:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.936+0000 7f3a8dffb640 1 -- 172.21.15.103:0/2363771302 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3a94044020 con 0x7f3a9c153b10 2024-09-10T08:44:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.936+0000 7f3a8dffb640 1 --2- 172.21.15.103:0/2363771302 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3a8006be60 0x7f3a8006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.936+0000 7f3a8dffb640 1 -- 172.21.15.103:0/2363771302 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f3a940abd00 con 0x7f3a9c153b10 2024-09-10T08:44:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.936+0000 7f3aa1192640 1 --2- 172.21.15.103:0/2363771302 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3a8006be60 0x7f3a8006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:36.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.937+0000 7f3aa1192640 1 --2- 172.21.15.103:0/2363771302 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3a8006be60 0x7f3a8006e320 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3a90000f60 tx=0x7f3a90009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:36.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:36.941+0000 7f3a8dffb640 1 -- 172.21.15.103:0/2363771302 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3a9c1514c0 con 0x7f3a9c153b10 2024-09-10T08:44:37.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:37.110+0000 7f3aa33f6640 1 -- 172.21.15.103:0/2363771302 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3a9c158d20 con 0x7f3a9c153b10 2024-09-10T08:44:37.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:37.111+0000 7f3a8dffb640 1 -- 172.21.15.103:0/2363771302 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+20749 (secure 0 0 0) 0x7f3a9404b070 con 0x7f3a9c153b10 2024-09-10T08:44:37.112 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:44:37.112 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":27,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","created":"2024-09-10T08:28:12.654957+0000","modified":"2024-09-10T08:29:35.089527+0000","last_up_change":"2024-09-10T08:28:25.445753+0000","last_in_change":"2024-09-10T08:28:14.741133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:24.821696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-10T08:28:33.488154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-10T08:28:33.857868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-10T08:28:44.793084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-10T08:28:45.930823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1abe08f4-0348-435e-9f97-cec00e96992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6809","nonce":2707863099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6811","nonce":2707863099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6815","nonce":2707863099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6813","nonce":2707863099}]},"public_addr":"172.21.15.103:6809/2707863099","cluster_addr":"172.21.15.103:6811/2707863099","heartbeat_back_addr":"172.21.15.103:6815/2707863099","heartbeat_front_addr":"172.21.15.103:6813/2707863099","state":["exists","up"]},{"osd":1,"uuid":"df342e58-1026-4739-82f6-7a216707444c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6818","nonce":4029892782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6822","nonce":4029892782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6830","nonce":4029892782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6826","nonce":4029892782}]},"public_addr":"172.21.15.103:6818/4029892782","cluster_addr":"172.21.15.103:6822/4029892782","heartbeat_back_addr":"172.21.15.103:6830/4029892782","heartbeat_front_addr":"172.21.15.103:6826/4029892782","state":["exists","up"]},{"osd":2,"uuid":"f7aea2cf-208c-41ed-a0f6-8948d70b9a0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6819","nonce":428484432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6821","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6823","nonce":428484432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6829","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6831","nonce":428484432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6825","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6827","nonce":428484432}]},"public_addr":"172.21.15.103:6819/428484432","cluster_addr":"172.21.15.103:6823/428484432","heartbeat_back_addr":"172.21.15.103:6831/428484432","heartbeat_front_addr":"172.21.15.103:6827/428484432","state":["exists","up"]},{"osd":3,"uuid":"615ef8b0-12a5-4503-96d0-f7ec17dbc792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6801","nonce":3453676282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6803","nonce":3453676282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6807","nonce":3453676282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6805","nonce":3453676282}]},"public_addr":"172.21.15.103:6801/3453676282","cluster_addr":"172.21.15.103:6803/3453676282","heartbeat_back_addr":"172.21.15.103:6807/3453676282","heartbeat_front_addr":"172.21.15.103:6805/3453676282","state":["exists","up"]},{"osd":4,"uuid":"644c5e94-db18-4b83-b5cd-3762ae2647a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6809","nonce":1808157069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6811","nonce":1808157069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6815","nonce":1808157069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6813","nonce":1808157069}]},"public_addr":"172.21.15.154:6809/1808157069","cluster_addr":"172.21.15.154:6811/1808157069","heartbeat_back_addr":"172.21.15.154:6815/1808157069","heartbeat_front_addr":"172.21.15.154:6813/1808157069","state":["exists","up"]},{"osd":5,"uuid":"f40210bd-f4ca-442e-baac-729ced5a9f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6817","nonce":1048015779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6819","nonce":1048015779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6823","nonce":1048015779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6821","nonce":1048015779}]},"public_addr":"172.21.15.154:6817/1048015779","cluster_addr":"172.21.15.154:6819/1048015779","heartbeat_back_addr":"172.21.15.154:6823/1048015779","heartbeat_front_addr":"172.21.15.154:6821/1048015779","state":["exists","up"]},{"osd":6,"uuid":"eebac31e-aaef-47b0-90d7-4af08f36d7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6801","nonce":345273812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6803","nonce":345273812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6807","nonce":345273812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6805","nonce":345273812}]},"public_addr":"172.21.15.154:6801/345273812","cluster_addr":"172.21.15.154:6803/345273812","heartbeat_back_addr":"172.21.15.154:6807/345273812","heartbeat_front_addr":"172.21.15.154:6805/345273812","state":["exists","up"]},{"osd":7,"uuid":"58406c9a-036f-4618-bfb6-0beddbd71605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6825","nonce":3439481239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6827","nonce":3439481239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6831","nonce":3439481239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6829","nonce":3439481239}]},"public_addr":"172.21.15.154:6825/3439481239","cluster_addr":"172.21.15.154:6827/3439481239","heartbeat_back_addr":"172.21.15.154:6831/3439481239","heartbeat_front_addr":"172.21.15.154:6829/3439481239","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.032718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.126448+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.781158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.808718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.050591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.038245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.586989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.223326+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:44:37.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:37.114+0000 7f3aa33f6640 1 -- 172.21.15.103:0/2363771302 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3a8006be60 msgr2=0x7f3a8006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:37.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:37.114+0000 7f3aa33f6640 1 --2- 172.21.15.103:0/2363771302 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3a8006be60 0x7f3a8006e320 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3a90000f60 tx=0x7f3a90009040 comp rx=0 tx=0).stop 2024-09-10T08:44:37.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:37.114+0000 7f3aa33f6640 1 -- 172.21.15.103:0/2363771302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a9c153b10 msgr2=0x7f3a9c149660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:37.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:37.114+0000 7f3aa33f6640 1 --2- 172.21.15.103:0/2363771302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a9c153b10 0x7f3a9c149660 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3a94009f70 tx=0x7f3a94004a40 comp rx=0 tx=0).stop 2024-09-10T08:44:37.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:37.114+0000 7f3aa33f6640 1 -- 172.21.15.103:0/2363771302 shutdown_connections 2024-09-10T08:44:37.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:37.114+0000 7f3aa33f6640 1 --2- 172.21.15.103:0/2363771302 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f3a8006be60 0x7f3a8006e320 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:37.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:37.114+0000 7f3aa33f6640 1 --2- 172.21.15.103:0/2363771302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a9c153b10 0x7f3a9c149660 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:37.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:37.114+0000 7f3aa33f6640 1 --2- 172.21.15.103:0/2363771302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a9c0a7de0 0x7f3a9c0c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:37.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:37.114+0000 7f3aa33f6640 1 --2- 172.21.15.103:0/2363771302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a9c074590 0x7f3a9c1ecde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:37.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:37.114+0000 7f3aa33f6640 1 -- 172.21.15.103:0/2363771302 >> 172.21.15.103:0/2363771302 conn(0x7f3a9c0c4fa0 msgr2=0x7f3a9c0c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:37.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:37.114+0000 7f3aa33f6640 1 -- 172.21.15.103:0/2363771302 shutdown_connections 2024-09-10T08:44:37.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:37.114+0000 7f3aa33f6640 1 -- 172.21.15.103:0/2363771302 wait complete. 2024-09-10T08:44:38.126 INFO:tasks.ceph:Scrubbing osd.0 2024-09-10T08:44:38.127 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:44:38.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.243+0000 7f4c0eeaf640 1 Processor -- start 2024-09-10T08:44:38.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.243+0000 7f4c0eeaf640 1 -- start start 2024-09-10T08:44:38.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.244+0000 7f4c0eeaf640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4c080afca0 0x7f4c08073e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.244+0000 7f4c0eeaf640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c080708c0 0x7f4c0806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.244+0000 7f4c0eeaf640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c081571f0 con 0x7f4c0814cca0 2024-09-10T08:44:38.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.244+0000 7f4c0eeaf640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4c08156cc0 con 0x7f4c080afca0 2024-09-10T08:44:38.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.244+0000 7f4c0eeaf640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4c08070d70 con 0x7f4c080708c0 2024-09-10T08:44:38.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.244+0000 7f4c0cc4b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4c0814cca0 0x7f4c080701b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40882/0 (socket says 172.21.15.103:40882) 2024-09-10T08:44:38.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.244+0000 7f4c0cc4b640 1 -- 172.21.15.103:0/3147592012 learned_addr learned my addr 172.21.15.103:0/3147592012 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:44:38.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.244+0000 7f4bfffff640 1 --2- 172.21.15.103:0/3147592012 >> v2:172.21.15.154:3300/0 conn(0x7f4c080afca0 0x7f4c08073e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.244+0000 7f4bff7fe640 1 -- 172.21.15.103:0/3147592012 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1058604050 0 0) 0x7f4c081571f0 con 0x7f4c0814cca0 2024-09-10T08:44:38.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.244+0000 7f4c0d44c640 1 --2- 172.21.15.103:0/3147592012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c080708c0 0x7f4c0806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.244+0000 7f4bff7fe640 1 -- 172.21.15.103:0/3147592012 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bf0003520 con 0x7f4c0814cca0 2024-09-10T08:44:38.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.244+0000 7f4bff7fe640 1 -- 172.21.15.103:0/3147592012 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 832089346 0 0) 0x7f4bf0003520 con 0x7f4c0814cca0 2024-09-10T08:44:38.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.244+0000 7f4bff7fe640 1 -- 172.21.15.103:0/3147592012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c080708c0 msgr2=0x7f4c0806d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:38.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.244+0000 7f4bff7fe640 1 --2- 172.21.15.103:0/3147592012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c080708c0 0x7f4c0806d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.244+0000 7f4bff7fe640 1 -- 172.21.15.103:0/3147592012 >> v2:172.21.15.154:3300/0 conn(0x7f4c080afca0 msgr2=0x7f4c08073e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:38.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.244+0000 7f4bff7fe640 1 --2- 172.21.15.103:0/3147592012 >> v2:172.21.15.154:3300/0 conn(0x7f4c080afca0 0x7f4c08073e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.244+0000 7f4bff7fe640 1 -- 172.21.15.103:0/3147592012 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0806cf00 con 0x7f4c0814cca0 2024-09-10T08:44:38.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.244+0000 7f4bff7fe640 1 -- 172.21.15.103:0/3147592012 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f4c04001670 con 0x7f4c0814cca0 2024-09-10T08:44:38.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.244+0000 7f4bff7fe640 1 -- 172.21.15.103:0/3147592012 >> v1:172.21.15.103:6789/0 conn(0x7f4c0814cca0 legacy=0x7f4c080701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:38.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.245+0000 7f4bff7fe640 1 --2- 172.21.15.103:0/3147592012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4bf00039b0 0x7f4bf0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.245+0000 7f4bff7fe640 1 --2- 172.21.15.103:0/3147592012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bf0004800 0x7f4bf0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.245+0000 7f4bff7fe640 1 --2- 172.21.15.103:0/3147592012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c080708c0 0x7f4bf00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.245+0000 7f4bff7fe640 1 -- 172.21.15.103:0/3147592012 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4c08156cc0 con 0x7f4bf00039b0 2024-09-10T08:44:38.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.245+0000 7f4bff7fe640 1 -- 172.21.15.103:0/3147592012 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4c08070d70 con 0x7f4bf0004800 2024-09-10T08:44:38.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.245+0000 7f4bff7fe640 1 -- 172.21.15.103:0/3147592012 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4bf000b9c0 con 0x7f4c080708c0 2024-09-10T08:44:38.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.245+0000 7f4c0cc4b640 1 --2- 172.21.15.103:0/3147592012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4bf00039b0 0x7f4bf0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.245+0000 7f4bfffff640 1 --2- 172.21.15.103:0/3147592012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bf0004800 0x7f4bf0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.245+0000 7f4c0d44c640 1 --2- 172.21.15.103:0/3147592012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c080708c0 0x7f4bf00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.245+0000 7f4c0cc4b640 1 -- 172.21.15.103:0/3147592012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c080708c0 msgr2=0x7f4bf00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:38.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.245+0000 7f4c0cc4b640 1 --2- 172.21.15.103:0/3147592012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c080708c0 0x7f4bf00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.245+0000 7f4c0cc4b640 1 -- 172.21.15.103:0/3147592012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bf0004800 msgr2=0x7f4bf0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:38.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.245+0000 7f4c0cc4b640 1 --2- 172.21.15.103:0/3147592012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bf0004800 0x7f4bf0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.245+0000 7f4c0cc4b640 1 -- 172.21.15.103:0/3147592012 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf0003520 con 0x7f4bf00039b0 2024-09-10T08:44:38.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.246+0000 7f4c0cc4b640 1 --2- 172.21.15.103:0/3147592012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4bf00039b0 0x7f4bf0003dd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4c0400c240 tx=0x7f4bf0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01568365a87cba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:38.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.246+0000 7f4bff7fe640 1 -- 172.21.15.103:0/3147592012 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c04007d50 con 0x7f4bf00039b0 2024-09-10T08:44:38.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.246+0000 7f4bff7fe640 1 -- 172.21.15.103:0/3147592012 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c0402e070 con 0x7f4bf00039b0 2024-09-10T08:44:38.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.246+0000 7f4bff7fe640 1 -- 172.21.15.103:0/3147592012 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c04005cd0 con 0x7f4bf00039b0 2024-09-10T08:44:38.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.246+0000 7f4c0eeaf640 1 -- 172.21.15.103:0/3147592012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4bf00039b0 msgr2=0x7f4bf0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:38.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.246+0000 7f4c0eeaf640 1 --2- 172.21.15.103:0/3147592012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4bf00039b0 0x7f4bf0003dd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4c0400c240 tx=0x7f4bf0005830 comp rx=0 tx=0).stop 2024-09-10T08:44:38.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.246+0000 7f4c0d44c640 1 -- 172.21.15.103:0/3147592012 reap_dead start 2024-09-10T08:44:38.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.246+0000 7f4c0eeaf640 1 -- 172.21.15.103:0/3147592012 shutdown_connections 2024-09-10T08:44:38.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.246+0000 7f4c0eeaf640 1 -- 172.21.15.103:0/3147592012 >> 172.21.15.103:0/3147592012 conn(0x7f4c080c6910 msgr2=0x7f4c080c6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:38.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.246+0000 7f4c0eeaf640 1 -- 172.21.15.103:0/3147592012 shutdown_connections 2024-09-10T08:44:38.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.246+0000 7f4c0eeaf640 1 -- 172.21.15.103:0/3147592012 wait complete. 2024-09-10T08:44:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.247+0000 7f4c0eeaf640 1 Processor -- start 2024-09-10T08:44:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.248+0000 7f4c0eeaf640 1 -- start start 2024-09-10T08:44:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.248+0000 7f4c0eeaf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bf00039b0 0x7f4c08145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.248+0000 7f4c0eeaf640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c08143910 0x7f4c08143d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.248+0000 7f4c0eeaf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c081e0960 0x7f4c081e0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.248+0000 7f4c0eeaf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0814d080 con 0x7f4c081e0960 2024-09-10T08:44:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.248+0000 7f4c0eeaf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4c08156f10 con 0x7f4bf00039b0 2024-09-10T08:44:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.248+0000 7f4c0eeaf640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4c0806d3e0 con 0x7f4c08143910 2024-09-10T08:44:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.249+0000 7f4c0d44c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c081e0960 0x7f4c081e0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.249+0000 7f4c0cc4b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bf00039b0 0x7f4c08145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.249+0000 7f4c0d44c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c081e0960 0x7f4c081e0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60616/0 (socket says 172.21.15.103:60616) 2024-09-10T08:44:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.249+0000 7f4c0d44c640 1 -- 172.21.15.103:0/2311842678 learned_addr learned my addr 172.21.15.103:0/2311842678 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.249+0000 7f4bfffff640 1 --2- 172.21.15.103:0/2311842678 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c08143910 0x7f4c08143d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.249+0000 7f4c0d44c640 1 -- 172.21.15.103:0/2311842678 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c08143910 msgr2=0x7f4c08143d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.249+0000 7f4c0d44c640 1 --2- 172.21.15.103:0/2311842678 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c08143910 0x7f4c08143d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.249+0000 7f4c0d44c640 1 -- 172.21.15.103:0/2311842678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bf00039b0 msgr2=0x7f4c08145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:38.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.249+0000 7f4c0d44c640 1 --2- 172.21.15.103:0/2311842678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bf00039b0 0x7f4c08145a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.249+0000 7f4c0d44c640 1 -- 172.21.15.103:0/2311842678 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c081e1350 con 0x7f4c081e0960 2024-09-10T08:44:38.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.249+0000 7f4c0d44c640 1 --2- 172.21.15.103:0/2311842678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c081e0960 0x7f4c081e0e10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4c00011bf0 tx=0x7f4c0000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:38.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.249+0000 7f4bfd7fa640 1 -- 172.21.15.103:0/2311842678 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0000fe10 con 0x7f4c081e0960 2024-09-10T08:44:38.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.249+0000 7f4bfd7fa640 1 -- 172.21.15.103:0/2311842678 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c00015430 con 0x7f4c081e0960 2024-09-10T08:44:38.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.249+0000 7f4bfd7fa640 1 -- 172.21.15.103:0/2311842678 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c00015820 con 0x7f4c081e0960 2024-09-10T08:44:38.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.249+0000 7f4c0eeaf640 1 -- 172.21.15.103:0/2311842678 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c081581e0 con 0x7f4c081e0960 2024-09-10T08:44:38.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.249+0000 7f4c0eeaf640 1 -- 172.21.15.103:0/2311842678 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c08145f80 con 0x7f4c081e0960 2024-09-10T08:44:38.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.250+0000 7f4c0eeaf640 1 -- 172.21.15.103:0/2311842678 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4c08158700 con 0x7f4c081e0960 2024-09-10T08:44:38.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.251+0000 7f4bfd7fa640 1 -- 172.21.15.103:0/2311842678 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c000159c0 con 0x7f4c081e0960 2024-09-10T08:44:38.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.251+0000 7f4bfd7fa640 1 --2- 172.21.15.103:0/2311842678 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4bf406be60 0x7f4bf406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.251+0000 7f4bfd7fa640 1 -- 172.21.15.103:0/2311842678 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f4c0008be40 con 0x7f4c081e0960 2024-09-10T08:44:38.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.251+0000 7f4c0cc4b640 1 --2- 172.21.15.103:0/2311842678 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4bf406be60 0x7f4bf406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.251+0000 7f4bfd7fa640 1 --2- 172.21.15.103:0/2311842678 >> [v2:172.21.15.103:6808/2707863099,v1:172.21.15.103:6809/2707863099] conn(0x7f4bf4076800 0x7f4bf4078c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.251+0000 7f4bfd7fa640 1 -- 172.21.15.103:0/2311842678 --> [v2:172.21.15.103:6808/2707863099,v1:172.21.15.103:6809/2707863099] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4c000047f0 con 0x7f4bf4076800 2024-09-10T08:44:38.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.251+0000 7f4bfd7fa640 1 -- 172.21.15.103:0/2311842678 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4c0008e540 con 0x7f4c081e0960 2024-09-10T08:44:38.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.252+0000 7f4bfffff640 1 --2- 172.21.15.103:0/2311842678 >> [v2:172.21.15.103:6808/2707863099,v1:172.21.15.103:6809/2707863099] conn(0x7f4bf4076800 0x7f4bf4078c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.252+0000 7f4c0cc4b640 1 --2- 172.21.15.103:0/2311842678 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4bf406be60 0x7f4bf406e320 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4c04033000 tx=0x7f4c04009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:38.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.252+0000 7f4bfffff640 1 --2- 172.21.15.103:0/2311842678 >> [v2:172.21.15.103:6808/2707863099,v1:172.21.15.103:6809/2707863099] conn(0x7f4bf4076800 0x7f4bf4078c80 crc :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:38.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.252+0000 7f4bfd7fa640 1 -- 172.21.15.103:0/2311842678 <== osd.0 v2:172.21.15.103:6808/2707863099 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4c000047f0 con 0x7f4bf4076800 2024-09-10T08:44:38.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.265+0000 7f4c0eeaf640 1 -- 172.21.15.103:0/2311842678 --> [v2:172.21.15.103:6808/2707863099,v1:172.21.15.103:6809/2707863099] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4c08073e70 con 0x7f4bf4076800 2024-09-10T08:44:38.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.265+0000 7f4bfd7fa640 1 -- 172.21.15.103:0/2311842678 <== osd.0 v2:172.21.15.103:6808/2707863099 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4c08073e70 con 0x7f4bf4076800 2024-09-10T08:44:38.266 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:44:38.266 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:44:38.266 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:44:38.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.265+0000 7f4c0eeaf640 1 -- 172.21.15.103:0/2311842678 >> [v2:172.21.15.103:6808/2707863099,v1:172.21.15.103:6809/2707863099] conn(0x7f4bf4076800 msgr2=0x7f4bf4078c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:38.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.265+0000 7f4c0eeaf640 1 --2- 172.21.15.103:0/2311842678 >> [v2:172.21.15.103:6808/2707863099,v1:172.21.15.103:6809/2707863099] conn(0x7f4bf4076800 0x7f4bf4078c80 crc :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.266+0000 7f4c0eeaf640 1 -- 172.21.15.103:0/2311842678 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4bf406be60 msgr2=0x7f4bf406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:38.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.266+0000 7f4c0eeaf640 1 --2- 172.21.15.103:0/2311842678 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4bf406be60 0x7f4bf406e320 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4c04033000 tx=0x7f4c04009030 comp rx=0 tx=0).stop 2024-09-10T08:44:38.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.266+0000 7f4c0eeaf640 1 -- 172.21.15.103:0/2311842678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c081e0960 msgr2=0x7f4c081e0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:38.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.266+0000 7f4c0eeaf640 1 --2- 172.21.15.103:0/2311842678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c081e0960 0x7f4c081e0e10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4c00011bf0 tx=0x7f4c0000f580 comp rx=0 tx=0).stop 2024-09-10T08:44:38.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.266+0000 7f4c0d44c640 1 -- 172.21.15.103:0/2311842678 reap_dead start 2024-09-10T08:44:38.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.266+0000 7f4c0eeaf640 1 -- 172.21.15.103:0/2311842678 shutdown_connections 2024-09-10T08:44:38.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.266+0000 7f4c0eeaf640 1 -- 172.21.15.103:0/2311842678 >> 172.21.15.103:0/2311842678 conn(0x7f4c080c6910 msgr2=0x7f4c080c4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:38.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.266+0000 7f4c0eeaf640 1 -- 172.21.15.103:0/2311842678 shutdown_connections 2024-09-10T08:44:38.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.266+0000 7f4c0eeaf640 1 -- 172.21.15.103:0/2311842678 wait complete. 2024-09-10T08:44:38.276 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-10T08:44:38.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.376+0000 7f6c826e4640 1 Processor -- start 2024-09-10T08:44:38.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.376+0000 7f6c826e4640 1 -- start start 2024-09-10T08:44:38.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.377+0000 7f6c826e4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c7c0afdd0 0x7f6c7c0c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.377+0000 7f6c826e4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6c7c0af870 0x7f6c7c0c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.377+0000 7f6c826e4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c7c0c54e0 con 0x7f6c7c153af0 2024-09-10T08:44:38.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.377+0000 7f6c826e4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f6c7c0c74a0 con 0x7f6c7c0af870 2024-09-10T08:44:38.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.377+0000 7f6c826e4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6c7c0c7740 con 0x7f6c7c0afdd0 2024-09-10T08:44:38.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.377+0000 7f6c7bfff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6c7c153af0 0x7f6c7c1563a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40898/0 (socket says 172.21.15.103:40898) 2024-09-10T08:44:38.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.377+0000 7f6c7bfff640 1 -- 172.21.15.103:0/558998846 learned_addr learned my addr 172.21.15.103:0/558998846 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:44:38.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.377+0000 7f6c80c81640 1 --2- 172.21.15.103:0/558998846 >> v2:172.21.15.154:3300/0 conn(0x7f6c7c0af870 0x7f6c7c0c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.377+0000 7f6c7b7fe640 1 --2- 172.21.15.103:0/558998846 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c7c0afdd0 0x7f6c7c0c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.377+0000 7f6c7affd640 1 -- 172.21.15.103:0/558998846 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2557591901 0 0) 0x7f6c7c0c54e0 con 0x7f6c7c153af0 2024-09-10T08:44:38.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.377+0000 7f6c7affd640 1 -- 172.21.15.103:0/558998846 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c68003520 con 0x7f6c7c153af0 2024-09-10T08:44:38.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.377+0000 7f6c7b7fe640 1 -- 172.21.15.103:0/558998846 >> v2:172.21.15.154:3300/0 conn(0x7f6c7c0af870 msgr2=0x7f6c7c0c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:38.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.377+0000 7f6c7b7fe640 1 --2- 172.21.15.103:0/558998846 >> v2:172.21.15.154:3300/0 conn(0x7f6c7c0af870 0x7f6c7c0c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.377+0000 7f6c7b7fe640 1 -- 172.21.15.103:0/558998846 >> v1:172.21.15.103:6789/0 conn(0x7f6c7c153af0 legacy=0x7f6c7c1563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:38.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.377+0000 7f6c7b7fe640 1 -- 172.21.15.103:0/558998846 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7c15a3c0 con 0x7f6c7c0afdd0 2024-09-10T08:44:38.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.377+0000 7f6c80c81640 1 --2- 172.21.15.103:0/558998846 >> v2:172.21.15.154:3300/0 conn(0x7f6c7c0af870 0x7f6c7c0c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:44:38.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.378+0000 7f6c7b7fe640 1 --2- 172.21.15.103:0/558998846 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c7c0afdd0 0x7f6c7c0c5900 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6c640097a0 tx=0x7f6c6402a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1702b6ad0a76331 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:38.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.378+0000 7f6c7affd640 1 -- 172.21.15.103:0/558998846 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c64037070 con 0x7f6c7c0afdd0 2024-09-10T08:44:38.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.378+0000 7f6c7affd640 1 -- 172.21.15.103:0/558998846 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c6402adb0 con 0x7f6c7c0afdd0 2024-09-10T08:44:38.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.378+0000 7f6c7affd640 1 -- 172.21.15.103:0/558998846 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c64032660 con 0x7f6c7c0afdd0 2024-09-10T08:44:38.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.379+0000 7f6c826e4640 1 -- 172.21.15.103:0/558998846 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c7c0afdd0 msgr2=0x7f6c7c0c5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:38.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.379+0000 7f6c826e4640 1 --2- 172.21.15.103:0/558998846 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c7c0afdd0 0x7f6c7c0c5900 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6c640097a0 tx=0x7f6c6402a060 comp rx=0 tx=0).stop 2024-09-10T08:44:38.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.379+0000 7f6c826e4640 1 -- 172.21.15.103:0/558998846 shutdown_connections 2024-09-10T08:44:38.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.379+0000 7f6c826e4640 1 --2- 172.21.15.103:0/558998846 >> v2:172.21.15.154:3300/0 conn(0x7f6c7c0af870 0x7f6c7c0c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.379+0000 7f6c826e4640 1 --2- 172.21.15.103:0/558998846 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c7c0afdd0 0x7f6c7c0c5900 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.379+0000 7f6c826e4640 1 -- 172.21.15.103:0/558998846 >> 172.21.15.103:0/558998846 conn(0x7f6c7c0c6880 msgr2=0x7f6c7c0c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:38.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.379+0000 7f6c826e4640 1 -- 172.21.15.103:0/558998846 shutdown_connections 2024-09-10T08:44:38.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.379+0000 7f6c826e4640 1 -- 172.21.15.103:0/558998846 wait complete. 2024-09-10T08:44:38.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.380+0000 7f6c826e4640 1 Processor -- start 2024-09-10T08:44:38.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.380+0000 7f6c826e4640 1 -- start start 2024-09-10T08:44:38.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.381+0000 7f6c826e4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c7c0af870 0x7f6c7c1ef600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.381+0000 7f6c826e4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c7c0afdd0 0x7f6c7c0c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.381+0000 7f6c826e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c7c153af0 0x7f6c7c1ec9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.381+0000 7f6c826e4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c154050 con 0x7f6c7c0afdd0 2024-09-10T08:44:38.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.381+0000 7f6c826e4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c153ed0 con 0x7f6c7c153af0 2024-09-10T08:44:38.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.381+0000 7f6c826e4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f6c7c0c4cc0 con 0x7f6c7c0af870 2024-09-10T08:44:38.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.381+0000 7f6c7b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c7c0afdd0 0x7f6c7c0c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.381+0000 7f6c7b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c7c0afdd0 0x7f6c7c0c8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60626/0 (socket says 172.21.15.103:60626) 2024-09-10T08:44:38.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.381+0000 7f6c7b7fe640 1 -- 172.21.15.103:0/3939507530 learned_addr learned my addr 172.21.15.103:0/3939507530 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:38.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.381+0000 7f6c7bfff640 1 --2- 172.21.15.103:0/3939507530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c7c0af870 0x7f6c7c1ef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.381+0000 7f6c80c81640 1 --2- 172.21.15.103:0/3939507530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c7c153af0 0x7f6c7c1ec9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.381+0000 7f6c7b7fe640 1 -- 172.21.15.103:0/3939507530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c7c0af870 msgr2=0x7f6c7c1ef600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:38.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.381+0000 7f6c7b7fe640 1 --2- 172.21.15.103:0/3939507530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c7c0af870 0x7f6c7c1ef600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.381+0000 7f6c7b7fe640 1 -- 172.21.15.103:0/3939507530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c7c153af0 msgr2=0x7f6c7c1ec9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:38.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.381+0000 7f6c7b7fe640 1 --2- 172.21.15.103:0/3939507530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c7c153af0 0x7f6c7c1ec9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.381+0000 7f6c7b7fe640 1 -- 172.21.15.103:0/3939507530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7c1eeb60 con 0x7f6c7c0afdd0 2024-09-10T08:44:38.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.381+0000 7f6c7b7fe640 1 --2- 172.21.15.103:0/3939507530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c7c0afdd0 0x7f6c7c0c8610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6c640098c0 tx=0x7f6c640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:38.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.381+0000 7f6c78ff9640 1 -- 172.21.15.103:0/3939507530 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c64041030 con 0x7f6c7c0afdd0 2024-09-10T08:44:38.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.382+0000 7f6c78ff9640 1 -- 172.21.15.103:0/3939507530 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c6402abb0 con 0x7f6c7c0afdd0 2024-09-10T08:44:38.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.382+0000 7f6c78ff9640 1 -- 172.21.15.103:0/3939507530 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c64037040 con 0x7f6c7c0afdd0 2024-09-10T08:44:38.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.382+0000 7f6c826e4640 1 -- 172.21.15.103:0/3939507530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c7c1ec130 con 0x7f6c7c0afdd0 2024-09-10T08:44:38.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.382+0000 7f6c826e4640 1 -- 172.21.15.103:0/3939507530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c7c1ec410 con 0x7f6c7c0afdd0 2024-09-10T08:44:38.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.383+0000 7f6c826e4640 1 -- 172.21.15.103:0/3939507530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c7c0c5110 con 0x7f6c7c0afdd0 2024-09-10T08:44:38.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.383+0000 7f6c78ff9640 1 -- 172.21.15.103:0/3939507530 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c64044070 con 0x7f6c7c0afdd0 2024-09-10T08:44:38.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.383+0000 7f6c78ff9640 1 --2- 172.21.15.103:0/3939507530 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6c5c06be30 0x7f6c5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.383+0000 7f6c78ff9640 1 -- 172.21.15.103:0/3939507530 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f6c640ab790 con 0x7f6c7c0afdd0 2024-09-10T08:44:38.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.384+0000 7f6c7bfff640 1 --2- 172.21.15.103:0/3939507530 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6c5c06be30 0x7f6c5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.384+0000 7f6c7bfff640 1 --2- 172.21.15.103:0/3939507530 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6c5c06be30 0x7f6c5c06e2f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c005880 tx=0x7f6c6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:38.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.388+0000 7f6c78ff9640 1 -- 172.21.15.103:0/3939507530 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6c64079f50 con 0x7f6c7c0afdd0 2024-09-10T08:44:38.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.553+0000 7f6c826e4640 1 -- 172.21.15.103:0/3939507530 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f6c7c0c8b50 con 0x7f6c5c06be30 2024-09-10T08:44:38.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.554+0000 7f6c78ff9640 1 -- 172.21.15.103:0/3939507530 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6c7c0c8b50 con 0x7f6c5c06be30 2024-09-10T08:44:38.554 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 0 to deep-scrub 2024-09-10T08:44:38.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.556+0000 7f6c826e4640 1 -- 172.21.15.103:0/3939507530 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6c5c06be30 msgr2=0x7f6c5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:38.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.556+0000 7f6c826e4640 1 --2- 172.21.15.103:0/3939507530 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6c5c06be30 0x7f6c5c06e2f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c005880 tx=0x7f6c6c009040 comp rx=0 tx=0).stop 2024-09-10T08:44:38.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.556+0000 7f6c826e4640 1 -- 172.21.15.103:0/3939507530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c7c0afdd0 msgr2=0x7f6c7c0c8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:38.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.556+0000 7f6c826e4640 1 --2- 172.21.15.103:0/3939507530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c7c0afdd0 0x7f6c7c0c8610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6c640098c0 tx=0x7f6c640046c0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.556+0000 7f6c826e4640 1 -- 172.21.15.103:0/3939507530 shutdown_connections 2024-09-10T08:44:38.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.556+0000 7f6c826e4640 1 --2- 172.21.15.103:0/3939507530 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f6c5c06be30 0x7f6c5c06e2f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.556+0000 7f6c826e4640 1 --2- 172.21.15.103:0/3939507530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c7c153af0 0x7f6c7c1ec9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.556+0000 7f6c826e4640 1 --2- 172.21.15.103:0/3939507530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c7c0afdd0 0x7f6c7c0c8610 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.556+0000 7f6c826e4640 1 --2- 172.21.15.103:0/3939507530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c7c0af870 0x7f6c7c1ef600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.556+0000 7f6c826e4640 1 -- 172.21.15.103:0/3939507530 >> 172.21.15.103:0/3939507530 conn(0x7f6c7c0c6880 msgr2=0x7f6c7c157c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:38.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.556+0000 7f6c826e4640 1 -- 172.21.15.103:0/3939507530 shutdown_connections 2024-09-10T08:44:38.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.556+0000 7f6c826e4640 1 -- 172.21.15.103:0/3939507530 wait complete. 2024-09-10T08:44:38.567 INFO:tasks.ceph:Scrubbing osd.1 2024-09-10T08:44:38.567 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:44:38.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.671+0000 7f26c31a6640 1 Processor -- start 2024-09-10T08:44:38.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.671+0000 7f26c31a6640 1 -- start start 2024-09-10T08:44:38.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26c31a6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26bc06f4a0 0x7f26bc0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26c31a6640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26bc070070 con 0x7f26bc1578c0 2024-09-10T08:44:38.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26c31a6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26bc1583d0 con 0x7f26bc073e70 2024-09-10T08:44:38.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26c31a6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f26bc0c5430 con 0x7f26bc06f4a0 2024-09-10T08:44:38.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26c0f42640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f26bc1578c0 0x7f26bc06f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40912/0 (socket says 172.21.15.103:40912) 2024-09-10T08:44:38.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26c0f42640 1 -- 172.21.15.103:0/3373396018 learned_addr learned my addr 172.21.15.103:0/3373396018 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:44:38.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26bbfff640 1 --2- 172.21.15.103:0/3373396018 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26bc06f4a0 0x7f26bc0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26bb7fe640 1 -- 172.21.15.103:0/3373396018 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3967943749 0 0) 0x7f26bc070070 con 0x7f26bc1578c0 2024-09-10T08:44:38.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26bb7fe640 1 -- 172.21.15.103:0/3373396018 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26ac003520 con 0x7f26bc1578c0 2024-09-10T08:44:38.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26bb7fe640 1 -- 172.21.15.103:0/3373396018 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1599384022 0 0) 0x7f26bc1583d0 con 0x7f26bc073e70 2024-09-10T08:44:38.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26bb7fe640 1 -- 172.21.15.103:0/3373396018 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26bc070070 con 0x7f26bc073e70 2024-09-10T08:44:38.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26bb7fe640 1 -- 172.21.15.103:0/3373396018 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2396291177 0 0) 0x7f26ac003520 con 0x7f26bc1578c0 2024-09-10T08:44:38.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26bb7fe640 1 -- 172.21.15.103:0/3373396018 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26bc06f4a0 msgr2=0x7f26bc0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:38.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26bb7fe640 1 --2- 172.21.15.103:0/3373396018 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26bc06f4a0 0x7f26bc0c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26bb7fe640 1 -- 172.21.15.103:0/3373396018 >> v1:172.21.15.154:6789/0 conn(0x7f26bc073e70 legacy=0x7f26bc151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:38.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26bb7fe640 1 -- 172.21.15.103:0/3373396018 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26bc0c5710 con 0x7f26bc1578c0 2024-09-10T08:44:38.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26bb7fe640 1 -- 172.21.15.103:0/3373396018 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f26b0001670 con 0x7f26bc1578c0 2024-09-10T08:44:38.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26bbfff640 1 --2- 172.21.15.103:0/3373396018 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26bc06f4a0 0x7f26bc0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:44:38.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26bb7fe640 1 -- 172.21.15.103:0/3373396018 >> v1:172.21.15.103:6789/0 conn(0x7f26bc1578c0 legacy=0x7f26bc06f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:38.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26bb7fe640 1 --2- 172.21.15.103:0/3373396018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26ac003b70 0x7f26ac003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26bb7fe640 1 --2- 172.21.15.103:0/3373396018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26ac004800 0x7f26ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26bb7fe640 1 --2- 172.21.15.103:0/3373396018 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26bc06f4a0 0x7f26ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26bb7fe640 1 -- 172.21.15.103:0/3373396018 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc0c5430 con 0x7f26ac004800 2024-09-10T08:44:38.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26bb7fe640 1 -- 172.21.15.103:0/3373396018 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac00baa0 con 0x7f26ac003b70 2024-09-10T08:44:38.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.672+0000 7f26bb7fe640 1 -- 172.21.15.103:0/3373396018 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f26ac00bca0 con 0x7f26bc06f4a0 2024-09-10T08:44:38.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.673+0000 7f26bbfff640 1 --2- 172.21.15.103:0/3373396018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26ac004800 0x7f26ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.673+0000 7f26c0f42640 1 --2- 172.21.15.103:0/3373396018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26ac003b70 0x7f26ac003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.673+0000 7f26c1743640 1 --2- 172.21.15.103:0/3373396018 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26bc06f4a0 0x7f26ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.673+0000 7f26bbfff640 1 -- 172.21.15.103:0/3373396018 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26bc06f4a0 msgr2=0x7f26ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:38.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.673+0000 7f26bbfff640 1 --2- 172.21.15.103:0/3373396018 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26bc06f4a0 0x7f26ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.673+0000 7f26bbfff640 1 -- 172.21.15.103:0/3373396018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26ac003b70 msgr2=0x7f26ac003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:38.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.673+0000 7f26bbfff640 1 --2- 172.21.15.103:0/3373396018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26ac003b70 0x7f26ac003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.673+0000 7f26bbfff640 1 -- 172.21.15.103:0/3373396018 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ac003520 con 0x7f26ac004800 2024-09-10T08:44:38.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.674+0000 7f26bbfff640 1 --2- 172.21.15.103:0/3373396018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26ac004800 0x7f26ac004c80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f26a8009c60 tx=0x7f26ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a7f602fd725a7d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:38.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.674+0000 7f26bb7fe640 1 -- 172.21.15.103:0/3373396018 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a8036070 con 0x7f26ac004800 2024-09-10T08:44:38.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.674+0000 7f26bb7fe640 1 -- 172.21.15.103:0/3373396018 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a8031400 con 0x7f26ac004800 2024-09-10T08:44:38.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.674+0000 7f26bb7fe640 1 -- 172.21.15.103:0/3373396018 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a8009860 con 0x7f26ac004800 2024-09-10T08:44:38.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.674+0000 7f26c31a6640 1 -- 172.21.15.103:0/3373396018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26ac004800 msgr2=0x7f26ac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:38.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.674+0000 7f26c31a6640 1 --2- 172.21.15.103:0/3373396018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26ac004800 0x7f26ac004c80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f26a8009c60 tx=0x7f26ac005830 comp rx=0 tx=0).stop 2024-09-10T08:44:38.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.674+0000 7f26c1743640 1 -- 172.21.15.103:0/3373396018 reap_dead start 2024-09-10T08:44:38.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.674+0000 7f26c31a6640 1 -- 172.21.15.103:0/3373396018 shutdown_connections 2024-09-10T08:44:38.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.674+0000 7f26c31a6640 1 -- 172.21.15.103:0/3373396018 >> 172.21.15.103:0/3373396018 conn(0x7f26bc0c6910 msgr2=0x7f26bc0c6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:38.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.674+0000 7f26c31a6640 1 -- 172.21.15.103:0/3373396018 shutdown_connections 2024-09-10T08:44:38.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.674+0000 7f26c31a6640 1 -- 172.21.15.103:0/3373396018 wait complete. 2024-09-10T08:44:38.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.675+0000 7f26c31a6640 1 Processor -- start 2024-09-10T08:44:38.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.676+0000 7f26c31a6640 1 -- start start 2024-09-10T08:44:38.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.676+0000 7f26c31a6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26ac004800 0x7f26bc06d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.676+0000 7f26c31a6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26bc0af550 0x7f26bc06e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.676+0000 7f26c31a6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26bc0c9510 0x7f26bc0aca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.676+0000 7f26c31a6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc151c10 con 0x7f26ac004800 2024-09-10T08:44:38.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.676+0000 7f26c31a6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc151a90 con 0x7f26bc0c9510 2024-09-10T08:44:38.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.676+0000 7f26c31a6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f26bc0c5f10 con 0x7f26bc0af550 2024-09-10T08:44:38.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.676+0000 7f26c0f42640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26ac004800 0x7f26bc06d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.676+0000 7f26c0f42640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26ac004800 0x7f26bc06d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60644/0 (socket says 172.21.15.103:60644) 2024-09-10T08:44:38.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.676+0000 7f26c0f42640 1 -- 172.21.15.103:0/1585384694 learned_addr learned my addr 172.21.15.103:0/1585384694 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:38.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.677+0000 7f26bbfff640 1 --2- 172.21.15.103:0/1585384694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26bc0af550 0x7f26bc06e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.677+0000 7f26c1743640 1 --2- 172.21.15.103:0/1585384694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26bc0c9510 0x7f26bc0aca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.677+0000 7f26c0f42640 1 -- 172.21.15.103:0/1585384694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26bc0af550 msgr2=0x7f26bc06e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:38.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.677+0000 7f26c0f42640 1 --2- 172.21.15.103:0/1585384694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26bc0af550 0x7f26bc06e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.677+0000 7f26c0f42640 1 -- 172.21.15.103:0/1585384694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26bc0c9510 msgr2=0x7f26bc0aca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:38.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.677+0000 7f26c0f42640 1 --2- 172.21.15.103:0/1585384694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26bc0c9510 0x7f26bc0aca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.677+0000 7f26c0f42640 1 -- 172.21.15.103:0/1585384694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26bc1efa40 con 0x7f26ac004800 2024-09-10T08:44:38.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.677+0000 7f26c0f42640 1 --2- 172.21.15.103:0/1585384694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26ac004800 0x7f26bc06d810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f26b0007320 tx=0x7f26b00077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:38.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.677+0000 7f26b97fa640 1 -- 172.21.15.103:0/1585384694 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b001a070 con 0x7f26ac004800 2024-09-10T08:44:38.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.677+0000 7f26b97fa640 1 -- 172.21.15.103:0/1585384694 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26b000f8e0 con 0x7f26ac004800 2024-09-10T08:44:38.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.677+0000 7f26c31a6640 1 -- 172.21.15.103:0/1585384694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26bc1ef760 con 0x7f26ac004800 2024-09-10T08:44:38.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.677+0000 7f26b97fa640 1 -- 172.21.15.103:0/1585384694 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b000fcd0 con 0x7f26ac004800 2024-09-10T08:44:38.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.677+0000 7f26c31a6640 1 -- 172.21.15.103:0/1585384694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26bc06e3d0 con 0x7f26ac004800 2024-09-10T08:44:38.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.678+0000 7f26c31a6640 1 -- 172.21.15.103:0/1585384694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f26bc1ef510 con 0x7f26ac004800 2024-09-10T08:44:38.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.679+0000 7f26b97fa640 1 -- 172.21.15.103:0/1585384694 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f26b001d070 con 0x7f26ac004800 2024-09-10T08:44:38.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.679+0000 7f26b97fa640 1 --2- 172.21.15.103:0/1585384694 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f26a006be60 0x7f26a006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.679+0000 7f26b97fa640 1 -- 172.21.15.103:0/1585384694 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f26b008a900 con 0x7f26ac004800 2024-09-10T08:44:38.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.679+0000 7f26bbfff640 1 --2- 172.21.15.103:0/1585384694 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f26a006be60 0x7f26a006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.679+0000 7f26b97fa640 1 --2- 172.21.15.103:0/1585384694 >> [v2:172.21.15.103:6816/4029892782,v1:172.21.15.103:6818/4029892782] conn(0x7f26a00767f0 0x7f26a0078c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:38.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.679+0000 7f26b97fa640 1 -- 172.21.15.103:0/1585384694 --> [v2:172.21.15.103:6816/4029892782,v1:172.21.15.103:6818/4029892782] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f26a0079340 con 0x7f26a00767f0 2024-09-10T08:44:38.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.679+0000 7f26b97fa640 1 -- 172.21.15.103:0/1585384694 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f26b008f2c0 con 0x7f26ac004800 2024-09-10T08:44:38.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.679+0000 7f26c1743640 1 --2- 172.21.15.103:0/1585384694 >> [v2:172.21.15.103:6816/4029892782,v1:172.21.15.103:6818/4029892782] conn(0x7f26a00767f0 0x7f26a0078c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.679+0000 7f26bbfff640 1 --2- 172.21.15.103:0/1585384694 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f26a006be60 0x7f26a006e320 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f26a8033000 tx=0x7f26a8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:38.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.680+0000 7f26c1743640 1 -- 172.21.15.103:0/1585384694 >> [v2:172.21.15.103:6816/4029892782,v1:172.21.15.103:6818/4029892782] conn(0x7f26a00767f0 msgr2=0x7f26a0078c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-10T08:44:38.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.680+0000 7f26c1743640 1 -- 172.21.15.103:0/1585384694 >> [v2:172.21.15.103:6816/4029892782,v1:172.21.15.103:6818/4029892782] conn(0x7f26a00767f0 msgr2=0x7f26a0078c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:44:38.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.680+0000 7f26c1743640 1 --2- 172.21.15.103:0/1585384694 >> [v2:172.21.15.103:6816/4029892782,v1:172.21.15.103:6818/4029892782] conn(0x7f26a00767f0 0x7f26a0078c70 crc :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:44:38.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.680+0000 7f26c1743640 1 --2- 172.21.15.103:0/1585384694 >> [v2:172.21.15.103:6816/4029892782,v1:172.21.15.103:6818/4029892782] conn(0x7f26a00767f0 0x7f26a0078c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:44:38.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.881+0000 7f26c1743640 1 --2- 172.21.15.103:0/1585384694 >> [v2:172.21.15.103:6816/4029892782,v1:172.21.15.103:6818/4029892782] conn(0x7f26a00767f0 0x7f26a0078c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:38.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.881+0000 7f26c1743640 1 --2- 172.21.15.103:0/1585384694 >> [v2:172.21.15.103:6816/4029892782,v1:172.21.15.103:6818/4029892782] conn(0x7f26a00767f0 0x7f26a0078c70 crc :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:38.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.882+0000 7f26b97fa640 1 -- 172.21.15.103:0/1585384694 <== osd.1 v2:172.21.15.103:6816/4029892782 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f26a0079340 con 0x7f26a00767f0 2024-09-10T08:44:38.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.894+0000 7f26c31a6640 1 -- 172.21.15.103:0/1585384694 --> [v2:172.21.15.103:6816/4029892782,v1:172.21.15.103:6818/4029892782] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f26bc0c6290 con 0x7f26a00767f0 2024-09-10T08:44:38.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.894+0000 7f26b97fa640 1 -- 172.21.15.103:0/1585384694 <== osd.1 v2:172.21.15.103:6816/4029892782 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f26bc0c6290 con 0x7f26a00767f0 2024-09-10T08:44:38.894 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:44:38.894 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:44:38.895 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:44:38.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.895+0000 7f26c31a6640 1 -- 172.21.15.103:0/1585384694 >> [v2:172.21.15.103:6816/4029892782,v1:172.21.15.103:6818/4029892782] conn(0x7f26a00767f0 msgr2=0x7f26a0078c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:38.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.895+0000 7f26c31a6640 1 --2- 172.21.15.103:0/1585384694 >> [v2:172.21.15.103:6816/4029892782,v1:172.21.15.103:6818/4029892782] conn(0x7f26a00767f0 0x7f26a0078c70 crc :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.895+0000 7f26c31a6640 1 -- 172.21.15.103:0/1585384694 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f26a006be60 msgr2=0x7f26a006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:38.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.895+0000 7f26c31a6640 1 --2- 172.21.15.103:0/1585384694 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f26a006be60 0x7f26a006e320 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f26a8033000 tx=0x7f26a8008030 comp rx=0 tx=0).stop 2024-09-10T08:44:38.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.895+0000 7f26c31a6640 1 -- 172.21.15.103:0/1585384694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26ac004800 msgr2=0x7f26bc06d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:38.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.895+0000 7f26c31a6640 1 --2- 172.21.15.103:0/1585384694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26ac004800 0x7f26bc06d810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f26b0007320 tx=0x7f26b00077e0 comp rx=0 tx=0).stop 2024-09-10T08:44:38.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.895+0000 7f26c1743640 1 -- 172.21.15.103:0/1585384694 reap_dead start 2024-09-10T08:44:38.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.895+0000 7f26c31a6640 1 -- 172.21.15.103:0/1585384694 shutdown_connections 2024-09-10T08:44:38.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.895+0000 7f26c31a6640 1 -- 172.21.15.103:0/1585384694 >> 172.21.15.103:0/1585384694 conn(0x7f26bc0c6910 msgr2=0x7f26bc151360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:38.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.895+0000 7f26c31a6640 1 -- 172.21.15.103:0/1585384694 shutdown_connections 2024-09-10T08:44:38.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:38.895+0000 7f26c31a6640 1 -- 172.21.15.103:0/1585384694 wait complete. 2024-09-10T08:44:38.905 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-10T08:44:39.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.005+0000 7faca2696640 1 Processor -- start 2024-09-10T08:44:39.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.005+0000 7faca2696640 1 -- start start 2024-09-10T08:44:39.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.006+0000 7faca2696640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fac9c0c84e0 0x7fac9c06e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.006+0000 7faca2696640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fac9c06ec10 0x7fac9c160c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.006+0000 7faca2696640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac9c15a830 con 0x7fac9c15a450 2024-09-10T08:44:39.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.006+0000 7faca2696640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fac9c06e240 con 0x7fac9c0c84e0 2024-09-10T08:44:39.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.006+0000 7faca2696640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fac9c0c7490 con 0x7fac9c06ec10 2024-09-10T08:44:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.006+0000 7fac9b7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fac9c0c84e0 0x7fac9c06e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.006+0000 7fac9b7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fac9c0c84e0 0x7fac9c06e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60648/0 (socket says 172.21.15.103:60648) 2024-09-10T08:44:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.006+0000 7fac9b7fe640 1 -- 172.21.15.103:0/632170373 learned_addr learned my addr 172.21.15.103:0/632170373 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.006+0000 7faca0c33640 1 --2- 172.21.15.103:0/632170373 >> v2:172.21.15.154:3300/0 conn(0x7fac9c06ec10 0x7fac9c160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.006+0000 7fac9b7fe640 1 -- 172.21.15.103:0/632170373 >> v2:172.21.15.154:3300/0 conn(0x7fac9c06ec10 msgr2=0x7fac9c160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.006+0000 7fac9b7fe640 1 --2- 172.21.15.103:0/632170373 >> v2:172.21.15.154:3300/0 conn(0x7fac9c06ec10 0x7fac9c160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.006+0000 7fac9b7fe640 1 -- 172.21.15.103:0/632170373 >> v1:172.21.15.154:6789/0 conn(0x7fac9c15a450 legacy=0x7fac9c0c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.006+0000 7fac9b7fe640 1 -- 172.21.15.103:0/632170373 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac9c0c7770 con 0x7fac9c0c84e0 2024-09-10T08:44:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.007+0000 7fac9b7fe640 1 --2- 172.21.15.103:0/632170373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac9c0c84e0 0x7fac9c06e6d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fac90009870 tx=0x7fac9002a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce800c01372b5f98 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.007+0000 7fac9affd640 1 -- 172.21.15.103:0/632170373 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90037070 con 0x7fac9c0c84e0 2024-09-10T08:44:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.007+0000 7fac9affd640 1 -- 172.21.15.103:0/632170373 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac90032640 con 0x7fac9c0c84e0 2024-09-10T08:44:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.007+0000 7fac9affd640 1 -- 172.21.15.103:0/632170373 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90032a10 con 0x7fac9c0c84e0 2024-09-10T08:44:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.008+0000 7faca2696640 1 -- 172.21.15.103:0/632170373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac9c0c84e0 msgr2=0x7fac9c06e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.008+0000 7faca2696640 1 --2- 172.21.15.103:0/632170373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac9c0c84e0 0x7fac9c06e6d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fac90009870 tx=0x7fac9002a330 comp rx=0 tx=0).stop 2024-09-10T08:44:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.008+0000 7faca2696640 1 -- 172.21.15.103:0/632170373 shutdown_connections 2024-09-10T08:44:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.008+0000 7faca2696640 1 --2- 172.21.15.103:0/632170373 >> v2:172.21.15.154:3300/0 conn(0x7fac9c06ec10 0x7fac9c160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.008+0000 7faca2696640 1 --2- 172.21.15.103:0/632170373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac9c0c84e0 0x7fac9c06e6d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.008+0000 7faca2696640 1 -- 172.21.15.103:0/632170373 >> 172.21.15.103:0/632170373 conn(0x7fac9c0c5660 msgr2=0x7fac9c0c5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.008+0000 7faca2696640 1 -- 172.21.15.103:0/632170373 shutdown_connections 2024-09-10T08:44:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.008+0000 7faca2696640 1 -- 172.21.15.103:0/632170373 wait complete. 2024-09-10T08:44:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.009+0000 7faca2696640 1 Processor -- start 2024-09-10T08:44:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.009+0000 7faca2696640 1 -- start start 2024-09-10T08:44:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7faca2696640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac9c06ec10 0x7fac9c1ece50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7faca2696640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac9c0c84e0 0x7fac9c06cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7faca2696640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac9c15a450 0x7fac9c1ed7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7faca2696640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fac9c0c41a0 con 0x7fac9c06ec10 2024-09-10T08:44:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7faca2696640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fac9c0c7d30 con 0x7fac9c15a450 2024-09-10T08:44:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7faca2696640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fac9c0c4320 con 0x7fac9c0c84e0 2024-09-10T08:44:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7fac9bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac9c06ec10 0x7fac9c1ece50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7fac9bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac9c06ec10 0x7fac9c1ece50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60664/0 (socket says 172.21.15.103:60664) 2024-09-10T08:44:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7fac9bfff640 1 -- 172.21.15.103:0/1229158305 learned_addr learned my addr 172.21.15.103:0/1229158305 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7fac9b7fe640 1 --2- 172.21.15.103:0/1229158305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac9c0c84e0 0x7fac9c06cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7faca0c33640 1 --2- 172.21.15.103:0/1229158305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac9c15a450 0x7fac9c1ed7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7fac9bfff640 1 -- 172.21.15.103:0/1229158305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac9c0c84e0 msgr2=0x7fac9c06cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7fac9bfff640 1 --2- 172.21.15.103:0/1229158305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac9c0c84e0 0x7fac9c06cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7fac9bfff640 1 -- 172.21.15.103:0/1229158305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac9c15a450 msgr2=0x7fac9c1ed7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7fac9bfff640 1 --2- 172.21.15.103:0/1229158305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac9c15a450 0x7fac9c1ed7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7fac9bfff640 1 -- 172.21.15.103:0/1229158305 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac9c157120 con 0x7fac9c06ec10 2024-09-10T08:44:39.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7faca0c33640 1 --2- 172.21.15.103:0/1229158305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac9c15a450 0x7fac9c1ed7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:44:39.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7fac9b7fe640 1 --2- 172.21.15.103:0/1229158305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac9c0c84e0 0x7fac9c06cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:44:39.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7fac9bfff640 1 --2- 172.21.15.103:0/1229158305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac9c06ec10 0x7fac9c1ece50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fac8c00c3c0 tx=0x7fac8c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:39.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7fac98ff9640 1 -- 172.21.15.103:0/1229158305 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c0052d0 con 0x7fac9c06ec10 2024-09-10T08:44:39.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7fac98ff9640 1 -- 172.21.15.103:0/1229158305 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac8c005490 con 0x7fac9c06ec10 2024-09-10T08:44:39.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7faca2696640 1 -- 172.21.15.103:0/1229158305 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac9c09d040 con 0x7fac9c06ec10 2024-09-10T08:44:39.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.010+0000 7fac98ff9640 1 -- 172.21.15.103:0/1229158305 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c007260 con 0x7fac9c06ec10 2024-09-10T08:44:39.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.011+0000 7faca2696640 1 -- 172.21.15.103:0/1229158305 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac9c0ae780 con 0x7fac9c06ec10 2024-09-10T08:44:39.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.011+0000 7faca2696640 1 -- 172.21.15.103:0/1229158305 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac9c0c45d0 con 0x7fac9c06ec10 2024-09-10T08:44:39.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.012+0000 7fac98ff9640 1 -- 172.21.15.103:0/1229158305 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fac8c007400 con 0x7fac9c06ec10 2024-09-10T08:44:39.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.012+0000 7fac98ff9640 1 --2- 172.21.15.103:0/1229158305 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fac8806be30 0x7fac8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.012+0000 7fac9b7fe640 1 --2- 172.21.15.103:0/1229158305 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fac8806be30 0x7fac8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.012+0000 7fac98ff9640 1 -- 172.21.15.103:0/1229158305 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fac8c08a630 con 0x7fac9c06ec10 2024-09-10T08:44:39.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.013+0000 7fac9b7fe640 1 --2- 172.21.15.103:0/1229158305 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fac8806be30 0x7fac8806e2f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fac90034000 tx=0x7fac9002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:39.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.016+0000 7fac98ff9640 1 -- 172.21.15.103:0/1229158305 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac9c0c45d0 con 0x7fac9c06ec10 2024-09-10T08:44:39.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.187+0000 7faca2696640 1 -- 172.21.15.103:0/1229158305 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fac9c09e7f0 con 0x7fac8806be30 2024-09-10T08:44:39.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.188+0000 7fac98ff9640 1 -- 172.21.15.103:0/1229158305 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fac9c09e7f0 con 0x7fac8806be30 2024-09-10T08:44:39.188 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 1 to deep-scrub 2024-09-10T08:44:39.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.190+0000 7faca2696640 1 -- 172.21.15.103:0/1229158305 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fac8806be30 msgr2=0x7fac8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.190+0000 7faca2696640 1 --2- 172.21.15.103:0/1229158305 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fac8806be30 0x7fac8806e2f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fac90034000 tx=0x7fac9002e000 comp rx=0 tx=0).stop 2024-09-10T08:44:39.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.190+0000 7faca2696640 1 -- 172.21.15.103:0/1229158305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac9c06ec10 msgr2=0x7fac9c1ece50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.190+0000 7faca2696640 1 --2- 172.21.15.103:0/1229158305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac9c06ec10 0x7fac9c1ece50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fac8c00c3c0 tx=0x7fac8c00c880 comp rx=0 tx=0).stop 2024-09-10T08:44:39.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.190+0000 7faca2696640 1 -- 172.21.15.103:0/1229158305 shutdown_connections 2024-09-10T08:44:39.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.190+0000 7faca2696640 1 --2- 172.21.15.103:0/1229158305 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fac8806be30 0x7fac8806e2f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.190+0000 7faca2696640 1 --2- 172.21.15.103:0/1229158305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac9c15a450 0x7fac9c1ed7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.190+0000 7faca2696640 1 --2- 172.21.15.103:0/1229158305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac9c0c84e0 0x7fac9c06cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.190+0000 7faca2696640 1 --2- 172.21.15.103:0/1229158305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac9c06ec10 0x7fac9c1ece50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.190+0000 7faca2696640 1 -- 172.21.15.103:0/1229158305 >> 172.21.15.103:0/1229158305 conn(0x7fac9c0c5660 msgr2=0x7fac9c06f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:39.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.190+0000 7faca2696640 1 -- 172.21.15.103:0/1229158305 shutdown_connections 2024-09-10T08:44:39.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.190+0000 7faca2696640 1 -- 172.21.15.103:0/1229158305 wait complete. 2024-09-10T08:44:39.202 INFO:tasks.ceph:Scrubbing osd.2 2024-09-10T08:44:39.202 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:44:39.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.305+0000 7f2288eed640 1 Processor -- start 2024-09-10T08:44:39.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.305+0000 7f2288eed640 1 -- start start 2024-09-10T08:44:39.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.306+0000 7f2288eed640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f22840c8b10 0x7f228415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.306+0000 7f2288eed640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f228406cd80 0x7f22841534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.306+0000 7f2288eed640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2284153a10 0x7f2284156660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.306+0000 7f2288eed640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f22840c7070 con 0x7f228406cd80 2024-09-10T08:44:39.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.306+0000 7f2288eed640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f228406d210 con 0x7f22840c8b10 2024-09-10T08:44:39.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.306+0000 7f2288eed640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f22840c69b0 con 0x7f2284153a10 2024-09-10T08:44:39.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.306+0000 7f227bfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f228406cd80 0x7f22841534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.306+0000 7f227bfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f228406cd80 0x7f22841534d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60672/0 (socket says 172.21.15.103:60672) 2024-09-10T08:44:39.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.306+0000 7f227bfff640 1 -- 172.21.15.103:0/1601410258 learned_addr learned my addr 172.21.15.103:0/1601410258 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:39.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.306+0000 7f2282d9d640 1 --2- 172.21.15.103:0/1601410258 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2284153a10 0x7f2284156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.306+0000 7f228259c640 1 --2- 172.21.15.103:0/1601410258 >> v2:172.21.15.154:3300/0 conn(0x7f22840c8b10 0x7f228415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.307+0000 7f227bfff640 1 -- 172.21.15.103:0/1601410258 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2284153a10 msgr2=0x7f2284156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:39.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.307+0000 7f227bfff640 1 --2- 172.21.15.103:0/1601410258 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2284153a10 0x7f2284156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.307+0000 7f227bfff640 1 -- 172.21.15.103:0/1601410258 >> v2:172.21.15.154:3300/0 conn(0x7f22840c8b10 msgr2=0x7f228415a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:39.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.307+0000 7f227bfff640 1 --2- 172.21.15.103:0/1601410258 >> v2:172.21.15.154:3300/0 conn(0x7f22840c8b10 0x7f228415a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.307+0000 7f227bfff640 1 -- 172.21.15.103:0/1601410258 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22840c6c90 con 0x7f228406cd80 2024-09-10T08:44:39.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.307+0000 7f228259c640 1 --2- 172.21.15.103:0/1601410258 >> v2:172.21.15.154:3300/0 conn(0x7f22840c8b10 0x7f228415a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:44:39.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.307+0000 7f227bfff640 1 --2- 172.21.15.103:0/1601410258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f228406cd80 0x7f22841534d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f22840ae760 tx=0x7f226c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4fd05f84b3cdef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:39.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.307+0000 7f2281d9b640 1 -- 172.21.15.103:0/1601410258 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c037070 con 0x7f228406cd80 2024-09-10T08:44:39.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.308+0000 7f2281d9b640 1 -- 172.21.15.103:0/1601410258 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f226c032440 con 0x7f228406cd80 2024-09-10T08:44:39.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.308+0000 7f2281d9b640 1 -- 172.21.15.103:0/1601410258 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c032810 con 0x7f228406cd80 2024-09-10T08:44:39.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.308+0000 7f2288eed640 1 -- 172.21.15.103:0/1601410258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f228406cd80 msgr2=0x7f22841534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.308+0000 7f2288eed640 1 --2- 172.21.15.103:0/1601410258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f228406cd80 0x7f22841534d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f22840ae760 tx=0x7f226c02a140 comp rx=0 tx=0).stop 2024-09-10T08:44:39.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.308+0000 7f2288eed640 1 -- 172.21.15.103:0/1601410258 shutdown_connections 2024-09-10T08:44:39.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.308+0000 7f2288eed640 1 --2- 172.21.15.103:0/1601410258 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2284153a10 0x7f2284156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.308+0000 7f2288eed640 1 --2- 172.21.15.103:0/1601410258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f228406cd80 0x7f22841534d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.308+0000 7f2288eed640 1 --2- 172.21.15.103:0/1601410258 >> v2:172.21.15.154:3300/0 conn(0x7f22840c8b10 0x7f228415a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.308+0000 7f2288eed640 1 -- 172.21.15.103:0/1601410258 >> 172.21.15.103:0/1601410258 conn(0x7f22840adb80 msgr2=0x7f22840adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:39.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.308+0000 7f2288eed640 1 -- 172.21.15.103:0/1601410258 shutdown_connections 2024-09-10T08:44:39.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.308+0000 7f2288eed640 1 -- 172.21.15.103:0/1601410258 wait complete. 2024-09-10T08:44:39.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.309+0000 7f2288eed640 1 Processor -- start 2024-09-10T08:44:39.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.309+0000 7f2288eed640 1 -- start start 2024-09-10T08:44:39.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.310+0000 7f2288eed640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22840c8b10 0x7f2284155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.310+0000 7f2288eed640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2284153a10 0x7f22841ebcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.310+0000 7f2288eed640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f228414d9e0 0x7f22841ec230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.310+0000 7f2288eed640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2284154020 con 0x7f22840c8b10 2024-09-10T08:44:39.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.310+0000 7f2288eed640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2284153ea0 con 0x7f228414d9e0 2024-09-10T08:44:39.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.310+0000 7f2288eed640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f22840c8ef0 con 0x7f2284153a10 2024-09-10T08:44:39.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.310+0000 7f228259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22840c8b10 0x7f2284155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.310+0000 7f228259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22840c8b10 0x7f2284155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60678/0 (socket says 172.21.15.103:60678) 2024-09-10T08:44:39.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.310+0000 7f228259c640 1 -- 172.21.15.103:0/824734181 learned_addr learned my addr 172.21.15.103:0/824734181 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:39.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.310+0000 7f2282d9d640 1 --2- 172.21.15.103:0/824734181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f228414d9e0 0x7f22841ec230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.310+0000 7f227bfff640 1 --2- 172.21.15.103:0/824734181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2284153a10 0x7f22841ebcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.310+0000 7f228259c640 1 -- 172.21.15.103:0/824734181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2284153a10 msgr2=0x7f22841ebcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.310+0000 7f228259c640 1 --2- 172.21.15.103:0/824734181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2284153a10 0x7f22841ebcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.310+0000 7f228259c640 1 -- 172.21.15.103:0/824734181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f228414d9e0 msgr2=0x7f22841ec230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.310+0000 7f228259c640 1 --2- 172.21.15.103:0/824734181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f228414d9e0 0x7f22841ec230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.310+0000 7f228259c640 1 -- 172.21.15.103:0/824734181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22841efda0 con 0x7f22840c8b10 2024-09-10T08:44:39.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.311+0000 7f228259c640 1 --2- 172.21.15.103:0/824734181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22840c8b10 0x7f2284155320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f227400d800 tx=0x7f227400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:39.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.311+0000 7f227affd640 1 -- 172.21.15.103:0/824734181 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2274018070 con 0x7f22840c8b10 2024-09-10T08:44:39.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.311+0000 7f227affd640 1 -- 172.21.15.103:0/824734181 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2274004030 con 0x7f22840c8b10 2024-09-10T08:44:39.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.311+0000 7f2288eed640 1 -- 172.21.15.103:0/824734181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22840acd00 con 0x7f22840c8b10 2024-09-10T08:44:39.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.311+0000 7f227affd640 1 -- 172.21.15.103:0/824734181 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2274004400 con 0x7f22840c8b10 2024-09-10T08:44:39.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.311+0000 7f2288eed640 1 -- 172.21.15.103:0/824734181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2284155860 con 0x7f22840c8b10 2024-09-10T08:44:39.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.311+0000 7f2288eed640 1 -- 172.21.15.103:0/824734181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2284146860 con 0x7f22840c8b10 2024-09-10T08:44:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.312+0000 7f227affd640 1 -- 172.21.15.103:0/824734181 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f22740096a0 con 0x7f22840c8b10 2024-09-10T08:44:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.313+0000 7f227affd640 1 --2- 172.21.15.103:0/824734181 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f226406be30 0x7f226406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.313+0000 7f227affd640 1 -- 172.21.15.103:0/824734181 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f227408b420 con 0x7f22840c8b10 2024-09-10T08:44:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.313+0000 7f227bfff640 1 --2- 172.21.15.103:0/824734181 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f226406be30 0x7f226406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.313+0000 7f227affd640 1 --2- 172.21.15.103:0/824734181 >> [v2:172.21.15.103:6817/428484432,v1:172.21.15.103:6819/428484432] conn(0x7f22640767d0 0x7f2264078c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.313+0000 7f227affd640 1 -- 172.21.15.103:0/824734181 --> [v2:172.21.15.103:6817/428484432,v1:172.21.15.103:6819/428484432] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2264079320 con 0x7f22640767d0 2024-09-10T08:44:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.313+0000 7f227affd640 1 -- 172.21.15.103:0/824734181 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2274092050 con 0x7f22840c8b10 2024-09-10T08:44:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.313+0000 7f2282d9d640 1 --2- 172.21.15.103:0/824734181 >> [v2:172.21.15.103:6817/428484432,v1:172.21.15.103:6819/428484432] conn(0x7f22640767d0 0x7f2264078c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.313+0000 7f227bfff640 1 --2- 172.21.15.103:0/824734181 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f226406be30 0x7f226406e2f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f226c034000 tx=0x7f226c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.313+0000 7f2282d9d640 1 --2- 172.21.15.103:0/824734181 >> [v2:172.21.15.103:6817/428484432,v1:172.21.15.103:6819/428484432] conn(0x7f22640767d0 0x7f2264078c50 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:39.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.314+0000 7f227affd640 1 -- 172.21.15.103:0/824734181 <== osd.2 v2:172.21.15.103:6817/428484432 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2264079320 con 0x7f22640767d0 2024-09-10T08:44:39.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.327+0000 7f2288eed640 1 -- 172.21.15.103:0/824734181 --> [v2:172.21.15.103:6817/428484432,v1:172.21.15.103:6819/428484432] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f22841534d0 con 0x7f22640767d0 2024-09-10T08:44:39.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.327+0000 7f227affd640 1 -- 172.21.15.103:0/824734181 <== osd.2 v2:172.21.15.103:6817/428484432 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f22841534d0 con 0x7f22640767d0 2024-09-10T08:44:39.327 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:44:39.328 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:44:39.328 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:44:39.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.327+0000 7f2288eed640 1 -- 172.21.15.103:0/824734181 >> [v2:172.21.15.103:6817/428484432,v1:172.21.15.103:6819/428484432] conn(0x7f22640767d0 msgr2=0x7f2264078c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.327+0000 7f2288eed640 1 --2- 172.21.15.103:0/824734181 >> [v2:172.21.15.103:6817/428484432,v1:172.21.15.103:6819/428484432] conn(0x7f22640767d0 0x7f2264078c50 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.327+0000 7f2288eed640 1 -- 172.21.15.103:0/824734181 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f226406be30 msgr2=0x7f226406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.327+0000 7f2288eed640 1 --2- 172.21.15.103:0/824734181 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f226406be30 0x7f226406e2f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f226c034000 tx=0x7f226c02e000 comp rx=0 tx=0).stop 2024-09-10T08:44:39.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.327+0000 7f2288eed640 1 -- 172.21.15.103:0/824734181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22840c8b10 msgr2=0x7f2284155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.327+0000 7f2288eed640 1 --2- 172.21.15.103:0/824734181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22840c8b10 0x7f2284155320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f227400d800 tx=0x7f227400dcc0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.327+0000 7f2282d9d640 1 -- 172.21.15.103:0/824734181 reap_dead start 2024-09-10T08:44:39.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.327+0000 7f2288eed640 1 -- 172.21.15.103:0/824734181 shutdown_connections 2024-09-10T08:44:39.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.328+0000 7f2288eed640 1 -- 172.21.15.103:0/824734181 >> 172.21.15.103:0/824734181 conn(0x7f22840adb80 msgr2=0x7f2284152100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:39.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.328+0000 7f2288eed640 1 -- 172.21.15.103:0/824734181 shutdown_connections 2024-09-10T08:44:39.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.328+0000 7f2288eed640 1 -- 172.21.15.103:0/824734181 wait complete. 2024-09-10T08:44:39.338 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-10T08:44:39.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.438+0000 7faec5edd640 1 Processor -- start 2024-09-10T08:44:39.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.438+0000 7faec5edd640 1 -- start start 2024-09-10T08:44:39.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.439+0000 7faec5edd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faec00adb70 0x7faec01514c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.439+0000 7faec5edd640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faec0067d50 con 0x7faec0151a00 2024-09-10T08:44:39.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.439+0000 7faec5edd640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faec0067a70 con 0x7faec00aa6b0 2024-09-10T08:44:39.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.439+0000 7faec5edd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7faec00abc20 con 0x7faec00adb70 2024-09-10T08:44:39.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.439+0000 7faebffff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7faec0151a00 0x7faec006cf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40914/0 (socket says 172.21.15.103:40914) 2024-09-10T08:44:39.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.439+0000 7faebffff640 1 -- 172.21.15.103:0/1596028518 learned_addr learned my addr 172.21.15.103:0/1596028518 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:44:39.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.439+0000 7faebeffd640 1 --2- 172.21.15.103:0/1596028518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faec00adb70 0x7faec01514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.439+0000 7faebe7fc640 1 -- 172.21.15.103:0/1596028518 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3895175896 0 0) 0x7faec0067d50 con 0x7faec0151a00 2024-09-10T08:44:39.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.439+0000 7faebe7fc640 1 -- 172.21.15.103:0/1596028518 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faea8003520 con 0x7faec0151a00 2024-09-10T08:44:39.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.439+0000 7faebe7fc640 1 -- 172.21.15.103:0/1596028518 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3388212681 0 0) 0x7faea8003520 con 0x7faec0151a00 2024-09-10T08:44:39.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.440+0000 7faebe7fc640 1 -- 172.21.15.103:0/1596028518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faec00adb70 msgr2=0x7faec01514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:39.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.440+0000 7faebe7fc640 1 --2- 172.21.15.103:0/1596028518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faec00adb70 0x7faec01514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.440+0000 7faebe7fc640 1 -- 172.21.15.103:0/1596028518 >> v1:172.21.15.154:6789/0 conn(0x7faec00aa6b0 legacy=0x7faec01549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.440+0000 7faebe7fc640 1 -- 172.21.15.103:0/1596028518 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec00ab660 con 0x7faec0151a00 2024-09-10T08:44:39.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.440+0000 7faebe7fc640 1 -- 172.21.15.103:0/1596028518 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7faeb80019f0 con 0x7faec0151a00 2024-09-10T08:44:39.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.440+0000 7faebe7fc640 1 -- 172.21.15.103:0/1596028518 >> v1:172.21.15.103:6789/0 conn(0x7faec0151a00 legacy=0x7faec006cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.440+0000 7faebe7fc640 1 --2- 172.21.15.103:0/1596028518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faea80039e0 0x7faea8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.440+0000 7faebe7fc640 1 --2- 172.21.15.103:0/1596028518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faec00adb70 0x7faea8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.440+0000 7faebe7fc640 1 --2- 172.21.15.103:0/1596028518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faea8004d40 0x7faea80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.440+0000 7faebe7fc640 1 -- 172.21.15.103:0/1596028518 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faec00abc20 con 0x7faea8004d40 2024-09-10T08:44:39.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.440+0000 7faebe7fc640 1 -- 172.21.15.103:0/1596028518 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faea800baf0 con 0x7faea80039e0 2024-09-10T08:44:39.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.440+0000 7faebe7fc640 1 -- 172.21.15.103:0/1596028518 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7faea800bcf0 con 0x7faec00adb70 2024-09-10T08:44:39.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.440+0000 7faebffff640 1 --2- 172.21.15.103:0/1596028518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faea8004d40 0x7faea80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.440+0000 7faebeffd640 1 --2- 172.21.15.103:0/1596028518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faec00adb70 0x7faea8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.440+0000 7faebf7fe640 1 --2- 172.21.15.103:0/1596028518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faea80039e0 0x7faea8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.440+0000 7faebffff640 1 -- 172.21.15.103:0/1596028518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faec00adb70 msgr2=0x7faea8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:39.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.440+0000 7faebffff640 1 --2- 172.21.15.103:0/1596028518 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faec00adb70 0x7faea8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.440+0000 7faebffff640 1 -- 172.21.15.103:0/1596028518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faea80039e0 msgr2=0x7faea8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:39.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.440+0000 7faebffff640 1 --2- 172.21.15.103:0/1596028518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faea80039e0 0x7faea8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.440+0000 7faebffff640 1 -- 172.21.15.103:0/1596028518 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea8003520 con 0x7faea8004d40 2024-09-10T08:44:39.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.441+0000 7faebffff640 1 --2- 172.21.15.103:0/1596028518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faea8004d40 0x7faea80051c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faeb800a850 tx=0x7faea8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29be693080e23d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:39.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.441+0000 7faebe7fc640 1 -- 172.21.15.103:0/1596028518 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb800a4a0 con 0x7faea8004d40 2024-09-10T08:44:39.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.441+0000 7faebe7fc640 1 -- 172.21.15.103:0/1596028518 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb802f070 con 0x7faea8004d40 2024-09-10T08:44:39.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.441+0000 7faebe7fc640 1 -- 172.21.15.103:0/1596028518 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb802bce0 con 0x7faea8004d40 2024-09-10T08:44:39.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.441+0000 7faec5edd640 1 -- 172.21.15.103:0/1596028518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faea8004d40 msgr2=0x7faea80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.441+0000 7faec5edd640 1 --2- 172.21.15.103:0/1596028518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faea8004d40 0x7faea80051c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faeb800a850 tx=0x7faea8005830 comp rx=0 tx=0).stop 2024-09-10T08:44:39.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.441+0000 7faebffff640 1 -- 172.21.15.103:0/1596028518 reap_dead start 2024-09-10T08:44:39.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.441+0000 7faec5edd640 1 -- 172.21.15.103:0/1596028518 shutdown_connections 2024-09-10T08:44:39.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.441+0000 7faec5edd640 1 -- 172.21.15.103:0/1596028518 >> 172.21.15.103:0/1596028518 conn(0x7faec00c4fa0 msgr2=0x7faec00c5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:39.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.441+0000 7faec5edd640 1 -- 172.21.15.103:0/1596028518 shutdown_connections 2024-09-10T08:44:39.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.441+0000 7faec5edd640 1 -- 172.21.15.103:0/1596028518 wait complete. 2024-09-10T08:44:39.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.442+0000 7faec5edd640 1 Processor -- start 2024-09-10T08:44:39.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.443+0000 7faec5edd640 1 -- start start 2024-09-10T08:44:39.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.443+0000 7faec5edd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faec0073be0 0x7faec0072d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.443+0000 7faec5edd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faec00732d0 0x7faec014b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.443+0000 7faec5edd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faec014be80 0x7faec014c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.443+0000 7faec5edd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faec0151e90 con 0x7faec00732d0 2024-09-10T08:44:39.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.443+0000 7faec5edd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faec0154480 con 0x7faec0073be0 2024-09-10T08:44:39.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.443+0000 7faec5edd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7faec00c5d10 con 0x7faec014be80 2024-09-10T08:44:39.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.443+0000 7faebeffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faec00732d0 0x7faec014b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.443+0000 7faebeffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faec00732d0 0x7faec014b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60696/0 (socket says 172.21.15.103:60696) 2024-09-10T08:44:39.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.443+0000 7faebeffd640 1 -- 172.21.15.103:0/182641539 learned_addr learned my addr 172.21.15.103:0/182641539 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:39.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.444+0000 7faebf7fe640 1 --2- 172.21.15.103:0/182641539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faec0073be0 0x7faec0072d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.444+0000 7faebffff640 1 --2- 172.21.15.103:0/182641539 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faec014be80 0x7faec014c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.444+0000 7faebeffd640 1 -- 172.21.15.103:0/182641539 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faec014be80 msgr2=0x7faec014c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.444+0000 7faebeffd640 1 --2- 172.21.15.103:0/182641539 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faec014be80 0x7faec014c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.444+0000 7faebeffd640 1 -- 172.21.15.103:0/182641539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faec0073be0 msgr2=0x7faec0072d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.444+0000 7faebeffd640 1 --2- 172.21.15.103:0/182641539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faec0073be0 0x7faec0072d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.444+0000 7faebeffd640 1 -- 172.21.15.103:0/182641539 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec01584f0 con 0x7faec00732d0 2024-09-10T08:44:39.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.444+0000 7faebeffd640 1 --2- 172.21.15.103:0/182641539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faec00732d0 0x7faec014b940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faeb4011940 tx=0x7faeb4011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:39.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.444+0000 7faea7fff640 1 -- 172.21.15.103:0/182641539 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb400fa90 con 0x7faec00732d0 2024-09-10T08:44:39.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.444+0000 7faea7fff640 1 -- 172.21.15.103:0/182641539 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb400fc30 con 0x7faec00732d0 2024-09-10T08:44:39.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.444+0000 7faec5edd640 1 -- 172.21.15.103:0/182641539 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec01ed700 con 0x7faec00732d0 2024-09-10T08:44:39.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.444+0000 7faea7fff640 1 -- 172.21.15.103:0/182641539 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb4014440 con 0x7faec00732d0 2024-09-10T08:44:39.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.444+0000 7faec5edd640 1 -- 172.21.15.103:0/182641539 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec01565d0 con 0x7faec00732d0 2024-09-10T08:44:39.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.445+0000 7faec5edd640 1 -- 172.21.15.103:0/182641539 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec01edc20 con 0x7faec00732d0 2024-09-10T08:44:39.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.445+0000 7faea7fff640 1 -- 172.21.15.103:0/182641539 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faeb4012040 con 0x7faec00732d0 2024-09-10T08:44:39.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.446+0000 7faea7fff640 1 --2- 172.21.15.103:0/182641539 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7faeac06be30 0x7faeac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.446+0000 7faea7fff640 1 -- 172.21.15.103:0/182641539 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7faeb408b720 con 0x7faec00732d0 2024-09-10T08:44:39.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.446+0000 7faebf7fe640 1 --2- 172.21.15.103:0/182641539 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7faeac06be30 0x7faeac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.446+0000 7faebf7fe640 1 --2- 172.21.15.103:0/182641539 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7faeac06be30 0x7faeac06e2f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7faec014cc90 tx=0x7faeb0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:39.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.450+0000 7faea7fff640 1 -- 172.21.15.103:0/182641539 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faec01edc20 con 0x7faec00732d0 2024-09-10T08:44:39.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.614+0000 7faec5edd640 1 -- 172.21.15.103:0/182641539 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7faec014c850 con 0x7faeac06be30 2024-09-10T08:44:39.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.615+0000 7faea7fff640 1 -- 172.21.15.103:0/182641539 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faec014c850 con 0x7faeac06be30 2024-09-10T08:44:39.615 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 2 to deep-scrub 2024-09-10T08:44:39.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.617+0000 7faec5edd640 1 -- 172.21.15.103:0/182641539 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7faeac06be30 msgr2=0x7faeac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.617+0000 7faec5edd640 1 --2- 172.21.15.103:0/182641539 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7faeac06be30 0x7faeac06e2f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7faec014cc90 tx=0x7faeb0009040 comp rx=0 tx=0).stop 2024-09-10T08:44:39.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.617+0000 7faec5edd640 1 -- 172.21.15.103:0/182641539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faec00732d0 msgr2=0x7faec014b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.617+0000 7faec5edd640 1 --2- 172.21.15.103:0/182641539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faec00732d0 0x7faec014b940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faeb4011940 tx=0x7faeb4011e00 comp rx=0 tx=0).stop 2024-09-10T08:44:39.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.617+0000 7faec5edd640 1 -- 172.21.15.103:0/182641539 shutdown_connections 2024-09-10T08:44:39.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.617+0000 7faec5edd640 1 --2- 172.21.15.103:0/182641539 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7faeac06be30 0x7faeac06e2f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.617+0000 7faec5edd640 1 --2- 172.21.15.103:0/182641539 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faec014be80 0x7faec014c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.617+0000 7faec5edd640 1 --2- 172.21.15.103:0/182641539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faec00732d0 0x7faec014b940 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.617+0000 7faec5edd640 1 --2- 172.21.15.103:0/182641539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faec0073be0 0x7faec0072d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.617+0000 7faec5edd640 1 -- 172.21.15.103:0/182641539 >> 172.21.15.103:0/182641539 conn(0x7faec00c4fa0 msgr2=0x7faec00c3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:39.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.617+0000 7faec5edd640 1 -- 172.21.15.103:0/182641539 shutdown_connections 2024-09-10T08:44:39.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.617+0000 7faec5edd640 1 -- 172.21.15.103:0/182641539 wait complete. 2024-09-10T08:44:39.628 INFO:tasks.ceph:Scrubbing osd.3 2024-09-10T08:44:39.628 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:44:39.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.733+0000 7f4eeeed0640 1 Processor -- start 2024-09-10T08:44:39.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.733+0000 7f4eeeed0640 1 -- start start 2024-09-10T08:44:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.734+0000 7f4eeeed0640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4ee80c6960 0x7f4ee80c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.734+0000 7f4eeeed0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ee80684f0 0x7f4ee81536d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.734+0000 7f4eeeed0640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ee80ca1b0 con 0x7f4ee8153c10 2024-09-10T08:44:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.734+0000 7f4eeeed0640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f4ee806c230 con 0x7f4ee80c6960 2024-09-10T08:44:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.734+0000 7f4eeeed0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4ee806cdb0 con 0x7f4ee80684f0 2024-09-10T08:44:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.734+0000 7f4eecc6c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4ee80c6960 0x7f4ee80c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.734+0000 7f4eecc6c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4ee80c6960 0x7f4ee80c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60704/0 (socket says 172.21.15.103:60704) 2024-09-10T08:44:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.734+0000 7f4eecc6c640 1 -- 172.21.15.103:0/1991643257 learned_addr learned my addr 172.21.15.103:0/1991643257 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.734+0000 7f4edffff640 1 --2- 172.21.15.103:0/1991643257 >> v2:172.21.15.154:3300/0 conn(0x7f4ee80684f0 0x7f4ee81536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.734+0000 7f4eecc6c640 1 -- 172.21.15.103:0/1991643257 >> v2:172.21.15.154:3300/0 conn(0x7f4ee80684f0 msgr2=0x7f4ee81536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.734+0000 7f4eecc6c640 1 --2- 172.21.15.103:0/1991643257 >> v2:172.21.15.154:3300/0 conn(0x7f4ee80684f0 0x7f4ee81536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.734+0000 7f4eecc6c640 1 -- 172.21.15.103:0/1991643257 >> v1:172.21.15.154:6789/0 conn(0x7f4ee8153c10 legacy=0x7f4ee8156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.734+0000 7f4eecc6c640 1 -- 172.21.15.103:0/1991643257 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee806c480 con 0x7f4ee80c6960 2024-09-10T08:44:39.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.735+0000 7f4eecc6c640 1 --2- 172.21.15.103:0/1991643257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee80c6960 0x7f4ee80c9c70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80b2060 tx=0x7f4ee402a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9728b48788e0ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:39.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.735+0000 7f4edf7fe640 1 -- 172.21.15.103:0/1991643257 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4037070 con 0x7f4ee80c6960 2024-09-10T08:44:39.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.735+0000 7f4edf7fe640 1 -- 172.21.15.103:0/1991643257 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee4032440 con 0x7f4ee80c6960 2024-09-10T08:44:39.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.735+0000 7f4edf7fe640 1 -- 172.21.15.103:0/1991643257 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4032810 con 0x7f4ee80c6960 2024-09-10T08:44:39.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.736+0000 7f4eeeed0640 1 -- 172.21.15.103:0/1991643257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee80c6960 msgr2=0x7f4ee80c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.736+0000 7f4eeeed0640 1 --2- 172.21.15.103:0/1991643257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee80c6960 0x7f4ee80c9c70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80b2060 tx=0x7f4ee402a150 comp rx=0 tx=0).stop 2024-09-10T08:44:39.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.736+0000 7f4eeeed0640 1 -- 172.21.15.103:0/1991643257 shutdown_connections 2024-09-10T08:44:39.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.736+0000 7f4eeeed0640 1 --2- 172.21.15.103:0/1991643257 >> v2:172.21.15.154:3300/0 conn(0x7f4ee80684f0 0x7f4ee81536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.736+0000 7f4eeeed0640 1 --2- 172.21.15.103:0/1991643257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee80c6960 0x7f4ee80c9c70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.736+0000 7f4eeeed0640 1 -- 172.21.15.103:0/1991643257 >> 172.21.15.103:0/1991643257 conn(0x7f4ee80c87f0 msgr2=0x7f4ee80c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:39.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.736+0000 7f4eeeed0640 1 -- 172.21.15.103:0/1991643257 shutdown_connections 2024-09-10T08:44:39.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.736+0000 7f4eeeed0640 1 -- 172.21.15.103:0/1991643257 wait complete. 2024-09-10T08:44:39.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.737+0000 7f4eeeed0640 1 Processor -- start 2024-09-10T08:44:39.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.737+0000 7f4eeeed0640 1 -- start start 2024-09-10T08:44:39.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.738+0000 7f4eeeed0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ee80684f0 0x7f4ee814f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.738+0000 7f4eeeed0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ee80c6960 0x7f4ee814c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.738+0000 7f4eeeed0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee8153c10 0x7f4ee81ef710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.738+0000 7f4eeeed0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee80c6d40 con 0x7f4ee8153c10 2024-09-10T08:44:39.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.738+0000 7f4eeeed0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee806ca40 con 0x7f4ee80c6960 2024-09-10T08:44:39.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.738+0000 7f4eeeed0640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f4ee80c6ec0 con 0x7f4ee80684f0 2024-09-10T08:44:39.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.738+0000 7f4eed46d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee8153c10 0x7f4ee81ef710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.738+0000 7f4eed46d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee8153c10 0x7f4ee81ef710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60708/0 (socket says 172.21.15.103:60708) 2024-09-10T08:44:39.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.738+0000 7f4eed46d640 1 -- 172.21.15.103:0/2988953047 learned_addr learned my addr 172.21.15.103:0/2988953047 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:39.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.738+0000 7f4edffff640 1 --2- 172.21.15.103:0/2988953047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ee80c6960 0x7f4ee814c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.738+0000 7f4eecc6c640 1 --2- 172.21.15.103:0/2988953047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ee80684f0 0x7f4ee814f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.738+0000 7f4eed46d640 1 -- 172.21.15.103:0/2988953047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ee80684f0 msgr2=0x7f4ee814f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.738+0000 7f4eed46d640 1 --2- 172.21.15.103:0/2988953047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ee80684f0 0x7f4ee814f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.738+0000 7f4eed46d640 1 -- 172.21.15.103:0/2988953047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ee80c6960 msgr2=0x7f4ee814c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.738+0000 7f4eed46d640 1 --2- 172.21.15.103:0/2988953047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ee80c6960 0x7f4ee814c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.738+0000 7f4eed46d640 1 -- 172.21.15.103:0/2988953047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee814a990 con 0x7f4ee8153c10 2024-09-10T08:44:39.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.739+0000 7f4eed46d640 1 --2- 172.21.15.103:0/2988953047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee8153c10 0x7f4ee81ef710 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4ee000c730 tx=0x7f4ee000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:39.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.739+0000 7f4edd7fa640 1 -- 172.21.15.103:0/2988953047 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0016020 con 0x7f4ee8153c10 2024-09-10T08:44:39.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.739+0000 7f4edd7fa640 1 -- 172.21.15.103:0/2988953047 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee0006d50 con 0x7f4ee8153c10 2024-09-10T08:44:39.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.739+0000 7f4eeeed0640 1 -- 172.21.15.103:0/2988953047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ee814d1e0 con 0x7f4ee8153c10 2024-09-10T08:44:39.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.739+0000 7f4edd7fa640 1 -- 172.21.15.103:0/2988953047 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0003bb0 con 0x7f4ee8153c10 2024-09-10T08:44:39.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.739+0000 7f4eeeed0640 1 -- 172.21.15.103:0/2988953047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ee814fd60 con 0x7f4ee8153c10 2024-09-10T08:44:39.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.740+0000 7f4eeeed0640 1 -- 172.21.15.103:0/2988953047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ee81536d0 con 0x7f4ee8153c10 2024-09-10T08:44:39.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.740+0000 7f4edd7fa640 1 -- 172.21.15.103:0/2988953047 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ee00050d0 con 0x7f4ee8153c10 2024-09-10T08:44:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.741+0000 7f4edd7fa640 1 --2- 172.21.15.103:0/2988953047 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4ed406be30 0x7f4ed406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.741+0000 7f4edd7fa640 1 -- 172.21.15.103:0/2988953047 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f4ee008aba0 con 0x7f4ee8153c10 2024-09-10T08:44:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.741+0000 7f4eecc6c640 1 --2- 172.21.15.103:0/2988953047 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4ed406be30 0x7f4ed406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.741+0000 7f4edd7fa640 1 --2- 172.21.15.103:0/2988953047 >> [v2:172.21.15.103:6800/3453676282,v1:172.21.15.103:6801/3453676282] conn(0x7f4ed40767d0 0x7f4ed4078c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.741+0000 7f4edd7fa640 1 -- 172.21.15.103:0/2988953047 --> [v2:172.21.15.103:6800/3453676282,v1:172.21.15.103:6801/3453676282] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4ee001eec0 con 0x7f4ed40767d0 2024-09-10T08:44:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.741+0000 7f4edd7fa640 1 -- 172.21.15.103:0/2988953047 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4ee008f2c0 con 0x7f4ee8153c10 2024-09-10T08:44:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.741+0000 7f4edffff640 1 --2- 172.21.15.103:0/2988953047 >> [v2:172.21.15.103:6800/3453676282,v1:172.21.15.103:6801/3453676282] conn(0x7f4ed40767d0 0x7f4ed4078c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.741+0000 7f4eecc6c640 1 --2- 172.21.15.103:0/2988953047 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4ed406be30 0x7f4ed406e2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4034000 tx=0x7f4ee402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:39.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.741+0000 7f4edffff640 1 --2- 172.21.15.103:0/2988953047 >> [v2:172.21.15.103:6800/3453676282,v1:172.21.15.103:6801/3453676282] conn(0x7f4ed40767d0 0x7f4ed4078c50 crc :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:39.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.742+0000 7f4edd7fa640 1 -- 172.21.15.103:0/2988953047 <== osd.3 v2:172.21.15.103:6800/3453676282 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4ee001eec0 con 0x7f4ed40767d0 2024-09-10T08:44:39.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.754+0000 7f4eeeed0640 1 -- 172.21.15.103:0/2988953047 --> [v2:172.21.15.103:6800/3453676282,v1:172.21.15.103:6801/3453676282] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4ee814d9c0 con 0x7f4ed40767d0 2024-09-10T08:44:39.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.754+0000 7f4edd7fa640 1 -- 172.21.15.103:0/2988953047 <== osd.3 v2:172.21.15.103:6800/3453676282 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4ee814d9c0 con 0x7f4ed40767d0 2024-09-10T08:44:39.754 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:44:39.755 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:44:39.755 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:44:39.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.755+0000 7f4eeeed0640 1 -- 172.21.15.103:0/2988953047 >> [v2:172.21.15.103:6800/3453676282,v1:172.21.15.103:6801/3453676282] conn(0x7f4ed40767d0 msgr2=0x7f4ed4078c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.755+0000 7f4eeeed0640 1 --2- 172.21.15.103:0/2988953047 >> [v2:172.21.15.103:6800/3453676282,v1:172.21.15.103:6801/3453676282] conn(0x7f4ed40767d0 0x7f4ed4078c50 crc :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.755+0000 7f4eeeed0640 1 -- 172.21.15.103:0/2988953047 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4ed406be30 msgr2=0x7f4ed406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.755+0000 7f4eeeed0640 1 --2- 172.21.15.103:0/2988953047 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f4ed406be30 0x7f4ed406e2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4034000 tx=0x7f4ee402e000 comp rx=0 tx=0).stop 2024-09-10T08:44:39.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.755+0000 7f4eeeed0640 1 -- 172.21.15.103:0/2988953047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee8153c10 msgr2=0x7f4ee81ef710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.755+0000 7f4eeeed0640 1 --2- 172.21.15.103:0/2988953047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ee8153c10 0x7f4ee81ef710 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4ee000c730 tx=0x7f4ee000cbf0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.755+0000 7f4eed46d640 1 -- 172.21.15.103:0/2988953047 reap_dead start 2024-09-10T08:44:39.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.755+0000 7f4eeeed0640 1 -- 172.21.15.103:0/2988953047 shutdown_connections 2024-09-10T08:44:39.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.755+0000 7f4eeeed0640 1 -- 172.21.15.103:0/2988953047 >> 172.21.15.103:0/2988953047 conn(0x7f4ee80c87f0 msgr2=0x7f4ee80ac990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:39.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.755+0000 7f4eeeed0640 1 -- 172.21.15.103:0/2988953047 shutdown_connections 2024-09-10T08:44:39.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.755+0000 7f4eeeed0640 1 -- 172.21.15.103:0/2988953047 wait complete. 2024-09-10T08:44:39.766 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-10T08:44:39.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.866+0000 7f889a931640 1 Processor -- start 2024-09-10T08:44:39.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.866+0000 7f889a931640 1 -- start start 2024-09-10T08:44:39.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.867+0000 7f889a931640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8894153af0 0x7f88941563a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.867+0000 7f889a931640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88940af870 0x7f88940c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.867+0000 7f889a931640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88940c54e0 con 0x7f88940afdd0 2024-09-10T08:44:39.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.867+0000 7f889a931640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f88940c74a0 con 0x7f88940af870 2024-09-10T08:44:39.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.867+0000 7f889a931640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f88940c7740 con 0x7f8894153af0 2024-09-10T08:44:39.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.867+0000 7f8893fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8894153af0 0x7f88941563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.867+0000 7f8898ece640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88940af870 0x7f88940c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.867+0000 7f8893fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8894153af0 0x7f88941563a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:48956/0 (socket says 172.21.15.103:48956) 2024-09-10T08:44:39.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.867+0000 7f8893fff640 1 -- 172.21.15.103:0/2280781908 learned_addr learned my addr 172.21.15.103:0/2280781908 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:39.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.867+0000 7f8893fff640 1 -- 172.21.15.103:0/2280781908 >> v2:172.21.15.154:3300/0 conn(0x7f88940af870 msgr2=0x7f88940c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:39.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.867+0000 7f8893fff640 1 --2- 172.21.15.103:0/2280781908 >> v2:172.21.15.154:3300/0 conn(0x7f88940af870 0x7f88940c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.867+0000 7f8893fff640 1 -- 172.21.15.103:0/2280781908 >> v1:172.21.15.154:6789/0 conn(0x7f88940afdd0 legacy=0x7f88940c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.868+0000 7f8893fff640 1 -- 172.21.15.103:0/2280781908 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889415a3c0 con 0x7f8894153af0 2024-09-10T08:44:39.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.868+0000 7f8893fff640 1 --2- 172.21.15.103:0/2280781908 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8894153af0 0x7f88941563a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8884009870 tx=0x7f888402a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e00529ce65e63778 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:39.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.868+0000 7f8892ffd640 1 -- 172.21.15.103:0/2280781908 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8884037070 con 0x7f8894153af0 2024-09-10T08:44:39.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.868+0000 7f8892ffd640 1 -- 172.21.15.103:0/2280781908 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8884032440 con 0x7f8894153af0 2024-09-10T08:44:39.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.868+0000 7f8892ffd640 1 -- 172.21.15.103:0/2280781908 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8884032810 con 0x7f8894153af0 2024-09-10T08:44:39.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.869+0000 7f889a931640 1 -- 172.21.15.103:0/2280781908 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8894153af0 msgr2=0x7f88941563a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.869+0000 7f889a931640 1 --2- 172.21.15.103:0/2280781908 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8894153af0 0x7f88941563a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8884009870 tx=0x7f888402a130 comp rx=0 tx=0).stop 2024-09-10T08:44:39.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.869+0000 7f889a931640 1 -- 172.21.15.103:0/2280781908 shutdown_connections 2024-09-10T08:44:39.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.869+0000 7f889a931640 1 --2- 172.21.15.103:0/2280781908 >> v2:172.21.15.154:3300/0 conn(0x7f88940af870 0x7f88940c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.869+0000 7f889a931640 1 --2- 172.21.15.103:0/2280781908 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8894153af0 0x7f88941563a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.869+0000 7f889a931640 1 -- 172.21.15.103:0/2280781908 >> 172.21.15.103:0/2280781908 conn(0x7f88940c6880 msgr2=0x7f88940c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:39.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.869+0000 7f889a931640 1 -- 172.21.15.103:0/2280781908 shutdown_connections 2024-09-10T08:44:39.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.869+0000 7f889a931640 1 -- 172.21.15.103:0/2280781908 wait complete. 2024-09-10T08:44:39.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.870+0000 7f889a931640 1 Processor -- start 2024-09-10T08:44:39.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.870+0000 7f889a931640 1 -- start start 2024-09-10T08:44:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.871+0000 7f889a931640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88940af870 0x7f8894157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.871+0000 7f889a931640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88940afdd0 0x7f88941eb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.871+0000 7f889a931640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8894153af0 0x7f8894158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.871+0000 7f889a931640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8894154050 con 0x7f88940afdd0 2024-09-10T08:44:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.871+0000 7f889a931640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8894153ed0 con 0x7f88940af870 2024-09-10T08:44:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.871+0000 7f889a931640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f88940c4cc0 con 0x7f8894153af0 2024-09-10T08:44:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.871+0000 7f88937fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88940afdd0 0x7f88941eb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.871+0000 7f8893fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88940af870 0x7f8894157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.871+0000 7f88937fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88940afdd0 0x7f88941eb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60712/0 (socket says 172.21.15.103:60712) 2024-09-10T08:44:39.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.871+0000 7f88937fe640 1 -- 172.21.15.103:0/4117393376 learned_addr learned my addr 172.21.15.103:0/4117393376 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.871+0000 7f8898ece640 1 --2- 172.21.15.103:0/4117393376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8894153af0 0x7f8894158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.871+0000 7f88937fe640 1 -- 172.21.15.103:0/4117393376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8894153af0 msgr2=0x7f8894158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.871+0000 7f88937fe640 1 --2- 172.21.15.103:0/4117393376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8894153af0 0x7f8894158760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.871+0000 7f88937fe640 1 -- 172.21.15.103:0/4117393376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88940af870 msgr2=0x7f8894157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.871+0000 7f88937fe640 1 --2- 172.21.15.103:0/4117393376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88940af870 0x7f8894157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.871+0000 7f88937fe640 1 -- 172.21.15.103:0/4117393376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8894157fa0 con 0x7f88940afdd0 2024-09-10T08:44:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.872+0000 7f88937fe640 1 --2- 172.21.15.103:0/4117393376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88940afdd0 0x7f88941eb790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f888800c390 tx=0x7f888800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.872+0000 7f8890ff9640 1 -- 172.21.15.103:0/4117393376 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888017070 con 0x7f88940afdd0 2024-09-10T08:44:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.872+0000 7f8890ff9640 1 -- 172.21.15.103:0/4117393376 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88880052d0 con 0x7f88940afdd0 2024-09-10T08:44:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.872+0000 7f889a931640 1 -- 172.21.15.103:0/4117393376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f889414e420 con 0x7f88940afdd0 2024-09-10T08:44:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.872+0000 7f8890ff9640 1 -- 172.21.15.103:0/4117393376 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888003830 con 0x7f88940afdd0 2024-09-10T08:44:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.872+0000 7f889a931640 1 -- 172.21.15.103:0/4117393376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f889414e9e0 con 0x7f88940afdd0 2024-09-10T08:44:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.873+0000 7f889a931640 1 -- 172.21.15.103:0/4117393376 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88940c5040 con 0x7f88940afdd0 2024-09-10T08:44:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.873+0000 7f8890ff9640 1 -- 172.21.15.103:0/4117393376 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f888801a070 con 0x7f88940afdd0 2024-09-10T08:44:39.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.874+0000 7f8890ff9640 1 --2- 172.21.15.103:0/4117393376 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f888006be30 0x7f888006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:39.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.874+0000 7f8890ff9640 1 -- 172.21.15.103:0/4117393376 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f888808a4d0 con 0x7f88940afdd0 2024-09-10T08:44:39.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.874+0000 7f8893fff640 1 --2- 172.21.15.103:0/4117393376 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f888006be30 0x7f888006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:39.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.874+0000 7f8893fff640 1 --2- 172.21.15.103:0/4117393376 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f888006be30 0x7f888006e2f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8884034000 tx=0x7f888402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:39.878+0000 7f8890ff9640 1 -- 172.21.15.103:0/4117393376 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f88880584a0 con 0x7f88940afdd0 2024-09-10T08:44:40.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.047+0000 7f889a931640 1 -- 172.21.15.103:0/4117393376 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f88940690a0 con 0x7f888006be30 2024-09-10T08:44:40.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.047+0000 7f8890ff9640 1 -- 172.21.15.103:0/4117393376 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f88940690a0 con 0x7f888006be30 2024-09-10T08:44:40.047 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 3 to deep-scrub 2024-09-10T08:44:40.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.049+0000 7f889a931640 1 -- 172.21.15.103:0/4117393376 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f888006be30 msgr2=0x7f888006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.049+0000 7f889a931640 1 --2- 172.21.15.103:0/4117393376 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f888006be30 0x7f888006e2f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8884034000 tx=0x7f888402e000 comp rx=0 tx=0).stop 2024-09-10T08:44:40.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.049+0000 7f889a931640 1 -- 172.21.15.103:0/4117393376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88940afdd0 msgr2=0x7f88941eb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.049+0000 7f889a931640 1 --2- 172.21.15.103:0/4117393376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88940afdd0 0x7f88941eb790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f888800c390 tx=0x7f888800c850 comp rx=0 tx=0).stop 2024-09-10T08:44:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.049+0000 7f889a931640 1 -- 172.21.15.103:0/4117393376 shutdown_connections 2024-09-10T08:44:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.049+0000 7f889a931640 1 --2- 172.21.15.103:0/4117393376 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f888006be30 0x7f888006e2f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.049+0000 7f889a931640 1 --2- 172.21.15.103:0/4117393376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8894153af0 0x7f8894158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.049+0000 7f889a931640 1 --2- 172.21.15.103:0/4117393376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88940afdd0 0x7f88941eb790 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.049+0000 7f889a931640 1 --2- 172.21.15.103:0/4117393376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88940af870 0x7f8894157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.049+0000 7f889a931640 1 -- 172.21.15.103:0/4117393376 >> 172.21.15.103:0/4117393376 conn(0x7f88940c6880 msgr2=0x7f88940c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.049+0000 7f889a931640 1 -- 172.21.15.103:0/4117393376 shutdown_connections 2024-09-10T08:44:40.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.050+0000 7f889a931640 1 -- 172.21.15.103:0/4117393376 wait complete. 2024-09-10T08:44:40.061 INFO:tasks.ceph:Scrubbing osd.4 2024-09-10T08:44:40.061 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:44:40.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.165+0000 7f94c67b7640 1 Processor -- start 2024-09-10T08:44:40.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.165+0000 7f94c67b7640 1 -- start start 2024-09-10T08:44:40.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.166+0000 7f94c67b7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f94c0156290 0x7f94c0156700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.166+0000 7f94c67b7640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94c006c480 con 0x7f94c00684f0 2024-09-10T08:44:40.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.166+0000 7f94c67b7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94c006c760 con 0x7f94c00c6960 2024-09-10T08:44:40.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.166+0000 7f94c67b7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f94c006c230 con 0x7f94c0156290 2024-09-10T08:44:40.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.166+0000 7f94bf7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f94c00684f0 0x7f94c01536d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40918/0 (socket says 172.21.15.103:40918) 2024-09-10T08:44:40.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.166+0000 7f94bf7fe640 1 -- 172.21.15.103:0/3041442069 learned_addr learned my addr 172.21.15.103:0/3041442069 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:44:40.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.166+0000 7f94c4d54640 1 --2- 172.21.15.103:0/3041442069 >> v2:172.21.15.154:3300/0 conn(0x7f94c0156290 0x7f94c0156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.166+0000 7f94beffd640 1 -- 172.21.15.103:0/3041442069 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1566239039 0 0) 0x7f94c006c480 con 0x7f94c00684f0 2024-09-10T08:44:40.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.166+0000 7f94beffd640 1 -- 172.21.15.103:0/3041442069 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94a8003520 con 0x7f94c00684f0 2024-09-10T08:44:40.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.166+0000 7f94c4d54640 1 -- 172.21.15.103:0/3041442069 >> v1:172.21.15.154:6789/0 conn(0x7f94c00c6960 legacy=0x7f94c00c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.166+0000 7f94c4d54640 1 -- 172.21.15.103:0/3041442069 >> v1:172.21.15.103:6789/0 conn(0x7f94c00684f0 legacy=0x7f94c01536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.166+0000 7f94c4d54640 1 -- 172.21.15.103:0/3041442069 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c006ca40 con 0x7f94c0156290 2024-09-10T08:44:40.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.167+0000 7f94c4d54640 1 --2- 172.21.15.103:0/3041442069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94c0156290 0x7f94c0156700 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f94b8009d90 tx=0x7f94b802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de27fdf42e86fa8b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:40.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.167+0000 7f94beffd640 1 -- 172.21.15.103:0/3041442069 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b8031600 con 0x7f94c0156290 2024-09-10T08:44:40.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.167+0000 7f94beffd640 1 -- 172.21.15.103:0/3041442069 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b80317a0 con 0x7f94c0156290 2024-09-10T08:44:40.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.167+0000 7f94beffd640 1 -- 172.21.15.103:0/3041442069 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b8031b70 con 0x7f94c0156290 2024-09-10T08:44:40.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.168+0000 7f94c67b7640 1 -- 172.21.15.103:0/3041442069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94c0156290 msgr2=0x7f94c0156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.168+0000 7f94c67b7640 1 --2- 172.21.15.103:0/3041442069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94c0156290 0x7f94c0156700 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f94b8009d90 tx=0x7f94b802a5d0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.168+0000 7f94c67b7640 1 -- 172.21.15.103:0/3041442069 shutdown_connections 2024-09-10T08:44:40.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.168+0000 7f94c67b7640 1 --2- 172.21.15.103:0/3041442069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94c0156290 0x7f94c0156700 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.168+0000 7f94c67b7640 1 -- 172.21.15.103:0/3041442069 >> 172.21.15.103:0/3041442069 conn(0x7f94c00c87f0 msgr2=0x7f94c00c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:40.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.168+0000 7f94c67b7640 1 -- 172.21.15.103:0/3041442069 shutdown_connections 2024-09-10T08:44:40.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.168+0000 7f94c67b7640 1 -- 172.21.15.103:0/3041442069 wait complete. 2024-09-10T08:44:40.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.169+0000 7f94c67b7640 1 Processor -- start 2024-09-10T08:44:40.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.169+0000 7f94c67b7640 1 -- start start 2024-09-10T08:44:40.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.170+0000 7f94c67b7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94c00684f0 0x7f94c014d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.170+0000 7f94c67b7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94c00c6960 0x7f94c0152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.170+0000 7f94c67b7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94c0156290 0x7f94c014acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.170+0000 7f94c67b7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f94c00c6d40 con 0x7f94c0156290 2024-09-10T08:44:40.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.170+0000 7f94c67b7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f94c006cdb0 con 0x7f94c00684f0 2024-09-10T08:44:40.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.170+0000 7f94c67b7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f94c00c6ec0 con 0x7f94c00c6960 2024-09-10T08:44:40.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.170+0000 7f94c4d54640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94c0156290 0x7f94c014acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.170+0000 7f94c4d54640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94c0156290 0x7f94c014acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60718/0 (socket says 172.21.15.103:60718) 2024-09-10T08:44:40.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.170+0000 7f94c4d54640 1 -- 172.21.15.103:0/991820029 learned_addr learned my addr 172.21.15.103:0/991820029 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:40.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.170+0000 7f94bffff640 1 --2- 172.21.15.103:0/991820029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94c00684f0 0x7f94c014d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.170+0000 7f94bf7fe640 1 --2- 172.21.15.103:0/991820029 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94c00c6960 0x7f94c0152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.170+0000 7f94c4d54640 1 -- 172.21.15.103:0/991820029 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94c00c6960 msgr2=0x7f94c0152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.170+0000 7f94c4d54640 1 --2- 172.21.15.103:0/991820029 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94c00c6960 0x7f94c0152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.170+0000 7f94c4d54640 1 -- 172.21.15.103:0/991820029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94c00684f0 msgr2=0x7f94c014d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.170+0000 7f94c4d54640 1 --2- 172.21.15.103:0/991820029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94c00684f0 0x7f94c014d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.170+0000 7f94c4d54640 1 -- 172.21.15.103:0/991820029 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c014bab0 con 0x7f94c0156290 2024-09-10T08:44:40.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.170+0000 7f94c4d54640 1 --2- 172.21.15.103:0/991820029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94c0156290 0x7f94c014acb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f94b802abc0 tx=0x7f94b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:40.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.171+0000 7f94bcff9640 1 -- 172.21.15.103:0/991820029 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b803f070 con 0x7f94c0156290 2024-09-10T08:44:40.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.171+0000 7f94bcff9640 1 -- 172.21.15.103:0/991820029 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b803b820 con 0x7f94c0156290 2024-09-10T08:44:40.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.171+0000 7f94c67b7640 1 -- 172.21.15.103:0/991820029 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94c014eef0 con 0x7f94c0156290 2024-09-10T08:44:40.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.171+0000 7f94bcff9640 1 -- 172.21.15.103:0/991820029 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b803bbd0 con 0x7f94c0156290 2024-09-10T08:44:40.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.171+0000 7f94c67b7640 1 -- 172.21.15.103:0/991820029 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94c014f4b0 con 0x7f94c0156290 2024-09-10T08:44:40.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.171+0000 7f94c67b7640 1 -- 172.21.15.103:0/991820029 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f94c014d7f0 con 0x7f94c0156290 2024-09-10T08:44:40.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.172+0000 7f94bcff9640 1 -- 172.21.15.103:0/991820029 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f94b804d3f0 con 0x7f94c0156290 2024-09-10T08:44:40.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.172+0000 7f94bcff9640 1 --2- 172.21.15.103:0/991820029 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f94ac06be30 0x7f94ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.173+0000 7f94bcff9640 1 -- 172.21.15.103:0/991820029 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f94b80ac6a0 con 0x7f94c0156290 2024-09-10T08:44:40.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.173+0000 7f94bffff640 1 --2- 172.21.15.103:0/991820029 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f94ac06be30 0x7f94ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.173+0000 7f94bcff9640 1 --2- 172.21.15.103:0/991820029 >> [v2:172.21.15.154:6808/1808157069,v1:172.21.15.154:6809/1808157069] conn(0x7f94ac0767d0 0x7f94ac078c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.173+0000 7f94bcff9640 1 -- 172.21.15.103:0/991820029 --> [v2:172.21.15.154:6808/1808157069,v1:172.21.15.154:6809/1808157069] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f94ac079320 con 0x7f94ac0767d0 2024-09-10T08:44:40.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.173+0000 7f94bcff9640 1 -- 172.21.15.103:0/991820029 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f94b80b3050 con 0x7f94c0156290 2024-09-10T08:44:40.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.173+0000 7f94bf7fe640 1 --2- 172.21.15.103:0/991820029 >> [v2:172.21.15.154:6808/1808157069,v1:172.21.15.154:6809/1808157069] conn(0x7f94ac0767d0 0x7f94ac078c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.173+0000 7f94bffff640 1 --2- 172.21.15.103:0/991820029 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f94ac06be30 0x7f94ac06e2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f94b0007fd0 tx=0x7f94b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:40.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.173+0000 7f94bf7fe640 1 --2- 172.21.15.103:0/991820029 >> [v2:172.21.15.154:6808/1808157069,v1:172.21.15.154:6809/1808157069] conn(0x7f94ac0767d0 0x7f94ac078c50 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:40.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.174+0000 7f94bcff9640 1 -- 172.21.15.103:0/991820029 <== osd.4 v2:172.21.15.154:6808/1808157069 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f94ac079320 con 0x7f94ac0767d0 2024-09-10T08:44:40.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.186+0000 7f94c67b7640 1 -- 172.21.15.103:0/991820029 --> [v2:172.21.15.154:6808/1808157069,v1:172.21.15.154:6809/1808157069] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f94c0154100 con 0x7f94ac0767d0 2024-09-10T08:44:40.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.187+0000 7f94bcff9640 1 -- 172.21.15.103:0/991820029 <== osd.4 v2:172.21.15.154:6808/1808157069 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f94c0154100 con 0x7f94ac0767d0 2024-09-10T08:44:40.187 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:44:40.187 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:44:40.187 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:44:40.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.187+0000 7f94c67b7640 1 -- 172.21.15.103:0/991820029 >> [v2:172.21.15.154:6808/1808157069,v1:172.21.15.154:6809/1808157069] conn(0x7f94ac0767d0 msgr2=0x7f94ac078c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.187+0000 7f94c67b7640 1 --2- 172.21.15.103:0/991820029 >> [v2:172.21.15.154:6808/1808157069,v1:172.21.15.154:6809/1808157069] conn(0x7f94ac0767d0 0x7f94ac078c50 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.187+0000 7f94c67b7640 1 -- 172.21.15.103:0/991820029 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f94ac06be30 msgr2=0x7f94ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.187+0000 7f94c67b7640 1 --2- 172.21.15.103:0/991820029 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f94ac06be30 0x7f94ac06e2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f94b0007fd0 tx=0x7f94b0009040 comp rx=0 tx=0).stop 2024-09-10T08:44:40.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.187+0000 7f94c67b7640 1 -- 172.21.15.103:0/991820029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94c0156290 msgr2=0x7f94c014acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.187+0000 7f94c67b7640 1 --2- 172.21.15.103:0/991820029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94c0156290 0x7f94c014acb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f94b802abc0 tx=0x7f94b8004a40 comp rx=0 tx=0).stop 2024-09-10T08:44:40.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.187+0000 7f94c4d54640 1 -- 172.21.15.103:0/991820029 reap_dead start 2024-09-10T08:44:40.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.188+0000 7f94c67b7640 1 -- 172.21.15.103:0/991820029 shutdown_connections 2024-09-10T08:44:40.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.188+0000 7f94c67b7640 1 -- 172.21.15.103:0/991820029 >> 172.21.15.103:0/991820029 conn(0x7f94c00c87f0 msgr2=0x7f94c00cac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:40.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.188+0000 7f94c67b7640 1 -- 172.21.15.103:0/991820029 shutdown_connections 2024-09-10T08:44:40.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.188+0000 7f94c67b7640 1 -- 172.21.15.103:0/991820029 wait complete. 2024-09-10T08:44:40.198 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-10T08:44:40.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.298+0000 7f43c4845640 1 Processor -- start 2024-09-10T08:44:40.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.298+0000 7f43c4845640 1 -- start start 2024-09-10T08:44:40.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.299+0000 7f43c4845640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f43c0072ec0 0x7f43c0153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.299+0000 7f43c4845640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43c00afc60 0x7f43c0151380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.299+0000 7f43c4845640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43c006efa0 con 0x7f43c00c4ac0 2024-09-10T08:44:40.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.299+0000 7f43c4845640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f43c006f280 con 0x7f43c0072ec0 2024-09-10T08:44:40.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.299+0000 7f43c4845640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f43c006f560 con 0x7f43c00afc60 2024-09-10T08:44:40.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.299+0000 7f43be59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f43c0072ec0 0x7f43c0153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.299+0000 7f43bed9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43c00afc60 0x7f43c0151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.299+0000 7f43bed9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43c00afc60 0x7f43c0151380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:48998/0 (socket says 172.21.15.103:48998) 2024-09-10T08:44:40.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.299+0000 7f43be59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f43c0072ec0 0x7f43c0153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:47608/0 (socket says 172.21.15.103:47608) 2024-09-10T08:44:40.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.299+0000 7f43bed9d640 1 -- 172.21.15.103:0/2204035977 learned_addr learned my addr 172.21.15.103:0/2204035977 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:40.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.299+0000 7f43bdd9b640 1 --1- 172.21.15.103:0/2204035977 >> v1:172.21.15.154:6789/0 conn(0x7f43c00c4ac0 0x7f43c0070040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:52062/0 (socket says 172.21.15.103:52062) 2024-09-10T08:44:40.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.300+0000 7f43be59c640 1 -- 172.21.15.103:0/2204035977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43c00afc60 msgr2=0x7f43c0151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:40.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.300+0000 7f43be59c640 1 --2- 172.21.15.103:0/2204035977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43c00afc60 0x7f43c0151380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.300+0000 7f43be59c640 1 -- 172.21.15.103:0/2204035977 >> v1:172.21.15.154:6789/0 conn(0x7f43c00c4ac0 legacy=0x7f43c0070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.300+0000 7f43be59c640 1 -- 172.21.15.103:0/2204035977 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c006f840 con 0x7f43c0072ec0 2024-09-10T08:44:40.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.300+0000 7f43bd59a640 1 -- 172.21.15.103:0/2204035977 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2168315350 0 0) 0x7f43c006efa0 con 0x7f43c00c4ac0 2024-09-10T08:44:40.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.300+0000 7f43bed9d640 1 --2- 172.21.15.103:0/2204035977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43c00afc60 0x7f43c0151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:44:40.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.300+0000 7f43be59c640 1 --2- 172.21.15.103:0/2204035977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43c0072ec0 0x7f43c0153ff0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f43b00097a0 tx=0x7f43b002a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=153310ecc26c82e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:40.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.301+0000 7f43bd59a640 1 -- 172.21.15.103:0/2204035977 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b0037070 con 0x7f43c0072ec0 2024-09-10T08:44:40.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.301+0000 7f43bd59a640 1 -- 172.21.15.103:0/2204035977 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43b002adb0 con 0x7f43c0072ec0 2024-09-10T08:44:40.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.301+0000 7f43bd59a640 1 -- 172.21.15.103:0/2204035977 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b0032660 con 0x7f43c0072ec0 2024-09-10T08:44:40.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.301+0000 7f43c4845640 1 -- 172.21.15.103:0/2204035977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43c0072ec0 msgr2=0x7f43c0153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.301+0000 7f43c4845640 1 --2- 172.21.15.103:0/2204035977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43c0072ec0 0x7f43c0153ff0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f43b00097a0 tx=0x7f43b002a060 comp rx=0 tx=0).stop 2024-09-10T08:44:40.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.301+0000 7f43c4845640 1 -- 172.21.15.103:0/2204035977 shutdown_connections 2024-09-10T08:44:40.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.301+0000 7f43c4845640 1 --2- 172.21.15.103:0/2204035977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43c00afc60 0x7f43c0151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.301+0000 7f43c4845640 1 --2- 172.21.15.103:0/2204035977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43c0072ec0 0x7f43c0153ff0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.301+0000 7f43c4845640 1 -- 172.21.15.103:0/2204035977 >> 172.21.15.103:0/2204035977 conn(0x7f43c00c9d80 msgr2=0x7f43c00ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:40.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.301+0000 7f43c4845640 1 -- 172.21.15.103:0/2204035977 shutdown_connections 2024-09-10T08:44:40.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.301+0000 7f43c4845640 1 -- 172.21.15.103:0/2204035977 wait complete. 2024-09-10T08:44:40.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.302+0000 7f43c4845640 1 Processor -- start 2024-09-10T08:44:40.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.302+0000 7f43c4845640 1 -- start start 2024-09-10T08:44:40.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.303+0000 7f43c4845640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c0072ec0 0x7f43c01e9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.303+0000 7f43c4845640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43c00afc60 0x7f43c01490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.303+0000 7f43c4845640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43c00c4ac0 0x7f43c01eda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.303+0000 7f43c4845640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f43c0070750 con 0x7f43c0072ec0 2024-09-10T08:44:40.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.303+0000 7f43c4845640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f43c00c47f0 con 0x7f43c00c4ac0 2024-09-10T08:44:40.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.303+0000 7f43c4845640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f43c00708d0 con 0x7f43c00afc60 2024-09-10T08:44:40.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.303+0000 7f43be59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c0072ec0 0x7f43c01e9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.303+0000 7f43be59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c0072ec0 0x7f43c01e9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60722/0 (socket says 172.21.15.103:60722) 2024-09-10T08:44:40.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.303+0000 7f43be59c640 1 -- 172.21.15.103:0/3364668231 learned_addr learned my addr 172.21.15.103:0/3364668231 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:40.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.303+0000 7f43bed9d640 1 --2- 172.21.15.103:0/3364668231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43c00c4ac0 0x7f43c01eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.303+0000 7f43bdd9b640 1 --2- 172.21.15.103:0/3364668231 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43c00afc60 0x7f43c01490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.304+0000 7f43be59c640 1 -- 172.21.15.103:0/3364668231 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43c00afc60 msgr2=0x7f43c01490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.304+0000 7f43be59c640 1 --2- 172.21.15.103:0/3364668231 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43c00afc60 0x7f43c01490d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.304+0000 7f43be59c640 1 -- 172.21.15.103:0/3364668231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43c00c4ac0 msgr2=0x7f43c01eda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.304+0000 7f43be59c640 1 --2- 172.21.15.103:0/3364668231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43c00c4ac0 0x7f43c01eda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.304+0000 7f43be59c640 1 -- 172.21.15.103:0/3364668231 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c01ea0d0 con 0x7f43c0072ec0 2024-09-10T08:44:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.304+0000 7f43be59c640 1 --2- 172.21.15.103:0/3364668231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c0072ec0 0x7f43c01e9b90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f43b0035040 tx=0x7f43b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.304+0000 7f43aeffd640 1 -- 172.21.15.103:0/3364668231 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b0041070 con 0x7f43c0072ec0 2024-09-10T08:44:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.304+0000 7f43aeffd640 1 -- 172.21.15.103:0/3364668231 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43b003c680 con 0x7f43c0072ec0 2024-09-10T08:44:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.304+0000 7f43aeffd640 1 -- 172.21.15.103:0/3364668231 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b0037040 con 0x7f43c0072ec0 2024-09-10T08:44:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.304+0000 7f43c4845640 1 -- 172.21.15.103:0/3364668231 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c014bed0 con 0x7f43c0072ec0 2024-09-10T08:44:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.304+0000 7f43c4845640 1 -- 172.21.15.103:0/3364668231 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c00af780 con 0x7f43c0072ec0 2024-09-10T08:44:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.305+0000 7f43c4845640 1 -- 172.21.15.103:0/3364668231 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43c01ed540 con 0x7f43c0072ec0 2024-09-10T08:44:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.305+0000 7f43aeffd640 1 -- 172.21.15.103:0/3364668231 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43b003a070 con 0x7f43c0072ec0 2024-09-10T08:44:40.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.306+0000 7f43aeffd640 1 --2- 172.21.15.103:0/3364668231 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f43a006be30 0x7f43a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.306+0000 7f43aeffd640 1 -- 172.21.15.103:0/3364668231 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f43b00ab3e0 con 0x7f43c0072ec0 2024-09-10T08:44:40.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.306+0000 7f43bdd9b640 1 --2- 172.21.15.103:0/3364668231 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f43a006be30 0x7f43a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.306+0000 7f43bdd9b640 1 --2- 172.21.15.103:0/3364668231 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f43a006be30 0x7f43a006e2f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f43c00c67d0 tx=0x7f43b4007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:40.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.310+0000 7f43aeffd640 1 -- 172.21.15.103:0/3364668231 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f43b0079430 con 0x7f43c0072ec0 2024-09-10T08:44:40.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.478+0000 7f43c4845640 1 -- 172.21.15.103:0/3364668231 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f43c00695d0 con 0x7f43a006be30 2024-09-10T08:44:40.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.478+0000 7f43aeffd640 1 -- 172.21.15.103:0/3364668231 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f43c00695d0 con 0x7f43a006be30 2024-09-10T08:44:40.478 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 4 to deep-scrub 2024-09-10T08:44:40.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.480+0000 7f43c4845640 1 -- 172.21.15.103:0/3364668231 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f43a006be30 msgr2=0x7f43a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.480+0000 7f43c4845640 1 --2- 172.21.15.103:0/3364668231 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f43a006be30 0x7f43a006e2f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f43c00c67d0 tx=0x7f43b4007de0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.480+0000 7f43c4845640 1 -- 172.21.15.103:0/3364668231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c0072ec0 msgr2=0x7f43c01e9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.480+0000 7f43c4845640 1 --2- 172.21.15.103:0/3364668231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c0072ec0 0x7f43c01e9b90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f43b0035040 tx=0x7f43b00046c0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.480+0000 7f43c4845640 1 -- 172.21.15.103:0/3364668231 shutdown_connections 2024-09-10T08:44:40.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.480+0000 7f43c4845640 1 --2- 172.21.15.103:0/3364668231 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f43a006be30 0x7f43a006e2f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.480+0000 7f43c4845640 1 --2- 172.21.15.103:0/3364668231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43c00c4ac0 0x7f43c01eda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.480+0000 7f43c4845640 1 --2- 172.21.15.103:0/3364668231 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f43c00afc60 0x7f43c01490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.480+0000 7f43c4845640 1 --2- 172.21.15.103:0/3364668231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c0072ec0 0x7f43c01e9b90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.480+0000 7f43c4845640 1 -- 172.21.15.103:0/3364668231 >> 172.21.15.103:0/3364668231 conn(0x7f43c00c9d80 msgr2=0x7f43c0149e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:40.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.480+0000 7f43c4845640 1 -- 172.21.15.103:0/3364668231 shutdown_connections 2024-09-10T08:44:40.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.480+0000 7f43c4845640 1 -- 172.21.15.103:0/3364668231 wait complete. 2024-09-10T08:44:40.491 INFO:tasks.ceph:Scrubbing osd.5 2024-09-10T08:44:40.491 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:44:40.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.594+0000 7f704bf9f640 1 Processor -- start 2024-09-10T08:44:40.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.594+0000 7f704bf9f640 1 -- start start 2024-09-10T08:44:40.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.595+0000 7f704bf9f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f704406fc40 0x7f7044070020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.595+0000 7f704bf9f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70440c8170 0x7f7044160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.595+0000 7f704bf9f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70440c4020 con 0x7f70440c6a10 2024-09-10T08:44:40.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.595+0000 7f704bf9f640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f704406e280 con 0x7f70440c8170 2024-09-10T08:44:40.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.595+0000 7f704bf9f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f70440c8670 con 0x7f704406fc40 2024-09-10T08:44:40.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.595+0000 7f704a53c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70440c8170 0x7f7044160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.595+0000 7f704a53c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70440c8170 0x7f7044160930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60736/0 (socket says 172.21.15.103:60736) 2024-09-10T08:44:40.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.595+0000 7f704a53c640 1 -- 172.21.15.103:0/1537597128 learned_addr learned my addr 172.21.15.103:0/1537597128 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:40.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.595+0000 7f704a53c640 1 -- 172.21.15.103:0/1537597128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f704406fc40 msgr2=0x7f7044070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:40.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.595+0000 7f704a53c640 1 --2- 172.21.15.103:0/1537597128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f704406fc40 0x7f7044070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.595+0000 7f704a53c640 1 -- 172.21.15.103:0/1537597128 >> v1:172.21.15.154:6789/0 conn(0x7f70440c6a10 legacy=0x7f704406bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:40.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.595+0000 7f704a53c640 1 -- 172.21.15.103:0/1537597128 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70440c74f0 con 0x7f70440c8170 2024-09-10T08:44:40.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.596+0000 7f704a53c640 1 --2- 172.21.15.103:0/1537597128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70440c8170 0x7f7044160930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f703c009e50 tx=0x7f703c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e72645c766d0b2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:40.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.596+0000 7f7048d39640 1 -- 172.21.15.103:0/1537597128 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703c036070 con 0x7f70440c8170 2024-09-10T08:44:40.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.596+0000 7f7048d39640 1 -- 172.21.15.103:0/1537597128 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f703c031600 con 0x7f70440c8170 2024-09-10T08:44:40.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.596+0000 7f7048d39640 1 -- 172.21.15.103:0/1537597128 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703c0319d0 con 0x7f70440c8170 2024-09-10T08:44:40.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.596+0000 7f704bf9f640 1 -- 172.21.15.103:0/1537597128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70440c8170 msgr2=0x7f7044160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.596+0000 7f704bf9f640 1 --2- 172.21.15.103:0/1537597128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70440c8170 0x7f7044160930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f703c009e50 tx=0x7f703c02a6c0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.597+0000 7f704bf9f640 1 -- 172.21.15.103:0/1537597128 shutdown_connections 2024-09-10T08:44:40.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.597+0000 7f704bf9f640 1 --2- 172.21.15.103:0/1537597128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70440c8170 0x7f7044160930 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.597+0000 7f704bf9f640 1 --2- 172.21.15.103:0/1537597128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f704406fc40 0x7f7044070020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.597+0000 7f704bf9f640 1 -- 172.21.15.103:0/1537597128 >> 172.21.15.103:0/1537597128 conn(0x7f70440c5580 msgr2=0x7f70440c5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:40.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.597+0000 7f704bf9f640 1 -- 172.21.15.103:0/1537597128 shutdown_connections 2024-09-10T08:44:40.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.597+0000 7f704bf9f640 1 -- 172.21.15.103:0/1537597128 wait complete. 2024-09-10T08:44:40.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.598+0000 7f704bf9f640 1 Processor -- start 2024-09-10T08:44:40.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.598+0000 7f704bf9f640 1 -- start start 2024-09-10T08:44:40.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.598+0000 7f704bf9f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f704406fc40 0x7f70441d9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.598+0000 7f704bf9f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70440c6a10 0x7f70440ad350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.598+0000 7f704bf9f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70440c8170 0x7f70441d85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.598+0000 7f704bf9f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f70440a84c0 con 0x7f704406fc40 2024-09-10T08:44:40.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.598+0000 7f704bf9f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70440c7ab0 con 0x7f70440c6a10 2024-09-10T08:44:40.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.598+0000 7f704bf9f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f70440ab640 con 0x7f70440c8170 2024-09-10T08:44:40.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.599+0000 7f7049d3b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f704406fc40 0x7f70441d9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.599+0000 7f7049d3b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f704406fc40 0x7f70441d9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60752/0 (socket says 172.21.15.103:60752) 2024-09-10T08:44:40.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.599+0000 7f7049d3b640 1 -- 172.21.15.103:0/89725698 learned_addr learned my addr 172.21.15.103:0/89725698 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:40.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.599+0000 7f704953a640 1 --2- 172.21.15.103:0/89725698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70440c6a10 0x7f70440ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.599+0000 7f704a53c640 1 --2- 172.21.15.103:0/89725698 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70440c8170 0x7f70441d85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.599+0000 7f7049d3b640 1 -- 172.21.15.103:0/89725698 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70440c8170 msgr2=0x7f70441d85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.599+0000 7f7049d3b640 1 --2- 172.21.15.103:0/89725698 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70440c8170 0x7f70441d85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.599+0000 7f7049d3b640 1 -- 172.21.15.103:0/89725698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70440c6a10 msgr2=0x7f70440ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.599+0000 7f7049d3b640 1 --2- 172.21.15.103:0/89725698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70440c6a10 0x7f70440ad350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.599+0000 7f7049d3b640 1 -- 172.21.15.103:0/89725698 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70441ef350 con 0x7f704406fc40 2024-09-10T08:44:40.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.599+0000 7f7049d3b640 1 --2- 172.21.15.103:0/89725698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f704406fc40 0x7f70441d9360 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f704000b4d0 tx=0x7f704000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:40.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.599+0000 7f703a7fc640 1 -- 172.21.15.103:0/89725698 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7040014070 con 0x7f704406fc40 2024-09-10T08:44:40.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.599+0000 7f703a7fc640 1 -- 172.21.15.103:0/89725698 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7040010870 con 0x7f704406fc40 2024-09-10T08:44:40.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.599+0000 7f704bf9f640 1 -- 172.21.15.103:0/89725698 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70441ef630 con 0x7f704406fc40 2024-09-10T08:44:40.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.599+0000 7f703a7fc640 1 -- 172.21.15.103:0/89725698 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7040010c60 con 0x7f704406fc40 2024-09-10T08:44:40.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.599+0000 7f704bf9f640 1 -- 172.21.15.103:0/89725698 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70441efbf0 con 0x7f704406fc40 2024-09-10T08:44:40.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.600+0000 7f704bf9f640 1 -- 172.21.15.103:0/89725698 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f704406e710 con 0x7f704406fc40 2024-09-10T08:44:40.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.601+0000 7f703a7fc640 1 -- 172.21.15.103:0/89725698 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7040017070 con 0x7f704406fc40 2024-09-10T08:44:40.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.601+0000 7f703a7fc640 1 --2- 172.21.15.103:0/89725698 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f702806be30 0x7f702806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.601+0000 7f703a7fc640 1 -- 172.21.15.103:0/89725698 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f704008af20 con 0x7f704406fc40 2024-09-10T08:44:40.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.601+0000 7f704953a640 1 --2- 172.21.15.103:0/89725698 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f702806be30 0x7f702806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.601+0000 7f703a7fc640 1 --2- 172.21.15.103:0/89725698 >> [v2:172.21.15.154:6816/1048015779,v1:172.21.15.154:6817/1048015779] conn(0x7f70280767c0 0x7f7028078c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.601+0000 7f703a7fc640 1 -- 172.21.15.103:0/89725698 --> [v2:172.21.15.154:6816/1048015779,v1:172.21.15.154:6817/1048015779] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f704001be50 con 0x7f70280767c0 2024-09-10T08:44:40.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.601+0000 7f703a7fc640 1 -- 172.21.15.103:0/89725698 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f704008d620 con 0x7f704406fc40 2024-09-10T08:44:40.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.602+0000 7f704a53c640 1 --2- 172.21.15.103:0/89725698 >> [v2:172.21.15.154:6816/1048015779,v1:172.21.15.154:6817/1048015779] conn(0x7f70280767c0 0x7f7028078c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.602+0000 7f704953a640 1 --2- 172.21.15.103:0/89725698 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f702806be30 0x7f702806e2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f70440746d0 tx=0x7f7034007e50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:40.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.602+0000 7f704a53c640 1 --2- 172.21.15.103:0/89725698 >> [v2:172.21.15.154:6816/1048015779,v1:172.21.15.154:6817/1048015779] conn(0x7f70280767c0 0x7f7028078c40 crc :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:40.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.603+0000 7f703a7fc640 1 -- 172.21.15.103:0/89725698 <== osd.5 v2:172.21.15.154:6816/1048015779 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f704001be50 con 0x7f70280767c0 2024-09-10T08:44:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.615+0000 7f704bf9f640 1 -- 172.21.15.103:0/89725698 --> [v2:172.21.15.154:6816/1048015779,v1:172.21.15.154:6817/1048015779] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f70440c6310 con 0x7f70280767c0 2024-09-10T08:44:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.615+0000 7f703a7fc640 1 -- 172.21.15.103:0/89725698 <== osd.5 v2:172.21.15.154:6816/1048015779 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f70440c6310 con 0x7f70280767c0 2024-09-10T08:44:40.615 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:44:40.615 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:44:40.616 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:44:40.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.616+0000 7f704bf9f640 1 -- 172.21.15.103:0/89725698 >> [v2:172.21.15.154:6816/1048015779,v1:172.21.15.154:6817/1048015779] conn(0x7f70280767c0 msgr2=0x7f7028078c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.616+0000 7f704bf9f640 1 --2- 172.21.15.103:0/89725698 >> [v2:172.21.15.154:6816/1048015779,v1:172.21.15.154:6817/1048015779] conn(0x7f70280767c0 0x7f7028078c40 crc :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.616+0000 7f704bf9f640 1 -- 172.21.15.103:0/89725698 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f702806be30 msgr2=0x7f702806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.616+0000 7f704bf9f640 1 --2- 172.21.15.103:0/89725698 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f702806be30 0x7f702806e2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f70440746d0 tx=0x7f7034007e50 comp rx=0 tx=0).stop 2024-09-10T08:44:40.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.616+0000 7f704bf9f640 1 -- 172.21.15.103:0/89725698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f704406fc40 msgr2=0x7f70441d9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.616+0000 7f704bf9f640 1 --2- 172.21.15.103:0/89725698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f704406fc40 0x7f70441d9360 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f704000b4d0 tx=0x7f704000b990 comp rx=0 tx=0).stop 2024-09-10T08:44:40.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.616+0000 7f704a53c640 1 -- 172.21.15.103:0/89725698 reap_dead start 2024-09-10T08:44:40.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.616+0000 7f704bf9f640 1 -- 172.21.15.103:0/89725698 shutdown_connections 2024-09-10T08:44:40.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.616+0000 7f704bf9f640 1 -- 172.21.15.103:0/89725698 >> 172.21.15.103:0/89725698 conn(0x7f70440c5580 msgr2=0x7f704406d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:40.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.616+0000 7f704bf9f640 1 -- 172.21.15.103:0/89725698 shutdown_connections 2024-09-10T08:44:40.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.616+0000 7f704bf9f640 1 -- 172.21.15.103:0/89725698 wait complete. 2024-09-10T08:44:40.626 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-10T08:44:40.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.724+0000 7f2e0dfaf640 1 Processor -- start 2024-09-10T08:44:40.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.724+0000 7f2e0dfaf640 1 -- start start 2024-09-10T08:44:40.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.725+0000 7f2e0dfaf640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e08150480 0x7f2e080c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.725+0000 7f2e0dfaf640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2e0806c650 0x7f2e080c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.725+0000 7f2e0dfaf640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e080c9c80 0x7f2e080ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.725+0000 7f2e0dfaf640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f2e0806c240 con 0x7f2e0806c650 2024-09-10T08:44:40.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.725+0000 7f2e0dfaf640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f2e0815a330 con 0x7f2e080c9c80 2024-09-10T08:44:40.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.725+0000 7f2e0dfaf640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2e0815a7c0 con 0x7f2e08150480 2024-09-10T08:44:40.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.725+0000 7f2e06ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2e0806c650 0x7f2e080c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.725+0000 7f2e06ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2e0806c650 0x7f2e080c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60764/0 (socket says 172.21.15.103:60764) 2024-09-10T08:44:40.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.725+0000 7f2e06ffd640 1 -- 172.21.15.103:0/392806791 learned_addr learned my addr 172.21.15.103:0/392806791 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:40.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.725+0000 7f2e077fe640 1 --2- 172.21.15.103:0/392806791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e08150480 0x7f2e080c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.725+0000 7f2e07fff640 1 --2- 172.21.15.103:0/392806791 >> v2:172.21.15.154:3300/0 conn(0x7f2e080c9c80 0x7f2e080ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.725+0000 7f2e06ffd640 1 -- 172.21.15.103:0/392806791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e08150480 msgr2=0x7f2e080c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:40.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.725+0000 7f2e06ffd640 1 --2- 172.21.15.103:0/392806791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e08150480 0x7f2e080c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.725+0000 7f2e06ffd640 1 -- 172.21.15.103:0/392806791 >> v2:172.21.15.154:3300/0 conn(0x7f2e080c9c80 msgr2=0x7f2e080ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:40.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.725+0000 7f2e06ffd640 1 --2- 172.21.15.103:0/392806791 >> v2:172.21.15.154:3300/0 conn(0x7f2e080c9c80 0x7f2e080ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.725+0000 7f2e06ffd640 1 -- 172.21.15.103:0/392806791 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e08159a00 con 0x7f2e0806c650 2024-09-10T08:44:40.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.726+0000 7f2e06ffd640 1 --2- 172.21.15.103:0/392806791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e0806c650 0x7f2e080c7fd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2e080c62d0 tx=0x7f2dfc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc01e155cf011b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:40.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.726+0000 7f2e067fc640 1 -- 172.21.15.103:0/392806791 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc037070 con 0x7f2e0806c650 2024-09-10T08:44:40.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.726+0000 7f2e067fc640 1 -- 172.21.15.103:0/392806791 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dfc032440 con 0x7f2e0806c650 2024-09-10T08:44:40.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.726+0000 7f2e067fc640 1 -- 172.21.15.103:0/392806791 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc032810 con 0x7f2e0806c650 2024-09-10T08:44:40.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.727+0000 7f2e0dfaf640 1 -- 172.21.15.103:0/392806791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e0806c650 msgr2=0x7f2e080c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.727+0000 7f2e0dfaf640 1 --2- 172.21.15.103:0/392806791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e0806c650 0x7f2e080c7fd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2e080c62d0 tx=0x7f2dfc02a1e0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.727+0000 7f2e0dfaf640 1 -- 172.21.15.103:0/392806791 shutdown_connections 2024-09-10T08:44:40.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.727+0000 7f2e0dfaf640 1 --2- 172.21.15.103:0/392806791 >> v2:172.21.15.154:3300/0 conn(0x7f2e080c9c80 0x7f2e080ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.727+0000 7f2e0dfaf640 1 --2- 172.21.15.103:0/392806791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e0806c650 0x7f2e080c7fd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.727+0000 7f2e0dfaf640 1 --2- 172.21.15.103:0/392806791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e08150480 0x7f2e080c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.727+0000 7f2e0dfaf640 1 -- 172.21.15.103:0/392806791 >> 172.21.15.103:0/392806791 conn(0x7f2e08068030 msgr2=0x7f2e08073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:40.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.727+0000 7f2e0dfaf640 1 -- 172.21.15.103:0/392806791 shutdown_connections 2024-09-10T08:44:40.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.727+0000 7f2e0dfaf640 1 -- 172.21.15.103:0/392806791 wait complete. 2024-09-10T08:44:40.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.728+0000 7f2e0dfaf640 1 Processor -- start 2024-09-10T08:44:40.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.728+0000 7f2e0dfaf640 1 -- start start 2024-09-10T08:44:40.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.729+0000 7f2e0dfaf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e0806c650 0x7f2e081508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.729+0000 7f2e0dfaf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e080c9c80 0x7f2e08152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.729+0000 7f2e0dfaf640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e08150480 0x7f2e081ec380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.729+0000 7f2e0dfaf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2e080ca670 con 0x7f2e0806c650 2024-09-10T08:44:40.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.729+0000 7f2e0dfaf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2e08159fc0 con 0x7f2e080c9c80 2024-09-10T08:44:40.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.729+0000 7f2e0dfaf640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2e0806d270 con 0x7f2e08150480 2024-09-10T08:44:40.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.729+0000 7f2e077fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e0806c650 0x7f2e081508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.729+0000 7f2e077fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e0806c650 0x7f2e081508f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60766/0 (socket says 172.21.15.103:60766) 2024-09-10T08:44:40.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.729+0000 7f2e077fe640 1 -- 172.21.15.103:0/682682597 learned_addr learned my addr 172.21.15.103:0/682682597 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:40.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.729+0000 7f2e06ffd640 1 --2- 172.21.15.103:0/682682597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e080c9c80 0x7f2e08152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.729+0000 7f2e07fff640 1 --2- 172.21.15.103:0/682682597 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e08150480 0x7f2e081ec380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.729+0000 7f2e077fe640 1 -- 172.21.15.103:0/682682597 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e08150480 msgr2=0x7f2e081ec380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.729+0000 7f2e077fe640 1 --2- 172.21.15.103:0/682682597 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e08150480 0x7f2e081ec380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.729+0000 7f2e077fe640 1 -- 172.21.15.103:0/682682597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e080c9c80 msgr2=0x7f2e08152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.729+0000 7f2e077fe640 1 --2- 172.21.15.103:0/682682597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e080c9c80 0x7f2e08152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.729+0000 7f2e077fe640 1 -- 172.21.15.103:0/682682597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e08151710 con 0x7f2e0806c650 2024-09-10T08:44:40.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.729+0000 7f2e077fe640 1 --2- 172.21.15.103:0/682682597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e0806c650 0x7f2e081508f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2df800d800 tx=0x7f2df800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:40.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.729+0000 7f2deffff640 1 -- 172.21.15.103:0/682682597 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df800b660 con 0x7f2e0806c650 2024-09-10T08:44:40.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.729+0000 7f2deffff640 1 -- 172.21.15.103:0/682682597 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df8019070 con 0x7f2e0806c650 2024-09-10T08:44:40.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.729+0000 7f2e0dfaf640 1 -- 172.21.15.103:0/682682597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e081537f0 con 0x7f2e0806c650 2024-09-10T08:44:40.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.729+0000 7f2deffff640 1 -- 172.21.15.103:0/682682597 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df800ba20 con 0x7f2e0806c650 2024-09-10T08:44:40.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.730+0000 7f2e0dfaf640 1 -- 172.21.15.103:0/682682597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e08152750 con 0x7f2e0806c650 2024-09-10T08:44:40.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.731+0000 7f2e0dfaf640 1 -- 172.21.15.103:0/682682597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e081e0b00 con 0x7f2e0806c650 2024-09-10T08:44:40.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.731+0000 7f2deffff640 1 -- 172.21.15.103:0/682682597 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2df800bbc0 con 0x7f2e0806c650 2024-09-10T08:44:40.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.731+0000 7f2deffff640 1 --2- 172.21.15.103:0/682682597 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2df406be60 0x7f2df406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:40.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.732+0000 7f2deffff640 1 -- 172.21.15.103:0/682682597 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f2df808b450 con 0x7f2e0806c650 2024-09-10T08:44:40.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.732+0000 7f2e06ffd640 1 --2- 172.21.15.103:0/682682597 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2df406be60 0x7f2df406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:40.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.732+0000 7f2e06ffd640 1 --2- 172.21.15.103:0/682682597 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2df406be60 0x7f2df406e320 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc034000 tx=0x7f2dfc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:40.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.736+0000 7f2deffff640 1 -- 172.21.15.103:0/682682597 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2df80594a0 con 0x7f2e0806c650 2024-09-10T08:44:40.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.905+0000 7f2e0dfaf640 1 -- 172.21.15.103:0/682682597 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f2e08156270 con 0x7f2df406be60 2024-09-10T08:44:40.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.905+0000 7f2deffff640 1 -- 172.21.15.103:0/682682597 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2e08156270 con 0x7f2df406be60 2024-09-10T08:44:40.905 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 5 to deep-scrub 2024-09-10T08:44:40.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.908+0000 7f2e0dfaf640 1 -- 172.21.15.103:0/682682597 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2df406be60 msgr2=0x7f2df406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.908+0000 7f2e0dfaf640 1 --2- 172.21.15.103:0/682682597 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2df406be60 0x7f2df406e320 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc034000 tx=0x7f2dfc02e000 comp rx=0 tx=0).stop 2024-09-10T08:44:40.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.908+0000 7f2e0dfaf640 1 -- 172.21.15.103:0/682682597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e0806c650 msgr2=0x7f2e081508f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:40.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.908+0000 7f2e0dfaf640 1 --2- 172.21.15.103:0/682682597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e0806c650 0x7f2e081508f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2df800d800 tx=0x7f2df800dcc0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.908+0000 7f2e0dfaf640 1 -- 172.21.15.103:0/682682597 shutdown_connections 2024-09-10T08:44:40.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.908+0000 7f2e0dfaf640 1 --2- 172.21.15.103:0/682682597 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2df406be60 0x7f2df406e320 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.908+0000 7f2e0dfaf640 1 --2- 172.21.15.103:0/682682597 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e08150480 0x7f2e081ec380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.908+0000 7f2e0dfaf640 1 --2- 172.21.15.103:0/682682597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e080c9c80 0x7f2e08152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.908+0000 7f2e0dfaf640 1 --2- 172.21.15.103:0/682682597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e0806c650 0x7f2e081508f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:40.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.908+0000 7f2e0dfaf640 1 -- 172.21.15.103:0/682682597 >> 172.21.15.103:0/682682597 conn(0x7f2e08068030 msgr2=0x7f2e080cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:40.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.908+0000 7f2e0dfaf640 1 -- 172.21.15.103:0/682682597 shutdown_connections 2024-09-10T08:44:40.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:40.908+0000 7f2e0dfaf640 1 -- 172.21.15.103:0/682682597 wait complete. 2024-09-10T08:44:40.919 INFO:tasks.ceph:Scrubbing osd.6 2024-09-10T08:44:40.919 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:44:41.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.021+0000 7f8df7bcd640 1 Processor -- start 2024-09-10T08:44:41.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.021+0000 7f8df7bcd640 1 -- start start 2024-09-10T08:44:41.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.022+0000 7f8df7bcd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8df00731e0 0x7f8df00c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.022+0000 7f8df7bcd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8df0073be0 0x7f8df015a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.022+0000 7f8df7bcd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8df015a570 0x7f8df00c5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.022+0000 7f8df7bcd640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f8df00c8430 con 0x7f8df0073be0 2024-09-10T08:44:41.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.022+0000 7f8df7bcd640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8df00c80d0 con 0x7f8df015a570 2024-09-10T08:44:41.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.022+0000 7f8df7bcd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8df00c8680 con 0x7f8df00731e0 2024-09-10T08:44:41.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.022+0000 7f8df5168640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8df0073be0 0x7f8df015a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.022+0000 7f8df5168640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8df0073be0 0x7f8df015a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60770/0 (socket says 172.21.15.103:60770) 2024-09-10T08:44:41.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.022+0000 7f8df5168640 1 -- 172.21.15.103:0/3236581638 learned_addr learned my addr 172.21.15.103:0/3236581638 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:41.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.022+0000 7f8df5969640 1 --2- 172.21.15.103:0/3236581638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8df00731e0 0x7f8df00c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.022+0000 7f8df616a640 1 --2- 172.21.15.103:0/3236581638 >> v2:172.21.15.154:3300/0 conn(0x7f8df015a570 0x7f8df00c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.023+0000 7f8df5168640 1 -- 172.21.15.103:0/3236581638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8df00731e0 msgr2=0x7f8df00c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:41.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.023+0000 7f8df5168640 1 --2- 172.21.15.103:0/3236581638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8df00731e0 0x7f8df00c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.023+0000 7f8df5168640 1 -- 172.21.15.103:0/3236581638 >> v2:172.21.15.154:3300/0 conn(0x7f8df015a570 msgr2=0x7f8df00c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:41.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.023+0000 7f8df5168640 1 --2- 172.21.15.103:0/3236581638 >> v2:172.21.15.154:3300/0 conn(0x7f8df015a570 0x7f8df00c5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.023+0000 7f8df5168640 1 -- 172.21.15.103:0/3236581638 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df00c8960 con 0x7f8df0073be0 2024-09-10T08:44:41.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.023+0000 7f8df5168640 1 --2- 172.21.15.103:0/3236581638 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8df0073be0 0x7f8df015a030 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8df00761c0 tx=0x7f8de002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2278451c82223665 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:41.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.023+0000 7f8df4967640 1 -- 172.21.15.103:0/3236581638 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0037070 con 0x7f8df0073be0 2024-09-10T08:44:41.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.023+0000 7f8df4967640 1 -- 172.21.15.103:0/3236581638 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8de0032440 con 0x7f8df0073be0 2024-09-10T08:44:41.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.023+0000 7f8df4967640 1 -- 172.21.15.103:0/3236581638 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0032810 con 0x7f8df0073be0 2024-09-10T08:44:41.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.024+0000 7f8df7bcd640 1 -- 172.21.15.103:0/3236581638 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8df0073be0 msgr2=0x7f8df015a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.024+0000 7f8df7bcd640 1 --2- 172.21.15.103:0/3236581638 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8df0073be0 0x7f8df015a030 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8df00761c0 tx=0x7f8de002a140 comp rx=0 tx=0).stop 2024-09-10T08:44:41.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.024+0000 7f8df7bcd640 1 -- 172.21.15.103:0/3236581638 shutdown_connections 2024-09-10T08:44:41.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.024+0000 7f8df7bcd640 1 --2- 172.21.15.103:0/3236581638 >> v2:172.21.15.154:3300/0 conn(0x7f8df015a570 0x7f8df00c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.024+0000 7f8df7bcd640 1 --2- 172.21.15.103:0/3236581638 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8df0073be0 0x7f8df015a030 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.024+0000 7f8df7bcd640 1 --2- 172.21.15.103:0/3236581638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8df00731e0 0x7f8df00c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.024+0000 7f8df7bcd640 1 -- 172.21.15.103:0/3236581638 >> 172.21.15.103:0/3236581638 conn(0x7f8df00c9c00 msgr2=0x7f8df00ca010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:41.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.024+0000 7f8df7bcd640 1 -- 172.21.15.103:0/3236581638 shutdown_connections 2024-09-10T08:44:41.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.024+0000 7f8df7bcd640 1 -- 172.21.15.103:0/3236581638 wait complete. 2024-09-10T08:44:41.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.025+0000 7f8df7bcd640 1 Processor -- start 2024-09-10T08:44:41.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.025+0000 7f8df7bcd640 1 -- start start 2024-09-10T08:44:41.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.026+0000 7f8df7bcd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8df00731e0 0x7f8df00add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.026+0000 7f8df7bcd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8df0073be0 0x7f8df00a96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.026+0000 7f8df7bcd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8df015a570 0x7f8df00a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.026+0000 7f8df7bcd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8df00735c0 con 0x7f8df015a570 2024-09-10T08:44:41.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.026+0000 7f8df7bcd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8df00c8f20 con 0x7f8df0073be0 2024-09-10T08:44:41.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.026+0000 7f8df7bcd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8df0073740 con 0x7f8df00731e0 2024-09-10T08:44:41.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.026+0000 7f8df616a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8df015a570 0x7f8df00a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.026+0000 7f8df616a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8df015a570 0x7f8df00a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60772/0 (socket says 172.21.15.103:60772) 2024-09-10T08:44:41.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.026+0000 7f8df616a640 1 -- 172.21.15.103:0/2270832037 learned_addr learned my addr 172.21.15.103:0/2270832037 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:41.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.026+0000 7f8df5168640 1 --2- 172.21.15.103:0/2270832037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8df0073be0 0x7f8df00a96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.026+0000 7f8df5969640 1 --2- 172.21.15.103:0/2270832037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8df00731e0 0x7f8df00add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.026+0000 7f8df616a640 1 -- 172.21.15.103:0/2270832037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8df00731e0 msgr2=0x7f8df00add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.026+0000 7f8df616a640 1 --2- 172.21.15.103:0/2270832037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8df00731e0 0x7f8df00add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.026+0000 7f8df616a640 1 -- 172.21.15.103:0/2270832037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8df0073be0 msgr2=0x7f8df00a96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.026+0000 7f8df616a640 1 --2- 172.21.15.103:0/2270832037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8df0073be0 0x7f8df00a96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.026+0000 7f8df616a640 1 -- 172.21.15.103:0/2270832037 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df006d2e0 con 0x7f8df015a570 2024-09-10T08:44:41.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.026+0000 7f8df616a640 1 --2- 172.21.15.103:0/2270832037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8df015a570 0x7f8df00a9c30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8de800d800 tx=0x7f8de800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:41.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.027+0000 7f8de67fc640 1 -- 172.21.15.103:0/2270832037 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de800b6c0 con 0x7f8df015a570 2024-09-10T08:44:41.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.027+0000 7f8de67fc640 1 -- 172.21.15.103:0/2270832037 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8de8019070 con 0x7f8df015a570 2024-09-10T08:44:41.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.027+0000 7f8df7bcd640 1 -- 172.21.15.103:0/2270832037 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8df01ebbf0 con 0x7f8df015a570 2024-09-10T08:44:41.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.027+0000 7f8de67fc640 1 -- 172.21.15.103:0/2270832037 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de800bac0 con 0x7f8df015a570 2024-09-10T08:44:41.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.027+0000 7f8df7bcd640 1 -- 172.21.15.103:0/2270832037 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8df01ec1b0 con 0x7f8df015a570 2024-09-10T08:44:41.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.027+0000 7f8df7bcd640 1 -- 172.21.15.103:0/2270832037 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8df00a8d80 con 0x7f8df015a570 2024-09-10T08:44:41.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.028+0000 7f8de67fc640 1 -- 172.21.15.103:0/2270832037 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8de800bc60 con 0x7f8df015a570 2024-09-10T08:44:41.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.029+0000 7f8de67fc640 1 --2- 172.21.15.103:0/2270832037 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8dd406be30 0x7f8dd406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.029+0000 7f8de67fc640 1 -- 172.21.15.103:0/2270832037 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f8de808c050 con 0x7f8df015a570 2024-09-10T08:44:41.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.029+0000 7f8df5969640 1 --2- 172.21.15.103:0/2270832037 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8dd406be30 0x7f8dd406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.029+0000 7f8de67fc640 1 --2- 172.21.15.103:0/2270832037 >> [v2:172.21.15.154:6800/345273812,v1:172.21.15.154:6801/345273812] conn(0x7f8dd40767d0 0x7f8dd4078c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.029+0000 7f8de67fc640 1 -- 172.21.15.103:0/2270832037 --> [v2:172.21.15.154:6800/345273812,v1:172.21.15.154:6801/345273812] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8dd4079320 con 0x7f8dd40767d0 2024-09-10T08:44:41.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.029+0000 7f8de67fc640 1 -- 172.21.15.103:0/2270832037 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8de808c4e0 con 0x7f8df015a570 2024-09-10T08:44:41.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.029+0000 7f8df5168640 1 --2- 172.21.15.103:0/2270832037 >> [v2:172.21.15.154:6800/345273812,v1:172.21.15.154:6801/345273812] conn(0x7f8dd40767d0 0x7f8dd4078c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.029+0000 7f8df5969640 1 --2- 172.21.15.103:0/2270832037 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8dd406be30 0x7f8dd406e2f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8df0159ce0 tx=0x7f8dec0039b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:41.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.030+0000 7f8df5168640 1 --2- 172.21.15.103:0/2270832037 >> [v2:172.21.15.154:6800/345273812,v1:172.21.15.154:6801/345273812] conn(0x7f8dd40767d0 0x7f8dd4078c50 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:41.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.030+0000 7f8de67fc640 1 -- 172.21.15.103:0/2270832037 <== osd.6 v2:172.21.15.154:6800/345273812 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8dd4079320 con 0x7f8dd40767d0 2024-09-10T08:44:41.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.043+0000 7f8df7bcd640 1 -- 172.21.15.103:0/2270832037 --> [v2:172.21.15.154:6800/345273812,v1:172.21.15.154:6801/345273812] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8df01eb9e0 con 0x7f8dd40767d0 2024-09-10T08:44:41.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.043+0000 7f8de67fc640 1 -- 172.21.15.103:0/2270832037 <== osd.6 v2:172.21.15.154:6800/345273812 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8df01eb9e0 con 0x7f8dd40767d0 2024-09-10T08:44:41.044 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:44:41.044 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:44:41.044 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:44:41.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.043+0000 7f8df7bcd640 1 -- 172.21.15.103:0/2270832037 >> [v2:172.21.15.154:6800/345273812,v1:172.21.15.154:6801/345273812] conn(0x7f8dd40767d0 msgr2=0x7f8dd4078c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.043+0000 7f8df7bcd640 1 --2- 172.21.15.103:0/2270832037 >> [v2:172.21.15.154:6800/345273812,v1:172.21.15.154:6801/345273812] conn(0x7f8dd40767d0 0x7f8dd4078c50 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.043+0000 7f8df7bcd640 1 -- 172.21.15.103:0/2270832037 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8dd406be30 msgr2=0x7f8dd406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.043+0000 7f8df7bcd640 1 --2- 172.21.15.103:0/2270832037 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8dd406be30 0x7f8dd406e2f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8df0159ce0 tx=0x7f8dec0039b0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.043+0000 7f8df7bcd640 1 -- 172.21.15.103:0/2270832037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8df015a570 msgr2=0x7f8df00a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.043+0000 7f8df7bcd640 1 --2- 172.21.15.103:0/2270832037 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8df015a570 0x7f8df00a9c30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8de800d800 tx=0x7f8de800dcc0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.043+0000 7f8df616a640 1 -- 172.21.15.103:0/2270832037 reap_dead start 2024-09-10T08:44:41.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.043+0000 7f8df7bcd640 1 -- 172.21.15.103:0/2270832037 shutdown_connections 2024-09-10T08:44:41.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.043+0000 7f8df7bcd640 1 -- 172.21.15.103:0/2270832037 >> 172.21.15.103:0/2270832037 conn(0x7f8df00c9c00 msgr2=0x7f8df0154e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:41.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.044+0000 7f8df7bcd640 1 -- 172.21.15.103:0/2270832037 shutdown_connections 2024-09-10T08:44:41.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.044+0000 7f8df7bcd640 1 -- 172.21.15.103:0/2270832037 wait complete. 2024-09-10T08:44:41.054 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-10T08:44:41.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.157+0000 7f0f59928640 1 Processor -- start 2024-09-10T08:44:41.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.157+0000 7f0f59928640 1 -- start start 2024-09-10T08:44:41.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.158+0000 7f0f59928640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0f54156f50 0x7f0f54161ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.158+0000 7f0f59928640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f5406dd50 con 0x7f0f540733d0 2024-09-10T08:44:41.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.158+0000 7f0f59928640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f5406e030 con 0x7f0f54073ae0 2024-09-10T08:44:41.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.158+0000 7f0f59928640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f0f5406e310 con 0x7f0f54156f50 2024-09-10T08:44:41.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.158+0000 7f0f537fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0f54156f50 0x7f0f54161ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.158+0000 7f0f4a7fc640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0f540733d0 0x7f0f54156840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40932/0 (socket says 172.21.15.103:40932) 2024-09-10T08:44:41.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.158+0000 7f0f4a7fc640 1 -- 172.21.15.103:0/1502725098 learned_addr learned my addr 172.21.15.103:0/1502725098 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:44:41.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.158+0000 7f0f537fe640 1 -- 172.21.15.103:0/1502725098 >> v1:172.21.15.154:6789/0 conn(0x7f0f54073ae0 legacy=0x7f0f54153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:41.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.158+0000 7f0f537fe640 1 -- 172.21.15.103:0/1502725098 >> v1:172.21.15.103:6789/0 conn(0x7f0f540733d0 legacy=0x7f0f54156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.158+0000 7f0f537fe640 1 -- 172.21.15.103:0/1502725098 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5406e5f0 con 0x7f0f54156f50 2024-09-10T08:44:41.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.158+0000 7f0f527fc640 1 -- 172.21.15.103:0/1502725098 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 824011149 0 0) 0x7f0f5406dd50 con 0x7f0f540733d0 2024-09-10T08:44:41.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.159+0000 7f0f537fe640 1 --2- 172.21.15.103:0/1502725098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f54156f50 0x7f0f54161ba0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009d90 tx=0x7f0f4c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c913f68556eeb030 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:41.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.159+0000 7f0f527fc640 1 -- 172.21.15.103:0/1502725098 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c007740 con 0x7f0f54156f50 2024-09-10T08:44:41.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.159+0000 7f0f527fc640 1 -- 172.21.15.103:0/1502725098 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4c0078e0 con 0x7f0f54156f50 2024-09-10T08:44:41.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.159+0000 7f0f527fc640 1 -- 172.21.15.103:0/1502725098 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c007cb0 con 0x7f0f54156f50 2024-09-10T08:44:41.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.160+0000 7f0f59928640 1 -- 172.21.15.103:0/1502725098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f54156f50 msgr2=0x7f0f54161ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.160+0000 7f0f59928640 1 --2- 172.21.15.103:0/1502725098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f54156f50 0x7f0f54161ba0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009d90 tx=0x7f0f4c02a6f0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.160+0000 7f0f59928640 1 -- 172.21.15.103:0/1502725098 shutdown_connections 2024-09-10T08:44:41.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.160+0000 7f0f59928640 1 --2- 172.21.15.103:0/1502725098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f54156f50 0x7f0f54161ba0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.160+0000 7f0f59928640 1 -- 172.21.15.103:0/1502725098 >> 172.21.15.103:0/1502725098 conn(0x7f0f540c9d80 msgr2=0x7f0f540ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:41.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.160+0000 7f0f59928640 1 -- 172.21.15.103:0/1502725098 shutdown_connections 2024-09-10T08:44:41.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.160+0000 7f0f59928640 1 -- 172.21.15.103:0/1502725098 wait complete. 2024-09-10T08:44:41.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.161+0000 7f0f59928640 1 Processor -- start 2024-09-10T08:44:41.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.161+0000 7f0f59928640 1 -- start start 2024-09-10T08:44:41.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.162+0000 7f0f59928640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f540733d0 0x7f0f541ef820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.162+0000 7f0f59928640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f54073ae0 0x7f0f54152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.162+0000 7f0f59928640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f54156f50 0x7f0f54145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.162+0000 7f0f59928640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5406edd0 con 0x7f0f540733d0 2024-09-10T08:44:41.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.162+0000 7f0f59928640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5406ec50 con 0x7f0f54073ae0 2024-09-10T08:44:41.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.162+0000 7f0f59928640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f0f54153a90 con 0x7f0f54156f50 2024-09-10T08:44:41.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.162+0000 7f0f52ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f540733d0 0x7f0f541ef820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.162+0000 7f0f52ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f540733d0 0x7f0f541ef820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60796/0 (socket says 172.21.15.103:60796) 2024-09-10T08:44:41.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.162+0000 7f0f52ffd640 1 -- 172.21.15.103:0/620192548 learned_addr learned my addr 172.21.15.103:0/620192548 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:41.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.162+0000 7f0f4a7fc640 1 --2- 172.21.15.103:0/620192548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f54073ae0 0x7f0f54152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.162+0000 7f0f537fe640 1 --2- 172.21.15.103:0/620192548 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f54156f50 0x7f0f54145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.162+0000 7f0f52ffd640 1 -- 172.21.15.103:0/620192548 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f54156f50 msgr2=0x7f0f54145470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.162+0000 7f0f52ffd640 1 --2- 172.21.15.103:0/620192548 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f54156f50 0x7f0f54145470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.162+0000 7f0f52ffd640 1 -- 172.21.15.103:0/620192548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f54073ae0 msgr2=0x7f0f54152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.162+0000 7f0f52ffd640 1 --2- 172.21.15.103:0/620192548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f54073ae0 0x7f0f54152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.162+0000 7f0f52ffd640 1 -- 172.21.15.103:0/620192548 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f541efd60 con 0x7f0f540733d0 2024-09-10T08:44:41.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.162+0000 7f0f52ffd640 1 --2- 172.21.15.103:0/620192548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f540733d0 0x7f0f541ef820 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400c450 tx=0x7f0f4400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:41.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.163+0000 7f0f50ff9640 1 -- 172.21.15.103:0/620192548 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f440052d0 con 0x7f0f540733d0 2024-09-10T08:44:41.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.163+0000 7f0f50ff9640 1 -- 172.21.15.103:0/620192548 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f44005470 con 0x7f0f540733d0 2024-09-10T08:44:41.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.163+0000 7f0f59928640 1 -- 172.21.15.103:0/620192548 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5414da10 con 0x7f0f540733d0 2024-09-10T08:44:41.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.163+0000 7f0f50ff9640 1 -- 172.21.15.103:0/620192548 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44012870 con 0x7f0f540733d0 2024-09-10T08:44:41.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.163+0000 7f0f59928640 1 -- 172.21.15.103:0/620192548 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f54158b20 con 0x7f0f540733d0 2024-09-10T08:44:41.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.164+0000 7f0f59928640 1 -- 172.21.15.103:0/620192548 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f5414df30 con 0x7f0f540733d0 2024-09-10T08:44:41.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.164+0000 7f0f50ff9640 1 -- 172.21.15.103:0/620192548 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f44012a10 con 0x7f0f540733d0 2024-09-10T08:44:41.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.165+0000 7f0f50ff9640 1 --2- 172.21.15.103:0/620192548 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0f3406be30 0x7f0f3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.165+0000 7f0f50ff9640 1 -- 172.21.15.103:0/620192548 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f0f4408acf0 con 0x7f0f540733d0 2024-09-10T08:44:41.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.165+0000 7f0f4a7fc640 1 --2- 172.21.15.103:0/620192548 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0f3406be30 0x7f0f3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.165+0000 7f0f4a7fc640 1 --2- 172.21.15.103:0/620192548 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0f3406be30 0x7f0f3406e2f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0f541558e0 tx=0x7f0f3c007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:41.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.169+0000 7f0f50ff9640 1 -- 172.21.15.103:0/620192548 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f5414df30 con 0x7f0f540733d0 2024-09-10T08:44:41.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.343+0000 7f0f59928640 1 -- 172.21.15.103:0/620192548 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f0f54073ec0 con 0x7f0f3406be30 2024-09-10T08:44:41.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.343+0000 7f0f50ff9640 1 -- 172.21.15.103:0/620192548 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0f54073ec0 con 0x7f0f3406be30 2024-09-10T08:44:41.344 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 6 to deep-scrub 2024-09-10T08:44:41.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.345+0000 7f0f59928640 1 -- 172.21.15.103:0/620192548 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0f3406be30 msgr2=0x7f0f3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.345+0000 7f0f59928640 1 --2- 172.21.15.103:0/620192548 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0f3406be30 0x7f0f3406e2f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0f541558e0 tx=0x7f0f3c007e40 comp rx=0 tx=0).stop 2024-09-10T08:44:41.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.345+0000 7f0f59928640 1 -- 172.21.15.103:0/620192548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f540733d0 msgr2=0x7f0f541ef820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.345+0000 7f0f59928640 1 --2- 172.21.15.103:0/620192548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f540733d0 0x7f0f541ef820 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400c450 tx=0x7f0f4400c910 comp rx=0 tx=0).stop 2024-09-10T08:44:41.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.345+0000 7f0f59928640 1 -- 172.21.15.103:0/620192548 shutdown_connections 2024-09-10T08:44:41.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.345+0000 7f0f59928640 1 --2- 172.21.15.103:0/620192548 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f0f3406be30 0x7f0f3406e2f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.345+0000 7f0f59928640 1 --2- 172.21.15.103:0/620192548 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f54156f50 0x7f0f54145470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.345+0000 7f0f59928640 1 --2- 172.21.15.103:0/620192548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f54073ae0 0x7f0f54152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.345+0000 7f0f59928640 1 --2- 172.21.15.103:0/620192548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f540733d0 0x7f0f541ef820 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.345+0000 7f0f59928640 1 -- 172.21.15.103:0/620192548 >> 172.21.15.103:0/620192548 conn(0x7f0f540c9d80 msgr2=0x7f0f540c5730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:41.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.346+0000 7f0f59928640 1 -- 172.21.15.103:0/620192548 shutdown_connections 2024-09-10T08:44:41.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.346+0000 7f0f59928640 1 -- 172.21.15.103:0/620192548 wait complete. 2024-09-10T08:44:41.357 INFO:tasks.ceph:Scrubbing osd.7 2024-09-10T08:44:41.357 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:44:41.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.462+0000 7f00a2dc4640 1 Processor -- start 2024-09-10T08:44:41.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.462+0000 7f00a2dc4640 1 -- start start 2024-09-10T08:44:41.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f00a2dc4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f009c0c47d0 0x7f009c158090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f00a2dc4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f009c0ace70 con 0x7f009c0c4bb0 2024-09-10T08:44:41.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f00a2dc4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f009c0c2690 con 0x7f009c0c3170 2024-09-10T08:44:41.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f00a2dc4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f009c0c2440 con 0x7f009c0c47d0 2024-09-10T08:44:41.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f0093fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f009c0c4bb0 0x7f009c0c39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40934/0 (socket says 172.21.15.103:40934) 2024-09-10T08:44:41.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f0093fff640 1 -- 172.21.15.103:0/1680713675 learned_addr learned my addr 172.21.15.103:0/1680713675 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:44:41.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f00a0b60640 1 --2- 172.21.15.103:0/1680713675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f009c0c47d0 0x7f009c158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f00937fe640 1 -- 172.21.15.103:0/1680713675 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3602959868 0 0) 0x7f009c0ace70 con 0x7f009c0c4bb0 2024-09-10T08:44:41.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f00937fe640 1 -- 172.21.15.103:0/1680713675 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0084003520 con 0x7f009c0c4bb0 2024-09-10T08:44:41.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f00937fe640 1 -- 172.21.15.103:0/1680713675 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1575383160 0 0) 0x7f009c0c2690 con 0x7f009c0c3170 2024-09-10T08:44:41.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f00937fe640 1 -- 172.21.15.103:0/1680713675 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f009c0ace70 con 0x7f009c0c3170 2024-09-10T08:44:41.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f00937fe640 1 -- 172.21.15.103:0/1680713675 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4080860367 0 0) 0x7f0084003520 con 0x7f009c0c4bb0 2024-09-10T08:44:41.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f00937fe640 1 -- 172.21.15.103:0/1680713675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f009c0c47d0 msgr2=0x7f009c158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:41.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f00937fe640 1 --2- 172.21.15.103:0/1680713675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f009c0c47d0 0x7f009c158090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f00937fe640 1 -- 172.21.15.103:0/1680713675 >> v1:172.21.15.154:6789/0 conn(0x7f009c0c3170 legacy=0x7f009c1575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f00937fe640 1 -- 172.21.15.103:0/1680713675 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009c0c2970 con 0x7f009c0c4bb0 2024-09-10T08:44:41.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f00937fe640 1 -- 172.21.15.103:0/1680713675 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f008c001670 con 0x7f009c0c4bb0 2024-09-10T08:44:41.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f00937fe640 1 -- 172.21.15.103:0/1680713675 >> v1:172.21.15.103:6789/0 conn(0x7f009c0c4bb0 legacy=0x7f009c0c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f00937fe640 1 --2- 172.21.15.103:0/1680713675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0084003b70 0x7f0084003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f00937fe640 1 --2- 172.21.15.103:0/1680713675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0084004800 0x7f0084004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f00937fe640 1 --2- 172.21.15.103:0/1680713675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f009c0c47d0 0x7f00840051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f00937fe640 1 -- 172.21.15.103:0/1680713675 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f009c0c2440 con 0x7f0084004800 2024-09-10T08:44:41.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f00937fe640 1 -- 172.21.15.103:0/1680713675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f008400bad0 con 0x7f0084003b70 2024-09-10T08:44:41.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f00937fe640 1 -- 172.21.15.103:0/1680713675 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f008400bcd0 con 0x7f009c0c47d0 2024-09-10T08:44:41.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.463+0000 7f0093fff640 1 --2- 172.21.15.103:0/1680713675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0084004800 0x7f0084004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.464+0000 7f00a0b60640 1 --2- 172.21.15.103:0/1680713675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0084003b70 0x7f0084003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.464+0000 7f00a1361640 1 --2- 172.21.15.103:0/1680713675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f009c0c47d0 0x7f00840051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.464+0000 7f0093fff640 1 -- 172.21.15.103:0/1680713675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f009c0c47d0 msgr2=0x7f00840051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:41.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.464+0000 7f0093fff640 1 --2- 172.21.15.103:0/1680713675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f009c0c47d0 0x7f00840051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.464+0000 7f0093fff640 1 -- 172.21.15.103:0/1680713675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0084003b70 msgr2=0x7f0084003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:41.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.464+0000 7f0093fff640 1 --2- 172.21.15.103:0/1680713675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0084003b70 0x7f0084003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.464+0000 7f0093fff640 1 -- 172.21.15.103:0/1680713675 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0084003520 con 0x7f0084004800 2024-09-10T08:44:41.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.464+0000 7f00a0b60640 1 --2- 172.21.15.103:0/1680713675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0084003b70 0x7f0084003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:44:41.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.464+0000 7f0093fff640 1 --2- 172.21.15.103:0/1680713675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0084004800 0x7f0084004c80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f009c0c8720 tx=0x7f0084005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04ca83630400a3b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:41.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.465+0000 7f00937fe640 1 -- 172.21.15.103:0/1680713675 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c007ce0 con 0x7f0084004800 2024-09-10T08:44:41.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.465+0000 7f00937fe640 1 -- 172.21.15.103:0/1680713675 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f008c005ad0 con 0x7f0084004800 2024-09-10T08:44:41.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.465+0000 7f00937fe640 1 -- 172.21.15.103:0/1680713675 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c007070 con 0x7f0084004800 2024-09-10T08:44:41.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.465+0000 7f00a2dc4640 1 -- 172.21.15.103:0/1680713675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0084004800 msgr2=0x7f0084004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.465+0000 7f00a2dc4640 1 --2- 172.21.15.103:0/1680713675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0084004800 0x7f0084004c80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f009c0c8720 tx=0x7f0084005830 comp rx=0 tx=0).stop 2024-09-10T08:44:41.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.465+0000 7f00a1361640 1 -- 172.21.15.103:0/1680713675 reap_dead start 2024-09-10T08:44:41.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.465+0000 7f00a2dc4640 1 -- 172.21.15.103:0/1680713675 shutdown_connections 2024-09-10T08:44:41.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.465+0000 7f00a2dc4640 1 -- 172.21.15.103:0/1680713675 >> 172.21.15.103:0/1680713675 conn(0x7f009c06c210 msgr2=0x7f009c0c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:41.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.465+0000 7f00a2dc4640 1 -- 172.21.15.103:0/1680713675 shutdown_connections 2024-09-10T08:44:41.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.465+0000 7f00a2dc4640 1 -- 172.21.15.103:0/1680713675 wait complete. 2024-09-10T08:44:41.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.466+0000 7f00a2dc4640 1 Processor -- start 2024-09-10T08:44:41.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.466+0000 7f00a2dc4640 1 -- start start 2024-09-10T08:44:41.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.467+0000 7f00a2dc4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0084004800 0x7f009c157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.467+0000 7f00a2dc4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c14be60 0x7f009c14c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.467+0000 7f00a2dc4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f009c1ebe50 0x7f009c1ec2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.467+0000 7f00a2dc4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f009c0a74c0 con 0x7f009c14be60 2024-09-10T08:44:41.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.467+0000 7f00a2dc4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f009c0a7340 con 0x7f0084004800 2024-09-10T08:44:41.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.467+0000 7f00a2dc4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f009c0aca90 con 0x7f009c1ebe50 2024-09-10T08:44:41.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.467+0000 7f0093fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c14be60 0x7f009c14c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.467+0000 7f0093fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c14be60 0x7f009c14c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60814/0 (socket says 172.21.15.103:60814) 2024-09-10T08:44:41.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.467+0000 7f0093fff640 1 -- 172.21.15.103:0/392843580 learned_addr learned my addr 172.21.15.103:0/392843580 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:41.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.467+0000 7f00a1361640 1 --2- 172.21.15.103:0/392843580 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f009c1ebe50 0x7f009c1ec2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.467+0000 7f00a0b60640 1 --2- 172.21.15.103:0/392843580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0084004800 0x7f009c157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.468+0000 7f0093fff640 1 -- 172.21.15.103:0/392843580 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f009c1ebe50 msgr2=0x7f009c1ec2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.468+0000 7f0093fff640 1 --2- 172.21.15.103:0/392843580 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f009c1ebe50 0x7f009c1ec2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.468+0000 7f0093fff640 1 -- 172.21.15.103:0/392843580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0084004800 msgr2=0x7f009c157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.468+0000 7f0093fff640 1 --2- 172.21.15.103:0/392843580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0084004800 0x7f009c157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.468+0000 7f0093fff640 1 -- 172.21.15.103:0/392843580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009c06ece0 con 0x7f009c14be60 2024-09-10T08:44:41.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.468+0000 7f00a0b60640 1 --2- 172.21.15.103:0/392843580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0084004800 0x7f009c157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:44:41.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.468+0000 7f0093fff640 1 --2- 172.21.15.103:0/392843580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c14be60 0x7f009c14c2c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f008c00c300 tx=0x7f009c155030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:41.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.468+0000 7f00917fa640 1 -- 172.21.15.103:0/392843580 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c041020 con 0x7f009c14be60 2024-09-10T08:44:41.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.468+0000 7f00917fa640 1 -- 172.21.15.103:0/392843580 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f008c0058f0 con 0x7f009c14be60 2024-09-10T08:44:41.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.468+0000 7f00917fa640 1 -- 172.21.15.103:0/392843580 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c007070 con 0x7f009c14be60 2024-09-10T08:44:41.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.468+0000 7f00a2dc4640 1 -- 172.21.15.103:0/392843580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f009c14cb20 con 0x7f009c14be60 2024-09-10T08:44:41.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.468+0000 7f00a2dc4640 1 -- 172.21.15.103:0/392843580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f009c1580c0 con 0x7f009c14be60 2024-09-10T08:44:41.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.469+0000 7f00a2dc4640 1 -- 172.21.15.103:0/392843580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f009c0c35c0 con 0x7f009c14be60 2024-09-10T08:44:41.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.469+0000 7f00917fa640 1 -- 172.21.15.103:0/392843580 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f008c044020 con 0x7f009c14be60 2024-09-10T08:44:41.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.470+0000 7f00917fa640 1 --2- 172.21.15.103:0/392843580 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f008806be60 0x7f008806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.470+0000 7f00917fa640 1 -- 172.21.15.103:0/392843580 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f008c0ab3e0 con 0x7f009c14be60 2024-09-10T08:44:41.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.470+0000 7f00a0b60640 1 --2- 172.21.15.103:0/392843580 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f008806be60 0x7f008806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.470+0000 7f00917fa640 1 --2- 172.21.15.103:0/392843580 >> [v2:172.21.15.154:6824/3439481239,v1:172.21.15.154:6825/3439481239] conn(0x7f00880767f0 0x7f0088078c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.470+0000 7f00917fa640 1 -- 172.21.15.103:0/392843580 --> [v2:172.21.15.154:6824/3439481239,v1:172.21.15.154:6825/3439481239] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f008c00bf30 con 0x7f00880767f0 2024-09-10T08:44:41.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.470+0000 7f00917fa640 1 -- 172.21.15.103:0/392843580 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f008c0b2050 con 0x7f009c14be60 2024-09-10T08:44:41.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.470+0000 7f00a1361640 1 --2- 172.21.15.103:0/392843580 >> [v2:172.21.15.154:6824/3439481239,v1:172.21.15.154:6825/3439481239] conn(0x7f00880767f0 0x7f0088078c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.470+0000 7f00a0b60640 1 --2- 172.21.15.103:0/392843580 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f008806be60 0x7f008806e320 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0098009a70 tx=0x7f0098008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:41.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.471+0000 7f00a1361640 1 --2- 172.21.15.103:0/392843580 >> [v2:172.21.15.154:6824/3439481239,v1:172.21.15.154:6825/3439481239] conn(0x7f00880767f0 0x7f0088078c70 crc :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:41.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.471+0000 7f00917fa640 1 -- 172.21.15.103:0/392843580 <== osd.7 v2:172.21.15.154:6824/3439481239 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f008c00bf30 con 0x7f00880767f0 2024-09-10T08:44:41.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.484+0000 7f00a2dc4640 1 -- 172.21.15.103:0/392843580 --> [v2:172.21.15.154:6824/3439481239,v1:172.21.15.154:6825/3439481239] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f009c0a8af0 con 0x7f00880767f0 2024-09-10T08:44:41.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.484+0000 7f00917fa640 1 -- 172.21.15.103:0/392843580 <== osd.7 v2:172.21.15.154:6824/3439481239 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f009c0a8af0 con 0x7f00880767f0 2024-09-10T08:44:41.484 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-10T08:44:41.484 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:44:41.484 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-10T08:44:41.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.484+0000 7f00a2dc4640 1 -- 172.21.15.103:0/392843580 >> [v2:172.21.15.154:6824/3439481239,v1:172.21.15.154:6825/3439481239] conn(0x7f00880767f0 msgr2=0x7f0088078c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.484+0000 7f00a2dc4640 1 --2- 172.21.15.103:0/392843580 >> [v2:172.21.15.154:6824/3439481239,v1:172.21.15.154:6825/3439481239] conn(0x7f00880767f0 0x7f0088078c70 crc :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.484+0000 7f00a2dc4640 1 -- 172.21.15.103:0/392843580 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f008806be60 msgr2=0x7f008806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.484+0000 7f00a2dc4640 1 --2- 172.21.15.103:0/392843580 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f008806be60 0x7f008806e320 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0098009a70 tx=0x7f0098008040 comp rx=0 tx=0).stop 2024-09-10T08:44:41.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.484+0000 7f00a2dc4640 1 -- 172.21.15.103:0/392843580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c14be60 msgr2=0x7f009c14c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.484+0000 7f00a2dc4640 1 --2- 172.21.15.103:0/392843580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f009c14be60 0x7f009c14c2c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f008c00c300 tx=0x7f009c155030 comp rx=0 tx=0).stop 2024-09-10T08:44:41.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.484+0000 7f00a1361640 1 -- 172.21.15.103:0/392843580 reap_dead start 2024-09-10T08:44:41.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.485+0000 7f00a2dc4640 1 -- 172.21.15.103:0/392843580 shutdown_connections 2024-09-10T08:44:41.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.485+0000 7f00a2dc4640 1 -- 172.21.15.103:0/392843580 >> 172.21.15.103:0/392843580 conn(0x7f009c06c210 msgr2=0x7f009c0a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:41.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.485+0000 7f00a2dc4640 1 -- 172.21.15.103:0/392843580 shutdown_connections 2024-09-10T08:44:41.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.485+0000 7f00a2dc4640 1 -- 172.21.15.103:0/392843580 wait complete. 2024-09-10T08:44:41.495 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-10T08:44:41.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.594+0000 7fa40cee6640 1 Processor -- start 2024-09-10T08:44:41.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.594+0000 7fa40cee6640 1 -- start start 2024-09-10T08:44:41.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.595+0000 7fa40cee6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa40815a450 0x7fa4080c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.595+0000 7fa40cee6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa4080c84e0 0x7fa40806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.595+0000 7fa40cee6640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa40815a830 con 0x7fa4080c3fd0 2024-09-10T08:44:41.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.595+0000 7fa40cee6640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa40806e240 con 0x7fa40815a450 2024-09-10T08:44:41.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.595+0000 7fa40cee6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fa4080c7490 con 0x7fa4080c84e0 2024-09-10T08:44:41.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.595+0000 7fa40659c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa40815a450 0x7fa4080c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.595+0000 7fa3fdd9b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa4080c3fd0 0x7fa40806e6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40940/0 (socket says 172.21.15.103:40940) 2024-09-10T08:44:41.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.595+0000 7fa3fdd9b640 1 -- 172.21.15.103:0/3973440855 learned_addr learned my addr 172.21.15.103:0/3973440855 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:44:41.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.595+0000 7fa40659c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa40815a450 0x7fa4080c3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60828/0 (socket says 172.21.15.103:60828) 2024-09-10T08:44:41.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.595+0000 7fa406d9d640 1 --2- 172.21.15.103:0/3973440855 >> v2:172.21.15.154:3300/0 conn(0x7fa4080c84e0 0x7fa40806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.595+0000 7fa40659c640 1 -- 172.21.15.103:0/3973440855 >> v2:172.21.15.154:3300/0 conn(0x7fa4080c84e0 msgr2=0x7fa40806ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:41.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.595+0000 7fa40659c640 1 --2- 172.21.15.103:0/3973440855 >> v2:172.21.15.154:3300/0 conn(0x7fa4080c84e0 0x7fa40806ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.595+0000 7fa40659c640 1 -- 172.21.15.103:0/3973440855 >> v1:172.21.15.103:6789/0 conn(0x7fa4080c3fd0 legacy=0x7fa40806e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.595+0000 7fa40659c640 1 -- 172.21.15.103:0/3973440855 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4080c7770 con 0x7fa40815a450 2024-09-10T08:44:41.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.595+0000 7fa405d9b640 1 -- 172.21.15.103:0/3973440855 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1835801959 0 0) 0x7fa40815a830 con 0x7fa4080c3fd0 2024-09-10T08:44:41.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.595+0000 7fa406d9d640 1 --2- 172.21.15.103:0/3973440855 >> v2:172.21.15.154:3300/0 conn(0x7fa4080c84e0 0x7fa40806ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:44:41.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.596+0000 7fa40659c640 1 --2- 172.21.15.103:0/3973440855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa40815a450 0x7fa4080c3a90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa40806e000 tx=0x7fa3f802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a696439f100cd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:41.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.596+0000 7fa405d9b640 1 -- 172.21.15.103:0/3973440855 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8037070 con 0x7fa40815a450 2024-09-10T08:44:41.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.596+0000 7fa405d9b640 1 -- 172.21.15.103:0/3973440855 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3f8032440 con 0x7fa40815a450 2024-09-10T08:44:41.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.596+0000 7fa405d9b640 1 -- 172.21.15.103:0/3973440855 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8032810 con 0x7fa40815a450 2024-09-10T08:44:41.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.597+0000 7fa40cee6640 1 -- 172.21.15.103:0/3973440855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa40815a450 msgr2=0x7fa4080c3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.597+0000 7fa40cee6640 1 --2- 172.21.15.103:0/3973440855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa40815a450 0x7fa4080c3a90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa40806e000 tx=0x7fa3f802a1a0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.597+0000 7fa40cee6640 1 -- 172.21.15.103:0/3973440855 shutdown_connections 2024-09-10T08:44:41.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.597+0000 7fa40cee6640 1 --2- 172.21.15.103:0/3973440855 >> v2:172.21.15.154:3300/0 conn(0x7fa4080c84e0 0x7fa40806ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.597+0000 7fa40cee6640 1 --2- 172.21.15.103:0/3973440855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa40815a450 0x7fa4080c3a90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.597+0000 7fa40cee6640 1 -- 172.21.15.103:0/3973440855 >> 172.21.15.103:0/3973440855 conn(0x7fa4080c5660 msgr2=0x7fa4080c5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:41.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.597+0000 7fa40cee6640 1 -- 172.21.15.103:0/3973440855 shutdown_connections 2024-09-10T08:44:41.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.597+0000 7fa40cee6640 1 -- 172.21.15.103:0/3973440855 wait complete. 2024-09-10T08:44:41.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.598+0000 7fa40cee6640 1 Processor -- start 2024-09-10T08:44:41.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.598+0000 7fa40cee6640 1 -- start start 2024-09-10T08:44:41.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.599+0000 7fa40cee6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4080c3fd0 0x7fa40806fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.599+0000 7fa40cee6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4080c84e0 0x7fa4081eb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.599+0000 7fa40cee6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa40815a450 0x7fa4081ebe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.599+0000 7fa40cee6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa40806f320 con 0x7fa40815a450 2024-09-10T08:44:41.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.599+0000 7fa40cee6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa4080c7d30 con 0x7fa4080c3fd0 2024-09-10T08:44:41.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.599+0000 7fa40cee6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa4080c70d0 con 0x7fa4080c84e0 2024-09-10T08:44:41.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.599+0000 7fa406d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa40815a450 0x7fa4081ebe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.599+0000 7fa406d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa40815a450 0x7fa4081ebe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60840/0 (socket says 172.21.15.103:60840) 2024-09-10T08:44:41.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.599+0000 7fa406d9d640 1 -- 172.21.15.103:0/1309164010 learned_addr learned my addr 172.21.15.103:0/1309164010 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:41.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.599+0000 7fa40659c640 1 --2- 172.21.15.103:0/1309164010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4080c3fd0 0x7fa40806fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.599+0000 7fa3fdd9b640 1 --2- 172.21.15.103:0/1309164010 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4080c84e0 0x7fa4081eb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.599+0000 7fa406d9d640 1 -- 172.21.15.103:0/1309164010 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4080c84e0 msgr2=0x7fa4081eb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.599+0000 7fa406d9d640 1 --2- 172.21.15.103:0/1309164010 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4080c84e0 0x7fa4081eb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.599+0000 7fa406d9d640 1 -- 172.21.15.103:0/1309164010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4080c3fd0 msgr2=0x7fa40806fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.599+0000 7fa406d9d640 1 --2- 172.21.15.103:0/1309164010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4080c3fd0 0x7fa40806fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.599+0000 7fa406d9d640 1 -- 172.21.15.103:0/1309164010 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4081e0370 con 0x7fa40815a450 2024-09-10T08:44:41.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.599+0000 7fa406d9d640 1 --2- 172.21.15.103:0/1309164010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa40815a450 0x7fa4081ebe90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa400009fa0 tx=0x7fa40000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:41.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.599+0000 7fa3ff7fe640 1 -- 172.21.15.103:0/1309164010 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40001a070 con 0x7fa40815a450 2024-09-10T08:44:41.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.600+0000 7fa3ff7fe640 1 -- 172.21.15.103:0/1309164010 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa400003bb0 con 0x7fa40815a450 2024-09-10T08:44:41.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.600+0000 7fa40cee6640 1 -- 172.21.15.103:0/1309164010 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4081ef060 con 0x7fa40815a450 2024-09-10T08:44:41.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.600+0000 7fa3ff7fe640 1 -- 172.21.15.103:0/1309164010 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa400004030 con 0x7fa40815a450 2024-09-10T08:44:41.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.600+0000 7fa40cee6640 1 -- 172.21.15.103:0/1309164010 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4080701f0 con 0x7fa40815a450 2024-09-10T08:44:41.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.601+0000 7fa40cee6640 1 -- 172.21.15.103:0/1309164010 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa40806c5c0 con 0x7fa40815a450 2024-09-10T08:44:41.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.601+0000 7fa3ff7fe640 1 -- 172.21.15.103:0/1309164010 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa40001d070 con 0x7fa40815a450 2024-09-10T08:44:41.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.601+0000 7fa3ff7fe640 1 --2- 172.21.15.103:0/1309164010 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa3e806be60 0x7fa3e806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.602+0000 7fa3ff7fe640 1 -- 172.21.15.103:0/1309164010 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fa40008b440 con 0x7fa40815a450 2024-09-10T08:44:41.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.602+0000 7fa40659c640 1 --2- 172.21.15.103:0/1309164010 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa3e806be60 0x7fa3e806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.602+0000 7fa40659c640 1 --2- 172.21.15.103:0/1309164010 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa3e806be60 0x7fa3e806e320 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8034000 tx=0x7fa3f802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:41.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.606+0000 7fa3ff7fe640 1 -- 172.21.15.103:0/1309164010 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa400010070 con 0x7fa40815a450 2024-09-10T08:44:41.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.773+0000 7fa40cee6640 1 -- 172.21.15.103:0/1309164010 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fa4080c3660 con 0x7fa3e806be60 2024-09-10T08:44:41.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.773+0000 7fa3ff7fe640 1 -- 172.21.15.103:0/1309164010 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa4080c3660 con 0x7fa3e806be60 2024-09-10T08:44:41.773 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 7 to deep-scrub 2024-09-10T08:44:41.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.775+0000 7fa40cee6640 1 -- 172.21.15.103:0/1309164010 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa3e806be60 msgr2=0x7fa3e806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.775+0000 7fa40cee6640 1 --2- 172.21.15.103:0/1309164010 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa3e806be60 0x7fa3e806e320 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8034000 tx=0x7fa3f802e000 comp rx=0 tx=0).stop 2024-09-10T08:44:41.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.775+0000 7fa40cee6640 1 -- 172.21.15.103:0/1309164010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa40815a450 msgr2=0x7fa4081ebe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.775+0000 7fa40cee6640 1 --2- 172.21.15.103:0/1309164010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa40815a450 0x7fa4081ebe90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa400009fa0 tx=0x7fa40000d560 comp rx=0 tx=0).stop 2024-09-10T08:44:41.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.776+0000 7fa40cee6640 1 -- 172.21.15.103:0/1309164010 shutdown_connections 2024-09-10T08:44:41.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.776+0000 7fa40cee6640 1 --2- 172.21.15.103:0/1309164010 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa3e806be60 0x7fa3e806e320 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.776+0000 7fa40cee6640 1 --2- 172.21.15.103:0/1309164010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa40815a450 0x7fa4081ebe90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.776+0000 7fa40cee6640 1 --2- 172.21.15.103:0/1309164010 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa4080c84e0 0x7fa4081eb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.776+0000 7fa40cee6640 1 --2- 172.21.15.103:0/1309164010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4080c3fd0 0x7fa40806fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.776+0000 7fa40cee6640 1 -- 172.21.15.103:0/1309164010 >> 172.21.15.103:0/1309164010 conn(0x7fa4080c5660 msgr2=0x7fa408156a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:41.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.776+0000 7fa40cee6640 1 -- 172.21.15.103:0/1309164010 shutdown_connections 2024-09-10T08:44:41.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.776+0000 7fa40cee6640 1 -- 172.21.15.103:0/1309164010 wait complete. 2024-09-10T08:44:41.788 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:44:41.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.888+0000 7fa9d8de4640 1 Processor -- start 2024-09-10T08:44:41.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.888+0000 7fa9d8de4640 1 -- start start 2024-09-10T08:44:41.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.889+0000 7fa9d8de4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa9d4073ae0 0x7fa9d4153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.889+0000 7fa9d8de4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9d406dd50 con 0x7fa9d4156f50 2024-09-10T08:44:41.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.889+0000 7fa9d8de4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9d406e030 con 0x7fa9d40733d0 2024-09-10T08:44:41.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.889+0000 7fa9d8de4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fa9d406e310 con 0x7fa9d4073ae0 2024-09-10T08:44:41.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.889+0000 7fa9d2d9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa9d4156f50 0x7fa9d4160b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:40952/0 (socket says 172.21.15.103:40952) 2024-09-10T08:44:41.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.889+0000 7fa9d2d9d640 1 -- 172.21.15.103:0/3381748902 learned_addr learned my addr 172.21.15.103:0/3381748902 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:44:41.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.889+0000 7fa9d159a640 1 -- 172.21.15.103:0/3381748902 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4168458634 0 0) 0x7fa9d406dd50 con 0x7fa9d4156f50 2024-09-10T08:44:41.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.889+0000 7fa9d159a640 1 -- 172.21.15.103:0/3381748902 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9bc003520 con 0x7fa9d4156f50 2024-09-10T08:44:41.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.889+0000 7fa9d259c640 1 --2- 172.21.15.103:0/3381748902 >> v2:172.21.15.154:3300/0 conn(0x7fa9d4073ae0 0x7fa9d4153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.889+0000 7fa9d159a640 1 -- 172.21.15.103:0/3381748902 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1274015084 0 0) 0x7fa9bc003520 con 0x7fa9d4156f50 2024-09-10T08:44:41.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.889+0000 7fa9d159a640 1 -- 172.21.15.103:0/3381748902 >> v2:172.21.15.154:3300/0 conn(0x7fa9d4073ae0 msgr2=0x7fa9d4153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:41.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.889+0000 7fa9d159a640 1 --2- 172.21.15.103:0/3381748902 >> v2:172.21.15.154:3300/0 conn(0x7fa9d4073ae0 0x7fa9d4153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.890+0000 7fa9d159a640 1 -- 172.21.15.103:0/3381748902 >> v1:172.21.15.154:6789/0 conn(0x7fa9d40733d0 legacy=0x7fa9d4156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:41.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.890+0000 7fa9d159a640 1 -- 172.21.15.103:0/3381748902 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d406e5f0 con 0x7fa9d4156f50 2024-09-10T08:44:41.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.890+0000 7fa9d159a640 1 -- 172.21.15.103:0/3381748902 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7fa9cc0019f0 con 0x7fa9d4156f50 2024-09-10T08:44:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.890+0000 7fa9d159a640 1 -- 172.21.15.103:0/3381748902 >> v1:172.21.15.103:6789/0 conn(0x7fa9d4156f50 legacy=0x7fa9d4160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.890+0000 7fa9d159a640 1 --2- 172.21.15.103:0/3381748902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc003a00 0x7fa9bc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.890+0000 7fa9d159a640 1 --2- 172.21.15.103:0/3381748902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9bc004800 0x7fa9bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.890+0000 7fa9d159a640 1 --2- 172.21.15.103:0/3381748902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc0051c0 0x7fa9bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.890+0000 7fa9d159a640 1 -- 172.21.15.103:0/3381748902 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d406e310 con 0x7fa9bc0051c0 2024-09-10T08:44:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.890+0000 7fa9d159a640 1 -- 172.21.15.103:0/3381748902 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc00c0c0 con 0x7fa9bc004800 2024-09-10T08:44:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.890+0000 7fa9d159a640 1 -- 172.21.15.103:0/3381748902 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa9bc00c2c0 con 0x7fa9bc003a00 2024-09-10T08:44:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.890+0000 7fa9d2d9d640 1 --2- 172.21.15.103:0/3381748902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc0051c0 0x7fa9bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.890+0000 7fa9d259c640 1 --2- 172.21.15.103:0/3381748902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc003a00 0x7fa9bc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.890+0000 7fa9d1d9b640 1 --2- 172.21.15.103:0/3381748902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9bc004800 0x7fa9bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.890+0000 7fa9d2d9d640 1 -- 172.21.15.103:0/3381748902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc003a00 msgr2=0x7fa9bc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.890+0000 7fa9d2d9d640 1 --2- 172.21.15.103:0/3381748902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc003a00 0x7fa9bc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.890+0000 7fa9d2d9d640 1 -- 172.21.15.103:0/3381748902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9bc004800 msgr2=0x7fa9bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:44:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.890+0000 7fa9d2d9d640 1 --2- 172.21.15.103:0/3381748902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9bc004800 0x7fa9bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.890+0000 7fa9d2d9d640 1 -- 172.21.15.103:0/3381748902 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9bc003520 con 0x7fa9bc0051c0 2024-09-10T08:44:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.890+0000 7fa9d1d9b640 1 --2- 172.21.15.103:0/3381748902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9bc004800 0x7fa9bc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:44:41.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.891+0000 7fa9d2d9d640 1 -- 172.21.15.103:0/3381748902 reap_dead start 2024-09-10T08:44:41.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.891+0000 7fa9d2d9d640 1 --2- 172.21.15.103:0/3381748902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc0051c0 0x7fa9bc00b9c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa9d406cf60 tx=0x7fa9bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5796ad616cb874 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:41.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.891+0000 7fa9d159a640 1 -- 172.21.15.103:0/3381748902 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc00a390 con 0x7fa9bc0051c0 2024-09-10T08:44:41.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.891+0000 7fa9d159a640 1 -- 172.21.15.103:0/3381748902 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9cc02f070 con 0x7fa9bc0051c0 2024-09-10T08:44:41.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.891+0000 7fa9d159a640 1 -- 172.21.15.103:0/3381748902 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc02bb70 con 0x7fa9bc0051c0 2024-09-10T08:44:41.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.891+0000 7fa9d8de4640 1 -- 172.21.15.103:0/3381748902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc0051c0 msgr2=0x7fa9bc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.891+0000 7fa9d8de4640 1 --2- 172.21.15.103:0/3381748902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc0051c0 0x7fa9bc00b9c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa9d406cf60 tx=0x7fa9bc005830 comp rx=0 tx=0).stop 2024-09-10T08:44:41.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.892+0000 7fa9d8de4640 1 -- 172.21.15.103:0/3381748902 shutdown_connections 2024-09-10T08:44:41.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.892+0000 7fa9d8de4640 1 --2- 172.21.15.103:0/3381748902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9bc0051c0 0x7fa9bc00b9c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.892+0000 7fa9d8de4640 1 -- 172.21.15.103:0/3381748902 >> 172.21.15.103:0/3381748902 conn(0x7fa9d40c9d80 msgr2=0x7fa9d40ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:41.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.892+0000 7fa9d8de4640 1 -- 172.21.15.103:0/3381748902 shutdown_connections 2024-09-10T08:44:41.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.892+0000 7fa9d8de4640 1 -- 172.21.15.103:0/3381748902 wait complete. 2024-09-10T08:44:41.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.893+0000 7fa9d8de4640 1 Processor -- start 2024-09-10T08:44:41.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.893+0000 7fa9d8de4640 1 -- start start 2024-09-10T08:44:41.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.893+0000 7fa9d8de4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc0051c0 0x7fa9d41eed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.893+0000 7fa9d8de4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9d4157f80 0x7fa9d4142360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.893+0000 7fa9d8de4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d40c8a90 0x7fa9d414f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.894+0000 7fa9d8de4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d406edd0 con 0x7fa9d4157f80 2024-09-10T08:44:41.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.894+0000 7fa9d8de4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d406ec50 con 0x7fa9d40c8a90 2024-09-10T08:44:41.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.894+0000 7fa9d8de4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fa9d4073ec0 con 0x7fa9bc0051c0 2024-09-10T08:44:41.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.894+0000 7fa9d1d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9d4157f80 0x7fa9d4142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.894+0000 7fa9d1d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9d4157f80 0x7fa9d4142360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60862/0 (socket says 172.21.15.103:60862) 2024-09-10T08:44:41.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.894+0000 7fa9d1d9b640 1 -- 172.21.15.103:0/883891132 learned_addr learned my addr 172.21.15.103:0/883891132 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:44:41.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.894+0000 7fa9d259c640 1 --2- 172.21.15.103:0/883891132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc0051c0 0x7fa9d41eed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.894+0000 7fa9d2d9d640 1 --2- 172.21.15.103:0/883891132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d40c8a90 0x7fa9d414f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.894+0000 7fa9d1d9b640 1 -- 172.21.15.103:0/883891132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc0051c0 msgr2=0x7fa9d41eed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.894+0000 7fa9d1d9b640 1 --2- 172.21.15.103:0/883891132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc0051c0 0x7fa9d41eed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.894+0000 7fa9d1d9b640 1 -- 172.21.15.103:0/883891132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d40c8a90 msgr2=0x7fa9d414f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:41.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.894+0000 7fa9d1d9b640 1 --2- 172.21.15.103:0/883891132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d40c8a90 0x7fa9d414f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:41.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.894+0000 7fa9d1d9b640 1 -- 172.21.15.103:0/883891132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d4155560 con 0x7fa9d4157f80 2024-09-10T08:44:41.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.894+0000 7fa9d1d9b640 1 --2- 172.21.15.103:0/883891132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9d4157f80 0x7fa9d4142360 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800e480 tx=0x7fa9c800e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:41.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.894+0000 7fa9c2ffd640 1 -- 172.21.15.103:0/883891132 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8019070 con 0x7fa9d4157f80 2024-09-10T08:44:41.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.894+0000 7fa9c2ffd640 1 -- 172.21.15.103:0/883891132 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9c80053a0 con 0x7fa9d4157f80 2024-09-10T08:44:41.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.894+0000 7fa9d8de4640 1 -- 172.21.15.103:0/883891132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9d41ec420 con 0x7fa9d4157f80 2024-09-10T08:44:41.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.894+0000 7fa9c2ffd640 1 -- 172.21.15.103:0/883891132 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8003830 con 0x7fa9d4157f80 2024-09-10T08:44:41.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.894+0000 7fa9d8de4640 1 -- 172.21.15.103:0/883891132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9d41ec700 con 0x7fa9d4157f80 2024-09-10T08:44:41.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.896+0000 7fa9d8de4640 1 -- 172.21.15.103:0/883891132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9d406d850 con 0x7fa9d4157f80 2024-09-10T08:44:41.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.896+0000 7fa9c2ffd640 1 -- 172.21.15.103:0/883891132 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa9c801c070 con 0x7fa9d4157f80 2024-09-10T08:44:41.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.896+0000 7fa9c2ffd640 1 --2- 172.21.15.103:0/883891132 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa9b406be30 0x7fa9b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:44:41.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.897+0000 7fa9c2ffd640 1 -- 172.21.15.103:0/883891132 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fa9c808a6f0 con 0x7fa9d4157f80 2024-09-10T08:44:41.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.897+0000 7fa9d259c640 1 --2- 172.21.15.103:0/883891132 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa9b406be30 0x7fa9b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:44:41.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.897+0000 7fa9d259c640 1 --2- 172.21.15.103:0/883891132 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa9b406be30 0x7fa9b406e2f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009b40 tx=0x7fa9c4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:44:41.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:41.901+0000 7fa9c2ffd640 1 -- 172.21.15.103:0/883891132 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa9c8058740 con 0x7fa9d4157f80 2024-09-10T08:44:42.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:42.064+0000 7fa9d8de4640 1 -- 172.21.15.103:0/883891132 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa9d4075380 con 0x7fa9b406be30 2024-09-10T08:44:42.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:42.075+0000 7fa9c2ffd640 1 -- 172.21.15.103:0/883891132 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+492890 (secure 0 0 0) 0x7fa9d4075380 con 0x7fa9b406be30 2024-09-10T08:44:42.082 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:44:42.086 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T08:44:42.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:42.079+0000 7fa9d8de4640 1 -- 172.21.15.103:0/883891132 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa9b406be30 msgr2=0x7fa9b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:42.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:42.079+0000 7fa9d8de4640 1 --2- 172.21.15.103:0/883891132 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa9b406be30 0x7fa9b406e2f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009b40 tx=0x7fa9c4009190 comp rx=0 tx=0).stop 2024-09-10T08:44:42.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:42.079+0000 7fa9d8de4640 1 -- 172.21.15.103:0/883891132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9d4157f80 msgr2=0x7fa9d4142360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:44:42.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:42.079+0000 7fa9d8de4640 1 --2- 172.21.15.103:0/883891132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9d4157f80 0x7fa9d4142360 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800e480 tx=0x7fa9c800e880 comp rx=0 tx=0).stop 2024-09-10T08:44:42.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:42.079+0000 7fa9d8de4640 1 -- 172.21.15.103:0/883891132 shutdown_connections 2024-09-10T08:44:42.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:42.079+0000 7fa9d8de4640 1 --2- 172.21.15.103:0/883891132 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fa9b406be30 0x7fa9b406e2f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:42.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:42.079+0000 7fa9d8de4640 1 --2- 172.21.15.103:0/883891132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9d40c8a90 0x7fa9d414f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:42.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:42.079+0000 7fa9d8de4640 1 --2- 172.21.15.103:0/883891132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9d4157f80 0x7fa9d4142360 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:42.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:42.079+0000 7fa9d8de4640 1 --2- 172.21.15.103:0/883891132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9bc0051c0 0x7fa9d41eed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:44:42.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:42.079+0000 7fa9d8de4640 1 -- 172.21.15.103:0/883891132 >> 172.21.15.103:0/883891132 conn(0x7fa9d40c9d80 msgr2=0x7fa9d414c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:44:42.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:42.079+0000 7fa9d8de4640 1 -- 172.21.15.103:0/883891132 shutdown_connections 2024-09-10T08:44:42.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:44:42.079+0000 7fa9d8de4640 1 -- 172.21.15.103:0/883891132 wait complete. 2024-09-10T08:44:42.091 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":509,"stamp":"2024-09-10T08:44:41.063635+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36141476,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":225,"num_read_kb":350,"num_write":3080803,"num_write_kb":38573613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":595349,"ondisk_log_size":595349,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7717728,"kb_used_data":72928,"kb_used_omap":12,"kb_used_meta":7644659,"kb_avail":747256992,"statfs":{"total":773094113280,"available":765191159808,"internally_reserved":0,"allocated":74678272,"data_stored":73201928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":7828131379},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003197"},"pg_stats":[{"pgid":"5.18","version":"27'4501","reported_seq":4523,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.380600+0000","last_change":"2024-09-10T08:28:47.627476+0000","last_active":"2024-09-10T08:44:29.380600+0000","last_peered":"2024-09-10T08:44:29.380600+0000","last_clean":"2024-09-10T08:44:29.380600+0000","last_became_active":"2024-09-10T08:28:47.627217+0000","last_became_peered":"2024-09-10T08:28:47.627217+0000","last_unstale":"2024-09-10T08:44:29.380600+0000","last_undegraded":"2024-09-10T08:44:29.380600+0000","last_fullsized":"2024-09-10T08:44:29.380600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":0,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:25.152836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23743,"num_write_kb":296073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"27'672","reported_seq":706,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:32.520359+0000","last_change":"2024-09-10T08:28:34.564816+0000","last_active":"2024-09-10T08:43:32.520359+0000","last_peered":"2024-09-10T08:43:32.520359+0000","last_clean":"2024-09-10T08:43:32.520359+0000","last_became_active":"2024-09-10T08:28:34.564545+0000","last_became_peered":"2024-09-10T08:28:34.564545+0000","last_unstale":"2024-09-10T08:43:32.520359+0000","last_undegraded":"2024-09-10T08:43:32.520359+0000","last_fullsized":"2024-09-10T08:43:32.520359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":670,"num_write_kb":4473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5460","reported_seq":5492,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.468641+0000","last_change":"2024-09-10T08:28:35.575267+0000","last_active":"2024-09-10T08:44:22.468641+0000","last_peered":"2024-09-10T08:44:22.468641+0000","last_clean":"2024-09-10T08:44:22.468641+0000","last_became_active":"2024-09-10T08:28:35.575019+0000","last_became_peered":"2024-09-10T08:28:35.575019+0000","last_unstale":"2024-09-10T08:44:22.468641+0000","last_undegraded":"2024-09-10T08:44:22.468641+0000","last_fullsized":"2024-09-10T08:44:22.468641+0000","mapping_epoch":19,"log_start":"27'200","ondisk_log_start":"27'200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5260,"log_dups_size":0,"ondisk_log_size":5260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:00.810645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28693,"num_write_kb":332310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:16.827314+0000","last_change":"2024-09-10T08:28:46.620227+0000","last_active":"2024-09-10T08:43:16.827314+0000","last_peered":"2024-09-10T08:43:16.827314+0000","last_clean":"2024-09-10T08:43:16.827314+0000","last_became_active":"2024-09-10T08:28:46.619540+0000","last_became_peered":"2024-09-10T08:28:46.619540+0000","last_unstale":"2024-09-10T08:43:16.827314+0000","last_undegraded":"2024-09-10T08:43:16.827314+0000","last_fullsized":"2024-09-10T08:43:16.827314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:13.402155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"27'5259","reported_seq":5281,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.450085+0000","last_change":"2024-09-10T08:28:47.633586+0000","last_active":"2024-09-10T08:44:29.450085+0000","last_peered":"2024-09-10T08:44:29.450085+0000","last_clean":"2024-09-10T08:44:29.450085+0000","last_became_active":"2024-09-10T08:28:47.633292+0000","last_became_peered":"2024-09-10T08:28:47.633292+0000","last_unstale":"2024-09-10T08:44:29.450085+0000","last_undegraded":"2024-09-10T08:44:29.450085+0000","last_fullsized":"2024-09-10T08:44:29.450085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5259,"log_dups_size":0,"ondisk_log_size":5259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:19.473028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27465,"num_write_kb":347758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.995834+0000","last_change":"2024-09-10T08:28:34.561691+0000","last_active":"2024-09-10T08:43:47.995834+0000","last_peered":"2024-09-10T08:43:47.995834+0000","last_clean":"2024-09-10T08:43:47.995834+0000","last_became_active":"2024-09-10T08:28:34.561410+0000","last_became_peered":"2024-09-10T08:28:34.561410+0000","last_unstale":"2024-09-10T08:43:47.995834+0000","last_undegraded":"2024-09-10T08:43:47.995834+0000","last_fullsized":"2024-09-10T08:43:47.995834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:35.629982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'5545","reported_seq":5585,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:39.900576+0000","last_change":"2024-09-10T08:44:39.900622+0000","last_active":"2024-09-10T08:44:39.900576+0000","last_peered":"2024-09-10T08:44:39.900576+0000","last_clean":"2024-09-10T08:44:39.900576+0000","last_became_active":"2024-09-10T08:28:35.578333+0000","last_became_peered":"2024-09-10T08:28:35.578333+0000","last_unstale":"2024-09-10T08:44:39.900576+0000","last_undegraded":"2024-09-10T08:44:39.900576+0000","last_fullsized":"2024-09-10T08:44:39.900576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5545","last_scrub_stamp":"2024-09-10T08:44:39.900423+0000","last_deep_scrub":"27'5545","last_deep_scrub_stamp":"2024-09-10T08:44:39.900423+0000","last_clean_scrub_stamp":"2024-09-10T08:44:39.900423+0000","objects_scrubbed":0,"log_size":5545,"log_dups_size":0,"ondisk_log_size":5545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:28:05.013137+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29606,"num_write_kb":364444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:31.334990+0000","last_change":"2024-09-10T08:28:46.617317+0000","last_active":"2024-09-10T08:43:31.334990+0000","last_peered":"2024-09-10T08:43:31.334990+0000","last_clean":"2024-09-10T08:43:31.334990+0000","last_became_active":"2024-09-10T08:28:46.616806+0000","last_became_peered":"2024-09-10T08:28:46.616806+0000","last_unstale":"2024-09-10T08:43:31.334990+0000","last_undegraded":"2024-09-10T08:43:31.334990+0000","last_fullsized":"2024-09-10T08:43:31.334990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:46.916848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"27'4143","reported_seq":4165,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.444464+0000","last_change":"2024-09-10T08:28:47.633194+0000","last_active":"2024-09-10T08:44:29.444464+0000","last_peered":"2024-09-10T08:44:29.444464+0000","last_clean":"2024-09-10T08:44:29.444464+0000","last_became_active":"2024-09-10T08:28:47.632772+0000","last_became_peered":"2024-09-10T08:28:47.632772+0000","last_unstale":"2024-09-10T08:44:29.444464+0000","last_undegraded":"2024-09-10T08:44:29.444464+0000","last_fullsized":"2024-09-10T08:44:29.444464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4143,"log_dups_size":0,"ondisk_log_size":4143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:59.228438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21394,"num_write_kb":261850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"27'11","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.989437+0000","last_change":"2024-09-10T08:28:34.571965+0000","last_active":"2024-09-10T08:43:47.989437+0000","last_peered":"2024-09-10T08:43:47.989437+0000","last_clean":"2024-09-10T08:43:47.989437+0000","last_became_active":"2024-09-10T08:28:34.571640+0000","last_became_peered":"2024-09-10T08:28:34.571640+0000","last_unstale":"2024-09-10T08:43:47.989437+0000","last_undegraded":"2024-09-10T08:43:47.989437+0000","last_fullsized":"2024-09-10T08:43:47.989437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:53.047030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'3192","reported_seq":3222,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.520724+0000","last_change":"2024-09-10T08:28:35.562132+0000","last_active":"2024-09-10T08:44:22.520724+0000","last_peered":"2024-09-10T08:44:22.520724+0000","last_clean":"2024-09-10T08:44:22.520724+0000","last_became_active":"2024-09-10T08:28:35.561842+0000","last_became_peered":"2024-09-10T08:28:35.561842+0000","last_unstale":"2024-09-10T08:44:22.520724+0000","last_undegraded":"2024-09-10T08:44:22.520724+0000","last_fullsized":"2024-09-10T08:44:22.520724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3192,"log_dups_size":0,"ondisk_log_size":3192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:48.810258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15765,"num_write_kb":210601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'613","reported_seq":637,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:30.437035+0000","last_change":"2024-09-10T08:28:46.621093+0000","last_active":"2024-09-10T08:43:30.437035+0000","last_peered":"2024-09-10T08:43:30.437035+0000","last_clean":"2024-09-10T08:43:30.437035+0000","last_became_active":"2024-09-10T08:28:46.620794+0000","last_became_peered":"2024-09-10T08:28:46.620794+0000","last_unstale":"2024-09-10T08:43:30.437035+0000","last_undegraded":"2024-09-10T08:43:30.437035+0000","last_fullsized":"2024-09-10T08:43:30.437035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:20.501262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":611,"num_write_kb":4232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"27'3484","reported_seq":3506,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.377089+0000","last_change":"2024-09-10T08:28:47.627756+0000","last_active":"2024-09-10T08:44:29.377089+0000","last_peered":"2024-09-10T08:44:29.377089+0000","last_clean":"2024-09-10T08:44:29.377089+0000","last_became_active":"2024-09-10T08:28:47.627476+0000","last_became_peered":"2024-09-10T08:28:47.627476+0000","last_unstale":"2024-09-10T08:44:29.377089+0000","last_undegraded":"2024-09-10T08:44:29.377089+0000","last_fullsized":"2024-09-10T08:44:29.377089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:25.945793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18057,"num_write_kb":232111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"27'3","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:38.481193+0000","last_change":"2024-09-10T08:28:34.566560+0000","last_active":"2024-09-10T08:43:38.481193+0000","last_peered":"2024-09-10T08:43:38.481193+0000","last_clean":"2024-09-10T08:43:38.481193+0000","last_became_active":"2024-09-10T08:28:34.566275+0000","last_became_peered":"2024-09-10T08:28:34.566275+0000","last_unstale":"2024-09-10T08:43:38.481193+0000","last_undegraded":"2024-09-10T08:43:38.481193+0000","last_fullsized":"2024-09-10T08:43:38.481193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:03.507683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'5826","reported_seq":5842,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.521812+0000","last_change":"2024-09-10T08:29:35.097937+0000","last_active":"2024-09-10T08:44:22.521812+0000","last_peered":"2024-09-10T08:44:22.521812+0000","last_clean":"2024-09-10T08:44:22.521812+0000","last_became_active":"2024-09-10T08:29:35.097553+0000","last_became_peered":"2024-09-10T08:29:35.097553+0000","last_unstale":"2024-09-10T08:44:22.521812+0000","last_undegraded":"2024-09-10T08:44:22.521812+0000","last_fullsized":"2024-09-10T08:44:22.521812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5826,"log_dups_size":0,"ondisk_log_size":5826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:02.685992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30231,"num_write_kb":366977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"27'66","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.247916+0000","last_change":"2024-09-10T08:28:46.620162+0000","last_active":"2024-09-10T08:44:29.247916+0000","last_peered":"2024-09-10T08:44:29.247916+0000","last_clean":"2024-09-10T08:44:29.247916+0000","last_became_active":"2024-09-10T08:28:46.619889+0000","last_became_peered":"2024-09-10T08:28:46.619889+0000","last_unstale":"2024-09-10T08:44:29.247916+0000","last_undegraded":"2024-09-10T08:44:29.247916+0000","last_fullsized":"2024-09-10T08:44:29.247916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:13.820143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":755904,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"27'4988","reported_seq":5011,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.402643+0000","last_change":"2024-09-10T08:28:47.631094+0000","last_active":"2024-09-10T08:44:29.402643+0000","last_peered":"2024-09-10T08:44:29.402643+0000","last_clean":"2024-09-10T08:44:29.402643+0000","last_became_active":"2024-09-10T08:28:47.630787+0000","last_became_peered":"2024-09-10T08:28:47.630787+0000","last_unstale":"2024-09-10T08:44:29.402643+0000","last_undegraded":"2024-09-10T08:44:29.402643+0000","last_fullsized":"2024-09-10T08:44:29.402643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4988,"log_dups_size":0,"ondisk_log_size":4988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:06.277094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26081,"num_write_kb":317657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"27'4088","reported_seq":4119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.452804+0000","last_change":"2024-09-10T08:28:35.572478+0000","last_active":"2024-09-10T08:44:22.452804+0000","last_peered":"2024-09-10T08:44:22.452804+0000","last_clean":"2024-09-10T08:44:22.452804+0000","last_became_active":"2024-09-10T08:28:35.572215+0000","last_became_peered":"2024-09-10T08:28:35.572215+0000","last_unstale":"2024-09-10T08:44:22.452804+0000","last_undegraded":"2024-09-10T08:44:22.452804+0000","last_fullsized":"2024-09-10T08:44:22.452804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4088,"log_dups_size":0,"ondisk_log_size":4088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:40.397318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21444,"num_write_kb":270258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'1129","reported_seq":1162,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.009048+0000","last_change":"2024-09-10T08:28:34.569235+0000","last_active":"2024-09-10T08:43:48.009048+0000","last_peered":"2024-09-10T08:43:48.009048+0000","last_clean":"2024-09-10T08:43:48.009048+0000","last_became_active":"2024-09-10T08:28:34.568899+0000","last_became_peered":"2024-09-10T08:28:34.568899+0000","last_unstale":"2024-09-10T08:43:48.009048+0000","last_undegraded":"2024-09-10T08:43:48.009048+0000","last_fullsized":"2024-09-10T08:43:48.009048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1129,"log_dups_size":0,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:21.927656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:30.440512+0000","last_change":"2024-09-10T08:28:46.618502+0000","last_active":"2024-09-10T08:43:30.440512+0000","last_peered":"2024-09-10T08:43:30.440512+0000","last_clean":"2024-09-10T08:43:30.440512+0000","last_became_active":"2024-09-10T08:28:46.616824+0000","last_became_peered":"2024-09-10T08:28:46.616824+0000","last_unstale":"2024-09-10T08:43:30.440512+0000","last_undegraded":"2024-09-10T08:43:30.440512+0000","last_fullsized":"2024-09-10T08:43:30.440512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:06.554102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"27'4540","reported_seq":4563,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.406451+0000","last_change":"2024-09-10T08:28:47.627138+0000","last_active":"2024-09-10T08:44:29.406451+0000","last_peered":"2024-09-10T08:44:29.406451+0000","last_clean":"2024-09-10T08:44:29.406451+0000","last_became_active":"2024-09-10T08:28:47.626871+0000","last_became_peered":"2024-09-10T08:28:47.626871+0000","last_unstale":"2024-09-10T08:44:29.406451+0000","last_undegraded":"2024-09-10T08:44:29.406451+0000","last_fullsized":"2024-09-10T08:44:29.406451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4540,"log_dups_size":0,"ondisk_log_size":4540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:10.927283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23818,"num_write_kb":300351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"27'4200","reported_seq":4231,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.491988+0000","last_change":"2024-09-10T08:28:35.577024+0000","last_active":"2024-09-10T08:44:22.491988+0000","last_peered":"2024-09-10T08:44:22.491988+0000","last_clean":"2024-09-10T08:44:22.491988+0000","last_became_active":"2024-09-10T08:28:35.576771+0000","last_became_peered":"2024-09-10T08:28:35.576771+0000","last_unstale":"2024-09-10T08:44:22.491988+0000","last_undegraded":"2024-09-10T08:44:22.491988+0000","last_fullsized":"2024-09-10T08:44:22.491988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4200,"log_dups_size":0,"ondisk_log_size":4200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:07.162941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21158,"num_write_kb":256901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.001370+0000","last_change":"2024-09-10T08:28:34.561324+0000","last_active":"2024-09-10T08:43:48.001370+0000","last_peered":"2024-09-10T08:43:48.001370+0000","last_clean":"2024-09-10T08:43:48.001370+0000","last_became_active":"2024-09-10T08:28:34.560974+0000","last_became_peered":"2024-09-10T08:28:34.560974+0000","last_unstale":"2024-09-10T08:43:48.001370+0000","last_undegraded":"2024-09-10T08:43:48.001370+0000","last_fullsized":"2024-09-10T08:43:48.001370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:18.790965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.763262+0000","last_change":"2024-09-10T08:28:46.620411+0000","last_active":"2024-09-10T08:43:37.763262+0000","last_peered":"2024-09-10T08:43:37.763262+0000","last_clean":"2024-09-10T08:43:37.763262+0000","last_became_active":"2024-09-10T08:28:46.619553+0000","last_became_peered":"2024-09-10T08:28:46.619553+0000","last_unstale":"2024-09-10T08:43:37.763262+0000","last_undegraded":"2024-09-10T08:43:37.763262+0000","last_fullsized":"2024-09-10T08:43:37.763262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:04.414048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"27'4215","reported_seq":4238,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.402849+0000","last_change":"2024-09-10T08:28:47.628563+0000","last_active":"2024-09-10T08:44:29.402849+0000","last_peered":"2024-09-10T08:44:29.402849+0000","last_clean":"2024-09-10T08:44:29.402849+0000","last_became_active":"2024-09-10T08:28:47.628290+0000","last_became_peered":"2024-09-10T08:28:47.628290+0000","last_unstale":"2024-09-10T08:44:29.402849+0000","last_undegraded":"2024-09-10T08:44:29.402849+0000","last_fullsized":"2024-09-10T08:44:29.402849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:15.652718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21334,"num_write_kb":282217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'4711","reported_seq":4742,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.503605+0000","last_change":"2024-09-10T08:28:35.572363+0000","last_active":"2024-09-10T08:44:22.503605+0000","last_peered":"2024-09-10T08:44:22.503605+0000","last_clean":"2024-09-10T08:44:22.503605+0000","last_became_active":"2024-09-10T08:28:35.572108+0000","last_became_peered":"2024-09-10T08:28:35.572108+0000","last_unstale":"2024-09-10T08:44:22.503605+0000","last_undegraded":"2024-09-10T08:44:22.503605+0000","last_fullsized":"2024-09-10T08:44:22.503605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4711,"log_dups_size":0,"ondisk_log_size":4711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:48.358634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24668,"num_write_kb":303691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.969574+0000","last_change":"2024-09-10T08:28:34.564813+0000","last_active":"2024-09-10T08:43:47.969574+0000","last_peered":"2024-09-10T08:43:47.969574+0000","last_clean":"2024-09-10T08:43:47.969574+0000","last_became_active":"2024-09-10T08:28:34.564557+0000","last_became_peered":"2024-09-10T08:28:34.564557+0000","last_unstale":"2024-09-10T08:43:47.969574+0000","last_undegraded":"2024-09-10T08:43:47.969574+0000","last_fullsized":"2024-09-10T08:43:47.969574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:48.356069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.846008+0000","last_change":"2024-09-10T08:28:46.625346+0000","last_active":"2024-09-10T08:43:37.846008+0000","last_peered":"2024-09-10T08:43:37.846008+0000","last_clean":"2024-09-10T08:43:37.846008+0000","last_became_active":"2024-09-10T08:28:46.625059+0000","last_became_peered":"2024-09-10T08:28:46.625059+0000","last_unstale":"2024-09-10T08:43:37.846008+0000","last_undegraded":"2024-09-10T08:43:37.846008+0000","last_fullsized":"2024-09-10T08:43:37.846008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:44.512285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"27'5035","reported_seq":5058,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.979988+0000","last_change":"2024-09-10T08:28:47.621307+0000","last_active":"2024-09-10T08:44:29.979988+0000","last_peered":"2024-09-10T08:44:29.979988+0000","last_clean":"2024-09-10T08:44:29.979988+0000","last_became_active":"2024-09-10T08:28:47.621043+0000","last_became_peered":"2024-09-10T08:28:47.621043+0000","last_unstale":"2024-09-10T08:44:29.979988+0000","last_undegraded":"2024-09-10T08:44:29.979988+0000","last_fullsized":"2024-09-10T08:44:29.979988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5035,"log_dups_size":0,"ondisk_log_size":5035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:30.300108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25734,"num_write_kb":340789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"27'4207","reported_seq":4238,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.428180+0000","last_change":"2024-09-10T08:28:35.569938+0000","last_active":"2024-09-10T08:44:22.428180+0000","last_peered":"2024-09-10T08:44:22.428180+0000","last_clean":"2024-09-10T08:44:22.428180+0000","last_became_active":"2024-09-10T08:28:35.569109+0000","last_became_peered":"2024-09-10T08:28:35.569109+0000","last_unstale":"2024-09-10T08:44:22.428180+0000","last_undegraded":"2024-09-10T08:44:22.428180+0000","last_fullsized":"2024-09-10T08:44:22.428180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4207,"log_dups_size":0,"ondisk_log_size":4207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:51.680564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21000,"num_write_kb":276623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.000341+0000","last_change":"2024-09-10T08:28:34.571069+0000","last_active":"2024-09-10T08:43:48.000341+0000","last_peered":"2024-09-10T08:43:48.000341+0000","last_clean":"2024-09-10T08:43:48.000341+0000","last_became_active":"2024-09-10T08:28:34.570766+0000","last_became_peered":"2024-09-10T08:28:34.570766+0000","last_unstale":"2024-09-10T08:43:48.000341+0000","last_undegraded":"2024-09-10T08:43:48.000341+0000","last_fullsized":"2024-09-10T08:43:48.000341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:47.458195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.830412+0000","last_change":"2024-09-10T08:28:46.616531+0000","last_active":"2024-09-10T08:43:37.830412+0000","last_peered":"2024-09-10T08:43:37.830412+0000","last_clean":"2024-09-10T08:43:37.830412+0000","last_became_active":"2024-09-10T08:28:46.616254+0000","last_became_peered":"2024-09-10T08:28:46.616254+0000","last_unstale":"2024-09-10T08:43:37.830412+0000","last_undegraded":"2024-09-10T08:43:37.830412+0000","last_fullsized":"2024-09-10T08:43:37.830412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:44.162368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"27'4342","reported_seq":4365,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.372206+0000","last_change":"2024-09-10T08:28:47.628177+0000","last_active":"2024-09-10T08:44:29.372206+0000","last_peered":"2024-09-10T08:44:29.372206+0000","last_clean":"2024-09-10T08:44:29.372206+0000","last_became_active":"2024-09-10T08:28:47.627869+0000","last_became_peered":"2024-09-10T08:28:47.627869+0000","last_unstale":"2024-09-10T08:44:29.372206+0000","last_undegraded":"2024-09-10T08:44:29.372206+0000","last_fullsized":"2024-09-10T08:44:29.372206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:19.075558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23056,"num_write_kb":285008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"27'4228","reported_seq":4260,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.475684+0000","last_change":"2024-09-10T08:28:35.575106+0000","last_active":"2024-09-10T08:44:22.475684+0000","last_peered":"2024-09-10T08:44:22.475684+0000","last_clean":"2024-09-10T08:44:22.475684+0000","last_became_active":"2024-09-10T08:28:35.574815+0000","last_became_peered":"2024-09-10T08:28:35.574815+0000","last_unstale":"2024-09-10T08:44:22.475684+0000","last_undegraded":"2024-09-10T08:44:22.475684+0000","last_fullsized":"2024-09-10T08:44:22.475684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4228,"log_dups_size":0,"ondisk_log_size":4228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21299,"num_write_kb":257333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.990461+0000","last_change":"2024-09-10T08:28:34.564865+0000","last_active":"2024-09-10T08:43:47.990461+0000","last_peered":"2024-09-10T08:43:47.990461+0000","last_clean":"2024-09-10T08:43:47.990461+0000","last_became_active":"2024-09-10T08:28:34.564549+0000","last_became_peered":"2024-09-10T08:28:34.564549+0000","last_unstale":"2024-09-10T08:43:47.990461+0000","last_undegraded":"2024-09-10T08:43:47.990461+0000","last_fullsized":"2024-09-10T08:43:47.990461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:05.523637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'53","reported_seq":129,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:43.064352+0000","last_change":"2024-09-10T08:28:46.622505+0000","last_active":"2024-09-10T08:43:43.064352+0000","last_peered":"2024-09-10T08:43:43.064352+0000","last_clean":"2024-09-10T08:43:43.064352+0000","last_became_active":"2024-09-10T08:28:46.621052+0000","last_became_peered":"2024-09-10T08:28:46.621052+0000","last_unstale":"2024-09-10T08:43:43.064352+0000","last_undegraded":"2024-09-10T08:43:43.064352+0000","last_fullsized":"2024-09-10T08:43:43.064352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:37.411404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":121,"num_write":51,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"27'4494","reported_seq":4517,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.358623+0000","last_change":"2024-09-10T08:28:47.624919+0000","last_active":"2024-09-10T08:44:29.358623+0000","last_peered":"2024-09-10T08:44:29.358623+0000","last_clean":"2024-09-10T08:44:29.358623+0000","last_became_active":"2024-09-10T08:28:47.624651+0000","last_became_peered":"2024-09-10T08:28:47.624651+0000","last_unstale":"2024-09-10T08:44:29.358623+0000","last_undegraded":"2024-09-10T08:44:29.358623+0000","last_fullsized":"2024-09-10T08:44:29.358623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4494,"log_dups_size":0,"ondisk_log_size":4494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:11.049160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23585,"num_write_kb":291272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'4460","reported_seq":4491,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.508365+0000","last_change":"2024-09-10T08:28:35.574107+0000","last_active":"2024-09-10T08:44:22.508365+0000","last_peered":"2024-09-10T08:44:22.508365+0000","last_clean":"2024-09-10T08:44:22.508365+0000","last_became_active":"2024-09-10T08:28:35.573851+0000","last_became_peered":"2024-09-10T08:28:35.573851+0000","last_unstale":"2024-09-10T08:44:22.508365+0000","last_undegraded":"2024-09-10T08:44:22.508365+0000","last_fullsized":"2024-09-10T08:44:22.508365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4460,"log_dups_size":0,"ondisk_log_size":4460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:53.240223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22566,"num_write_kb":290967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'599","reported_seq":632,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.994651+0000","last_change":"2024-09-10T08:28:34.563451+0000","last_active":"2024-09-10T08:43:47.994651+0000","last_peered":"2024-09-10T08:43:47.994651+0000","last_clean":"2024-09-10T08:43:47.994651+0000","last_became_active":"2024-09-10T08:28:34.563259+0000","last_became_peered":"2024-09-10T08:28:34.563259+0000","last_unstale":"2024-09-10T08:43:47.994651+0000","last_undegraded":"2024-09-10T08:43:47.994651+0000","last_fullsized":"2024-09-10T08:43:47.994651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:44.899351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1430,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.807587+0000","last_change":"2024-09-10T08:28:46.623396+0000","last_active":"2024-09-10T08:43:37.807587+0000","last_peered":"2024-09-10T08:43:37.807587+0000","last_clean":"2024-09-10T08:43:37.807587+0000","last_became_active":"2024-09-10T08:28:46.623139+0000","last_became_peered":"2024-09-10T08:28:46.623139+0000","last_unstale":"2024-09-10T08:43:37.807587+0000","last_undegraded":"2024-09-10T08:43:37.807587+0000","last_fullsized":"2024-09-10T08:43:37.807587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:00.210413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"27'4787","reported_seq":4810,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.341999+0000","last_change":"2024-09-10T08:28:47.634754+0000","last_active":"2024-09-10T08:44:29.341999+0000","last_peered":"2024-09-10T08:44:29.341999+0000","last_clean":"2024-09-10T08:44:29.341999+0000","last_became_active":"2024-09-10T08:28:47.634382+0000","last_became_peered":"2024-09-10T08:28:47.634382+0000","last_unstale":"2024-09-10T08:44:29.341999+0000","last_undegraded":"2024-09-10T08:44:29.341999+0000","last_fullsized":"2024-09-10T08:44:29.341999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4787,"log_dups_size":0,"ondisk_log_size":4787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:23.489596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24922,"num_write_kb":313092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"27'4927","reported_seq":4958,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.461013+0000","last_change":"2024-09-10T08:28:35.567481+0000","last_active":"2024-09-10T08:44:22.461013+0000","last_peered":"2024-09-10T08:44:22.461013+0000","last_clean":"2024-09-10T08:44:22.461013+0000","last_became_active":"2024-09-10T08:28:35.567167+0000","last_became_peered":"2024-09-10T08:28:35.567167+0000","last_unstale":"2024-09-10T08:44:22.461013+0000","last_undegraded":"2024-09-10T08:44:22.461013+0000","last_fullsized":"2024-09-10T08:44:22.461013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4927,"log_dups_size":0,"ondisk_log_size":4927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:44.110012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25981,"num_write_kb":313006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.989517+0000","last_change":"2024-09-10T08:28:34.571283+0000","last_active":"2024-09-10T08:43:47.989517+0000","last_peered":"2024-09-10T08:43:47.989517+0000","last_clean":"2024-09-10T08:43:47.989517+0000","last_became_active":"2024-09-10T08:28:34.570791+0000","last_became_peered":"2024-09-10T08:28:34.570791+0000","last_unstale":"2024-09-10T08:43:47.989517+0000","last_undegraded":"2024-09-10T08:43:47.989517+0000","last_fullsized":"2024-09-10T08:43:47.989517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:17.427597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:25.817729+0000","last_change":"2024-09-10T08:28:46.630983+0000","last_active":"2024-09-10T08:43:25.817729+0000","last_peered":"2024-09-10T08:43:25.817729+0000","last_clean":"2024-09-10T08:43:25.817729+0000","last_became_active":"2024-09-10T08:28:46.630658+0000","last_became_peered":"2024-09-10T08:28:46.630658+0000","last_unstale":"2024-09-10T08:43:25.817729+0000","last_undegraded":"2024-09-10T08:43:25.817729+0000","last_fullsized":"2024-09-10T08:43:25.817729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"27'4308","reported_seq":4332,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.419125+0000","last_change":"2024-09-10T08:28:47.625475+0000","last_active":"2024-09-10T08:44:29.419125+0000","last_peered":"2024-09-10T08:44:29.419125+0000","last_clean":"2024-09-10T08:44:29.419125+0000","last_became_active":"2024-09-10T08:28:47.625186+0000","last_became_peered":"2024-09-10T08:28:47.625186+0000","last_unstale":"2024-09-10T08:44:29.419125+0000","last_undegraded":"2024-09-10T08:44:29.419125+0000","last_fullsized":"2024-09-10T08:44:29.419125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4308,"log_dups_size":0,"ondisk_log_size":4308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23330,"num_write_kb":286070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'4301","reported_seq":4332,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.444485+0000","last_change":"2024-09-10T08:28:35.576280+0000","last_active":"2024-09-10T08:44:22.444485+0000","last_peered":"2024-09-10T08:44:22.444485+0000","last_clean":"2024-09-10T08:44:22.444485+0000","last_became_active":"2024-09-10T08:28:35.576002+0000","last_became_peered":"2024-09-10T08:28:35.576002+0000","last_unstale":"2024-09-10T08:44:22.444485+0000","last_undegraded":"2024-09-10T08:44:22.444485+0000","last_fullsized":"2024-09-10T08:44:22.444485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4301,"log_dups_size":0,"ondisk_log_size":4301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:46.278441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22897,"num_write_kb":271992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.974079+0000","last_change":"2024-09-10T08:28:34.555212+0000","last_active":"2024-09-10T08:43:47.974079+0000","last_peered":"2024-09-10T08:43:47.974079+0000","last_clean":"2024-09-10T08:43:47.974079+0000","last_became_active":"2024-09-10T08:28:34.554922+0000","last_became_peered":"2024-09-10T08:28:34.554922+0000","last_unstale":"2024-09-10T08:43:47.974079+0000","last_undegraded":"2024-09-10T08:43:47.974079+0000","last_fullsized":"2024-09-10T08:43:47.974079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:46.222597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.824479+0000","last_change":"2024-09-10T08:28:46.624886+0000","last_active":"2024-09-10T08:43:37.824479+0000","last_peered":"2024-09-10T08:43:37.824479+0000","last_clean":"2024-09-10T08:43:37.824479+0000","last_became_active":"2024-09-10T08:28:46.624690+0000","last_became_peered":"2024-09-10T08:28:46.624690+0000","last_unstale":"2024-09-10T08:43:37.824479+0000","last_undegraded":"2024-09-10T08:43:37.824479+0000","last_fullsized":"2024-09-10T08:43:37.824479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:15.023379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"27'4253","reported_seq":4277,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.376906+0000","last_change":"2024-09-10T08:28:47.634161+0000","last_active":"2024-09-10T08:44:29.376906+0000","last_peered":"2024-09-10T08:44:29.376906+0000","last_clean":"2024-09-10T08:44:29.376906+0000","last_became_active":"2024-09-10T08:28:47.633893+0000","last_became_peered":"2024-09-10T08:28:47.633893+0000","last_unstale":"2024-09-10T08:44:29.376906+0000","last_undegraded":"2024-09-10T08:44:29.376906+0000","last_fullsized":"2024-09-10T08:44:29.376906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4253,"log_dups_size":0,"ondisk_log_size":4253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22807,"num_write_kb":271856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'4548","reported_seq":4579,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.464810+0000","last_change":"2024-09-10T08:28:35.577978+0000","last_active":"2024-09-10T08:44:22.464810+0000","last_peered":"2024-09-10T08:44:22.464810+0000","last_clean":"2024-09-10T08:44:22.464810+0000","last_became_active":"2024-09-10T08:28:35.577718+0000","last_became_peered":"2024-09-10T08:28:35.577718+0000","last_unstale":"2024-09-10T08:44:22.464810+0000","last_undegraded":"2024-09-10T08:44:22.464810+0000","last_fullsized":"2024-09-10T08:44:22.464810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4548,"log_dups_size":0,"ondisk_log_size":4548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:01:57.257817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24326,"num_write_kb":290026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.003029+0000","last_change":"2024-09-10T08:28:34.553983+0000","last_active":"2024-09-10T08:43:48.003029+0000","last_peered":"2024-09-10T08:43:48.003029+0000","last_clean":"2024-09-10T08:43:48.003029+0000","last_became_active":"2024-09-10T08:28:34.553693+0000","last_became_peered":"2024-09-10T08:28:34.553693+0000","last_unstale":"2024-09-10T08:43:48.003029+0000","last_undegraded":"2024-09-10T08:43:48.003029+0000","last_fullsized":"2024-09-10T08:43:48.003029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:40.001685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.780271+0000","last_change":"2024-09-10T08:28:46.620165+0000","last_active":"2024-09-10T08:43:37.780271+0000","last_peered":"2024-09-10T08:43:37.780271+0000","last_clean":"2024-09-10T08:43:37.780271+0000","last_became_active":"2024-09-10T08:28:46.619853+0000","last_became_peered":"2024-09-10T08:28:46.619853+0000","last_unstale":"2024-09-10T08:43:37.780271+0000","last_undegraded":"2024-09-10T08:43:37.780271+0000","last_fullsized":"2024-09-10T08:43:37.780271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:36.006532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'3675","reported_seq":3698,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.383338+0000","last_change":"2024-09-10T08:28:47.621588+0000","last_active":"2024-09-10T08:44:29.383338+0000","last_peered":"2024-09-10T08:44:29.383338+0000","last_clean":"2024-09-10T08:44:29.383338+0000","last_became_active":"2024-09-10T08:28:47.621122+0000","last_became_peered":"2024-09-10T08:28:47.621122+0000","last_unstale":"2024-09-10T08:44:29.383338+0000","last_undegraded":"2024-09-10T08:44:29.383338+0000","last_fullsized":"2024-09-10T08:44:29.383338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3675,"log_dups_size":0,"ondisk_log_size":3675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:11.250838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18710,"num_write_kb":246893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'4629","reported_seq":4661,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.445776+0000","last_change":"2024-09-10T08:28:35.566745+0000","last_active":"2024-09-10T08:44:22.445776+0000","last_peered":"2024-09-10T08:44:22.445776+0000","last_clean":"2024-09-10T08:44:22.445776+0000","last_became_active":"2024-09-10T08:28:35.566444+0000","last_became_peered":"2024-09-10T08:28:35.566444+0000","last_unstale":"2024-09-10T08:44:22.445776+0000","last_undegraded":"2024-09-10T08:44:22.445776+0000","last_fullsized":"2024-09-10T08:44:22.445776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4629,"log_dups_size":0,"ondisk_log_size":4629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:52.735296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24423,"num_write_kb":290556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'60","reported_seq":151,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:38.178514+0000","last_change":"2024-09-10T08:28:34.560745+0000","last_active":"2024-09-10T08:43:38.178514+0000","last_peered":"2024-09-10T08:43:38.178514+0000","last_clean":"2024-09-10T08:43:38.178514+0000","last_became_active":"2024-09-10T08:28:34.559911+0000","last_became_peered":"2024-09-10T08:28:34.559911+0000","last_unstale":"2024-09-10T08:43:38.178514+0000","last_undegraded":"2024-09-10T08:43:38.178514+0000","last_fullsized":"2024-09-10T08:43:38.178514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:00.234067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":129,"num_write":58,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.785296+0000","last_change":"2024-09-10T08:28:46.623886+0000","last_active":"2024-09-10T08:43:37.785296+0000","last_peered":"2024-09-10T08:43:37.785296+0000","last_clean":"2024-09-10T08:43:37.785296+0000","last_became_active":"2024-09-10T08:28:46.622790+0000","last_became_peered":"2024-09-10T08:28:46.622790+0000","last_unstale":"2024-09-10T08:43:37.785296+0000","last_undegraded":"2024-09-10T08:43:37.785296+0000","last_fullsized":"2024-09-10T08:43:37.785296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:06:32.333116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"27'4388","reported_seq":4411,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.440297+0000","last_change":"2024-09-10T08:28:47.634500+0000","last_active":"2024-09-10T08:44:29.440297+0000","last_peered":"2024-09-10T08:44:29.440297+0000","last_clean":"2024-09-10T08:44:29.440297+0000","last_became_active":"2024-09-10T08:28:47.634219+0000","last_became_peered":"2024-09-10T08:28:47.634219+0000","last_unstale":"2024-09-10T08:44:29.440297+0000","last_undegraded":"2024-09-10T08:44:29.440297+0000","last_fullsized":"2024-09-10T08:44:29.440297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4388,"log_dups_size":0,"ondisk_log_size":4388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:59.689554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22741,"num_write_kb":291819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"27'4638","reported_seq":4670,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.452837+0000","last_change":"2024-09-10T08:28:35.576360+0000","last_active":"2024-09-10T08:44:22.452837+0000","last_peered":"2024-09-10T08:44:22.452837+0000","last_clean":"2024-09-10T08:44:22.452837+0000","last_became_active":"2024-09-10T08:28:35.576096+0000","last_became_peered":"2024-09-10T08:28:35.576096+0000","last_unstale":"2024-09-10T08:44:22.452837+0000","last_undegraded":"2024-09-10T08:44:22.452837+0000","last_fullsized":"2024-09-10T08:44:22.452837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4638,"log_dups_size":0,"ondisk_log_size":4638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24206,"num_write_kb":293700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.010129+0000","last_change":"2024-09-10T08:28:34.568477+0000","last_active":"2024-09-10T08:43:48.010129+0000","last_peered":"2024-09-10T08:43:48.010129+0000","last_clean":"2024-09-10T08:43:48.010129+0000","last_became_active":"2024-09-10T08:28:34.568249+0000","last_became_peered":"2024-09-10T08:28:34.568249+0000","last_unstale":"2024-09-10T08:43:48.010129+0000","last_undegraded":"2024-09-10T08:43:48.010129+0000","last_fullsized":"2024-09-10T08:43:48.010129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:08.640043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'605","reported_seq":631,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:00.831520+0000","last_change":"2024-09-10T08:28:46.621567+0000","last_active":"2024-09-10T08:44:00.831520+0000","last_peered":"2024-09-10T08:44:00.831520+0000","last_clean":"2024-09-10T08:44:00.831520+0000","last_became_active":"2024-09-10T08:28:46.621272+0000","last_became_peered":"2024-09-10T08:28:46.621272+0000","last_unstale":"2024-09-10T08:44:00.831520+0000","last_undegraded":"2024-09-10T08:44:00.831520+0000","last_fullsized":"2024-09-10T08:44:00.831520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1451,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"27'4536","reported_seq":4559,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.455805+0000","last_change":"2024-09-10T08:28:47.631621+0000","last_active":"2024-09-10T08:44:29.455805+0000","last_peered":"2024-09-10T08:44:29.455805+0000","last_clean":"2024-09-10T08:44:29.455805+0000","last_became_active":"2024-09-10T08:28:47.631337+0000","last_became_peered":"2024-09-10T08:28:47.631337+0000","last_unstale":"2024-09-10T08:44:29.455805+0000","last_undegraded":"2024-09-10T08:44:29.455805+0000","last_fullsized":"2024-09-10T08:44:29.455805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4536,"log_dups_size":0,"ondisk_log_size":4536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:04.196705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23763,"num_write_kb":304142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"27'4950","reported_seq":4981,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.485120+0000","last_change":"2024-09-10T08:28:35.572658+0000","last_active":"2024-09-10T08:44:22.485120+0000","last_peered":"2024-09-10T08:44:22.485120+0000","last_clean":"2024-09-10T08:44:22.485120+0000","last_became_active":"2024-09-10T08:28:35.571611+0000","last_became_peered":"2024-09-10T08:28:35.571611+0000","last_unstale":"2024-09-10T08:44:22.485120+0000","last_undegraded":"2024-09-10T08:44:22.485120+0000","last_fullsized":"2024-09-10T08:44:22.485120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4950,"log_dups_size":0,"ondisk_log_size":4950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:42.726996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25652,"num_write_kb":316024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:41:05.971983+0000","last_change":"2024-09-10T08:28:34.555587+0000","last_active":"2024-09-10T08:41:05.971983+0000","last_peered":"2024-09-10T08:41:05.971983+0000","last_clean":"2024-09-10T08:41:05.971983+0000","last_became_active":"2024-09-10T08:28:34.555269+0000","last_became_peered":"2024-09-10T08:28:34.555269+0000","last_unstale":"2024-09-10T08:41:05.971983+0000","last_undegraded":"2024-09-10T08:41:05.971983+0000","last_fullsized":"2024-09-10T08:41:05.971983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:19.499870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":190,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:42:26.593595+0000","last_change":"2024-09-10T08:28:26.724394+0000","last_active":"2024-09-10T08:42:26.593595+0000","last_peered":"2024-09-10T08:42:26.593595+0000","last_clean":"2024-09-10T08:42:26.593595+0000","last_became_active":"2024-09-10T08:28:26.723452+0000","last_became_peered":"2024-09-10T08:28:26.723452+0000","last_unstale":"2024-09-10T08:42:26.593595+0000","last_undegraded":"2024-09-10T08:42:26.593595+0000","last_fullsized":"2024-09-10T08:42:26.593595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:25.445753+0000","last_clean_scrub_stamp":"2024-09-10T08:28:25.445753+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:00.811505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.779193+0000","last_change":"2024-09-10T08:28:46.622048+0000","last_active":"2024-09-10T08:43:37.779193+0000","last_peered":"2024-09-10T08:43:37.779193+0000","last_clean":"2024-09-10T08:43:37.779193+0000","last_became_active":"2024-09-10T08:28:46.621770+0000","last_became_peered":"2024-09-10T08:28:46.621770+0000","last_unstale":"2024-09-10T08:43:37.779193+0000","last_undegraded":"2024-09-10T08:43:37.779193+0000","last_fullsized":"2024-09-10T08:43:37.779193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:51.430760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"27'3353","reported_seq":3376,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.382825+0000","last_change":"2024-09-10T08:28:47.620746+0000","last_active":"2024-09-10T08:44:29.382825+0000","last_peered":"2024-09-10T08:44:29.382825+0000","last_clean":"2024-09-10T08:44:29.382825+0000","last_became_active":"2024-09-10T08:28:47.620492+0000","last_became_peered":"2024-09-10T08:28:47.620492+0000","last_unstale":"2024-09-10T08:44:29.382825+0000","last_undegraded":"2024-09-10T08:44:29.382825+0000","last_fullsized":"2024-09-10T08:44:29.382825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3353,"log_dups_size":0,"ondisk_log_size":3353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:40.117978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16947,"num_write_kb":239873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'4450","reported_seq":4481,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.537803+0000","last_change":"2024-09-10T08:28:35.574532+0000","last_active":"2024-09-10T08:44:22.537803+0000","last_peered":"2024-09-10T08:44:22.537803+0000","last_clean":"2024-09-10T08:44:22.537803+0000","last_became_active":"2024-09-10T08:28:35.574215+0000","last_became_peered":"2024-09-10T08:28:35.574215+0000","last_unstale":"2024-09-10T08:44:22.537803+0000","last_undegraded":"2024-09-10T08:44:22.537803+0000","last_fullsized":"2024-09-10T08:44:22.537803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4450,"log_dups_size":0,"ondisk_log_size":4450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:28.455653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23087,"num_write_kb":297343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:35.033572+0000","last_change":"2024-09-10T08:28:34.559911+0000","last_active":"2024-09-10T08:43:35.033572+0000","last_peered":"2024-09-10T08:43:35.033572+0000","last_clean":"2024-09-10T08:43:35.033572+0000","last_became_active":"2024-09-10T08:28:34.559635+0000","last_became_peered":"2024-09-10T08:28:34.559635+0000","last_unstale":"2024-09-10T08:43:35.033572+0000","last_undegraded":"2024-09-10T08:43:35.033572+0000","last_fullsized":"2024-09-10T08:43:35.033572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:40.892609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.843424+0000","last_change":"2024-09-10T08:28:46.620352+0000","last_active":"2024-09-10T08:43:37.843424+0000","last_peered":"2024-09-10T08:43:37.843424+0000","last_clean":"2024-09-10T08:43:37.843424+0000","last_became_active":"2024-09-10T08:28:46.620064+0000","last_became_peered":"2024-09-10T08:28:46.620064+0000","last_unstale":"2024-09-10T08:43:37.843424+0000","last_undegraded":"2024-09-10T08:43:37.843424+0000","last_fullsized":"2024-09-10T08:43:37.843424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:59.333579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"27'3678","reported_seq":3701,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.377144+0000","last_change":"2024-09-10T08:28:47.620305+0000","last_active":"2024-09-10T08:44:29.377144+0000","last_peered":"2024-09-10T08:44:29.377144+0000","last_clean":"2024-09-10T08:44:29.377144+0000","last_became_active":"2024-09-10T08:28:47.620014+0000","last_became_peered":"2024-09-10T08:28:47.620014+0000","last_unstale":"2024-09-10T08:44:29.377144+0000","last_undegraded":"2024-09-10T08:44:29.377144+0000","last_fullsized":"2024-09-10T08:44:29.377144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3678,"log_dups_size":0,"ondisk_log_size":3678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:44.916136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19171,"num_write_kb":261286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'5065","reported_seq":5096,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.514606+0000","last_change":"2024-09-10T08:28:35.577124+0000","last_active":"2024-09-10T08:44:22.514606+0000","last_peered":"2024-09-10T08:44:22.514606+0000","last_clean":"2024-09-10T08:44:22.514606+0000","last_became_active":"2024-09-10T08:28:35.576655+0000","last_became_peered":"2024-09-10T08:28:35.576655+0000","last_unstale":"2024-09-10T08:44:22.514606+0000","last_undegraded":"2024-09-10T08:44:22.514606+0000","last_fullsized":"2024-09-10T08:44:22.514606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5065,"log_dups_size":0,"ondisk_log_size":5065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:29.878600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26367,"num_write_kb":318681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:35.039309+0000","last_change":"2024-09-10T08:28:34.560694+0000","last_active":"2024-09-10T08:43:35.039309+0000","last_peered":"2024-09-10T08:43:35.039309+0000","last_clean":"2024-09-10T08:43:35.039309+0000","last_became_active":"2024-09-10T08:28:34.560429+0000","last_became_peered":"2024-09-10T08:28:34.560429+0000","last_unstale":"2024-09-10T08:43:35.039309+0000","last_undegraded":"2024-09-10T08:43:35.039309+0000","last_fullsized":"2024-09-10T08:43:35.039309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:54.514467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'1099","reported_seq":1125,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:35.835457+0000","last_change":"2024-09-10T08:28:46.622232+0000","last_active":"2024-09-10T08:44:35.835457+0000","last_peered":"2024-09-10T08:44:35.835457+0000","last_clean":"2024-09-10T08:44:35.835457+0000","last_became_active":"2024-09-10T08:28:46.621966+0000","last_became_peered":"2024-09-10T08:28:46.621966+0000","last_unstale":"2024-09-10T08:44:35.835457+0000","last_undegraded":"2024-09-10T08:44:35.835457+0000","last_fullsized":"2024-09-10T08:44:35.835457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":1099,"log_dups_size":0,"ondisk_log_size":1099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1090,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"27'4366","reported_seq":4389,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.312771+0000","last_change":"2024-09-10T08:28:47.630602+0000","last_active":"2024-09-10T08:44:29.312771+0000","last_peered":"2024-09-10T08:44:29.312771+0000","last_clean":"2024-09-10T08:44:29.312771+0000","last_became_active":"2024-09-10T08:28:47.630234+0000","last_became_peered":"2024-09-10T08:28:47.630234+0000","last_unstale":"2024-09-10T08:44:29.312771+0000","last_undegraded":"2024-09-10T08:44:29.312771+0000","last_fullsized":"2024-09-10T08:44:29.312771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4366,"log_dups_size":0,"ondisk_log_size":4366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:03.808098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22466,"num_write_kb":282639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"27'5771","reported_seq":5802,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.572787+0000","last_change":"2024-09-10T08:28:35.577577+0000","last_active":"2024-09-10T08:44:22.572787+0000","last_peered":"2024-09-10T08:44:22.572787+0000","last_clean":"2024-09-10T08:44:22.572787+0000","last_became_active":"2024-09-10T08:28:35.576686+0000","last_became_peered":"2024-09-10T08:28:35.576686+0000","last_unstale":"2024-09-10T08:44:22.572787+0000","last_undegraded":"2024-09-10T08:44:22.572787+0000","last_fullsized":"2024-09-10T08:44:22.572787+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5671,"log_dups_size":0,"ondisk_log_size":5671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:37:36.334494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29457,"num_write_kb":355657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'6","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.996141+0000","last_change":"2024-09-10T08:28:34.560313+0000","last_active":"2024-09-10T08:43:47.996141+0000","last_peered":"2024-09-10T08:43:47.996141+0000","last_clean":"2024-09-10T08:43:47.996141+0000","last_became_active":"2024-09-10T08:28:34.560035+0000","last_became_peered":"2024-09-10T08:28:34.560035+0000","last_unstale":"2024-09-10T08:43:47.996141+0000","last_undegraded":"2024-09-10T08:43:47.996141+0000","last_fullsized":"2024-09-10T08:43:47.996141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:56.945537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.793333+0000","last_change":"2024-09-10T08:28:46.623371+0000","last_active":"2024-09-10T08:43:37.793333+0000","last_peered":"2024-09-10T08:43:37.793333+0000","last_clean":"2024-09-10T08:43:37.793333+0000","last_became_active":"2024-09-10T08:28:46.623092+0000","last_became_peered":"2024-09-10T08:28:46.623092+0000","last_unstale":"2024-09-10T08:43:37.793333+0000","last_undegraded":"2024-09-10T08:43:37.793333+0000","last_fullsized":"2024-09-10T08:43:37.793333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:36.359127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"27'4470","reported_seq":4493,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.335120+0000","last_change":"2024-09-10T08:28:47.619805+0000","last_active":"2024-09-10T08:44:29.335120+0000","last_peered":"2024-09-10T08:44:29.335120+0000","last_clean":"2024-09-10T08:44:29.335120+0000","last_became_active":"2024-09-10T08:28:47.619452+0000","last_became_peered":"2024-09-10T08:28:47.619452+0000","last_unstale":"2024-09-10T08:44:29.335120+0000","last_undegraded":"2024-09-10T08:44:29.335120+0000","last_fullsized":"2024-09-10T08:44:29.335120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4470,"log_dups_size":0,"ondisk_log_size":4470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:20.052707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23926,"num_write_kb":300839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"27'4014","reported_seq":4045,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.536870+0000","last_change":"2024-09-10T08:28:35.577476+0000","last_active":"2024-09-10T08:44:22.536870+0000","last_peered":"2024-09-10T08:44:22.536870+0000","last_clean":"2024-09-10T08:44:22.536870+0000","last_became_active":"2024-09-10T08:28:35.576786+0000","last_became_peered":"2024-09-10T08:28:35.576786+0000","last_unstale":"2024-09-10T08:44:22.536870+0000","last_undegraded":"2024-09-10T08:44:22.536870+0000","last_fullsized":"2024-09-10T08:44:22.536870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4014,"log_dups_size":0,"ondisk_log_size":4014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:46.914074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19823,"num_write_kb":276089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.005418+0000","last_change":"2024-09-10T08:28:34.551102+0000","last_active":"2024-09-10T08:43:48.005418+0000","last_peered":"2024-09-10T08:43:48.005418+0000","last_clean":"2024-09-10T08:43:48.005418+0000","last_became_active":"2024-09-10T08:28:34.550773+0000","last_became_peered":"2024-09-10T08:28:34.550773+0000","last_unstale":"2024-09-10T08:43:48.005418+0000","last_undegraded":"2024-09-10T08:43:48.005418+0000","last_fullsized":"2024-09-10T08:43:48.005418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:35.393695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'3","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.815410+0000","last_change":"2024-09-10T08:28:46.619639+0000","last_active":"2024-09-10T08:43:37.815410+0000","last_peered":"2024-09-10T08:43:37.815410+0000","last_clean":"2024-09-10T08:43:37.815410+0000","last_became_active":"2024-09-10T08:28:46.619330+0000","last_became_peered":"2024-09-10T08:28:46.619330+0000","last_unstale":"2024-09-10T08:43:37.815410+0000","last_undegraded":"2024-09-10T08:43:37.815410+0000","last_fullsized":"2024-09-10T08:43:37.815410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:10.371693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"27'3797","reported_seq":3819,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.367348+0000","last_change":"2024-09-10T08:28:47.633627+0000","last_active":"2024-09-10T08:44:29.367348+0000","last_peered":"2024-09-10T08:44:29.367348+0000","last_clean":"2024-09-10T08:44:29.367348+0000","last_became_active":"2024-09-10T08:28:47.633362+0000","last_became_peered":"2024-09-10T08:28:47.633362+0000","last_unstale":"2024-09-10T08:44:29.367348+0000","last_undegraded":"2024-09-10T08:44:29.367348+0000","last_fullsized":"2024-09-10T08:44:29.367348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3797,"log_dups_size":0,"ondisk_log_size":3797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:59:19.473028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19693,"num_write_kb":255099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"27'4998","reported_seq":5028,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.499387+0000","last_change":"2024-09-10T08:28:35.575307+0000","last_active":"2024-09-10T08:44:22.499387+0000","last_peered":"2024-09-10T08:44:22.499387+0000","last_clean":"2024-09-10T08:44:22.499387+0000","last_became_active":"2024-09-10T08:28:35.575038+0000","last_became_peered":"2024-09-10T08:28:35.575038+0000","last_unstale":"2024-09-10T08:44:22.499387+0000","last_undegraded":"2024-09-10T08:44:22.499387+0000","last_fullsized":"2024-09-10T08:44:22.499387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4998,"log_dups_size":0,"ondisk_log_size":4998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:36.478822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25962,"num_write_kb":304804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'11","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.948250+0000","last_change":"2024-09-10T08:28:34.555542+0000","last_active":"2024-09-10T08:43:47.948250+0000","last_peered":"2024-09-10T08:43:47.948250+0000","last_clean":"2024-09-10T08:43:47.948250+0000","last_became_active":"2024-09-10T08:28:34.555179+0000","last_became_peered":"2024-09-10T08:28:34.555179+0000","last_unstale":"2024-09-10T08:43:47.948250+0000","last_undegraded":"2024-09-10T08:43:47.948250+0000","last_fullsized":"2024-09-10T08:43:47.948250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:53.313161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.836746+0000","last_change":"2024-09-10T08:28:46.618615+0000","last_active":"2024-09-10T08:43:37.836746+0000","last_peered":"2024-09-10T08:43:37.836746+0000","last_clean":"2024-09-10T08:43:37.836746+0000","last_became_active":"2024-09-10T08:28:46.618318+0000","last_became_peered":"2024-09-10T08:28:46.618318+0000","last_unstale":"2024-09-10T08:43:37.836746+0000","last_undegraded":"2024-09-10T08:43:37.836746+0000","last_fullsized":"2024-09-10T08:43:37.836746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"27'4510","reported_seq":4532,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.460057+0000","last_change":"2024-09-10T08:28:47.625025+0000","last_active":"2024-09-10T08:44:29.460057+0000","last_peered":"2024-09-10T08:44:29.460057+0000","last_clean":"2024-09-10T08:44:29.460057+0000","last_became_active":"2024-09-10T08:28:47.624230+0000","last_became_peered":"2024-09-10T08:28:47.624230+0000","last_unstale":"2024-09-10T08:44:29.460057+0000","last_undegraded":"2024-09-10T08:44:29.460057+0000","last_fullsized":"2024-09-10T08:44:29.460057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4510,"log_dups_size":0,"ondisk_log_size":4510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:25.530264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23053,"num_write_kb":297434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'5001","reported_seq":5031,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.475930+0000","last_change":"2024-09-10T08:28:35.578892+0000","last_active":"2024-09-10T08:44:22.475930+0000","last_peered":"2024-09-10T08:44:22.475930+0000","last_clean":"2024-09-10T08:44:22.475930+0000","last_became_active":"2024-09-10T08:28:35.578299+0000","last_became_peered":"2024-09-10T08:28:35.578299+0000","last_unstale":"2024-09-10T08:44:22.475930+0000","last_undegraded":"2024-09-10T08:44:22.475930+0000","last_fullsized":"2024-09-10T08:44:22.475930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5001,"log_dups_size":0,"ondisk_log_size":5001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:27.485392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25723,"num_write_kb":320130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'6","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.992918+0000","last_change":"2024-09-10T08:28:34.560444+0000","last_active":"2024-09-10T08:43:47.992918+0000","last_peered":"2024-09-10T08:43:47.992918+0000","last_clean":"2024-09-10T08:43:47.992918+0000","last_became_active":"2024-09-10T08:28:34.560188+0000","last_became_peered":"2024-09-10T08:28:34.560188+0000","last_unstale":"2024-09-10T08:43:47.992918+0000","last_undegraded":"2024-09-10T08:43:47.992918+0000","last_fullsized":"2024-09-10T08:43:47.992918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:15.727780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:16.827380+0000","last_change":"2024-09-10T08:28:46.623483+0000","last_active":"2024-09-10T08:43:16.827380+0000","last_peered":"2024-09-10T08:43:16.827380+0000","last_clean":"2024-09-10T08:43:16.827380+0000","last_became_active":"2024-09-10T08:28:46.623211+0000","last_became_peered":"2024-09-10T08:28:46.623211+0000","last_unstale":"2024-09-10T08:43:16.827380+0000","last_undegraded":"2024-09-10T08:43:16.827380+0000","last_fullsized":"2024-09-10T08:43:16.827380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:24.611015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"27'4287","reported_seq":4309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.418397+0000","last_change":"2024-09-10T08:28:47.635185+0000","last_active":"2024-09-10T08:44:29.418397+0000","last_peered":"2024-09-10T08:44:29.418397+0000","last_clean":"2024-09-10T08:44:29.418397+0000","last_became_active":"2024-09-10T08:28:47.634782+0000","last_became_peered":"2024-09-10T08:28:47.634782+0000","last_unstale":"2024-09-10T08:44:29.418397+0000","last_undegraded":"2024-09-10T08:44:29.418397+0000","last_fullsized":"2024-09-10T08:44:29.418397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4287,"log_dups_size":0,"ondisk_log_size":4287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:05.512645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22519,"num_write_kb":282718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'5007","reported_seq":5037,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.563134+0000","last_change":"2024-09-10T08:28:35.575788+0000","last_active":"2024-09-10T08:44:22.563134+0000","last_peered":"2024-09-10T08:44:22.563134+0000","last_clean":"2024-09-10T08:44:22.563134+0000","last_became_active":"2024-09-10T08:28:35.575333+0000","last_became_peered":"2024-09-10T08:28:35.575333+0000","last_unstale":"2024-09-10T08:44:22.563134+0000","last_undegraded":"2024-09-10T08:44:22.563134+0000","last_fullsized":"2024-09-10T08:44:22.563134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5007,"log_dups_size":0,"ondisk_log_size":5007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:39.756390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25404,"num_write_kb":331142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.009202+0000","last_change":"2024-09-10T08:28:34.560699+0000","last_active":"2024-09-10T08:43:48.009202+0000","last_peered":"2024-09-10T08:43:48.009202+0000","last_clean":"2024-09-10T08:43:48.009202+0000","last_became_active":"2024-09-10T08:28:34.560376+0000","last_became_peered":"2024-09-10T08:28:34.560376+0000","last_unstale":"2024-09-10T08:43:48.009202+0000","last_undegraded":"2024-09-10T08:43:48.009202+0000","last_fullsized":"2024-09-10T08:43:48.009202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:09.981216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'327","reported_seq":351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.842658+0000","last_change":"2024-09-10T08:28:46.620745+0000","last_active":"2024-09-10T08:43:37.842658+0000","last_peered":"2024-09-10T08:43:37.842658+0000","last_clean":"2024-09-10T08:43:37.842658+0000","last_became_active":"2024-09-10T08:28:46.619030+0000","last_became_peered":"2024-09-10T08:28:46.619030+0000","last_unstale":"2024-09-10T08:43:37.842658+0000","last_undegraded":"2024-09-10T08:43:37.842658+0000","last_fullsized":"2024-09-10T08:43:37.842658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:07.653226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":4249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"27'6390","reported_seq":6412,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.443881+0000","last_change":"2024-09-10T08:28:47.626648+0000","last_active":"2024-09-10T08:44:29.443881+0000","last_peered":"2024-09-10T08:44:29.443881+0000","last_clean":"2024-09-10T08:44:29.443881+0000","last_became_active":"2024-09-10T08:28:47.626330+0000","last_became_peered":"2024-09-10T08:28:47.626330+0000","last_unstale":"2024-09-10T08:44:29.443881+0000","last_undegraded":"2024-09-10T08:44:29.443881+0000","last_fullsized":"2024-09-10T08:44:29.443881+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5190,"log_dups_size":0,"ondisk_log_size":5190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:02.346881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33857,"num_write_kb":406580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'4502","reported_seq":4533,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.486156+0000","last_change":"2024-09-10T08:28:35.574810+0000","last_active":"2024-09-10T08:44:22.486156+0000","last_peered":"2024-09-10T08:44:22.486156+0000","last_clean":"2024-09-10T08:44:22.486156+0000","last_became_active":"2024-09-10T08:28:35.574567+0000","last_became_peered":"2024-09-10T08:28:35.574567+0000","last_unstale":"2024-09-10T08:44:22.486156+0000","last_undegraded":"2024-09-10T08:44:22.486156+0000","last_fullsized":"2024-09-10T08:44:22.486156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4502,"log_dups_size":0,"ondisk_log_size":4502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23284,"num_write_kb":285817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'8","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.001341+0000","last_change":"2024-09-10T08:28:34.553556+0000","last_active":"2024-09-10T08:43:48.001341+0000","last_peered":"2024-09-10T08:43:48.001341+0000","last_clean":"2024-09-10T08:43:48.001341+0000","last_became_active":"2024-09-10T08:28:34.553275+0000","last_became_peered":"2024-09-10T08:28:34.553275+0000","last_unstale":"2024-09-10T08:43:48.001341+0000","last_undegraded":"2024-09-10T08:43:48.001341+0000","last_fullsized":"2024-09-10T08:43:48.001341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'29","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.870711+0000","last_change":"2024-09-10T08:28:46.619760+0000","last_active":"2024-09-10T08:43:37.870711+0000","last_peered":"2024-09-10T08:43:37.870711+0000","last_clean":"2024-09-10T08:43:37.870711+0000","last_became_active":"2024-09-10T08:28:46.619165+0000","last_became_peered":"2024-09-10T08:28:46.619165+0000","last_unstale":"2024-09-10T08:43:37.870711+0000","last_undegraded":"2024-09-10T08:43:37.870711+0000","last_fullsized":"2024-09-10T08:43:37.870711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:27.691197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"27'5339","reported_seq":5361,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.399784+0000","last_change":"2024-09-10T08:28:47.620135+0000","last_active":"2024-09-10T08:44:29.399784+0000","last_peered":"2024-09-10T08:44:29.399784+0000","last_clean":"2024-09-10T08:44:29.399784+0000","last_became_active":"2024-09-10T08:28:47.619661+0000","last_became_peered":"2024-09-10T08:28:47.619661+0000","last_unstale":"2024-09-10T08:44:29.399784+0000","last_undegraded":"2024-09-10T08:44:29.399784+0000","last_fullsized":"2024-09-10T08:44:29.399784+0000","mapping_epoch":23,"log_start":"27'100","ondisk_log_start":"27'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:34.815426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27578,"num_write_kb":340014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'4089","reported_seq":4119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.533296+0000","last_change":"2024-09-10T08:28:35.582473+0000","last_active":"2024-09-10T08:44:22.533296+0000","last_peered":"2024-09-10T08:44:22.533296+0000","last_clean":"2024-09-10T08:44:22.533296+0000","last_became_active":"2024-09-10T08:28:35.582205+0000","last_became_peered":"2024-09-10T08:28:35.582205+0000","last_unstale":"2024-09-10T08:44:22.533296+0000","last_undegraded":"2024-09-10T08:44:22.533296+0000","last_fullsized":"2024-09-10T08:44:22.533296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4089,"log_dups_size":0,"ondisk_log_size":4089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:11.200963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21083,"num_write_kb":276854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'305","reported_seq":337,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.000513+0000","last_change":"2024-09-10T08:28:34.559823+0000","last_active":"2024-09-10T08:43:48.000513+0000","last_peered":"2024-09-10T08:43:48.000513+0000","last_clean":"2024-09-10T08:43:48.000513+0000","last_became_active":"2024-09-10T08:28:34.559560+0000","last_became_peered":"2024-09-10T08:28:34.559560+0000","last_unstale":"2024-09-10T08:43:48.000513+0000","last_undegraded":"2024-09-10T08:43:48.000513+0000","last_fullsized":"2024-09-10T08:43:48.000513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:53.724382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":301,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'5","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.840086+0000","last_change":"2024-09-10T08:28:46.628040+0000","last_active":"2024-09-10T08:43:37.840086+0000","last_peered":"2024-09-10T08:43:37.840086+0000","last_clean":"2024-09-10T08:43:37.840086+0000","last_became_active":"2024-09-10T08:28:46.627819+0000","last_became_peered":"2024-09-10T08:28:46.627819+0000","last_unstale":"2024-09-10T08:43:37.840086+0000","last_undegraded":"2024-09-10T08:43:37.840086+0000","last_fullsized":"2024-09-10T08:43:37.840086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:29.467540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"27'3973","reported_seq":3995,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456273+0000","last_change":"2024-09-10T08:28:47.628067+0000","last_active":"2024-09-10T08:44:29.456273+0000","last_peered":"2024-09-10T08:44:29.456273+0000","last_clean":"2024-09-10T08:44:29.456273+0000","last_became_active":"2024-09-10T08:28:47.627775+0000","last_became_peered":"2024-09-10T08:28:47.627775+0000","last_unstale":"2024-09-10T08:44:29.456273+0000","last_undegraded":"2024-09-10T08:44:29.456273+0000","last_fullsized":"2024-09-10T08:44:29.456273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3973,"log_dups_size":0,"ondisk_log_size":3973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:43.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20759,"num_write_kb":275665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'6218","reported_seq":6248,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.501495+0000","last_change":"2024-09-10T08:28:35.571262+0000","last_active":"2024-09-10T08:44:22.501495+0000","last_peered":"2024-09-10T08:44:22.501495+0000","last_clean":"2024-09-10T08:44:22.501495+0000","last_became_active":"2024-09-10T08:28:35.570711+0000","last_became_peered":"2024-09-10T08:28:35.570711+0000","last_unstale":"2024-09-10T08:44:22.501495+0000","last_undegraded":"2024-09-10T08:44:22.501495+0000","last_fullsized":"2024-09-10T08:44:22.501495+0000","mapping_epoch":19,"log_start":"27'700","ondisk_log_start":"27'700","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5518,"log_dups_size":0,"ondisk_log_size":5518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:29.116422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31535,"num_write_kb":397056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'35","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.003205+0000","last_change":"2024-09-10T08:28:34.557352+0000","last_active":"2024-09-10T08:43:48.003205+0000","last_peered":"2024-09-10T08:43:48.003205+0000","last_clean":"2024-09-10T08:43:48.003205+0000","last_became_active":"2024-09-10T08:28:34.557076+0000","last_became_peered":"2024-09-10T08:28:34.557076+0000","last_unstale":"2024-09-10T08:43:48.003205+0000","last_undegraded":"2024-09-10T08:43:48.003205+0000","last_fullsized":"2024-09-10T08:43:48.003205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:04.957739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'8","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.822684+0000","last_change":"2024-09-10T08:28:46.615923+0000","last_active":"2024-09-10T08:43:37.822684+0000","last_peered":"2024-09-10T08:43:37.822684+0000","last_clean":"2024-09-10T08:43:37.822684+0000","last_became_active":"2024-09-10T08:28:46.615451+0000","last_became_peered":"2024-09-10T08:28:46.615451+0000","last_unstale":"2024-09-10T08:43:37.822684+0000","last_undegraded":"2024-09-10T08:43:37.822684+0000","last_fullsized":"2024-09-10T08:43:37.822684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:22.612001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"27'4284","reported_seq":4306,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456315+0000","last_change":"2024-09-10T08:28:47.623223+0000","last_active":"2024-09-10T08:44:29.456315+0000","last_peered":"2024-09-10T08:44:29.456315+0000","last_clean":"2024-09-10T08:44:29.456315+0000","last_became_active":"2024-09-10T08:28:47.622961+0000","last_became_peered":"2024-09-10T08:28:47.622961+0000","last_unstale":"2024-09-10T08:44:29.456315+0000","last_undegraded":"2024-09-10T08:44:29.456315+0000","last_fullsized":"2024-09-10T08:44:29.456315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4284,"log_dups_size":0,"ondisk_log_size":4284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:30.979580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23423,"num_write_kb":294728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"27'3896","reported_seq":3935,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:38.878248+0000","last_change":"2024-09-10T08:44:38.878270+0000","last_active":"2024-09-10T08:44:38.878248+0000","last_peered":"2024-09-10T08:44:38.878248+0000","last_clean":"2024-09-10T08:44:38.878248+0000","last_became_active":"2024-09-10T08:28:35.577255+0000","last_became_peered":"2024-09-10T08:28:35.577255+0000","last_unstale":"2024-09-10T08:44:38.878248+0000","last_undegraded":"2024-09-10T08:44:38.878248+0000","last_fullsized":"2024-09-10T08:44:38.878248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3896","last_scrub_stamp":"2024-09-10T08:44:38.878177+0000","last_deep_scrub":"27'3896","last_deep_scrub_stamp":"2024-09-10T08:44:38.878177+0000","last_clean_scrub_stamp":"2024-09-10T08:44:38.878177+0000","objects_scrubbed":0,"log_size":3896,"log_dups_size":0,"ondisk_log_size":3896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:37.246919+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19770,"num_write_kb":255291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'2","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.988679+0000","last_change":"2024-09-10T08:28:34.564571+0000","last_active":"2024-09-10T08:43:47.988679+0000","last_peered":"2024-09-10T08:43:47.988679+0000","last_clean":"2024-09-10T08:43:47.988679+0000","last_became_active":"2024-09-10T08:28:34.564189+0000","last_became_peered":"2024-09-10T08:28:34.564189+0000","last_unstale":"2024-09-10T08:43:47.988679+0000","last_undegraded":"2024-09-10T08:43:47.988679+0000","last_fullsized":"2024-09-10T08:43:47.988679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:46.055510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'12","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.816926+0000","last_change":"2024-09-10T08:28:46.618917+0000","last_active":"2024-09-10T08:43:37.816926+0000","last_peered":"2024-09-10T08:43:37.816926+0000","last_clean":"2024-09-10T08:43:37.816926+0000","last_became_active":"2024-09-10T08:28:46.618625+0000","last_became_peered":"2024-09-10T08:28:46.618625+0000","last_unstale":"2024-09-10T08:43:37.816926+0000","last_undegraded":"2024-09-10T08:43:37.816926+0000","last_fullsized":"2024-09-10T08:43:37.816926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:19.431857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"27'4685","reported_seq":4707,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.447574+0000","last_change":"2024-09-10T08:28:47.630243+0000","last_active":"2024-09-10T08:44:29.447574+0000","last_peered":"2024-09-10T08:44:29.447574+0000","last_clean":"2024-09-10T08:44:29.447574+0000","last_became_active":"2024-09-10T08:28:47.629869+0000","last_became_peered":"2024-09-10T08:28:47.629869+0000","last_unstale":"2024-09-10T08:44:29.447574+0000","last_undegraded":"2024-09-10T08:44:29.447574+0000","last_fullsized":"2024-09-10T08:44:29.447574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4685,"log_dups_size":0,"ondisk_log_size":4685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:58.696156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24572,"num_write_kb":315590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'4682","reported_seq":4712,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.546974+0000","last_change":"2024-09-10T08:28:35.572944+0000","last_active":"2024-09-10T08:44:22.546974+0000","last_peered":"2024-09-10T08:44:22.546974+0000","last_clean":"2024-09-10T08:44:22.546974+0000","last_became_active":"2024-09-10T08:28:35.572620+0000","last_became_peered":"2024-09-10T08:28:35.572620+0000","last_unstale":"2024-09-10T08:44:22.546974+0000","last_undegraded":"2024-09-10T08:44:22.546974+0000","last_fullsized":"2024-09-10T08:44:22.546974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4682,"log_dups_size":0,"ondisk_log_size":4682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:04.524048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24219,"num_write_kb":302042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'2","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:04.444745+0000","last_change":"2024-09-10T08:28:34.562935+0000","last_active":"2024-09-10T08:43:04.444745+0000","last_peered":"2024-09-10T08:43:04.444745+0000","last_clean":"2024-09-10T08:43:04.444745+0000","last_became_active":"2024-09-10T08:28:34.562647+0000","last_became_peered":"2024-09-10T08:28:34.562647+0000","last_unstale":"2024-09-10T08:43:04.444745+0000","last_undegraded":"2024-09-10T08:43:04.444745+0000","last_fullsized":"2024-09-10T08:43:04.444745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:47.492281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'6","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.806115+0000","last_change":"2024-09-10T08:28:46.621472+0000","last_active":"2024-09-10T08:43:37.806115+0000","last_peered":"2024-09-10T08:43:37.806115+0000","last_clean":"2024-09-10T08:43:37.806115+0000","last_became_active":"2024-09-10T08:28:46.621157+0000","last_became_peered":"2024-09-10T08:28:46.621157+0000","last_unstale":"2024-09-10T08:43:37.806115+0000","last_undegraded":"2024-09-10T08:43:37.806115+0000","last_fullsized":"2024-09-10T08:43:37.806115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:44.166068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"27'5768","reported_seq":5791,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.460342+0000","last_change":"2024-09-10T08:28:47.627750+0000","last_active":"2024-09-10T08:44:29.460342+0000","last_peered":"2024-09-10T08:44:29.460342+0000","last_clean":"2024-09-10T08:44:29.460342+0000","last_became_active":"2024-09-10T08:28:47.627481+0000","last_became_peered":"2024-09-10T08:28:47.627481+0000","last_unstale":"2024-09-10T08:44:29.460342+0000","last_undegraded":"2024-09-10T08:44:29.460342+0000","last_fullsized":"2024-09-10T08:44:29.460342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5768,"log_dups_size":0,"ondisk_log_size":5768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:01.105133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30773,"num_write_kb":369268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"27'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.831265+0000","last_change":"2024-09-10T08:28:46.620162+0000","last_active":"2024-09-10T08:43:37.831265+0000","last_peered":"2024-09-10T08:43:37.831265+0000","last_clean":"2024-09-10T08:43:37.831265+0000","last_became_active":"2024-09-10T08:28:46.619843+0000","last_became_peered":"2024-09-10T08:28:46.619843+0000","last_unstale":"2024-09-10T08:43:37.831265+0000","last_undegraded":"2024-09-10T08:43:37.831265+0000","last_fullsized":"2024-09-10T08:43:37.831265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'5404","reported_seq":5434,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.528764+0000","last_change":"2024-09-10T08:28:35.572803+0000","last_active":"2024-09-10T08:44:22.528764+0000","last_peered":"2024-09-10T08:44:22.528764+0000","last_clean":"2024-09-10T08:44:22.528764+0000","last_became_active":"2024-09-10T08:28:35.572219+0000","last_became_peered":"2024-09-10T08:28:35.572219+0000","last_unstale":"2024-09-10T08:44:22.528764+0000","last_undegraded":"2024-09-10T08:44:22.528764+0000","last_fullsized":"2024-09-10T08:44:22.528764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5404,"log_dups_size":0,"ondisk_log_size":5404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:10:45.920218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27626,"num_write_kb":348430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:35.055986+0000","last_change":"2024-09-10T08:28:34.554346+0000","last_active":"2024-09-10T08:43:35.055986+0000","last_peered":"2024-09-10T08:43:35.055986+0000","last_clean":"2024-09-10T08:43:35.055986+0000","last_became_active":"2024-09-10T08:28:34.553933+0000","last_became_peered":"2024-09-10T08:28:34.553933+0000","last_unstale":"2024-09-10T08:43:35.055986+0000","last_undegraded":"2024-09-10T08:43:35.055986+0000","last_fullsized":"2024-09-10T08:43:35.055986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:07.639671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"27'4656","reported_seq":4680,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.353922+0000","last_change":"2024-09-10T08:28:47.629468+0000","last_active":"2024-09-10T08:44:29.353922+0000","last_peered":"2024-09-10T08:44:29.353922+0000","last_clean":"2024-09-10T08:44:29.353922+0000","last_became_active":"2024-09-10T08:28:47.629177+0000","last_became_peered":"2024-09-10T08:28:47.629177+0000","last_unstale":"2024-09-10T08:44:29.353922+0000","last_undegraded":"2024-09-10T08:44:29.353922+0000","last_fullsized":"2024-09-10T08:44:29.353922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4656,"log_dups_size":0,"ondisk_log_size":4656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24729,"num_write_kb":316330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"27'630","reported_seq":655,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:28.449319+0000","last_change":"2024-09-10T08:28:46.630904+0000","last_active":"2024-09-10T08:43:28.449319+0000","last_peered":"2024-09-10T08:43:28.449319+0000","last_clean":"2024-09-10T08:43:28.449319+0000","last_became_active":"2024-09-10T08:28:46.630530+0000","last_became_peered":"2024-09-10T08:28:46.630530+0000","last_unstale":"2024-09-10T08:43:28.449319+0000","last_undegraded":"2024-09-10T08:43:28.449319+0000","last_fullsized":"2024-09-10T08:43:28.449319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:33.599739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":4465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'4762","reported_seq":4792,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.510821+0000","last_change":"2024-09-10T08:28:35.580244+0000","last_active":"2024-09-10T08:44:22.510821+0000","last_peered":"2024-09-10T08:44:22.510821+0000","last_clean":"2024-09-10T08:44:22.510821+0000","last_became_active":"2024-09-10T08:28:35.579975+0000","last_became_peered":"2024-09-10T08:28:35.579975+0000","last_unstale":"2024-09-10T08:44:22.510821+0000","last_undegraded":"2024-09-10T08:44:22.510821+0000","last_fullsized":"2024-09-10T08:44:22.510821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4762,"log_dups_size":0,"ondisk_log_size":4762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:16.498045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24500,"num_write_kb":298921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:06.786232+0000","last_change":"2024-09-10T08:28:34.564751+0000","last_active":"2024-09-10T08:43:06.786232+0000","last_peered":"2024-09-10T08:43:06.786232+0000","last_clean":"2024-09-10T08:43:06.786232+0000","last_became_active":"2024-09-10T08:28:34.564479+0000","last_became_peered":"2024-09-10T08:28:34.564479+0000","last_unstale":"2024-09-10T08:43:06.786232+0000","last_undegraded":"2024-09-10T08:43:06.786232+0000","last_fullsized":"2024-09-10T08:43:06.786232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:29.618224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"27'5070","reported_seq":5092,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.463937+0000","last_change":"2024-09-10T08:28:47.627041+0000","last_active":"2024-09-10T08:44:29.463937+0000","last_peered":"2024-09-10T08:44:29.463937+0000","last_clean":"2024-09-10T08:44:29.463937+0000","last_became_active":"2024-09-10T08:28:47.626692+0000","last_became_peered":"2024-09-10T08:28:47.626692+0000","last_unstale":"2024-09-10T08:44:29.463937+0000","last_undegraded":"2024-09-10T08:44:29.463937+0000","last_fullsized":"2024-09-10T08:44:29.463937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5070,"log_dups_size":0,"ondisk_log_size":5070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:57.666849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26421,"num_write_kb":351729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"27'90","reported_seq":122,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.343291+0000","last_change":"2024-09-10T08:28:34.561906+0000","last_active":"2024-09-10T08:44:22.343291+0000","last_peered":"2024-09-10T08:44:22.343291+0000","last_clean":"2024-09-10T08:44:22.343291+0000","last_became_active":"2024-09-10T08:28:34.561613+0000","last_became_peered":"2024-09-10T08:28:34.561613+0000","last_unstale":"2024-09-10T08:44:22.343291+0000","last_undegraded":"2024-09-10T08:44:22.343291+0000","last_fullsized":"2024-09-10T08:44:22.343291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:56.065939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061672,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":1094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'3916","reported_seq":3947,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.533887+0000","last_change":"2024-09-10T08:28:35.576406+0000","last_active":"2024-09-10T08:44:22.533887+0000","last_peered":"2024-09-10T08:44:22.533887+0000","last_clean":"2024-09-10T08:44:22.533887+0000","last_became_active":"2024-09-10T08:28:35.576145+0000","last_became_peered":"2024-09-10T08:28:35.576145+0000","last_unstale":"2024-09-10T08:44:22.533887+0000","last_undegraded":"2024-09-10T08:44:22.533887+0000","last_fullsized":"2024-09-10T08:44:22.533887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3916,"log_dups_size":0,"ondisk_log_size":3916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19526,"num_write_kb":237971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.846532+0000","last_change":"2024-09-10T08:28:46.622395+0000","last_active":"2024-09-10T08:43:37.846532+0000","last_peered":"2024-09-10T08:43:37.846532+0000","last_clean":"2024-09-10T08:43:37.846532+0000","last_became_active":"2024-09-10T08:28:46.621941+0000","last_became_peered":"2024-09-10T08:28:46.621941+0000","last_unstale":"2024-09-10T08:43:37.846532+0000","last_undegraded":"2024-09-10T08:43:37.846532+0000","last_fullsized":"2024-09-10T08:43:37.846532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:54.928969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"27'3193","reported_seq":3215,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.434312+0000","last_change":"2024-09-10T08:28:47.626495+0000","last_active":"2024-09-10T08:44:29.434312+0000","last_peered":"2024-09-10T08:44:29.434312+0000","last_clean":"2024-09-10T08:44:29.434312+0000","last_became_active":"2024-09-10T08:28:47.625258+0000","last_became_peered":"2024-09-10T08:28:47.625258+0000","last_unstale":"2024-09-10T08:44:29.434312+0000","last_undegraded":"2024-09-10T08:44:29.434312+0000","last_fullsized":"2024-09-10T08:44:29.434312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3193,"log_dups_size":0,"ondisk_log_size":3193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:00.101586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16183,"num_write_kb":212369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'622","reported_seq":654,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:35.040191+0000","last_change":"2024-09-10T08:28:34.566606+0000","last_active":"2024-09-10T08:43:35.040191+0000","last_peered":"2024-09-10T08:43:35.040191+0000","last_clean":"2024-09-10T08:43:35.040191+0000","last_became_active":"2024-09-10T08:28:34.566388+0000","last_became_peered":"2024-09-10T08:28:34.566388+0000","last_unstale":"2024-09-10T08:43:35.040191+0000","last_undegraded":"2024-09-10T08:43:35.040191+0000","last_fullsized":"2024-09-10T08:43:35.040191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:33.528801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":620,"num_write_kb":4248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'4051","reported_seq":4081,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.448831+0000","last_change":"2024-09-10T08:28:35.559371+0000","last_active":"2024-09-10T08:44:22.448831+0000","last_peered":"2024-09-10T08:44:22.448831+0000","last_clean":"2024-09-10T08:44:22.448831+0000","last_became_active":"2024-09-10T08:28:35.559145+0000","last_became_peered":"2024-09-10T08:28:35.559145+0000","last_unstale":"2024-09-10T08:44:22.448831+0000","last_undegraded":"2024-09-10T08:44:22.448831+0000","last_fullsized":"2024-09-10T08:44:22.448831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4051,"log_dups_size":0,"ondisk_log_size":4051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:57.339318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20269,"num_write_kb":257190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'11","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:37.853770+0000","last_change":"2024-09-10T08:28:46.620231+0000","last_active":"2024-09-10T08:43:37.853770+0000","last_peered":"2024-09-10T08:43:37.853770+0000","last_clean":"2024-09-10T08:43:37.853770+0000","last_became_active":"2024-09-10T08:28:46.619403+0000","last_became_peered":"2024-09-10T08:28:46.619403+0000","last_unstale":"2024-09-10T08:43:37.853770+0000","last_undegraded":"2024-09-10T08:43:37.853770+0000","last_fullsized":"2024-09-10T08:43:37.853770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:45.593387+0000","last_clean_scrub_stamp":"2024-09-10T08:28:45.593387+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:26.308749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"27'4023","reported_seq":4046,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.453630+0000","last_change":"2024-09-10T08:28:47.627135+0000","last_active":"2024-09-10T08:44:29.453630+0000","last_peered":"2024-09-10T08:44:29.453630+0000","last_clean":"2024-09-10T08:44:29.453630+0000","last_became_active":"2024-09-10T08:28:47.626791+0000","last_became_peered":"2024-09-10T08:28:47.626791+0000","last_unstale":"2024-09-10T08:44:29.453630+0000","last_undegraded":"2024-09-10T08:44:29.453630+0000","last_fullsized":"2024-09-10T08:44:29.453630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4023,"log_dups_size":0,"ondisk_log_size":4023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:43.954450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21172,"num_write_kb":269680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'5985","reported_seq":6016,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.506685+0000","last_change":"2024-09-10T08:28:35.579106+0000","last_active":"2024-09-10T08:44:22.506685+0000","last_peered":"2024-09-10T08:44:22.506685+0000","last_clean":"2024-09-10T08:44:22.506685+0000","last_became_active":"2024-09-10T08:28:35.578631+0000","last_became_peered":"2024-09-10T08:28:35.578631+0000","last_unstale":"2024-09-10T08:44:22.506685+0000","last_undegraded":"2024-09-10T08:44:22.506685+0000","last_fullsized":"2024-09-10T08:44:22.506685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5985,"log_dups_size":0,"ondisk_log_size":5985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:31.592460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30721,"num_write_kb":377078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"27'5461","reported_seq":5484,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.347960+0000","last_change":"2024-09-10T08:28:47.632052+0000","last_active":"2024-09-10T08:44:29.347960+0000","last_peered":"2024-09-10T08:44:29.347960+0000","last_clean":"2024-09-10T08:44:29.347960+0000","last_became_active":"2024-09-10T08:28:47.631578+0000","last_became_peered":"2024-09-10T08:28:47.631578+0000","last_unstale":"2024-09-10T08:44:29.347960+0000","last_undegraded":"2024-09-10T08:44:29.347960+0000","last_fullsized":"2024-09-10T08:44:29.347960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5461,"log_dups_size":0,"ondisk_log_size":5461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:24.570729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28495,"num_write_kb":351882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"27'5419","reported_seq":5455,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.513489+0000","last_change":"2024-09-10T08:29:36.030138+0000","last_active":"2024-09-10T08:44:22.513489+0000","last_peered":"2024-09-10T08:44:22.513489+0000","last_clean":"2024-09-10T08:44:22.513489+0000","last_became_active":"2024-09-10T08:29:36.029789+0000","last_became_peered":"2024-09-10T08:29:36.029789+0000","last_unstale":"2024-09-10T08:44:22.513489+0000","last_undegraded":"2024-09-10T08:44:22.513489+0000","last_fullsized":"2024-09-10T08:44:22.513489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5419,"log_dups_size":0,"ondisk_log_size":5419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:56:49.067000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28175,"num_write_kb":329998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"27'4342","reported_seq":4365,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456079+0000","last_change":"2024-09-10T08:28:47.629148+0000","last_active":"2024-09-10T08:44:29.456079+0000","last_peered":"2024-09-10T08:44:29.456079+0000","last_clean":"2024-09-10T08:44:29.456079+0000","last_became_active":"2024-09-10T08:28:47.628741+0000","last_became_peered":"2024-09-10T08:28:47.628741+0000","last_unstale":"2024-09-10T08:44:29.456079+0000","last_undegraded":"2024-09-10T08:44:29.456079+0000","last_fullsized":"2024-09-10T08:44:29.456079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:48.950503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22591,"num_write_kb":275032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"27'5933","reported_seq":5964,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.508630+0000","last_change":"2024-09-10T08:28:35.578735+0000","last_active":"2024-09-10T08:44:22.508630+0000","last_peered":"2024-09-10T08:44:22.508630+0000","last_clean":"2024-09-10T08:44:22.508630+0000","last_became_active":"2024-09-10T08:28:35.577995+0000","last_became_peered":"2024-09-10T08:28:35.577995+0000","last_unstale":"2024-09-10T08:44:22.508630+0000","last_undegraded":"2024-09-10T08:44:22.508630+0000","last_fullsized":"2024-09-10T08:44:22.508630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5933,"log_dups_size":0,"ondisk_log_size":5933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:11.033441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30577,"num_write_kb":368306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"27'4476","reported_seq":4499,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.461540+0000","last_change":"2024-09-10T08:28:47.628639+0000","last_active":"2024-09-10T08:44:29.461540+0000","last_peered":"2024-09-10T08:44:29.461540+0000","last_clean":"2024-09-10T08:44:29.461540+0000","last_became_active":"2024-09-10T08:28:47.628317+0000","last_became_peered":"2024-09-10T08:28:47.628317+0000","last_unstale":"2024-09-10T08:44:29.461540+0000","last_undegraded":"2024-09-10T08:44:29.461540+0000","last_fullsized":"2024-09-10T08:44:29.461540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4476,"log_dups_size":0,"ondisk_log_size":4476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:50.314678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23867,"num_write_kb":312797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"27'4232","reported_seq":4264,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.523906+0000","last_change":"2024-09-10T08:28:35.577852+0000","last_active":"2024-09-10T08:44:22.523906+0000","last_peered":"2024-09-10T08:44:22.523906+0000","last_clean":"2024-09-10T08:44:22.523906+0000","last_became_active":"2024-09-10T08:28:35.577571+0000","last_became_peered":"2024-09-10T08:28:35.577571+0000","last_unstale":"2024-09-10T08:44:22.523906+0000","last_undegraded":"2024-09-10T08:44:22.523906+0000","last_fullsized":"2024-09-10T08:44:22.523906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4232,"log_dups_size":0,"ondisk_log_size":4232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21938,"num_write_kb":263982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"27'5518","reported_seq":5541,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.374526+0000","last_change":"2024-09-10T08:28:47.629931+0000","last_active":"2024-09-10T08:44:29.374526+0000","last_peered":"2024-09-10T08:44:29.374526+0000","last_clean":"2024-09-10T08:44:29.374526+0000","last_became_active":"2024-09-10T08:28:47.629634+0000","last_became_peered":"2024-09-10T08:28:47.629634+0000","last_unstale":"2024-09-10T08:44:29.374526+0000","last_undegraded":"2024-09-10T08:44:29.374526+0000","last_fullsized":"2024-09-10T08:44:29.374526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5518,"log_dups_size":0,"ondisk_log_size":5518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:57.964208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28611,"num_write_kb":360382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"27'3937","reported_seq":3968,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.454987+0000","last_change":"2024-09-10T08:28:35.574676+0000","last_active":"2024-09-10T08:44:22.454987+0000","last_peered":"2024-09-10T08:44:22.454987+0000","last_clean":"2024-09-10T08:44:22.454987+0000","last_became_active":"2024-09-10T08:28:35.574437+0000","last_became_peered":"2024-09-10T08:28:35.574437+0000","last_unstale":"2024-09-10T08:44:22.454987+0000","last_undegraded":"2024-09-10T08:44:22.454987+0000","last_fullsized":"2024-09-10T08:44:22.454987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3937,"log_dups_size":0,"ondisk_log_size":3937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:45.422506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20167,"num_write_kb":265112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"27'3790","reported_seq":3813,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456016+0000","last_change":"2024-09-10T08:28:47.624178+0000","last_active":"2024-09-10T08:44:29.456016+0000","last_peered":"2024-09-10T08:44:29.456016+0000","last_clean":"2024-09-10T08:44:29.456016+0000","last_became_active":"2024-09-10T08:28:47.623671+0000","last_became_peered":"2024-09-10T08:28:47.623671+0000","last_unstale":"2024-09-10T08:44:29.456016+0000","last_undegraded":"2024-09-10T08:44:29.456016+0000","last_fullsized":"2024-09-10T08:44:29.456016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3790,"log_dups_size":0,"ondisk_log_size":3790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:35:48.613870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19891,"num_write_kb":255782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"27'4956","reported_seq":4987,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.486306+0000","last_change":"2024-09-10T08:28:35.572550+0000","last_active":"2024-09-10T08:44:22.486306+0000","last_peered":"2024-09-10T08:44:22.486306+0000","last_clean":"2024-09-10T08:44:22.486306+0000","last_became_active":"2024-09-10T08:28:35.572184+0000","last_became_peered":"2024-09-10T08:28:35.572184+0000","last_unstale":"2024-09-10T08:44:22.486306+0000","last_undegraded":"2024-09-10T08:44:22.486306+0000","last_fullsized":"2024-09-10T08:44:22.486306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4956,"log_dups_size":0,"ondisk_log_size":4956,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:08.490734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26295,"num_write_kb":322461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"27'5495","reported_seq":5518,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.478950+0000","last_change":"2024-09-10T08:28:47.630214+0000","last_active":"2024-09-10T08:44:29.478950+0000","last_peered":"2024-09-10T08:44:29.478950+0000","last_clean":"2024-09-10T08:44:29.478950+0000","last_became_active":"2024-09-10T08:28:47.629512+0000","last_became_peered":"2024-09-10T08:28:47.629512+0000","last_unstale":"2024-09-10T08:44:29.478950+0000","last_undegraded":"2024-09-10T08:44:29.478950+0000","last_fullsized":"2024-09-10T08:44:29.478950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5495,"log_dups_size":0,"ondisk_log_size":5495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:35:35.692107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29037,"num_write_kb":370350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"27'4400","reported_seq":4431,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.553518+0000","last_change":"2024-09-10T08:28:35.573217+0000","last_active":"2024-09-10T08:44:22.553518+0000","last_peered":"2024-09-10T08:44:22.553518+0000","last_clean":"2024-09-10T08:44:22.553518+0000","last_became_active":"2024-09-10T08:28:35.572955+0000","last_became_peered":"2024-09-10T08:28:35.572955+0000","last_unstale":"2024-09-10T08:44:22.553518+0000","last_undegraded":"2024-09-10T08:44:22.553518+0000","last_fullsized":"2024-09-10T08:44:22.553518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4400,"log_dups_size":0,"ondisk_log_size":4400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:24.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22665,"num_write_kb":275496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"27'4608","reported_seq":4631,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.438440+0000","last_change":"2024-09-10T08:28:47.623365+0000","last_active":"2024-09-10T08:44:29.438440+0000","last_peered":"2024-09-10T08:44:29.438440+0000","last_clean":"2024-09-10T08:44:29.438440+0000","last_became_active":"2024-09-10T08:28:47.623082+0000","last_became_peered":"2024-09-10T08:28:47.623082+0000","last_unstale":"2024-09-10T08:44:29.438440+0000","last_undegraded":"2024-09-10T08:44:29.438440+0000","last_fullsized":"2024-09-10T08:44:29.438440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:20.558484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24193,"num_write_kb":313982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'6039","reported_seq":6070,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.401543+0000","last_change":"2024-09-10T08:28:35.575902+0000","last_active":"2024-09-10T08:44:22.401543+0000","last_peered":"2024-09-10T08:44:22.401543+0000","last_clean":"2024-09-10T08:44:22.401543+0000","last_became_active":"2024-09-10T08:28:35.575614+0000","last_became_peered":"2024-09-10T08:28:35.575614+0000","last_unstale":"2024-09-10T08:44:22.401543+0000","last_undegraded":"2024-09-10T08:44:22.401543+0000","last_fullsized":"2024-09-10T08:44:22.401543+0000","mapping_epoch":19,"log_start":"27'800","ondisk_log_start":"27'800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:11.277682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31129,"num_write_kb":362414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"27'3524","reported_seq":3546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.429365+0000","last_change":"2024-09-10T08:28:47.629795+0000","last_active":"2024-09-10T08:44:29.429365+0000","last_peered":"2024-09-10T08:44:29.429365+0000","last_clean":"2024-09-10T08:44:29.429365+0000","last_became_active":"2024-09-10T08:28:47.628861+0000","last_became_peered":"2024-09-10T08:28:47.628861+0000","last_unstale":"2024-09-10T08:44:29.429365+0000","last_undegraded":"2024-09-10T08:44:29.429365+0000","last_fullsized":"2024-09-10T08:44:29.429365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3524,"log_dups_size":0,"ondisk_log_size":3524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:06.277094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18277,"num_write_kb":237112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'4470","reported_seq":4501,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.481878+0000","last_change":"2024-09-10T08:28:35.578285+0000","last_active":"2024-09-10T08:44:22.481878+0000","last_peered":"2024-09-10T08:44:22.481878+0000","last_clean":"2024-09-10T08:44:22.481878+0000","last_became_active":"2024-09-10T08:28:35.576805+0000","last_became_peered":"2024-09-10T08:28:35.576805+0000","last_unstale":"2024-09-10T08:44:22.481878+0000","last_undegraded":"2024-09-10T08:44:22.481878+0000","last_fullsized":"2024-09-10T08:44:22.481878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4470,"log_dups_size":0,"ondisk_log_size":4470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:46.203320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22783,"num_write_kb":271507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"27'5536","reported_seq":5558,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.409088+0000","last_change":"2024-09-10T08:28:47.635713+0000","last_active":"2024-09-10T08:44:29.409088+0000","last_peered":"2024-09-10T08:44:29.409088+0000","last_clean":"2024-09-10T08:44:29.409088+0000","last_became_active":"2024-09-10T08:28:47.635381+0000","last_became_peered":"2024-09-10T08:28:47.635381+0000","last_unstale":"2024-09-10T08:44:29.409088+0000","last_undegraded":"2024-09-10T08:44:29.409088+0000","last_fullsized":"2024-09-10T08:44:29.409088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5536,"log_dups_size":0,"ondisk_log_size":5536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:39.419510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28458,"num_write_kb":359914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"27'4347","reported_seq":4363,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.499781+0000","last_change":"2024-09-10T08:29:35.097545+0000","last_active":"2024-09-10T08:44:22.499781+0000","last_peered":"2024-09-10T08:44:22.499781+0000","last_clean":"2024-09-10T08:44:22.499781+0000","last_became_active":"2024-09-10T08:29:35.097273+0000","last_became_peered":"2024-09-10T08:29:35.097273+0000","last_unstale":"2024-09-10T08:44:22.499781+0000","last_undegraded":"2024-09-10T08:44:22.499781+0000","last_fullsized":"2024-09-10T08:44:22.499781+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4347,"log_dups_size":0,"ondisk_log_size":4347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:40.058249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22114,"num_write_kb":289250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2c","version":"27'4653","reported_seq":4676,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.447481+0000","last_change":"2024-09-10T08:28:47.619863+0000","last_active":"2024-09-10T08:44:29.447481+0000","last_peered":"2024-09-10T08:44:29.447481+0000","last_clean":"2024-09-10T08:44:29.447481+0000","last_became_active":"2024-09-10T08:28:47.619525+0000","last_became_peered":"2024-09-10T08:28:47.619525+0000","last_unstale":"2024-09-10T08:44:29.447481+0000","last_undegraded":"2024-09-10T08:44:29.447481+0000","last_fullsized":"2024-09-10T08:44:29.447481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4653,"log_dups_size":0,"ondisk_log_size":4653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:49.591318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24519,"num_write_kb":299145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"27'5080","reported_seq":5111,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.544103+0000","last_change":"2024-09-10T08:28:35.568044+0000","last_active":"2024-09-10T08:44:22.544103+0000","last_peered":"2024-09-10T08:44:22.544103+0000","last_clean":"2024-09-10T08:44:22.544103+0000","last_became_active":"2024-09-10T08:28:35.567744+0000","last_became_peered":"2024-09-10T08:28:35.567744+0000","last_unstale":"2024-09-10T08:44:22.544103+0000","last_undegraded":"2024-09-10T08:44:22.544103+0000","last_fullsized":"2024-09-10T08:44:22.544103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5080,"log_dups_size":0,"ondisk_log_size":5080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:19.081138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26557,"num_write_kb":327659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"27'4432","reported_seq":4455,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.404476+0000","last_change":"2024-09-10T08:28:47.629417+0000","last_active":"2024-09-10T08:44:29.404476+0000","last_peered":"2024-09-10T08:44:29.404476+0000","last_clean":"2024-09-10T08:44:29.404476+0000","last_became_active":"2024-09-10T08:28:47.629095+0000","last_became_peered":"2024-09-10T08:28:47.629095+0000","last_unstale":"2024-09-10T08:44:29.404476+0000","last_undegraded":"2024-09-10T08:44:29.404476+0000","last_fullsized":"2024-09-10T08:44:29.404476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4432,"log_dups_size":0,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:05.606381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22331,"num_write_kb":294288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"27'4801","reported_seq":4833,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.553010+0000","last_change":"2024-09-10T08:28:35.575802+0000","last_active":"2024-09-10T08:44:22.553010+0000","last_peered":"2024-09-10T08:44:22.553010+0000","last_clean":"2024-09-10T08:44:22.553010+0000","last_became_active":"2024-09-10T08:28:35.575388+0000","last_became_peered":"2024-09-10T08:28:35.575388+0000","last_unstale":"2024-09-10T08:44:22.553010+0000","last_undegraded":"2024-09-10T08:44:22.553010+0000","last_fullsized":"2024-09-10T08:44:22.553010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4801,"log_dups_size":0,"ondisk_log_size":4801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24675,"num_write_kb":307760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"27'4608","reported_seq":4631,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.451602+0000","last_change":"2024-09-10T08:28:47.624305+0000","last_active":"2024-09-10T08:44:29.451602+0000","last_peered":"2024-09-10T08:44:29.451602+0000","last_clean":"2024-09-10T08:44:29.451602+0000","last_became_active":"2024-09-10T08:28:47.624026+0000","last_became_peered":"2024-09-10T08:28:47.624026+0000","last_unstale":"2024-09-10T08:44:29.451602+0000","last_undegraded":"2024-09-10T08:44:29.451602+0000","last_fullsized":"2024-09-10T08:44:29.451602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:01.194271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24388,"num_write_kb":319015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'4484","reported_seq":4515,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.485515+0000","last_change":"2024-09-10T08:28:35.574499+0000","last_active":"2024-09-10T08:44:22.485515+0000","last_peered":"2024-09-10T08:44:22.485515+0000","last_clean":"2024-09-10T08:44:22.485515+0000","last_became_active":"2024-09-10T08:28:35.574249+0000","last_became_peered":"2024-09-10T08:28:35.574249+0000","last_unstale":"2024-09-10T08:44:22.485515+0000","last_undegraded":"2024-09-10T08:44:22.485515+0000","last_fullsized":"2024-09-10T08:44:22.485515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4484,"log_dups_size":0,"ondisk_log_size":4484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:55.952307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23126,"num_write_kb":293453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"27'4466","reported_seq":4489,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456529+0000","last_change":"2024-09-10T08:28:47.629525+0000","last_active":"2024-09-10T08:44:29.456529+0000","last_peered":"2024-09-10T08:44:29.456529+0000","last_clean":"2024-09-10T08:44:29.456529+0000","last_became_active":"2024-09-10T08:28:47.629259+0000","last_became_peered":"2024-09-10T08:28:47.629259+0000","last_unstale":"2024-09-10T08:44:29.456529+0000","last_undegraded":"2024-09-10T08:44:29.456529+0000","last_fullsized":"2024-09-10T08:44:29.456529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4466,"log_dups_size":0,"ondisk_log_size":4466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:46:11.864322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23096,"num_write_kb":301452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"27'4995","reported_seq":5026,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.537572+0000","last_change":"2024-09-10T08:28:35.572709+0000","last_active":"2024-09-10T08:44:22.537572+0000","last_peered":"2024-09-10T08:44:22.537572+0000","last_clean":"2024-09-10T08:44:22.537572+0000","last_became_active":"2024-09-10T08:28:35.572392+0000","last_became_peered":"2024-09-10T08:28:35.572392+0000","last_unstale":"2024-09-10T08:44:22.537572+0000","last_undegraded":"2024-09-10T08:44:22.537572+0000","last_fullsized":"2024-09-10T08:44:22.537572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4995,"log_dups_size":0,"ondisk_log_size":4995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:42.636299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25177,"num_write_kb":305700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"27'4176","reported_seq":4199,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.350264+0000","last_change":"2024-09-10T08:28:47.623285+0000","last_active":"2024-09-10T08:44:29.350264+0000","last_peered":"2024-09-10T08:44:29.350264+0000","last_clean":"2024-09-10T08:44:29.350264+0000","last_became_active":"2024-09-10T08:28:47.621776+0000","last_became_peered":"2024-09-10T08:28:47.621776+0000","last_unstale":"2024-09-10T08:44:29.350264+0000","last_undegraded":"2024-09-10T08:44:29.350264+0000","last_fullsized":"2024-09-10T08:44:29.350264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:32.543418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21718,"num_write_kb":267375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'3678","reported_seq":3708,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.498693+0000","last_change":"2024-09-10T08:28:35.574438+0000","last_active":"2024-09-10T08:44:22.498693+0000","last_peered":"2024-09-10T08:44:22.498693+0000","last_clean":"2024-09-10T08:44:22.498693+0000","last_became_active":"2024-09-10T08:28:35.574175+0000","last_became_peered":"2024-09-10T08:28:35.574175+0000","last_unstale":"2024-09-10T08:44:22.498693+0000","last_undegraded":"2024-09-10T08:44:22.498693+0000","last_fullsized":"2024-09-10T08:44:22.498693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3678,"log_dups_size":0,"ondisk_log_size":3678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:55.808543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18345,"num_write_kb":237300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"27'4228","reported_seq":4252,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:35.835429+0000","last_change":"2024-09-10T08:28:47.629092+0000","last_active":"2024-09-10T08:44:35.835429+0000","last_peered":"2024-09-10T08:44:35.835429+0000","last_clean":"2024-09-10T08:44:35.835429+0000","last_became_active":"2024-09-10T08:28:47.628806+0000","last_became_peered":"2024-09-10T08:28:47.628806+0000","last_unstale":"2024-09-10T08:44:35.835429+0000","last_undegraded":"2024-09-10T08:44:35.835429+0000","last_fullsized":"2024-09-10T08:44:35.835429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4228,"log_dups_size":0,"ondisk_log_size":4228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21732,"num_write_kb":287874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"27'5344","reported_seq":5360,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.508645+0000","last_change":"2024-09-10T08:29:35.107021+0000","last_active":"2024-09-10T08:44:22.508645+0000","last_peered":"2024-09-10T08:44:22.508645+0000","last_clean":"2024-09-10T08:44:22.508645+0000","last_became_active":"2024-09-10T08:29:35.106806+0000","last_became_peered":"2024-09-10T08:29:35.106806+0000","last_unstale":"2024-09-10T08:44:22.508645+0000","last_undegraded":"2024-09-10T08:44:22.508645+0000","last_fullsized":"2024-09-10T08:44:22.508645+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5344,"log_dups_size":0,"ondisk_log_size":5344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:20.234687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27047,"num_write_kb":354198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"27'5319","reported_seq":5341,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.401144+0000","last_change":"2024-09-10T08:28:47.631797+0000","last_active":"2024-09-10T08:44:29.401144+0000","last_peered":"2024-09-10T08:44:29.401144+0000","last_clean":"2024-09-10T08:44:29.401144+0000","last_became_active":"2024-09-10T08:28:47.631523+0000","last_became_peered":"2024-09-10T08:28:47.631523+0000","last_unstale":"2024-09-10T08:44:29.401144+0000","last_undegraded":"2024-09-10T08:44:29.401144+0000","last_fullsized":"2024-09-10T08:44:29.401144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5319,"log_dups_size":0,"ondisk_log_size":5319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:05.829116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28163,"num_write_kb":342261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'4477","reported_seq":4507,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.480254+0000","last_change":"2024-09-10T08:28:35.570249+0000","last_active":"2024-09-10T08:44:22.480254+0000","last_peered":"2024-09-10T08:44:22.480254+0000","last_clean":"2024-09-10T08:44:22.480254+0000","last_became_active":"2024-09-10T08:28:35.569960+0000","last_became_peered":"2024-09-10T08:28:35.569960+0000","last_unstale":"2024-09-10T08:44:22.480254+0000","last_undegraded":"2024-09-10T08:44:22.480254+0000","last_fullsized":"2024-09-10T08:44:22.480254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4477,"log_dups_size":0,"ondisk_log_size":4477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:29.787554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23485,"num_write_kb":274341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"27'5295","reported_seq":5317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.481069+0000","last_change":"2024-09-10T08:28:47.633644+0000","last_active":"2024-09-10T08:44:29.481069+0000","last_peered":"2024-09-10T08:44:29.481069+0000","last_clean":"2024-09-10T08:44:29.481069+0000","last_became_active":"2024-09-10T08:28:47.633315+0000","last_became_peered":"2024-09-10T08:28:47.633315+0000","last_unstale":"2024-09-10T08:44:29.481069+0000","last_undegraded":"2024-09-10T08:44:29.481069+0000","last_fullsized":"2024-09-10T08:44:29.481069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5295,"log_dups_size":0,"ondisk_log_size":5295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:45:55.827386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28671,"num_write_kb":360707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"27'4645","reported_seq":4675,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.519615+0000","last_change":"2024-09-10T08:28:35.560693+0000","last_active":"2024-09-10T08:44:22.519615+0000","last_peered":"2024-09-10T08:44:22.519615+0000","last_clean":"2024-09-10T08:44:22.519615+0000","last_became_active":"2024-09-10T08:28:35.560409+0000","last_became_peered":"2024-09-10T08:28:35.560409+0000","last_unstale":"2024-09-10T08:44:22.519615+0000","last_undegraded":"2024-09-10T08:44:22.519615+0000","last_fullsized":"2024-09-10T08:44:22.519615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4645,"log_dups_size":0,"ondisk_log_size":4645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:10.597654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23495,"num_write_kb":303194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"27'3828","reported_seq":3850,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.453763+0000","last_change":"2024-09-10T08:28:47.622614+0000","last_active":"2024-09-10T08:44:29.453763+0000","last_peered":"2024-09-10T08:44:29.453763+0000","last_clean":"2024-09-10T08:44:29.453763+0000","last_became_active":"2024-09-10T08:28:47.622205+0000","last_became_peered":"2024-09-10T08:28:47.622205+0000","last_unstale":"2024-09-10T08:44:29.453763+0000","last_undegraded":"2024-09-10T08:44:29.453763+0000","last_fullsized":"2024-09-10T08:44:29.453763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3828,"log_dups_size":0,"ondisk_log_size":3828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:47.090782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19475,"num_write_kb":250147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'5239","reported_seq":5270,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.476682+0000","last_change":"2024-09-10T08:28:35.574551+0000","last_active":"2024-09-10T08:44:22.476682+0000","last_peered":"2024-09-10T08:44:22.476682+0000","last_clean":"2024-09-10T08:44:22.476682+0000","last_became_active":"2024-09-10T08:28:35.574256+0000","last_became_peered":"2024-09-10T08:28:35.574256+0000","last_unstale":"2024-09-10T08:44:22.476682+0000","last_undegraded":"2024-09-10T08:44:22.476682+0000","last_fullsized":"2024-09-10T08:44:22.476682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27760,"num_write_kb":320273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"27'4221","reported_seq":4243,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.396030+0000","last_change":"2024-09-10T08:28:47.633476+0000","last_active":"2024-09-10T08:44:29.396030+0000","last_peered":"2024-09-10T08:44:29.396030+0000","last_clean":"2024-09-10T08:44:29.396030+0000","last_became_active":"2024-09-10T08:28:47.633189+0000","last_became_peered":"2024-09-10T08:28:47.633189+0000","last_unstale":"2024-09-10T08:44:29.396030+0000","last_undegraded":"2024-09-10T08:44:29.396030+0000","last_fullsized":"2024-09-10T08:44:29.396030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4221,"log_dups_size":0,"ondisk_log_size":4221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:46.175490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21808,"num_write_kb":284043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"27'4276","reported_seq":4306,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.491121+0000","last_change":"2024-09-10T08:28:35.573330+0000","last_active":"2024-09-10T08:44:22.491121+0000","last_peered":"2024-09-10T08:44:22.491121+0000","last_clean":"2024-09-10T08:44:22.491121+0000","last_became_active":"2024-09-10T08:28:35.572992+0000","last_became_peered":"2024-09-10T08:28:35.572992+0000","last_unstale":"2024-09-10T08:44:22.491121+0000","last_undegraded":"2024-09-10T08:44:22.491121+0000","last_fullsized":"2024-09-10T08:44:22.491121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4276,"log_dups_size":0,"ondisk_log_size":4276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:15.412219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22251,"num_write_kb":273423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"27'4525","reported_seq":4547,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.372686+0000","last_change":"2024-09-10T08:28:47.630733+0000","last_active":"2024-09-10T08:44:29.372686+0000","last_peered":"2024-09-10T08:44:29.372686+0000","last_clean":"2024-09-10T08:44:29.372686+0000","last_became_active":"2024-09-10T08:28:47.630447+0000","last_became_peered":"2024-09-10T08:28:47.630447+0000","last_unstale":"2024-09-10T08:44:29.372686+0000","last_undegraded":"2024-09-10T08:44:29.372686+0000","last_fullsized":"2024-09-10T08:44:29.372686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4525,"log_dups_size":0,"ondisk_log_size":4525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:55:08.797818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23690,"num_write_kb":303969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'4030","reported_seq":4060,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.496908+0000","last_change":"2024-09-10T08:28:35.566574+0000","last_active":"2024-09-10T08:44:22.496908+0000","last_peered":"2024-09-10T08:44:22.496908+0000","last_clean":"2024-09-10T08:44:22.496908+0000","last_became_active":"2024-09-10T08:28:35.566205+0000","last_became_peered":"2024-09-10T08:28:35.566205+0000","last_unstale":"2024-09-10T08:44:22.496908+0000","last_undegraded":"2024-09-10T08:44:22.496908+0000","last_fullsized":"2024-09-10T08:44:22.496908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4030,"log_dups_size":0,"ondisk_log_size":4030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:49.876773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20014,"num_write_kb":252379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"27'4167","reported_seq":4189,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.339294+0000","last_change":"2024-09-10T08:28:47.628051+0000","last_active":"2024-09-10T08:44:29.339294+0000","last_peered":"2024-09-10T08:44:29.339294+0000","last_clean":"2024-09-10T08:44:29.339294+0000","last_became_active":"2024-09-10T08:28:47.627747+0000","last_became_peered":"2024-09-10T08:28:47.627747+0000","last_unstale":"2024-09-10T08:44:29.339294+0000","last_undegraded":"2024-09-10T08:44:29.339294+0000","last_fullsized":"2024-09-10T08:44:29.339294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4167,"log_dups_size":0,"ondisk_log_size":4167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:54.210449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22015,"num_write_kb":272523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"27'4068","reported_seq":4098,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.450841+0000","last_change":"2024-09-10T08:28:35.565023+0000","last_active":"2024-09-10T08:44:22.450841+0000","last_peered":"2024-09-10T08:44:22.450841+0000","last_clean":"2024-09-10T08:44:22.450841+0000","last_became_active":"2024-09-10T08:28:35.564747+0000","last_became_peered":"2024-09-10T08:28:35.564747+0000","last_unstale":"2024-09-10T08:44:22.450841+0000","last_undegraded":"2024-09-10T08:44:22.450841+0000","last_fullsized":"2024-09-10T08:44:22.450841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4068,"log_dups_size":0,"ondisk_log_size":4068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:32.419621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20848,"num_write_kb":280067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"27'3614","reported_seq":3636,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.473598+0000","last_change":"2024-09-10T08:28:47.631047+0000","last_active":"2024-09-10T08:44:29.473598+0000","last_peered":"2024-09-10T08:44:29.473598+0000","last_clean":"2024-09-10T08:44:29.473598+0000","last_became_active":"2024-09-10T08:28:47.630617+0000","last_became_peered":"2024-09-10T08:28:47.630617+0000","last_unstale":"2024-09-10T08:44:29.473598+0000","last_undegraded":"2024-09-10T08:44:29.473598+0000","last_fullsized":"2024-09-10T08:44:29.473598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3614,"log_dups_size":0,"ondisk_log_size":3614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:29.867640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19300,"num_write_kb":257617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'4938","reported_seq":4968,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.528147+0000","last_change":"2024-09-10T08:28:35.570619+0000","last_active":"2024-09-10T08:44:22.528147+0000","last_peered":"2024-09-10T08:44:22.528147+0000","last_clean":"2024-09-10T08:44:22.528147+0000","last_became_active":"2024-09-10T08:28:35.570351+0000","last_became_peered":"2024-09-10T08:28:35.570351+0000","last_unstale":"2024-09-10T08:44:22.528147+0000","last_undegraded":"2024-09-10T08:44:22.528147+0000","last_fullsized":"2024-09-10T08:44:22.528147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4938,"log_dups_size":0,"ondisk_log_size":4938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:35.161279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26047,"num_write_kb":333713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"27'4403","reported_seq":4425,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.439522+0000","last_change":"2024-09-10T08:28:47.626191+0000","last_active":"2024-09-10T08:44:29.439522+0000","last_peered":"2024-09-10T08:44:29.439522+0000","last_clean":"2024-09-10T08:44:29.439522+0000","last_became_active":"2024-09-10T08:28:47.625781+0000","last_became_peered":"2024-09-10T08:28:47.625781+0000","last_unstale":"2024-09-10T08:44:29.439522+0000","last_undegraded":"2024-09-10T08:44:29.439522+0000","last_fullsized":"2024-09-10T08:44:29.439522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4403,"log_dups_size":0,"ondisk_log_size":4403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:36:38.651973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22837,"num_write_kb":300422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"27'5731","reported_seq":5761,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.570796+0000","last_change":"2024-09-10T08:28:35.577345+0000","last_active":"2024-09-10T08:44:22.570796+0000","last_peered":"2024-09-10T08:44:22.570796+0000","last_clean":"2024-09-10T08:44:22.570796+0000","last_became_active":"2024-09-10T08:28:35.576191+0000","last_became_peered":"2024-09-10T08:28:35.576191+0000","last_unstale":"2024-09-10T08:44:22.570796+0000","last_undegraded":"2024-09-10T08:44:22.570796+0000","last_fullsized":"2024-09-10T08:44:22.570796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5731,"log_dups_size":0,"ondisk_log_size":5731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:29.218797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30251,"num_write_kb":366959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"27'5875","reported_seq":5898,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.422514+0000","last_change":"2024-09-10T08:28:47.623129+0000","last_active":"2024-09-10T08:44:29.422514+0000","last_peered":"2024-09-10T08:44:29.422514+0000","last_clean":"2024-09-10T08:44:29.422514+0000","last_became_active":"2024-09-10T08:28:47.622851+0000","last_became_peered":"2024-09-10T08:28:47.622851+0000","last_unstale":"2024-09-10T08:44:29.422514+0000","last_undegraded":"2024-09-10T08:44:29.422514+0000","last_fullsized":"2024-09-10T08:44:29.422514+0000","mapping_epoch":23,"log_start":"27'700","ondisk_log_start":"27'700","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5175,"log_dups_size":0,"ondisk_log_size":5175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:16.045213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31498,"num_write_kb":384432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"27'4833","reported_seq":4863,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.512670+0000","last_change":"2024-09-10T08:28:35.575275+0000","last_active":"2024-09-10T08:44:22.512670+0000","last_peered":"2024-09-10T08:44:22.512670+0000","last_clean":"2024-09-10T08:44:22.512670+0000","last_became_active":"2024-09-10T08:28:35.575052+0000","last_became_peered":"2024-09-10T08:28:35.575052+0000","last_unstale":"2024-09-10T08:44:22.512670+0000","last_undegraded":"2024-09-10T08:44:22.512670+0000","last_fullsized":"2024-09-10T08:44:22.512670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4833,"log_dups_size":0,"ondisk_log_size":4833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:39:24.313017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24290,"num_write_kb":318500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"27'3897","reported_seq":3920,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.448047+0000","last_change":"2024-09-10T08:28:47.628651+0000","last_active":"2024-09-10T08:44:29.448047+0000","last_peered":"2024-09-10T08:44:29.448047+0000","last_clean":"2024-09-10T08:44:29.448047+0000","last_became_active":"2024-09-10T08:28:47.628343+0000","last_became_peered":"2024-09-10T08:28:47.628343+0000","last_unstale":"2024-09-10T08:44:29.448047+0000","last_undegraded":"2024-09-10T08:44:29.448047+0000","last_fullsized":"2024-09-10T08:44:29.448047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3897,"log_dups_size":0,"ondisk_log_size":3897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:05.848341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20646,"num_write_kb":258901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"27'4919","reported_seq":4949,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.470476+0000","last_change":"2024-09-10T08:28:35.578664+0000","last_active":"2024-09-10T08:44:22.470476+0000","last_peered":"2024-09-10T08:44:22.470476+0000","last_clean":"2024-09-10T08:44:22.470476+0000","last_became_active":"2024-09-10T08:28:35.578384+0000","last_became_peered":"2024-09-10T08:28:35.578384+0000","last_unstale":"2024-09-10T08:44:22.470476+0000","last_undegraded":"2024-09-10T08:44:22.470476+0000","last_fullsized":"2024-09-10T08:44:22.470476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4919,"log_dups_size":0,"ondisk_log_size":4919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:44.278718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25865,"num_write_kb":300415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"27'4164","reported_seq":4187,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.421617+0000","last_change":"2024-09-10T08:28:47.627593+0000","last_active":"2024-09-10T08:44:29.421617+0000","last_peered":"2024-09-10T08:44:29.421617+0000","last_clean":"2024-09-10T08:44:29.421617+0000","last_became_active":"2024-09-10T08:28:47.627237+0000","last_became_peered":"2024-09-10T08:28:47.627237+0000","last_unstale":"2024-09-10T08:44:29.421617+0000","last_undegraded":"2024-09-10T08:44:29.421617+0000","last_fullsized":"2024-09-10T08:44:29.421617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4164,"log_dups_size":0,"ondisk_log_size":4164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:16.045213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22780,"num_write_kb":275817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'3973","reported_seq":4003,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.535798+0000","last_change":"2024-09-10T08:28:35.578978+0000","last_active":"2024-09-10T08:44:22.535798+0000","last_peered":"2024-09-10T08:44:22.535798+0000","last_clean":"2024-09-10T08:44:22.535798+0000","last_became_active":"2024-09-10T08:28:35.578475+0000","last_became_peered":"2024-09-10T08:28:35.578475+0000","last_unstale":"2024-09-10T08:44:22.535798+0000","last_undegraded":"2024-09-10T08:44:22.535798+0000","last_fullsized":"2024-09-10T08:44:22.535798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3973,"log_dups_size":0,"ondisk_log_size":3973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:08.520314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20258,"num_write_kb":257321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"27'4520","reported_seq":4543,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.418567+0000","last_change":"2024-09-10T08:28:47.634072+0000","last_active":"2024-09-10T08:44:29.418567+0000","last_peered":"2024-09-10T08:44:29.418567+0000","last_clean":"2024-09-10T08:44:29.418567+0000","last_became_active":"2024-09-10T08:28:47.633776+0000","last_became_peered":"2024-09-10T08:28:47.633776+0000","last_unstale":"2024-09-10T08:44:29.418567+0000","last_undegraded":"2024-09-10T08:44:29.418567+0000","last_fullsized":"2024-09-10T08:44:29.418567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4520,"log_dups_size":0,"ondisk_log_size":4520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:30.690202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23464,"num_write_kb":303031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'5689","reported_seq":5719,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.552561+0000","last_change":"2024-09-10T08:28:35.572112+0000","last_active":"2024-09-10T08:44:22.552561+0000","last_peered":"2024-09-10T08:44:22.552561+0000","last_clean":"2024-09-10T08:44:22.552561+0000","last_became_active":"2024-09-10T08:28:35.571803+0000","last_became_peered":"2024-09-10T08:28:35.571803+0000","last_unstale":"2024-09-10T08:44:22.552561+0000","last_undegraded":"2024-09-10T08:44:22.552561+0000","last_fullsized":"2024-09-10T08:44:22.552561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5689,"log_dups_size":0,"ondisk_log_size":5689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:29.969987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28713,"num_write_kb":356779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"27'3638","reported_seq":3660,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456832+0000","last_change":"2024-09-10T08:28:47.620523+0000","last_active":"2024-09-10T08:44:29.456832+0000","last_peered":"2024-09-10T08:44:29.456832+0000","last_clean":"2024-09-10T08:44:29.456832+0000","last_became_active":"2024-09-10T08:28:47.620220+0000","last_became_peered":"2024-09-10T08:28:47.620220+0000","last_unstale":"2024-09-10T08:44:29.456832+0000","last_undegraded":"2024-09-10T08:44:29.456832+0000","last_fullsized":"2024-09-10T08:44:29.456832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3638,"log_dups_size":0,"ondisk_log_size":3638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:14.405210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18717,"num_write_kb":251073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"27'4254","reported_seq":4286,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.520565+0000","last_change":"2024-09-10T08:28:35.578961+0000","last_active":"2024-09-10T08:44:22.520565+0000","last_peered":"2024-09-10T08:44:22.520565+0000","last_clean":"2024-09-10T08:44:22.520565+0000","last_became_active":"2024-09-10T08:28:35.578680+0000","last_became_peered":"2024-09-10T08:28:35.578680+0000","last_unstale":"2024-09-10T08:44:22.520565+0000","last_undegraded":"2024-09-10T08:44:22.520565+0000","last_fullsized":"2024-09-10T08:44:22.520565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4254,"log_dups_size":0,"ondisk_log_size":4254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:53.737412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22529,"num_write_kb":274609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"27'5728","reported_seq":5750,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.335399+0000","last_change":"2024-09-10T08:28:47.624859+0000","last_active":"2024-09-10T08:44:29.335399+0000","last_peered":"2024-09-10T08:44:29.335399+0000","last_clean":"2024-09-10T08:44:29.335399+0000","last_became_active":"2024-09-10T08:28:47.624585+0000","last_became_peered":"2024-09-10T08:28:47.624585+0000","last_unstale":"2024-09-10T08:44:29.335399+0000","last_undegraded":"2024-09-10T08:44:29.335399+0000","last_fullsized":"2024-09-10T08:44:29.335399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5728,"log_dups_size":0,"ondisk_log_size":5728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:00.956870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28703,"num_write_kb":356727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'4780","reported_seq":4812,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.491273+0000","last_change":"2024-09-10T08:28:35.573918+0000","last_active":"2024-09-10T08:44:22.491273+0000","last_peered":"2024-09-10T08:44:22.491273+0000","last_clean":"2024-09-10T08:44:22.491273+0000","last_became_active":"2024-09-10T08:28:35.573646+0000","last_became_peered":"2024-09-10T08:28:35.573646+0000","last_unstale":"2024-09-10T08:44:22.491273+0000","last_undegraded":"2024-09-10T08:44:22.491273+0000","last_fullsized":"2024-09-10T08:44:22.491273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4780,"log_dups_size":0,"ondisk_log_size":4780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24418,"num_write_kb":306743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"27'4700","reported_seq":4722,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.478952+0000","last_change":"2024-09-10T08:28:47.631802+0000","last_active":"2024-09-10T08:44:29.478952+0000","last_peered":"2024-09-10T08:44:29.478952+0000","last_clean":"2024-09-10T08:44:29.478952+0000","last_became_active":"2024-09-10T08:28:47.631456+0000","last_became_peered":"2024-09-10T08:28:47.631456+0000","last_unstale":"2024-09-10T08:44:29.478952+0000","last_undegraded":"2024-09-10T08:44:29.478952+0000","last_fullsized":"2024-09-10T08:44:29.478952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4700,"log_dups_size":0,"ondisk_log_size":4700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:56.571659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23620,"num_write_kb":315928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'5816","reported_seq":5847,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.453619+0000","last_change":"2024-09-10T08:28:35.578197+0000","last_active":"2024-09-10T08:44:22.453619+0000","last_peered":"2024-09-10T08:44:22.453619+0000","last_clean":"2024-09-10T08:44:22.453619+0000","last_became_active":"2024-09-10T08:28:35.577852+0000","last_became_peered":"2024-09-10T08:28:35.577852+0000","last_unstale":"2024-09-10T08:44:22.453619+0000","last_undegraded":"2024-09-10T08:44:22.453619+0000","last_fullsized":"2024-09-10T08:44:22.453619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5816,"log_dups_size":0,"ondisk_log_size":5816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:44.348299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30528,"num_write_kb":380548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"27'4272","reported_seq":4294,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.370484+0000","last_change":"2024-09-10T08:28:47.629993+0000","last_active":"2024-09-10T08:44:29.370484+0000","last_peered":"2024-09-10T08:44:29.370484+0000","last_clean":"2024-09-10T08:44:29.370484+0000","last_became_active":"2024-09-10T08:28:47.629713+0000","last_became_peered":"2024-09-10T08:28:47.629713+0000","last_unstale":"2024-09-10T08:44:29.370484+0000","last_undegraded":"2024-09-10T08:44:29.370484+0000","last_fullsized":"2024-09-10T08:44:29.370484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4272,"log_dups_size":0,"ondisk_log_size":4272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:56.640722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22513,"num_write_kb":287067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"27'4101","reported_seq":4132,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.558949+0000","last_change":"2024-09-10T08:28:35.571065+0000","last_active":"2024-09-10T08:44:22.558949+0000","last_peered":"2024-09-10T08:44:22.558949+0000","last_clean":"2024-09-10T08:44:22.558949+0000","last_became_active":"2024-09-10T08:28:35.570749+0000","last_became_peered":"2024-09-10T08:28:35.570749+0000","last_unstale":"2024-09-10T08:44:22.558949+0000","last_undegraded":"2024-09-10T08:44:22.558949+0000","last_fullsized":"2024-09-10T08:44:22.558949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4101,"log_dups_size":0,"ondisk_log_size":4101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:04.628661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21304,"num_write_kb":261525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1506886,"num_write_kb":19151846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":286269,"ondisk_log_size":286269,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":17622670,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":51,"num_read_kb":121,"num_write":4293,"num_write_kb":18856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":35307520,"data_stored":35245340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3534,"ondisk_log_size":3534,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1565097,"num_write_kb":19381290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":301805,"ondisk_log_size":301805,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":17928438,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":58,"num_read_kb":129,"num_write":4368,"num_write_kb":19205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":35921920,"data_stored":35856876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3624,"ondisk_log_size":3624,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509638,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1140720,"kb_used_data":13152,"kb_used_omap":1,"kb_used_meta":1127550,"kb_avail":93231120,"statfs":{"total":96636764160,"available":95468666880,"internally_reserved":0,"allocated":13467648,"data_stored":13288824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1154611659},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509637,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1037512,"kb_used_data":4472,"kb_used_omap":1,"kb_used_meta":1033022,"kb_avail":93334328,"statfs":{"total":96636764160,"available":95574351872,"internally_reserved":0,"allocated":4579328,"data_stored":4398018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1057814981},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509639,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1082628,"kb_used_data":10356,"kb_used_omap":1,"kb_used_meta":1072254,"kb_avail":93289212,"statfs":{"total":96636764160,"available":95528153088,"internally_reserved":0,"allocated":10604544,"data_stored":10409366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1097988549},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509640,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1151860,"kb_used_data":17508,"kb_used_omap":1,"kb_used_meta":1134334,"kb_avail":93219980,"statfs":{"total":96636764160,"available":95457259520,"internally_reserved":0,"allocated":17928192,"data_stored":17737438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1161558471},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509639,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":892856,"kb_used_data":8488,"kb_used_omap":1,"kb_used_meta":884350,"kb_avail":93478984,"statfs":{"total":96636764160,"available":95722479616,"internally_reserved":0,"allocated":8691712,"data_stored":8504334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":905574853},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509639,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":911348,"kb_used_data":9060,"kb_used_omap":1,"kb_used_meta":902270,"kb_avail":93460492,"statfs":{"total":96636764160,"available":95703543808,"internally_reserved":0,"allocated":9277440,"data_stored":9094486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":923924933},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575045,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":775044,"kb_used_data":9524,"kb_used_omap":1,"kb_used_meta":765502,"kb_avail":93596796,"statfs":{"total":96636764160,"available":95843119104,"internally_reserved":0,"allocated":9752576,"data_stored":9566440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":783874503},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575048,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":725760,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":725374,"kb_avail":93646080,"statfs":{"total":96636764160,"available":95893585920,"internally_reserved":0,"allocated":376832,"data_stored":203022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":742783430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":88080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8477360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5271552,"data_stored":5256102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5267456,"data_stored":5256648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9158656,"data_stored":9145206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5050368,"data_stored":5038392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4292608,"data_stored":4283056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:44:42.102 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.102 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.102 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.102 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.102 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.103 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.103 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.103 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.103 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.103 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.103 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.103 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.103 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.103 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.105 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.105 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.105 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.105 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.106 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.106 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.106 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.106 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.106 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.107 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.107 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.107 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.107 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.107 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.108 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.108 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.108 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.108 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.108 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.108 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.108 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.109 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.109 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.109 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.109 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.109 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.109 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.110 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.110 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.110 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.110 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.110 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.110 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.111 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.111 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.111 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.111 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.111 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.112 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.112 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.112 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.112 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.112 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.113 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.113 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.113 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.113 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.114 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.114 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T08:28:25.445753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.114 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.114 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.114 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.114 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.115 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.115 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.115 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.115 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.115 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.115 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.116 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.116 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.116 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.116 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.117 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.117 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.117 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.117 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.117 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.118 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.118 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.118 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.118 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.119 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.119 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.120 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.120 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.120 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.120 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.121 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.121 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.121 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.121 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.121 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.121 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.121 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.121 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.122 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.122 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.122 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.122 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.122 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.122 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.122 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.123 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.123 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.123 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.123 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.123 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.124 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.124 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.124 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.124 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.124 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.125 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.125 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.125 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.125 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.125 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.126 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.126 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.126 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.126 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.126 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-10T08:28:45.593387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=45, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.126 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.126 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.127 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.127 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.127 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.127 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.127 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.128 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.128 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.128 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.128 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.128 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.129 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.129 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.129 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.129 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.129 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.129 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.130 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.130 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.130 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.130 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.130 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.130 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.131 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.131 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.131 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.131 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.131 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.131 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.131 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.132 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.132 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.132 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.132 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.132 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.132 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.132 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.132 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.133 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.133 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.133 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.133 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.133 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.133 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.133 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.134 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.134 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.134 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.134 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.134 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.134 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.134 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.134 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.134 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.135 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.135 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.135 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.135 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.135 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.135 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.135 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.136 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.136 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:44:42.136 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T08:45:02.137 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:45:02.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.247+0000 7f5c1e4eb640 1 Processor -- start 2024-09-10T08:45:02.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.247+0000 7f5c1e4eb640 1 -- start start 2024-09-10T08:45:02.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.248+0000 7f5c1e4eb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5c18151bd0 0x7f5c1815fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:02.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.248+0000 7f5c1e4eb640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c18067d50 con 0x7f5c180adb70 2024-09-10T08:45:02.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.248+0000 7f5c1e4eb640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c18067a70 con 0x7f5c180aa6b0 2024-09-10T08:45:02.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.248+0000 7f5c1e4eb640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f5c180abc20 con 0x7f5c18151bd0 2024-09-10T08:45:02.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.248+0000 7f5c177fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5c180adb70 0x7f5c181514c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:53080/0 (socket says 172.21.15.103:53080) 2024-09-10T08:45:02.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.248+0000 7f5c177fe640 1 -- 172.21.15.103:0/1118634143 learned_addr learned my addr 172.21.15.103:0/1118634143 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:45:02.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.249+0000 7f5c1ca88640 1 --2- 172.21.15.103:0/1118634143 >> v2:172.21.15.154:3300/0 conn(0x7f5c18151bd0 0x7f5c1815fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:02.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.249+0000 7f5c16ffd640 1 -- 172.21.15.103:0/1118634143 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 596157960 0 0) 0x7f5c18067d50 con 0x7f5c180adb70 2024-09-10T08:45:02.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.249+0000 7f5c16ffd640 1 -- 172.21.15.103:0/1118634143 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c00003520 con 0x7f5c180adb70 2024-09-10T08:45:02.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.249+0000 7f5c1ca88640 1 -- 172.21.15.103:0/1118634143 >> v1:172.21.15.154:6789/0 conn(0x7f5c180aa6b0 legacy=0x7f5c181549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:02.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.249+0000 7f5c1ca88640 1 -- 172.21.15.103:0/1118634143 >> v1:172.21.15.103:6789/0 conn(0x7f5c180adb70 legacy=0x7f5c181514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:02.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.249+0000 7f5c16ffd640 1 -- 172.21.15.103:0/1118634143 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3577864034 0 0) 0x7f5c00003520 con 0x7f5c180adb70 2024-09-10T08:45:02.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.249+0000 7f5c1ca88640 1 -- 172.21.15.103:0/1118634143 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c180ab660 con 0x7f5c18151bd0 2024-09-10T08:45:02.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.250+0000 7f5c1ca88640 1 --2- 172.21.15.103:0/1118634143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c18151bd0 0x7f5c1815fb40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009d90 tx=0x7f5c1002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b0d70e4b2a93531 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:02.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.250+0000 7f5c16ffd640 1 -- 172.21.15.103:0/1118634143 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c001670 con 0x7f5c18151bd0 2024-09-10T08:45:02.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.250+0000 7f5c16ffd640 1 -- 172.21.15.103:0/1118634143 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c10007540 con 0x7f5c18151bd0 2024-09-10T08:45:02.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.250+0000 7f5c16ffd640 1 -- 172.21.15.103:0/1118634143 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c100078f0 con 0x7f5c18151bd0 2024-09-10T08:45:02.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.250+0000 7f5c1e4eb640 1 -- 172.21.15.103:0/1118634143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c18151bd0 msgr2=0x7f5c1815fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:02.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.250+0000 7f5c1e4eb640 1 --2- 172.21.15.103:0/1118634143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c18151bd0 0x7f5c1815fb40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009d90 tx=0x7f5c1002a5f0 comp rx=0 tx=0).stop 2024-09-10T08:45:02.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.250+0000 7f5c1e4eb640 1 -- 172.21.15.103:0/1118634143 shutdown_connections 2024-09-10T08:45:02.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.250+0000 7f5c1e4eb640 1 --2- 172.21.15.103:0/1118634143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c18151bd0 0x7f5c1815fb40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:02.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.250+0000 7f5c1e4eb640 1 -- 172.21.15.103:0/1118634143 >> 172.21.15.103:0/1118634143 conn(0x7f5c180c4fa0 msgr2=0x7f5c180c5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:02.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.250+0000 7f5c1e4eb640 1 -- 172.21.15.103:0/1118634143 shutdown_connections 2024-09-10T08:45:02.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.251+0000 7f5c1e4eb640 1 -- 172.21.15.103:0/1118634143 wait complete. 2024-09-10T08:45:02.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.252+0000 7f5c1e4eb640 1 Processor -- start 2024-09-10T08:45:02.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.252+0000 7f5c1e4eb640 1 -- start start 2024-09-10T08:45:02.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.252+0000 7f5c1e4eb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c180aa6b0 0x7f5c1814c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:02.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.252+0000 7f5c1e4eb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c180adb70 0x7f5c180a94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:02.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.252+0000 7f5c1e4eb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c18151bd0 0x7f5c181ebb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:02.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.252+0000 7f5c1e4eb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5c180c5d10 con 0x7f5c180adb70 2024-09-10T08:45:02.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.253+0000 7f5c1e4eb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5c18154480 con 0x7f5c180aa6b0 2024-09-10T08:45:02.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.253+0000 7f5c1e4eb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f5c180ae540 con 0x7f5c18151bd0 2024-09-10T08:45:02.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.253+0000 7f5c177fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c180adb70 0x7f5c180a94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:02.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.253+0000 7f5c177fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c180adb70 0x7f5c180a94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33526/0 (socket says 172.21.15.103:33526) 2024-09-10T08:45:02.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.253+0000 7f5c177fe640 1 -- 172.21.15.103:0/1087159186 learned_addr learned my addr 172.21.15.103:0/1087159186 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:45:02.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.253+0000 7f5c17fff640 1 --2- 172.21.15.103:0/1087159186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c180aa6b0 0x7f5c1814c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.253+0000 7f5c1ca88640 1 --2- 172.21.15.103:0/1087159186 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c18151bd0 0x7f5c181ebb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.253+0000 7f5c177fe640 1 -- 172.21.15.103:0/1087159186 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c18151bd0 msgr2=0x7f5c181ebb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.253+0000 7f5c177fe640 1 --2- 172.21.15.103:0/1087159186 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c18151bd0 0x7f5c181ebb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.253+0000 7f5c177fe640 1 -- 172.21.15.103:0/1087159186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c180aa6b0 msgr2=0x7f5c1814c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.253+0000 7f5c177fe640 1 --2- 172.21.15.103:0/1087159186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c180aa6b0 0x7f5c1814c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.253+0000 7f5c177fe640 1 -- 172.21.15.103:0/1087159186 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c181effe0 con 0x7f5c180adb70 2024-09-10T08:45:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.253+0000 7f5c1ca88640 1 --2- 172.21.15.103:0/1087159186 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c18151bd0 0x7f5c181ebb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:45:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.253+0000 7f5c177fe640 1 --2- 172.21.15.103:0/1087159186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c180adb70 0x7f5c180a94f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00c780 tx=0x7f5c0c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.253+0000 7f5c14ff9640 1 -- 172.21.15.103:0/1087159186 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c017070 con 0x7f5c180adb70 2024-09-10T08:45:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.253+0000 7f5c14ff9640 1 -- 172.21.15.103:0/1087159186 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c0c005ad0 con 0x7f5c180adb70 2024-09-10T08:45:02.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.253+0000 7f5c1e4eb640 1 -- 172.21.15.103:0/1087159186 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c180c80c0 con 0x7f5c180adb70 2024-09-10T08:45:02.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.253+0000 7f5c14ff9640 1 -- 172.21.15.103:0/1087159186 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c007070 con 0x7f5c180adb70 2024-09-10T08:45:02.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.253+0000 7f5c1e4eb640 1 -- 172.21.15.103:0/1087159186 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c180a7e70 con 0x7f5c180adb70 2024-09-10T08:45:02.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.254+0000 7f5c1e4eb640 1 -- 172.21.15.103:0/1087159186 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c180761c0 con 0x7f5c180adb70 2024-09-10T08:45:02.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.255+0000 7f5c14ff9640 1 -- 172.21.15.103:0/1087159186 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c0c01a070 con 0x7f5c180adb70 2024-09-10T08:45:02.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.255+0000 7f5c14ff9640 1 --2- 172.21.15.103:0/1087159186 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5c0406be30 0x7f5c0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:02.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.255+0000 7f5c14ff9640 1 -- 172.21.15.103:0/1087159186 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f5c0c08a650 con 0x7f5c180adb70 2024-09-10T08:45:02.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.255+0000 7f5c17fff640 1 --2- 172.21.15.103:0/1087159186 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5c0406be30 0x7f5c0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:02.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.256+0000 7f5c17fff640 1 --2- 172.21.15.103:0/1087159186 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5c0406be30 0x7f5c0406e2f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5c180a9d70 tx=0x7f5c08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:02.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.260+0000 7f5c14ff9640 1 -- 172.21.15.103:0/1087159186 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5c180761c0 con 0x7f5c180adb70 2024-09-10T08:45:02.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.422+0000 7f5c1e4eb640 1 -- 172.21.15.103:0/1087159186 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c180aaa90 con 0x7f5c0406be30 2024-09-10T08:45:02.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.433+0000 7f5c14ff9640 1 -- 172.21.15.103:0/1087159186 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+492644 (secure 0 0 0) 0x7f5c180aaa90 con 0x7f5c0406be30 2024-09-10T08:45:02.434 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:45:02.443 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T08:45:02.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.437+0000 7f5c1e4eb640 1 -- 172.21.15.103:0/1087159186 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5c0406be30 msgr2=0x7f5c0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:02.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.437+0000 7f5c1e4eb640 1 --2- 172.21.15.103:0/1087159186 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5c0406be30 0x7f5c0406e2f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5c180a9d70 tx=0x7f5c08009040 comp rx=0 tx=0).stop 2024-09-10T08:45:02.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.437+0000 7f5c1e4eb640 1 -- 172.21.15.103:0/1087159186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c180adb70 msgr2=0x7f5c180a94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:02.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.437+0000 7f5c1e4eb640 1 --2- 172.21.15.103:0/1087159186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c180adb70 0x7f5c180a94f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00c780 tx=0x7f5c0c00cc40 comp rx=0 tx=0).stop 2024-09-10T08:45:02.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.437+0000 7f5c1e4eb640 1 -- 172.21.15.103:0/1087159186 shutdown_connections 2024-09-10T08:45:02.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.437+0000 7f5c1e4eb640 1 --2- 172.21.15.103:0/1087159186 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f5c0406be30 0x7f5c0406e2f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:02.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.437+0000 7f5c1e4eb640 1 --2- 172.21.15.103:0/1087159186 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c18151bd0 0x7f5c181ebb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:02.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.437+0000 7f5c1e4eb640 1 --2- 172.21.15.103:0/1087159186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c180adb70 0x7f5c180a94f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:02.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.437+0000 7f5c1e4eb640 1 --2- 172.21.15.103:0/1087159186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c180aa6b0 0x7f5c1814c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:02.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.437+0000 7f5c1e4eb640 1 -- 172.21.15.103:0/1087159186 >> 172.21.15.103:0/1087159186 conn(0x7f5c180c4fa0 msgr2=0x7f5c1814f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:02.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.437+0000 7f5c1e4eb640 1 -- 172.21.15.103:0/1087159186 shutdown_connections 2024-09-10T08:45:02.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:02.437+0000 7f5c1e4eb640 1 -- 172.21.15.103:0/1087159186 wait complete. 2024-09-10T08:45:02.452 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":519,"stamp":"2024-09-10T08:45:01.070113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36141476,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":225,"num_read_kb":350,"num_write":3080803,"num_write_kb":38573613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":595400,"ondisk_log_size":595400,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7701088,"kb_used_data":72928,"kb_used_omap":12,"kb_used_meta":7628019,"kb_avail":747273632,"statfs":{"total":773094113280,"available":765208199168,"internally_reserved":0,"allocated":74678272,"data_stored":73201928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":7811092019},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004072"},"pg_stats":[{"pgid":"5.18","version":"27'4501","reported_seq":4524,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.380982+0000","last_change":"2024-09-10T08:28:47.627476+0000","last_active":"2024-09-10T08:44:29.380982+0000","last_peered":"2024-09-10T08:44:29.380982+0000","last_clean":"2024-09-10T08:44:29.380982+0000","last_became_active":"2024-09-10T08:28:47.627217+0000","last_became_peered":"2024-09-10T08:28:47.627217+0000","last_unstale":"2024-09-10T08:44:29.380982+0000","last_undegraded":"2024-09-10T08:44:29.380982+0000","last_fullsized":"2024-09-10T08:44:29.380982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":0,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23743,"num_write_kb":296073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"27'675","reported_seq":717,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:44.959738+0000","last_change":"2024-09-10T08:44:44.959766+0000","last_active":"2024-09-10T08:44:44.959738+0000","last_peered":"2024-09-10T08:44:44.959738+0000","last_clean":"2024-09-10T08:44:44.959738+0000","last_became_active":"2024-09-10T08:28:34.564545+0000","last_became_peered":"2024-09-10T08:28:34.564545+0000","last_unstale":"2024-09-10T08:44:44.959738+0000","last_undegraded":"2024-09-10T08:44:44.959738+0000","last_fullsized":"2024-09-10T08:44:44.959738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'675","last_scrub_stamp":"2024-09-10T08:44:44.959643+0000","last_deep_scrub":"27'675","last_deep_scrub_stamp":"2024-09-10T08:44:44.959643+0000","last_clean_scrub_stamp":"2024-09-10T08:44:44.959643+0000","objects_scrubbed":3,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:46.408917+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":670,"num_write_kb":4473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5460","reported_seq":5501,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:53.616472+0000","last_change":"2024-09-10T08:44:53.616501+0000","last_active":"2024-09-10T08:44:53.616472+0000","last_peered":"2024-09-10T08:44:53.616472+0000","last_clean":"2024-09-10T08:44:53.616472+0000","last_became_active":"2024-09-10T08:28:35.575019+0000","last_became_peered":"2024-09-10T08:28:35.575019+0000","last_unstale":"2024-09-10T08:44:53.616472+0000","last_undegraded":"2024-09-10T08:44:53.616472+0000","last_fullsized":"2024-09-10T08:44:53.616472+0000","mapping_epoch":19,"log_start":"27'200","ondisk_log_start":"27'200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5460","last_scrub_stamp":"2024-09-10T08:44:53.616348+0000","last_deep_scrub":"27'5460","last_deep_scrub_stamp":"2024-09-10T08:44:53.616348+0000","last_clean_scrub_stamp":"2024-09-10T08:44:53.616348+0000","objects_scrubbed":0,"log_size":5260,"log_dups_size":0,"ondisk_log_size":5260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:55.258412+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28693,"num_write_kb":332310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:41.883417+0000","last_change":"2024-09-10T08:44:41.883480+0000","last_active":"2024-09-10T08:44:41.883417+0000","last_peered":"2024-09-10T08:44:41.883417+0000","last_clean":"2024-09-10T08:44:41.883417+0000","last_became_active":"2024-09-10T08:28:46.619540+0000","last_became_peered":"2024-09-10T08:28:46.619540+0000","last_unstale":"2024-09-10T08:44:41.883417+0000","last_undegraded":"2024-09-10T08:44:41.883417+0000","last_fullsized":"2024-09-10T08:44:41.883417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-10T08:44:41.883299+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-10T08:44:41.883299+0000","last_clean_scrub_stamp":"2024-09-10T08:44:41.883299+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:25.715674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"27'5259","reported_seq":5282,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.450233+0000","last_change":"2024-09-10T08:28:47.633586+0000","last_active":"2024-09-10T08:44:29.450233+0000","last_peered":"2024-09-10T08:44:29.450233+0000","last_clean":"2024-09-10T08:44:29.450233+0000","last_became_active":"2024-09-10T08:28:47.633292+0000","last_became_peered":"2024-09-10T08:28:47.633292+0000","last_unstale":"2024-09-10T08:44:29.450233+0000","last_undegraded":"2024-09-10T08:44:29.450233+0000","last_fullsized":"2024-09-10T08:44:29.450233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5259,"log_dups_size":0,"ondisk_log_size":5259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27465,"num_write_kb":347758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"27'8","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:54.631479+0000","last_change":"2024-09-10T08:44:54.631508+0000","last_active":"2024-09-10T08:44:54.631479+0000","last_peered":"2024-09-10T08:44:54.631479+0000","last_clean":"2024-09-10T08:44:54.631479+0000","last_became_active":"2024-09-10T08:28:34.561410+0000","last_became_peered":"2024-09-10T08:28:34.561410+0000","last_unstale":"2024-09-10T08:44:54.631479+0000","last_undegraded":"2024-09-10T08:44:54.631479+0000","last_fullsized":"2024-09-10T08:44:54.631479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-09-10T08:44:54.631352+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-09-10T08:44:54.631352+0000","last_clean_scrub_stamp":"2024-09-10T08:44:54.631352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:55:20.219441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'5545","reported_seq":5585,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:39.900576+0000","last_change":"2024-09-10T08:44:39.900622+0000","last_active":"2024-09-10T08:44:39.900576+0000","last_peered":"2024-09-10T08:44:39.900576+0000","last_clean":"2024-09-10T08:44:39.900576+0000","last_became_active":"2024-09-10T08:28:35.578333+0000","last_became_peered":"2024-09-10T08:28:35.578333+0000","last_unstale":"2024-09-10T08:44:39.900576+0000","last_undegraded":"2024-09-10T08:44:39.900576+0000","last_fullsized":"2024-09-10T08:44:39.900576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5545","last_scrub_stamp":"2024-09-10T08:44:39.900423+0000","last_deep_scrub":"27'5545","last_deep_scrub_stamp":"2024-09-10T08:44:39.900423+0000","last_clean_scrub_stamp":"2024-09-10T08:44:39.900423+0000","objects_scrubbed":0,"log_size":5545,"log_dups_size":0,"ondisk_log_size":5545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:28:05.013137+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29606,"num_write_kb":364444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:46.472560+0000","last_change":"2024-09-10T08:44:46.472588+0000","last_active":"2024-09-10T08:44:46.472560+0000","last_peered":"2024-09-10T08:44:46.472560+0000","last_clean":"2024-09-10T08:44:46.472560+0000","last_became_active":"2024-09-10T08:28:46.616806+0000","last_became_peered":"2024-09-10T08:28:46.616806+0000","last_unstale":"2024-09-10T08:44:46.472560+0000","last_undegraded":"2024-09-10T08:44:46.472560+0000","last_fullsized":"2024-09-10T08:44:46.472560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-10T08:44:46.472467+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-10T08:44:46.472467+0000","last_clean_scrub_stamp":"2024-09-10T08:44:46.472467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:56.731181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"27'4143","reported_seq":4166,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.447253+0000","last_change":"2024-09-10T08:28:47.633194+0000","last_active":"2024-09-10T08:44:29.447253+0000","last_peered":"2024-09-10T08:44:29.447253+0000","last_clean":"2024-09-10T08:44:29.447253+0000","last_became_active":"2024-09-10T08:28:47.632772+0000","last_became_peered":"2024-09-10T08:28:47.632772+0000","last_unstale":"2024-09-10T08:44:29.447253+0000","last_undegraded":"2024-09-10T08:44:29.447253+0000","last_fullsized":"2024-09-10T08:44:29.447253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4143,"log_dups_size":0,"ondisk_log_size":4143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21394,"num_write_kb":261850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"27'11","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.004403+0000","last_change":"2024-09-10T08:28:34.571965+0000","last_active":"2024-09-10T08:43:48.004403+0000","last_peered":"2024-09-10T08:43:48.004403+0000","last_clean":"2024-09-10T08:43:48.004403+0000","last_became_active":"2024-09-10T08:28:34.571640+0000","last_became_peered":"2024-09-10T08:28:34.571640+0000","last_unstale":"2024-09-10T08:43:48.004403+0000","last_undegraded":"2024-09-10T08:43:48.004403+0000","last_fullsized":"2024-09-10T08:43:48.004403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'3192","reported_seq":3231,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:57.255787+0000","last_change":"2024-09-10T08:44:57.255814+0000","last_active":"2024-09-10T08:44:57.255787+0000","last_peered":"2024-09-10T08:44:57.255787+0000","last_clean":"2024-09-10T08:44:57.255787+0000","last_became_active":"2024-09-10T08:28:35.561842+0000","last_became_peered":"2024-09-10T08:28:35.561842+0000","last_unstale":"2024-09-10T08:44:57.255787+0000","last_undegraded":"2024-09-10T08:44:57.255787+0000","last_fullsized":"2024-09-10T08:44:57.255787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3192","last_scrub_stamp":"2024-09-10T08:44:57.255692+0000","last_deep_scrub":"27'3192","last_deep_scrub_stamp":"2024-09-10T08:44:57.255692+0000","last_clean_scrub_stamp":"2024-09-10T08:44:57.255692+0000","objects_scrubbed":0,"log_size":3192,"log_dups_size":0,"ondisk_log_size":3192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:57.395124+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15765,"num_write_kb":210601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'614","reported_seq":647,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:43.569199+0000","last_change":"2024-09-10T08:44:43.569226+0000","last_active":"2024-09-10T08:44:43.569199+0000","last_peered":"2024-09-10T08:44:43.569199+0000","last_clean":"2024-09-10T08:44:43.569199+0000","last_became_active":"2024-09-10T08:28:46.620794+0000","last_became_peered":"2024-09-10T08:28:46.620794+0000","last_unstale":"2024-09-10T08:44:43.569199+0000","last_undegraded":"2024-09-10T08:44:43.569199+0000","last_fullsized":"2024-09-10T08:44:43.569199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'614","last_scrub_stamp":"2024-09-10T08:44:43.569112+0000","last_deep_scrub":"27'614","last_deep_scrub_stamp":"2024-09-10T08:44:43.569112+0000","last_clean_scrub_stamp":"2024-09-10T08:44:43.569112+0000","objects_scrubbed":1,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:30:05.692225+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":611,"num_write_kb":4232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"27'3484","reported_seq":3507,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.383543+0000","last_change":"2024-09-10T08:28:47.627756+0000","last_active":"2024-09-10T08:44:29.383543+0000","last_peered":"2024-09-10T08:44:29.383543+0000","last_clean":"2024-09-10T08:44:29.383543+0000","last_became_active":"2024-09-10T08:28:47.627476+0000","last_became_peered":"2024-09-10T08:28:47.627476+0000","last_unstale":"2024-09-10T08:44:29.383543+0000","last_undegraded":"2024-09-10T08:44:29.383543+0000","last_fullsized":"2024-09-10T08:44:29.383543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18057,"num_write_kb":232111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"27'4","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:55.929911+0000","last_change":"2024-09-10T08:44:55.929943+0000","last_active":"2024-09-10T08:44:55.929911+0000","last_peered":"2024-09-10T08:44:55.929911+0000","last_clean":"2024-09-10T08:44:55.929911+0000","last_became_active":"2024-09-10T08:28:34.566275+0000","last_became_peered":"2024-09-10T08:28:34.566275+0000","last_unstale":"2024-09-10T08:44:55.929911+0000","last_undegraded":"2024-09-10T08:44:55.929911+0000","last_fullsized":"2024-09-10T08:44:55.929911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-09-10T08:44:55.929815+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-09-10T08:44:55.929815+0000","last_clean_scrub_stamp":"2024-09-10T08:44:55.929815+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:27.462244+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'5826","reported_seq":5851,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:55.338232+0000","last_change":"2024-09-10T08:44:55.338261+0000","last_active":"2024-09-10T08:44:55.338232+0000","last_peered":"2024-09-10T08:44:55.338232+0000","last_clean":"2024-09-10T08:44:55.338232+0000","last_became_active":"2024-09-10T08:29:35.097553+0000","last_became_peered":"2024-09-10T08:29:35.097553+0000","last_unstale":"2024-09-10T08:44:55.338232+0000","last_undegraded":"2024-09-10T08:44:55.338232+0000","last_fullsized":"2024-09-10T08:44:55.338232+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5826","last_scrub_stamp":"2024-09-10T08:44:55.338134+0000","last_deep_scrub":"27'5826","last_deep_scrub_stamp":"2024-09-10T08:44:55.338134+0000","last_clean_scrub_stamp":"2024-09-10T08:44:55.338134+0000","objects_scrubbed":0,"log_size":5826,"log_dups_size":0,"ondisk_log_size":5826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:38:37.610377+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30231,"num_write_kb":366977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"27'66","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:40.627161+0000","last_change":"2024-09-10T08:44:40.627188+0000","last_active":"2024-09-10T08:44:40.627161+0000","last_peered":"2024-09-10T08:44:40.627161+0000","last_clean":"2024-09-10T08:44:40.627161+0000","last_became_active":"2024-09-10T08:28:46.619889+0000","last_became_peered":"2024-09-10T08:28:46.619889+0000","last_unstale":"2024-09-10T08:44:40.627161+0000","last_undegraded":"2024-09-10T08:44:40.627161+0000","last_fullsized":"2024-09-10T08:44:40.627161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2024-09-10T08:44:40.627072+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2024-09-10T08:44:40.627072+0000","last_clean_scrub_stamp":"2024-09-10T08:44:40.627072+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:39.075014+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":755904,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"27'4988","reported_seq":5012,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:36.297578+0000","last_change":"2024-09-10T08:28:47.631094+0000","last_active":"2024-09-10T08:44:36.297578+0000","last_peered":"2024-09-10T08:44:36.297578+0000","last_clean":"2024-09-10T08:44:36.297578+0000","last_became_active":"2024-09-10T08:28:47.630787+0000","last_became_peered":"2024-09-10T08:28:47.630787+0000","last_unstale":"2024-09-10T08:44:36.297578+0000","last_undegraded":"2024-09-10T08:44:36.297578+0000","last_fullsized":"2024-09-10T08:44:36.297578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4988,"log_dups_size":0,"ondisk_log_size":4988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26081,"num_write_kb":317657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"27'4088","reported_seq":4128,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:53.166146+0000","last_change":"2024-09-10T08:44:53.166170+0000","last_active":"2024-09-10T08:44:53.166146+0000","last_peered":"2024-09-10T08:44:53.166146+0000","last_clean":"2024-09-10T08:44:53.166146+0000","last_became_active":"2024-09-10T08:28:35.572215+0000","last_became_peered":"2024-09-10T08:28:35.572215+0000","last_unstale":"2024-09-10T08:44:53.166146+0000","last_undegraded":"2024-09-10T08:44:53.166146+0000","last_fullsized":"2024-09-10T08:44:53.166146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4088","last_scrub_stamp":"2024-09-10T08:44:53.166055+0000","last_deep_scrub":"27'4088","last_deep_scrub_stamp":"2024-09-10T08:44:53.166055+0000","last_clean_scrub_stamp":"2024-09-10T08:44:53.166055+0000","objects_scrubbed":0,"log_size":4088,"log_dups_size":0,"ondisk_log_size":4088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:00.429408+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21444,"num_write_kb":270258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'1131","reported_seq":1173,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:57.925717+0000","last_change":"2024-09-10T08:44:57.925775+0000","last_active":"2024-09-10T08:44:57.925717+0000","last_peered":"2024-09-10T08:44:57.925717+0000","last_clean":"2024-09-10T08:44:57.925717+0000","last_became_active":"2024-09-10T08:28:34.568899+0000","last_became_peered":"2024-09-10T08:28:34.568899+0000","last_unstale":"2024-09-10T08:44:57.925717+0000","last_undegraded":"2024-09-10T08:44:57.925717+0000","last_fullsized":"2024-09-10T08:44:57.925717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1131","last_scrub_stamp":"2024-09-10T08:44:57.925604+0000","last_deep_scrub":"27'1131","last_deep_scrub_stamp":"2024-09-10T08:44:57.925604+0000","last_clean_scrub_stamp":"2024-09-10T08:44:57.925604+0000","objects_scrubbed":2,"log_size":1131,"log_dups_size":0,"ondisk_log_size":1131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:38.187805+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'3","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:44.519593+0000","last_change":"2024-09-10T08:44:44.519624+0000","last_active":"2024-09-10T08:44:44.519593+0000","last_peered":"2024-09-10T08:44:44.519593+0000","last_clean":"2024-09-10T08:44:44.519593+0000","last_became_active":"2024-09-10T08:28:46.616824+0000","last_became_peered":"2024-09-10T08:28:46.616824+0000","last_unstale":"2024-09-10T08:44:44.519593+0000","last_undegraded":"2024-09-10T08:44:44.519593+0000","last_fullsized":"2024-09-10T08:44:44.519593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-10T08:44:44.519486+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-10T08:44:44.519486+0000","last_clean_scrub_stamp":"2024-09-10T08:44:44.519486+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:07.229643+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"27'4540","reported_seq":4572,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:52.268065+0000","last_change":"2024-09-10T08:44:52.268106+0000","last_active":"2024-09-10T08:44:52.268065+0000","last_peered":"2024-09-10T08:44:52.268065+0000","last_clean":"2024-09-10T08:44:52.268065+0000","last_became_active":"2024-09-10T08:28:47.626871+0000","last_became_peered":"2024-09-10T08:28:47.626871+0000","last_unstale":"2024-09-10T08:44:52.268065+0000","last_undegraded":"2024-09-10T08:44:52.268065+0000","last_fullsized":"2024-09-10T08:44:52.268065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4540","last_scrub_stamp":"2024-09-10T08:44:52.267964+0000","last_deep_scrub":"27'4540","last_deep_scrub_stamp":"2024-09-10T08:44:52.267964+0000","last_clean_scrub_stamp":"2024-09-10T08:44:52.267964+0000","objects_scrubbed":0,"log_size":4540,"log_dups_size":0,"ondisk_log_size":4540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:45.826167+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23818,"num_write_kb":300351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"27'4200","reported_seq":4240,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:47.681611+0000","last_change":"2024-09-10T08:44:47.681659+0000","last_active":"2024-09-10T08:44:47.681611+0000","last_peered":"2024-09-10T08:44:47.681611+0000","last_clean":"2024-09-10T08:44:47.681611+0000","last_became_active":"2024-09-10T08:28:35.576771+0000","last_became_peered":"2024-09-10T08:28:35.576771+0000","last_unstale":"2024-09-10T08:44:47.681611+0000","last_undegraded":"2024-09-10T08:44:47.681611+0000","last_fullsized":"2024-09-10T08:44:47.681611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4200","last_scrub_stamp":"2024-09-10T08:44:47.681450+0000","last_deep_scrub":"27'4200","last_deep_scrub_stamp":"2024-09-10T08:44:47.681450+0000","last_clean_scrub_stamp":"2024-09-10T08:44:47.681450+0000","objects_scrubbed":0,"log_size":4200,"log_dups_size":0,"ondisk_log_size":4200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:05.324828+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21158,"num_write_kb":256901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:51.258970+0000","last_change":"2024-09-10T08:44:51.258994+0000","last_active":"2024-09-10T08:44:51.258970+0000","last_peered":"2024-09-10T08:44:51.258970+0000","last_clean":"2024-09-10T08:44:51.258970+0000","last_became_active":"2024-09-10T08:28:34.560974+0000","last_became_peered":"2024-09-10T08:28:34.560974+0000","last_unstale":"2024-09-10T08:44:51.258970+0000","last_undegraded":"2024-09-10T08:44:51.258970+0000","last_fullsized":"2024-09-10T08:44:51.258970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-09-10T08:44:51.258870+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-09-10T08:44:51.258870+0000","last_clean_scrub_stamp":"2024-09-10T08:44:51.258870+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:16.745084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'2","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:41.628795+0000","last_change":"2024-09-10T08:44:41.628836+0000","last_active":"2024-09-10T08:44:41.628795+0000","last_peered":"2024-09-10T08:44:41.628795+0000","last_clean":"2024-09-10T08:44:41.628795+0000","last_became_active":"2024-09-10T08:28:46.619553+0000","last_became_peered":"2024-09-10T08:28:46.619553+0000","last_unstale":"2024-09-10T08:44:41.628795+0000","last_undegraded":"2024-09-10T08:44:41.628795+0000","last_fullsized":"2024-09-10T08:44:41.628795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-09-10T08:44:41.628691+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-09-10T08:44:41.628691+0000","last_clean_scrub_stamp":"2024-09-10T08:44:41.628691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:02:26.008015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"27'4215","reported_seq":4239,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:37.563898+0000","last_change":"2024-09-10T08:28:47.628563+0000","last_active":"2024-09-10T08:44:37.563898+0000","last_peered":"2024-09-10T08:44:37.563898+0000","last_clean":"2024-09-10T08:44:37.563898+0000","last_became_active":"2024-09-10T08:28:47.628290+0000","last_became_peered":"2024-09-10T08:28:47.628290+0000","last_unstale":"2024-09-10T08:44:37.563898+0000","last_undegraded":"2024-09-10T08:44:37.563898+0000","last_fullsized":"2024-09-10T08:44:37.563898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21334,"num_write_kb":282217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'4711","reported_seq":4743,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.512110+0000","last_change":"2024-09-10T08:28:35.572363+0000","last_active":"2024-09-10T08:44:22.512110+0000","last_peered":"2024-09-10T08:44:22.512110+0000","last_clean":"2024-09-10T08:44:22.512110+0000","last_became_active":"2024-09-10T08:28:35.572108+0000","last_became_peered":"2024-09-10T08:28:35.572108+0000","last_unstale":"2024-09-10T08:44:22.512110+0000","last_undegraded":"2024-09-10T08:44:22.512110+0000","last_fullsized":"2024-09-10T08:44:22.512110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4711,"log_dups_size":0,"ondisk_log_size":4711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24668,"num_write_kb":303691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:53.206674+0000","last_change":"2024-09-10T08:44:53.206703+0000","last_active":"2024-09-10T08:44:53.206674+0000","last_peered":"2024-09-10T08:44:53.206674+0000","last_clean":"2024-09-10T08:44:53.206674+0000","last_became_active":"2024-09-10T08:28:34.564557+0000","last_became_peered":"2024-09-10T08:28:34.564557+0000","last_unstale":"2024-09-10T08:44:53.206674+0000","last_undegraded":"2024-09-10T08:44:53.206674+0000","last_fullsized":"2024-09-10T08:44:53.206674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-10T08:44:53.206572+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-10T08:44:53.206572+0000","last_clean_scrub_stamp":"2024-09-10T08:44:53.206572+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:41.035223+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:44.295347+0000","last_change":"2024-09-10T08:44:44.295378+0000","last_active":"2024-09-10T08:44:44.295347+0000","last_peered":"2024-09-10T08:44:44.295347+0000","last_clean":"2024-09-10T08:44:44.295347+0000","last_became_active":"2024-09-10T08:28:46.625059+0000","last_became_peered":"2024-09-10T08:28:46.625059+0000","last_unstale":"2024-09-10T08:44:44.295347+0000","last_undegraded":"2024-09-10T08:44:44.295347+0000","last_fullsized":"2024-09-10T08:44:44.295347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-09-10T08:44:44.295257+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-09-10T08:44:44.295257+0000","last_clean_scrub_stamp":"2024-09-10T08:44:44.295257+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:26.589335+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"27'5035","reported_seq":5067,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:48.041644+0000","last_change":"2024-09-10T08:44:48.041693+0000","last_active":"2024-09-10T08:44:48.041644+0000","last_peered":"2024-09-10T08:44:48.041644+0000","last_clean":"2024-09-10T08:44:48.041644+0000","last_became_active":"2024-09-10T08:28:47.621043+0000","last_became_peered":"2024-09-10T08:28:47.621043+0000","last_unstale":"2024-09-10T08:44:48.041644+0000","last_undegraded":"2024-09-10T08:44:48.041644+0000","last_fullsized":"2024-09-10T08:44:48.041644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5035","last_scrub_stamp":"2024-09-10T08:44:48.041529+0000","last_deep_scrub":"27'5035","last_deep_scrub_stamp":"2024-09-10T08:44:48.041529+0000","last_clean_scrub_stamp":"2024-09-10T08:44:48.041529+0000","objects_scrubbed":0,"log_size":5035,"log_dups_size":0,"ondisk_log_size":5035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:04.907621+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25734,"num_write_kb":340789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"27'4207","reported_seq":4247,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:50.434430+0000","last_change":"2024-09-10T08:44:50.434455+0000","last_active":"2024-09-10T08:44:50.434430+0000","last_peered":"2024-09-10T08:44:50.434430+0000","last_clean":"2024-09-10T08:44:50.434430+0000","last_became_active":"2024-09-10T08:28:35.569109+0000","last_became_peered":"2024-09-10T08:28:35.569109+0000","last_unstale":"2024-09-10T08:44:50.434430+0000","last_undegraded":"2024-09-10T08:44:50.434430+0000","last_fullsized":"2024-09-10T08:44:50.434430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4207","last_scrub_stamp":"2024-09-10T08:44:50.434311+0000","last_deep_scrub":"27'4207","last_deep_scrub_stamp":"2024-09-10T08:44:50.434311+0000","last_clean_scrub_stamp":"2024-09-10T08:44:50.434311+0000","objects_scrubbed":0,"log_size":4207,"log_dups_size":0,"ondisk_log_size":4207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:02.471993+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21000,"num_write_kb":276623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:48.522734+0000","last_change":"2024-09-10T08:28:34.571069+0000","last_active":"2024-09-10T08:43:48.522734+0000","last_peered":"2024-09-10T08:43:48.522734+0000","last_clean":"2024-09-10T08:43:48.522734+0000","last_became_active":"2024-09-10T08:28:34.570766+0000","last_became_peered":"2024-09-10T08:28:34.570766+0000","last_unstale":"2024-09-10T08:43:48.522734+0000","last_undegraded":"2024-09-10T08:43:48.522734+0000","last_fullsized":"2024-09-10T08:43:48.522734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:54.403176+0000","last_change":"2024-09-10T08:44:54.403209+0000","last_active":"2024-09-10T08:44:54.403176+0000","last_peered":"2024-09-10T08:44:54.403176+0000","last_clean":"2024-09-10T08:44:54.403176+0000","last_became_active":"2024-09-10T08:28:46.616254+0000","last_became_peered":"2024-09-10T08:28:46.616254+0000","last_unstale":"2024-09-10T08:44:54.403176+0000","last_undegraded":"2024-09-10T08:44:54.403176+0000","last_fullsized":"2024-09-10T08:44:54.403176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-09-10T08:44:54.403087+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-09-10T08:44:54.403087+0000","last_clean_scrub_stamp":"2024-09-10T08:44:54.403087+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:34.733408+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"27'4342","reported_seq":4367,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:40.048750+0000","last_change":"2024-09-10T08:28:47.628177+0000","last_active":"2024-09-10T08:44:40.048750+0000","last_peered":"2024-09-10T08:44:40.048750+0000","last_clean":"2024-09-10T08:44:40.048750+0000","last_became_active":"2024-09-10T08:28:47.627869+0000","last_became_peered":"2024-09-10T08:28:47.627869+0000","last_unstale":"2024-09-10T08:44:40.048750+0000","last_undegraded":"2024-09-10T08:44:40.048750+0000","last_fullsized":"2024-09-10T08:44:40.048750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23056,"num_write_kb":285008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"27'4228","reported_seq":4268,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:48.937528+0000","last_change":"2024-09-10T08:44:48.937554+0000","last_active":"2024-09-10T08:44:48.937528+0000","last_peered":"2024-09-10T08:44:48.937528+0000","last_clean":"2024-09-10T08:44:48.937528+0000","last_became_active":"2024-09-10T08:28:35.574815+0000","last_became_peered":"2024-09-10T08:28:35.574815+0000","last_unstale":"2024-09-10T08:44:48.937528+0000","last_undegraded":"2024-09-10T08:44:48.937528+0000","last_fullsized":"2024-09-10T08:44:48.937528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4228","last_scrub_stamp":"2024-09-10T08:44:48.937413+0000","last_deep_scrub":"27'4228","last_deep_scrub_stamp":"2024-09-10T08:44:48.937413+0000","last_clean_scrub_stamp":"2024-09-10T08:44:48.937413+0000","objects_scrubbed":0,"log_size":4228,"log_dups_size":0,"ondisk_log_size":4228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:19.291612+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21299,"num_write_kb":257333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'6","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:50.139475+0000","last_change":"2024-09-10T08:44:50.139548+0000","last_active":"2024-09-10T08:44:50.139475+0000","last_peered":"2024-09-10T08:44:50.139475+0000","last_clean":"2024-09-10T08:44:50.139475+0000","last_became_active":"2024-09-10T08:28:34.564549+0000","last_became_peered":"2024-09-10T08:28:34.564549+0000","last_unstale":"2024-09-10T08:44:50.139475+0000","last_undegraded":"2024-09-10T08:44:50.139475+0000","last_fullsized":"2024-09-10T08:44:50.139475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-09-10T08:44:50.139386+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-09-10T08:44:50.139386+0000","last_clean_scrub_stamp":"2024-09-10T08:44:50.139386+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:15.672405+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'54","reported_seq":139,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:45.501874+0000","last_change":"2024-09-10T08:44:45.501934+0000","last_active":"2024-09-10T08:44:45.501874+0000","last_peered":"2024-09-10T08:44:45.501874+0000","last_clean":"2024-09-10T08:44:45.501874+0000","last_became_active":"2024-09-10T08:28:46.621052+0000","last_became_peered":"2024-09-10T08:28:46.621052+0000","last_unstale":"2024-09-10T08:44:45.501874+0000","last_undegraded":"2024-09-10T08:44:45.501874+0000","last_fullsized":"2024-09-10T08:44:45.501874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2024-09-10T08:44:45.501762+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2024-09-10T08:44:45.501762+0000","last_clean_scrub_stamp":"2024-09-10T08:44:45.501762+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:57.954829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":121,"num_write":51,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"27'4494","reported_seq":4526,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:57.502087+0000","last_change":"2024-09-10T08:44:57.502140+0000","last_active":"2024-09-10T08:44:57.502087+0000","last_peered":"2024-09-10T08:44:57.502087+0000","last_clean":"2024-09-10T08:44:57.502087+0000","last_became_active":"2024-09-10T08:28:47.624651+0000","last_became_peered":"2024-09-10T08:28:47.624651+0000","last_unstale":"2024-09-10T08:44:57.502087+0000","last_undegraded":"2024-09-10T08:44:57.502087+0000","last_fullsized":"2024-09-10T08:44:57.502087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4494","last_scrub_stamp":"2024-09-10T08:44:57.501977+0000","last_deep_scrub":"27'4494","last_deep_scrub_stamp":"2024-09-10T08:44:57.501977+0000","last_clean_scrub_stamp":"2024-09-10T08:44:57.501977+0000","objects_scrubbed":0,"log_size":4494,"log_dups_size":0,"ondisk_log_size":4494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:22.816586+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23585,"num_write_kb":291272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'4460","reported_seq":4492,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.508569+0000","last_change":"2024-09-10T08:28:35.574107+0000","last_active":"2024-09-10T08:44:22.508569+0000","last_peered":"2024-09-10T08:44:22.508569+0000","last_clean":"2024-09-10T08:44:22.508569+0000","last_became_active":"2024-09-10T08:28:35.573851+0000","last_became_peered":"2024-09-10T08:28:35.573851+0000","last_unstale":"2024-09-10T08:44:22.508569+0000","last_undegraded":"2024-09-10T08:44:22.508569+0000","last_fullsized":"2024-09-10T08:44:22.508569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4460,"log_dups_size":0,"ondisk_log_size":4460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22566,"num_write_kb":290967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'600","reported_seq":642,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:52.237596+0000","last_change":"2024-09-10T08:44:52.237626+0000","last_active":"2024-09-10T08:44:52.237596+0000","last_peered":"2024-09-10T08:44:52.237596+0000","last_clean":"2024-09-10T08:44:52.237596+0000","last_became_active":"2024-09-10T08:28:34.563259+0000","last_became_peered":"2024-09-10T08:28:34.563259+0000","last_unstale":"2024-09-10T08:44:52.237596+0000","last_undegraded":"2024-09-10T08:44:52.237596+0000","last_fullsized":"2024-09-10T08:44:52.237596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'600","last_scrub_stamp":"2024-09-10T08:44:52.237501+0000","last_deep_scrub":"27'600","last_deep_scrub_stamp":"2024-09-10T08:44:52.237501+0000","last_clean_scrub_stamp":"2024-09-10T08:44:52.237501+0000","objects_scrubbed":1,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:37.448960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1430,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:48.625577+0000","last_change":"2024-09-10T08:44:48.625603+0000","last_active":"2024-09-10T08:44:48.625577+0000","last_peered":"2024-09-10T08:44:48.625577+0000","last_clean":"2024-09-10T08:44:48.625577+0000","last_became_active":"2024-09-10T08:28:46.623139+0000","last_became_peered":"2024-09-10T08:28:46.623139+0000","last_unstale":"2024-09-10T08:44:48.625577+0000","last_undegraded":"2024-09-10T08:44:48.625577+0000","last_fullsized":"2024-09-10T08:44:48.625577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-10T08:44:48.625481+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-10T08:44:48.625481+0000","last_clean_scrub_stamp":"2024-09-10T08:44:48.625481+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:23.139955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"27'4787","reported_seq":4811,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.342219+0000","last_change":"2024-09-10T08:28:47.634754+0000","last_active":"2024-09-10T08:44:29.342219+0000","last_peered":"2024-09-10T08:44:29.342219+0000","last_clean":"2024-09-10T08:44:29.342219+0000","last_became_active":"2024-09-10T08:28:47.634382+0000","last_became_peered":"2024-09-10T08:28:47.634382+0000","last_unstale":"2024-09-10T08:44:29.342219+0000","last_undegraded":"2024-09-10T08:44:29.342219+0000","last_fullsized":"2024-09-10T08:44:29.342219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4787,"log_dups_size":0,"ondisk_log_size":4787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24922,"num_write_kb":313092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"27'4927","reported_seq":4967,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:47.339949+0000","last_change":"2024-09-10T08:44:47.339974+0000","last_active":"2024-09-10T08:44:47.339949+0000","last_peered":"2024-09-10T08:44:47.339949+0000","last_clean":"2024-09-10T08:44:47.339949+0000","last_became_active":"2024-09-10T08:28:35.567167+0000","last_became_peered":"2024-09-10T08:28:35.567167+0000","last_unstale":"2024-09-10T08:44:47.339949+0000","last_undegraded":"2024-09-10T08:44:47.339949+0000","last_fullsized":"2024-09-10T08:44:47.339949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4927","last_scrub_stamp":"2024-09-10T08:44:47.339830+0000","last_deep_scrub":"27'4927","last_deep_scrub_stamp":"2024-09-10T08:44:47.339830+0000","last_clean_scrub_stamp":"2024-09-10T08:44:47.339830+0000","objects_scrubbed":0,"log_size":4927,"log_dups_size":0,"ondisk_log_size":4927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:49.138722+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25981,"num_write_kb":313006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:43:47.989959+0000","last_change":"2024-09-10T08:28:34.571283+0000","last_active":"2024-09-10T08:43:47.989959+0000","last_peered":"2024-09-10T08:43:47.989959+0000","last_clean":"2024-09-10T08:43:47.989959+0000","last_became_active":"2024-09-10T08:28:34.570791+0000","last_became_peered":"2024-09-10T08:28:34.570791+0000","last_unstale":"2024-09-10T08:43:47.989959+0000","last_undegraded":"2024-09-10T08:43:47.989959+0000","last_fullsized":"2024-09-10T08:43:47.989959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:33.538281+0000","last_clean_scrub_stamp":"2024-09-10T08:28:33.538281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'1","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:54.954443+0000","last_change":"2024-09-10T08:44:54.954482+0000","last_active":"2024-09-10T08:44:54.954443+0000","last_peered":"2024-09-10T08:44:54.954443+0000","last_clean":"2024-09-10T08:44:54.954443+0000","last_became_active":"2024-09-10T08:28:46.630658+0000","last_became_peered":"2024-09-10T08:28:46.630658+0000","last_unstale":"2024-09-10T08:44:54.954443+0000","last_undegraded":"2024-09-10T08:44:54.954443+0000","last_fullsized":"2024-09-10T08:44:54.954443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-09-10T08:44:54.954353+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-09-10T08:44:54.954353+0000","last_clean_scrub_stamp":"2024-09-10T08:44:54.954353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:57.451147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"27'4308","reported_seq":4340,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:55.973768+0000","last_change":"2024-09-10T08:44:55.973796+0000","last_active":"2024-09-10T08:44:55.973768+0000","last_peered":"2024-09-10T08:44:55.973768+0000","last_clean":"2024-09-10T08:44:55.973768+0000","last_became_active":"2024-09-10T08:28:47.625186+0000","last_became_peered":"2024-09-10T08:28:47.625186+0000","last_unstale":"2024-09-10T08:44:55.973768+0000","last_undegraded":"2024-09-10T08:44:55.973768+0000","last_fullsized":"2024-09-10T08:44:55.973768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4308","last_scrub_stamp":"2024-09-10T08:44:55.973668+0000","last_deep_scrub":"27'4308","last_deep_scrub_stamp":"2024-09-10T08:44:55.973668+0000","last_clean_scrub_stamp":"2024-09-10T08:44:55.973668+0000","objects_scrubbed":0,"log_size":4308,"log_dups_size":0,"ondisk_log_size":4308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:51.692338+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23330,"num_write_kb":286070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'4301","reported_seq":4341,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:48.996486+0000","last_change":"2024-09-10T08:44:48.996508+0000","last_active":"2024-09-10T08:44:48.996486+0000","last_peered":"2024-09-10T08:44:48.996486+0000","last_clean":"2024-09-10T08:44:48.996486+0000","last_became_active":"2024-09-10T08:28:35.576002+0000","last_became_peered":"2024-09-10T08:28:35.576002+0000","last_unstale":"2024-09-10T08:44:48.996486+0000","last_undegraded":"2024-09-10T08:44:48.996486+0000","last_fullsized":"2024-09-10T08:44:48.996486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4301","last_scrub_stamp":"2024-09-10T08:44:48.996403+0000","last_deep_scrub":"27'4301","last_deep_scrub_stamp":"2024-09-10T08:44:48.996403+0000","last_clean_scrub_stamp":"2024-09-10T08:44:48.996403+0000","objects_scrubbed":0,"log_size":4301,"log_dups_size":0,"ondisk_log_size":4301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:47.544185+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22897,"num_write_kb":271992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'5","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:48.338301+0000","last_change":"2024-09-10T08:44:48.338327+0000","last_active":"2024-09-10T08:44:48.338301+0000","last_peered":"2024-09-10T08:44:48.338301+0000","last_clean":"2024-09-10T08:44:48.338301+0000","last_became_active":"2024-09-10T08:28:34.554922+0000","last_became_peered":"2024-09-10T08:28:34.554922+0000","last_unstale":"2024-09-10T08:44:48.338301+0000","last_undegraded":"2024-09-10T08:44:48.338301+0000","last_fullsized":"2024-09-10T08:44:48.338301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-10T08:44:48.338208+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-10T08:44:48.338208+0000","last_clean_scrub_stamp":"2024-09-10T08:44:48.338208+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:03.308785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:42.271194+0000","last_change":"2024-09-10T08:44:42.271234+0000","last_active":"2024-09-10T08:44:42.271194+0000","last_peered":"2024-09-10T08:44:42.271194+0000","last_clean":"2024-09-10T08:44:42.271194+0000","last_became_active":"2024-09-10T08:28:46.624690+0000","last_became_peered":"2024-09-10T08:28:46.624690+0000","last_unstale":"2024-09-10T08:44:42.271194+0000","last_undegraded":"2024-09-10T08:44:42.271194+0000","last_fullsized":"2024-09-10T08:44:42.271194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-10T08:44:42.271093+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-10T08:44:42.271093+0000","last_clean_scrub_stamp":"2024-09-10T08:44:42.271093+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:03.630352+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"27'4253","reported_seq":4285,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:58.929784+0000","last_change":"2024-09-10T08:44:58.929812+0000","last_active":"2024-09-10T08:44:58.929784+0000","last_peered":"2024-09-10T08:44:58.929784+0000","last_clean":"2024-09-10T08:44:58.929784+0000","last_became_active":"2024-09-10T08:28:47.633893+0000","last_became_peered":"2024-09-10T08:28:47.633893+0000","last_unstale":"2024-09-10T08:44:58.929784+0000","last_undegraded":"2024-09-10T08:44:58.929784+0000","last_fullsized":"2024-09-10T08:44:58.929784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4253","last_scrub_stamp":"2024-09-10T08:44:58.929679+0000","last_deep_scrub":"27'4253","last_deep_scrub_stamp":"2024-09-10T08:44:58.929679+0000","last_clean_scrub_stamp":"2024-09-10T08:44:58.929679+0000","objects_scrubbed":0,"log_size":4253,"log_dups_size":0,"ondisk_log_size":4253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:39.332418+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22807,"num_write_kb":271856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'4548","reported_seq":4588,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:52.455134+0000","last_change":"2024-09-10T08:44:52.455164+0000","last_active":"2024-09-10T08:44:52.455134+0000","last_peered":"2024-09-10T08:44:52.455134+0000","last_clean":"2024-09-10T08:44:52.455134+0000","last_became_active":"2024-09-10T08:28:35.577718+0000","last_became_peered":"2024-09-10T08:28:35.577718+0000","last_unstale":"2024-09-10T08:44:52.455134+0000","last_undegraded":"2024-09-10T08:44:52.455134+0000","last_fullsized":"2024-09-10T08:44:52.455134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4548","last_scrub_stamp":"2024-09-10T08:44:52.455036+0000","last_deep_scrub":"27'4548","last_deep_scrub_stamp":"2024-09-10T08:44:52.455036+0000","last_clean_scrub_stamp":"2024-09-10T08:44:52.455036+0000","objects_scrubbed":0,"log_size":4548,"log_dups_size":0,"ondisk_log_size":4548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:19.735940+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24326,"num_write_kb":290026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:52.085061+0000","last_change":"2024-09-10T08:44:52.085091+0000","last_active":"2024-09-10T08:44:52.085061+0000","last_peered":"2024-09-10T08:44:52.085061+0000","last_clean":"2024-09-10T08:44:52.085061+0000","last_became_active":"2024-09-10T08:28:34.553693+0000","last_became_peered":"2024-09-10T08:28:34.553693+0000","last_unstale":"2024-09-10T08:44:52.085061+0000","last_undegraded":"2024-09-10T08:44:52.085061+0000","last_fullsized":"2024-09-10T08:44:52.085061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-10T08:44:52.084962+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-10T08:44:52.084962+0000","last_clean_scrub_stamp":"2024-09-10T08:44:52.084962+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:33.373396+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:39.323008+0000","last_change":"2024-09-10T08:44:39.323029+0000","last_active":"2024-09-10T08:44:39.323008+0000","last_peered":"2024-09-10T08:44:39.323008+0000","last_clean":"2024-09-10T08:44:39.323008+0000","last_became_active":"2024-09-10T08:28:46.619853+0000","last_became_peered":"2024-09-10T08:28:46.619853+0000","last_unstale":"2024-09-10T08:44:39.323008+0000","last_undegraded":"2024-09-10T08:44:39.323008+0000","last_fullsized":"2024-09-10T08:44:39.323008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-10T08:44:39.322926+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-10T08:44:39.322926+0000","last_clean_scrub_stamp":"2024-09-10T08:44:39.322926+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:00.188842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'3675","reported_seq":3707,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:50.316119+0000","last_change":"2024-09-10T08:44:50.316147+0000","last_active":"2024-09-10T08:44:50.316119+0000","last_peered":"2024-09-10T08:44:50.316119+0000","last_clean":"2024-09-10T08:44:50.316119+0000","last_became_active":"2024-09-10T08:28:47.621122+0000","last_became_peered":"2024-09-10T08:28:47.621122+0000","last_unstale":"2024-09-10T08:44:50.316119+0000","last_undegraded":"2024-09-10T08:44:50.316119+0000","last_fullsized":"2024-09-10T08:44:50.316119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3675","last_scrub_stamp":"2024-09-10T08:44:50.316011+0000","last_deep_scrub":"27'3675","last_deep_scrub_stamp":"2024-09-10T08:44:50.316011+0000","last_clean_scrub_stamp":"2024-09-10T08:44:50.316011+0000","objects_scrubbed":0,"log_size":3675,"log_dups_size":0,"ondisk_log_size":3675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:21.342938+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18710,"num_write_kb":246893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'4629","reported_seq":4670,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:55.226538+0000","last_change":"2024-09-10T08:44:55.226584+0000","last_active":"2024-09-10T08:44:55.226538+0000","last_peered":"2024-09-10T08:44:55.226538+0000","last_clean":"2024-09-10T08:44:55.226538+0000","last_became_active":"2024-09-10T08:28:35.566444+0000","last_became_peered":"2024-09-10T08:28:35.566444+0000","last_unstale":"2024-09-10T08:44:55.226538+0000","last_undegraded":"2024-09-10T08:44:55.226538+0000","last_fullsized":"2024-09-10T08:44:55.226538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4629","last_scrub_stamp":"2024-09-10T08:44:55.226415+0000","last_deep_scrub":"27'4629","last_deep_scrub_stamp":"2024-09-10T08:44:55.226415+0000","last_clean_scrub_stamp":"2024-09-10T08:44:55.226415+0000","objects_scrubbed":0,"log_size":4629,"log_dups_size":0,"ondisk_log_size":4629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:53.503830+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24423,"num_write_kb":290556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'61","reported_seq":161,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:45.290042+0000","last_change":"2024-09-10T08:44:45.290090+0000","last_active":"2024-09-10T08:44:45.290042+0000","last_peered":"2024-09-10T08:44:45.290042+0000","last_clean":"2024-09-10T08:44:45.290042+0000","last_became_active":"2024-09-10T08:28:34.559911+0000","last_became_peered":"2024-09-10T08:28:34.559911+0000","last_unstale":"2024-09-10T08:44:45.290042+0000","last_undegraded":"2024-09-10T08:44:45.290042+0000","last_fullsized":"2024-09-10T08:44:45.290042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'61","last_scrub_stamp":"2024-09-10T08:44:45.289925+0000","last_deep_scrub":"27'61","last_deep_scrub_stamp":"2024-09-10T08:44:45.289925+0000","last_clean_scrub_stamp":"2024-09-10T08:44:45.289925+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:06.896795+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":129,"num_write":58,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:40.328286+0000","last_change":"2024-09-10T08:44:40.328312+0000","last_active":"2024-09-10T08:44:40.328286+0000","last_peered":"2024-09-10T08:44:40.328286+0000","last_clean":"2024-09-10T08:44:40.328286+0000","last_became_active":"2024-09-10T08:28:46.622790+0000","last_became_peered":"2024-09-10T08:28:46.622790+0000","last_unstale":"2024-09-10T08:44:40.328286+0000","last_undegraded":"2024-09-10T08:44:40.328286+0000","last_fullsized":"2024-09-10T08:44:40.328286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-10T08:44:40.327894+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-10T08:44:40.327894+0000","last_clean_scrub_stamp":"2024-09-10T08:44:40.327894+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:24.396479+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"27'4388","reported_seq":4412,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.444158+0000","last_change":"2024-09-10T08:28:47.634500+0000","last_active":"2024-09-10T08:44:29.444158+0000","last_peered":"2024-09-10T08:44:29.444158+0000","last_clean":"2024-09-10T08:44:29.444158+0000","last_became_active":"2024-09-10T08:28:47.634219+0000","last_became_peered":"2024-09-10T08:28:47.634219+0000","last_unstale":"2024-09-10T08:44:29.444158+0000","last_undegraded":"2024-09-10T08:44:29.444158+0000","last_fullsized":"2024-09-10T08:44:29.444158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4388,"log_dups_size":0,"ondisk_log_size":4388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22741,"num_write_kb":291819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"27'4638","reported_seq":4678,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:50.945923+0000","last_change":"2024-09-10T08:44:50.945947+0000","last_active":"2024-09-10T08:44:50.945923+0000","last_peered":"2024-09-10T08:44:50.945923+0000","last_clean":"2024-09-10T08:44:50.945923+0000","last_became_active":"2024-09-10T08:28:35.576096+0000","last_became_peered":"2024-09-10T08:28:35.576096+0000","last_unstale":"2024-09-10T08:44:50.945923+0000","last_undegraded":"2024-09-10T08:44:50.945923+0000","last_fullsized":"2024-09-10T08:44:50.945923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4638","last_scrub_stamp":"2024-09-10T08:44:50.945827+0000","last_deep_scrub":"27'4638","last_deep_scrub_stamp":"2024-09-10T08:44:50.945827+0000","last_clean_scrub_stamp":"2024-09-10T08:44:50.945827+0000","objects_scrubbed":0,"log_size":4638,"log_dups_size":0,"ondisk_log_size":4638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:02.517203+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24206,"num_write_kb":293700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'5","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:56.938697+0000","last_change":"2024-09-10T08:44:56.938759+0000","last_active":"2024-09-10T08:44:56.938697+0000","last_peered":"2024-09-10T08:44:56.938697+0000","last_clean":"2024-09-10T08:44:56.938697+0000","last_became_active":"2024-09-10T08:28:34.568249+0000","last_became_peered":"2024-09-10T08:28:34.568249+0000","last_unstale":"2024-09-10T08:44:56.938697+0000","last_undegraded":"2024-09-10T08:44:56.938697+0000","last_fullsized":"2024-09-10T08:44:56.938697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-10T08:44:56.938588+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-10T08:44:56.938588+0000","last_clean_scrub_stamp":"2024-09-10T08:44:56.938588+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:42.544754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'606","reported_seq":640,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:52.983874+0000","last_change":"2024-09-10T08:44:52.983909+0000","last_active":"2024-09-10T08:44:52.983874+0000","last_peered":"2024-09-10T08:44:52.983874+0000","last_clean":"2024-09-10T08:44:52.983874+0000","last_became_active":"2024-09-10T08:28:46.621272+0000","last_became_peered":"2024-09-10T08:28:46.621272+0000","last_unstale":"2024-09-10T08:44:52.983874+0000","last_undegraded":"2024-09-10T08:44:52.983874+0000","last_fullsized":"2024-09-10T08:44:52.983874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'606","last_scrub_stamp":"2024-09-10T08:44:52.983778+0000","last_deep_scrub":"27'606","last_deep_scrub_stamp":"2024-09-10T08:44:52.983778+0000","last_clean_scrub_stamp":"2024-09-10T08:44:52.983778+0000","objects_scrubbed":1,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:20.350692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1451,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"27'4536","reported_seq":4560,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456801+0000","last_change":"2024-09-10T08:28:47.631621+0000","last_active":"2024-09-10T08:44:29.456801+0000","last_peered":"2024-09-10T08:44:29.456801+0000","last_clean":"2024-09-10T08:44:29.456801+0000","last_became_active":"2024-09-10T08:28:47.631337+0000","last_became_peered":"2024-09-10T08:28:47.631337+0000","last_unstale":"2024-09-10T08:44:29.456801+0000","last_undegraded":"2024-09-10T08:44:29.456801+0000","last_fullsized":"2024-09-10T08:44:29.456801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4536,"log_dups_size":0,"ondisk_log_size":4536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23763,"num_write_kb":304142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"27'4950","reported_seq":4982,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.485568+0000","last_change":"2024-09-10T08:28:35.572658+0000","last_active":"2024-09-10T08:44:22.485568+0000","last_peered":"2024-09-10T08:44:22.485568+0000","last_clean":"2024-09-10T08:44:22.485568+0000","last_became_active":"2024-09-10T08:28:35.571611+0000","last_became_peered":"2024-09-10T08:28:35.571611+0000","last_unstale":"2024-09-10T08:44:22.485568+0000","last_undegraded":"2024-09-10T08:44:22.485568+0000","last_fullsized":"2024-09-10T08:44:22.485568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4950,"log_dups_size":0,"ondisk_log_size":4950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25652,"num_write_kb":316024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:54.165957+0000","last_change":"2024-09-10T08:44:54.165985+0000","last_active":"2024-09-10T08:44:54.165957+0000","last_peered":"2024-09-10T08:44:54.165957+0000","last_clean":"2024-09-10T08:44:54.165957+0000","last_became_active":"2024-09-10T08:28:34.555269+0000","last_became_peered":"2024-09-10T08:28:34.555269+0000","last_unstale":"2024-09-10T08:44:54.165957+0000","last_undegraded":"2024-09-10T08:44:54.165957+0000","last_fullsized":"2024-09-10T08:44:54.165957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-09-10T08:44:54.165846+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-09-10T08:44:54.165846+0000","last_clean_scrub_stamp":"2024-09-10T08:44:54.165846+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:32.232295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:54.931025+0000","last_change":"2024-09-10T08:44:54.931060+0000","last_active":"2024-09-10T08:44:54.931025+0000","last_peered":"2024-09-10T08:44:54.931025+0000","last_clean":"2024-09-10T08:44:54.931025+0000","last_became_active":"2024-09-10T08:28:26.723452+0000","last_became_peered":"2024-09-10T08:28:26.723452+0000","last_unstale":"2024-09-10T08:44:54.931025+0000","last_undegraded":"2024-09-10T08:44:54.931025+0000","last_fullsized":"2024-09-10T08:44:54.931025+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-09-10T08:44:54.930934+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-09-10T08:44:54.930934+0000","last_clean_scrub_stamp":"2024-09-10T08:44:54.930934+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:25.754459+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'4","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:55.180423+0000","last_change":"2024-09-10T08:44:55.180450+0000","last_active":"2024-09-10T08:44:55.180423+0000","last_peered":"2024-09-10T08:44:55.180423+0000","last_clean":"2024-09-10T08:44:55.180423+0000","last_became_active":"2024-09-10T08:28:46.621770+0000","last_became_peered":"2024-09-10T08:28:46.621770+0000","last_unstale":"2024-09-10T08:44:55.180423+0000","last_undegraded":"2024-09-10T08:44:55.180423+0000","last_fullsized":"2024-09-10T08:44:55.180423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-09-10T08:44:55.180331+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-09-10T08:44:55.180331+0000","last_clean_scrub_stamp":"2024-09-10T08:44:55.180331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:12.012732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"27'3353","reported_seq":3385,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:40.246178+0000","last_change":"2024-09-10T08:44:40.246217+0000","last_active":"2024-09-10T08:44:40.246178+0000","last_peered":"2024-09-10T08:44:40.246178+0000","last_clean":"2024-09-10T08:44:40.246178+0000","last_became_active":"2024-09-10T08:28:47.620492+0000","last_became_peered":"2024-09-10T08:28:47.620492+0000","last_unstale":"2024-09-10T08:44:40.246178+0000","last_undegraded":"2024-09-10T08:44:40.246178+0000","last_fullsized":"2024-09-10T08:44:40.246178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3353","last_scrub_stamp":"2024-09-10T08:44:40.246080+0000","last_deep_scrub":"27'3353","last_deep_scrub_stamp":"2024-09-10T08:44:40.246080+0000","last_clean_scrub_stamp":"2024-09-10T08:44:40.246080+0000","objects_scrubbed":0,"log_size":3353,"log_dups_size":0,"ondisk_log_size":3353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:49.803947+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16947,"num_write_kb":239873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'4450","reported_seq":4490,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:49.922336+0000","last_change":"2024-09-10T08:44:49.922361+0000","last_active":"2024-09-10T08:44:49.922336+0000","last_peered":"2024-09-10T08:44:49.922336+0000","last_clean":"2024-09-10T08:44:49.922336+0000","last_became_active":"2024-09-10T08:28:35.574215+0000","last_became_peered":"2024-09-10T08:28:35.574215+0000","last_unstale":"2024-09-10T08:44:49.922336+0000","last_undegraded":"2024-09-10T08:44:49.922336+0000","last_fullsized":"2024-09-10T08:44:49.922336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4450","last_scrub_stamp":"2024-09-10T08:44:49.922242+0000","last_deep_scrub":"27'4450","last_deep_scrub_stamp":"2024-09-10T08:44:49.922242+0000","last_clean_scrub_stamp":"2024-09-10T08:44:49.922242+0000","objects_scrubbed":0,"log_size":4450,"log_dups_size":0,"ondisk_log_size":4450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:18:37.398355+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23087,"num_write_kb":297343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'2","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:43.281825+0000","last_change":"2024-09-10T08:44:43.281885+0000","last_active":"2024-09-10T08:44:43.281825+0000","last_peered":"2024-09-10T08:44:43.281825+0000","last_clean":"2024-09-10T08:44:43.281825+0000","last_became_active":"2024-09-10T08:28:34.559635+0000","last_became_peered":"2024-09-10T08:28:34.559635+0000","last_unstale":"2024-09-10T08:44:43.281825+0000","last_undegraded":"2024-09-10T08:44:43.281825+0000","last_fullsized":"2024-09-10T08:44:43.281825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-09-10T08:44:43.281678+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-09-10T08:44:43.281678+0000","last_clean_scrub_stamp":"2024-09-10T08:44:43.281678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:17.194886+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'4","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:54.199149+0000","last_change":"2024-09-10T08:44:54.199175+0000","last_active":"2024-09-10T08:44:54.199149+0000","last_peered":"2024-09-10T08:44:54.199149+0000","last_clean":"2024-09-10T08:44:54.199149+0000","last_became_active":"2024-09-10T08:28:46.620064+0000","last_became_peered":"2024-09-10T08:28:46.620064+0000","last_unstale":"2024-09-10T08:44:54.199149+0000","last_undegraded":"2024-09-10T08:44:54.199149+0000","last_fullsized":"2024-09-10T08:44:54.199149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-09-10T08:44:54.199059+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-09-10T08:44:54.199059+0000","last_clean_scrub_stamp":"2024-09-10T08:44:54.199059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:58.722695+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"27'3678","reported_seq":3710,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:41.272528+0000","last_change":"2024-09-10T08:44:41.272576+0000","last_active":"2024-09-10T08:44:41.272528+0000","last_peered":"2024-09-10T08:44:41.272528+0000","last_clean":"2024-09-10T08:44:41.272528+0000","last_became_active":"2024-09-10T08:28:47.620014+0000","last_became_peered":"2024-09-10T08:28:47.620014+0000","last_unstale":"2024-09-10T08:44:41.272528+0000","last_undegraded":"2024-09-10T08:44:41.272528+0000","last_fullsized":"2024-09-10T08:44:41.272528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3678","last_scrub_stamp":"2024-09-10T08:44:41.272393+0000","last_deep_scrub":"27'3678","last_deep_scrub_stamp":"2024-09-10T08:44:41.272393+0000","last_clean_scrub_stamp":"2024-09-10T08:44:41.272393+0000","objects_scrubbed":0,"log_size":3678,"log_dups_size":0,"ondisk_log_size":3678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:33.535697+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19171,"num_write_kb":261286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'5065","reported_seq":5105,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:47.080414+0000","last_change":"2024-09-10T08:44:47.080443+0000","last_active":"2024-09-10T08:44:47.080414+0000","last_peered":"2024-09-10T08:44:47.080414+0000","last_clean":"2024-09-10T08:44:47.080414+0000","last_became_active":"2024-09-10T08:28:35.576655+0000","last_became_peered":"2024-09-10T08:28:35.576655+0000","last_unstale":"2024-09-10T08:44:47.080414+0000","last_undegraded":"2024-09-10T08:44:47.080414+0000","last_fullsized":"2024-09-10T08:44:47.080414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5065","last_scrub_stamp":"2024-09-10T08:44:47.080317+0000","last_deep_scrub":"27'5065","last_deep_scrub_stamp":"2024-09-10T08:44:47.080317+0000","last_clean_scrub_stamp":"2024-09-10T08:44:47.080317+0000","objects_scrubbed":0,"log_size":5065,"log_dups_size":0,"ondisk_log_size":5065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:43.618914+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26367,"num_write_kb":318681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:50.250088+0000","last_change":"2024-09-10T08:44:50.250116+0000","last_active":"2024-09-10T08:44:50.250088+0000","last_peered":"2024-09-10T08:44:50.250088+0000","last_clean":"2024-09-10T08:44:50.250088+0000","last_became_active":"2024-09-10T08:28:34.560429+0000","last_became_peered":"2024-09-10T08:28:34.560429+0000","last_unstale":"2024-09-10T08:44:50.250088+0000","last_undegraded":"2024-09-10T08:44:50.250088+0000","last_fullsized":"2024-09-10T08:44:50.250088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-10T08:44:50.250007+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-10T08:44:50.250007+0000","last_clean_scrub_stamp":"2024-09-10T08:44:50.250007+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:03.204208+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'1101","reported_seq":1135,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:53.977440+0000","last_change":"2024-09-10T08:44:53.977487+0000","last_active":"2024-09-10T08:44:53.977440+0000","last_peered":"2024-09-10T08:44:53.977440+0000","last_clean":"2024-09-10T08:44:53.977440+0000","last_became_active":"2024-09-10T08:28:46.621966+0000","last_became_peered":"2024-09-10T08:28:46.621966+0000","last_unstale":"2024-09-10T08:44:53.977440+0000","last_undegraded":"2024-09-10T08:44:53.977440+0000","last_fullsized":"2024-09-10T08:44:53.977440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1101","last_scrub_stamp":"2024-09-10T08:44:53.977349+0000","last_deep_scrub":"27'1101","last_deep_scrub_stamp":"2024-09-10T08:44:53.977349+0000","last_clean_scrub_stamp":"2024-09-10T08:44:53.977349+0000","objects_scrubbed":2,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:21.019883+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1090,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"27'4366","reported_seq":4390,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.370762+0000","last_change":"2024-09-10T08:28:47.630602+0000","last_active":"2024-09-10T08:44:29.370762+0000","last_peered":"2024-09-10T08:44:29.370762+0000","last_clean":"2024-09-10T08:44:29.370762+0000","last_became_active":"2024-09-10T08:28:47.630234+0000","last_became_peered":"2024-09-10T08:28:47.630234+0000","last_unstale":"2024-09-10T08:44:29.370762+0000","last_undegraded":"2024-09-10T08:44:29.370762+0000","last_fullsized":"2024-09-10T08:44:29.370762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4366,"log_dups_size":0,"ondisk_log_size":4366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22466,"num_write_kb":282639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"27'5771","reported_seq":5811,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:42.932772+0000","last_change":"2024-09-10T08:44:42.932801+0000","last_active":"2024-09-10T08:44:42.932772+0000","last_peered":"2024-09-10T08:44:42.932772+0000","last_clean":"2024-09-10T08:44:42.932772+0000","last_became_active":"2024-09-10T08:28:35.576686+0000","last_became_peered":"2024-09-10T08:28:35.576686+0000","last_unstale":"2024-09-10T08:44:42.932772+0000","last_undegraded":"2024-09-10T08:44:42.932772+0000","last_fullsized":"2024-09-10T08:44:42.932772+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5771","last_scrub_stamp":"2024-09-10T08:44:42.932632+0000","last_deep_scrub":"27'5771","last_deep_scrub_stamp":"2024-09-10T08:44:42.932632+0000","last_clean_scrub_stamp":"2024-09-10T08:44:42.932632+0000","objects_scrubbed":0,"log_size":5671,"log_dups_size":0,"ondisk_log_size":5671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:20.436060+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29457,"num_write_kb":355657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'7","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:44.308075+0000","last_change":"2024-09-10T08:44:44.308108+0000","last_active":"2024-09-10T08:44:44.308075+0000","last_peered":"2024-09-10T08:44:44.308075+0000","last_clean":"2024-09-10T08:44:44.308075+0000","last_became_active":"2024-09-10T08:28:34.560035+0000","last_became_peered":"2024-09-10T08:28:34.560035+0000","last_unstale":"2024-09-10T08:44:44.308075+0000","last_undegraded":"2024-09-10T08:44:44.308075+0000","last_fullsized":"2024-09-10T08:44:44.308075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-09-10T08:44:44.307983+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-09-10T08:44:44.307983+0000","last_clean_scrub_stamp":"2024-09-10T08:44:44.307983+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:57.415585+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'3","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:46.058815+0000","last_change":"2024-09-10T08:44:46.058839+0000","last_active":"2024-09-10T08:44:46.058815+0000","last_peered":"2024-09-10T08:44:46.058815+0000","last_clean":"2024-09-10T08:44:46.058815+0000","last_became_active":"2024-09-10T08:28:46.623092+0000","last_became_peered":"2024-09-10T08:28:46.623092+0000","last_unstale":"2024-09-10T08:44:46.058815+0000","last_undegraded":"2024-09-10T08:44:46.058815+0000","last_fullsized":"2024-09-10T08:44:46.058815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-10T08:44:46.058724+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-10T08:44:46.058724+0000","last_clean_scrub_stamp":"2024-09-10T08:44:46.058724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:46.873577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"27'4470","reported_seq":4502,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:48.311452+0000","last_change":"2024-09-10T08:44:48.311490+0000","last_active":"2024-09-10T08:44:48.311452+0000","last_peered":"2024-09-10T08:44:48.311452+0000","last_clean":"2024-09-10T08:44:48.311452+0000","last_became_active":"2024-09-10T08:28:47.619452+0000","last_became_peered":"2024-09-10T08:28:47.619452+0000","last_unstale":"2024-09-10T08:44:48.311452+0000","last_undegraded":"2024-09-10T08:44:48.311452+0000","last_fullsized":"2024-09-10T08:44:48.311452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4470","last_scrub_stamp":"2024-09-10T08:44:48.311335+0000","last_deep_scrub":"27'4470","last_deep_scrub_stamp":"2024-09-10T08:44:48.311335+0000","last_clean_scrub_stamp":"2024-09-10T08:44:48.311335+0000","objects_scrubbed":0,"log_size":4470,"log_dups_size":0,"ondisk_log_size":4470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:47.034132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23926,"num_write_kb":300839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"27'4014","reported_seq":4054,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:41.954585+0000","last_change":"2024-09-10T08:44:41.954613+0000","last_active":"2024-09-10T08:44:41.954585+0000","last_peered":"2024-09-10T08:44:41.954585+0000","last_clean":"2024-09-10T08:44:41.954585+0000","last_became_active":"2024-09-10T08:28:35.576786+0000","last_became_peered":"2024-09-10T08:28:35.576786+0000","last_unstale":"2024-09-10T08:44:41.954585+0000","last_undegraded":"2024-09-10T08:44:41.954585+0000","last_fullsized":"2024-09-10T08:44:41.954585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4014","last_scrub_stamp":"2024-09-10T08:44:41.954485+0000","last_deep_scrub":"27'4014","last_deep_scrub_stamp":"2024-09-10T08:44:41.954485+0000","last_clean_scrub_stamp":"2024-09-10T08:44:41.954485+0000","objects_scrubbed":0,"log_size":4014,"log_dups_size":0,"ondisk_log_size":4014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:13.716238+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19823,"num_write_kb":276089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'6","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:47.427214+0000","last_change":"2024-09-10T08:44:47.427247+0000","last_active":"2024-09-10T08:44:47.427214+0000","last_peered":"2024-09-10T08:44:47.427214+0000","last_clean":"2024-09-10T08:44:47.427214+0000","last_became_active":"2024-09-10T08:28:34.550773+0000","last_became_peered":"2024-09-10T08:28:34.550773+0000","last_unstale":"2024-09-10T08:44:47.427214+0000","last_undegraded":"2024-09-10T08:44:47.427214+0000","last_fullsized":"2024-09-10T08:44:47.427214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-09-10T08:44:47.427124+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-09-10T08:44:47.427124+0000","last_clean_scrub_stamp":"2024-09-10T08:44:47.427124+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:07.750733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'3","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:42.592046+0000","last_change":"2024-09-10T08:44:42.592078+0000","last_active":"2024-09-10T08:44:42.592046+0000","last_peered":"2024-09-10T08:44:42.592046+0000","last_clean":"2024-09-10T08:44:42.592046+0000","last_became_active":"2024-09-10T08:28:46.619330+0000","last_became_peered":"2024-09-10T08:28:46.619330+0000","last_unstale":"2024-09-10T08:44:42.592046+0000","last_undegraded":"2024-09-10T08:44:42.592046+0000","last_fullsized":"2024-09-10T08:44:42.592046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-10T08:44:42.591946+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-10T08:44:42.591946+0000","last_clean_scrub_stamp":"2024-09-10T08:44:42.591946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:33.628156+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"27'3797","reported_seq":3820,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.367766+0000","last_change":"2024-09-10T08:28:47.633627+0000","last_active":"2024-09-10T08:44:29.367766+0000","last_peered":"2024-09-10T08:44:29.367766+0000","last_clean":"2024-09-10T08:44:29.367766+0000","last_became_active":"2024-09-10T08:28:47.633362+0000","last_became_peered":"2024-09-10T08:28:47.633362+0000","last_unstale":"2024-09-10T08:44:29.367766+0000","last_undegraded":"2024-09-10T08:44:29.367766+0000","last_fullsized":"2024-09-10T08:44:29.367766+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3797,"log_dups_size":0,"ondisk_log_size":3797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19693,"num_write_kb":255099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"27'4998","reported_seq":5038,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:47.945239+0000","last_change":"2024-09-10T08:44:47.945239+0000","last_active":"2024-09-10T08:44:47.945239+0000","last_peered":"2024-09-10T08:44:47.945239+0000","last_clean":"2024-09-10T08:44:47.945239+0000","last_became_active":"2024-09-10T08:28:35.575038+0000","last_became_peered":"2024-09-10T08:28:35.575038+0000","last_unstale":"2024-09-10T08:44:47.945239+0000","last_undegraded":"2024-09-10T08:44:47.945239+0000","last_fullsized":"2024-09-10T08:44:47.945239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4998","last_scrub_stamp":"2024-09-10T08:44:47.945097+0000","last_deep_scrub":"27'4998","last_deep_scrub_stamp":"2024-09-10T08:44:47.945097+0000","last_clean_scrub_stamp":"2024-09-10T08:44:47.945097+0000","objects_scrubbed":0,"log_size":4998,"log_dups_size":0,"ondisk_log_size":4998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:19.611238+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25962,"num_write_kb":304804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'15","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:42.238910+0000","last_change":"2024-09-10T08:44:42.238910+0000","last_active":"2024-09-10T08:44:42.238910+0000","last_peered":"2024-09-10T08:44:42.238910+0000","last_clean":"2024-09-10T08:44:42.238910+0000","last_became_active":"2024-09-10T08:28:34.555179+0000","last_became_peered":"2024-09-10T08:28:34.555179+0000","last_unstale":"2024-09-10T08:44:42.238910+0000","last_undegraded":"2024-09-10T08:44:42.238910+0000","last_fullsized":"2024-09-10T08:44:42.238910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-09-10T08:44:42.238791+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-09-10T08:44:42.238791+0000","last_clean_scrub_stamp":"2024-09-10T08:44:42.238791+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:19:31.270198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:41.895958+0000","last_change":"2024-09-10T08:44:41.895998+0000","last_active":"2024-09-10T08:44:41.895958+0000","last_peered":"2024-09-10T08:44:41.895958+0000","last_clean":"2024-09-10T08:44:41.895958+0000","last_became_active":"2024-09-10T08:28:46.618318+0000","last_became_peered":"2024-09-10T08:28:46.618318+0000","last_unstale":"2024-09-10T08:44:41.895958+0000","last_undegraded":"2024-09-10T08:44:41.895958+0000","last_fullsized":"2024-09-10T08:44:41.895958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-09-10T08:44:41.895839+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-09-10T08:44:41.895839+0000","last_clean_scrub_stamp":"2024-09-10T08:44:41.895839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:13.389899+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"27'4510","reported_seq":4533,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.461441+0000","last_change":"2024-09-10T08:28:47.625025+0000","last_active":"2024-09-10T08:44:29.461441+0000","last_peered":"2024-09-10T08:44:29.461441+0000","last_clean":"2024-09-10T08:44:29.461441+0000","last_became_active":"2024-09-10T08:28:47.624230+0000","last_became_peered":"2024-09-10T08:28:47.624230+0000","last_unstale":"2024-09-10T08:44:29.461441+0000","last_undegraded":"2024-09-10T08:44:29.461441+0000","last_fullsized":"2024-09-10T08:44:29.461441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4510,"log_dups_size":0,"ondisk_log_size":4510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23053,"num_write_kb":297434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'5001","reported_seq":5041,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:42.168528+0000","last_change":"2024-09-10T08:44:42.168528+0000","last_active":"2024-09-10T08:44:42.168528+0000","last_peered":"2024-09-10T08:44:42.168528+0000","last_clean":"2024-09-10T08:44:42.168528+0000","last_became_active":"2024-09-10T08:28:35.578299+0000","last_became_peered":"2024-09-10T08:28:35.578299+0000","last_unstale":"2024-09-10T08:44:42.168528+0000","last_undegraded":"2024-09-10T08:44:42.168528+0000","last_fullsized":"2024-09-10T08:44:42.168528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5001","last_scrub_stamp":"2024-09-10T08:44:42.168397+0000","last_deep_scrub":"27'5001","last_deep_scrub_stamp":"2024-09-10T08:44:42.168397+0000","last_clean_scrub_stamp":"2024-09-10T08:44:42.168397+0000","objects_scrubbed":0,"log_size":5001,"log_dups_size":0,"ondisk_log_size":5001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:12.471816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25723,"num_write_kb":320130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'6","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:47.230645+0000","last_change":"2024-09-10T08:44:47.230645+0000","last_active":"2024-09-10T08:44:47.230645+0000","last_peered":"2024-09-10T08:44:47.230645+0000","last_clean":"2024-09-10T08:44:47.230645+0000","last_became_active":"2024-09-10T08:28:34.560188+0000","last_became_peered":"2024-09-10T08:28:34.560188+0000","last_unstale":"2024-09-10T08:44:47.230645+0000","last_undegraded":"2024-09-10T08:44:47.230645+0000","last_fullsized":"2024-09-10T08:44:47.230645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-09-10T08:44:47.230520+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-09-10T08:44:47.230520+0000","last_clean_scrub_stamp":"2024-09-10T08:44:47.230520+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:14.843454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:46.716514+0000","last_change":"2024-09-10T08:44:46.716547+0000","last_active":"2024-09-10T08:44:46.716514+0000","last_peered":"2024-09-10T08:44:46.716514+0000","last_clean":"2024-09-10T08:44:46.716514+0000","last_became_active":"2024-09-10T08:28:46.623211+0000","last_became_peered":"2024-09-10T08:28:46.623211+0000","last_unstale":"2024-09-10T08:44:46.716514+0000","last_undegraded":"2024-09-10T08:44:46.716514+0000","last_fullsized":"2024-09-10T08:44:46.716514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-09-10T08:44:46.716401+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-09-10T08:44:46.716401+0000","last_clean_scrub_stamp":"2024-09-10T08:44:46.716401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:53.625657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"27'4287","reported_seq":4310,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.418512+0000","last_change":"2024-09-10T08:28:47.635185+0000","last_active":"2024-09-10T08:44:29.418512+0000","last_peered":"2024-09-10T08:44:29.418512+0000","last_clean":"2024-09-10T08:44:29.418512+0000","last_became_active":"2024-09-10T08:28:47.634782+0000","last_became_peered":"2024-09-10T08:28:47.634782+0000","last_unstale":"2024-09-10T08:44:29.418512+0000","last_undegraded":"2024-09-10T08:44:29.418512+0000","last_fullsized":"2024-09-10T08:44:29.418512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4287,"log_dups_size":0,"ondisk_log_size":4287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22519,"num_write_kb":282718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'5007","reported_seq":5047,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:46.057655+0000","last_change":"2024-09-10T08:44:46.057655+0000","last_active":"2024-09-10T08:44:46.057655+0000","last_peered":"2024-09-10T08:44:46.057655+0000","last_clean":"2024-09-10T08:44:46.057655+0000","last_became_active":"2024-09-10T08:28:35.575333+0000","last_became_peered":"2024-09-10T08:28:35.575333+0000","last_unstale":"2024-09-10T08:44:46.057655+0000","last_undegraded":"2024-09-10T08:44:46.057655+0000","last_fullsized":"2024-09-10T08:44:46.057655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5007","last_scrub_stamp":"2024-09-10T08:44:46.057467+0000","last_deep_scrub":"27'5007","last_deep_scrub_stamp":"2024-09-10T08:44:46.057467+0000","last_clean_scrub_stamp":"2024-09-10T08:44:46.057467+0000","objects_scrubbed":0,"log_size":5007,"log_dups_size":0,"ondisk_log_size":5007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:33.426082+0000","scrub_duration":139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25404,"num_write_kb":331142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:55.171909+0000","last_change":"2024-09-10T08:44:55.171909+0000","last_active":"2024-09-10T08:44:55.171909+0000","last_peered":"2024-09-10T08:44:55.171909+0000","last_clean":"2024-09-10T08:44:55.171909+0000","last_became_active":"2024-09-10T08:28:34.560376+0000","last_became_peered":"2024-09-10T08:28:34.560376+0000","last_unstale":"2024-09-10T08:44:55.171909+0000","last_undegraded":"2024-09-10T08:44:55.171909+0000","last_fullsized":"2024-09-10T08:44:55.171909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-10T08:44:55.171731+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-10T08:44:55.171731+0000","last_clean_scrub_stamp":"2024-09-10T08:44:55.171731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:21.178056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'330","reported_seq":363,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:42.853663+0000","last_change":"2024-09-10T08:44:42.853697+0000","last_active":"2024-09-10T08:44:42.853663+0000","last_peered":"2024-09-10T08:44:42.853663+0000","last_clean":"2024-09-10T08:44:42.853663+0000","last_became_active":"2024-09-10T08:28:46.619030+0000","last_became_peered":"2024-09-10T08:28:46.619030+0000","last_unstale":"2024-09-10T08:44:42.853663+0000","last_undegraded":"2024-09-10T08:44:42.853663+0000","last_fullsized":"2024-09-10T08:44:42.853663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'330","last_scrub_stamp":"2024-09-10T08:44:42.853564+0000","last_deep_scrub":"27'330","last_deep_scrub_stamp":"2024-09-10T08:44:42.853564+0000","last_clean_scrub_stamp":"2024-09-10T08:44:42.853564+0000","objects_scrubbed":4,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:34.426242+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":4249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"27'6390","reported_seq":6413,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.443989+0000","last_change":"2024-09-10T08:28:47.626648+0000","last_active":"2024-09-10T08:44:29.443989+0000","last_peered":"2024-09-10T08:44:29.443989+0000","last_clean":"2024-09-10T08:44:29.443989+0000","last_became_active":"2024-09-10T08:28:47.626330+0000","last_became_peered":"2024-09-10T08:28:47.626330+0000","last_unstale":"2024-09-10T08:44:29.443989+0000","last_undegraded":"2024-09-10T08:44:29.443989+0000","last_fullsized":"2024-09-10T08:44:29.443989+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5190,"log_dups_size":0,"ondisk_log_size":5190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33857,"num_write_kb":406580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'4502","reported_seq":4542,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:47.975843+0000","last_change":"2024-09-10T08:44:47.975843+0000","last_active":"2024-09-10T08:44:47.975843+0000","last_peered":"2024-09-10T08:44:47.975843+0000","last_clean":"2024-09-10T08:44:47.975843+0000","last_became_active":"2024-09-10T08:28:35.574567+0000","last_became_peered":"2024-09-10T08:28:35.574567+0000","last_unstale":"2024-09-10T08:44:47.975843+0000","last_undegraded":"2024-09-10T08:44:47.975843+0000","last_fullsized":"2024-09-10T08:44:47.975843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4502","last_scrub_stamp":"2024-09-10T08:44:47.975716+0000","last_deep_scrub":"27'4502","last_deep_scrub_stamp":"2024-09-10T08:44:47.975716+0000","last_clean_scrub_stamp":"2024-09-10T08:44:47.975716+0000","objects_scrubbed":0,"log_size":4502,"log_dups_size":0,"ondisk_log_size":4502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:33.824797+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23284,"num_write_kb":285817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'10","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:43.935520+0000","last_change":"2024-09-10T08:44:43.935520+0000","last_active":"2024-09-10T08:44:43.935520+0000","last_peered":"2024-09-10T08:44:43.935520+0000","last_clean":"2024-09-10T08:44:43.935520+0000","last_became_active":"2024-09-10T08:28:34.553275+0000","last_became_peered":"2024-09-10T08:28:34.553275+0000","last_unstale":"2024-09-10T08:44:43.935520+0000","last_undegraded":"2024-09-10T08:44:43.935520+0000","last_fullsized":"2024-09-10T08:44:43.935520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-09-10T08:44:43.935392+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-09-10T08:44:43.935392+0000","last_clean_scrub_stamp":"2024-09-10T08:44:43.935392+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:27.366592+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'31","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:44.137301+0000","last_change":"2024-09-10T08:44:44.137334+0000","last_active":"2024-09-10T08:44:44.137301+0000","last_peered":"2024-09-10T08:44:44.137301+0000","last_clean":"2024-09-10T08:44:44.137301+0000","last_became_active":"2024-09-10T08:28:46.619165+0000","last_became_peered":"2024-09-10T08:28:46.619165+0000","last_unstale":"2024-09-10T08:44:44.137301+0000","last_undegraded":"2024-09-10T08:44:44.137301+0000","last_fullsized":"2024-09-10T08:44:44.137301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-09-10T08:44:44.137207+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-09-10T08:44:44.137207+0000","last_clean_scrub_stamp":"2024-09-10T08:44:44.137207+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:27.655450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"27'5339","reported_seq":5370,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:50.642364+0000","last_change":"2024-09-10T08:44:50.642393+0000","last_active":"2024-09-10T08:44:50.642364+0000","last_peered":"2024-09-10T08:44:50.642364+0000","last_clean":"2024-09-10T08:44:50.642364+0000","last_became_active":"2024-09-10T08:28:47.619661+0000","last_became_peered":"2024-09-10T08:28:47.619661+0000","last_unstale":"2024-09-10T08:44:50.642364+0000","last_undegraded":"2024-09-10T08:44:50.642364+0000","last_fullsized":"2024-09-10T08:44:50.642364+0000","mapping_epoch":23,"log_start":"27'100","ondisk_log_start":"27'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5339","last_scrub_stamp":"2024-09-10T08:44:50.642265+0000","last_deep_scrub":"27'5339","last_deep_scrub_stamp":"2024-09-10T08:44:50.642265+0000","last_clean_scrub_stamp":"2024-09-10T08:44:50.642265+0000","objects_scrubbed":0,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:29.034369+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27578,"num_write_kb":340014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'4089","reported_seq":4128,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:46.941504+0000","last_change":"2024-09-10T08:44:46.941532+0000","last_active":"2024-09-10T08:44:46.941504+0000","last_peered":"2024-09-10T08:44:46.941504+0000","last_clean":"2024-09-10T08:44:46.941504+0000","last_became_active":"2024-09-10T08:28:35.582205+0000","last_became_peered":"2024-09-10T08:28:35.582205+0000","last_unstale":"2024-09-10T08:44:46.941504+0000","last_undegraded":"2024-09-10T08:44:46.941504+0000","last_fullsized":"2024-09-10T08:44:46.941504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4089","last_scrub_stamp":"2024-09-10T08:44:46.941400+0000","last_deep_scrub":"27'4089","last_deep_scrub_stamp":"2024-09-10T08:44:46.941400+0000","last_clean_scrub_stamp":"2024-09-10T08:44:46.941400+0000","objects_scrubbed":0,"log_size":4089,"log_dups_size":0,"ondisk_log_size":4089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:28.604207+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21083,"num_write_kb":276854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'308","reported_seq":350,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:46.199737+0000","last_change":"2024-09-10T08:44:46.199737+0000","last_active":"2024-09-10T08:44:46.199737+0000","last_peered":"2024-09-10T08:44:46.199737+0000","last_clean":"2024-09-10T08:44:46.199737+0000","last_became_active":"2024-09-10T08:28:34.559560+0000","last_became_peered":"2024-09-10T08:28:34.559560+0000","last_unstale":"2024-09-10T08:44:46.199737+0000","last_undegraded":"2024-09-10T08:44:46.199737+0000","last_fullsized":"2024-09-10T08:44:46.199737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'308","last_scrub_stamp":"2024-09-10T08:44:46.199620+0000","last_deep_scrub":"27'308","last_deep_scrub_stamp":"2024-09-10T08:44:46.199620+0000","last_clean_scrub_stamp":"2024-09-10T08:44:46.199620+0000","objects_scrubbed":4,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:39.516369+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":301,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'5","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:46.346679+0000","last_change":"2024-09-10T08:44:46.346725+0000","last_active":"2024-09-10T08:44:46.346679+0000","last_peered":"2024-09-10T08:44:46.346679+0000","last_clean":"2024-09-10T08:44:46.346679+0000","last_became_active":"2024-09-10T08:28:46.627819+0000","last_became_peered":"2024-09-10T08:28:46.627819+0000","last_unstale":"2024-09-10T08:44:46.346679+0000","last_undegraded":"2024-09-10T08:44:46.346679+0000","last_fullsized":"2024-09-10T08:44:46.346679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-10T08:44:46.346577+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-10T08:44:46.346577+0000","last_clean_scrub_stamp":"2024-09-10T08:44:46.346577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:32.453969+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"27'3973","reported_seq":3996,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456550+0000","last_change":"2024-09-10T08:28:47.628067+0000","last_active":"2024-09-10T08:44:29.456550+0000","last_peered":"2024-09-10T08:44:29.456550+0000","last_clean":"2024-09-10T08:44:29.456550+0000","last_became_active":"2024-09-10T08:28:47.627775+0000","last_became_peered":"2024-09-10T08:28:47.627775+0000","last_unstale":"2024-09-10T08:44:29.456550+0000","last_undegraded":"2024-09-10T08:44:29.456550+0000","last_fullsized":"2024-09-10T08:44:29.456550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3973,"log_dups_size":0,"ondisk_log_size":3973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20759,"num_write_kb":275665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'6218","reported_seq":6258,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:51.453979+0000","last_change":"2024-09-10T08:44:51.453979+0000","last_active":"2024-09-10T08:44:51.453979+0000","last_peered":"2024-09-10T08:44:51.453979+0000","last_clean":"2024-09-10T08:44:51.453979+0000","last_became_active":"2024-09-10T08:28:35.570711+0000","last_became_peered":"2024-09-10T08:28:35.570711+0000","last_unstale":"2024-09-10T08:44:51.453979+0000","last_undegraded":"2024-09-10T08:44:51.453979+0000","last_fullsized":"2024-09-10T08:44:51.453979+0000","mapping_epoch":19,"log_start":"27'700","ondisk_log_start":"27'700","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6218","last_scrub_stamp":"2024-09-10T08:44:51.453840+0000","last_deep_scrub":"27'6218","last_deep_scrub_stamp":"2024-09-10T08:44:51.453840+0000","last_clean_scrub_stamp":"2024-09-10T08:44:51.453840+0000","objects_scrubbed":0,"log_size":5518,"log_dups_size":0,"ondisk_log_size":5518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:11.132906+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31535,"num_write_kb":397056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'37","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:49.297803+0000","last_change":"2024-09-10T08:44:49.297832+0000","last_active":"2024-09-10T08:44:49.297803+0000","last_peered":"2024-09-10T08:44:49.297803+0000","last_clean":"2024-09-10T08:44:49.297803+0000","last_became_active":"2024-09-10T08:28:34.557076+0000","last_became_peered":"2024-09-10T08:28:34.557076+0000","last_unstale":"2024-09-10T08:44:49.297803+0000","last_undegraded":"2024-09-10T08:44:49.297803+0000","last_fullsized":"2024-09-10T08:44:49.297803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2024-09-10T08:44:49.297719+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2024-09-10T08:44:49.297719+0000","last_clean_scrub_stamp":"2024-09-10T08:44:49.297719+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:48:45.895217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'10","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:53.411665+0000","last_change":"2024-09-10T08:44:53.411705+0000","last_active":"2024-09-10T08:44:53.411665+0000","last_peered":"2024-09-10T08:44:53.411665+0000","last_clean":"2024-09-10T08:44:53.411665+0000","last_became_active":"2024-09-10T08:28:46.615451+0000","last_became_peered":"2024-09-10T08:28:46.615451+0000","last_unstale":"2024-09-10T08:44:53.411665+0000","last_undegraded":"2024-09-10T08:44:53.411665+0000","last_fullsized":"2024-09-10T08:44:53.411665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-09-10T08:44:53.411570+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-09-10T08:44:53.411570+0000","last_clean_scrub_stamp":"2024-09-10T08:44:53.411570+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:55.535421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"27'4284","reported_seq":4315,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:57.174720+0000","last_change":"2024-09-10T08:44:57.174762+0000","last_active":"2024-09-10T08:44:57.174720+0000","last_peered":"2024-09-10T08:44:57.174720+0000","last_clean":"2024-09-10T08:44:57.174720+0000","last_became_active":"2024-09-10T08:28:47.622961+0000","last_became_peered":"2024-09-10T08:28:47.622961+0000","last_unstale":"2024-09-10T08:44:57.174720+0000","last_undegraded":"2024-09-10T08:44:57.174720+0000","last_fullsized":"2024-09-10T08:44:57.174720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4284","last_scrub_stamp":"2024-09-10T08:44:57.174608+0000","last_deep_scrub":"27'4284","last_deep_scrub_stamp":"2024-09-10T08:44:57.174608+0000","last_clean_scrub_stamp":"2024-09-10T08:44:57.174608+0000","objects_scrubbed":0,"log_size":4284,"log_dups_size":0,"ondisk_log_size":4284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:17.791121+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23423,"num_write_kb":294728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"27'3896","reported_seq":3935,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:38.878248+0000","last_change":"2024-09-10T08:44:38.878270+0000","last_active":"2024-09-10T08:44:38.878248+0000","last_peered":"2024-09-10T08:44:38.878248+0000","last_clean":"2024-09-10T08:44:38.878248+0000","last_became_active":"2024-09-10T08:28:35.577255+0000","last_became_peered":"2024-09-10T08:28:35.577255+0000","last_unstale":"2024-09-10T08:44:38.878248+0000","last_undegraded":"2024-09-10T08:44:38.878248+0000","last_fullsized":"2024-09-10T08:44:38.878248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3896","last_scrub_stamp":"2024-09-10T08:44:38.878177+0000","last_deep_scrub":"27'3896","last_deep_scrub_stamp":"2024-09-10T08:44:38.878177+0000","last_clean_scrub_stamp":"2024-09-10T08:44:38.878177+0000","objects_scrubbed":0,"log_size":3896,"log_dups_size":0,"ondisk_log_size":3896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:37.246919+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19770,"num_write_kb":255291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'2","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:56.209108+0000","last_change":"2024-09-10T08:44:56.209134+0000","last_active":"2024-09-10T08:44:56.209108+0000","last_peered":"2024-09-10T08:44:56.209108+0000","last_clean":"2024-09-10T08:44:56.209108+0000","last_became_active":"2024-09-10T08:28:34.564189+0000","last_became_peered":"2024-09-10T08:28:34.564189+0000","last_unstale":"2024-09-10T08:44:56.209108+0000","last_undegraded":"2024-09-10T08:44:56.209108+0000","last_fullsized":"2024-09-10T08:44:56.209108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-09-10T08:44:56.209016+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-09-10T08:44:56.209016+0000","last_clean_scrub_stamp":"2024-09-10T08:44:56.209016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:57.531020+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'16","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:43.849891+0000","last_change":"2024-09-10T08:44:43.849935+0000","last_active":"2024-09-10T08:44:43.849891+0000","last_peered":"2024-09-10T08:44:43.849891+0000","last_clean":"2024-09-10T08:44:43.849891+0000","last_became_active":"2024-09-10T08:28:46.618625+0000","last_became_peered":"2024-09-10T08:28:46.618625+0000","last_unstale":"2024-09-10T08:44:43.849891+0000","last_undegraded":"2024-09-10T08:44:43.849891+0000","last_fullsized":"2024-09-10T08:44:43.849891+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-09-10T08:44:43.849781+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-09-10T08:44:43.849781+0000","last_clean_scrub_stamp":"2024-09-10T08:44:43.849781+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:09.392025+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"27'4685","reported_seq":4708,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.464080+0000","last_change":"2024-09-10T08:28:47.630243+0000","last_active":"2024-09-10T08:44:29.464080+0000","last_peered":"2024-09-10T08:44:29.464080+0000","last_clean":"2024-09-10T08:44:29.464080+0000","last_became_active":"2024-09-10T08:28:47.629869+0000","last_became_peered":"2024-09-10T08:28:47.629869+0000","last_unstale":"2024-09-10T08:44:29.464080+0000","last_undegraded":"2024-09-10T08:44:29.464080+0000","last_fullsized":"2024-09-10T08:44:29.464080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4685,"log_dups_size":0,"ondisk_log_size":4685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24572,"num_write_kb":315590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'4682","reported_seq":4721,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:51.059197+0000","last_change":"2024-09-10T08:44:51.059224+0000","last_active":"2024-09-10T08:44:51.059197+0000","last_peered":"2024-09-10T08:44:51.059197+0000","last_clean":"2024-09-10T08:44:51.059197+0000","last_became_active":"2024-09-10T08:28:35.572620+0000","last_became_peered":"2024-09-10T08:28:35.572620+0000","last_unstale":"2024-09-10T08:44:51.059197+0000","last_undegraded":"2024-09-10T08:44:51.059197+0000","last_fullsized":"2024-09-10T08:44:51.059197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4682","last_scrub_stamp":"2024-09-10T08:44:51.059094+0000","last_deep_scrub":"27'4682","last_deep_scrub_stamp":"2024-09-10T08:44:51.059094+0000","last_clean_scrub_stamp":"2024-09-10T08:44:51.059094+0000","objects_scrubbed":0,"log_size":4682,"log_dups_size":0,"ondisk_log_size":4682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:04.719958+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24219,"num_write_kb":302042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'2","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:49.162599+0000","last_change":"2024-09-10T08:44:49.162626+0000","last_active":"2024-09-10T08:44:49.162599+0000","last_peered":"2024-09-10T08:44:49.162599+0000","last_clean":"2024-09-10T08:44:49.162599+0000","last_became_active":"2024-09-10T08:28:34.562647+0000","last_became_peered":"2024-09-10T08:28:34.562647+0000","last_unstale":"2024-09-10T08:44:49.162599+0000","last_undegraded":"2024-09-10T08:44:49.162599+0000","last_fullsized":"2024-09-10T08:44:49.162599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-09-10T08:44:49.162508+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-09-10T08:44:49.162508+0000","last_clean_scrub_stamp":"2024-09-10T08:44:49.162508+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:53.095206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'6","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:44.801738+0000","last_change":"2024-09-10T08:44:44.801766+0000","last_active":"2024-09-10T08:44:44.801738+0000","last_peered":"2024-09-10T08:44:44.801738+0000","last_clean":"2024-09-10T08:44:44.801738+0000","last_became_active":"2024-09-10T08:28:46.621157+0000","last_became_peered":"2024-09-10T08:28:46.621157+0000","last_unstale":"2024-09-10T08:44:44.801738+0000","last_undegraded":"2024-09-10T08:44:44.801738+0000","last_fullsized":"2024-09-10T08:44:44.801738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-09-10T08:44:44.801648+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-09-10T08:44:44.801648+0000","last_clean_scrub_stamp":"2024-09-10T08:44:44.801648+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:11.488688+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"27'5768","reported_seq":5792,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.467950+0000","last_change":"2024-09-10T08:28:47.627750+0000","last_active":"2024-09-10T08:44:29.467950+0000","last_peered":"2024-09-10T08:44:29.467950+0000","last_clean":"2024-09-10T08:44:29.467950+0000","last_became_active":"2024-09-10T08:28:47.627481+0000","last_became_peered":"2024-09-10T08:28:47.627481+0000","last_unstale":"2024-09-10T08:44:29.467950+0000","last_undegraded":"2024-09-10T08:44:29.467950+0000","last_fullsized":"2024-09-10T08:44:29.467950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5768,"log_dups_size":0,"ondisk_log_size":5768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30773,"num_write_kb":369268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:51.978548+0000","last_change":"2024-09-10T08:44:51.978548+0000","last_active":"2024-09-10T08:44:51.978548+0000","last_peered":"2024-09-10T08:44:51.978548+0000","last_clean":"2024-09-10T08:44:51.978548+0000","last_became_active":"2024-09-10T08:28:46.619843+0000","last_became_peered":"2024-09-10T08:28:46.619843+0000","last_unstale":"2024-09-10T08:44:51.978548+0000","last_undegraded":"2024-09-10T08:44:51.978548+0000","last_fullsized":"2024-09-10T08:44:51.978548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-09-10T08:44:51.978409+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-09-10T08:44:51.978409+0000","last_clean_scrub_stamp":"2024-09-10T08:44:51.978409+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:18:47.538545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'5404","reported_seq":5443,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:43.324480+0000","last_change":"2024-09-10T08:44:43.324510+0000","last_active":"2024-09-10T08:44:43.324480+0000","last_peered":"2024-09-10T08:44:43.324480+0000","last_clean":"2024-09-10T08:44:43.324480+0000","last_became_active":"2024-09-10T08:28:35.572219+0000","last_became_peered":"2024-09-10T08:28:35.572219+0000","last_unstale":"2024-09-10T08:44:43.324480+0000","last_undegraded":"2024-09-10T08:44:43.324480+0000","last_fullsized":"2024-09-10T08:44:43.324480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5404","last_scrub_stamp":"2024-09-10T08:44:43.324352+0000","last_deep_scrub":"27'5404","last_deep_scrub_stamp":"2024-09-10T08:44:43.324352+0000","last_clean_scrub_stamp":"2024-09-10T08:44:43.324352+0000","objects_scrubbed":0,"log_size":5404,"log_dups_size":0,"ondisk_log_size":5404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:52.590735+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27626,"num_write_kb":348430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:53.124095+0000","last_change":"2024-09-10T08:44:53.124124+0000","last_active":"2024-09-10T08:44:53.124095+0000","last_peered":"2024-09-10T08:44:53.124095+0000","last_clean":"2024-09-10T08:44:53.124095+0000","last_became_active":"2024-09-10T08:28:34.553933+0000","last_became_peered":"2024-09-10T08:28:34.553933+0000","last_unstale":"2024-09-10T08:44:53.124095+0000","last_undegraded":"2024-09-10T08:44:53.124095+0000","last_fullsized":"2024-09-10T08:44:53.124095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-10T08:44:53.123992+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-10T08:44:53.123992+0000","last_clean_scrub_stamp":"2024-09-10T08:44:53.123992+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:53.148741+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"27'4656","reported_seq":4689,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:57.923629+0000","last_change":"2024-09-10T08:44:57.923656+0000","last_active":"2024-09-10T08:44:57.923629+0000","last_peered":"2024-09-10T08:44:57.923629+0000","last_clean":"2024-09-10T08:44:57.923629+0000","last_became_active":"2024-09-10T08:28:47.629177+0000","last_became_peered":"2024-09-10T08:28:47.629177+0000","last_unstale":"2024-09-10T08:44:57.923629+0000","last_undegraded":"2024-09-10T08:44:57.923629+0000","last_fullsized":"2024-09-10T08:44:57.923629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4656","last_scrub_stamp":"2024-09-10T08:44:57.923524+0000","last_deep_scrub":"27'4656","last_deep_scrub_stamp":"2024-09-10T08:44:57.923524+0000","last_clean_scrub_stamp":"2024-09-10T08:44:57.923524+0000","objects_scrubbed":0,"log_size":4656,"log_dups_size":0,"ondisk_log_size":4656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:56.921725+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24729,"num_write_kb":316330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"27'633","reported_seq":667,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:56.226073+0000","last_change":"2024-09-10T08:44:56.226102+0000","last_active":"2024-09-10T08:44:56.226073+0000","last_peered":"2024-09-10T08:44:56.226073+0000","last_clean":"2024-09-10T08:44:56.226073+0000","last_became_active":"2024-09-10T08:28:46.630530+0000","last_became_peered":"2024-09-10T08:28:46.630530+0000","last_unstale":"2024-09-10T08:44:56.226073+0000","last_undegraded":"2024-09-10T08:44:56.226073+0000","last_fullsized":"2024-09-10T08:44:56.226073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'633","last_scrub_stamp":"2024-09-10T08:44:56.225992+0000","last_deep_scrub":"27'633","last_deep_scrub_stamp":"2024-09-10T08:44:56.225992+0000","last_clean_scrub_stamp":"2024-09-10T08:44:56.225992+0000","objects_scrubbed":3,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:38.329170+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":4465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'4762","reported_seq":4801,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:45.774805+0000","last_change":"2024-09-10T08:44:45.774831+0000","last_active":"2024-09-10T08:44:45.774805+0000","last_peered":"2024-09-10T08:44:45.774805+0000","last_clean":"2024-09-10T08:44:45.774805+0000","last_became_active":"2024-09-10T08:28:35.579975+0000","last_became_peered":"2024-09-10T08:28:35.579975+0000","last_unstale":"2024-09-10T08:44:45.774805+0000","last_undegraded":"2024-09-10T08:44:45.774805+0000","last_fullsized":"2024-09-10T08:44:45.774805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4762","last_scrub_stamp":"2024-09-10T08:44:45.774702+0000","last_deep_scrub":"27'4762","last_deep_scrub_stamp":"2024-09-10T08:44:45.774702+0000","last_clean_scrub_stamp":"2024-09-10T08:44:45.774702+0000","objects_scrubbed":0,"log_size":4762,"log_dups_size":0,"ondisk_log_size":4762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:21:59.061286+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24500,"num_write_kb":298921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:55.590917+0000","last_change":"2024-09-10T08:44:55.590943+0000","last_active":"2024-09-10T08:44:55.590917+0000","last_peered":"2024-09-10T08:44:55.590917+0000","last_clean":"2024-09-10T08:44:55.590917+0000","last_became_active":"2024-09-10T08:28:34.564479+0000","last_became_peered":"2024-09-10T08:28:34.564479+0000","last_unstale":"2024-09-10T08:44:55.590917+0000","last_undegraded":"2024-09-10T08:44:55.590917+0000","last_fullsized":"2024-09-10T08:44:55.590917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-10T08:44:55.590792+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-10T08:44:55.590792+0000","last_clean_scrub_stamp":"2024-09-10T08:44:55.590792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:34.961720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"27'5070","reported_seq":5101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:56.202230+0000","last_change":"2024-09-10T08:44:56.202259+0000","last_active":"2024-09-10T08:44:56.202230+0000","last_peered":"2024-09-10T08:44:56.202230+0000","last_clean":"2024-09-10T08:44:56.202230+0000","last_became_active":"2024-09-10T08:28:47.626692+0000","last_became_peered":"2024-09-10T08:28:47.626692+0000","last_unstale":"2024-09-10T08:44:56.202230+0000","last_undegraded":"2024-09-10T08:44:56.202230+0000","last_fullsized":"2024-09-10T08:44:56.202230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5070","last_scrub_stamp":"2024-09-10T08:44:56.202133+0000","last_deep_scrub":"27'5070","last_deep_scrub_stamp":"2024-09-10T08:44:56.202133+0000","last_clean_scrub_stamp":"2024-09-10T08:44:56.202133+0000","objects_scrubbed":0,"log_size":5070,"log_dups_size":0,"ondisk_log_size":5070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:38:54.246227+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26421,"num_write_kb":351729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"27'90","reported_seq":131,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:48.194392+0000","last_change":"2024-09-10T08:44:48.194442+0000","last_active":"2024-09-10T08:44:48.194392+0000","last_peered":"2024-09-10T08:44:48.194392+0000","last_clean":"2024-09-10T08:44:48.194392+0000","last_became_active":"2024-09-10T08:28:34.561613+0000","last_became_peered":"2024-09-10T08:28:34.561613+0000","last_unstale":"2024-09-10T08:44:48.194392+0000","last_undegraded":"2024-09-10T08:44:48.194392+0000","last_fullsized":"2024-09-10T08:44:48.194392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'90","last_scrub_stamp":"2024-09-10T08:44:48.194281+0000","last_deep_scrub":"27'90","last_deep_scrub_stamp":"2024-09-10T08:44:48.194281+0000","last_clean_scrub_stamp":"2024-09-10T08:44:48.194281+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:09.873480+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061672,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":1094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'3916","reported_seq":3955,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:42.948004+0000","last_change":"2024-09-10T08:44:42.948063+0000","last_active":"2024-09-10T08:44:42.948004+0000","last_peered":"2024-09-10T08:44:42.948004+0000","last_clean":"2024-09-10T08:44:42.948004+0000","last_became_active":"2024-09-10T08:28:35.576145+0000","last_became_peered":"2024-09-10T08:28:35.576145+0000","last_unstale":"2024-09-10T08:44:42.948004+0000","last_undegraded":"2024-09-10T08:44:42.948004+0000","last_fullsized":"2024-09-10T08:44:42.948004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3916","last_scrub_stamp":"2024-09-10T08:44:42.947880+0000","last_deep_scrub":"27'3916","last_deep_scrub_stamp":"2024-09-10T08:44:42.947880+0000","last_clean_scrub_stamp":"2024-09-10T08:44:42.947880+0000","objects_scrubbed":0,"log_size":3916,"log_dups_size":0,"ondisk_log_size":3916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:34.524482+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19526,"num_write_kb":237971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:47.280689+0000","last_change":"2024-09-10T08:44:47.280719+0000","last_active":"2024-09-10T08:44:47.280689+0000","last_peered":"2024-09-10T08:44:47.280689+0000","last_clean":"2024-09-10T08:44:47.280689+0000","last_became_active":"2024-09-10T08:28:46.621941+0000","last_became_peered":"2024-09-10T08:28:46.621941+0000","last_unstale":"2024-09-10T08:44:47.280689+0000","last_undegraded":"2024-09-10T08:44:47.280689+0000","last_fullsized":"2024-09-10T08:44:47.280689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-09-10T08:44:47.280603+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-09-10T08:44:47.280603+0000","last_clean_scrub_stamp":"2024-09-10T08:44:47.280603+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:44.503304+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"27'3193","reported_seq":3216,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.438031+0000","last_change":"2024-09-10T08:28:47.626495+0000","last_active":"2024-09-10T08:44:29.438031+0000","last_peered":"2024-09-10T08:44:29.438031+0000","last_clean":"2024-09-10T08:44:29.438031+0000","last_became_active":"2024-09-10T08:28:47.625258+0000","last_became_peered":"2024-09-10T08:28:47.625258+0000","last_unstale":"2024-09-10T08:44:29.438031+0000","last_undegraded":"2024-09-10T08:44:29.438031+0000","last_fullsized":"2024-09-10T08:44:29.438031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3193,"log_dups_size":0,"ondisk_log_size":3193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16183,"num_write_kb":212369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'623","reported_seq":664,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:56.615576+0000","last_change":"2024-09-10T08:44:56.615616+0000","last_active":"2024-09-10T08:44:56.615576+0000","last_peered":"2024-09-10T08:44:56.615576+0000","last_clean":"2024-09-10T08:44:56.615576+0000","last_became_active":"2024-09-10T08:28:34.566388+0000","last_became_peered":"2024-09-10T08:28:34.566388+0000","last_unstale":"2024-09-10T08:44:56.615576+0000","last_undegraded":"2024-09-10T08:44:56.615576+0000","last_fullsized":"2024-09-10T08:44:56.615576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'623","last_scrub_stamp":"2024-09-10T08:44:56.615470+0000","last_deep_scrub":"27'623","last_deep_scrub_stamp":"2024-09-10T08:44:56.615470+0000","last_clean_scrub_stamp":"2024-09-10T08:44:56.615470+0000","objects_scrubbed":1,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:02.777836+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":620,"num_write_kb":4248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'4051","reported_seq":4090,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:48.465503+0000","last_change":"2024-09-10T08:44:48.465543+0000","last_active":"2024-09-10T08:44:48.465503+0000","last_peered":"2024-09-10T08:44:48.465503+0000","last_clean":"2024-09-10T08:44:48.465503+0000","last_became_active":"2024-09-10T08:28:35.559145+0000","last_became_peered":"2024-09-10T08:28:35.559145+0000","last_unstale":"2024-09-10T08:44:48.465503+0000","last_undegraded":"2024-09-10T08:44:48.465503+0000","last_fullsized":"2024-09-10T08:44:48.465503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4051","last_scrub_stamp":"2024-09-10T08:44:48.465379+0000","last_deep_scrub":"27'4051","last_deep_scrub_stamp":"2024-09-10T08:44:48.465379+0000","last_clean_scrub_stamp":"2024-09-10T08:44:48.465379+0000","objects_scrubbed":0,"log_size":4051,"log_dups_size":0,"ondisk_log_size":4051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:01.759800+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20269,"num_write_kb":257190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'12","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:40.856236+0000","last_change":"2024-09-10T08:44:40.856260+0000","last_active":"2024-09-10T08:44:40.856236+0000","last_peered":"2024-09-10T08:44:40.856236+0000","last_clean":"2024-09-10T08:44:40.856236+0000","last_became_active":"2024-09-10T08:28:46.619403+0000","last_became_peered":"2024-09-10T08:28:46.619403+0000","last_unstale":"2024-09-10T08:44:40.856236+0000","last_undegraded":"2024-09-10T08:44:40.856236+0000","last_fullsized":"2024-09-10T08:44:40.856236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-09-10T08:44:40.856154+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-09-10T08:44:40.856154+0000","last_clean_scrub_stamp":"2024-09-10T08:44:40.856154+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:50:13.135382+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"27'4023","reported_seq":4047,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.453795+0000","last_change":"2024-09-10T08:28:47.627135+0000","last_active":"2024-09-10T08:44:29.453795+0000","last_peered":"2024-09-10T08:44:29.453795+0000","last_clean":"2024-09-10T08:44:29.453795+0000","last_became_active":"2024-09-10T08:28:47.626791+0000","last_became_peered":"2024-09-10T08:28:47.626791+0000","last_unstale":"2024-09-10T08:44:29.453795+0000","last_undegraded":"2024-09-10T08:44:29.453795+0000","last_fullsized":"2024-09-10T08:44:29.453795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4023,"log_dups_size":0,"ondisk_log_size":4023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21172,"num_write_kb":269680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'5985","reported_seq":6025,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:44.150701+0000","last_change":"2024-09-10T08:44:44.150728+0000","last_active":"2024-09-10T08:44:44.150701+0000","last_peered":"2024-09-10T08:44:44.150701+0000","last_clean":"2024-09-10T08:44:44.150701+0000","last_became_active":"2024-09-10T08:28:35.578631+0000","last_became_peered":"2024-09-10T08:28:35.578631+0000","last_unstale":"2024-09-10T08:44:44.150701+0000","last_undegraded":"2024-09-10T08:44:44.150701+0000","last_fullsized":"2024-09-10T08:44:44.150701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5985","last_scrub_stamp":"2024-09-10T08:44:44.150593+0000","last_deep_scrub":"27'5985","last_deep_scrub_stamp":"2024-09-10T08:44:44.150593+0000","last_clean_scrub_stamp":"2024-09-10T08:44:44.150593+0000","objects_scrubbed":0,"log_size":5985,"log_dups_size":0,"ondisk_log_size":5985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:31.184341+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30721,"num_write_kb":377078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"27'5461","reported_seq":5485,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.369607+0000","last_change":"2024-09-10T08:28:47.632052+0000","last_active":"2024-09-10T08:44:29.369607+0000","last_peered":"2024-09-10T08:44:29.369607+0000","last_clean":"2024-09-10T08:44:29.369607+0000","last_became_active":"2024-09-10T08:28:47.631578+0000","last_became_peered":"2024-09-10T08:28:47.631578+0000","last_unstale":"2024-09-10T08:44:29.369607+0000","last_undegraded":"2024-09-10T08:44:29.369607+0000","last_fullsized":"2024-09-10T08:44:29.369607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5461,"log_dups_size":0,"ondisk_log_size":5461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28495,"num_write_kb":351882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"27'5419","reported_seq":5464,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:57.321473+0000","last_change":"2024-09-10T08:44:57.321502+0000","last_active":"2024-09-10T08:44:57.321473+0000","last_peered":"2024-09-10T08:44:57.321473+0000","last_clean":"2024-09-10T08:44:57.321473+0000","last_became_active":"2024-09-10T08:29:36.029789+0000","last_became_peered":"2024-09-10T08:29:36.029789+0000","last_unstale":"2024-09-10T08:44:57.321473+0000","last_undegraded":"2024-09-10T08:44:57.321473+0000","last_fullsized":"2024-09-10T08:44:57.321473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5419","last_scrub_stamp":"2024-09-10T08:44:57.321355+0000","last_deep_scrub":"27'5419","last_deep_scrub_stamp":"2024-09-10T08:44:57.321355+0000","last_clean_scrub_stamp":"2024-09-10T08:44:57.321355+0000","objects_scrubbed":0,"log_size":5419,"log_dups_size":0,"ondisk_log_size":5419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:31.294298+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28175,"num_write_kb":329998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"27'4342","reported_seq":4366,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.456271+0000","last_change":"2024-09-10T08:28:47.629148+0000","last_active":"2024-09-10T08:44:29.456271+0000","last_peered":"2024-09-10T08:44:29.456271+0000","last_clean":"2024-09-10T08:44:29.456271+0000","last_became_active":"2024-09-10T08:28:47.628741+0000","last_became_peered":"2024-09-10T08:28:47.628741+0000","last_unstale":"2024-09-10T08:44:29.456271+0000","last_undegraded":"2024-09-10T08:44:29.456271+0000","last_fullsized":"2024-09-10T08:44:29.456271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22591,"num_write_kb":275032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"27'5933","reported_seq":5973,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:43.131131+0000","last_change":"2024-09-10T08:44:43.131167+0000","last_active":"2024-09-10T08:44:43.131131+0000","last_peered":"2024-09-10T08:44:43.131131+0000","last_clean":"2024-09-10T08:44:43.131131+0000","last_became_active":"2024-09-10T08:28:35.577995+0000","last_became_peered":"2024-09-10T08:28:35.577995+0000","last_unstale":"2024-09-10T08:44:43.131131+0000","last_undegraded":"2024-09-10T08:44:43.131131+0000","last_fullsized":"2024-09-10T08:44:43.131131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5933","last_scrub_stamp":"2024-09-10T08:44:43.131024+0000","last_deep_scrub":"27'5933","last_deep_scrub_stamp":"2024-09-10T08:44:43.131024+0000","last_clean_scrub_stamp":"2024-09-10T08:44:43.131024+0000","objects_scrubbed":0,"log_size":5933,"log_dups_size":0,"ondisk_log_size":5933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:01:19.719084+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30577,"num_write_kb":368306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"27'4476","reported_seq":4500,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.461630+0000","last_change":"2024-09-10T08:28:47.628639+0000","last_active":"2024-09-10T08:44:29.461630+0000","last_peered":"2024-09-10T08:44:29.461630+0000","last_clean":"2024-09-10T08:44:29.461630+0000","last_became_active":"2024-09-10T08:28:47.628317+0000","last_became_peered":"2024-09-10T08:28:47.628317+0000","last_unstale":"2024-09-10T08:44:29.461630+0000","last_undegraded":"2024-09-10T08:44:29.461630+0000","last_fullsized":"2024-09-10T08:44:29.461630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4476,"log_dups_size":0,"ondisk_log_size":4476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23867,"num_write_kb":312797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"27'4232","reported_seq":4272,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:40.902340+0000","last_change":"2024-09-10T08:44:40.902363+0000","last_active":"2024-09-10T08:44:40.902340+0000","last_peered":"2024-09-10T08:44:40.902340+0000","last_clean":"2024-09-10T08:44:40.902340+0000","last_became_active":"2024-09-10T08:28:35.577571+0000","last_became_peered":"2024-09-10T08:28:35.577571+0000","last_unstale":"2024-09-10T08:44:40.902340+0000","last_undegraded":"2024-09-10T08:44:40.902340+0000","last_fullsized":"2024-09-10T08:44:40.902340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4232","last_scrub_stamp":"2024-09-10T08:44:40.902258+0000","last_deep_scrub":"27'4232","last_deep_scrub_stamp":"2024-09-10T08:44:40.902258+0000","last_clean_scrub_stamp":"2024-09-10T08:44:40.902258+0000","objects_scrubbed":0,"log_size":4232,"log_dups_size":0,"ondisk_log_size":4232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:33.553812+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21938,"num_write_kb":263982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"27'5518","reported_seq":5550,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:48.928201+0000","last_change":"2024-09-10T08:44:48.928229+0000","last_active":"2024-09-10T08:44:48.928201+0000","last_peered":"2024-09-10T08:44:48.928201+0000","last_clean":"2024-09-10T08:44:48.928201+0000","last_became_active":"2024-09-10T08:28:47.629634+0000","last_became_peered":"2024-09-10T08:28:47.629634+0000","last_unstale":"2024-09-10T08:44:48.928201+0000","last_undegraded":"2024-09-10T08:44:48.928201+0000","last_fullsized":"2024-09-10T08:44:48.928201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5518","last_scrub_stamp":"2024-09-10T08:44:48.928106+0000","last_deep_scrub":"27'5518","last_deep_scrub_stamp":"2024-09-10T08:44:48.928106+0000","last_clean_scrub_stamp":"2024-09-10T08:44:48.928106+0000","objects_scrubbed":0,"log_size":5518,"log_dups_size":0,"ondisk_log_size":5518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:17.015968+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28611,"num_write_kb":360382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"27'3937","reported_seq":3969,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.456197+0000","last_change":"2024-09-10T08:28:35.574676+0000","last_active":"2024-09-10T08:44:22.456197+0000","last_peered":"2024-09-10T08:44:22.456197+0000","last_clean":"2024-09-10T08:44:22.456197+0000","last_became_active":"2024-09-10T08:28:35.574437+0000","last_became_peered":"2024-09-10T08:28:35.574437+0000","last_unstale":"2024-09-10T08:44:22.456197+0000","last_undegraded":"2024-09-10T08:44:22.456197+0000","last_fullsized":"2024-09-10T08:44:22.456197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":3937,"log_dups_size":0,"ondisk_log_size":3937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20167,"num_write_kb":265112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"27'3790","reported_seq":3822,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:55.449718+0000","last_change":"2024-09-10T08:44:55.449746+0000","last_active":"2024-09-10T08:44:55.449718+0000","last_peered":"2024-09-10T08:44:55.449718+0000","last_clean":"2024-09-10T08:44:55.449718+0000","last_became_active":"2024-09-10T08:28:47.623671+0000","last_became_peered":"2024-09-10T08:28:47.623671+0000","last_unstale":"2024-09-10T08:44:55.449718+0000","last_undegraded":"2024-09-10T08:44:55.449718+0000","last_fullsized":"2024-09-10T08:44:55.449718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3790","last_scrub_stamp":"2024-09-10T08:44:55.449594+0000","last_deep_scrub":"27'3790","last_deep_scrub_stamp":"2024-09-10T08:44:55.449594+0000","last_clean_scrub_stamp":"2024-09-10T08:44:55.449594+0000","objects_scrubbed":0,"log_size":3790,"log_dups_size":0,"ondisk_log_size":3790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:20.920203+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19891,"num_write_kb":255782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"27'4956","reported_seq":4996,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:45.307383+0000","last_change":"2024-09-10T08:44:45.307408+0000","last_active":"2024-09-10T08:44:45.307383+0000","last_peered":"2024-09-10T08:44:45.307383+0000","last_clean":"2024-09-10T08:44:45.307383+0000","last_became_active":"2024-09-10T08:28:35.572184+0000","last_became_peered":"2024-09-10T08:28:35.572184+0000","last_unstale":"2024-09-10T08:44:45.307383+0000","last_undegraded":"2024-09-10T08:44:45.307383+0000","last_fullsized":"2024-09-10T08:44:45.307383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4956","last_scrub_stamp":"2024-09-10T08:44:45.307282+0000","last_deep_scrub":"27'4956","last_deep_scrub_stamp":"2024-09-10T08:44:45.307282+0000","last_clean_scrub_stamp":"2024-09-10T08:44:45.307282+0000","objects_scrubbed":0,"log_size":4956,"log_dups_size":0,"ondisk_log_size":4956,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:09.568692+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26295,"num_write_kb":322461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"27'5495","reported_seq":5527,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:52.902932+0000","last_change":"2024-09-10T08:44:52.902960+0000","last_active":"2024-09-10T08:44:52.902932+0000","last_peered":"2024-09-10T08:44:52.902932+0000","last_clean":"2024-09-10T08:44:52.902932+0000","last_became_active":"2024-09-10T08:28:47.629512+0000","last_became_peered":"2024-09-10T08:28:47.629512+0000","last_unstale":"2024-09-10T08:44:52.902932+0000","last_undegraded":"2024-09-10T08:44:52.902932+0000","last_fullsized":"2024-09-10T08:44:52.902932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5495","last_scrub_stamp":"2024-09-10T08:44:52.902818+0000","last_deep_scrub":"27'5495","last_deep_scrub_stamp":"2024-09-10T08:44:52.902818+0000","last_clean_scrub_stamp":"2024-09-10T08:44:52.902818+0000","objects_scrubbed":0,"log_size":5495,"log_dups_size":0,"ondisk_log_size":5495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:48.062940+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29037,"num_write_kb":370350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"27'4400","reported_seq":4440,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:45.185557+0000","last_change":"2024-09-10T08:44:45.185582+0000","last_active":"2024-09-10T08:44:45.185557+0000","last_peered":"2024-09-10T08:44:45.185557+0000","last_clean":"2024-09-10T08:44:45.185557+0000","last_became_active":"2024-09-10T08:28:35.572955+0000","last_became_peered":"2024-09-10T08:28:35.572955+0000","last_unstale":"2024-09-10T08:44:45.185557+0000","last_undegraded":"2024-09-10T08:44:45.185557+0000","last_fullsized":"2024-09-10T08:44:45.185557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4400","last_scrub_stamp":"2024-09-10T08:44:45.185459+0000","last_deep_scrub":"27'4400","last_deep_scrub_stamp":"2024-09-10T08:44:45.185459+0000","last_clean_scrub_stamp":"2024-09-10T08:44:45.185459+0000","objects_scrubbed":0,"log_size":4400,"log_dups_size":0,"ondisk_log_size":4400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:30:16.876549+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22665,"num_write_kb":275496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"27'4608","reported_seq":4640,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:58.187397+0000","last_change":"2024-09-10T08:44:58.187428+0000","last_active":"2024-09-10T08:44:58.187397+0000","last_peered":"2024-09-10T08:44:58.187397+0000","last_clean":"2024-09-10T08:44:58.187397+0000","last_became_active":"2024-09-10T08:28:47.623082+0000","last_became_peered":"2024-09-10T08:28:47.623082+0000","last_unstale":"2024-09-10T08:44:58.187397+0000","last_undegraded":"2024-09-10T08:44:58.187397+0000","last_fullsized":"2024-09-10T08:44:58.187397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4608","last_scrub_stamp":"2024-09-10T08:44:58.187306+0000","last_deep_scrub":"27'4608","last_deep_scrub_stamp":"2024-09-10T08:44:58.187306+0000","last_clean_scrub_stamp":"2024-09-10T08:44:58.187306+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:52.439664+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24193,"num_write_kb":313982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'6039","reported_seq":6079,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:49.616869+0000","last_change":"2024-09-10T08:44:49.616898+0000","last_active":"2024-09-10T08:44:49.616869+0000","last_peered":"2024-09-10T08:44:49.616869+0000","last_clean":"2024-09-10T08:44:49.616869+0000","last_became_active":"2024-09-10T08:28:35.575614+0000","last_became_peered":"2024-09-10T08:28:35.575614+0000","last_unstale":"2024-09-10T08:44:49.616869+0000","last_undegraded":"2024-09-10T08:44:49.616869+0000","last_fullsized":"2024-09-10T08:44:49.616869+0000","mapping_epoch":19,"log_start":"27'800","ondisk_log_start":"27'800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6039","last_scrub_stamp":"2024-09-10T08:44:49.616767+0000","last_deep_scrub":"27'6039","last_deep_scrub_stamp":"2024-09-10T08:44:49.616767+0000","last_clean_scrub_stamp":"2024-09-10T08:44:49.616767+0000","objects_scrubbed":0,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:15.817052+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31129,"num_write_kb":362414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"27'3524","reported_seq":3547,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.429805+0000","last_change":"2024-09-10T08:28:47.629795+0000","last_active":"2024-09-10T08:44:29.429805+0000","last_peered":"2024-09-10T08:44:29.429805+0000","last_clean":"2024-09-10T08:44:29.429805+0000","last_became_active":"2024-09-10T08:28:47.628861+0000","last_became_peered":"2024-09-10T08:28:47.628861+0000","last_unstale":"2024-09-10T08:44:29.429805+0000","last_undegraded":"2024-09-10T08:44:29.429805+0000","last_fullsized":"2024-09-10T08:44:29.429805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3524,"log_dups_size":0,"ondisk_log_size":3524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18277,"num_write_kb":237112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'4470","reported_seq":4510,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:45.103341+0000","last_change":"2024-09-10T08:44:45.103401+0000","last_active":"2024-09-10T08:44:45.103341+0000","last_peered":"2024-09-10T08:44:45.103341+0000","last_clean":"2024-09-10T08:44:45.103341+0000","last_became_active":"2024-09-10T08:28:35.576805+0000","last_became_peered":"2024-09-10T08:28:35.576805+0000","last_unstale":"2024-09-10T08:44:45.103341+0000","last_undegraded":"2024-09-10T08:44:45.103341+0000","last_fullsized":"2024-09-10T08:44:45.103341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4470","last_scrub_stamp":"2024-09-10T08:44:45.103202+0000","last_deep_scrub":"27'4470","last_deep_scrub_stamp":"2024-09-10T08:44:45.103202+0000","last_clean_scrub_stamp":"2024-09-10T08:44:45.103202+0000","objects_scrubbed":0,"log_size":4470,"log_dups_size":0,"ondisk_log_size":4470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:35:51.980264+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22783,"num_write_kb":271507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"27'5536","reported_seq":5559,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.447422+0000","last_change":"2024-09-10T08:28:47.635713+0000","last_active":"2024-09-10T08:44:29.447422+0000","last_peered":"2024-09-10T08:44:29.447422+0000","last_clean":"2024-09-10T08:44:29.447422+0000","last_became_active":"2024-09-10T08:28:47.635381+0000","last_became_peered":"2024-09-10T08:28:47.635381+0000","last_unstale":"2024-09-10T08:44:29.447422+0000","last_undegraded":"2024-09-10T08:44:29.447422+0000","last_fullsized":"2024-09-10T08:44:29.447422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5536,"log_dups_size":0,"ondisk_log_size":5536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28458,"num_write_kb":359914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"27'4347","reported_seq":4372,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:54.339547+0000","last_change":"2024-09-10T08:44:54.339577+0000","last_active":"2024-09-10T08:44:54.339547+0000","last_peered":"2024-09-10T08:44:54.339547+0000","last_clean":"2024-09-10T08:44:54.339547+0000","last_became_active":"2024-09-10T08:29:35.097273+0000","last_became_peered":"2024-09-10T08:29:35.097273+0000","last_unstale":"2024-09-10T08:44:54.339547+0000","last_undegraded":"2024-09-10T08:44:54.339547+0000","last_fullsized":"2024-09-10T08:44:54.339547+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4347","last_scrub_stamp":"2024-09-10T08:44:54.339442+0000","last_deep_scrub":"27'4347","last_deep_scrub_stamp":"2024-09-10T08:44:54.339442+0000","last_clean_scrub_stamp":"2024-09-10T08:44:54.339442+0000","objects_scrubbed":0,"log_size":4347,"log_dups_size":0,"ondisk_log_size":4347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:24.445714+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22114,"num_write_kb":289250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2c","version":"27'4653","reported_seq":4685,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:49.358981+0000","last_change":"2024-09-10T08:44:49.359006+0000","last_active":"2024-09-10T08:44:49.358981+0000","last_peered":"2024-09-10T08:44:49.358981+0000","last_clean":"2024-09-10T08:44:49.358981+0000","last_became_active":"2024-09-10T08:28:47.619525+0000","last_became_peered":"2024-09-10T08:28:47.619525+0000","last_unstale":"2024-09-10T08:44:49.358981+0000","last_undegraded":"2024-09-10T08:44:49.358981+0000","last_fullsized":"2024-09-10T08:44:49.358981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4653","last_scrub_stamp":"2024-09-10T08:44:49.358850+0000","last_deep_scrub":"27'4653","last_deep_scrub_stamp":"2024-09-10T08:44:49.358850+0000","last_clean_scrub_stamp":"2024-09-10T08:44:49.358850+0000","objects_scrubbed":0,"log_size":4653,"log_dups_size":0,"ondisk_log_size":4653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:57.197427+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24519,"num_write_kb":299145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"27'5080","reported_seq":5112,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:23.051923+0000","last_change":"2024-09-10T08:28:35.568044+0000","last_active":"2024-09-10T08:44:23.051923+0000","last_peered":"2024-09-10T08:44:23.051923+0000","last_clean":"2024-09-10T08:44:23.051923+0000","last_became_active":"2024-09-10T08:28:35.567744+0000","last_became_peered":"2024-09-10T08:28:35.567744+0000","last_unstale":"2024-09-10T08:44:23.051923+0000","last_undegraded":"2024-09-10T08:44:23.051923+0000","last_fullsized":"2024-09-10T08:44:23.051923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":5080,"log_dups_size":0,"ondisk_log_size":5080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26557,"num_write_kb":327659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"27'4432","reported_seq":4456,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:36.949321+0000","last_change":"2024-09-10T08:28:47.629417+0000","last_active":"2024-09-10T08:44:36.949321+0000","last_peered":"2024-09-10T08:44:36.949321+0000","last_clean":"2024-09-10T08:44:36.949321+0000","last_became_active":"2024-09-10T08:28:47.629095+0000","last_became_peered":"2024-09-10T08:28:47.629095+0000","last_unstale":"2024-09-10T08:44:36.949321+0000","last_undegraded":"2024-09-10T08:44:36.949321+0000","last_fullsized":"2024-09-10T08:44:36.949321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4432,"log_dups_size":0,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22331,"num_write_kb":294288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"27'4801","reported_seq":4841,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:49.978247+0000","last_change":"2024-09-10T08:44:49.978271+0000","last_active":"2024-09-10T08:44:49.978247+0000","last_peered":"2024-09-10T08:44:49.978247+0000","last_clean":"2024-09-10T08:44:49.978247+0000","last_became_active":"2024-09-10T08:28:35.575388+0000","last_became_peered":"2024-09-10T08:28:35.575388+0000","last_unstale":"2024-09-10T08:44:49.978247+0000","last_undegraded":"2024-09-10T08:44:49.978247+0000","last_fullsized":"2024-09-10T08:44:49.978247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4801","last_scrub_stamp":"2024-09-10T08:44:49.978135+0000","last_deep_scrub":"27'4801","last_deep_scrub_stamp":"2024-09-10T08:44:49.978135+0000","last_clean_scrub_stamp":"2024-09-10T08:44:49.978135+0000","objects_scrubbed":0,"log_size":4801,"log_dups_size":0,"ondisk_log_size":4801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:10.666027+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24675,"num_write_kb":307760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"27'4608","reported_seq":4640,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:56.485639+0000","last_change":"2024-09-10T08:44:56.485666+0000","last_active":"2024-09-10T08:44:56.485639+0000","last_peered":"2024-09-10T08:44:56.485639+0000","last_clean":"2024-09-10T08:44:56.485639+0000","last_became_active":"2024-09-10T08:28:47.624026+0000","last_became_peered":"2024-09-10T08:28:47.624026+0000","last_unstale":"2024-09-10T08:44:56.485639+0000","last_undegraded":"2024-09-10T08:44:56.485639+0000","last_fullsized":"2024-09-10T08:44:56.485639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4608","last_scrub_stamp":"2024-09-10T08:44:56.485539+0000","last_deep_scrub":"27'4608","last_deep_scrub_stamp":"2024-09-10T08:44:56.485539+0000","last_clean_scrub_stamp":"2024-09-10T08:44:56.485539+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:00.357282+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24388,"num_write_kb":319015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'4484","reported_seq":4524,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:43.132421+0000","last_change":"2024-09-10T08:44:43.132447+0000","last_active":"2024-09-10T08:44:43.132421+0000","last_peered":"2024-09-10T08:44:43.132421+0000","last_clean":"2024-09-10T08:44:43.132421+0000","last_became_active":"2024-09-10T08:28:35.574249+0000","last_became_peered":"2024-09-10T08:28:35.574249+0000","last_unstale":"2024-09-10T08:44:43.132421+0000","last_undegraded":"2024-09-10T08:44:43.132421+0000","last_fullsized":"2024-09-10T08:44:43.132421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4484","last_scrub_stamp":"2024-09-10T08:44:43.132322+0000","last_deep_scrub":"27'4484","last_deep_scrub_stamp":"2024-09-10T08:44:43.132322+0000","last_clean_scrub_stamp":"2024-09-10T08:44:43.132322+0000","objects_scrubbed":0,"log_size":4484,"log_dups_size":0,"ondisk_log_size":4484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:20.060459+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23126,"num_write_kb":293453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"27'4466","reported_seq":4490,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:37.563833+0000","last_change":"2024-09-10T08:28:47.629525+0000","last_active":"2024-09-10T08:44:37.563833+0000","last_peered":"2024-09-10T08:44:37.563833+0000","last_clean":"2024-09-10T08:44:37.563833+0000","last_became_active":"2024-09-10T08:28:47.629259+0000","last_became_peered":"2024-09-10T08:28:47.629259+0000","last_unstale":"2024-09-10T08:44:37.563833+0000","last_undegraded":"2024-09-10T08:44:37.563833+0000","last_fullsized":"2024-09-10T08:44:37.563833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4466,"log_dups_size":0,"ondisk_log_size":4466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23096,"num_write_kb":301452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"27'4995","reported_seq":5035,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:51.908188+0000","last_change":"2024-09-10T08:44:51.908250+0000","last_active":"2024-09-10T08:44:51.908188+0000","last_peered":"2024-09-10T08:44:51.908188+0000","last_clean":"2024-09-10T08:44:51.908188+0000","last_became_active":"2024-09-10T08:28:35.572392+0000","last_became_peered":"2024-09-10T08:28:35.572392+0000","last_unstale":"2024-09-10T08:44:51.908188+0000","last_undegraded":"2024-09-10T08:44:51.908188+0000","last_fullsized":"2024-09-10T08:44:51.908188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4995","last_scrub_stamp":"2024-09-10T08:44:51.908071+0000","last_deep_scrub":"27'4995","last_deep_scrub_stamp":"2024-09-10T08:44:51.908071+0000","last_clean_scrub_stamp":"2024-09-10T08:44:51.908071+0000","objects_scrubbed":0,"log_size":4995,"log_dups_size":0,"ondisk_log_size":4995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:09.697838+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25177,"num_write_kb":305700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"27'4176","reported_seq":4200,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.357965+0000","last_change":"2024-09-10T08:28:47.623285+0000","last_active":"2024-09-10T08:44:29.357965+0000","last_peered":"2024-09-10T08:44:29.357965+0000","last_clean":"2024-09-10T08:44:29.357965+0000","last_became_active":"2024-09-10T08:28:47.621776+0000","last_became_peered":"2024-09-10T08:28:47.621776+0000","last_unstale":"2024-09-10T08:44:29.357965+0000","last_undegraded":"2024-09-10T08:44:29.357965+0000","last_fullsized":"2024-09-10T08:44:29.357965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21718,"num_write_kb":267375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'3678","reported_seq":3718,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:46.313613+0000","last_change":"2024-09-10T08:44:46.313613+0000","last_active":"2024-09-10T08:44:46.313613+0000","last_peered":"2024-09-10T08:44:46.313613+0000","last_clean":"2024-09-10T08:44:46.313613+0000","last_became_active":"2024-09-10T08:28:35.574175+0000","last_became_peered":"2024-09-10T08:28:35.574175+0000","last_unstale":"2024-09-10T08:44:46.313613+0000","last_undegraded":"2024-09-10T08:44:46.313613+0000","last_fullsized":"2024-09-10T08:44:46.313613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3678","last_scrub_stamp":"2024-09-10T08:44:46.313469+0000","last_deep_scrub":"27'3678","last_deep_scrub_stamp":"2024-09-10T08:44:46.313469+0000","last_clean_scrub_stamp":"2024-09-10T08:44:46.313469+0000","objects_scrubbed":0,"log_size":3678,"log_dups_size":0,"ondisk_log_size":3678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:33:42.883346+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18345,"num_write_kb":237300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"27'4228","reported_seq":4260,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:56.964369+0000","last_change":"2024-09-10T08:44:56.964394+0000","last_active":"2024-09-10T08:44:56.964369+0000","last_peered":"2024-09-10T08:44:56.964369+0000","last_clean":"2024-09-10T08:44:56.964369+0000","last_became_active":"2024-09-10T08:28:47.628806+0000","last_became_peered":"2024-09-10T08:28:47.628806+0000","last_unstale":"2024-09-10T08:44:56.964369+0000","last_undegraded":"2024-09-10T08:44:56.964369+0000","last_fullsized":"2024-09-10T08:44:56.964369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4228","last_scrub_stamp":"2024-09-10T08:44:56.964268+0000","last_deep_scrub":"27'4228","last_deep_scrub_stamp":"2024-09-10T08:44:56.964268+0000","last_clean_scrub_stamp":"2024-09-10T08:44:56.964268+0000","objects_scrubbed":0,"log_size":4228,"log_dups_size":0,"ondisk_log_size":4228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:23.960432+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21732,"num_write_kb":287874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"27'5344","reported_seq":5369,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:56.296694+0000","last_change":"2024-09-10T08:44:56.296717+0000","last_active":"2024-09-10T08:44:56.296694+0000","last_peered":"2024-09-10T08:44:56.296694+0000","last_clean":"2024-09-10T08:44:56.296694+0000","last_became_active":"2024-09-10T08:29:35.106806+0000","last_became_peered":"2024-09-10T08:29:35.106806+0000","last_unstale":"2024-09-10T08:44:56.296694+0000","last_undegraded":"2024-09-10T08:44:56.296694+0000","last_fullsized":"2024-09-10T08:44:56.296694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5344","last_scrub_stamp":"2024-09-10T08:44:56.296600+0000","last_deep_scrub":"27'5344","last_deep_scrub_stamp":"2024-09-10T08:44:56.296600+0000","last_clean_scrub_stamp":"2024-09-10T08:44:56.296600+0000","objects_scrubbed":0,"log_size":5344,"log_dups_size":0,"ondisk_log_size":5344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:11.893999+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27047,"num_write_kb":354198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"27'5319","reported_seq":5342,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.409578+0000","last_change":"2024-09-10T08:28:47.631797+0000","last_active":"2024-09-10T08:44:29.409578+0000","last_peered":"2024-09-10T08:44:29.409578+0000","last_clean":"2024-09-10T08:44:29.409578+0000","last_became_active":"2024-09-10T08:28:47.631523+0000","last_became_peered":"2024-09-10T08:28:47.631523+0000","last_unstale":"2024-09-10T08:44:29.409578+0000","last_undegraded":"2024-09-10T08:44:29.409578+0000","last_fullsized":"2024-09-10T08:44:29.409578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5319,"log_dups_size":0,"ondisk_log_size":5319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28163,"num_write_kb":342261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'4477","reported_seq":4509,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:40.906864+0000","last_change":"2024-09-10T08:28:35.570249+0000","last_active":"2024-09-10T08:44:40.906864+0000","last_peered":"2024-09-10T08:44:40.906864+0000","last_clean":"2024-09-10T08:44:40.906864+0000","last_became_active":"2024-09-10T08:28:35.569960+0000","last_became_peered":"2024-09-10T08:28:35.569960+0000","last_unstale":"2024-09-10T08:44:40.906864+0000","last_undegraded":"2024-09-10T08:44:40.906864+0000","last_fullsized":"2024-09-10T08:44:40.906864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4477,"log_dups_size":0,"ondisk_log_size":4477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23485,"num_write_kb":274341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"27'5295","reported_seq":5318,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.482480+0000","last_change":"2024-09-10T08:28:47.633644+0000","last_active":"2024-09-10T08:44:29.482480+0000","last_peered":"2024-09-10T08:44:29.482480+0000","last_clean":"2024-09-10T08:44:29.482480+0000","last_became_active":"2024-09-10T08:28:47.633315+0000","last_became_peered":"2024-09-10T08:28:47.633315+0000","last_unstale":"2024-09-10T08:44:29.482480+0000","last_undegraded":"2024-09-10T08:44:29.482480+0000","last_fullsized":"2024-09-10T08:44:29.482480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5295,"log_dups_size":0,"ondisk_log_size":5295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28671,"num_write_kb":360707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"27'4645","reported_seq":4685,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:54.182915+0000","last_change":"2024-09-10T08:44:54.182915+0000","last_active":"2024-09-10T08:44:54.182915+0000","last_peered":"2024-09-10T08:44:54.182915+0000","last_clean":"2024-09-10T08:44:54.182915+0000","last_became_active":"2024-09-10T08:28:35.560409+0000","last_became_peered":"2024-09-10T08:28:35.560409+0000","last_unstale":"2024-09-10T08:44:54.182915+0000","last_undegraded":"2024-09-10T08:44:54.182915+0000","last_fullsized":"2024-09-10T08:44:54.182915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4645","last_scrub_stamp":"2024-09-10T08:44:54.182783+0000","last_deep_scrub":"27'4645","last_deep_scrub_stamp":"2024-09-10T08:44:54.182783+0000","last_clean_scrub_stamp":"2024-09-10T08:44:54.182783+0000","objects_scrubbed":0,"log_size":4645,"log_dups_size":0,"ondisk_log_size":4645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:16.361829+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23495,"num_write_kb":303194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"27'3828","reported_seq":3859,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:50.044322+0000","last_change":"2024-09-10T08:44:50.044346+0000","last_active":"2024-09-10T08:44:50.044322+0000","last_peered":"2024-09-10T08:44:50.044322+0000","last_clean":"2024-09-10T08:44:50.044322+0000","last_became_active":"2024-09-10T08:28:47.622205+0000","last_became_peered":"2024-09-10T08:28:47.622205+0000","last_unstale":"2024-09-10T08:44:50.044322+0000","last_undegraded":"2024-09-10T08:44:50.044322+0000","last_fullsized":"2024-09-10T08:44:50.044322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3828","last_scrub_stamp":"2024-09-10T08:44:50.044229+0000","last_deep_scrub":"27'3828","last_deep_scrub_stamp":"2024-09-10T08:44:50.044229+0000","last_clean_scrub_stamp":"2024-09-10T08:44:50.044229+0000","objects_scrubbed":0,"log_size":3828,"log_dups_size":0,"ondisk_log_size":3828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:51.908797+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19475,"num_write_kb":250147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'5239","reported_seq":5279,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:46.949250+0000","last_change":"2024-09-10T08:44:46.949250+0000","last_active":"2024-09-10T08:44:46.949250+0000","last_peered":"2024-09-10T08:44:46.949250+0000","last_clean":"2024-09-10T08:44:46.949250+0000","last_became_active":"2024-09-10T08:28:35.574256+0000","last_became_peered":"2024-09-10T08:28:35.574256+0000","last_unstale":"2024-09-10T08:44:46.949250+0000","last_undegraded":"2024-09-10T08:44:46.949250+0000","last_fullsized":"2024-09-10T08:44:46.949250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5239","last_scrub_stamp":"2024-09-10T08:44:46.949125+0000","last_deep_scrub":"27'5239","last_deep_scrub_stamp":"2024-09-10T08:44:46.949125+0000","last_clean_scrub_stamp":"2024-09-10T08:44:46.949125+0000","objects_scrubbed":0,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:10.417229+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27760,"num_write_kb":320273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"27'4221","reported_seq":4244,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.397964+0000","last_change":"2024-09-10T08:28:47.633476+0000","last_active":"2024-09-10T08:44:29.397964+0000","last_peered":"2024-09-10T08:44:29.397964+0000","last_clean":"2024-09-10T08:44:29.397964+0000","last_became_active":"2024-09-10T08:28:47.633189+0000","last_became_peered":"2024-09-10T08:28:47.633189+0000","last_unstale":"2024-09-10T08:44:29.397964+0000","last_undegraded":"2024-09-10T08:44:29.397964+0000","last_fullsized":"2024-09-10T08:44:29.397964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4221,"log_dups_size":0,"ondisk_log_size":4221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21808,"num_write_kb":284043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"27'4276","reported_seq":4307,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.491559+0000","last_change":"2024-09-10T08:28:35.573330+0000","last_active":"2024-09-10T08:44:22.491559+0000","last_peered":"2024-09-10T08:44:22.491559+0000","last_clean":"2024-09-10T08:44:22.491559+0000","last_became_active":"2024-09-10T08:28:35.572992+0000","last_became_peered":"2024-09-10T08:28:35.572992+0000","last_unstale":"2024-09-10T08:44:22.491559+0000","last_undegraded":"2024-09-10T08:44:22.491559+0000","last_fullsized":"2024-09-10T08:44:22.491559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4276,"log_dups_size":0,"ondisk_log_size":4276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22251,"num_write_kb":273423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"27'4525","reported_seq":4548,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.373824+0000","last_change":"2024-09-10T08:28:47.630733+0000","last_active":"2024-09-10T08:44:29.373824+0000","last_peered":"2024-09-10T08:44:29.373824+0000","last_clean":"2024-09-10T08:44:29.373824+0000","last_became_active":"2024-09-10T08:28:47.630447+0000","last_became_peered":"2024-09-10T08:28:47.630447+0000","last_unstale":"2024-09-10T08:44:29.373824+0000","last_undegraded":"2024-09-10T08:44:29.373824+0000","last_fullsized":"2024-09-10T08:44:29.373824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4525,"log_dups_size":0,"ondisk_log_size":4525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23690,"num_write_kb":303969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'4030","reported_seq":4069,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:49.477049+0000","last_change":"2024-09-10T08:44:49.477091+0000","last_active":"2024-09-10T08:44:49.477049+0000","last_peered":"2024-09-10T08:44:49.477049+0000","last_clean":"2024-09-10T08:44:49.477049+0000","last_became_active":"2024-09-10T08:28:35.566205+0000","last_became_peered":"2024-09-10T08:28:35.566205+0000","last_unstale":"2024-09-10T08:44:49.477049+0000","last_undegraded":"2024-09-10T08:44:49.477049+0000","last_fullsized":"2024-09-10T08:44:49.477049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4030","last_scrub_stamp":"2024-09-10T08:44:49.476934+0000","last_deep_scrub":"27'4030","last_deep_scrub_stamp":"2024-09-10T08:44:49.476934+0000","last_clean_scrub_stamp":"2024-09-10T08:44:49.476934+0000","objects_scrubbed":0,"log_size":4030,"log_dups_size":0,"ondisk_log_size":4030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:05.294555+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20014,"num_write_kb":252379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"27'4167","reported_seq":4198,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:53.307210+0000","last_change":"2024-09-10T08:44:53.307238+0000","last_active":"2024-09-10T08:44:53.307210+0000","last_peered":"2024-09-10T08:44:53.307210+0000","last_clean":"2024-09-10T08:44:53.307210+0000","last_became_active":"2024-09-10T08:28:47.627747+0000","last_became_peered":"2024-09-10T08:28:47.627747+0000","last_unstale":"2024-09-10T08:44:53.307210+0000","last_undegraded":"2024-09-10T08:44:53.307210+0000","last_fullsized":"2024-09-10T08:44:53.307210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4167","last_scrub_stamp":"2024-09-10T08:44:53.307107+0000","last_deep_scrub":"27'4167","last_deep_scrub_stamp":"2024-09-10T08:44:53.307107+0000","last_clean_scrub_stamp":"2024-09-10T08:44:53.307107+0000","objects_scrubbed":0,"log_size":4167,"log_dups_size":0,"ondisk_log_size":4167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:45.390276+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22015,"num_write_kb":272523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"27'4068","reported_seq":4107,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:51.159917+0000","last_change":"2024-09-10T08:44:51.159944+0000","last_active":"2024-09-10T08:44:51.159917+0000","last_peered":"2024-09-10T08:44:51.159917+0000","last_clean":"2024-09-10T08:44:51.159917+0000","last_became_active":"2024-09-10T08:28:35.564747+0000","last_became_peered":"2024-09-10T08:28:35.564747+0000","last_unstale":"2024-09-10T08:44:51.159917+0000","last_undegraded":"2024-09-10T08:44:51.159917+0000","last_fullsized":"2024-09-10T08:44:51.159917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4068","last_scrub_stamp":"2024-09-10T08:44:51.159807+0000","last_deep_scrub":"27'4068","last_deep_scrub_stamp":"2024-09-10T08:44:51.159807+0000","last_clean_scrub_stamp":"2024-09-10T08:44:51.159807+0000","objects_scrubbed":0,"log_size":4068,"log_dups_size":0,"ondisk_log_size":4068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:19.326740+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20848,"num_write_kb":280067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"27'3614","reported_seq":3637,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.482794+0000","last_change":"2024-09-10T08:28:47.631047+0000","last_active":"2024-09-10T08:44:29.482794+0000","last_peered":"2024-09-10T08:44:29.482794+0000","last_clean":"2024-09-10T08:44:29.482794+0000","last_became_active":"2024-09-10T08:28:47.630617+0000","last_became_peered":"2024-09-10T08:28:47.630617+0000","last_unstale":"2024-09-10T08:44:29.482794+0000","last_undegraded":"2024-09-10T08:44:29.482794+0000","last_fullsized":"2024-09-10T08:44:29.482794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3614,"log_dups_size":0,"ondisk_log_size":3614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19300,"num_write_kb":257617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'4938","reported_seq":4977,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:52.129334+0000","last_change":"2024-09-10T08:44:52.129360+0000","last_active":"2024-09-10T08:44:52.129334+0000","last_peered":"2024-09-10T08:44:52.129334+0000","last_clean":"2024-09-10T08:44:52.129334+0000","last_became_active":"2024-09-10T08:28:35.570351+0000","last_became_peered":"2024-09-10T08:28:35.570351+0000","last_unstale":"2024-09-10T08:44:52.129334+0000","last_undegraded":"2024-09-10T08:44:52.129334+0000","last_fullsized":"2024-09-10T08:44:52.129334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4938","last_scrub_stamp":"2024-09-10T08:44:52.129233+0000","last_deep_scrub":"27'4938","last_deep_scrub_stamp":"2024-09-10T08:44:52.129233+0000","last_clean_scrub_stamp":"2024-09-10T08:44:52.129233+0000","objects_scrubbed":0,"log_size":4938,"log_dups_size":0,"ondisk_log_size":4938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:15:46.777558+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26047,"num_write_kb":333713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"27'4403","reported_seq":4426,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.449261+0000","last_change":"2024-09-10T08:28:47.626191+0000","last_active":"2024-09-10T08:44:29.449261+0000","last_peered":"2024-09-10T08:44:29.449261+0000","last_clean":"2024-09-10T08:44:29.449261+0000","last_became_active":"2024-09-10T08:28:47.625781+0000","last_became_peered":"2024-09-10T08:28:47.625781+0000","last_unstale":"2024-09-10T08:44:29.449261+0000","last_undegraded":"2024-09-10T08:44:29.449261+0000","last_fullsized":"2024-09-10T08:44:29.449261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4403,"log_dups_size":0,"ondisk_log_size":4403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22837,"num_write_kb":300422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"27'5731","reported_seq":5770,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:43.929410+0000","last_change":"2024-09-10T08:44:43.929437+0000","last_active":"2024-09-10T08:44:43.929410+0000","last_peered":"2024-09-10T08:44:43.929410+0000","last_clean":"2024-09-10T08:44:43.929410+0000","last_became_active":"2024-09-10T08:28:35.576191+0000","last_became_peered":"2024-09-10T08:28:35.576191+0000","last_unstale":"2024-09-10T08:44:43.929410+0000","last_undegraded":"2024-09-10T08:44:43.929410+0000","last_fullsized":"2024-09-10T08:44:43.929410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5731","last_scrub_stamp":"2024-09-10T08:44:43.929301+0000","last_deep_scrub":"27'5731","last_deep_scrub_stamp":"2024-09-10T08:44:43.929301+0000","last_clean_scrub_stamp":"2024-09-10T08:44:43.929301+0000","objects_scrubbed":0,"log_size":5731,"log_dups_size":0,"ondisk_log_size":5731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:51.527656+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30251,"num_write_kb":366959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"27'5875","reported_seq":5899,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.431407+0000","last_change":"2024-09-10T08:28:47.623129+0000","last_active":"2024-09-10T08:44:29.431407+0000","last_peered":"2024-09-10T08:44:29.431407+0000","last_clean":"2024-09-10T08:44:29.431407+0000","last_became_active":"2024-09-10T08:28:47.622851+0000","last_became_peered":"2024-09-10T08:28:47.622851+0000","last_unstale":"2024-09-10T08:44:29.431407+0000","last_undegraded":"2024-09-10T08:44:29.431407+0000","last_fullsized":"2024-09-10T08:44:29.431407+0000","mapping_epoch":23,"log_start":"27'700","ondisk_log_start":"27'700","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":5175,"log_dups_size":0,"ondisk_log_size":5175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31498,"num_write_kb":384432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"27'4833","reported_seq":4872,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:51.667144+0000","last_change":"2024-09-10T08:44:51.667172+0000","last_active":"2024-09-10T08:44:51.667144+0000","last_peered":"2024-09-10T08:44:51.667144+0000","last_clean":"2024-09-10T08:44:51.667144+0000","last_became_active":"2024-09-10T08:28:35.575052+0000","last_became_peered":"2024-09-10T08:28:35.575052+0000","last_unstale":"2024-09-10T08:44:51.667144+0000","last_undegraded":"2024-09-10T08:44:51.667144+0000","last_fullsized":"2024-09-10T08:44:51.667144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4833","last_scrub_stamp":"2024-09-10T08:44:51.667034+0000","last_deep_scrub":"27'4833","last_deep_scrub_stamp":"2024-09-10T08:44:51.667034+0000","last_clean_scrub_stamp":"2024-09-10T08:44:51.667034+0000","objects_scrubbed":0,"log_size":4833,"log_dups_size":0,"ondisk_log_size":4833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:21.326318+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24290,"num_write_kb":318500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"27'3897","reported_seq":3921,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.448191+0000","last_change":"2024-09-10T08:28:47.628651+0000","last_active":"2024-09-10T08:44:29.448191+0000","last_peered":"2024-09-10T08:44:29.448191+0000","last_clean":"2024-09-10T08:44:29.448191+0000","last_became_active":"2024-09-10T08:28:47.628343+0000","last_became_peered":"2024-09-10T08:28:47.628343+0000","last_unstale":"2024-09-10T08:44:29.448191+0000","last_undegraded":"2024-09-10T08:44:29.448191+0000","last_fullsized":"2024-09-10T08:44:29.448191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":3897,"log_dups_size":0,"ondisk_log_size":3897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20646,"num_write_kb":258901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"27'4919","reported_seq":4958,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:44.941138+0000","last_change":"2024-09-10T08:44:44.941177+0000","last_active":"2024-09-10T08:44:44.941138+0000","last_peered":"2024-09-10T08:44:44.941138+0000","last_clean":"2024-09-10T08:44:44.941138+0000","last_became_active":"2024-09-10T08:28:35.578384+0000","last_became_peered":"2024-09-10T08:28:35.578384+0000","last_unstale":"2024-09-10T08:44:44.941138+0000","last_undegraded":"2024-09-10T08:44:44.941138+0000","last_fullsized":"2024-09-10T08:44:44.941138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4919","last_scrub_stamp":"2024-09-10T08:44:44.941028+0000","last_deep_scrub":"27'4919","last_deep_scrub_stamp":"2024-09-10T08:44:44.941028+0000","last_clean_scrub_stamp":"2024-09-10T08:44:44.941028+0000","objects_scrubbed":0,"log_size":4919,"log_dups_size":0,"ondisk_log_size":4919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:29.151875+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25865,"num_write_kb":300415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"27'4164","reported_seq":4189,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:39.189174+0000","last_change":"2024-09-10T08:28:47.627593+0000","last_active":"2024-09-10T08:44:39.189174+0000","last_peered":"2024-09-10T08:44:39.189174+0000","last_clean":"2024-09-10T08:44:39.189174+0000","last_became_active":"2024-09-10T08:28:47.627237+0000","last_became_peered":"2024-09-10T08:28:47.627237+0000","last_unstale":"2024-09-10T08:44:39.189174+0000","last_undegraded":"2024-09-10T08:44:39.189174+0000","last_fullsized":"2024-09-10T08:44:39.189174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4164,"log_dups_size":0,"ondisk_log_size":4164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22780,"num_write_kb":275817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'3973","reported_seq":4012,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:42.142964+0000","last_change":"2024-09-10T08:44:42.142989+0000","last_active":"2024-09-10T08:44:42.142964+0000","last_peered":"2024-09-10T08:44:42.142964+0000","last_clean":"2024-09-10T08:44:42.142964+0000","last_became_active":"2024-09-10T08:28:35.578475+0000","last_became_peered":"2024-09-10T08:28:35.578475+0000","last_unstale":"2024-09-10T08:44:42.142964+0000","last_undegraded":"2024-09-10T08:44:42.142964+0000","last_fullsized":"2024-09-10T08:44:42.142964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3973","last_scrub_stamp":"2024-09-10T08:44:42.142864+0000","last_deep_scrub":"27'3973","last_deep_scrub_stamp":"2024-09-10T08:44:42.142864+0000","last_clean_scrub_stamp":"2024-09-10T08:44:42.142864+0000","objects_scrubbed":0,"log_size":3973,"log_dups_size":0,"ondisk_log_size":3973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:28.837978+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20258,"num_write_kb":257321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"27'4520","reported_seq":4544,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.427524+0000","last_change":"2024-09-10T08:28:47.634072+0000","last_active":"2024-09-10T08:44:29.427524+0000","last_peered":"2024-09-10T08:44:29.427524+0000","last_clean":"2024-09-10T08:44:29.427524+0000","last_became_active":"2024-09-10T08:28:47.633776+0000","last_became_peered":"2024-09-10T08:28:47.633776+0000","last_unstale":"2024-09-10T08:44:29.427524+0000","last_undegraded":"2024-09-10T08:44:29.427524+0000","last_fullsized":"2024-09-10T08:44:29.427524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4520,"log_dups_size":0,"ondisk_log_size":4520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23464,"num_write_kb":303031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'5689","reported_seq":5728,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:53.950356+0000","last_change":"2024-09-10T08:44:53.950385+0000","last_active":"2024-09-10T08:44:53.950356+0000","last_peered":"2024-09-10T08:44:53.950356+0000","last_clean":"2024-09-10T08:44:53.950356+0000","last_became_active":"2024-09-10T08:28:35.571803+0000","last_became_peered":"2024-09-10T08:28:35.571803+0000","last_unstale":"2024-09-10T08:44:53.950356+0000","last_undegraded":"2024-09-10T08:44:53.950356+0000","last_fullsized":"2024-09-10T08:44:53.950356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5689","last_scrub_stamp":"2024-09-10T08:44:53.950255+0000","last_deep_scrub":"27'5689","last_deep_scrub_stamp":"2024-09-10T08:44:53.950255+0000","last_clean_scrub_stamp":"2024-09-10T08:44:53.950255+0000","objects_scrubbed":0,"log_size":5689,"log_dups_size":0,"ondisk_log_size":5689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:27.010173+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28713,"num_write_kb":356779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"27'3638","reported_seq":3669,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:52.640770+0000","last_change":"2024-09-10T08:44:52.640797+0000","last_active":"2024-09-10T08:44:52.640770+0000","last_peered":"2024-09-10T08:44:52.640770+0000","last_clean":"2024-09-10T08:44:52.640770+0000","last_became_active":"2024-09-10T08:28:47.620220+0000","last_became_peered":"2024-09-10T08:28:47.620220+0000","last_unstale":"2024-09-10T08:44:52.640770+0000","last_undegraded":"2024-09-10T08:44:52.640770+0000","last_fullsized":"2024-09-10T08:44:52.640770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3638","last_scrub_stamp":"2024-09-10T08:44:52.640678+0000","last_deep_scrub":"27'3638","last_deep_scrub_stamp":"2024-09-10T08:44:52.640678+0000","last_clean_scrub_stamp":"2024-09-10T08:44:52.640678+0000","objects_scrubbed":0,"log_size":3638,"log_dups_size":0,"ondisk_log_size":3638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:18.286011+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18717,"num_write_kb":251073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"27'4254","reported_seq":4295,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:41.119606+0000","last_change":"2024-09-10T08:44:41.119632+0000","last_active":"2024-09-10T08:44:41.119606+0000","last_peered":"2024-09-10T08:44:41.119606+0000","last_clean":"2024-09-10T08:44:41.119606+0000","last_became_active":"2024-09-10T08:28:35.578680+0000","last_became_peered":"2024-09-10T08:28:35.578680+0000","last_unstale":"2024-09-10T08:44:41.119606+0000","last_undegraded":"2024-09-10T08:44:41.119606+0000","last_fullsized":"2024-09-10T08:44:41.119606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4254","last_scrub_stamp":"2024-09-10T08:44:41.119501+0000","last_deep_scrub":"27'4254","last_deep_scrub_stamp":"2024-09-10T08:44:41.119501+0000","last_clean_scrub_stamp":"2024-09-10T08:44:41.119501+0000","objects_scrubbed":0,"log_size":4254,"log_dups_size":0,"ondisk_log_size":4254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:51.667576+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22529,"num_write_kb":274609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"27'5728","reported_seq":5759,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:51.283581+0000","last_change":"2024-09-10T08:44:51.283606+0000","last_active":"2024-09-10T08:44:51.283581+0000","last_peered":"2024-09-10T08:44:51.283581+0000","last_clean":"2024-09-10T08:44:51.283581+0000","last_became_active":"2024-09-10T08:28:47.624585+0000","last_became_peered":"2024-09-10T08:28:47.624585+0000","last_unstale":"2024-09-10T08:44:51.283581+0000","last_undegraded":"2024-09-10T08:44:51.283581+0000","last_fullsized":"2024-09-10T08:44:51.283581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5728","last_scrub_stamp":"2024-09-10T08:44:51.283484+0000","last_deep_scrub":"27'5728","last_deep_scrub_stamp":"2024-09-10T08:44:51.283484+0000","last_clean_scrub_stamp":"2024-09-10T08:44:51.283484+0000","objects_scrubbed":0,"log_size":5728,"log_dups_size":0,"ondisk_log_size":5728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:56.641875+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28703,"num_write_kb":356727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'4780","reported_seq":4820,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:45.916642+0000","last_change":"2024-09-10T08:44:45.916669+0000","last_active":"2024-09-10T08:44:45.916642+0000","last_peered":"2024-09-10T08:44:45.916642+0000","last_clean":"2024-09-10T08:44:45.916642+0000","last_became_active":"2024-09-10T08:28:35.573646+0000","last_became_peered":"2024-09-10T08:28:35.573646+0000","last_unstale":"2024-09-10T08:44:45.916642+0000","last_undegraded":"2024-09-10T08:44:45.916642+0000","last_fullsized":"2024-09-10T08:44:45.916642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4780","last_scrub_stamp":"2024-09-10T08:44:45.916540+0000","last_deep_scrub":"27'4780","last_deep_scrub_stamp":"2024-09-10T08:44:45.916540+0000","last_clean_scrub_stamp":"2024-09-10T08:44:45.916540+0000","objects_scrubbed":0,"log_size":4780,"log_dups_size":0,"ondisk_log_size":4780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:21.431528+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24418,"num_write_kb":306743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"27'4700","reported_seq":4723,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:29.479630+0000","last_change":"2024-09-10T08:28:47.631802+0000","last_active":"2024-09-10T08:44:29.479630+0000","last_peered":"2024-09-10T08:44:29.479630+0000","last_clean":"2024-09-10T08:44:29.479630+0000","last_became_active":"2024-09-10T08:28:47.631456+0000","last_became_peered":"2024-09-10T08:28:47.631456+0000","last_unstale":"2024-09-10T08:44:29.479630+0000","last_undegraded":"2024-09-10T08:44:29.479630+0000","last_fullsized":"2024-09-10T08:44:29.479630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:46.598195+0000","last_clean_scrub_stamp":"2024-09-10T08:28:46.598195+0000","objects_scrubbed":0,"log_size":4700,"log_dups_size":0,"ondisk_log_size":4700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23620,"num_write_kb":315928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'5816","reported_seq":5856,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:41.289019+0000","last_change":"2024-09-10T08:44:41.289041+0000","last_active":"2024-09-10T08:44:41.289019+0000","last_peered":"2024-09-10T08:44:41.289019+0000","last_clean":"2024-09-10T08:44:41.289019+0000","last_became_active":"2024-09-10T08:28:35.577852+0000","last_became_peered":"2024-09-10T08:28:35.577852+0000","last_unstale":"2024-09-10T08:44:41.289019+0000","last_undegraded":"2024-09-10T08:44:41.289019+0000","last_fullsized":"2024-09-10T08:44:41.289019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5816","last_scrub_stamp":"2024-09-10T08:44:41.288940+0000","last_deep_scrub":"27'5816","last_deep_scrub_stamp":"2024-09-10T08:44:41.288940+0000","last_clean_scrub_stamp":"2024-09-10T08:44:41.288940+0000","objects_scrubbed":0,"log_size":5816,"log_dups_size":0,"ondisk_log_size":5816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:41.317937+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30528,"num_write_kb":380548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"27'4272","reported_seq":4303,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:50.909454+0000","last_change":"2024-09-10T08:44:50.909482+0000","last_active":"2024-09-10T08:44:50.909454+0000","last_peered":"2024-09-10T08:44:50.909454+0000","last_clean":"2024-09-10T08:44:50.909454+0000","last_became_active":"2024-09-10T08:28:47.629713+0000","last_became_peered":"2024-09-10T08:28:47.629713+0000","last_unstale":"2024-09-10T08:44:50.909454+0000","last_undegraded":"2024-09-10T08:44:50.909454+0000","last_fullsized":"2024-09-10T08:44:50.909454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4272","last_scrub_stamp":"2024-09-10T08:44:50.909347+0000","last_deep_scrub":"27'4272","last_deep_scrub_stamp":"2024-09-10T08:44:50.909347+0000","last_clean_scrub_stamp":"2024-09-10T08:44:50.909347+0000","objects_scrubbed":0,"log_size":4272,"log_dups_size":0,"ondisk_log_size":4272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:24.975104+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22513,"num_write_kb":287067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"27'4101","reported_seq":4133,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:22.562274+0000","last_change":"2024-09-10T08:28:35.571065+0000","last_active":"2024-09-10T08:44:22.562274+0000","last_peered":"2024-09-10T08:44:22.562274+0000","last_clean":"2024-09-10T08:44:22.562274+0000","last_became_active":"2024-09-10T08:28:35.570749+0000","last_became_peered":"2024-09-10T08:28:35.570749+0000","last_unstale":"2024-09-10T08:44:22.562274+0000","last_undegraded":"2024-09-10T08:44:22.562274+0000","last_fullsized":"2024-09-10T08:44:22.562274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:34.539900+0000","last_clean_scrub_stamp":"2024-09-10T08:28:34.539900+0000","objects_scrubbed":0,"log_size":4101,"log_dups_size":0,"ondisk_log_size":4101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21304,"num_write_kb":261525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1506886,"num_write_kb":19151846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":286269,"ondisk_log_size":286269,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":17622670,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":51,"num_read_kb":121,"num_write":4293,"num_write_kb":18856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":35307520,"data_stored":35245340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3559,"ondisk_log_size":3559,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1565097,"num_write_kb":19381290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":301805,"ondisk_log_size":301805,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":17928438,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":58,"num_read_kb":129,"num_write":4368,"num_write_kb":19205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":35921920,"data_stored":35856876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3648,"ondisk_log_size":3648,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509642,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1140720,"kb_used_data":13152,"kb_used_omap":1,"kb_used_meta":1127550,"kb_avail":93231120,"statfs":{"total":96636764160,"available":95468666880,"internally_reserved":0,"allocated":13467648,"data_stored":13288824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1154611659},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509641,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1037512,"kb_used_data":4472,"kb_used_omap":1,"kb_used_meta":1033022,"kb_avail":93334328,"statfs":{"total":96636764160,"available":95574351872,"internally_reserved":0,"allocated":4579328,"data_stored":4398018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1057814981},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509643,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1082628,"kb_used_data":10356,"kb_used_omap":1,"kb_used_meta":1072254,"kb_avail":93289212,"statfs":{"total":96636764160,"available":95528153088,"internally_reserved":0,"allocated":10604544,"data_stored":10409366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1097988549},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509644,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1135220,"kb_used_data":17508,"kb_used_omap":1,"kb_used_meta":1117694,"kb_avail":93236620,"statfs":{"total":96636764160,"available":95474298880,"internally_reserved":0,"allocated":17928192,"data_stored":17737438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1144519111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509643,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":892856,"kb_used_data":8488,"kb_used_omap":1,"kb_used_meta":884350,"kb_avail":93478984,"statfs":{"total":96636764160,"available":95722479616,"internally_reserved":0,"allocated":8691712,"data_stored":8504334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":905574853},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509643,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":911348,"kb_used_data":9060,"kb_used_omap":1,"kb_used_meta":902270,"kb_avail":93460492,"statfs":{"total":96636764160,"available":95703543808,"internally_reserved":0,"allocated":9277440,"data_stored":9094486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":923924933},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575049,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":775044,"kb_used_data":9524,"kb_used_omap":1,"kb_used_meta":765502,"kb_avail":93596796,"statfs":{"total":96636764160,"available":95843119104,"internally_reserved":0,"allocated":9752576,"data_stored":9566440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":783874503},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575052,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":725760,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":725374,"kb_avail":93646080,"statfs":{"total":96636764160,"available":95893585920,"internally_reserved":0,"allocated":376832,"data_stored":203022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":742783430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":88080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8477360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5271552,"data_stored":5256102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5267456,"data_stored":5256648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9158656,"data_stored":9145206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5050368,"data_stored":5038392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4292608,"data_stored":4283056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:45:02.463 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.464 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.464 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.464 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.464 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.464 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.464 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.465 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.465 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.465 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.465 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.465 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.465 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-10T08:28:33.538281+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.466 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.466 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.466 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.466 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.466 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.466 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.467 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.467 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.467 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.467 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.467 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.468 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.468 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.468 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.468 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.468 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.468 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.469 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.469 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.469 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.469 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.469 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.469 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.469 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.469 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.470 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.470 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.470 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.470 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.470 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.470 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.470 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.471 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.471 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.471 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.471 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-09-10T08:28:46.598195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=46, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.471 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-10T08:28:34.539900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=28, tm_sec=34, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=44, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:45:02.471 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T08:45:05.147 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:45:05.150 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:45:22.472 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:45:22.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.585+0000 7fe5a73d8640 1 Processor -- start 2024-09-10T08:45:22.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.585+0000 7fe5a73d8640 1 -- start start 2024-09-10T08:45:22.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.586+0000 7fe5a73d8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5a00a6c10 0x7fe5a00c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:22.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.586+0000 7fe5a73d8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe5a00c5940 0x7fe5a006e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:22.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.586+0000 7fe5a73d8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5a015a970 con 0x7fe5a00c6010 2024-09-10T08:45:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.586+0000 7fe5a73d8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fe5a015ac50 con 0x7fe5a00c5940 2024-09-10T08:45:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.586+0000 7fe5a73d8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe5a015af30 con 0x7fe5a00a6c10 2024-09-10T08:45:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.586+0000 7fe5a5975640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe5a00c5940 0x7fe5a006e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.586+0000 7fe5a5975640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe5a00c5940 0x7fe5a006e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41754/0 (socket says 172.21.15.103:41754) 2024-09-10T08:45:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.586+0000 7fe5a5975640 1 -- 172.21.15.103:0/1737287120 learned_addr learned my addr 172.21.15.103:0/1737287120 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:45:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.586+0000 7fe5a5174640 1 --2- 172.21.15.103:0/1737287120 >> v2:172.21.15.154:3300/0 conn(0x7fe5a00a6c10 0x7fe5a00c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.586+0000 7fe5a5975640 1 -- 172.21.15.103:0/1737287120 >> v2:172.21.15.154:3300/0 conn(0x7fe5a00a6c10 msgr2=0x7fe5a00c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.586+0000 7fe5a5975640 1 --2- 172.21.15.103:0/1737287120 >> v2:172.21.15.154:3300/0 conn(0x7fe5a00a6c10 0x7fe5a00c2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.586+0000 7fe5a5975640 1 -- 172.21.15.103:0/1737287120 >> v1:172.21.15.154:6789/0 conn(0x7fe5a00c6010 legacy=0x7fe5a006dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:22.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.586+0000 7fe5a5975640 1 -- 172.21.15.103:0/1737287120 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a015b210 con 0x7fe5a00c5940 2024-09-10T08:45:22.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.587+0000 7fe5a5975640 1 --2- 172.21.15.103:0/1737287120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a00c5940 0x7fe5a006e1c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00c5510 tx=0x7fe59802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf18a52039db4d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:22.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.587+0000 7fe597fff640 1 -- 172.21.15.103:0/1737287120 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe598036070 con 0x7fe5a00c5940 2024-09-10T08:45:22.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.587+0000 7fe597fff640 1 -- 172.21.15.103:0/1737287120 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe598031600 con 0x7fe5a00c5940 2024-09-10T08:45:22.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.587+0000 7fe597fff640 1 -- 172.21.15.103:0/1737287120 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5980319d0 con 0x7fe5a00c5940 2024-09-10T08:45:22.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.588+0000 7fe5a73d8640 1 -- 172.21.15.103:0/1737287120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a00c5940 msgr2=0x7fe5a006e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:22.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.588+0000 7fe5a73d8640 1 --2- 172.21.15.103:0/1737287120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a00c5940 0x7fe5a006e1c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00c5510 tx=0x7fe59802a660 comp rx=0 tx=0).stop 2024-09-10T08:45:22.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.588+0000 7fe5a73d8640 1 -- 172.21.15.103:0/1737287120 shutdown_connections 2024-09-10T08:45:22.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.588+0000 7fe5a73d8640 1 --2- 172.21.15.103:0/1737287120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a00c5940 0x7fe5a006e1c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:22.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.588+0000 7fe5a73d8640 1 --2- 172.21.15.103:0/1737287120 >> v2:172.21.15.154:3300/0 conn(0x7fe5a00a6c10 0x7fe5a00c2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:22.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.588+0000 7fe5a73d8640 1 -- 172.21.15.103:0/1737287120 >> 172.21.15.103:0/1737287120 conn(0x7fe5a00c7a40 msgr2=0x7fe5a00c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:22.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.588+0000 7fe5a73d8640 1 -- 172.21.15.103:0/1737287120 shutdown_connections 2024-09-10T08:45:22.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.588+0000 7fe5a73d8640 1 -- 172.21.15.103:0/1737287120 wait complete. 2024-09-10T08:45:22.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.589+0000 7fe5a73d8640 1 Processor -- start 2024-09-10T08:45:22.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.589+0000 7fe5a73d8640 1 -- start start 2024-09-10T08:45:22.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.590+0000 7fe5a73d8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a00a6c10 0x7fe5a01e7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:22.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.590+0000 7fe5a73d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5a00c5940 0x7fe5a014d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:22.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.590+0000 7fe5a73d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5a00c6010 0x7fe5a014d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:22.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.590+0000 7fe5a73d8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a00a73a0 con 0x7fe5a00a6c10 2024-09-10T08:45:22.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.590+0000 7fe5a73d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a015a620 con 0x7fe5a00c6010 2024-09-10T08:45:22.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.590+0000 7fe5a73d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe5a00a7520 con 0x7fe5a00c5940 2024-09-10T08:45:22.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.590+0000 7fe5a5174640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a00a6c10 0x7fe5a01e7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:22.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.590+0000 7fe5a5174640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a00a6c10 0x7fe5a01e7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41758/0 (socket says 172.21.15.103:41758) 2024-09-10T08:45:22.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.590+0000 7fe5a5174640 1 -- 172.21.15.103:0/1639913220 learned_addr learned my addr 172.21.15.103:0/1639913220 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:45:22.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.590+0000 7fe5a5174640 1 -- 172.21.15.103:0/1639913220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5a00c5940 msgr2=0x7fe5a014d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:22.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.590+0000 7fe5a5174640 1 --2- 172.21.15.103:0/1639913220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5a00c5940 0x7fe5a014d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:22.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.590+0000 7fe5a5174640 1 -- 172.21.15.103:0/1639913220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5a00c6010 msgr2=0x7fe5a014d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:22.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.590+0000 7fe5a5975640 1 --2- 172.21.15.103:0/1639913220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5a00c6010 0x7fe5a014d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.590+0000 7fe5a5174640 1 --2- 172.21.15.103:0/1639913220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5a00c6010 0x7fe5a014d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.590+0000 7fe5a5174640 1 -- 172.21.15.103:0/1639913220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a01e3c80 con 0x7fe5a00a6c10 2024-09-10T08:45:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.590+0000 7fe5a5975640 1 --2- 172.21.15.103:0/1639913220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5a00c6010 0x7fe5a014d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:45:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.590+0000 7fe5a5174640 1 --2- 172.21.15.103:0/1639913220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a00a6c10 0x7fe5a01e7380 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00c7f0 tx=0x7fe59c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.591+0000 7fe595ffb640 1 -- 172.21.15.103:0/1639913220 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c015070 con 0x7fe5a00a6c10 2024-09-10T08:45:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.591+0000 7fe595ffb640 1 -- 172.21.15.103:0/1639913220 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe59c004240 con 0x7fe5a00a6c10 2024-09-10T08:45:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.591+0000 7fe595ffb640 1 -- 172.21.15.103:0/1639913220 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c007620 con 0x7fe5a00a6c10 2024-09-10T08:45:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.591+0000 7fe5a73d8640 1 -- 172.21.15.103:0/1639913220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5a014e870 con 0x7fe5a00a6c10 2024-09-10T08:45:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.591+0000 7fe5a73d8640 1 -- 172.21.15.103:0/1639913220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5a01e3f20 con 0x7fe5a00a6c10 2024-09-10T08:45:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.592+0000 7fe5a73d8640 1 -- 172.21.15.103:0/1639913220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5a014e5d0 con 0x7fe5a00a6c10 2024-09-10T08:45:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.592+0000 7fe595ffb640 1 -- 172.21.15.103:0/1639913220 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe59c0079d0 con 0x7fe5a00a6c10 2024-09-10T08:45:22.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.593+0000 7fe595ffb640 1 --2- 172.21.15.103:0/1639913220 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe58406be30 0x7fe58406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:22.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.593+0000 7fe595ffb640 1 -- 172.21.15.103:0/1639913220 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fe59c08b610 con 0x7fe5a00a6c10 2024-09-10T08:45:22.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.593+0000 7fe5a4973640 1 --2- 172.21.15.103:0/1639913220 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe58406be30 0x7fe58406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:22.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.593+0000 7fe5a4973640 1 --2- 172.21.15.103:0/1639913220 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe58406be30 0x7fe58406e2f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00c4f90 tx=0x7fe590006ba0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:22.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.597+0000 7fe595ffb640 1 -- 172.21.15.103:0/1639913220 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe59c059cb0 con 0x7fe5a00a6c10 2024-09-10T08:45:22.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.765+0000 7fe5a73d8640 1 -- 172.21.15.103:0/1639913220 --> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe5a014e180 con 0x7fe58406be30 2024-09-10T08:45:22.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.776+0000 7fe595ffb640 1 -- 172.21.15.103:0/1639913220 <== mgr.4107 v2:172.21.15.103:6832/2491184865 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+494893 (secure 0 0 0) 0x7fe5a014e180 con 0x7fe58406be30 2024-09-10T08:45:22.782 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:45:22.786 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-10T08:45:22.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.780+0000 7fe5a73d8640 1 -- 172.21.15.103:0/1639913220 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe58406be30 msgr2=0x7fe58406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:22.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.780+0000 7fe5a73d8640 1 --2- 172.21.15.103:0/1639913220 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe58406be30 0x7fe58406e2f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00c4f90 tx=0x7fe590006ba0 comp rx=0 tx=0).stop 2024-09-10T08:45:22.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.780+0000 7fe5a73d8640 1 -- 172.21.15.103:0/1639913220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a00a6c10 msgr2=0x7fe5a01e7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:22.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.780+0000 7fe5a73d8640 1 --2- 172.21.15.103:0/1639913220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a00a6c10 0x7fe5a01e7380 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00c7f0 tx=0x7fe59c00ccb0 comp rx=0 tx=0).stop 2024-09-10T08:45:22.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.780+0000 7fe5a73d8640 1 -- 172.21.15.103:0/1639913220 shutdown_connections 2024-09-10T08:45:22.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.780+0000 7fe5a73d8640 1 --2- 172.21.15.103:0/1639913220 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe58406be30 0x7fe58406e2f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:22.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.780+0000 7fe5a73d8640 1 --2- 172.21.15.103:0/1639913220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5a00c6010 0x7fe5a014d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:22.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.780+0000 7fe5a73d8640 1 --2- 172.21.15.103:0/1639913220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5a00c5940 0x7fe5a014d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:22.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.780+0000 7fe5a73d8640 1 --2- 172.21.15.103:0/1639913220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5a00a6c10 0x7fe5a01e7380 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:22.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.780+0000 7fe5a73d8640 1 -- 172.21.15.103:0/1639913220 >> 172.21.15.103:0/1639913220 conn(0x7fe5a00c7a40 msgr2=0x7fe5a00a7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:22.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.780+0000 7fe5a73d8640 1 -- 172.21.15.103:0/1639913220 shutdown_connections 2024-09-10T08:45:22.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.780+0000 7fe5a73d8640 1 -- 172.21.15.103:0/1639913220 wait complete. 2024-09-10T08:45:22.792 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":529,"stamp":"2024-09-10T08:45:21.075696+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36141476,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":225,"num_read_kb":350,"num_write":3080803,"num_write_kb":38573613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":595401,"ondisk_log_size":595401,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7701088,"kb_used_data":72928,"kb_used_omap":12,"kb_used_meta":7628019,"kb_avail":747273632,"statfs":{"total":773094113280,"available":765208199168,"internally_reserved":0,"allocated":74678272,"data_stored":73201928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":7811092019},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003562"},"pg_stats":[{"pgid":"5.18","version":"27'4501","reported_seq":4532,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:59.518854+0000","last_change":"2024-09-10T08:44:59.518881+0000","last_active":"2024-09-10T08:44:59.518854+0000","last_peered":"2024-09-10T08:44:59.518854+0000","last_clean":"2024-09-10T08:44:59.518854+0000","last_became_active":"2024-09-10T08:28:47.627217+0000","last_became_peered":"2024-09-10T08:28:47.627217+0000","last_unstale":"2024-09-10T08:44:59.518854+0000","last_undegraded":"2024-09-10T08:44:59.518854+0000","last_fullsized":"2024-09-10T08:44:59.518854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4501","last_scrub_stamp":"2024-09-10T08:44:59.518750+0000","last_deep_scrub":"27'4501","last_deep_scrub_stamp":"2024-09-10T08:44:59.518750+0000","last_clean_scrub_stamp":"2024-09-10T08:44:59.518750+0000","objects_scrubbed":0,"log_size":4501,"log_dups_size":0,"ondisk_log_size":4501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:45:34.985687+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23743,"num_write_kb":296073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"27'675","reported_seq":718,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:44.959766+0000","last_change":"2024-09-10T08:44:44.959766+0000","last_active":"2024-09-10T08:44:44.959766+0000","last_peered":"2024-09-10T08:44:44.959766+0000","last_clean":"2024-09-10T08:44:44.959766+0000","last_became_active":"2024-09-10T08:28:34.564545+0000","last_became_peered":"2024-09-10T08:28:34.564545+0000","last_unstale":"2024-09-10T08:44:44.959766+0000","last_undegraded":"2024-09-10T08:44:44.959766+0000","last_fullsized":"2024-09-10T08:44:44.959766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'675","last_scrub_stamp":"2024-09-10T08:44:44.959643+0000","last_deep_scrub":"27'675","last_deep_scrub_stamp":"2024-09-10T08:44:44.959643+0000","last_clean_scrub_stamp":"2024-09-10T08:44:44.959643+0000","objects_scrubbed":3,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:46:46.408917+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":670,"num_write_kb":4473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5460","reported_seq":5501,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:53.616472+0000","last_change":"2024-09-10T08:44:53.616501+0000","last_active":"2024-09-10T08:44:53.616472+0000","last_peered":"2024-09-10T08:44:53.616472+0000","last_clean":"2024-09-10T08:44:53.616472+0000","last_became_active":"2024-09-10T08:28:35.575019+0000","last_became_peered":"2024-09-10T08:28:35.575019+0000","last_unstale":"2024-09-10T08:44:53.616472+0000","last_undegraded":"2024-09-10T08:44:53.616472+0000","last_fullsized":"2024-09-10T08:44:53.616472+0000","mapping_epoch":19,"log_start":"27'200","ondisk_log_start":"27'200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5460","last_scrub_stamp":"2024-09-10T08:44:53.616348+0000","last_deep_scrub":"27'5460","last_deep_scrub_stamp":"2024-09-10T08:44:53.616348+0000","last_clean_scrub_stamp":"2024-09-10T08:44:53.616348+0000","objects_scrubbed":0,"log_size":5260,"log_dups_size":0,"ondisk_log_size":5260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:55.258412+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28693,"num_write_kb":332310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:41.883417+0000","last_change":"2024-09-10T08:44:41.883480+0000","last_active":"2024-09-10T08:44:41.883417+0000","last_peered":"2024-09-10T08:44:41.883417+0000","last_clean":"2024-09-10T08:44:41.883417+0000","last_became_active":"2024-09-10T08:28:46.619540+0000","last_became_peered":"2024-09-10T08:28:46.619540+0000","last_unstale":"2024-09-10T08:44:41.883417+0000","last_undegraded":"2024-09-10T08:44:41.883417+0000","last_fullsized":"2024-09-10T08:44:41.883417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-10T08:44:41.883299+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-10T08:44:41.883299+0000","last_clean_scrub_stamp":"2024-09-10T08:44:41.883299+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:25.715674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"27'5259","reported_seq":5290,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:03.105200+0000","last_change":"2024-09-10T08:45:03.105247+0000","last_active":"2024-09-10T08:45:03.105200+0000","last_peered":"2024-09-10T08:45:03.105200+0000","last_clean":"2024-09-10T08:45:03.105200+0000","last_became_active":"2024-09-10T08:28:47.633292+0000","last_became_peered":"2024-09-10T08:28:47.633292+0000","last_unstale":"2024-09-10T08:45:03.105200+0000","last_undegraded":"2024-09-10T08:45:03.105200+0000","last_fullsized":"2024-09-10T08:45:03.105200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5259","last_scrub_stamp":"2024-09-10T08:45:03.105095+0000","last_deep_scrub":"27'5259","last_deep_scrub_stamp":"2024-09-10T08:45:03.105095+0000","last_clean_scrub_stamp":"2024-09-10T08:45:03.105095+0000","objects_scrubbed":0,"log_size":5259,"log_dups_size":0,"ondisk_log_size":5259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:05.742753+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27465,"num_write_kb":347758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"27'8","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:54.631479+0000","last_change":"2024-09-10T08:44:54.631508+0000","last_active":"2024-09-10T08:44:54.631479+0000","last_peered":"2024-09-10T08:44:54.631479+0000","last_clean":"2024-09-10T08:44:54.631479+0000","last_became_active":"2024-09-10T08:28:34.561410+0000","last_became_peered":"2024-09-10T08:28:34.561410+0000","last_unstale":"2024-09-10T08:44:54.631479+0000","last_undegraded":"2024-09-10T08:44:54.631479+0000","last_fullsized":"2024-09-10T08:44:54.631479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-09-10T08:44:54.631352+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-09-10T08:44:54.631352+0000","last_clean_scrub_stamp":"2024-09-10T08:44:54.631352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:55:20.219441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'5545","reported_seq":5586,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:39.900622+0000","last_change":"2024-09-10T08:44:39.900622+0000","last_active":"2024-09-10T08:44:39.900622+0000","last_peered":"2024-09-10T08:44:39.900622+0000","last_clean":"2024-09-10T08:44:39.900622+0000","last_became_active":"2024-09-10T08:28:35.578333+0000","last_became_peered":"2024-09-10T08:28:35.578333+0000","last_unstale":"2024-09-10T08:44:39.900622+0000","last_undegraded":"2024-09-10T08:44:39.900622+0000","last_fullsized":"2024-09-10T08:44:39.900622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5545","last_scrub_stamp":"2024-09-10T08:44:39.900423+0000","last_deep_scrub":"27'5545","last_deep_scrub_stamp":"2024-09-10T08:44:39.900423+0000","last_clean_scrub_stamp":"2024-09-10T08:44:39.900423+0000","objects_scrubbed":0,"log_size":5545,"log_dups_size":0,"ondisk_log_size":5545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:28:05.013137+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29606,"num_write_kb":364444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:46.472560+0000","last_change":"2024-09-10T08:44:46.472588+0000","last_active":"2024-09-10T08:44:46.472560+0000","last_peered":"2024-09-10T08:44:46.472560+0000","last_clean":"2024-09-10T08:44:46.472560+0000","last_became_active":"2024-09-10T08:28:46.616806+0000","last_became_peered":"2024-09-10T08:28:46.616806+0000","last_unstale":"2024-09-10T08:44:46.472560+0000","last_undegraded":"2024-09-10T08:44:46.472560+0000","last_fullsized":"2024-09-10T08:44:46.472560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-10T08:44:46.472467+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-10T08:44:46.472467+0000","last_clean_scrub_stamp":"2024-09-10T08:44:46.472467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:56.731181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"27'4143","reported_seq":4174,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:07.805066+0000","last_change":"2024-09-10T08:45:07.805094+0000","last_active":"2024-09-10T08:45:07.805066+0000","last_peered":"2024-09-10T08:45:07.805066+0000","last_clean":"2024-09-10T08:45:07.805066+0000","last_became_active":"2024-09-10T08:28:47.632772+0000","last_became_peered":"2024-09-10T08:28:47.632772+0000","last_unstale":"2024-09-10T08:45:07.805066+0000","last_undegraded":"2024-09-10T08:45:07.805066+0000","last_fullsized":"2024-09-10T08:45:07.805066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4143","last_scrub_stamp":"2024-09-10T08:45:07.804952+0000","last_deep_scrub":"27'4143","last_deep_scrub_stamp":"2024-09-10T08:45:07.804952+0000","last_clean_scrub_stamp":"2024-09-10T08:45:07.804952+0000","objects_scrubbed":0,"log_size":4143,"log_dups_size":0,"ondisk_log_size":4143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:42:32.136046+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21394,"num_write_kb":261850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"27'12","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:00.870692+0000","last_change":"2024-09-10T08:45:00.870744+0000","last_active":"2024-09-10T08:45:00.870692+0000","last_peered":"2024-09-10T08:45:00.870692+0000","last_clean":"2024-09-10T08:45:00.870692+0000","last_became_active":"2024-09-10T08:28:34.571640+0000","last_became_peered":"2024-09-10T08:28:34.571640+0000","last_unstale":"2024-09-10T08:45:00.870692+0000","last_undegraded":"2024-09-10T08:45:00.870692+0000","last_fullsized":"2024-09-10T08:45:00.870692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-09-10T08:45:00.870589+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-09-10T08:45:00.870589+0000","last_clean_scrub_stamp":"2024-09-10T08:45:00.870589+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:40.458743+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'3192","reported_seq":3231,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:57.255787+0000","last_change":"2024-09-10T08:44:57.255814+0000","last_active":"2024-09-10T08:44:57.255787+0000","last_peered":"2024-09-10T08:44:57.255787+0000","last_clean":"2024-09-10T08:44:57.255787+0000","last_became_active":"2024-09-10T08:28:35.561842+0000","last_became_peered":"2024-09-10T08:28:35.561842+0000","last_unstale":"2024-09-10T08:44:57.255787+0000","last_undegraded":"2024-09-10T08:44:57.255787+0000","last_fullsized":"2024-09-10T08:44:57.255787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3192","last_scrub_stamp":"2024-09-10T08:44:57.255692+0000","last_deep_scrub":"27'3192","last_deep_scrub_stamp":"2024-09-10T08:44:57.255692+0000","last_clean_scrub_stamp":"2024-09-10T08:44:57.255692+0000","objects_scrubbed":0,"log_size":3192,"log_dups_size":0,"ondisk_log_size":3192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:57.395124+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15765,"num_write_kb":210601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'614","reported_seq":647,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:43.569199+0000","last_change":"2024-09-10T08:44:43.569226+0000","last_active":"2024-09-10T08:44:43.569199+0000","last_peered":"2024-09-10T08:44:43.569199+0000","last_clean":"2024-09-10T08:44:43.569199+0000","last_became_active":"2024-09-10T08:28:46.620794+0000","last_became_peered":"2024-09-10T08:28:46.620794+0000","last_unstale":"2024-09-10T08:44:43.569199+0000","last_undegraded":"2024-09-10T08:44:43.569199+0000","last_fullsized":"2024-09-10T08:44:43.569199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'614","last_scrub_stamp":"2024-09-10T08:44:43.569112+0000","last_deep_scrub":"27'614","last_deep_scrub_stamp":"2024-09-10T08:44:43.569112+0000","last_clean_scrub_stamp":"2024-09-10T08:44:43.569112+0000","objects_scrubbed":1,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:30:05.692225+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":611,"num_write_kb":4232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"27'3484","reported_seq":3515,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:03.407069+0000","last_change":"2024-09-10T08:45:03.407095+0000","last_active":"2024-09-10T08:45:03.407069+0000","last_peered":"2024-09-10T08:45:03.407069+0000","last_clean":"2024-09-10T08:45:03.407069+0000","last_became_active":"2024-09-10T08:28:47.627476+0000","last_became_peered":"2024-09-10T08:28:47.627476+0000","last_unstale":"2024-09-10T08:45:03.407069+0000","last_undegraded":"2024-09-10T08:45:03.407069+0000","last_fullsized":"2024-09-10T08:45:03.407069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3484","last_scrub_stamp":"2024-09-10T08:45:03.406977+0000","last_deep_scrub":"27'3484","last_deep_scrub_stamp":"2024-09-10T08:45:03.406977+0000","last_clean_scrub_stamp":"2024-09-10T08:45:03.406977+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:48:55.612370+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18057,"num_write_kb":232111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"27'4","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:55.929911+0000","last_change":"2024-09-10T08:44:55.929943+0000","last_active":"2024-09-10T08:44:55.929911+0000","last_peered":"2024-09-10T08:44:55.929911+0000","last_clean":"2024-09-10T08:44:55.929911+0000","last_became_active":"2024-09-10T08:28:34.566275+0000","last_became_peered":"2024-09-10T08:28:34.566275+0000","last_unstale":"2024-09-10T08:44:55.929911+0000","last_undegraded":"2024-09-10T08:44:55.929911+0000","last_fullsized":"2024-09-10T08:44:55.929911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-09-10T08:44:55.929815+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-09-10T08:44:55.929815+0000","last_clean_scrub_stamp":"2024-09-10T08:44:55.929815+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:27.462244+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'5826","reported_seq":5851,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:55.338232+0000","last_change":"2024-09-10T08:44:55.338261+0000","last_active":"2024-09-10T08:44:55.338232+0000","last_peered":"2024-09-10T08:44:55.338232+0000","last_clean":"2024-09-10T08:44:55.338232+0000","last_became_active":"2024-09-10T08:29:35.097553+0000","last_became_peered":"2024-09-10T08:29:35.097553+0000","last_unstale":"2024-09-10T08:44:55.338232+0000","last_undegraded":"2024-09-10T08:44:55.338232+0000","last_fullsized":"2024-09-10T08:44:55.338232+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5826","last_scrub_stamp":"2024-09-10T08:44:55.338134+0000","last_deep_scrub":"27'5826","last_deep_scrub_stamp":"2024-09-10T08:44:55.338134+0000","last_clean_scrub_stamp":"2024-09-10T08:44:55.338134+0000","objects_scrubbed":0,"log_size":5826,"log_dups_size":0,"ondisk_log_size":5826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:38:37.610377+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30231,"num_write_kb":366977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"27'66","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:40.627161+0000","last_change":"2024-09-10T08:44:40.627188+0000","last_active":"2024-09-10T08:44:40.627161+0000","last_peered":"2024-09-10T08:44:40.627161+0000","last_clean":"2024-09-10T08:44:40.627161+0000","last_became_active":"2024-09-10T08:28:46.619889+0000","last_became_peered":"2024-09-10T08:28:46.619889+0000","last_unstale":"2024-09-10T08:44:40.627161+0000","last_undegraded":"2024-09-10T08:44:40.627161+0000","last_fullsized":"2024-09-10T08:44:40.627161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'66","last_scrub_stamp":"2024-09-10T08:44:40.627072+0000","last_deep_scrub":"27'66","last_deep_scrub_stamp":"2024-09-10T08:44:40.627072+0000","last_clean_scrub_stamp":"2024-09-10T08:44:40.627072+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:39.075014+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":755904,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"27'4988","reported_seq":5020,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:00.119332+0000","last_change":"2024-09-10T08:45:00.119359+0000","last_active":"2024-09-10T08:45:00.119332+0000","last_peered":"2024-09-10T08:45:00.119332+0000","last_clean":"2024-09-10T08:45:00.119332+0000","last_became_active":"2024-09-10T08:28:47.630787+0000","last_became_peered":"2024-09-10T08:28:47.630787+0000","last_unstale":"2024-09-10T08:45:00.119332+0000","last_undegraded":"2024-09-10T08:45:00.119332+0000","last_fullsized":"2024-09-10T08:45:00.119332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4988","last_scrub_stamp":"2024-09-10T08:45:00.119221+0000","last_deep_scrub":"27'4988","last_deep_scrub_stamp":"2024-09-10T08:45:00.119221+0000","last_clean_scrub_stamp":"2024-09-10T08:45:00.119221+0000","objects_scrubbed":0,"log_size":4988,"log_dups_size":0,"ondisk_log_size":4988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:09.821929+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26081,"num_write_kb":317657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"27'4088","reported_seq":4128,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:53.166146+0000","last_change":"2024-09-10T08:44:53.166170+0000","last_active":"2024-09-10T08:44:53.166146+0000","last_peered":"2024-09-10T08:44:53.166146+0000","last_clean":"2024-09-10T08:44:53.166146+0000","last_became_active":"2024-09-10T08:28:35.572215+0000","last_became_peered":"2024-09-10T08:28:35.572215+0000","last_unstale":"2024-09-10T08:44:53.166146+0000","last_undegraded":"2024-09-10T08:44:53.166146+0000","last_fullsized":"2024-09-10T08:44:53.166146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4088","last_scrub_stamp":"2024-09-10T08:44:53.166055+0000","last_deep_scrub":"27'4088","last_deep_scrub_stamp":"2024-09-10T08:44:53.166055+0000","last_clean_scrub_stamp":"2024-09-10T08:44:53.166055+0000","objects_scrubbed":0,"log_size":4088,"log_dups_size":0,"ondisk_log_size":4088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:00.429408+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21444,"num_write_kb":270258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'1131","reported_seq":1173,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:57.925717+0000","last_change":"2024-09-10T08:44:57.925775+0000","last_active":"2024-09-10T08:44:57.925717+0000","last_peered":"2024-09-10T08:44:57.925717+0000","last_clean":"2024-09-10T08:44:57.925717+0000","last_became_active":"2024-09-10T08:28:34.568899+0000","last_became_peered":"2024-09-10T08:28:34.568899+0000","last_unstale":"2024-09-10T08:44:57.925717+0000","last_undegraded":"2024-09-10T08:44:57.925717+0000","last_fullsized":"2024-09-10T08:44:57.925717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1131","last_scrub_stamp":"2024-09-10T08:44:57.925604+0000","last_deep_scrub":"27'1131","last_deep_scrub_stamp":"2024-09-10T08:44:57.925604+0000","last_clean_scrub_stamp":"2024-09-10T08:44:57.925604+0000","objects_scrubbed":2,"log_size":1131,"log_dups_size":0,"ondisk_log_size":1131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:38.187805+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'3","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:44.519593+0000","last_change":"2024-09-10T08:44:44.519624+0000","last_active":"2024-09-10T08:44:44.519593+0000","last_peered":"2024-09-10T08:44:44.519593+0000","last_clean":"2024-09-10T08:44:44.519593+0000","last_became_active":"2024-09-10T08:28:46.616824+0000","last_became_peered":"2024-09-10T08:28:46.616824+0000","last_unstale":"2024-09-10T08:44:44.519593+0000","last_undegraded":"2024-09-10T08:44:44.519593+0000","last_fullsized":"2024-09-10T08:44:44.519593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-10T08:44:44.519486+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-10T08:44:44.519486+0000","last_clean_scrub_stamp":"2024-09-10T08:44:44.519486+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:07.229643+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"27'4540","reported_seq":4572,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:52.268065+0000","last_change":"2024-09-10T08:44:52.268106+0000","last_active":"2024-09-10T08:44:52.268065+0000","last_peered":"2024-09-10T08:44:52.268065+0000","last_clean":"2024-09-10T08:44:52.268065+0000","last_became_active":"2024-09-10T08:28:47.626871+0000","last_became_peered":"2024-09-10T08:28:47.626871+0000","last_unstale":"2024-09-10T08:44:52.268065+0000","last_undegraded":"2024-09-10T08:44:52.268065+0000","last_fullsized":"2024-09-10T08:44:52.268065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4540","last_scrub_stamp":"2024-09-10T08:44:52.267964+0000","last_deep_scrub":"27'4540","last_deep_scrub_stamp":"2024-09-10T08:44:52.267964+0000","last_clean_scrub_stamp":"2024-09-10T08:44:52.267964+0000","objects_scrubbed":0,"log_size":4540,"log_dups_size":0,"ondisk_log_size":4540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:45.826167+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23818,"num_write_kb":300351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"27'4200","reported_seq":4240,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:47.681611+0000","last_change":"2024-09-10T08:44:47.681659+0000","last_active":"2024-09-10T08:44:47.681611+0000","last_peered":"2024-09-10T08:44:47.681611+0000","last_clean":"2024-09-10T08:44:47.681611+0000","last_became_active":"2024-09-10T08:28:35.576771+0000","last_became_peered":"2024-09-10T08:28:35.576771+0000","last_unstale":"2024-09-10T08:44:47.681611+0000","last_undegraded":"2024-09-10T08:44:47.681611+0000","last_fullsized":"2024-09-10T08:44:47.681611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4200","last_scrub_stamp":"2024-09-10T08:44:47.681450+0000","last_deep_scrub":"27'4200","last_deep_scrub_stamp":"2024-09-10T08:44:47.681450+0000","last_clean_scrub_stamp":"2024-09-10T08:44:47.681450+0000","objects_scrubbed":0,"log_size":4200,"log_dups_size":0,"ondisk_log_size":4200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:05.324828+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21158,"num_write_kb":256901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:51.258970+0000","last_change":"2024-09-10T08:44:51.258994+0000","last_active":"2024-09-10T08:44:51.258970+0000","last_peered":"2024-09-10T08:44:51.258970+0000","last_clean":"2024-09-10T08:44:51.258970+0000","last_became_active":"2024-09-10T08:28:34.560974+0000","last_became_peered":"2024-09-10T08:28:34.560974+0000","last_unstale":"2024-09-10T08:44:51.258970+0000","last_undegraded":"2024-09-10T08:44:51.258970+0000","last_fullsized":"2024-09-10T08:44:51.258970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-09-10T08:44:51.258870+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-09-10T08:44:51.258870+0000","last_clean_scrub_stamp":"2024-09-10T08:44:51.258870+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:16.745084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'2","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:41.628795+0000","last_change":"2024-09-10T08:44:41.628836+0000","last_active":"2024-09-10T08:44:41.628795+0000","last_peered":"2024-09-10T08:44:41.628795+0000","last_clean":"2024-09-10T08:44:41.628795+0000","last_became_active":"2024-09-10T08:28:46.619553+0000","last_became_peered":"2024-09-10T08:28:46.619553+0000","last_unstale":"2024-09-10T08:44:41.628795+0000","last_undegraded":"2024-09-10T08:44:41.628795+0000","last_fullsized":"2024-09-10T08:44:41.628795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-09-10T08:44:41.628691+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-09-10T08:44:41.628691+0000","last_clean_scrub_stamp":"2024-09-10T08:44:41.628691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:02:26.008015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"27'4215","reported_seq":4247,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:00.545022+0000","last_change":"2024-09-10T08:45:00.545049+0000","last_active":"2024-09-10T08:45:00.545022+0000","last_peered":"2024-09-10T08:45:00.545022+0000","last_clean":"2024-09-10T08:45:00.545022+0000","last_became_active":"2024-09-10T08:28:47.628290+0000","last_became_peered":"2024-09-10T08:28:47.628290+0000","last_unstale":"2024-09-10T08:45:00.545022+0000","last_undegraded":"2024-09-10T08:45:00.545022+0000","last_fullsized":"2024-09-10T08:45:00.545022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4215","last_scrub_stamp":"2024-09-10T08:45:00.544913+0000","last_deep_scrub":"27'4215","last_deep_scrub_stamp":"2024-09-10T08:45:00.544913+0000","last_clean_scrub_stamp":"2024-09-10T08:45:00.544913+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:37.499930+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21334,"num_write_kb":282217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'4711","reported_seq":4751,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:57.563337+0000","last_change":"2024-09-10T08:44:57.563361+0000","last_active":"2024-09-10T08:44:57.563337+0000","last_peered":"2024-09-10T08:44:57.563337+0000","last_clean":"2024-09-10T08:44:57.563337+0000","last_became_active":"2024-09-10T08:28:35.572108+0000","last_became_peered":"2024-09-10T08:28:35.572108+0000","last_unstale":"2024-09-10T08:44:57.563337+0000","last_undegraded":"2024-09-10T08:44:57.563337+0000","last_fullsized":"2024-09-10T08:44:57.563337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4711","last_scrub_stamp":"2024-09-10T08:44:57.563237+0000","last_deep_scrub":"27'4711","last_deep_scrub_stamp":"2024-09-10T08:44:57.563237+0000","last_clean_scrub_stamp":"2024-09-10T08:44:57.563237+0000","objects_scrubbed":0,"log_size":4711,"log_dups_size":0,"ondisk_log_size":4711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:34:35.832492+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24668,"num_write_kb":303691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:53.206674+0000","last_change":"2024-09-10T08:44:53.206703+0000","last_active":"2024-09-10T08:44:53.206674+0000","last_peered":"2024-09-10T08:44:53.206674+0000","last_clean":"2024-09-10T08:44:53.206674+0000","last_became_active":"2024-09-10T08:28:34.564557+0000","last_became_peered":"2024-09-10T08:28:34.564557+0000","last_unstale":"2024-09-10T08:44:53.206674+0000","last_undegraded":"2024-09-10T08:44:53.206674+0000","last_fullsized":"2024-09-10T08:44:53.206674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-10T08:44:53.206572+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-10T08:44:53.206572+0000","last_clean_scrub_stamp":"2024-09-10T08:44:53.206572+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:41.035223+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:44.295347+0000","last_change":"2024-09-10T08:44:44.295378+0000","last_active":"2024-09-10T08:44:44.295347+0000","last_peered":"2024-09-10T08:44:44.295347+0000","last_clean":"2024-09-10T08:44:44.295347+0000","last_became_active":"2024-09-10T08:28:46.625059+0000","last_became_peered":"2024-09-10T08:28:46.625059+0000","last_unstale":"2024-09-10T08:44:44.295347+0000","last_undegraded":"2024-09-10T08:44:44.295347+0000","last_fullsized":"2024-09-10T08:44:44.295347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-09-10T08:44:44.295257+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-09-10T08:44:44.295257+0000","last_clean_scrub_stamp":"2024-09-10T08:44:44.295257+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:26.589335+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"27'5035","reported_seq":5067,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:48.041644+0000","last_change":"2024-09-10T08:44:48.041693+0000","last_active":"2024-09-10T08:44:48.041644+0000","last_peered":"2024-09-10T08:44:48.041644+0000","last_clean":"2024-09-10T08:44:48.041644+0000","last_became_active":"2024-09-10T08:28:47.621043+0000","last_became_peered":"2024-09-10T08:28:47.621043+0000","last_unstale":"2024-09-10T08:44:48.041644+0000","last_undegraded":"2024-09-10T08:44:48.041644+0000","last_fullsized":"2024-09-10T08:44:48.041644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5035","last_scrub_stamp":"2024-09-10T08:44:48.041529+0000","last_deep_scrub":"27'5035","last_deep_scrub_stamp":"2024-09-10T08:44:48.041529+0000","last_clean_scrub_stamp":"2024-09-10T08:44:48.041529+0000","objects_scrubbed":0,"log_size":5035,"log_dups_size":0,"ondisk_log_size":5035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:04.907621+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25734,"num_write_kb":340789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"27'4207","reported_seq":4247,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:50.434430+0000","last_change":"2024-09-10T08:44:50.434455+0000","last_active":"2024-09-10T08:44:50.434430+0000","last_peered":"2024-09-10T08:44:50.434430+0000","last_clean":"2024-09-10T08:44:50.434430+0000","last_became_active":"2024-09-10T08:28:35.569109+0000","last_became_peered":"2024-09-10T08:28:35.569109+0000","last_unstale":"2024-09-10T08:44:50.434430+0000","last_undegraded":"2024-09-10T08:44:50.434430+0000","last_fullsized":"2024-09-10T08:44:50.434430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4207","last_scrub_stamp":"2024-09-10T08:44:50.434311+0000","last_deep_scrub":"27'4207","last_deep_scrub_stamp":"2024-09-10T08:44:50.434311+0000","last_clean_scrub_stamp":"2024-09-10T08:44:50.434311+0000","objects_scrubbed":0,"log_size":4207,"log_dups_size":0,"ondisk_log_size":4207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:02.471993+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21000,"num_write_kb":276623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:58.943429+0000","last_change":"2024-09-10T08:44:58.943454+0000","last_active":"2024-09-10T08:44:58.943429+0000","last_peered":"2024-09-10T08:44:58.943429+0000","last_clean":"2024-09-10T08:44:58.943429+0000","last_became_active":"2024-09-10T08:28:34.570766+0000","last_became_peered":"2024-09-10T08:28:34.570766+0000","last_unstale":"2024-09-10T08:44:58.943429+0000","last_undegraded":"2024-09-10T08:44:58.943429+0000","last_fullsized":"2024-09-10T08:44:58.943429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-10T08:44:58.943342+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-10T08:44:58.943342+0000","last_clean_scrub_stamp":"2024-09-10T08:44:58.943342+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:55.029789+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:54.403176+0000","last_change":"2024-09-10T08:44:54.403209+0000","last_active":"2024-09-10T08:44:54.403176+0000","last_peered":"2024-09-10T08:44:54.403176+0000","last_clean":"2024-09-10T08:44:54.403176+0000","last_became_active":"2024-09-10T08:28:46.616254+0000","last_became_peered":"2024-09-10T08:28:46.616254+0000","last_unstale":"2024-09-10T08:44:54.403176+0000","last_undegraded":"2024-09-10T08:44:54.403176+0000","last_fullsized":"2024-09-10T08:44:54.403176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-09-10T08:44:54.403087+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-09-10T08:44:54.403087+0000","last_clean_scrub_stamp":"2024-09-10T08:44:54.403087+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:34.733408+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"27'4342","reported_seq":4375,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:05.682522+0000","last_change":"2024-09-10T08:45:05.682548+0000","last_active":"2024-09-10T08:45:05.682522+0000","last_peered":"2024-09-10T08:45:05.682522+0000","last_clean":"2024-09-10T08:45:05.682522+0000","last_became_active":"2024-09-10T08:28:47.627869+0000","last_became_peered":"2024-09-10T08:28:47.627869+0000","last_unstale":"2024-09-10T08:45:05.682522+0000","last_undegraded":"2024-09-10T08:45:05.682522+0000","last_fullsized":"2024-09-10T08:45:05.682522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4342","last_scrub_stamp":"2024-09-10T08:45:05.682398+0000","last_deep_scrub":"27'4342","last_deep_scrub_stamp":"2024-09-10T08:45:05.682398+0000","last_clean_scrub_stamp":"2024-09-10T08:45:05.682398+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:58:32.200799+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23056,"num_write_kb":285008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"27'4228","reported_seq":4268,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:48.937528+0000","last_change":"2024-09-10T08:44:48.937554+0000","last_active":"2024-09-10T08:44:48.937528+0000","last_peered":"2024-09-10T08:44:48.937528+0000","last_clean":"2024-09-10T08:44:48.937528+0000","last_became_active":"2024-09-10T08:28:35.574815+0000","last_became_peered":"2024-09-10T08:28:35.574815+0000","last_unstale":"2024-09-10T08:44:48.937528+0000","last_undegraded":"2024-09-10T08:44:48.937528+0000","last_fullsized":"2024-09-10T08:44:48.937528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4228","last_scrub_stamp":"2024-09-10T08:44:48.937413+0000","last_deep_scrub":"27'4228","last_deep_scrub_stamp":"2024-09-10T08:44:48.937413+0000","last_clean_scrub_stamp":"2024-09-10T08:44:48.937413+0000","objects_scrubbed":0,"log_size":4228,"log_dups_size":0,"ondisk_log_size":4228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:19.291612+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21299,"num_write_kb":257333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'6","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:50.139475+0000","last_change":"2024-09-10T08:44:50.139548+0000","last_active":"2024-09-10T08:44:50.139475+0000","last_peered":"2024-09-10T08:44:50.139475+0000","last_clean":"2024-09-10T08:44:50.139475+0000","last_became_active":"2024-09-10T08:28:34.564549+0000","last_became_peered":"2024-09-10T08:28:34.564549+0000","last_unstale":"2024-09-10T08:44:50.139475+0000","last_undegraded":"2024-09-10T08:44:50.139475+0000","last_fullsized":"2024-09-10T08:44:50.139475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-09-10T08:44:50.139386+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-09-10T08:44:50.139386+0000","last_clean_scrub_stamp":"2024-09-10T08:44:50.139386+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:15.672405+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'54","reported_seq":139,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:45.501874+0000","last_change":"2024-09-10T08:44:45.501934+0000","last_active":"2024-09-10T08:44:45.501874+0000","last_peered":"2024-09-10T08:44:45.501874+0000","last_clean":"2024-09-10T08:44:45.501874+0000","last_became_active":"2024-09-10T08:28:46.621052+0000","last_became_peered":"2024-09-10T08:28:46.621052+0000","last_unstale":"2024-09-10T08:44:45.501874+0000","last_undegraded":"2024-09-10T08:44:45.501874+0000","last_fullsized":"2024-09-10T08:44:45.501874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2024-09-10T08:44:45.501762+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2024-09-10T08:44:45.501762+0000","last_clean_scrub_stamp":"2024-09-10T08:44:45.501762+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:57.954829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":121,"num_write":51,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"27'4494","reported_seq":4526,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:57.502087+0000","last_change":"2024-09-10T08:44:57.502140+0000","last_active":"2024-09-10T08:44:57.502087+0000","last_peered":"2024-09-10T08:44:57.502087+0000","last_clean":"2024-09-10T08:44:57.502087+0000","last_became_active":"2024-09-10T08:28:47.624651+0000","last_became_peered":"2024-09-10T08:28:47.624651+0000","last_unstale":"2024-09-10T08:44:57.502087+0000","last_undegraded":"2024-09-10T08:44:57.502087+0000","last_fullsized":"2024-09-10T08:44:57.502087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4494","last_scrub_stamp":"2024-09-10T08:44:57.501977+0000","last_deep_scrub":"27'4494","last_deep_scrub_stamp":"2024-09-10T08:44:57.501977+0000","last_clean_scrub_stamp":"2024-09-10T08:44:57.501977+0000","objects_scrubbed":0,"log_size":4494,"log_dups_size":0,"ondisk_log_size":4494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:22.816586+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23585,"num_write_kb":291272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'4460","reported_seq":4500,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:00.590354+0000","last_change":"2024-09-10T08:45:00.590380+0000","last_active":"2024-09-10T08:45:00.590354+0000","last_peered":"2024-09-10T08:45:00.590354+0000","last_clean":"2024-09-10T08:45:00.590354+0000","last_became_active":"2024-09-10T08:28:35.573851+0000","last_became_peered":"2024-09-10T08:28:35.573851+0000","last_unstale":"2024-09-10T08:45:00.590354+0000","last_undegraded":"2024-09-10T08:45:00.590354+0000","last_fullsized":"2024-09-10T08:45:00.590354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4460","last_scrub_stamp":"2024-09-10T08:45:00.590261+0000","last_deep_scrub":"27'4460","last_deep_scrub_stamp":"2024-09-10T08:45:00.590261+0000","last_clean_scrub_stamp":"2024-09-10T08:45:00.590261+0000","objects_scrubbed":0,"log_size":4460,"log_dups_size":0,"ondisk_log_size":4460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:26.106925+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22566,"num_write_kb":290967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'600","reported_seq":642,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:52.237596+0000","last_change":"2024-09-10T08:44:52.237626+0000","last_active":"2024-09-10T08:44:52.237596+0000","last_peered":"2024-09-10T08:44:52.237596+0000","last_clean":"2024-09-10T08:44:52.237596+0000","last_became_active":"2024-09-10T08:28:34.563259+0000","last_became_peered":"2024-09-10T08:28:34.563259+0000","last_unstale":"2024-09-10T08:44:52.237596+0000","last_undegraded":"2024-09-10T08:44:52.237596+0000","last_fullsized":"2024-09-10T08:44:52.237596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'600","last_scrub_stamp":"2024-09-10T08:44:52.237501+0000","last_deep_scrub":"27'600","last_deep_scrub_stamp":"2024-09-10T08:44:52.237501+0000","last_clean_scrub_stamp":"2024-09-10T08:44:52.237501+0000","objects_scrubbed":1,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:37.448960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1430,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:48.625577+0000","last_change":"2024-09-10T08:44:48.625603+0000","last_active":"2024-09-10T08:44:48.625577+0000","last_peered":"2024-09-10T08:44:48.625577+0000","last_clean":"2024-09-10T08:44:48.625577+0000","last_became_active":"2024-09-10T08:28:46.623139+0000","last_became_peered":"2024-09-10T08:28:46.623139+0000","last_unstale":"2024-09-10T08:44:48.625577+0000","last_undegraded":"2024-09-10T08:44:48.625577+0000","last_fullsized":"2024-09-10T08:44:48.625577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-10T08:44:48.625481+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-10T08:44:48.625481+0000","last_clean_scrub_stamp":"2024-09-10T08:44:48.625481+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:23.139955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"27'4787","reported_seq":4819,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:01.191704+0000","last_change":"2024-09-10T08:45:01.191730+0000","last_active":"2024-09-10T08:45:01.191704+0000","last_peered":"2024-09-10T08:45:01.191704+0000","last_clean":"2024-09-10T08:45:01.191704+0000","last_became_active":"2024-09-10T08:28:47.634382+0000","last_became_peered":"2024-09-10T08:28:47.634382+0000","last_unstale":"2024-09-10T08:45:01.191704+0000","last_undegraded":"2024-09-10T08:45:01.191704+0000","last_fullsized":"2024-09-10T08:45:01.191704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4787","last_scrub_stamp":"2024-09-10T08:45:01.191595+0000","last_deep_scrub":"27'4787","last_deep_scrub_stamp":"2024-09-10T08:45:01.191595+0000","last_clean_scrub_stamp":"2024-09-10T08:45:01.191595+0000","objects_scrubbed":0,"log_size":4787,"log_dups_size":0,"ondisk_log_size":4787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:45.828042+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24922,"num_write_kb":313092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"27'4927","reported_seq":4968,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:47.339974+0000","last_change":"2024-09-10T08:44:47.339974+0000","last_active":"2024-09-10T08:44:47.339974+0000","last_peered":"2024-09-10T08:44:47.339974+0000","last_clean":"2024-09-10T08:44:47.339974+0000","last_became_active":"2024-09-10T08:28:35.567167+0000","last_became_peered":"2024-09-10T08:28:35.567167+0000","last_unstale":"2024-09-10T08:44:47.339974+0000","last_undegraded":"2024-09-10T08:44:47.339974+0000","last_fullsized":"2024-09-10T08:44:47.339974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4927","last_scrub_stamp":"2024-09-10T08:44:47.339830+0000","last_deep_scrub":"27'4927","last_deep_scrub_stamp":"2024-09-10T08:44:47.339830+0000","last_clean_scrub_stamp":"2024-09-10T08:44:47.339830+0000","objects_scrubbed":0,"log_size":4927,"log_dups_size":0,"ondisk_log_size":4927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:49.138722+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25981,"num_write_kb":313006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:59.894223+0000","last_change":"2024-09-10T08:44:59.894223+0000","last_active":"2024-09-10T08:44:59.894223+0000","last_peered":"2024-09-10T08:44:59.894223+0000","last_clean":"2024-09-10T08:44:59.894223+0000","last_became_active":"2024-09-10T08:28:34.570791+0000","last_became_peered":"2024-09-10T08:28:34.570791+0000","last_unstale":"2024-09-10T08:44:59.894223+0000","last_undegraded":"2024-09-10T08:44:59.894223+0000","last_fullsized":"2024-09-10T08:44:59.894223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-09-10T08:44:59.894103+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-09-10T08:44:59.894103+0000","last_clean_scrub_stamp":"2024-09-10T08:44:59.894103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:38.583049+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'1","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:54.954443+0000","last_change":"2024-09-10T08:44:54.954482+0000","last_active":"2024-09-10T08:44:54.954443+0000","last_peered":"2024-09-10T08:44:54.954443+0000","last_clean":"2024-09-10T08:44:54.954443+0000","last_became_active":"2024-09-10T08:28:46.630658+0000","last_became_peered":"2024-09-10T08:28:46.630658+0000","last_unstale":"2024-09-10T08:44:54.954443+0000","last_undegraded":"2024-09-10T08:44:54.954443+0000","last_fullsized":"2024-09-10T08:44:54.954443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-09-10T08:44:54.954353+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-09-10T08:44:54.954353+0000","last_clean_scrub_stamp":"2024-09-10T08:44:54.954353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:57.451147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"27'4308","reported_seq":4340,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:55.973768+0000","last_change":"2024-09-10T08:44:55.973796+0000","last_active":"2024-09-10T08:44:55.973768+0000","last_peered":"2024-09-10T08:44:55.973768+0000","last_clean":"2024-09-10T08:44:55.973768+0000","last_became_active":"2024-09-10T08:28:47.625186+0000","last_became_peered":"2024-09-10T08:28:47.625186+0000","last_unstale":"2024-09-10T08:44:55.973768+0000","last_undegraded":"2024-09-10T08:44:55.973768+0000","last_fullsized":"2024-09-10T08:44:55.973768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4308","last_scrub_stamp":"2024-09-10T08:44:55.973668+0000","last_deep_scrub":"27'4308","last_deep_scrub_stamp":"2024-09-10T08:44:55.973668+0000","last_clean_scrub_stamp":"2024-09-10T08:44:55.973668+0000","objects_scrubbed":0,"log_size":4308,"log_dups_size":0,"ondisk_log_size":4308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:51.692338+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23330,"num_write_kb":286070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'4301","reported_seq":4342,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:48.996508+0000","last_change":"2024-09-10T08:44:48.996508+0000","last_active":"2024-09-10T08:44:48.996508+0000","last_peered":"2024-09-10T08:44:48.996508+0000","last_clean":"2024-09-10T08:44:48.996508+0000","last_became_active":"2024-09-10T08:28:35.576002+0000","last_became_peered":"2024-09-10T08:28:35.576002+0000","last_unstale":"2024-09-10T08:44:48.996508+0000","last_undegraded":"2024-09-10T08:44:48.996508+0000","last_fullsized":"2024-09-10T08:44:48.996508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4301","last_scrub_stamp":"2024-09-10T08:44:48.996403+0000","last_deep_scrub":"27'4301","last_deep_scrub_stamp":"2024-09-10T08:44:48.996403+0000","last_clean_scrub_stamp":"2024-09-10T08:44:48.996403+0000","objects_scrubbed":0,"log_size":4301,"log_dups_size":0,"ondisk_log_size":4301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:47.544185+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22897,"num_write_kb":271992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'5","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:48.338327+0000","last_change":"2024-09-10T08:44:48.338327+0000","last_active":"2024-09-10T08:44:48.338327+0000","last_peered":"2024-09-10T08:44:48.338327+0000","last_clean":"2024-09-10T08:44:48.338327+0000","last_became_active":"2024-09-10T08:28:34.554922+0000","last_became_peered":"2024-09-10T08:28:34.554922+0000","last_unstale":"2024-09-10T08:44:48.338327+0000","last_undegraded":"2024-09-10T08:44:48.338327+0000","last_fullsized":"2024-09-10T08:44:48.338327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-10T08:44:48.338208+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-10T08:44:48.338208+0000","last_clean_scrub_stamp":"2024-09-10T08:44:48.338208+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:03.308785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:42.271194+0000","last_change":"2024-09-10T08:44:42.271234+0000","last_active":"2024-09-10T08:44:42.271194+0000","last_peered":"2024-09-10T08:44:42.271194+0000","last_clean":"2024-09-10T08:44:42.271194+0000","last_became_active":"2024-09-10T08:28:46.624690+0000","last_became_peered":"2024-09-10T08:28:46.624690+0000","last_unstale":"2024-09-10T08:44:42.271194+0000","last_undegraded":"2024-09-10T08:44:42.271194+0000","last_fullsized":"2024-09-10T08:44:42.271194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-10T08:44:42.271093+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-10T08:44:42.271093+0000","last_clean_scrub_stamp":"2024-09-10T08:44:42.271093+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:03.630352+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"27'4253","reported_seq":4285,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:58.929784+0000","last_change":"2024-09-10T08:44:58.929812+0000","last_active":"2024-09-10T08:44:58.929784+0000","last_peered":"2024-09-10T08:44:58.929784+0000","last_clean":"2024-09-10T08:44:58.929784+0000","last_became_active":"2024-09-10T08:28:47.633893+0000","last_became_peered":"2024-09-10T08:28:47.633893+0000","last_unstale":"2024-09-10T08:44:58.929784+0000","last_undegraded":"2024-09-10T08:44:58.929784+0000","last_fullsized":"2024-09-10T08:44:58.929784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4253","last_scrub_stamp":"2024-09-10T08:44:58.929679+0000","last_deep_scrub":"27'4253","last_deep_scrub_stamp":"2024-09-10T08:44:58.929679+0000","last_clean_scrub_stamp":"2024-09-10T08:44:58.929679+0000","objects_scrubbed":0,"log_size":4253,"log_dups_size":0,"ondisk_log_size":4253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:39.332418+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22807,"num_write_kb":271856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"27'4548","reported_seq":4589,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:52.455164+0000","last_change":"2024-09-10T08:44:52.455164+0000","last_active":"2024-09-10T08:44:52.455164+0000","last_peered":"2024-09-10T08:44:52.455164+0000","last_clean":"2024-09-10T08:44:52.455164+0000","last_became_active":"2024-09-10T08:28:35.577718+0000","last_became_peered":"2024-09-10T08:28:35.577718+0000","last_unstale":"2024-09-10T08:44:52.455164+0000","last_undegraded":"2024-09-10T08:44:52.455164+0000","last_fullsized":"2024-09-10T08:44:52.455164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4548","last_scrub_stamp":"2024-09-10T08:44:52.455036+0000","last_deep_scrub":"27'4548","last_deep_scrub_stamp":"2024-09-10T08:44:52.455036+0000","last_clean_scrub_stamp":"2024-09-10T08:44:52.455036+0000","objects_scrubbed":0,"log_size":4548,"log_dups_size":0,"ondisk_log_size":4548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:19.735940+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24326,"num_write_kb":290026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:52.085091+0000","last_change":"2024-09-10T08:44:52.085091+0000","last_active":"2024-09-10T08:44:52.085091+0000","last_peered":"2024-09-10T08:44:52.085091+0000","last_clean":"2024-09-10T08:44:52.085091+0000","last_became_active":"2024-09-10T08:28:34.553693+0000","last_became_peered":"2024-09-10T08:28:34.553693+0000","last_unstale":"2024-09-10T08:44:52.085091+0000","last_undegraded":"2024-09-10T08:44:52.085091+0000","last_fullsized":"2024-09-10T08:44:52.085091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-10T08:44:52.084962+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-10T08:44:52.084962+0000","last_clean_scrub_stamp":"2024-09-10T08:44:52.084962+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:33.373396+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:39.323008+0000","last_change":"2024-09-10T08:44:39.323029+0000","last_active":"2024-09-10T08:44:39.323008+0000","last_peered":"2024-09-10T08:44:39.323008+0000","last_clean":"2024-09-10T08:44:39.323008+0000","last_became_active":"2024-09-10T08:28:46.619853+0000","last_became_peered":"2024-09-10T08:28:46.619853+0000","last_unstale":"2024-09-10T08:44:39.323008+0000","last_undegraded":"2024-09-10T08:44:39.323008+0000","last_fullsized":"2024-09-10T08:44:39.323008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-10T08:44:39.322926+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-10T08:44:39.322926+0000","last_clean_scrub_stamp":"2024-09-10T08:44:39.322926+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:00.188842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'3675","reported_seq":3707,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:50.316119+0000","last_change":"2024-09-10T08:44:50.316147+0000","last_active":"2024-09-10T08:44:50.316119+0000","last_peered":"2024-09-10T08:44:50.316119+0000","last_clean":"2024-09-10T08:44:50.316119+0000","last_became_active":"2024-09-10T08:28:47.621122+0000","last_became_peered":"2024-09-10T08:28:47.621122+0000","last_unstale":"2024-09-10T08:44:50.316119+0000","last_undegraded":"2024-09-10T08:44:50.316119+0000","last_fullsized":"2024-09-10T08:44:50.316119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3675","last_scrub_stamp":"2024-09-10T08:44:50.316011+0000","last_deep_scrub":"27'3675","last_deep_scrub_stamp":"2024-09-10T08:44:50.316011+0000","last_clean_scrub_stamp":"2024-09-10T08:44:50.316011+0000","objects_scrubbed":0,"log_size":3675,"log_dups_size":0,"ondisk_log_size":3675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:21.342938+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18710,"num_write_kb":246893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'4629","reported_seq":4670,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:55.226538+0000","last_change":"2024-09-10T08:44:55.226584+0000","last_active":"2024-09-10T08:44:55.226538+0000","last_peered":"2024-09-10T08:44:55.226538+0000","last_clean":"2024-09-10T08:44:55.226538+0000","last_became_active":"2024-09-10T08:28:35.566444+0000","last_became_peered":"2024-09-10T08:28:35.566444+0000","last_unstale":"2024-09-10T08:44:55.226538+0000","last_undegraded":"2024-09-10T08:44:55.226538+0000","last_fullsized":"2024-09-10T08:44:55.226538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4629","last_scrub_stamp":"2024-09-10T08:44:55.226415+0000","last_deep_scrub":"27'4629","last_deep_scrub_stamp":"2024-09-10T08:44:55.226415+0000","last_clean_scrub_stamp":"2024-09-10T08:44:55.226415+0000","objects_scrubbed":0,"log_size":4629,"log_dups_size":0,"ondisk_log_size":4629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:53.503830+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24423,"num_write_kb":290556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'61","reported_seq":162,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:45.290090+0000","last_change":"2024-09-10T08:44:45.290090+0000","last_active":"2024-09-10T08:44:45.290090+0000","last_peered":"2024-09-10T08:44:45.290090+0000","last_clean":"2024-09-10T08:44:45.290090+0000","last_became_active":"2024-09-10T08:28:34.559911+0000","last_became_peered":"2024-09-10T08:28:34.559911+0000","last_unstale":"2024-09-10T08:44:45.290090+0000","last_undegraded":"2024-09-10T08:44:45.290090+0000","last_fullsized":"2024-09-10T08:44:45.290090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'61","last_scrub_stamp":"2024-09-10T08:44:45.289925+0000","last_deep_scrub":"27'61","last_deep_scrub_stamp":"2024-09-10T08:44:45.289925+0000","last_clean_scrub_stamp":"2024-09-10T08:44:45.289925+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:06.896795+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":129,"num_write":58,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:40.328286+0000","last_change":"2024-09-10T08:44:40.328312+0000","last_active":"2024-09-10T08:44:40.328286+0000","last_peered":"2024-09-10T08:44:40.328286+0000","last_clean":"2024-09-10T08:44:40.328286+0000","last_became_active":"2024-09-10T08:28:46.622790+0000","last_became_peered":"2024-09-10T08:28:46.622790+0000","last_unstale":"2024-09-10T08:44:40.328286+0000","last_undegraded":"2024-09-10T08:44:40.328286+0000","last_fullsized":"2024-09-10T08:44:40.328286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-10T08:44:40.327894+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-10T08:44:40.327894+0000","last_clean_scrub_stamp":"2024-09-10T08:44:40.327894+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:24.396479+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"27'4388","reported_seq":4420,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:06.422335+0000","last_change":"2024-09-10T08:45:06.422361+0000","last_active":"2024-09-10T08:45:06.422335+0000","last_peered":"2024-09-10T08:45:06.422335+0000","last_clean":"2024-09-10T08:45:06.422335+0000","last_became_active":"2024-09-10T08:28:47.634219+0000","last_became_peered":"2024-09-10T08:28:47.634219+0000","last_unstale":"2024-09-10T08:45:06.422335+0000","last_undegraded":"2024-09-10T08:45:06.422335+0000","last_fullsized":"2024-09-10T08:45:06.422335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4388","last_scrub_stamp":"2024-09-10T08:45:06.422235+0000","last_deep_scrub":"27'4388","last_deep_scrub_stamp":"2024-09-10T08:45:06.422235+0000","last_clean_scrub_stamp":"2024-09-10T08:45:06.422235+0000","objects_scrubbed":0,"log_size":4388,"log_dups_size":0,"ondisk_log_size":4388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:15.594122+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22741,"num_write_kb":291819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"27'4638","reported_seq":4679,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:50.945947+0000","last_change":"2024-09-10T08:44:50.945947+0000","last_active":"2024-09-10T08:44:50.945947+0000","last_peered":"2024-09-10T08:44:50.945947+0000","last_clean":"2024-09-10T08:44:50.945947+0000","last_became_active":"2024-09-10T08:28:35.576096+0000","last_became_peered":"2024-09-10T08:28:35.576096+0000","last_unstale":"2024-09-10T08:44:50.945947+0000","last_undegraded":"2024-09-10T08:44:50.945947+0000","last_fullsized":"2024-09-10T08:44:50.945947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4638","last_scrub_stamp":"2024-09-10T08:44:50.945827+0000","last_deep_scrub":"27'4638","last_deep_scrub_stamp":"2024-09-10T08:44:50.945827+0000","last_clean_scrub_stamp":"2024-09-10T08:44:50.945827+0000","objects_scrubbed":0,"log_size":4638,"log_dups_size":0,"ondisk_log_size":4638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:02.517203+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24206,"num_write_kb":293700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'5","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:56.938697+0000","last_change":"2024-09-10T08:44:56.938759+0000","last_active":"2024-09-10T08:44:56.938697+0000","last_peered":"2024-09-10T08:44:56.938697+0000","last_clean":"2024-09-10T08:44:56.938697+0000","last_became_active":"2024-09-10T08:28:34.568249+0000","last_became_peered":"2024-09-10T08:28:34.568249+0000","last_unstale":"2024-09-10T08:44:56.938697+0000","last_undegraded":"2024-09-10T08:44:56.938697+0000","last_fullsized":"2024-09-10T08:44:56.938697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-10T08:44:56.938588+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-10T08:44:56.938588+0000","last_clean_scrub_stamp":"2024-09-10T08:44:56.938588+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:42.544754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'606","reported_seq":640,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:52.983874+0000","last_change":"2024-09-10T08:44:52.983909+0000","last_active":"2024-09-10T08:44:52.983874+0000","last_peered":"2024-09-10T08:44:52.983874+0000","last_clean":"2024-09-10T08:44:52.983874+0000","last_became_active":"2024-09-10T08:28:46.621272+0000","last_became_peered":"2024-09-10T08:28:46.621272+0000","last_unstale":"2024-09-10T08:44:52.983874+0000","last_undegraded":"2024-09-10T08:44:52.983874+0000","last_fullsized":"2024-09-10T08:44:52.983874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'606","last_scrub_stamp":"2024-09-10T08:44:52.983778+0000","last_deep_scrub":"27'606","last_deep_scrub_stamp":"2024-09-10T08:44:52.983778+0000","last_clean_scrub_stamp":"2024-09-10T08:44:52.983778+0000","objects_scrubbed":1,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:20.350692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1451,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"27'4536","reported_seq":4568,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:05.821610+0000","last_change":"2024-09-10T08:45:05.821640+0000","last_active":"2024-09-10T08:45:05.821610+0000","last_peered":"2024-09-10T08:45:05.821610+0000","last_clean":"2024-09-10T08:45:05.821610+0000","last_became_active":"2024-09-10T08:28:47.631337+0000","last_became_peered":"2024-09-10T08:28:47.631337+0000","last_unstale":"2024-09-10T08:45:05.821610+0000","last_undegraded":"2024-09-10T08:45:05.821610+0000","last_fullsized":"2024-09-10T08:45:05.821610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4536","last_scrub_stamp":"2024-09-10T08:45:05.821508+0000","last_deep_scrub":"27'4536","last_deep_scrub_stamp":"2024-09-10T08:45:05.821508+0000","last_clean_scrub_stamp":"2024-09-10T08:45:05.821508+0000","objects_scrubbed":0,"log_size":4536,"log_dups_size":0,"ondisk_log_size":4536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:20.181129+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23763,"num_write_kb":304142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"27'4950","reported_seq":4991,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:58.556847+0000","last_change":"2024-09-10T08:44:58.556847+0000","last_active":"2024-09-10T08:44:58.556847+0000","last_peered":"2024-09-10T08:44:58.556847+0000","last_clean":"2024-09-10T08:44:58.556847+0000","last_became_active":"2024-09-10T08:28:35.571611+0000","last_became_peered":"2024-09-10T08:28:35.571611+0000","last_unstale":"2024-09-10T08:44:58.556847+0000","last_undegraded":"2024-09-10T08:44:58.556847+0000","last_fullsized":"2024-09-10T08:44:58.556847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4950","last_scrub_stamp":"2024-09-10T08:44:58.556676+0000","last_deep_scrub":"27'4950","last_deep_scrub_stamp":"2024-09-10T08:44:58.556676+0000","last_clean_scrub_stamp":"2024-09-10T08:44:58.556676+0000","objects_scrubbed":0,"log_size":4950,"log_dups_size":0,"ondisk_log_size":4950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:12.906091+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25652,"num_write_kb":316024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:54.165985+0000","last_change":"2024-09-10T08:44:54.165985+0000","last_active":"2024-09-10T08:44:54.165985+0000","last_peered":"2024-09-10T08:44:54.165985+0000","last_clean":"2024-09-10T08:44:54.165985+0000","last_became_active":"2024-09-10T08:28:34.555269+0000","last_became_peered":"2024-09-10T08:28:34.555269+0000","last_unstale":"2024-09-10T08:44:54.165985+0000","last_undegraded":"2024-09-10T08:44:54.165985+0000","last_fullsized":"2024-09-10T08:44:54.165985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-09-10T08:44:54.165846+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-09-10T08:44:54.165846+0000","last_clean_scrub_stamp":"2024-09-10T08:44:54.165846+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:32.232295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:54.931025+0000","last_change":"2024-09-10T08:44:54.931060+0000","last_active":"2024-09-10T08:44:54.931025+0000","last_peered":"2024-09-10T08:44:54.931025+0000","last_clean":"2024-09-10T08:44:54.931025+0000","last_became_active":"2024-09-10T08:28:26.723452+0000","last_became_peered":"2024-09-10T08:28:26.723452+0000","last_unstale":"2024-09-10T08:44:54.931025+0000","last_undegraded":"2024-09-10T08:44:54.931025+0000","last_fullsized":"2024-09-10T08:44:54.931025+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-09-10T08:44:54.930934+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-09-10T08:44:54.930934+0000","last_clean_scrub_stamp":"2024-09-10T08:44:54.930934+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:25.754459+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'4","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:55.180423+0000","last_change":"2024-09-10T08:44:55.180450+0000","last_active":"2024-09-10T08:44:55.180423+0000","last_peered":"2024-09-10T08:44:55.180423+0000","last_clean":"2024-09-10T08:44:55.180423+0000","last_became_active":"2024-09-10T08:28:46.621770+0000","last_became_peered":"2024-09-10T08:28:46.621770+0000","last_unstale":"2024-09-10T08:44:55.180423+0000","last_undegraded":"2024-09-10T08:44:55.180423+0000","last_fullsized":"2024-09-10T08:44:55.180423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-09-10T08:44:55.180331+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-09-10T08:44:55.180331+0000","last_clean_scrub_stamp":"2024-09-10T08:44:55.180331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:12.012732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"27'3353","reported_seq":3385,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:40.246178+0000","last_change":"2024-09-10T08:44:40.246217+0000","last_active":"2024-09-10T08:44:40.246178+0000","last_peered":"2024-09-10T08:44:40.246178+0000","last_clean":"2024-09-10T08:44:40.246178+0000","last_became_active":"2024-09-10T08:28:47.620492+0000","last_became_peered":"2024-09-10T08:28:47.620492+0000","last_unstale":"2024-09-10T08:44:40.246178+0000","last_undegraded":"2024-09-10T08:44:40.246178+0000","last_fullsized":"2024-09-10T08:44:40.246178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3353","last_scrub_stamp":"2024-09-10T08:44:40.246080+0000","last_deep_scrub":"27'3353","last_deep_scrub_stamp":"2024-09-10T08:44:40.246080+0000","last_clean_scrub_stamp":"2024-09-10T08:44:40.246080+0000","objects_scrubbed":0,"log_size":3353,"log_dups_size":0,"ondisk_log_size":3353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:49.803947+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16947,"num_write_kb":239873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'4450","reported_seq":4490,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:49.922336+0000","last_change":"2024-09-10T08:44:49.922361+0000","last_active":"2024-09-10T08:44:49.922336+0000","last_peered":"2024-09-10T08:44:49.922336+0000","last_clean":"2024-09-10T08:44:49.922336+0000","last_became_active":"2024-09-10T08:28:35.574215+0000","last_became_peered":"2024-09-10T08:28:35.574215+0000","last_unstale":"2024-09-10T08:44:49.922336+0000","last_undegraded":"2024-09-10T08:44:49.922336+0000","last_fullsized":"2024-09-10T08:44:49.922336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4450","last_scrub_stamp":"2024-09-10T08:44:49.922242+0000","last_deep_scrub":"27'4450","last_deep_scrub_stamp":"2024-09-10T08:44:49.922242+0000","last_clean_scrub_stamp":"2024-09-10T08:44:49.922242+0000","objects_scrubbed":0,"log_size":4450,"log_dups_size":0,"ondisk_log_size":4450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:18:37.398355+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23087,"num_write_kb":297343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'2","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:43.281825+0000","last_change":"2024-09-10T08:44:43.281885+0000","last_active":"2024-09-10T08:44:43.281825+0000","last_peered":"2024-09-10T08:44:43.281825+0000","last_clean":"2024-09-10T08:44:43.281825+0000","last_became_active":"2024-09-10T08:28:34.559635+0000","last_became_peered":"2024-09-10T08:28:34.559635+0000","last_unstale":"2024-09-10T08:44:43.281825+0000","last_undegraded":"2024-09-10T08:44:43.281825+0000","last_fullsized":"2024-09-10T08:44:43.281825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-09-10T08:44:43.281678+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-09-10T08:44:43.281678+0000","last_clean_scrub_stamp":"2024-09-10T08:44:43.281678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:17.194886+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'4","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:54.199149+0000","last_change":"2024-09-10T08:44:54.199175+0000","last_active":"2024-09-10T08:44:54.199149+0000","last_peered":"2024-09-10T08:44:54.199149+0000","last_clean":"2024-09-10T08:44:54.199149+0000","last_became_active":"2024-09-10T08:28:46.620064+0000","last_became_peered":"2024-09-10T08:28:46.620064+0000","last_unstale":"2024-09-10T08:44:54.199149+0000","last_undegraded":"2024-09-10T08:44:54.199149+0000","last_fullsized":"2024-09-10T08:44:54.199149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-09-10T08:44:54.199059+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-09-10T08:44:54.199059+0000","last_clean_scrub_stamp":"2024-09-10T08:44:54.199059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:58.722695+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"27'3678","reported_seq":3710,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:41.272528+0000","last_change":"2024-09-10T08:44:41.272576+0000","last_active":"2024-09-10T08:44:41.272528+0000","last_peered":"2024-09-10T08:44:41.272528+0000","last_clean":"2024-09-10T08:44:41.272528+0000","last_became_active":"2024-09-10T08:28:47.620014+0000","last_became_peered":"2024-09-10T08:28:47.620014+0000","last_unstale":"2024-09-10T08:44:41.272528+0000","last_undegraded":"2024-09-10T08:44:41.272528+0000","last_fullsized":"2024-09-10T08:44:41.272528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3678","last_scrub_stamp":"2024-09-10T08:44:41.272393+0000","last_deep_scrub":"27'3678","last_deep_scrub_stamp":"2024-09-10T08:44:41.272393+0000","last_clean_scrub_stamp":"2024-09-10T08:44:41.272393+0000","objects_scrubbed":0,"log_size":3678,"log_dups_size":0,"ondisk_log_size":3678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:33.535697+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19171,"num_write_kb":261286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'5065","reported_seq":5105,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:47.080414+0000","last_change":"2024-09-10T08:44:47.080443+0000","last_active":"2024-09-10T08:44:47.080414+0000","last_peered":"2024-09-10T08:44:47.080414+0000","last_clean":"2024-09-10T08:44:47.080414+0000","last_became_active":"2024-09-10T08:28:35.576655+0000","last_became_peered":"2024-09-10T08:28:35.576655+0000","last_unstale":"2024-09-10T08:44:47.080414+0000","last_undegraded":"2024-09-10T08:44:47.080414+0000","last_fullsized":"2024-09-10T08:44:47.080414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5065","last_scrub_stamp":"2024-09-10T08:44:47.080317+0000","last_deep_scrub":"27'5065","last_deep_scrub_stamp":"2024-09-10T08:44:47.080317+0000","last_clean_scrub_stamp":"2024-09-10T08:44:47.080317+0000","objects_scrubbed":0,"log_size":5065,"log_dups_size":0,"ondisk_log_size":5065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:43.618914+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26367,"num_write_kb":318681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:50.250088+0000","last_change":"2024-09-10T08:44:50.250116+0000","last_active":"2024-09-10T08:44:50.250088+0000","last_peered":"2024-09-10T08:44:50.250088+0000","last_clean":"2024-09-10T08:44:50.250088+0000","last_became_active":"2024-09-10T08:28:34.560429+0000","last_became_peered":"2024-09-10T08:28:34.560429+0000","last_unstale":"2024-09-10T08:44:50.250088+0000","last_undegraded":"2024-09-10T08:44:50.250088+0000","last_fullsized":"2024-09-10T08:44:50.250088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-10T08:44:50.250007+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-10T08:44:50.250007+0000","last_clean_scrub_stamp":"2024-09-10T08:44:50.250007+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:03.204208+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'1101","reported_seq":1135,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:53.977440+0000","last_change":"2024-09-10T08:44:53.977487+0000","last_active":"2024-09-10T08:44:53.977440+0000","last_peered":"2024-09-10T08:44:53.977440+0000","last_clean":"2024-09-10T08:44:53.977440+0000","last_became_active":"2024-09-10T08:28:46.621966+0000","last_became_peered":"2024-09-10T08:28:46.621966+0000","last_unstale":"2024-09-10T08:44:53.977440+0000","last_undegraded":"2024-09-10T08:44:53.977440+0000","last_fullsized":"2024-09-10T08:44:53.977440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1101","last_scrub_stamp":"2024-09-10T08:44:53.977349+0000","last_deep_scrub":"27'1101","last_deep_scrub_stamp":"2024-09-10T08:44:53.977349+0000","last_clean_scrub_stamp":"2024-09-10T08:44:53.977349+0000","objects_scrubbed":2,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:21.019883+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1090,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"27'4366","reported_seq":4398,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:03.803640+0000","last_change":"2024-09-10T08:45:03.803702+0000","last_active":"2024-09-10T08:45:03.803640+0000","last_peered":"2024-09-10T08:45:03.803640+0000","last_clean":"2024-09-10T08:45:03.803640+0000","last_became_active":"2024-09-10T08:28:47.630234+0000","last_became_peered":"2024-09-10T08:28:47.630234+0000","last_unstale":"2024-09-10T08:45:03.803640+0000","last_undegraded":"2024-09-10T08:45:03.803640+0000","last_fullsized":"2024-09-10T08:45:03.803640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4366","last_scrub_stamp":"2024-09-10T08:45:03.803490+0000","last_deep_scrub":"27'4366","last_deep_scrub_stamp":"2024-09-10T08:45:03.803490+0000","last_clean_scrub_stamp":"2024-09-10T08:45:03.803490+0000","objects_scrubbed":0,"log_size":4366,"log_dups_size":0,"ondisk_log_size":4366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:14.286613+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22466,"num_write_kb":282639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"27'5771","reported_seq":5811,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:42.932772+0000","last_change":"2024-09-10T08:44:42.932801+0000","last_active":"2024-09-10T08:44:42.932772+0000","last_peered":"2024-09-10T08:44:42.932772+0000","last_clean":"2024-09-10T08:44:42.932772+0000","last_became_active":"2024-09-10T08:28:35.576686+0000","last_became_peered":"2024-09-10T08:28:35.576686+0000","last_unstale":"2024-09-10T08:44:42.932772+0000","last_undegraded":"2024-09-10T08:44:42.932772+0000","last_fullsized":"2024-09-10T08:44:42.932772+0000","mapping_epoch":19,"log_start":"27'100","ondisk_log_start":"27'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5771","last_scrub_stamp":"2024-09-10T08:44:42.932632+0000","last_deep_scrub":"27'5771","last_deep_scrub_stamp":"2024-09-10T08:44:42.932632+0000","last_clean_scrub_stamp":"2024-09-10T08:44:42.932632+0000","objects_scrubbed":0,"log_size":5671,"log_dups_size":0,"ondisk_log_size":5671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:20.436060+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29457,"num_write_kb":355657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'7","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:44.308075+0000","last_change":"2024-09-10T08:44:44.308108+0000","last_active":"2024-09-10T08:44:44.308075+0000","last_peered":"2024-09-10T08:44:44.308075+0000","last_clean":"2024-09-10T08:44:44.308075+0000","last_became_active":"2024-09-10T08:28:34.560035+0000","last_became_peered":"2024-09-10T08:28:34.560035+0000","last_unstale":"2024-09-10T08:44:44.308075+0000","last_undegraded":"2024-09-10T08:44:44.308075+0000","last_fullsized":"2024-09-10T08:44:44.308075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-09-10T08:44:44.307983+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-09-10T08:44:44.307983+0000","last_clean_scrub_stamp":"2024-09-10T08:44:44.307983+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:57.415585+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'3","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:46.058815+0000","last_change":"2024-09-10T08:44:46.058839+0000","last_active":"2024-09-10T08:44:46.058815+0000","last_peered":"2024-09-10T08:44:46.058815+0000","last_clean":"2024-09-10T08:44:46.058815+0000","last_became_active":"2024-09-10T08:28:46.623092+0000","last_became_peered":"2024-09-10T08:28:46.623092+0000","last_unstale":"2024-09-10T08:44:46.058815+0000","last_undegraded":"2024-09-10T08:44:46.058815+0000","last_fullsized":"2024-09-10T08:44:46.058815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-10T08:44:46.058724+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-10T08:44:46.058724+0000","last_clean_scrub_stamp":"2024-09-10T08:44:46.058724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:46.873577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"27'4470","reported_seq":4502,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:48.311452+0000","last_change":"2024-09-10T08:44:48.311490+0000","last_active":"2024-09-10T08:44:48.311452+0000","last_peered":"2024-09-10T08:44:48.311452+0000","last_clean":"2024-09-10T08:44:48.311452+0000","last_became_active":"2024-09-10T08:28:47.619452+0000","last_became_peered":"2024-09-10T08:28:47.619452+0000","last_unstale":"2024-09-10T08:44:48.311452+0000","last_undegraded":"2024-09-10T08:44:48.311452+0000","last_fullsized":"2024-09-10T08:44:48.311452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4470","last_scrub_stamp":"2024-09-10T08:44:48.311335+0000","last_deep_scrub":"27'4470","last_deep_scrub_stamp":"2024-09-10T08:44:48.311335+0000","last_clean_scrub_stamp":"2024-09-10T08:44:48.311335+0000","objects_scrubbed":0,"log_size":4470,"log_dups_size":0,"ondisk_log_size":4470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:47.034132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23926,"num_write_kb":300839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"27'4014","reported_seq":4054,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:41.954585+0000","last_change":"2024-09-10T08:44:41.954613+0000","last_active":"2024-09-10T08:44:41.954585+0000","last_peered":"2024-09-10T08:44:41.954585+0000","last_clean":"2024-09-10T08:44:41.954585+0000","last_became_active":"2024-09-10T08:28:35.576786+0000","last_became_peered":"2024-09-10T08:28:35.576786+0000","last_unstale":"2024-09-10T08:44:41.954585+0000","last_undegraded":"2024-09-10T08:44:41.954585+0000","last_fullsized":"2024-09-10T08:44:41.954585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4014","last_scrub_stamp":"2024-09-10T08:44:41.954485+0000","last_deep_scrub":"27'4014","last_deep_scrub_stamp":"2024-09-10T08:44:41.954485+0000","last_clean_scrub_stamp":"2024-09-10T08:44:41.954485+0000","objects_scrubbed":0,"log_size":4014,"log_dups_size":0,"ondisk_log_size":4014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:13.716238+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19823,"num_write_kb":276089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'6","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:47.427214+0000","last_change":"2024-09-10T08:44:47.427247+0000","last_active":"2024-09-10T08:44:47.427214+0000","last_peered":"2024-09-10T08:44:47.427214+0000","last_clean":"2024-09-10T08:44:47.427214+0000","last_became_active":"2024-09-10T08:28:34.550773+0000","last_became_peered":"2024-09-10T08:28:34.550773+0000","last_unstale":"2024-09-10T08:44:47.427214+0000","last_undegraded":"2024-09-10T08:44:47.427214+0000","last_fullsized":"2024-09-10T08:44:47.427214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-09-10T08:44:47.427124+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-09-10T08:44:47.427124+0000","last_clean_scrub_stamp":"2024-09-10T08:44:47.427124+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:07.750733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'3","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:42.592046+0000","last_change":"2024-09-10T08:44:42.592078+0000","last_active":"2024-09-10T08:44:42.592046+0000","last_peered":"2024-09-10T08:44:42.592046+0000","last_clean":"2024-09-10T08:44:42.592046+0000","last_became_active":"2024-09-10T08:28:46.619330+0000","last_became_peered":"2024-09-10T08:28:46.619330+0000","last_unstale":"2024-09-10T08:44:42.592046+0000","last_undegraded":"2024-09-10T08:44:42.592046+0000","last_fullsized":"2024-09-10T08:44:42.592046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-10T08:44:42.591946+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-10T08:44:42.591946+0000","last_clean_scrub_stamp":"2024-09-10T08:44:42.591946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:33.628156+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"27'3797","reported_seq":3828,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:09.725129+0000","last_change":"2024-09-10T08:45:09.725178+0000","last_active":"2024-09-10T08:45:09.725129+0000","last_peered":"2024-09-10T08:45:09.725129+0000","last_clean":"2024-09-10T08:45:09.725129+0000","last_became_active":"2024-09-10T08:28:47.633362+0000","last_became_peered":"2024-09-10T08:28:47.633362+0000","last_unstale":"2024-09-10T08:45:09.725129+0000","last_undegraded":"2024-09-10T08:45:09.725129+0000","last_fullsized":"2024-09-10T08:45:09.725129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3797","last_scrub_stamp":"2024-09-10T08:45:09.725014+0000","last_deep_scrub":"27'3797","last_deep_scrub_stamp":"2024-09-10T08:45:09.725014+0000","last_clean_scrub_stamp":"2024-09-10T08:45:09.725014+0000","objects_scrubbed":0,"log_size":3797,"log_dups_size":0,"ondisk_log_size":3797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:17:57.337079+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19693,"num_write_kb":255099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"27'4998","reported_seq":5038,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:47.945239+0000","last_change":"2024-09-10T08:44:47.945239+0000","last_active":"2024-09-10T08:44:47.945239+0000","last_peered":"2024-09-10T08:44:47.945239+0000","last_clean":"2024-09-10T08:44:47.945239+0000","last_became_active":"2024-09-10T08:28:35.575038+0000","last_became_peered":"2024-09-10T08:28:35.575038+0000","last_unstale":"2024-09-10T08:44:47.945239+0000","last_undegraded":"2024-09-10T08:44:47.945239+0000","last_fullsized":"2024-09-10T08:44:47.945239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4998","last_scrub_stamp":"2024-09-10T08:44:47.945097+0000","last_deep_scrub":"27'4998","last_deep_scrub_stamp":"2024-09-10T08:44:47.945097+0000","last_clean_scrub_stamp":"2024-09-10T08:44:47.945097+0000","objects_scrubbed":0,"log_size":4998,"log_dups_size":0,"ondisk_log_size":4998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:19.611238+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25962,"num_write_kb":304804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'15","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:42.238910+0000","last_change":"2024-09-10T08:44:42.238910+0000","last_active":"2024-09-10T08:44:42.238910+0000","last_peered":"2024-09-10T08:44:42.238910+0000","last_clean":"2024-09-10T08:44:42.238910+0000","last_became_active":"2024-09-10T08:28:34.555179+0000","last_became_peered":"2024-09-10T08:28:34.555179+0000","last_unstale":"2024-09-10T08:44:42.238910+0000","last_undegraded":"2024-09-10T08:44:42.238910+0000","last_fullsized":"2024-09-10T08:44:42.238910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-09-10T08:44:42.238791+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-09-10T08:44:42.238791+0000","last_clean_scrub_stamp":"2024-09-10T08:44:42.238791+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:19:31.270198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:41.895958+0000","last_change":"2024-09-10T08:44:41.895998+0000","last_active":"2024-09-10T08:44:41.895958+0000","last_peered":"2024-09-10T08:44:41.895958+0000","last_clean":"2024-09-10T08:44:41.895958+0000","last_became_active":"2024-09-10T08:28:46.618318+0000","last_became_peered":"2024-09-10T08:28:46.618318+0000","last_unstale":"2024-09-10T08:44:41.895958+0000","last_undegraded":"2024-09-10T08:44:41.895958+0000","last_fullsized":"2024-09-10T08:44:41.895958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-09-10T08:44:41.895839+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-09-10T08:44:41.895839+0000","last_clean_scrub_stamp":"2024-09-10T08:44:41.895839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:13.389899+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"27'4510","reported_seq":4541,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:01.380175+0000","last_change":"2024-09-10T08:45:01.380199+0000","last_active":"2024-09-10T08:45:01.380175+0000","last_peered":"2024-09-10T08:45:01.380175+0000","last_clean":"2024-09-10T08:45:01.380175+0000","last_became_active":"2024-09-10T08:28:47.624230+0000","last_became_peered":"2024-09-10T08:28:47.624230+0000","last_unstale":"2024-09-10T08:45:01.380175+0000","last_undegraded":"2024-09-10T08:45:01.380175+0000","last_fullsized":"2024-09-10T08:45:01.380175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4510","last_scrub_stamp":"2024-09-10T08:45:01.380042+0000","last_deep_scrub":"27'4510","last_deep_scrub_stamp":"2024-09-10T08:45:01.380042+0000","last_clean_scrub_stamp":"2024-09-10T08:45:01.380042+0000","objects_scrubbed":0,"log_size":4510,"log_dups_size":0,"ondisk_log_size":4510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:41.550513+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23053,"num_write_kb":297434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'5001","reported_seq":5041,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:42.168528+0000","last_change":"2024-09-10T08:44:42.168528+0000","last_active":"2024-09-10T08:44:42.168528+0000","last_peered":"2024-09-10T08:44:42.168528+0000","last_clean":"2024-09-10T08:44:42.168528+0000","last_became_active":"2024-09-10T08:28:35.578299+0000","last_became_peered":"2024-09-10T08:28:35.578299+0000","last_unstale":"2024-09-10T08:44:42.168528+0000","last_undegraded":"2024-09-10T08:44:42.168528+0000","last_fullsized":"2024-09-10T08:44:42.168528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5001","last_scrub_stamp":"2024-09-10T08:44:42.168397+0000","last_deep_scrub":"27'5001","last_deep_scrub_stamp":"2024-09-10T08:44:42.168397+0000","last_clean_scrub_stamp":"2024-09-10T08:44:42.168397+0000","objects_scrubbed":0,"log_size":5001,"log_dups_size":0,"ondisk_log_size":5001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:12.471816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25723,"num_write_kb":320130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'6","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:47.230645+0000","last_change":"2024-09-10T08:44:47.230645+0000","last_active":"2024-09-10T08:44:47.230645+0000","last_peered":"2024-09-10T08:44:47.230645+0000","last_clean":"2024-09-10T08:44:47.230645+0000","last_became_active":"2024-09-10T08:28:34.560188+0000","last_became_peered":"2024-09-10T08:28:34.560188+0000","last_unstale":"2024-09-10T08:44:47.230645+0000","last_undegraded":"2024-09-10T08:44:47.230645+0000","last_fullsized":"2024-09-10T08:44:47.230645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-09-10T08:44:47.230520+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-09-10T08:44:47.230520+0000","last_clean_scrub_stamp":"2024-09-10T08:44:47.230520+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:14.843454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:46.716514+0000","last_change":"2024-09-10T08:44:46.716547+0000","last_active":"2024-09-10T08:44:46.716514+0000","last_peered":"2024-09-10T08:44:46.716514+0000","last_clean":"2024-09-10T08:44:46.716514+0000","last_became_active":"2024-09-10T08:28:46.623211+0000","last_became_peered":"2024-09-10T08:28:46.623211+0000","last_unstale":"2024-09-10T08:44:46.716514+0000","last_undegraded":"2024-09-10T08:44:46.716514+0000","last_fullsized":"2024-09-10T08:44:46.716514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-09-10T08:44:46.716401+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-09-10T08:44:46.716401+0000","last_clean_scrub_stamp":"2024-09-10T08:44:46.716401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:53.625657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"27'4287","reported_seq":4318,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:07.425767+0000","last_change":"2024-09-10T08:45:07.425814+0000","last_active":"2024-09-10T08:45:07.425767+0000","last_peered":"2024-09-10T08:45:07.425767+0000","last_clean":"2024-09-10T08:45:07.425767+0000","last_became_active":"2024-09-10T08:28:47.634782+0000","last_became_peered":"2024-09-10T08:28:47.634782+0000","last_unstale":"2024-09-10T08:45:07.425767+0000","last_undegraded":"2024-09-10T08:45:07.425767+0000","last_fullsized":"2024-09-10T08:45:07.425767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4287","last_scrub_stamp":"2024-09-10T08:45:07.425641+0000","last_deep_scrub":"27'4287","last_deep_scrub_stamp":"2024-09-10T08:45:07.425641+0000","last_clean_scrub_stamp":"2024-09-10T08:45:07.425641+0000","objects_scrubbed":0,"log_size":4287,"log_dups_size":0,"ondisk_log_size":4287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:28.610632+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22519,"num_write_kb":282718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'5007","reported_seq":5047,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:46.057655+0000","last_change":"2024-09-10T08:44:46.057655+0000","last_active":"2024-09-10T08:44:46.057655+0000","last_peered":"2024-09-10T08:44:46.057655+0000","last_clean":"2024-09-10T08:44:46.057655+0000","last_became_active":"2024-09-10T08:28:35.575333+0000","last_became_peered":"2024-09-10T08:28:35.575333+0000","last_unstale":"2024-09-10T08:44:46.057655+0000","last_undegraded":"2024-09-10T08:44:46.057655+0000","last_fullsized":"2024-09-10T08:44:46.057655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5007","last_scrub_stamp":"2024-09-10T08:44:46.057467+0000","last_deep_scrub":"27'5007","last_deep_scrub_stamp":"2024-09-10T08:44:46.057467+0000","last_clean_scrub_stamp":"2024-09-10T08:44:46.057467+0000","objects_scrubbed":0,"log_size":5007,"log_dups_size":0,"ondisk_log_size":5007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:33.426082+0000","scrub_duration":139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25404,"num_write_kb":331142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:55.171909+0000","last_change":"2024-09-10T08:44:55.171909+0000","last_active":"2024-09-10T08:44:55.171909+0000","last_peered":"2024-09-10T08:44:55.171909+0000","last_clean":"2024-09-10T08:44:55.171909+0000","last_became_active":"2024-09-10T08:28:34.560376+0000","last_became_peered":"2024-09-10T08:28:34.560376+0000","last_unstale":"2024-09-10T08:44:55.171909+0000","last_undegraded":"2024-09-10T08:44:55.171909+0000","last_fullsized":"2024-09-10T08:44:55.171909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-10T08:44:55.171731+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-10T08:44:55.171731+0000","last_clean_scrub_stamp":"2024-09-10T08:44:55.171731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:21.178056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'330","reported_seq":364,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:42.853697+0000","last_change":"2024-09-10T08:44:42.853697+0000","last_active":"2024-09-10T08:44:42.853697+0000","last_peered":"2024-09-10T08:44:42.853697+0000","last_clean":"2024-09-10T08:44:42.853697+0000","last_became_active":"2024-09-10T08:28:46.619030+0000","last_became_peered":"2024-09-10T08:28:46.619030+0000","last_unstale":"2024-09-10T08:44:42.853697+0000","last_undegraded":"2024-09-10T08:44:42.853697+0000","last_fullsized":"2024-09-10T08:44:42.853697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'330","last_scrub_stamp":"2024-09-10T08:44:42.853564+0000","last_deep_scrub":"27'330","last_deep_scrub_stamp":"2024-09-10T08:44:42.853564+0000","last_clean_scrub_stamp":"2024-09-10T08:44:42.853564+0000","objects_scrubbed":4,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:34.426242+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":4249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"27'6390","reported_seq":6422,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:03.645199+0000","last_change":"2024-09-10T08:45:03.645199+0000","last_active":"2024-09-10T08:45:03.645199+0000","last_peered":"2024-09-10T08:45:03.645199+0000","last_clean":"2024-09-10T08:45:03.645199+0000","last_became_active":"2024-09-10T08:28:47.626330+0000","last_became_peered":"2024-09-10T08:28:47.626330+0000","last_unstale":"2024-09-10T08:45:03.645199+0000","last_undegraded":"2024-09-10T08:45:03.645199+0000","last_fullsized":"2024-09-10T08:45:03.645199+0000","mapping_epoch":23,"log_start":"27'1200","ondisk_log_start":"27'1200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6390","last_scrub_stamp":"2024-09-10T08:45:03.645085+0000","last_deep_scrub":"27'6390","last_deep_scrub_stamp":"2024-09-10T08:45:03.645085+0000","last_clean_scrub_stamp":"2024-09-10T08:45:03.645085+0000","objects_scrubbed":0,"log_size":5190,"log_dups_size":0,"ondisk_log_size":5190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:20.173193+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33857,"num_write_kb":406580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'4502","reported_seq":4542,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:47.975843+0000","last_change":"2024-09-10T08:44:47.975843+0000","last_active":"2024-09-10T08:44:47.975843+0000","last_peered":"2024-09-10T08:44:47.975843+0000","last_clean":"2024-09-10T08:44:47.975843+0000","last_became_active":"2024-09-10T08:28:35.574567+0000","last_became_peered":"2024-09-10T08:28:35.574567+0000","last_unstale":"2024-09-10T08:44:47.975843+0000","last_undegraded":"2024-09-10T08:44:47.975843+0000","last_fullsized":"2024-09-10T08:44:47.975843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4502","last_scrub_stamp":"2024-09-10T08:44:47.975716+0000","last_deep_scrub":"27'4502","last_deep_scrub_stamp":"2024-09-10T08:44:47.975716+0000","last_clean_scrub_stamp":"2024-09-10T08:44:47.975716+0000","objects_scrubbed":0,"log_size":4502,"log_dups_size":0,"ondisk_log_size":4502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:33.824797+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23284,"num_write_kb":285817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'10","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:43.935520+0000","last_change":"2024-09-10T08:44:43.935520+0000","last_active":"2024-09-10T08:44:43.935520+0000","last_peered":"2024-09-10T08:44:43.935520+0000","last_clean":"2024-09-10T08:44:43.935520+0000","last_became_active":"2024-09-10T08:28:34.553275+0000","last_became_peered":"2024-09-10T08:28:34.553275+0000","last_unstale":"2024-09-10T08:44:43.935520+0000","last_undegraded":"2024-09-10T08:44:43.935520+0000","last_fullsized":"2024-09-10T08:44:43.935520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-09-10T08:44:43.935392+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-09-10T08:44:43.935392+0000","last_clean_scrub_stamp":"2024-09-10T08:44:43.935392+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:27.366592+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'31","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:44.137301+0000","last_change":"2024-09-10T08:44:44.137334+0000","last_active":"2024-09-10T08:44:44.137301+0000","last_peered":"2024-09-10T08:44:44.137301+0000","last_clean":"2024-09-10T08:44:44.137301+0000","last_became_active":"2024-09-10T08:28:46.619165+0000","last_became_peered":"2024-09-10T08:28:46.619165+0000","last_unstale":"2024-09-10T08:44:44.137301+0000","last_undegraded":"2024-09-10T08:44:44.137301+0000","last_fullsized":"2024-09-10T08:44:44.137301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-09-10T08:44:44.137207+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-09-10T08:44:44.137207+0000","last_clean_scrub_stamp":"2024-09-10T08:44:44.137207+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:27.655450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"27'5339","reported_seq":5371,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:50.642393+0000","last_change":"2024-09-10T08:44:50.642393+0000","last_active":"2024-09-10T08:44:50.642393+0000","last_peered":"2024-09-10T08:44:50.642393+0000","last_clean":"2024-09-10T08:44:50.642393+0000","last_became_active":"2024-09-10T08:28:47.619661+0000","last_became_peered":"2024-09-10T08:28:47.619661+0000","last_unstale":"2024-09-10T08:44:50.642393+0000","last_undegraded":"2024-09-10T08:44:50.642393+0000","last_fullsized":"2024-09-10T08:44:50.642393+0000","mapping_epoch":23,"log_start":"27'100","ondisk_log_start":"27'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5339","last_scrub_stamp":"2024-09-10T08:44:50.642265+0000","last_deep_scrub":"27'5339","last_deep_scrub_stamp":"2024-09-10T08:44:50.642265+0000","last_clean_scrub_stamp":"2024-09-10T08:44:50.642265+0000","objects_scrubbed":0,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:29.034369+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27578,"num_write_kb":340014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'4089","reported_seq":4128,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:46.941504+0000","last_change":"2024-09-10T08:44:46.941532+0000","last_active":"2024-09-10T08:44:46.941504+0000","last_peered":"2024-09-10T08:44:46.941504+0000","last_clean":"2024-09-10T08:44:46.941504+0000","last_became_active":"2024-09-10T08:28:35.582205+0000","last_became_peered":"2024-09-10T08:28:35.582205+0000","last_unstale":"2024-09-10T08:44:46.941504+0000","last_undegraded":"2024-09-10T08:44:46.941504+0000","last_fullsized":"2024-09-10T08:44:46.941504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4089","last_scrub_stamp":"2024-09-10T08:44:46.941400+0000","last_deep_scrub":"27'4089","last_deep_scrub_stamp":"2024-09-10T08:44:46.941400+0000","last_clean_scrub_stamp":"2024-09-10T08:44:46.941400+0000","objects_scrubbed":0,"log_size":4089,"log_dups_size":0,"ondisk_log_size":4089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:28.604207+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21083,"num_write_kb":276854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'308","reported_seq":350,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:46.199737+0000","last_change":"2024-09-10T08:44:46.199737+0000","last_active":"2024-09-10T08:44:46.199737+0000","last_peered":"2024-09-10T08:44:46.199737+0000","last_clean":"2024-09-10T08:44:46.199737+0000","last_became_active":"2024-09-10T08:28:34.559560+0000","last_became_peered":"2024-09-10T08:28:34.559560+0000","last_unstale":"2024-09-10T08:44:46.199737+0000","last_undegraded":"2024-09-10T08:44:46.199737+0000","last_fullsized":"2024-09-10T08:44:46.199737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'308","last_scrub_stamp":"2024-09-10T08:44:46.199620+0000","last_deep_scrub":"27'308","last_deep_scrub_stamp":"2024-09-10T08:44:46.199620+0000","last_clean_scrub_stamp":"2024-09-10T08:44:46.199620+0000","objects_scrubbed":4,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:39.516369+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":301,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:46.346725+0000","last_change":"2024-09-10T08:44:46.346725+0000","last_active":"2024-09-10T08:44:46.346725+0000","last_peered":"2024-09-10T08:44:46.346725+0000","last_clean":"2024-09-10T08:44:46.346725+0000","last_became_active":"2024-09-10T08:28:46.627819+0000","last_became_peered":"2024-09-10T08:28:46.627819+0000","last_unstale":"2024-09-10T08:44:46.346725+0000","last_undegraded":"2024-09-10T08:44:46.346725+0000","last_fullsized":"2024-09-10T08:44:46.346725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-09-10T08:44:46.346577+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-09-10T08:44:46.346577+0000","last_clean_scrub_stamp":"2024-09-10T08:44:46.346577+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:32.453969+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"27'3973","reported_seq":4005,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:58.128744+0000","last_change":"2024-09-10T08:44:58.128744+0000","last_active":"2024-09-10T08:44:58.128744+0000","last_peered":"2024-09-10T08:44:58.128744+0000","last_clean":"2024-09-10T08:44:58.128744+0000","last_became_active":"2024-09-10T08:28:47.627775+0000","last_became_peered":"2024-09-10T08:28:47.627775+0000","last_unstale":"2024-09-10T08:44:58.128744+0000","last_undegraded":"2024-09-10T08:44:58.128744+0000","last_fullsized":"2024-09-10T08:44:58.128744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3973","last_scrub_stamp":"2024-09-10T08:44:58.128587+0000","last_deep_scrub":"27'3973","last_deep_scrub_stamp":"2024-09-10T08:44:58.128587+0000","last_clean_scrub_stamp":"2024-09-10T08:44:58.128587+0000","objects_scrubbed":0,"log_size":3973,"log_dups_size":0,"ondisk_log_size":3973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:29.789715+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20759,"num_write_kb":275665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'6218","reported_seq":6258,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:51.453979+0000","last_change":"2024-09-10T08:44:51.453979+0000","last_active":"2024-09-10T08:44:51.453979+0000","last_peered":"2024-09-10T08:44:51.453979+0000","last_clean":"2024-09-10T08:44:51.453979+0000","last_became_active":"2024-09-10T08:28:35.570711+0000","last_became_peered":"2024-09-10T08:28:35.570711+0000","last_unstale":"2024-09-10T08:44:51.453979+0000","last_undegraded":"2024-09-10T08:44:51.453979+0000","last_fullsized":"2024-09-10T08:44:51.453979+0000","mapping_epoch":19,"log_start":"27'700","ondisk_log_start":"27'700","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6218","last_scrub_stamp":"2024-09-10T08:44:51.453840+0000","last_deep_scrub":"27'6218","last_deep_scrub_stamp":"2024-09-10T08:44:51.453840+0000","last_clean_scrub_stamp":"2024-09-10T08:44:51.453840+0000","objects_scrubbed":0,"log_size":5518,"log_dups_size":0,"ondisk_log_size":5518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:11.132906+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31535,"num_write_kb":397056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'37","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:49.297803+0000","last_change":"2024-09-10T08:44:49.297832+0000","last_active":"2024-09-10T08:44:49.297803+0000","last_peered":"2024-09-10T08:44:49.297803+0000","last_clean":"2024-09-10T08:44:49.297803+0000","last_became_active":"2024-09-10T08:28:34.557076+0000","last_became_peered":"2024-09-10T08:28:34.557076+0000","last_unstale":"2024-09-10T08:44:49.297803+0000","last_undegraded":"2024-09-10T08:44:49.297803+0000","last_fullsized":"2024-09-10T08:44:49.297803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2024-09-10T08:44:49.297719+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2024-09-10T08:44:49.297719+0000","last_clean_scrub_stamp":"2024-09-10T08:44:49.297719+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:48:45.895217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'10","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:53.411705+0000","last_change":"2024-09-10T08:44:53.411705+0000","last_active":"2024-09-10T08:44:53.411705+0000","last_peered":"2024-09-10T08:44:53.411705+0000","last_clean":"2024-09-10T08:44:53.411705+0000","last_became_active":"2024-09-10T08:28:46.615451+0000","last_became_peered":"2024-09-10T08:28:46.615451+0000","last_unstale":"2024-09-10T08:44:53.411705+0000","last_undegraded":"2024-09-10T08:44:53.411705+0000","last_fullsized":"2024-09-10T08:44:53.411705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-09-10T08:44:53.411570+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-09-10T08:44:53.411570+0000","last_clean_scrub_stamp":"2024-09-10T08:44:53.411570+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:55.535421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"27'4284","reported_seq":4316,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:57.174762+0000","last_change":"2024-09-10T08:44:57.174762+0000","last_active":"2024-09-10T08:44:57.174762+0000","last_peered":"2024-09-10T08:44:57.174762+0000","last_clean":"2024-09-10T08:44:57.174762+0000","last_became_active":"2024-09-10T08:28:47.622961+0000","last_became_peered":"2024-09-10T08:28:47.622961+0000","last_unstale":"2024-09-10T08:44:57.174762+0000","last_undegraded":"2024-09-10T08:44:57.174762+0000","last_fullsized":"2024-09-10T08:44:57.174762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4284","last_scrub_stamp":"2024-09-10T08:44:57.174608+0000","last_deep_scrub":"27'4284","last_deep_scrub_stamp":"2024-09-10T08:44:57.174608+0000","last_clean_scrub_stamp":"2024-09-10T08:44:57.174608+0000","objects_scrubbed":0,"log_size":4284,"log_dups_size":0,"ondisk_log_size":4284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:17.791121+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23423,"num_write_kb":294728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"27'3896","reported_seq":3935,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:38.878248+0000","last_change":"2024-09-10T08:44:38.878270+0000","last_active":"2024-09-10T08:44:38.878248+0000","last_peered":"2024-09-10T08:44:38.878248+0000","last_clean":"2024-09-10T08:44:38.878248+0000","last_became_active":"2024-09-10T08:28:35.577255+0000","last_became_peered":"2024-09-10T08:28:35.577255+0000","last_unstale":"2024-09-10T08:44:38.878248+0000","last_undegraded":"2024-09-10T08:44:38.878248+0000","last_fullsized":"2024-09-10T08:44:38.878248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3896","last_scrub_stamp":"2024-09-10T08:44:38.878177+0000","last_deep_scrub":"27'3896","last_deep_scrub_stamp":"2024-09-10T08:44:38.878177+0000","last_clean_scrub_stamp":"2024-09-10T08:44:38.878177+0000","objects_scrubbed":0,"log_size":3896,"log_dups_size":0,"ondisk_log_size":3896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:37.246919+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19770,"num_write_kb":255291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'2","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:56.209108+0000","last_change":"2024-09-10T08:44:56.209134+0000","last_active":"2024-09-10T08:44:56.209108+0000","last_peered":"2024-09-10T08:44:56.209108+0000","last_clean":"2024-09-10T08:44:56.209108+0000","last_became_active":"2024-09-10T08:28:34.564189+0000","last_became_peered":"2024-09-10T08:28:34.564189+0000","last_unstale":"2024-09-10T08:44:56.209108+0000","last_undegraded":"2024-09-10T08:44:56.209108+0000","last_fullsized":"2024-09-10T08:44:56.209108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-09-10T08:44:56.209016+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-09-10T08:44:56.209016+0000","last_clean_scrub_stamp":"2024-09-10T08:44:56.209016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:57.531020+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'16","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:43.849935+0000","last_change":"2024-09-10T08:44:43.849935+0000","last_active":"2024-09-10T08:44:43.849935+0000","last_peered":"2024-09-10T08:44:43.849935+0000","last_clean":"2024-09-10T08:44:43.849935+0000","last_became_active":"2024-09-10T08:28:46.618625+0000","last_became_peered":"2024-09-10T08:28:46.618625+0000","last_unstale":"2024-09-10T08:44:43.849935+0000","last_undegraded":"2024-09-10T08:44:43.849935+0000","last_fullsized":"2024-09-10T08:44:43.849935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-09-10T08:44:43.849781+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-09-10T08:44:43.849781+0000","last_clean_scrub_stamp":"2024-09-10T08:44:43.849781+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:09.392025+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"27'4685","reported_seq":4717,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:02.785349+0000","last_change":"2024-09-10T08:45:02.785349+0000","last_active":"2024-09-10T08:45:02.785349+0000","last_peered":"2024-09-10T08:45:02.785349+0000","last_clean":"2024-09-10T08:45:02.785349+0000","last_became_active":"2024-09-10T08:28:47.629869+0000","last_became_peered":"2024-09-10T08:28:47.629869+0000","last_unstale":"2024-09-10T08:45:02.785349+0000","last_undegraded":"2024-09-10T08:45:02.785349+0000","last_fullsized":"2024-09-10T08:45:02.785349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4685","last_scrub_stamp":"2024-09-10T08:45:02.785212+0000","last_deep_scrub":"27'4685","last_deep_scrub_stamp":"2024-09-10T08:45:02.785212+0000","last_clean_scrub_stamp":"2024-09-10T08:45:02.785212+0000","objects_scrubbed":0,"log_size":4685,"log_dups_size":0,"ondisk_log_size":4685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:53.542306+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24572,"num_write_kb":315590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'4682","reported_seq":4721,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:51.059197+0000","last_change":"2024-09-10T08:44:51.059224+0000","last_active":"2024-09-10T08:44:51.059197+0000","last_peered":"2024-09-10T08:44:51.059197+0000","last_clean":"2024-09-10T08:44:51.059197+0000","last_became_active":"2024-09-10T08:28:35.572620+0000","last_became_peered":"2024-09-10T08:28:35.572620+0000","last_unstale":"2024-09-10T08:44:51.059197+0000","last_undegraded":"2024-09-10T08:44:51.059197+0000","last_fullsized":"2024-09-10T08:44:51.059197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4682","last_scrub_stamp":"2024-09-10T08:44:51.059094+0000","last_deep_scrub":"27'4682","last_deep_scrub_stamp":"2024-09-10T08:44:51.059094+0000","last_clean_scrub_stamp":"2024-09-10T08:44:51.059094+0000","objects_scrubbed":0,"log_size":4682,"log_dups_size":0,"ondisk_log_size":4682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:23:04.719958+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24219,"num_write_kb":302042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'2","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:49.162599+0000","last_change":"2024-09-10T08:44:49.162626+0000","last_active":"2024-09-10T08:44:49.162599+0000","last_peered":"2024-09-10T08:44:49.162599+0000","last_clean":"2024-09-10T08:44:49.162599+0000","last_became_active":"2024-09-10T08:28:34.562647+0000","last_became_peered":"2024-09-10T08:28:34.562647+0000","last_unstale":"2024-09-10T08:44:49.162599+0000","last_undegraded":"2024-09-10T08:44:49.162599+0000","last_fullsized":"2024-09-10T08:44:49.162599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-09-10T08:44:49.162508+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-09-10T08:44:49.162508+0000","last_clean_scrub_stamp":"2024-09-10T08:44:49.162508+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:53.095206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:44.801766+0000","last_change":"2024-09-10T08:44:44.801766+0000","last_active":"2024-09-10T08:44:44.801766+0000","last_peered":"2024-09-10T08:44:44.801766+0000","last_clean":"2024-09-10T08:44:44.801766+0000","last_became_active":"2024-09-10T08:28:46.621157+0000","last_became_peered":"2024-09-10T08:28:46.621157+0000","last_unstale":"2024-09-10T08:44:44.801766+0000","last_undegraded":"2024-09-10T08:44:44.801766+0000","last_fullsized":"2024-09-10T08:44:44.801766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-09-10T08:44:44.801648+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-09-10T08:44:44.801648+0000","last_clean_scrub_stamp":"2024-09-10T08:44:44.801648+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:11.488688+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"27'5768","reported_seq":5800,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:59.219807+0000","last_change":"2024-09-10T08:44:59.219835+0000","last_active":"2024-09-10T08:44:59.219807+0000","last_peered":"2024-09-10T08:44:59.219807+0000","last_clean":"2024-09-10T08:44:59.219807+0000","last_became_active":"2024-09-10T08:28:47.627481+0000","last_became_peered":"2024-09-10T08:28:47.627481+0000","last_unstale":"2024-09-10T08:44:59.219807+0000","last_undegraded":"2024-09-10T08:44:59.219807+0000","last_fullsized":"2024-09-10T08:44:59.219807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5768","last_scrub_stamp":"2024-09-10T08:44:59.219701+0000","last_deep_scrub":"27'5768","last_deep_scrub_stamp":"2024-09-10T08:44:59.219701+0000","last_clean_scrub_stamp":"2024-09-10T08:44:59.219701+0000","objects_scrubbed":0,"log_size":5768,"log_dups_size":0,"ondisk_log_size":5768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:19.702877+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30773,"num_write_kb":369268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:51.978548+0000","last_change":"2024-09-10T08:44:51.978548+0000","last_active":"2024-09-10T08:44:51.978548+0000","last_peered":"2024-09-10T08:44:51.978548+0000","last_clean":"2024-09-10T08:44:51.978548+0000","last_became_active":"2024-09-10T08:28:46.619843+0000","last_became_peered":"2024-09-10T08:28:46.619843+0000","last_unstale":"2024-09-10T08:44:51.978548+0000","last_undegraded":"2024-09-10T08:44:51.978548+0000","last_fullsized":"2024-09-10T08:44:51.978548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-09-10T08:44:51.978409+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-09-10T08:44:51.978409+0000","last_clean_scrub_stamp":"2024-09-10T08:44:51.978409+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:18:47.538545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'5404","reported_seq":5443,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:43.324480+0000","last_change":"2024-09-10T08:44:43.324510+0000","last_active":"2024-09-10T08:44:43.324480+0000","last_peered":"2024-09-10T08:44:43.324480+0000","last_clean":"2024-09-10T08:44:43.324480+0000","last_became_active":"2024-09-10T08:28:35.572219+0000","last_became_peered":"2024-09-10T08:28:35.572219+0000","last_unstale":"2024-09-10T08:44:43.324480+0000","last_undegraded":"2024-09-10T08:44:43.324480+0000","last_fullsized":"2024-09-10T08:44:43.324480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5404","last_scrub_stamp":"2024-09-10T08:44:43.324352+0000","last_deep_scrub":"27'5404","last_deep_scrub_stamp":"2024-09-10T08:44:43.324352+0000","last_clean_scrub_stamp":"2024-09-10T08:44:43.324352+0000","objects_scrubbed":0,"log_size":5404,"log_dups_size":0,"ondisk_log_size":5404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:52.590735+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27626,"num_write_kb":348430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:53.124095+0000","last_change":"2024-09-10T08:44:53.124124+0000","last_active":"2024-09-10T08:44:53.124095+0000","last_peered":"2024-09-10T08:44:53.124095+0000","last_clean":"2024-09-10T08:44:53.124095+0000","last_became_active":"2024-09-10T08:28:34.553933+0000","last_became_peered":"2024-09-10T08:28:34.553933+0000","last_unstale":"2024-09-10T08:44:53.124095+0000","last_undegraded":"2024-09-10T08:44:53.124095+0000","last_fullsized":"2024-09-10T08:44:53.124095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-10T08:44:53.123992+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-10T08:44:53.123992+0000","last_clean_scrub_stamp":"2024-09-10T08:44:53.123992+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:53.148741+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"27'4656","reported_seq":4689,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:57.923629+0000","last_change":"2024-09-10T08:44:57.923656+0000","last_active":"2024-09-10T08:44:57.923629+0000","last_peered":"2024-09-10T08:44:57.923629+0000","last_clean":"2024-09-10T08:44:57.923629+0000","last_became_active":"2024-09-10T08:28:47.629177+0000","last_became_peered":"2024-09-10T08:28:47.629177+0000","last_unstale":"2024-09-10T08:44:57.923629+0000","last_undegraded":"2024-09-10T08:44:57.923629+0000","last_fullsized":"2024-09-10T08:44:57.923629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4656","last_scrub_stamp":"2024-09-10T08:44:57.923524+0000","last_deep_scrub":"27'4656","last_deep_scrub_stamp":"2024-09-10T08:44:57.923524+0000","last_clean_scrub_stamp":"2024-09-10T08:44:57.923524+0000","objects_scrubbed":0,"log_size":4656,"log_dups_size":0,"ondisk_log_size":4656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:56.921725+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24729,"num_write_kb":316330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"27'633","reported_seq":667,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:56.226073+0000","last_change":"2024-09-10T08:44:56.226102+0000","last_active":"2024-09-10T08:44:56.226073+0000","last_peered":"2024-09-10T08:44:56.226073+0000","last_clean":"2024-09-10T08:44:56.226073+0000","last_became_active":"2024-09-10T08:28:46.630530+0000","last_became_peered":"2024-09-10T08:28:46.630530+0000","last_unstale":"2024-09-10T08:44:56.226073+0000","last_undegraded":"2024-09-10T08:44:56.226073+0000","last_fullsized":"2024-09-10T08:44:56.226073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'633","last_scrub_stamp":"2024-09-10T08:44:56.225992+0000","last_deep_scrub":"27'633","last_deep_scrub_stamp":"2024-09-10T08:44:56.225992+0000","last_clean_scrub_stamp":"2024-09-10T08:44:56.225992+0000","objects_scrubbed":3,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:38.329170+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":4465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'4762","reported_seq":4801,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:45.774805+0000","last_change":"2024-09-10T08:44:45.774831+0000","last_active":"2024-09-10T08:44:45.774805+0000","last_peered":"2024-09-10T08:44:45.774805+0000","last_clean":"2024-09-10T08:44:45.774805+0000","last_became_active":"2024-09-10T08:28:35.579975+0000","last_became_peered":"2024-09-10T08:28:35.579975+0000","last_unstale":"2024-09-10T08:44:45.774805+0000","last_undegraded":"2024-09-10T08:44:45.774805+0000","last_fullsized":"2024-09-10T08:44:45.774805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4762","last_scrub_stamp":"2024-09-10T08:44:45.774702+0000","last_deep_scrub":"27'4762","last_deep_scrub_stamp":"2024-09-10T08:44:45.774702+0000","last_clean_scrub_stamp":"2024-09-10T08:44:45.774702+0000","objects_scrubbed":0,"log_size":4762,"log_dups_size":0,"ondisk_log_size":4762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:21:59.061286+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24500,"num_write_kb":298921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:55.590917+0000","last_change":"2024-09-10T08:44:55.590943+0000","last_active":"2024-09-10T08:44:55.590917+0000","last_peered":"2024-09-10T08:44:55.590917+0000","last_clean":"2024-09-10T08:44:55.590917+0000","last_became_active":"2024-09-10T08:28:34.564479+0000","last_became_peered":"2024-09-10T08:28:34.564479+0000","last_unstale":"2024-09-10T08:44:55.590917+0000","last_undegraded":"2024-09-10T08:44:55.590917+0000","last_fullsized":"2024-09-10T08:44:55.590917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-10T08:44:55.590792+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-10T08:44:55.590792+0000","last_clean_scrub_stamp":"2024-09-10T08:44:55.590792+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:34.961720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"27'5070","reported_seq":5101,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:56.202230+0000","last_change":"2024-09-10T08:44:56.202259+0000","last_active":"2024-09-10T08:44:56.202230+0000","last_peered":"2024-09-10T08:44:56.202230+0000","last_clean":"2024-09-10T08:44:56.202230+0000","last_became_active":"2024-09-10T08:28:47.626692+0000","last_became_peered":"2024-09-10T08:28:47.626692+0000","last_unstale":"2024-09-10T08:44:56.202230+0000","last_undegraded":"2024-09-10T08:44:56.202230+0000","last_fullsized":"2024-09-10T08:44:56.202230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5070","last_scrub_stamp":"2024-09-10T08:44:56.202133+0000","last_deep_scrub":"27'5070","last_deep_scrub_stamp":"2024-09-10T08:44:56.202133+0000","last_clean_scrub_stamp":"2024-09-10T08:44:56.202133+0000","objects_scrubbed":0,"log_size":5070,"log_dups_size":0,"ondisk_log_size":5070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:38:54.246227+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26421,"num_write_kb":351729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"27'90","reported_seq":131,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:48.194392+0000","last_change":"2024-09-10T08:44:48.194442+0000","last_active":"2024-09-10T08:44:48.194392+0000","last_peered":"2024-09-10T08:44:48.194392+0000","last_clean":"2024-09-10T08:44:48.194392+0000","last_became_active":"2024-09-10T08:28:34.561613+0000","last_became_peered":"2024-09-10T08:28:34.561613+0000","last_unstale":"2024-09-10T08:44:48.194392+0000","last_undegraded":"2024-09-10T08:44:48.194392+0000","last_fullsized":"2024-09-10T08:44:48.194392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'90","last_scrub_stamp":"2024-09-10T08:44:48.194281+0000","last_deep_scrub":"27'90","last_deep_scrub_stamp":"2024-09-10T08:44:48.194281+0000","last_clean_scrub_stamp":"2024-09-10T08:44:48.194281+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:09.873480+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061672,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":1094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'3916","reported_seq":3955,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:42.948004+0000","last_change":"2024-09-10T08:44:42.948063+0000","last_active":"2024-09-10T08:44:42.948004+0000","last_peered":"2024-09-10T08:44:42.948004+0000","last_clean":"2024-09-10T08:44:42.948004+0000","last_became_active":"2024-09-10T08:28:35.576145+0000","last_became_peered":"2024-09-10T08:28:35.576145+0000","last_unstale":"2024-09-10T08:44:42.948004+0000","last_undegraded":"2024-09-10T08:44:42.948004+0000","last_fullsized":"2024-09-10T08:44:42.948004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3916","last_scrub_stamp":"2024-09-10T08:44:42.947880+0000","last_deep_scrub":"27'3916","last_deep_scrub_stamp":"2024-09-10T08:44:42.947880+0000","last_clean_scrub_stamp":"2024-09-10T08:44:42.947880+0000","objects_scrubbed":0,"log_size":3916,"log_dups_size":0,"ondisk_log_size":3916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:34.524482+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19526,"num_write_kb":237971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:47.280689+0000","last_change":"2024-09-10T08:44:47.280719+0000","last_active":"2024-09-10T08:44:47.280689+0000","last_peered":"2024-09-10T08:44:47.280689+0000","last_clean":"2024-09-10T08:44:47.280689+0000","last_became_active":"2024-09-10T08:28:46.621941+0000","last_became_peered":"2024-09-10T08:28:46.621941+0000","last_unstale":"2024-09-10T08:44:47.280689+0000","last_undegraded":"2024-09-10T08:44:47.280689+0000","last_fullsized":"2024-09-10T08:44:47.280689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-09-10T08:44:47.280603+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-09-10T08:44:47.280603+0000","last_clean_scrub_stamp":"2024-09-10T08:44:47.280603+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:44.503304+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"27'3193","reported_seq":3224,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:58.546180+0000","last_change":"2024-09-10T08:44:58.546202+0000","last_active":"2024-09-10T08:44:58.546180+0000","last_peered":"2024-09-10T08:44:58.546180+0000","last_clean":"2024-09-10T08:44:58.546180+0000","last_became_active":"2024-09-10T08:28:47.625258+0000","last_became_peered":"2024-09-10T08:28:47.625258+0000","last_unstale":"2024-09-10T08:44:58.546180+0000","last_undegraded":"2024-09-10T08:44:58.546180+0000","last_fullsized":"2024-09-10T08:44:58.546180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3193","last_scrub_stamp":"2024-09-10T08:44:58.546064+0000","last_deep_scrub":"27'3193","last_deep_scrub_stamp":"2024-09-10T08:44:58.546064+0000","last_clean_scrub_stamp":"2024-09-10T08:44:58.546064+0000","objects_scrubbed":0,"log_size":3193,"log_dups_size":0,"ondisk_log_size":3193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:32.583118+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16183,"num_write_kb":212369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'623","reported_seq":664,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:56.615576+0000","last_change":"2024-09-10T08:44:56.615616+0000","last_active":"2024-09-10T08:44:56.615576+0000","last_peered":"2024-09-10T08:44:56.615576+0000","last_clean":"2024-09-10T08:44:56.615576+0000","last_became_active":"2024-09-10T08:28:34.566388+0000","last_became_peered":"2024-09-10T08:28:34.566388+0000","last_unstale":"2024-09-10T08:44:56.615576+0000","last_undegraded":"2024-09-10T08:44:56.615576+0000","last_fullsized":"2024-09-10T08:44:56.615576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'623","last_scrub_stamp":"2024-09-10T08:44:56.615470+0000","last_deep_scrub":"27'623","last_deep_scrub_stamp":"2024-09-10T08:44:56.615470+0000","last_clean_scrub_stamp":"2024-09-10T08:44:56.615470+0000","objects_scrubbed":1,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:02.777836+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":620,"num_write_kb":4248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'4051","reported_seq":4090,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:48.465503+0000","last_change":"2024-09-10T08:44:48.465543+0000","last_active":"2024-09-10T08:44:48.465503+0000","last_peered":"2024-09-10T08:44:48.465503+0000","last_clean":"2024-09-10T08:44:48.465503+0000","last_became_active":"2024-09-10T08:28:35.559145+0000","last_became_peered":"2024-09-10T08:28:35.559145+0000","last_unstale":"2024-09-10T08:44:48.465503+0000","last_undegraded":"2024-09-10T08:44:48.465503+0000","last_fullsized":"2024-09-10T08:44:48.465503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4051","last_scrub_stamp":"2024-09-10T08:44:48.465379+0000","last_deep_scrub":"27'4051","last_deep_scrub_stamp":"2024-09-10T08:44:48.465379+0000","last_clean_scrub_stamp":"2024-09-10T08:44:48.465379+0000","objects_scrubbed":0,"log_size":4051,"log_dups_size":0,"ondisk_log_size":4051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:01.759800+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20269,"num_write_kb":257190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'12","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:40.856236+0000","last_change":"2024-09-10T08:44:40.856260+0000","last_active":"2024-09-10T08:44:40.856236+0000","last_peered":"2024-09-10T08:44:40.856236+0000","last_clean":"2024-09-10T08:44:40.856236+0000","last_became_active":"2024-09-10T08:28:46.619403+0000","last_became_peered":"2024-09-10T08:28:46.619403+0000","last_unstale":"2024-09-10T08:44:40.856236+0000","last_undegraded":"2024-09-10T08:44:40.856236+0000","last_fullsized":"2024-09-10T08:44:40.856236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-09-10T08:44:40.856154+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-09-10T08:44:40.856154+0000","last_clean_scrub_stamp":"2024-09-10T08:44:40.856154+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:50:13.135382+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"27'4023","reported_seq":4055,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:04.677523+0000","last_change":"2024-09-10T08:45:04.677549+0000","last_active":"2024-09-10T08:45:04.677523+0000","last_peered":"2024-09-10T08:45:04.677523+0000","last_clean":"2024-09-10T08:45:04.677523+0000","last_became_active":"2024-09-10T08:28:47.626791+0000","last_became_peered":"2024-09-10T08:28:47.626791+0000","last_unstale":"2024-09-10T08:45:04.677523+0000","last_undegraded":"2024-09-10T08:45:04.677523+0000","last_fullsized":"2024-09-10T08:45:04.677523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4023","last_scrub_stamp":"2024-09-10T08:45:04.677416+0000","last_deep_scrub":"27'4023","last_deep_scrub_stamp":"2024-09-10T08:45:04.677416+0000","last_clean_scrub_stamp":"2024-09-10T08:45:04.677416+0000","objects_scrubbed":0,"log_size":4023,"log_dups_size":0,"ondisk_log_size":4023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:45.496205+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21172,"num_write_kb":269680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'5985","reported_seq":6026,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:44.150728+0000","last_change":"2024-09-10T08:44:44.150728+0000","last_active":"2024-09-10T08:44:44.150728+0000","last_peered":"2024-09-10T08:44:44.150728+0000","last_clean":"2024-09-10T08:44:44.150728+0000","last_became_active":"2024-09-10T08:28:35.578631+0000","last_became_peered":"2024-09-10T08:28:35.578631+0000","last_unstale":"2024-09-10T08:44:44.150728+0000","last_undegraded":"2024-09-10T08:44:44.150728+0000","last_fullsized":"2024-09-10T08:44:44.150728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5985","last_scrub_stamp":"2024-09-10T08:44:44.150593+0000","last_deep_scrub":"27'5985","last_deep_scrub_stamp":"2024-09-10T08:44:44.150593+0000","last_clean_scrub_stamp":"2024-09-10T08:44:44.150593+0000","objects_scrubbed":0,"log_size":5985,"log_dups_size":0,"ondisk_log_size":5985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:31.184341+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30721,"num_write_kb":377078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"27'5461","reported_seq":5493,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:02.127576+0000","last_change":"2024-09-10T08:45:02.127623+0000","last_active":"2024-09-10T08:45:02.127576+0000","last_peered":"2024-09-10T08:45:02.127576+0000","last_clean":"2024-09-10T08:45:02.127576+0000","last_became_active":"2024-09-10T08:28:47.631578+0000","last_became_peered":"2024-09-10T08:28:47.631578+0000","last_unstale":"2024-09-10T08:45:02.127576+0000","last_undegraded":"2024-09-10T08:45:02.127576+0000","last_fullsized":"2024-09-10T08:45:02.127576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5461","last_scrub_stamp":"2024-09-10T08:45:02.127418+0000","last_deep_scrub":"27'5461","last_deep_scrub_stamp":"2024-09-10T08:45:02.127418+0000","last_clean_scrub_stamp":"2024-09-10T08:45:02.127418+0000","objects_scrubbed":0,"log_size":5461,"log_dups_size":0,"ondisk_log_size":5461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:37:41.730953+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28495,"num_write_kb":351882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"27'5419","reported_seq":5465,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:57.321502+0000","last_change":"2024-09-10T08:44:57.321502+0000","last_active":"2024-09-10T08:44:57.321502+0000","last_peered":"2024-09-10T08:44:57.321502+0000","last_clean":"2024-09-10T08:44:57.321502+0000","last_became_active":"2024-09-10T08:29:36.029789+0000","last_became_peered":"2024-09-10T08:29:36.029789+0000","last_unstale":"2024-09-10T08:44:57.321502+0000","last_undegraded":"2024-09-10T08:44:57.321502+0000","last_fullsized":"2024-09-10T08:44:57.321502+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5419","last_scrub_stamp":"2024-09-10T08:44:57.321355+0000","last_deep_scrub":"27'5419","last_deep_scrub_stamp":"2024-09-10T08:44:57.321355+0000","last_clean_scrub_stamp":"2024-09-10T08:44:57.321355+0000","objects_scrubbed":0,"log_size":5419,"log_dups_size":0,"ondisk_log_size":5419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:31.294298+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28175,"num_write_kb":329998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"27'4342","reported_seq":4374,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:04.368738+0000","last_change":"2024-09-10T08:45:04.368765+0000","last_active":"2024-09-10T08:45:04.368738+0000","last_peered":"2024-09-10T08:45:04.368738+0000","last_clean":"2024-09-10T08:45:04.368738+0000","last_became_active":"2024-09-10T08:28:47.628741+0000","last_became_peered":"2024-09-10T08:28:47.628741+0000","last_unstale":"2024-09-10T08:45:04.368738+0000","last_undegraded":"2024-09-10T08:45:04.368738+0000","last_fullsized":"2024-09-10T08:45:04.368738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4342","last_scrub_stamp":"2024-09-10T08:45:04.368608+0000","last_deep_scrub":"27'4342","last_deep_scrub_stamp":"2024-09-10T08:45:04.368608+0000","last_clean_scrub_stamp":"2024-09-10T08:45:04.368608+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:39.109500+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22591,"num_write_kb":275032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"27'5933","reported_seq":5974,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:43.131167+0000","last_change":"2024-09-10T08:44:43.131167+0000","last_active":"2024-09-10T08:44:43.131167+0000","last_peered":"2024-09-10T08:44:43.131167+0000","last_clean":"2024-09-10T08:44:43.131167+0000","last_became_active":"2024-09-10T08:28:35.577995+0000","last_became_peered":"2024-09-10T08:28:35.577995+0000","last_unstale":"2024-09-10T08:44:43.131167+0000","last_undegraded":"2024-09-10T08:44:43.131167+0000","last_fullsized":"2024-09-10T08:44:43.131167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5933","last_scrub_stamp":"2024-09-10T08:44:43.131024+0000","last_deep_scrub":"27'5933","last_deep_scrub_stamp":"2024-09-10T08:44:43.131024+0000","last_clean_scrub_stamp":"2024-09-10T08:44:43.131024+0000","objects_scrubbed":0,"log_size":5933,"log_dups_size":0,"ondisk_log_size":5933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:01:19.719084+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30577,"num_write_kb":368306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"27'4476","reported_seq":4508,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:59.145779+0000","last_change":"2024-09-10T08:44:59.145823+0000","last_active":"2024-09-10T08:44:59.145779+0000","last_peered":"2024-09-10T08:44:59.145779+0000","last_clean":"2024-09-10T08:44:59.145779+0000","last_became_active":"2024-09-10T08:28:47.628317+0000","last_became_peered":"2024-09-10T08:28:47.628317+0000","last_unstale":"2024-09-10T08:44:59.145779+0000","last_undegraded":"2024-09-10T08:44:59.145779+0000","last_fullsized":"2024-09-10T08:44:59.145779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4476","last_scrub_stamp":"2024-09-10T08:44:59.145678+0000","last_deep_scrub":"27'4476","last_deep_scrub_stamp":"2024-09-10T08:44:59.145678+0000","last_clean_scrub_stamp":"2024-09-10T08:44:59.145678+0000","objects_scrubbed":0,"log_size":4476,"log_dups_size":0,"ondisk_log_size":4476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:10.045906+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23867,"num_write_kb":312797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"27'4232","reported_seq":4273,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:40.902363+0000","last_change":"2024-09-10T08:44:40.902363+0000","last_active":"2024-09-10T08:44:40.902363+0000","last_peered":"2024-09-10T08:44:40.902363+0000","last_clean":"2024-09-10T08:44:40.902363+0000","last_became_active":"2024-09-10T08:28:35.577571+0000","last_became_peered":"2024-09-10T08:28:35.577571+0000","last_unstale":"2024-09-10T08:44:40.902363+0000","last_undegraded":"2024-09-10T08:44:40.902363+0000","last_fullsized":"2024-09-10T08:44:40.902363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4232","last_scrub_stamp":"2024-09-10T08:44:40.902258+0000","last_deep_scrub":"27'4232","last_deep_scrub_stamp":"2024-09-10T08:44:40.902258+0000","last_clean_scrub_stamp":"2024-09-10T08:44:40.902258+0000","objects_scrubbed":0,"log_size":4232,"log_dups_size":0,"ondisk_log_size":4232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:33.553812+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21938,"num_write_kb":263982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"27'5518","reported_seq":5550,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:48.928201+0000","last_change":"2024-09-10T08:44:48.928229+0000","last_active":"2024-09-10T08:44:48.928201+0000","last_peered":"2024-09-10T08:44:48.928201+0000","last_clean":"2024-09-10T08:44:48.928201+0000","last_became_active":"2024-09-10T08:28:47.629634+0000","last_became_peered":"2024-09-10T08:28:47.629634+0000","last_unstale":"2024-09-10T08:44:48.928201+0000","last_undegraded":"2024-09-10T08:44:48.928201+0000","last_fullsized":"2024-09-10T08:44:48.928201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5518","last_scrub_stamp":"2024-09-10T08:44:48.928106+0000","last_deep_scrub":"27'5518","last_deep_scrub_stamp":"2024-09-10T08:44:48.928106+0000","last_clean_scrub_stamp":"2024-09-10T08:44:48.928106+0000","objects_scrubbed":0,"log_size":5518,"log_dups_size":0,"ondisk_log_size":5518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:17.015968+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28611,"num_write_kb":360382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"27'3937","reported_seq":3977,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:01.617230+0000","last_change":"2024-09-10T08:45:01.617257+0000","last_active":"2024-09-10T08:45:01.617230+0000","last_peered":"2024-09-10T08:45:01.617230+0000","last_clean":"2024-09-10T08:45:01.617230+0000","last_became_active":"2024-09-10T08:28:35.574437+0000","last_became_peered":"2024-09-10T08:28:35.574437+0000","last_unstale":"2024-09-10T08:45:01.617230+0000","last_undegraded":"2024-09-10T08:45:01.617230+0000","last_fullsized":"2024-09-10T08:45:01.617230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3937","last_scrub_stamp":"2024-09-10T08:45:01.617138+0000","last_deep_scrub":"27'3937","last_deep_scrub_stamp":"2024-09-10T08:45:01.617138+0000","last_clean_scrub_stamp":"2024-09-10T08:45:01.617138+0000","objects_scrubbed":0,"log_size":3937,"log_dups_size":0,"ondisk_log_size":3937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:03.729561+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20167,"num_write_kb":265112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"27'3790","reported_seq":3822,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:55.449718+0000","last_change":"2024-09-10T08:44:55.449746+0000","last_active":"2024-09-10T08:44:55.449718+0000","last_peered":"2024-09-10T08:44:55.449718+0000","last_clean":"2024-09-10T08:44:55.449718+0000","last_became_active":"2024-09-10T08:28:47.623671+0000","last_became_peered":"2024-09-10T08:28:47.623671+0000","last_unstale":"2024-09-10T08:44:55.449718+0000","last_undegraded":"2024-09-10T08:44:55.449718+0000","last_fullsized":"2024-09-10T08:44:55.449718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3790","last_scrub_stamp":"2024-09-10T08:44:55.449594+0000","last_deep_scrub":"27'3790","last_deep_scrub_stamp":"2024-09-10T08:44:55.449594+0000","last_clean_scrub_stamp":"2024-09-10T08:44:55.449594+0000","objects_scrubbed":0,"log_size":3790,"log_dups_size":0,"ondisk_log_size":3790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:20.920203+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19891,"num_write_kb":255782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"27'4956","reported_seq":4996,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:45.307383+0000","last_change":"2024-09-10T08:44:45.307408+0000","last_active":"2024-09-10T08:44:45.307383+0000","last_peered":"2024-09-10T08:44:45.307383+0000","last_clean":"2024-09-10T08:44:45.307383+0000","last_became_active":"2024-09-10T08:28:35.572184+0000","last_became_peered":"2024-09-10T08:28:35.572184+0000","last_unstale":"2024-09-10T08:44:45.307383+0000","last_undegraded":"2024-09-10T08:44:45.307383+0000","last_fullsized":"2024-09-10T08:44:45.307383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4956","last_scrub_stamp":"2024-09-10T08:44:45.307282+0000","last_deep_scrub":"27'4956","last_deep_scrub_stamp":"2024-09-10T08:44:45.307282+0000","last_clean_scrub_stamp":"2024-09-10T08:44:45.307282+0000","objects_scrubbed":0,"log_size":4956,"log_dups_size":0,"ondisk_log_size":4956,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:09.568692+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26295,"num_write_kb":322461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"27'5495","reported_seq":5527,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:52.902932+0000","last_change":"2024-09-10T08:44:52.902960+0000","last_active":"2024-09-10T08:44:52.902932+0000","last_peered":"2024-09-10T08:44:52.902932+0000","last_clean":"2024-09-10T08:44:52.902932+0000","last_became_active":"2024-09-10T08:28:47.629512+0000","last_became_peered":"2024-09-10T08:28:47.629512+0000","last_unstale":"2024-09-10T08:44:52.902932+0000","last_undegraded":"2024-09-10T08:44:52.902932+0000","last_fullsized":"2024-09-10T08:44:52.902932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5495","last_scrub_stamp":"2024-09-10T08:44:52.902818+0000","last_deep_scrub":"27'5495","last_deep_scrub_stamp":"2024-09-10T08:44:52.902818+0000","last_clean_scrub_stamp":"2024-09-10T08:44:52.902818+0000","objects_scrubbed":0,"log_size":5495,"log_dups_size":0,"ondisk_log_size":5495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:48.062940+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29037,"num_write_kb":370350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"27'4400","reported_seq":4440,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:45.185557+0000","last_change":"2024-09-10T08:44:45.185582+0000","last_active":"2024-09-10T08:44:45.185557+0000","last_peered":"2024-09-10T08:44:45.185557+0000","last_clean":"2024-09-10T08:44:45.185557+0000","last_became_active":"2024-09-10T08:28:35.572955+0000","last_became_peered":"2024-09-10T08:28:35.572955+0000","last_unstale":"2024-09-10T08:44:45.185557+0000","last_undegraded":"2024-09-10T08:44:45.185557+0000","last_fullsized":"2024-09-10T08:44:45.185557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4400","last_scrub_stamp":"2024-09-10T08:44:45.185459+0000","last_deep_scrub":"27'4400","last_deep_scrub_stamp":"2024-09-10T08:44:45.185459+0000","last_clean_scrub_stamp":"2024-09-10T08:44:45.185459+0000","objects_scrubbed":0,"log_size":4400,"log_dups_size":0,"ondisk_log_size":4400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:30:16.876549+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22665,"num_write_kb":275496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"27'4608","reported_seq":4640,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:58.187397+0000","last_change":"2024-09-10T08:44:58.187428+0000","last_active":"2024-09-10T08:44:58.187397+0000","last_peered":"2024-09-10T08:44:58.187397+0000","last_clean":"2024-09-10T08:44:58.187397+0000","last_became_active":"2024-09-10T08:28:47.623082+0000","last_became_peered":"2024-09-10T08:28:47.623082+0000","last_unstale":"2024-09-10T08:44:58.187397+0000","last_undegraded":"2024-09-10T08:44:58.187397+0000","last_fullsized":"2024-09-10T08:44:58.187397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4608","last_scrub_stamp":"2024-09-10T08:44:58.187306+0000","last_deep_scrub":"27'4608","last_deep_scrub_stamp":"2024-09-10T08:44:58.187306+0000","last_clean_scrub_stamp":"2024-09-10T08:44:58.187306+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:52.439664+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24193,"num_write_kb":313982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'6039","reported_seq":6079,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:49.616869+0000","last_change":"2024-09-10T08:44:49.616898+0000","last_active":"2024-09-10T08:44:49.616869+0000","last_peered":"2024-09-10T08:44:49.616869+0000","last_clean":"2024-09-10T08:44:49.616869+0000","last_became_active":"2024-09-10T08:28:35.575614+0000","last_became_peered":"2024-09-10T08:28:35.575614+0000","last_unstale":"2024-09-10T08:44:49.616869+0000","last_undegraded":"2024-09-10T08:44:49.616869+0000","last_fullsized":"2024-09-10T08:44:49.616869+0000","mapping_epoch":19,"log_start":"27'800","ondisk_log_start":"27'800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6039","last_scrub_stamp":"2024-09-10T08:44:49.616767+0000","last_deep_scrub":"27'6039","last_deep_scrub_stamp":"2024-09-10T08:44:49.616767+0000","last_clean_scrub_stamp":"2024-09-10T08:44:49.616767+0000","objects_scrubbed":0,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:15.817052+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31129,"num_write_kb":362414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"27'3524","reported_seq":3556,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:07.743249+0000","last_change":"2024-09-10T08:45:07.743249+0000","last_active":"2024-09-10T08:45:07.743249+0000","last_peered":"2024-09-10T08:45:07.743249+0000","last_clean":"2024-09-10T08:45:07.743249+0000","last_became_active":"2024-09-10T08:28:47.628861+0000","last_became_peered":"2024-09-10T08:28:47.628861+0000","last_unstale":"2024-09-10T08:45:07.743249+0000","last_undegraded":"2024-09-10T08:45:07.743249+0000","last_fullsized":"2024-09-10T08:45:07.743249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3524","last_scrub_stamp":"2024-09-10T08:45:07.743134+0000","last_deep_scrub":"27'3524","last_deep_scrub_stamp":"2024-09-10T08:45:07.743134+0000","last_clean_scrub_stamp":"2024-09-10T08:45:07.743134+0000","objects_scrubbed":0,"log_size":3524,"log_dups_size":0,"ondisk_log_size":3524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:36.991252+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18277,"num_write_kb":237112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'4470","reported_seq":4510,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:45.103341+0000","last_change":"2024-09-10T08:44:45.103401+0000","last_active":"2024-09-10T08:44:45.103341+0000","last_peered":"2024-09-10T08:44:45.103341+0000","last_clean":"2024-09-10T08:44:45.103341+0000","last_became_active":"2024-09-10T08:28:35.576805+0000","last_became_peered":"2024-09-10T08:28:35.576805+0000","last_unstale":"2024-09-10T08:44:45.103341+0000","last_undegraded":"2024-09-10T08:44:45.103341+0000","last_fullsized":"2024-09-10T08:44:45.103341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4470","last_scrub_stamp":"2024-09-10T08:44:45.103202+0000","last_deep_scrub":"27'4470","last_deep_scrub_stamp":"2024-09-10T08:44:45.103202+0000","last_clean_scrub_stamp":"2024-09-10T08:44:45.103202+0000","objects_scrubbed":0,"log_size":4470,"log_dups_size":0,"ondisk_log_size":4470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:35:51.980264+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22783,"num_write_kb":271507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"27'5536","reported_seq":5568,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:09.865733+0000","last_change":"2024-09-10T08:45:09.865733+0000","last_active":"2024-09-10T08:45:09.865733+0000","last_peered":"2024-09-10T08:45:09.865733+0000","last_clean":"2024-09-10T08:45:09.865733+0000","last_became_active":"2024-09-10T08:28:47.635381+0000","last_became_peered":"2024-09-10T08:28:47.635381+0000","last_unstale":"2024-09-10T08:45:09.865733+0000","last_undegraded":"2024-09-10T08:45:09.865733+0000","last_fullsized":"2024-09-10T08:45:09.865733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5536","last_scrub_stamp":"2024-09-10T08:45:09.865596+0000","last_deep_scrub":"27'5536","last_deep_scrub_stamp":"2024-09-10T08:45:09.865596+0000","last_clean_scrub_stamp":"2024-09-10T08:45:09.865596+0000","objects_scrubbed":0,"log_size":5536,"log_dups_size":0,"ondisk_log_size":5536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:06.919662+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28458,"num_write_kb":359914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"27'4347","reported_seq":4372,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:54.339547+0000","last_change":"2024-09-10T08:44:54.339577+0000","last_active":"2024-09-10T08:44:54.339547+0000","last_peered":"2024-09-10T08:44:54.339547+0000","last_clean":"2024-09-10T08:44:54.339547+0000","last_became_active":"2024-09-10T08:29:35.097273+0000","last_became_peered":"2024-09-10T08:29:35.097273+0000","last_unstale":"2024-09-10T08:44:54.339547+0000","last_undegraded":"2024-09-10T08:44:54.339547+0000","last_fullsized":"2024-09-10T08:44:54.339547+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4347","last_scrub_stamp":"2024-09-10T08:44:54.339442+0000","last_deep_scrub":"27'4347","last_deep_scrub_stamp":"2024-09-10T08:44:54.339442+0000","last_clean_scrub_stamp":"2024-09-10T08:44:54.339442+0000","objects_scrubbed":0,"log_size":4347,"log_dups_size":0,"ondisk_log_size":4347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:24.445714+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22114,"num_write_kb":289250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2c","version":"27'4653","reported_seq":4685,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:49.358981+0000","last_change":"2024-09-10T08:44:49.359006+0000","last_active":"2024-09-10T08:44:49.358981+0000","last_peered":"2024-09-10T08:44:49.358981+0000","last_clean":"2024-09-10T08:44:49.358981+0000","last_became_active":"2024-09-10T08:28:47.619525+0000","last_became_peered":"2024-09-10T08:28:47.619525+0000","last_unstale":"2024-09-10T08:44:49.358981+0000","last_undegraded":"2024-09-10T08:44:49.358981+0000","last_fullsized":"2024-09-10T08:44:49.358981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4653","last_scrub_stamp":"2024-09-10T08:44:49.358850+0000","last_deep_scrub":"27'4653","last_deep_scrub_stamp":"2024-09-10T08:44:49.358850+0000","last_clean_scrub_stamp":"2024-09-10T08:44:49.358850+0000","objects_scrubbed":0,"log_size":4653,"log_dups_size":0,"ondisk_log_size":4653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:57.197427+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24519,"num_write_kb":299145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"27'5080","reported_seq":5120,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:58.268795+0000","last_change":"2024-09-10T08:44:58.268823+0000","last_active":"2024-09-10T08:44:58.268795+0000","last_peered":"2024-09-10T08:44:58.268795+0000","last_clean":"2024-09-10T08:44:58.268795+0000","last_became_active":"2024-09-10T08:28:35.567744+0000","last_became_peered":"2024-09-10T08:28:35.567744+0000","last_unstale":"2024-09-10T08:44:58.268795+0000","last_undegraded":"2024-09-10T08:44:58.268795+0000","last_fullsized":"2024-09-10T08:44:58.268795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5080","last_scrub_stamp":"2024-09-10T08:44:58.268692+0000","last_deep_scrub":"27'5080","last_deep_scrub_stamp":"2024-09-10T08:44:58.268692+0000","last_clean_scrub_stamp":"2024-09-10T08:44:58.268692+0000","objects_scrubbed":0,"log_size":5080,"log_dups_size":0,"ondisk_log_size":5080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:19.407235+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26557,"num_write_kb":327659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"27'4432","reported_seq":4464,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:06.729967+0000","last_change":"2024-09-10T08:45:06.729989+0000","last_active":"2024-09-10T08:45:06.729967+0000","last_peered":"2024-09-10T08:45:06.729967+0000","last_clean":"2024-09-10T08:45:06.729967+0000","last_became_active":"2024-09-10T08:28:47.629095+0000","last_became_peered":"2024-09-10T08:28:47.629095+0000","last_unstale":"2024-09-10T08:45:06.729967+0000","last_undegraded":"2024-09-10T08:45:06.729967+0000","last_fullsized":"2024-09-10T08:45:06.729967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4432","last_scrub_stamp":"2024-09-10T08:45:06.729876+0000","last_deep_scrub":"27'4432","last_deep_scrub_stamp":"2024-09-10T08:45:06.729876+0000","last_clean_scrub_stamp":"2024-09-10T08:45:06.729876+0000","objects_scrubbed":0,"log_size":4432,"log_dups_size":0,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:18.855334+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22331,"num_write_kb":294288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"27'4801","reported_seq":4841,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:49.978247+0000","last_change":"2024-09-10T08:44:49.978271+0000","last_active":"2024-09-10T08:44:49.978247+0000","last_peered":"2024-09-10T08:44:49.978247+0000","last_clean":"2024-09-10T08:44:49.978247+0000","last_became_active":"2024-09-10T08:28:35.575388+0000","last_became_peered":"2024-09-10T08:28:35.575388+0000","last_unstale":"2024-09-10T08:44:49.978247+0000","last_undegraded":"2024-09-10T08:44:49.978247+0000","last_fullsized":"2024-09-10T08:44:49.978247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4801","last_scrub_stamp":"2024-09-10T08:44:49.978135+0000","last_deep_scrub":"27'4801","last_deep_scrub_stamp":"2024-09-10T08:44:49.978135+0000","last_clean_scrub_stamp":"2024-09-10T08:44:49.978135+0000","objects_scrubbed":0,"log_size":4801,"log_dups_size":0,"ondisk_log_size":4801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:10.666027+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24675,"num_write_kb":307760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"27'4608","reported_seq":4640,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:56.485639+0000","last_change":"2024-09-10T08:44:56.485666+0000","last_active":"2024-09-10T08:44:56.485639+0000","last_peered":"2024-09-10T08:44:56.485639+0000","last_clean":"2024-09-10T08:44:56.485639+0000","last_became_active":"2024-09-10T08:28:47.624026+0000","last_became_peered":"2024-09-10T08:28:47.624026+0000","last_unstale":"2024-09-10T08:44:56.485639+0000","last_undegraded":"2024-09-10T08:44:56.485639+0000","last_fullsized":"2024-09-10T08:44:56.485639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4608","last_scrub_stamp":"2024-09-10T08:44:56.485539+0000","last_deep_scrub":"27'4608","last_deep_scrub_stamp":"2024-09-10T08:44:56.485539+0000","last_clean_scrub_stamp":"2024-09-10T08:44:56.485539+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:00.357282+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24388,"num_write_kb":319015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'4484","reported_seq":4524,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:43.132421+0000","last_change":"2024-09-10T08:44:43.132447+0000","last_active":"2024-09-10T08:44:43.132421+0000","last_peered":"2024-09-10T08:44:43.132421+0000","last_clean":"2024-09-10T08:44:43.132421+0000","last_became_active":"2024-09-10T08:28:35.574249+0000","last_became_peered":"2024-09-10T08:28:35.574249+0000","last_unstale":"2024-09-10T08:44:43.132421+0000","last_undegraded":"2024-09-10T08:44:43.132421+0000","last_fullsized":"2024-09-10T08:44:43.132421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4484","last_scrub_stamp":"2024-09-10T08:44:43.132322+0000","last_deep_scrub":"27'4484","last_deep_scrub_stamp":"2024-09-10T08:44:43.132322+0000","last_clean_scrub_stamp":"2024-09-10T08:44:43.132322+0000","objects_scrubbed":0,"log_size":4484,"log_dups_size":0,"ondisk_log_size":4484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:20.060459+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23126,"num_write_kb":293453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"27'4466","reported_seq":4498,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:01.528970+0000","last_change":"2024-09-10T08:45:01.528997+0000","last_active":"2024-09-10T08:45:01.528970+0000","last_peered":"2024-09-10T08:45:01.528970+0000","last_clean":"2024-09-10T08:45:01.528970+0000","last_became_active":"2024-09-10T08:28:47.629259+0000","last_became_peered":"2024-09-10T08:28:47.629259+0000","last_unstale":"2024-09-10T08:45:01.528970+0000","last_undegraded":"2024-09-10T08:45:01.528970+0000","last_fullsized":"2024-09-10T08:45:01.528970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4466","last_scrub_stamp":"2024-09-10T08:45:01.528852+0000","last_deep_scrub":"27'4466","last_deep_scrub_stamp":"2024-09-10T08:45:01.528852+0000","last_clean_scrub_stamp":"2024-09-10T08:45:01.528852+0000","objects_scrubbed":0,"log_size":4466,"log_dups_size":0,"ondisk_log_size":4466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:43.543498+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23096,"num_write_kb":301452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"27'4995","reported_seq":5035,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:51.908188+0000","last_change":"2024-09-10T08:44:51.908250+0000","last_active":"2024-09-10T08:44:51.908188+0000","last_peered":"2024-09-10T08:44:51.908188+0000","last_clean":"2024-09-10T08:44:51.908188+0000","last_became_active":"2024-09-10T08:28:35.572392+0000","last_became_peered":"2024-09-10T08:28:35.572392+0000","last_unstale":"2024-09-10T08:44:51.908188+0000","last_undegraded":"2024-09-10T08:44:51.908188+0000","last_fullsized":"2024-09-10T08:44:51.908188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4995","last_scrub_stamp":"2024-09-10T08:44:51.908071+0000","last_deep_scrub":"27'4995","last_deep_scrub_stamp":"2024-09-10T08:44:51.908071+0000","last_clean_scrub_stamp":"2024-09-10T08:44:51.908071+0000","objects_scrubbed":0,"log_size":4995,"log_dups_size":0,"ondisk_log_size":4995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:09.697838+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25177,"num_write_kb":305700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"27'4176","reported_seq":4208,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:00.348210+0000","last_change":"2024-09-10T08:45:00.348236+0000","last_active":"2024-09-10T08:45:00.348210+0000","last_peered":"2024-09-10T08:45:00.348210+0000","last_clean":"2024-09-10T08:45:00.348210+0000","last_became_active":"2024-09-10T08:28:47.621776+0000","last_became_peered":"2024-09-10T08:28:47.621776+0000","last_unstale":"2024-09-10T08:45:00.348210+0000","last_undegraded":"2024-09-10T08:45:00.348210+0000","last_fullsized":"2024-09-10T08:45:00.348210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4176","last_scrub_stamp":"2024-09-10T08:45:00.348118+0000","last_deep_scrub":"27'4176","last_deep_scrub_stamp":"2024-09-10T08:45:00.348118+0000","last_clean_scrub_stamp":"2024-09-10T08:45:00.348118+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:21:12.512562+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21718,"num_write_kb":267375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'3678","reported_seq":3718,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:46.313613+0000","last_change":"2024-09-10T08:44:46.313613+0000","last_active":"2024-09-10T08:44:46.313613+0000","last_peered":"2024-09-10T08:44:46.313613+0000","last_clean":"2024-09-10T08:44:46.313613+0000","last_became_active":"2024-09-10T08:28:35.574175+0000","last_became_peered":"2024-09-10T08:28:35.574175+0000","last_unstale":"2024-09-10T08:44:46.313613+0000","last_undegraded":"2024-09-10T08:44:46.313613+0000","last_fullsized":"2024-09-10T08:44:46.313613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3678","last_scrub_stamp":"2024-09-10T08:44:46.313469+0000","last_deep_scrub":"27'3678","last_deep_scrub_stamp":"2024-09-10T08:44:46.313469+0000","last_clean_scrub_stamp":"2024-09-10T08:44:46.313469+0000","objects_scrubbed":0,"log_size":3678,"log_dups_size":0,"ondisk_log_size":3678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:33:42.883346+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18345,"num_write_kb":237300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"27'4228","reported_seq":4260,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:56.964369+0000","last_change":"2024-09-10T08:44:56.964394+0000","last_active":"2024-09-10T08:44:56.964369+0000","last_peered":"2024-09-10T08:44:56.964369+0000","last_clean":"2024-09-10T08:44:56.964369+0000","last_became_active":"2024-09-10T08:28:47.628806+0000","last_became_peered":"2024-09-10T08:28:47.628806+0000","last_unstale":"2024-09-10T08:44:56.964369+0000","last_undegraded":"2024-09-10T08:44:56.964369+0000","last_fullsized":"2024-09-10T08:44:56.964369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4228","last_scrub_stamp":"2024-09-10T08:44:56.964268+0000","last_deep_scrub":"27'4228","last_deep_scrub_stamp":"2024-09-10T08:44:56.964268+0000","last_clean_scrub_stamp":"2024-09-10T08:44:56.964268+0000","objects_scrubbed":0,"log_size":4228,"log_dups_size":0,"ondisk_log_size":4228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:23.960432+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21732,"num_write_kb":287874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"27'5344","reported_seq":5369,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:56.296694+0000","last_change":"2024-09-10T08:44:56.296717+0000","last_active":"2024-09-10T08:44:56.296694+0000","last_peered":"2024-09-10T08:44:56.296694+0000","last_clean":"2024-09-10T08:44:56.296694+0000","last_became_active":"2024-09-10T08:29:35.106806+0000","last_became_peered":"2024-09-10T08:29:35.106806+0000","last_unstale":"2024-09-10T08:44:56.296694+0000","last_undegraded":"2024-09-10T08:44:56.296694+0000","last_fullsized":"2024-09-10T08:44:56.296694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5344","last_scrub_stamp":"2024-09-10T08:44:56.296600+0000","last_deep_scrub":"27'5344","last_deep_scrub_stamp":"2024-09-10T08:44:56.296600+0000","last_clean_scrub_stamp":"2024-09-10T08:44:56.296600+0000","objects_scrubbed":0,"log_size":5344,"log_dups_size":0,"ondisk_log_size":5344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:27:11.893999+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27047,"num_write_kb":354198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"27'5319","reported_seq":5350,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:01.101285+0000","last_change":"2024-09-10T08:45:01.101312+0000","last_active":"2024-09-10T08:45:01.101285+0000","last_peered":"2024-09-10T08:45:01.101285+0000","last_clean":"2024-09-10T08:45:01.101285+0000","last_became_active":"2024-09-10T08:28:47.631523+0000","last_became_peered":"2024-09-10T08:28:47.631523+0000","last_unstale":"2024-09-10T08:45:01.101285+0000","last_undegraded":"2024-09-10T08:45:01.101285+0000","last_fullsized":"2024-09-10T08:45:01.101285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5319","last_scrub_stamp":"2024-09-10T08:45:01.101178+0000","last_deep_scrub":"27'5319","last_deep_scrub_stamp":"2024-09-10T08:45:01.101178+0000","last_clean_scrub_stamp":"2024-09-10T08:45:01.101178+0000","objects_scrubbed":0,"log_size":5319,"log_dups_size":0,"ondisk_log_size":5319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:04.377592+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28163,"num_write_kb":342261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'4477","reported_seq":4517,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:59.309626+0000","last_change":"2024-09-10T08:44:59.309655+0000","last_active":"2024-09-10T08:44:59.309626+0000","last_peered":"2024-09-10T08:44:59.309626+0000","last_clean":"2024-09-10T08:44:59.309626+0000","last_became_active":"2024-09-10T08:28:35.569960+0000","last_became_peered":"2024-09-10T08:28:35.569960+0000","last_unstale":"2024-09-10T08:44:59.309626+0000","last_undegraded":"2024-09-10T08:44:59.309626+0000","last_fullsized":"2024-09-10T08:44:59.309626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4477","last_scrub_stamp":"2024-09-10T08:44:59.309528+0000","last_deep_scrub":"27'4477","last_deep_scrub_stamp":"2024-09-10T08:44:59.309528+0000","last_clean_scrub_stamp":"2024-09-10T08:44:59.309528+0000","objects_scrubbed":0,"log_size":4477,"log_dups_size":0,"ondisk_log_size":4477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:39.558604+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23485,"num_write_kb":274341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"27'5295","reported_seq":5326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:02.542536+0000","last_change":"2024-09-10T08:45:02.542560+0000","last_active":"2024-09-10T08:45:02.542536+0000","last_peered":"2024-09-10T08:45:02.542536+0000","last_clean":"2024-09-10T08:45:02.542536+0000","last_became_active":"2024-09-10T08:28:47.633315+0000","last_became_peered":"2024-09-10T08:28:47.633315+0000","last_unstale":"2024-09-10T08:45:02.542536+0000","last_undegraded":"2024-09-10T08:45:02.542536+0000","last_fullsized":"2024-09-10T08:45:02.542536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5295","last_scrub_stamp":"2024-09-10T08:45:02.542443+0000","last_deep_scrub":"27'5295","last_deep_scrub_stamp":"2024-09-10T08:45:02.542443+0000","last_clean_scrub_stamp":"2024-09-10T08:45:02.542443+0000","objects_scrubbed":0,"log_size":5295,"log_dups_size":0,"ondisk_log_size":5295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:31.669501+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28671,"num_write_kb":360707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"27'4645","reported_seq":4685,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:54.182915+0000","last_change":"2024-09-10T08:44:54.182915+0000","last_active":"2024-09-10T08:44:54.182915+0000","last_peered":"2024-09-10T08:44:54.182915+0000","last_clean":"2024-09-10T08:44:54.182915+0000","last_became_active":"2024-09-10T08:28:35.560409+0000","last_became_peered":"2024-09-10T08:28:35.560409+0000","last_unstale":"2024-09-10T08:44:54.182915+0000","last_undegraded":"2024-09-10T08:44:54.182915+0000","last_fullsized":"2024-09-10T08:44:54.182915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4645","last_scrub_stamp":"2024-09-10T08:44:54.182783+0000","last_deep_scrub":"27'4645","last_deep_scrub_stamp":"2024-09-10T08:44:54.182783+0000","last_clean_scrub_stamp":"2024-09-10T08:44:54.182783+0000","objects_scrubbed":0,"log_size":4645,"log_dups_size":0,"ondisk_log_size":4645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:16.361829+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23495,"num_write_kb":303194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"27'3828","reported_seq":3859,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:50.044322+0000","last_change":"2024-09-10T08:44:50.044346+0000","last_active":"2024-09-10T08:44:50.044322+0000","last_peered":"2024-09-10T08:44:50.044322+0000","last_clean":"2024-09-10T08:44:50.044322+0000","last_became_active":"2024-09-10T08:28:47.622205+0000","last_became_peered":"2024-09-10T08:28:47.622205+0000","last_unstale":"2024-09-10T08:44:50.044322+0000","last_undegraded":"2024-09-10T08:44:50.044322+0000","last_fullsized":"2024-09-10T08:44:50.044322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3828","last_scrub_stamp":"2024-09-10T08:44:50.044229+0000","last_deep_scrub":"27'3828","last_deep_scrub_stamp":"2024-09-10T08:44:50.044229+0000","last_clean_scrub_stamp":"2024-09-10T08:44:50.044229+0000","objects_scrubbed":0,"log_size":3828,"log_dups_size":0,"ondisk_log_size":3828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:51.908797+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19475,"num_write_kb":250147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'5239","reported_seq":5279,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:46.949250+0000","last_change":"2024-09-10T08:44:46.949250+0000","last_active":"2024-09-10T08:44:46.949250+0000","last_peered":"2024-09-10T08:44:46.949250+0000","last_clean":"2024-09-10T08:44:46.949250+0000","last_became_active":"2024-09-10T08:28:35.574256+0000","last_became_peered":"2024-09-10T08:28:35.574256+0000","last_unstale":"2024-09-10T08:44:46.949250+0000","last_undegraded":"2024-09-10T08:44:46.949250+0000","last_fullsized":"2024-09-10T08:44:46.949250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5239","last_scrub_stamp":"2024-09-10T08:44:46.949125+0000","last_deep_scrub":"27'5239","last_deep_scrub_stamp":"2024-09-10T08:44:46.949125+0000","last_clean_scrub_stamp":"2024-09-10T08:44:46.949125+0000","objects_scrubbed":0,"log_size":5239,"log_dups_size":0,"ondisk_log_size":5239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:10.417229+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27760,"num_write_kb":320273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"27'4221","reported_seq":4252,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:08.831779+0000","last_change":"2024-09-10T08:45:08.831829+0000","last_active":"2024-09-10T08:45:08.831779+0000","last_peered":"2024-09-10T08:45:08.831779+0000","last_clean":"2024-09-10T08:45:08.831779+0000","last_became_active":"2024-09-10T08:28:47.633189+0000","last_became_peered":"2024-09-10T08:28:47.633189+0000","last_unstale":"2024-09-10T08:45:08.831779+0000","last_undegraded":"2024-09-10T08:45:08.831779+0000","last_fullsized":"2024-09-10T08:45:08.831779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4221","last_scrub_stamp":"2024-09-10T08:45:08.831660+0000","last_deep_scrub":"27'4221","last_deep_scrub_stamp":"2024-09-10T08:45:08.831660+0000","last_clean_scrub_stamp":"2024-09-10T08:45:08.831660+0000","objects_scrubbed":0,"log_size":4221,"log_dups_size":0,"ondisk_log_size":4221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:53.172970+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21808,"num_write_kb":284043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"27'4276","reported_seq":4315,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:59.604437+0000","last_change":"2024-09-10T08:44:59.604473+0000","last_active":"2024-09-10T08:44:59.604437+0000","last_peered":"2024-09-10T08:44:59.604437+0000","last_clean":"2024-09-10T08:44:59.604437+0000","last_became_active":"2024-09-10T08:28:35.572992+0000","last_became_peered":"2024-09-10T08:28:35.572992+0000","last_unstale":"2024-09-10T08:44:59.604437+0000","last_undegraded":"2024-09-10T08:44:59.604437+0000","last_fullsized":"2024-09-10T08:44:59.604437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4276","last_scrub_stamp":"2024-09-10T08:44:59.604336+0000","last_deep_scrub":"27'4276","last_deep_scrub_stamp":"2024-09-10T08:44:59.604336+0000","last_clean_scrub_stamp":"2024-09-10T08:44:59.604336+0000","objects_scrubbed":0,"log_size":4276,"log_dups_size":0,"ondisk_log_size":4276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:38.587447+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22251,"num_write_kb":273423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"27'4525","reported_seq":4557,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:08.705938+0000","last_change":"2024-09-10T08:45:08.705938+0000","last_active":"2024-09-10T08:45:08.705938+0000","last_peered":"2024-09-10T08:45:08.705938+0000","last_clean":"2024-09-10T08:45:08.705938+0000","last_became_active":"2024-09-10T08:28:47.630447+0000","last_became_peered":"2024-09-10T08:28:47.630447+0000","last_unstale":"2024-09-10T08:45:08.705938+0000","last_undegraded":"2024-09-10T08:45:08.705938+0000","last_fullsized":"2024-09-10T08:45:08.705938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4525","last_scrub_stamp":"2024-09-10T08:45:08.705794+0000","last_deep_scrub":"27'4525","last_deep_scrub_stamp":"2024-09-10T08:45:08.705794+0000","last_clean_scrub_stamp":"2024-09-10T08:45:08.705794+0000","objects_scrubbed":0,"log_size":4525,"log_dups_size":0,"ondisk_log_size":4525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:46.993374+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23690,"num_write_kb":303969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'4030","reported_seq":4069,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:49.477049+0000","last_change":"2024-09-10T08:44:49.477091+0000","last_active":"2024-09-10T08:44:49.477049+0000","last_peered":"2024-09-10T08:44:49.477049+0000","last_clean":"2024-09-10T08:44:49.477049+0000","last_became_active":"2024-09-10T08:28:35.566205+0000","last_became_peered":"2024-09-10T08:28:35.566205+0000","last_unstale":"2024-09-10T08:44:49.477049+0000","last_undegraded":"2024-09-10T08:44:49.477049+0000","last_fullsized":"2024-09-10T08:44:49.477049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4030","last_scrub_stamp":"2024-09-10T08:44:49.476934+0000","last_deep_scrub":"27'4030","last_deep_scrub_stamp":"2024-09-10T08:44:49.476934+0000","last_clean_scrub_stamp":"2024-09-10T08:44:49.476934+0000","objects_scrubbed":0,"log_size":4030,"log_dups_size":0,"ondisk_log_size":4030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:05.294555+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20014,"num_write_kb":252379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"27'4167","reported_seq":4198,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:53.307210+0000","last_change":"2024-09-10T08:44:53.307238+0000","last_active":"2024-09-10T08:44:53.307210+0000","last_peered":"2024-09-10T08:44:53.307210+0000","last_clean":"2024-09-10T08:44:53.307210+0000","last_became_active":"2024-09-10T08:28:47.627747+0000","last_became_peered":"2024-09-10T08:28:47.627747+0000","last_unstale":"2024-09-10T08:44:53.307210+0000","last_undegraded":"2024-09-10T08:44:53.307210+0000","last_fullsized":"2024-09-10T08:44:53.307210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4167","last_scrub_stamp":"2024-09-10T08:44:53.307107+0000","last_deep_scrub":"27'4167","last_deep_scrub_stamp":"2024-09-10T08:44:53.307107+0000","last_clean_scrub_stamp":"2024-09-10T08:44:53.307107+0000","objects_scrubbed":0,"log_size":4167,"log_dups_size":0,"ondisk_log_size":4167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:45.390276+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22015,"num_write_kb":272523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"27'4068","reported_seq":4107,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:51.159917+0000","last_change":"2024-09-10T08:44:51.159944+0000","last_active":"2024-09-10T08:44:51.159917+0000","last_peered":"2024-09-10T08:44:51.159917+0000","last_clean":"2024-09-10T08:44:51.159917+0000","last_became_active":"2024-09-10T08:28:35.564747+0000","last_became_peered":"2024-09-10T08:28:35.564747+0000","last_unstale":"2024-09-10T08:44:51.159917+0000","last_undegraded":"2024-09-10T08:44:51.159917+0000","last_fullsized":"2024-09-10T08:44:51.159917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4068","last_scrub_stamp":"2024-09-10T08:44:51.159807+0000","last_deep_scrub":"27'4068","last_deep_scrub_stamp":"2024-09-10T08:44:51.159807+0000","last_clean_scrub_stamp":"2024-09-10T08:44:51.159807+0000","objects_scrubbed":0,"log_size":4068,"log_dups_size":0,"ondisk_log_size":4068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:19.326740+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20848,"num_write_kb":280067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"27'3614","reported_seq":3646,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:04.811189+0000","last_change":"2024-09-10T08:45:04.811189+0000","last_active":"2024-09-10T08:45:04.811189+0000","last_peered":"2024-09-10T08:45:04.811189+0000","last_clean":"2024-09-10T08:45:04.811189+0000","last_became_active":"2024-09-10T08:28:47.630617+0000","last_became_peered":"2024-09-10T08:28:47.630617+0000","last_unstale":"2024-09-10T08:45:04.811189+0000","last_undegraded":"2024-09-10T08:45:04.811189+0000","last_fullsized":"2024-09-10T08:45:04.811189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3614","last_scrub_stamp":"2024-09-10T08:45:04.811066+0000","last_deep_scrub":"27'3614","last_deep_scrub_stamp":"2024-09-10T08:45:04.811066+0000","last_clean_scrub_stamp":"2024-09-10T08:45:04.811066+0000","objects_scrubbed":0,"log_size":3614,"log_dups_size":0,"ondisk_log_size":3614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:30:14.396161+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19300,"num_write_kb":257617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'4938","reported_seq":4977,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:52.129334+0000","last_change":"2024-09-10T08:44:52.129360+0000","last_active":"2024-09-10T08:44:52.129334+0000","last_peered":"2024-09-10T08:44:52.129334+0000","last_clean":"2024-09-10T08:44:52.129334+0000","last_became_active":"2024-09-10T08:28:35.570351+0000","last_became_peered":"2024-09-10T08:28:35.570351+0000","last_unstale":"2024-09-10T08:44:52.129334+0000","last_undegraded":"2024-09-10T08:44:52.129334+0000","last_fullsized":"2024-09-10T08:44:52.129334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4938","last_scrub_stamp":"2024-09-10T08:44:52.129233+0000","last_deep_scrub":"27'4938","last_deep_scrub_stamp":"2024-09-10T08:44:52.129233+0000","last_clean_scrub_stamp":"2024-09-10T08:44:52.129233+0000","objects_scrubbed":0,"log_size":4938,"log_dups_size":0,"ondisk_log_size":4938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:15:46.777558+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26047,"num_write_kb":333713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"27'4403","reported_seq":4435,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:02.429680+0000","last_change":"2024-09-10T08:45:02.429680+0000","last_active":"2024-09-10T08:45:02.429680+0000","last_peered":"2024-09-10T08:45:02.429680+0000","last_clean":"2024-09-10T08:45:02.429680+0000","last_became_active":"2024-09-10T08:28:47.625781+0000","last_became_peered":"2024-09-10T08:28:47.625781+0000","last_unstale":"2024-09-10T08:45:02.429680+0000","last_undegraded":"2024-09-10T08:45:02.429680+0000","last_fullsized":"2024-09-10T08:45:02.429680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4403","last_scrub_stamp":"2024-09-10T08:45:02.429459+0000","last_deep_scrub":"27'4403","last_deep_scrub_stamp":"2024-09-10T08:45:02.429459+0000","last_clean_scrub_stamp":"2024-09-10T08:45:02.429459+0000","objects_scrubbed":0,"log_size":4403,"log_dups_size":0,"ondisk_log_size":4403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:21.258478+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22837,"num_write_kb":300422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"27'5731","reported_seq":5770,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:43.929410+0000","last_change":"2024-09-10T08:44:43.929437+0000","last_active":"2024-09-10T08:44:43.929410+0000","last_peered":"2024-09-10T08:44:43.929410+0000","last_clean":"2024-09-10T08:44:43.929410+0000","last_became_active":"2024-09-10T08:28:35.576191+0000","last_became_peered":"2024-09-10T08:28:35.576191+0000","last_unstale":"2024-09-10T08:44:43.929410+0000","last_undegraded":"2024-09-10T08:44:43.929410+0000","last_fullsized":"2024-09-10T08:44:43.929410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5731","last_scrub_stamp":"2024-09-10T08:44:43.929301+0000","last_deep_scrub":"27'5731","last_deep_scrub_stamp":"2024-09-10T08:44:43.929301+0000","last_clean_scrub_stamp":"2024-09-10T08:44:43.929301+0000","objects_scrubbed":0,"log_size":5731,"log_dups_size":0,"ondisk_log_size":5731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:51.527656+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30251,"num_write_kb":366959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"27'5875","reported_seq":5907,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:02.626486+0000","last_change":"2024-09-10T08:45:02.626509+0000","last_active":"2024-09-10T08:45:02.626486+0000","last_peered":"2024-09-10T08:45:02.626486+0000","last_clean":"2024-09-10T08:45:02.626486+0000","last_became_active":"2024-09-10T08:28:47.622851+0000","last_became_peered":"2024-09-10T08:28:47.622851+0000","last_unstale":"2024-09-10T08:45:02.626486+0000","last_undegraded":"2024-09-10T08:45:02.626486+0000","last_fullsized":"2024-09-10T08:45:02.626486+0000","mapping_epoch":23,"log_start":"27'700","ondisk_log_start":"27'700","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5875","last_scrub_stamp":"2024-09-10T08:45:02.626387+0000","last_deep_scrub":"27'5875","last_deep_scrub_stamp":"2024-09-10T08:45:02.626387+0000","last_clean_scrub_stamp":"2024-09-10T08:45:02.626387+0000","objects_scrubbed":0,"log_size":5175,"log_dups_size":0,"ondisk_log_size":5175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:32.220520+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31498,"num_write_kb":384432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"27'4833","reported_seq":4872,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:51.667144+0000","last_change":"2024-09-10T08:44:51.667172+0000","last_active":"2024-09-10T08:44:51.667144+0000","last_peered":"2024-09-10T08:44:51.667144+0000","last_clean":"2024-09-10T08:44:51.667144+0000","last_became_active":"2024-09-10T08:28:35.575052+0000","last_became_peered":"2024-09-10T08:28:35.575052+0000","last_unstale":"2024-09-10T08:44:51.667144+0000","last_undegraded":"2024-09-10T08:44:51.667144+0000","last_fullsized":"2024-09-10T08:44:51.667144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4833","last_scrub_stamp":"2024-09-10T08:44:51.667034+0000","last_deep_scrub":"27'4833","last_deep_scrub_stamp":"2024-09-10T08:44:51.667034+0000","last_clean_scrub_stamp":"2024-09-10T08:44:51.667034+0000","objects_scrubbed":0,"log_size":4833,"log_dups_size":0,"ondisk_log_size":4833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:21.326318+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24290,"num_write_kb":318500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"27'3897","reported_seq":3929,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:00.231760+0000","last_change":"2024-09-10T08:45:00.231787+0000","last_active":"2024-09-10T08:45:00.231760+0000","last_peered":"2024-09-10T08:45:00.231760+0000","last_clean":"2024-09-10T08:45:00.231760+0000","last_became_active":"2024-09-10T08:28:47.628343+0000","last_became_peered":"2024-09-10T08:28:47.628343+0000","last_unstale":"2024-09-10T08:45:00.231760+0000","last_undegraded":"2024-09-10T08:45:00.231760+0000","last_fullsized":"2024-09-10T08:45:00.231760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3897","last_scrub_stamp":"2024-09-10T08:45:00.231666+0000","last_deep_scrub":"27'3897","last_deep_scrub_stamp":"2024-09-10T08:45:00.231666+0000","last_clean_scrub_stamp":"2024-09-10T08:45:00.231666+0000","objects_scrubbed":0,"log_size":3897,"log_dups_size":0,"ondisk_log_size":3897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:00.215378+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20646,"num_write_kb":258901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"27'4919","reported_seq":4958,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:44.941138+0000","last_change":"2024-09-10T08:44:44.941177+0000","last_active":"2024-09-10T08:44:44.941138+0000","last_peered":"2024-09-10T08:44:44.941138+0000","last_clean":"2024-09-10T08:44:44.941138+0000","last_became_active":"2024-09-10T08:28:35.578384+0000","last_became_peered":"2024-09-10T08:28:35.578384+0000","last_unstale":"2024-09-10T08:44:44.941138+0000","last_undegraded":"2024-09-10T08:44:44.941138+0000","last_fullsized":"2024-09-10T08:44:44.941138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4919","last_scrub_stamp":"2024-09-10T08:44:44.941028+0000","last_deep_scrub":"27'4919","last_deep_scrub_stamp":"2024-09-10T08:44:44.941028+0000","last_clean_scrub_stamp":"2024-09-10T08:44:44.941028+0000","objects_scrubbed":0,"log_size":4919,"log_dups_size":0,"ondisk_log_size":4919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:29.151875+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25865,"num_write_kb":300415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"27'4164","reported_seq":4197,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:57.173887+0000","last_change":"2024-09-10T08:44:57.173934+0000","last_active":"2024-09-10T08:44:57.173887+0000","last_peered":"2024-09-10T08:44:57.173887+0000","last_clean":"2024-09-10T08:44:57.173887+0000","last_became_active":"2024-09-10T08:28:47.627237+0000","last_became_peered":"2024-09-10T08:28:47.627237+0000","last_unstale":"2024-09-10T08:44:57.173887+0000","last_undegraded":"2024-09-10T08:44:57.173887+0000","last_fullsized":"2024-09-10T08:44:57.173887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4164","last_scrub_stamp":"2024-09-10T08:44:57.173713+0000","last_deep_scrub":"27'4164","last_deep_scrub_stamp":"2024-09-10T08:44:57.173713+0000","last_clean_scrub_stamp":"2024-09-10T08:44:57.173713+0000","objects_scrubbed":0,"log_size":4164,"log_dups_size":0,"ondisk_log_size":4164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:19.175913+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22780,"num_write_kb":275817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'3973","reported_seq":4012,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:42.142964+0000","last_change":"2024-09-10T08:44:42.142989+0000","last_active":"2024-09-10T08:44:42.142964+0000","last_peered":"2024-09-10T08:44:42.142964+0000","last_clean":"2024-09-10T08:44:42.142964+0000","last_became_active":"2024-09-10T08:28:35.578475+0000","last_became_peered":"2024-09-10T08:28:35.578475+0000","last_unstale":"2024-09-10T08:44:42.142964+0000","last_undegraded":"2024-09-10T08:44:42.142964+0000","last_fullsized":"2024-09-10T08:44:42.142964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3973","last_scrub_stamp":"2024-09-10T08:44:42.142864+0000","last_deep_scrub":"27'3973","last_deep_scrub_stamp":"2024-09-10T08:44:42.142864+0000","last_clean_scrub_stamp":"2024-09-10T08:44:42.142864+0000","objects_scrubbed":0,"log_size":3973,"log_dups_size":0,"ondisk_log_size":3973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:28.837978+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20258,"num_write_kb":257321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"27'4520","reported_seq":4552,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:05.419122+0000","last_change":"2024-09-10T08:45:05.419184+0000","last_active":"2024-09-10T08:45:05.419122+0000","last_peered":"2024-09-10T08:45:05.419122+0000","last_clean":"2024-09-10T08:45:05.419122+0000","last_became_active":"2024-09-10T08:28:47.633776+0000","last_became_peered":"2024-09-10T08:28:47.633776+0000","last_unstale":"2024-09-10T08:45:05.419122+0000","last_undegraded":"2024-09-10T08:45:05.419122+0000","last_fullsized":"2024-09-10T08:45:05.419122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4520","last_scrub_stamp":"2024-09-10T08:45:05.418987+0000","last_deep_scrub":"27'4520","last_deep_scrub_stamp":"2024-09-10T08:45:05.418987+0000","last_clean_scrub_stamp":"2024-09-10T08:45:05.418987+0000","objects_scrubbed":0,"log_size":4520,"log_dups_size":0,"ondisk_log_size":4520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:31:12.985312+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23464,"num_write_kb":303031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'5689","reported_seq":5728,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:53.950356+0000","last_change":"2024-09-10T08:44:53.950385+0000","last_active":"2024-09-10T08:44:53.950356+0000","last_peered":"2024-09-10T08:44:53.950356+0000","last_clean":"2024-09-10T08:44:53.950356+0000","last_became_active":"2024-09-10T08:28:35.571803+0000","last_became_peered":"2024-09-10T08:28:35.571803+0000","last_unstale":"2024-09-10T08:44:53.950356+0000","last_undegraded":"2024-09-10T08:44:53.950356+0000","last_fullsized":"2024-09-10T08:44:53.950356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5689","last_scrub_stamp":"2024-09-10T08:44:53.950255+0000","last_deep_scrub":"27'5689","last_deep_scrub_stamp":"2024-09-10T08:44:53.950255+0000","last_clean_scrub_stamp":"2024-09-10T08:44:53.950255+0000","objects_scrubbed":0,"log_size":5689,"log_dups_size":0,"ondisk_log_size":5689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:27.010173+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28713,"num_write_kb":356779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"27'3638","reported_seq":3669,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:52.640770+0000","last_change":"2024-09-10T08:44:52.640797+0000","last_active":"2024-09-10T08:44:52.640770+0000","last_peered":"2024-09-10T08:44:52.640770+0000","last_clean":"2024-09-10T08:44:52.640770+0000","last_became_active":"2024-09-10T08:28:47.620220+0000","last_became_peered":"2024-09-10T08:28:47.620220+0000","last_unstale":"2024-09-10T08:44:52.640770+0000","last_undegraded":"2024-09-10T08:44:52.640770+0000","last_fullsized":"2024-09-10T08:44:52.640770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3638","last_scrub_stamp":"2024-09-10T08:44:52.640678+0000","last_deep_scrub":"27'3638","last_deep_scrub_stamp":"2024-09-10T08:44:52.640678+0000","last_clean_scrub_stamp":"2024-09-10T08:44:52.640678+0000","objects_scrubbed":0,"log_size":3638,"log_dups_size":0,"ondisk_log_size":3638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:18.286011+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18717,"num_write_kb":251073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"27'4254","reported_seq":4295,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:41.119606+0000","last_change":"2024-09-10T08:44:41.119632+0000","last_active":"2024-09-10T08:44:41.119606+0000","last_peered":"2024-09-10T08:44:41.119606+0000","last_clean":"2024-09-10T08:44:41.119606+0000","last_became_active":"2024-09-10T08:28:35.578680+0000","last_became_peered":"2024-09-10T08:28:35.578680+0000","last_unstale":"2024-09-10T08:44:41.119606+0000","last_undegraded":"2024-09-10T08:44:41.119606+0000","last_fullsized":"2024-09-10T08:44:41.119606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4254","last_scrub_stamp":"2024-09-10T08:44:41.119501+0000","last_deep_scrub":"27'4254","last_deep_scrub_stamp":"2024-09-10T08:44:41.119501+0000","last_clean_scrub_stamp":"2024-09-10T08:44:41.119501+0000","objects_scrubbed":0,"log_size":4254,"log_dups_size":0,"ondisk_log_size":4254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:51.667576+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22529,"num_write_kb":274609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"27'5728","reported_seq":5759,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:51.283581+0000","last_change":"2024-09-10T08:44:51.283606+0000","last_active":"2024-09-10T08:44:51.283581+0000","last_peered":"2024-09-10T08:44:51.283581+0000","last_clean":"2024-09-10T08:44:51.283581+0000","last_became_active":"2024-09-10T08:28:47.624585+0000","last_became_peered":"2024-09-10T08:28:47.624585+0000","last_unstale":"2024-09-10T08:44:51.283581+0000","last_undegraded":"2024-09-10T08:44:51.283581+0000","last_fullsized":"2024-09-10T08:44:51.283581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5728","last_scrub_stamp":"2024-09-10T08:44:51.283484+0000","last_deep_scrub":"27'5728","last_deep_scrub_stamp":"2024-09-10T08:44:51.283484+0000","last_clean_scrub_stamp":"2024-09-10T08:44:51.283484+0000","objects_scrubbed":0,"log_size":5728,"log_dups_size":0,"ondisk_log_size":5728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:56.641875+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28703,"num_write_kb":356727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'4780","reported_seq":4821,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:45.916669+0000","last_change":"2024-09-10T08:44:45.916669+0000","last_active":"2024-09-10T08:44:45.916669+0000","last_peered":"2024-09-10T08:44:45.916669+0000","last_clean":"2024-09-10T08:44:45.916669+0000","last_became_active":"2024-09-10T08:28:35.573646+0000","last_became_peered":"2024-09-10T08:28:35.573646+0000","last_unstale":"2024-09-10T08:44:45.916669+0000","last_undegraded":"2024-09-10T08:44:45.916669+0000","last_fullsized":"2024-09-10T08:44:45.916669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4780","last_scrub_stamp":"2024-09-10T08:44:45.916540+0000","last_deep_scrub":"27'4780","last_deep_scrub_stamp":"2024-09-10T08:44:45.916540+0000","last_clean_scrub_stamp":"2024-09-10T08:44:45.916540+0000","objects_scrubbed":0,"log_size":4780,"log_dups_size":0,"ondisk_log_size":4780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:21.431528+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24418,"num_write_kb":306743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"27'4700","reported_seq":4731,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:06.824246+0000","last_change":"2024-09-10T08:45:06.824274+0000","last_active":"2024-09-10T08:45:06.824246+0000","last_peered":"2024-09-10T08:45:06.824246+0000","last_clean":"2024-09-10T08:45:06.824246+0000","last_became_active":"2024-09-10T08:28:47.631456+0000","last_became_peered":"2024-09-10T08:28:47.631456+0000","last_unstale":"2024-09-10T08:45:06.824246+0000","last_undegraded":"2024-09-10T08:45:06.824246+0000","last_fullsized":"2024-09-10T08:45:06.824246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4700","last_scrub_stamp":"2024-09-10T08:45:06.824143+0000","last_deep_scrub":"27'4700","last_deep_scrub_stamp":"2024-09-10T08:45:06.824143+0000","last_clean_scrub_stamp":"2024-09-10T08:45:06.824143+0000","objects_scrubbed":0,"log_size":4700,"log_dups_size":0,"ondisk_log_size":4700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:22.754990+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23620,"num_write_kb":315928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'5816","reported_seq":5857,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:41.289041+0000","last_change":"2024-09-10T08:44:41.289041+0000","last_active":"2024-09-10T08:44:41.289041+0000","last_peered":"2024-09-10T08:44:41.289041+0000","last_clean":"2024-09-10T08:44:41.289041+0000","last_became_active":"2024-09-10T08:28:35.577852+0000","last_became_peered":"2024-09-10T08:28:35.577852+0000","last_unstale":"2024-09-10T08:44:41.289041+0000","last_undegraded":"2024-09-10T08:44:41.289041+0000","last_fullsized":"2024-09-10T08:44:41.289041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5816","last_scrub_stamp":"2024-09-10T08:44:41.288940+0000","last_deep_scrub":"27'5816","last_deep_scrub_stamp":"2024-09-10T08:44:41.288940+0000","last_clean_scrub_stamp":"2024-09-10T08:44:41.288940+0000","objects_scrubbed":0,"log_size":5816,"log_dups_size":0,"ondisk_log_size":5816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:41.317937+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30528,"num_write_kb":380548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"27'4272","reported_seq":4303,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:44:50.909454+0000","last_change":"2024-09-10T08:44:50.909482+0000","last_active":"2024-09-10T08:44:50.909454+0000","last_peered":"2024-09-10T08:44:50.909454+0000","last_clean":"2024-09-10T08:44:50.909454+0000","last_became_active":"2024-09-10T08:28:47.629713+0000","last_became_peered":"2024-09-10T08:28:47.629713+0000","last_unstale":"2024-09-10T08:44:50.909454+0000","last_undegraded":"2024-09-10T08:44:50.909454+0000","last_fullsized":"2024-09-10T08:44:50.909454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4272","last_scrub_stamp":"2024-09-10T08:44:50.909347+0000","last_deep_scrub":"27'4272","last_deep_scrub_stamp":"2024-09-10T08:44:50.909347+0000","last_clean_scrub_stamp":"2024-09-10T08:44:50.909347+0000","objects_scrubbed":0,"log_size":4272,"log_dups_size":0,"ondisk_log_size":4272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:24.975104+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22513,"num_write_kb":287067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"27'4101","reported_seq":4142,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T08:45:01.829904+0000","last_change":"2024-09-10T08:45:01.829904+0000","last_active":"2024-09-10T08:45:01.829904+0000","last_peered":"2024-09-10T08:45:01.829904+0000","last_clean":"2024-09-10T08:45:01.829904+0000","last_became_active":"2024-09-10T08:28:35.570749+0000","last_became_peered":"2024-09-10T08:28:35.570749+0000","last_unstale":"2024-09-10T08:45:01.829904+0000","last_undegraded":"2024-09-10T08:45:01.829904+0000","last_fullsized":"2024-09-10T08:45:01.829904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4101","last_scrub_stamp":"2024-09-10T08:45:01.829770+0000","last_deep_scrub":"27'4101","last_deep_scrub_stamp":"2024-09-10T08:45:01.829770+0000","last_clean_scrub_stamp":"2024-09-10T08:45:01.829770+0000","objects_scrubbed":0,"log_size":4101,"log_dups_size":0,"ondisk_log_size":4101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:35.497514+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21304,"num_write_kb":261525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1506886,"num_write_kb":19151846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":286269,"ondisk_log_size":286269,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":17622670,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":51,"num_read_kb":121,"num_write":4293,"num_write_kb":18856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":35307520,"data_stored":35245340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3559,"ondisk_log_size":3559,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1565097,"num_write_kb":19381290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":301805,"ondisk_log_size":301805,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":17928438,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":58,"num_read_kb":129,"num_write":4368,"num_write_kb":19205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":35921920,"data_stored":35856876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3649,"ondisk_log_size":3649,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509646,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1140720,"kb_used_data":13152,"kb_used_omap":1,"kb_used_meta":1127550,"kb_avail":93231120,"statfs":{"total":96636764160,"available":95468666880,"internally_reserved":0,"allocated":13467648,"data_stored":13288824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1154611659},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509645,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1037512,"kb_used_data":4472,"kb_used_omap":1,"kb_used_meta":1033022,"kb_avail":93334328,"statfs":{"total":96636764160,"available":95574351872,"internally_reserved":0,"allocated":4579328,"data_stored":4398018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1057814981},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509647,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1082628,"kb_used_data":10356,"kb_used_omap":1,"kb_used_meta":1072254,"kb_avail":93289212,"statfs":{"total":96636764160,"available":95528153088,"internally_reserved":0,"allocated":10604544,"data_stored":10409366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1097988549},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509648,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1135220,"kb_used_data":17508,"kb_used_omap":1,"kb_used_meta":1117694,"kb_avail":93236620,"statfs":{"total":96636764160,"available":95474298880,"internally_reserved":0,"allocated":17928192,"data_stored":17737438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1144519111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509647,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":892856,"kb_used_data":8488,"kb_used_omap":1,"kb_used_meta":884350,"kb_avail":93478984,"statfs":{"total":96636764160,"available":95722479616,"internally_reserved":0,"allocated":8691712,"data_stored":8504334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":905574853},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509647,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":911348,"kb_used_data":9060,"kb_used_omap":1,"kb_used_meta":902270,"kb_avail":93460492,"statfs":{"total":96636764160,"available":95703543808,"internally_reserved":0,"allocated":9277440,"data_stored":9094486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":923924933},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575053,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":775044,"kb_used_data":9524,"kb_used_omap":1,"kb_used_meta":765502,"kb_avail":93596796,"statfs":{"total":96636764160,"available":95843119104,"internally_reserved":0,"allocated":9752576,"data_stored":9566440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":783874503},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575056,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":725760,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":725374,"kb_avail":93646080,"statfs":{"total":96636764160,"available":95893585920,"internally_reserved":0,"allocated":376832,"data_stored":203022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":742783430},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4206592,"data_stored":4194942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":88080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8486912,"data_stored":8477360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5271552,"data_stored":5256102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5267456,"data_stored":5256648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12583494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9158656,"data_stored":9145206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5050368,"data_stored":5038392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4292608,"data_stored":4283056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:45:22.803 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-10T08:45:22.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.931+0000 7f98d501e640 1 Processor -- start 2024-09-10T08:45:22.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.931+0000 7f98d501e640 1 -- start start 2024-09-10T08:45:22.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.932+0000 7f98d501e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f98d00c3df0 0x7f98d0070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:22.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.932+0000 7f98d501e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98d00c8d20 0x7f98d00c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:22.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.932+0000 7f98d501e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98d01572b0 con 0x7f98d0153c50 2024-09-10T08:45:22.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.932+0000 7f98d501e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f98d0154030 con 0x7f98d00c3df0 2024-09-10T08:45:22.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.932+0000 7f98d501e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f98d01566a0 con 0x7f98d00c8d20 2024-09-10T08:45:22.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.933+0000 7f98cf59e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98d00c8d20 0x7f98d00c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:22.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.933+0000 7f98ce59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f98d00c3df0 0x7f98d0070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:22.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.933+0000 7f98cf59e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98d00c8d20 0x7f98d00c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:34726/0 (socket says 172.21.15.103:34726) 2024-09-10T08:45:22.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.933+0000 7f98cf59e640 1 -- 172.21.15.103:0/1437240574 learned_addr learned my addr 172.21.15.103:0/1437240574 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:45:22.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.933+0000 7f98cf59e640 1 -- 172.21.15.103:0/1437240574 >> v2:172.21.15.154:3300/0 conn(0x7f98d00c3df0 msgr2=0x7f98d0070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:22.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.933+0000 7f98cf59e640 1 --2- 172.21.15.103:0/1437240574 >> v2:172.21.15.154:3300/0 conn(0x7f98d00c3df0 0x7f98d0070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:22.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.933+0000 7f98cf59e640 1 -- 172.21.15.103:0/1437240574 >> v1:172.21.15.154:6789/0 conn(0x7f98d0153c50 legacy=0x7f98d00c30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:22.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.933+0000 7f98cf59e640 1 -- 172.21.15.103:0/1437240574 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d0156980 con 0x7f98d00c8d20 2024-09-10T08:45:22.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.933+0000 7f98ce59c640 1 --2- 172.21.15.103:0/1437240574 >> v2:172.21.15.154:3300/0 conn(0x7f98d00c3df0 0x7f98d0070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:45:22.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.934+0000 7f98cf59e640 1 --2- 172.21.15.103:0/1437240574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98d00c8d20 0x7f98d00c91b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009e50 tx=0x7f98c802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=440bf976cc1f0c26 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:22.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.934+0000 7f98cdd9b640 1 -- 172.21.15.103:0/1437240574 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c8036070 con 0x7f98d00c8d20 2024-09-10T08:45:22.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.934+0000 7f98cdd9b640 1 -- 172.21.15.103:0/1437240574 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98c8031600 con 0x7f98d00c8d20 2024-09-10T08:45:22.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.934+0000 7f98cdd9b640 1 -- 172.21.15.103:0/1437240574 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c80319d0 con 0x7f98d00c8d20 2024-09-10T08:45:22.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.934+0000 7f98d501e640 1 -- 172.21.15.103:0/1437240574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98d00c8d20 msgr2=0x7f98d00c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:22.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.934+0000 7f98d501e640 1 --2- 172.21.15.103:0/1437240574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98d00c8d20 0x7f98d00c91b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009e50 tx=0x7f98c802a680 comp rx=0 tx=0).stop 2024-09-10T08:45:22.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.934+0000 7f98d501e640 1 -- 172.21.15.103:0/1437240574 shutdown_connections 2024-09-10T08:45:22.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.934+0000 7f98d501e640 1 --2- 172.21.15.103:0/1437240574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98d00c8d20 0x7f98d00c91b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:22.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.934+0000 7f98d501e640 1 --2- 172.21.15.103:0/1437240574 >> v2:172.21.15.154:3300/0 conn(0x7f98d00c3df0 0x7f98d0070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:22.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.934+0000 7f98d501e640 1 -- 172.21.15.103:0/1437240574 >> 172.21.15.103:0/1437240574 conn(0x7f98d00aba20 msgr2=0x7f98d00abe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:22.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.935+0000 7f98d501e640 1 -- 172.21.15.103:0/1437240574 shutdown_connections 2024-09-10T08:45:22.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.935+0000 7f98d501e640 1 -- 172.21.15.103:0/1437240574 wait complete. 2024-09-10T08:45:22.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.936+0000 7f98d501e640 1 Processor -- start 2024-09-10T08:45:22.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.936+0000 7f98d501e640 1 -- start start 2024-09-10T08:45:22.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.937+0000 7f98d501e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98d00c3df0 0x7f98d01ef8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:22.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.937+0000 7f98d501e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98d00c8d20 0x7f98d0149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:22.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.937+0000 7f98d501e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98d0153c50 0x7f98d0149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:22.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.937+0000 7f98d501e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f98d0156350 con 0x7f98d00c3df0 2024-09-10T08:45:22.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.937+0000 7f98d501e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f98d0156f40 con 0x7f98d0153c50 2024-09-10T08:45:22.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.937+0000 7f98d501e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f98d00c37b0 con 0x7f98d00c8d20 2024-09-10T08:45:22.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.937+0000 7f98ced9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98d00c3df0 0x7f98d01ef8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:22.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.937+0000 7f98ced9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98d00c3df0 0x7f98d01ef8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41774/0 (socket says 172.21.15.103:41774) 2024-09-10T08:45:22.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.937+0000 7f98ced9d640 1 -- 172.21.15.103:0/501306808 learned_addr learned my addr 172.21.15.103:0/501306808 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:45:22.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.937+0000 7f98ced9d640 1 -- 172.21.15.103:0/501306808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98d00c8d20 msgr2=0x7f98d0149240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:22.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.937+0000 7f98ced9d640 1 --2- 172.21.15.103:0/501306808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98d00c8d20 0x7f98d0149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:22.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.937+0000 7f98ced9d640 1 -- 172.21.15.103:0/501306808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98d0153c50 msgr2=0x7f98d0149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:22.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.937+0000 7f98ced9d640 1 --2- 172.21.15.103:0/501306808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98d0153c50 0x7f98d0149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:22.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.937+0000 7f98ced9d640 1 -- 172.21.15.103:0/501306808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d01e2420 con 0x7f98d00c3df0 2024-09-10T08:45:22.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.937+0000 7f98ced9d640 1 --2- 172.21.15.103:0/501306808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98d00c3df0 0x7f98d01ef8c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f98b800c400 tx=0x7f98b800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:22.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.937+0000 7f98c77fe640 1 -- 172.21.15.103:0/501306808 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b80052d0 con 0x7f98d00c3df0 2024-09-10T08:45:22.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.937+0000 7f98c77fe640 1 -- 172.21.15.103:0/501306808 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b8005490 con 0x7f98d00c3df0 2024-09-10T08:45:22.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.937+0000 7f98c77fe640 1 -- 172.21.15.103:0/501306808 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b8007260 con 0x7f98d00c3df0 2024-09-10T08:45:22.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.937+0000 7f98d501e640 1 -- 172.21.15.103:0/501306808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98d01f0100 con 0x7f98d00c3df0 2024-09-10T08:45:22.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.937+0000 7f98d501e640 1 -- 172.21.15.103:0/501306808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98d01efe00 con 0x7f98d00c3df0 2024-09-10T08:45:22.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.938+0000 7f98d501e640 1 -- 172.21.15.103:0/501306808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98d0070800 con 0x7f98d00c3df0 2024-09-10T08:45:22.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.939+0000 7f98c77fe640 1 -- 172.21.15.103:0/501306808 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98b8007400 con 0x7f98d00c3df0 2024-09-10T08:45:22.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.939+0000 7f98c77fe640 1 --2- 172.21.15.103:0/501306808 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f98b006be30 0x7f98b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:22.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.939+0000 7f98ce59c640 1 --2- 172.21.15.103:0/501306808 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f98b006be30 0x7f98b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:22.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.939+0000 7f98c77fe640 1 -- 172.21.15.103:0/501306808 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f98b808a700 con 0x7f98d00c3df0 2024-09-10T08:45:22.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.940+0000 7f98ce59c640 1 --2- 172.21.15.103:0/501306808 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f98b006be30 0x7f98b006e2f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f98c0006e80 tx=0x7f98c0006dd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:22.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:22.943+0000 7f98c77fe640 1 -- 172.21.15.103:0/501306808 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f98b8058da0 con 0x7f98d00c3df0 2024-09-10T08:45:23.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.111+0000 7f98d501e640 1 -- 172.21.15.103:0/501306808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f98d0070010 con 0x7f98d00c3df0 2024-09-10T08:45:23.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.114+0000 7f98c77fe640 1 -- 172.21.15.103:0/501306808 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f98b80586a0 con 0x7f98d00c3df0 2024-09-10T08:45:23.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.115+0000 7f98c77fe640 1 -- 172.21.15.103:0/501306808 <== mon.0 v2:172.21.15.103:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f98b805ca50 con 0x7f98d00c3df0 2024-09-10T08:45:23.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.117+0000 7f98d501e640 1 -- 172.21.15.103:0/501306808 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f98b006be30 msgr2=0x7f98b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:23.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.117+0000 7f98d501e640 1 --2- 172.21.15.103:0/501306808 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f98b006be30 0x7f98b006e2f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f98c0006e80 tx=0x7f98c0006dd0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.117+0000 7f98d501e640 1 -- 172.21.15.103:0/501306808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98d00c3df0 msgr2=0x7f98d01ef8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:23.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.117+0000 7f98d501e640 1 --2- 172.21.15.103:0/501306808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98d00c3df0 0x7f98d01ef8c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f98b800c400 tx=0x7f98b800c8c0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.117+0000 7f98d501e640 1 -- 172.21.15.103:0/501306808 shutdown_connections 2024-09-10T08:45:23.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.117+0000 7f98d501e640 1 --2- 172.21.15.103:0/501306808 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f98b006be30 0x7f98b006e2f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.117+0000 7f98d501e640 1 --2- 172.21.15.103:0/501306808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98d0153c50 0x7f98d0149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.117+0000 7f98d501e640 1 --2- 172.21.15.103:0/501306808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98d00c8d20 0x7f98d0149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.117+0000 7f98d501e640 1 --2- 172.21.15.103:0/501306808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98d00c3df0 0x7f98d01ef8c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.117+0000 7f98d501e640 1 -- 172.21.15.103:0/501306808 >> 172.21.15.103:0/501306808 conn(0x7f98d00aba20 msgr2=0x7f98d014c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:23.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.117+0000 7f98d501e640 1 -- 172.21.15.103:0/501306808 shutdown_connections 2024-09-10T08:45:23.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.117+0000 7f98d501e640 1 -- 172.21.15.103:0/501306808 wait complete. 2024-09-10T08:45:23.129 INFO:tasks.cephfs.filesystem:Destroying file system a and related pools 2024-09-10T08:45:23.129 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:45:23.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.228+0000 7f003282e640 1 Processor -- start 2024-09-10T08:45:23.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.228+0000 7f003282e640 1 -- start start 2024-09-10T08:45:23.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.229+0000 7f003282e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f002c1505f0 0x7f002c153910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:23.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.229+0000 7f003282e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f002c0c5940 con 0x7f002c0c42b0 2024-09-10T08:45:23.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.229+0000 7f003282e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f002c0c5c00 con 0x7f002c0c69c0 2024-09-10T08:45:23.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.229+0000 7f003282e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f002c0c7860 con 0x7f002c1505f0 2024-09-10T08:45:23.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.229+0000 7f0030dcb640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f002c0c42b0 0x7f002c0c46d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:34880/0 (socket says 172.21.15.103:34880) 2024-09-10T08:45:23.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.229+0000 7f0030dcb640 1 -- 172.21.15.103:0/3998869076 learned_addr learned my addr 172.21.15.103:0/3998869076 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:45:23.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.229+0000 7f002bfff640 1 --2- 172.21.15.103:0/3998869076 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f002c1505f0 0x7f002c153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:23.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.230+0000 7f002affd640 1 -- 172.21.15.103:0/3998869076 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2490332915 0 0) 0x7f002c0c5940 con 0x7f002c0c42b0 2024-09-10T08:45:23.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.230+0000 7f002affd640 1 -- 172.21.15.103:0/3998869076 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0014003520 con 0x7f002c0c42b0 2024-09-10T08:45:23.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.230+0000 7f002bfff640 1 -- 172.21.15.103:0/3998869076 >> v1:172.21.15.154:6789/0 conn(0x7f002c0c69c0 legacy=0x7f002c0c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:23.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.230+0000 7f002affd640 1 -- 172.21.15.103:0/3998869076 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2093253098 0 0) 0x7f0014003520 con 0x7f002c0c42b0 2024-09-10T08:45:23.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.230+0000 7f002bfff640 1 -- 172.21.15.103:0/3998869076 >> v1:172.21.15.103:6789/0 conn(0x7f002c0c42b0 legacy=0x7f002c0c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:23.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.230+0000 7f002bfff640 1 -- 172.21.15.103:0/3998869076 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f002c0c5ee0 con 0x7f002c1505f0 2024-09-10T08:45:23.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.231+0000 7f002bfff640 1 --2- 172.21.15.103:0/3998869076 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f002c1505f0 0x7f002c153910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f001c009750 tx=0x7f001c029fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fbf8b18318d2765 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:23.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.231+0000 7f002affd640 1 -- 172.21.15.103:0/3998869076 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c037070 con 0x7f002c1505f0 2024-09-10T08:45:23.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.231+0000 7f002affd640 1 -- 172.21.15.103:0/3998869076 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f001c02aa40 con 0x7f002c1505f0 2024-09-10T08:45:23.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.231+0000 7f002affd640 1 -- 172.21.15.103:0/3998869076 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00240019f0 con 0x7f002c1505f0 2024-09-10T08:45:23.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.231+0000 7f003282e640 1 -- 172.21.15.103:0/3998869076 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f002c1505f0 msgr2=0x7f002c153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:23.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.231+0000 7f003282e640 1 --2- 172.21.15.103:0/3998869076 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f002c1505f0 0x7f002c153910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f001c009750 tx=0x7f001c029fb0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.231+0000 7f003282e640 1 -- 172.21.15.103:0/3998869076 shutdown_connections 2024-09-10T08:45:23.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.231+0000 7f003282e640 1 --2- 172.21.15.103:0/3998869076 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f002c1505f0 0x7f002c153910 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.231+0000 7f003282e640 1 -- 172.21.15.103:0/3998869076 >> 172.21.15.103:0/3998869076 conn(0x7f002c0c7a40 msgr2=0x7f002c0c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:23.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.231+0000 7f003282e640 1 -- 172.21.15.103:0/3998869076 shutdown_connections 2024-09-10T08:45:23.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.231+0000 7f003282e640 1 -- 172.21.15.103:0/3998869076 wait complete. 2024-09-10T08:45:23.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.232+0000 7f003282e640 1 Processor -- start 2024-09-10T08:45:23.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.233+0000 7f003282e640 1 -- start start 2024-09-10T08:45:23.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.233+0000 7f003282e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f002c0c42b0 0x7f002c151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:23.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.233+0000 7f003282e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f002c1505f0 0x7f002c1de7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:23.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.233+0000 7f003282e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f002c1dece0 0x7f002c1ecf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:23.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.233+0000 7f003282e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f002c1509d0 con 0x7f002c0c42b0 2024-09-10T08:45:23.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.233+0000 7f003282e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f002c0c64a0 con 0x7f002c1dece0 2024-09-10T08:45:23.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.233+0000 7f003282e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f002c150b50 con 0x7f002c1505f0 2024-09-10T08:45:23.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.233+0000 7f002bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f002c0c42b0 0x7f002c151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:23.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.233+0000 7f002bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f002c0c42b0 0x7f002c151fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41784/0 (socket says 172.21.15.103:41784) 2024-09-10T08:45:23.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.233+0000 7f002bfff640 1 -- 172.21.15.103:0/542572440 learned_addr learned my addr 172.21.15.103:0/542572440 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:45:23.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.234+0000 7f002b7fe640 1 --2- 172.21.15.103:0/542572440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f002c1505f0 0x7f002c1de7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:23.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.234+0000 7f0030dcb640 1 --2- 172.21.15.103:0/542572440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f002c1dece0 0x7f002c1ecf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:23.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.234+0000 7f002bfff640 1 -- 172.21.15.103:0/542572440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f002c1505f0 msgr2=0x7f002c1de7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:23.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.234+0000 7f002bfff640 1 --2- 172.21.15.103:0/542572440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f002c1505f0 0x7f002c1de7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.234+0000 7f002bfff640 1 -- 172.21.15.103:0/542572440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f002c1dece0 msgr2=0x7f002c1ecf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:23.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.234+0000 7f002bfff640 1 --2- 172.21.15.103:0/542572440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f002c1dece0 0x7f002c1ecf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.234+0000 7f002bfff640 1 -- 172.21.15.103:0/542572440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f002c1e0140 con 0x7f002c0c42b0 2024-09-10T08:45:23.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.234+0000 7f002b7fe640 1 --2- 172.21.15.103:0/542572440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f002c1505f0 0x7f002c1de7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:45:23.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.234+0000 7f0030dcb640 1 --2- 172.21.15.103:0/542572440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f002c1dece0 0x7f002c1ecf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:45:23.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.234+0000 7f002bfff640 1 --2- 172.21.15.103:0/542572440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f002c0c42b0 0x7f002c151fc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f001c029ff0 tx=0x7f001c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:23.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.234+0000 7f0028ff9640 1 -- 172.21.15.103:0/542572440 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c041070 con 0x7f002c0c42b0 2024-09-10T08:45:23.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.234+0000 7f0028ff9640 1 -- 172.21.15.103:0/542572440 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f001c032d10 con 0x7f002c0c42b0 2024-09-10T08:45:23.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.234+0000 7f003282e640 1 -- 172.21.15.103:0/542572440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f002c14eb40 con 0x7f002c0c42b0 2024-09-10T08:45:23.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.234+0000 7f0028ff9640 1 -- 172.21.15.103:0/542572440 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c037040 con 0x7f002c0c42b0 2024-09-10T08:45:23.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.234+0000 7f003282e640 1 -- 172.21.15.103:0/542572440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f002c1ea780 con 0x7f002c0c42b0 2024-09-10T08:45:23.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.235+0000 7f003282e640 1 -- 172.21.15.103:0/542572440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f002c1df0f0 con 0x7f002c0c42b0 2024-09-10T08:45:23.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.236+0000 7f0028ff9640 1 -- 172.21.15.103:0/542572440 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f001c044070 con 0x7f002c0c42b0 2024-09-10T08:45:23.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.236+0000 7f0028ff9640 1 --2- 172.21.15.103:0/542572440 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f001806be30 0x7f001806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:23.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.236+0000 7f0028ff9640 1 -- 172.21.15.103:0/542572440 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f001c0ab7b0 con 0x7f002c0c42b0 2024-09-10T08:45:23.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.236+0000 7f002b7fe640 1 --2- 172.21.15.103:0/542572440 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f001806be30 0x7f001806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:23.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.236+0000 7f002b7fe640 1 --2- 172.21.15.103:0/542572440 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f001806be30 0x7f001806e2f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f002c1e0000 tx=0x7f0020009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:23.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.240+0000 7f0028ff9640 1 -- 172.21.15.103:0/542572440 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f001c079e50 con 0x7f002c0c42b0 2024-09-10T08:45:23.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.443+0000 7f003282e640 1 -- 172.21.15.103:0/542572440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f002c0a6c10 con 0x7f002c0c42b0 2024-09-10T08:45:23.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.444+0000 7f0028ff9640 1 -- 172.21.15.103:0/542572440 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6536 (secure 0 0 0) 0x7f001c079750 con 0x7f002c0c42b0 2024-09-10T08:45:23.445 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:45:23.445 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":11,"btime":"2024-09-10T08:28:50:632324+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3378269214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3378269214},{"type":"v1","addr":"172.21.15.154:6833","nonce":3378269214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2141115327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2141115327},{"type":"v1","addr":"172.21.15.154:6835","nonce":2141115327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:34.885455+0000","modified":"2024-09-10T08:28:37.905202+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/3032037784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":3032037784},{"type":"v1","addr":"172.21.15.103:6837","nonce":3032037784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:46.949092+0000","modified":"2024-09-10T08:28:49.966725+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.103:6836/2250136134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2250136134},{"type":"v1","addr":"172.21.15.103:6836","nonce":2250136134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":2}]} 2024-09-10T08:45:23.445 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 11 2024-09-10T08:45:23.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.446+0000 7f003282e640 1 -- 172.21.15.103:0/542572440 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f001806be30 msgr2=0x7f001806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:23.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.446+0000 7f003282e640 1 --2- 172.21.15.103:0/542572440 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f001806be30 0x7f001806e2f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f002c1e0000 tx=0x7f0020009040 comp rx=0 tx=0).stop 2024-09-10T08:45:23.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.446+0000 7f003282e640 1 -- 172.21.15.103:0/542572440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f002c0c42b0 msgr2=0x7f002c151fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:23.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.446+0000 7f003282e640 1 --2- 172.21.15.103:0/542572440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f002c0c42b0 0x7f002c151fc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f001c029ff0 tx=0x7f001c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.446+0000 7f003282e640 1 -- 172.21.15.103:0/542572440 shutdown_connections 2024-09-10T08:45:23.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.446+0000 7f003282e640 1 --2- 172.21.15.103:0/542572440 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f001806be30 0x7f001806e2f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.446+0000 7f003282e640 1 --2- 172.21.15.103:0/542572440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f002c1dece0 0x7f002c1ecf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.446+0000 7f003282e640 1 --2- 172.21.15.103:0/542572440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f002c1505f0 0x7f002c1de7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.446+0000 7f003282e640 1 --2- 172.21.15.103:0/542572440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f002c0c42b0 0x7f002c151fc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.446+0000 7f003282e640 1 -- 172.21.15.103:0/542572440 >> 172.21.15.103:0/542572440 conn(0x7f002c0c7a40 msgr2=0x7f002c1dc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:23.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.446+0000 7f003282e640 1 -- 172.21.15.103:0/542572440 shutdown_connections 2024-09-10T08:45:23.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.446+0000 7f003282e640 1 -- 172.21.15.103:0/542572440 wait complete. 2024-09-10T08:45:23.459 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:45:23.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.557+0000 7faba4b28640 1 Processor -- start 2024-09-10T08:45:23.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.557+0000 7faba4b28640 1 -- start start 2024-09-10T08:45:23.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.558+0000 7faba4b28640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faba00afdd0 0x7faba00c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:23.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.558+0000 7faba4b28640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faba00c54e0 con 0x7faba00af870 2024-09-10T08:45:23.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.558+0000 7faba4b28640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faba00c74a0 con 0x7faba0153af0 2024-09-10T08:45:23.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.558+0000 7faba4b28640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7faba00c7740 con 0x7faba00afdd0 2024-09-10T08:45:23.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.558+0000 7fab9ed9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7faba00af870 0x7faba00c4780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:34888/0 (socket says 172.21.15.103:34888) 2024-09-10T08:45:23.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.558+0000 7fab9ed9d640 1 -- 172.21.15.103:0/1312420988 learned_addr learned my addr 172.21.15.103:0/1312420988 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:45:23.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.558+0000 7fab95d9b640 1 --2- 172.21.15.103:0/1312420988 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faba00afdd0 0x7faba00c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:23.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.558+0000 7fab9dd9b640 1 -- 172.21.15.103:0/1312420988 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2951090886 0 0) 0x7faba00c54e0 con 0x7faba00af870 2024-09-10T08:45:23.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.558+0000 7fab9dd9b640 1 -- 172.21.15.103:0/1312420988 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab8c003520 con 0x7faba00af870 2024-09-10T08:45:23.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.559+0000 7fab9dd9b640 1 -- 172.21.15.103:0/1312420988 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1303837776 0 0) 0x7fab8c003520 con 0x7faba00af870 2024-09-10T08:45:23.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.559+0000 7fab9dd9b640 1 -- 172.21.15.103:0/1312420988 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faba00afdd0 msgr2=0x7faba00c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:23.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.559+0000 7fab9dd9b640 1 --2- 172.21.15.103:0/1312420988 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faba00afdd0 0x7faba00c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.559+0000 7fab9dd9b640 1 -- 172.21.15.103:0/1312420988 >> v1:172.21.15.154:6789/0 conn(0x7faba0153af0 legacy=0x7faba01563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:23.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.559+0000 7fab9dd9b640 1 -- 172.21.15.103:0/1312420988 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba015a3c0 con 0x7faba00af870 2024-09-10T08:45:23.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.559+0000 7fab9dd9b640 1 -- 172.21.15.103:0/1312420988 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7fab980019f0 con 0x7faba00af870 2024-09-10T08:45:23.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.559+0000 7fab9dd9b640 1 -- 172.21.15.103:0/1312420988 >> v1:172.21.15.103:6789/0 conn(0x7faba00af870 legacy=0x7faba00c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:23.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.559+0000 7fab9dd9b640 1 --2- 172.21.15.103:0/1312420988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab8c0039e0 0x7fab8c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:23.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.559+0000 7fab9dd9b640 1 --2- 172.21.15.103:0/1312420988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab8c004800 0x7fab8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:23.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.559+0000 7fab9dd9b640 1 --2- 172.21.15.103:0/1312420988 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faba00afdd0 0x7fab8c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:23.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.559+0000 7fab9dd9b640 1 -- 172.21.15.103:0/1312420988 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faba00c7740 con 0x7fab8c004800 2024-09-10T08:45:23.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.559+0000 7fab9dd9b640 1 -- 172.21.15.103:0/1312420988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c00bb20 con 0x7fab8c0039e0 2024-09-10T08:45:23.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.559+0000 7fab9dd9b640 1 -- 172.21.15.103:0/1312420988 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fab8c00bd20 con 0x7faba00afdd0 2024-09-10T08:45:23.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.559+0000 7fab95d9b640 1 --2- 172.21.15.103:0/1312420988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab8c004800 0x7fab8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:23.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.559+0000 7fab9e59c640 1 --2- 172.21.15.103:0/1312420988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab8c0039e0 0x7fab8c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:23.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.559+0000 7fab9ed9d640 1 --2- 172.21.15.103:0/1312420988 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faba00afdd0 0x7fab8c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:23.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.559+0000 7fab95d9b640 1 -- 172.21.15.103:0/1312420988 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faba00afdd0 msgr2=0x7fab8c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:23.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.559+0000 7fab95d9b640 1 --2- 172.21.15.103:0/1312420988 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faba00afdd0 0x7fab8c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.559+0000 7fab95d9b640 1 -- 172.21.15.103:0/1312420988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab8c0039e0 msgr2=0x7fab8c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:23.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.559+0000 7fab95d9b640 1 --2- 172.21.15.103:0/1312420988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab8c0039e0 0x7fab8c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.559+0000 7fab95d9b640 1 -- 172.21.15.103:0/1312420988 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8c003520 con 0x7fab8c004800 2024-09-10T08:45:23.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.560+0000 7fab95d9b640 1 --2- 172.21.15.103:0/1312420988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab8c004800 0x7fab8c004c80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faba0076290 tx=0x7fab8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1954fc914fcfd232 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:23.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.560+0000 7fab9dd9b640 1 -- 172.21.15.103:0/1312420988 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab88036070 con 0x7fab8c004800 2024-09-10T08:45:23.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.560+0000 7fab9dd9b640 1 -- 172.21.15.103:0/1312420988 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fab88031400 con 0x7fab8c004800 2024-09-10T08:45:23.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.560+0000 7fab9dd9b640 1 -- 172.21.15.103:0/1312420988 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab88009690 con 0x7fab8c004800 2024-09-10T08:45:23.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.560+0000 7faba4b28640 1 -- 172.21.15.103:0/1312420988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab8c004800 msgr2=0x7fab8c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:23.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.560+0000 7faba4b28640 1 --2- 172.21.15.103:0/1312420988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab8c004800 0x7fab8c004c80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faba0076290 tx=0x7fab8c005830 comp rx=0 tx=0).stop 2024-09-10T08:45:23.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.560+0000 7fab9ed9d640 1 -- 172.21.15.103:0/1312420988 reap_dead start 2024-09-10T08:45:23.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.560+0000 7faba4b28640 1 -- 172.21.15.103:0/1312420988 shutdown_connections 2024-09-10T08:45:23.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.560+0000 7faba4b28640 1 -- 172.21.15.103:0/1312420988 >> 172.21.15.103:0/1312420988 conn(0x7faba00c6880 msgr2=0x7faba00c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:23.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.560+0000 7faba4b28640 1 -- 172.21.15.103:0/1312420988 shutdown_connections 2024-09-10T08:45:23.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.560+0000 7faba4b28640 1 -- 172.21.15.103:0/1312420988 wait complete. 2024-09-10T08:45:23.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.562+0000 7faba4b28640 1 Processor -- start 2024-09-10T08:45:23.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.562+0000 7faba4b28640 1 -- start start 2024-09-10T08:45:23.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7faba4b28640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab8c004800 0x7faba00c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:23.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7faba4b28640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faba00c27d0 0x7faba01ebd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:23.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7faba4b28640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faba00c3920 0x7faba01ec2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:23.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7faba4b28640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faba00c5010 con 0x7faba00c3920 2024-09-10T08:45:23.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7faba4b28640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faba00c4e90 con 0x7fab8c004800 2024-09-10T08:45:23.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7faba4b28640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7faba00c5190 con 0x7faba00c27d0 2024-09-10T08:45:23.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7fab9ed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faba00c3920 0x7faba01ec2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:23.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7fab9ed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faba00c3920 0x7faba01ec2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41796/0 (socket says 172.21.15.103:41796) 2024-09-10T08:45:23.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7fab9ed9d640 1 -- 172.21.15.103:0/2108943181 learned_addr learned my addr 172.21.15.103:0/2108943181 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:45:23.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7fab95d9b640 1 --2- 172.21.15.103:0/2108943181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faba00c27d0 0x7faba01ebd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:23.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7fab9e59c640 1 --2- 172.21.15.103:0/2108943181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab8c004800 0x7faba00c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:23.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7fab9ed9d640 1 -- 172.21.15.103:0/2108943181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faba00c27d0 msgr2=0x7faba01ebd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:23.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7fab9ed9d640 1 --2- 172.21.15.103:0/2108943181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faba00c27d0 0x7faba01ebd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7fab9ed9d640 1 -- 172.21.15.103:0/2108943181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab8c004800 msgr2=0x7faba00c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:23.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7fab9ed9d640 1 --2- 172.21.15.103:0/2108943181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab8c004800 0x7faba00c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7fab9ed9d640 1 -- 172.21.15.103:0/2108943181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba00c3510 con 0x7faba00c3920 2024-09-10T08:45:23.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7fab95d9b640 1 --2- 172.21.15.103:0/2108943181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faba00c27d0 0x7faba01ebd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:45:23.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7fab9e59c640 1 --2- 172.21.15.103:0/2108943181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab8c004800 0x7faba00c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:45:23.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7fab9ed9d640 1 --2- 172.21.15.103:0/2108943181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faba00c3920 0x7faba01ec2c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faba01574b0 tx=0x7fab9800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:23.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7fab977fe640 1 -- 172.21.15.103:0/2108943181 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9800ec40 con 0x7faba00c3920 2024-09-10T08:45:23.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7fab977fe640 1 -- 172.21.15.103:0/2108943181 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fab9800ede0 con 0x7faba00c3920 2024-09-10T08:45:23.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7faba4b28640 1 -- 172.21.15.103:0/2108943181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faba00c2c90 con 0x7faba00c3920 2024-09-10T08:45:23.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.563+0000 7fab977fe640 1 -- 172.21.15.103:0/2108943181 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab98014690 con 0x7faba00c3920 2024-09-10T08:45:23.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.564+0000 7faba4b28640 1 -- 172.21.15.103:0/2108943181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faba00c3230 con 0x7faba00c3920 2024-09-10T08:45:23.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.565+0000 7faba4b28640 1 -- 172.21.15.103:0/2108943181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faba00c53a0 con 0x7faba00c3920 2024-09-10T08:45:23.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.565+0000 7fab977fe640 1 -- 172.21.15.103:0/2108943181 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fab98014830 con 0x7faba00c3920 2024-09-10T08:45:23.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.565+0000 7fab977fe640 1 --2- 172.21.15.103:0/2108943181 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fab8006be30 0x7fab8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:23.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.565+0000 7fab977fe640 1 -- 172.21.15.103:0/2108943181 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fab9808b120 con 0x7faba00c3920 2024-09-10T08:45:23.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.565+0000 7fab9e59c640 1 --2- 172.21.15.103:0/2108943181 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fab8006be30 0x7fab8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:23.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.566+0000 7fab9e59c640 1 --2- 172.21.15.103:0/2108943181 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fab8006be30 0x7fab8006e2f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fab90003640 tx=0x7fab90009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:23.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.570+0000 7fab977fe640 1 -- 172.21.15.103:0/2108943181 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fab980596a0 con 0x7faba00c3920 2024-09-10T08:45:23.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.772+0000 7faba4b28640 1 -- 172.21.15.103:0/2108943181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faba0075520 con 0x7faba00c3920 2024-09-10T08:45:23.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.773+0000 7fab977fe640 1 -- 172.21.15.103:0/2108943181 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6536 (secure 0 0 0) 0x7fab98058fa0 con 0x7faba00c3920 2024-09-10T08:45:23.774 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:45:23.774 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":11,"btime":"2024-09-10T08:28:50:632324+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3378269214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3378269214},{"type":"v1","addr":"172.21.15.154:6833","nonce":3378269214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2141115327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2141115327},{"type":"v1","addr":"172.21.15.154:6835","nonce":2141115327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:34.885455+0000","modified":"2024-09-10T08:28:37.905202+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/3032037784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":3032037784},{"type":"v1","addr":"172.21.15.103:6837","nonce":3032037784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:46.949092+0000","modified":"2024-09-10T08:28:49.966725+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.103:6836/2250136134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2250136134},{"type":"v1","addr":"172.21.15.103:6836","nonce":2250136134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":2}]} 2024-09-10T08:45:23.774 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 11 2024-09-10T08:45:23.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.775+0000 7faba4b28640 1 -- 172.21.15.103:0/2108943181 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fab8006be30 msgr2=0x7fab8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:23.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.775+0000 7faba4b28640 1 --2- 172.21.15.103:0/2108943181 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fab8006be30 0x7fab8006e2f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fab90003640 tx=0x7fab90009040 comp rx=0 tx=0).stop 2024-09-10T08:45:23.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.775+0000 7faba4b28640 1 -- 172.21.15.103:0/2108943181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faba00c3920 msgr2=0x7faba01ec2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:23.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.775+0000 7faba4b28640 1 --2- 172.21.15.103:0/2108943181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faba00c3920 0x7faba01ec2c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faba01574b0 tx=0x7fab9800e530 comp rx=0 tx=0).stop 2024-09-10T08:45:23.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.775+0000 7faba4b28640 1 -- 172.21.15.103:0/2108943181 shutdown_connections 2024-09-10T08:45:23.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.775+0000 7faba4b28640 1 --2- 172.21.15.103:0/2108943181 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fab8006be30 0x7fab8006e2f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.775+0000 7faba4b28640 1 --2- 172.21.15.103:0/2108943181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faba00c3920 0x7faba01ec2c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.775+0000 7faba4b28640 1 --2- 172.21.15.103:0/2108943181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faba00c27d0 0x7faba01ebd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.775+0000 7faba4b28640 1 --2- 172.21.15.103:0/2108943181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab8c004800 0x7faba00c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.775+0000 7faba4b28640 1 -- 172.21.15.103:0/2108943181 >> 172.21.15.103:0/2108943181 conn(0x7faba00c6880 msgr2=0x7faba0070810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:23.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.775+0000 7faba4b28640 1 -- 172.21.15.103:0/2108943181 shutdown_connections 2024-09-10T08:45:23.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.775+0000 7faba4b28640 1 -- 172.21.15.103:0/2108943181 wait complete. 2024-09-10T08:45:23.787 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:45:23.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.885+0000 7f42a12ba640 1 Processor -- start 2024-09-10T08:45:23.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.885+0000 7f42a12ba640 1 -- start start 2024-09-10T08:45:23.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.885+0000 7f42a12ba640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f429c06c650 0x7f429c0c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:23.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.885+0000 7f42a12ba640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f429c0ca1c0 0x7f429c160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:23.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.885+0000 7f42a12ba640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f429c15a7c0 con 0x7f429c150480 2024-09-10T08:45:23.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.885+0000 7f42a12ba640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f429c06c240 con 0x7f429c06c650 2024-09-10T08:45:23.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.885+0000 7f42a12ba640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f429c15a330 con 0x7f429c0ca1c0 2024-09-10T08:45:23.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.886+0000 7f429a7fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f429c06c650 0x7f429c0c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:23.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.886+0000 7f429affd640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f429c150480 0x7f429c0c7a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:34904/0 (socket says 172.21.15.103:34904) 2024-09-10T08:45:23.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.886+0000 7f429affd640 1 -- 172.21.15.103:0/4276604602 learned_addr learned my addr 172.21.15.103:0/4276604602 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:45:23.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.886+0000 7f429b7fe640 1 --2- 172.21.15.103:0/4276604602 >> v2:172.21.15.154:3300/0 conn(0x7f429c0ca1c0 0x7f429c160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:23.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.886+0000 7f429a7fc640 1 -- 172.21.15.103:0/4276604602 >> v2:172.21.15.154:3300/0 conn(0x7f429c0ca1c0 msgr2=0x7f429c160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:23.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.886+0000 7f429a7fc640 1 --2- 172.21.15.103:0/4276604602 >> v2:172.21.15.154:3300/0 conn(0x7f429c0ca1c0 0x7f429c160bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.886+0000 7f429a7fc640 1 -- 172.21.15.103:0/4276604602 >> v1:172.21.15.103:6789/0 conn(0x7f429c150480 legacy=0x7f429c0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:23.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.886+0000 7f429a7fc640 1 -- 172.21.15.103:0/4276604602 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429c159a00 con 0x7f429c06c650 2024-09-10T08:45:23.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.886+0000 7f4299ffb640 1 -- 172.21.15.103:0/4276604602 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1166469023 0 0) 0x7f429c15a7c0 con 0x7f429c150480 2024-09-10T08:45:23.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.886+0000 7f429b7fe640 1 --2- 172.21.15.103:0/4276604602 >> v2:172.21.15.154:3300/0 conn(0x7f429c0ca1c0 0x7f429c160bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:45:23.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.887+0000 7f429a7fc640 1 --2- 172.21.15.103:0/4276604602 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f429c06c650 0x7f429c0c9c80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f429c06bc70 tx=0x7f429002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06b510fc9859f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:23.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.887+0000 7f4299ffb640 1 -- 172.21.15.103:0/4276604602 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4290037070 con 0x7f429c06c650 2024-09-10T08:45:23.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.887+0000 7f4299ffb640 1 -- 172.21.15.103:0/4276604602 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4290032440 con 0x7f429c06c650 2024-09-10T08:45:23.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.887+0000 7f4299ffb640 1 -- 172.21.15.103:0/4276604602 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4290032830 con 0x7f429c06c650 2024-09-10T08:45:23.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.887+0000 7f42a12ba640 1 -- 172.21.15.103:0/4276604602 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f429c06c650 msgr2=0x7f429c0c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:23.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.887+0000 7f42a12ba640 1 --2- 172.21.15.103:0/4276604602 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f429c06c650 0x7f429c0c9c80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f429c06bc70 tx=0x7f429002a1a0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.887+0000 7f42a12ba640 1 -- 172.21.15.103:0/4276604602 shutdown_connections 2024-09-10T08:45:23.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.887+0000 7f42a12ba640 1 --2- 172.21.15.103:0/4276604602 >> v2:172.21.15.154:3300/0 conn(0x7f429c0ca1c0 0x7f429c160bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.887+0000 7f42a12ba640 1 --2- 172.21.15.103:0/4276604602 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f429c06c650 0x7f429c0c9c80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.887+0000 7f42a12ba640 1 -- 172.21.15.103:0/4276604602 >> 172.21.15.103:0/4276604602 conn(0x7f429c068030 msgr2=0x7f429c073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:23.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.887+0000 7f42a12ba640 1 -- 172.21.15.103:0/4276604602 shutdown_connections 2024-09-10T08:45:23.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.887+0000 7f42a12ba640 1 -- 172.21.15.103:0/4276604602 wait complete. 2024-09-10T08:45:23.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.888+0000 7f42a12ba640 1 Processor -- start 2024-09-10T08:45:23.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.889+0000 7f42a12ba640 1 -- start start 2024-09-10T08:45:23.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.889+0000 7f42a12ba640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f429c06c650 0x7f429c0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:23.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.889+0000 7f42a12ba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f429c0ca1c0 0x7f429c0afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:23.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.889+0000 7f42a12ba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f429c150480 0x7f429c158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:23.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.889+0000 7f42a12ba640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f429c06d270 con 0x7f429c150480 2024-09-10T08:45:23.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.889+0000 7f42a12ba640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f429c159fc0 con 0x7f429c0ca1c0 2024-09-10T08:45:23.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.889+0000 7f42a12ba640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f429c0ca5f0 con 0x7f429c06c650 2024-09-10T08:45:23.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.889+0000 7f429b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f429c150480 0x7f429c158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:23.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.889+0000 7f429b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f429c150480 0x7f429c158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41816/0 (socket says 172.21.15.103:41816) 2024-09-10T08:45:23.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.889+0000 7f429b7fe640 1 -- 172.21.15.103:0/4140683213 learned_addr learned my addr 172.21.15.103:0/4140683213 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:45:23.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.889+0000 7f429affd640 1 --2- 172.21.15.103:0/4140683213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f429c06c650 0x7f429c0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:23.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.889+0000 7f429a7fc640 1 --2- 172.21.15.103:0/4140683213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f429c0ca1c0 0x7f429c0afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:23.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.890+0000 7f429b7fe640 1 -- 172.21.15.103:0/4140683213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f429c06c650 msgr2=0x7f429c0aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:23.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.890+0000 7f429b7fe640 1 --2- 172.21.15.103:0/4140683213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f429c06c650 0x7f429c0aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.890+0000 7f429b7fe640 1 -- 172.21.15.103:0/4140683213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f429c0ca1c0 msgr2=0x7f429c0afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:23.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.890+0000 7f429b7fe640 1 --2- 172.21.15.103:0/4140683213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f429c0ca1c0 0x7f429c0afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:23.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.890+0000 7f429b7fe640 1 -- 172.21.15.103:0/4140683213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429c0aec60 con 0x7f429c150480 2024-09-10T08:45:23.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.890+0000 7f429b7fe640 1 --2- 172.21.15.103:0/4140683213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f429c150480 0x7f429c158320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f429400cef0 tx=0x7f429400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:23.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.890+0000 7f42837fe640 1 -- 172.21.15.103:0/4140683213 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429401a070 con 0x7f429c150480 2024-09-10T08:45:23.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.890+0000 7f42837fe640 1 -- 172.21.15.103:0/4140683213 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f429400d860 con 0x7f429c150480 2024-09-10T08:45:23.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.890+0000 7f42a12ba640 1 -- 172.21.15.103:0/4140683213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f429c1e2570 con 0x7f429c150480 2024-09-10T08:45:23.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.890+0000 7f42837fe640 1 -- 172.21.15.103:0/4140683213 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429400dc70 con 0x7f429c150480 2024-09-10T08:45:23.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.890+0000 7f42a12ba640 1 -- 172.21.15.103:0/4140683213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f429c155d10 con 0x7f429c150480 2024-09-10T08:45:23.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.891+0000 7f42a12ba640 1 -- 172.21.15.103:0/4140683213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f429c156270 con 0x7f429c150480 2024-09-10T08:45:23.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.891+0000 7f42837fe640 1 -- 172.21.15.103:0/4140683213 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f429401d070 con 0x7f429c150480 2024-09-10T08:45:23.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.892+0000 7f42837fe640 1 --2- 172.21.15.103:0/4140683213 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f428806be60 0x7f428806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:23.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.892+0000 7f42837fe640 1 -- 172.21.15.103:0/4140683213 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f429408b960 con 0x7f429c150480 2024-09-10T08:45:23.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.892+0000 7f429affd640 1 --2- 172.21.15.103:0/4140683213 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f428806be60 0x7f428806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:23.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.892+0000 7f429affd640 1 --2- 172.21.15.103:0/4140683213 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f428806be60 0x7f428806e320 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f428c007fd0 tx=0x7f428c007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:23.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:23.896+0000 7f42837fe640 1 -- 172.21.15.103:0/4140683213 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4294059a70 con 0x7f429c150480 2024-09-10T08:45:24.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.063+0000 7f42a12ba640 1 -- 172.21.15.103:0/4140683213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f429c06c430 con 0x7f429c150480 2024-09-10T08:45:24.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.065+0000 7f42837fe640 1 -- 172.21.15.103:0/4140683213 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+20749 (secure 0 0 0) 0x7f429405dd70 con 0x7f429c150480 2024-09-10T08:45:24.066 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:45:24.066 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":27,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","created":"2024-09-10T08:28:12.654957+0000","modified":"2024-09-10T08:29:35.089527+0000","last_up_change":"2024-09-10T08:28:25.445753+0000","last_in_change":"2024-09-10T08:28:14.741133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:24.821696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-09-10T08:28:33.488154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-09-10T08:28:33.857868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-10T08:28:44.793084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-10T08:28:45.930823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1abe08f4-0348-435e-9f97-cec00e96992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6809","nonce":2707863099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6811","nonce":2707863099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6815","nonce":2707863099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6813","nonce":2707863099}]},"public_addr":"172.21.15.103:6809/2707863099","cluster_addr":"172.21.15.103:6811/2707863099","heartbeat_back_addr":"172.21.15.103:6815/2707863099","heartbeat_front_addr":"172.21.15.103:6813/2707863099","state":["exists","up"]},{"osd":1,"uuid":"df342e58-1026-4739-82f6-7a216707444c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6818","nonce":4029892782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6822","nonce":4029892782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6830","nonce":4029892782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6826","nonce":4029892782}]},"public_addr":"172.21.15.103:6818/4029892782","cluster_addr":"172.21.15.103:6822/4029892782","heartbeat_back_addr":"172.21.15.103:6830/4029892782","heartbeat_front_addr":"172.21.15.103:6826/4029892782","state":["exists","up"]},{"osd":2,"uuid":"f7aea2cf-208c-41ed-a0f6-8948d70b9a0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6819","nonce":428484432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6821","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6823","nonce":428484432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6829","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6831","nonce":428484432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6825","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6827","nonce":428484432}]},"public_addr":"172.21.15.103:6819/428484432","cluster_addr":"172.21.15.103:6823/428484432","heartbeat_back_addr":"172.21.15.103:6831/428484432","heartbeat_front_addr":"172.21.15.103:6827/428484432","state":["exists","up"]},{"osd":3,"uuid":"615ef8b0-12a5-4503-96d0-f7ec17dbc792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6801","nonce":3453676282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6803","nonce":3453676282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6807","nonce":3453676282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6805","nonce":3453676282}]},"public_addr":"172.21.15.103:6801/3453676282","cluster_addr":"172.21.15.103:6803/3453676282","heartbeat_back_addr":"172.21.15.103:6807/3453676282","heartbeat_front_addr":"172.21.15.103:6805/3453676282","state":["exists","up"]},{"osd":4,"uuid":"644c5e94-db18-4b83-b5cd-3762ae2647a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6809","nonce":1808157069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6811","nonce":1808157069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6815","nonce":1808157069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6813","nonce":1808157069}]},"public_addr":"172.21.15.154:6809/1808157069","cluster_addr":"172.21.15.154:6811/1808157069","heartbeat_back_addr":"172.21.15.154:6815/1808157069","heartbeat_front_addr":"172.21.15.154:6813/1808157069","state":["exists","up"]},{"osd":5,"uuid":"f40210bd-f4ca-442e-baac-729ced5a9f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6817","nonce":1048015779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6819","nonce":1048015779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6823","nonce":1048015779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6821","nonce":1048015779}]},"public_addr":"172.21.15.154:6817/1048015779","cluster_addr":"172.21.15.154:6819/1048015779","heartbeat_back_addr":"172.21.15.154:6823/1048015779","heartbeat_front_addr":"172.21.15.154:6821/1048015779","state":["exists","up"]},{"osd":6,"uuid":"eebac31e-aaef-47b0-90d7-4af08f36d7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6801","nonce":345273812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6803","nonce":345273812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6807","nonce":345273812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6805","nonce":345273812}]},"public_addr":"172.21.15.154:6801/345273812","cluster_addr":"172.21.15.154:6803/345273812","heartbeat_back_addr":"172.21.15.154:6807/345273812","heartbeat_front_addr":"172.21.15.154:6805/345273812","state":["exists","up"]},{"osd":7,"uuid":"58406c9a-036f-4618-bfb6-0beddbd71605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6825","nonce":3439481239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6827","nonce":3439481239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6831","nonce":3439481239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6829","nonce":3439481239}]},"public_addr":"172.21.15.154:6825/3439481239","cluster_addr":"172.21.15.154:6827/3439481239","heartbeat_back_addr":"172.21.15.154:6831/3439481239","heartbeat_front_addr":"172.21.15.154:6829/3439481239","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.032718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.126448+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.781158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.808718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.050591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.038245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.586989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.223326+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:45:24.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.067+0000 7f42a12ba640 1 -- 172.21.15.103:0/4140683213 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f428806be60 msgr2=0x7f428806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:24.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.067+0000 7f42a12ba640 1 --2- 172.21.15.103:0/4140683213 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f428806be60 0x7f428806e320 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f428c007fd0 tx=0x7f428c007de0 comp rx=0 tx=0).stop 2024-09-10T08:45:24.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.067+0000 7f42a12ba640 1 -- 172.21.15.103:0/4140683213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f429c150480 msgr2=0x7f429c158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:24.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.067+0000 7f42a12ba640 1 --2- 172.21.15.103:0/4140683213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f429c150480 0x7f429c158320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f429400cef0 tx=0x7f429400a710 comp rx=0 tx=0).stop 2024-09-10T08:45:24.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.067+0000 7f42a12ba640 1 -- 172.21.15.103:0/4140683213 shutdown_connections 2024-09-10T08:45:24.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.067+0000 7f42a12ba640 1 --2- 172.21.15.103:0/4140683213 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f428806be60 0x7f428806e320 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:24.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.067+0000 7f42a12ba640 1 --2- 172.21.15.103:0/4140683213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f429c150480 0x7f429c158320 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:24.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.067+0000 7f42a12ba640 1 --2- 172.21.15.103:0/4140683213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f429c0ca1c0 0x7f429c0afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:24.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.067+0000 7f42a12ba640 1 --2- 172.21.15.103:0/4140683213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f429c06c650 0x7f429c0aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:24.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.067+0000 7f42a12ba640 1 -- 172.21.15.103:0/4140683213 >> 172.21.15.103:0/4140683213 conn(0x7f429c068030 msgr2=0x7f429c073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:24.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.067+0000 7f42a12ba640 1 -- 172.21.15.103:0/4140683213 shutdown_connections 2024-09-10T08:45:24.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.067+0000 7f42a12ba640 1 -- 172.21.15.103:0/4140683213 wait complete. 2024-09-10T08:45:24.079 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail a 2024-09-10T08:45:24.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.180+0000 7f8ac2fc4640 1 Processor -- start 2024-09-10T08:45:24.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.180+0000 7f8ac2fc4640 1 -- start start 2024-09-10T08:45:24.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.180+0000 7f8ac2fc4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8abc153af0 0x7f8abc1563a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:24.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.181+0000 7f8ac2fc4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8abc0af870 0x7f8abc0c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:24.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.181+0000 7f8ac2fc4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8abc0c54e0 con 0x7f8abc0afdd0 2024-09-10T08:45:24.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.181+0000 7f8ac2fc4640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f8abc0c74a0 con 0x7f8abc153af0 2024-09-10T08:45:24.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.181+0000 7f8ac2fc4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8abc0c7740 con 0x7f8abc0af870 2024-09-10T08:45:24.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.181+0000 7f8ac0d60640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8abc153af0 0x7f8abc1563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:24.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.181+0000 7f8ac0d60640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8abc153af0 0x7f8abc1563a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41820/0 (socket says 172.21.15.103:41820) 2024-09-10T08:45:24.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.181+0000 7f8ac0d60640 1 -- 172.21.15.103:0/1558699517 learned_addr learned my addr 172.21.15.103:0/1558699517 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:45:24.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.181+0000 7f8ac0d60640 1 -- 172.21.15.103:0/1558699517 >> v2:172.21.15.154:3300/0 conn(0x7f8abc0af870 msgr2=0x7f8abc0c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:24.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.181+0000 7f8ac1561640 1 --2- 172.21.15.103:0/1558699517 >> v2:172.21.15.154:3300/0 conn(0x7f8abc0af870 0x7f8abc0c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:24.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.181+0000 7f8ac0d60640 1 --2- 172.21.15.103:0/1558699517 >> v2:172.21.15.154:3300/0 conn(0x7f8abc0af870 0x7f8abc0c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:24.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.181+0000 7f8ac0d60640 1 -- 172.21.15.103:0/1558699517 >> v1:172.21.15.154:6789/0 conn(0x7f8abc0afdd0 legacy=0x7f8abc0c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:24.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.181+0000 7f8ac0d60640 1 -- 172.21.15.103:0/1558699517 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8abc15a3c0 con 0x7f8abc153af0 2024-09-10T08:45:24.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.182+0000 7f8ac0d60640 1 --2- 172.21.15.103:0/1558699517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8abc153af0 0x7f8abc1563a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8abc0747c0 tx=0x7f8ab002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b5cf06057e40a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:24.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.182+0000 7f8abb7fe640 1 -- 172.21.15.103:0/1558699517 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0037070 con 0x7f8abc153af0 2024-09-10T08:45:24.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.182+0000 7f8abb7fe640 1 -- 172.21.15.103:0/1558699517 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8ab002ae20 con 0x7f8abc153af0 2024-09-10T08:45:24.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.182+0000 7f8abb7fe640 1 -- 172.21.15.103:0/1558699517 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0032680 con 0x7f8abc153af0 2024-09-10T08:45:24.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.182+0000 7f8ac2fc4640 1 -- 172.21.15.103:0/1558699517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8abc153af0 msgr2=0x7f8abc1563a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:24.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.182+0000 7f8ac2fc4640 1 --2- 172.21.15.103:0/1558699517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8abc153af0 0x7f8abc1563a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8abc0747c0 tx=0x7f8ab002a110 comp rx=0 tx=0).stop 2024-09-10T08:45:24.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.182+0000 7f8ac2fc4640 1 -- 172.21.15.103:0/1558699517 shutdown_connections 2024-09-10T08:45:24.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.182+0000 7f8ac2fc4640 1 --2- 172.21.15.103:0/1558699517 >> v2:172.21.15.154:3300/0 conn(0x7f8abc0af870 0x7f8abc0c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:24.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.182+0000 7f8ac2fc4640 1 --2- 172.21.15.103:0/1558699517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8abc153af0 0x7f8abc1563a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:24.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.182+0000 7f8ac2fc4640 1 -- 172.21.15.103:0/1558699517 >> 172.21.15.103:0/1558699517 conn(0x7f8abc0c6880 msgr2=0x7f8abc0c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:24.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.182+0000 7f8ac2fc4640 1 -- 172.21.15.103:0/1558699517 shutdown_connections 2024-09-10T08:45:24.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.182+0000 7f8ac2fc4640 1 -- 172.21.15.103:0/1558699517 wait complete. 2024-09-10T08:45:24.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.184+0000 7f8ac2fc4640 1 Processor -- start 2024-09-10T08:45:24.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.184+0000 7f8ac2fc4640 1 -- start start 2024-09-10T08:45:24.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.184+0000 7f8ac2fc4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8abc0af870 0x7f8abc1554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:24.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.184+0000 7f8ac2fc4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8abc0afdd0 0x7f8abc1453e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:24.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.184+0000 7f8ac2fc4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8abc153af0 0x7f8abc145920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:24.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.184+0000 7f8ac2fc4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc154050 con 0x7f8abc0afdd0 2024-09-10T08:45:24.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.184+0000 7f8ac2fc4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc153ed0 con 0x7f8abc153af0 2024-09-10T08:45:24.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.184+0000 7f8ac2fc4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f8abc0c4cc0 con 0x7f8abc0af870 2024-09-10T08:45:24.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.185+0000 7f8abbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8abc0afdd0 0x7f8abc1453e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:24.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.185+0000 7f8abbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8abc0afdd0 0x7f8abc1453e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41828/0 (socket says 172.21.15.103:41828) 2024-09-10T08:45:24.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.185+0000 7f8abbfff640 1 -- 172.21.15.103:0/2510475325 learned_addr learned my addr 172.21.15.103:0/2510475325 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:45:24.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.185+0000 7f8ac0d60640 1 --2- 172.21.15.103:0/2510475325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8abc0af870 0x7f8abc1554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:24.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.185+0000 7f8ac1561640 1 --2- 172.21.15.103:0/2510475325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8abc153af0 0x7f8abc145920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:24.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.185+0000 7f8abbfff640 1 -- 172.21.15.103:0/2510475325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8abc0af870 msgr2=0x7f8abc1554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:24.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.185+0000 7f8abbfff640 1 --2- 172.21.15.103:0/2510475325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8abc0af870 0x7f8abc1554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:24.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.185+0000 7f8abbfff640 1 -- 172.21.15.103:0/2510475325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8abc153af0 msgr2=0x7f8abc145920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:24.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.185+0000 7f8abbfff640 1 --2- 172.21.15.103:0/2510475325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8abc153af0 0x7f8abc145920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:24.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.185+0000 7f8abbfff640 1 -- 172.21.15.103:0/2510475325 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8abc1ec7a0 con 0x7f8abc0afdd0 2024-09-10T08:45:24.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.185+0000 7f8ac1561640 1 --2- 172.21.15.103:0/2510475325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8abc153af0 0x7f8abc145920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:45:24.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.185+0000 7f8abbfff640 1 --2- 172.21.15.103:0/2510475325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8abc0afdd0 0x7f8abc1453e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800c410 tx=0x7f8aa800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:24.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.185+0000 7f8ab97fa640 1 -- 172.21.15.103:0/2510475325 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8017070 con 0x7f8abc0afdd0 2024-09-10T08:45:24.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.185+0000 7f8ab97fa640 1 -- 172.21.15.103:0/2510475325 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8aa80035f0 con 0x7f8abc0afdd0 2024-09-10T08:45:24.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.185+0000 7f8ab97fa640 1 -- 172.21.15.103:0/2510475325 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8003a40 con 0x7f8abc0afdd0 2024-09-10T08:45:24.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.185+0000 7f8ac2fc4640 1 -- 172.21.15.103:0/2510475325 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8abc0c2360 con 0x7f8abc0afdd0 2024-09-10T08:45:24.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.185+0000 7f8ac2fc4640 1 -- 172.21.15.103:0/2510475325 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8abc155a10 con 0x7f8abc0afdd0 2024-09-10T08:45:24.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.186+0000 7f8ac2fc4640 1 -- 172.21.15.103:0/2510475325 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8abc0c5040 con 0x7f8abc0afdd0 2024-09-10T08:45:24.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.187+0000 7f8ab97fa640 1 -- 172.21.15.103:0/2510475325 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8aa801a070 con 0x7f8abc0afdd0 2024-09-10T08:45:24.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.187+0000 7f8ab97fa640 1 --2- 172.21.15.103:0/2510475325 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8aa006be30 0x7f8aa006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:24.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.187+0000 7f8ab97fa640 1 -- 172.21.15.103:0/2510475325 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f8aa808a680 con 0x7f8abc0afdd0 2024-09-10T08:45:24.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.187+0000 7f8ac0d60640 1 --2- 172.21.15.103:0/2510475325 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8aa006be30 0x7f8aa006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:24.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.187+0000 7f8ac0d60640 1 --2- 172.21.15.103:0/2510475325 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8aa006be30 0x7f8aa006e2f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0034000 tx=0x7f8ab002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:24.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.191+0000 7f8ab97fa640 1 -- 172.21.15.103:0/2510475325 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8aa80585b0 con 0x7f8abc0afdd0 2024-09-10T08:45:24.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.389+0000 7f8ac2fc4640 1 -- 172.21.15.103:0/2510475325 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "a"} v 0) -- 0x7f8abc073740 con 0x7f8abc0afdd0 2024-09-10T08:45:24.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.398+0000 7f8ab97fa640 1 -- 172.21.15.103:0/2510475325 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "a"}]=0 a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v12) ==== 151+0+0 (secure 0 0 0) 0x7f8aa805c8b0 con 0x7f8abc0afdd0 2024-09-10T08:45:24.401 INFO:teuthology.orchestra.run.smithi103.stderr:a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T08:45:24.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.403+0000 7f8ac2fc4640 1 -- 172.21.15.103:0/2510475325 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8aa006be30 msgr2=0x7f8aa006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:24.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.403+0000 7f8ac2fc4640 1 --2- 172.21.15.103:0/2510475325 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8aa006be30 0x7f8aa006e2f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0034000 tx=0x7f8ab002e000 comp rx=0 tx=0).stop 2024-09-10T08:45:24.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.403+0000 7f8ac2fc4640 1 -- 172.21.15.103:0/2510475325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8abc0afdd0 msgr2=0x7f8abc1453e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:24.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.403+0000 7f8ac2fc4640 1 --2- 172.21.15.103:0/2510475325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8abc0afdd0 0x7f8abc1453e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800c410 tx=0x7f8aa800c8d0 comp rx=0 tx=0).stop 2024-09-10T08:45:24.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.403+0000 7f8ac2fc4640 1 -- 172.21.15.103:0/2510475325 shutdown_connections 2024-09-10T08:45:24.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.403+0000 7f8ac2fc4640 1 --2- 172.21.15.103:0/2510475325 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f8aa006be30 0x7f8aa006e2f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:24.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.403+0000 7f8ac2fc4640 1 --2- 172.21.15.103:0/2510475325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8abc153af0 0x7f8abc145920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:24.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.403+0000 7f8ac2fc4640 1 --2- 172.21.15.103:0/2510475325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8abc0afdd0 0x7f8abc1453e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:24.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.403+0000 7f8ac2fc4640 1 --2- 172.21.15.103:0/2510475325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8abc0af870 0x7f8abc1554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:24.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.403+0000 7f8ac2fc4640 1 -- 172.21.15.103:0/2510475325 >> 172.21.15.103:0/2510475325 conn(0x7f8abc0c6880 msgr2=0x7f8abc156b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:24.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.403+0000 7f8ac2fc4640 1 -- 172.21.15.103:0/2510475325 shutdown_connections 2024-09-10T08:45:24.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.403+0000 7f8ac2fc4640 1 -- 172.21.15.103:0/2510475325 wait complete. 2024-09-10T08:45:24.418 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm a --yes-i-really-mean-it 2024-09-10T08:45:24.457 INFO:tasks.ceph.mds.c.smithi103.stdout:starting mds.c at 2024-09-10T08:45:24.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.519+0000 7fbff212a640 1 Processor -- start 2024-09-10T08:45:24.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.520+0000 7fbff212a640 1 -- start start 2024-09-10T08:45:24.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.520+0000 7fbff212a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbfec073be0 0x7fbfec15a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:24.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.520+0000 7fbff212a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfec0c8680 con 0x7fbfec0731e0 2024-09-10T08:45:24.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.520+0000 7fbff212a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfec0c8960 con 0x7fbfec15a570 2024-09-10T08:45:24.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.520+0000 7fbff212a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fbfec0c8430 con 0x7fbfec073be0 2024-09-10T08:45:24.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.520+0000 7fbfeb7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbfec0731e0 0x7fbfec0c7b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:34922/0 (socket says 172.21.15.103:34922) 2024-09-10T08:45:24.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.520+0000 7fbfeb7fe640 1 -- 172.21.15.103:0/488294505 learned_addr learned my addr 172.21.15.103:0/488294505 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:45:24.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.521+0000 7fbfeaffd640 1 --2- 172.21.15.103:0/488294505 >> v2:172.21.15.154:3300/0 conn(0x7fbfec073be0 0x7fbfec15a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:24.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.521+0000 7fbfea7fc640 1 -- 172.21.15.103:0/488294505 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3375201778 0 0) 0x7fbfec0c8680 con 0x7fbfec0731e0 2024-09-10T08:45:24.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.521+0000 7fbfea7fc640 1 -- 172.21.15.103:0/488294505 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfd4003520 con 0x7fbfec0731e0 2024-09-10T08:45:24.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.521+0000 7fbfeaffd640 1 -- 172.21.15.103:0/488294505 >> v1:172.21.15.154:6789/0 conn(0x7fbfec15a570 legacy=0x7fbfec0c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:24.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.521+0000 7fbfeaffd640 1 -- 172.21.15.103:0/488294505 >> v1:172.21.15.103:6789/0 conn(0x7fbfec0731e0 legacy=0x7fbfec0c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:24.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.521+0000 7fbfeaffd640 1 -- 172.21.15.103:0/488294505 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfec0c8c40 con 0x7fbfec073be0 2024-09-10T08:45:24.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.522+0000 7fbfeaffd640 1 --2- 172.21.15.103:0/488294505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfec073be0 0x7fbfec15a030 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00097a0 tx=0x7fbfe002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43586b06b6548f0e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:24.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.522+0000 7fbfea7fc640 1 -- 172.21.15.103:0/488294505 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0037070 con 0x7fbfec073be0 2024-09-10T08:45:24.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.522+0000 7fbfea7fc640 1 -- 172.21.15.103:0/488294505 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbfe0032440 con 0x7fbfec073be0 2024-09-10T08:45:24.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.522+0000 7fbfea7fc640 1 -- 172.21.15.103:0/488294505 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe00327f0 con 0x7fbfec073be0 2024-09-10T08:45:24.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.522+0000 7fbff212a640 1 -- 172.21.15.103:0/488294505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfec073be0 msgr2=0x7fbfec15a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:24.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.522+0000 7fbff212a640 1 --2- 172.21.15.103:0/488294505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfec073be0 0x7fbfec15a030 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00097a0 tx=0x7fbfe002a1a0 comp rx=0 tx=0).stop 2024-09-10T08:45:24.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.522+0000 7fbff212a640 1 -- 172.21.15.103:0/488294505 shutdown_connections 2024-09-10T08:45:24.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.522+0000 7fbff212a640 1 --2- 172.21.15.103:0/488294505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfec073be0 0x7fbfec15a030 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:24.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.523+0000 7fbff212a640 1 -- 172.21.15.103:0/488294505 >> 172.21.15.103:0/488294505 conn(0x7fbfec0c9c00 msgr2=0x7fbfec0ca010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:24.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.523+0000 7fbff212a640 1 -- 172.21.15.103:0/488294505 shutdown_connections 2024-09-10T08:45:24.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.523+0000 7fbff212a640 1 -- 172.21.15.103:0/488294505 wait complete. 2024-09-10T08:45:24.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.524+0000 7fbff212a640 1 Processor -- start 2024-09-10T08:45:24.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.524+0000 7fbff212a640 1 -- start start 2024-09-10T08:45:24.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.524+0000 7fbff212a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfec0731e0 0x7fbfec1e2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:24.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.524+0000 7fbff212a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfec073be0 0x7fbfec151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:24.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.524+0000 7fbff212a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfec15a570 0x7fbfec1ef160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:24.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.524+0000 7fbff212a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec073740 con 0x7fbfec073be0 2024-09-10T08:45:24.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.524+0000 7fbff212a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec0735c0 con 0x7fbfec15a570 2024-09-10T08:45:24.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.524+0000 7fbff212a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fbfec0c5990 con 0x7fbfec0731e0 2024-09-10T08:45:24.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.525+0000 7fbfeaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfec073be0 0x7fbfec151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:24.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.525+0000 7fbfeaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfec073be0 0x7fbfec151940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41860/0 (socket says 172.21.15.103:41860) 2024-09-10T08:45:24.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.525+0000 7fbfeaffd640 1 -- 172.21.15.103:0/2669230543 learned_addr learned my addr 172.21.15.103:0/2669230543 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:45:24.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.525+0000 7fbfeb7fe640 1 --2- 172.21.15.103:0/2669230543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfec0731e0 0x7fbfec1e2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:24.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.525+0000 7fbfeaffd640 1 -- 172.21.15.103:0/2669230543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfec0731e0 msgr2=0x7fbfec1e2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:24.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.525+0000 7fbfeaffd640 1 --2- 172.21.15.103:0/2669230543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfec0731e0 0x7fbfec1e2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:24.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.525+0000 7fbfeaffd640 1 -- 172.21.15.103:0/2669230543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfec15a570 msgr2=0x7fbfec1ef160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:24.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.525+0000 7fbfebfff640 1 --2- 172.21.15.103:0/2669230543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfec15a570 0x7fbfec1ef160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:24.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.525+0000 7fbfeaffd640 1 --2- 172.21.15.103:0/2669230543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfec15a570 0x7fbfec1ef160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:24.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.525+0000 7fbfeaffd640 1 -- 172.21.15.103:0/2669230543 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfec1dfb30 con 0x7fbfec073be0 2024-09-10T08:45:24.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.525+0000 7fbfeb7fe640 1 --2- 172.21.15.103:0/2669230543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfec0731e0 0x7fbfec1e2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:45:24.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.525+0000 7fbfebfff640 1 --2- 172.21.15.103:0/2669230543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfec15a570 0x7fbfec1ef160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:45:24.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.525+0000 7fbfeaffd640 1 --2- 172.21.15.103:0/2669230543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfec073be0 0x7fbfec151940 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0035040 tx=0x7fbfe00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:24.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.525+0000 7fbfd3fff640 1 -- 172.21.15.103:0/2669230543 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0037050 con 0x7fbfec073be0 2024-09-10T08:45:24.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.525+0000 7fbfd3fff640 1 -- 172.21.15.103:0/2669230543 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbfe0043070 con 0x7fbfec073be0 2024-09-10T08:45:24.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.525+0000 7fbff212a640 1 -- 172.21.15.103:0/2669230543 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfec1dfe10 con 0x7fbfec073be0 2024-09-10T08:45:24.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.525+0000 7fbfd3fff640 1 -- 172.21.15.103:0/2669230543 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe00044e0 con 0x7fbfec073be0 2024-09-10T08:45:24.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.525+0000 7fbff212a640 1 -- 172.21.15.103:0/2669230543 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfec1e31e0 con 0x7fbfec073be0 2024-09-10T08:45:24.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.526+0000 7fbff212a640 1 -- 172.21.15.103:0/2669230543 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfec15a130 con 0x7fbfec073be0 2024-09-10T08:45:24.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.527+0000 7fbfd3fff640 1 -- 172.21.15.103:0/2669230543 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbfe0048460 con 0x7fbfec073be0 2024-09-10T08:45:24.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.527+0000 7fbfd3fff640 1 --2- 172.21.15.103:0/2669230543 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbfd806be30 0x7fbfd806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:24.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.527+0000 7fbfd3fff640 1 -- 172.21.15.103:0/2669230543 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6723+0+0 (secure 0 0 0) 0x7fbfe00abfe0 con 0x7fbfec073be0 2024-09-10T08:45:24.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.527+0000 7fbfeb7fe640 1 --2- 172.21.15.103:0/2669230543 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbfd806be30 0x7fbfd806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:24.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.528+0000 7fbfeb7fe640 1 --2- 172.21.15.103:0/2669230543 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbfd806be30 0x7fbfd806e2f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc001560 tx=0x7fbfdc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:24.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.532+0000 7fbfd3fff640 1 -- 172.21.15.103:0/2669230543 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbfe007a480 con 0x7fbfec073be0 2024-09-10T08:45:24.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:24.733+0000 7fbff212a640 1 -- 172.21.15.103:0/2669230543 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true} v 0) -- 0x7fbfec0ca230 con 0x7fbfec073be0 2024-09-10T08:45:25.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.405+0000 7fbfd3fff640 1 -- 172.21.15.103:0/2669230543 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true}]=0 v13) ==== 99+0+0 (secure 0 0 0) 0x7fbfe0079d80 con 0x7fbfec073be0 2024-09-10T08:45:25.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.408+0000 7fbff212a640 1 -- 172.21.15.103:0/2669230543 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbfd806be30 msgr2=0x7fbfd806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:25.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.408+0000 7fbff212a640 1 --2- 172.21.15.103:0/2669230543 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbfd806be30 0x7fbfd806e2f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc001560 tx=0x7fbfdc009040 comp rx=0 tx=0).stop 2024-09-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.408+0000 7fbff212a640 1 -- 172.21.15.103:0/2669230543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfec073be0 msgr2=0x7fbfec151940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.408+0000 7fbff212a640 1 --2- 172.21.15.103:0/2669230543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfec073be0 0x7fbfec151940 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0035040 tx=0x7fbfe00046c0 comp rx=0 tx=0).stop 2024-09-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.408+0000 7fbff212a640 1 -- 172.21.15.103:0/2669230543 shutdown_connections 2024-09-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.408+0000 7fbff212a640 1 --2- 172.21.15.103:0/2669230543 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fbfd806be30 0x7fbfd806e2f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.408+0000 7fbff212a640 1 --2- 172.21.15.103:0/2669230543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfec15a570 0x7fbfec1ef160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.408+0000 7fbff212a640 1 --2- 172.21.15.103:0/2669230543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfec073be0 0x7fbfec151940 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.408+0000 7fbff212a640 1 --2- 172.21.15.103:0/2669230543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfec0731e0 0x7fbfec1e2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.408+0000 7fbff212a640 1 -- 172.21.15.103:0/2669230543 >> 172.21.15.103:0/2669230543 conn(0x7fbfec0c9c00 msgr2=0x7fbfec0c7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.408+0000 7fbff212a640 1 -- 172.21.15.103:0/2669230543 shutdown_connections 2024-09-10T08:45:25.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.408+0000 7fbff212a640 1 -- 172.21.15.103:0/2669230543 wait complete. 2024-09-10T08:45:25.423 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_metadata a_metadata --yes-i-really-really-mean-it 2024-09-10T08:45:25.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.572+0000 7f270d8e4640 1 Processor -- start 2024-09-10T08:45:25.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.573+0000 7f270d8e4640 1 -- start start 2024-09-10T08:45:25.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.573+0000 7f270d8e4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f27080c6180 0x7f2708157db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:25.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.573+0000 7f270d8e4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27080c53c0 con 0x7f270814e320 2024-09-10T08:45:25.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.573+0000 7f270d8e4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27080c56a0 con 0x7f27080af1b0 2024-09-10T08:45:25.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.573+0000 7f270d8e4640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f27080c5980 con 0x7f27080c6180 2024-09-10T08:45:25.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.573+0000 7f27077fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f27080c6180 0x7f2708157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:25.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.574+0000 7f2706ffd640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f270814e320 0x7f270806ef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:57706/0 (socket says 172.21.15.103:57706) 2024-09-10T08:45:25.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.574+0000 7f27077fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f27080c6180 0x7f2708157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56376/0 (socket says 172.21.15.103:56376) 2024-09-10T08:45:25.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.574+0000 7f2706ffd640 1 -- 172.21.15.103:0/2816960683 learned_addr learned my addr 172.21.15.103:0/2816960683 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:45:25.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.574+0000 7f27077fe640 1 -- 172.21.15.103:0/2816960683 >> v1:172.21.15.154:6789/0 conn(0x7f27080af1b0 legacy=0x7f27081576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:25.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.574+0000 7f27077fe640 1 -- 172.21.15.103:0/2816960683 >> v1:172.21.15.103:6789/0 conn(0x7f270814e320 legacy=0x7f270806ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:25.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.574+0000 7f27077fe640 1 -- 172.21.15.103:0/2816960683 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27080c5c60 con 0x7f27080c6180 2024-09-10T08:45:25.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.574+0000 7f2705ffb640 1 -- 172.21.15.103:0/2816960683 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2152442916 0 0) 0x7f27080c53c0 con 0x7f270814e320 2024-09-10T08:45:25.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.575+0000 7f27077fe640 1 --2- 172.21.15.103:0/2816960683 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27080c6180 0x7f2708157db0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009d90 tx=0x7f26f802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace2131aa922d3af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:25.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.575+0000 7f2705ffb640 1 -- 172.21.15.103:0/2816960683 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f8031600 con 0x7f27080c6180 2024-09-10T08:45:25.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.575+0000 7f2705ffb640 1 -- 172.21.15.103:0/2816960683 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f26f80317a0 con 0x7f27080c6180 2024-09-10T08:45:25.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.575+0000 7f2705ffb640 1 -- 172.21.15.103:0/2816960683 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f8031b90 con 0x7f27080c6180 2024-09-10T08:45:25.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.575+0000 7f270d8e4640 1 -- 172.21.15.103:0/2816960683 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27080c6180 msgr2=0x7f2708157db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:25.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.575+0000 7f270d8e4640 1 --2- 172.21.15.103:0/2816960683 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27080c6180 0x7f2708157db0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009d90 tx=0x7f26f802a610 comp rx=0 tx=0).stop 2024-09-10T08:45:25.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.575+0000 7f270d8e4640 1 -- 172.21.15.103:0/2816960683 shutdown_connections 2024-09-10T08:45:25.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.575+0000 7f270d8e4640 1 --2- 172.21.15.103:0/2816960683 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27080c6180 0x7f2708157db0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:25.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.575+0000 7f270d8e4640 1 -- 172.21.15.103:0/2816960683 >> 172.21.15.103:0/2816960683 conn(0x7f27080c6910 msgr2=0x7f27080c6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:25.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.575+0000 7f270d8e4640 1 -- 172.21.15.103:0/2816960683 shutdown_connections 2024-09-10T08:45:25.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.575+0000 7f270d8e4640 1 -- 172.21.15.103:0/2816960683 wait complete. 2024-09-10T08:45:25.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.576+0000 7f270d8e4640 1 Processor -- start 2024-09-10T08:45:25.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.577+0000 7f270d8e4640 1 -- start start 2024-09-10T08:45:25.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.577+0000 7f270d8e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27080af1b0 0x7f27081e1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:25.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.577+0000 7f270d8e4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27080c6180 0x7f2708147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:25.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.577+0000 7f270d8e4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f270814e320 0x7f2708147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:25.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.577+0000 7f270d8e4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f27080ab720 con 0x7f27080c6180 2024-09-10T08:45:25.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.577+0000 7f270d8e4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f27080ab5a0 con 0x7f27080af1b0 2024-09-10T08:45:25.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.577+0000 7f270d8e4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f27080ab8a0 con 0x7f270814e320 2024-09-10T08:45:25.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.577+0000 7f27067fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27080c6180 0x7f2708147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:25.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.577+0000 7f27067fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27080c6180 0x7f2708147720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56382/0 (socket says 172.21.15.103:56382) 2024-09-10T08:45:25.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.577+0000 7f27067fc640 1 -- 172.21.15.103:0/2624525440 learned_addr learned my addr 172.21.15.103:0/2624525440 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:45:25.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.578+0000 7f27077fe640 1 --2- 172.21.15.103:0/2624525440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f270814e320 0x7f2708147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:25.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.578+0000 7f2706ffd640 1 --2- 172.21.15.103:0/2624525440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27080af1b0 0x7f27081e1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:25.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.578+0000 7f27067fc640 1 -- 172.21.15.103:0/2624525440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f270814e320 msgr2=0x7f2708147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.578+0000 7f27067fc640 1 --2- 172.21.15.103:0/2624525440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f270814e320 0x7f2708147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.578+0000 7f27067fc640 1 -- 172.21.15.103:0/2624525440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27080af1b0 msgr2=0x7f27081e1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.578+0000 7f27067fc640 1 --2- 172.21.15.103:0/2624525440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27080af1b0 0x7f27081e1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.578+0000 7f27067fc640 1 -- 172.21.15.103:0/2624525440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2708154860 con 0x7f27080c6180 2024-09-10T08:45:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.578+0000 7f27077fe640 1 --2- 172.21.15.103:0/2624525440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f270814e320 0x7f2708147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:45:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.578+0000 7f2706ffd640 1 --2- 172.21.15.103:0/2624525440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27080af1b0 0x7f27081e1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:45:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.578+0000 7f27067fc640 1 --2- 172.21.15.103:0/2624525440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27080c6180 0x7f2708147720 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f26f000c430 tx=0x7f26f000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.578+0000 7f26fffff640 1 -- 172.21.15.103:0/2624525440 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f0011790 con 0x7f27080c6180 2024-09-10T08:45:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.578+0000 7f26fffff640 1 -- 172.21.15.103:0/2624525440 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f26f0017070 con 0x7f27080c6180 2024-09-10T08:45:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.578+0000 7f26fffff640 1 -- 172.21.15.103:0/2624525440 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f0011b90 con 0x7f27080c6180 2024-09-10T08:45:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.578+0000 7f270d8e4640 1 -- 172.21.15.103:0/2624525440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27081edd50 con 0x7f27080c6180 2024-09-10T08:45:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.578+0000 7f270d8e4640 1 -- 172.21.15.103:0/2624525440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27081ee030 con 0x7f27080c6180 2024-09-10T08:45:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.579+0000 7f270d8e4640 1 -- 172.21.15.103:0/2624525440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2708074120 con 0x7f27080c6180 2024-09-10T08:45:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.580+0000 7f26fffff640 1 -- 172.21.15.103:0/2624525440 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f26f001c460 con 0x7f27080c6180 2024-09-10T08:45:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.580+0000 7f26fffff640 1 --2- 172.21.15.103:0/2624525440 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f26e806be30 0x7f26e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.580+0000 7f26fffff640 1 -- 172.21.15.103:0/2624525440 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6723+0+0 (secure 0 0 0) 0x7f26f008b120 con 0x7f27080c6180 2024-09-10T08:45:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.580+0000 7f2706ffd640 1 --2- 172.21.15.103:0/2624525440 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f26e806be30 0x7f26e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.580+0000 7f2706ffd640 1 --2- 172.21.15.103:0/2624525440 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f26e806be30 0x7f26e806e2f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2700000f60 tx=0x7f2700007cc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:25.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.584+0000 7f26fffff640 1 -- 172.21.15.103:0/2624525440 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26f00596d0 con 0x7f27080c6180 2024-09-10T08:45:25.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:25.749+0000 7f270d8e4640 1 -- 172.21.15.103:0/2624525440 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f270806ef00 con 0x7f27080c6180 2024-09-10T08:45:26.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.407+0000 7f26fffff640 1 -- 172.21.15.103:0/2624525440 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'a_metadata' removed v29) ==== 166+0+0 (secure 0 0 0) 0x7f26f0058fd0 con 0x7f27080c6180 2024-09-10T08:45:26.408 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'a_metadata' removed 2024-09-10T08:45:26.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.410+0000 7f270d8e4640 1 -- 172.21.15.103:0/2624525440 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f26e806be30 msgr2=0x7f26e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:26.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.410+0000 7f270d8e4640 1 --2- 172.21.15.103:0/2624525440 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f26e806be30 0x7f26e806e2f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2700000f60 tx=0x7f2700007cc0 comp rx=0 tx=0).stop 2024-09-10T08:45:26.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.410+0000 7f270d8e4640 1 -- 172.21.15.103:0/2624525440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27080c6180 msgr2=0x7f2708147720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:26.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.410+0000 7f270d8e4640 1 --2- 172.21.15.103:0/2624525440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27080c6180 0x7f2708147720 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f26f000c430 tx=0x7f26f000c8f0 comp rx=0 tx=0).stop 2024-09-10T08:45:26.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.410+0000 7f270d8e4640 1 -- 172.21.15.103:0/2624525440 shutdown_connections 2024-09-10T08:45:26.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.410+0000 7f270d8e4640 1 --2- 172.21.15.103:0/2624525440 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f26e806be30 0x7f26e806e2f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:26.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.410+0000 7f270d8e4640 1 --2- 172.21.15.103:0/2624525440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f270814e320 0x7f2708147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:26.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.410+0000 7f270d8e4640 1 --2- 172.21.15.103:0/2624525440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27080c6180 0x7f2708147720 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:26.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.410+0000 7f270d8e4640 1 --2- 172.21.15.103:0/2624525440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27080af1b0 0x7f27081e1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:26.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.410+0000 7f270d8e4640 1 -- 172.21.15.103:0/2624525440 >> 172.21.15.103:0/2624525440 conn(0x7f27080c6910 msgr2=0x7f2708072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:26.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.410+0000 7f270d8e4640 1 -- 172.21.15.103:0/2624525440 shutdown_connections 2024-09-10T08:45:26.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.410+0000 7f270d8e4640 1 -- 172.21.15.103:0/2624525440 wait complete. 2024-09-10T08:45:26.429 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_data a_data --yes-i-really-really-mean-it 2024-09-10T08:45:26.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.536+0000 7fe81f63c640 1 Processor -- start 2024-09-10T08:45:26.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.537+0000 7fe81f63c640 1 -- start start 2024-09-10T08:45:26.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.537+0000 7fe81f63c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8180c47d0 0x7fe818158090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:26.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.537+0000 7fe81f63c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe8180c4bb0 0x7fe8180c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:26.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.537+0000 7fe81f63c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8180c3f20 con 0x7fe8180c3170 2024-09-10T08:45:26.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.537+0000 7fe81f63c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fe8180c2440 con 0x7fe8180c4bb0 2024-09-10T08:45:26.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.537+0000 7fe81f63c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe8180ace70 con 0x7fe8180c47d0 2024-09-10T08:45:26.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.538+0000 7fe81cbd7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe8180c4bb0 0x7fe8180c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:26.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.538+0000 7fe81cbd7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe8180c4bb0 0x7fe8180c39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56384/0 (socket says 172.21.15.103:56384) 2024-09-10T08:45:26.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.538+0000 7fe81cbd7640 1 -- 172.21.15.103:0/3475272808 learned_addr learned my addr 172.21.15.103:0/3475272808 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:45:26.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.538+0000 7fe81cbd7640 1 -- 172.21.15.103:0/3475272808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8180c47d0 msgr2=0x7fe818158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:26.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.538+0000 7fe81d3d8640 1 --2- 172.21.15.103:0/3475272808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8180c47d0 0x7fe818158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:26.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.538+0000 7fe81cbd7640 1 --2- 172.21.15.103:0/3475272808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8180c47d0 0x7fe818158090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:26.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.538+0000 7fe81cbd7640 1 -- 172.21.15.103:0/3475272808 >> v1:172.21.15.154:6789/0 conn(0x7fe8180c3170 legacy=0x7fe8181575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:26.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.538+0000 7fe81cbd7640 1 -- 172.21.15.103:0/3475272808 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8180c2690 con 0x7fe8180c4bb0 2024-09-10T08:45:26.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.539+0000 7fe81cbd7640 1 --2- 172.21.15.103:0/3475272808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8180c4bb0 0x7fe8180c39e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe8180c25c0 tx=0x7fe80802a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d142f8c9c2d005e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:26.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.539+0000 7fe80ffff640 1 -- 172.21.15.103:0/3475272808 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808037070 con 0x7fe8180c4bb0 2024-09-10T08:45:26.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.539+0000 7fe80ffff640 1 -- 172.21.15.103:0/3475272808 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe808032440 con 0x7fe8180c4bb0 2024-09-10T08:45:26.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.539+0000 7fe80ffff640 1 -- 172.21.15.103:0/3475272808 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808032830 con 0x7fe8180c4bb0 2024-09-10T08:45:26.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.539+0000 7fe81f63c640 1 -- 172.21.15.103:0/3475272808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8180c4bb0 msgr2=0x7fe8180c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:26.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.539+0000 7fe81f63c640 1 --2- 172.21.15.103:0/3475272808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8180c4bb0 0x7fe8180c39e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe8180c25c0 tx=0x7fe80802a160 comp rx=0 tx=0).stop 2024-09-10T08:45:26.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.539+0000 7fe81f63c640 1 -- 172.21.15.103:0/3475272808 shutdown_connections 2024-09-10T08:45:26.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.539+0000 7fe81f63c640 1 --2- 172.21.15.103:0/3475272808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8180c4bb0 0x7fe8180c39e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:26.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.539+0000 7fe81f63c640 1 --2- 172.21.15.103:0/3475272808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8180c47d0 0x7fe818158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:26.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.539+0000 7fe81f63c640 1 -- 172.21.15.103:0/3475272808 >> 172.21.15.103:0/3475272808 conn(0x7fe81806c210 msgr2=0x7fe8180c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:26.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.539+0000 7fe81f63c640 1 -- 172.21.15.103:0/3475272808 shutdown_connections 2024-09-10T08:45:26.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.539+0000 7fe81f63c640 1 -- 172.21.15.103:0/3475272808 wait complete. 2024-09-10T08:45:26.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.540+0000 7fe81f63c640 1 Processor -- start 2024-09-10T08:45:26.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.541+0000 7fe81f63c640 1 -- start start 2024-09-10T08:45:26.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.541+0000 7fe81f63c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8180c3170 0x7fe8181e9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:26.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.541+0000 7fe81f63c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8180c47d0 0x7fe8181ed470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:26.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.541+0000 7fe81f63c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8180c4bb0 0x7fe818153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:26.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.541+0000 7fe81f63c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe8180a7340 con 0x7fe8180c47d0 2024-09-10T08:45:26.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.541+0000 7fe81f63c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe8180c2c50 con 0x7fe8180c3170 2024-09-10T08:45:26.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.541+0000 7fe81f63c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fe8180a74c0 con 0x7fe8180c4bb0 2024-09-10T08:45:26.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.541+0000 7fe81cbd7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8180c47d0 0x7fe8181ed470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:26.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.541+0000 7fe81cbd7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8180c47d0 0x7fe8181ed470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56400/0 (socket says 172.21.15.103:56400) 2024-09-10T08:45:26.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.541+0000 7fe81cbd7640 1 -- 172.21.15.103:0/3253954407 learned_addr learned my addr 172.21.15.103:0/3253954407 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:45:26.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.541+0000 7fe81dbd9640 1 --2- 172.21.15.103:0/3253954407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8180c4bb0 0x7fe818153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:26.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.541+0000 7fe81d3d8640 1 --2- 172.21.15.103:0/3253954407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8180c3170 0x7fe8181e9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:26.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.542+0000 7fe81cbd7640 1 -- 172.21.15.103:0/3253954407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8180c4bb0 msgr2=0x7fe818153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:26.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.542+0000 7fe81cbd7640 1 --2- 172.21.15.103:0/3253954407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8180c4bb0 0x7fe818153720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:26.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.542+0000 7fe81cbd7640 1 -- 172.21.15.103:0/3253954407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8180c3170 msgr2=0x7fe8181e9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:26.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.542+0000 7fe81cbd7640 1 --2- 172.21.15.103:0/3253954407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8180c3170 0x7fe8181e9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:26.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.542+0000 7fe81cbd7640 1 -- 172.21.15.103:0/3253954407 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8181e94f0 con 0x7fe8180c47d0 2024-09-10T08:45:26.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.542+0000 7fe81d3d8640 1 --2- 172.21.15.103:0/3253954407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8180c3170 0x7fe8181e9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:45:26.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.542+0000 7fe81cbd7640 1 --2- 172.21.15.103:0/3253954407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8180c47d0 0x7fe8181ed470 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe80802a1a0 tx=0x7fe8080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:26.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.542+0000 7fe80dffb640 1 -- 172.21.15.103:0/3253954407 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808037040 con 0x7fe8180c47d0 2024-09-10T08:45:26.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.542+0000 7fe80dffb640 1 -- 172.21.15.103:0/3253954407 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe808042070 con 0x7fe8180c47d0 2024-09-10T08:45:26.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.542+0000 7fe81f63c640 1 -- 172.21.15.103:0/3253954407 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8180a7090 con 0x7fe8180c47d0 2024-09-10T08:45:26.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.542+0000 7fe80dffb640 1 -- 172.21.15.103:0/3253954407 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808030bd0 con 0x7fe8180c47d0 2024-09-10T08:45:26.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.542+0000 7fe81f63c640 1 -- 172.21.15.103:0/3253954407 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8181ddb00 con 0x7fe8180c47d0 2024-09-10T08:45:26.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.543+0000 7fe81f63c640 1 -- 172.21.15.103:0/3253954407 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8180aca90 con 0x7fe8180c47d0 2024-09-10T08:45:26.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.544+0000 7fe80dffb640 1 -- 172.21.15.103:0/3253954407 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe808047460 con 0x7fe8180c47d0 2024-09-10T08:45:26.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.544+0000 7fe80dffb640 1 --2- 172.21.15.103:0/3253954407 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe7fc06be30 0x7fe7fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:26.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.544+0000 7fe80dffb640 1 -- 172.21.15.103:0/3253954407 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6295+0+0 (secure 0 0 0) 0x7fe8080abd00 con 0x7fe8180c47d0 2024-09-10T08:45:26.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.544+0000 7fe81d3d8640 1 --2- 172.21.15.103:0/3253954407 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe7fc06be30 0x7fe7fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:26.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.545+0000 7fe81d3d8640 1 --2- 172.21.15.103:0/3253954407 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe7fc06be30 0x7fe7fc06e2f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe81400a9d0 tx=0x7fe814008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:26.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.548+0000 7fe80dffb640 1 -- 172.21.15.103:0/3253954407 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe80807a460 con 0x7fe8180c47d0 2024-09-10T08:45:26.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:26.716+0000 7fe81f63c640 1 -- 172.21.15.103:0/3253954407 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe818153c60 con 0x7fe8180c47d0 2024-09-10T08:45:27.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.422+0000 7fe80dffb640 1 -- 172.21.15.103:0/3253954407 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true}]=0 pool 'a_data' removed v30) ==== 154+0+0 (secure 0 0 0) 0x7fe808079d60 con 0x7fe8180c47d0 2024-09-10T08:45:27.423 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'a_data' removed 2024-09-10T08:45:27.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.428+0000 7fe81f63c640 1 -- 172.21.15.103:0/3253954407 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe7fc06be30 msgr2=0x7fe7fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:27.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.428+0000 7fe81f63c640 1 --2- 172.21.15.103:0/3253954407 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe7fc06be30 0x7fe7fc06e2f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe81400a9d0 tx=0x7fe814008040 comp rx=0 tx=0).stop 2024-09-10T08:45:27.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.428+0000 7fe81f63c640 1 -- 172.21.15.103:0/3253954407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8180c47d0 msgr2=0x7fe8181ed470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:27.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.428+0000 7fe81f63c640 1 --2- 172.21.15.103:0/3253954407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8180c47d0 0x7fe8181ed470 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe80802a1a0 tx=0x7fe8080046c0 comp rx=0 tx=0).stop 2024-09-10T08:45:27.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.428+0000 7fe81f63c640 1 -- 172.21.15.103:0/3253954407 shutdown_connections 2024-09-10T08:45:27.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.428+0000 7fe81f63c640 1 --2- 172.21.15.103:0/3253954407 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fe7fc06be30 0x7fe7fc06e2f0 secure :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe81400a9d0 tx=0x7fe814008040 comp rx=0 tx=0).stop 2024-09-10T08:45:27.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.429+0000 7fe81f63c640 1 --2- 172.21.15.103:0/3253954407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8180c4bb0 0x7fe818153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:27.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.429+0000 7fe81f63c640 1 --2- 172.21.15.103:0/3253954407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe8180c47d0 0x7fe8181ed470 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:27.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.429+0000 7fe81f63c640 1 --2- 172.21.15.103:0/3253954407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8180c3170 0x7fe8181e9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:27.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.429+0000 7fe81f63c640 1 -- 172.21.15.103:0/3253954407 >> 172.21.15.103:0/3253954407 conn(0x7fe81806c210 msgr2=0x7fe8180c5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:27.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.435+0000 7fe81f63c640 1 -- 172.21.15.103:0/3253954407 shutdown_connections 2024-09-10T08:45:27.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.437+0000 7fe81f63c640 1 -- 172.21.15.103:0/3253954407 wait complete. 2024-09-10T08:45:27.467 INFO:tasks.cephfs.filesystem:Destroying file system b and related pools 2024-09-10T08:45:27.467 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:45:27.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.624+0000 7f775d0ac640 1 Processor -- start 2024-09-10T08:45:27.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.624+0000 7f775d0ac640 1 -- start start 2024-09-10T08:45:27.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.624+0000 7f775d0ac640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77580aa6b0 0x7f77581549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:27.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.624+0000 7f775d0ac640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7758067d50 con 0x7f77580adb70 2024-09-10T08:45:27.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.624+0000 7f775d0ac640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7758067a70 con 0x7f7758154ee0 2024-09-10T08:45:27.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.624+0000 7f775d0ac640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f77580abc20 con 0x7f77580aa6b0 2024-09-10T08:45:27.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f775659c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f77580adb70 0x7f77581514c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:57710/0 (socket says 172.21.15.103:57710) 2024-09-10T08:45:27.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f775659c640 1 -- 172.21.15.103:0/26086127 learned_addr learned my addr 172.21.15.103:0/26086127 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:45:27.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f7756d9d640 1 --2- 172.21.15.103:0/26086127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77580aa6b0 0x7f77581549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:27.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f7755d9b640 1 -- 172.21.15.103:0/26086127 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1019048831 0 0) 0x7f7758067d50 con 0x7f77580adb70 2024-09-10T08:45:27.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f7755d9b640 1 -- 172.21.15.103:0/26086127 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7740003520 con 0x7f77580adb70 2024-09-10T08:45:27.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f7755d9b640 1 -- 172.21.15.103:0/26086127 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2906775400 0 0) 0x7f7758067a70 con 0x7f7758154ee0 2024-09-10T08:45:27.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f7755d9b640 1 -- 172.21.15.103:0/26086127 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7758067d50 con 0x7f7758154ee0 2024-09-10T08:45:27.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f7755d9b640 1 -- 172.21.15.103:0/26086127 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4131737207 0 0) 0x7f7740003520 con 0x7f77580adb70 2024-09-10T08:45:27.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f7755d9b640 1 -- 172.21.15.103:0/26086127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77580aa6b0 msgr2=0x7f77581549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:27.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f7755d9b640 1 --2- 172.21.15.103:0/26086127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77580aa6b0 0x7f77581549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:27.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f7755d9b640 1 -- 172.21.15.103:0/26086127 >> v1:172.21.15.154:6789/0 conn(0x7f7758154ee0 legacy=0x7f775806cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:27.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f7755d9b640 1 -- 172.21.15.103:0/26086127 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77580ab660 con 0x7f77580adb70 2024-09-10T08:45:27.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f7755d9b640 1 -- 172.21.15.103:0/26086127 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f774c001670 con 0x7f77580adb70 2024-09-10T08:45:27.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f7755d9b640 1 -- 172.21.15.103:0/26086127 >> v1:172.21.15.103:6789/0 conn(0x7f77580adb70 legacy=0x7f77581514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:27.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f7755d9b640 1 --2- 172.21.15.103:0/26086127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7740003b70 0x7f7740003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:27.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f7755d9b640 1 --2- 172.21.15.103:0/26086127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7740004800 0x7f7740004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:27.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f7755d9b640 1 --2- 172.21.15.103:0/26086127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77580aa6b0 0x7f7740005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:27.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f7755d9b640 1 -- 172.21.15.103:0/26086127 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f77580abc20 con 0x7f7740004800 2024-09-10T08:45:27.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f7755d9b640 1 -- 172.21.15.103:0/26086127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f774000bb50 con 0x7f7740003b70 2024-09-10T08:45:27.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f7755d9b640 1 -- 172.21.15.103:0/26086127 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f774000bd20 con 0x7f77580aa6b0 2024-09-10T08:45:27.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f775659c640 1 --2- 172.21.15.103:0/26086127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7740004800 0x7f7740004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:27.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f7756d9d640 1 --2- 172.21.15.103:0/26086127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7740003b70 0x7f7740003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:27.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.625+0000 7f775759e640 1 --2- 172.21.15.103:0/26086127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77580aa6b0 0x7f7740005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:27.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.626+0000 7f775659c640 1 -- 172.21.15.103:0/26086127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77580aa6b0 msgr2=0x7f7740005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:27.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.626+0000 7f775659c640 1 --2- 172.21.15.103:0/26086127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77580aa6b0 0x7f7740005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:27.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.626+0000 7f775659c640 1 -- 172.21.15.103:0/26086127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7740003b70 msgr2=0x7f7740003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:27.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.626+0000 7f775659c640 1 --2- 172.21.15.103:0/26086127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7740003b70 0x7f7740003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:27.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.626+0000 7f775659c640 1 -- 172.21.15.103:0/26086127 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7740003520 con 0x7f7740004800 2024-09-10T08:45:27.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.626+0000 7f775659c640 1 --2- 172.21.15.103:0/26086127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7740004800 0x7f7740004c80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f774c00c0e0 tx=0x7f7740005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58b69e2f17f1fbd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:27.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.626+0000 7f7755d9b640 1 -- 172.21.15.103:0/26086127 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c007c40 con 0x7f7740004800 2024-09-10T08:45:27.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.626+0000 7f7755d9b640 1 -- 172.21.15.103:0/26086127 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f774c005ad0 con 0x7f7740004800 2024-09-10T08:45:27.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.626+0000 7f7755d9b640 1 -- 172.21.15.103:0/26086127 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c007070 con 0x7f7740004800 2024-09-10T08:45:27.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.627+0000 7f775d0ac640 1 -- 172.21.15.103:0/26086127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7740004800 msgr2=0x7f7740004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:27.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.627+0000 7f775d0ac640 1 --2- 172.21.15.103:0/26086127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7740004800 0x7f7740004c80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f774c00c0e0 tx=0x7f7740005830 comp rx=0 tx=0).stop 2024-09-10T08:45:27.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.627+0000 7f775759e640 1 -- 172.21.15.103:0/26086127 reap_dead start 2024-09-10T08:45:27.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.627+0000 7f775d0ac640 1 -- 172.21.15.103:0/26086127 shutdown_connections 2024-09-10T08:45:27.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.627+0000 7f775d0ac640 1 -- 172.21.15.103:0/26086127 >> 172.21.15.103:0/26086127 conn(0x7f77580c4fa0 msgr2=0x7f77580c5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:27.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.627+0000 7f775d0ac640 1 -- 172.21.15.103:0/26086127 shutdown_connections 2024-09-10T08:45:27.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.627+0000 7f775d0ac640 1 -- 172.21.15.103:0/26086127 wait complete. 2024-09-10T08:45:27.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.628+0000 7f775d0ac640 1 Processor -- start 2024-09-10T08:45:27.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.629+0000 7f775d0ac640 1 -- start start 2024-09-10T08:45:27.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.629+0000 7f775d0ac640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7740004800 0x7f77580c1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:27.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.629+0000 7f775d0ac640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77581e9b30 0x7f77580bff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:27.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.629+0000 7f775d0ac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77580c0440 0x7f7758072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:27.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.629+0000 7f775d0ac640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f77580c5d10 con 0x7f7740004800 2024-09-10T08:45:27.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.629+0000 7f775d0ac640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7758154480 con 0x7f77580c0440 2024-09-10T08:45:27.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.629+0000 7f775d0ac640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f77580ae540 con 0x7f77581e9b30 2024-09-10T08:45:27.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.629+0000 7f7756d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7740004800 0x7f77580c1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:27.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.629+0000 7f7756d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7740004800 0x7f77580c1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56426/0 (socket says 172.21.15.103:56426) 2024-09-10T08:45:27.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.629+0000 7f7756d9d640 1 -- 172.21.15.103:0/1280346200 learned_addr learned my addr 172.21.15.103:0/1280346200 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:45:27.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.629+0000 7f775659c640 1 --2- 172.21.15.103:0/1280346200 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77581e9b30 0x7f77580bff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:27.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.629+0000 7f775759e640 1 --2- 172.21.15.103:0/1280346200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77580c0440 0x7f7758072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:27.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.630+0000 7f7756d9d640 1 -- 172.21.15.103:0/1280346200 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77581e9b30 msgr2=0x7f77580bff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:27.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.630+0000 7f7756d9d640 1 --2- 172.21.15.103:0/1280346200 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77581e9b30 0x7f77580bff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:27.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.630+0000 7f7756d9d640 1 -- 172.21.15.103:0/1280346200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77580c0440 msgr2=0x7f7758072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:27.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.630+0000 7f7756d9d640 1 --2- 172.21.15.103:0/1280346200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77580c0440 0x7f7758072e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:27.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.630+0000 7f7756d9d640 1 -- 172.21.15.103:0/1280346200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77580c18d0 con 0x7f7740004800 2024-09-10T08:45:27.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.630+0000 7f775759e640 1 --2- 172.21.15.103:0/1280346200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77580c0440 0x7f7758072e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:45:27.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.630+0000 7f7756d9d640 1 --2- 172.21.15.103:0/1280346200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7740004800 0x7f77580c1ff0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7748011960 tx=0x7f7748011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:27.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.630+0000 7f773f7fe640 1 -- 172.21.15.103:0/1280346200 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774800fa90 con 0x7f7740004800 2024-09-10T08:45:27.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.630+0000 7f773f7fe640 1 -- 172.21.15.103:0/1280346200 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f774800fc30 con 0x7f7740004800 2024-09-10T08:45:27.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.630+0000 7f775d0ac640 1 -- 172.21.15.103:0/1280346200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77581ed250 con 0x7f7740004800 2024-09-10T08:45:27.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.630+0000 7f773f7fe640 1 -- 172.21.15.103:0/1280346200 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7748014440 con 0x7f7740004800 2024-09-10T08:45:27.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.630+0000 7f775d0ac640 1 -- 172.21.15.103:0/1280346200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77581ed810 con 0x7f7740004800 2024-09-10T08:45:27.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.631+0000 7f775d0ac640 1 -- 172.21.15.103:0/1280346200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77580761c0 con 0x7f7740004800 2024-09-10T08:45:27.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.631+0000 7f773f7fe640 1 -- 172.21.15.103:0/1280346200 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7748012040 con 0x7f7740004800 2024-09-10T08:45:27.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.632+0000 7f773f7fe640 1 --2- 172.21.15.103:0/1280346200 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f774406be30 0x7f774406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:27.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.632+0000 7f775659c640 1 --2- 172.21.15.103:0/1280346200 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f774406be30 0x7f774406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:27.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.632+0000 7f773f7fe640 1 -- 172.21.15.103:0/1280346200 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5775+0+0 (secure 0 0 0) 0x7f774808b1c0 con 0x7f7740004800 2024-09-10T08:45:27.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.633+0000 7f775659c640 1 --2- 172.21.15.103:0/1280346200 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f774406be30 0x7f774406e2f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f774c032000 tx=0x7f774c02d000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:27.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.636+0000 7f773f7fe640 1 -- 172.21.15.103:0/1280346200 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f77580761c0 con 0x7f7740004800 2024-09-10T08:45:27.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.861+0000 7f775d0ac640 1 -- 172.21.15.103:0/1280346200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7758152550 con 0x7f7740004800 2024-09-10T08:45:27.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.861+0000 7f773f7fe640 1 -- 172.21.15.103:0/1280346200 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5231 (secure 0 0 0) 0x7f7758152550 con 0x7f7740004800 2024-09-10T08:45:27.862 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:45:27.863 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":13,"btime":"2024-09-10T08:45:25:400853+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3378269214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3378269214},{"type":"v1","addr":"172.21.15.154:6833","nonce":3378269214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2141115327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2141115327},{"type":"v1","addr":"172.21.15.154:6835","nonce":2141115327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":174354,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3524032058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":3524032058},{"type":"v1","addr":"172.21.15.103:6837","nonce":3524032058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:46.949092+0000","modified":"2024-09-10T08:28:49.966725+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.103:6836/2250136134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2250136134},{"type":"v1","addr":"172.21.15.103:6836","nonce":2250136134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":2}]} 2024-09-10T08:45:27.863 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 13 2024-09-10T08:45:27.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.864+0000 7f775d0ac640 1 -- 172.21.15.103:0/1280346200 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f774406be30 msgr2=0x7f774406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:27.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.864+0000 7f775d0ac640 1 --2- 172.21.15.103:0/1280346200 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f774406be30 0x7f774406e2f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f774c032000 tx=0x7f774c02d000 comp rx=0 tx=0).stop 2024-09-10T08:45:27.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.864+0000 7f775d0ac640 1 -- 172.21.15.103:0/1280346200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7740004800 msgr2=0x7f77580c1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:27.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.864+0000 7f775d0ac640 1 --2- 172.21.15.103:0/1280346200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7740004800 0x7f77580c1ff0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7748011960 tx=0x7f7748011e20 comp rx=0 tx=0).stop 2024-09-10T08:45:27.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.864+0000 7f775d0ac640 1 -- 172.21.15.103:0/1280346200 shutdown_connections 2024-09-10T08:45:27.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.864+0000 7f775d0ac640 1 --2- 172.21.15.103:0/1280346200 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f774406be30 0x7f774406e2f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:27.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.864+0000 7f775d0ac640 1 --2- 172.21.15.103:0/1280346200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77580c0440 0x7f7758072e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:27.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.864+0000 7f775d0ac640 1 --2- 172.21.15.103:0/1280346200 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77581e9b30 0x7f77580bff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:27.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.864+0000 7f775d0ac640 1 --2- 172.21.15.103:0/1280346200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7740004800 0x7f77580c1ff0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:27.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.864+0000 7f775d0ac640 1 -- 172.21.15.103:0/1280346200 >> 172.21.15.103:0/1280346200 conn(0x7f77580c4fa0 msgr2=0x7f77580ad160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:27.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.864+0000 7f775d0ac640 1 -- 172.21.15.103:0/1280346200 shutdown_connections 2024-09-10T08:45:27.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.864+0000 7f775d0ac640 1 -- 172.21.15.103:0/1280346200 wait complete. 2024-09-10T08:45:27.880 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:45:27.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.983+0000 7f5961e77640 1 Processor -- start 2024-09-10T08:45:27.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.983+0000 7f5961e77640 1 -- start start 2024-09-10T08:45:27.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.984+0000 7f5961e77640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f595c157c90 0x7f595c0c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:27.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.984+0000 7f5961e77640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f595c0741e0 con 0x7f595c0c9860 2024-09-10T08:45:27.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.984+0000 7f5961e77640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f595c0c4820 con 0x7f595c1578b0 2024-09-10T08:45:27.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.984+0000 7f5961e77640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f595c073f90 con 0x7f595c157c90 2024-09-10T08:45:27.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.984+0000 7f595affd640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f595c0c9860 0x7f595c0c8840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:57712/0 (socket says 172.21.15.103:57712) 2024-09-10T08:45:27.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.984+0000 7f595affd640 1 -- 172.21.15.103:0/968047011 learned_addr learned my addr 172.21.15.103:0/968047011 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:45:27.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.984+0000 7f595a7fc640 1 -- 172.21.15.103:0/968047011 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3664867442 0 0) 0x7f595c0741e0 con 0x7f595c0c9860 2024-09-10T08:45:27.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.984+0000 7f595bfff640 1 --2- 172.21.15.103:0/968047011 >> v2:172.21.15.154:3300/0 conn(0x7f595c157c90 0x7f595c0c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:27.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.984+0000 7f595a7fc640 1 -- 172.21.15.103:0/968047011 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5944003520 con 0x7f595c0c9860 2024-09-10T08:45:27.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.984+0000 7f595a7fc640 1 -- 172.21.15.103:0/968047011 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3860193237 0 0) 0x7f5944003520 con 0x7f595c0c9860 2024-09-10T08:45:27.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.984+0000 7f595a7fc640 1 -- 172.21.15.103:0/968047011 >> v2:172.21.15.154:3300/0 conn(0x7f595c157c90 msgr2=0x7f595c0c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:27.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.984+0000 7f595a7fc640 1 --2- 172.21.15.103:0/968047011 >> v2:172.21.15.154:3300/0 conn(0x7f595c157c90 0x7f595c0c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:27.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.984+0000 7f595a7fc640 1 -- 172.21.15.103:0/968047011 >> v1:172.21.15.154:6789/0 conn(0x7f595c1578b0 legacy=0x7f595c1513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:27.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.984+0000 7f595a7fc640 1 -- 172.21.15.103:0/968047011 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595c0c9490 con 0x7f595c0c9860 2024-09-10T08:45:27.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.984+0000 7f595a7fc640 1 -- 172.21.15.103:0/968047011 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4057785196 0 0) 0x7f5950001670 con 0x7f595c0c9860 2024-09-10T08:45:27.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.985+0000 7f595a7fc640 1 -- 172.21.15.103:0/968047011 >> v1:172.21.15.103:6789/0 conn(0x7f595c0c9860 legacy=0x7f595c0c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:27.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.985+0000 7f595a7fc640 1 --2- 172.21.15.103:0/968047011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59440039b0 0x7f5944003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:27.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.985+0000 7f595a7fc640 1 --2- 172.21.15.103:0/968047011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5944004800 0x7f5944004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:27.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.985+0000 7f595a7fc640 1 --2- 172.21.15.103:0/968047011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59440052e0 0x7f594400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:27.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.985+0000 7f595a7fc640 1 -- 172.21.15.103:0/968047011 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f595c073f90 con 0x7f5944004800 2024-09-10T08:45:27.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.985+0000 7f595a7fc640 1 -- 172.21.15.103:0/968047011 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f594400c1b0 con 0x7f59440039b0 2024-09-10T08:45:27.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.985+0000 7f595a7fc640 1 -- 172.21.15.103:0/968047011 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f594400c3b0 con 0x7f59440052e0 2024-09-10T08:45:27.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.985+0000 7f595affd640 1 --2- 172.21.15.103:0/968047011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5944004800 0x7f5944004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:27.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.985+0000 7f595b7fe640 1 --2- 172.21.15.103:0/968047011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59440039b0 0x7f5944003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:27.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.985+0000 7f595bfff640 1 --2- 172.21.15.103:0/968047011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59440052e0 0x7f594400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:27.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.985+0000 7f595affd640 1 -- 172.21.15.103:0/968047011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59440052e0 msgr2=0x7f594400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:27.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.985+0000 7f595affd640 1 --2- 172.21.15.103:0/968047011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59440052e0 0x7f594400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:27.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.985+0000 7f595affd640 1 -- 172.21.15.103:0/968047011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59440039b0 msgr2=0x7f5944003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:27.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.985+0000 7f595affd640 1 --2- 172.21.15.103:0/968047011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59440039b0 0x7f5944003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:27.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.985+0000 7f595bfff640 1 -- 172.21.15.103:0/968047011 reap_dead start 2024-09-10T08:45:27.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.985+0000 7f595affd640 1 -- 172.21.15.103:0/968047011 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5944003520 con 0x7f5944004800 2024-09-10T08:45:27.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.986+0000 7f595affd640 1 --2- 172.21.15.103:0/968047011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5944004800 0x7f5944004c80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f595000c210 tx=0x7f5944005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef382c7865024bd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:27.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.986+0000 7f595a7fc640 1 -- 172.21.15.103:0/968047011 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5950007d10 con 0x7f5944004800 2024-09-10T08:45:27.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.986+0000 7f595a7fc640 1 -- 172.21.15.103:0/968047011 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5950005af0 con 0x7f5944004800 2024-09-10T08:45:27.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.986+0000 7f595a7fc640 1 -- 172.21.15.103:0/968047011 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5950007070 con 0x7f5944004800 2024-09-10T08:45:27.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.986+0000 7f5961e77640 1 -- 172.21.15.103:0/968047011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5944004800 msgr2=0x7f5944004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:27.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.986+0000 7f5961e77640 1 --2- 172.21.15.103:0/968047011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5944004800 0x7f5944004c80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f595000c210 tx=0x7f5944005830 comp rx=0 tx=0).stop 2024-09-10T08:45:27.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.986+0000 7f5961e77640 1 -- 172.21.15.103:0/968047011 shutdown_connections 2024-09-10T08:45:27.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.986+0000 7f5961e77640 1 --2- 172.21.15.103:0/968047011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5944004800 0x7f5944004c80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:27.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.986+0000 7f5961e77640 1 -- 172.21.15.103:0/968047011 >> 172.21.15.103:0/968047011 conn(0x7f595c0c6880 msgr2=0x7f595c0c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:27.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.986+0000 7f5961e77640 1 -- 172.21.15.103:0/968047011 shutdown_connections 2024-09-10T08:45:27.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.986+0000 7f5961e77640 1 -- 172.21.15.103:0/968047011 wait complete. 2024-09-10T08:45:27.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.988+0000 7f5961e77640 1 Processor -- start 2024-09-10T08:45:27.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.988+0000 7f5961e77640 1 -- start start 2024-09-10T08:45:27.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.988+0000 7f5961e77640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5944004800 0x7f595c149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:27.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.988+0000 7f5961e77640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f595c156be0 0x7f595c1df900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:27.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.988+0000 7f5961e77640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f595c157020 0x7f595c1dfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:27.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.988+0000 7f5961e77640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f595c0afd30 con 0x7f595c157020 2024-09-10T08:45:27.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.988+0000 7f5961e77640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f595c158280 con 0x7f5944004800 2024-09-10T08:45:27.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.988+0000 7f5961e77640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f595c0afeb0 con 0x7f595c156be0 2024-09-10T08:45:27.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.988+0000 7f595bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f595c157020 0x7f595c1dfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:27.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.989+0000 7f595bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f595c157020 0x7f595c1dfe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56442/0 (socket says 172.21.15.103:56442) 2024-09-10T08:45:27.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.989+0000 7f595bfff640 1 -- 172.21.15.103:0/1768935300 learned_addr learned my addr 172.21.15.103:0/1768935300 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:45:27.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.989+0000 7f595affd640 1 --2- 172.21.15.103:0/1768935300 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f595c156be0 0x7f595c1df900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:27.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.989+0000 7f595b7fe640 1 --2- 172.21.15.103:0/1768935300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5944004800 0x7f595c149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:27.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.989+0000 7f595bfff640 1 -- 172.21.15.103:0/1768935300 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f595c156be0 msgr2=0x7f595c1df900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:27.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.989+0000 7f595bfff640 1 --2- 172.21.15.103:0/1768935300 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f595c156be0 0x7f595c1df900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:27.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.989+0000 7f595bfff640 1 -- 172.21.15.103:0/1768935300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5944004800 msgr2=0x7f595c149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:27.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.989+0000 7f595bfff640 1 --2- 172.21.15.103:0/1768935300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5944004800 0x7f595c149370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:27.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.989+0000 7f595bfff640 1 -- 172.21.15.103:0/1768935300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595c149d20 con 0x7f595c157020 2024-09-10T08:45:27.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.989+0000 7f595bfff640 1 --2- 172.21.15.103:0/1768935300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f595c157020 0x7f595c1dfe40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f595c0c7500 tx=0x7f5954011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:27.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.989+0000 7f5943fff640 1 -- 172.21.15.103:0/1768935300 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5954004030 con 0x7f595c157020 2024-09-10T08:45:27.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.989+0000 7f5943fff640 1 -- 172.21.15.103:0/1768935300 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f595401b070 con 0x7f595c157020 2024-09-10T08:45:27.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.989+0000 7f5943fff640 1 -- 172.21.15.103:0/1768935300 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5954004410 con 0x7f595c157020 2024-09-10T08:45:27.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.989+0000 7f5961e77640 1 -- 172.21.15.103:0/1768935300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f595c0c33e0 con 0x7f595c157020 2024-09-10T08:45:27.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.989+0000 7f5961e77640 1 -- 172.21.15.103:0/1768935300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f595c0c3960 con 0x7f595c157020 2024-09-10T08:45:27.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.990+0000 7f5961e77640 1 -- 172.21.15.103:0/1768935300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f595c0c7550 con 0x7f595c157020 2024-09-10T08:45:27.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.990+0000 7f5943fff640 1 -- 172.21.15.103:0/1768935300 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5954012040 con 0x7f595c157020 2024-09-10T08:45:27.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.991+0000 7f5943fff640 1 --2- 172.21.15.103:0/1768935300 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f594806be30 0x7f594806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:27.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.991+0000 7f5943fff640 1 -- 172.21.15.103:0/1768935300 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5775+0+0 (secure 0 0 0) 0x7f595408ad60 con 0x7f595c157020 2024-09-10T08:45:27.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.991+0000 7f595b7fe640 1 --2- 172.21.15.103:0/1768935300 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f594806be30 0x7f594806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:27.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.991+0000 7f595b7fe640 1 --2- 172.21.15.103:0/1768935300 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f594806be30 0x7f594806e2f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f594c000f80 tx=0x7f594c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:27.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:27.995+0000 7f5943fff640 1 -- 172.21.15.103:0/1768935300 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5954059640 con 0x7f595c157020 2024-09-10T08:45:28.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.195+0000 7f5961e77640 1 -- 172.21.15.103:0/1768935300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f595c0ab460 con 0x7f595c157020 2024-09-10T08:45:28.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.196+0000 7f5943fff640 1 -- 172.21.15.103:0/1768935300 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5231 (secure 0 0 0) 0x7f5954058f40 con 0x7f595c157020 2024-09-10T08:45:28.197 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:45:28.197 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":13,"btime":"2024-09-10T08:45:25:400853+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/3378269214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3378269214},{"type":"v1","addr":"172.21.15.154:6833","nonce":3378269214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2141115327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2141115327},{"type":"v1","addr":"172.21.15.154:6835","nonce":2141115327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":174354,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3524032058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":3524032058},{"type":"v1","addr":"172.21.15.103:6837","nonce":3524032058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:46.949092+0000","modified":"2024-09-10T08:28:49.966725+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.103:6836/2250136134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2250136134},{"type":"v1","addr":"172.21.15.103:6836","nonce":2250136134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":2}]} 2024-09-10T08:45:28.197 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 13 2024-09-10T08:45:28.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.198+0000 7f5961e77640 1 -- 172.21.15.103:0/1768935300 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f594806be30 msgr2=0x7f594806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:28.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.198+0000 7f5961e77640 1 --2- 172.21.15.103:0/1768935300 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f594806be30 0x7f594806e2f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f594c000f80 tx=0x7f594c009040 comp rx=0 tx=0).stop 2024-09-10T08:45:28.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.198+0000 7f5961e77640 1 -- 172.21.15.103:0/1768935300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f595c157020 msgr2=0x7f595c1dfe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:28.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.198+0000 7f5961e77640 1 --2- 172.21.15.103:0/1768935300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f595c157020 0x7f595c1dfe40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f595c0c7500 tx=0x7f5954011c30 comp rx=0 tx=0).stop 2024-09-10T08:45:28.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.198+0000 7f5961e77640 1 -- 172.21.15.103:0/1768935300 shutdown_connections 2024-09-10T08:45:28.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.198+0000 7f5961e77640 1 --2- 172.21.15.103:0/1768935300 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f594806be30 0x7f594806e2f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.198+0000 7f5961e77640 1 --2- 172.21.15.103:0/1768935300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f595c157020 0x7f595c1dfe40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.198+0000 7f5961e77640 1 --2- 172.21.15.103:0/1768935300 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f595c156be0 0x7f595c1df900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.198+0000 7f5961e77640 1 --2- 172.21.15.103:0/1768935300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5944004800 0x7f595c149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.198+0000 7f5961e77640 1 -- 172.21.15.103:0/1768935300 >> 172.21.15.103:0/1768935300 conn(0x7f595c0c6880 msgr2=0x7f595c1511c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:28.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.198+0000 7f5961e77640 1 -- 172.21.15.103:0/1768935300 shutdown_connections 2024-09-10T08:45:28.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.198+0000 7f5961e77640 1 -- 172.21.15.103:0/1768935300 wait complete. 2024-09-10T08:45:28.210 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:45:28.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.308+0000 7f2ad1918640 1 Processor -- start 2024-09-10T08:45:28.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.308+0000 7f2ad1918640 1 -- start start 2024-09-10T08:45:28.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.309+0000 7f2ad1918640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2acc150480 0x7f2acc0c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:28.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.309+0000 7f2ad1918640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2acc06c650 0x7f2acc0c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:28.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.309+0000 7f2ad1918640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2acc15a7c0 con 0x7f2acc0c9c80 2024-09-10T08:45:28.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.309+0000 7f2ad1918640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f2acc06c240 con 0x7f2acc150480 2024-09-10T08:45:28.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.309+0000 7f2ad1918640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2acc15a330 con 0x7f2acc06c650 2024-09-10T08:45:28.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.309+0000 7f2acb7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2acc0c9c80 0x7f2acc0ca130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:57720/0 (socket says 172.21.15.103:57720) 2024-09-10T08:45:28.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.309+0000 7f2acb7fe640 1 -- 172.21.15.103:0/216137892 learned_addr learned my addr 172.21.15.103:0/216137892 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:45:28.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.309+0000 7f2aca7fc640 1 --2- 172.21.15.103:0/216137892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2acc06c650 0x7f2acc0c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:28.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.309+0000 7f2acaffd640 1 --2- 172.21.15.103:0/216137892 >> v2:172.21.15.154:3300/0 conn(0x7f2acc150480 0x7f2acc0c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:28.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.309+0000 7f2ac9ffb640 1 -- 172.21.15.103:0/216137892 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2281859514 0 0) 0x7f2acc15a7c0 con 0x7f2acc0c9c80 2024-09-10T08:45:28.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.309+0000 7f2ac9ffb640 1 -- 172.21.15.103:0/216137892 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ab4003520 con 0x7f2acc0c9c80 2024-09-10T08:45:28.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.309+0000 7f2aca7fc640 1 -- 172.21.15.103:0/216137892 >> v2:172.21.15.154:3300/0 conn(0x7f2acc150480 msgr2=0x7f2acc0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:28.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.309+0000 7f2aca7fc640 1 --2- 172.21.15.103:0/216137892 >> v2:172.21.15.154:3300/0 conn(0x7f2acc150480 0x7f2acc0c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.309+0000 7f2aca7fc640 1 -- 172.21.15.103:0/216137892 >> v1:172.21.15.103:6789/0 conn(0x7f2acc0c9c80 legacy=0x7f2acc0ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:28.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.309+0000 7f2aca7fc640 1 -- 172.21.15.103:0/216137892 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2acc159a00 con 0x7f2acc06c650 2024-09-10T08:45:28.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.310+0000 7f2aca7fc640 1 --2- 172.21.15.103:0/216137892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2acc06c650 0x7f2acc0c7fd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00097a0 tx=0x7f2ac002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6893a131462a5ead server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:28.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.310+0000 7f2ac9ffb640 1 -- 172.21.15.103:0/216137892 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0037070 con 0x7f2acc06c650 2024-09-10T08:45:28.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.310+0000 7f2ac9ffb640 1 -- 172.21.15.103:0/216137892 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2ac0032440 con 0x7f2acc06c650 2024-09-10T08:45:28.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.310+0000 7f2ac9ffb640 1 -- 172.21.15.103:0/216137892 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac00327f0 con 0x7f2acc06c650 2024-09-10T08:45:28.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.311+0000 7f2ad1918640 1 -- 172.21.15.103:0/216137892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2acc06c650 msgr2=0x7f2acc0c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:28.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.311+0000 7f2ad1918640 1 --2- 172.21.15.103:0/216137892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2acc06c650 0x7f2acc0c7fd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00097a0 tx=0x7f2ac002a180 comp rx=0 tx=0).stop 2024-09-10T08:45:28.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.311+0000 7f2ad1918640 1 -- 172.21.15.103:0/216137892 shutdown_connections 2024-09-10T08:45:28.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.311+0000 7f2ad1918640 1 --2- 172.21.15.103:0/216137892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2acc06c650 0x7f2acc0c7fd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.311+0000 7f2ad1918640 1 --2- 172.21.15.103:0/216137892 >> v2:172.21.15.154:3300/0 conn(0x7f2acc150480 0x7f2acc0c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.311+0000 7f2ad1918640 1 -- 172.21.15.103:0/216137892 >> 172.21.15.103:0/216137892 conn(0x7f2acc068030 msgr2=0x7f2acc073340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:28.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.311+0000 7f2ad1918640 1 -- 172.21.15.103:0/216137892 shutdown_connections 2024-09-10T08:45:28.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.311+0000 7f2ad1918640 1 -- 172.21.15.103:0/216137892 wait complete. 2024-09-10T08:45:28.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.312+0000 7f2ad1918640 1 Processor -- start 2024-09-10T08:45:28.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.312+0000 7f2ad1918640 1 -- start start 2024-09-10T08:45:28.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.313+0000 7f2ad1918640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2acc06c650 0x7f2acc1e2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:28.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.313+0000 7f2ad1918640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2acc0c9c80 0x7f2acc1ef4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:28.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.313+0000 7f2ad1918640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc150480 0x7f2acc1efa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:28.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.313+0000 7f2ad1918640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2acc06d270 con 0x7f2acc06c650 2024-09-10T08:45:28.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.313+0000 7f2ad1918640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2acc159fc0 con 0x7f2acc150480 2024-09-10T08:45:28.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.313+0000 7f2ad1918640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f2acc156270 con 0x7f2acc0c9c80 2024-09-10T08:45:28.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.313+0000 7f2acaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2acc06c650 0x7f2acc1e2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:28.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.313+0000 7f2acaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2acc06c650 0x7f2acc1e2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56454/0 (socket says 172.21.15.103:56454) 2024-09-10T08:45:28.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.313+0000 7f2acaffd640 1 -- 172.21.15.103:0/4224448385 learned_addr learned my addr 172.21.15.103:0/4224448385 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:45:28.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.313+0000 7f2aca7fc640 1 --2- 172.21.15.103:0/4224448385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2acc0c9c80 0x7f2acc1ef4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:28.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.313+0000 7f2acb7fe640 1 --2- 172.21.15.103:0/4224448385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc150480 0x7f2acc1efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:28.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.313+0000 7f2acaffd640 1 -- 172.21.15.103:0/4224448385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2acc0c9c80 msgr2=0x7f2acc1ef4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:28.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.313+0000 7f2acaffd640 1 --2- 172.21.15.103:0/4224448385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2acc0c9c80 0x7f2acc1ef4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.313+0000 7f2acaffd640 1 -- 172.21.15.103:0/4224448385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc150480 msgr2=0x7f2acc1efa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:28.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.313+0000 7f2acaffd640 1 --2- 172.21.15.103:0/4224448385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc150480 0x7f2acc1efa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.313+0000 7f2acaffd640 1 -- 172.21.15.103:0/4224448385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2acc149df0 con 0x7f2acc06c650 2024-09-10T08:45:28.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.313+0000 7f2acb7fe640 1 --2- 172.21.15.103:0/4224448385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc150480 0x7f2acc1efa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:45:28.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.314+0000 7f2acaffd640 1 --2- 172.21.15.103:0/4224448385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2acc06c650 0x7f2acc1e2d80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00efc0 tx=0x7f2abc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:28.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.314+0000 7f2ab3fff640 1 -- 172.21.15.103:0/4224448385 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2abc018020 con 0x7f2acc06c650 2024-09-10T08:45:28.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.314+0000 7f2ab3fff640 1 -- 172.21.15.103:0/4224448385 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2abc014480 con 0x7f2acc06c650 2024-09-10T08:45:28.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.314+0000 7f2ad1918640 1 -- 172.21.15.103:0/4224448385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2acc153aa0 con 0x7f2acc06c650 2024-09-10T08:45:28.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.314+0000 7f2ab3fff640 1 -- 172.21.15.103:0/4224448385 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2abc014870 con 0x7f2acc06c650 2024-09-10T08:45:28.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.314+0000 7f2ad1918640 1 -- 172.21.15.103:0/4224448385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2acc153d60 con 0x7f2acc06c650 2024-09-10T08:45:28.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.315+0000 7f2ad1918640 1 -- 172.21.15.103:0/4224448385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2acc0ca130 con 0x7f2acc06c650 2024-09-10T08:45:28.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.315+0000 7f2ab3fff640 1 -- 172.21.15.103:0/4224448385 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2abc005d10 con 0x7f2acc06c650 2024-09-10T08:45:28.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.316+0000 7f2ab3fff640 1 --2- 172.21.15.103:0/4224448385 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2ab806be30 0x7f2ab806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:28.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.316+0000 7f2ab3fff640 1 -- 172.21.15.103:0/4224448385 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5775+0+0 (secure 0 0 0) 0x7f2abc08ba10 con 0x7f2acc06c650 2024-09-10T08:45:28.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.316+0000 7f2aca7fc640 1 --2- 172.21.15.103:0/4224448385 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2ab806be30 0x7f2ab806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:28.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.316+0000 7f2aca7fc640 1 --2- 172.21.15.103:0/4224448385 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2ab806be30 0x7f2ab806e2f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0034000 tx=0x7f2ac002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:28.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.320+0000 7f2ab3fff640 1 -- 172.21.15.103:0/4224448385 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2abc022070 con 0x7f2acc06c650 2024-09-10T08:45:28.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.487+0000 7f2ad1918640 1 -- 172.21.15.103:0/4224448385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2acc0cbc70 con 0x7f2acc06c650 2024-09-10T08:45:28.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.488+0000 7f2ab3fff640 1 -- 172.21.15.103:0/4224448385 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16888 (secure 0 0 0) 0x7f2acc149df0 con 0x7f2acc06c650 2024-09-10T08:45:28.490 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-10T08:45:28.490 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":30,"fsid":"4e00c5a2-3333-4e58-8ac6-d7e41a23ceb5","created":"2024-09-10T08:28:12.654957+0000","modified":"2024-09-10T08:45:27.416952+0000","last_up_change":"2024-09-10T08:28:25.445753+0000","last_in_change":"2024-09-10T08:28:14.741133+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:24.821696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-09-10T08:28:44.793084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-09-10T08:28:45.930823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1abe08f4-0348-435e-9f97-cec00e96992c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6809","nonce":2707863099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6811","nonce":2707863099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6815","nonce":2707863099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2707863099},{"type":"v1","addr":"172.21.15.103:6813","nonce":2707863099}]},"public_addr":"172.21.15.103:6809/2707863099","cluster_addr":"172.21.15.103:6811/2707863099","heartbeat_back_addr":"172.21.15.103:6815/2707863099","heartbeat_front_addr":"172.21.15.103:6813/2707863099","state":["exists","up"]},{"osd":1,"uuid":"df342e58-1026-4739-82f6-7a216707444c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6818","nonce":4029892782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6822","nonce":4029892782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6830","nonce":4029892782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4029892782},{"type":"v1","addr":"172.21.15.103:6826","nonce":4029892782}]},"public_addr":"172.21.15.103:6818/4029892782","cluster_addr":"172.21.15.103:6822/4029892782","heartbeat_back_addr":"172.21.15.103:6830/4029892782","heartbeat_front_addr":"172.21.15.103:6826/4029892782","state":["exists","up"]},{"osd":2,"uuid":"f7aea2cf-208c-41ed-a0f6-8948d70b9a0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6819","nonce":428484432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6821","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6823","nonce":428484432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6829","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6831","nonce":428484432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6825","nonce":428484432},{"type":"v1","addr":"172.21.15.103:6827","nonce":428484432}]},"public_addr":"172.21.15.103:6819/428484432","cluster_addr":"172.21.15.103:6823/428484432","heartbeat_back_addr":"172.21.15.103:6831/428484432","heartbeat_front_addr":"172.21.15.103:6827/428484432","state":["exists","up"]},{"osd":3,"uuid":"615ef8b0-12a5-4503-96d0-f7ec17dbc792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6801","nonce":3453676282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6803","nonce":3453676282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6807","nonce":3453676282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3453676282},{"type":"v1","addr":"172.21.15.103:6805","nonce":3453676282}]},"public_addr":"172.21.15.103:6801/3453676282","cluster_addr":"172.21.15.103:6803/3453676282","heartbeat_back_addr":"172.21.15.103:6807/3453676282","heartbeat_front_addr":"172.21.15.103:6805/3453676282","state":["exists","up"]},{"osd":4,"uuid":"644c5e94-db18-4b83-b5cd-3762ae2647a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6809","nonce":1808157069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6811","nonce":1808157069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6815","nonce":1808157069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1808157069},{"type":"v1","addr":"172.21.15.154:6813","nonce":1808157069}]},"public_addr":"172.21.15.154:6809/1808157069","cluster_addr":"172.21.15.154:6811/1808157069","heartbeat_back_addr":"172.21.15.154:6815/1808157069","heartbeat_front_addr":"172.21.15.154:6813/1808157069","state":["exists","up"]},{"osd":5,"uuid":"f40210bd-f4ca-442e-baac-729ced5a9f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6817","nonce":1048015779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6819","nonce":1048015779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6823","nonce":1048015779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1048015779},{"type":"v1","addr":"172.21.15.154:6821","nonce":1048015779}]},"public_addr":"172.21.15.154:6817/1048015779","cluster_addr":"172.21.15.154:6819/1048015779","heartbeat_back_addr":"172.21.15.154:6823/1048015779","heartbeat_front_addr":"172.21.15.154:6821/1048015779","state":["exists","up"]},{"osd":6,"uuid":"eebac31e-aaef-47b0-90d7-4af08f36d7c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6801","nonce":345273812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6803","nonce":345273812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6807","nonce":345273812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":345273812},{"type":"v1","addr":"172.21.15.154:6805","nonce":345273812}]},"public_addr":"172.21.15.154:6801/345273812","cluster_addr":"172.21.15.154:6803/345273812","heartbeat_back_addr":"172.21.15.154:6807/345273812","heartbeat_front_addr":"172.21.15.154:6805/345273812","state":["exists","up"]},{"osd":7,"uuid":"58406c9a-036f-4618-bfb6-0beddbd71605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6825","nonce":3439481239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6827","nonce":3439481239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6831","nonce":3439481239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3439481239},{"type":"v1","addr":"172.21.15.154:6829","nonce":3439481239}]},"public_addr":"172.21.15.154:6825/3439481239","cluster_addr":"172.21.15.154:6827/3439481239","heartbeat_back_addr":"172.21.15.154:6831/3439481239","heartbeat_front_addr":"172.21.15.154:6829/3439481239","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.032718+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.126448+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.781158+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.808718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.050591+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.038245+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:21.586989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:22.223326+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:6837/3032037784":"2024-09-11T08:45:24.391613+0000","172.21.15.103:6835/3032037784":"2024-09-11T08:45:24.391613+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:45:28.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.490+0000 7f2ad1918640 1 -- 172.21.15.103:0/4224448385 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2ab806be30 msgr2=0x7f2ab806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:28.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.490+0000 7f2ad1918640 1 --2- 172.21.15.103:0/4224448385 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2ab806be30 0x7f2ab806e2f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0034000 tx=0x7f2ac002e000 comp rx=0 tx=0).stop 2024-09-10T08:45:28.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.490+0000 7f2ad1918640 1 -- 172.21.15.103:0/4224448385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2acc06c650 msgr2=0x7f2acc1e2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:28.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.490+0000 7f2ad1918640 1 --2- 172.21.15.103:0/4224448385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2acc06c650 0x7f2acc1e2d80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00efc0 tx=0x7f2abc00c490 comp rx=0 tx=0).stop 2024-09-10T08:45:28.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.490+0000 7f2ad1918640 1 -- 172.21.15.103:0/4224448385 shutdown_connections 2024-09-10T08:45:28.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.490+0000 7f2ad1918640 1 --2- 172.21.15.103:0/4224448385 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f2ab806be30 0x7f2ab806e2f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.490+0000 7f2ad1918640 1 --2- 172.21.15.103:0/4224448385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc150480 0x7f2acc1efa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.490+0000 7f2ad1918640 1 --2- 172.21.15.103:0/4224448385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2acc0c9c80 0x7f2acc1ef4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.490+0000 7f2ad1918640 1 --2- 172.21.15.103:0/4224448385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2acc06c650 0x7f2acc1e2d80 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.490+0000 7f2ad1918640 1 -- 172.21.15.103:0/4224448385 >> 172.21.15.103:0/4224448385 conn(0x7f2acc068030 msgr2=0x7f2acc0cc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:28.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.490+0000 7f2ad1918640 1 -- 172.21.15.103:0/4224448385 shutdown_connections 2024-09-10T08:45:28.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.490+0000 7f2ad1918640 1 -- 172.21.15.103:0/4224448385 wait complete. 2024-09-10T08:45:28.503 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail b 2024-09-10T08:45:28.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.603+0000 7f35cab4b640 1 Processor -- start 2024-09-10T08:45:28.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.603+0000 7f35cab4b640 1 -- start start 2024-09-10T08:45:28.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.604+0000 7f35cab4b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f35c41578b0 0x7f35c41513f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:28.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.604+0000 7f35cab4b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c40c9860 0x7f35c4151930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:28.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.604+0000 7f35cab4b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35c40741e0 con 0x7f35c4157c90 2024-09-10T08:45:28.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.604+0000 7f35cab4b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f35c4073f90 con 0x7f35c41578b0 2024-09-10T08:45:28.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.604+0000 7f35cab4b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f35c4158280 con 0x7f35c40c9860 2024-09-10T08:45:28.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.604+0000 7f35bbfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c40c9860 0x7f35c4151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:28.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.604+0000 7f35c88e7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f35c41578b0 0x7f35c41513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:28.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.604+0000 7f35bbfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c40c9860 0x7f35c4151930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:52506/0 (socket says 172.21.15.103:52506) 2024-09-10T08:45:28.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.604+0000 7f35bbfff640 1 -- 172.21.15.103:0/490576879 learned_addr learned my addr 172.21.15.103:0/490576879 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:45:28.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.604+0000 7f35bbfff640 1 -- 172.21.15.103:0/490576879 >> v2:172.21.15.154:3300/0 conn(0x7f35c41578b0 msgr2=0x7f35c41513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:28.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.604+0000 7f35bbfff640 1 --2- 172.21.15.103:0/490576879 >> v2:172.21.15.154:3300/0 conn(0x7f35c41578b0 0x7f35c41513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.604+0000 7f35bbfff640 1 -- 172.21.15.103:0/490576879 >> v1:172.21.15.154:6789/0 conn(0x7f35c4157c90 legacy=0x7f35c40c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:28.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.604+0000 7f35bbfff640 1 -- 172.21.15.103:0/490576879 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c40c4820 con 0x7f35c40c9860 2024-09-10T08:45:28.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.605+0000 7f35bbfff640 1 --2- 172.21.15.103:0/490576879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c40c9860 0x7f35c4151930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009870 tx=0x7f35b402a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42f98d7c8f8ae6c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:28.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.605+0000 7f35bb7fe640 1 -- 172.21.15.103:0/490576879 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4037070 con 0x7f35c40c9860 2024-09-10T08:45:28.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.605+0000 7f35bb7fe640 1 -- 172.21.15.103:0/490576879 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f35b4032440 con 0x7f35c40c9860 2024-09-10T08:45:28.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.605+0000 7f35bb7fe640 1 -- 172.21.15.103:0/490576879 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4032830 con 0x7f35c40c9860 2024-09-10T08:45:28.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.606+0000 7f35cab4b640 1 -- 172.21.15.103:0/490576879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c40c9860 msgr2=0x7f35c4151930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:28.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.606+0000 7f35cab4b640 1 --2- 172.21.15.103:0/490576879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c40c9860 0x7f35c4151930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009870 tx=0x7f35b402a130 comp rx=0 tx=0).stop 2024-09-10T08:45:28.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.606+0000 7f35cab4b640 1 -- 172.21.15.103:0/490576879 shutdown_connections 2024-09-10T08:45:28.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.606+0000 7f35cab4b640 1 --2- 172.21.15.103:0/490576879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c40c9860 0x7f35c4151930 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.606+0000 7f35cab4b640 1 --2- 172.21.15.103:0/490576879 >> v2:172.21.15.154:3300/0 conn(0x7f35c41578b0 0x7f35c41513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.606+0000 7f35cab4b640 1 -- 172.21.15.103:0/490576879 >> 172.21.15.103:0/490576879 conn(0x7f35c40c6880 msgr2=0x7f35c40c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:28.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.606+0000 7f35cab4b640 1 -- 172.21.15.103:0/490576879 shutdown_connections 2024-09-10T08:45:28.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.606+0000 7f35cab4b640 1 -- 172.21.15.103:0/490576879 wait complete. 2024-09-10T08:45:28.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.607+0000 7f35cab4b640 1 Processor -- start 2024-09-10T08:45:28.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.607+0000 7f35cab4b640 1 -- start start 2024-09-10T08:45:28.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.608+0000 7f35cab4b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c40c9860 0x7f35c414cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.608+0000 7f35cab4b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c41578b0 0x7f35c41ed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.608+0000 7f35cab4b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35c4157c90 0x7f35c41edd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.608+0000 7f35cab4b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f35c40afeb0 con 0x7f35c4157c90 2024-09-10T08:45:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.608+0000 7f35cab4b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f35c40afd30 con 0x7f35c41578b0 2024-09-10T08:45:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.608+0000 7f35cab4b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f35c40c7550 con 0x7f35c40c9860 2024-09-10T08:45:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.608+0000 7f35c90e8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35c4157c90 0x7f35c41edd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.608+0000 7f35bbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c41578b0 0x7f35c41ed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.608+0000 7f35c88e7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c40c9860 0x7f35c414cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.608+0000 7f35c90e8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35c4157c90 0x7f35c41edd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56458/0 (socket says 172.21.15.103:56458) 2024-09-10T08:45:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.608+0000 7f35c90e8640 1 -- 172.21.15.103:0/4214701904 learned_addr learned my addr 172.21.15.103:0/4214701904 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:45:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.608+0000 7f35c90e8640 1 -- 172.21.15.103:0/4214701904 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c40c9860 msgr2=0x7f35c414cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.608+0000 7f35c90e8640 1 --2- 172.21.15.103:0/4214701904 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c40c9860 0x7f35c414cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.608+0000 7f35c90e8640 1 -- 172.21.15.103:0/4214701904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c41578b0 msgr2=0x7f35c41ed7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.608+0000 7f35c90e8640 1 --2- 172.21.15.103:0/4214701904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c41578b0 0x7f35c41ed7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.609+0000 7f35c90e8640 1 -- 172.21.15.103:0/4214701904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c41dd8b0 con 0x7f35c4157c90 2024-09-10T08:45:28.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.609+0000 7f35bbfff640 1 --2- 172.21.15.103:0/4214701904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c41578b0 0x7f35c41ed7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:45:28.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.609+0000 7f35c90e8640 1 --2- 172.21.15.103:0/4214701904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35c4157c90 0x7f35c41edd00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00c6b0 tx=0x7f35bc00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:28.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.609+0000 7f35b97fa640 1 -- 172.21.15.103:0/4214701904 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc003b70 con 0x7f35c4157c90 2024-09-10T08:45:28.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.609+0000 7f35b97fa640 1 -- 172.21.15.103:0/4214701904 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f35bc003d30 con 0x7f35c4157c90 2024-09-10T08:45:28.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.609+0000 7f35cab4b640 1 -- 172.21.15.103:0/4214701904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c41de030 con 0x7f35c4157c90 2024-09-10T08:45:28.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.609+0000 7f35b97fa640 1 -- 172.21.15.103:0/4214701904 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc005330 con 0x7f35c4157c90 2024-09-10T08:45:28.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.609+0000 7f35cab4b640 1 -- 172.21.15.103:0/4214701904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c414d330 con 0x7f35c4157c90 2024-09-10T08:45:28.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.610+0000 7f35cab4b640 1 -- 172.21.15.103:0/4214701904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35c41513f0 con 0x7f35c4157c90 2024-09-10T08:45:28.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.610+0000 7f35b97fa640 1 -- 172.21.15.103:0/4214701904 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f35bc0054d0 con 0x7f35c4157c90 2024-09-10T08:45:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.611+0000 7f35b97fa640 1 --2- 172.21.15.103:0/4214701904 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f35b006be30 0x7f35b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.611+0000 7f35c88e7640 1 --2- 172.21.15.103:0/4214701904 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f35b006be30 0x7f35b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.611+0000 7f35b97fa640 1 -- 172.21.15.103:0/4214701904 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5775+0+0 (secure 0 0 0) 0x7f35bc08ac70 con 0x7f35c4157c90 2024-09-10T08:45:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.611+0000 7f35c88e7640 1 --2- 172.21.15.103:0/4214701904 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f35b006be30 0x7f35b006e2f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f35c0009b40 tx=0x7f35c0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.616+0000 7f35b97fa640 1 -- 172.21.15.103:0/4214701904 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f35bc058f10 con 0x7f35c4157c90 2024-09-10T08:45:28.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.814+0000 7f35cab4b640 1 -- 172.21.15.103:0/4214701904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "b"} v 0) -- 0x7f35c40ab460 con 0x7f35c4157c90 2024-09-10T08:45:28.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.816+0000 7f35b97fa640 1 -- 172.21.15.103:0/4214701904 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "b"}]=0 b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) ==== 151+0+0 (secure 0 0 0) 0x7f35bc05d210 con 0x7f35c4157c90 2024-09-10T08:45:28.817 INFO:teuthology.orchestra.run.smithi103.stderr:b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T08:45:28.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.819+0000 7f35cab4b640 1 -- 172.21.15.103:0/4214701904 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f35b006be30 msgr2=0x7f35b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:28.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.819+0000 7f35cab4b640 1 --2- 172.21.15.103:0/4214701904 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f35b006be30 0x7f35b006e2f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f35c0009b40 tx=0x7f35c0009190 comp rx=0 tx=0).stop 2024-09-10T08:45:28.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.819+0000 7f35cab4b640 1 -- 172.21.15.103:0/4214701904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35c4157c90 msgr2=0x7f35c41edd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:28.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.819+0000 7f35cab4b640 1 --2- 172.21.15.103:0/4214701904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35c4157c90 0x7f35c41edd00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00c6b0 tx=0x7f35bc00cb70 comp rx=0 tx=0).stop 2024-09-10T08:45:28.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.819+0000 7f35cab4b640 1 -- 172.21.15.103:0/4214701904 shutdown_connections 2024-09-10T08:45:28.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.819+0000 7f35cab4b640 1 --2- 172.21.15.103:0/4214701904 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f35b006be30 0x7f35b006e2f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.819+0000 7f35cab4b640 1 --2- 172.21.15.103:0/4214701904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35c4157c90 0x7f35c41edd00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.819+0000 7f35cab4b640 1 --2- 172.21.15.103:0/4214701904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c41578b0 0x7f35c41ed7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.819+0000 7f35cab4b640 1 --2- 172.21.15.103:0/4214701904 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35c40c9860 0x7f35c414cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.819+0000 7f35cab4b640 1 -- 172.21.15.103:0/4214701904 >> 172.21.15.103:0/4214701904 conn(0x7f35c40c6880 msgr2=0x7f35c414aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:28.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.819+0000 7f35cab4b640 1 -- 172.21.15.103:0/4214701904 shutdown_connections 2024-09-10T08:45:28.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.819+0000 7f35cab4b640 1 -- 172.21.15.103:0/4214701904 wait complete. 2024-09-10T08:45:28.833 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm b --yes-i-really-mean-it 2024-09-10T08:45:28.859 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2024-09-10T08:45:28.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.934+0000 7fdd603d6640 1 Processor -- start 2024-09-10T08:45:28.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.934+0000 7fdd603d6640 1 -- start start 2024-09-10T08:45:28.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.934+0000 7fdd603d6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdd580c3df0 0x7fdd58070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:28.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.934+0000 7fdd603d6640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd581572b0 con 0x7fdd580c8d20 2024-09-10T08:45:28.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.934+0000 7fdd603d6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd581566a0 con 0x7fdd58153c50 2024-09-10T08:45:28.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.934+0000 7fdd603d6640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fdd58154030 con 0x7fdd580c3df0 2024-09-10T08:45:28.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.935+0000 7fdd5d971640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdd580c3df0 0x7fdd58070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:28.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.935+0000 7fdd5e973640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdd580c8d20 0x7fdd580c9190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:57724/0 (socket says 172.21.15.103:57724) 2024-09-10T08:45:28.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.935+0000 7fdd5e973640 1 -- 172.21.15.103:0/3549287819 learned_addr learned my addr 172.21.15.103:0/3549287819 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:45:28.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.935+0000 7fdd5d971640 1 -- 172.21.15.103:0/3549287819 >> v1:172.21.15.154:6789/0 conn(0x7fdd58153c50 legacy=0x7fdd580c30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:28.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.935+0000 7fdd5d971640 1 -- 172.21.15.103:0/3549287819 >> v1:172.21.15.103:6789/0 conn(0x7fdd580c8d20 legacy=0x7fdd580c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:28.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.935+0000 7fdd5d170640 1 -- 172.21.15.103:0/3549287819 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2788374208 0 0) 0x7fdd581572b0 con 0x7fdd580c8d20 2024-09-10T08:45:28.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.935+0000 7fdd5d971640 1 -- 172.21.15.103:0/3549287819 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd58156980 con 0x7fdd580c3df0 2024-09-10T08:45:28.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.935+0000 7fdd5d971640 1 --2- 172.21.15.103:0/3549287819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd580c3df0 0x7fdd58070800 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c0097a0 tx=0x7fdd4c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6abab1c86671ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:28.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.936+0000 7fdd5d170640 1 -- 172.21.15.103:0/3549287819 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c037070 con 0x7fdd580c3df0 2024-09-10T08:45:28.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.936+0000 7fdd5d170640 1 -- 172.21.15.103:0/3549287819 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fdd4c02ae50 con 0x7fdd580c3df0 2024-09-10T08:45:28.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.936+0000 7fdd5d170640 1 -- 172.21.15.103:0/3549287819 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c032680 con 0x7fdd580c3df0 2024-09-10T08:45:28.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.936+0000 7fdd603d6640 1 -- 172.21.15.103:0/3549287819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd580c3df0 msgr2=0x7fdd58070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:28.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.936+0000 7fdd603d6640 1 --2- 172.21.15.103:0/3549287819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd580c3df0 0x7fdd58070800 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c0097a0 tx=0x7fdd4c02a140 comp rx=0 tx=0).stop 2024-09-10T08:45:28.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.936+0000 7fdd603d6640 1 -- 172.21.15.103:0/3549287819 shutdown_connections 2024-09-10T08:45:28.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.936+0000 7fdd603d6640 1 --2- 172.21.15.103:0/3549287819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd580c3df0 0x7fdd58070800 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.936+0000 7fdd603d6640 1 -- 172.21.15.103:0/3549287819 >> 172.21.15.103:0/3549287819 conn(0x7fdd580aba20 msgr2=0x7fdd580abe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:28.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.936+0000 7fdd603d6640 1 -- 172.21.15.103:0/3549287819 shutdown_connections 2024-09-10T08:45:28.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.936+0000 7fdd603d6640 1 -- 172.21.15.103:0/3549287819 wait complete. 2024-09-10T08:45:28.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.937+0000 7fdd603d6640 1 Processor -- start 2024-09-10T08:45:28.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.937+0000 7fdd603d6640 1 -- start start 2024-09-10T08:45:28.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.938+0000 7fdd603d6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd580c3df0 0x7fdd581e0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:28.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.938+0000 7fdd603d6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd580c8d20 0x7fdd5814bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:28.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.938+0000 7fdd603d6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd58153c50 0x7fdd581ec200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:28.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.938+0000 7fdd603d6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdd58156350 con 0x7fdd58153c50 2024-09-10T08:45:28.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.938+0000 7fdd603d6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdd58156f40 con 0x7fdd580c8d20 2024-09-10T08:45:28.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.938+0000 7fdd603d6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fdd580c98a0 con 0x7fdd580c3df0 2024-09-10T08:45:28.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.938+0000 7fdd5e973640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd58153c50 0x7fdd581ec200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:28.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.938+0000 7fdd5e973640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd58153c50 0x7fdd581ec200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56500/0 (socket says 172.21.15.103:56500) 2024-09-10T08:45:28.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.938+0000 7fdd5e973640 1 -- 172.21.15.103:0/987686289 learned_addr learned my addr 172.21.15.103:0/987686289 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:45:28.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.938+0000 7fdd5d971640 1 --2- 172.21.15.103:0/987686289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd580c8d20 0x7fdd5814bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:28.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.938+0000 7fdd5e172640 1 --2- 172.21.15.103:0/987686289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd580c3df0 0x7fdd581e0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:28.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.938+0000 7fdd5e973640 1 -- 172.21.15.103:0/987686289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd580c3df0 msgr2=0x7fdd581e0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:28.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.938+0000 7fdd5e973640 1 --2- 172.21.15.103:0/987686289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd580c3df0 0x7fdd581e0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.938+0000 7fdd5e973640 1 -- 172.21.15.103:0/987686289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd580c8d20 msgr2=0x7fdd5814bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:28.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.938+0000 7fdd5e973640 1 --2- 172.21.15.103:0/987686289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd580c8d20 0x7fdd5814bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:28.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.938+0000 7fdd5e973640 1 -- 172.21.15.103:0/987686289 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd581ebd20 con 0x7fdd58153c50 2024-09-10T08:45:28.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.938+0000 7fdd5e172640 1 --2- 172.21.15.103:0/987686289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd580c3df0 0x7fdd581e0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:45:28.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.938+0000 7fdd5d971640 1 --2- 172.21.15.103:0/987686289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd580c8d20 0x7fdd5814bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:45:28.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.939+0000 7fdd5e973640 1 --2- 172.21.15.103:0/987686289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd58153c50 0x7fdd581ec200 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000c410 tx=0x7fdd5000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:28.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.939+0000 7fdd56ffd640 1 -- 172.21.15.103:0/987686289 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd500074e0 con 0x7fdd58153c50 2024-09-10T08:45:28.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.939+0000 7fdd56ffd640 1 -- 172.21.15.103:0/987686289 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fdd500047e0 con 0x7fdd58153c50 2024-09-10T08:45:28.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.939+0000 7fdd603d6640 1 -- 172.21.15.103:0/987686289 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd581e0ba0 con 0x7fdd58153c50 2024-09-10T08:45:28.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.939+0000 7fdd56ffd640 1 -- 172.21.15.103:0/987686289 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd50004bf0 con 0x7fdd58153c50 2024-09-10T08:45:28.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.939+0000 7fdd603d6640 1 -- 172.21.15.103:0/987686289 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd581efd30 con 0x7fdd58153c50 2024-09-10T08:45:28.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.940+0000 7fdd603d6640 1 -- 172.21.15.103:0/987686289 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd581ebef0 con 0x7fdd58153c50 2024-09-10T08:45:28.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.940+0000 7fdd56ffd640 1 -- 172.21.15.103:0/987686289 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd50011070 con 0x7fdd58153c50 2024-09-10T08:45:28.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.941+0000 7fdd56ffd640 1 --2- 172.21.15.103:0/987686289 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdd4406be30 0x7fdd4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:28.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.941+0000 7fdd5e172640 1 --2- 172.21.15.103:0/987686289 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdd4406be30 0x7fdd4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:28.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.941+0000 7fdd56ffd640 1 -- 172.21.15.103:0/987686289 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5861+0+0 (secure 0 0 0) 0x7fdd5008aa30 con 0x7fdd58153c50 2024-09-10T08:45:28.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.941+0000 7fdd5e172640 1 --2- 172.21.15.103:0/987686289 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdd4406be30 0x7fdd4406e2f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fdd581e2940 tx=0x7fdd48009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:28.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:28.945+0000 7fdd56ffd640 1 -- 172.21.15.103:0/987686289 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd5001a2b0 con 0x7fdd58153c50 2024-09-10T08:45:29.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.144+0000 7fdd603d6640 1 -- 172.21.15.103:0/987686289 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true} v 0) -- 0x7fdd58070800 con 0x7fdd58153c50 2024-09-10T08:45:29.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.817+0000 7fdd56ffd640 1 -- 172.21.15.103:0/987686289 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true}]=0 v15) ==== 99+0+0 (secure 0 0 0) 0x7fdd500593d0 con 0x7fdd58153c50 2024-09-10T08:45:29.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.820+0000 7fdd603d6640 1 -- 172.21.15.103:0/987686289 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdd4406be30 msgr2=0x7fdd4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:29.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.820+0000 7fdd603d6640 1 --2- 172.21.15.103:0/987686289 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdd4406be30 0x7fdd4406e2f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fdd581e2940 tx=0x7fdd48009040 comp rx=0 tx=0).stop 2024-09-10T08:45:29.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.820+0000 7fdd603d6640 1 -- 172.21.15.103:0/987686289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd58153c50 msgr2=0x7fdd581ec200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:29.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.820+0000 7fdd603d6640 1 --2- 172.21.15.103:0/987686289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd58153c50 0x7fdd581ec200 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000c410 tx=0x7fdd5000c8d0 comp rx=0 tx=0).stop 2024-09-10T08:45:29.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.820+0000 7fdd603d6640 1 -- 172.21.15.103:0/987686289 shutdown_connections 2024-09-10T08:45:29.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.820+0000 7fdd603d6640 1 --2- 172.21.15.103:0/987686289 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fdd4406be30 0x7fdd4406e2f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:29.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.820+0000 7fdd603d6640 1 --2- 172.21.15.103:0/987686289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd58153c50 0x7fdd581ec200 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:29.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.820+0000 7fdd603d6640 1 --2- 172.21.15.103:0/987686289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd580c8d20 0x7fdd5814bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:29.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.820+0000 7fdd603d6640 1 --2- 172.21.15.103:0/987686289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd580c3df0 0x7fdd581e0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:29.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.820+0000 7fdd603d6640 1 -- 172.21.15.103:0/987686289 >> 172.21.15.103:0/987686289 conn(0x7fdd580aba20 msgr2=0x7fdd5814c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:29.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.820+0000 7fdd603d6640 1 -- 172.21.15.103:0/987686289 shutdown_connections 2024-09-10T08:45:29.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.820+0000 7fdd603d6640 1 -- 172.21.15.103:0/987686289 wait complete. 2024-09-10T08:45:29.834 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_metadata b_metadata --yes-i-really-really-mean-it 2024-09-10T08:45:29.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.981+0000 7fde27ff6640 1 Processor -- start 2024-09-10T08:45:29.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.981+0000 7fde27ff6640 1 -- start start 2024-09-10T08:45:29.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.982+0000 7fde27ff6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fde20156290 0x7fde20156700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:29.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.982+0000 7fde27ff6640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde2006c480 con 0x7fde200c6960 2024-09-10T08:45:29.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.982+0000 7fde27ff6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde2006c760 con 0x7fde200684f0 2024-09-10T08:45:29.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.982+0000 7fde27ff6640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fde2006c230 con 0x7fde20156290 2024-09-10T08:45:29.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.982+0000 7fde26593640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fde20156290 0x7fde20156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:29.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.982+0000 7fde25d92640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fde200c6960 0x7fde200c9c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:57728/0 (socket says 172.21.15.103:57728) 2024-09-10T08:45:29.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.982+0000 7fde25d92640 1 -- 172.21.15.103:0/1898562860 learned_addr learned my addr 172.21.15.103:0/1898562860 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:45:29.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.982+0000 7fde26593640 1 -- 172.21.15.103:0/1898562860 >> v1:172.21.15.154:6789/0 conn(0x7fde200684f0 legacy=0x7fde201536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:29.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.983+0000 7fde26593640 1 -- 172.21.15.103:0/1898562860 >> v1:172.21.15.103:6789/0 conn(0x7fde200c6960 legacy=0x7fde200c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:29.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.983+0000 7fde24d90640 1 -- 172.21.15.103:0/1898562860 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1029323441 0 0) 0x7fde2006c480 con 0x7fde200c6960 2024-09-10T08:45:29.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.983+0000 7fde26593640 1 -- 172.21.15.103:0/1898562860 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2006ca40 con 0x7fde20156290 2024-09-10T08:45:29.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.983+0000 7fde26593640 1 --2- 172.21.15.103:0/1898562860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde20156290 0x7fde20156700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fde180097a0 tx=0x7fde1802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126f303239ce1aa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:29.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.983+0000 7fde24d90640 1 -- 172.21.15.103:0/1898562860 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18037070 con 0x7fde20156290 2024-09-10T08:45:29.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.983+0000 7fde24d90640 1 -- 172.21.15.103:0/1898562860 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fde1802adc0 con 0x7fde20156290 2024-09-10T08:45:29.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.983+0000 7fde24d90640 1 -- 172.21.15.103:0/1898562860 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18032680 con 0x7fde20156290 2024-09-10T08:45:29.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.984+0000 7fde27ff6640 1 -- 172.21.15.103:0/1898562860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde20156290 msgr2=0x7fde20156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:29.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.984+0000 7fde27ff6640 1 --2- 172.21.15.103:0/1898562860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde20156290 0x7fde20156700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fde180097a0 tx=0x7fde1802a0b0 comp rx=0 tx=0).stop 2024-09-10T08:45:29.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.984+0000 7fde27ff6640 1 -- 172.21.15.103:0/1898562860 shutdown_connections 2024-09-10T08:45:29.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.984+0000 7fde27ff6640 1 --2- 172.21.15.103:0/1898562860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde20156290 0x7fde20156700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:29.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.984+0000 7fde27ff6640 1 -- 172.21.15.103:0/1898562860 >> 172.21.15.103:0/1898562860 conn(0x7fde200c87f0 msgr2=0x7fde200c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:29.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.984+0000 7fde27ff6640 1 -- 172.21.15.103:0/1898562860 shutdown_connections 2024-09-10T08:45:29.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.984+0000 7fde27ff6640 1 -- 172.21.15.103:0/1898562860 wait complete. 2024-09-10T08:45:29.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.985+0000 7fde27ff6640 1 Processor -- start 2024-09-10T08:45:29.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.985+0000 7fde27ff6640 1 -- start start 2024-09-10T08:45:29.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.986+0000 7fde27ff6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde200684f0 0x7fde200b1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:29.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.986+0000 7fde27ff6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde200c6960 0x7fde201e0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:29.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.986+0000 7fde27ff6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde20156290 0x7fde200aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:29.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.986+0000 7fde27ff6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fde200c6d40 con 0x7fde20156290 2024-09-10T08:45:29.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.986+0000 7fde27ff6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fde2006cdb0 con 0x7fde200684f0 2024-09-10T08:45:29.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.986+0000 7fde27ff6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7fde200c6ec0 con 0x7fde200c6960 2024-09-10T08:45:29.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.986+0000 7fde26593640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde20156290 0x7fde200aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:29.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.986+0000 7fde26593640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde20156290 0x7fde200aedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56510/0 (socket says 172.21.15.103:56510) 2024-09-10T08:45:29.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.986+0000 7fde26593640 1 -- 172.21.15.103:0/2633169767 learned_addr learned my addr 172.21.15.103:0/2633169767 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:45:29.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.986+0000 7fde26593640 1 -- 172.21.15.103:0/2633169767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde200c6960 msgr2=0x7fde201e0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:29.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.986+0000 7fde25d92640 1 --2- 172.21.15.103:0/2633169767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde200684f0 0x7fde200b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:29.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.986+0000 7fde25591640 1 --2- 172.21.15.103:0/2633169767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde200c6960 0x7fde201e0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:29.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.986+0000 7fde26593640 1 --2- 172.21.15.103:0/2633169767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde200c6960 0x7fde201e0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:29.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.986+0000 7fde26593640 1 -- 172.21.15.103:0/2633169767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde200684f0 msgr2=0x7fde200b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:29.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.986+0000 7fde26593640 1 --2- 172.21.15.103:0/2633169767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde200684f0 0x7fde200b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:29.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.986+0000 7fde26593640 1 -- 172.21.15.103:0/2633169767 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde200b0b70 con 0x7fde20156290 2024-09-10T08:45:29.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.986+0000 7fde25d92640 1 --2- 172.21.15.103:0/2633169767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde200684f0 0x7fde200b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:45:29.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.986+0000 7fde25591640 1 --2- 172.21.15.103:0/2633169767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde200c6960 0x7fde201e0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:45:29.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.986+0000 7fde26593640 1 --2- 172.21.15.103:0/2633169767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde20156290 0x7fde200aedd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fde1802a0f0 tx=0x7fde180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:29.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.987+0000 7fde167fc640 1 -- 172.21.15.103:0/2633169767 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18037040 con 0x7fde20156290 2024-09-10T08:45:29.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.987+0000 7fde167fc640 1 -- 172.21.15.103:0/2633169767 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fde18042070 con 0x7fde20156290 2024-09-10T08:45:29.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.987+0000 7fde27ff6640 1 -- 172.21.15.103:0/2633169767 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde201ecc70 con 0x7fde20156290 2024-09-10T08:45:29.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.987+0000 7fde167fc640 1 -- 172.21.15.103:0/2633169767 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1803d660 con 0x7fde20156290 2024-09-10T08:45:29.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.987+0000 7fde27ff6640 1 -- 172.21.15.103:0/2633169767 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde201ecf50 con 0x7fde20156290 2024-09-10T08:45:29.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.988+0000 7fde27ff6640 1 -- 172.21.15.103:0/2633169767 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde20155450 con 0x7fde20156290 2024-09-10T08:45:29.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.988+0000 7fde167fc640 1 -- 172.21.15.103:0/2633169767 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde1803d800 con 0x7fde20156290 2024-09-10T08:45:29.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.989+0000 7fde167fc640 1 --2- 172.21.15.103:0/2633169767 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fde0406be30 0x7fde0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:29.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.989+0000 7fde25d92640 1 --2- 172.21.15.103:0/2633169767 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fde0406be30 0x7fde0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:29.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.989+0000 7fde167fc640 1 -- 172.21.15.103:0/2633169767 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5861+0+0 (secure 0 0 0) 0x7fde180ab510 con 0x7fde20156290 2024-09-10T08:45:29.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.989+0000 7fde25d92640 1 --2- 172.21.15.103:0/2633169767 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fde0406be30 0x7fde0406e2f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fde1c007fd0 tx=0x7fde1c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:29.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:29.993+0000 7fde167fc640 1 -- 172.21.15.103:0/2633169767 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fde20155450 con 0x7fde20156290 2024-09-10T08:45:30.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.160+0000 7fde27ff6640 1 -- 172.21.15.103:0/2633169767 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fde201536d0 con 0x7fde20156290 2024-09-10T08:45:30.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.824+0000 7fde167fc640 1 -- 172.21.15.103:0/2633169767 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'b_metadata' removed v32) ==== 166+0+0 (secure 0 0 0) 0x7fde18030e20 con 0x7fde20156290 2024-09-10T08:45:30.824 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'b_metadata' removed 2024-09-10T08:45:30.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.828+0000 7fde27ff6640 1 -- 172.21.15.103:0/2633169767 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fde0406be30 msgr2=0x7fde0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:30.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.828+0000 7fde27ff6640 1 --2- 172.21.15.103:0/2633169767 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fde0406be30 0x7fde0406e2f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fde1c007fd0 tx=0x7fde1c009040 comp rx=0 tx=0).stop 2024-09-10T08:45:30.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.828+0000 7fde27ff6640 1 -- 172.21.15.103:0/2633169767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde20156290 msgr2=0x7fde200aedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:30.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.828+0000 7fde27ff6640 1 --2- 172.21.15.103:0/2633169767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde20156290 0x7fde200aedd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fde1802a0f0 tx=0x7fde180046c0 comp rx=0 tx=0).stop 2024-09-10T08:45:30.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.830+0000 7fde27ff6640 1 -- 172.21.15.103:0/2633169767 shutdown_connections 2024-09-10T08:45:30.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.830+0000 7fde27ff6640 1 --2- 172.21.15.103:0/2633169767 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7fde0406be30 0x7fde0406e2f0 secure :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fde1c007fd0 tx=0x7fde1c009040 comp rx=0 tx=0).stop 2024-09-10T08:45:30.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.830+0000 7fde27ff6640 1 --2- 172.21.15.103:0/2633169767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde20156290 0x7fde200aedd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:30.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.830+0000 7fde27ff6640 1 --2- 172.21.15.103:0/2633169767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde200c6960 0x7fde201e0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:30.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.830+0000 7fde27ff6640 1 --2- 172.21.15.103:0/2633169767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde200684f0 0x7fde200b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:30.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.831+0000 7fde27ff6640 1 -- 172.21.15.103:0/2633169767 >> 172.21.15.103:0/2633169767 conn(0x7fde200c87f0 msgr2=0x7fde201566a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:30.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.831+0000 7fde27ff6640 1 -- 172.21.15.103:0/2633169767 shutdown_connections 2024-09-10T08:45:30.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.831+0000 7fde27ff6640 1 -- 172.21.15.103:0/2633169767 wait complete. 2024-09-10T08:45:30.851 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_data b_data --yes-i-really-really-mean-it 2024-09-10T08:45:30.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.957+0000 7f44ea36d640 1 Processor -- start 2024-09-10T08:45:30.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.957+0000 7f44ea36d640 1 -- start start 2024-09-10T08:45:30.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.958+0000 7f44ea36d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44e40c6a10 0x7f44e4070020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:30.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.958+0000 7f44ea36d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e40c8170 0x7f44e4160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:30.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.958+0000 7f44ea36d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44e40c4020 con 0x7f44e406fc40 2024-09-10T08:45:30.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.958+0000 7f44ea36d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f44e406e280 con 0x7f44e40c6a10 2024-09-10T08:45:30.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.958+0000 7f44ea36d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f44e40c8670 con 0x7f44e40c8170 2024-09-10T08:45:30.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.958+0000 7f44e890a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e40c8170 0x7f44e4160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:30.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.958+0000 7f44e37fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44e40c6a10 0x7f44e4070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:30.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.958+0000 7f44e3fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f44e406fc40 0x7f44e406bbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.103:42124/0 (socket says 172.21.15.103:42124) 2024-09-10T08:45:30.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.958+0000 7f44e890a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e40c8170 0x7f44e4160930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.103:52550/0 (socket says 172.21.15.103:52550) 2024-09-10T08:45:30.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.958+0000 7f44e37fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44e40c6a10 0x7f44e4070020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.103:49854/0 (socket says 172.21.15.103:49854) 2024-09-10T08:45:30.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.958+0000 7f44e3fff640 1 -- 172.21.15.103:0/3325904107 learned_addr learned my addr 172.21.15.103:0/3325904107 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-09-10T08:45:30.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.959+0000 7f44e890a640 1 -- 172.21.15.103:0/3325904107 >> v2:172.21.15.154:3300/0 conn(0x7f44e40c6a10 msgr2=0x7f44e4070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:45:30.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.959+0000 7f44e890a640 1 --2- 172.21.15.103:0/3325904107 >> v2:172.21.15.154:3300/0 conn(0x7f44e40c6a10 0x7f44e4070020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:30.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.959+0000 7f44e890a640 1 -- 172.21.15.103:0/3325904107 >> v1:172.21.15.154:6789/0 conn(0x7f44e406fc40 legacy=0x7f44e406bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:30.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.959+0000 7f44e890a640 1 -- 172.21.15.103:0/3325904107 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e40c74f0 con 0x7f44e40c8170 2024-09-10T08:45:30.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.959+0000 7f44e37fe640 1 --2- 172.21.15.103:0/3325904107 >> v2:172.21.15.154:3300/0 conn(0x7f44e40c6a10 0x7f44e4070020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:45:30.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.959+0000 7f44e890a640 1 --2- 172.21.15.103:0/3325904107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e40c8170 0x7f44e4160930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f44dc009d90 tx=0x7f44dc02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10073d0256503c51 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:30.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.960+0000 7f44e2ffd640 1 -- 172.21.15.103:0/3325904107 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc007740 con 0x7f44e40c8170 2024-09-10T08:45:30.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.960+0000 7f44e2ffd640 1 -- 172.21.15.103:0/3325904107 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f44dc0078e0 con 0x7f44e40c8170 2024-09-10T08:45:30.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.960+0000 7f44e2ffd640 1 -- 172.21.15.103:0/3325904107 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc007cd0 con 0x7f44e40c8170 2024-09-10T08:45:30.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.960+0000 7f44ea36d640 1 -- 172.21.15.103:0/3325904107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e40c8170 msgr2=0x7f44e4160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:30.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.960+0000 7f44ea36d640 1 --2- 172.21.15.103:0/3325904107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e40c8170 0x7f44e4160930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f44dc009d90 tx=0x7f44dc02a660 comp rx=0 tx=0).stop 2024-09-10T08:45:30.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.960+0000 7f44ea36d640 1 -- 172.21.15.103:0/3325904107 shutdown_connections 2024-09-10T08:45:30.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.960+0000 7f44ea36d640 1 --2- 172.21.15.103:0/3325904107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e40c8170 0x7f44e4160930 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:30.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.960+0000 7f44ea36d640 1 --2- 172.21.15.103:0/3325904107 >> v2:172.21.15.154:3300/0 conn(0x7f44e40c6a10 0x7f44e4070020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:30.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.960+0000 7f44ea36d640 1 -- 172.21.15.103:0/3325904107 >> 172.21.15.103:0/3325904107 conn(0x7f44e40c5580 msgr2=0x7f44e40c5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:30.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.960+0000 7f44ea36d640 1 -- 172.21.15.103:0/3325904107 shutdown_connections 2024-09-10T08:45:30.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.960+0000 7f44ea36d640 1 -- 172.21.15.103:0/3325904107 wait complete. 2024-09-10T08:45:30.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.961+0000 7f44ea36d640 1 Processor -- start 2024-09-10T08:45:30.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.962+0000 7f44ea36d640 1 -- start start 2024-09-10T08:45:30.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.962+0000 7f44ea36d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e406fc40 0x7f44e41e16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:30.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.962+0000 7f44ea36d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44e40c6a10 0x7f44e41e1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:30.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.962+0000 7f44ea36d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44e40c8170 0x7f44e41da5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:30.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.962+0000 7f44ea36d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f44e40a84c0 con 0x7f44e40c8170 2024-09-10T08:45:30.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.962+0000 7f44ea36d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f44e40c7ab0 con 0x7f44e40c6a10 2024-09-10T08:45:30.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.962+0000 7f44ea36d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 -- 0x7f44e40ab640 con 0x7f44e406fc40 2024-09-10T08:45:30.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.962+0000 7f44e890a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44e40c8170 0x7f44e41da5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:30.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.962+0000 7f44e890a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44e40c8170 0x7f44e41da5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56526/0 (socket says 172.21.15.103:56526) 2024-09-10T08:45:30.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.962+0000 7f44e890a640 1 -- 172.21.15.103:0/627613691 learned_addr learned my addr 172.21.15.103:0/627613691 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-10T08:45:30.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.963+0000 7f44e3fff640 1 --2- 172.21.15.103:0/627613691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e406fc40 0x7f44e41e16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:30.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.963+0000 7f44e37fe640 1 --2- 172.21.15.103:0/627613691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44e40c6a10 0x7f44e41e1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:30.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.963+0000 7f44e890a640 1 -- 172.21.15.103:0/627613691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e406fc40 msgr2=0x7f44e41e16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:30.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.963+0000 7f44e890a640 1 --2- 172.21.15.103:0/627613691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e406fc40 0x7f44e41e16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:30.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.963+0000 7f44e890a640 1 -- 172.21.15.103:0/627613691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44e40c6a10 msgr2=0x7f44e41e1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:30.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.963+0000 7f44e890a640 1 --2- 172.21.15.103:0/627613691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44e40c6a10 0x7f44e41e1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:30.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.963+0000 7f44e890a640 1 -- 172.21.15.103:0/627613691 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e41dfc70 con 0x7f44e40c8170 2024-09-10T08:45:30.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.963+0000 7f44e890a640 1 --2- 172.21.15.103:0/627613691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44e40c8170 0x7f44e41da5e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f44dc009eb0 tx=0x7f44dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:30.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.963+0000 7f44e0ff9640 1 -- 172.21.15.103:0/627613691 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc03f070 con 0x7f44e40c8170 2024-09-10T08:45:30.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.963+0000 7f44e0ff9640 1 -- 172.21.15.103:0/627613691 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f44dc031c40 con 0x7f44e40c8170 2024-09-10T08:45:30.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.963+0000 7f44ea36d640 1 -- 172.21.15.103:0/627613691 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e40ac9b0 con 0x7f44e40c8170 2024-09-10T08:45:30.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.963+0000 7f44e0ff9640 1 -- 172.21.15.103:0/627613691 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc009450 con 0x7f44e40c8170 2024-09-10T08:45:30.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.963+0000 7f44ea36d640 1 -- 172.21.15.103:0/627613691 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e40acf30 con 0x7f44e40c8170 2024-09-10T08:45:30.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.964+0000 7f44ea36d640 1 -- 172.21.15.103:0/627613691 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e406e710 con 0x7f44e40c8170 2024-09-10T08:45:30.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.964+0000 7f44e0ff9640 1 -- 172.21.15.103:0/627613691 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44dc043410 con 0x7f44e40c8170 2024-09-10T08:45:30.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.965+0000 7f44e0ff9640 1 --2- 172.21.15.103:0/627613691 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f44d006be30 0x7f44d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:45:30.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.965+0000 7f44e0ff9640 1 -- 172.21.15.103:0/627613691 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5433+0+0 (secure 0 0 0) 0x7f44dc0ac1f0 con 0x7f44e40c8170 2024-09-10T08:45:30.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.965+0000 7f44e3fff640 1 --2- 172.21.15.103:0/627613691 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f44d006be30 0x7f44d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:45:30.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.965+0000 7f44e3fff640 1 --2- 172.21.15.103:0/627613691 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f44d006be30 0x7f44d006e2f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f44d4000f60 tx=0x7f44d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:45:30.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:30.969+0000 7f44e0ff9640 1 -- 172.21.15.103:0/627613691 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f44dc07acb0 con 0x7f44e40c8170 2024-09-10T08:45:31.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:31.140+0000 7f44ea36d640 1 -- 172.21.15.103:0/627613691 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f44e4074270 con 0x7f44e40c8170 2024-09-10T08:45:31.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:31.831+0000 7f44e0ff9640 1 -- 172.21.15.103:0/627613691 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true}]=0 pool 'b_data' removed v33) ==== 154+0+0 (secure 0 0 0) 0x7f44dc07a5b0 con 0x7f44e40c8170 2024-09-10T08:45:31.832 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'b_data' removed 2024-09-10T08:45:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:31.834+0000 7f44ea36d640 1 -- 172.21.15.103:0/627613691 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f44d006be30 msgr2=0x7f44d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:31.834+0000 7f44ea36d640 1 --2- 172.21.15.103:0/627613691 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f44d006be30 0x7f44d006e2f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f44d4000f60 tx=0x7f44d4009040 comp rx=0 tx=0).stop 2024-09-10T08:45:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:31.834+0000 7f44ea36d640 1 -- 172.21.15.103:0/627613691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44e40c8170 msgr2=0x7f44e41da5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:45:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:31.834+0000 7f44ea36d640 1 --2- 172.21.15.103:0/627613691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44e40c8170 0x7f44e41da5e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f44dc009eb0 tx=0x7f44dc004a40 comp rx=0 tx=0).stop 2024-09-10T08:45:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:31.834+0000 7f44ea36d640 1 -- 172.21.15.103:0/627613691 shutdown_connections 2024-09-10T08:45:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:31.834+0000 7f44ea36d640 1 --2- 172.21.15.103:0/627613691 >> [v2:172.21.15.103:6832/2491184865,v1:172.21.15.103:6833/2491184865] conn(0x7f44d006be30 0x7f44d006e2f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:31.834+0000 7f44ea36d640 1 --2- 172.21.15.103:0/627613691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44e40c8170 0x7f44e41da5e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:31.834+0000 7f44ea36d640 1 --2- 172.21.15.103:0/627613691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44e40c6a10 0x7f44e41e1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:31.834+0000 7f44ea36d640 1 --2- 172.21.15.103:0/627613691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44e406fc40 0x7f44e41e16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:45:31.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:31.834+0000 7f44ea36d640 1 -- 172.21.15.103:0/627613691 >> 172.21.15.103:0/627613691 conn(0x7f44e40c5580 msgr2=0x7f44e40a8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:45:31.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:31.834+0000 7f44ea36d640 1 -- 172.21.15.103:0/627613691 shutdown_connections 2024-09-10T08:45:31.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-10T08:45:31.834+0000 7f44ea36d640 1 -- 172.21.15.103:0/627613691 wait complete. 2024-09-10T08:45:31.852 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-10T08:45:31.852 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T08:45:31.852 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:45:31.865 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T08:45:31.865 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T08:45:31.865 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:45:31.915 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T08:45:31.915 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T08:45:31.916 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:45:31.930 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T08:45:31.930 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T08:45:31.930 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:45:31.981 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T08:45:31.981 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-10T08:45:31.981 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-10T08:45:31.981 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:45:32.046 INFO:tasks.ceph.osd.0:Stopped 2024-09-10T08:45:32.046 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-10T08:45:32.047 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:45:32.116 INFO:tasks.ceph.osd.1:Stopped 2024-09-10T08:45:32.116 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-10T08:45:32.117 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:45:32.176 INFO:tasks.ceph.osd.2:Stopped 2024-09-10T08:45:32.176 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-10T08:45:32.177 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:45:32.252 INFO:tasks.ceph.osd.3:Stopped 2024-09-10T08:45:32.252 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-10T08:45:32.252 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:45:32.321 INFO:tasks.ceph.osd.4:Stopped 2024-09-10T08:45:32.321 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-10T08:45:32.321 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:45:32.400 INFO:tasks.ceph.osd.5:Stopped 2024-09-10T08:45:32.400 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-10T08:45:32.400 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:45:32.459 INFO:tasks.ceph.osd.6:Stopped 2024-09-10T08:45:32.459 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-10T08:45:32.460 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:45:32.524 INFO:tasks.ceph.osd.7:Stopped 2024-09-10T08:45:32.525 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-10T08:45:32.525 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-10T08:45:32.525 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:45:32.563 INFO:tasks.ceph.mgr.y:Stopped 2024-09-10T08:45:32.563 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-10T08:45:32.563 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:45:32.589 INFO:tasks.ceph.mgr.x:Stopped 2024-09-10T08:45:32.589 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-10T08:45:32.590 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T08:45:32.590 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:45:32.616 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T08:45:32.616 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T08:45:32.616 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:45:32.639 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T08:45:32.639 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T08:45:32.640 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:45:32.690 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T08:45:32.690 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-10T08:45:32.691 DEBUG:teuthology.orchestra.run.smithi103:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-10T08:45:32.772 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T08:45:32.772 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-10T08:45:33.175 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T08:45:33.175 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-10T08:45:33.319 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T08:45:33.320 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-10T08:45:33.409 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T08:45:33.482 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-10T08:45:33.606 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T08:45:33.606 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-10T08:45:34.066 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T08:45:34.066 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-10T08:45:34.173 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T08:45:34.174 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-10T08:45:34.269 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T08:45:34.269 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-10T08:45:34.376 INFO:tasks.ceph:Archiving mon data... 2024-09-10T08:45:34.378 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898918/data/mon.a.tgz 2024-09-10T08:45:34.378 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-09-10T08:45:34.411 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.06vUGzXiEs 2024-09-10T08:45:34.412 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.06vUGzXiEs 2024-09-10T08:45:34.601 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.06vUGzXiEs 2024-09-10T08:45:34.697 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.06vUGzXiEs is 496KB 2024-09-10T08:45:34.796 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.06vUGzXiEs 2024-09-10T08:45:34.812 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898918/data/mon.b.tgz 2024-09-10T08:45:34.812 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-09-10T08:45:34.840 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.j4v9caBhZo 2024-09-10T08:45:34.840 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.j4v9caBhZo 2024-09-10T08:45:35.018 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.j4v9caBhZo 2024-09-10T08:45:35.131 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.j4v9caBhZo is 504KB 2024-09-10T08:45:35.202 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.j4v9caBhZo 2024-09-10T08:45:35.217 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898918/data/mon.c.tgz 2024-09-10T08:45:35.217 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-09-10T08:45:35.271 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.PqjfIT2DMU 2024-09-10T08:45:35.271 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.PqjfIT2DMU 2024-09-10T08:45:35.278 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:45:35.280 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:45:35.429 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.PqjfIT2DMU 2024-09-10T08:45:35.514 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.PqjfIT2DMU is 504KB 2024-09-10T08:45:35.619 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.PqjfIT2DMU 2024-09-10T08:45:35.634 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-10T08:45:35.634 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T08:45:35.637 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T08:45:35.718 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T08:45:35.755 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T08:45:35.755 INFO:tasks.ceph:Archiving crash dumps... 2024-09-10T08:45:35.757 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898918/remote/smithi103/crash 2024-09-10T08:45:35.758 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T08:45:35.785 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898918/remote/smithi154/crash 2024-09-10T08:45:35.786 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T08:45:35.819 INFO:tasks.ceph:Shutting down logrotate 2024-09-10T08:45:35.819 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:45:35.829 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:45:35.910 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T08:45:35.935 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T08:45:35.961 INFO:tasks.ceph:Compressing logs... 2024-09-10T08:45:35.961 DEBUG:teuthology.orchestra.run.smithi103:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T08:45:35.978 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T08:45:36.049 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36447.log 2024-09-10T08:45:36.050 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-10T08:45:36.050 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36658.log 2024-09-10T08:45:36.050 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-10T08:45:36.050 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36658.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-10T08:45:36.050 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36698.log 2024-09-10T08:45:36.050 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T08:45:36.050 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42674.log 2024-09-10T08:45:36.050 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-10T08:45:36.050 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.1.42674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36567.log 2024-09-10T08:45:36.050 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36407.log 2024-09-10T08:45:36.050 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36527.log 2024-09-10T08:45:36.051 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36407.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-10T08:45:36.051 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36527.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-10T08:45:36.051 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T08:45:36.051 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-10T08:45:36.051 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-10T08:45:36.051 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36615.log 2024-09-10T08:45:36.051 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-10T08:45:36.051 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.36615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36487.log 2024-09-10T08:45:36.051 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.36487.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36447.log.gz 2024-09-10T08:45:36.052 INFO:teuthology.orchestra.run.smithi154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36407.log.gz 2024-09-10T08:45:36.052 INFO:teuthology.orchestra.run.smithi154.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36487.log.gz 2024-09-10T08:45:36.149 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-10T08:45:36.149 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90350.log 2024-09-10T08:45:36.150 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107091.log 2024-09-10T08:45:36.150 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.90350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108704.log 2024-09-10T08:45:36.150 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90350.log.gz 2024-09-10T08:45:36.150 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.107091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43630.log 2024-09-10T08:45:36.150 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.108704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51061.log 2024-09-10T08:45:36.150 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107091.log.gz 2024-09-10T08:45:36.150 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42170.log 2024-09-10T08:45:36.150 INFO:teuthology.orchestra.run.smithi103.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.108704.log.gz 2024-09-10T08:45:36.150 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52788.log 2024-09-10T08:45:36.150 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101288.log 2024-09-10T08:45:36.150 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43451.log 2024-09-10T08:45:36.150 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.101288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50355.log 2024-09-10T08:45:36.150 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47329.log 2024-09-10T08:45:36.151 INFO:teuthology.orchestra.run.smithi103.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.101288.log.gz 2024-09-10T08:45:36.151 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106258.log 2024-09-10T08:45:36.151 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46553.log 2024-09-10T08:45:36.151 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50355.log.gz 2024-09-10T08:45:36.151 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.106258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51745.log 2024-09-10T08:45:36.151 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46638.log 2024-09-10T08:45:36.151 INFO:teuthology.orchestra.run.smithi103.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.106258.log.gz 2024-09-10T08:45:36.151 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44242.log 2024-09-10T08:45:36.151 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50481.log 2024-09-10T08:45:36.151 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108986.log 2024-09-10T08:45:36.151 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64003.log 2024-09-10T08:45:36.151 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.108986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42901.log 2024-09-10T08:45:36.151 INFO:teuthology.orchestra.run.smithi103.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108986.log.gz 2024-09-10T08:45:36.152 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81261.log 2024-09-10T08:45:36.152 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50481.log.gz 2024-09-10T08:45:36.152 INFO:teuthology.orchestra.run.smithi103.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64003.log.gz 2024-09-10T08:45:36.152 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51331.log 2024-09-10T08:45:36.152 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.81261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42722.log 2024-09-10T08:45:36.152 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51331.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.81261.log.gz 2024-09-10T08:45:36.152 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107217.log 2024-09-10T08:45:36.152 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108115.log 2024-09-10T08:45:36.152 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.107217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42426.log 2024-09-10T08:45:36.152 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5%/var/log/ceph/ceph-client.admin.108115.log: -- replaced with /var/log/ceph/ceph-client.admin.107217.log.gz 2024-09-10T08:45:36.152 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53040.log 2024-09-10T08:45:36.152 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5%/var/log/ceph/ceph-client.admin.42426.log: -- replaced with /var/log/ceph/ceph-client.admin.108115.log.gz 2024-09-10T08:45:36.153 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36403.log 2024-09-10T08:45:36.153 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43632.log 2024-09-10T08:45:36.153 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103476.log 2024-09-10T08:45:36.153 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50565.log 2024-09-10T08:45:36.153 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.103476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93317.log 2024-09-10T08:45:36.153 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53124.log 2024-09-10T08:45:36.153 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103476.log.gz 2024-09-10T08:45:36.154 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.93317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108199.log 2024-09-10T08:45:36.154 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53124.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.93317.log.gz 2024-09-10T08:45:36.154 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86682.log 2024-09-10T08:45:36.154 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.108199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108746.log 2024-09-10T08:45:36.154 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.86682.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108199.log.gz 2024-09-10T08:45:36.154 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58631.log 2024-09-10T08:45:36.154 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.108746.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.86682.log.gz 2024-09-10T08:45:36.154 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60828.log 2024-09-10T08:45:36.154 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108746.log.gz 2024-09-10T08:45:36.154 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61740.log 2024-09-10T08:45:36.154 INFO:teuthology.orchestra.run.smithi103.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.58631.log.gz 2024-09-10T08:45:36.155 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57130.log 2024-09-10T08:45:36.155 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61740.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.60828.log.gz 2024-09-10T08:45:36.155 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41905.log 2024-09-10T08:45:36.155 INFO:teuthology.orchestra.run.smithi103.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61740.log.gz 2024-09-10T08:45:36.155 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.57130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74976.log 2024-09-10T08:45:36.155 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42086.log 2024-09-10T08:45:36.155 INFO:teuthology.orchestra.run.smithi103.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.57130.log.gz 2024-09-10T08:45:36.155 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.74976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46511.log 2024-09-10T08:45:36.155 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74976.log.gz 2024-09-10T08:45:36.155 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55606.log 2024-09-10T08:45:36.155 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46638.log.gz 2024-09-10T08:45:36.155 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83724.log 2024-09-10T08:45:36.155 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52494.log 2024-09-10T08:45:36.156 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.83724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50851.log 2024-09-10T08:45:36.156 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55606.log.gz 2024-09-10T08:45:36.156 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51493.log 87.5% 2024-09-10T08:45:36.156 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.83724.log.gz 2024-09-10T08:45:36.156 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53380.log 2024-09-10T08:45:36.156 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47736.log 2024-09-10T08:45:36.156 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54584.log 2024-09-10T08:45:36.156 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53632.log 2024-09-10T08:45:36.156 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60971.log 2024-09-10T08:45:36.156 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50851.log.gz 2024-09-10T08:45:36.156 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52257.log 2024-09-10T08:45:36.157 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96224.log 2024-09-10T08:45:36.157 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103677.log 2024-09-10T08:45:36.157 INFO:teuthology.orchestra.run.smithi103.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60971.log.gz 2024-09-10T08:45:36.157 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.96224.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-10T08:45:36.157 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.103677.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96224.log.gz 2024-09-10T08:45:36.157 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47329.log.gz 2024-09-10T08:45:36.157 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109381.log 2024-09-10T08:45:36.157 INFO:teuthology.orchestra.run.smithi103.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103677.log.gz 2024-09-10T08:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42678.log 2024-09-10T08:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.109381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43325.log 2024-09-10T08:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44879.log 2024-09-10T08:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109381.log.gz 2024-09-10T08:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.43325.log: /var/log/ceph/ceph-client.admin.107259.log 2024-09-10T08:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43956.log 2024-09-10T08:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.107259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51535.log 2024-09-10T08:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43956.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.107259.log.gz -5 2024-09-10T08:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51787.log 2024-09-10T08:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109652.log 2024-09-10T08:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107787.log 2024-09-10T08:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43617.log 2024-09-10T08:45:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.109652.log: /var/log/ceph/ceph-client.admin.107787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54155.log 2024-09-10T08:45:36.159 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109652.log.gz 2024-09-10T08:45:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68082.log 2024-09-10T08:45:36.159 INFO:teuthology.orchestra.run.smithi103.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.107787.log.gz 2024-09-10T08:45:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36033.log 2024-09-10T08:45:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53590.log 2024-09-10T08:45:36.159 INFO:teuthology.orchestra.run.smithi103.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68082.log.gz 2024-09-10T08:45:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103214.log 2024-09-10T08:45:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90964.log 2024-09-10T08:45:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.103214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105586.log 2024-09-10T08:45:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.90964.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103214.log.gz 2024-09-10T08:45:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44341.log 2024-09-10T08:45:36.159 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.90964.log.gz 2024-09-10T08:45:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.105586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53861.log 2024-09-10T08:45:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44341.log: gzip 90.5% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.105586.log.gz -- 2024-09-10T08:45:36.160 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.45812.log 2024-09-10T08:45:36.160 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86604.log 2024-09-10T08:45:36.160 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45812.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42170.log.gzgzip 2024-09-10T08:45:36.160 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44339.log 2024-09-10T08:45:36.160 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.86604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107655.log 2024-09-10T08:45:36.160 INFO:teuthology.orchestra.run.smithi103.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42426.log.gz 2024-09-10T08:45:36.160 INFO:teuthology.orchestra.run.smithi103.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42086.log.gz 2024-09-10T08:45:36.160 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58781.log 2024-09-10T08:45:36.160 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.86604.log.gz 2024-09-10T08:45:36.160 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100258.log 2024-09-10T08:45:36.160 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.107655.log: /var/log/ceph/ceph-client.admin.58781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103379.log 2024-09-10T08:45:36.160 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107655.log.gz 2024-09-10T08:45:36.160 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.100258.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.58781.log.gz -5 2024-09-10T08:45:36.161 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44243.log 2024-09-10T08:45:36.161 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.103379.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100258.log.gz 2024-09-10T08:45:36.161 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103571.log 2024-09-10T08:45:36.161 INFO:teuthology.orchestra.run.smithi103.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103379.log.gz 2024-09-10T08:45:36.161 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52704.log 2024-09-10T08:45:36.161 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.103571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43157.log 2024-09-10T08:45:36.161 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.103571.log.gz 2024-09-10T08:45:36.161 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108367.log 2024-09-10T08:45:36.161 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91402.log 2024-09-10T08:45:36.161 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.108367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52425.log 2024-09-10T08:45:36.161 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.91402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45652.log 2024-09-10T08:45:36.161 INFO:teuthology.orchestra.run.smithi103.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108367.log.gz 2024-09-10T08:45:36.161 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52425.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.91402.log.gz 2024-09-10T08:45:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43627.log 2024-09-10T08:45:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40810.log 2024-09-10T08:45:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84734.log 2024-09-10T08:45:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53422.log 2024-09-10T08:45:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.84734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53945.log 2024-09-10T08:45:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91302.log 2024-09-10T08:45:36.162 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.84734.log.gz 2024-09-10T08:45:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107729.log 2024-09-10T08:45:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.91302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42128.log 2024-09-10T08:45:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.107729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108325.log 2024-09-10T08:45:36.162 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.91302.log.gz 2024-09-10T08:45:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41947.log 2024-09-10T08:45:36.162 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107729.log.gz 2024-09-10T08:45:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.108325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43968.log 2024-09-10T08:45:36.163 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41947.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108325.log.gz 2024-09-10T08:45:36.163 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51247.log 2024-09-10T08:45:36.163 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47171.log 2024-09-10T08:45:36.163 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53296.log 2024-09-10T08:45:36.163 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41863.log 2024-09-10T08:45:36.163 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108493.log 2024-09-10T08:45:36.163 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108578.log 2024-09-10T08:45:36.163 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.108493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51956.log 2024-09-10T08:45:36.163 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108493.log.gz 2024-09-10T08:45:36.163 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.108578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54626.log 2024-09-10T08:45:36.163 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50253.log 2024-09-10T08:45:36.163 INFO:teuthology.orchestra.run.smithi103.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108578.log.gz 2024-09-10T08:45:36.163 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107133.log 2024-09-10T08:45:36.164 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76837.log 2024-09-10T08:45:36.164 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.107133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108788.log 2024-09-10T08:45:36.164 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107133.log.gz 2024-09-10T08:45:36.164 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.76837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52215.log 2024-09-10T08:45:36.164 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.108788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43620.log 2024-09-10T08:45:36.164 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.76837.log.gz 2024-09-10T08:45:36.164 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50439.log 2024-09-10T08:45:36.164 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108788.log.gz 2024-09-10T08:45:36.164 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45980.log 2024-09-10T08:45:36.164 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54892.log 2024-09-10T08:45:36.164 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76764.log 2024-09-10T08:45:36.164 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52578.log 2024-09-10T08:45:36.165 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51331.log.gz 2024-09-10T08:45:36.165 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.76764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107613.log 2024-09-10T08:45:36.165 INFO:teuthology.orchestra.run.smithi103.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.54892.log.gz 2024-09-10T08:45:36.165 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52578.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.76764.log.gz 2024-09-10T08:45:36.165 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108914.log 2024-09-10T08:45:36.165 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.107613.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T08:45:36.165 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8%/var/log/ceph/ceph-client.admin.108914.log: -- replaced with /var/log/ceph/ceph-client.admin.107613.log.gz 2024-09-10T08:45:36.165 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44645.log 2024-09-10T08:45:36.165 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108914.log.gz 2024-09-10T08:45:36.165 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55354.log 2024-09-10T08:45:36.165 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52134.log 2024-09-10T08:45:36.165 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51998.log 2024-09-10T08:45:36.165 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.52134.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55648.log 2024-09-10T08:45:36.165 INFO:teuthology.orchestra.run.smithi103.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.55354.log.gz 2024-09-10T08:45:36.166 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51163.log 2024-09-10T08:45:36.166 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76196.log 2024-09-10T08:45:36.166 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93080.log 2024-09-10T08:45:36.166 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55648.log.gz 2024-09-10T08:45:36.166 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.76196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108872.log 2024-09-10T08:45:36.166 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.93080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79888.log 2024-09-10T08:45:36.166 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36403.log.gz 2024-09-10T08:45:36.166 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.76196.log.gz 2024-09-10T08:45:36.166 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93080.log.gz 2024-09-10T08:45:36.166 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.108872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55732.log 2024-09-10T08:45:36.166 INFO:teuthology.orchestra.run.smithi103.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108872.log.gz 2024-09-10T08:45:36.166 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.79888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46404.log 2024-09-10T08:45:36.166 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55163.log 2024-09-10T08:45:36.167 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.79888.log.gz 2024-09-10T08:45:36.167 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43954.log 2024-09-10T08:45:36.167 INFO:teuthology.orchestra.run.smithi103.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.55732.log.gz 2024-09-10T08:45:36.167 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109110.log 2024-09-10T08:45:36.167 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43954.log: gzip 90.0% -- replaced with /var/log/ceph/ceph-client.admin.55163.log.gz -5 2024-09-10T08:45:36.167 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44603.log 2024-09-10T08:45:36.167 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.109110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50649.log 2024-09-10T08:45:36.167 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109110.log.gz 2024-09-10T08:45:36.167 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50313.log 2024-09-10T08:45:36.167 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50649.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46553.log.gz 2024-09-10T08:45:36.167 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107865.log 2024-09-10T08:45:36.167 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51451.log 2024-09-10T08:45:36.167 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.107865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41685.log 2024-09-10T08:45:36.168 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107865.log.gz 2024-09-10T08:45:36.168 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108535.log 2024-09-10T08:45:36.168 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54341.log 2024-09-10T08:45:36.168 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41685.log: /var/log/ceph/ceph-client.admin.108535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107403.log 2024-09-10T08:45:36.168 INFO:teuthology.orchestra.run.smithi103.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54584.log.gz 2024-09-10T08:45:36.168 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.108535.log.gz 2024-09-10T08:45:36.168 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53338.log 2024-09-10T08:45:36.168 INFO:teuthology.orchestra.run.smithi103.stderr: 89.8%/var/log/ceph/ceph-client.admin.54341.log: -- replaced with /var/log/ceph/ceph-client.admin.50439.log.gz 2024-09-10T08:45:36.168 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.107403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54752.log 2024-09-10T08:45:36.168 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107403.log.gz 2024-09-10T08:45:36.168 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46596.log 2024-09-10T08:45:36.168 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42035.log 2024-09-10T08:45:36.168 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54542.log 2024-09-10T08:45:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50211.log 2024-09-10T08:45:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42035.log: /var/log/ceph/ceph-client.admin.54542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81963.log 2024-09-10T08:45:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52299.log 2024-09-10T08:45:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.81963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109507.log 2024-09-10T08:45:36.169 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.81963.log.gz 2024-09-10T08:45:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100925.log 2024-09-10T08:45:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.109507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55690.log 2024-09-10T08:45:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.100925.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109507.log.gz 2024-09-10T08:45:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94790.log 2024-09-10T08:45:36.169 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100925.log.gz 2024-09-10T08:45:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54710.log 2024-09-10T08:45:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.94790.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55690.log.gz 2024-09-10T08:45:36.169 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55270.log 2024-09-10T08:45:36.169 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94790.log.gz 2024-09-10T08:45:36.170 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54113.log 2024-09-10T08:45:36.170 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73947.log 2024-09-10T08:45:36.170 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51121.log 2024-09-10T08:45:36.170 INFO:teuthology.orchestra.run.smithi103.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.55270.log.gz 2024-09-10T08:45:36.170 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53040.log.gz 2024-09-10T08:45:36.170 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5/var/log/ceph/ceph-client.admin.73947.log: --verbose -- /var/log/ceph/ceph-client.admin.81889.log 2024-09-10T08:45:36.170 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53124.log.gz 2024-09-10T08:45:36.170 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51121.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.73947.log.gz -5 2024-09-10T08:45:36.170 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.109152.log 2024-09-10T08:45:36.170 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44963.log 2024-09-10T08:45:36.170 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53380.log.gz 2024-09-10T08:45:36.170 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.81889.log: /var/log/ceph/ceph-client.admin.109152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58706.log 2024-09-10T08:45:36.170 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.81889.log.gz 2024-09-10T08:45:36.171 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44963.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109152.log.gz 2024-09-10T08:45:36.171 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84028.log 2024-09-10T08:45:36.171 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72126.log 2024-09-10T08:45:36.171 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.84028.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58706.log.gz 2024-09-10T08:45:36.171 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54934.log 2024-09-10T08:45:36.171 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.72126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52998.log 2024-09-10T08:45:36.171 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.84028.log.gz 2024-09-10T08:45:36.171 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54934.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72126.log.gz 2024-09-10T08:45:36.171 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109068.log 2024-09-10T08:45:36.171 INFO:teuthology.orchestra.run.smithi103.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54934.log.gz 2024-09-10T08:45:36.171 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42216.log 2024-09-10T08:45:36.171 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.109068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109297.log 2024-09-10T08:45:36.171 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109068.log.gz 2024-09-10T08:45:36.172 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53166.log 2024-09-10T08:45:36.172 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.109297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107010.log 2024-09-10T08:45:36.172 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.109297.log.gz 2024-09-10T08:45:36.172 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108662.log 2024-09-10T08:45:36.172 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.107010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42552.log 2024-09-10T08:45:36.172 INFO:teuthology.orchestra.run.smithi103.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.107010.log.gz 2024-09-10T08:45:36.172 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.108662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41781.log 2024-09-10T08:45:36.172 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51829.log 2024-09-10T08:45:36.172 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.108662.log.gz 2024-09-10T08:45:36.172 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51913.log 2024-09-10T08:45:36.172 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55396.log 2024-09-10T08:45:36.172 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51913.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-10T08:45:36.172 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109423.log 2024-09-10T08:45:36.173 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93500.log 2024-09-10T08:45:36.173 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55396.log.gz 2024-09-10T08:45:36.173 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.109423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55834.log 2024-09-10T08:45:36.173 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109423.log.gz 2024-09-10T08:45:36.173 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.93500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104945.log 2024-09-10T08:45:36.173 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43969.log 2024-09-10T08:45:36.173 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93500.log.gz 2024-09-10T08:45:36.173 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.104945.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55834.log.gz 2024-09-10T08:45:36.173 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48594.log 2024-09-10T08:45:36.173 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104945.log.gz 2024-09-10T08:45:36.173 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109339.log 2024-09-10T08:45:36.173 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51373.log 2024-09-10T08:45:36.173 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.109339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52383.log 2024-09-10T08:45:36.174 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109339.log.gz 2024-09-10T08:45:36.174 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108409.log 2024-09-10T08:45:36.174 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70141.log 2024-09-10T08:45:36.174 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.108409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64091.log 2024-09-10T08:45:36.174 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.70141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50523.log 2024-09-10T08:45:36.174 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108409.log.gz 2024-09-10T08:45:36.174 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.64091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94095.log 2024-09-10T08:45:36.174 INFO:teuthology.orchestra.run.smithi103.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.70141.log.gz 2024-09-10T08:45:36.174 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.64091.log.gz 2024-09-10T08:45:36.174 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55792.log 2024-09-10T08:45:36.174 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.94095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54071.log 2024-09-10T08:45:36.174 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55792.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94095.log.gz 2024-09-10T08:45:36.174 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108157.log 2024-09-10T08:45:36.174 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54071.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55792.log.gz 2024-09-10T08:45:36.175 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52536.log 2024-09-10T08:45:36.175 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.108157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52830.log 2024-09-10T08:45:36.175 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52536.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108157.log.gz 2024-09-10T08:45:36.175 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42342.log 2024-09-10T08:45:36.175 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74344.log 2024-09-10T08:45:36.175 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51871.log 2024-09-10T08:45:36.175 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.74344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46446.log 2024-09-10T08:45:36.175 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.74344.log.gz 2024-09-10T08:45:36.175 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54197.log 2024-09-10T08:45:36.175 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51871.log: /var/log/ceph/ceph-client.admin.46446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107571.log 2024-09-10T08:45:36.175 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109465.log 2024-09-10T08:45:36.175 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54197.log: /var/log/ceph/ceph-client.admin.107571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107487.log 2024-09-10T08:45:36.175 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.109465.log: gzip 89.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.107571.log.gz --verbose 2024-09-10T08:45:36.176 INFO:teuthology.orchestra.run.smithi103.stderr: -- /var/log/ceph/ceph-client.admin.55121.log 2024-09-10T08:45:36.176 INFO:teuthology.orchestra.run.smithi103.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109465.log.gz 2024-09-10T08:45:36.176 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.107487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74090.log 2024-09-10T08:45:36.176 INFO:teuthology.orchestra.run.smithi103.stderr:gzip 89.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.107487.log.gz -- 2024-09-10T08:45:36.176 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.42300.log 2024-09-10T08:45:36.176 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55121.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54155.log.gz 2024-09-10T08:45:36.176 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44561.log 2024-09-10T08:45:36.176 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.74090.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55121.log.gz 2024-09-10T08:45:36.176 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43631.log 2024-09-10T08:45:36.176 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.74090.log.gz 2024-09-10T08:45:36.176 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44561.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-10T08:45:36.176 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43199.log 2024-09-10T08:45:36.176 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53254.log 2024-09-10T08:45:36.177 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55312.log 2024-09-10T08:45:36.177 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45005.log 2024-09-10T08:45:36.177 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51703.log 2024-09-10T08:45:36.177 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55522.log 2024-09-10T08:45:36.177 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55312.log.gz 2024-09-10T08:45:36.177 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104296.log 2024-09-10T08:45:36.177 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52341.log 2024-09-10T08:45:36.177 INFO:teuthology.orchestra.run.smithi103.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.55522.log.gz 2024-09-10T08:45:36.177 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.104296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48696.log 2024-09-10T08:45:36.177 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46680.log 2024-09-10T08:45:36.177 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104296.log.gz 2024-09-10T08:45:36.177 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101391.log 2024-09-10T08:45:36.177 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51205.log 2024-09-10T08:45:36.178 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.101391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96147.log 2024-09-10T08:45:36.178 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72282.log 2024-09-10T08:45:36.178 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101391.log.gz 2024-09-10T08:45:36.178 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.96147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42989.log 2024-09-10T08:45:36.178 INFO:teuthology.orchestra.run.smithi103.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.52788.log.gz 2024-09-10T08:45:36.178 INFO:teuthology.orchestra.run.smithi103.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96147.log.gz 2024-09-10T08:45:36.178 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.72282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53819.log 2024-09-10T08:45:36.178 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42989.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.53861.log.gz 2024-09-10T08:45:36.178 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 89.5% --verbose -- replaced with /var/log/ceph/ceph-client.admin.72282.log.gz -- 2024-09-10T08:45:36.178 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.80532.log 2024-09-10T08:45:36.178 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53945.log.gz 2024-09-10T08:45:36.178 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46022.log 2024-09-10T08:45:36.178 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.80532.log: gzip -5 89.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.54626.log.gz 2024-09-10T08:45:36.179 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-osd.2.log 2024-09-10T08:45:36.179 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46022.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.80532.log.gz 2024-09-10T08:45:36.179 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107361.log 2024-09-10T08:45:36.179 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91205.log 2024-09-10T08:45:36.179 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.107361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107445.log 2024-09-10T08:45:36.179 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.91205.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107361.log.gz 2024-09-10T08:45:36.179 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42859.log 2024-09-10T08:45:36.179 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.107445.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.91205.log.gz 2024-09-10T08:45:36.179 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43115.log 2024-09-10T08:45:36.179 INFO:teuthology.orchestra.run.smithi103.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.107445.log.gz 2024-09-10T08:45:36.179 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101089.log 2024-09-10T08:45:36.179 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108031.log 2024-09-10T08:45:36.179 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.101089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58482.log 2024-09-10T08:45:36.180 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.108031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42947.log 2024-09-10T08:45:36.180 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.101089.log.gz 2024-09-10T08:45:36.180 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58482.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108031.log.gz 2024-09-10T08:45:36.180 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55036.log 2024-09-10T08:45:36.180 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.58482.log.gz 2024-09-10T08:45:36.180 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51577.log/var/log/ceph/ceph-client.admin.42947.log: 2024-09-10T08:45:36.180 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52662.log 2024-09-10T08:45:36.180 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51577.log: gzip 87.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.55036.log.gz -- 2024-09-10T08:45:36.180 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.46205.log 2024-09-10T08:45:36.180 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101198.log 2024-09-10T08:45:36.180 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45938.log 2024-09-10T08:45:36.180 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46205.log: /var/log/ceph/ceph-client.admin.101198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43633.log 2024-09-10T08:45:36.181 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45938.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.101198.log.gz 2024-09-10T08:45:36.181 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50893.log 2024-09-10T08:45:36.181 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53506.log 2024-09-10T08:45:36.181 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50893.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-10T08:45:36.181 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41991.log 2024-09-10T08:45:36.181 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43367.log 2024-09-10T08:45:36.181 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50935.log 2024-09-10T08:45:36.181 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108620.log 2024-09-10T08:45:36.181 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52040.log 2024-09-10T08:45:36.181 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.108620.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T08:45:36.181 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108620.log.gz 2024-09-10T08:45:36.181 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51661.log 2024-09-10T08:45:36.181 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50691.log 2024-09-10T08:45:36.182 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45770.log 2024-09-10T08:45:36.182 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54976.log 2024-09-10T08:45:36.182 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93238.log 2024-09-10T08:45:36.182 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53464.log 2024-09-10T08:45:36.182 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54976.log.gz 2024-09-10T08:45:36.182 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.93238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67394.log 2024-09-10T08:45:36.182 INFO:teuthology.orchestra.run.smithi103.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.93238.log.gz 2024-09-10T08:45:36.182 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.53464.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55228.log 2024-09-10T08:45:36.182 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.67394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44183.log 2024-09-10T08:45:36.182 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67394.log.gz 2024-09-10T08:45:36.182 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43073.log 2024-09-10T08:45:36.183 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46247.log 2024-09-10T08:45:36.183 INFO:teuthology.orchestra.run.smithi103.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55228.log.gz 2024-09-10T08:45:36.183 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51745.log.gz 2024-09-10T08:45:36.183 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99644.log 2024-09-10T08:45:36.183 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51787.log.gz 2024-09-10T08:45:36.183 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.46247.log: /var/log/ceph/ceph-client.admin.58856.log 2024-09-10T08:45:36.183 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52215.log.gz 2024-09-10T08:45:36.183 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.99644.log: 87.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T08:45:36.183 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107529.log 2024-09-10T08:45:36.184 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99644.log.gz 2024-09-10T08:45:36.184 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.58856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54850.log 2024-09-10T08:45:36.184 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52257.log.gz 2024-09-10T08:45:36.184 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.107529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54499.log 2024-09-10T08:45:36.184 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58856.log.gz 2024-09-10T08:45:36.184 INFO:teuthology.orchestra.run.smithi103.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53590.log.gz 2024-09-10T08:45:36.184 INFO:teuthology.orchestra.run.smithi103.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.107529.log.gz 2024-09-10T08:45:36.184 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109026.log 2024-09-10T08:45:36.184 INFO:teuthology.orchestra.run.smithi103.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.53632.log.gz 2024-09-10T08:45:36.184 INFO:teuthology.orchestra.run.smithi103.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.54341.log.gz 2024-09-10T08:45:36.184 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54499.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.54850.log.gz 2024-09-10T08:45:36.184 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81120.log 2024-09-10T08:45:36.185 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.109026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60895.log 2024-09-10T08:45:36.185 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109026.log.gz 2024-09-10T08:45:36.185 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.81120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62375.log 2024-09-10T08:45:36.185 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60895.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.81120.log.gz 2024-09-10T08:45:36.185 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109610.log 2024-09-10T08:45:36.185 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60895.log.gz 2024-09-10T08:45:36.185 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55564.log 2024-09-10T08:45:36.185 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62375.log.gz 2024-09-10T08:45:36.185 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.109610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45534.log 2024-09-10T08:45:36.185 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55564.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109610.log.gz 2024-09-10T08:45:36.185 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51619.log 2024-09-10T08:45:36.185 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55564.log.gz 2024-09-10T08:45:36.186 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.0.45534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43962.log 2024-09-10T08:45:36.186 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85362.log 2024-09-10T08:45:36.186 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56512.log 2024-09-10T08:45:36.186 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.85362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46331.log 2024-09-10T08:45:36.186 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.85362.log.gz 2024-09-10T08:45:36.186 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5/var/log/ceph/ceph-client.admin.56512.log: --verbose -- /var/log/ceph/ceph-client.admin.50127.log 2024-09-10T08:45:36.186 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46331.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56512.log.gz 2024-09-10T08:45:36.186 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108830.log 2024-09-10T08:45:36.186 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55438.log 2024-09-10T08:45:36.186 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41905.log.gz/var/log/ceph/ceph-client.admin.108830.log: 2024-09-10T08:45:36.186 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108241.log 2024-09-10T08:45:36.186 INFO:teuthology.orchestra.run.smithi103.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108830.log.gz 2024-09-10T08:45:36.186 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74260.log 2024-09-10T08:45:36.187 INFO:teuthology.orchestra.run.smithi103.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55438.log.gz 2024-09-10T08:45:36.187 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.108241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53693.log 2024-09-10T08:45:36.187 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108241.log.gz 2024-09-10T08:45:36.187 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.74260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42766.log 2024-09-10T08:45:36.187 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.74260.log.gz -- replaced with /var/log/ceph/ceph-client.admin.41685.log.gz 2024-09-10T08:45:36.187 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-10T08:45:36.187 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52956.log 2024-09-10T08:45:36.187 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53693.log: /var/log/ceph/ceph-client.admin.42766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53903.log 2024-09-10T08:45:36.187 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43031.log 2024-09-10T08:45:36.187 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85957.log 2024-09-10T08:45:36.187 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50770.log 2024-09-10T08:45:36.187 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.85957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53735.log 2024-09-10T08:45:36.187 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50770.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47736.log.gz 2024-09-10T08:45:36.188 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74178.log 2024-09-10T08:45:36.188 INFO:teuthology.orchestra.run.smithi103.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.85957.log.gz 2024-09-10T08:45:36.188 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62992.log 2024-09-10T08:45:36.188 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53735.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50565.log.gz 2024-09-10T08:45:36.188 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.74178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45728.log 2024-09-10T08:45:36.188 INFO:teuthology.orchestra.run.smithi103.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.74178.log.gz 2024-09-10T08:45:36.188 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.62992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47261.log 2024-09-10T08:45:36.188 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51019.log 2024-09-10T08:45:36.188 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47261.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.62992.log.gz 2024-09-10T08:45:36.188 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41781.log.gz 2024-09-10T08:45:36.188 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41863.log.gz 2024-09-10T08:45:36.188 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44921.log 2024-09-10T08:45:36.188 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46080.log 2024-09-10T08:45:36.189 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50607.log 2024-09-10T08:45:36.189 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81342.log 2024-09-10T08:45:36.189 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54752.log.gz 2024-09-10T08:45:36.189 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43241.log 2024-09-10T08:45:36.189 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50607.log: 89.1%/var/log/ceph/ceph-client.admin.81342.log: -- replaced with /var/log/ceph/ceph-client.admin.42128.log.gz 2024-09-10T08:45:36.189 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44241.log 2024-09-10T08:45:36.189 INFO:teuthology.orchestra.run.smithi103.stderr:gzip 91.4% -- replaced with /var/log/ceph/ceph-client.admin.81342.log.gz 2024-09-10T08:45:36.189 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose --/var/log/ceph/ceph-client.admin.43241.log: /var/log/ceph/ceph-client.admin.83950.log 2024-09-10T08:45:36.189 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50169.log 2024-09-10T08:45:36.189 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.83950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61053.log 2024-09-10T08:45:36.189 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42817.log 2024-09-10T08:45:36.189 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.83950.log.gz 2024-09-10T08:45:36.189 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.61053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54299.log 2024-09-10T08:45:36.190 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61053.log.gz 2024-09-10T08:45:36.190 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5/var/log/ceph/ceph-client.admin.42817.log: --verbose -- /var/log/ceph/ceph-client.admin.60679.log 2024-09-10T08:45:36.190 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44687.log 2024-09-10T08:45:36.190 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.60679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83879.log 2024-09-10T08:45:36.190 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43624.log 2024-09-10T08:45:36.190 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60679.log.gz 2024-09-10T08:45:36.190 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.83879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42594.log 2024-09-10T08:45:36.190 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43624.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.83879.log.gz 2024-09-10T08:45:36.190 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93391.log 2024-09-10T08:45:36.190 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41947.log.gz 2024-09-10T08:45:36.190 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41991.log.gz 2024-09-10T08:45:36.190 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44519.log 2024-09-10T08:45:36.191 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42594.log: /var/log/ceph/ceph-client.admin.93391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108283.log 2024-09-10T08:45:36.191 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.93391.log.gz 2024-09-10T08:45:36.191 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109194.log 2024-09-10T08:45:36.191 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44519.log: /var/log/ceph/ceph-client.admin.108283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54257.log 2024-09-10T08:45:36.191 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.109194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48654.log 2024-09-10T08:45:36.191 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108283.log.gz 2024-09-10T08:45:36.191 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109194.log.gz 2024-09-10T08:45:36.191 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75632.log 2024-09-10T08:45:36.191 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52620.log 2024-09-10T08:45:36.191 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.75632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48738.log 2024-09-10T08:45:36.191 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107301.log 2024-09-10T08:45:36.191 INFO:teuthology.orchestra.run.smithi103.stderr: 88.2% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.75632.log.gz -- replaced with /var/log/ceph/ceph-client.admin.46022.log.gz 2024-09-10T08:45:36.191 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-10T08:45:36.192 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.48738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36298.log 2024-09-10T08:45:36.192 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.107301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44771.log 2024-09-10T08:45:36.192 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107301.log.gz 2024-09-10T08:45:36.192 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50977.log 2024-09-10T08:45:36.192 INFO:teuthology.orchestra.run.smithi103.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.46247.log.gz 2024-09-10T08:45:36.192 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42468.log 2024-09-10T08:45:36.192 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42258.log 2024-09-10T08:45:36.192 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36033.log.gz 2024-09-10T08:45:36.192 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45854.log 2024-09-10T08:45:36.192 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47443.log 2024-09-10T08:45:36.192 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42384.log 2024-09-10T08:45:36.192 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53777.log 2024-09-10T08:45:36.192 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52746.log 2024-09-10T08:45:36.193 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51289.log 2024-09-10T08:45:36.193 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68741.log 2024-09-10T08:45:36.193 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.51289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108073.log 2024-09-10T08:45:36.193 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.68741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69417.log 2024-09-10T08:45:36.193 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5/var/log/ceph/ceph-client.admin.108073.log: --verbose -- /var/log/ceph/ceph-client.admin.44340.log 2024-09-10T08:45:36.193 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68741.log.gz 2024-09-10T08:45:36.193 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.69417.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108073.log.gz 2024-09-10T08:45:36.193 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53082.log 2024-09-10T08:45:36.193 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69417.log.gz 2024-09-10T08:45:36.193 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89740.log 2024-09-10T08:45:36.193 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45107.log 2024-09-10T08:45:36.193 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.89740.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.51205.log.gz 2024-09-10T08:45:36.193 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53987.log 2024-09-10T08:45:36.194 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51247.log.gz 2024-09-10T08:45:36.194 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.89740.log.gz 2024-09-10T08:45:36.194 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108451.log 2024-09-10T08:45:36.194 INFO:teuthology.orchestra.run.smithi103.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.52040.log.gz 2024-09-10T08:45:36.194 INFO:teuthology.orchestra.run.smithi103.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.51956.log.gz 2024-09-10T08:45:36.194 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53987.log: gzip 89.2% -5 --verbose -- /var/log/ceph/ceph-client.admin.52872.log 2024-09-10T08:45:36.194 INFO:teuthology.orchestra.run.smithi103.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52383.log.gz 2024-09-10T08:45:36.194 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52425.log.gz 2024-09-10T08:45:36.194 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.108451.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52494.log.gz 2024-09-10T08:45:36.194 INFO:teuthology.orchestra.run.smithi103.stderr: 90.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.52341.log.gz 2024-09-10T08:45:36.194 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50397.log 2024-09-10T08:45:36.194 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108451.log.gz 2024-09-10T08:45:36.195 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.52872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95489.log 2024-09-10T08:45:36.195 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.50397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107175.log 2024-09-10T08:45:36.195 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.95489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72352.log 2024-09-10T08:45:36.195 INFO:teuthology.orchestra.run.smithi103.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47171.log.gz 2024-09-10T08:45:36.195 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.107175.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30024.log 2024-09-10T08:45:36.195 INFO:teuthology.orchestra.run.smithi103.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.95489.log.gz 2024-09-10T08:45:36.195 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107175.log.gz 2024-09-10T08:45:36.195 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.72352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43960.log 2024-09-10T08:45:36.195 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72352.log.gz 2024-09-10T08:45:36.195 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91110.log 2024-09-10T08:45:36.195 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph.tmp-client.admin.30024.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30024.log.gz 2024-09-10T08:45:36.195 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84125.log 2024-09-10T08:45:36.195 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.91110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43964.log 2024-09-10T08:45:36.196 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.91110.log.gz 2024-09-10T08:45:36.196 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.84125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53548.log 2024-09-10T08:45:36.196 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43964.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.84125.log.gz 2024-09-10T08:45:36.196 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107907.log 2024-09-10T08:45:36.196 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.53548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43283.log 2024-09-10T08:45:36.196 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.107907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42636.log 2024-09-10T08:45:36.196 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43283.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107907.log.gz 2024-09-10T08:45:36.196 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43963.log 2024-09-10T08:45:36.196 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46162.log 2024-09-10T08:45:36.196 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54668.log 2024-09-10T08:45:36.196 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.46162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106363.log 2024-09-10T08:45:36.196 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54668.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-10T08:45:36.196 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.106363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109236.log 2024-09-10T08:45:36.197 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.3.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.106363.log.gz 2024-09-10T08:45:36.197 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-10T08:45:36.197 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.109236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46289.log 2024-09-10T08:45:36.197 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109236.log.gz 2024-09-10T08:45:36.197 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43409.log 2024-09-10T08:45:36.197 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.46289.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55480.log 2024-09-10T08:45:36.197 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44729.log 2024-09-10T08:45:36.197 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109559.log 2024-09-10T08:45:36.197 INFO:teuthology.orchestra.run.smithi103.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55480.log.gz 2024-09-10T08:45:36.197 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44338.log 2024-09-10T08:45:36.197 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.109559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42510.log 2024-09-10T08:45:36.197 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7%/var/log/ceph/ceph-client.admin.44338.log: -- replaced with /var/log/ceph/ceph-client.admin.109559.log.gz 2024-09-10T08:45:36.197 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54808.log 2024-09-10T08:45:36.198 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72210.log 2024-09-10T08:45:36.198 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55078.log 2024-09-10T08:45:36.198 INFO:teuthology.orchestra.run.smithi103.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54808.log.gz 2024-09-10T08:45:36.198 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.72210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47213.log 2024-09-10T08:45:36.198 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.55078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44813.log 2024-09-10T08:45:36.198 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72210.log.gz 2024-09-10T08:45:36.198 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.47213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45896.log 2024-09-10T08:45:36.198 INFO:teuthology.orchestra.run.smithi103.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.55078.log.gz 2024-09-10T08:45:36.198 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54457.log 2024-09-10T08:45:36.198 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.45896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54383.log 2024-09-10T08:45:36.198 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54029.log 2024-09-10T08:45:36.198 INFO:teuthology.orchestra.run.smithi103.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43630.log.gz 2024-09-10T08:45:36.198 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54383.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43632.log.gz 2024-09-10T08:45:36.199 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43617.log.gz 2024-09-10T08:45:36.199 INFO:teuthology.orchestra.run.smithi103.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43627.log.gz 2024-09-10T08:45:36.199 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43631.log.gz 2024-09-10T08:45:36.199 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43620.log.gz 2024-09-10T08:45:36.199 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.54029.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43954.log.gz 2024-09-10T08:45:36.199 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43956.log.gz 2024-09-10T08:45:36.199 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43968.log.gz 2024-09-10T08:45:36.199 INFO:teuthology.orchestra.run.smithi103.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47261.log.gz 2024-09-10T08:45:36.199 INFO:teuthology.orchestra.run.smithi103.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.50253.log.gz 2024-09-10T08:45:36.199 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54499.log.gz 2024-09-10T08:45:36.199 INFO:teuthology.orchestra.run.smithi103.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.52536.log.gz 2024-09-10T08:45:36.199 INFO:teuthology.orchestra.run.smithi103.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.52578.log.gz 2024-09-10T08:45:36.199 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53166.log.gz 2024-09-10T08:45:36.200 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42901.log.gz 2024-09-10T08:45:36.200 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43199.log.gz 2024-09-10T08:45:36.200 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43115.log.gz 2024-09-10T08:45:36.200 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43031.log.gz 2024-09-10T08:45:36.200 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43073.log.gz 2024-09-10T08:45:36.200 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43157.log.gz 2024-09-10T08:45:36.200 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53254.log.gz 2024-09-10T08:45:36.200 INFO:teuthology.orchestra.run.smithi103.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.53296.log.gz 2024-09-10T08:45:36.200 INFO:teuthology.orchestra.run.smithi103.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.53338.log.gz 2024-09-10T08:45:36.200 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53422.log.gz 2024-09-10T08:45:36.200 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40810.log.gz 2024-09-10T08:45:36.200 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50313.log.gz 2024-09-10T08:45:36.200 INFO:teuthology.orchestra.run.smithi103.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.54542.log.gz 2024-09-10T08:45:36.200 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52746.log.gz 2024-09-10T08:45:36.201 INFO:teuthology.orchestra.run.smithi103.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.52998.log.gz 2024-09-10T08:45:36.201 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50127.log.gz 2024-09-10T08:45:36.201 INFO:teuthology.orchestra.run.smithi103.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.50169.log.gz 2024-09-10T08:45:36.201 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50211.log.gz 2024-09-10T08:45:36.201 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% 89.8% -- replaced with /var/log/ceph/ceph-client.admin.53777.log.gz 2024-09-10T08:45:36.201 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53819.log.gz 2024-09-10T08:45:36.201 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54710.log.gz 2024-09-10T08:45:36.201 INFO:teuthology.orchestra.run.smithi103.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50977.log.gz 2024-09-10T08:45:36.201 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46511.log.gz 2024-09-10T08:45:36.201 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51871.log.gz 2024-09-10T08:45:36.201 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53464.log.gz 2024-09-10T08:45:36.201 INFO:teuthology.orchestra.run.smithi103.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52704.log.gz 2024-09-10T08:45:36.201 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53987.log.gz 2024-09-10T08:45:36.202 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54071.log.gz 2024-09-10T08:45:36.202 INFO:teuthology.orchestra.run.smithi103.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.54113.log.gz 2024-09-10T08:45:36.202 INFO:teuthology.orchestra.run.smithi103.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52830.log.gz 2024-09-10T08:45:36.202 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52872.log.gz 2024-09-10T08:45:36.202 INFO:teuthology.orchestra.run.smithi103.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.53548.log.gz 2024-09-10T08:45:36.202 INFO:teuthology.orchestra.run.smithi103.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.50607.log.gz 2024-09-10T08:45:36.202 INFO:teuthology.orchestra.run.smithi103.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.54383.log.gz 2024-09-10T08:45:36.202 INFO:teuthology.orchestra.run.smithi103.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48696.log.gz 2024-09-10T08:45:36.204 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36658.log.gz 2024-09-10T08:45:36.204 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36698.log.gz 2024-09-10T08:45:36.204 INFO:teuthology.orchestra.run.smithi154.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-10T08:45:36.204 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36567.log.gz 2024-09-10T08:45:36.204 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36615.log.gz 2024-09-10T08:45:36.204 INFO:teuthology.orchestra.run.smithi154.stderr: 92.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T08:45:36.211 INFO:teuthology.orchestra.run.smithi103.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51451.log.gz 2024-09-10T08:45:36.212 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51493.log.gz 2024-09-10T08:45:36.212 INFO:teuthology.orchestra.run.smithi103.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.51535.log.gz 2024-09-10T08:45:36.212 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51661.log.gz 2024-09-10T08:45:36.212 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42035.log.gz 2024-09-10T08:45:36.212 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42216.log.gz 2024-09-10T08:45:36.212 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42342.log.gz 2024-09-10T08:45:36.212 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42384.log.gz 2024-09-10T08:45:36.212 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44183.log.gz 2024-09-10T08:45:36.212 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44242.log.gz 2024-09-10T08:45:36.212 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44243.log.gz 2024-09-10T08:45:36.212 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44339.log.gz 2024-09-10T08:45:36.212 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44338.log.gz 2024-09-10T08:45:36.212 INFO:teuthology.orchestra.run.smithi103.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44241.log.gz 2024-09-10T08:45:36.213 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44341.log.gz 2024-09-10T08:45:36.213 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44645.log.gz 2024-09-10T08:45:36.213 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44340.log.gz 2024-09-10T08:45:36.213 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44729.log.gz 2024-09-10T08:45:36.213 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44687.log.gz -- replaced with /var/log/ceph/ceph-client.admin.44561.log.gz 2024-09-10T08:45:36.213 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-10T08:45:36.213 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44603.log.gz 2024-09-10T08:45:36.213 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44519.log.gz 2024-09-10T08:45:36.213 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44879.log.gz 2024-09-10T08:45:36.213 INFO:teuthology.orchestra.run.smithi103.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44921.log.gz 2024-09-10T08:45:36.213 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% 89.8% -- replaced with /var/log/ceph/ceph-client.admin.42552.log.gz -- replaced with /var/log/ceph/ceph-client.admin.42510.log.gz 2024-09-10T08:45:36.213 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-10T08:45:36.214 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42989.log.gz 2024-09-10T08:45:36.214 INFO:teuthology.orchestra.run.smithi103.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43241.log.gz 2024-09-10T08:45:36.214 INFO:teuthology.orchestra.run.smithi103.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46080.log.gz 2024-09-10T08:45:36.214 INFO:teuthology.orchestra.run.smithi103.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46205.log.gz 2024-09-10T08:45:36.214 INFO:teuthology.orchestra.run.smithi103.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53506.log.gz 2024-09-10T08:45:36.214 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54029.log.gz 2024-09-10T08:45:36.214 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51998.log.gz 2024-09-10T08:45:36.214 INFO:teuthology.orchestra.run.smithi103.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44771.log.gz 2024-09-10T08:45:36.214 INFO:teuthology.orchestra.run.smithi103.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.54299.log.gz 2024-09-10T08:45:36.214 INFO:teuthology.orchestra.run.smithi103.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44813.log.gz 2024-09-10T08:45:36.214 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50523.log.gz 2024-09-10T08:45:36.214 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51373.log.gz 2024-09-10T08:45:36.214 INFO:teuthology.orchestra.run.smithi103.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52620.log.gz 2024-09-10T08:45:36.214 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54197.log.gz 2024-09-10T08:45:36.215 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52134.log.gz 2024-09-10T08:45:36.215 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52956.log.gz 2024-09-10T08:45:36.215 INFO:teuthology.orchestra.run.smithi103.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.53903.log.gz 2024-09-10T08:45:36.215 INFO:teuthology.orchestra.run.smithi103.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.54668.log.gz 2024-09-10T08:45:36.215 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50935.log.gz 2024-09-10T08:45:36.215 INFO:teuthology.orchestra.run.smithi103.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.50893.log.gz 2024-09-10T08:45:36.215 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51019.log.gz 2024-09-10T08:45:36.215 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48738.log.gz 2024-09-10T08:45:36.215 INFO:teuthology.orchestra.run.smithi103.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50397.log.gz 2024-09-10T08:45:36.215 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50770.log.gz 2024-09-10T08:45:36.215 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51829.log.gz 2024-09-10T08:45:36.215 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54457.log.gz 2024-09-10T08:45:36.215 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53693.log.gz 2024-09-10T08:45:36.216 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53735.log.gz 2024-09-10T08:45:36.216 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42817.log.gz 2024-09-10T08:45:36.216 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43624.log.gz 2024-09-10T08:45:36.216 INFO:teuthology.orchestra.run.smithi103.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43633.log.gz 2024-09-10T08:45:36.216 INFO:teuthology.orchestra.run.smithi103.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47443.log.gz 2024-09-10T08:45:36.216 INFO:teuthology.orchestra.run.smithi103.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48594.log.gz 2024-09-10T08:45:36.216 INFO:teuthology.orchestra.run.smithi103.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.48654.log.gz 2024-09-10T08:45:36.216 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50649.log.gz 2024-09-10T08:45:36.216 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51619.log.gz 2024-09-10T08:45:36.216 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50691.log.gz -- replaced with /var/log/ceph/ceph-client.admin.51577.log.gz 2024-09-10T08:45:36.216 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-10T08:45:36.216 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52662.log.gz 2024-09-10T08:45:36.216 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43960.log.gz 2024-09-10T08:45:36.217 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43964.log.gz 2024-09-10T08:45:36.217 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43963.log.gz 2024-09-10T08:45:36.217 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43962.log.gz 2024-09-10T08:45:36.217 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43283.log.gz 2024-09-10T08:45:36.217 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52299.log.gz 2024-09-10T08:45:36.217 INFO:teuthology.orchestra.run.smithi103.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43969.log.gz 2024-09-10T08:45:36.217 INFO:teuthology.orchestra.run.smithi103.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51121.log.gz 2024-09-10T08:45:36.217 INFO:teuthology.orchestra.run.smithi103.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.51163.log.gz 2024-09-10T08:45:36.217 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51061.log.gz 2024-09-10T08:45:36.217 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42258.log.gz 2024-09-10T08:45:36.217 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42859.log.gz 2024-09-10T08:45:36.217 INFO:teuthology.orchestra.run.smithi103.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42947.log.gz 2024-09-10T08:45:36.217 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46162.log.gz 2024-09-10T08:45:36.218 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47213.log.gz 2024-09-10T08:45:36.218 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51913.log.gz 2024-09-10T08:45:36.218 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53082.log.gz 2024-09-10T08:45:36.218 INFO:teuthology.orchestra.run.smithi103.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.51289.log.gz 2024-09-10T08:45:36.218 INFO:teuthology.orchestra.run.smithi103.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.46596.log.gz 2024-09-10T08:45:36.218 INFO:teuthology.orchestra.run.smithi103.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51703.log.gz 2024-09-10T08:45:36.218 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42468.log.gz 2024-09-10T08:45:36.218 INFO:teuthology.orchestra.run.smithi103.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.46289.log.gz 2024-09-10T08:45:36.218 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36527.log.gz 2024-09-10T08:45:36.229 INFO:teuthology.orchestra.run.smithi103.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42636.log.gz 2024-09-10T08:45:36.230 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42300.log.gz 2024-09-10T08:45:36.230 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42594.log.gz -- replaced with /var/log/ceph/ceph-client.admin.42678.log.gz 2024-09-10T08:45:36.230 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-10T08:45:36.230 INFO:teuthology.orchestra.run.smithi103.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42722.log.gz 2024-09-10T08:45:36.230 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42766.log.gz 2024-09-10T08:45:36.232 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44963.log.gz 2024-09-10T08:45:36.232 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45107.log.gz 2024-09-10T08:45:36.232 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45652.log.gz 2024-09-10T08:45:36.232 INFO:teuthology.orchestra.run.smithi103.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45728.log.gz 2024-09-10T08:45:36.232 INFO:teuthology.orchestra.run.smithi103.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45005.log.gz 2024-09-10T08:45:36.232 INFO:teuthology.orchestra.run.smithi103.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45770.log.gz 2024-09-10T08:45:36.232 INFO:teuthology.orchestra.run.smithi103.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45812.log.gz 2024-09-10T08:45:36.232 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45854.log.gz 2024-09-10T08:45:36.232 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45896.log.gz 2024-09-10T08:45:36.232 INFO:teuthology.orchestra.run.smithi103.stderr: 89.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T08:45:36.232 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45980.log.gz -- replaced with /var/log/ceph/ceph-client.admin.45938.log.gz 2024-09-10T08:45:36.233 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-10T08:45:36.233 INFO:teuthology.orchestra.run.smithi103.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.46331.log.gz 2024-09-10T08:45:36.233 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46404.log.gz 2024-09-10T08:45:36.233 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46446.log.gz 2024-09-10T08:45:36.236 INFO:teuthology.orchestra.run.smithi103.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36298.log.gz 2024-09-10T08:45:36.249 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43325.log.gz 2024-09-10T08:45:36.249 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43367.log.gz 2024-09-10T08:45:36.249 INFO:teuthology.orchestra.run.smithi103.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43409.log.gz 2024-09-10T08:45:36.250 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43451.log.gz 2024-09-10T08:45:36.253 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46680.log.gz 2024-09-10T08:45:36.269 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54257.log.gz 2024-09-10T08:45:36.444 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-10T08:45:36.998 INFO:teuthology.orchestra.run.smithi154.stderr: 94.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T08:45:37.000 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-10T08:45:39.498 INFO:teuthology.orchestra.run.smithi154.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-10T08:45:39.642 INFO:teuthology.orchestra.run.smithi154.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-10T08:45:40.050 INFO:teuthology.orchestra.run.smithi103.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-10T08:45:44.852 INFO:teuthology.orchestra.run.smithi103.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-10T08:46:00.500 INFO:teuthology.orchestra.run.smithi154.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-10T08:46:02.623 INFO:teuthology.orchestra.run.smithi103.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-10T08:46:03.423 INFO:teuthology.orchestra.run.smithi103.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-10T08:46:04.271 INFO:teuthology.orchestra.run.smithi103.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-10T08:46:10.584 INFO:teuthology.orchestra.run.smithi103.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-10T08:46:11.147 INFO:teuthology.orchestra.run.smithi154.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-10T08:46:11.307 INFO:teuthology.orchestra.run.smithi103.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-10T08:46:12.868 INFO:teuthology.orchestra.run.smithi154.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-10T08:46:18.671 INFO:teuthology.orchestra.run.smithi154.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-10T08:46:29.584 INFO:teuthology.orchestra.run.smithi103.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-10T08:48:22.751 INFO:teuthology.orchestra.run.smithi154.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.1.42674.log.gz 2024-09-10T08:48:22.752 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-09-10T08:48:22.753 INFO:teuthology.orchestra.run.smithi154.stderr:real 2m46.736s 2024-09-10T08:48:22.753 INFO:teuthology.orchestra.run.smithi154.stderr:user 4m8.696s 2024-09-10T08:48:22.753 INFO:teuthology.orchestra.run.smithi154.stderr:sys 0m11.082s 2024-09-10T08:48:40.656 INFO:teuthology.orchestra.run.smithi103.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.0.45534.log.gz 2024-09-10T08:48:40.658 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-10T08:48:40.658 INFO:teuthology.orchestra.run.smithi103.stderr:real 3m4.667s 2024-09-10T08:48:40.659 INFO:teuthology.orchestra.run.smithi103.stderr:user 4m13.269s 2024-09-10T08:48:40.659 INFO:teuthology.orchestra.run.smithi103.stderr:sys 0m11.053s 2024-09-10T08:48:40.659 INFO:tasks.ceph:Archiving logs... 2024-09-10T08:48:40.659 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898918/remote/smithi103/log 2024-09-10T08:48:40.660 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T08:49:14.901 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898918/remote/smithi154/log 2024-09-10T08:49:14.902 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T08:49:46.845 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T08:49:46.857 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T08:49:46.858 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T08:49:46.861 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T08:49:46.948 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T08:49:46.957 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T08:49:46.958 DEBUG:teuthology.orchestra.run.smithi103:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T08:49:46.960 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T08:49:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-09-10T08:49:46.978 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-09-10T08:49:47.026 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T08:49:47.026 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-09-10T08:49:47.026 INFO:teuthology.orchestra.run.smithi154.stdout:^* hv01.front.sepia.ceph.com 3 6 377 20 +898us[ +867us] +/- 39ms 2024-09-10T08:49:47.026 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 17 +1672us[+1672us] +/- 61ms 2024-09-10T08:49:47.026 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 -4215us[-4215us] +/- 87ms 2024-09-10T08:49:47.026 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:49:47.207 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T08:49:47.207 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-09-10T08:49:47.207 INFO:teuthology.orchestra.run.smithi103.stdout:^* hv01.front.sepia.ceph.com 3 6 377 20 +839us[ +863us] +/- 39ms 2024-09-10T08:49:47.207 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 21 +1639us[+1663us] +/- 61ms 2024-09-10T08:49:47.207 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 -4267us[-4267us] +/- 87ms 2024-09-10T08:49:47.207 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:49:47.209 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T08:49:47.222 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T08:49:47.223 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T08:49:47.242 DEBUG:teuthology.orchestra.run.smithi103:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T08:49:47.396 DEBUG:teuthology.orchestra.run.smithi154:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T08:49:47.513 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T08:49:47.546 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:49:47.547 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T08:49:47.578 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:49:47.579 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T08:49:47.596 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T08:49:47.635 INFO:teuthology.task.internal:Duration was 1672.952001 seconds 2024-09-10T08:49:47.636 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T08:49:47.668 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T08:49:47.669 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T08:49:47.672 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T08:49:47.734 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T08:49:47.738 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T08:49:48.200 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T08:49:48.201 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi103.front.sepia.ceph.com 2024-09-10T08:49:48.201 DEBUG:teuthology.orchestra.run.smithi103:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T08:49:48.225 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T08:49:48.225 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T08:49:48.259 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T08:49:48.259 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T08:49:48.268 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T08:49:48.327 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T08:49:48.328 DEBUG:teuthology.orchestra.run.smithi103:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T08:49:48.339 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T08:49:48.486 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T08:49:48.498 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T08:49:48.498 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T08:49:48.541 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T08:49:48.580 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T08:49:48.590 DEBUG:teuthology.orchestra.run.smithi103:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:49:48.593 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:49:48.631 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = core 2024-09-10T08:49:48.659 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2024-09-10T08:49:48.676 DEBUG:teuthology.orchestra.run.smithi103:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:49:48.699 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:49:48.699 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:49:48.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:49:48.730 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T08:49:48.741 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T08:49:48.742 DEBUG:teuthology.misc:Transferring archived files from smithi103:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898918/remote/smithi103 2024-09-10T08:49:48.742 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T08:49:48.777 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898918/remote/smithi154 2024-09-10T08:49:48.777 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T08:49:48.811 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T08:49:48.811 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T08:49:48.814 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T08:49:48.861 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T08:49:48.875 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T08:49:48.875 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T08:49:48.903 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T08:49:48.903 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T08:49:48.906 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T08:49:48.919 INFO:teuthology.orchestra.run.smithi103.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 08:49 /home/ubuntu/cephtest 2024-09-10T08:49:48.921 INFO:teuthology.orchestra.run.smithi154.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 08:49 /home/ubuntu/cephtest 2024-09-10T08:49:48.922 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T08:49:48.933 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T08:49:49.008 INFO:teuthology.run:Summary data: description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} duration: 1672.952000617981 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-10T08:49:49.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T08:49:49.096 INFO:teuthology.run:pass